2024-09-12T17:12:42.942 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T17:12:42.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T17:12:43.056 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902725 branch: wip-rgw-meta-handlers description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7902725' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b rgw: compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: false frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 6279 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNN8MMYM+SHieaJjUTKt+7+2HLdFqlQG4dk6wgKEWy8VaUd5tcHcv8JhOV+Owo/NeNKDtKa+QNVr4+Am8WRoEoM= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF14u2/znr3Zs5f0S9E4U6z8alr9fOk1uQ+CbQr1vD74hW+BmBYSPhaSvrStVQJKcD1Gje+JqYbRHo39rg6iNrE= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_15:39:52 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T17:12:43.056 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-12T17:12:43.057 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-12T17:12:43.057 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T17:12:43.059 INFO:teuthology.task.internal:Checking packages... 2024-09-12T17:12:43.081 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-12T17:12:43.081 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T17:12:43.081 INFO:teuthology.packaging:ref: None 2024-09-12T17:12:43.081 INFO:teuthology.packaging:tag: None 2024-09-12T17:12:43.082 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-12T17:12:43.082 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:12:43.082 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-12T17:12:43.229 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762.gbad475c1 2024-09-12T17:12:43.230 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T17:12:43.236 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T17:12:43.237 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T17:12:43.244 INFO:teuthology.task.internal:Saving configuration 2024-09-12T17:12:43.269 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T17:12:43.276 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T17:12:43.302 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902725', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:07:48.051677', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNN8MMYM+SHieaJjUTKt+7+2HLdFqlQG4dk6wgKEWy8VaUd5tcHcv8JhOV+Owo/NeNKDtKa+QNVr4+Am8WRoEoM='} 2024-09-12T17:12:43.326 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902725', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:07:48.053672', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF14u2/znr3Zs5f0S9E4U6z8alr9fOk1uQ+CbQr1vD74hW+BmBYSPhaSvrStVQJKcD1Gje+JqYbRHo39rg6iNrE='} 2024-09-12T17:12:43.326 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T17:12:43.332 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T17:12:43.332 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T17:12:43.333 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T17:12:43.396 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd9a1403ac0>, signals=[15]) 2024-09-12T17:12:43.396 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T17:12:43.402 INFO:teuthology.task.internal:Opening connections... 2024-09-12T17:12:43.402 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-09-12T17:12:43.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:12:43.482 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T17:12:43.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:12:43.555 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T17:12:43.562 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-09-12T17:12:43.580 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-09-12T17:12:43.581 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-09-12T17:12:43.638 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-09-12T17:12:43.638 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-09-12T17:12:43.639 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-09-12T17:12:43.639 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-09-12T17:12:43.639 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-09-12T17:12:43.639 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-09-12T17:12:43.639 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T17:12:43.639 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-09-12T17:12:43.639 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-09-12T17:12:43.639 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T17:12:43.639 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-09-12T17:12:43.639 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T17:12:43.639 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T17:12:43.639 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T17:12:43.640 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-09-12T17:12:43.669 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-09-12T17:12:43.688 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-09-12T17:12:43.688 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-09-12T17:12:43.745 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-09-12T17:12:43.746 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-09-12T17:12:43.746 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-09-12T17:12:43.746 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-09-12T17:12:43.746 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-09-12T17:12:43.746 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-09-12T17:12:43.746 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T17:12:43.746 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-09-12T17:12:43.746 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-09-12T17:12:43.746 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T17:12:43.746 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-09-12T17:12:43.746 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T17:12:43.746 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T17:12:43.746 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T17:12:43.747 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-09-12T17:12:43.769 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T17:12:43.780 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T17:12:43.788 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T17:12:43.788 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:12:43.791 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:12:43.807 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T17:12:43.813 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T17:12:43.814 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:12:43.849 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:12:43.880 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T17:12:43.934 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T17:12:43.948 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T17:12:43.948 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T17:12:43.948 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:12:43.949 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:12:43.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:12:43.965 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-09-12T17:12:43.966 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:12:43.967 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-09-12T17:12:44.023 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-503.el9.x86_64 2024-09-12T17:12:44.023 INFO:teuthology.task.kernel:Running kernel on smithi181: 5.14.0-503.el9.x86_64 2024-09-12T17:12:44.024 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum install -y kernel 2024-09-12T17:12:44.025 INFO:teuthology.orchestra.run.smithi044.stdout:5.14.0-503.el9.x86_64 2024-09-12T17:12:44.025 INFO:teuthology.task.kernel:Running kernel on smithi044: 5.14.0-503.el9.x86_64 2024-09-12T17:12:44.025 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum install -y kernel 2024-09-12T17:12:46.580 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-12T17:12:48.576 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.2 MB 00:02 2024-09-12T17:12:49.973 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 20 MB 00:02 2024-09-12T17:12:51.861 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 20 MB 00:02 2024-09-12T17:12:54.581 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.5 MB 00:00 2024-09-12T17:12:56.907 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-12T17:12:57.402 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-12T17:12:57.828 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T17:12:58.903 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-12T17:12:59.708 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-12T17:13:03.401 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-12T17:13:05.146 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-12T17:13:05.382 INFO:teuthology.orchestra.run.smithi044.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T17:13:05.382 INFO:teuthology.orchestra.run.smithi044.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T17:13:05.483 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-12T17:13:05.493 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-12T17:13:05.493 INFO:teuthology.orchestra.run.smithi044.stdout: Package Architecture Version Repository Size 2024-09-12T17:13:05.493 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-12T17:13:05.493 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-12T17:13:05.493 INFO:teuthology.orchestra.run.smithi044.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T17:13:05.494 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-09-12T17:13:05.494 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T17:13:05.494 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T17:13:05.494 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T17:13:05.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:13:05.494 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-12T17:13:05.494 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-12T17:13:05.494 INFO:teuthology.orchestra.run.smithi044.stdout:Install 4 Packages 2024-09-12T17:13:05.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:13:05.495 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 79 M 2024-09-12T17:13:05.495 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 126 M 2024-09-12T17:13:05.495 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-12T17:13:06.052 INFO:teuthology.orchestra.run.smithi044.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 42 kB/s | 23 kB 00:00 2024-09-12T17:13:07.019 INFO:teuthology.orchestra.run.smithi044.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-12T17:13:07.145 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T17:13:07.145 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T17:13:07.241 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-12T17:13:07.248 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-12T17:13:07.248 INFO:teuthology.orchestra.run.smithi181.stdout: Package Architecture Version Repository Size 2024-09-12T17:13:07.248 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-12T17:13:07.248 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-12T17:13:07.248 INFO:teuthology.orchestra.run.smithi181.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T17:13:07.248 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-12T17:13:07.249 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T17:13:07.249 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T17:13:07.249 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T17:13:07.249 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:13:07.249 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-12T17:13:07.249 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-12T17:13:07.249 INFO:teuthology.orchestra.run.smithi181.stdout:Install 4 Packages 2024-09-12T17:13:07.249 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:13:07.250 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 79 M 2024-09-12T17:13:07.250 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 126 M 2024-09-12T17:13:07.250 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-12T17:13:07.440 INFO:teuthology.orchestra.run.smithi181.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 268 kB/s | 23 kB 00:00 2024-09-12T17:13:07.727 INFO:teuthology.orchestra.run.smithi044.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 16 MB/s | 35 MB 00:02 2024-09-12T17:13:08.278 INFO:teuthology.orchestra.run.smithi044.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-12T17:13:08.278 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:13:08.278 INFO:teuthology.orchestra.run.smithi044.stdout:Total 28 MB/s | 79 MB 00:02 2024-09-12T17:13:08.990 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-12T17:13:09.395 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-12T17:13:09.395 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-12T17:13:10.381 INFO:teuthology.orchestra.run.smithi181.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 11 MB/s | 35 MB 00:03 2024-09-12T17:13:10.393 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-12T17:13:10.394 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-12T17:13:10.756 INFO:teuthology.orchestra.run.smithi181.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 4.6 MB/s | 16 MB 00:03 2024-09-12T17:13:12.972 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-12T17:13:13.640 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:13:13.728 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:13:16.356 INFO:teuthology.orchestra.run.smithi181.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 3.2 MB/s | 29 MB 00:08 2024-09-12T17:13:16.356 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:13:16.356 INFO:teuthology.orchestra.run.smithi181.stdout:Total 8.6 MB/s | 79 MB 00:09 2024-09-12T17:13:16.520 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:13:16.650 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:13:17.040 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-12T17:13:17.378 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-12T17:13:17.378 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-12T17:13:18.343 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-12T17:13:18.344 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-12T17:13:20.795 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-12T17:13:21.442 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:13:21.531 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:13:21.781 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:13:21.826 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:13:24.305 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:13:24.443 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:13:26.973 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:13:29.265 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:13:29.352 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:13:34.208 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:14:06.205 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:14:06.246 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:14:06.582 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:14:06.583 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:14:06.583 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:14:06.583 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:14:07.418 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:14:07.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:14:07.419 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-12T17:14:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T17:14:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T17:14:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T17:14:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T17:14:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:14:07.419 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-12T17:14:07.773 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:14:07.864 INFO:teuthology.orchestra.run.smithi044.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:14:07.865 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:14:07.866 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T17:14:07.866 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:14:07.866 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:14:07.866 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T17:14:07.866 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi044.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:14:07.866 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:14:07.925 INFO:teuthology.orchestra.run.smithi044.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:14:07.925 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:14:07.925 DEBUG:teuthology.orchestra.run.smithi044:> sudo rpm -qi grub2-tools 2024-09-12T17:14:07.956 INFO:teuthology.orchestra.run.smithi044.stdout:Name : grub2-tools 2024-09-12T17:14:07.957 INFO:teuthology.orchestra.run.smithi044.stdout:Epoch : 1 2024-09-12T17:14:07.957 INFO:teuthology.orchestra.run.smithi044.stdout:Version : 2.06 2024-09-12T17:14:07.957 INFO:teuthology.orchestra.run.smithi044.stdout:Release : 82.el9 2024-09-12T17:14:07.957 INFO:teuthology.orchestra.run.smithi044.stdout:Architecture: x86_64 2024-09-12T17:14:07.957 INFO:teuthology.orchestra.run.smithi044.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T17:14:07.957 INFO:teuthology.orchestra.run.smithi044.stdout:Group : Unspecified 2024-09-12T17:14:07.957 INFO:teuthology.orchestra.run.smithi044.stdout:Size : 8274670 2024-09-12T17:14:07.957 INFO:teuthology.orchestra.run.smithi044.stdout:License : GPLv3+ 2024-09-12T17:14:07.957 INFO:teuthology.orchestra.run.smithi044.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T17:14:07.957 INFO:teuthology.orchestra.run.smithi044.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T17:14:07.957 INFO:teuthology.orchestra.run.smithi044.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T17:14:07.957 INFO:teuthology.orchestra.run.smithi044.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T17:14:07.957 INFO:teuthology.orchestra.run.smithi044.stdout:Packager : builder@centos.org 2024-09-12T17:14:07.958 INFO:teuthology.orchestra.run.smithi044.stdout:Vendor : CentOS 2024-09-12T17:14:07.958 INFO:teuthology.orchestra.run.smithi044.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T17:14:07.958 INFO:teuthology.orchestra.run.smithi044.stdout:Summary : Support tools for GRUB. 2024-09-12T17:14:07.958 INFO:teuthology.orchestra.run.smithi044.stdout:Description : 2024-09-12T17:14:07.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:14:07.958 INFO:teuthology.orchestra.run.smithi044.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T17:14:07.958 INFO:teuthology.orchestra.run.smithi044.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T17:14:07.958 INFO:teuthology.orchestra.run.smithi044.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T17:14:07.958 INFO:teuthology.orchestra.run.smithi044.stdout:hardware devices. 2024-09-12T17:14:07.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:14:07.958 INFO:teuthology.orchestra.run.smithi044.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T17:14:07.959 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T17:14:07.959 INFO:teuthology.task.kernel:Updating grub on smithi044 to boot 5.14.0-505.el9.x86_64 2024-09-12T17:14:07.959 DEBUG:teuthology.orchestra.run.smithi044:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T17:14:08.651 INFO:teuthology.orchestra.run.smithi044.stderr:Generating grub configuration file ... 2024-09-12T17:14:10.009 INFO:teuthology.orchestra.run.smithi044.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T17:14:10.039 INFO:teuthology.orchestra.run.smithi044.stderr:done 2024-09-12T17:14:10.041 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-09-12T17:14:10.058 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.dFrgc5EwqD 2024-09-12T17:14:10.081 DEBUG:teuthology.orchestra.run.smithi044:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dFrgc5EwqD 2024-09-12T17:14:10.127 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.dFrgc5EwqD 2024-09-12T17:14:10.282 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.dFrgc5EwqD is 6KB 2024-09-12T17:14:10.305 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.dFrgc5EwqD 2024-09-12T17:14:10.320 DEBUG:teuthology.orchestra.run.smithi044:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T17:14:10.391 INFO:teuthology.orchestra.run.smithi044.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T17:14:10.391 INFO:teuthology.orchestra.run.smithi044.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T17:14:10.391 INFO:teuthology.orchestra.run.smithi044.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T17:14:10.391 INFO:teuthology.orchestra.run.smithi044.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T17:14:10.393 DEBUG:teuthology.orchestra.run.smithi044:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T17:14:10.538 DEBUG:teuthology.orchestra.run.smithi044:> sudo shutdown -r now 2024-09-12T17:14:12.103 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:14:12.143 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:14:12.488 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:14:12.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:14:12.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:14:12.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:14:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:14:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:14:13.360 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-12T17:14:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T17:14:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T17:14:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T17:14:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T17:14:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:14:13.361 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-12T17:14:13.721 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:14:13.807 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:14:13.808 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:14:13.808 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T17:14:13.808 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:14:13.808 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:14:13.808 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T17:14:13.808 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi181.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:14:13.808 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:14:13.868 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:14:13.868 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:14:13.869 DEBUG:teuthology.orchestra.run.smithi181:> sudo rpm -qi grub2-tools 2024-09-12T17:14:13.906 INFO:teuthology.orchestra.run.smithi181.stdout:Name : grub2-tools 2024-09-12T17:14:13.906 INFO:teuthology.orchestra.run.smithi181.stdout:Epoch : 1 2024-09-12T17:14:13.906 INFO:teuthology.orchestra.run.smithi181.stdout:Version : 2.06 2024-09-12T17:14:13.906 INFO:teuthology.orchestra.run.smithi181.stdout:Release : 82.el9 2024-09-12T17:14:13.906 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: x86_64 2024-09-12T17:14:13.906 INFO:teuthology.orchestra.run.smithi181.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T17:14:13.906 INFO:teuthology.orchestra.run.smithi181.stdout:Group : Unspecified 2024-09-12T17:14:13.907 INFO:teuthology.orchestra.run.smithi181.stdout:Size : 8274670 2024-09-12T17:14:13.907 INFO:teuthology.orchestra.run.smithi181.stdout:License : GPLv3+ 2024-09-12T17:14:13.907 INFO:teuthology.orchestra.run.smithi181.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T17:14:13.907 INFO:teuthology.orchestra.run.smithi181.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T17:14:13.907 INFO:teuthology.orchestra.run.smithi181.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T17:14:13.907 INFO:teuthology.orchestra.run.smithi181.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T17:14:13.907 INFO:teuthology.orchestra.run.smithi181.stdout:Packager : builder@centos.org 2024-09-12T17:14:13.907 INFO:teuthology.orchestra.run.smithi181.stdout:Vendor : CentOS 2024-09-12T17:14:13.907 INFO:teuthology.orchestra.run.smithi181.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T17:14:13.907 INFO:teuthology.orchestra.run.smithi181.stdout:Summary : Support tools for GRUB. 2024-09-12T17:14:13.907 INFO:teuthology.orchestra.run.smithi181.stdout:Description : 2024-09-12T17:14:13.907 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:14:13.907 INFO:teuthology.orchestra.run.smithi181.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T17:14:13.908 INFO:teuthology.orchestra.run.smithi181.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T17:14:13.908 INFO:teuthology.orchestra.run.smithi181.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T17:14:13.908 INFO:teuthology.orchestra.run.smithi181.stdout:hardware devices. 2024-09-12T17:14:13.908 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:14:13.908 INFO:teuthology.orchestra.run.smithi181.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T17:14:13.909 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T17:14:13.909 INFO:teuthology.task.kernel:Updating grub on smithi181 to boot 5.14.0-505.el9.x86_64 2024-09-12T17:14:13.909 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T17:14:14.553 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2024-09-12T17:14:15.885 INFO:teuthology.orchestra.run.smithi181.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T17:14:15.912 INFO:teuthology.orchestra.run.smithi181.stderr:done 2024-09-12T17:14:15.914 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-09-12T17:14:15.930 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.Dlvs4fT4v2 2024-09-12T17:14:15.930 DEBUG:teuthology.orchestra.run.smithi181:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Dlvs4fT4v2 2024-09-12T17:14:15.996 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.Dlvs4fT4v2 2024-09-12T17:14:16.134 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.Dlvs4fT4v2 is 6KB 2024-09-12T17:14:16.183 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.Dlvs4fT4v2 2024-09-12T17:14:16.199 DEBUG:teuthology.orchestra.run.smithi181:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T17:14:16.269 INFO:teuthology.orchestra.run.smithi181.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T17:14:16.269 INFO:teuthology.orchestra.run.smithi181.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T17:14:16.269 INFO:teuthology.orchestra.run.smithi181.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T17:14:16.270 INFO:teuthology.orchestra.run.smithi181.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T17:14:16.271 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T17:14:16.437 DEBUG:teuthology.orchestra.run.smithi181:> sudo shutdown -r now 2024-09-12T17:14:40.565 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T17:14:40.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-12T17:14:40.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:14:46.445 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T17:14:46.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-12T17:14:46.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:14:59.009 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-09-12T17:15:04.893 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-09-12T17:15:08.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-12T17:15:08.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:15:13.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-12T17:15:13.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:15:16.957 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-09-12T17:15:28.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-12T17:15:28.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:16:00.775 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-09-12T17:16:01.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-12T17:16:01.760 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-12T17:16:01.760 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-09-12T17:16:01.775 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-505.el9.x86_64 2024-09-12T17:16:01.775 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T17:16:01.775 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:16:01.775 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T17:16:02.776 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T17:16:02.776 DEBUG:teuthology.orchestra.run.smithi181:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:16:02.841 INFO:teuthology.orchestra.run.smithi181.stdout:ttyS1 2024-09-12T17:16:02.860 DEBUG:teuthology.parallel:result is None 2024-09-12T17:16:08.016 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T17:16:20.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-12T17:16:20.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:16:20.406 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-09-12T17:16:20.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-12T17:16:20.738 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T17:16:20.739 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-09-12T17:16:20.755 INFO:teuthology.orchestra.run.smithi044.stdout:5.14.0-505.el9.x86_64 2024-09-12T17:16:20.756 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T17:16:20.756 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:16:20.756 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T17:16:21.757 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T17:16:21.757 DEBUG:teuthology.orchestra.run.smithi044:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:16:21.837 INFO:teuthology.orchestra.run.smithi044.stdout:ttyS1 2024-09-12T17:16:21.860 DEBUG:teuthology.parallel:result is None 2024-09-12T17:16:21.860 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T17:16:21.868 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T17:16:21.868 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:16:21.870 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:16:21.889 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T17:16:21.900 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T17:16:21.915 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T17:16:21.915 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:16:21.928 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:16:21.958 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T17:16:21.969 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T17:16:21.970 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:16:21.989 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:16:22.026 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:16:22.031 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:16:22.038 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:16:22.042 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:16:22.044 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T17:16:22.055 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T17:16:22.055 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:16:22.082 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:16:22.111 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T17:16:22.123 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T17:16:22.124 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:16:22.151 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:16:22.167 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:16:22.249 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:16:22.296 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:16:22.378 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:16:22.421 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:16:22.421 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:16:22.487 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:16:22.529 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:16:22.585 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:16:22.669 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:16:22.711 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:16:22.711 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:16:22.778 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-09-12T17:16:22.780 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-09-12T17:16:22.815 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T17:16:22.859 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T17:16:23.308 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T17:16:23.316 INFO:teuthology.task.internal:Starting timer... 2024-09-12T17:16:23.317 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T17:16:23.377 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T17:16:23.393 DEBUG:teuthology.orchestra.run.smithi044:> sudo service auditd rotate 2024-09-12T17:16:23.463 INFO:teuthology.orchestra.run.smithi044.stdout:Rotating logs: 2024-09-12T17:16:23.465 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2024-09-12T17:16:23.526 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2024-09-12T17:16:23.528 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T17:16:23.528 DEBUG:teuthology.orchestra.run.smithi044:> /usr/sbin/getenforce 2024-09-12T17:16:23.548 INFO:teuthology.orchestra.run.smithi044.stdout:Permissive 2024-09-12T17:16:23.549 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2024-09-12T17:16:23.570 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2024-09-12T17:16:23.570 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi044.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2024-09-12T17:16:23.571 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T17:16:23.617 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:16:23.617 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T17:16:23.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:16:23.645 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T17:16:23.646 DEBUG:teuthology.orchestra.run.smithi044:> sudo /usr/sbin/setenforce permissive 2024-09-12T17:16:23.688 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2024-09-12T17:16:23.719 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T17:16:23.733 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T17:16:23.736 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T17:16:23.871 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T17:16:23.890 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T17:16:23.891 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi044.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T17:20:09.164 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-09-12T17:20:09.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-12T17:20:09.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:20:09.248 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-09-12T17:20:09.326 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-12T17:20:09.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-12T17:20:09.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:20:09.400 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-09-12T17:20:09.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-12T17:20:09.482 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T17:20:09.491 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T17:20:09.492 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:20:09.492 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:20:09.495 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:20:09.495 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:20:09.525 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T17:20:09.542 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T17:20:09.553 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T17:20:09.568 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T17:20:09.569 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: ntpd: command not found 2024-09-12T17:20:09.581 INFO:teuthology.orchestra.run.smithi044.stdout:506 Cannot talk to daemon 2024-09-12T17:20:09.594 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2024-09-12T17:20:09.596 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T17:20:09.605 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2024-09-12T17:20:09.611 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T17:20:09.620 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T17:20:09.634 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T17:20:09.668 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-09-12T17:20:09.671 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T17:20:09.671 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-09-12T17:20:09.671 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:20:09.672 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:20:09.672 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:20:09.672 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:20:09.690 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-09-12T17:20:09.693 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T17:20:09.693 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-09-12T17:20:09.694 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:20:09.694 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:20:09.694 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:20:09.694 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:20:09.695 INFO:teuthology.run_tasks:Running task install... 2024-09-12T17:20:09.704 DEBUG:teuthology.task.install:project ceph 2024-09-12T17:20:09.704 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-12T17:20:09.704 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-12T17:20:09.704 INFO:teuthology.task.install:Using flavor: default 2024-09-12T17:20:09.710 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T17:20:09.710 INFO:teuthology.task.install:extra packages: [] 2024-09-12T17:20:09.710 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-12T17:20:09.711 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:20:09.712 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-12T17:20:09.713 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:20:09.855 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-12T17:20:09.855 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-12T17:20:09.859 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-12T17:20:09.859 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-12T17:20:09.966 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T17:20:09.966 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:20:09.966 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T17:20:09.973 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T17:20:09.973 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:20:09.974 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T17:20:09.992 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T17:20:09.992 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T17:20:10.001 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T17:20:10.002 DEBUG:teuthology.orchestra.run.smithi044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T17:20:10.058 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T17:20:10.069 DEBUG:teuthology.orchestra.run.smithi044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T17:20:10.133 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T17:20:10.146 DEBUG:teuthology.orchestra.run.smithi044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T17:20:10.198 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2024-09-12T17:20:10.199 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2024-09-12T17:20:10.211 INFO:teuthology.orchestra.run.smithi044.stdout:check_obsoletes = 1 2024-09-12T17:20:10.212 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum clean all 2024-09-12T17:20:10.424 INFO:teuthology.orchestra.run.smithi181.stdout:45 files removed 2024-09-12T17:20:10.451 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T17:20:10.459 INFO:teuthology.orchestra.run.smithi044.stdout:45 files removed 2024-09-12T17:20:10.486 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T17:20:10.998 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 320 kB/s | 84 kB 00:00 2024-09-12T17:20:11.036 INFO:teuthology.orchestra.run.smithi044.stdout:ceph packages for x86_64 335 kB/s | 84 kB 00:00 2024-09-12T17:20:11.274 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 104 kB/s | 24 kB 00:00 2024-09-12T17:20:11.311 INFO:teuthology.orchestra.run.smithi044.stdout:ceph noarch packages 105 kB/s | 24 kB 00:00 2024-09-12T17:20:11.533 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 8.7 kB/s | 1.9 kB 00:00 2024-09-12T17:20:11.595 INFO:teuthology.orchestra.run.smithi044.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T17:20:11.992 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-09-12T17:20:12.253 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-12T17:20:13.726 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-12T17:20:14.221 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-12T17:20:19.260 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-12T17:20:20.230 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.5 MB 00:02 2024-09-12T17:20:20.803 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 19 kB 00:00 2024-09-12T17:20:21.707 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T17:20:21.990 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-12T17:20:22.777 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-12T17:20:27.129 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T17:20:28.392 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-12T17:20:29.438 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:20:29.438 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:20:29.520 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-12T17:20:29.549 INFO:teuthology.orchestra.run.smithi181.stdout:====================================================================================================== 2024-09-12T17:20:29.550 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-09-12T17:20:29.550 INFO:teuthology.orchestra.run.smithi181.stdout:====================================================================================================== 2024-09-12T17:20:29.550 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-12T17:20:29.550 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-12T17:20:29.550 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:20:29.550 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-12T17:20:29.550 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-12T17:20:29.550 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-12T17:20:29.550 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-12T17:20:29.550 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-12T17:20:29.551 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-12T17:20:29.551 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-12T17:20:29.551 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-12T17:20:29.551 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-12T17:20:29.551 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-12T17:20:29.551 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-12T17:20:29.551 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-12T17:20:29.551 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-12T17:20:29.551 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-12T17:20:29.552 INFO:teuthology.orchestra.run.smithi181.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T17:20:29.552 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:20:29.552 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-12T17:20:29.552 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-12T17:20:29.552 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-12T17:20:29.552 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-12T17:20:29.552 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:20:29.552 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-12T17:20:29.552 INFO:teuthology.orchestra.run.smithi181.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T17:20:29.552 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-09-12T17:20:29.552 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-12T17:20:29.553 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:20:29.553 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-12T17:20:29.553 INFO:teuthology.orchestra.run.smithi181.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T17:20:29.553 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T17:20:29.553 INFO:teuthology.orchestra.run.smithi181.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T17:20:29.553 INFO:teuthology.orchestra.run.smithi181.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T17:20:29.553 INFO:teuthology.orchestra.run.smithi181.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T17:20:29.553 INFO:teuthology.orchestra.run.smithi181.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T17:20:29.553 INFO:teuthology.orchestra.run.smithi181.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T17:20:29.553 INFO:teuthology.orchestra.run.smithi181.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T17:20:29.553 INFO:teuthology.orchestra.run.smithi181.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T17:20:29.553 INFO:teuthology.orchestra.run.smithi181.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T17:20:29.554 INFO:teuthology.orchestra.run.smithi181.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T17:20:29.554 INFO:teuthology.orchestra.run.smithi181.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T17:20:29.554 INFO:teuthology.orchestra.run.smithi181.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T17:20:29.554 INFO:teuthology.orchestra.run.smithi181.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T17:20:29.554 INFO:teuthology.orchestra.run.smithi181.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T17:20:29.554 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T17:20:29.554 INFO:teuthology.orchestra.run.smithi181.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T17:20:29.554 INFO:teuthology.orchestra.run.smithi181.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T17:20:29.554 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-12T17:20:29.554 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-12T17:20:29.554 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-12T17:20:29.554 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-12T17:20:29.554 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-12T17:20:29.555 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-12T17:20:29.555 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-12T17:20:29.555 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-12T17:20:29.555 INFO:teuthology.orchestra.run.smithi181.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T17:20:29.555 INFO:teuthology.orchestra.run.smithi181.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T17:20:29.555 INFO:teuthology.orchestra.run.smithi181.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T17:20:29.555 INFO:teuthology.orchestra.run.smithi181.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T17:20:29.555 INFO:teuthology.orchestra.run.smithi181.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T17:20:29.555 INFO:teuthology.orchestra.run.smithi181.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T17:20:29.555 INFO:teuthology.orchestra.run.smithi181.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T17:20:29.555 INFO:teuthology.orchestra.run.smithi181.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T17:20:29.555 INFO:teuthology.orchestra.run.smithi181.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T17:20:29.556 INFO:teuthology.orchestra.run.smithi181.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T17:20:29.556 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T17:20:29.556 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T17:20:29.556 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T17:20:29.556 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T17:20:29.556 INFO:teuthology.orchestra.run.smithi181.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T17:20:29.556 INFO:teuthology.orchestra.run.smithi181.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T17:20:29.556 INFO:teuthology.orchestra.run.smithi181.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T17:20:29.556 INFO:teuthology.orchestra.run.smithi181.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T17:20:29.556 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T17:20:29.556 INFO:teuthology.orchestra.run.smithi181.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T17:20:29.556 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T17:20:29.557 INFO:teuthology.orchestra.run.smithi181.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T17:20:29.557 INFO:teuthology.orchestra.run.smithi181.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T17:20:29.557 INFO:teuthology.orchestra.run.smithi181.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T17:20:29.557 INFO:teuthology.orchestra.run.smithi181.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T17:20:29.557 INFO:teuthology.orchestra.run.smithi181.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T17:20:29.557 INFO:teuthology.orchestra.run.smithi181.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T17:20:29.557 INFO:teuthology.orchestra.run.smithi181.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T17:20:29.557 INFO:teuthology.orchestra.run.smithi181.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T17:20:29.557 INFO:teuthology.orchestra.run.smithi181.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T17:20:29.557 INFO:teuthology.orchestra.run.smithi181.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T17:20:29.557 INFO:teuthology.orchestra.run.smithi181.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T17:20:29.557 INFO:teuthology.orchestra.run.smithi181.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T17:20:29.558 INFO:teuthology.orchestra.run.smithi181.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T17:20:29.558 INFO:teuthology.orchestra.run.smithi181.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T17:20:29.558 INFO:teuthology.orchestra.run.smithi181.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T17:20:29.558 INFO:teuthology.orchestra.run.smithi181.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T17:20:29.558 INFO:teuthology.orchestra.run.smithi181.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T17:20:29.558 INFO:teuthology.orchestra.run.smithi181.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T17:20:29.558 INFO:teuthology.orchestra.run.smithi181.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T17:20:29.558 INFO:teuthology.orchestra.run.smithi181.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T17:20:29.558 INFO:teuthology.orchestra.run.smithi181.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T17:20:29.558 INFO:teuthology.orchestra.run.smithi181.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T17:20:29.558 INFO:teuthology.orchestra.run.smithi181.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T17:20:29.558 INFO:teuthology.orchestra.run.smithi181.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T17:20:29.558 INFO:teuthology.orchestra.run.smithi181.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T17:20:29.559 INFO:teuthology.orchestra.run.smithi181.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T17:20:29.559 INFO:teuthology.orchestra.run.smithi181.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T17:20:29.559 INFO:teuthology.orchestra.run.smithi181.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T17:20:29.559 INFO:teuthology.orchestra.run.smithi181.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T17:20:29.559 INFO:teuthology.orchestra.run.smithi181.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T17:20:29.559 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T17:20:29.559 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T17:20:29.559 INFO:teuthology.orchestra.run.smithi181.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T17:20:29.559 INFO:teuthology.orchestra.run.smithi181.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T17:20:29.559 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:20:29.559 INFO:teuthology.orchestra.run.smithi181.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T17:20:29.559 INFO:teuthology.orchestra.run.smithi181.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T17:20:29.560 INFO:teuthology.orchestra.run.smithi181.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T17:20:29.560 INFO:teuthology.orchestra.run.smithi181.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T17:20:29.560 INFO:teuthology.orchestra.run.smithi181.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T17:20:29.560 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T17:20:29.560 INFO:teuthology.orchestra.run.smithi181.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T17:20:29.560 INFO:teuthology.orchestra.run.smithi181.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T17:20:29.560 INFO:teuthology.orchestra.run.smithi181.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T17:20:29.560 INFO:teuthology.orchestra.run.smithi181.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T17:20:29.560 INFO:teuthology.orchestra.run.smithi181.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T17:20:29.560 INFO:teuthology.orchestra.run.smithi181.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T17:20:29.560 INFO:teuthology.orchestra.run.smithi181.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T17:20:29.560 INFO:teuthology.orchestra.run.smithi181.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T17:20:29.561 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T17:20:29.561 INFO:teuthology.orchestra.run.smithi181.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T17:20:29.561 INFO:teuthology.orchestra.run.smithi181.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T17:20:29.561 INFO:teuthology.orchestra.run.smithi181.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T17:20:29.561 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T17:20:29.561 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T17:20:29.561 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T17:20:29.561 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-12T17:20:29.561 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T17:20:29.561 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:20:29.561 INFO:teuthology.orchestra.run.smithi181.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T17:20:29.561 INFO:teuthology.orchestra.run.smithi181.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T17:20:29.562 INFO:teuthology.orchestra.run.smithi181.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T17:20:29.562 INFO:teuthology.orchestra.run.smithi181.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T17:20:29.562 INFO:teuthology.orchestra.run.smithi181.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T17:20:29.562 INFO:teuthology.orchestra.run.smithi181.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T17:20:29.562 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T17:20:29.562 INFO:teuthology.orchestra.run.smithi181.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T17:20:29.562 INFO:teuthology.orchestra.run.smithi181.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T17:20:29.562 INFO:teuthology.orchestra.run.smithi181.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T17:20:29.562 INFO:teuthology.orchestra.run.smithi181.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T17:20:29.562 INFO:teuthology.orchestra.run.smithi181.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T17:20:29.562 INFO:teuthology.orchestra.run.smithi181.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T17:20:29.562 INFO:teuthology.orchestra.run.smithi181.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T17:20:29.562 INFO:teuthology.orchestra.run.smithi181.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T17:20:29.563 INFO:teuthology.orchestra.run.smithi181.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T17:20:29.563 INFO:teuthology.orchestra.run.smithi181.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T17:20:29.563 INFO:teuthology.orchestra.run.smithi181.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T17:20:29.563 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T17:20:29.563 INFO:teuthology.orchestra.run.smithi181.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T17:20:29.563 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T17:20:29.563 INFO:teuthology.orchestra.run.smithi181.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T17:20:29.563 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T17:20:29.563 INFO:teuthology.orchestra.run.smithi181.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T17:20:29.563 INFO:teuthology.orchestra.run.smithi181.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T17:20:29.564 INFO:teuthology.orchestra.run.smithi181.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T17:20:29.564 INFO:teuthology.orchestra.run.smithi181.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T17:20:29.564 INFO:teuthology.orchestra.run.smithi181.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T17:20:29.564 INFO:teuthology.orchestra.run.smithi181.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T17:20:29.564 INFO:teuthology.orchestra.run.smithi181.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T17:20:29.564 INFO:teuthology.orchestra.run.smithi181.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T17:20:29.564 INFO:teuthology.orchestra.run.smithi181.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T17:20:29.564 INFO:teuthology.orchestra.run.smithi181.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T17:20:29.564 INFO:teuthology.orchestra.run.smithi181.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T17:20:29.564 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T17:20:29.564 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T17:20:29.564 INFO:teuthology.orchestra.run.smithi181.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T17:20:29.565 INFO:teuthology.orchestra.run.smithi181.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T17:20:29.565 INFO:teuthology.orchestra.run.smithi181.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T17:20:29.565 INFO:teuthology.orchestra.run.smithi181.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T17:20:29.565 INFO:teuthology.orchestra.run.smithi181.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T17:20:29.565 INFO:teuthology.orchestra.run.smithi181.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T17:20:29.565 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T17:20:29.565 INFO:teuthology.orchestra.run.smithi181.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T17:20:29.565 INFO:teuthology.orchestra.run.smithi181.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T17:20:29.565 INFO:teuthology.orchestra.run.smithi181.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T17:20:29.565 INFO:teuthology.orchestra.run.smithi181.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T17:20:29.565 INFO:teuthology.orchestra.run.smithi181.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T17:20:29.565 INFO:teuthology.orchestra.run.smithi181.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T17:20:29.566 INFO:teuthology.orchestra.run.smithi181.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T17:20:29.566 INFO:teuthology.orchestra.run.smithi181.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T17:20:29.566 INFO:teuthology.orchestra.run.smithi181.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T17:20:29.566 INFO:teuthology.orchestra.run.smithi181.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T17:20:29.566 INFO:teuthology.orchestra.run.smithi181.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T17:20:29.566 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T17:20:29.566 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T17:20:29.566 INFO:teuthology.orchestra.run.smithi181.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T17:20:29.566 INFO:teuthology.orchestra.run.smithi181.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T17:20:29.566 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T17:20:29.566 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T17:20:29.566 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T17:20:29.566 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T17:20:29.567 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-12T17:20:29.567 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-12T17:20:29.567 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T17:20:29.567 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T17:20:29.567 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T17:20:29.567 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T17:20:29.567 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T17:20:29.567 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T17:20:29.567 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T17:20:29.567 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T17:20:29.567 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T17:20:29.567 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T17:20:29.568 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T17:20:29.568 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T17:20:29.568 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T17:20:29.568 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T17:20:29.568 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T17:20:29.568 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T17:20:29.568 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T17:20:29.568 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T17:20:29.568 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T17:20:29.568 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T17:20:29.568 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T17:20:29.568 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T17:20:29.569 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T17:20:29.569 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T17:20:29.569 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T17:20:29.569 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T17:20:29.569 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T17:20:29.569 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T17:20:29.569 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T17:20:29.569 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T17:20:29.569 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T17:20:29.569 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T17:20:29.569 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T17:20:29.569 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T17:20:29.569 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T17:20:29.570 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T17:20:29.570 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T17:20:29.570 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T17:20:29.570 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T17:20:29.570 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T17:20:29.570 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T17:20:29.570 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T17:20:29.570 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T17:20:29.570 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T17:20:29.570 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T17:20:29.570 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T17:20:29.570 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T17:20:29.571 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T17:20:29.571 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T17:20:29.571 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T17:20:29.571 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T17:20:29.571 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T17:20:29.571 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T17:20:29.571 INFO:teuthology.orchestra.run.smithi181.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T17:20:29.571 INFO:teuthology.orchestra.run.smithi181.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T17:20:29.571 INFO:teuthology.orchestra.run.smithi181.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T17:20:29.571 INFO:teuthology.orchestra.run.smithi181.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T17:20:29.571 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T17:20:29.572 INFO:teuthology.orchestra.run.smithi181.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T17:20:29.572 INFO:teuthology.orchestra.run.smithi181.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T17:20:29.572 INFO:teuthology.orchestra.run.smithi181.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T17:20:29.572 INFO:teuthology.orchestra.run.smithi181.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T17:20:29.572 INFO:teuthology.orchestra.run.smithi181.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T17:20:29.572 INFO:teuthology.orchestra.run.smithi181.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T17:20:29.572 INFO:teuthology.orchestra.run.smithi181.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T17:20:29.572 INFO:teuthology.orchestra.run.smithi181.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T17:20:29.572 INFO:teuthology.orchestra.run.smithi181.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T17:20:29.573 INFO:teuthology.orchestra.run.smithi181.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T17:20:29.573 INFO:teuthology.orchestra.run.smithi181.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T17:20:29.573 INFO:teuthology.orchestra.run.smithi181.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T17:20:29.573 INFO:teuthology.orchestra.run.smithi181.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T17:20:29.573 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T17:20:29.573 INFO:teuthology.orchestra.run.smithi181.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T17:20:29.573 INFO:teuthology.orchestra.run.smithi181.stdout:Installing weak dependencies: 2024-09-12T17:20:29.573 INFO:teuthology.orchestra.run.smithi181.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T17:20:29.573 INFO:teuthology.orchestra.run.smithi181.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T17:20:29.573 INFO:teuthology.orchestra.run.smithi181.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T17:20:29.573 INFO:teuthology.orchestra.run.smithi181.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T17:20:29.574 INFO:teuthology.orchestra.run.smithi181.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T17:20:29.574 INFO:teuthology.orchestra.run.smithi181.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T17:20:29.574 INFO:teuthology.orchestra.run.smithi181.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T17:20:29.574 INFO:teuthology.orchestra.run.smithi181.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T17:20:29.574 INFO:teuthology.orchestra.run.smithi181.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T17:20:29.574 INFO:teuthology.orchestra.run.smithi181.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T17:20:29.574 INFO:teuthology.orchestra.run.smithi181.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T17:20:29.574 INFO:teuthology.orchestra.run.smithi181.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T17:20:29.574 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T17:20:29.574 INFO:teuthology.orchestra.run.smithi181.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T17:20:29.574 INFO:teuthology.orchestra.run.smithi181.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T17:20:29.575 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:20:29.575 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-12T17:20:29.575 INFO:teuthology.orchestra.run.smithi181.stdout:====================================================================================================== 2024-09-12T17:20:29.575 INFO:teuthology.orchestra.run.smithi181.stdout:Install 283 Packages 2024-09-12T17:20:29.575 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 2 Packages 2024-09-12T17:20:29.575 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:20:29.576 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 322 M 2024-09-12T17:20:29.576 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-12T17:20:30.039 INFO:teuthology.orchestra.run.smithi181.stdout:(1/285): ceph-19.3.0-4762.gbad475c1.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-12T17:20:30.223 INFO:teuthology.orchestra.run.smithi181.stdout:(2/285): ceph-fuse-19.3.0-4762.gbad475c1.el9.x8 4.8 MB/s | 900 kB 00:00 2024-09-12T17:20:30.290 INFO:teuthology.orchestra.run.smithi181.stdout:(3/285): ceph-immutable-object-cache-19.3.0-476 2.1 MB/s | 145 kB 00:00 2024-09-12T17:20:30.423 INFO:teuthology.orchestra.run.smithi181.stdout:(4/285): ceph-base-19.3.0-4762.gbad475c1.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-12T17:20:30.474 INFO:teuthology.orchestra.run.smithi181.stdout:(5/285): ceph-mds-19.3.0-4762.gbad475c1.el9.x86 13 MB/s | 2.4 MB 00:00 2024-09-12T17:20:30.557 INFO:teuthology.orchestra.run.smithi181.stdout:(6/285): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-12T17:20:30.778 INFO:teuthology.orchestra.run.smithi044.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:20:30.778 INFO:teuthology.orchestra.run.smithi044.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:20:30.841 INFO:teuthology.orchestra.run.smithi181.stdout:(7/285): ceph-mon-19.3.0-4762.gbad475c1.el9.x86 13 MB/s | 4.8 MB 00:00 2024-09-12T17:20:30.874 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-12T17:20:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================================== 2024-09-12T17:20:30.900 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-09-12T17:20:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================================== 2024-09-12T17:20:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-12T17:20:30.900 INFO:teuthology.orchestra.run.smithi044.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-12T17:20:30.900 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:20:30.901 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-12T17:20:30.901 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-12T17:20:30.901 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-12T17:20:30.901 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-12T17:20:30.901 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-12T17:20:30.901 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-12T17:20:30.901 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-12T17:20:30.901 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-12T17:20:30.901 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-12T17:20:30.901 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-12T17:20:30.901 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-12T17:20:30.901 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-12T17:20:30.902 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-12T17:20:30.902 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-12T17:20:30.902 INFO:teuthology.orchestra.run.smithi044.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T17:20:30.902 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:20:30.902 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-12T17:20:30.902 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-12T17:20:30.902 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-12T17:20:30.902 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-12T17:20:30.902 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:20:30.902 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-12T17:20:30.902 INFO:teuthology.orchestra.run.smithi044.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T17:20:30.902 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrading: 2024-09-12T17:20:30.902 INFO:teuthology.orchestra.run.smithi044.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-12T17:20:30.903 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:20:30.903 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-09-12T17:20:30.903 INFO:teuthology.orchestra.run.smithi044.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T17:20:30.903 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T17:20:30.903 INFO:teuthology.orchestra.run.smithi044.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T17:20:30.903 INFO:teuthology.orchestra.run.smithi044.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T17:20:30.903 INFO:teuthology.orchestra.run.smithi044.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T17:20:30.903 INFO:teuthology.orchestra.run.smithi044.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T17:20:30.903 INFO:teuthology.orchestra.run.smithi044.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T17:20:30.903 INFO:teuthology.orchestra.run.smithi044.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T17:20:30.903 INFO:teuthology.orchestra.run.smithi044.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T17:20:30.903 INFO:teuthology.orchestra.run.smithi044.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T17:20:30.903 INFO:teuthology.orchestra.run.smithi044.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T17:20:30.904 INFO:teuthology.orchestra.run.smithi044.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T17:20:30.904 INFO:teuthology.orchestra.run.smithi044.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T17:20:30.904 INFO:teuthology.orchestra.run.smithi044.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T17:20:30.904 INFO:teuthology.orchestra.run.smithi044.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T17:20:30.904 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T17:20:30.904 INFO:teuthology.orchestra.run.smithi044.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T17:20:30.904 INFO:teuthology.orchestra.run.smithi044.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T17:20:30.904 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-12T17:20:30.904 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-12T17:20:30.904 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-12T17:20:30.904 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-12T17:20:30.904 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-12T17:20:30.905 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-12T17:20:30.905 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-12T17:20:30.905 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-12T17:20:30.905 INFO:teuthology.orchestra.run.smithi044.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T17:20:30.905 INFO:teuthology.orchestra.run.smithi044.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T17:20:30.905 INFO:teuthology.orchestra.run.smithi044.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T17:20:30.905 INFO:teuthology.orchestra.run.smithi044.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T17:20:30.905 INFO:teuthology.orchestra.run.smithi044.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T17:20:30.905 INFO:teuthology.orchestra.run.smithi044.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T17:20:30.905 INFO:teuthology.orchestra.run.smithi044.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T17:20:30.905 INFO:teuthology.orchestra.run.smithi044.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T17:20:30.905 INFO:teuthology.orchestra.run.smithi044.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T17:20:30.905 INFO:teuthology.orchestra.run.smithi044.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T17:20:30.906 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T17:20:30.906 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T17:20:30.906 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T17:20:30.906 INFO:teuthology.orchestra.run.smithi044.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T17:20:30.906 INFO:teuthology.orchestra.run.smithi044.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T17:20:30.906 INFO:teuthology.orchestra.run.smithi044.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T17:20:30.906 INFO:teuthology.orchestra.run.smithi044.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T17:20:30.906 INFO:teuthology.orchestra.run.smithi044.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T17:20:30.906 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T17:20:30.906 INFO:teuthology.orchestra.run.smithi044.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T17:20:30.906 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T17:20:30.906 INFO:teuthology.orchestra.run.smithi044.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T17:20:30.906 INFO:teuthology.orchestra.run.smithi044.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T17:20:30.907 INFO:teuthology.orchestra.run.smithi044.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T17:20:30.907 INFO:teuthology.orchestra.run.smithi044.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T17:20:30.907 INFO:teuthology.orchestra.run.smithi044.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T17:20:30.907 INFO:teuthology.orchestra.run.smithi044.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T17:20:30.907 INFO:teuthology.orchestra.run.smithi044.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T17:20:30.907 INFO:teuthology.orchestra.run.smithi044.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T17:20:30.907 INFO:teuthology.orchestra.run.smithi044.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T17:20:30.907 INFO:teuthology.orchestra.run.smithi044.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T17:20:30.907 INFO:teuthology.orchestra.run.smithi044.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T17:20:30.907 INFO:teuthology.orchestra.run.smithi044.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T17:20:30.907 INFO:teuthology.orchestra.run.smithi044.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T17:20:30.907 INFO:teuthology.orchestra.run.smithi044.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T17:20:30.908 INFO:teuthology.orchestra.run.smithi044.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T17:20:30.908 INFO:teuthology.orchestra.run.smithi044.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T17:20:30.908 INFO:teuthology.orchestra.run.smithi044.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T17:20:30.908 INFO:teuthology.orchestra.run.smithi044.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T17:20:30.908 INFO:teuthology.orchestra.run.smithi044.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T17:20:30.908 INFO:teuthology.orchestra.run.smithi044.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T17:20:30.908 INFO:teuthology.orchestra.run.smithi044.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T17:20:30.908 INFO:teuthology.orchestra.run.smithi044.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T17:20:30.908 INFO:teuthology.orchestra.run.smithi044.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T17:20:30.908 INFO:teuthology.orchestra.run.smithi044.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T17:20:30.908 INFO:teuthology.orchestra.run.smithi044.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T17:20:30.908 INFO:teuthology.orchestra.run.smithi044.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T17:20:30.909 INFO:teuthology.orchestra.run.smithi044.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T17:20:30.909 INFO:teuthology.orchestra.run.smithi044.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T17:20:30.909 INFO:teuthology.orchestra.run.smithi044.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T17:20:30.909 INFO:teuthology.orchestra.run.smithi044.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T17:20:30.909 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T17:20:30.909 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T17:20:30.909 INFO:teuthology.orchestra.run.smithi044.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T17:20:30.909 INFO:teuthology.orchestra.run.smithi044.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T17:20:30.909 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:20:30.909 INFO:teuthology.orchestra.run.smithi044.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T17:20:30.909 INFO:teuthology.orchestra.run.smithi044.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T17:20:30.909 INFO:teuthology.orchestra.run.smithi044.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T17:20:30.909 INFO:teuthology.orchestra.run.smithi044.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T17:20:30.910 INFO:teuthology.orchestra.run.smithi044.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T17:20:30.910 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T17:20:30.910 INFO:teuthology.orchestra.run.smithi044.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T17:20:30.910 INFO:teuthology.orchestra.run.smithi044.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T17:20:30.910 INFO:teuthology.orchestra.run.smithi044.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T17:20:30.910 INFO:teuthology.orchestra.run.smithi044.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T17:20:30.910 INFO:teuthology.orchestra.run.smithi044.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T17:20:30.910 INFO:teuthology.orchestra.run.smithi044.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T17:20:30.910 INFO:teuthology.orchestra.run.smithi044.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T17:20:30.910 INFO:teuthology.orchestra.run.smithi044.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T17:20:30.910 INFO:teuthology.orchestra.run.smithi044.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T17:20:30.910 INFO:teuthology.orchestra.run.smithi044.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T17:20:30.910 INFO:teuthology.orchestra.run.smithi044.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T17:20:30.911 INFO:teuthology.orchestra.run.smithi044.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T17:20:30.911 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T17:20:30.911 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T17:20:30.911 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T17:20:30.911 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-12T17:20:30.911 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T17:20:30.911 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:20:30.911 INFO:teuthology.orchestra.run.smithi044.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T17:20:30.911 INFO:teuthology.orchestra.run.smithi044.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T17:20:30.911 INFO:teuthology.orchestra.run.smithi044.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T17:20:30.911 INFO:teuthology.orchestra.run.smithi044.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T17:20:30.911 INFO:teuthology.orchestra.run.smithi044.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T17:20:30.912 INFO:teuthology.orchestra.run.smithi044.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T17:20:30.912 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T17:20:30.912 INFO:teuthology.orchestra.run.smithi044.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T17:20:30.912 INFO:teuthology.orchestra.run.smithi044.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T17:20:30.912 INFO:teuthology.orchestra.run.smithi044.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T17:20:30.912 INFO:teuthology.orchestra.run.smithi044.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T17:20:30.912 INFO:teuthology.orchestra.run.smithi044.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T17:20:30.912 INFO:teuthology.orchestra.run.smithi044.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T17:20:30.912 INFO:teuthology.orchestra.run.smithi044.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T17:20:30.912 INFO:teuthology.orchestra.run.smithi044.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T17:20:30.912 INFO:teuthology.orchestra.run.smithi044.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T17:20:30.912 INFO:teuthology.orchestra.run.smithi044.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T17:20:30.913 INFO:teuthology.orchestra.run.smithi044.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T17:20:30.913 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T17:20:30.913 INFO:teuthology.orchestra.run.smithi044.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T17:20:30.913 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T17:20:30.913 INFO:teuthology.orchestra.run.smithi044.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T17:20:30.913 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T17:20:30.913 INFO:teuthology.orchestra.run.smithi044.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T17:20:30.913 INFO:teuthology.orchestra.run.smithi044.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T17:20:30.913 INFO:teuthology.orchestra.run.smithi044.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T17:20:30.913 INFO:teuthology.orchestra.run.smithi044.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T17:20:30.913 INFO:teuthology.orchestra.run.smithi044.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T17:20:30.913 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T17:20:30.913 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T17:20:30.914 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T17:20:30.914 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T17:20:30.914 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T17:20:30.914 INFO:teuthology.orchestra.run.smithi044.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T17:20:30.914 INFO:teuthology.orchestra.run.smithi044.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T17:20:30.914 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T17:20:30.914 INFO:teuthology.orchestra.run.smithi044.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T17:20:30.914 INFO:teuthology.orchestra.run.smithi044.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T17:20:30.914 INFO:teuthology.orchestra.run.smithi044.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T17:20:30.914 INFO:teuthology.orchestra.run.smithi044.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T17:20:30.914 INFO:teuthology.orchestra.run.smithi044.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T17:20:30.914 INFO:teuthology.orchestra.run.smithi044.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T17:20:30.915 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T17:20:30.915 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T17:20:30.915 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T17:20:30.915 INFO:teuthology.orchestra.run.smithi044.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T17:20:30.915 INFO:teuthology.orchestra.run.smithi044.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T17:20:30.915 INFO:teuthology.orchestra.run.smithi044.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T17:20:30.915 INFO:teuthology.orchestra.run.smithi044.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T17:20:30.915 INFO:teuthology.orchestra.run.smithi044.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T17:20:30.915 INFO:teuthology.orchestra.run.smithi044.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T17:20:30.915 INFO:teuthology.orchestra.run.smithi044.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T17:20:30.915 INFO:teuthology.orchestra.run.smithi044.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T17:20:30.915 INFO:teuthology.orchestra.run.smithi044.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T17:20:30.915 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T17:20:30.915 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T17:20:30.916 INFO:teuthology.orchestra.run.smithi044.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T17:20:30.916 INFO:teuthology.orchestra.run.smithi044.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T17:20:30.916 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T17:20:30.916 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T17:20:30.916 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T17:20:30.916 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T17:20:30.916 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-12T17:20:30.916 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-12T17:20:30.916 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T17:20:30.916 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T17:20:30.916 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T17:20:30.916 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T17:20:30.916 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T17:20:30.916 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T17:20:30.917 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T17:20:30.917 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T17:20:30.917 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T17:20:30.917 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T17:20:30.917 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T17:20:30.917 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T17:20:30.917 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T17:20:30.917 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T17:20:30.917 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T17:20:30.917 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T17:20:30.917 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T17:20:30.917 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T17:20:30.917 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T17:20:30.917 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T17:20:30.918 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T17:20:30.918 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T17:20:30.918 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T17:20:30.918 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T17:20:30.918 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T17:20:30.918 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T17:20:30.918 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T17:20:30.918 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T17:20:30.918 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T17:20:30.918 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T17:20:30.918 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T17:20:30.918 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T17:20:30.918 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T17:20:30.919 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T17:20:30.919 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T17:20:30.919 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T17:20:30.919 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T17:20:30.919 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T17:20:30.919 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T17:20:30.919 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T17:20:30.919 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T17:20:30.919 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T17:20:30.919 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T17:20:30.919 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T17:20:30.919 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T17:20:30.919 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T17:20:30.919 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T17:20:30.920 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T17:20:30.920 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T17:20:30.920 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T17:20:30.920 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T17:20:30.920 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T17:20:30.920 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T17:20:30.920 INFO:teuthology.orchestra.run.smithi044.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T17:20:30.920 INFO:teuthology.orchestra.run.smithi044.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T17:20:30.920 INFO:teuthology.orchestra.run.smithi044.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T17:20:30.920 INFO:teuthology.orchestra.run.smithi044.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T17:20:30.920 INFO:teuthology.orchestra.run.smithi044.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T17:20:30.920 INFO:teuthology.orchestra.run.smithi044.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T17:20:30.920 INFO:teuthology.orchestra.run.smithi044.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T17:20:30.921 INFO:teuthology.orchestra.run.smithi044.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T17:20:30.921 INFO:teuthology.orchestra.run.smithi044.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T17:20:30.921 INFO:teuthology.orchestra.run.smithi044.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T17:20:30.921 INFO:teuthology.orchestra.run.smithi044.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T17:20:30.921 INFO:teuthology.orchestra.run.smithi044.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T17:20:30.921 INFO:teuthology.orchestra.run.smithi044.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T17:20:30.921 INFO:teuthology.orchestra.run.smithi044.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T17:20:30.921 INFO:teuthology.orchestra.run.smithi044.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T17:20:30.921 INFO:teuthology.orchestra.run.smithi044.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T17:20:30.921 INFO:teuthology.orchestra.run.smithi044.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T17:20:30.921 INFO:teuthology.orchestra.run.smithi044.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T17:20:30.921 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T17:20:30.921 INFO:teuthology.orchestra.run.smithi044.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T17:20:30.922 INFO:teuthology.orchestra.run.smithi044.stdout:Installing weak dependencies: 2024-09-12T17:20:30.922 INFO:teuthology.orchestra.run.smithi044.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T17:20:30.922 INFO:teuthology.orchestra.run.smithi044.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T17:20:30.922 INFO:teuthology.orchestra.run.smithi044.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T17:20:30.922 INFO:teuthology.orchestra.run.smithi044.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T17:20:30.922 INFO:teuthology.orchestra.run.smithi044.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T17:20:30.922 INFO:teuthology.orchestra.run.smithi044.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T17:20:30.922 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T17:20:30.922 INFO:teuthology.orchestra.run.smithi044.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T17:20:30.922 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T17:20:30.923 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T17:20:30.923 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T17:20:30.923 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T17:20:30.923 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T17:20:30.923 INFO:teuthology.orchestra.run.smithi044.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T17:20:30.923 INFO:teuthology.orchestra.run.smithi044.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T17:20:30.923 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:20:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-12T17:20:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================================== 2024-09-12T17:20:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:Install 283 Packages 2024-09-12T17:20:30.923 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrade 2 Packages 2024-09-12T17:20:30.923 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:20:30.924 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 322 M 2024-09-12T17:20:30.924 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-12T17:20:31.191 INFO:teuthology.orchestra.run.smithi181.stdout:(8/285): ceph-common-19.3.0-4762.gbad475c1.el9. 17 MB/s | 22 MB 00:01 2024-09-12T17:20:31.224 INFO:teuthology.orchestra.run.smithi181.stdout:(9/285): ceph-selinux-19.3.0-4762.gbad475c1.el9 759 kB/s | 25 kB 00:00 2024-09-12T17:20:31.608 INFO:teuthology.orchestra.run.smithi181.stdout:(10/285): ceph-osd-19.3.0-4762.gbad475c1.el9.x8 16 MB/s | 17 MB 00:01 2024-09-12T17:20:31.626 INFO:teuthology.orchestra.run.smithi044.stdout:(1/285): ceph-19.3.0-4762.gbad475c1.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-12T17:20:31.725 INFO:teuthology.orchestra.run.smithi181.stdout:(11/285): ceph-radosgw-19.3.0-4762.gbad475c1.el 12 MB/s | 11 MB 00:00 2024-09-12T17:20:31.750 INFO:teuthology.orchestra.run.smithi181.stdout:(12/285): libcephfs-devel-19.3.0-4762.gbad475c1 224 kB/s | 32 kB 00:00 2024-09-12T17:20:31.826 INFO:teuthology.orchestra.run.smithi181.stdout:(13/285): libcephfs2-19.3.0-4762.gbad475c1.el9. 7.4 MB/s | 756 kB 00:00 2024-09-12T17:20:31.851 INFO:teuthology.orchestra.run.smithi181.stdout:(14/285): libcephsqlite-19.3.0-4762.gbad475c1.e 1.6 MB/s | 161 kB 00:00 2024-09-12T17:20:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:(2/285): ceph-fuse-19.3.0-4762.gbad475c1.el9.x8 3.6 MB/s | 900 kB 00:00 2024-09-12T17:20:31.901 INFO:teuthology.orchestra.run.smithi181.stdout:(15/285): librados-devel-19.3.0-4762.gbad475c1. 1.6 MB/s | 126 kB 00:00 2024-09-12T17:20:31.926 INFO:teuthology.orchestra.run.smithi181.stdout:(16/285): libradosstriper1-19.3.0-4762.gbad475c 6.6 MB/s | 508 kB 00:00 2024-09-12T17:20:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:(3/285): ceph-immutable-object-cache-19.3.0-476 1.5 MB/s | 145 kB 00:00 2024-09-12T17:20:32.010 INFO:teuthology.orchestra.run.smithi181.stdout:(17/285): python3-ceph-argparse-19.3.0-4762.gba 542 kB/s | 45 kB 00:00 2024-09-12T17:20:32.110 INFO:teuthology.orchestra.run.smithi181.stdout:(18/285): python3-ceph-common-19.3.0-4762.gbad4 1.4 MB/s | 143 kB 00:00 2024-09-12T17:20:32.160 INFO:teuthology.orchestra.run.smithi044.stdout:(4/285): ceph-base-19.3.0-4762.gbad475c1.el9.x8 8.4 MB/s | 5.5 MB 00:00 2024-09-12T17:20:32.169 INFO:teuthology.orchestra.run.smithi181.stdout:(19/285): python3-cephfs-19.3.0-4762.gbad475c1. 2.7 MB/s | 161 kB 00:00 2024-09-12T17:20:32.278 INFO:teuthology.orchestra.run.smithi181.stdout:(20/285): python3-rados-19.3.0-4762.gbad475c1.e 2.9 MB/s | 321 kB 00:00 2024-09-12T17:20:32.378 INFO:teuthology.orchestra.run.smithi181.stdout:(21/285): python3-rbd-19.3.0-4762.gbad475c1.el9 3.0 MB/s | 305 kB 00:00 2024-09-12T17:20:32.402 INFO:teuthology.orchestra.run.smithi044.stdout:(5/285): ceph-mds-19.3.0-4762.gbad475c1.el9.x86 5.4 MB/s | 2.4 MB 00:00 2024-09-12T17:20:32.478 INFO:teuthology.orchestra.run.smithi181.stdout:(22/285): librgw2-19.3.0-4762.gbad475c1.el9.x86 9.5 MB/s | 5.5 MB 00:00 2024-09-12T17:20:32.511 INFO:teuthology.orchestra.run.smithi181.stdout:(23/285): python3-rgw-19.3.0-4762.gbad475c1.el9 746 kB/s | 99 kB 00:00 2024-09-12T17:20:32.554 INFO:teuthology.orchestra.run.smithi181.stdout:(24/285): rbd-fuse-19.3.0-4762.gbad475c1.el9.x8 1.1 MB/s | 85 kB 00:00 2024-09-12T17:20:32.586 INFO:teuthology.orchestra.run.smithi044.stdout:(6/285): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86 3.6 MB/s | 1.5 MB 00:00 2024-09-12T17:20:32.637 INFO:teuthology.orchestra.run.smithi181.stdout:(25/285): rbd-nbd-19.3.0-4762.gbad475c1.el9.x86 2.0 MB/s | 170 kB 00:00 2024-09-12T17:20:32.754 INFO:teuthology.orchestra.run.smithi181.stdout:(26/285): ceph-grafana-dashboards-19.3.0-4762.g 294 kB/s | 34 kB 00:00 2024-09-12T17:20:32.855 INFO:teuthology.orchestra.run.smithi181.stdout:(27/285): ceph-mgr-cephadm-19.3.0-4762.gbad475c 1.5 MB/s | 154 kB 00:00 2024-09-12T17:20:32.913 INFO:teuthology.orchestra.run.smithi181.stdout:(28/285): rbd-mirror-19.3.0-4762.gbad475c1.el9. 7.9 MB/s | 3.2 MB 00:00 2024-09-12T17:20:33.095 INFO:teuthology.orchestra.run.smithi044.stdout:(7/285): ceph-common-19.3.0-4762.gbad475c1.el9. 14 MB/s | 22 MB 00:01 2024-09-12T17:20:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:(8/285): ceph-mon-19.3.0-4762.gbad475c1.el9.x86 6.1 MB/s | 4.8 MB 00:00 2024-09-12T17:20:33.278 INFO:teuthology.orchestra.run.smithi044.stdout:(9/285): ceph-selinux-19.3.0-4762.gbad475c1.el9 275 kB/s | 25 kB 00:00 2024-09-12T17:20:33.655 INFO:teuthology.orchestra.run.smithi181.stdout:(29/285): ceph-mgr-diskprediction-local-19.3.0- 10 MB/s | 7.4 MB 00:00 2024-09-12T17:20:33.755 INFO:teuthology.orchestra.run.smithi181.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4762.gba 2.8 MB/s | 291 kB 00:00 2024-09-12T17:20:33.839 INFO:teuthology.orchestra.run.smithi181.stdout:(31/285): ceph-mgr-rook-19.3.0-4762.gbad475c1.e 592 kB/s | 49 kB 00:00 2024-09-12T17:20:33.914 INFO:teuthology.orchestra.run.smithi181.stdout:(32/285): ceph-prometheus-alerts-19.3.0-4762.gb 219 kB/s | 16 kB 00:00 2024-09-12T17:20:34.012 INFO:teuthology.orchestra.run.smithi044.stdout:(10/285): ceph-radosgw-19.3.0-4762.gbad475c1.el 12 MB/s | 11 MB 00:00 2024-09-12T17:20:34.056 INFO:teuthology.orchestra.run.smithi181.stdout:(33/285): ceph-mgr-dashboard-19.3.0-4762.gbad47 12 MB/s | 14 MB 00:01 2024-09-12T17:20:34.062 INFO:teuthology.orchestra.run.smithi044.stdout:(11/285): libcephfs-devel-19.3.0-4762.gbad475c1 637 kB/s | 32 kB 00:00 2024-09-12T17:20:34.082 INFO:teuthology.orchestra.run.smithi181.stdout:(34/285): ceph-volume-19.3.0-4762.gbad475c1.el9 1.7 MB/s | 285 kB 00:00 2024-09-12T17:20:34.123 INFO:teuthology.orchestra.run.smithi181.stdout:(35/285): cephadm-19.3.0-4762.gbad475c1.el9.noa 11 MB/s | 783 kB 00:00 2024-09-12T17:20:34.146 INFO:teuthology.orchestra.run.smithi044.stdout:(12/285): libcephfs2-19.3.0-4762.gbad475c1.el9. 8.9 MB/s | 756 kB 00:00 2024-09-12T17:20:34.205 INFO:teuthology.orchestra.run.smithi044.stdout:(13/285): libcephsqlite-19.3.0-4762.gbad475c1.e 2.7 MB/s | 161 kB 00:00 2024-09-12T17:20:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:(14/285): librados-devel-19.3.0-4762.gbad475c1. 2.5 MB/s | 126 kB 00:00 2024-09-12T17:20:34.265 INFO:teuthology.orchestra.run.smithi181.stdout:(36/285): bluez-libs-5.56-6.el9.x86_64.rpm 598 kB/s | 85 kB 00:00 2024-09-12T17:20:34.291 INFO:teuthology.orchestra.run.smithi181.stdout:(37/285): ModemManager-glib-1.20.2-1.el9.x86_64 1.6 MB/s | 335 kB 00:00 2024-09-12T17:20:34.324 INFO:teuthology.orchestra.run.smithi181.stdout:(38/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 845 kB/s | 49 kB 00:00 2024-09-12T17:20:34.350 INFO:teuthology.orchestra.run.smithi181.stdout:(39/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 4.4 MB/s | 262 kB 00:00 2024-09-12T17:20:34.447 INFO:teuthology.orchestra.run.smithi044.stdout:(15/285): ceph-osd-19.3.0-4762.gbad475c1.el9.x8 9.2 MB/s | 17 MB 00:01 2024-09-12T17:20:34.481 INFO:teuthology.orchestra.run.smithi044.stdout:(16/285): libradosstriper1-19.3.0-4762.gbad475c 2.2 MB/s | 508 kB 00:00 2024-09-12T17:20:34.523 INFO:teuthology.orchestra.run.smithi044.stdout:(17/285): python3-ceph-argparse-19.3.0-4762.gba 1.1 MB/s | 45 kB 00:00 2024-09-12T17:20:34.581 INFO:teuthology.orchestra.run.smithi044.stdout:(18/285): python3-ceph-common-19.3.0-4762.gbad4 2.4 MB/s | 143 kB 00:00 2024-09-12T17:20:34.640 INFO:teuthology.orchestra.run.smithi044.stdout:(19/285): python3-cephfs-19.3.0-4762.gbad475c1. 2.7 MB/s | 161 kB 00:00 2024-09-12T17:20:34.699 INFO:teuthology.orchestra.run.smithi044.stdout:(20/285): python3-rados-19.3.0-4762.gbad475c1.e 5.4 MB/s | 321 kB 00:00 2024-09-12T17:20:34.742 INFO:teuthology.orchestra.run.smithi181.stdout:(40/285): ceph-test-19.3.0-4762.gbad475c1.el9.x 13 MB/s | 45 MB 00:03 2024-09-12T17:20:34.767 INFO:teuthology.orchestra.run.smithi181.stdout:(41/285): fuse-2.9.9-16.el9.x86_64.rpm 180 kB/s | 80 kB 00:00 2024-09-12T17:20:34.799 INFO:teuthology.orchestra.run.smithi044.stdout:(21/285): librgw2-19.3.0-4762.gbad475c1.el9.x86 16 MB/s | 5.5 MB 00:00 2024-09-12T17:20:34.809 INFO:teuthology.orchestra.run.smithi181.stdout:(42/285): libgfortran-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 801 kB 00:00 2024-09-12T17:20:34.833 INFO:teuthology.orchestra.run.smithi044.stdout:(22/285): python3-rbd-19.3.0-4762.gbad475c1.el9 2.2 MB/s | 305 kB 00:00 2024-09-12T17:20:34.842 INFO:teuthology.orchestra.run.smithi181.stdout:(43/285): libpciaccess-0.16-7.el9.x86_64.rpm 268 kB/s | 27 kB 00:00 2024-09-12T17:20:34.858 INFO:teuthology.orchestra.run.smithi044.stdout:(23/285): python3-rgw-19.3.0-4762.gbad475c1.el9 1.7 MB/s | 99 kB 00:00 2024-09-12T17:20:34.876 INFO:teuthology.orchestra.run.smithi181.stdout:(44/285): libquadmath-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-09-12T17:20:34.883 INFO:teuthology.orchestra.run.smithi044.stdout:(24/285): rbd-fuse-19.3.0-4762.gbad475c1.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-12T17:20:34.901 INFO:teuthology.orchestra.run.smithi181.stdout:(45/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.0 MB/s | 94 kB 00:00 2024-09-12T17:20:34.950 INFO:teuthology.orchestra.run.smithi044.stdout:(25/285): rbd-nbd-19.3.0-4762.gbad475c1.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-12T17:20:34.952 INFO:teuthology.orchestra.run.smithi181.stdout:(46/285): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T17:20:34.977 INFO:teuthology.orchestra.run.smithi181.stdout:(47/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.8 MB/s | 253 kB 00:00 2024-09-12T17:20:35.000 INFO:teuthology.orchestra.run.smithi044.stdout:(26/285): ceph-grafana-dashboards-19.3.0-4762.g 686 kB/s | 34 kB 00:00 2024-09-12T17:20:35.002 INFO:teuthology.orchestra.run.smithi181.stdout:(48/285): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T17:20:35.036 INFO:teuthology.orchestra.run.smithi181.stdout:(49/285): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-09-12T17:20:35.078 INFO:teuthology.orchestra.run.smithi181.stdout:(50/285): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-12T17:20:35.084 INFO:teuthology.orchestra.run.smithi044.stdout:(27/285): rbd-mirror-19.3.0-4762.gbad475c1.el9. 14 MB/s | 3.2 MB 00:00 2024-09-12T17:20:35.109 INFO:teuthology.orchestra.run.smithi044.stdout:(28/285): ceph-mgr-cephadm-19.3.0-4762.gbad475c 1.4 MB/s | 154 kB 00:00 2024-09-12T17:20:35.111 INFO:teuthology.orchestra.run.smithi181.stdout:(51/285): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-12T17:20:35.245 INFO:teuthology.orchestra.run.smithi181.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 3.0 MB/s | 650 kB 00:00 2024-09-12T17:20:35.287 INFO:teuthology.orchestra.run.smithi181.stdout:(53/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.9 MB/s | 523 kB 00:00 2024-09-12T17:20:35.312 INFO:teuthology.orchestra.run.smithi181.stdout:(54/285): apache-commons-cli-1.4-17.el9.noarch. 1.0 MB/s | 71 kB 00:00 2024-09-12T17:20:35.346 INFO:teuthology.orchestra.run.smithi181.stdout:(55/285): apache-commons-codec-1.15-7.el9.noarc 5.0 MB/s | 302 kB 00:00 2024-09-12T17:20:35.371 INFO:teuthology.orchestra.run.smithi181.stdout:(56/285): apache-commons-io-2.8.0-8.el9.noarch. 4.7 MB/s | 283 kB 00:00 2024-09-12T17:20:35.430 INFO:teuthology.orchestra.run.smithi181.stdout:(57/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T17:20:35.484 INFO:teuthology.orchestra.run.smithi044.stdout:(29/285): ceph-mgr-diskprediction-local-19.3.0- 20 MB/s | 7.4 MB 00:00 2024-09-12T17:20:35.514 INFO:teuthology.orchestra.run.smithi181.stdout:(58/285): apache-commons-lang3-3.12.0-6.el9.noa 3.3 MB/s | 559 kB 00:00 2024-09-12T17:20:35.539 INFO:teuthology.orchestra.run.smithi181.stdout:(59/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-09-12T17:20:35.543 INFO:teuthology.orchestra.run.smithi044.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4762.gba 4.9 MB/s | 291 kB 00:00 2024-09-12T17:20:35.564 INFO:teuthology.orchestra.run.smithi181.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 464 kB/s | 23 kB 00:00 2024-09-12T17:20:35.589 INFO:teuthology.orchestra.run.smithi181.stdout:(61/285): atk-2.36.0-5.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T17:20:35.593 INFO:teuthology.orchestra.run.smithi044.stdout:(31/285): ceph-mgr-rook-19.3.0-4762.gbad475c1.e 987 kB/s | 49 kB 00:00 2024-09-12T17:20:35.615 INFO:teuthology.orchestra.run.smithi181.stdout:(62/285): avahi-glib-0.8-21.el9.x86_64.rpm 296 kB/s | 15 kB 00:00 2024-09-12T17:20:35.643 INFO:teuthology.orchestra.run.smithi044.stdout:(32/285): ceph-prometheus-alerts-19.3.0-4762.gb 329 kB/s | 16 kB 00:00 2024-09-12T17:20:35.665 INFO:teuthology.orchestra.run.smithi181.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-12T17:20:35.690 INFO:teuthology.orchestra.run.smithi181.stdout:(64/285): cdi-api-2.0.2-6.el9.noarch.rpm 712 kB/s | 53 kB 00:00 2024-09-12T17:20:35.702 INFO:teuthology.orchestra.run.smithi044.stdout:(33/285): ceph-volume-19.3.0-4762.gbad475c1.el9 4.8 MB/s | 285 kB 00:00 2024-09-12T17:20:35.732 INFO:teuthology.orchestra.run.smithi181.stdout:(65/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.4 MB/s | 61 kB 00:00 2024-09-12T17:20:35.774 INFO:teuthology.orchestra.run.smithi181.stdout:(66/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 679 kB/s | 28 kB 00:00 2024-09-12T17:20:35.777 INFO:teuthology.orchestra.run.smithi044.stdout:(34/285): cephadm-19.3.0-4762.gbad475c1.el9.noa 10 MB/s | 783 kB 00:00 2024-09-12T17:20:35.808 INFO:teuthology.orchestra.run.smithi181.stdout:(67/285): colord-libs-1.4.5-4.el9.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2024-09-12T17:20:35.850 INFO:teuthology.orchestra.run.smithi181.stdout:(68/285): dconf-0.40.0-6.el9.x86_64.rpm 1.5 MB/s | 113 kB 00:00 2024-09-12T17:20:35.900 INFO:teuthology.orchestra.run.smithi181.stdout:(69/285): exempi-2.6.0-0.2.20211007gite23c213.e 5.6 MB/s | 525 kB 00:00 2024-09-12T17:20:35.995 INFO:teuthology.orchestra.run.smithi044.stdout:(35/285): ceph-mgr-dashboard-19.3.0-4762.gbad47 16 MB/s | 14 MB 00:00 2024-09-12T17:20:36.000 INFO:teuthology.orchestra.run.smithi181.stdout:(70/285): exiv2-0.27.5-2.el9.x86_64.rpm 6.4 MB/s | 980 kB 00:00 2024-09-12T17:20:36.117 INFO:teuthology.orchestra.run.smithi181.stdout:(71/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 2.7 MB/s | 325 kB 00:00 2024-09-12T17:20:36.168 INFO:teuthology.orchestra.run.smithi181.stdout:(72/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 2.9 MB/s | 781 kB 00:00 2024-09-12T17:20:36.201 INFO:teuthology.orchestra.run.smithi181.stdout:(73/285): flac-libs-1.3.3-12.el9.x86_64.rpm 2.5 MB/s | 218 kB 00:00 2024-09-12T17:20:36.244 INFO:teuthology.orchestra.run.smithi181.stdout:(74/285): flatpak-selinux-1.12.9-1.el9.noarch.r 520 kB/s | 22 kB 00:00 2024-09-12T17:20:36.302 INFO:teuthology.orchestra.run.smithi181.stdout:(75/285): flatpak-session-helper-1.12.9-1.el9.x 1.2 MB/s | 73 kB 00:00 2024-09-12T17:20:36.336 INFO:teuthology.orchestra.run.smithi181.stdout:(76/285): flexiblas-3.0.4-8.el9.x86_64.rpm 982 kB/s | 33 kB 00:00 2024-09-12T17:20:36.453 INFO:teuthology.orchestra.run.smithi044.stdout:(36/285): bluez-libs-5.56-6.el9.x86_64.rpm 185 kB/s | 85 kB 00:00 2024-09-12T17:20:36.570 INFO:teuthology.orchestra.run.smithi044.stdout:(37/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 424 kB/s | 49 kB 00:00 2024-09-12T17:20:36.595 INFO:teuthology.orchestra.run.smithi044.stdout:(38/285): ModemManager-glib-1.20.2-1.el9.x86_64 410 kB/s | 335 kB 00:00 2024-09-12T17:20:36.729 INFO:teuthology.orchestra.run.smithi044.stdout:(39/285): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-09-12T17:20:36.736 INFO:teuthology.orchestra.run.smithi181.stdout:(77/285): flatpak-1.12.9-1.el9.x86_64.rpm 3.0 MB/s | 1.7 MB 00:00 2024-09-12T17:20:36.770 INFO:teuthology.orchestra.run.smithi181.stdout:(78/285): flexiblas-openblas-openmp-3.0.4-8.el9 550 kB/s | 18 kB 00:00 2024-09-12T17:20:36.828 INFO:teuthology.orchestra.run.smithi181.stdout:(79/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.5 MB/s | 89 kB 00:00 2024-09-12T17:20:36.862 INFO:teuthology.orchestra.run.smithi044.stdout:(40/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 897 kB/s | 262 kB 00:00 2024-09-12T17:20:36.887 INFO:teuthology.orchestra.run.smithi181.stdout:(80/285): geoclue2-2.6.0-7.el9.x86_64.rpm 2.1 MB/s | 124 kB 00:00 2024-09-12T17:20:36.920 INFO:teuthology.orchestra.run.smithi181.stdout:(81/285): giflib-5.2.1-9.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-12T17:20:36.980 INFO:teuthology.orchestra.run.smithi044.stdout:(41/285): libpciaccess-0.16-7.el9.x86_64.rpm 230 kB/s | 27 kB 00:00 2024-09-12T17:20:37.071 INFO:teuthology.orchestra.run.smithi181.stdout:(82/285): google-guice-4.2.3-9.el9.noarch.rpm 3.1 MB/s | 473 kB 00:00 2024-09-12T17:20:37.129 INFO:teuthology.orchestra.run.smithi181.stdout:(83/285): graphene-1.10.6-2.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-12T17:20:37.171 INFO:teuthology.orchestra.run.smithi181.stdout:(84/285): gsm-1.0.19-6.el9.x86_64.rpm 819 kB/s | 34 kB 00:00 2024-09-12T17:20:37.222 INFO:teuthology.orchestra.run.smithi181.stdout:(85/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.4 MB/s | 3.0 MB 00:00 2024-09-12T17:20:37.464 INFO:teuthology.orchestra.run.smithi044.stdout:(42/285): ceph-test-19.3.0-4762.gbad475c1.el9.x 11 MB/s | 45 MB 00:04 2024-09-12T17:20:37.488 INFO:teuthology.orchestra.run.smithi044.stdout:(43/285): libquadmath-11.5.0-2.el9.x86_64.rpm 376 kB/s | 191 kB 00:00 2024-09-12T17:20:37.530 INFO:teuthology.orchestra.run.smithi044.stdout:(44/285): libgfortran-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 801 kB 00:00 2024-09-12T17:20:37.614 INFO:teuthology.orchestra.run.smithi181.stdout:(86/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 3.2 MB/s | 1.4 MB 00:00 2024-09-12T17:20:37.656 INFO:teuthology.orchestra.run.smithi181.stdout:(87/285): gtk-update-icon-cache-3.24.31-5.el9.x 795 kB/s | 33 kB 00:00 2024-09-12T17:20:37.689 INFO:teuthology.orchestra.run.smithi044.stdout:(45/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-12T17:20:37.814 INFO:teuthology.orchestra.run.smithi044.stdout:(46/285): python3-ply-3.11-14.el9.noarch.rpm 851 kB/s | 106 kB 00:00 2024-09-12T17:20:37.864 INFO:teuthology.orchestra.run.smithi181.stdout:(88/285): gstreamer1-plugins-base-1.22.1-2.el9. 3.5 MB/s | 2.2 MB 00:00 2024-09-12T17:20:37.923 INFO:teuthology.orchestra.run.smithi044.stdout:(47/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 205 kB/s | 94 kB 00:00 2024-09-12T17:20:37.948 INFO:teuthology.orchestra.run.smithi044.stdout:(48/285): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-09-12T17:20:38.066 INFO:teuthology.orchestra.run.smithi044.stdout:(49/285): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-12T17:20:38.099 INFO:teuthology.orchestra.run.smithi044.stdout:(50/285): python3-cryptography-36.0.1-4.el9.x86 2.2 MB/s | 1.2 MB 00:00 2024-09-12T17:20:38.124 INFO:teuthology.orchestra.run.smithi044.stdout:(51/285): python3-requests-2.25.1-8.el9.noarch. 622 kB/s | 125 kB 00:00 2024-09-12T17:20:38.266 INFO:teuthology.orchestra.run.smithi044.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 3.2 MB/s | 650 kB 00:00 2024-09-12T17:20:38.341 INFO:teuthology.orchestra.run.smithi044.stdout:(53/285): apache-commons-cli-1.4-17.el9.noarch. 946 kB/s | 71 kB 00:00 2024-09-12T17:20:38.417 INFO:teuthology.orchestra.run.smithi044.stdout:(54/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 1.8 MB/s | 523 kB 00:00 2024-09-12T17:20:38.442 INFO:teuthology.orchestra.run.smithi044.stdout:(55/285): apache-commons-codec-1.15-7.el9.noarc 2.9 MB/s | 302 kB 00:00 2024-09-12T17:20:38.481 INFO:teuthology.orchestra.run.smithi181.stdout:(89/285): guava-30.1-6.el9.noarch.rpm 3.8 MB/s | 2.3 MB 00:00 2024-09-12T17:20:38.584 INFO:teuthology.orchestra.run.smithi044.stdout:(56/285): adwaita-icon-theme-40.1.1-3.el9.noarc 25 MB/s | 12 MB 00:00 2024-09-12T17:20:38.606 INFO:teuthology.orchestra.run.smithi181.stdout:(90/285): adwaita-icon-theme-40.1.1-3.el9.noarc 3.4 MB/s | 12 MB 00:03 2024-09-12T17:20:38.609 INFO:teuthology.orchestra.run.smithi044.stdout:(57/285): apache-commons-io-2.8.0-8.el9.noarch. 1.4 MB/s | 283 kB 00:00 2024-09-12T17:20:38.631 INFO:teuthology.orchestra.run.smithi181.stdout:(91/285): hicolor-icon-theme-0.17-13.el9.noarch 1.4 MB/s | 219 kB 00:00 2024-09-12T17:20:38.643 INFO:teuthology.orchestra.run.smithi044.stdout:(58/285): apache-commons-lang3-3.12.0-6.el9.noa 2.7 MB/s | 559 kB 00:00 2024-09-12T17:20:38.668 INFO:teuthology.orchestra.run.smithi044.stdout:(59/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2024-09-12T17:20:38.710 INFO:teuthology.orchestra.run.smithi044.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 347 kB/s | 23 kB 00:00 2024-09-12T17:20:38.735 INFO:teuthology.orchestra.run.smithi044.stdout:(61/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-09-12T17:20:38.760 INFO:teuthology.orchestra.run.smithi044.stdout:(62/285): atk-2.36.0-5.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-12T17:20:38.786 INFO:teuthology.orchestra.run.smithi044.stdout:(63/285): avahi-glib-0.8-21.el9.x86_64.rpm 197 kB/s | 15 kB 00:00 2024-09-12T17:20:38.819 INFO:teuthology.orchestra.run.smithi044.stdout:(64/285): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 107 kB 00:00 2024-09-12T17:20:38.824 INFO:teuthology.orchestra.run.smithi181.stdout:(92/285): httpcomponents-client-4.5.13-3.el9.no 3.0 MB/s | 657 kB 00:00 2024-09-12T17:20:38.844 INFO:teuthology.orchestra.run.smithi044.stdout:(65/285): cdi-api-2.0.2-6.el9.noarch.rpm 636 kB/s | 53 kB 00:00 2024-09-12T17:20:38.865 INFO:teuthology.orchestra.run.smithi181.stdout:(93/285): httpcomponents-core-4.4.13-7.el9.noar 2.6 MB/s | 632 kB 00:00 2024-09-12T17:20:38.878 INFO:teuthology.orchestra.run.smithi044.stdout:(66/285): colord-libs-1.4.5-4.el9.x86_64.rpm 2.4 MB/s | 229 kB 00:00 2024-09-12T17:20:38.903 INFO:teuthology.orchestra.run.smithi044.stdout:(67/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 730 kB/s | 61 kB 00:00 2024-09-12T17:20:38.907 INFO:teuthology.orchestra.run.smithi181.stdout:(94/285): jakarta-annotations-1.3.5-13.el9.noar 1.1 MB/s | 45 kB 00:00 2024-09-12T17:20:38.929 INFO:teuthology.orchestra.run.smithi044.stdout:(68/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 336 kB/s | 28 kB 00:00 2024-09-12T17:20:38.954 INFO:teuthology.orchestra.run.smithi044.stdout:(69/285): dconf-0.40.0-6.el9.x86_64.rpm 1.5 MB/s | 113 kB 00:00 2024-09-12T17:20:38.966 INFO:teuthology.orchestra.run.smithi181.stdout:(95/285): jansi-2.3.3-6.el9.x86_64.rpm 1.8 MB/s | 110 kB 00:00 2024-09-12T17:20:39.013 INFO:teuthology.orchestra.run.smithi044.stdout:(70/285): exempi-2.6.0-0.2.20211007gite23c213.e 4.7 MB/s | 525 kB 00:00 2024-09-12T17:20:39.046 INFO:teuthology.orchestra.run.smithi044.stdout:(71/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 8.3 MB/s | 781 kB 00:00 2024-09-12T17:20:39.088 INFO:teuthology.orchestra.run.smithi044.stdout:(72/285): exiv2-0.27.5-2.el9.x86_64.rpm 6.0 MB/s | 980 kB 00:00 2024-09-12T17:20:39.099 INFO:teuthology.orchestra.run.smithi181.stdout:(96/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 3.0 MB/s | 413 kB 00:00 2024-09-12T17:20:39.113 INFO:teuthology.orchestra.run.smithi044.stdout:(73/285): flac-libs-1.3.3-12.el9.x86_64.rpm 3.2 MB/s | 218 kB 00:00 2024-09-12T17:20:39.139 INFO:teuthology.orchestra.run.smithi044.stdout:(74/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 2.5 MB/s | 325 kB 00:00 2024-09-12T17:20:39.181 INFO:teuthology.orchestra.run.smithi044.stdout:(75/285): flatpak-selinux-1.12.9-1.el9.noarch.r 322 kB/s | 22 kB 00:00 2024-09-12T17:20:39.200 INFO:teuthology.orchestra.run.smithi181.stdout:(97/285): gtk3-3.24.31-5.el9.x86_64.rpm 3.2 MB/s | 4.9 MB 00:01 2024-09-12T17:20:39.278 INFO:teuthology.orchestra.run.smithi044.stdout:(76/285): flatpak-1.12.9-1.el9.x86_64.rpm 9.1 MB/s | 1.7 MB 00:00 2024-09-12T17:20:39.283 INFO:teuthology.orchestra.run.smithi181.stdout:(98/285): iso-codes-4.6.0-3.el9.noarch.rpm 7.7 MB/s | 3.5 MB 00:00 2024-09-12T17:20:39.306 INFO:teuthology.orchestra.run.smithi044.stdout:(77/285): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-12T17:20:39.332 INFO:teuthology.orchestra.run.smithi044.stdout:(78/285): flatpak-session-helper-1.12.9-1.el9.x 379 kB/s | 73 kB 00:00 2024-09-12T17:20:39.333 INFO:teuthology.orchestra.run.smithi181.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 261 kB/s | 13 kB 00:00 2024-09-12T17:20:39.375 INFO:teuthology.orchestra.run.smithi181.stdout:(100/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.2 MB/s | 53 kB 00:00 2024-09-12T17:20:39.409 INFO:teuthology.orchestra.run.smithi044.stdout:(79/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 23 MB/s | 3.0 MB 00:00 2024-09-12T17:20:39.417 INFO:teuthology.orchestra.run.smithi181.stdout:(101/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 579 kB/s | 24 kB 00:00 2024-09-12T17:20:39.424 INFO:teuthology.orchestra.run.smithi044.stdout:(80/285): flexiblas-openblas-openmp-3.0.4-8.el9 155 kB/s | 18 kB 00:00 2024-09-12T17:20:39.449 INFO:teuthology.orchestra.run.smithi044.stdout:(81/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 759 kB/s | 89 kB 00:00 2024-09-12T17:20:39.459 INFO:teuthology.orchestra.run.smithi181.stdout:(102/285): jsoup-1.13.1-10.el9.noarch.rpm 8.8 MB/s | 377 kB 00:00 2024-09-12T17:20:39.483 INFO:teuthology.orchestra.run.smithi044.stdout:(82/285): geoclue2-2.6.0-7.el9.x86_64.rpm 1.6 MB/s | 124 kB 00:00 2024-09-12T17:20:39.500 INFO:teuthology.orchestra.run.smithi044.stdout:(83/285): giflib-5.2.1-9.el9.x86_64.rpm 641 kB/s | 49 kB 00:00 2024-09-12T17:20:39.501 INFO:teuthology.orchestra.run.smithi181.stdout:(103/285): jsr-305-3.0.2-6.el9.noarch.rpm 854 kB/s | 35 kB 00:00 2024-09-12T17:20:39.535 INFO:teuthology.orchestra.run.smithi181.stdout:(104/285): lcms2-2.12-3.el9.x86_64.rpm 4.9 MB/s | 168 kB 00:00 2024-09-12T17:20:39.542 INFO:teuthology.orchestra.run.smithi044.stdout:(84/285): google-guice-4.2.3-9.el9.noarch.rpm 5.0 MB/s | 473 kB 00:00 2024-09-12T17:20:39.567 INFO:teuthology.orchestra.run.smithi044.stdout:(85/285): graphene-1.10.6-2.el9.x86_64.rpm 770 kB/s | 64 kB 00:00 2024-09-12T17:20:39.577 INFO:teuthology.orchestra.run.smithi181.stdout:(105/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 267 kB/s | 11 kB 00:00 2024-09-12T17:20:39.592 INFO:teuthology.orchestra.run.smithi044.stdout:(86/285): gsm-1.0.19-6.el9.x86_64.rpm 369 kB/s | 34 kB 00:00 2024-09-12T17:20:39.619 INFO:teuthology.orchestra.run.smithi181.stdout:(106/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 581 kB/s | 24 kB 00:00 2024-09-12T17:20:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:(87/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-12T17:20:39.661 INFO:teuthology.orchestra.run.smithi181.stdout:(107/285): libXcursor-1.2.0-7.el9.x86_64.rpm 738 kB/s | 31 kB 00:00 2024-09-12T17:20:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:(88/285): gtk-update-icon-cache-3.24.31-5.el9.x 440 kB/s | 33 kB 00:00 2024-09-12T17:20:39.702 INFO:teuthology.orchestra.run.smithi181.stdout:(108/285): libXdamage-1.1.5-7.el9.x86_64.rpm 551 kB/s | 23 kB 00:00 2024-09-12T17:20:39.726 INFO:teuthology.orchestra.run.smithi044.stdout:(89/285): gstreamer1-plugins-base-1.22.1-2.el9. 14 MB/s | 2.2 MB 00:00 2024-09-12T17:20:39.744 INFO:teuthology.orchestra.run.smithi181.stdout:(109/285): libXfixes-5.0.3-16.el9.x86_64.rpm 476 kB/s | 20 kB 00:00 2024-09-12T17:20:39.823 INFO:teuthology.orchestra.run.smithi181.stdout:(110/285): libXi-1.7.10-8.el9.x86_64.rpm 953 kB/s | 40 kB 00:00 2024-09-12T17:20:39.823 INFO:teuthology.orchestra.run.smithi044.stdout:(90/285): guava-30.1-6.el9.noarch.rpm 20 MB/s | 2.3 MB 00:00 2024-09-12T17:20:39.823 INFO:teuthology.orchestra.run.smithi044.stdout:(91/285): hicolor-icon-theme-0.17-13.el9.noarch 2.6 MB/s | 219 kB 00:00 2024-09-12T17:20:39.828 INFO:teuthology.orchestra.run.smithi181.stdout:(111/285): libXinerama-1.1.4-10.el9.x86_64.rpm 361 kB/s | 15 kB 00:00 2024-09-12T17:20:39.870 INFO:teuthology.orchestra.run.smithi181.stdout:(112/285): libXrandr-1.5.2-8.el9.x86_64.rpm 685 kB/s | 28 kB 00:00 2024-09-12T17:20:39.885 INFO:teuthology.orchestra.run.smithi044.stdout:(92/285): gtk3-3.24.31-5.el9.x86_64.rpm 20 MB/s | 4.9 MB 00:00 2024-09-12T17:20:39.912 INFO:teuthology.orchestra.run.smithi181.stdout:(113/285): libXtst-1.2.3-16.el9.x86_64.rpm 516 kB/s | 21 kB 00:00 2024-09-12T17:20:39.919 INFO:teuthology.orchestra.run.smithi044.stdout:(93/285): httpcomponents-core-4.4.13-7.el9.noar 5.7 MB/s | 632 kB 00:00 2024-09-12T17:20:39.944 INFO:teuthology.orchestra.run.smithi044.stdout:(94/285): httpcomponents-client-4.5.13-3.el9.no 4.0 MB/s | 657 kB 00:00 2024-09-12T17:20:39.954 INFO:teuthology.orchestra.run.smithi181.stdout:(114/285): libXv-1.0.11-16.el9.x86_64.rpm 458 kB/s | 19 kB 00:00 2024-09-12T17:20:39.986 INFO:teuthology.orchestra.run.smithi044.stdout:(95/285): jakarta-annotations-1.3.5-13.el9.noar 673 kB/s | 45 kB 00:00 2024-09-12T17:20:39.996 INFO:teuthology.orchestra.run.smithi181.stdout:(115/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 452 kB/s | 19 kB 00:00 2024-09-12T17:20:40.030 INFO:teuthology.orchestra.run.smithi181.stdout:(116/285): libasyncns-0.8-22.el9.x86_64.rpm 916 kB/s | 30 kB 00:00 2024-09-12T17:20:40.062 INFO:teuthology.orchestra.run.smithi044.stdout:(96/285): iso-codes-4.6.0-3.el9.noarch.rpm 20 MB/s | 3.5 MB 00:00 2024-09-12T17:20:40.072 INFO:teuthology.orchestra.run.smithi181.stdout:(117/285): libcanberra-0.30-27.el9.x86_64.rpm 2.0 MB/s | 86 kB 00:00 2024-09-12T17:20:40.087 INFO:teuthology.orchestra.run.smithi044.stdout:(97/285): jansi-2.3.3-6.el9.x86_64.rpm 771 kB/s | 110 kB 00:00 2024-09-12T17:20:40.106 INFO:teuthology.orchestra.run.smithi181.stdout:(118/285): libcanberra-gtk3-0.30-27.el9.x86_64. 960 kB/s | 32 kB 00:00 2024-09-12T17:20:40.112 INFO:teuthology.orchestra.run.smithi044.stdout:(98/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 3.2 MB/s | 413 kB 00:00 2024-09-12T17:20:40.148 INFO:teuthology.orchestra.run.smithi181.stdout:(119/285): libdrm-2.4.121-1.el9.x86_64.rpm 3.8 MB/s | 161 kB 00:00 2024-09-12T17:20:40.179 INFO:teuthology.orchestra.run.smithi044.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 196 kB/s | 13 kB 00:00 2024-09-12T17:20:40.190 INFO:teuthology.orchestra.run.smithi181.stdout:(120/285): libepoxy-1.5.5-4.el9.x86_64.rpm 5.7 MB/s | 241 kB 00:00 2024-09-12T17:20:40.232 INFO:teuthology.orchestra.run.smithi181.stdout:(121/285): libexif-0.6.22-6.el9.x86_64.rpm 10 MB/s | 435 kB 00:00 2024-09-12T17:20:40.247 INFO:teuthology.orchestra.run.smithi044.stdout:(100/285): java-11-openjdk-devel-11.0.20.1.1-2. 18 MB/s | 3.3 MB 00:00 2024-09-12T17:20:40.265 INFO:teuthology.orchestra.run.smithi181.stdout:(122/285): libfontenc-1.1.3-17.el9.x86_64.rpm 939 kB/s | 31 kB 00:00 2024-09-12T17:20:40.271 INFO:teuthology.orchestra.run.smithi044.stdout:(101/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 576 kB/s | 53 kB 00:00 2024-09-12T17:20:40.299 INFO:teuthology.orchestra.run.smithi181.stdout:(123/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2024-09-12T17:20:40.330 INFO:teuthology.orchestra.run.smithi044.stdout:(102/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 288 kB/s | 24 kB 00:00 2024-09-12T17:20:40.349 INFO:teuthology.orchestra.run.smithi181.stdout:(124/285): java-11-openjdk-devel-11.0.20.1.1-2. 2.7 MB/s | 3.3 MB 00:01 2024-09-12T17:20:40.355 INFO:teuthology.orchestra.run.smithi044.stdout:(103/285): jsoup-1.13.1-10.el9.noarch.rpm 4.4 MB/s | 377 kB 00:00 2024-09-12T17:20:40.391 INFO:teuthology.orchestra.run.smithi181.stdout:(125/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 885 kB/s | 37 kB 00:00 2024-09-12T17:20:40.406 INFO:teuthology.orchestra.run.smithi044.stdout:(104/285): jsr-305-3.0.2-6.el9.noarch.rpm 473 kB/s | 35 kB 00:00 2024-09-12T17:20:40.416 INFO:teuthology.orchestra.run.smithi181.stdout:(126/285): libglvnd-1.3.4-1.el9.x86_64.rpm 1.1 MB/s | 135 kB 00:00 2024-09-12T17:20:40.431 INFO:teuthology.orchestra.run.smithi044.stdout:(105/285): lcms2-2.12-3.el9.x86_64.rpm 2.2 MB/s | 168 kB 00:00 2024-09-12T17:20:40.458 INFO:teuthology.orchestra.run.smithi181.stdout:(127/285): libgsf-1.14.47-5.el9.x86_64.rpm 6.0 MB/s | 256 kB 00:00 2024-09-12T17:20:40.482 INFO:teuthology.orchestra.run.smithi044.stdout:(106/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 147 kB/s | 11 kB 00:00 2024-09-12T17:20:40.484 INFO:teuthology.orchestra.run.smithi181.stdout:(128/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.5 MB/s | 142 kB 00:00 2024-09-12T17:20:40.506 INFO:teuthology.orchestra.run.smithi044.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 321 kB/s | 24 kB 00:00 2024-09-12T17:20:40.509 INFO:teuthology.orchestra.run.smithi181.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-09-12T17:20:40.534 INFO:teuthology.orchestra.run.smithi181.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-12T17:20:40.559 INFO:teuthology.orchestra.run.smithi181.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 824 kB/s | 41 kB 00:00 2024-09-12T17:20:40.565 INFO:teuthology.orchestra.run.smithi044.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 368 kB/s | 31 kB 00:00 2024-09-12T17:20:40.585 INFO:teuthology.orchestra.run.smithi181.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 871 kB/s | 44 kB 00:00 2024-09-12T17:20:40.591 INFO:teuthology.orchestra.run.smithi044.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 273 kB/s | 23 kB 00:00 2024-09-12T17:20:40.626 INFO:teuthology.orchestra.run.smithi181.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 501 kB/s | 34 kB 00:00 2024-09-12T17:20:40.657 INFO:teuthology.orchestra.run.smithi044.stdout:(110/285): libXi-1.7.10-8.el9.x86_64.rpm 595 kB/s | 40 kB 00:00 2024-09-12T17:20:40.683 INFO:teuthology.orchestra.run.smithi044.stdout:(111/285): libXfixes-5.0.3-16.el9.x86_64.rpm 169 kB/s | 20 kB 00:00 2024-09-12T17:20:40.685 INFO:teuthology.orchestra.run.smithi181.stdout:(134/285): libosinfo-1.10.0-1.el9.x86_64.rpm 3.1 MB/s | 319 kB 00:00 2024-09-12T17:20:40.702 INFO:teuthology.orchestra.run.smithi181.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-12T17:20:40.747 INFO:teuthology.orchestra.run.smithi181.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 733 kB/s | 45 kB 00:00 2024-09-12T17:20:40.778 INFO:teuthology.orchestra.run.smithi181.stdout:(137/285): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-12T17:20:40.828 INFO:teuthology.orchestra.run.smithi181.stdout:(138/285): libsbc-1.4-9.el9.x86_64.rpm 558 kB/s | 45 kB 00:00 2024-09-12T17:20:40.853 INFO:teuthology.orchestra.run.smithi181.stdout:(139/285): libsndfile-1.0.31-8.el9.x86_64.rpm 2.7 MB/s | 206 kB 00:00 2024-09-12T17:20:40.887 INFO:teuthology.orchestra.run.smithi181.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-09-12T17:20:40.912 INFO:teuthology.orchestra.run.smithi181.stdout:(141/285): libtiff-4.4.0-13.el9.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2024-09-12T17:20:40.938 INFO:teuthology.orchestra.run.smithi181.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 705 kB/s | 36 kB 00:00 2024-09-12T17:20:40.963 INFO:teuthology.orchestra.run.smithi181.stdout:(143/285): libtracker-sparql-3.1.2-3.el9.x86_64 6.3 MB/s | 324 kB 00:00 2024-09-12T17:20:40.989 INFO:teuthology.orchestra.run.smithi181.stdout:(144/285): libvisual-0.4.0-34.el9.x86_64.rpm 2.8 MB/s | 144 kB 00:00 2024-09-12T17:20:41.022 INFO:teuthology.orchestra.run.smithi181.stdout:(145/285): libvorbis-1.3.7-5.el9.x86_64.rpm 3.2 MB/s | 193 kB 00:00 2024-09-12T17:20:41.047 INFO:teuthology.orchestra.run.smithi181.stdout:(146/285): libwayland-client-1.21.0-1.el9.x86_6 571 kB/s | 33 kB 00:00 2024-09-12T17:20:41.067 INFO:teuthology.orchestra.run.smithi044.stdout:(112/285): java-11-openjdk-headless-11.0.20.1.1 40 MB/s | 39 MB 00:00 2024-09-12T17:20:41.089 INFO:teuthology.orchestra.run.smithi181.stdout:(147/285): libwayland-cursor-1.21.0-1.el9.x86_6 291 kB/s | 19 kB 00:00 2024-09-12T17:20:41.092 INFO:teuthology.orchestra.run.smithi044.stdout:(113/285): libXinerama-1.1.4-10.el9.x86_64.rpm 35 kB/s | 15 kB 00:00 2024-09-12T17:20:41.115 INFO:teuthology.orchestra.run.smithi181.stdout:(148/285): libwayland-egl-1.21.0-1.el9.x86_64.r 192 kB/s | 13 kB 00:00 2024-09-12T17:20:41.117 INFO:teuthology.orchestra.run.smithi044.stdout:(114/285): libXrandr-1.5.2-8.el9.x86_64.rpm 65 kB/s | 28 kB 00:00 2024-09-12T17:20:41.140 INFO:teuthology.orchestra.run.smithi181.stdout:(149/285): libwayland-server-1.21.0-1.el9.x86_6 829 kB/s | 42 kB 00:00 2024-09-12T17:20:41.142 INFO:teuthology.orchestra.run.smithi044.stdout:(115/285): libXtst-1.2.3-16.el9.x86_64.rpm 285 kB/s | 21 kB 00:00 2024-09-12T17:20:41.165 INFO:teuthology.orchestra.run.smithi181.stdout:(150/285): libwebp-1.2.0-8.el9.x86_64.rpm 5.4 MB/s | 277 kB 00:00 2024-09-12T17:20:41.168 INFO:teuthology.orchestra.run.smithi044.stdout:(116/285): libXv-1.0.11-16.el9.x86_64.rpm 253 kB/s | 19 kB 00:00 2024-09-12T17:20:41.190 INFO:teuthology.orchestra.run.smithi181.stdout:(151/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.6 MB/s | 133 kB 00:00 2024-09-12T17:20:41.201 INFO:teuthology.orchestra.run.smithi044.stdout:(117/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 224 kB/s | 19 kB 00:00 2024-09-12T17:20:41.215 INFO:teuthology.orchestra.run.smithi181.stdout:(152/285): libxshmfence-1.3-10.el9.x86_64.rpm 251 kB/s | 13 kB 00:00 2024-09-12T17:20:41.226 INFO:teuthology.orchestra.run.smithi044.stdout:(118/285): libasyncns-0.8-22.el9.x86_64.rpm 363 kB/s | 30 kB 00:00 2024-09-12T17:20:41.241 INFO:teuthology.orchestra.run.smithi181.stdout:(153/285): low-memory-monitor-2.1-4.el9.x86_64. 714 kB/s | 36 kB 00:00 2024-09-12T17:20:41.252 INFO:teuthology.orchestra.run.smithi044.stdout:(119/285): libcanberra-0.30-27.el9.x86_64.rpm 1.0 MB/s | 86 kB 00:00 2024-09-12T17:20:41.266 INFO:teuthology.orchestra.run.smithi181.stdout:(154/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T17:20:41.277 INFO:teuthology.orchestra.run.smithi044.stdout:(120/285): libcanberra-gtk3-0.30-27.el9.x86_64. 421 kB/s | 32 kB 00:00 2024-09-12T17:20:41.291 INFO:teuthology.orchestra.run.smithi181.stdout:(155/285): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-12T17:20:41.302 INFO:teuthology.orchestra.run.smithi044.stdout:(121/285): libdrm-2.4.121-1.el9.x86_64.rpm 2.1 MB/s | 161 kB 00:00 2024-09-12T17:20:41.317 INFO:teuthology.orchestra.run.smithi181.stdout:(156/285): lua-posix-35.0-8.el9.x86_64.rpm 2.9 MB/s | 151 kB 00:00 2024-09-12T17:20:41.327 INFO:teuthology.orchestra.run.smithi044.stdout:(122/285): libepoxy-1.5.5-4.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-09-12T17:20:41.342 INFO:teuthology.orchestra.run.smithi181.stdout:(157/285): maven-3.6.3-15.el9.noarch.rpm 353 kB/s | 18 kB 00:00 2024-09-12T17:20:41.378 INFO:teuthology.orchestra.run.smithi044.stdout:(123/285): libexif-0.6.22-6.el9.x86_64.rpm 4.2 MB/s | 435 kB 00:00 2024-09-12T17:20:41.384 INFO:teuthology.orchestra.run.smithi181.stdout:(158/285): maven-lib-3.6.3-15.el9.noarch.rpm 22 MB/s | 1.5 MB 00:00 2024-09-12T17:20:41.401 INFO:teuthology.orchestra.run.smithi181.stdout:(159/285): maven-openjdk11-3.6.3-15.el9.noarch. 154 kB/s | 9.0 kB 00:00 2024-09-12T17:20:41.403 INFO:teuthology.orchestra.run.smithi044.stdout:(124/285): libfontenc-1.1.3-17.el9.x86_64.rpm 308 kB/s | 31 kB 00:00 2024-09-12T17:20:41.428 INFO:teuthology.orchestra.run.smithi044.stdout:(125/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 823 kB/s | 83 kB 00:00 2024-09-12T17:20:41.434 INFO:teuthology.orchestra.run.smithi181.stdout:(160/285): maven-resolver-1.6.1-10.el9.noarch.r 10 MB/s | 517 kB 00:00 2024-09-12T17:20:41.460 INFO:teuthology.orchestra.run.smithi181.stdout:(161/285): maven-shared-utils-3.3.4-3.el9.noarc 2.5 MB/s | 151 kB 00:00 2024-09-12T17:20:41.470 INFO:teuthology.orchestra.run.smithi044.stdout:(126/285): libglvnd-1.3.4-1.el9.x86_64.rpm 1.4 MB/s | 135 kB 00:00 2024-09-12T17:20:41.496 INFO:teuthology.orchestra.run.smithi044.stdout:(127/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 398 kB/s | 37 kB 00:00 2024-09-12T17:20:41.502 INFO:teuthology.orchestra.run.smithi181.stdout:(162/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.6 MB/s | 112 kB 00:00 2024-09-12T17:20:41.521 INFO:teuthology.orchestra.run.smithi044.stdout:(128/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.5 MB/s | 142 kB 00:00 2024-09-12T17:20:41.555 INFO:teuthology.orchestra.run.smithi044.stdout:(129/285): libgsf-1.14.47-5.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-09-12T17:20:41.569 INFO:teuthology.orchestra.run.smithi181.stdout:(163/285): mesa-filesystem-24.1.2-3.el9.x86_64. 169 kB/s | 11 kB 00:00 2024-09-12T17:20:41.580 INFO:teuthology.orchestra.run.smithi044.stdout:(130/285): libgxps-0.3.2-3.el9.x86_64.rpm 938 kB/s | 79 kB 00:00 2024-09-12T17:20:41.605 INFO:teuthology.orchestra.run.smithi044.stdout:(131/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 729 kB/s | 61 kB 00:00 2024-09-12T17:20:41.639 INFO:teuthology.orchestra.run.smithi044.stdout:(132/285): libldac-2.0.2.3-10.el9.x86_64.rpm 492 kB/s | 41 kB 00:00 2024-09-12T17:20:41.664 INFO:teuthology.orchestra.run.smithi044.stdout:(133/285): libnotify-0.7.9-8.el9.x86_64.rpm 521 kB/s | 44 kB 00:00 2024-09-12T17:20:41.689 INFO:teuthology.orchestra.run.smithi044.stdout:(134/285): libogg-1.3.4-6.el9.x86_64.rpm 400 kB/s | 34 kB 00:00 2024-09-12T17:20:41.719 INFO:teuthology.orchestra.run.smithi181.stdout:(164/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 34 MB/s | 8.8 MB 00:00 2024-09-12T17:20:41.723 INFO:teuthology.orchestra.run.smithi044.stdout:(135/285): libosinfo-1.10.0-1.el9.x86_64.rpm 3.7 MB/s | 319 kB 00:00 2024-09-12T17:20:41.744 INFO:teuthology.orchestra.run.smithi181.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 791 kB/s | 139 kB 00:00 2024-09-12T17:20:41.748 INFO:teuthology.orchestra.run.smithi044.stdout:(136/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-12T17:20:41.769 INFO:teuthology.orchestra.run.smithi181.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-12T17:20:41.774 INFO:teuthology.orchestra.run.smithi044.stdout:(137/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 539 kB/s | 45 kB 00:00 2024-09-12T17:20:41.794 INFO:teuthology.orchestra.run.smithi181.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 725 kB/s | 36 kB 00:00 2024-09-12T17:20:41.820 INFO:teuthology.orchestra.run.smithi181.stdout:(168/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 915 kB/s | 46 kB 00:00 2024-09-12T17:20:41.824 INFO:teuthology.orchestra.run.smithi044.stdout:(138/285): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-12T17:20:41.845 INFO:teuthology.orchestra.run.smithi181.stdout:(169/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 642 kB/s | 32 kB 00:00 2024-09-12T17:20:41.849 INFO:teuthology.orchestra.run.smithi044.stdout:(139/285): libsbc-1.4-9.el9.x86_64.rpm 445 kB/s | 45 kB 00:00 2024-09-12T17:20:41.875 INFO:teuthology.orchestra.run.smithi044.stdout:(140/285): libsndfile-1.0.31-8.el9.x86_64.rpm 2.0 MB/s | 206 kB 00:00 2024-09-12T17:20:41.880 INFO:teuthology.orchestra.run.smithi181.stdout:(170/285): openblas-0.3.26-2.el9.x86_64.rpm 645 kB/s | 38 kB 00:00 2024-09-12T17:20:41.908 INFO:teuthology.orchestra.run.smithi044.stdout:(141/285): libtheora-1.1.1-31.el9.x86_64.rpm 1.9 MB/s | 164 kB 00:00 2024-09-12T17:20:41.922 INFO:teuthology.orchestra.run.smithi181.stdout:(171/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 3.8 MB/s | 163 kB 00:00 2024-09-12T17:20:41.933 INFO:teuthology.orchestra.run.smithi044.stdout:(142/285): libtiff-4.4.0-13.el9.x86_64.rpm 2.3 MB/s | 198 kB 00:00 2024-09-12T17:20:41.959 INFO:teuthology.orchestra.run.smithi044.stdout:(143/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 425 kB/s | 36 kB 00:00 2024-09-12T17:20:41.973 INFO:teuthology.orchestra.run.smithi181.stdout:(172/285): opus-1.3.1-10.el9.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2024-09-12T17:20:41.984 INFO:teuthology.orchestra.run.smithi044.stdout:(144/285): libtracker-sparql-3.1.2-3.el9.x86_64 4.2 MB/s | 324 kB 00:00 2024-09-12T17:20:42.014 INFO:teuthology.orchestra.run.smithi181.stdout:(173/285): orc-0.4.31-8.el9.x86_64.rpm 4.3 MB/s | 183 kB 00:00 2024-09-12T17:20:42.027 INFO:teuthology.orchestra.run.smithi044.stdout:(145/285): libvisual-0.4.0-34.el9.x86_64.rpm 1.5 MB/s | 144 kB 00:00 2024-09-12T17:20:42.052 INFO:teuthology.orchestra.run.smithi044.stdout:(146/285): libwayland-client-1.21.0-1.el9.x86_6 495 kB/s | 33 kB 00:00 2024-09-12T17:20:42.073 INFO:teuthology.orchestra.run.smithi181.stdout:(174/285): osinfo-db-20240701-2.el9.noarch.rpm 8.9 MB/s | 531 kB 00:00 2024-09-12T17:20:42.077 INFO:teuthology.orchestra.run.smithi044.stdout:(147/285): libvorbis-1.3.7-5.el9.x86_64.rpm 1.6 MB/s | 193 kB 00:00 2024-09-12T17:20:42.103 INFO:teuthology.orchestra.run.smithi044.stdout:(148/285): libwayland-cursor-1.21.0-1.el9.x86_6 257 kB/s | 19 kB 00:00 2024-09-12T17:20:42.115 INFO:teuthology.orchestra.run.smithi181.stdout:(175/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.7 MB/s | 74 kB 00:00 2024-09-12T17:20:42.128 INFO:teuthology.orchestra.run.smithi044.stdout:(149/285): libwayland-egl-1.21.0-1.el9.x86_64.r 170 kB/s | 13 kB 00:00 2024-09-12T17:20:42.153 INFO:teuthology.orchestra.run.smithi044.stdout:(150/285): libwayland-server-1.21.0-1.el9.x86_6 554 kB/s | 42 kB 00:00 2024-09-12T17:20:42.174 INFO:teuthology.orchestra.run.smithi181.stdout:(176/285): ostree-libs-2024.7-2.el9.x86_64.rpm 7.8 MB/s | 468 kB 00:00 2024-09-12T17:20:42.187 INFO:teuthology.orchestra.run.smithi044.stdout:(151/285): libwebp-1.2.0-8.el9.x86_64.rpm 3.2 MB/s | 277 kB 00:00 2024-09-12T17:20:42.220 INFO:teuthology.orchestra.run.smithi044.stdout:(152/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.4 MB/s | 133 kB 00:00 2024-09-12T17:20:42.224 INFO:teuthology.orchestra.run.smithi181.stdout:(177/285): p11-kit-server-0.25.3-2.el9.x86_64.r 4.8 MB/s | 246 kB 00:00 2024-09-12T17:20:42.245 INFO:teuthology.orchestra.run.smithi044.stdout:(153/285): libxshmfence-1.3-10.el9.x86_64.rpm 137 kB/s | 13 kB 00:00 2024-09-12T17:20:42.271 INFO:teuthology.orchestra.run.smithi044.stdout:(154/285): low-memory-monitor-2.1-4.el9.x86_64. 428 kB/s | 36 kB 00:00 2024-09-12T17:20:42.274 INFO:teuthology.orchestra.run.smithi181.stdout:(178/285): pipewire-1.0.1-1.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-09-12T17:20:42.304 INFO:teuthology.orchestra.run.smithi044.stdout:(155/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-12T17:20:42.316 INFO:teuthology.orchestra.run.smithi181.stdout:(179/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.3 MB/s | 57 kB 00:00 2024-09-12T17:20:42.338 INFO:teuthology.orchestra.run.smithi044.stdout:(156/285): lua-posix-35.0-8.el9.x86_64.rpm 2.2 MB/s | 151 kB 00:00 2024-09-12T17:20:42.363 INFO:teuthology.orchestra.run.smithi044.stdout:(157/285): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-12T17:20:42.383 INFO:teuthology.orchestra.run.smithi181.stdout:(180/285): pipewire-jack-audio-connection-kit-1 137 kB/s | 9.1 kB 00:00 2024-09-12T17:20:42.389 INFO:teuthology.orchestra.run.smithi044.stdout:(158/285): maven-3.6.3-15.el9.noarch.rpm 211 kB/s | 18 kB 00:00 2024-09-12T17:20:42.425 INFO:teuthology.orchestra.run.smithi181.stdout:(181/285): pipewire-jack-audio-connection-kit-l 3.2 MB/s | 135 kB 00:00 2024-09-12T17:20:42.439 INFO:teuthology.orchestra.run.smithi044.stdout:(159/285): maven-lib-3.6.3-15.el9.noarch.rpm 15 MB/s | 1.5 MB 00:00 2024-09-12T17:20:42.473 INFO:teuthology.orchestra.run.smithi044.stdout:(160/285): maven-openjdk11-3.6.3-15.el9.noarch. 108 kB/s | 9.0 kB 00:00 2024-09-12T17:20:42.498 INFO:teuthology.orchestra.run.smithi044.stdout:(161/285): maven-resolver-1.6.1-10.el9.noarch.r 4.6 MB/s | 517 kB 00:00 2024-09-12T17:20:42.500 INFO:teuthology.orchestra.run.smithi181.stdout:(182/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 26 MB/s | 1.9 MB 00:00 2024-09-12T17:20:42.523 INFO:teuthology.orchestra.run.smithi044.stdout:(162/285): maven-shared-utils-3.3.4-3.el9.noarc 1.8 MB/s | 151 kB 00:00 2024-09-12T17:20:42.551 INFO:teuthology.orchestra.run.smithi181.stdout:(183/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.7 MB/s | 192 kB 00:00 2024-09-12T17:20:42.557 INFO:teuthology.orchestra.run.smithi044.stdout:(163/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.3 MB/s | 112 kB 00:00 2024-09-12T17:20:42.591 INFO:teuthology.orchestra.run.smithi044.stdout:(164/285): mesa-filesystem-24.1.2-3.el9.x86_64. 168 kB/s | 11 kB 00:00 2024-09-12T17:20:42.601 INFO:teuthology.orchestra.run.smithi181.stdout:(184/285): plexus-cipher-1.7-27.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-09-12T17:20:42.624 INFO:teuthology.orchestra.run.smithi044.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.0 MB/s | 139 kB 00:00 2024-09-12T17:20:42.643 INFO:teuthology.orchestra.run.smithi181.stdout:(185/285): plexus-classworlds-2.6.0-11.el9.noar 1.4 MB/s | 60 kB 00:00 2024-09-12T17:20:42.649 INFO:teuthology.orchestra.run.smithi044.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.8 MB/s | 171 kB 00:00 2024-09-12T17:20:42.692 INFO:teuthology.orchestra.run.smithi044.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 541 kB/s | 36 kB 00:00 2024-09-12T17:20:42.693 INFO:teuthology.orchestra.run.smithi181.stdout:(186/285): plexus-containers-component-annotati 368 kB/s | 18 kB 00:00 2024-09-12T17:20:42.733 INFO:teuthology.orchestra.run.smithi044.stdout:(168/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 549 kB/s | 46 kB 00:00 2024-09-12T17:20:42.735 INFO:teuthology.orchestra.run.smithi181.stdout:(187/285): plexus-interpolation-1.26-11.el9.noa 1.9 MB/s | 80 kB 00:00 2024-09-12T17:20:42.758 INFO:teuthology.orchestra.run.smithi044.stdout:(169/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 484 kB/s | 32 kB 00:00 2024-09-12T17:20:42.777 INFO:teuthology.orchestra.run.smithi181.stdout:(188/285): plexus-sec-dispatcher-1.4-37.el9.noa 809 kB/s | 34 kB 00:00 2024-09-12T17:20:42.801 INFO:teuthology.orchestra.run.smithi044.stdout:(170/285): openblas-0.3.26-2.el9.x86_64.rpm 576 kB/s | 38 kB 00:00 2024-09-12T17:20:42.819 INFO:teuthology.orchestra.run.smithi181.stdout:(189/285): plexus-utils-3.3.0-10.el9.noarch.rpm 6.0 MB/s | 254 kB 00:00 2024-09-12T17:20:42.878 INFO:teuthology.orchestra.run.smithi181.stdout:(190/285): poppler-21.01.0-21.el9.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2024-09-12T17:20:42.918 INFO:teuthology.orchestra.run.smithi044.stdout:(171/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 21 MB/s | 8.8 MB 00:00 2024-09-12T17:20:42.943 INFO:teuthology.orchestra.run.smithi044.stdout:(172/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.1 MB/s | 163 kB 00:00 2024-09-12T17:20:42.953 INFO:teuthology.orchestra.run.smithi181.stdout:(191/285): poppler-data-0.4.9-9.el9.noarch.rpm 25 MB/s | 1.9 MB 00:00 2024-09-12T17:20:42.995 INFO:teuthology.orchestra.run.smithi181.stdout:(192/285): poppler-glib-21.01.0-21.el9.x86_64.r 3.6 MB/s | 152 kB 00:00 2024-09-12T17:20:43.035 INFO:teuthology.orchestra.run.smithi044.stdout:(173/285): openblas-openmp-0.3.26-2.el9.x86_64. 18 MB/s | 4.9 MB 00:00 2024-09-12T17:20:43.054 INFO:teuthology.orchestra.run.smithi181.stdout:(193/285): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-12T17:20:43.060 INFO:teuthology.orchestra.run.smithi044.stdout:(174/285): orc-0.4.31-8.el9.x86_64.rpm 1.5 MB/s | 183 kB 00:00 2024-09-12T17:20:43.085 INFO:teuthology.orchestra.run.smithi044.stdout:(175/285): opus-1.3.1-10.el9.x86_64.rpm 1.2 MB/s | 200 kB 00:00 2024-09-12T17:20:43.087 INFO:teuthology.orchestra.run.smithi181.stdout:(194/285): publicsuffix-list-20210518-3.el9.noa 2.4 MB/s | 83 kB 00:00 2024-09-12T17:20:43.127 INFO:teuthology.orchestra.run.smithi044.stdout:(176/285): osinfo-db-20240701-2.el9.noarch.rpm 5.6 MB/s | 531 kB 00:00 2024-09-12T17:20:43.138 INFO:teuthology.orchestra.run.smithi181.stdout:(195/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 13 MB/s | 679 kB 00:00 2024-09-12T17:20:43.152 INFO:teuthology.orchestra.run.smithi044.stdout:(177/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 801 kB/s | 74 kB 00:00 2024-09-12T17:20:43.178 INFO:teuthology.orchestra.run.smithi044.stdout:(178/285): ostree-libs-2024.7-2.el9.x86_64.rpm 4.9 MB/s | 468 kB 00:00 2024-09-12T17:20:43.203 INFO:teuthology.orchestra.run.smithi044.stdout:(179/285): p11-kit-server-0.25.3-2.el9.x86_64.r 3.2 MB/s | 246 kB 00:00 2024-09-12T17:20:43.237 INFO:teuthology.orchestra.run.smithi044.stdout:(180/285): pipewire-1.0.1-1.el9.x86_64.rpm 1.2 MB/s | 107 kB 00:00 2024-09-12T17:20:43.262 INFO:teuthology.orchestra.run.smithi044.stdout:(181/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 685 kB/s | 57 kB 00:00 2024-09-12T17:20:43.287 INFO:teuthology.orchestra.run.smithi044.stdout:(182/285): pipewire-jack-audio-connection-kit-1 109 kB/s | 9.1 kB 00:00 2024-09-12T17:20:43.312 INFO:teuthology.orchestra.run.smithi044.stdout:(183/285): pipewire-jack-audio-connection-kit-l 1.8 MB/s | 135 kB 00:00 2024-09-12T17:20:43.313 INFO:teuthology.orchestra.run.smithi181.stdout:(196/285): python3-babel-2.9.1-2.el9.noarch.rpm 34 MB/s | 6.0 MB 00:00 2024-09-12T17:20:43.371 INFO:teuthology.orchestra.run.smithi044.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.2 MB/s | 192 kB 00:00 2024-09-12T17:20:43.380 INFO:teuthology.orchestra.run.smithi181.stdout:(197/285): python3-devel-3.9.19-8.el9.x86_64.rp 3.6 MB/s | 245 kB 00:00 2024-09-12T17:20:43.430 INFO:teuthology.orchestra.run.smithi044.stdout:(185/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 11 MB/s | 1.9 MB 00:00 2024-09-12T17:20:43.438 INFO:teuthology.orchestra.run.smithi181.stdout:(198/285): python3-jinja2-2.11.3-6.el9.noarch.r 4.2 MB/s | 248 kB 00:00 2024-09-12T17:20:43.489 INFO:teuthology.orchestra.run.smithi181.stdout:(199/285): python3-jsonpatch-1.21-16.el9.noarch 512 kB/s | 26 kB 00:00 2024-09-12T17:20:43.497 INFO:teuthology.orchestra.run.smithi044.stdout:(186/285): plexus-containers-component-annotati 275 kB/s | 18 kB 00:00 2024-09-12T17:20:43.547 INFO:teuthology.orchestra.run.smithi181.stdout:(200/285): python3-jsonpointer-2.0-4.el9.noarch 327 kB/s | 19 kB 00:00 2024-09-12T17:20:43.555 INFO:teuthology.orchestra.run.smithi044.stdout:(187/285): plexus-interpolation-1.26-11.el9.noa 1.3 MB/s | 80 kB 00:00 2024-09-12T17:20:43.589 INFO:teuthology.orchestra.run.smithi044.stdout:(188/285): plexus-cipher-1.7-27.el9.noarch.rpm 93 kB/s | 26 kB 00:00 2024-09-12T17:20:43.598 INFO:teuthology.orchestra.run.smithi181.stdout:(201/285): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-12T17:20:43.614 INFO:teuthology.orchestra.run.smithi044.stdout:(189/285): plexus-sec-dispatcher-1.4-37.el9.noa 574 kB/s | 34 kB 00:00 2024-09-12T17:20:43.656 INFO:teuthology.orchestra.run.smithi181.stdout:(202/285): openblas-openmp-0.3.26-2.el9.x86_64. 2.7 MB/s | 4.9 MB 00:01 2024-09-12T17:20:43.665 INFO:teuthology.orchestra.run.smithi044.stdout:(190/285): plexus-utils-3.3.0-10.el9.noarch.rpm 3.3 MB/s | 254 kB 00:00 2024-09-12T17:20:43.674 INFO:teuthology.orchestra.run.smithi181.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 462 kB/s | 35 kB 00:00 2024-09-12T17:20:43.715 INFO:teuthology.orchestra.run.smithi181.stdout:(204/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 5.9 MB/s | 250 kB 00:00 2024-09-12T17:20:43.723 INFO:teuthology.orchestra.run.smithi044.stdout:(191/285): poppler-21.01.0-21.el9.x86_64.rpm 9.8 MB/s | 1.1 MB 00:00 2024-09-12T17:20:43.757 INFO:teuthology.orchestra.run.smithi181.stdout:(205/285): python3-oauthlib-3.1.1-5.el9.noarch. 5.2 MB/s | 222 kB 00:00 2024-09-12T17:20:43.774 INFO:teuthology.orchestra.run.smithi044.stdout:(192/285): poppler-data-0.4.9-9.el9.noarch.rpm 17 MB/s | 1.9 MB 00:00 2024-09-12T17:20:43.790 INFO:teuthology.orchestra.run.smithi044.stdout:(193/285): plexus-classworlds-2.6.0-11.el9.noar 143 kB/s | 60 kB 00:00 2024-09-12T17:20:43.799 INFO:teuthology.orchestra.run.smithi181.stdout:(206/285): python3-packaging-20.9-5.el9.noarch. 1.8 MB/s | 77 kB 00:00 2024-09-12T17:20:43.816 INFO:teuthology.orchestra.run.smithi044.stdout:(194/285): poppler-glib-21.01.0-21.el9.x86_64.r 1.6 MB/s | 152 kB 00:00 2024-09-12T17:20:43.849 INFO:teuthology.orchestra.run.smithi044.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 1.4 MB/s | 83 kB 00:00 2024-09-12T17:20:43.883 INFO:teuthology.orchestra.run.smithi044.stdout:(196/285): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-12T17:20:43.900 INFO:teuthology.orchestra.run.smithi181.stdout:(207/285): python3-prettytable-0.7.2-27.el9.noa 423 kB/s | 42 kB 00:00 2024-09-12T17:20:43.925 INFO:teuthology.orchestra.run.smithi044.stdout:(197/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 6.1 MB/s | 679 kB 00:00 2024-09-12T17:20:43.950 INFO:teuthology.orchestra.run.smithi044.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 3.6 MB/s | 245 kB 00:00 2024-09-12T17:20:44.001 INFO:teuthology.orchestra.run.smithi044.stdout:(199/285): python3-jinja2-2.11.3-6.el9.noarch.r 3.2 MB/s | 248 kB 00:00 2024-09-12T17:20:44.025 INFO:teuthology.orchestra.run.smithi044.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 341 kB/s | 26 kB 00:00 2024-09-12T17:20:44.075 INFO:teuthology.orchestra.run.smithi181.stdout:(208/285): python3-protobuf-3.14.0-13.el9.noarc 1.5 MB/s | 269 kB 00:00 2024-09-12T17:20:44.076 INFO:teuthology.orchestra.run.smithi044.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 255 kB/s | 19 kB 00:00 2024-09-12T17:20:44.101 INFO:teuthology.orchestra.run.smithi044.stdout:(202/285): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-12T17:20:44.117 INFO:teuthology.orchestra.run.smithi181.stdout:(209/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 3.7 MB/s | 159 kB 00:00 2024-09-12T17:20:44.159 INFO:teuthology.orchestra.run.smithi181.stdout:(210/285): python3-pyasn1-modules-0.4.8-6.el9.n 6.6 MB/s | 279 kB 00:00 2024-09-12T17:20:44.185 INFO:teuthology.orchestra.run.smithi044.stdout:(203/285): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-12T17:20:44.201 INFO:teuthology.orchestra.run.smithi181.stdout:(211/285): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-12T17:20:44.210 INFO:teuthology.orchestra.run.smithi044.stdout:(204/285): python3-markupsafe-1.1.1-12.el9.x86_ 260 kB/s | 35 kB 00:00 2024-09-12T17:20:44.242 INFO:teuthology.orchestra.run.smithi181.stdout:(212/285): python3-requests-oauthlib-1.3.0-12.e 1.3 MB/s | 54 kB 00:00 2024-09-12T17:20:44.294 INFO:teuthology.orchestra.run.smithi044.stdout:(205/285): python3-numpy-1.20.1-5.el9.x86_64.rp 27 MB/s | 5.1 MB 00:00 2024-09-12T17:20:44.319 INFO:teuthology.orchestra.run.smithi044.stdout:(206/285): python3-oauthlib-3.1.1-5.el9.noarch. 2.0 MB/s | 222 kB 00:00 2024-09-12T17:20:44.445 INFO:teuthology.orchestra.run.smithi044.stdout:(207/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 967 kB/s | 250 kB 00:00 2024-09-12T17:20:44.470 INFO:teuthology.orchestra.run.smithi044.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 283 kB/s | 42 kB 00:00 2024-09-12T17:20:44.495 INFO:teuthology.orchestra.run.smithi044.stdout:(209/285): python3-packaging-20.9-5.el9.noarch. 384 kB/s | 77 kB 00:00 2024-09-12T17:20:44.520 INFO:teuthology.orchestra.run.smithi044.stdout:(210/285): python3-protobuf-3.14.0-13.el9.noarc 3.5 MB/s | 269 kB 00:00 2024-09-12T17:20:44.554 INFO:teuthology.orchestra.run.smithi044.stdout:(211/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.9 MB/s | 159 kB 00:00 2024-09-12T17:20:44.579 INFO:teuthology.orchestra.run.smithi044.stdout:(212/285): python3-pyasn1-modules-0.4.8-6.el9.n 3.3 MB/s | 279 kB 00:00 2024-09-12T17:20:44.605 INFO:teuthology.orchestra.run.smithi044.stdout:(213/285): python3-pytz-2021.1-5.el9.noarch.rpm 608 kB/s | 51 kB 00:00 2024-09-12T17:20:44.638 INFO:teuthology.orchestra.run.smithi044.stdout:(214/285): python3-requests-oauthlib-1.3.0-12.e 641 kB/s | 54 kB 00:00 2024-09-12T17:20:44.680 INFO:teuthology.orchestra.run.smithi044.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 555 kB/s | 42 kB 00:00 2024-09-12T17:20:44.722 INFO:teuthology.orchestra.run.smithi044.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-12T17:20:44.772 INFO:teuthology.orchestra.run.smithi044.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 390 kB/s | 36 kB 00:00 2024-09-12T17:20:44.797 INFO:teuthology.orchestra.run.smithi044.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 631 kB/s | 47 kB 00:00 2024-09-12T17:20:44.998 INFO:teuthology.orchestra.run.smithi044.stdout:(219/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-09-12T17:20:45.023 INFO:teuthology.orchestra.run.smithi044.stdout:(220/285): rtkit-0.11-29.el9.x86_64.rpm 223 kB/s | 56 kB 00:00 2024-09-12T17:20:45.051 INFO:teuthology.orchestra.run.smithi181.stdout:(213/285): python3-numpy-1.20.1-5.el9.x86_64.rp 3.7 MB/s | 5.1 MB 00:01 2024-09-12T17:20:45.057 INFO:teuthology.orchestra.run.smithi044.stdout:(221/285): sisu-0.3.4-10.el9.noarch.rpm 1.9 MB/s | 510 kB 00:00 2024-09-12T17:20:45.090 INFO:teuthology.orchestra.run.smithi044.stdout:(222/285): slf4j-1.7.30-13.el9.noarch.rpm 749 kB/s | 69 kB 00:00 2024-09-12T17:20:45.093 INFO:teuthology.orchestra.run.smithi181.stdout:(214/285): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-12T17:20:45.124 INFO:teuthology.orchestra.run.smithi044.stdout:(223/285): socat-1.7.4.1-6.el9.x86_64.rpm 3.0 MB/s | 304 kB 00:00 2024-09-12T17:20:45.135 INFO:teuthology.orchestra.run.smithi181.stdout:(215/285): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-12T17:20:45.158 INFO:teuthology.orchestra.run.smithi044.stdout:(224/285): sound-theme-freedesktop-0.8-17.el9.n 3.7 MB/s | 383 kB 00:00 2024-09-12T17:20:45.177 INFO:teuthology.orchestra.run.smithi181.stdout:(216/285): qatlib-service-24.02.0-1.el9.x86_64. 864 kB/s | 36 kB 00:00 2024-09-12T17:20:45.183 INFO:teuthology.orchestra.run.smithi044.stdout:(225/285): totem-pl-parser-3.26.6-2.el9.x86_64. 1.6 MB/s | 152 kB 00:00 2024-09-12T17:20:45.219 INFO:teuthology.orchestra.run.smithi181.stdout:(217/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-12T17:20:45.242 INFO:teuthology.orchestra.run.smithi044.stdout:(226/285): tracker-3.1.2-3.el9.x86_64.rpm 4.6 MB/s | 555 kB 00:00 2024-09-12T17:20:45.261 INFO:teuthology.orchestra.run.smithi181.stdout:(218/285): rtkit-0.11-29.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2024-09-12T17:20:45.267 INFO:teuthology.orchestra.run.smithi044.stdout:(227/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 635 kB/s | 53 kB 00:00 2024-09-12T17:20:45.309 INFO:teuthology.orchestra.run.smithi044.stdout:(228/285): tzdata-java-2024a-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-12T17:20:45.334 INFO:teuthology.orchestra.run.smithi044.stdout:(229/285): upower-0.99.11-11.el9.x86_64.rpm 2.5 MB/s | 173 kB 00:00 2024-09-12T17:20:45.359 INFO:teuthology.orchestra.run.smithi044.stdout:(230/285): tracker-miners-3.1.2-4.el9.x86_64.rp 4.6 MB/s | 944 kB 00:00 2024-09-12T17:20:45.393 INFO:teuthology.orchestra.run.smithi044.stdout:(231/285): webrtc-audio-processing-0.3.1-8.el9. 3.6 MB/s | 306 kB 00:00 2024-09-12T17:20:45.427 INFO:teuthology.orchestra.run.smithi044.stdout:(232/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.0 MB/s | 96 kB 00:00 2024-09-12T17:20:45.460 INFO:teuthology.orchestra.run.smithi044.stdout:(233/285): wireplumber-libs-0.4.14-1.el9.x86_64 3.5 MB/s | 358 kB 00:00 2024-09-12T17:20:45.468 INFO:teuthology.orchestra.run.smithi181.stdout:(219/285): sisu-0.3.4-10.el9.noarch.rpm 2.4 MB/s | 510 kB 00:00 2024-09-12T17:20:45.514 INFO:teuthology.orchestra.run.smithi044.stdout:(234/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 350 kB/s | 42 kB 00:00 2024-09-12T17:20:45.544 INFO:teuthology.orchestra.run.smithi044.stdout:(235/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.6 MB/s | 134 kB 00:00 2024-09-12T17:20:45.562 INFO:teuthology.orchestra.run.smithi181.stdout:(220/285): slf4j-1.7.30-13.el9.noarch.rpm 744 kB/s | 69 kB 00:00 2024-09-12T17:20:45.569 INFO:teuthology.orchestra.run.smithi044.stdout:(236/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 2.6 MB/s | 385 kB 00:00 2024-09-12T17:20:45.603 INFO:teuthology.orchestra.run.smithi044.stdout:(237/285): xkeyboard-config-2.33-2.el9.noarch.r 9.5 MB/s | 859 kB 00:00 2024-09-12T17:20:45.612 INFO:teuthology.orchestra.run.smithi181.stdout:(221/285): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-12T17:20:45.628 INFO:teuthology.orchestra.run.smithi044.stdout:(238/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 757 kB/s | 64 kB 00:00 2024-09-12T17:20:45.662 INFO:teuthology.orchestra.run.smithi181.stdout:(222/285): sound-theme-freedesktop-0.8-17.el9.n 7.5 MB/s | 383 kB 00:00 2024-09-12T17:20:45.670 INFO:teuthology.orchestra.run.smithi044.stdout:(239/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 4.9 MB/s | 505 kB 00:00 2024-09-12T17:20:45.712 INFO:teuthology.orchestra.run.smithi181.stdout:(223/285): totem-pl-parser-3.26.6-2.el9.x86_64. 3.0 MB/s | 152 kB 00:00 2024-09-12T17:20:45.729 INFO:teuthology.orchestra.run.smithi044.stdout:(240/285): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T17:20:45.762 INFO:teuthology.orchestra.run.smithi044.stdout:(241/285): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-12T17:20:45.771 INFO:teuthology.orchestra.run.smithi181.stdout:(224/285): tracker-3.1.2-3.el9.x86_64.rpm 9.3 MB/s | 555 kB 00:00 2024-09-12T17:20:45.788 INFO:teuthology.orchestra.run.smithi044.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-12T17:20:45.838 INFO:teuthology.orchestra.run.smithi181.stdout:(225/285): tracker-miners-3.1.2-4.el9.x86_64.rp 14 MB/s | 944 kB 00:00 2024-09-12T17:20:45.905 INFO:teuthology.orchestra.run.smithi044.stdout:(243/285): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-12T17:20:45.947 INFO:teuthology.orchestra.run.smithi044.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 988 kB/s | 26 kB 00:00 2024-09-12T17:20:45.972 INFO:teuthology.orchestra.run.smithi044.stdout:(245/285): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T17:20:45.972 INFO:teuthology.orchestra.run.smithi181.stdout:(226/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 398 kB/s | 53 kB 00:00 2024-09-12T17:20:45.997 INFO:teuthology.orchestra.run.smithi044.stdout:(246/285): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T17:20:46.022 INFO:teuthology.orchestra.run.smithi181.stdout:(227/285): tzdata-java-2024a-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-12T17:20:46.031 INFO:teuthology.orchestra.run.smithi044.stdout:(247/285): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2024-09-12T17:20:46.073 INFO:teuthology.orchestra.run.smithi044.stdout:(248/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-12T17:20:46.073 INFO:teuthology.orchestra.run.smithi181.stdout:(228/285): upower-0.99.11-11.el9.x86_64.rpm 3.4 MB/s | 173 kB 00:00 2024-09-12T17:20:46.106 INFO:teuthology.orchestra.run.smithi044.stdout:(249/285): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-12T17:20:46.132 INFO:teuthology.orchestra.run.smithi044.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T17:20:46.157 INFO:teuthology.orchestra.run.smithi044.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T17:20:46.182 INFO:teuthology.orchestra.run.smithi044.stdout:(252/285): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-12T17:20:46.208 INFO:teuthology.orchestra.run.smithi044.stdout:(253/285): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-12T17:20:46.241 INFO:teuthology.orchestra.run.smithi044.stdout:(254/285): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-12T17:20:46.267 INFO:teuthology.orchestra.run.smithi044.stdout:(255/285): lua-devel-5.4.4-4.el9.x86_64.rpm 34 kB/s | 22 kB 00:00 2024-09-12T17:20:46.292 INFO:teuthology.orchestra.run.smithi044.stdout:(256/285): python3-google-auth-2.34.0-1.el9.noa 4.4 MB/s | 220 kB 00:00 2024-09-12T17:20:46.325 INFO:teuthology.orchestra.run.smithi044.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-12T17:20:46.351 INFO:teuthology.orchestra.run.smithi044.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 472 kB/s | 11 kB 00:00 2024-09-12T17:20:46.376 INFO:teuthology.orchestra.run.smithi044.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-12T17:20:46.401 INFO:teuthology.orchestra.run.smithi044.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 936 kB/s | 23 kB 00:00 2024-09-12T17:20:46.423 INFO:teuthology.orchestra.run.smithi181.stdout:(229/285): java-11-openjdk-headless-11.0.20.1.1 5.4 MB/s | 39 MB 00:07 2024-09-12T17:20:46.426 INFO:teuthology.orchestra.run.smithi044.stdout:(261/285): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-09-12T17:20:46.452 INFO:teuthology.orchestra.run.smithi044.stdout:(262/285): python3-jaraco-text-3.2.0-6.el9.noar 794 kB/s | 20 kB 00:00 2024-09-12T17:20:46.457 INFO:teuthology.orchestra.run.smithi181.stdout:(230/285): webrtc-audio-processing-0.3.1-8.el9. 797 kB/s | 306 kB 00:00 2024-09-12T17:20:46.482 INFO:teuthology.orchestra.run.smithi181.stdout:(231/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-12T17:20:46.511 INFO:teuthology.orchestra.run.smithi044.stdout:(263/285): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-12T17:20:46.536 INFO:teuthology.orchestra.run.smithi044.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T17:20:46.561 INFO:teuthology.orchestra.run.smithi044.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T17:20:46.578 INFO:teuthology.orchestra.run.smithi044.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-12T17:20:46.612 INFO:teuthology.orchestra.run.smithi044.stdout:(267/285): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T17:20:46.628 INFO:teuthology.orchestra.run.smithi044.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 998 kB/s | 16 kB 00:00 2024-09-12T17:20:46.641 INFO:teuthology.orchestra.run.smithi181.stdout:(232/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.8 MB/s | 16 MB 00:02 2024-09-12T17:20:46.666 INFO:teuthology.orchestra.run.smithi181.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 231 kB/s | 42 kB 00:00 2024-09-12T17:20:46.670 INFO:teuthology.orchestra.run.smithi044.stdout:(269/285): python3-grpcio-1.46.7-10.el9.x86_64. 5.1 MB/s | 2.0 MB 00:00 2024-09-12T17:20:46.691 INFO:teuthology.orchestra.run.smithi181.stdout:(234/285): wireplumber-libs-0.4.14-1.el9.x86_64 1.5 MB/s | 358 kB 00:00 2024-09-12T17:20:46.704 INFO:teuthology.orchestra.run.smithi044.stdout:(270/285): protobuf-compiler-3.14.0-13.el9.x86_ 803 kB/s | 863 kB 00:01 2024-09-12T17:20:46.716 INFO:teuthology.orchestra.run.smithi181.stdout:(235/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.6 MB/s | 134 kB 00:00 2024-09-12T17:20:46.729 INFO:teuthology.orchestra.run.smithi044.stdout:(271/285): python3-repoze-lru-0.7-16.el9.noarch 535 kB/s | 31 kB 00:00 2024-09-12T17:20:46.742 INFO:teuthology.orchestra.run.smithi181.stdout:(236/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 3.7 MB/s | 385 kB 00:00 2024-09-12T17:20:46.758 INFO:teuthology.orchestra.run.smithi181.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-12T17:20:46.763 INFO:teuthology.orchestra.run.smithi044.stdout:(272/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 670 kB/s | 90 kB 00:00 2024-09-12T17:20:46.788 INFO:teuthology.orchestra.run.smithi044.stdout:(273/285): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T17:20:46.801 INFO:teuthology.orchestra.run.smithi181.stdout:(238/285): xkeyboard-config-2.33-2.el9.noarch.r 7.7 MB/s | 859 kB 00:00 2024-09-12T17:20:46.813 INFO:teuthology.orchestra.run.smithi044.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 744 kB/s | 36 kB 00:00 2024-09-12T17:20:46.834 INFO:teuthology.orchestra.run.smithi181.stdout:(239/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.4 MB/s | 505 kB 00:00 2024-09-12T17:20:46.839 INFO:teuthology.orchestra.run.smithi044.stdout:(275/285): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T17:20:46.859 INFO:teuthology.orchestra.run.smithi181.stdout:(240/285): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-12T17:20:46.864 INFO:teuthology.orchestra.run.smithi044.stdout:(276/285): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-12T17:20:46.889 INFO:teuthology.orchestra.run.smithi044.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T17:20:46.901 INFO:teuthology.orchestra.run.smithi181.stdout:(241/285): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-12T17:20:46.915 INFO:teuthology.orchestra.run.smithi044.stdout:(278/285): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T17:20:46.927 INFO:teuthology.orchestra.run.smithi181.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 844 kB/s | 19 kB 00:00 2024-09-12T17:20:46.940 INFO:teuthology.orchestra.run.smithi044.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 396 kB/s | 20 kB 00:00 2024-09-12T17:20:46.952 INFO:teuthology.orchestra.run.smithi181.stdout:(243/285): gperftools-libs-2.9.1-3.el9.x86_64.r 3.3 MB/s | 308 kB 00:00 2024-09-12T17:20:46.973 INFO:teuthology.orchestra.run.smithi044.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-12T17:20:46.977 INFO:teuthology.orchestra.run.smithi181.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T17:20:46.999 INFO:teuthology.orchestra.run.smithi044.stdout:(281/285): s3cmd-2.4.0-1.el9.noarch.rpm 3.5 MB/s | 206 kB 00:00 2024-09-12T17:20:47.002 INFO:teuthology.orchestra.run.smithi181.stdout:(245/285): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T17:20:47.024 INFO:teuthology.orchestra.run.smithi044.stdout:(282/285): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-09-12T17:20:47.036 INFO:teuthology.orchestra.run.smithi181.stdout:(246/285): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-09-12T17:20:47.061 INFO:teuthology.orchestra.run.smithi181.stdout:(247/285): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-12T17:20:47.074 INFO:teuthology.orchestra.run.smithi044.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T17:20:47.095 INFO:teuthology.orchestra.run.smithi181.stdout:(248/285): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-12T17:20:47.137 INFO:teuthology.orchestra.run.smithi181.stdout:(249/285): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T17:20:47.162 INFO:teuthology.orchestra.run.smithi181.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T17:20:47.187 INFO:teuthology.orchestra.run.smithi181.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T17:20:47.212 INFO:teuthology.orchestra.run.smithi181.stdout:(252/285): python3-certifi-2023.05.07-4.el9.noa 570 kB/s | 14 kB 00:00 2024-09-12T17:20:47.246 INFO:teuthology.orchestra.run.smithi181.stdout:(253/285): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-12T17:20:47.279 INFO:teuthology.orchestra.run.smithi181.stdout:(254/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 839 kB 00:00 2024-09-12T17:20:47.292 INFO:teuthology.orchestra.run.smithi044.stdout:(284/285): librbd1-19.3.0-4762.gbad475c1.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-12T17:20:47.305 INFO:teuthology.orchestra.run.smithi181.stdout:(255/285): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-12T17:20:47.330 INFO:teuthology.orchestra.run.smithi181.stdout:(256/285): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-12T17:20:47.364 INFO:teuthology.orchestra.run.smithi181.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T17:20:47.367 INFO:teuthology.orchestra.run.smithi044.stdout:(285/285): librados2-19.3.0-4762.gbad475c1.el9. 9.4 MB/s | 3.5 MB 00:00 2024-09-12T17:20:47.374 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:20:47.374 INFO:teuthology.orchestra.run.smithi044.stdout:Total 20 MB/s | 322 MB 00:16 2024-09-12T17:20:47.389 INFO:teuthology.orchestra.run.smithi181.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-12T17:20:47.415 INFO:teuthology.orchestra.run.smithi181.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-12T17:20:47.440 INFO:teuthology.orchestra.run.smithi181.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-12T17:20:47.499 INFO:teuthology.orchestra.run.smithi181.stdout:(261/285): libarrow-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 4.4 MB 00:00 2024-09-12T17:20:47.524 INFO:teuthology.orchestra.run.smithi181.stdout:(262/285): python3-jaraco-functools-3.5.0-2.el9 232 kB/s | 19 kB 00:00 2024-09-12T17:20:47.549 INFO:teuthology.orchestra.run.smithi181.stdout:(263/285): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-12T17:20:47.574 INFO:teuthology.orchestra.run.smithi181.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T17:20:47.599 INFO:teuthology.orchestra.run.smithi181.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T17:20:47.625 INFO:teuthology.orchestra.run.smithi181.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T17:20:47.658 INFO:teuthology.orchestra.run.smithi181.stdout:(267/285): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T17:20:47.684 INFO:teuthology.orchestra.run.smithi181.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-12T17:20:47.718 INFO:teuthology.orchestra.run.smithi181.stdout:(269/285): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-12T17:20:47.743 INFO:teuthology.orchestra.run.smithi181.stdout:(270/285): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-12T17:20:47.768 INFO:teuthology.orchestra.run.smithi181.stdout:(271/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-12T17:20:47.794 INFO:teuthology.orchestra.run.smithi181.stdout:(272/285): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T17:20:47.819 INFO:teuthology.orchestra.run.smithi181.stdout:(273/285): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T17:20:47.861 INFO:teuthology.orchestra.run.smithi181.stdout:(274/285): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-09-12T17:20:47.886 INFO:teuthology.orchestra.run.smithi181.stdout:(275/285): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-09-12T17:20:47.911 INFO:teuthology.orchestra.run.smithi181.stdout:(276/285): python3-typing-extensions-4.12.2-2.e 809 kB/s | 74 kB 00:00 2024-09-12T17:20:47.936 INFO:teuthology.orchestra.run.smithi181.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-12T17:20:47.953 INFO:teuthology.orchestra.run.smithi181.stdout:(278/285): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-12T17:20:47.979 INFO:teuthology.orchestra.run.smithi181.stdout:(279/285): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-12T17:20:48.004 INFO:teuthology.orchestra.run.smithi181.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T17:20:48.029 INFO:teuthology.orchestra.run.smithi181.stdout:(281/285): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-12T17:20:48.054 INFO:teuthology.orchestra.run.smithi181.stdout:(282/285): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-12T17:20:48.105 INFO:teuthology.orchestra.run.smithi181.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T17:20:48.280 INFO:teuthology.orchestra.run.smithi181.stdout:(284/285): librados2-19.3.0-4762.gbad475c1.el9. 14 MB/s | 3.5 MB 00:00 2024-09-12T17:20:48.363 INFO:teuthology.orchestra.run.smithi181.stdout:(285/285): librbd1-19.3.0-4762.gbad475c1.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-12T17:20:48.370 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:20:48.370 INFO:teuthology.orchestra.run.smithi181.stdout:Total 17 MB/s | 322 MB 00:18 2024-09-12T17:20:50.723 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-12T17:20:50.927 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-12T17:20:50.927 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-12T17:20:51.392 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-12T17:20:51.575 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-12T17:20:51.575 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-12T17:20:54.311 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-12T17:20:54.311 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-12T17:20:54.697 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-12T17:20:54.698 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-12T17:21:04.791 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T17:21:04.841 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T17:21:04.973 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T17:21:05.000 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T17:21:05.140 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-12T17:21:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-12T17:21:05.213 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T17:21:05.233 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T17:21:05.246 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T17:21:05.267 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T17:21:05.348 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T17:21:05.392 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T17:21:05.430 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T17:21:05.454 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T17:21:05.484 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T17:21:05.494 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T17:21:05.519 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T17:21:05.541 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T17:21:05.566 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T17:21:05.582 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T17:21:05.607 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T17:21:05.665 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T17:21:05.904 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T17:21:06.029 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:21:06.050 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T17:21:06.152 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:21:06.166 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:21:06.188 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:21:06.281 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:21:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:21:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:21:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:21:06.356 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T17:21:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T17:21:06.411 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T17:21:06.437 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T17:21:06.452 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:21:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T17:21:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:21:06.493 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T17:21:06.522 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T17:21:06.529 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T17:21:06.563 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T17:21:06.598 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T17:21:06.624 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T17:21:06.656 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T17:21:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T17:21:06.681 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T17:21:06.718 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T17:21:06.815 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T17:21:06.853 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T17:21:06.856 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T17:21:06.889 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T17:21:06.918 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:21:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T17:21:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T17:21:07.030 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:21:07.061 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:21:07.064 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T17:21:07.100 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:21:07.123 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:21:07.148 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T17:21:07.179 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:21:07.199 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:21:07.206 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:21:07.251 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:21:07.315 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:21:07.347 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T17:21:07.370 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:21:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:21:07.398 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:21:07.424 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:21:07.549 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T17:21:07.580 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T17:21:07.598 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:21:07.615 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T17:21:07.636 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:21:07.690 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T17:21:07.752 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T17:21:07.763 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T17:21:07.791 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T17:21:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T17:21:07.834 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T17:21:07.837 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T17:21:07.858 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T17:21:07.911 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T17:21:07.914 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T17:21:07.944 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T17:21:07.964 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T17:21:07.969 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T17:21:07.998 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T17:21:08.003 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T17:21:08.030 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T17:21:08.047 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T17:21:08.055 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T17:21:08.087 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T17:21:08.103 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T17:21:08.123 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T17:21:08.128 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:21:08.147 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T17:21:08.173 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T17:21:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:21:08.202 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T17:21:08.234 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T17:21:08.256 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T17:21:08.268 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T17:21:08.293 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T17:21:08.314 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T17:21:08.340 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:21:08.342 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T17:21:08.381 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T17:21:08.414 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T17:21:08.423 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:21:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T17:21:08.493 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T17:21:08.524 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 51/287 2024-09-12T17:21:08.532 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T17:21:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 52/287 2024-09-12T17:21:08.575 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T17:21:08.609 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 53/287 2024-09-12T17:21:08.611 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T17:21:08.652 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T17:21:08.687 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T17:21:08.733 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T17:21:08.771 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 51/287 2024-09-12T17:21:08.822 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 52/287 2024-09-12T17:21:08.843 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T17:21:08.864 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 53/287 2024-09-12T17:21:08.907 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T17:21:08.945 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T17:21:09.095 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T17:21:09.153 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T17:21:09.461 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T17:21:09.543 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T17:21:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T17:21:09.658 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T17:21:09.701 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T17:21:09.737 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T17:21:09.757 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T17:21:09.767 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T17:21:09.841 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T17:21:09.842 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T17:21:09.878 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T17:21:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T17:21:09.903 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T17:21:09.938 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T17:21:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T17:21:09.976 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 68/287 2024-09-12T17:21:10.005 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T17:21:10.009 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T17:21:10.041 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T17:21:10.041 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T17:21:10.070 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T17:21:10.091 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T17:21:10.148 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T17:21:10.157 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:21:10.189 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T17:21:10.193 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T17:21:10.223 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T17:21:10.229 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T17:21:10.258 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T17:21:10.297 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 68/287 2024-09-12T17:21:10.324 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T17:21:10.329 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T17:21:10.361 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T17:21:10.387 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T17:21:10.403 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T17:21:10.459 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T17:21:10.469 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:21:10.499 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T17:21:10.535 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T17:21:10.591 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T17:21:10.644 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T17:21:10.686 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T17:21:10.710 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T17:21:10.819 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T17:21:10.826 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T17:21:10.862 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T17:21:10.904 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T17:21:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T17:21:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T17:21:11.011 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T17:21:11.048 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T17:21:11.060 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T17:21:11.089 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T17:21:11.095 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T17:21:11.121 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/287 2024-09-12T17:21:11.131 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T17:21:11.146 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T17:21:11.180 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T17:21:11.225 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T17:21:11.238 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T17:21:11.267 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T17:21:11.376 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T17:21:11.415 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T17:21:11.415 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T17:21:11.467 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T17:21:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T17:21:11.621 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T17:21:11.633 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T17:21:11.659 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T17:21:11.691 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T17:21:11.700 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T17:21:11.723 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T17:21:11.732 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/287 2024-09-12T17:21:11.757 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T17:21:11.761 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T17:21:11.811 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T17:21:11.847 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:21:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T17:21:11.861 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:21:11.861 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T17:21:11.862 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:21:11.985 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T17:21:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T17:21:12.060 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T17:21:12.137 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T17:21:12.205 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T17:21:12.229 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:21:12.254 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:21:12.257 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T17:21:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T17:21:12.294 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T17:21:12.325 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T17:21:12.355 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T17:21:12.397 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T17:21:12.433 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:21:12.449 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:21:12.449 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T17:21:12.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:21:12.654 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T17:21:12.722 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:21:12.738 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T17:21:12.759 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:21:12.774 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:21:12.774 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T17:21:12.774 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:21:12.791 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T17:21:12.814 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:21:12.824 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T17:21:12.841 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:21:12.866 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T17:21:12.867 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T17:21:12.900 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T17:21:12.942 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T17:21:12.976 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T17:21:13.074 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T17:21:13.124 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T17:21:13.163 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T17:21:13.277 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T17:21:13.340 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T17:21:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:21:13.453 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:21:13.470 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:21:13.470 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T17:21:13.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:21:13.527 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T17:21:13.561 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T17:21:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T17:21:13.638 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T17:21:13.679 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T17:21:13.775 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T17:21:13.827 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T17:21:13.874 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T17:21:13.985 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T17:21:14.044 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T17:21:14.091 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T17:21:14.145 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T17:21:14.178 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T17:21:14.281 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T17:21:14.335 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T17:21:14.522 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T17:21:14.559 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T17:21:14.610 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T17:21:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T17:21:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T17:21:14.939 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T17:21:15.054 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T17:21:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T17:21:15.148 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T17:21:15.226 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T17:21:15.263 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T17:21:15.298 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T17:21:15.309 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T17:21:15.330 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T17:21:15.345 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T17:21:15.393 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T17:21:15.514 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T17:21:15.536 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T17:21:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T17:21:15.943 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T17:21:16.005 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T17:21:16.049 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T17:21:16.091 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T17:21:16.124 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T17:21:16.305 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T17:21:16.315 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T17:21:16.355 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T17:21:16.421 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T17:21:16.442 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T17:21:17.189 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T17:21:17.319 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T17:21:17.740 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T17:21:17.840 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T17:21:17.895 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T17:21:17.933 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T17:21:17.960 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T17:21:17.990 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:21:18.001 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:21:18.001 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T17:21:18.002 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:21:18.052 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T17:21:18.085 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T17:21:18.114 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T17:21:18.445 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T17:21:18.493 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:21:18.593 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:21:18.626 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 145/287 2024-09-12T17:21:18.657 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T17:21:18.687 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T17:21:18.714 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T17:21:18.749 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T17:21:18.786 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T17:21:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T17:21:18.811 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T17:21:18.868 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T17:21:18.871 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T17:21:18.909 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:21:18.912 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T17:21:18.937 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T17:21:18.966 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:21:18.979 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:21:18.980 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T17:21:18.980 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:21:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T17:21:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T17:21:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T17:21:19.225 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:21:19.269 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T17:21:19.306 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T17:21:19.331 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T17:21:19.357 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T17:21:19.382 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T17:21:19.407 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T17:21:19.436 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T17:21:19.456 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T17:21:19.472 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T17:21:19.503 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:21:19.519 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T17:21:19.556 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T17:21:19.603 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T17:21:19.604 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:21:19.636 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 145/287 2024-09-12T17:21:19.639 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T17:21:19.676 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T17:21:19.706 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T17:21:19.769 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T17:21:19.813 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T17:21:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T17:21:19.877 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T17:21:19.903 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:21:20.106 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T17:21:20.179 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:21:20.230 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T17:21:20.242 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T17:21:20.258 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T17:21:20.283 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T17:21:20.309 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T17:21:20.313 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T17:21:20.334 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T17:21:20.337 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T17:21:20.359 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T17:21:20.366 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T17:21:20.396 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T17:21:20.440 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T17:21:20.448 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T17:21:20.493 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T17:21:20.496 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T17:21:20.523 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:21:20.533 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T17:21:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:21:20.569 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T17:21:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T17:21:20.594 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T17:21:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T17:21:20.630 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T17:21:20.666 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:21:21.115 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T17:21:21.272 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T17:21:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T17:21:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T17:21:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T17:21:21.481 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T17:21:21.539 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T17:21:21.565 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:21:21.587 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:21:21.620 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T17:21:21.655 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T17:21:21.690 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T17:21:21.717 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:21:32.474 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:21:32.517 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T17:21:32.545 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T17:21:32.587 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T17:21:32.619 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T17:21:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T17:21:33.179 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T17:21:33.210 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:21:33.274 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:21:33.304 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 184/287 2024-09-12T17:21:33.835 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:21:33.877 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T17:21:33.913 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T17:21:33.959 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T17:21:33.987 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T17:21:34.024 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T17:21:34.574 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T17:21:34.603 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:21:34.692 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:21:34.722 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 184/287 2024-09-12T17:21:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:21:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:21:36.288 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:21:36.332 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:21:36.424 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:21:36.424 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T17:21:36.424 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T17:21:36.424 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:21:36.457 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:21:37.193 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:21:37.237 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:21:37.843 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:21:37.882 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:21:37.983 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:21:37.983 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T17:21:37.983 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T17:21:37.983 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:21:38.016 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:21:45.785 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:21:45.785 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2024-09-12T17:21:45.785 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2024-09-12T17:21:45.785 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2024-09-12T17:21:45.785 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2024-09-12T17:21:45.785 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2024-09-12T17:21:45.785 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /root 2024-09-12T17:21:45.786 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2024-09-12T17:21:45.786 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:21:45.957 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:21:45.972 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:21:45.972 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:21:45.972 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T17:21:45.973 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:21:47.432 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:21:47.459 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:21:47.459 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:21:47.459 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T17:21:47.459 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:21:47.460 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:21:47.460 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:21:47.683 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:21:47.706 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:21:47.706 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:21:47.706 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T17:21:47.706 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:21:47.707 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:21:47.707 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:21:47.834 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:21:47.834 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /sys 2024-09-12T17:21:47.834 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /proc 2024-09-12T17:21:47.834 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /mnt 2024-09-12T17:21:47.834 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /var/tmp 2024-09-12T17:21:47.834 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /home 2024-09-12T17:21:47.834 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /root 2024-09-12T17:21:47.834 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /tmp 2024-09-12T17:21:47.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:21:48.015 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:21:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:21:48.033 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:21:48.033 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T17:21:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:21:48.151 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:21:48.174 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:21:48.174 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:21:48.174 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T17:21:48.174 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:21:48.174 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:21:48.175 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:21:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T17:21:49.583 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:21:49.612 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:21:49.612 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:21:49.612 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T17:21:49.612 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:21:49.612 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:21:49.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:21:49.850 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:21:49.875 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:21:49.876 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:21:49.876 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T17:21:49.876 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:21:49.876 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:21:49.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:21:50.351 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:21:50.376 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:21:50.376 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:21:50.377 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T17:21:50.377 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:21:50.377 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:21:50.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:21:50.482 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T17:21:51.177 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T17:21:51.285 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T17:21:51.341 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T17:21:51.398 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T17:21:51.593 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T17:21:51.646 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T17:21:51.725 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T17:21:51.822 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T17:21:51.962 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T17:21:52.004 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T17:21:52.051 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T17:21:52.917 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T17:21:52.978 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:21:53.330 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:21:53.368 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T17:21:53.399 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T17:21:53.426 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T17:21:53.461 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T17:21:53.498 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T17:21:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T17:21:53.552 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T17:21:53.577 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T17:21:53.602 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T17:21:53.614 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T17:21:53.628 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T17:21:53.654 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T17:21:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T17:21:53.720 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T17:21:53.728 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T17:21:53.748 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T17:21:53.783 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T17:21:53.786 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T17:21:53.819 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T17:21:53.850 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T17:21:53.859 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T17:21:53.884 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T17:21:53.918 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T17:21:53.955 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T17:21:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T17:21:54.045 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T17:21:54.084 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T17:21:54.097 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T17:21:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T17:21:54.130 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T17:21:54.160 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T17:21:54.213 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T17:21:54.215 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T17:21:54.246 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T17:21:54.282 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T17:21:54.314 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T17:21:54.320 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T17:21:54.339 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T17:21:54.465 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T17:21:54.508 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T17:21:54.513 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T17:21:54.539 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T17:21:54.554 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T17:21:54.577 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T17:21:54.602 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T17:21:54.634 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T17:21:54.767 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T17:21:54.836 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T17:21:54.904 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T17:21:54.933 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:21:55.041 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:21:55.080 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:21:55.095 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:21:55.125 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T17:21:55.148 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T17:21:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T17:21:55.513 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:21:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:21:55.543 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:21:55.560 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:21:55.560 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T17:21:55.560 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:21:55.795 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T17:21:55.865 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T17:21:55.894 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:21:55.911 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T17:21:55.935 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T17:21:55.956 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T17:21:55.966 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T17:21:55.981 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T17:21:55.993 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T17:21:56.037 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T17:21:56.074 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T17:21:56.101 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T17:21:56.127 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T17:21:56.153 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T17:21:56.194 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T17:21:56.220 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T17:21:56.246 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T17:21:56.289 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T17:21:56.319 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T17:21:56.321 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:21:56.347 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T17:21:56.360 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:21:56.376 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:21:56.383 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T17:21:56.418 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T17:21:56.450 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T17:21:56.484 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T17:21:56.518 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T17:21:56.556 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T17:21:56.595 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T17:21:56.646 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T17:21:56.706 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T17:21:56.745 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T17:21:56.776 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T17:21:56.836 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T17:21:56.870 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T17:21:56.907 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T17:21:56.929 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:21:56.938 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T17:21:56.963 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T17:21:57.016 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:21:57.060 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:21:57.088 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:21:57.146 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T17:21:57.174 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T17:21:57.201 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T17:21:57.237 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T17:21:57.277 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T17:21:57.294 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T17:21:57.350 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T17:21:57.385 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:21:57.407 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:21:57.413 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T17:21:57.444 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:21:57.478 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T17:21:57.514 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:21:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T17:21:57.556 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:21:57.566 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:21:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:21:57.598 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:21:57.617 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:21:57.640 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T17:21:57.705 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:21:57.745 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:21:57.762 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:21:57.791 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T17:21:57.814 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T17:21:58.020 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:21:58.046 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:21:58.079 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 265/287 2024-09-12T17:21:58.154 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 266/287 2024-09-12T17:21:58.187 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:21:58.208 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:21:58.234 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:21:58.254 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:21:58.254 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T17:21:58.254 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:21:58.505 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T17:21:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T17:21:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T17:21:58.664 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T17:21:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T17:21:59.023 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:21:59.060 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:21:59.081 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:21:59.625 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:21:59.719 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:21:59.768 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:21:59.800 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:22:00.013 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T17:22:00.077 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T17:22:00.101 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:22:00.125 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:22:00.161 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:22:00.231 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:22:00.272 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:22:00.284 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:22:00.314 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:22:00.335 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:22:00.366 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T17:22:00.773 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:22:00.805 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:22:00.839 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 265/287 2024-09-12T17:22:00.910 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 266/287 2024-09-12T17:22:00.937 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:22:01.422 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:22:01.485 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:22:02.445 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:22:02.477 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:22:02.593 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:22:02.755 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 270/287 2024-09-12T17:22:02.779 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:22:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:22:02.802 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:22:02.802 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T17:22:02.802 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:22:02.802 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:22:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:02.870 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:22:02.881 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:22:02.906 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 273/287 2024-09-12T17:22:02.943 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T17:22:03.000 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T17:22:03.023 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:22:03.039 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:22:03.039 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T17:22:03.039 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:03.991 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:22:04.014 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:22:04.014 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:22:04.014 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T17:22:04.014 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:22:04.015 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:22:04.015 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:04.058 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:22:04.081 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:22:04.081 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:22:04.081 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T17:22:04.081 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:04.357 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:22:04.393 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:22:04.410 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:22:04.416 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:22:04.416 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:22:04.416 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T17:22:04.416 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:22:04.416 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:22:04.416 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:05.429 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:22:05.460 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:22:05.586 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:22:05.756 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 270/287 2024-09-12T17:22:05.788 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:22:05.813 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:22:05.814 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:22:05.814 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T17:22:05.814 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:22:05.814 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:22:05.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:22:05.885 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:22:05.906 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 273/287 2024-09-12T17:22:05.936 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T17:22:05.986 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T17:22:06.016 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:22:06.033 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:22:06.033 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T17:22:06.033 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:07.059 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:22:07.084 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:22:07.084 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:22:07.084 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T17:22:07.084 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:22:07.085 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:22:07.085 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:07.126 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:22:07.150 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:22:07.151 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:22:07.151 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T17:22:07.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:07.485 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:22:07.510 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:22:07.510 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:22:07.510 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T17:22:07.510 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:22:07.511 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:22:07.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:08.705 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 280/287 2024-09-12T17:22:08.746 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 281/287 2024-09-12T17:22:08.786 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 282/287 2024-09-12T17:22:08.890 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 283/287 2024-09-12T17:22:08.946 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:22:08.977 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T17:22:08.977 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:22:09.069 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:22:09.069 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:22:09.152 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:22:09.170 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T17:22:09.177 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T17:22:09.185 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T17:22:09.196 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T17:22:09.196 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:22:09.196 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:22:09.196 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:09.254 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:22:09.322 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:22:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 280/287 2024-09-12T17:22:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 281/287 2024-09-12T17:22:12.128 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 282/287 2024-09-12T17:22:12.237 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 283/287 2024-09-12T17:22:12.299 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:22:12.337 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T17:22:12.337 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:22:12.438 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:22:12.438 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:22:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:22:12.547 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T17:22:12.554 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T17:22:12.564 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T17:22:12.575 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T17:22:12.575 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:22:12.576 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:22:12.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:12.636 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:22:12.710 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:22:18.873 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:22:18.873 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/287 2024-09-12T17:22:18.873 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2/287 2024-09-12T17:22:18.873 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 3/287 2024-09-12T17:22:18.873 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 4/287 2024-09-12T17:22:18.873 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 5/287 2024-09-12T17:22:18.873 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 6/287 2024-09-12T17:22:18.873 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 7/287 2024-09-12T17:22:18.874 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 8/287 2024-09-12T17:22:18.874 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 9/287 2024-09-12T17:22:18.874 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:22:18.874 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:22:18.874 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:22:18.874 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 13/287 2024-09-12T17:22:18.874 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 14/287 2024-09-12T17:22:18.874 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 15/287 2024-09-12T17:22:18.874 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 16/287 2024-09-12T17:22:18.874 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 17/287 2024-09-12T17:22:18.874 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 18/287 2024-09-12T17:22:18.874 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 19/287 2024-09-12T17:22:18.874 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 20/287 2024-09-12T17:22:18.875 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 21/287 2024-09-12T17:22:18.875 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 22/287 2024-09-12T17:22:18.875 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/287 2024-09-12T17:22:18.875 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:22:18.875 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 25/287 2024-09-12T17:22:18.875 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 26/287 2024-09-12T17:22:18.875 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 27/287 2024-09-12T17:22:18.875 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 28/287 2024-09-12T17:22:18.875 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 29/287 2024-09-12T17:22:18.875 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 30/287 2024-09-12T17:22:18.875 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 31/287 2024-09-12T17:22:18.875 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 32/287 2024-09-12T17:22:18.876 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 33/287 2024-09-12T17:22:18.876 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 34/287 2024-09-12T17:22:18.876 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 35/287 2024-09-12T17:22:18.876 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 36/287 2024-09-12T17:22:18.876 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T17:22:18.876 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T17:22:18.876 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T17:22:18.876 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T17:22:18.876 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T17:22:18.876 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T17:22:18.876 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T17:22:18.876 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T17:22:18.876 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T17:22:18.877 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T17:22:18.877 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T17:22:18.877 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T17:22:18.877 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T17:22:18.877 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T17:22:18.877 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T17:22:18.877 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T17:22:18.877 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T17:22:18.877 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T17:22:18.877 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T17:22:18.877 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T17:22:18.877 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T17:22:18.877 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T17:22:18.878 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T17:22:18.878 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T17:22:18.878 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T17:22:18.878 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T17:22:18.878 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T17:22:18.878 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T17:22:18.878 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T17:22:18.878 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T17:22:18.878 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T17:22:18.878 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T17:22:18.878 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T17:22:18.878 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T17:22:18.878 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T17:22:18.878 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:22:18.879 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T17:22:18.879 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T17:22:18.879 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T17:22:18.879 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T17:22:18.879 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T17:22:18.879 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T17:22:18.879 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T17:22:18.879 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T17:22:18.879 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T17:22:18.879 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T17:22:18.879 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T17:22:18.879 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T17:22:18.879 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T17:22:18.879 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T17:22:18.880 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T17:22:18.880 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T17:22:18.880 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T17:22:18.880 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T17:22:18.880 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T17:22:18.880 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T17:22:18.880 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T17:22:18.880 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T17:22:18.880 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T17:22:18.880 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T17:22:18.880 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T17:22:18.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T17:22:18.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T17:22:18.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T17:22:18.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T17:22:18.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T17:22:18.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T17:22:18.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T17:22:18.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T17:22:18.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T17:22:18.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T17:22:18.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T17:22:18.881 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T17:22:18.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T17:22:18.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T17:22:18.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T17:22:18.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T17:22:18.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T17:22:18.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T17:22:18.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T17:22:18.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T17:22:18.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T17:22:18.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T17:22:18.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T17:22:18.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T17:22:18.882 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T17:22:18.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T17:22:18.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T17:22:18.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T17:22:18.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T17:22:18.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T17:22:18.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T17:22:18.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T17:22:18.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T17:22:18.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T17:22:18.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T17:22:18.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T17:22:18.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T17:22:18.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T17:22:18.883 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T17:22:18.884 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T17:22:18.884 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T17:22:18.884 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T17:22:18.884 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T17:22:18.884 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T17:22:18.884 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T17:22:18.884 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T17:22:18.884 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T17:22:18.884 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T17:22:18.884 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T17:22:18.884 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T17:22:18.884 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T17:22:18.885 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T17:22:18.885 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T17:22:18.885 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T17:22:18.885 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T17:22:18.885 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T17:22:18.885 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T17:22:18.885 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T17:22:18.885 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T17:22:18.885 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T17:22:18.885 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T17:22:18.885 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T17:22:18.885 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T17:22:18.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T17:22:18.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T17:22:18.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T17:22:18.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T17:22:18.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T17:22:18.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T17:22:18.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T17:22:18.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T17:22:18.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T17:22:18.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T17:22:18.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T17:22:18.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T17:22:18.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T17:22:18.886 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T17:22:18.887 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T17:22:18.887 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T17:22:18.887 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T17:22:18.887 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T17:22:18.887 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T17:22:18.887 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T17:22:18.887 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T17:22:18.887 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T17:22:18.887 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T17:22:18.887 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T17:22:18.887 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T17:22:18.887 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T17:22:18.887 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T17:22:18.888 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T17:22:18.888 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T17:22:18.888 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T17:22:18.888 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T17:22:18.888 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T17:22:18.888 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T17:22:18.888 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T17:22:18.888 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T17:22:18.888 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T17:22:18.888 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T17:22:18.888 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T17:22:18.888 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T17:22:18.889 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T17:22:18.889 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T17:22:18.889 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T17:22:18.889 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T17:22:18.889 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T17:22:18.889 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T17:22:18.889 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T17:22:18.889 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T17:22:18.889 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T17:22:18.889 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T17:22:18.889 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T17:22:18.890 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T17:22:18.890 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T17:22:18.890 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T17:22:18.890 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T17:22:18.890 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T17:22:18.890 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T17:22:18.890 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T17:22:18.890 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T17:22:18.890 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T17:22:18.890 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T17:22:18.890 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T17:22:18.890 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T17:22:18.890 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T17:22:18.891 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T17:22:18.891 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T17:22:18.891 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T17:22:18.891 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T17:22:18.891 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T17:22:18.891 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T17:22:18.891 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T17:22:18.891 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T17:22:18.891 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T17:22:18.891 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T17:22:18.891 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T17:22:18.891 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T17:22:18.891 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T17:22:18.892 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T17:22:18.892 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T17:22:18.892 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T17:22:18.892 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T17:22:18.892 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T17:22:18.892 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T17:22:18.892 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 243/287 2024-09-12T17:22:18.892 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T17:22:18.892 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T17:22:18.892 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T17:22:18.892 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T17:22:18.892 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T17:22:18.892 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T17:22:18.893 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T17:22:18.893 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T17:22:18.893 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T17:22:18.893 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T17:22:18.893 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T17:22:18.893 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T17:22:18.893 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T17:22:18.893 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T17:22:18.893 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T17:22:18.893 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T17:22:18.893 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T17:22:18.893 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T17:22:18.894 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T17:22:18.894 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T17:22:18.894 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T17:22:18.894 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T17:22:18.894 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T17:22:18.894 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T17:22:18.894 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T17:22:18.894 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T17:22:18.894 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T17:22:18.894 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T17:22:18.894 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T17:22:18.894 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T17:22:18.894 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T17:22:18.894 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T17:22:18.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T17:22:18.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T17:22:18.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T17:22:18.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T17:22:18.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T17:22:18.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T17:22:18.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T17:22:18.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T17:22:18.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:22:18.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T17:22:18.895 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 286/287 2024-09-12T17:22:22.513 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:22:22.513 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:22.513 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-09-12T17:22:22.513 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.513 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.514 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-12T17:22:22.514 INFO:teuthology.orchestra.run.smithi181.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T17:22:22.514 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T17:22:22.514 INFO:teuthology.orchestra.run.smithi181.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T17:22:22.514 INFO:teuthology.orchestra.run.smithi181.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T17:22:22.514 INFO:teuthology.orchestra.run.smithi181.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T17:22:22.514 INFO:teuthology.orchestra.run.smithi181.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T17:22:22.514 INFO:teuthology.orchestra.run.smithi181.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T17:22:22.514 INFO:teuthology.orchestra.run.smithi181.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T17:22:22.514 INFO:teuthology.orchestra.run.smithi181.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T17:22:22.514 INFO:teuthology.orchestra.run.smithi181.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T17:22:22.514 INFO:teuthology.orchestra.run.smithi181.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T17:22:22.514 INFO:teuthology.orchestra.run.smithi181.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T17:22:22.515 INFO:teuthology.orchestra.run.smithi181.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T17:22:22.515 INFO:teuthology.orchestra.run.smithi181.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T17:22:22.515 INFO:teuthology.orchestra.run.smithi181.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T17:22:22.515 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T17:22:22.515 INFO:teuthology.orchestra.run.smithi181.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T17:22:22.515 INFO:teuthology.orchestra.run.smithi181.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T17:22:22.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:22.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.516 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:22.516 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:22.516 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:22.516 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:22.516 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:22.516 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.516 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.516 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:22.516 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.516 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.516 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.516 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:22.517 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:22.517 INFO:teuthology.orchestra.run.smithi181.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T17:22:22.517 INFO:teuthology.orchestra.run.smithi181.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T17:22:22.517 INFO:teuthology.orchestra.run.smithi181.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T17:22:22.517 INFO:teuthology.orchestra.run.smithi181.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T17:22:22.517 INFO:teuthology.orchestra.run.smithi181.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T17:22:22.517 INFO:teuthology.orchestra.run.smithi181.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T17:22:22.517 INFO:teuthology.orchestra.run.smithi181.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T17:22:22.517 INFO:teuthology.orchestra.run.smithi181.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T17:22:22.517 INFO:teuthology.orchestra.run.smithi181.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T17:22:22.517 INFO:teuthology.orchestra.run.smithi181.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T17:22:22.517 INFO:teuthology.orchestra.run.smithi181.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T17:22:22.517 INFO:teuthology.orchestra.run.smithi181.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T17:22:22.518 INFO:teuthology.orchestra.run.smithi181.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T17:22:22.518 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T17:22:22.518 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T17:22:22.518 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T17:22:22.518 INFO:teuthology.orchestra.run.smithi181.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T17:22:22.518 INFO:teuthology.orchestra.run.smithi181.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T17:22:22.518 INFO:teuthology.orchestra.run.smithi181.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T17:22:22.518 INFO:teuthology.orchestra.run.smithi181.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T17:22:22.518 INFO:teuthology.orchestra.run.smithi181.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T17:22:22.518 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T17:22:22.518 INFO:teuthology.orchestra.run.smithi181.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T17:22:22.518 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T17:22:22.518 INFO:teuthology.orchestra.run.smithi181.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T17:22:22.519 INFO:teuthology.orchestra.run.smithi181.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T17:22:22.519 INFO:teuthology.orchestra.run.smithi181.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T17:22:22.519 INFO:teuthology.orchestra.run.smithi181.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T17:22:22.519 INFO:teuthology.orchestra.run.smithi181.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T17:22:22.519 INFO:teuthology.orchestra.run.smithi181.stdout: guava-30.1-6.el9.noarch 2024-09-12T17:22:22.519 INFO:teuthology.orchestra.run.smithi181.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T17:22:22.519 INFO:teuthology.orchestra.run.smithi181.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T17:22:22.519 INFO:teuthology.orchestra.run.smithi181.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T17:22:22.519 INFO:teuthology.orchestra.run.smithi181.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T17:22:22.519 INFO:teuthology.orchestra.run.smithi181.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T17:22:22.519 INFO:teuthology.orchestra.run.smithi181.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T17:22:22.519 INFO:teuthology.orchestra.run.smithi181.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:22:22.519 INFO:teuthology.orchestra.run.smithi181.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:22:22.519 INFO:teuthology.orchestra.run.smithi181.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:22:22.520 INFO:teuthology.orchestra.run.smithi181.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T17:22:22.520 INFO:teuthology.orchestra.run.smithi181.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T17:22:22.520 INFO:teuthology.orchestra.run.smithi181.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T17:22:22.520 INFO:teuthology.orchestra.run.smithi181.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T17:22:22.520 INFO:teuthology.orchestra.run.smithi181.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T17:22:22.520 INFO:teuthology.orchestra.run.smithi181.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T17:22:22.520 INFO:teuthology.orchestra.run.smithi181.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T17:22:22.520 INFO:teuthology.orchestra.run.smithi181.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T17:22:22.520 INFO:teuthology.orchestra.run.smithi181.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T17:22:22.520 INFO:teuthology.orchestra.run.smithi181.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T17:22:22.520 INFO:teuthology.orchestra.run.smithi181.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T17:22:22.520 INFO:teuthology.orchestra.run.smithi181.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T17:22:22.520 INFO:teuthology.orchestra.run.smithi181.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T17:22:22.521 INFO:teuthology.orchestra.run.smithi181.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T17:22:22.521 INFO:teuthology.orchestra.run.smithi181.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T17:22:22.521 INFO:teuthology.orchestra.run.smithi181.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T17:22:22.521 INFO:teuthology.orchestra.run.smithi181.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T17:22:22.521 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T17:22:22.521 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T17:22:22.521 INFO:teuthology.orchestra.run.smithi181.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T17:22:22.521 INFO:teuthology.orchestra.run.smithi181.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T17:22:22.521 INFO:teuthology.orchestra.run.smithi181.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T17:22:22.521 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.521 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.522 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.522 INFO:teuthology.orchestra.run.smithi181.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T17:22:22.522 INFO:teuthology.orchestra.run.smithi181.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T17:22:22.522 INFO:teuthology.orchestra.run.smithi181.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T17:22:22.522 INFO:teuthology.orchestra.run.smithi181.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T17:22:22.522 INFO:teuthology.orchestra.run.smithi181.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T17:22:22.522 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T17:22:22.522 INFO:teuthology.orchestra.run.smithi181.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T17:22:22.522 INFO:teuthology.orchestra.run.smithi181.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T17:22:22.522 INFO:teuthology.orchestra.run.smithi181.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T17:22:22.522 INFO:teuthology.orchestra.run.smithi181.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T17:22:22.523 INFO:teuthology.orchestra.run.smithi181.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T17:22:22.523 INFO:teuthology.orchestra.run.smithi181.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T17:22:22.523 INFO:teuthology.orchestra.run.smithi181.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T17:22:22.523 INFO:teuthology.orchestra.run.smithi181.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T17:22:22.523 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T17:22:22.523 INFO:teuthology.orchestra.run.smithi181.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T17:22:22.523 INFO:teuthology.orchestra.run.smithi181.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T17:22:22.523 INFO:teuthology.orchestra.run.smithi181.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T17:22:22.523 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T17:22:22.523 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T17:22:22.523 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T17:22:22.523 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.523 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.524 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T17:22:22.524 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.524 INFO:teuthology.orchestra.run.smithi181.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T17:22:22.524 INFO:teuthology.orchestra.run.smithi181.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T17:22:22.524 INFO:teuthology.orchestra.run.smithi181.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T17:22:22.524 INFO:teuthology.orchestra.run.smithi181.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T17:22:22.524 INFO:teuthology.orchestra.run.smithi181.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T17:22:22.524 INFO:teuthology.orchestra.run.smithi181.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T17:22:22.524 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T17:22:22.524 INFO:teuthology.orchestra.run.smithi181.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T17:22:22.524 INFO:teuthology.orchestra.run.smithi181.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T17:22:22.524 INFO:teuthology.orchestra.run.smithi181.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T17:22:22.524 INFO:teuthology.orchestra.run.smithi181.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T17:22:22.525 INFO:teuthology.orchestra.run.smithi181.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T17:22:22.525 INFO:teuthology.orchestra.run.smithi181.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T17:22:22.525 INFO:teuthology.orchestra.run.smithi181.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T17:22:22.525 INFO:teuthology.orchestra.run.smithi181.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T17:22:22.525 INFO:teuthology.orchestra.run.smithi181.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T17:22:22.525 INFO:teuthology.orchestra.run.smithi181.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T17:22:22.525 INFO:teuthology.orchestra.run.smithi181.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T17:22:22.525 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T17:22:22.525 INFO:teuthology.orchestra.run.smithi181.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T17:22:22.525 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T17:22:22.525 INFO:teuthology.orchestra.run.smithi181.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T17:22:22.525 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T17:22:22.526 INFO:teuthology.orchestra.run.smithi181.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T17:22:22.526 INFO:teuthology.orchestra.run.smithi181.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T17:22:22.526 INFO:teuthology.orchestra.run.smithi181.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T17:22:22.526 INFO:teuthology.orchestra.run.smithi181.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T17:22:22.526 INFO:teuthology.orchestra.run.smithi181.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T17:22:22.526 INFO:teuthology.orchestra.run.smithi181.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T17:22:22.526 INFO:teuthology.orchestra.run.smithi181.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T17:22:22.526 INFO:teuthology.orchestra.run.smithi181.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T17:22:22.526 INFO:teuthology.orchestra.run.smithi181.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T17:22:22.526 INFO:teuthology.orchestra.run.smithi181.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T17:22:22.526 INFO:teuthology.orchestra.run.smithi181.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T17:22:22.526 INFO:teuthology.orchestra.run.smithi181.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T17:22:22.526 INFO:teuthology.orchestra.run.smithi181.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T17:22:22.527 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T17:22:22.527 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T17:22:22.527 INFO:teuthology.orchestra.run.smithi181.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T17:22:22.527 INFO:teuthology.orchestra.run.smithi181.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T17:22:22.527 INFO:teuthology.orchestra.run.smithi181.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T17:22:22.527 INFO:teuthology.orchestra.run.smithi181.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T17:22:22.527 INFO:teuthology.orchestra.run.smithi181.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T17:22:22.527 INFO:teuthology.orchestra.run.smithi181.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T17:22:22.527 INFO:teuthology.orchestra.run.smithi181.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T17:22:22.527 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T17:22:22.527 INFO:teuthology.orchestra.run.smithi181.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T17:22:22.527 INFO:teuthology.orchestra.run.smithi181.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T17:22:22.527 INFO:teuthology.orchestra.run.smithi181.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T17:22:22.528 INFO:teuthology.orchestra.run.smithi181.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T17:22:22.528 INFO:teuthology.orchestra.run.smithi181.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T17:22:22.528 INFO:teuthology.orchestra.run.smithi181.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T17:22:22.528 INFO:teuthology.orchestra.run.smithi181.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T17:22:22.528 INFO:teuthology.orchestra.run.smithi181.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T17:22:22.528 INFO:teuthology.orchestra.run.smithi181.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T17:22:22.528 INFO:teuthology.orchestra.run.smithi181.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T17:22:22.528 INFO:teuthology.orchestra.run.smithi181.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T17:22:22.528 INFO:teuthology.orchestra.run.smithi181.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T17:22:22.528 INFO:teuthology.orchestra.run.smithi181.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T17:22:22.528 INFO:teuthology.orchestra.run.smithi181.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T17:22:22.528 INFO:teuthology.orchestra.run.smithi181.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T17:22:22.528 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T17:22:22.529 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T17:22:22.529 INFO:teuthology.orchestra.run.smithi181.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T17:22:22.529 INFO:teuthology.orchestra.run.smithi181.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T17:22:22.529 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T17:22:22.529 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T17:22:22.529 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T17:22:22.529 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T17:22:22.529 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.529 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.529 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.529 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T17:22:22.529 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T17:22:22.529 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T17:22:22.530 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T17:22:22.530 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T17:22:22.530 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T17:22:22.530 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T17:22:22.530 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T17:22:22.530 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T17:22:22.530 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T17:22:22.530 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T17:22:22.530 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T17:22:22.530 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T17:22:22.530 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T17:22:22.530 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T17:22:22.530 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T17:22:22.531 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T17:22:22.531 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T17:22:22.531 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T17:22:22.531 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T17:22:22.531 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T17:22:22.531 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T17:22:22.531 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T17:22:22.531 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T17:22:22.531 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T17:22:22.531 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T17:22:22.531 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T17:22:22.531 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T17:22:22.531 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T17:22:22.532 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T17:22:22.532 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T17:22:22.532 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T17:22:22.532 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T17:22:22.532 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T17:22:22.532 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T17:22:22.532 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T17:22:22.532 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T17:22:22.532 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.532 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.533 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T17:22:22.533 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T17:22:22.533 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T17:22:22.533 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.533 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T17:22:22.533 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T17:22:22.533 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T17:22:22.533 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T17:22:22.533 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T17:22:22.533 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T17:22:22.533 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T17:22:22.533 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T17:22:22.533 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T17:22:22.534 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T17:22:22.534 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T17:22:22.534 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T17:22:22.534 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T17:22:22.534 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T17:22:22.534 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.534 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.534 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:22.534 INFO:teuthology.orchestra.run.smithi181.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T17:22:22.534 INFO:teuthology.orchestra.run.smithi181.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T17:22:22.534 INFO:teuthology.orchestra.run.smithi181.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T17:22:22.534 INFO:teuthology.orchestra.run.smithi181.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T17:22:22.534 INFO:teuthology.orchestra.run.smithi181.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T17:22:22.534 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T17:22:22.535 INFO:teuthology.orchestra.run.smithi181.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T17:22:22.535 INFO:teuthology.orchestra.run.smithi181.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T17:22:22.535 INFO:teuthology.orchestra.run.smithi181.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T17:22:22.535 INFO:teuthology.orchestra.run.smithi181.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T17:22:22.535 INFO:teuthology.orchestra.run.smithi181.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T17:22:22.535 INFO:teuthology.orchestra.run.smithi181.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T17:22:22.535 INFO:teuthology.orchestra.run.smithi181.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T17:22:22.535 INFO:teuthology.orchestra.run.smithi181.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T17:22:22.535 INFO:teuthology.orchestra.run.smithi181.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T17:22:22.535 INFO:teuthology.orchestra.run.smithi181.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T17:22:22.535 INFO:teuthology.orchestra.run.smithi181.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T17:22:22.535 INFO:teuthology.orchestra.run.smithi181.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T17:22:22.535 INFO:teuthology.orchestra.run.smithi181.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T17:22:22.536 INFO:teuthology.orchestra.run.smithi181.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T17:22:22.536 INFO:teuthology.orchestra.run.smithi181.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T17:22:22.536 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T17:22:22.536 INFO:teuthology.orchestra.run.smithi181.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T17:22:22.536 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:22.536 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-12T17:22:22.673 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:22:22.674 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/287 2024-09-12T17:22:22.674 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2/287 2024-09-12T17:22:22.674 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 3/287 2024-09-12T17:22:22.674 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 4/287 2024-09-12T17:22:22.674 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 5/287 2024-09-12T17:22:22.674 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 6/287 2024-09-12T17:22:22.674 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 7/287 2024-09-12T17:22:22.674 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 8/287 2024-09-12T17:22:22.674 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 9/287 2024-09-12T17:22:22.674 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:22:22.674 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:22:22.674 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:22:22.674 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 13/287 2024-09-12T17:22:22.675 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 14/287 2024-09-12T17:22:22.675 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 15/287 2024-09-12T17:22:22.675 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 16/287 2024-09-12T17:22:22.675 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 17/287 2024-09-12T17:22:22.675 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 18/287 2024-09-12T17:22:22.675 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 19/287 2024-09-12T17:22:22.675 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 20/287 2024-09-12T17:22:22.675 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 21/287 2024-09-12T17:22:22.675 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 22/287 2024-09-12T17:22:22.675 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/287 2024-09-12T17:22:22.675 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:22:22.675 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 25/287 2024-09-12T17:22:22.675 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 26/287 2024-09-12T17:22:22.675 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 27/287 2024-09-12T17:22:22.698 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 28/287 2024-09-12T17:22:22.698 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 29/287 2024-09-12T17:22:22.698 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 30/287 2024-09-12T17:22:22.698 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 31/287 2024-09-12T17:22:22.698 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 32/287 2024-09-12T17:22:22.698 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 33/287 2024-09-12T17:22:22.698 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 34/287 2024-09-12T17:22:22.698 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 35/287 2024-09-12T17:22:22.698 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 36/287 2024-09-12T17:22:22.699 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T17:22:22.699 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T17:22:22.699 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T17:22:22.699 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T17:22:22.699 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T17:22:22.699 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T17:22:22.699 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T17:22:22.699 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T17:22:22.699 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T17:22:22.699 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T17:22:22.699 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T17:22:22.699 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T17:22:22.700 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T17:22:22.700 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T17:22:22.700 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T17:22:22.700 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T17:22:22.700 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T17:22:22.700 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T17:22:22.700 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T17:22:22.700 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T17:22:22.700 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T17:22:22.700 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T17:22:22.700 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T17:22:22.700 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T17:22:22.701 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T17:22:22.701 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T17:22:22.701 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T17:22:22.701 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T17:22:22.701 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T17:22:22.701 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T17:22:22.701 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T17:22:22.701 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T17:22:22.701 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T17:22:22.701 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T17:22:22.701 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T17:22:22.701 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:22:22.701 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T17:22:22.702 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T17:22:22.702 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T17:22:22.702 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T17:22:22.702 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T17:22:22.702 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T17:22:22.702 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T17:22:22.702 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T17:22:22.702 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T17:22:22.702 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T17:22:22.702 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T17:22:22.702 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T17:22:22.702 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T17:22:22.703 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T17:22:22.703 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T17:22:22.703 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T17:22:22.703 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T17:22:22.703 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T17:22:22.703 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T17:22:22.703 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T17:22:22.703 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T17:22:22.703 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T17:22:22.703 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T17:22:22.703 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T17:22:22.703 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T17:22:22.703 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T17:22:22.703 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T17:22:22.704 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T17:22:22.704 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T17:22:22.704 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T17:22:22.704 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T17:22:22.704 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T17:22:22.704 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T17:22:22.704 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T17:22:22.704 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T17:22:22.704 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T17:22:22.704 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T17:22:22.704 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T17:22:22.704 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T17:22:22.705 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T17:22:22.705 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T17:22:22.705 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T17:22:22.705 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T17:22:22.705 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T17:22:22.705 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T17:22:22.705 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T17:22:22.705 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T17:22:22.705 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T17:22:22.705 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T17:22:22.705 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T17:22:22.705 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T17:22:22.706 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T17:22:22.706 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T17:22:22.706 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T17:22:22.706 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T17:22:22.706 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T17:22:22.706 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T17:22:22.706 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T17:22:22.706 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T17:22:22.706 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T17:22:22.706 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T17:22:22.706 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T17:22:22.706 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T17:22:22.707 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T17:22:22.707 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T17:22:22.707 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T17:22:22.707 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T17:22:22.707 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T17:22:22.707 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T17:22:22.707 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T17:22:22.707 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T17:22:22.707 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T17:22:22.707 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T17:22:22.707 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T17:22:22.707 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T17:22:22.708 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T17:22:22.708 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T17:22:22.708 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T17:22:22.708 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T17:22:22.708 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T17:22:22.708 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T17:22:22.708 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T17:22:22.708 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T17:22:22.708 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T17:22:22.708 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T17:22:22.708 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T17:22:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T17:22:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T17:22:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T17:22:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T17:22:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T17:22:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T17:22:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T17:22:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T17:22:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T17:22:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T17:22:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T17:22:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T17:22:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T17:22:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T17:22:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T17:22:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T17:22:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T17:22:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T17:22:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T17:22:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T17:22:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T17:22:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T17:22:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T17:22:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T17:22:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T17:22:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T17:22:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T17:22:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T17:22:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T17:22:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T17:22:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T17:22:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T17:22:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T17:22:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T17:22:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T17:22:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T17:22:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T17:22:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T17:22:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T17:22:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T17:22:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T17:22:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T17:22:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T17:22:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T17:22:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T17:22:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T17:22:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T17:22:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T17:22:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T17:22:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T17:22:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T17:22:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T17:22:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T17:22:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T17:22:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T17:22:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T17:22:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T17:22:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T17:22:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T17:22:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T17:22:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T17:22:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T17:22:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T17:22:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T17:22:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T17:22:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T17:22:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T17:22:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T17:22:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T17:22:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T17:22:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T17:22:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T17:22:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T17:22:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T17:22:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T17:22:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T17:22:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T17:22:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T17:22:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T17:22:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T17:22:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T17:22:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T17:22:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T17:22:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T17:22:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 243/287 2024-09-12T17:22:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T17:22:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T17:22:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T17:22:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T17:22:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T17:22:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T17:22:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T17:22:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T17:22:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T17:22:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T17:22:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T17:22:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T17:22:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T17:22:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T17:22:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T17:22:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T17:22:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T17:22:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T17:22:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T17:22:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T17:22:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T17:22:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T17:22:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T17:22:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T17:22:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T17:22:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T17:22:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T17:22:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T17:22:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T17:22:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T17:22:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T17:22:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T17:22:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T17:22:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T17:22:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T17:22:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T17:22:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T17:22:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T17:22:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T17:22:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T17:22:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:22:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T17:22:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 286/287 2024-09-12T17:22:22.959 DEBUG:teuthology.parallel:result is None 2024-09-12T17:22:26.363 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:22:26.364 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:26.364 INFO:teuthology.orchestra.run.smithi044.stdout:Upgraded: 2024-09-12T17:22:26.364 INFO:teuthology.orchestra.run.smithi044.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.364 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.364 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-12T17:22:26.364 INFO:teuthology.orchestra.run.smithi044.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T17:22:26.364 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T17:22:26.364 INFO:teuthology.orchestra.run.smithi044.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T17:22:26.364 INFO:teuthology.orchestra.run.smithi044.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T17:22:26.365 INFO:teuthology.orchestra.run.smithi044.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T17:22:26.365 INFO:teuthology.orchestra.run.smithi044.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T17:22:26.365 INFO:teuthology.orchestra.run.smithi044.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T17:22:26.365 INFO:teuthology.orchestra.run.smithi044.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T17:22:26.365 INFO:teuthology.orchestra.run.smithi044.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T17:22:26.365 INFO:teuthology.orchestra.run.smithi044.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T17:22:26.365 INFO:teuthology.orchestra.run.smithi044.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T17:22:26.365 INFO:teuthology.orchestra.run.smithi044.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T17:22:26.365 INFO:teuthology.orchestra.run.smithi044.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T17:22:26.365 INFO:teuthology.orchestra.run.smithi044.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T17:22:26.365 INFO:teuthology.orchestra.run.smithi044.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T17:22:26.365 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T17:22:26.365 INFO:teuthology.orchestra.run.smithi044.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T17:22:26.366 INFO:teuthology.orchestra.run.smithi044.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T17:22:26.366 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.366 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.366 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.366 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.366 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:26.366 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.366 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.366 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.366 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:26.366 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:26.366 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:26.366 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:26.367 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:26.367 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.367 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.367 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:26.367 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.367 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.367 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.367 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:26.367 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:22:26.367 INFO:teuthology.orchestra.run.smithi044.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T17:22:26.367 INFO:teuthology.orchestra.run.smithi044.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T17:22:26.367 INFO:teuthology.orchestra.run.smithi044.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T17:22:26.367 INFO:teuthology.orchestra.run.smithi044.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T17:22:26.368 INFO:teuthology.orchestra.run.smithi044.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T17:22:26.368 INFO:teuthology.orchestra.run.smithi044.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T17:22:26.368 INFO:teuthology.orchestra.run.smithi044.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T17:22:26.368 INFO:teuthology.orchestra.run.smithi044.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T17:22:26.368 INFO:teuthology.orchestra.run.smithi044.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T17:22:26.368 INFO:teuthology.orchestra.run.smithi044.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T17:22:26.368 INFO:teuthology.orchestra.run.smithi044.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T17:22:26.368 INFO:teuthology.orchestra.run.smithi044.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T17:22:26.368 INFO:teuthology.orchestra.run.smithi044.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T17:22:26.368 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T17:22:26.368 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T17:22:26.368 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T17:22:26.369 INFO:teuthology.orchestra.run.smithi044.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T17:22:26.369 INFO:teuthology.orchestra.run.smithi044.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T17:22:26.369 INFO:teuthology.orchestra.run.smithi044.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T17:22:26.369 INFO:teuthology.orchestra.run.smithi044.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T17:22:26.369 INFO:teuthology.orchestra.run.smithi044.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T17:22:26.369 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T17:22:26.369 INFO:teuthology.orchestra.run.smithi044.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T17:22:26.369 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T17:22:26.369 INFO:teuthology.orchestra.run.smithi044.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T17:22:26.369 INFO:teuthology.orchestra.run.smithi044.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T17:22:26.369 INFO:teuthology.orchestra.run.smithi044.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T17:22:26.369 INFO:teuthology.orchestra.run.smithi044.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T17:22:26.369 INFO:teuthology.orchestra.run.smithi044.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T17:22:26.370 INFO:teuthology.orchestra.run.smithi044.stdout: guava-30.1-6.el9.noarch 2024-09-12T17:22:26.370 INFO:teuthology.orchestra.run.smithi044.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T17:22:26.370 INFO:teuthology.orchestra.run.smithi044.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T17:22:26.370 INFO:teuthology.orchestra.run.smithi044.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T17:22:26.370 INFO:teuthology.orchestra.run.smithi044.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T17:22:26.370 INFO:teuthology.orchestra.run.smithi044.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T17:22:26.370 INFO:teuthology.orchestra.run.smithi044.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T17:22:26.370 INFO:teuthology.orchestra.run.smithi044.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:22:26.370 INFO:teuthology.orchestra.run.smithi044.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:22:26.370 INFO:teuthology.orchestra.run.smithi044.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:22:26.370 INFO:teuthology.orchestra.run.smithi044.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T17:22:26.370 INFO:teuthology.orchestra.run.smithi044.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T17:22:26.370 INFO:teuthology.orchestra.run.smithi044.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T17:22:26.371 INFO:teuthology.orchestra.run.smithi044.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T17:22:26.371 INFO:teuthology.orchestra.run.smithi044.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T17:22:26.371 INFO:teuthology.orchestra.run.smithi044.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T17:22:26.371 INFO:teuthology.orchestra.run.smithi044.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T17:22:26.371 INFO:teuthology.orchestra.run.smithi044.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T17:22:26.371 INFO:teuthology.orchestra.run.smithi044.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T17:22:26.371 INFO:teuthology.orchestra.run.smithi044.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T17:22:26.371 INFO:teuthology.orchestra.run.smithi044.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T17:22:26.371 INFO:teuthology.orchestra.run.smithi044.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T17:22:26.371 INFO:teuthology.orchestra.run.smithi044.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T17:22:26.371 INFO:teuthology.orchestra.run.smithi044.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T17:22:26.371 INFO:teuthology.orchestra.run.smithi044.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T17:22:26.371 INFO:teuthology.orchestra.run.smithi044.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T17:22:26.372 INFO:teuthology.orchestra.run.smithi044.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T17:22:26.372 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T17:22:26.372 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T17:22:26.372 INFO:teuthology.orchestra.run.smithi044.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T17:22:26.372 INFO:teuthology.orchestra.run.smithi044.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T17:22:26.372 INFO:teuthology.orchestra.run.smithi044.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T17:22:26.372 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.372 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.372 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.372 INFO:teuthology.orchestra.run.smithi044.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T17:22:26.372 INFO:teuthology.orchestra.run.smithi044.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T17:22:26.372 INFO:teuthology.orchestra.run.smithi044.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T17:22:26.372 INFO:teuthology.orchestra.run.smithi044.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T17:22:26.373 INFO:teuthology.orchestra.run.smithi044.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T17:22:26.373 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T17:22:26.373 INFO:teuthology.orchestra.run.smithi044.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T17:22:26.373 INFO:teuthology.orchestra.run.smithi044.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T17:22:26.373 INFO:teuthology.orchestra.run.smithi044.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T17:22:26.373 INFO:teuthology.orchestra.run.smithi044.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T17:22:26.373 INFO:teuthology.orchestra.run.smithi044.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T17:22:26.373 INFO:teuthology.orchestra.run.smithi044.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T17:22:26.373 INFO:teuthology.orchestra.run.smithi044.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T17:22:26.373 INFO:teuthology.orchestra.run.smithi044.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T17:22:26.373 INFO:teuthology.orchestra.run.smithi044.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T17:22:26.373 INFO:teuthology.orchestra.run.smithi044.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T17:22:26.374 INFO:teuthology.orchestra.run.smithi044.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T17:22:26.374 INFO:teuthology.orchestra.run.smithi044.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T17:22:26.374 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T17:22:26.374 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T17:22:26.374 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T17:22:26.374 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.374 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.374 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T17:22:26.374 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.374 INFO:teuthology.orchestra.run.smithi044.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T17:22:26.374 INFO:teuthology.orchestra.run.smithi044.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T17:22:26.374 INFO:teuthology.orchestra.run.smithi044.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T17:22:26.374 INFO:teuthology.orchestra.run.smithi044.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T17:22:26.375 INFO:teuthology.orchestra.run.smithi044.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T17:22:26.375 INFO:teuthology.orchestra.run.smithi044.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T17:22:26.375 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T17:22:26.375 INFO:teuthology.orchestra.run.smithi044.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T17:22:26.375 INFO:teuthology.orchestra.run.smithi044.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T17:22:26.375 INFO:teuthology.orchestra.run.smithi044.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T17:22:26.375 INFO:teuthology.orchestra.run.smithi044.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T17:22:26.375 INFO:teuthology.orchestra.run.smithi044.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T17:22:26.375 INFO:teuthology.orchestra.run.smithi044.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T17:22:26.375 INFO:teuthology.orchestra.run.smithi044.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T17:22:26.375 INFO:teuthology.orchestra.run.smithi044.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T17:22:26.375 INFO:teuthology.orchestra.run.smithi044.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T17:22:26.375 INFO:teuthology.orchestra.run.smithi044.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T17:22:26.376 INFO:teuthology.orchestra.run.smithi044.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T17:22:26.376 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T17:22:26.376 INFO:teuthology.orchestra.run.smithi044.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T17:22:26.376 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T17:22:26.376 INFO:teuthology.orchestra.run.smithi044.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T17:22:26.376 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T17:22:26.376 INFO:teuthology.orchestra.run.smithi044.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T17:22:26.376 INFO:teuthology.orchestra.run.smithi044.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T17:22:26.376 INFO:teuthology.orchestra.run.smithi044.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T17:22:26.376 INFO:teuthology.orchestra.run.smithi044.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T17:22:26.376 INFO:teuthology.orchestra.run.smithi044.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T17:22:26.376 INFO:teuthology.orchestra.run.smithi044.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T17:22:26.377 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T17:22:26.377 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T17:22:26.377 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T17:22:26.377 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T17:22:26.377 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T17:22:26.377 INFO:teuthology.orchestra.run.smithi044.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T17:22:26.377 INFO:teuthology.orchestra.run.smithi044.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T17:22:26.377 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T17:22:26.377 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T17:22:26.377 INFO:teuthology.orchestra.run.smithi044.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T17:22:26.377 INFO:teuthology.orchestra.run.smithi044.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T17:22:26.377 INFO:teuthology.orchestra.run.smithi044.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T17:22:26.377 INFO:teuthology.orchestra.run.smithi044.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T17:22:26.378 INFO:teuthology.orchestra.run.smithi044.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T17:22:26.378 INFO:teuthology.orchestra.run.smithi044.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T17:22:26.378 INFO:teuthology.orchestra.run.smithi044.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T17:22:26.378 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T17:22:26.378 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T17:22:26.378 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T17:22:26.378 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T17:22:26.378 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T17:22:26.378 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T17:22:26.378 INFO:teuthology.orchestra.run.smithi044.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T17:22:26.378 INFO:teuthology.orchestra.run.smithi044.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T17:22:26.378 INFO:teuthology.orchestra.run.smithi044.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T17:22:26.378 INFO:teuthology.orchestra.run.smithi044.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T17:22:26.379 INFO:teuthology.orchestra.run.smithi044.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T17:22:26.379 INFO:teuthology.orchestra.run.smithi044.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T17:22:26.379 INFO:teuthology.orchestra.run.smithi044.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T17:22:26.379 INFO:teuthology.orchestra.run.smithi044.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T17:22:26.379 INFO:teuthology.orchestra.run.smithi044.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T17:22:26.379 INFO:teuthology.orchestra.run.smithi044.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T17:22:26.379 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T17:22:26.379 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T17:22:26.379 INFO:teuthology.orchestra.run.smithi044.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T17:22:26.379 INFO:teuthology.orchestra.run.smithi044.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T17:22:26.379 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T17:22:26.379 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T17:22:26.379 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T17:22:26.379 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T17:22:26.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T17:22:26.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T17:22:26.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T17:22:26.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T17:22:26.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T17:22:26.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T17:22:26.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T17:22:26.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T17:22:26.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T17:22:26.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T17:22:26.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T17:22:26.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T17:22:26.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T17:22:26.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T17:22:26.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T17:22:26.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T17:22:26.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T17:22:26.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T17:22:26.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T17:22:26.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T17:22:26.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T17:22:26.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T17:22:26.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T17:22:26.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T17:22:26.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T17:22:26.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T17:22:26.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T17:22:26.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T17:22:26.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T17:22:26.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T17:22:26.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T17:22:26.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T17:22:26.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T17:22:26.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T17:22:26.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T17:22:26.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T17:22:26.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T17:22:26.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T17:22:26.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T17:22:26.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T17:22:26.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T17:22:26.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T17:22:26.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T17:22:26.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T17:22:26.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T17:22:26.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T17:22:26.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T17:22:26.384 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T17:22:26.384 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T17:22:26.384 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T17:22:26.384 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T17:22:26.384 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T17:22:26.384 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T17:22:26.384 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T17:22:26.384 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.384 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.384 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:22:26.384 INFO:teuthology.orchestra.run.smithi044.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T17:22:26.384 INFO:teuthology.orchestra.run.smithi044.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T17:22:26.385 INFO:teuthology.orchestra.run.smithi044.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T17:22:26.385 INFO:teuthology.orchestra.run.smithi044.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T17:22:26.385 INFO:teuthology.orchestra.run.smithi044.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T17:22:26.385 INFO:teuthology.orchestra.run.smithi044.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T17:22:26.385 INFO:teuthology.orchestra.run.smithi044.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T17:22:26.385 INFO:teuthology.orchestra.run.smithi044.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T17:22:26.385 INFO:teuthology.orchestra.run.smithi044.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T17:22:26.385 INFO:teuthology.orchestra.run.smithi044.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T17:22:26.385 INFO:teuthology.orchestra.run.smithi044.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T17:22:26.385 INFO:teuthology.orchestra.run.smithi044.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T17:22:26.385 INFO:teuthology.orchestra.run.smithi044.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T17:22:26.386 INFO:teuthology.orchestra.run.smithi044.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T17:22:26.386 INFO:teuthology.orchestra.run.smithi044.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T17:22:26.386 INFO:teuthology.orchestra.run.smithi044.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T17:22:26.386 INFO:teuthology.orchestra.run.smithi044.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T17:22:26.386 INFO:teuthology.orchestra.run.smithi044.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T17:22:26.386 INFO:teuthology.orchestra.run.smithi044.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T17:22:26.386 INFO:teuthology.orchestra.run.smithi044.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T17:22:26.386 INFO:teuthology.orchestra.run.smithi044.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T17:22:26.386 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T17:22:26.387 INFO:teuthology.orchestra.run.smithi044.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T17:22:26.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:26.387 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-12T17:22:26.812 DEBUG:teuthology.parallel:result is None 2024-09-12T17:22:26.813 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:22:26.960 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T17:22:27.016 INFO:teuthology.orchestra.run.smithi044.stdout:19.3.0-4762.gbad475c1.el9 2024-09-12T17:22:27.017 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-12T17:22:27.017 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-12T17:22:27.019 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:22:27.155 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T17:22:27.232 INFO:teuthology.orchestra.run.smithi181.stdout:19.3.0-4762.gbad475c1.el9 2024-09-12T17:22:27.233 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-12T17:22:27.233 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-12T17:22:27.235 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T17:22:27.235 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:22:27.235 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:22:27.282 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:22:27.282 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:22:27.327 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T17:22:27.327 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:22:27.327 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:22:27.370 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:22:27.452 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:22:27.453 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:22:27.495 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:22:27.575 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T17:22:27.576 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:22:27.576 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:22:27.617 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:22:27.698 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:22:27.699 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:22:27.740 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:22:27.820 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T17:22:27.820 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:22:27.820 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:22:27.861 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:22:27.940 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:22:27.940 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:22:27.981 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:22:28.060 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T17:22:28.144 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T17:22:28.144 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /var/log/ceph 2024-09-12T17:22:28.147 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /var/log/ceph 2024-09-12T17:22:28.187 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T17:22:28.187 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:22:28.228 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:22:28.266 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T17:22:28.266 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:22:28.308 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:22:28.357 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T17:22:28.357 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T17:22:28.357 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902725', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7902725', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'rgw': {'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': False, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6279, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi044.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNN8MMYM+SHieaJjUTKt+7+2HLdFqlQG4dk6wgKEWy8VaUd5tcHcv8JhOV+Owo/NeNKDtKa+QNVr4+Am8WRoEoM=', 'smithi181.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF14u2/znr3Zs5f0S9E4U6z8alr9fOk1uQ+CbQr1vD74hW+BmBYSPhaSvrStVQJKcD1Gje+JqYbRHo39rg6iNrE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_15:39:52', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T17:22:28.358 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:22:28.388 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:22:28.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:22:28.458 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:22:28.497 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:22:28.497 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:22:28.565 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:22:28.566 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2024-09-12T17:22:28.635 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:22:28.636 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:22:28.636 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T17:22:28.636 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:22:28.636 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:22:28.636 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-12 17:22:13.798031310 +0000 2024-09-12T17:22:28.636 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-12 17:19:50.620661154 +0000 2024-09-12T17:22:28.636 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-12 17:19:50.620661154 +0000 2024-09-12T17:22:28.636 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-12 17:19:50.620661154 +0000 2024-09-12T17:22:28.636 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:22:28.713 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-12T17:22:28.713 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-12T17:22:28.714 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000240757 s, 2.1 MB/s 2024-09-12T17:22:28.715 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:22:28.785 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2024-09-12T17:22:28.855 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:22:28.855 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:22:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T17:22:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:22:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:22:28.855 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-12 17:22:13.799031294 +0000 2024-09-12T17:22:28.856 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-12 17:19:50.950655957 +0000 2024-09-12T17:22:28.856 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-12 17:19:50.950655957 +0000 2024-09-12T17:22:28.856 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-12 17:19:50.950655957 +0000 2024-09-12T17:22:28.856 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:22:28.933 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-12T17:22:28.933 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-12T17:22:28.934 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000186259 s, 2.7 MB/s 2024-09-12T17:22:28.935 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:22:29.006 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2024-09-12T17:22:29.076 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:22:29.076 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:22:29.077 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T17:22:29.077 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:22:29.077 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:22:29.077 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-12 17:22:13.799031294 +0000 2024-09-12T17:22:29.077 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-12 17:19:51.283650714 +0000 2024-09-12T17:22:29.077 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-12 17:19:51.283650714 +0000 2024-09-12T17:22:29.077 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-12 17:19:51.283650714 +0000 2024-09-12T17:22:29.077 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:22:29.155 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-12T17:22:29.155 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-12T17:22:29.155 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000209895 s, 2.4 MB/s 2024-09-12T17:22:29.156 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:22:29.227 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2024-09-12T17:22:29.296 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:22:29.296 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:22:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T17:22:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:22:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:22:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-12 17:22:13.799031294 +0000 2024-09-12T17:22:29.296 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-12 17:19:51.635645170 +0000 2024-09-12T17:22:29.297 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-12 17:19:51.635645170 +0000 2024-09-12T17:22:29.297 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-12 17:19:51.635645170 +0000 2024-09-12T17:22:29.297 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:22:29.374 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-12T17:22:29.375 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-12T17:22:29.375 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000199778 s, 2.6 MB/s 2024-09-12T17:22:29.376 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:22:29.447 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:22:29.447 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:22:29.447 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:22:29.481 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:22:29.481 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-09-12T17:22:29.556 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:22:29.556 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:22:29.556 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T17:22:29.556 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:22:29.556 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:22:29.556 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-12 17:22:10.338119248 +0000 2024-09-12T17:22:29.557 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-12 17:19:48.104114606 +0000 2024-09-12T17:22:29.557 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-12 17:19:48.104114606 +0000 2024-09-12T17:22:29.557 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-12 17:19:48.104114606 +0000 2024-09-12T17:22:29.557 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:22:29.637 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-12T17:22:29.637 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-12T17:22:29.637 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.00021758 s, 2.4 MB/s 2024-09-12T17:22:29.638 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:22:29.710 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-09-12T17:22:29.781 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:22:29.781 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:22:29.781 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T17:22:29.781 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:22:29.781 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:22:29.781 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-12 17:22:10.338119248 +0000 2024-09-12T17:22:29.781 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-12 17:19:48.438108038 +0000 2024-09-12T17:22:29.781 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-12 17:19:48.438108038 +0000 2024-09-12T17:22:29.782 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-12 17:19:48.438108038 +0000 2024-09-12T17:22:29.782 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:22:29.859 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-12T17:22:29.860 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-12T17:22:29.860 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000214855 s, 2.4 MB/s 2024-09-12T17:22:29.861 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:22:29.931 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-09-12T17:22:30.001 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:22:30.001 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:22:30.001 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T17:22:30.001 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:22:30.001 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:22:30.001 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-12 17:22:10.339119229 +0000 2024-09-12T17:22:30.001 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-12 17:19:48.754101824 +0000 2024-09-12T17:22:30.001 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-12 17:19:48.754101824 +0000 2024-09-12T17:22:30.001 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-12 17:19:48.754101824 +0000 2024-09-12T17:22:30.002 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:22:30.078 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-12T17:22:30.078 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-12T17:22:30.078 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.00023294 s, 2.2 MB/s 2024-09-12T17:22:30.080 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:22:30.149 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-09-12T17:22:30.218 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:22:30.219 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:22:30.219 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T17:22:30.219 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:22:30.219 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:22:30.219 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-12 17:22:10.339119229 +0000 2024-09-12T17:22:30.219 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-12 17:19:49.076095492 +0000 2024-09-12T17:22:30.219 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-12 17:19:49.076095492 +0000 2024-09-12T17:22:30.219 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-12 17:19:49.076095492 +0000 2024-09-12T17:22:30.220 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:22:30.296 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-12T17:22:30.296 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-12T17:22:30.296 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000214974 s, 2.4 MB/s 2024-09-12T17:22:30.297 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:22:30.367 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:22:30.368 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:22:30.368 INFO:tasks.ceph:Generating config... 2024-09-12T17:22:30.370 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T17:22:30.370 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T17:22:30.370 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T17:22:30.370 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T17:22:30.370 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T17:22:30.370 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:22:30.370 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T17:22:30.370 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-12T17:22:30.370 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-12T17:22:30.371 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-12T17:22:30.371 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-12T17:22:30.371 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-12T17:22:30.371 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T17:22:30.371 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T17:22:30.371 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T17:22:30.371 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T17:22:30.371 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T17:22:30.371 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T17:22:30.371 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T17:22:30.371 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T17:22:30.371 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T17:22:30.372 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T17:22:30.372 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T17:22:30.372 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T17:22:30.372 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T17:22:30.372 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T17:22:30.372 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T17:22:30.372 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T17:22:30.372 INFO:tasks.ceph:[mon] lockdep = True 2024-09-12T17:22:30.372 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T17:22:30.372 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T17:22:30.373 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T17:22:30.373 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T17:22:30.373 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T17:22:30.373 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T17:22:30.373 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T17:22:30.373 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T17:22:30.373 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T17:22:30.373 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T17:22:30.373 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T17:22:30.373 INFO:tasks.ceph:[osd] lockdep = True 2024-09-12T17:22:30.373 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T17:22:30.373 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T17:22:30.373 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T17:22:30.373 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T17:22:30.374 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T17:22:30.374 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T17:22:30.374 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T17:22:30.374 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T17:22:30.468 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T17:22:30.470 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T17:22:30.534 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:22:30.575 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.44'), ('mon.c', '[v2:172.21.15.44:3301,v1:172.21.15.44:6790]'), ('mon.b', '172.21.15.181')] 2024-09-12T17:22:30.575 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.44,[v2:172.21.15.44:3301,v1:172.21.15.44:6790],172.21.15.181', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T17:22:30.576 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:22:30.576 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:22:30.645 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.44 --addv c '[v2:172.21.15.44:3301,v1:172.21.15.44:6790]' --add b 172.21.15.181 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:22:30.747 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:30.747 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:22:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: generated fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:22:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:setting min_mon_release = quincy 2024-09-12T17:22:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 0 2024-09-12T17:22:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:22:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:22:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:22:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:min_mon_release 17 (quincy) 2024-09-12T17:22:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:election_strategy: 1 2024-09-12T17:22:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:22:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:22:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:22:30.749 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T17:22:30.750 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:22:30.780 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e2fc0024-c5a5-4250-915f-923340ab7b0f... 2024-09-12T17:22:30.781 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:22:30.822 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:22:30.879 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-09-12T17:22:30.879 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2024-09-12T17:22:30.879 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:22:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2024-09-12T17:22:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2024-09-12T17:22:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2024-09-12T17:22:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2024-09-12T17:22:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2024-09-12T17:22:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2024-09-12T17:22:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2024-09-12T17:22:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:22:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2024-09-12T17:22:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:22:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:22:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2024-09-12T17:22:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2024-09-12T17:22:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2024-09-12T17:22:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:22:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:22:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2024-09-12T17:22:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:22:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2024-09-12T17:22:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:22:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:22:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2024-09-12T17:22:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:22:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2024-09-12T17:22:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2024-09-12T17:22:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2024-09-12T17:22:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2024-09-12T17:22:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2024-09-12T17:22:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = "172.21.15.44,[v2:172.21.15.44:3301,v1:172.21.15.44:6790],172.21.15.181" 2024-09-12T17:22:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: mon client directed command retry = 5 2024-09-12T17:22:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: ms inject socket failures = 5000 2024-09-12T17:22:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:22:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:22:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:22:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.883 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2024-09-12T17:22:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2024-09-12T17:22:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2024-09-12T17:22:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2024-09-12T17:22:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:22:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2024-09-12T17:22:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2024-09-12T17:22:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2024-09-12T17:22:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2024-09-12T17:22:30.886 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2024-09-12T17:22:30.886 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug trim objects = true 2024-09-12T17:22:30.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.886 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2024-09-12T17:22:30.886 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2024-09-12T17:22:30.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.887 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:22:30.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.887 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2024-09-12T17:22:30.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.887 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2024-09-12T17:22:30.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.887 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:22:30.888 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2024-09-12T17:22:30.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.888 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2024-09-12T17:22:30.888 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2024-09-12T17:22:30.888 INFO:teuthology.orchestra.run.smithi044.stdout: bdev async discard = True 2024-09-12T17:22:30.888 INFO:teuthology.orchestra.run.smithi044.stdout: bdev enable discard = True 2024-09-12T17:22:30.888 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore allocator = bitmap 2024-09-12T17:22:30.889 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2024-09-12T17:22:30.889 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2024-09-12T17:22:30.889 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 1/20 2024-09-12T17:22:30.889 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 1/20 2024-09-12T17:22:30.889 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-12T17:22:30.889 INFO:teuthology.orchestra.run.smithi044.stdout: debug objclass = 20 2024-09-12T17:22:30.890 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2024-09-12T17:22:30.890 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 4/10 2024-09-12T17:22:30.890 INFO:teuthology.orchestra.run.smithi044.stdout: lockdep = True 2024-09-12T17:22:30.890 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:22:30.890 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2024-09-12T17:22:30.890 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:22:30.890 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:22:30.891 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2024-09-12T17:22:30.891 INFO:teuthology.orchestra.run.smithi044.stdout: osd shutdown pgref assert = True 2024-09-12T17:22:30.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.891 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2024-09-12T17:22:30.891 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-12T17:22:30.891 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2024-09-12T17:22:30.891 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-09-12T17:22:30.891 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-09-12T17:22:30.892 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:22:30.892 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:22:30.892 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2024-09-12T17:22:30.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.892 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2024-09-12T17:22:30.892 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-12T17:22:30.892 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-09-12T17:22:30.892 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2024-09-12T17:22:30.893 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-09-12T17:22:30.893 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2024-09-12T17:22:30.893 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2024-09-12T17:22:30.893 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:22:30.893 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2024-09-12T17:22:30.893 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2024-09-12T17:22:30.894 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:22:30.894 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.894 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:22:30.894 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:22:30.894 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:22:30.894 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.894 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:22:30.895 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:22:30.895 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:22:30.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.895 INFO:teuthology.orchestra.run.smithi044.stdout: # 1m isn't quite enough 2024-09-12T17:22:30.895 INFO:teuthology.orchestra.run.smithi044.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:22:30.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.896 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:22:30.896 INFO:teuthology.orchestra.run.smithi044.stdout: lockdep = True 2024-09-12T17:22:30.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:22:30.896 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2024-09-12T17:22:30.896 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2024-09-12T17:22:30.896 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = True 2024-09-12T17:22:30.896 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2024-09-12T17:22:30.897 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:22:30.897 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:22:30.897 INFO:teuthology.orchestra.run.smithi044.stdout: debug rgw = 20 2024-09-12T17:22:30.897 INFO:teuthology.orchestra.run.smithi044.stdout: debug rgw notification = 20 2024-09-12T17:22:30.897 INFO:teuthology.orchestra.run.smithi044.stdout: rgw bucket counters cache = True 2024-09-12T17:22:30.897 INFO:teuthology.orchestra.run.smithi044.stdout: rgw crypt require ssl = False 2024-09-12T17:22:30.898 INFO:teuthology.orchestra.run.smithi044.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:22:30.898 INFO:teuthology.orchestra.run.smithi044.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:22:30.898 INFO:teuthology.orchestra.run.smithi044.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T17:22:30.898 INFO:teuthology.orchestra.run.smithi044.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T17:22:30.898 INFO:teuthology.orchestra.run.smithi044.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T17:22:30.898 INFO:teuthology.orchestra.run.smithi044.stdout: rgw max chunk size = 4194304 2024-09-12T17:22:30.898 INFO:teuthology.orchestra.run.smithi044.stdout: rgw obj stripe size = 6291456 2024-09-12T17:22:30.899 INFO:teuthology.orchestra.run.smithi044.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:22:30.899 INFO:teuthology.orchestra.run.smithi044.stdout: rgw s3 auth use sts = True 2024-09-12T17:22:30.899 INFO:teuthology.orchestra.run.smithi044.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:22:30.899 INFO:teuthology.orchestra.run.smithi044.stdout: rgw torrent flag = True 2024-09-12T17:22:30.899 INFO:teuthology.orchestra.run.smithi044.stdout: rgw user counters cache = True 2024-09-12T17:22:30.899 INFO:teuthology.orchestra.run.smithi044.stdout: setgroup = ceph 2024-09-12T17:22:30.899 INFO:teuthology.orchestra.run.smithi044.stdout: setuser = ceph 2024-09-12T17:22:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2024-09-12T17:22:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.c] 2024-09-12T17:22:30.900 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.b] 2024-09-12T17:22:30.902 INFO:teuthology.orchestra.run.smithi181.stdout:[global] 2024-09-12T17:22:30.902 INFO:teuthology.orchestra.run.smithi181.stdout: chdir = "" 2024-09-12T17:22:30.903 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:22:30.903 INFO:teuthology.orchestra.run.smithi181.stdout: auth supported = cephx 2024-09-12T17:22:30.903 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.903 INFO:teuthology.orchestra.run.smithi181.stdout: filestore xattr use omap = true 2024-09-12T17:22:30.903 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.903 INFO:teuthology.orchestra.run.smithi181.stdout: mon clock drift allowed = 1.000 2024-09-12T17:22:30.903 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.904 INFO:teuthology.orchestra.run.smithi181.stdout: osd crush chooseleaf type = 0 2024-09-12T17:22:30.904 INFO:teuthology.orchestra.run.smithi181.stdout: auth debug = true 2024-09-12T17:22:30.904 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.904 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on old message = true 2024-09-12T17:22:30.904 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on bug = true 2024-09-12T17:22:30.904 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.904 INFO:teuthology.orchestra.run.smithi181.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:22:30.905 INFO:teuthology.orchestra.run.smithi181.stdout: mon pg warn max object skew = 0 2024-09-12T17:22:30.905 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.905 INFO:teuthology.orchestra.run.smithi181.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:22:30.905 INFO:teuthology.orchestra.run.smithi181.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:22:30.905 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.905 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default size = 2 2024-09-12T17:22:30.905 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.905 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow primary affinity = true 2024-09-12T17:22:30.906 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow pg remap = true 2024-09-12T17:22:30.906 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:22:30.906 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:22:30.906 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on no sortbitwise = false 2024-09-12T17:22:30.906 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:22:30.906 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on too few osds = false 2024-09-12T17:22:30.906 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:22:30.906 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:22:30.906 INFO:teuthology.orchestra.run.smithi181.stdout: mon_allow_pool_size_one = true 2024-09-12T17:22:30.906 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.906 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:22:30.906 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.906 INFO:teuthology.orchestra.run.smithi181.stdout: osd default data pool replay window = 5 2024-09-12T17:22:30.907 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.907 INFO:teuthology.orchestra.run.smithi181.stdout: mon allow pool delete = true 2024-09-12T17:22:30.907 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.907 INFO:teuthology.orchestra.run.smithi181.stdout: mon cluster log file level = debug 2024-09-12T17:22:30.907 INFO:teuthology.orchestra.run.smithi181.stdout: debug asserts on shutdown = true 2024-09-12T17:22:30.907 INFO:teuthology.orchestra.run.smithi181.stdout: mon health detail to clog = false 2024-09-12T17:22:30.907 INFO:teuthology.orchestra.run.smithi181.stdout: mon host = "172.21.15.44,[v2:172.21.15.44:3301,v1:172.21.15.44:6790],172.21.15.181" 2024-09-12T17:22:30.907 INFO:teuthology.orchestra.run.smithi181.stdout: mon client directed command retry = 5 2024-09-12T17:22:30.907 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject socket failures = 5000 2024-09-12T17:22:30.907 INFO:teuthology.orchestra.run.smithi181.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:22:30.907 INFO:teuthology.orchestra.run.smithi181.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:22:30.907 INFO:teuthology.orchestra.run.smithi181.stdout: fsid = e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:22:30.907 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.908 INFO:teuthology.orchestra.run.smithi181.stdout:[osd] 2024-09-12T17:22:30.908 INFO:teuthology.orchestra.run.smithi181.stdout: osd journal size = 100 2024-09-12T17:22:30.908 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.908 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub load threshold = 5.0 2024-09-12T17:22:30.908 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub max interval = 600 2024-09-12T17:22:30.908 INFO:teuthology.orchestra.run.smithi181.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:22:30.908 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.908 INFO:teuthology.orchestra.run.smithi181.stdout: osd recover clone overlap = true 2024-09-12T17:22:30.908 INFO:teuthology.orchestra.run.smithi181.stdout: osd recovery max chunk = 1048576 2024-09-12T17:22:30.908 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.908 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug shutdown = true 2024-09-12T17:22:30.908 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug op order = true 2024-09-12T17:22:30.908 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify stray on activate = true 2024-09-12T17:22:30.909 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug trim objects = true 2024-09-12T17:22:30.909 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.909 INFO:teuthology.orchestra.run.smithi181.stdout: osd open classes on start = true 2024-09-12T17:22:30.909 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug pg log writeout = true 2024-09-12T17:22:30.909 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.909 INFO:teuthology.orchestra.run.smithi181.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:22:30.909 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.909 INFO:teuthology.orchestra.run.smithi181.stdout: osd map max advance = 10 2024-09-12T17:22:30.909 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.910 INFO:teuthology.orchestra.run.smithi181.stdout: journal zero on create = true 2024-09-12T17:22:30.910 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.910 INFO:teuthology.orchestra.run.smithi181.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:22:30.910 INFO:teuthology.orchestra.run.smithi181.stdout: filestore apply finisher threads = 3 2024-09-12T17:22:30.910 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.910 INFO:teuthology.orchestra.run.smithi181.stdout: bdev debug aio = true 2024-09-12T17:22:30.911 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug misdirected ops = true 2024-09-12T17:22:30.911 INFO:teuthology.orchestra.run.smithi181.stdout: bdev async discard = True 2024-09-12T17:22:30.911 INFO:teuthology.orchestra.run.smithi181.stdout: bdev enable discard = True 2024-09-12T17:22:30.911 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore allocator = bitmap 2024-09-12T17:22:30.911 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore block size = 96636764160 2024-09-12T17:22:30.911 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore fsck on mount = True 2024-09-12T17:22:30.912 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluefs = 1/20 2024-09-12T17:22:30.912 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluestore = 1/20 2024-09-12T17:22:30.912 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-12T17:22:30.912 INFO:teuthology.orchestra.run.smithi181.stdout: debug objclass = 20 2024-09-12T17:22:30.912 INFO:teuthology.orchestra.run.smithi181.stdout: debug osd = 20 2024-09-12T17:22:30.912 INFO:teuthology.orchestra.run.smithi181.stdout: debug rocksdb = 4/10 2024-09-12T17:22:30.912 INFO:teuthology.orchestra.run.smithi181.stdout: lockdep = True 2024-09-12T17:22:30.912 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:22:30.913 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd full ratio = 0.9 2024-09-12T17:22:30.913 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:22:30.913 INFO:teuthology.orchestra.run.smithi181.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:22:30.913 INFO:teuthology.orchestra.run.smithi181.stdout: osd objectstore = bluestore 2024-09-12T17:22:30.913 INFO:teuthology.orchestra.run.smithi181.stdout: osd shutdown pgref assert = True 2024-09-12T17:22:30.913 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.913 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr] 2024-09-12T17:22:30.913 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-12T17:22:30.913 INFO:teuthology.orchestra.run.smithi181.stdout: debug mgr = 20 2024-09-12T17:22:30.914 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-09-12T17:22:30.914 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-09-12T17:22:30.914 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:22:30.914 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:22:30.914 INFO:teuthology.orchestra.run.smithi181.stdout: mgr/telemetry/nag = false 2024-09-12T17:22:30.914 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.915 INFO:teuthology.orchestra.run.smithi181.stdout:[mon] 2024-09-12T17:22:30.915 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-12T17:22:30.915 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-09-12T17:22:30.915 INFO:teuthology.orchestra.run.smithi181.stdout: debug paxos = 20 2024-09-12T17:22:30.915 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-09-12T17:22:30.915 INFO:teuthology.orchestra.run.smithi181.stdout: mon data avail warn = 5 2024-09-12T17:22:30.915 INFO:teuthology.orchestra.run.smithi181.stdout: mon mgr mkfs grace = 240 2024-09-12T17:22:30.915 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:22:30.915 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd reporter subtree level = osd 2024-09-12T17:22:30.915 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd prime pg temp = true 2024-09-12T17:22:30.916 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:22:30.916 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.916 INFO:teuthology.orchestra.run.smithi181.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:22:30.916 INFO:teuthology.orchestra.run.smithi181.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:22:30.916 INFO:teuthology.orchestra.run.smithi181.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:22:30.916 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.916 INFO:teuthology.orchestra.run.smithi181.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:22:30.916 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:22:30.916 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:22:30.916 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.916 INFO:teuthology.orchestra.run.smithi181.stdout: # 1m isn't quite enough 2024-09-12T17:22:30.916 INFO:teuthology.orchestra.run.smithi181.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:22:30.917 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.917 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:22:30.917 INFO:teuthology.orchestra.run.smithi181.stdout: lockdep = True 2024-09-12T17:22:30.917 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-12T17:22:30.917 INFO:teuthology.orchestra.run.smithi181.stdout:[client] 2024-09-12T17:22:30.917 INFO:teuthology.orchestra.run.smithi181.stdout: rgw cache enabled = true 2024-09-12T17:22:30.917 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable ops log = True 2024-09-12T17:22:30.917 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable usage log = true 2024-09-12T17:22:30.917 INFO:teuthology.orchestra.run.smithi181.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:22:30.917 INFO:teuthology.orchestra.run.smithi181.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:22:30.917 INFO:teuthology.orchestra.run.smithi181.stdout: debug rgw = 20 2024-09-12T17:22:30.917 INFO:teuthology.orchestra.run.smithi181.stdout: debug rgw notification = 20 2024-09-12T17:22:30.917 INFO:teuthology.orchestra.run.smithi181.stdout: rgw bucket counters cache = True 2024-09-12T17:22:30.918 INFO:teuthology.orchestra.run.smithi181.stdout: rgw crypt require ssl = False 2024-09-12T17:22:30.918 INFO:teuthology.orchestra.run.smithi181.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:22:30.918 INFO:teuthology.orchestra.run.smithi181.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:22:30.918 INFO:teuthology.orchestra.run.smithi181.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T17:22:30.918 INFO:teuthology.orchestra.run.smithi181.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T17:22:30.918 INFO:teuthology.orchestra.run.smithi181.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T17:22:30.918 INFO:teuthology.orchestra.run.smithi181.stdout: rgw max chunk size = 4194304 2024-09-12T17:22:30.918 INFO:teuthology.orchestra.run.smithi181.stdout: rgw obj stripe size = 6291456 2024-09-12T17:22:30.918 INFO:teuthology.orchestra.run.smithi181.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:22:30.918 INFO:teuthology.orchestra.run.smithi181.stdout: rgw s3 auth use sts = True 2024-09-12T17:22:30.918 INFO:teuthology.orchestra.run.smithi181.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:22:30.918 INFO:teuthology.orchestra.run.smithi181.stdout: rgw torrent flag = True 2024-09-12T17:22:30.918 INFO:teuthology.orchestra.run.smithi181.stdout: rgw user counters cache = True 2024-09-12T17:22:30.919 INFO:teuthology.orchestra.run.smithi181.stdout: setgroup = ceph 2024-09-12T17:22:30.919 INFO:teuthology.orchestra.run.smithi181.stdout: setuser = ceph 2024-09-12T17:22:30.919 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.a] 2024-09-12T17:22:30.919 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.c] 2024-09-12T17:22:30.919 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.b] 2024-09-12T17:22:30.919 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T17:22:30.919 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T17:22:30.989 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T17:22:30.989 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:22:30.989 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T17:22:31.021 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:22:31.022 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T17:22:31.091 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi044.front.sepia.ceph.com 2024-09-12T17:22:31.091 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:22:31.092 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:22:31.092 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:22:31.181 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:22:31.182 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:22:31.252 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T17:22:31.253 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:22:31.253 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:22:31.253 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:22:31.302 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:22:31.303 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:22:31.372 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T17:22:31.373 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T17:22:31.373 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:22:31.441 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:22:31.444 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:22:31.525 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:22:31.528 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T17:22:31.528 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T17:22:31.528 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T17:22:31.585 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T17:22:31.599 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T17:22:31.654 INFO:teuthology.orchestra.run.smithi181.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T17:22:31.667 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T17:22:31.667 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:22:31.668 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T17:22:31.707 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:22:31.707 INFO:tasks.ceph:role: osd.0 2024-09-12T17:22:31.707 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-12T17:22:31.707 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:22:31.794 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:22:31.795 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:22:31.795 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:22:31.795 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:22:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:22:31.795 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:22:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:22:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:22:31.795 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:22:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:22:32.300 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-09-12T17:22:32.302 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-09-12T17:22:32.302 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T17:22:32.391 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T17:22:32.472 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T17:22:32.512 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:22:32.512 INFO:tasks.ceph:role: osd.1 2024-09-12T17:22:32.512 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-12T17:22:32.512 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:22:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:22:32.600 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:22:32.600 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:22:32.600 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:22:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:22:32.600 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:22:32.600 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:22:32.601 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:22:32.601 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:22:32.601 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:22:33.048 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-09-12T17:22:33.050 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-09-12T17:22:33.050 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T17:22:33.112 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T17:22:33.156 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T17:22:33.236 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:22:33.236 INFO:tasks.ceph:role: osd.2 2024-09-12T17:22:33.236 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-12T17:22:33.236 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:22:33.325 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:22:33.326 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:22:33.326 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:22:33.326 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:22:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:22:33.326 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:22:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:22:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:22:33.326 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:22:33.326 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:22:33.812 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-09-12T17:22:33.814 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-09-12T17:22:33.814 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T17:22:33.928 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T17:22:33.973 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T17:22:34.052 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:22:34.052 INFO:tasks.ceph:role: osd.3 2024-09-12T17:22:34.052 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-12T17:22:34.053 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:22:34.139 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:22:34.139 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:22:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:22:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:22:34.140 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:22:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:22:34.140 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:22:34.140 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:22:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:22:34.140 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:22:34.655 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-09-12T17:22:34.657 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-09-12T17:22:34.657 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T17:22:34.774 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T17:22:34.821 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:22:34.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:22:34.892+0000 7fac4001e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T17:22:34.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:22:34.892+0000 7fac4001e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T17:22:34.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:22:34.892+0000 7fac4001e640 -1 bdev(0x55eed4bb3800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T17:22:34.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:22:34.892+0000 7fac4001e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T17:22:37.799 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T17:22:37.845 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:22:37.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:22:37.949+0000 7f90e1624640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T17:22:37.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:22:37.949+0000 7f90e1624640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T17:22:37.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:22:37.949+0000 7f90e1624640 -1 bdev(0x5577e984f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T17:22:37.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:22:37.949+0000 7f90e1624640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T17:22:41.121 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T17:22:41.167 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:22:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:22:41.231+0000 7f3940c32640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T17:22:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:22:41.231+0000 7f3940c32640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T17:22:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:22:41.231+0000 7f3940c32640 -1 bdev(0x55e8d6e5d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T17:22:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:22:41.231+0000 7f3940c32640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T17:22:44.679 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T17:22:44.725 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:22:44.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:22:44.788+0000 7f0de5345640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T17:22:44.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:22:44.788+0000 7f0de5345640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T17:22:44.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:22:44.788+0000 7f0de5345640 -1 bdev(0x563479b0f800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T17:22:44.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:22:44.788+0000 7f0de5345640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T17:22:47.951 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T17:22:47.998 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T17:22:48.044 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:22:48.044 INFO:tasks.ceph:role: osd.4 2024-09-12T17:22:48.044 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T17:22:48.044 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:22:48.093 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:22:48.093 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:22:48.093 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:22:48.093 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:22:48.093 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:22:48.093 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:22:48.093 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:22:48.093 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:22:48.094 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:22:48.094 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:22:48.598 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-09-12T17:22:48.601 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-09-12T17:22:48.601 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T17:22:48.718 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T17:22:48.769 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T17:22:48.812 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:22:48.813 INFO:tasks.ceph:role: osd.5 2024-09-12T17:22:48.813 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T17:22:48.813 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:22:48.901 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:22:48.901 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:22:48.901 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:22:48.901 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:22:48.901 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:22:48.901 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:22:48.901 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:22:48.901 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:22:48.902 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:22:48.902 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:22:49.363 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-09-12T17:22:49.365 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-09-12T17:22:49.365 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T17:22:49.430 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T17:22:49.473 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T17:22:49.553 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:22:49.553 INFO:tasks.ceph:role: osd.6 2024-09-12T17:22:49.553 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T17:22:49.553 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:22:49.639 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:22:49.639 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:22:49.639 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:22:49.639 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:22:49.639 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:22:49.639 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:22:49.639 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:22:49.640 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:22:49.640 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:22:49.640 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:22:50.171 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-09-12T17:22:50.173 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-09-12T17:22:50.173 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T17:22:50.294 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T17:22:50.340 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T17:22:50.378 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:22:50.378 INFO:tasks.ceph:role: osd.7 2024-09-12T17:22:50.378 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T17:22:50.378 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:22:50.464 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:22:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:22:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:22:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:22:50.464 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:22:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:22:50.464 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:22:50.464 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:22:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:22:50.465 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:22:50.950 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-09-12T17:22:50.952 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-09-12T17:22:50.952 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T17:22:51.075 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T17:22:51.120 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:22:51.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T17:22:51.186+0000 7f5f5bffd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T17:22:51.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T17:22:51.187+0000 7f5f5bffd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T17:22:51.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T17:22:51.187+0000 7f5f5bffd640 -1 bdev(0x5614fe7cd800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T17:22:51.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T17:22:51.187+0000 7f5f5bffd640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T17:22:54.354 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T17:22:54.397 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:22:54.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T17:22:54.496+0000 7feec4c19640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T17:22:54.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T17:22:54.497+0000 7feec4c19640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T17:22:54.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T17:22:54.497+0000 7feec4c19640 -1 bdev(0x55993f837800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T17:22:54.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T17:22:54.497+0000 7feec4c19640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T17:22:57.423 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T17:22:57.469 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:22:57.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T17:22:57.530+0000 7f0fa000e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T17:22:57.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T17:22:57.530+0000 7f0fa000e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T17:22:57.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T17:22:57.530+0000 7f0fa000e640 -1 bdev(0x55c225d57800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T17:22:57.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T17:22:57.530+0000 7f0fa000e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T17:23:00.468 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T17:23:00.512 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:23:00.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T17:23:00.614+0000 7f9e578ae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T17:23:00.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T17:23:00.615+0000 7f9e578ae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T17:23:00.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T17:23:00.615+0000 7f9e578ae640 -1 bdev(0x556a788cb800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T17:23:00.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-12T17:23:00.615+0000 7f9e578ae640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T17:23:03.525 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T17:23:03.570 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T17:23:03.570 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:23:03.570 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T17:23:03.617 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:23:03.617 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T17:23:03.703 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:23:03.703 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T17:23:03.789 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:23:03.789 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T17:23:03.870 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:23:03.870 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T17:23:03.952 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:23:03.952 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T17:23:03.997 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:23:03.997 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T17:23:04.081 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:23:04.081 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T17:23:04.162 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:23:04.162 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T17:23:04.241 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:23:04.241 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T17:23:04.320 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:23:04.320 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T17:23:04.353 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:23:04.354 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T17:23:04.389 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T17:23:04.389 DEBUG:teuthology.orchestra.run.smithi044:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:23:04.396 DEBUG:teuthology.orchestra.run.smithi181:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:23:04.435 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.y] 2024-09-12T17:23:04.435 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBXI+NmRpxPGhAATrA2avOe4TRGIsI+tg+1eQ== 2024-09-12T17:23:04.435 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.0] 2024-09-12T17:23:04.435 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBaI+NmnKBJNRAAlqfFQrtK1/iOPEhNlK7BZw== 2024-09-12T17:23:04.435 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.1] 2024-09-12T17:23:04.435 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBdI+NmQ+enOBAA0V6aShm42/1twTBDZ/Rs3g== 2024-09-12T17:23:04.435 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.2] 2024-09-12T17:23:04.436 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBhI+NmTyzjDRAAgvaJi89Of/nWc+x3NloyAQ== 2024-09-12T17:23:04.436 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.3] 2024-09-12T17:23:04.436 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBkI+Nm4bsQLxAAHr66DbaSWmLgekkYMC/JzA== 2024-09-12T17:23:04.436 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.x] 2024-09-12T17:23:04.436 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBXI+NmKbhRHxAAN3BdvJN4HhnkGf7pXfiozA== 2024-09-12T17:23:04.436 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.4] 2024-09-12T17:23:04.436 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBrI+NmHn8oCxAAeFdBX+sHZrHfmlADnwEIxw== 2024-09-12T17:23:04.436 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.5] 2024-09-12T17:23:04.436 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBuI+NmyP2pHRAAdNWwt1iz59v9XQ/U0HdJAg== 2024-09-12T17:23:04.436 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.6] 2024-09-12T17:23:04.436 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBxI+NmvwKsHxAAP5hjJ0K/dnS9Z7cntnRQxA== 2024-09-12T17:23:04.436 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.7] 2024-09-12T17:23:04.436 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQB0I+NmsweyJBAAs/cH51wi0LWN7DS45xesOA== 2024-09-12T17:23:04.437 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-09-12T17:23:04.437 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBXI+NmasDgIhAAYTgSzFURpeNr3LnlGJrl+g== 2024-09-12T17:23:04.437 INFO:teuthology.orchestra.run.smithi044.stdout:[client.1] 2024-09-12T17:23:04.437 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBXI+Nm9Bv+JhAARj84Bi+1LTWvIw+U3Kg2jg== 2024-09-12T17:23:04.466 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.y] 2024-09-12T17:23:04.466 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBXI+NmRpxPGhAATrA2avOe4TRGIsI+tg+1eQ== 2024-09-12T17:23:04.467 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.0] 2024-09-12T17:23:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBaI+NmnKBJNRAAlqfFQrtK1/iOPEhNlK7BZw== 2024-09-12T17:23:04.467 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.1] 2024-09-12T17:23:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBdI+NmQ+enOBAA0V6aShm42/1twTBDZ/Rs3g== 2024-09-12T17:23:04.467 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.2] 2024-09-12T17:23:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBhI+NmTyzjDRAAgvaJi89Of/nWc+x3NloyAQ== 2024-09-12T17:23:04.467 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.3] 2024-09-12T17:23:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBkI+Nm4bsQLxAAHr66DbaSWmLgekkYMC/JzA== 2024-09-12T17:23:04.467 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.x] 2024-09-12T17:23:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBXI+NmKbhRHxAAN3BdvJN4HhnkGf7pXfiozA== 2024-09-12T17:23:04.467 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.4] 2024-09-12T17:23:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBrI+NmHn8oCxAAeFdBX+sHZrHfmlADnwEIxw== 2024-09-12T17:23:04.467 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.5] 2024-09-12T17:23:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBuI+NmyP2pHRAAdNWwt1iz59v9XQ/U0HdJAg== 2024-09-12T17:23:04.468 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.6] 2024-09-12T17:23:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBxI+NmvwKsHxAAP5hjJ0K/dnS9Z7cntnRQxA== 2024-09-12T17:23:04.468 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.7] 2024-09-12T17:23:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQB0I+NmsweyJBAAs/cH51wi0LWN7DS45xesOA== 2024-09-12T17:23:04.468 INFO:teuthology.orchestra.run.smithi181.stdout:[client.0] 2024-09-12T17:23:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBXI+NmasDgIhAAYTgSzFURpeNr3LnlGJrl+g== 2024-09-12T17:23:04.468 INFO:teuthology.orchestra.run.smithi181.stdout:[client.1] 2024-09-12T17:23:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBXI+Nm9Bv+JhAARj84Bi+1LTWvIw+U3Kg2jg== 2024-09-12T17:23:04.470 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:23:04.481 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:23:04.574 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:23:04.577 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:23:04.642 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:23:04.644 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:23:04.711 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:23:04.713 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:23:04.778 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:23:04.781 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:23:04.845 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:23:04.848 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:23:04.912 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:23:04.914 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:23:04.979 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:23:04.982 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:23:05.047 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:23:05.049 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:23:05.113 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:23:05.116 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:23:05.180 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:23:05.183 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:23:05.251 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:23:05.253 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:23:05.321 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T17:23:05.321 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T17:23:05.361 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:23:05.472 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T17:23:05.513 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T17:23:05.593 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:23:05.705 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T17:23:05.745 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T17:23:05.785 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:23:05.898 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T17:23:05.936 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:23:05.939 DEBUG:teuthology.orchestra.run.smithi181:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:23:06.005 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T17:23:06.006 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T17:23:06.006 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T17:23:06.009 INFO:tasks.ceph.mon.a:Started 2024-09-12T17:23:06.009 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T17:23:06.009 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T17:23:06.011 INFO:tasks.ceph.mon.c:Started 2024-09-12T17:23:06.011 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T17:23:06.012 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T17:23:06.047 INFO:tasks.ceph.mon.b:Started 2024-09-12T17:23:06.048 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T17:23:06.048 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T17:23:06.048 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T17:23:06.050 INFO:tasks.ceph.mgr.y:Started 2024-09-12T17:23:06.050 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T17:23:06.051 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T17:23:06.053 INFO:tasks.ceph.mgr.x:Started 2024-09-12T17:23:06.053 DEBUG:tasks.ceph:set 0 configs 2024-09-12T17:23:06.053 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T17:23:06.053 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T17:23:11.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:11.554+0000 7fb53568a640 0 --2- 172.21.15.44:0/1542128764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5140099b0 0x7fb51400bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:23:11.634 INFO:teuthology.orchestra.run.smithi044.stderr:adjusted tunables profile to default 2024-09-12T17:23:11.647 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T17:23:11.648 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T17:23:11.648 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:23:11.648 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T17:23:11.689 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:23:11.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T17:23:11.773 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:23:11.773 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T17:23:11.853 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:23:11.854 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T17:23:11.933 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:23:11.933 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T17:23:11.971 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:23:11.972 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T17:23:12.051 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:23:12.051 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T17:23:12.130 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-12T17:23:12.130 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T17:23:12.208 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new bc14ac54-a573-4ab7-9060-b1b49e7f29ed 0 2024-09-12T17:23:12.447 INFO:teuthology.orchestra.run.smithi181.stdout:0 2024-09-12T17:23:12.458 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new aa0a9bcc-3ee4-467e-882e-b81ac1e33d34 1 2024-09-12T17:23:12.654 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-09-12T17:23:12.665 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 7b386e6f-8a15-4112-be99-d23d16d6e0ee 2 2024-09-12T17:23:12.861 INFO:teuthology.orchestra.run.smithi181.stdout:2 2024-09-12T17:23:12.872 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 971fc3af-fe85-46e5-8a51-44f1e460416b 3 2024-09-12T17:23:13.071 INFO:teuthology.orchestra.run.smithi181.stdout:3 2024-09-12T17:23:13.083 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new b70b28f6-11c6-468b-9059-400624bcbdea 4 2024-09-12T17:23:13.283 INFO:teuthology.orchestra.run.smithi181.stdout:4 2024-09-12T17:23:13.294 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 564a5e08-75c6-45fa-aa10-4231c4284450 5 2024-09-12T17:23:13.488 INFO:teuthology.orchestra.run.smithi181.stdout:5 2024-09-12T17:23:13.499 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new cbcc8c67-5471-43d4-a384-01f692997d65 6 2024-09-12T17:23:13.694 INFO:teuthology.orchestra.run.smithi181.stdout:6 2024-09-12T17:23:13.705 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new bfc77994-e3e4-4c97-87b7-ce5eb6424fd0 7 2024-09-12T17:23:13.899 INFO:teuthology.orchestra.run.smithi181.stdout:7 2024-09-12T17:23:13.911 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T17:23:13.911 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T17:23:13.913 INFO:tasks.ceph.osd.0:Started 2024-09-12T17:23:13.913 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T17:23:13.914 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T17:23:13.916 INFO:tasks.ceph.osd.1:Started 2024-09-12T17:23:13.916 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T17:23:13.916 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T17:23:13.918 INFO:tasks.ceph.osd.2:Started 2024-09-12T17:23:13.918 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T17:23:13.918 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T17:23:13.920 INFO:tasks.ceph.osd.3:Started 2024-09-12T17:23:13.921 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T17:23:13.921 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T17:23:13.923 INFO:tasks.ceph.osd.4:Started 2024-09-12T17:23:13.923 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T17:23:13.923 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T17:23:13.925 INFO:tasks.ceph.osd.5:Started 2024-09-12T17:23:13.925 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T17:23:13.925 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T17:23:13.927 INFO:tasks.ceph.osd.6:Started 2024-09-12T17:23:13.928 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T17:23:13.928 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T17:23:13.930 INFO:tasks.ceph.osd.7:Started 2024-09-12T17:23:13.930 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:23:14.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:23:14.145 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":10,"fsid":"e2fc0024-c5a5-4250-915f-923340ab7b0f","created":"2024-09-12T17:23:11.337064+0000","modified":"2024-09-12T17:23:13.896535+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:23:13.896535+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bc14ac54-a573-4ab7-9060-b1b49e7f29ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aa0a9bcc-3ee4-467e-882e-b81ac1e33d34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b386e6f-8a15-4112-be99-d23d16d6e0ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"971fc3af-fe85-46e5-8a51-44f1e460416b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b70b28f6-11c6-468b-9059-400624bcbdea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"564a5e08-75c6-45fa-aa10-4231c4284450","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cbcc8c67-5471-43d4-a384-01f692997d65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"bfc77994-e3e4-4c97-87b7-ce5eb6424fd0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:23:14.156 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T17:23:14.156 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T17:23:14.963 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:23:15.142 INFO:teuthology.misc.health.smithi044.stdout: 2024-09-12T17:23:15.142 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":10,"fsid":"e2fc0024-c5a5-4250-915f-923340ab7b0f","created":"2024-09-12T17:23:11.337064+0000","modified":"2024-09-12T17:23:13.896535+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:23:13.896535+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bc14ac54-a573-4ab7-9060-b1b49e7f29ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aa0a9bcc-3ee4-467e-882e-b81ac1e33d34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b386e6f-8a15-4112-be99-d23d16d6e0ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"971fc3af-fe85-46e5-8a51-44f1e460416b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b70b28f6-11c6-468b-9059-400624bcbdea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"564a5e08-75c6-45fa-aa10-4231c4284450","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cbcc8c67-5471-43d4-a384-01f692997d65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"bfc77994-e3e4-4c97-87b7-ce5eb6424fd0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:23:15.152 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:23:15.422 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-09-12T17:23:15.421+0000 7fa228c18640 -1 Falling back to public interface 2024-09-12T17:23:15.433 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-09-12T17:23:15.432+0000 7f1e48341640 -1 Falling back to public interface 2024-09-12T17:23:15.640 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-09-12T17:23:15.638+0000 7f437d087640 -1 Falling back to public interface 2024-09-12T17:23:15.652 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-09-12T17:23:15.651+0000 7fd735356640 -1 Falling back to public interface 2024-09-12T17:23:15.663 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-09-12T17:23:15.663+0000 7f1b1120c640 -1 Falling back to public interface 2024-09-12T17:23:15.691 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-09-12T17:23:15.690+0000 7fb26ba19640 -1 Falling back to public interface 2024-09-12T17:23:15.898 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-09-12T17:23:15.897+0000 7f25de80d640 -1 Falling back to public interface 2024-09-12T17:23:15.936 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-09-12T17:23:15.935+0000 7f5148820640 -1 Falling back to public interface 2024-09-12T17:23:16.623 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-12T17:23:16.621+0000 7fab1735b640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T17:23:16.623 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-09-12T17:23:16.622+0000 7fab1735b640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T17:23:19.005 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-09-12T17:23:19.004+0000 7f1e48341640 -1 osd.2 0 log_to_monitors true 2024-09-12T17:23:19.239 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-09-12T17:23:19.237+0000 7fa228c18640 -1 osd.3 0 log_to_monitors true 2024-09-12T17:23:19.474 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-09-12T17:23:19.473+0000 7fb26ba19640 -1 osd.6 0 log_to_monitors true 2024-09-12T17:23:19.651 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-09-12T17:23:19.650+0000 7f25de80d640 -1 osd.4 0 log_to_monitors true 2024-09-12T17:23:19.674 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-09-12T17:23:19.673+0000 7f437d087640 -1 osd.7 0 log_to_monitors true 2024-09-12T17:23:19.675 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-09-12T17:23:19.673+0000 7fd735356640 -1 osd.1 0 log_to_monitors true 2024-09-12T17:23:19.776 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-09-12T17:23:19.774+0000 7f5148820640 -1 osd.5 0 log_to_monitors true 2024-09-12T17:23:19.965 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-09-12T17:23:19.964+0000 7f1b1120c640 -1 osd.0 0 log_to_monitors true 2024-09-12T17:23:21.774 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-09-12T17:23:21.772+0000 7fa2245e8640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T17:23:21.794 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-09-12T17:23:21.793+0000 7f1e442d5640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T17:23:21.798 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-09-12T17:23:21.797+0000 7fa21c407640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:23:21.831 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-09-12T17:23:21.829+0000 7f1e3c0f4640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:23:21.960 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:23:22.388 INFO:teuthology.misc.health.smithi044.stdout: 2024-09-12T17:23:22.388 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":13,"fsid":"e2fc0024-c5a5-4250-915f-923340ab7b0f","created":"2024-09-12T17:23:11.337064+0000","modified":"2024-09-12T17:23:21.357338+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:23:13.896535+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bc14ac54-a573-4ab7-9060-b1b49e7f29ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aa0a9bcc-3ee4-467e-882e-b81ac1e33d34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b386e6f-8a15-4112-be99-d23d16d6e0ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"971fc3af-fe85-46e5-8a51-44f1e460416b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b70b28f6-11c6-468b-9059-400624bcbdea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"564a5e08-75c6-45fa-aa10-4231c4284450","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cbcc8c67-5471-43d4-a384-01f692997d65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"bfc77994-e3e4-4c97-87b7-ce5eb6424fd0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:23:22.403 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:23:22.544 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-09-12T17:23:22.542+0000 7f1b0cace640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T17:23:22.557 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-09-12T17:23:22.556+0000 7f1b048ed640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:23:22.845 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-09-12T17:23:22.844+0000 7fd7312ea640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T17:23:22.861 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-09-12T17:23:22.859+0000 7fd729109640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:23:23.335 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-09-12T17:23:23.334+0000 7fb2679ad640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T17:23:23.349 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-09-12T17:23:23.348+0000 7fb25f7cc640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:23:23.415 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-09-12T17:23:23.414+0000 7f437982f640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T17:23:23.430 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-09-12T17:23:23.429+0000 7f25da250640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T17:23:23.431 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-09-12T17:23:23.430+0000 7f4370e3a640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:23:23.448 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-09-12T17:23:23.447+0000 7f25d206f640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:23:23.459 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-09-12T17:23:23.458+0000 7f514492c640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T17:23:23.473 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-09-12T17:23:23.472+0000 7f513bf37640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:23:29.210 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:23:29.534 INFO:teuthology.misc.health.smithi044.stdout: 2024-09-12T17:23:29.534 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":18,"fsid":"e2fc0024-c5a5-4250-915f-923340ab7b0f","created":"2024-09-12T17:23:11.337064+0000","modified":"2024-09-12T17:23:26.555201+0000","last_up_change":"2024-09-12T17:23:23.530521+0000","last_in_change":"2024-09-12T17:23:13.896535+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:23:23.633116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc14ac54-a573-4ab7-9060-b1b49e7f29ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2872503546},{"type":"v1","addr":"172.21.15.44:6825","nonce":2872503546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2872503546},{"type":"v1","addr":"172.21.15.44:6827","nonce":2872503546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2872503546},{"type":"v1","addr":"172.21.15.44:6831","nonce":2872503546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2872503546},{"type":"v1","addr":"172.21.15.44:6829","nonce":2872503546}]},"public_addr":"172.21.15.44:6825/2872503546","cluster_addr":"172.21.15.44:6827/2872503546","heartbeat_back_addr":"172.21.15.44:6831/2872503546","heartbeat_front_addr":"172.21.15.44:6829/2872503546","state":["exists","up"]},{"osd":1,"uuid":"aa0a9bcc-3ee4-467e-882e-b81ac1e33d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2388684615},{"type":"v1","addr":"172.21.15.44:6817","nonce":2388684615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2388684615},{"type":"v1","addr":"172.21.15.44:6819","nonce":2388684615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2388684615},{"type":"v1","addr":"172.21.15.44:6823","nonce":2388684615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2388684615},{"type":"v1","addr":"172.21.15.44:6821","nonce":2388684615}]},"public_addr":"172.21.15.44:6817/2388684615","cluster_addr":"172.21.15.44:6819/2388684615","heartbeat_back_addr":"172.21.15.44:6823/2388684615","heartbeat_front_addr":"172.21.15.44:6821/2388684615","state":["exists","up"]},{"osd":2,"uuid":"7b386e6f-8a15-4112-be99-d23d16d6e0ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1676130713},{"type":"v1","addr":"172.21.15.44:6809","nonce":1676130713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1676130713},{"type":"v1","addr":"172.21.15.44:6811","nonce":1676130713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1676130713},{"type":"v1","addr":"172.21.15.44:6815","nonce":1676130713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1676130713},{"type":"v1","addr":"172.21.15.44:6813","nonce":1676130713}]},"public_addr":"172.21.15.44:6809/1676130713","cluster_addr":"172.21.15.44:6811/1676130713","heartbeat_back_addr":"172.21.15.44:6815/1676130713","heartbeat_front_addr":"172.21.15.44:6813/1676130713","state":["exists","up"]},{"osd":3,"uuid":"971fc3af-fe85-46e5-8a51-44f1e460416b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":4250907931},{"type":"v1","addr":"172.21.15.44:6801","nonce":4250907931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4250907931},{"type":"v1","addr":"172.21.15.44:6803","nonce":4250907931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4250907931},{"type":"v1","addr":"172.21.15.44:6807","nonce":4250907931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4250907931},{"type":"v1","addr":"172.21.15.44:6805","nonce":4250907931}]},"public_addr":"172.21.15.44:6801/4250907931","cluster_addr":"172.21.15.44:6803/4250907931","heartbeat_back_addr":"172.21.15.44:6807/4250907931","heartbeat_front_addr":"172.21.15.44:6805/4250907931","state":["exists","up"]},{"osd":4,"uuid":"b70b28f6-11c6-468b-9059-400624bcbdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2591499742},{"type":"v1","addr":"172.21.15.181:6819","nonce":2591499742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2591499742},{"type":"v1","addr":"172.21.15.181:6821","nonce":2591499742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2591499742},{"type":"v1","addr":"172.21.15.181:6825","nonce":2591499742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2591499742},{"type":"v1","addr":"172.21.15.181:6823","nonce":2591499742}]},"public_addr":"172.21.15.181:6819/2591499742","cluster_addr":"172.21.15.181:6821/2591499742","heartbeat_back_addr":"172.21.15.181:6825/2591499742","heartbeat_front_addr":"172.21.15.181:6823/2591499742","state":["exists","up"]},{"osd":5,"uuid":"564a5e08-75c6-45fa-aa10-4231c4284450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1273321942},{"type":"v1","addr":"172.21.15.181:6827","nonce":1273321942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1273321942},{"type":"v1","addr":"172.21.15.181:6829","nonce":1273321942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1273321942},{"type":"v1","addr":"172.21.15.181:6833","nonce":1273321942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1273321942},{"type":"v1","addr":"172.21.15.181:6831","nonce":1273321942}]},"public_addr":"172.21.15.181:6827/1273321942","cluster_addr":"172.21.15.181:6829/1273321942","heartbeat_back_addr":"172.21.15.181:6833/1273321942","heartbeat_front_addr":"172.21.15.181:6831/1273321942","state":["exists","up"]},{"osd":6,"uuid":"cbcc8c67-5471-43d4-a384-01f692997d65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2228110208},{"type":"v1","addr":"172.21.15.181:6811","nonce":2228110208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2228110208},{"type":"v1","addr":"172.21.15.181:6813","nonce":2228110208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2228110208},{"type":"v1","addr":"172.21.15.181:6817","nonce":2228110208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2228110208},{"type":"v1","addr":"172.21.15.181:6815","nonce":2228110208}]},"public_addr":"172.21.15.181:6811/2228110208","cluster_addr":"172.21.15.181:6813/2228110208","heartbeat_back_addr":"172.21.15.181:6817/2228110208","heartbeat_front_addr":"172.21.15.181:6815/2228110208","state":["exists","up"]},{"osd":7,"uuid":"bfc77994-e3e4-4c97-87b7-ce5eb6424fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1372247348},{"type":"v1","addr":"172.21.15.181:6803","nonce":1372247348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1372247348},{"type":"v1","addr":"172.21.15.181:6805","nonce":1372247348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1372247348},{"type":"v1","addr":"172.21.15.181:6809","nonce":1372247348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1372247348},{"type":"v1","addr":"172.21.15.181:6807","nonce":1372247348}]},"public_addr":"172.21.15.181:6803/1372247348","cluster_addr":"172.21.15.181:6805/1372247348","heartbeat_back_addr":"172.21.15.181:6809/1372247348","heartbeat_front_addr":"172.21.15.181:6807/1372247348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.920869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.697020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.045772+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.209650+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.616652+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.802487+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.481025+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.698668+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:23:29.545 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T17:23:29.546 INFO:tasks.ceph:Creating RBD pool 2024-09-12T17:23:29.546 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T17:23:30.578 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'rbd' created 2024-09-12T17:23:30.595 DEBUG:teuthology.orchestra.run.smithi044:> rbd --cluster ceph pool init rbd 2024-09-12T17:23:30.659 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:30.659 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:33.603 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T17:23:33.603 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T17:23:33.604 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T17:23:33.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:23:34.042 INFO:teuthology.orchestra.run.smithi044.stdout:[{"version":9,"timestamp":"2024-09-12T17:23:23.459651+0000","name":"","changes":[{"name":"osd.5/osd_mclock_max_capacity_iops_ssd","new_value":"5532.032901"}]}] 2024-09-12T17:23:34.043 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T17:23:34.043 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T17:23:34.043 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T17:23:34.043 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T17:23:34.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:23:34.419 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2827779215},{"type":"v1","addr":"172.21.15.181:6801","nonce":2827779215}]},"active_addr":"172.21.15.181:6801/2827779215","active_change":"2024-09-12T17:23:15.610492+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":1878971036}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":3752723954}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":106636548}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":2011004479}]}]} 2024-09-12T17:23:34.424 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T17:23:34.424 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T17:23:34.424 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:23:34.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:23:34.739 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":22,"fsid":"e2fc0024-c5a5-4250-915f-923340ab7b0f","created":"2024-09-12T17:23:11.337064+0000","modified":"2024-09-12T17:23:33.586511+0000","last_up_change":"2024-09-12T17:23:23.530521+0000","last_in_change":"2024-09-12T17:23:13.896535+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:23:23.633116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:23:29.858635+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc14ac54-a573-4ab7-9060-b1b49e7f29ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2872503546},{"type":"v1","addr":"172.21.15.44:6825","nonce":2872503546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2872503546},{"type":"v1","addr":"172.21.15.44:6827","nonce":2872503546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2872503546},{"type":"v1","addr":"172.21.15.44:6831","nonce":2872503546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2872503546},{"type":"v1","addr":"172.21.15.44:6829","nonce":2872503546}]},"public_addr":"172.21.15.44:6825/2872503546","cluster_addr":"172.21.15.44:6827/2872503546","heartbeat_back_addr":"172.21.15.44:6831/2872503546","heartbeat_front_addr":"172.21.15.44:6829/2872503546","state":["exists","up"]},{"osd":1,"uuid":"aa0a9bcc-3ee4-467e-882e-b81ac1e33d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2388684615},{"type":"v1","addr":"172.21.15.44:6817","nonce":2388684615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2388684615},{"type":"v1","addr":"172.21.15.44:6819","nonce":2388684615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2388684615},{"type":"v1","addr":"172.21.15.44:6823","nonce":2388684615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2388684615},{"type":"v1","addr":"172.21.15.44:6821","nonce":2388684615}]},"public_addr":"172.21.15.44:6817/2388684615","cluster_addr":"172.21.15.44:6819/2388684615","heartbeat_back_addr":"172.21.15.44:6823/2388684615","heartbeat_front_addr":"172.21.15.44:6821/2388684615","state":["exists","up"]},{"osd":2,"uuid":"7b386e6f-8a15-4112-be99-d23d16d6e0ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1676130713},{"type":"v1","addr":"172.21.15.44:6809","nonce":1676130713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1676130713},{"type":"v1","addr":"172.21.15.44:6811","nonce":1676130713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1676130713},{"type":"v1","addr":"172.21.15.44:6815","nonce":1676130713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1676130713},{"type":"v1","addr":"172.21.15.44:6813","nonce":1676130713}]},"public_addr":"172.21.15.44:6809/1676130713","cluster_addr":"172.21.15.44:6811/1676130713","heartbeat_back_addr":"172.21.15.44:6815/1676130713","heartbeat_front_addr":"172.21.15.44:6813/1676130713","state":["exists","up"]},{"osd":3,"uuid":"971fc3af-fe85-46e5-8a51-44f1e460416b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":4250907931},{"type":"v1","addr":"172.21.15.44:6801","nonce":4250907931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4250907931},{"type":"v1","addr":"172.21.15.44:6803","nonce":4250907931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4250907931},{"type":"v1","addr":"172.21.15.44:6807","nonce":4250907931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4250907931},{"type":"v1","addr":"172.21.15.44:6805","nonce":4250907931}]},"public_addr":"172.21.15.44:6801/4250907931","cluster_addr":"172.21.15.44:6803/4250907931","heartbeat_back_addr":"172.21.15.44:6807/4250907931","heartbeat_front_addr":"172.21.15.44:6805/4250907931","state":["exists","up"]},{"osd":4,"uuid":"b70b28f6-11c6-468b-9059-400624bcbdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2591499742},{"type":"v1","addr":"172.21.15.181:6819","nonce":2591499742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2591499742},{"type":"v1","addr":"172.21.15.181:6821","nonce":2591499742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2591499742},{"type":"v1","addr":"172.21.15.181:6825","nonce":2591499742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2591499742},{"type":"v1","addr":"172.21.15.181:6823","nonce":2591499742}]},"public_addr":"172.21.15.181:6819/2591499742","cluster_addr":"172.21.15.181:6821/2591499742","heartbeat_back_addr":"172.21.15.181:6825/2591499742","heartbeat_front_addr":"172.21.15.181:6823/2591499742","state":["exists","up"]},{"osd":5,"uuid":"564a5e08-75c6-45fa-aa10-4231c4284450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1273321942},{"type":"v1","addr":"172.21.15.181:6827","nonce":1273321942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1273321942},{"type":"v1","addr":"172.21.15.181:6829","nonce":1273321942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1273321942},{"type":"v1","addr":"172.21.15.181:6833","nonce":1273321942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1273321942},{"type":"v1","addr":"172.21.15.181:6831","nonce":1273321942}]},"public_addr":"172.21.15.181:6827/1273321942","cluster_addr":"172.21.15.181:6829/1273321942","heartbeat_back_addr":"172.21.15.181:6833/1273321942","heartbeat_front_addr":"172.21.15.181:6831/1273321942","state":["exists","up"]},{"osd":6,"uuid":"cbcc8c67-5471-43d4-a384-01f692997d65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2228110208},{"type":"v1","addr":"172.21.15.181:6811","nonce":2228110208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2228110208},{"type":"v1","addr":"172.21.15.181:6813","nonce":2228110208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2228110208},{"type":"v1","addr":"172.21.15.181:6817","nonce":2228110208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2228110208},{"type":"v1","addr":"172.21.15.181:6815","nonce":2228110208}]},"public_addr":"172.21.15.181:6811/2228110208","cluster_addr":"172.21.15.181:6813/2228110208","heartbeat_back_addr":"172.21.15.181:6817/2228110208","heartbeat_front_addr":"172.21.15.181:6815/2228110208","state":["exists","up"]},{"osd":7,"uuid":"bfc77994-e3e4-4c97-87b7-ce5eb6424fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1372247348},{"type":"v1","addr":"172.21.15.181:6803","nonce":1372247348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1372247348},{"type":"v1","addr":"172.21.15.181:6805","nonce":1372247348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1372247348},{"type":"v1","addr":"172.21.15.181:6809","nonce":1372247348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1372247348},{"type":"v1","addr":"172.21.15.181:6807","nonce":1372247348}]},"public_addr":"172.21.15.181:6803/1372247348","cluster_addr":"172.21.15.181:6805/1372247348","heartbeat_back_addr":"172.21.15.181:6809/1372247348","heartbeat_front_addr":"172.21.15.181:6807/1372247348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.920869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.697020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.045772+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.209650+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.616652+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.802487+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.481025+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.698668+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:23:34.752 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T17:23:34.752 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:23:35.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:23:35.066 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":22,"fsid":"e2fc0024-c5a5-4250-915f-923340ab7b0f","created":"2024-09-12T17:23:11.337064+0000","modified":"2024-09-12T17:23:33.586511+0000","last_up_change":"2024-09-12T17:23:23.530521+0000","last_in_change":"2024-09-12T17:23:13.896535+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:23:23.633116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:23:29.858635+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc14ac54-a573-4ab7-9060-b1b49e7f29ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2872503546},{"type":"v1","addr":"172.21.15.44:6825","nonce":2872503546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2872503546},{"type":"v1","addr":"172.21.15.44:6827","nonce":2872503546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2872503546},{"type":"v1","addr":"172.21.15.44:6831","nonce":2872503546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2872503546},{"type":"v1","addr":"172.21.15.44:6829","nonce":2872503546}]},"public_addr":"172.21.15.44:6825/2872503546","cluster_addr":"172.21.15.44:6827/2872503546","heartbeat_back_addr":"172.21.15.44:6831/2872503546","heartbeat_front_addr":"172.21.15.44:6829/2872503546","state":["exists","up"]},{"osd":1,"uuid":"aa0a9bcc-3ee4-467e-882e-b81ac1e33d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2388684615},{"type":"v1","addr":"172.21.15.44:6817","nonce":2388684615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2388684615},{"type":"v1","addr":"172.21.15.44:6819","nonce":2388684615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2388684615},{"type":"v1","addr":"172.21.15.44:6823","nonce":2388684615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2388684615},{"type":"v1","addr":"172.21.15.44:6821","nonce":2388684615}]},"public_addr":"172.21.15.44:6817/2388684615","cluster_addr":"172.21.15.44:6819/2388684615","heartbeat_back_addr":"172.21.15.44:6823/2388684615","heartbeat_front_addr":"172.21.15.44:6821/2388684615","state":["exists","up"]},{"osd":2,"uuid":"7b386e6f-8a15-4112-be99-d23d16d6e0ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1676130713},{"type":"v1","addr":"172.21.15.44:6809","nonce":1676130713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1676130713},{"type":"v1","addr":"172.21.15.44:6811","nonce":1676130713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1676130713},{"type":"v1","addr":"172.21.15.44:6815","nonce":1676130713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1676130713},{"type":"v1","addr":"172.21.15.44:6813","nonce":1676130713}]},"public_addr":"172.21.15.44:6809/1676130713","cluster_addr":"172.21.15.44:6811/1676130713","heartbeat_back_addr":"172.21.15.44:6815/1676130713","heartbeat_front_addr":"172.21.15.44:6813/1676130713","state":["exists","up"]},{"osd":3,"uuid":"971fc3af-fe85-46e5-8a51-44f1e460416b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":4250907931},{"type":"v1","addr":"172.21.15.44:6801","nonce":4250907931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4250907931},{"type":"v1","addr":"172.21.15.44:6803","nonce":4250907931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4250907931},{"type":"v1","addr":"172.21.15.44:6807","nonce":4250907931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4250907931},{"type":"v1","addr":"172.21.15.44:6805","nonce":4250907931}]},"public_addr":"172.21.15.44:6801/4250907931","cluster_addr":"172.21.15.44:6803/4250907931","heartbeat_back_addr":"172.21.15.44:6807/4250907931","heartbeat_front_addr":"172.21.15.44:6805/4250907931","state":["exists","up"]},{"osd":4,"uuid":"b70b28f6-11c6-468b-9059-400624bcbdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2591499742},{"type":"v1","addr":"172.21.15.181:6819","nonce":2591499742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2591499742},{"type":"v1","addr":"172.21.15.181:6821","nonce":2591499742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2591499742},{"type":"v1","addr":"172.21.15.181:6825","nonce":2591499742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2591499742},{"type":"v1","addr":"172.21.15.181:6823","nonce":2591499742}]},"public_addr":"172.21.15.181:6819/2591499742","cluster_addr":"172.21.15.181:6821/2591499742","heartbeat_back_addr":"172.21.15.181:6825/2591499742","heartbeat_front_addr":"172.21.15.181:6823/2591499742","state":["exists","up"]},{"osd":5,"uuid":"564a5e08-75c6-45fa-aa10-4231c4284450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1273321942},{"type":"v1","addr":"172.21.15.181:6827","nonce":1273321942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1273321942},{"type":"v1","addr":"172.21.15.181:6829","nonce":1273321942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1273321942},{"type":"v1","addr":"172.21.15.181:6833","nonce":1273321942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1273321942},{"type":"v1","addr":"172.21.15.181:6831","nonce":1273321942}]},"public_addr":"172.21.15.181:6827/1273321942","cluster_addr":"172.21.15.181:6829/1273321942","heartbeat_back_addr":"172.21.15.181:6833/1273321942","heartbeat_front_addr":"172.21.15.181:6831/1273321942","state":["exists","up"]},{"osd":6,"uuid":"cbcc8c67-5471-43d4-a384-01f692997d65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2228110208},{"type":"v1","addr":"172.21.15.181:6811","nonce":2228110208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2228110208},{"type":"v1","addr":"172.21.15.181:6813","nonce":2228110208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2228110208},{"type":"v1","addr":"172.21.15.181:6817","nonce":2228110208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2228110208},{"type":"v1","addr":"172.21.15.181:6815","nonce":2228110208}]},"public_addr":"172.21.15.181:6811/2228110208","cluster_addr":"172.21.15.181:6813/2228110208","heartbeat_back_addr":"172.21.15.181:6817/2228110208","heartbeat_front_addr":"172.21.15.181:6815/2228110208","state":["exists","up"]},{"osd":7,"uuid":"bfc77994-e3e4-4c97-87b7-ce5eb6424fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1372247348},{"type":"v1","addr":"172.21.15.181:6803","nonce":1372247348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1372247348},{"type":"v1","addr":"172.21.15.181:6805","nonce":1372247348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1372247348},{"type":"v1","addr":"172.21.15.181:6809","nonce":1372247348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1372247348},{"type":"v1","addr":"172.21.15.181:6807","nonce":1372247348}]},"public_addr":"172.21.15.181:6803/1372247348","cluster_addr":"172.21.15.181:6805/1372247348","heartbeat_back_addr":"172.21.15.181:6809/1372247348","heartbeat_front_addr":"172.21.15.181:6807/1372247348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.920869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.697020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.045772+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.209650+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.616652+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.802487+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.481025+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.698668+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:23:35.080 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T17:23:35.080 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T17:23:35.081 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T17:23:35.081 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T17:23:35.081 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T17:23:35.082 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T17:23:35.082 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T17:23:35.083 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T17:23:35.353 INFO:teuthology.orchestra.run.smithi044.stdout:60129542150 2024-09-12T17:23:35.353 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:23:35.357 INFO:teuthology.orchestra.run.smithi044.stdout:60129542150 2024-09-12T17:23:35.357 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:23:35.359 INFO:teuthology.orchestra.run.smithi044.stdout:64424509445 2024-09-12T17:23:35.359 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:23:35.360 INFO:teuthology.orchestra.run.smithi044.stdout:64424509446 2024-09-12T17:23:35.360 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:23:35.362 INFO:teuthology.orchestra.run.smithi044.stdout:64424509445 2024-09-12T17:23:35.363 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:23:35.363 INFO:teuthology.orchestra.run.smithi044.stdout:64424509445 2024-09-12T17:23:35.364 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:23:35.364 INFO:teuthology.orchestra.run.smithi044.stdout:64424509445 2024-09-12T17:23:35.365 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:23:35.366 INFO:teuthology.orchestra.run.smithi044.stdout:64424509446 2024-09-12T17:23:35.366 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:23:35.973 INFO:teuthology.orchestra.run.smithi044.stdout:60129542149 2024-09-12T17:23:35.978 INFO:teuthology.orchestra.run.smithi044.stdout:64424509443 2024-09-12T17:23:35.988 INFO:teuthology.orchestra.run.smithi044.stdout:60129542149 2024-09-12T17:23:35.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.3 2024-09-12T17:23:35.998 INFO:teuthology.orchestra.run.smithi044.stdout:64424509444 2024-09-12T17:23:36.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.1 2024-09-12T17:23:36.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.2 2024-09-12T17:23:36.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.5 2024-09-12T17:23:36.024 INFO:teuthology.orchestra.run.smithi044.stdout:64424509444 2024-09-12T17:23:36.028 INFO:teuthology.orchestra.run.smithi044.stdout:64424509443 2024-09-12T17:23:36.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.4 2024-09-12T17:23:36.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.0 2024-09-12T17:23:36.065 INFO:teuthology.orchestra.run.smithi044.stdout:64424509443 2024-09-12T17:23:36.068 INFO:teuthology.orchestra.run.smithi044.stdout:64424509443 2024-09-12T17:23:36.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.6 2024-09-12T17:23:36.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.7 2024-09-12T17:23:36.996 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:23:37.004 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:23:37.011 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:23:37.016 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:23:37.040 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:23:37.042 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:23:37.084 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:23:37.085 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:23:37.623 INFO:teuthology.orchestra.run.smithi044.stdout:60129542150 2024-09-12T17:23:37.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-09-12T17:23:37.640 DEBUG:teuthology.parallel:result is None 2024-09-12T17:23:37.690 INFO:teuthology.orchestra.run.smithi044.stdout:64424509446 2024-09-12T17:23:37.692 INFO:teuthology.orchestra.run.smithi044.stdout:64424509445 2024-09-12T17:23:37.693 INFO:teuthology.orchestra.run.smithi044.stdout:64424509445 2024-09-12T17:23:37.701 INFO:teuthology.orchestra.run.smithi044.stdout:64424509446 2024-09-12T17:23:37.712 INFO:teuthology.orchestra.run.smithi044.stdout:60129542150 2024-09-12T17:23:37.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.5 2024-09-12T17:23:37.713 DEBUG:teuthology.parallel:result is None 2024-09-12T17:23:37.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.7 2024-09-12T17:23:37.715 DEBUG:teuthology.parallel:result is None 2024-09-12T17:23:37.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.1 2024-09-12T17:23:37.716 DEBUG:teuthology.parallel:result is None 2024-09-12T17:23:37.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-12T17:23:37.718 DEBUG:teuthology.parallel:result is None 2024-09-12T17:23:37.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-09-12T17:23:37.726 DEBUG:teuthology.parallel:result is None 2024-09-12T17:23:37.733 INFO:teuthology.orchestra.run.smithi044.stdout:64424509445 2024-09-12T17:23:37.744 INFO:teuthology.orchestra.run.smithi044.stdout:64424509445 2024-09-12T17:23:37.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.6 2024-09-12T17:23:37.747 DEBUG:teuthology.parallel:result is None 2024-09-12T17:23:37.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.0 2024-09-12T17:23:37.756 DEBUG:teuthology.parallel:result is None 2024-09-12T17:23:37.757 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:23:37.757 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:23:38.106 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:23:38.106 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-12T17:23:38.118 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T17:23:37.618574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219144,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755576,"statfs":{"total":773094113280,"available":772869709824,"internally_reserved":0,"allocated":2965504,"data_stored":1777574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.037500"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.971199+0000","last_change":"2024-09-12T17:23:33.971199+0000","last_active":"2024-09-12T17:23:33.971199+0000","last_peered":"2024-09-12T17:23:33.971199+0000","last_clean":"2024-09-12T17:23:33.971199+0000","last_became_active":"2024-09-12T17:23:31.588266+0000","last_became_peered":"2024-09-12T17:23:31.588266+0000","last_unstale":"2024-09-12T17:23:33.971199+0000","last_undegraded":"2024-09-12T17:23:33.971199+0000","last_fullsized":"2024-09-12T17:23:33.971199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:05.248877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051630700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.592959+0000","last_change":"2024-09-12T17:23:33.592959+0000","last_active":"2024-09-12T17:23:33.592959+0000","last_peered":"2024-09-12T17:23:33.592959+0000","last_clean":"2024-09-12T17:23:33.592959+0000","last_became_active":"2024-09-12T17:23:31.588526+0000","last_became_peered":"2024-09-12T17:23:31.588526+0000","last_unstale":"2024-09-12T17:23:33.592959+0000","last_undegraded":"2024-09-12T17:23:33.592959+0000","last_fullsized":"2024-09-12T17:23:33.592959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:32.240058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055923099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.971206+0000","last_change":"2024-09-12T17:23:33.971206+0000","last_active":"2024-09-12T17:23:33.971206+0000","last_peered":"2024-09-12T17:23:33.971206+0000","last_clean":"2024-09-12T17:23:33.971206+0000","last_became_active":"2024-09-12T17:23:31.681155+0000","last_became_peered":"2024-09-12T17:23:31.681155+0000","last_unstale":"2024-09-12T17:23:33.971206+0000","last_undegraded":"2024-09-12T17:23:33.971206+0000","last_fullsized":"2024-09-12T17:23:33.971206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:20.293962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048562399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.592955+0000","last_change":"2024-09-12T17:23:33.592955+0000","last_active":"2024-09-12T17:23:33.592955+0000","last_peered":"2024-09-12T17:23:33.592955+0000","last_clean":"2024-09-12T17:23:33.592955+0000","last_became_active":"2024-09-12T17:23:31.681209+0000","last_became_peered":"2024-09-12T17:23:31.681209+0000","last_unstale":"2024-09-12T17:23:33.592955+0000","last_undegraded":"2024-09-12T17:23:33.592955+0000","last_fullsized":"2024-09-12T17:23:33.592955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:00.576073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056110600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.597635+0000","last_change":"2024-09-12T17:23:33.596992+0000","last_active":"2024-09-12T17:23:33.597635+0000","last_peered":"2024-09-12T17:23:33.597635+0000","last_clean":"2024-09-12T17:23:33.597635+0000","last_became_active":"2024-09-12T17:23:31.588612+0000","last_became_peered":"2024-09-12T17:23:31.588612+0000","last_unstale":"2024-09-12T17:23:33.597635+0000","last_undegraded":"2024-09-12T17:23:33.597635+0000","last_fullsized":"2024-09-12T17:23:33.597635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:20.500808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095838300000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.835627+0000","last_change":"2024-09-12T17:23:33.835818+0000","last_active":"2024-09-12T17:23:33.835627+0000","last_peered":"2024-09-12T17:23:33.835627+0000","last_clean":"2024-09-12T17:23:33.835627+0000","last_became_active":"2024-09-12T17:23:31.584259+0000","last_became_peered":"2024-09-12T17:23:31.584259+0000","last_unstale":"2024-09-12T17:23:33.835627+0000","last_undegraded":"2024-09-12T17:23:33.835627+0000","last_fullsized":"2024-09-12T17:23:33.835627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:33.916339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045870900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.971250+0000","last_change":"2024-09-12T17:23:33.971250+0000","last_active":"2024-09-12T17:23:33.971250+0000","last_peered":"2024-09-12T17:23:33.971250+0000","last_clean":"2024-09-12T17:23:33.971250+0000","last_became_active":"2024-09-12T17:23:31.588699+0000","last_became_peered":"2024-09-12T17:23:31.588699+0000","last_unstale":"2024-09-12T17:23:33.971250+0000","last_undegraded":"2024-09-12T17:23:33.971250+0000","last_fullsized":"2024-09-12T17:23:33.971250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:46.725886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052181899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.596450+0000","last_change":"2024-09-12T17:23:33.596450+0000","last_active":"2024-09-12T17:23:33.596450+0000","last_peered":"2024-09-12T17:23:33.596450+0000","last_clean":"2024-09-12T17:23:33.596450+0000","last_became_active":"2024-09-12T17:23:31.584884+0000","last_became_peered":"2024-09-12T17:23:31.584884+0000","last_unstale":"2024-09-12T17:23:33.596450+0000","last_undegraded":"2024-09-12T17:23:33.596450+0000","last_fullsized":"2024-09-12T17:23:33.596450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:30.448834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423087,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.970629+0000","last_change":"2024-09-12T17:23:26.035893+0000","last_active":"2024-09-12T17:23:33.970629+0000","last_peered":"2024-09-12T17:23:33.970629+0000","last_clean":"2024-09-12T17:23:33.970629+0000","last_became_active":"2024-09-12T17:23:26.034872+0000","last_became_peered":"2024-09-12T17:23:26.034872+0000","last_unstale":"2024-09-12T17:23:33.970629+0000","last_undegraded":"2024-09-12T17:23:33.970629+0000","last_fullsized":"2024-09-12T17:23:33.970629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:24.539348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:24.539348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:24.539348+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:20.611359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":664968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":664968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:23:38.119 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:23:38.428 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:23:38.429 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-12T17:23:38.440 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T17:23:37.618574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219144,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755576,"statfs":{"total":773094113280,"available":772869709824,"internally_reserved":0,"allocated":2965504,"data_stored":1777574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.037500"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.971199+0000","last_change":"2024-09-12T17:23:33.971199+0000","last_active":"2024-09-12T17:23:33.971199+0000","last_peered":"2024-09-12T17:23:33.971199+0000","last_clean":"2024-09-12T17:23:33.971199+0000","last_became_active":"2024-09-12T17:23:31.588266+0000","last_became_peered":"2024-09-12T17:23:31.588266+0000","last_unstale":"2024-09-12T17:23:33.971199+0000","last_undegraded":"2024-09-12T17:23:33.971199+0000","last_fullsized":"2024-09-12T17:23:33.971199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:05.248877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051630700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.592959+0000","last_change":"2024-09-12T17:23:33.592959+0000","last_active":"2024-09-12T17:23:33.592959+0000","last_peered":"2024-09-12T17:23:33.592959+0000","last_clean":"2024-09-12T17:23:33.592959+0000","last_became_active":"2024-09-12T17:23:31.588526+0000","last_became_peered":"2024-09-12T17:23:31.588526+0000","last_unstale":"2024-09-12T17:23:33.592959+0000","last_undegraded":"2024-09-12T17:23:33.592959+0000","last_fullsized":"2024-09-12T17:23:33.592959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:32.240058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055923099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.971206+0000","last_change":"2024-09-12T17:23:33.971206+0000","last_active":"2024-09-12T17:23:33.971206+0000","last_peered":"2024-09-12T17:23:33.971206+0000","last_clean":"2024-09-12T17:23:33.971206+0000","last_became_active":"2024-09-12T17:23:31.681155+0000","last_became_peered":"2024-09-12T17:23:31.681155+0000","last_unstale":"2024-09-12T17:23:33.971206+0000","last_undegraded":"2024-09-12T17:23:33.971206+0000","last_fullsized":"2024-09-12T17:23:33.971206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:20.293962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048562399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.592955+0000","last_change":"2024-09-12T17:23:33.592955+0000","last_active":"2024-09-12T17:23:33.592955+0000","last_peered":"2024-09-12T17:23:33.592955+0000","last_clean":"2024-09-12T17:23:33.592955+0000","last_became_active":"2024-09-12T17:23:31.681209+0000","last_became_peered":"2024-09-12T17:23:31.681209+0000","last_unstale":"2024-09-12T17:23:33.592955+0000","last_undegraded":"2024-09-12T17:23:33.592955+0000","last_fullsized":"2024-09-12T17:23:33.592955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:00.576073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056110600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.597635+0000","last_change":"2024-09-12T17:23:33.596992+0000","last_active":"2024-09-12T17:23:33.597635+0000","last_peered":"2024-09-12T17:23:33.597635+0000","last_clean":"2024-09-12T17:23:33.597635+0000","last_became_active":"2024-09-12T17:23:31.588612+0000","last_became_peered":"2024-09-12T17:23:31.588612+0000","last_unstale":"2024-09-12T17:23:33.597635+0000","last_undegraded":"2024-09-12T17:23:33.597635+0000","last_fullsized":"2024-09-12T17:23:33.597635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:20.500808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095838300000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.835627+0000","last_change":"2024-09-12T17:23:33.835818+0000","last_active":"2024-09-12T17:23:33.835627+0000","last_peered":"2024-09-12T17:23:33.835627+0000","last_clean":"2024-09-12T17:23:33.835627+0000","last_became_active":"2024-09-12T17:23:31.584259+0000","last_became_peered":"2024-09-12T17:23:31.584259+0000","last_unstale":"2024-09-12T17:23:33.835627+0000","last_undegraded":"2024-09-12T17:23:33.835627+0000","last_fullsized":"2024-09-12T17:23:33.835627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:33.916339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045870900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.971250+0000","last_change":"2024-09-12T17:23:33.971250+0000","last_active":"2024-09-12T17:23:33.971250+0000","last_peered":"2024-09-12T17:23:33.971250+0000","last_clean":"2024-09-12T17:23:33.971250+0000","last_became_active":"2024-09-12T17:23:31.588699+0000","last_became_peered":"2024-09-12T17:23:31.588699+0000","last_unstale":"2024-09-12T17:23:33.971250+0000","last_undegraded":"2024-09-12T17:23:33.971250+0000","last_fullsized":"2024-09-12T17:23:33.971250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:46.725886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052181899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.596450+0000","last_change":"2024-09-12T17:23:33.596450+0000","last_active":"2024-09-12T17:23:33.596450+0000","last_peered":"2024-09-12T17:23:33.596450+0000","last_clean":"2024-09-12T17:23:33.596450+0000","last_became_active":"2024-09-12T17:23:31.584884+0000","last_became_peered":"2024-09-12T17:23:31.584884+0000","last_unstale":"2024-09-12T17:23:33.596450+0000","last_undegraded":"2024-09-12T17:23:33.596450+0000","last_fullsized":"2024-09-12T17:23:33.596450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:30.448834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423087,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:23:33.970629+0000","last_change":"2024-09-12T17:23:26.035893+0000","last_active":"2024-09-12T17:23:33.970629+0000","last_peered":"2024-09-12T17:23:33.970629+0000","last_clean":"2024-09-12T17:23:33.970629+0000","last_became_active":"2024-09-12T17:23:26.034872+0000","last_became_peered":"2024-09-12T17:23:26.034872+0000","last_unstale":"2024-09-12T17:23:33.970629+0000","last_undegraded":"2024-09-12T17:23:33.970629+0000","last_fullsized":"2024-09-12T17:23:33.970629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:24.539348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:24.539348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:24.539348+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:20.611359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":664968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":664968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:23:38.441 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:23:38.441 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T17:23:38.441 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T17:23:38.442 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T17:23:38.793 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:23:38.793 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T17:23:38.805 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T17:23:38.806 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T17:23:38.817 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T17:23:38.842 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-12T17:23:38.842 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T17:23:38.842 INFO:tasks.rgw:Creating data pools 2024-09-12T17:23:38.842 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T17:23:38.842 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-12T17:23:39.692 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T17:23:39.711 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T17:23:40.688 INFO:teuthology.orchestra.run.smithi044.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T17:23:40.722 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T17:23:41.113 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T17:23:41.132 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T17:23:42.127 INFO:teuthology.orchestra.run.smithi044.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T17:23:42.162 DEBUG:tasks.rgw:Pools created 2024-09-12T17:23:42.162 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T17:23:42.162 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:23:42.162 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:23:42.163 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:23:42.277 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:42.277 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:44.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.181+0000 7f87f07f1640 0 -- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556827f2c650 msgr2=0x556827f33f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2024-09-12T17:23:44.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.185+0000 7f87fb508800 20 rados->read ofs=0 len=0 2024-09-12T17:23:44.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.186+0000 7f87f97f3640 0 -- 172.21.15.44:0/3729919560 >> [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] conn(0x7f86c0076470 msgr2=0x7f86c0078930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:44.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.187+0000 7f87fb508800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:44.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.187+0000 7f87fb508800 20 realm 2024-09-12T17:23:44.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.187+0000 7f87fb508800 20 rados->read ofs=0 len=0 2024-09-12T17:23:44.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.187+0000 7f87fb508800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:44.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.187+0000 7f87fb508800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:44.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.187+0000 7f87fb508800 20 rados->read ofs=0 len=0 2024-09-12T17:23:44.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.188+0000 7f87fb508800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:44.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.188+0000 7f87fb508800 20 rados->read ofs=0 len=0 2024-09-12T17:23:44.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.189+0000 7f87fb508800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:44.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.189+0000 7f87fb508800 20 rados->read ofs=0 len=0 2024-09-12T17:23:44.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.189+0000 7f87fb508800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:23:44.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.189+0000 7f87fb508800 20 searching for the correct realm 2024-09-12T17:23:44.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.202+0000 7f87fb508800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:23:44.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.202+0000 7f87fb508800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:23:44.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.202+0000 7f87fb508800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:44.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.202+0000 7f87fb508800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:44.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.202+0000 7f87fb508800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:44.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.202+0000 7f87fb508800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:44.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.202+0000 7f87fb508800 20 rados->read ofs=0 len=0 2024-09-12T17:23:44.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.203+0000 7f87fb508800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:44.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.203+0000 7f87fb508800 20 rados->read ofs=0 len=0 2024-09-12T17:23:44.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.203+0000 7f87fb508800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:44.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.203+0000 7f87fb508800 20 rados->read ofs=0 len=0 2024-09-12T17:23:44.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.204+0000 7f87fb508800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:23:44.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.204+0000 7f87fb508800 20 zone default found 2024-09-12T17:23:44.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.204+0000 7f87fb508800 4 Realm: () 2024-09-12T17:23:44.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.204+0000 7f87fb508800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:23:44.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.204+0000 7f87fb508800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:23:44.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.204+0000 7f87fb508800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:44.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.204+0000 7f87fb508800 20 zonegroup default 2024-09-12T17:23:44.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.204+0000 7f87fb508800 20 rados->read ofs=0 len=0 2024-09-12T17:23:44.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.204+0000 7f87fb508800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:44.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:44.204+0000 7f87fb508800 20 rados->read ofs=0 len=0 2024-09-12T17:23:46.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:46.151+0000 7f87fb508800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:46.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:46.151+0000 7f87fb508800 20 rados->read ofs=0 len=0 2024-09-12T17:23:46.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:46.153+0000 7f87fb508800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:46.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:46.153+0000 7f87fb508800 20 started sync module instance, tier type = 2024-09-12T17:23:46.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:46.153+0000 7f87fb508800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:23:48.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.195+0000 7f87fb508800 20 add_watcher() i=0 2024-09-12T17:23:48.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.195+0000 7f87fb508800 20 add_watcher() i=1 2024-09-12T17:23:48.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.195+0000 7f87fb508800 20 add_watcher() i=2 2024-09-12T17:23:48.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.195+0000 7f87fb508800 20 add_watcher() i=3 2024-09-12T17:23:48.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.195+0000 7f87fb508800 20 add_watcher() i=4 2024-09-12T17:23:48.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.195+0000 7f87fb508800 20 add_watcher() i=5 2024-09-12T17:23:48.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.195+0000 7f87fb508800 20 add_watcher() i=6 2024-09-12T17:23:48.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.198+0000 7f87fb508800 20 add_watcher() i=7 2024-09-12T17:23:48.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.198+0000 7f87fb508800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:48.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.198+0000 7f87fb508800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T17:23:48.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.198+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T17:23:48.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.198+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.199+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T17:23:48.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.199+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T17:23:48.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.199+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.200+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T17:23:48.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.200+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T17:23:48.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.200+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.200+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T17:23:48.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.200+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T17:23:48.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.200+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.200+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T17:23:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.200+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T17:23:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.200+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.200+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T17:23:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.200+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T17:23:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.200+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.201+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T17:23:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.201+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T17:23:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.201+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.201+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T17:23:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.201+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T17:23:48.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.201+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.201+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T17:23:48.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.201+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T17:23:48.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.201+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.202+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T17:23:48.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.202+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T17:23:48.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.202+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.202+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T17:23:48.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.202+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T17:23:48.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.202+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.203+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T17:23:48.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.203+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T17:23:48.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.203+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.203+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T17:23:48.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.203+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T17:23:48.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.203+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.203+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T17:23:48.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.203+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T17:23:48.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.203+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.203+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T17:23:48.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.203+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T17:23:48.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.203+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.204+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T17:23:48.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.204+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T17:23:48.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.204+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.204+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T17:23:48.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.204+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T17:23:48.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.204+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.205+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T17:23:48.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.205+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T17:23:48.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.205+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.205+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T17:23:48.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.205+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T17:23:48.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.205+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.205+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T17:23:48.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.205+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T17:23:48.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.205+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.206+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T17:23:48.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.206+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T17:23:48.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.206+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.206+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T17:23:48.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.206+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T17:23:48.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.206+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.206+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T17:23:48.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.206+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T17:23:48.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.206+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.206+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T17:23:48.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.206+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T17:23:48.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.206+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.207+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T17:23:48.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.207+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T17:23:48.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.207+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.207+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T17:23:48.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.207+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T17:23:48.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.207+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.207+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T17:23:48.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.207+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T17:23:48.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.207+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.208+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T17:23:48.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.208+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T17:23:48.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.208+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.208+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T17:23:48.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.208+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T17:23:48.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.208+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.208+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T17:23:48.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.208+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T17:23:48.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.208+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.208+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T17:23:48.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.208+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T17:23:48.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.208+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.209+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T17:23:48.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.209+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T17:23:48.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.209+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.209+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T17:23:48.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.209+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T17:23:48.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.209+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.209+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T17:23:48.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.209+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T17:23:48.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.209+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.210+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T17:23:48.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.210+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T17:23:48.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.210+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.210+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T17:23:48.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.210+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T17:23:48.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.210+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.210+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T17:23:48.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.210+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T17:23:48.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.210+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.210+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T17:23:48.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.210+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T17:23:48.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.210+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.211+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T17:23:48.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.211+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T17:23:48.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.211+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.211+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T17:23:48.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.211+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T17:23:48.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.211+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.211+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T17:23:48.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.211+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T17:23:48.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.211+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.212+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T17:23:48.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.212+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T17:23:48.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.212+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.212+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T17:23:48.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.212+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T17:23:48.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.212+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.212+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T17:23:48.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.212+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T17:23:48.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.212+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.212+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T17:23:48.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.212+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T17:23:48.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.212+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.213+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T17:23:48.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.213+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T17:23:48.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.213+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.213+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T17:23:48.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.213+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T17:23:48.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.213+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.213+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T17:23:48.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.213+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T17:23:48.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.213+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.214+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T17:23:48.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.214+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T17:23:48.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.214+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.214+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T17:23:48.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.214+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T17:23:48.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.214+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.214+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T17:23:48.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.214+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T17:23:48.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.214+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.214+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T17:23:48.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.214+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T17:23:48.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.214+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.215+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T17:23:48.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.215+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T17:23:48.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.215+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.215+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T17:23:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.215+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T17:23:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.215+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.215+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T17:23:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.215+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T17:23:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.215+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.215+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T17:23:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.215+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T17:23:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.215+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.216+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T17:23:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.216+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T17:23:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.216+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.216+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T17:23:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.216+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T17:23:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.216+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.216+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T17:23:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.216+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T17:23:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.216+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.216+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T17:23:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.216+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T17:23:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.216+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.217+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T17:23:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.217+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T17:23:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.217+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.217+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T17:23:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.217+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T17:23:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.217+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.217+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T17:23:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.217+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T17:23:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.217+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.218+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T17:23:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.218+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T17:23:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.218+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.218+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T17:23:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.218+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T17:23:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.218+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.218+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T17:23:48.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.218+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T17:23:48.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.218+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.218+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T17:23:48.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.218+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T17:23:48.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.218+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.219+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T17:23:48.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.219+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T17:23:48.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.219+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.219+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T17:23:48.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.219+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T17:23:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.219+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.219+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T17:23:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.219+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T17:23:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.219+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.220+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T17:23:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.220+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T17:23:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.220+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.220+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T17:23:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.220+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T17:23:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.220+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.220+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T17:23:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.220+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T17:23:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.220+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.221+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T17:23:48.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.221+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T17:23:48.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.221+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.221+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T17:23:48.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.221+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T17:23:48.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.221+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.221+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T17:23:48.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.221+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T17:23:48.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.221+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.221+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T17:23:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.221+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T17:23:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.221+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.222+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T17:23:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.222+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T17:23:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.222+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.222+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T17:23:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.222+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T17:23:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.222+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.222+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T17:23:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.222+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T17:23:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.222+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.222+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T17:23:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.222+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T17:23:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.223+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.223+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T17:23:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.223+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T17:23:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.223+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.223+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T17:23:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.223+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T17:23:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.223+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.224+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T17:23:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.224+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T17:23:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.224+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.224+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T17:23:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.224+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T17:23:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.224+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.224+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T17:23:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.224+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T17:23:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.224+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.225+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T17:23:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.225+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T17:23:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.225+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.225+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T17:23:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.225+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T17:23:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.225+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.225+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T17:23:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.225+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T17:23:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.225+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.226+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T17:23:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.226+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T17:23:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.226+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.226+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T17:23:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.226+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T17:23:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.226+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.226+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T17:23:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.226+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T17:23:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.226+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.226+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T17:23:48.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.226+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T17:23:48.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.226+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.227+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T17:23:48.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.227+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T17:23:48.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.227+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.227+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T17:23:48.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.227+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T17:23:48.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.227+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.227+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T17:23:48.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.227+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T17:23:48.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.227+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.228+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T17:23:48.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.228+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T17:23:48.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.228+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.228+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T17:23:48.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.228+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T17:23:48.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.228+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.228+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T17:23:48.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.228+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T17:23:48.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.228+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.228+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T17:23:48.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.228+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T17:23:48.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.228+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.229+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T17:23:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.229+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T17:23:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.229+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.229+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T17:23:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.229+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T17:23:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.229+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.229+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T17:23:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.229+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T17:23:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.229+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.229+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T17:23:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.229+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T17:23:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.229+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.230+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T17:23:48.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.230+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T17:23:48.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.230+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.230+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T17:23:48.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.230+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T17:23:48.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.230+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.230+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T17:23:48.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.230+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T17:23:48.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.230+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.230+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T17:23:48.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.230+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T17:23:48.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.230+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.231+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T17:23:48.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.231+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T17:23:48.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.231+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.231+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T17:23:48.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.231+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T17:23:48.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.231+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.232+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T17:23:48.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.232+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T17:23:48.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.232+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.232+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T17:23:48.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.232+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T17:23:48.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.232+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.232+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T17:23:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.232+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T17:23:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.232+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.232+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T17:23:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.232+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T17:23:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.232+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.233+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T17:23:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.233+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T17:23:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.233+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.233+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T17:23:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.233+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T17:23:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.233+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.233+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T17:23:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.233+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T17:23:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.233+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.233+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T17:23:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.233+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T17:23:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.233+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.234+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T17:23:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.234+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T17:23:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.234+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.234+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T17:23:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.234+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T17:23:48.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.234+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.234+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T17:23:48.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.234+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T17:23:48.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.234+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.234+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T17:23:48.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.234+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T17:23:48.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.234+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.235+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T17:23:48.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.235+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T17:23:48.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.235+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.235+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T17:23:48.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.235+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T17:23:48.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.235+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.235+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T17:23:48.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.235+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T17:23:48.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.235+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.236+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T17:23:48.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.236+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T17:23:48.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.236+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.236+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T17:23:48.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.236+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T17:23:48.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.236+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.236+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T17:23:48.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.236+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T17:23:48.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.236+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.236+0000 7f87fb508800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T17:23:48.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.236+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T17:23:48.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.238+0000 7f87fb508800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:23:48.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.241+0000 7f86ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:48.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.242+0000 7f87fb508800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:48.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:48.242+0000 7f87fb508800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:51.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.174+0000 7f87fb508800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T17:23:51.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.174+0000 7f87fb508800 5 note: GC not initialized 2024-09-12T17:23:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.174+0000 7f87fb508800 20 init_complete bucket index max shards: 11 2024-09-12T17:23:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.174+0000 7f86aa7e4640 20 reqs_thread_entry: start 2024-09-12T17:23:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.175+0000 7f87fb508800 20 Filter name: none 2024-09-12T17:23:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.175+0000 7f86a37fe640 20 reqs_thread_entry: start 2024-09-12T17:23:51.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.205+0000 7f86ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:51.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.208+0000 7f87fb508800 20 remove_watcher() i=0 2024-09-12T17:23:51.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.208+0000 7f87fb508800 2 removed watcher, disabling cache 2024-09-12T17:23:51.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.209+0000 7f87fb508800 20 remove_watcher() i=1 2024-09-12T17:23:51.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.211+0000 7f87fb508800 20 remove_watcher() i=2 2024-09-12T17:23:51.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.212+0000 7f87fb508800 20 remove_watcher() i=3 2024-09-12T17:23:51.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.214+0000 7f87fb508800 20 remove_watcher() i=4 2024-09-12T17:23:51.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.215+0000 7f87fb508800 20 remove_watcher() i=5 2024-09-12T17:23:51.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.216+0000 7f87fb508800 20 remove_watcher() i=6 2024-09-12T17:23:51.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.217+0000 7f87fb508800 20 remove_watcher() i=7 2024-09-12T17:23:51.240 INFO:teuthology.orchestra.run.smithi044.stdout:[] 2024-09-12T17:23:51.240 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:23:51.241 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:23:51.241 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:23:51.241 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T17:23:51.311 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:51.311 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:51.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.339+0000 7fb79db2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:51.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.339+0000 7fb79db2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:51.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.343+0000 7fb5d77fe640 20 reqs_thread_entry: start 2024-09-12T17:23:51.362 INFO:teuthology.orchestra.run.smithi044.stdout:{"id":"fe33886c-9948-4f8e-85ed-a04bdce9353e","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:23:51.362 DEBUG:tasks.util.rgw: json result: {'id': 'fe33886c-9948-4f8e-85ed-a04bdce9353e', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:23:51.362 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:23:51.362 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:23:51.362 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:23:51.419 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:51.420 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:51.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.454+0000 7f221ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.456+0000 7f221ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.456+0000 7f221ed75800 20 realm 2024-09-12T17:23:51.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.456+0000 7f221ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.457+0000 7f221ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.457+0000 7f221ed75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:51.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.457+0000 7f221ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.457+0000 7f221ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.457+0000 7f221ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.458+0000 7f221ed75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:51.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.458+0000 7f221ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.458+0000 7f221ed75800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:23:51.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.458+0000 7f221ed75800 20 searching for the correct realm 2024-09-12T17:23:51.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.461+0000 7f221d060640 0 -- 172.21.15.44:0/2842470060 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f220802b070 msgr2=0x7f220802d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:51.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.465+0000 7f221c85f640 0 -- 172.21.15.44:0/2842470060 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f2208048920 msgr2=0x7f2208022450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:23:51.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.671+0000 7f221ed75800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:23:51.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.671+0000 7f221ed75800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:23:51.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.671+0000 7f221ed75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:51.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.671+0000 7f221ed75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:51.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.671+0000 7f221ed75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:51.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.671+0000 7f221ed75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:51.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.671+0000 7f221ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.672+0000 7f221ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.672+0000 7f221ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.672+0000 7f221ed75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:51.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.672+0000 7f221ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.672+0000 7f221ed75800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:23:51.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.673+0000 7f221ed75800 20 zone default found 2024-09-12T17:23:51.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.673+0000 7f221ed75800 4 Realm: () 2024-09-12T17:23:51.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.673+0000 7f221ed75800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:23:51.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.673+0000 7f221ed75800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:23:51.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.673+0000 7f221ed75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:51.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.673+0000 7f221ed75800 20 zonegroup default 2024-09-12T17:23:51.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.673+0000 7f221ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.673+0000 7f221ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.673+0000 7f221ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.673+0000 7f221ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.673+0000 7f221ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.674+0000 7f221ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.674+0000 7f221ed75800 20 started sync module instance, tier type = 2024-09-12T17:23:51.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.674+0000 7f221ed75800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:23:51.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.692+0000 7f221ed75800 20 add_watcher() i=0 2024-09-12T17:23:51.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.692+0000 7f221ed75800 20 add_watcher() i=1 2024-09-12T17:23:51.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.692+0000 7f221ed75800 20 add_watcher() i=2 2024-09-12T17:23:51.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.692+0000 7f221ed75800 20 add_watcher() i=3 2024-09-12T17:23:51.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.692+0000 7f221ed75800 20 add_watcher() i=4 2024-09-12T17:23:51.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.692+0000 7f221ed75800 20 add_watcher() i=5 2024-09-12T17:23:51.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.692+0000 7f221ed75800 20 add_watcher() i=6 2024-09-12T17:23:51.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.694+0000 7f221ed75800 20 add_watcher() i=7 2024-09-12T17:23:51.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.694+0000 7f221ed75800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:51.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.696+0000 7f20d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:51.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.696+0000 7f221ed75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:51.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.696+0000 7f221ed75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:51.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.697+0000 7f221ed75800 5 note: GC not initialized 2024-09-12T17:23:51.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.697+0000 7f20d1fe3640 20 reqs_thread_entry: start 2024-09-12T17:23:51.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.697+0000 7f221ed75800 20 init_complete bucket index max shards: 11 2024-09-12T17:23:51.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.697+0000 7f221ed75800 20 Filter name: none 2024-09-12T17:23:51.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.697+0000 7f20437fe640 20 reqs_thread_entry: start 2024-09-12T17:23:51.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.708+0000 7f20d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:51.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.710+0000 7f221ed75800 20 remove_watcher() i=0 2024-09-12T17:23:51.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.710+0000 7f221ed75800 2 removed watcher, disabling cache 2024-09-12T17:23:51.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.711+0000 7f221ed75800 20 remove_watcher() i=1 2024-09-12T17:23:51.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.712+0000 7f221ed75800 20 remove_watcher() i=2 2024-09-12T17:23:51.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.714+0000 7f221ed75800 20 remove_watcher() i=3 2024-09-12T17:23:51.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.715+0000 7f221ed75800 20 remove_watcher() i=4 2024-09-12T17:23:51.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.716+0000 7f221ed75800 20 remove_watcher() i=5 2024-09-12T17:23:51.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.718+0000 7f221ed75800 20 remove_watcher() i=6 2024-09-12T17:23:51.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.719+0000 7f221ed75800 20 remove_watcher() i=7 2024-09-12T17:23:51.731 INFO:teuthology.orchestra.run.smithi044.stdout:[] 2024-09-12T17:23:51.731 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:23:51.731 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T17:23:51.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T17:23:51.732 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T17:23:51.795 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:51.796 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:51.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.821+0000 7fcc5fd2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:51.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.821+0000 7fcc5fd2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:51.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:51.825+0000 7fcac9ffb640 20 reqs_thread_entry: start 2024-09-12T17:23:51.842 INFO:teuthology.orchestra.run.smithi044.stdout:{"id":"fe33886c-9948-4f8e-85ed-a04bdce9353e","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:23:51.843 DEBUG:tasks.util.rgw: json result: {'id': 'fe33886c-9948-4f8e-85ed-a04bdce9353e', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:23:51.843 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-12T17:23:51.843 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p /tmp/rgw_datacache 2024-09-12T17:23:51.873 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-12T17:23:51.953 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:23:51.953 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:23:51.954 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:23:52.052 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:52.053 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:52.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.087+0000 7fbb35b20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.089+0000 7fbb35b20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.089+0000 7fbb35b20800 20 realm 2024-09-12T17:23:52.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.089+0000 7fbb35b20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.089+0000 7fbb35b20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.089+0000 7fbb35b20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:52.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.089+0000 7fbb35b20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.089+0000 7fbb35b20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.089+0000 7fbb35b20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.090+0000 7fbb35b20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:52.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.090+0000 7fbb35b20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.091+0000 7fbb35b20800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:23:52.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.091+0000 7fbb35b20800 20 searching for the correct realm 2024-09-12T17:23:52.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.095+0000 7fbb30f01640 0 -- 172.21.15.44:0/2525338529 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x5592bbb6bea0 msgr2=0x5592bbb6e290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:52.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.099+0000 7fbb31702640 0 -- 172.21.15.44:0/2525338529 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fbb28019410 msgr2=0x7fbb28019890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:52.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.103+0000 7fbb35b20800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:23:52.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.103+0000 7fbb35b20800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:23:52.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.103+0000 7fbb35b20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:52.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.103+0000 7fbb35b20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:52.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.103+0000 7fbb35b20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:52.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.103+0000 7fbb35b20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:52.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.103+0000 7fbb35b20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.103+0000 7fbb35b20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.103+0000 7fbb35b20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.104+0000 7fbb35b20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.104+0000 7fbb35b20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.104+0000 7fbb35b20800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:23:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.104+0000 7fbb35b20800 20 zone default found 2024-09-12T17:23:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.104+0000 7fbb35b20800 4 Realm: () 2024-09-12T17:23:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.104+0000 7fbb35b20800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:23:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.104+0000 7fbb35b20800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:23:52.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.104+0000 7fbb35b20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:52.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.104+0000 7fbb35b20800 20 zonegroup default 2024-09-12T17:23:52.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.104+0000 7fbb35b20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.104+0000 7fbb35b20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.104+0000 7fbb35b20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.105+0000 7fbb35b20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.105+0000 7fbb35b20800 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.105+0000 7fbb35b20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.105+0000 7fbb35b20800 20 started sync module instance, tier type = 2024-09-12T17:23:52.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.105+0000 7fbb35b20800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:23:52.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.121+0000 7fbb35b20800 20 add_watcher() i=0 2024-09-12T17:23:52.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.121+0000 7fbb35b20800 20 add_watcher() i=1 2024-09-12T17:23:52.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.121+0000 7fbb35b20800 20 add_watcher() i=2 2024-09-12T17:23:52.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.121+0000 7fbb35b20800 20 add_watcher() i=3 2024-09-12T17:23:52.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.121+0000 7fbb35b20800 20 add_watcher() i=4 2024-09-12T17:23:52.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.121+0000 7fbb35b20800 20 add_watcher() i=5 2024-09-12T17:23:52.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.121+0000 7fbb35b20800 20 add_watcher() i=6 2024-09-12T17:23:52.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.121+0000 7fbb35b20800 20 add_watcher() i=7 2024-09-12T17:23:52.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.121+0000 7fbb35b20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:52.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.123+0000 7fb9e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:52.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.123+0000 7fbb35b20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:52.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.123+0000 7fbb35b20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:52.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.123+0000 7fbb35b20800 5 note: GC not initialized 2024-09-12T17:23:52.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.124+0000 7fb9e67e4640 20 reqs_thread_entry: start 2024-09-12T17:23:52.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.124+0000 7fbb35b20800 20 init_complete bucket index max shards: 11 2024-09-12T17:23:52.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.124+0000 7fbb35b20800 20 Filter name: none 2024-09-12T17:23:52.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.124+0000 7fb957fff640 20 reqs_thread_entry: start 2024-09-12T17:23:52.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.134+0000 7fb9e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:52.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.136+0000 7fbb35b20800 20 remove_watcher() i=0 2024-09-12T17:23:52.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.136+0000 7fbb35b20800 2 removed watcher, disabling cache 2024-09-12T17:23:52.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.138+0000 7fbb35b20800 20 remove_watcher() i=1 2024-09-12T17:23:52.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.139+0000 7fbb35b20800 20 remove_watcher() i=2 2024-09-12T17:23:52.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.140+0000 7fbb35b20800 20 remove_watcher() i=3 2024-09-12T17:23:52.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.141+0000 7fbb35b20800 20 remove_watcher() i=4 2024-09-12T17:23:52.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.142+0000 7fbb35b20800 20 remove_watcher() i=5 2024-09-12T17:23:52.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.143+0000 7fbb35b20800 20 remove_watcher() i=6 2024-09-12T17:23:52.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.144+0000 7fbb35b20800 20 remove_watcher() i=7 2024-09-12T17:23:52.158 INFO:teuthology.orchestra.run.smithi044.stdout:[] 2024-09-12T17:23:52.158 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:23:52.158 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T17:23:52.158 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:23:52.158 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:23:52.158 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T17:23:52.223 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:52.223 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:52.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.249+0000 7fe92410a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:52.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.249+0000 7fe92410a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:52.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.254+0000 7fe757fff640 20 reqs_thread_entry: start 2024-09-12T17:23:52.270 INFO:teuthology.orchestra.run.smithi044.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T17:23:52.271 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T17:23:52.271 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:23:52.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:23:52.271 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T17:23:52.339 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:52.339 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:52.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.365+0000 7fb0f2640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:52.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.365+0000 7fb0f2640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:52.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.369+0000 7faf5e7fc640 20 reqs_thread_entry: start 2024-09-12T17:23:52.386 INFO:teuthology.orchestra.run.smithi044.stdout:{"id":"fe33886c-9948-4f8e-85ed-a04bdce9353e","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:23:52.386 DEBUG:tasks.util.rgw: json result: {'id': 'fe33886c-9948-4f8e-85ed-a04bdce9353e', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:23:52.386 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T17:23:52.387 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:23:52.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:23:52.387 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T17:23:52.450 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:52.451 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:52.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.477+0000 7f67f9298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:52.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.477+0000 7f67f9298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:52.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.481+0000 7f66b97e2640 20 reqs_thread_entry: start 2024-09-12T17:23:52.496 INFO:teuthology.orchestra.run.smithi044.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T17:23:52.497 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T17:23:52.497 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:23:52.497 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:23:52.497 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T17:23:52.563 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:52.564 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:52.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.590+0000 7fe66a725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:52.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.590+0000 7fe66a725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:52.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:23:52.594+0000 7fe528fe1640 20 reqs_thread_entry: start 2024-09-12T17:23:52.611 INFO:teuthology.orchestra.run.smithi044.stdout:{"id":"fe33886c-9948-4f8e-85ed-a04bdce9353e","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:23:52.611 DEBUG:tasks.util.rgw: json result: {'id': 'fe33886c-9948-4f8e-85ed-a04bdce9353e', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:23:52.611 INFO:tasks.rgw:Starting rgw... 2024-09-12T17:23:52.611 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-12T17:23:52.611 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T17:23:52.612 DEBUG:teuthology.orchestra.run.smithi044:> sudo echo -n http://smithi044.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T17:23:52.653 INFO:teuthology.orchestra.run.smithi044.stdout:http://smithi044.front.sepia.ceph.com:80 2024-09-12T17:23:52.653 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T17:23:52.734 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T17:23:52.734 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T17:23:52.776 INFO:tasks.rgw.client.0:Started 2024-09-12T17:23:52.776 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi044.front.sepia.ceph.com:80/ 2024-09-12T17:23:52.776 DEBUG:teuthology.orchestra.run.smithi044:> curl http://smithi044.front.sepia.ceph.com:80/ 2024-09-12T17:23:52.821 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:23:52.822 INFO:teuthology.orchestra.run.smithi044.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:23:52.822 INFO:teuthology.orchestra.run.smithi044.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:23:52.822 INFO:teuthology.orchestra.run.smithi044.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:23:52.822 INFO:teuthology.orchestra.run.smithi044.stderr:curl: (7) Failed to connect to smithi044.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:23:53.823 DEBUG:teuthology.orchestra.run.smithi044:> curl http://smithi044.front.sepia.ceph.com:80/ 2024-09-12T17:23:53.857 INFO:teuthology.orchestra.run.smithi044.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:23:53.858 INFO:teuthology.orchestra.run.smithi044.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:23:53.859 INFO:teuthology.orchestra.run.smithi044.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 182k 2024-09-12T17:23:53.859 INFO:teuthology.orchestra.run.smithi044.stdout:anonymous 2024-09-12T17:23:53.860 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T17:23:53.873 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T17:23:53.874 DEBUG:teuthology.orchestra.run.smithi044:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T17:23:56.297 DEBUG:teuthology.orchestra.run.smithi044:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T17:23:56.828 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting tox==3.15.0 2024-09-12T17:23:56.880 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T17:23:57.004 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting six<2,>=1.14.0 2024-09-12T17:23:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:23:57.125 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting packaging>=14 2024-09-12T17:23:57.140 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T17:23:57.243 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting py<2,>=1.4.17 2024-09-12T17:23:57.258 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T17:23:57.354 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T17:23:57.368 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T17:23:57.450 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting toml>=0.9.4 2024-09-12T17:23:57.465 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T17:23:57.578 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T17:23:57.593 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T17:23:57.859 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T17:23:57.875 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T17:23:58.156 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T17:23:58.171 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T17:23:58.257 INFO:teuthology.orchestra.run.smithi044.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T17:23:58.273 INFO:teuthology.orchestra.run.smithi044.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T17:23:58.406 INFO:teuthology.orchestra.run.smithi044.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-12T17:23:59.264 INFO:teuthology.orchestra.run.smithi044.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T17:23:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-12T17:23:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-12T17:23:59.554 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:23:59.572 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:23:59.572 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:23:59.572 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:23:59.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:23:59.602 INFO:teuthology.orchestra.run.smithi044.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:23:59.602 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:23:59.672 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:23:59.672 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:23:59.742 INFO:tasks.workunit:timeout=3h 2024-09-12T17:23:59.742 INFO:tasks.workunit:cleanup=True 2024-09-12T17:23:59.743 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:23:59.813 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:24:59.401 INFO:tasks.workunit.client.0.smithi044.stderr:Updating files: 90% (11477/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:25:00.090 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:25:00.090 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:25:00.090 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:25:00.090 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:25:00.090 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:25:00.090 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:25:00.090 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:25:00.091 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:25:00.091 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:25:00.091 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2024-09-12T17:25:00.091 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:25:00.091 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2024-09-12T17:25:00.091 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:25:00.091 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2024-09-12T17:25:00.091 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:25:00.091 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:25:00.091 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:25:00.091 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:25:00.095 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:25:00.176 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:25:00.179 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:25:00.179 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:25:00.765 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:25:00.824 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:25:00.864 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:25:00.866 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:25:00.866 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:25:00.905 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:25:00.909 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:25:00.909 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:25:00.980 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-12T17:25:00.981 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-12T17:25:00.981 DEBUG:teuthology.orchestra.run.smithi044:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T17:25:01.054 INFO:tasks.workunit.client.0.smithi044.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T17:25:01.054 INFO:tasks.workunit.client.0.smithi044.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:25:01.054 INFO:tasks.workunit.client.0.smithi044.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:25:03.461 INFO:tasks.workunit.client.0.smithi044.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:25:03.461 INFO:tasks.workunit.client.0.smithi044.stderr:++ deactivate nondestructive 2024-09-12T17:25:03.461 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2024-09-12T17:25:03.461 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2024-09-12T17:25:03.461 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:25:03.462 INFO:tasks.workunit.client.0.smithi044.stderr:++ hash -r 2024-09-12T17:25:03.462 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2024-09-12T17:25:03.462 INFO:tasks.workunit.client.0.smithi044.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:25:03.462 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:25:03.462 INFO:tasks.workunit.client.0.smithi044.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:25:03.462 INFO:tasks.workunit.client.0.smithi044.stderr:++ export VIRTUAL_ENV 2024-09-12T17:25:03.462 INFO:tasks.workunit.client.0.smithi044.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:25:03.463 INFO:tasks.workunit.client.0.smithi044.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:25:03.463 INFO:tasks.workunit.client.0.smithi044.stderr:++ export PATH 2024-09-12T17:25:03.463 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2024-09-12T17:25:03.463 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -z '' ']' 2024-09-12T17:25:03.464 INFO:tasks.workunit.client.0.smithi044.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:25:03.464 INFO:tasks.workunit.client.0.smithi044.stderr:++ PS1='(rgw) ' 2024-09-12T17:25:03.464 INFO:tasks.workunit.client.0.smithi044.stderr:++ export PS1 2024-09-12T17:25:03.464 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:25:03.464 INFO:tasks.workunit.client.0.smithi044.stderr:++ hash -r 2024-09-12T17:25:03.464 INFO:tasks.workunit.client.0.smithi044.stderr:+ pip install pip --upgrade 2024-09-12T17:25:03.702 INFO:tasks.workunit.client.0.smithi044.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:25:03.883 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting pip 2024-09-12T17:25:03.934 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:25:04.087 INFO:tasks.workunit.client.0.smithi044.stdout:Installing collected packages: pip 2024-09-12T17:25:04.087 INFO:tasks.workunit.client.0.smithi044.stdout: Attempting uninstall: pip 2024-09-12T17:25:04.087 INFO:tasks.workunit.client.0.smithi044.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:25:04.262 INFO:tasks.workunit.client.0.smithi044.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:25:04.267 INFO:tasks.workunit.client.0.smithi044.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:25:05.042 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully installed pip-24.2 2024-09-12T17:25:05.275 INFO:tasks.workunit.client.0.smithi044.stderr:+ pip install configobj 2024-09-12T17:25:05.663 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting configobj 2024-09-12T17:25:05.709 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-12T17:25:05.836 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting six (from configobj) 2024-09-12T17:25:05.851 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:25:05.905 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-12T17:25:05.962 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:25:06.009 INFO:tasks.workunit.client.0.smithi044.stdout:Installing collected packages: six, configobj 2024-09-12T17:25:06.134 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-12T17:25:06.185 INFO:tasks.workunit.client.0.smithi044.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-12T17:25:06.218 INFO:tasks.workunit.client.0.smithi044.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-12T17:25:06.218 INFO:tasks.workunit.client.0.smithi044.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-12T17:25:06.220 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:command succeeded 2024-09-12T17:25:06.220 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-12T17:25:06.220 INFO:tasks.workunit.client.0.smithi044.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:25:06.220 INFO:tasks.workunit.client.0.smithi044.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-12T17:25:06.264 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:command succeeded 2024-09-12T17:25:06.264 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:b'tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 45179/radosgw \ntcp6 0 0 :::80 :::* LISTEN 45179/radosgw \n' 2024-09-12T17:25:06.264 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:radosgw port: 80 2024-09-12T17:25:06.265 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-12T17:25:06.265 INFO:tasks.workunit.client.0.smithi044.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-12T17:25:06.287 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:command succeeded 2024-09-12T17:25:06.287 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:b'' 2024-09-12T17:25:06.287 INFO:tasks.workunit.client.0.smithi044.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-12T17:25:06.630 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:command succeeded 2024-09-12T17:25:06.630 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-12T17:25:06.600719Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-12T17:25:06.600702Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-12T17:25:06.631 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:Creating s3cmd config... 2024-09-12T17:25:06.631 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:proto for s3cmd config is http 2024-09-12T17:25:06.631 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:s3cmd config written 2024-09-12T17:25:06.631 INFO:tasks.workunit.client.0.smithi044.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-12T17:25:06.771 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:command succeeded 2024-09-12T17:25:06.771 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-12T17:25:06.771 INFO:tasks.workunit.client.0.smithi044.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-12T17:25:06.998 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:command succeeded 2024-09-12T17:25:06.999 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 0.1 seconds, 80.59 MB/s) [1 of 1]\n" 2024-09-12T17:25:06.999 INFO:tasks.workunit.client.0.smithi044.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-12T17:25:07.157 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:command succeeded 2024-09-12T17:25:07.157 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.0 seconds, 238.88 MB/s)\n" 2024-09-12T17:25:07.158 INFO:tasks.workunit.client.0.smithi044.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-12T17:25:07.487 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:command succeeded 2024-09-12T17:25:07.487 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340376,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "snappy",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4194500\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4194500,\n "len": 3145876\n }\n ]\n },\n "etag": "4c2dd28dfae93ecae116b799b962dffa",\n "tag": "fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7805175216731972424",\n "manifest": {\n "objs": [],\n "obj_size": 7340376,\n "explicit_objs": false,\n "head_size": 0,\n "max_head_size": 0,\n "prefix": ".BE_mOZGn0MdpaMrzPekFck-PBd_Yqjg_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 0,\n "part_size": 0,\n "stripe_max_size": 6291456,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1",\n "bucket_id": "fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 6291456,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1",\n "bucket_id": "fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".BE_mOZGn0MdpaMrzPekFck-PBd_Yqjg_0",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 0,\n "stripe_ofs": 6291456,\n "ofs": 7340376,\n "stripe_size": 1048920,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1",\n "bucket_id": "fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".BE_mOZGn0MdpaMrzPekFck-PBd_Yqjg_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-12T17:25:06.979901Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7805175216731972424",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726161906/ctime:1726161906/gid:1333/gname:ubuntu/md5:4c2dd28dfae93ecae116b799b962dffa/mode:33188/mtime:1726161906/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-12T17:25:07.487 INFO:tasks.workunit.client.0.smithi044.stderr:DEBUG:root:Cached object name is: .BE_mOZGn0MdpaMrzPekFck-PBd_Yqjg_ 2024-09-12T17:25:07.487 INFO:tasks.workunit.client.0.smithi044.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-12T17:25:07.504 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:command succeeded 2024-09-12T17:25:07.504 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:b'0\n' 2024-09-12T17:25:07.504 INFO:tasks.workunit.client.0.smithi044.stderr:DEBUG:root:Check cache dir content: 0 2024-09-12T17:25:07.504 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-12T17:25:07.504 INFO:tasks.workunit.client.0.smithi044.stderr:INFO:root:Completed Datacache tests 2024-09-12T17:25:07.509 INFO:tasks.workunit.client.0.smithi044.stderr:+ deactivate 2024-09-12T17:25:07.510 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T17:25:07.510 INFO:tasks.workunit.client.0.smithi044.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:25:07.510 INFO:tasks.workunit.client.0.smithi044.stderr:+ export PATH 2024-09-12T17:25:07.510 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:25:07.510 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n '' ']' 2024-09-12T17:25:07.510 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:25:07.510 INFO:tasks.workunit.client.0.smithi044.stderr:+ hash -r 2024-09-12T17:25:07.510 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n '' ']' 2024-09-12T17:25:07.510 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:25:07.510 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:25:07.510 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset -f deactivate 2024-09-12T17:25:07.510 INFO:tasks.workunit.client.0.smithi044.stderr:+ echo OK. 2024-09-12T17:25:07.511 INFO:tasks.workunit.client.0.smithi044.stdout:OK. 2024-09-12T17:25:07.511 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:25:07.512 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:25:07.594 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-12T17:25:07.594 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:25:07.930 DEBUG:teuthology.parallel:result is None 2024-09-12T17:25:07.930 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:25:07.971 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:25:07.971 DEBUG:teuthology.orchestra.run.smithi044:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:25:08.046 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:25:08.046 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:25:08.061 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:25:08.061 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:25:08.061 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:25:08.116 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:25:08.116 INFO:teuthology.orchestra.run.smithi044.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:25:08.117 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:25:08.187 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:25:08.187 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:25:08.257 INFO:tasks.workunit:timeout=3h 2024-09-12T17:25:08.257 INFO:tasks.workunit:cleanup=True 2024-09-12T17:25:08.258 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:25:08.328 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:26:08.022 INFO:tasks.workunit.client.0.smithi044.stderr:Updating files: 90% (11486/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:26:08.357 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:26:08.357 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:08.357 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:26:08.357 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:26:08.357 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:26:08.357 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:08.357 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:26:08.357 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:26:08.357 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:08.358 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2024-09-12T17:26:08.358 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:08.358 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2024-09-12T17:26:08.358 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:08.358 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2024-09-12T17:26:08.358 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:08.358 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:26:08.358 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:08.358 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:26:08.362 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:26:08.432 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:26:08.434 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:26:08.435 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:26:08.484 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:26:08.534 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:26:08.574 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:26:08.576 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:26:08.576 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:26:08.617 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:26:08.620 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:26:08.620 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:26:08.691 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T17:26:08.692 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T17:26:08.692 DEBUG:teuthology.orchestra.run.smithi044:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:26:08.765 INFO:tasks.workunit.client.0.smithi044.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:26:08.766 INFO:tasks.workunit.client.0.smithi044.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:26:08.766 INFO:tasks.workunit.client.0.smithi044.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:26:11.123 INFO:tasks.workunit.client.0.smithi044.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:26:11.123 INFO:tasks.workunit.client.0.smithi044.stderr:++ deactivate nondestructive 2024-09-12T17:26:11.123 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2024-09-12T17:26:11.123 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2024-09-12T17:26:11.123 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:26:11.123 INFO:tasks.workunit.client.0.smithi044.stderr:++ hash -r 2024-09-12T17:26:11.123 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2024-09-12T17:26:11.124 INFO:tasks.workunit.client.0.smithi044.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:26:11.124 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:26:11.124 INFO:tasks.workunit.client.0.smithi044.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:26:11.124 INFO:tasks.workunit.client.0.smithi044.stderr:++ export VIRTUAL_ENV 2024-09-12T17:26:11.125 INFO:tasks.workunit.client.0.smithi044.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:26:11.125 INFO:tasks.workunit.client.0.smithi044.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:26:11.125 INFO:tasks.workunit.client.0.smithi044.stderr:++ export PATH 2024-09-12T17:26:11.125 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2024-09-12T17:26:11.125 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -z '' ']' 2024-09-12T17:26:11.125 INFO:tasks.workunit.client.0.smithi044.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:26:11.125 INFO:tasks.workunit.client.0.smithi044.stderr:++ PS1='(rgw) ' 2024-09-12T17:26:11.126 INFO:tasks.workunit.client.0.smithi044.stderr:++ export PS1 2024-09-12T17:26:11.126 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:26:11.126 INFO:tasks.workunit.client.0.smithi044.stderr:++ hash -r 2024-09-12T17:26:11.126 INFO:tasks.workunit.client.0.smithi044.stderr:+ pip install pip --upgrade 2024-09-12T17:26:11.362 INFO:tasks.workunit.client.0.smithi044.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:26:11.545 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting pip 2024-09-12T17:26:11.551 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:26:11.598 INFO:tasks.workunit.client.0.smithi044.stdout:Installing collected packages: pip 2024-09-12T17:26:11.598 INFO:tasks.workunit.client.0.smithi044.stdout: Attempting uninstall: pip 2024-09-12T17:26:11.598 INFO:tasks.workunit.client.0.smithi044.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:26:11.762 INFO:tasks.workunit.client.0.smithi044.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:26:11.768 INFO:tasks.workunit.client.0.smithi044.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:26:12.542 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully installed pip-24.2 2024-09-12T17:26:12.590 INFO:tasks.workunit.client.0.smithi044.stderr:+ pip install boto3 2024-09-12T17:26:13.474 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting boto3 2024-09-12T17:26:13.516 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:26:14.216 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:26:14.230 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:26:14.362 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:26:14.375 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:26:14.484 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:26:14.497 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:26:14.603 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:26:14.617 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:26:14.773 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:26:14.788 INFO:tasks.workunit.client.0.smithi044.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:26:15.010 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:26:15.011 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:26:15.031 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:26:15.124 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:26:15.332 INFO:tasks.workunit.client.0.smithi044.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 63.5 MB/s eta 0:00:00 2024-09-12T17:26:15.346 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:26:15.410 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:26:15.477 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:26:15.544 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:26:15.599 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:26:15.676 INFO:tasks.workunit.client.0.smithi044.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:26:16.735 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:26:16.850 INFO:tasks.workunit.client.0.smithi044.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T17:26:16.996 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T17:26:17.032 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:17.032 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:17.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.072+0000 7fdf67315800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.074+0000 7fdf67315800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.074+0000 7fdf67315800 20 realm 2024-09-12T17:26:17.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.074+0000 7fdf67315800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.074+0000 7fdf67315800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.074+0000 7fdf67315800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:17.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.074+0000 7fdf67315800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.074+0000 7fdf67315800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.074+0000 7fdf67315800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.075+0000 7fdf67315800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:17.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.075+0000 7fdf67315800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.076+0000 7fdf67315800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:17.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.076+0000 7fdf67315800 20 searching for the correct realm 2024-09-12T17:26:17.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.080+0000 7fdf645fe640 0 -- 172.21.15.44:0/3267985150 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fdf54082120 msgr2=0x7fdf5400d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:17.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.083+0000 7fdf65600640 0 -- 172.21.15.44:0/3267985150 >> [v2:172.21.15.181:6810/2228110208,v1:172.21.15.181:6811/2228110208] conn(0x7fdf58048040 msgr2=0x7fdf58048930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:17.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.087+0000 7fdf67315800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:17.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.087+0000 7fdf67315800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:17.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.087+0000 7fdf67315800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:17.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.087+0000 7fdf67315800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:17.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.087+0000 7fdf67315800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:17.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.087+0000 7fdf67315800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:17.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.087+0000 7fdf67315800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.087+0000 7fdf67315800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.087+0000 7fdf67315800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.088+0000 7fdf67315800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:17.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.088+0000 7fdf67315800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.088+0000 7fdf67315800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:17.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.088+0000 7fdf67315800 20 zone default found 2024-09-12T17:26:17.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.088+0000 7fdf67315800 4 Realm: () 2024-09-12T17:26:17.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.088+0000 7fdf67315800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:17.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.088+0000 7fdf67315800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:17.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.088+0000 7fdf67315800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:17.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.088+0000 7fdf67315800 20 zonegroup default 2024-09-12T17:26:17.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.088+0000 7fdf67315800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.088+0000 7fdf67315800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.088+0000 7fdf67315800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.089+0000 7fdf67315800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.089+0000 7fdf67315800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.089+0000 7fdf67315800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.089+0000 7fdf67315800 20 started sync module instance, tier type = 2024-09-12T17:26:17.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.089+0000 7fdf67315800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:17.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.100+0000 7fdf67315800 20 add_watcher() i=0 2024-09-12T17:26:17.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.100+0000 7fdf67315800 20 add_watcher() i=1 2024-09-12T17:26:17.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.100+0000 7fdf67315800 20 add_watcher() i=2 2024-09-12T17:26:17.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.100+0000 7fdf67315800 20 add_watcher() i=3 2024-09-12T17:26:17.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.100+0000 7fdf67315800 20 add_watcher() i=4 2024-09-12T17:26:17.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.100+0000 7fdf67315800 20 add_watcher() i=5 2024-09-12T17:26:17.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.100+0000 7fdf67315800 20 add_watcher() i=6 2024-09-12T17:26:17.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.101+0000 7fdf67315800 20 add_watcher() i=7 2024-09-12T17:26:17.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.101+0000 7fdf67315800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:17.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.103+0000 7fde1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:17.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.103+0000 7fdf67315800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:17.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.103+0000 7fdf67315800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:17.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.103+0000 7fdf67315800 5 note: GC not initialized 2024-09-12T17:26:17.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.103+0000 7fde1a7e4640 20 reqs_thread_entry: start 2024-09-12T17:26:17.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.103+0000 7fdf67315800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:17.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.103+0000 7fdf67315800 20 Filter name: none 2024-09-12T17:26:17.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.104+0000 7fde137fe640 20 reqs_thread_entry: start 2024-09-12T17:26:17.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.104+0000 7fdf67315800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T17:26:17.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.104+0000 7fdf67315800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.104+0000 7fdf67315800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.104+0000 7fdf67315800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T17:26:17.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.104+0000 7fdf67315800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:26:17.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.104+0000 7fdf67315800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T17:26:17.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.104+0000 7fdf67315800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.104+0000 7fdf67315800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.104+0000 7fdf67315800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T17:26:17.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.104+0000 7fdf67315800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:26:17.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.104+0000 7fdf67315800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:26:17.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.104+0000 7fdf67315800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:26:17.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.106+0000 7fdf67315800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:26:17.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.106+0000 7fdf67315800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:26:17.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.106+0000 7fdf67315800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T17:26:17.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.106+0000 7fde3bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789954 cookie 94074182126160 notifier 4589 bl.length()=593 2024-09-12T17:26:17.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.106+0000 7fde3bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:26:17.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.106+0000 7fde3bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:26:17.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.108+0000 7fdf67315800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:26:17.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.108+0000 7fdf67315800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:26:17.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.108+0000 7fdf67315800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T17:26:17.110 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.109+0000 7fde3bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789952 cookie 94074182118448 notifier 4589 bl.length()=186 2024-09-12T17:26:17.110 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.109+0000 7fde3bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:26:17.110 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.109+0000 7fde3bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:26:17.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.110+0000 7fde1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:17.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.113+0000 7fdf67315800 20 remove_watcher() i=0 2024-09-12T17:26:17.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.113+0000 7fdf67315800 2 removed watcher, disabling cache 2024-09-12T17:26:17.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.114+0000 7fdf67315800 20 remove_watcher() i=1 2024-09-12T17:26:17.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.117+0000 7fdf67315800 20 remove_watcher() i=2 2024-09-12T17:26:17.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.118+0000 7fdf67315800 20 remove_watcher() i=3 2024-09-12T17:26:17.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.119+0000 7fdf67315800 20 remove_watcher() i=4 2024-09-12T17:26:17.121 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.121+0000 7fdf67315800 20 remove_watcher() i=5 2024-09-12T17:26:17.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.122+0000 7fdf67315800 20 remove_watcher() i=6 2024-09-12T17:26:17.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.123+0000 7fdf67315800 20 remove_watcher() i=7 2024-09-12T17:26:17.451 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T17:26:17.451 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:17.453 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:26:17.484 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:17.484 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:17.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.523+0000 7f614d944800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.525+0000 7f614d944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.525+0000 7f614d944800 20 realm 2024-09-12T17:26:17.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.525+0000 7f614d944800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.525+0000 7f614d944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.525+0000 7f614d944800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:17.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.525+0000 7f614d944800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.525+0000 7f614d944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.525+0000 7f614d944800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.526+0000 7f614d944800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:17.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.526+0000 7f614d944800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.526+0000 7f614d944800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:17.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.526+0000 7f614d944800 20 searching for the correct realm 2024-09-12T17:26:17.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.529+0000 7f6149ef5640 0 -- 172.21.15.44:0/3637598234 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f61400af3e0 msgr2=0x7f61400a9d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:17.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.533+0000 7f61496f4640 0 -- 172.21.15.44:0/3637598234 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f61400b3dc0 msgr2=0x7f61400787c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:26:17.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.739+0000 7f614d944800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:17.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.739+0000 7f614d944800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:17.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.739+0000 7f614d944800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:17.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.739+0000 7f614d944800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:17.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.739+0000 7f614d944800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:17.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.739+0000 7f614d944800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:17.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.739+0000 7f614d944800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.740+0000 7f614d944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.740+0000 7f614d944800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.740+0000 7f614d944800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:17.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.740+0000 7f614d944800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.741+0000 7f614d944800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:17.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.741+0000 7f614d944800 20 zone default found 2024-09-12T17:26:17.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.741+0000 7f614d944800 4 Realm: () 2024-09-12T17:26:17.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.741+0000 7f614d944800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:17.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.741+0000 7f614d944800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:17.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.741+0000 7f614d944800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:17.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.741+0000 7f614d944800 20 zonegroup default 2024-09-12T17:26:17.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.741+0000 7f614d944800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.741+0000 7f614d944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.741+0000 7f614d944800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.741+0000 7f614d944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.741+0000 7f614d944800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.741+0000 7f614d944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.742+0000 7f614d944800 20 started sync module instance, tier type = 2024-09-12T17:26:17.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.742+0000 7f614d944800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:17.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.759+0000 7f614d944800 20 add_watcher() i=0 2024-09-12T17:26:17.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.759+0000 7f614d944800 20 add_watcher() i=1 2024-09-12T17:26:17.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.759+0000 7f614d944800 20 add_watcher() i=2 2024-09-12T17:26:17.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.759+0000 7f614d944800 20 add_watcher() i=3 2024-09-12T17:26:17.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.759+0000 7f614d944800 20 add_watcher() i=4 2024-09-12T17:26:17.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.759+0000 7f614d944800 20 add_watcher() i=5 2024-09-12T17:26:17.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.759+0000 7f614d944800 20 add_watcher() i=6 2024-09-12T17:26:17.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.760+0000 7f614d944800 20 add_watcher() i=7 2024-09-12T17:26:17.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.760+0000 7f614d944800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:17.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.762+0000 7f5fff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:17.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.762+0000 7f614d944800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:17.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.762+0000 7f614d944800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:17.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.762+0000 7f614d944800 5 note: GC not initialized 2024-09-12T17:26:17.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.763+0000 7f5ffe7e4640 20 reqs_thread_entry: start 2024-09-12T17:26:17.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.763+0000 7f614d944800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:17.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.763+0000 7f614d944800 20 Filter name: none 2024-09-12T17:26:17.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.763+0000 7f5f6ffff640 20 reqs_thread_entry: start 2024-09-12T17:26:17.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.763+0000 7f614d944800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:26:17.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.763+0000 7f614d944800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.763+0000 7f614d944800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:17.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.763+0000 7f614d944800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:26:17.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.763+0000 7f614d944800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:26:17.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.763+0000 7f614d944800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 : miss 2024-09-12T17:26:17.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.763+0000 7f614d944800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.764+0000 7f614d944800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:17.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.764+0000 7f614d944800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 info.flags=0x17 2024-09-12T17:26:17.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.764+0000 7f614d944800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 to cache LRU end 2024-09-12T17:26:17.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.764+0000 7f614d944800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:17.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.764+0000 7f614d944800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:26:17.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.764+0000 7f614d944800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 2024-09-12T17:26:17.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.765+0000 7f614d944800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:17.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.765+0000 7f614d944800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:17.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.766+0000 7f614d944800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:17.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.766+0000 7f614d944800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:17.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.767+0000 7f614d944800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:17.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.767+0000 7f614d944800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:17.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.768+0000 7f614d944800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:17.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.769+0000 7f614d944800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:17.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.769+0000 7f614d944800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:17.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.770+0000 7f614d944800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:17.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.771+0000 7f614d944800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:17.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.778+0000 7f5fff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:17.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.781+0000 7f614d944800 20 remove_watcher() i=0 2024-09-12T17:26:17.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.781+0000 7f614d944800 2 removed watcher, disabling cache 2024-09-12T17:26:17.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.782+0000 7f614d944800 20 remove_watcher() i=1 2024-09-12T17:26:17.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.784+0000 7f614d944800 20 remove_watcher() i=2 2024-09-12T17:26:17.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.785+0000 7f614d944800 20 remove_watcher() i=3 2024-09-12T17:26:17.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.786+0000 7f614d944800 20 remove_watcher() i=4 2024-09-12T17:26:17.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.787+0000 7f614d944800 20 remove_watcher() i=5 2024-09-12T17:26:17.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.789+0000 7f614d944800 20 remove_watcher() i=6 2024-09-12T17:26:17.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.790+0000 7f614d944800 20 remove_watcher() i=7 2024-09-12T17:26:17.803 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:26:17.833 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:17.833 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:17.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.872+0000 7fda63533800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.873+0000 7fda63533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.873+0000 7fda63533800 20 realm 2024-09-12T17:26:17.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.873+0000 7fda63533800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.873+0000 7fda63533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.873+0000 7fda63533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:17.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.873+0000 7fda63533800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.873+0000 7fda63533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.873+0000 7fda63533800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.874+0000 7fda63533800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:17.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.874+0000 7fda63533800 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.874+0000 7fda63533800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:17.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:17.874+0000 7fda63533800 20 searching for the correct realm 2024-09-12T17:26:18.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.079+0000 7fda57fff640 0 -- 172.21.15.44:0/3777752101 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fda5006d070 msgr2=0x7fda500c2a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:18.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.083+0000 7fda5f276640 0 -- 172.21.15.44:0/3777752101 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fda48022450 msgr2=0x7fda480228b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:18.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.289+0000 7fda63533800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:18.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.289+0000 7fda63533800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:18.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.289+0000 7fda63533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:18.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.289+0000 7fda63533800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:18.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.289+0000 7fda63533800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:18.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.289+0000 7fda63533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:18.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.289+0000 7fda63533800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.290+0000 7fda63533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:18.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.290+0000 7fda63533800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.290+0000 7fda63533800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:18.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.290+0000 7fda63533800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.290+0000 7fda63533800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:18.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.290+0000 7fda63533800 20 zone default found 2024-09-12T17:26:18.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.290+0000 7fda63533800 4 Realm: () 2024-09-12T17:26:18.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.290+0000 7fda63533800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:18.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.290+0000 7fda63533800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:18.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.290+0000 7fda63533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:18.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.290+0000 7fda63533800 20 zonegroup default 2024-09-12T17:26:18.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.290+0000 7fda63533800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.291+0000 7fda63533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:18.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.291+0000 7fda63533800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.291+0000 7fda63533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:18.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.291+0000 7fda63533800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.292+0000 7fda63533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:18.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.292+0000 7fda63533800 20 started sync module instance, tier type = 2024-09-12T17:26:18.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.292+0000 7fda63533800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:18.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.306+0000 7fda63533800 20 add_watcher() i=0 2024-09-12T17:26:18.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.306+0000 7fda63533800 20 add_watcher() i=1 2024-09-12T17:26:18.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.306+0000 7fda63533800 20 add_watcher() i=2 2024-09-12T17:26:18.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.306+0000 7fda63533800 20 add_watcher() i=3 2024-09-12T17:26:18.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.306+0000 7fda63533800 20 add_watcher() i=4 2024-09-12T17:26:18.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.306+0000 7fda63533800 20 add_watcher() i=5 2024-09-12T17:26:18.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.306+0000 7fda63533800 20 add_watcher() i=6 2024-09-12T17:26:18.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.307+0000 7fda63533800 20 add_watcher() i=7 2024-09-12T17:26:18.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.307+0000 7fda63533800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:18.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.308+0000 7fd915fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:18.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.309+0000 7fda63533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:18.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.309+0000 7fda63533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:18.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.309+0000 7fda63533800 5 note: GC not initialized 2024-09-12T17:26:18.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.309+0000 7fd914fe1640 20 reqs_thread_entry: start 2024-09-12T17:26:18.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.309+0000 7fda63533800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:18.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.309+0000 7fda63533800 20 Filter name: none 2024-09-12T17:26:18.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.309+0000 7fd88e7fc640 20 reqs_thread_entry: start 2024-09-12T17:26:18.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.310+0000 7fda63533800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.310+0000 7fda63533800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:18.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.310+0000 7fda63533800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.310+0000 7fda63533800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:18.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.310+0000 7fda63533800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:18.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.310+0000 7fda63533800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.311+0000 7fda63533800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:18.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.311+0000 7fda63533800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.311+0000 7fda63533800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:18.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.311+0000 7fda63533800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:18.314 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.313+0000 7fd915fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:18.316 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.315+0000 7fda63533800 20 remove_watcher() i=0 2024-09-12T17:26:18.316 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.315+0000 7fda63533800 2 removed watcher, disabling cache 2024-09-12T17:26:18.318 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.317+0000 7fda63533800 20 remove_watcher() i=1 2024-09-12T17:26:18.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.318+0000 7fda63533800 20 remove_watcher() i=2 2024-09-12T17:26:18.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.320+0000 7fda63533800 20 remove_watcher() i=3 2024-09-12T17:26:18.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.321+0000 7fda63533800 20 remove_watcher() i=4 2024-09-12T17:26:18.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.322+0000 7fda63533800 20 remove_watcher() i=5 2024-09-12T17:26:18.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.324+0000 7fda63533800 20 remove_watcher() i=6 2024-09-12T17:26:18.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.325+0000 7fda63533800 20 remove_watcher() i=7 2024-09-12T17:26:18.337 INFO:tasks.workunit.client.0.smithi044.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 108, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T17:26:18.337 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T17:26:18.337 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:18.338 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:26:18.372 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:18.373 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:18.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.412+0000 7f95d9b30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.413+0000 7f95d9b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:18.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.413+0000 7f95d9b30800 20 realm 2024-09-12T17:26:18.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.413+0000 7f95d9b30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.414+0000 7f95d9b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:18.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.414+0000 7f95d9b30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:18.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.414+0000 7f95d9b30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.414+0000 7f95d9b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:18.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.414+0000 7f95d9b30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.415+0000 7f95d9b30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:18.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.415+0000 7f95d9b30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.415+0000 7f95d9b30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:18.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.415+0000 7f95d9b30800 20 searching for the correct realm 2024-09-12T17:26:18.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.419+0000 7f95cd0af640 0 -- 172.21.15.44:0/1532367306 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x558e033c61c0 msgr2=0x558e033c8680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:18.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.422+0000 7f95d58b0640 0 -- 172.21.15.44:0/1532367306 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f95c002b8d0 msgr2=0x7f95c001b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:26:18.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.427+0000 7f95d9b30800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:18.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.427+0000 7f95d9b30800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:18.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.427+0000 7f95d9b30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:18.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.427+0000 7f95d9b30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:18.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.427+0000 7f95d9b30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:18.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.427+0000 7f95d9b30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:18.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.427+0000 7f95d9b30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.427+0000 7f95d9b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:18.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.427+0000 7f95d9b30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.428+0000 7f95d9b30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:18.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.428+0000 7f95d9b30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.428+0000 7f95d9b30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:18.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.428+0000 7f95d9b30800 20 zone default found 2024-09-12T17:26:18.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.428+0000 7f95d9b30800 4 Realm: () 2024-09-12T17:26:18.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.428+0000 7f95d9b30800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:18.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.428+0000 7f95d9b30800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:18.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.428+0000 7f95d9b30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:18.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.428+0000 7f95d9b30800 20 zonegroup default 2024-09-12T17:26:18.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.428+0000 7f95d9b30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.428+0000 7f95d9b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:18.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.428+0000 7f95d9b30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.429+0000 7f95d9b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:18.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.429+0000 7f95d9b30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.429+0000 7f95d9b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:18.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.429+0000 7f95d9b30800 20 started sync module instance, tier type = 2024-09-12T17:26:18.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.429+0000 7f95d9b30800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:18.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.442+0000 7f95d9b30800 20 add_watcher() i=0 2024-09-12T17:26:18.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.442+0000 7f95d9b30800 20 add_watcher() i=1 2024-09-12T17:26:18.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.442+0000 7f95d9b30800 20 add_watcher() i=2 2024-09-12T17:26:18.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.442+0000 7f95d9b30800 20 add_watcher() i=3 2024-09-12T17:26:18.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.442+0000 7f95d9b30800 20 add_watcher() i=4 2024-09-12T17:26:18.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.442+0000 7f95d9b30800 20 add_watcher() i=5 2024-09-12T17:26:18.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.442+0000 7f95d9b30800 20 add_watcher() i=6 2024-09-12T17:26:18.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.445+0000 7f95d9b30800 20 add_watcher() i=7 2024-09-12T17:26:18.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.445+0000 7f95d9b30800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:18.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.447+0000 7f94877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:18.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.448+0000 7f95d9b30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:18.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.448+0000 7f95d9b30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:18.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.448+0000 7f95d9b30800 5 note: GC not initialized 2024-09-12T17:26:18.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.448+0000 7f94867fc640 20 reqs_thread_entry: start 2024-09-12T17:26:18.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.448+0000 7f95d9b30800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:18.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.448+0000 7f95d9b30800 20 Filter name: none 2024-09-12T17:26:18.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.448+0000 7f93f7fff640 20 reqs_thread_entry: start 2024-09-12T17:26:18.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.448+0000 7f95d9b30800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:26:18.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.448+0000 7f95d9b30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.449+0000 7f95d9b30800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:18.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.449+0000 7f95d9b30800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:26:18.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.449+0000 7f95d9b30800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:26:18.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.449+0000 7f95d9b30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 : miss 2024-09-12T17:26:18.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.449+0000 7f95d9b30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:18.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.449+0000 7f95d9b30800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:18.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.449+0000 7f95d9b30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 info.flags=0x17 2024-09-12T17:26:18.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.449+0000 7f95d9b30800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 to cache LRU end 2024-09-12T17:26:18.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.449+0000 7f95d9b30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:18.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.449+0000 7f95d9b30800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:26:18.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.449+0000 7f95d9b30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 2024-09-12T17:26:18.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.450+0000 7f95d9b30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:18.452 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.450+0000 7f95d9b30800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:26:18.452 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.450+0000 7f95d9b30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:18.452 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.451+0000 7f95d9b30800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:26:18.452 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.451+0000 7f95d9b30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:18.452 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.451+0000 7f95d9b30800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:26:18.452 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.451+0000 7f95d9b30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:18.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.452+0000 7f95d9b30800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:26:18.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.452+0000 7f95d9b30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:18.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.453+0000 7f95d9b30800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:26:18.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.453+0000 7f95d9b30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:18.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.453+0000 7f95d9b30800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:26:18.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.453+0000 7f95d9b30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:18.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.454+0000 7f95d9b30800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:26:18.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.454+0000 7f95d9b30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:18.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.454+0000 7f95d9b30800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:26:18.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.454+0000 7f95d9b30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:18.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.455+0000 7f95d9b30800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:26:18.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.455+0000 7f95d9b30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:18.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.455+0000 7f95d9b30800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:26:18.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.455+0000 7f95d9b30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:18.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.456+0000 7f95d9b30800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:26:18.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.456+0000 7f95d9b30800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:26:18.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.457+0000 7f94877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:18.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.460+0000 7f95d9b30800 20 remove_watcher() i=0 2024-09-12T17:26:18.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.460+0000 7f95d9b30800 2 removed watcher, disabling cache 2024-09-12T17:26:18.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.461+0000 7f95d9b30800 20 remove_watcher() i=1 2024-09-12T17:26:18.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.462+0000 7f95d9b30800 20 remove_watcher() i=2 2024-09-12T17:26:18.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.463+0000 7f95d9b30800 20 remove_watcher() i=3 2024-09-12T17:26:18.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.465+0000 7f95d9b30800 20 remove_watcher() i=4 2024-09-12T17:26:18.467 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.466+0000 7f95d9b30800 20 remove_watcher() i=5 2024-09-12T17:26:18.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.467+0000 7f95d9b30800 20 remove_watcher() i=6 2024-09-12T17:26:18.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:18.468+0000 7f95d9b30800 20 remove_watcher() i=7 2024-09-12T17:26:18.481 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:26:18.892 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:26:20.355 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:26:20.357 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:26:20.393 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:20.393 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:20.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.438+0000 7f5376e30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.440+0000 7f5376e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.440+0000 7f5376e30800 20 realm 2024-09-12T17:26:20.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.440+0000 7f5376e30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.440+0000 7f5376e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.440+0000 7f5376e30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:20.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.440+0000 7f5376e30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.440+0000 7f5376e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.440+0000 7f5376e30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.442+0000 7f5376e30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:20.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.442+0000 7f5376e30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.442+0000 7f5376e30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:20.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.442+0000 7f5376e30800 20 searching for the correct realm 2024-09-12T17:26:20.446 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.446+0000 7f5371952640 0 -- 172.21.15.44:0/1754692173 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f53640b8b70 msgr2=0x7f5364094110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:20.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.450+0000 7f5372153640 0 -- 172.21.15.44:0/1754692173 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f5368069430 msgr2=0x7f5368069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:20.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.658+0000 7f5376e30800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:20.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.658+0000 7f5376e30800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:20.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.658+0000 7f5376e30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:20.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.658+0000 7f5376e30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:20.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.658+0000 7f5376e30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:20.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.658+0000 7f5376e30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:20.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.658+0000 7f5376e30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.658+0000 7f5376e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.658+0000 7f5376e30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.658+0000 7f5376e30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:20.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.658+0000 7f5376e30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.659+0000 7f5376e30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:20.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.659+0000 7f5376e30800 20 zone default found 2024-09-12T17:26:20.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.659+0000 7f5376e30800 4 Realm: () 2024-09-12T17:26:20.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.659+0000 7f5376e30800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:20.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.659+0000 7f5376e30800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:20.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.659+0000 7f5376e30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:20.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.659+0000 7f5376e30800 20 zonegroup default 2024-09-12T17:26:20.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.659+0000 7f5376e30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.659+0000 7f5376e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.659+0000 7f5376e30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.659+0000 7f5376e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.659+0000 7f5376e30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.660+0000 7f5376e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.660+0000 7f5376e30800 20 started sync module instance, tier type = 2024-09-12T17:26:20.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.660+0000 7f5376e30800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:20.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.671+0000 7f5376e30800 20 add_watcher() i=0 2024-09-12T17:26:20.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.671+0000 7f5376e30800 20 add_watcher() i=1 2024-09-12T17:26:20.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.671+0000 7f5376e30800 20 add_watcher() i=2 2024-09-12T17:26:20.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.671+0000 7f5376e30800 20 add_watcher() i=3 2024-09-12T17:26:20.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.671+0000 7f5376e30800 20 add_watcher() i=4 2024-09-12T17:26:20.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.671+0000 7f5376e30800 20 add_watcher() i=5 2024-09-12T17:26:20.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.671+0000 7f5376e30800 20 add_watcher() i=6 2024-09-12T17:26:20.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.672+0000 7f5376e30800 20 add_watcher() i=7 2024-09-12T17:26:20.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.672+0000 7f5376e30800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:20.675 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.674+0000 7f5228fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:20.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.674+0000 7f5376e30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:20.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.674+0000 7f5376e30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:20.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.675+0000 7f5376e30800 5 note: GC not initialized 2024-09-12T17:26:20.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.675+0000 7f51a37fe640 20 reqs_thread_entry: start 2024-09-12T17:26:20.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.675+0000 7f5376e30800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:20.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.675+0000 7f5376e30800 20 Filter name: none 2024-09-12T17:26:20.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.675+0000 7f51a17fa640 20 reqs_thread_entry: start 2024-09-12T17:26:20.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.675+0000 7f5376e30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.676+0000 7f5376e30800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:20.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.676+0000 7f5376e30800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.676+0000 7f5376e30800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:20.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.676+0000 7f5376e30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:20.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.676+0000 7f5376e30800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:26:20.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.676+0000 7f5376e30800 20 INFO: main: starting shard=0 2024-09-12T17:26:20.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.676+0000 7f5376e30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:20.678 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.677+0000 7f5376e30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.678 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.677+0000 7f5376e30800 20 INFO: main: starting shard=1 2024-09-12T17:26:20.678 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.677+0000 7f5376e30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:20.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.678+0000 7f5376e30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.678+0000 7f5376e30800 20 INFO: main: starting shard=2 2024-09-12T17:26:20.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.678+0000 7f5376e30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:20.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.678+0000 7f5376e30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.678+0000 7f5376e30800 20 INFO: main: starting shard=3 2024-09-12T17:26:20.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.678+0000 7f5376e30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:20.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.679+0000 7f5376e30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.679+0000 7f5376e30800 20 INFO: main: starting shard=4 2024-09-12T17:26:20.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.679+0000 7f5376e30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:20.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.679+0000 7f5376e30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.679+0000 7f5376e30800 20 INFO: main: starting shard=5 2024-09-12T17:26:20.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.679+0000 7f5376e30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:20.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.680+0000 7f5376e30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.680+0000 7f5376e30800 20 INFO: main: starting shard=6 2024-09-12T17:26:20.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.680+0000 7f5376e30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:20.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.681+0000 7f5376e30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.681+0000 7f5376e30800 20 INFO: main: starting shard=7 2024-09-12T17:26:20.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.681+0000 7f5376e30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:20.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.681+0000 7f5376e30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.681+0000 7f5376e30800 20 INFO: main: starting shard=8 2024-09-12T17:26:20.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.681+0000 7f5376e30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:20.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.682+0000 7f5376e30800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:26:20.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.682+0000 7f5376e30800 20 INFO: main: starting shard=9 2024-09-12T17:26:20.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.682+0000 7f5376e30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:20.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.683+0000 7f5376e30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.683+0000 7f5376e30800 20 INFO: main: starting shard=10 2024-09-12T17:26:20.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.683+0000 7f5376e30800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:20.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.683+0000 7f5376e30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.683+0000 7f5376e30800 20 INFO: main: done 2024-09-12T17:26:20.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.684+0000 7f5228fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:20.688 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.687+0000 7f5376e30800 20 remove_watcher() i=0 2024-09-12T17:26:20.688 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.687+0000 7f5376e30800 2 removed watcher, disabling cache 2024-09-12T17:26:20.690 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.689+0000 7f5376e30800 20 remove_watcher() i=1 2024-09-12T17:26:20.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.690+0000 7f5376e30800 20 remove_watcher() i=2 2024-09-12T17:26:20.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.691+0000 7f5376e30800 20 remove_watcher() i=3 2024-09-12T17:26:20.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.693+0000 7f5376e30800 20 remove_watcher() i=4 2024-09-12T17:26:20.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.694+0000 7f5376e30800 20 remove_watcher() i=5 2024-09-12T17:26:20.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.695+0000 7f5376e30800 20 remove_watcher() i=6 2024-09-12T17:26:20.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.696+0000 7f5376e30800 20 remove_watcher() i=7 2024-09-12T17:26:20.771 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:26:20.773 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:26:20.805 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:20.805 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:20.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.844+0000 7f9c2da32800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.846+0000 7f9c2da32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.846+0000 7f9c2da32800 20 realm 2024-09-12T17:26:20.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.846+0000 7f9c2da32800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.846+0000 7f9c2da32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.846+0000 7f9c2da32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:20.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.846+0000 7f9c2da32800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.846+0000 7f9c2da32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.846+0000 7f9c2da32800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.847+0000 7f9c2da32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:20.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.847+0000 7f9c2da32800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.847+0000 7f9c2da32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:20.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.847+0000 7f9c2da32800 20 searching for the correct realm 2024-09-12T17:26:20.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.851+0000 7f9c20552640 0 -- 172.21.15.44:0/1028938444 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f9c18088c50 msgr2=0x7f9c180764b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:20.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.855+0000 7f9c29554640 0 -- 172.21.15.44:0/1028938444 >> [v2:172.21.15.181:6810/2228110208,v1:172.21.15.181:6811/2228110208] conn(0x7f9c100454c0 msgr2=0x7f9c1005e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:20.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.858+0000 7f9c2da32800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:20.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.858+0000 7f9c2da32800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:20.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.858+0000 7f9c2da32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:20.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.858+0000 7f9c2da32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:20.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.858+0000 7f9c2da32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:20.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.858+0000 7f9c2da32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:20.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.858+0000 7f9c2da32800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.859+0000 7f9c2da32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.859+0000 7f9c2da32800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.859+0000 7f9c2da32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:20.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.859+0000 7f9c2da32800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.859+0000 7f9c2da32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:20.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.859+0000 7f9c2da32800 20 zone default found 2024-09-12T17:26:20.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.859+0000 7f9c2da32800 4 Realm: () 2024-09-12T17:26:20.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.859+0000 7f9c2da32800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:20.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.859+0000 7f9c2da32800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:20.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.859+0000 7f9c2da32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:20.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.859+0000 7f9c2da32800 20 zonegroup default 2024-09-12T17:26:20.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.859+0000 7f9c2da32800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.859+0000 7f9c2da32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.860+0000 7f9c2da32800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.860+0000 7f9c2da32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.860+0000 7f9c2da32800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.860+0000 7f9c2da32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.860+0000 7f9c2da32800 20 started sync module instance, tier type = 2024-09-12T17:26:20.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.860+0000 7f9c2da32800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:20.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.870+0000 7f9c2da32800 20 add_watcher() i=0 2024-09-12T17:26:20.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.870+0000 7f9c2da32800 20 add_watcher() i=1 2024-09-12T17:26:20.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.870+0000 7f9c2da32800 20 add_watcher() i=2 2024-09-12T17:26:20.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.870+0000 7f9c2da32800 20 add_watcher() i=3 2024-09-12T17:26:20.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.870+0000 7f9c2da32800 20 add_watcher() i=4 2024-09-12T17:26:20.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.870+0000 7f9c2da32800 20 add_watcher() i=5 2024-09-12T17:26:20.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.870+0000 7f9c2da32800 20 add_watcher() i=6 2024-09-12T17:26:20.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.872+0000 7f9c2da32800 20 add_watcher() i=7 2024-09-12T17:26:20.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.872+0000 7f9c2da32800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:20.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.874+0000 7f9adf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:20.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.875+0000 7f9c2da32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:20.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.875+0000 7f9c2da32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:20.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.875+0000 7f9c2da32800 5 note: GC not initialized 2024-09-12T17:26:20.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.875+0000 7f9ade7e4640 20 reqs_thread_entry: start 2024-09-12T17:26:20.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.875+0000 7f9c2da32800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:20.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.875+0000 7f9c2da32800 20 Filter name: none 2024-09-12T17:26:20.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.875+0000 7f9ad7fff640 20 reqs_thread_entry: start 2024-09-12T17:26:20.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.875+0000 7f9c2da32800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.875+0000 7f9c2da32800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:20.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.875+0000 7f9c2da32800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.876+0000 7f9c2da32800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:20.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.876+0000 7f9c2da32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:20.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.876+0000 7f9c2da32800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:26:20.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.876+0000 7f9c2da32800 20 INFO: main: starting shard=0 2024-09-12T17:26:20.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.876+0000 7f9c2da32800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:20.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.877+0000 7f9c2da32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.877+0000 7f9c2da32800 20 INFO: main: starting shard=1 2024-09-12T17:26:20.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.877+0000 7f9c2da32800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:20.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.877+0000 7f9c2da32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.877+0000 7f9c2da32800 20 INFO: main: starting shard=2 2024-09-12T17:26:20.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.877+0000 7f9c2da32800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:20.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.877+0000 7f9c2da32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.877+0000 7f9c2da32800 20 INFO: main: starting shard=3 2024-09-12T17:26:20.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.877+0000 7f9c2da32800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:20.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.878+0000 7f9c2da32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.878+0000 7f9c2da32800 20 INFO: main: starting shard=4 2024-09-12T17:26:20.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.878+0000 7f9c2da32800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:20.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.879+0000 7f9c2da32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.879+0000 7f9c2da32800 20 INFO: main: starting shard=5 2024-09-12T17:26:20.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.879+0000 7f9c2da32800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:20.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.879+0000 7f9c2da32800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:26:20.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.879+0000 7f9c2da32800 20 INFO: main: starting shard=6 2024-09-12T17:26:20.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.879+0000 7f9c2da32800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:20.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.880+0000 7f9c2da32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.880+0000 7f9c2da32800 20 INFO: main: starting shard=7 2024-09-12T17:26:20.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.880+0000 7f9c2da32800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:20.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.881+0000 7f9c2da32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.881+0000 7f9c2da32800 20 INFO: main: starting shard=8 2024-09-12T17:26:20.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.881+0000 7f9c2da32800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:20.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.881+0000 7f9c2da32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.881+0000 7f9c2da32800 20 INFO: main: starting shard=9 2024-09-12T17:26:20.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.881+0000 7f9c2da32800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:20.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.882+0000 7f9c2da32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.882+0000 7f9c2da32800 20 INFO: main: starting shard=10 2024-09-12T17:26:20.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.882+0000 7f9c2da32800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:20.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.882+0000 7f9c2da32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:20.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.882+0000 7f9c2da32800 20 INFO: main: done 2024-09-12T17:26:20.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.883+0000 7f9adf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:20.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.889+0000 7f9c2da32800 20 remove_watcher() i=0 2024-09-12T17:26:20.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.889+0000 7f9c2da32800 2 removed watcher, disabling cache 2024-09-12T17:26:20.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.890+0000 7f9c2da32800 20 remove_watcher() i=1 2024-09-12T17:26:20.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.891+0000 7f9c2da32800 20 remove_watcher() i=2 2024-09-12T17:26:20.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.893+0000 7f9c2da32800 20 remove_watcher() i=3 2024-09-12T17:26:20.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.894+0000 7f9c2da32800 20 remove_watcher() i=4 2024-09-12T17:26:20.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.895+0000 7f9c2da32800 20 remove_watcher() i=5 2024-09-12T17:26:20.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.897+0000 7f9c2da32800 20 remove_watcher() i=6 2024-09-12T17:26:20.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:20.898+0000 7f9c2da32800 20 remove_watcher() i=7 2024-09-12T17:26:20.967 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:26:20.969 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:26:21.002 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:21.002 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:21.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.040+0000 7f54b5210800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.042+0000 7f54b5210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.042+0000 7f54b5210800 20 realm 2024-09-12T17:26:21.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.042+0000 7f54b5210800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.043+0000 7f54b5210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.043+0000 7f54b5210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:21.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.043+0000 7f54b5210800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.043+0000 7f54b5210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.043+0000 7f54b5210800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.044+0000 7f54b5210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:21.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.044+0000 7f54b5210800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.044+0000 7f54b5210800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:21.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.044+0000 7f54b5210800 20 searching for the correct realm 2024-09-12T17:26:21.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.046+0000 7f54b09bc640 0 -- 172.21.15.44:0/4245686658 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x55f10f0a1bb0 msgr2=0x7f54a80c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:21.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.251+0000 7f54b11bd640 0 -- 172.21.15.44:0/4245686658 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f54a4019940 msgr2=0x7f54a400f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:21.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.257+0000 7f54b5210800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:21.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.257+0000 7f54b5210800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:21.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.257+0000 7f54b5210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:21.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.257+0000 7f54b5210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:21.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.257+0000 7f54b5210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:21.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.257+0000 7f54b5210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:21.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.257+0000 7f54b5210800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.257+0000 7f54b5210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.257+0000 7f54b5210800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.258+0000 7f54b5210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:21.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.258+0000 7f54b5210800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.258+0000 7f54b5210800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:21.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.258+0000 7f54b5210800 20 zone default found 2024-09-12T17:26:21.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.258+0000 7f54b5210800 4 Realm: () 2024-09-12T17:26:21.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.258+0000 7f54b5210800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:21.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.258+0000 7f54b5210800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:21.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.258+0000 7f54b5210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:21.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.258+0000 7f54b5210800 20 zonegroup default 2024-09-12T17:26:21.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.258+0000 7f54b5210800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.258+0000 7f54b5210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.258+0000 7f54b5210800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.259+0000 7f54b5210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.259+0000 7f54b5210800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.259+0000 7f54b5210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.259+0000 7f54b5210800 20 started sync module instance, tier type = 2024-09-12T17:26:21.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.259+0000 7f54b5210800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:21.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.280+0000 7f54b5210800 20 add_watcher() i=0 2024-09-12T17:26:21.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.280+0000 7f54b5210800 20 add_watcher() i=1 2024-09-12T17:26:21.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.280+0000 7f54b5210800 20 add_watcher() i=2 2024-09-12T17:26:21.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.280+0000 7f54b5210800 20 add_watcher() i=3 2024-09-12T17:26:21.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.280+0000 7f54b5210800 20 add_watcher() i=4 2024-09-12T17:26:21.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.280+0000 7f54b5210800 20 add_watcher() i=5 2024-09-12T17:26:21.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.280+0000 7f54b5210800 20 add_watcher() i=6 2024-09-12T17:26:21.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.283+0000 7f54b5210800 20 add_watcher() i=7 2024-09-12T17:26:21.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.283+0000 7f54b5210800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:21.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.285+0000 7f53677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:21.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.286+0000 7f54b5210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:21.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.286+0000 7f54b5210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:21.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.286+0000 7f54b5210800 5 note: GC not initialized 2024-09-12T17:26:21.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.286+0000 7f53667e4640 20 reqs_thread_entry: start 2024-09-12T17:26:21.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.286+0000 7f54b5210800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:21.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.286+0000 7f54b5210800 20 Filter name: none 2024-09-12T17:26:21.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.286+0000 7f535f7fe640 20 reqs_thread_entry: start 2024-09-12T17:26:21.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.286+0000 7f54b5210800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.287+0000 7f54b5210800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:21.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.287+0000 7f54b5210800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.287+0000 7f54b5210800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:21.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.287+0000 7f54b5210800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:21.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.287+0000 7f54b5210800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:26:21.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.287+0000 7f54b5210800 20 INFO: main: starting shard=0 2024-09-12T17:26:21.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.287+0000 7f54b5210800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:21.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.288+0000 7f54b5210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.288+0000 7f54b5210800 20 INFO: main: starting shard=1 2024-09-12T17:26:21.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.288+0000 7f54b5210800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:21.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.288+0000 7f54b5210800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:26:21.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.288+0000 7f54b5210800 20 INFO: main: starting shard=2 2024-09-12T17:26:21.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.288+0000 7f54b5210800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:21.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.289+0000 7f54b5210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.289+0000 7f54b5210800 20 INFO: main: starting shard=3 2024-09-12T17:26:21.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.289+0000 7f54b5210800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:21.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.289+0000 7f54b5210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.289+0000 7f54b5210800 20 INFO: main: starting shard=4 2024-09-12T17:26:21.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.289+0000 7f54b5210800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:21.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.290+0000 7f54b5210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.290+0000 7f54b5210800 20 INFO: main: starting shard=5 2024-09-12T17:26:21.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.290+0000 7f54b5210800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:21.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.290+0000 7f54b5210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.290+0000 7f54b5210800 20 INFO: main: starting shard=6 2024-09-12T17:26:21.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.290+0000 7f54b5210800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:21.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.290+0000 7f54b5210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.290+0000 7f54b5210800 20 INFO: main: starting shard=7 2024-09-12T17:26:21.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.290+0000 7f54b5210800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:21.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.291+0000 7f54b5210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.291+0000 7f54b5210800 20 INFO: main: starting shard=8 2024-09-12T17:26:21.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.291+0000 7f54b5210800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:21.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.292+0000 7f54b5210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.292+0000 7f54b5210800 20 INFO: main: starting shard=9 2024-09-12T17:26:21.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.292+0000 7f54b5210800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:21.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.292+0000 7f54b5210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.292+0000 7f54b5210800 20 INFO: main: starting shard=10 2024-09-12T17:26:21.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.292+0000 7f54b5210800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:21.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.293+0000 7f54b5210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.293+0000 7f54b5210800 20 INFO: main: done 2024-09-12T17:26:21.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.294+0000 7f53677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:21.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.296+0000 7f54b5210800 20 remove_watcher() i=0 2024-09-12T17:26:21.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.296+0000 7f54b5210800 2 removed watcher, disabling cache 2024-09-12T17:26:21.298 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.298+0000 7f54b5210800 20 remove_watcher() i=1 2024-09-12T17:26:21.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.299+0000 7f54b5210800 20 remove_watcher() i=2 2024-09-12T17:26:21.301 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.300+0000 7f54b5210800 20 remove_watcher() i=3 2024-09-12T17:26:21.302 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.302+0000 7f54b5210800 20 remove_watcher() i=4 2024-09-12T17:26:21.303 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.303+0000 7f54b5210800 20 remove_watcher() i=5 2024-09-12T17:26:21.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.304+0000 7f54b5210800 20 remove_watcher() i=6 2024-09-12T17:26:21.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.305+0000 7f54b5210800 20 remove_watcher() i=7 2024-09-12T17:26:21.375 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:26:21.376 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:26:21.408 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:21.408 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:21.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.445+0000 7f9febf40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.447+0000 7f9febf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.447+0000 7f9febf40800 20 realm 2024-09-12T17:26:21.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.447+0000 7f9febf40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.447+0000 7f9febf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.447+0000 7f9febf40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:21.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.447+0000 7f9febf40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.448+0000 7f9febf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.448+0000 7f9febf40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.449+0000 7f9febf40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:21.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.449+0000 7f9febf40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.449+0000 7f9febf40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:21.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.449+0000 7f9febf40800 20 searching for the correct realm 2024-09-12T17:26:21.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.452+0000 7f9fe84c1640 0 -- 172.21.15.44:0/4040932495 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f9fdc06b020 msgr2=0x7f9fdc0a3d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:21.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.455+0000 7f9fe7cc0640 0 -- 172.21.15.44:0/4040932495 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f9fdc0a9040 msgr2=0x7f9fdc0a3410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:21.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.661+0000 7f9febf40800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:21.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.661+0000 7f9febf40800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:21.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.661+0000 7f9febf40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:21.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.661+0000 7f9febf40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:21.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.661+0000 7f9febf40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:21.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.661+0000 7f9febf40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:21.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.661+0000 7f9febf40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.661+0000 7f9febf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.661+0000 7f9febf40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.661+0000 7f9febf40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:21.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.661+0000 7f9febf40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.662+0000 7f9febf40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:21.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.662+0000 7f9febf40800 20 zone default found 2024-09-12T17:26:21.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.662+0000 7f9febf40800 4 Realm: () 2024-09-12T17:26:21.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.662+0000 7f9febf40800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:21.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.662+0000 7f9febf40800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:21.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.662+0000 7f9febf40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:21.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.662+0000 7f9febf40800 20 zonegroup default 2024-09-12T17:26:21.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.662+0000 7f9febf40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.662+0000 7f9febf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.662+0000 7f9febf40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.662+0000 7f9febf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.662+0000 7f9febf40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.662+0000 7f9febf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.662+0000 7f9febf40800 20 started sync module instance, tier type = 2024-09-12T17:26:21.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.663+0000 7f9febf40800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:21.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.682+0000 7f9febf40800 20 add_watcher() i=0 2024-09-12T17:26:21.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.682+0000 7f9febf40800 20 add_watcher() i=1 2024-09-12T17:26:21.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.682+0000 7f9febf40800 20 add_watcher() i=2 2024-09-12T17:26:21.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.682+0000 7f9febf40800 20 add_watcher() i=3 2024-09-12T17:26:21.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.682+0000 7f9febf40800 20 add_watcher() i=4 2024-09-12T17:26:21.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.682+0000 7f9febf40800 20 add_watcher() i=5 2024-09-12T17:26:21.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.684+0000 7f9febf40800 20 add_watcher() i=6 2024-09-12T17:26:21.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.684+0000 7f9febf40800 20 add_watcher() i=7 2024-09-12T17:26:21.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.684+0000 7f9febf40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:21.688 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.686+0000 7f9e9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:21.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.686+0000 7f9febf40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:21.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.686+0000 7f9febf40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:21.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.686+0000 7f9febf40800 5 note: GC not initialized 2024-09-12T17:26:21.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.687+0000 7f9e9cfe1640 20 reqs_thread_entry: start 2024-09-12T17:26:21.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.687+0000 7f9febf40800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:21.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.687+0000 7f9febf40800 20 Filter name: none 2024-09-12T17:26:21.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.687+0000 7f9e167fc640 20 reqs_thread_entry: start 2024-09-12T17:26:21.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.687+0000 7f9febf40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.687+0000 7f9febf40800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:21.690 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.687+0000 7f9febf40800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.690 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.688+0000 7f9febf40800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:21.690 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.688+0000 7f9febf40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:21.690 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.688+0000 7f9febf40800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:26:21.690 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.688+0000 7f9febf40800 20 INFO: main: starting shard=0 2024-09-12T17:26:21.690 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.688+0000 7f9febf40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:21.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.688+0000 7f9febf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.688+0000 7f9febf40800 20 INFO: main: starting shard=1 2024-09-12T17:26:21.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.688+0000 7f9febf40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:21.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.689+0000 7f9febf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.689+0000 7f9febf40800 20 INFO: main: starting shard=2 2024-09-12T17:26:21.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.689+0000 7f9febf40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:21.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.690+0000 7f9febf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.690+0000 7f9febf40800 20 INFO: main: starting shard=3 2024-09-12T17:26:21.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.690+0000 7f9febf40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:21.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.690+0000 7f9febf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.690+0000 7f9febf40800 20 INFO: main: starting shard=4 2024-09-12T17:26:21.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.690+0000 7f9febf40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:21.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.691+0000 7f9febf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.691+0000 7f9febf40800 20 INFO: main: starting shard=5 2024-09-12T17:26:21.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.691+0000 7f9febf40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:21.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.691+0000 7f9febf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.691+0000 7f9febf40800 20 INFO: main: starting shard=6 2024-09-12T17:26:21.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.691+0000 7f9febf40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:21.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.692+0000 7f9febf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.692+0000 7f9febf40800 20 INFO: main: starting shard=7 2024-09-12T17:26:21.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.692+0000 7f9febf40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:21.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.692+0000 7f9febf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.692+0000 7f9febf40800 20 INFO: main: starting shard=8 2024-09-12T17:26:21.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.692+0000 7f9febf40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:21.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.693+0000 7f9febf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.693+0000 7f9febf40800 20 INFO: main: starting shard=9 2024-09-12T17:26:21.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.693+0000 7f9febf40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:21.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.693+0000 7f9febf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:21.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.693+0000 7f9febf40800 20 INFO: main: starting shard=10 2024-09-12T17:26:21.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.693+0000 7f9febf40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:21.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.694+0000 7f9febf40800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:26:21.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.694+0000 7f9febf40800 20 INFO: main: done 2024-09-12T17:26:21.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.695+0000 7f9e9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:21.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.697+0000 7f9febf40800 20 remove_watcher() i=0 2024-09-12T17:26:21.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.697+0000 7f9febf40800 2 removed watcher, disabling cache 2024-09-12T17:26:21.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.698+0000 7f9febf40800 20 remove_watcher() i=1 2024-09-12T17:26:21.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.701+0000 7f9febf40800 20 remove_watcher() i=2 2024-09-12T17:26:21.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.702+0000 7f9febf40800 20 remove_watcher() i=3 2024-09-12T17:26:21.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.704+0000 7f9febf40800 20 remove_watcher() i=4 2024-09-12T17:26:21.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.705+0000 7f9febf40800 20 remove_watcher() i=5 2024-09-12T17:26:21.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.706+0000 7f9febf40800 20 remove_watcher() i=6 2024-09-12T17:26:21.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:21.707+0000 7f9febf40800 20 remove_watcher() i=7 2024-09-12T17:26:21.726 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:26:22.131 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:26:22.537 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T17:26:22.537 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:22.538 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:26:22.572 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:22.572 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:22.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.610+0000 7f2d36335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.611+0000 7f2d36335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.611+0000 7f2d36335800 20 realm 2024-09-12T17:26:22.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.611+0000 7f2d36335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.611+0000 7f2d36335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.611+0000 7f2d36335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:22.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.611+0000 7f2d36335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.611+0000 7f2d36335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.611+0000 7f2d36335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.613+0000 7f2d36335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:22.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.613+0000 7f2d36335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.613+0000 7f2d36335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:22.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.613+0000 7f2d36335800 20 searching for the correct realm 2024-09-12T17:26:22.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.617+0000 7f2d3287e640 0 -- 172.21.15.44:0/4149983938 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x557ebb4c2470 msgr2=0x557ebb4c4910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:22.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.620+0000 7f2d3187c640 0 -- 172.21.15.44:0/4149983938 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f2d2407e070 msgr2=0x7f2d24064970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:22.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.624+0000 7f2d36335800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:22.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.624+0000 7f2d36335800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:22.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.624+0000 7f2d36335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:22.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.624+0000 7f2d36335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:22.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.624+0000 7f2d36335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:22.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.624+0000 7f2d36335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:22.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.624+0000 7f2d36335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.625+0000 7f2d36335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.625+0000 7f2d36335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.625+0000 7f2d36335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:22.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.625+0000 7f2d36335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.625+0000 7f2d36335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:22.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.625+0000 7f2d36335800 20 zone default found 2024-09-12T17:26:22.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.625+0000 7f2d36335800 4 Realm: () 2024-09-12T17:26:22.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.625+0000 7f2d36335800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:22.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.625+0000 7f2d36335800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:22.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.625+0000 7f2d36335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:22.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.625+0000 7f2d36335800 20 zonegroup default 2024-09-12T17:26:22.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.625+0000 7f2d36335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.626+0000 7f2d36335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.626+0000 7f2d36335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.626+0000 7f2d36335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.626+0000 7f2d36335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.626+0000 7f2d36335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.626+0000 7f2d36335800 20 started sync module instance, tier type = 2024-09-12T17:26:22.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.626+0000 7f2d36335800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:22.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.638+0000 7f2d36335800 20 add_watcher() i=0 2024-09-12T17:26:22.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.638+0000 7f2d36335800 20 add_watcher() i=1 2024-09-12T17:26:22.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.638+0000 7f2d36335800 20 add_watcher() i=2 2024-09-12T17:26:22.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.638+0000 7f2d36335800 20 add_watcher() i=3 2024-09-12T17:26:22.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.638+0000 7f2d36335800 20 add_watcher() i=4 2024-09-12T17:26:22.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.638+0000 7f2d36335800 20 add_watcher() i=5 2024-09-12T17:26:22.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.638+0000 7f2d36335800 20 add_watcher() i=6 2024-09-12T17:26:22.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.639+0000 7f2d36335800 20 add_watcher() i=7 2024-09-12T17:26:22.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.639+0000 7f2d36335800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:22.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.641+0000 7f2be8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:22.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.642+0000 7f2d36335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:22.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.642+0000 7f2d36335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:22.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.642+0000 7f2d36335800 5 note: GC not initialized 2024-09-12T17:26:22.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.642+0000 7f2b637fe640 20 reqs_thread_entry: start 2024-09-12T17:26:22.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.642+0000 7f2d36335800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:22.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.642+0000 7f2d36335800 20 Filter name: none 2024-09-12T17:26:22.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.642+0000 7f2b617fa640 20 reqs_thread_entry: start 2024-09-12T17:26:22.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.642+0000 7f2d36335800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:26:22.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.642+0000 7f2d36335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.643+0000 7f2d36335800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:22.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.643+0000 7f2d36335800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:26:22.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.643+0000 7f2d36335800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:26:22.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.643+0000 7f2d36335800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 : miss 2024-09-12T17:26:22.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.643+0000 7f2d36335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.643+0000 7f2d36335800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.643+0000 7f2d36335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 info.flags=0x17 2024-09-12T17:26:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.643+0000 7f2d36335800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 to cache LRU end 2024-09-12T17:26:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.643+0000 7f2d36335800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.643+0000 7f2d36335800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:26:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.643+0000 7f2d36335800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 2024-09-12T17:26:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.643+0000 7f2d36335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.644+0000 7f2d36335800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:26:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.644+0000 7f2d36335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.644+0000 7f2d36335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.645+0000 7f2d36335800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:26:22.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.645+0000 7f2d36335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:22.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.645+0000 7f2d36335800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:26:22.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.645+0000 7f2d36335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:22.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.646+0000 7f2d36335800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:26:22.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.646+0000 7f2d36335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:22.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.646+0000 7f2d36335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:22.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.647+0000 7f2d36335800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:26:22.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.647+0000 7f2d36335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:22.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.647+0000 7f2d36335800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:26:22.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.647+0000 7f2d36335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:22.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.648+0000 7f2d36335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:22.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.648+0000 7f2d36335800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:26:22.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.648+0000 7f2d36335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:22.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.649+0000 7f2d36335800 1 NOTICE: finished shard 1 (1 entries found) 2024-09-12T17:26:22.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.649+0000 7f2d36335800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T17:26:22.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.649+0000 7f2d36335800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T17:26:22.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.649+0000 7f2d36335800 1 NOTICE: finished shard 10 (1 entries found) 2024-09-12T17:26:22.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.649+0000 7f2d36335800 1 NOTICE: finished all shards (4 entries found) 2024-09-12T17:26:22.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.650+0000 7f2be8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:22.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.652+0000 7f2d36335800 20 remove_watcher() i=0 2024-09-12T17:26:22.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.652+0000 7f2d36335800 2 removed watcher, disabling cache 2024-09-12T17:26:22.655 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.654+0000 7f2d36335800 20 remove_watcher() i=1 2024-09-12T17:26:22.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.655+0000 7f2d36335800 20 remove_watcher() i=2 2024-09-12T17:26:22.658 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.657+0000 7f2d36335800 20 remove_watcher() i=3 2024-09-12T17:26:22.659 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.658+0000 7f2d36335800 20 remove_watcher() i=4 2024-09-12T17:26:22.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.659+0000 7f2d36335800 20 remove_watcher() i=5 2024-09-12T17:26:22.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.660+0000 7f2d36335800 20 remove_watcher() i=6 2024-09-12T17:26:22.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.661+0000 7f2d36335800 20 remove_watcher() i=7 2024-09-12T17:26:22.674 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: unlinked entries are not listable 2024-09-12T17:26:22.674 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:22.682 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T17:26:22.682 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:22.771 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T17:26:22.771 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:22.772 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:26:22.809 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:22.809 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:22.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.846+0000 7f0b03726800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.847+0000 7f0b03726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.847+0000 7f0b03726800 20 realm 2024-09-12T17:26:22.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.847+0000 7f0b03726800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.848+0000 7f0b03726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.848+0000 7f0b03726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:22.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.848+0000 7f0b03726800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.848+0000 7f0b03726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.848+0000 7f0b03726800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.849+0000 7f0b03726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:22.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.849+0000 7f0b03726800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.849+0000 7f0b03726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:22.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.849+0000 7f0b03726800 20 searching for the correct realm 2024-09-12T17:26:22.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.853+0000 7f0afeb08640 0 -- 172.21.15.44:0/2944488426 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f0af0085060 msgr2=0x7f0af00ab0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:22.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.857+0000 7f0affb0a640 0 -- 172.21.15.44:0/2944488426 >> [v2:172.21.15.181:6810/2228110208,v1:172.21.15.181:6811/2228110208] conn(0x7f0af4028070 msgr2=0x7f0af405c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:22.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:22.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:22.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:22.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:22.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:22.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:22.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:22.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:22.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 20 zone default found 2024-09-12T17:26:22.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 4 Realm: () 2024-09-12T17:26:22.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:22.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:22.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:22.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 20 zonegroup default 2024-09-12T17:26:22.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.861+0000 7f0b03726800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.862+0000 7f0b03726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.862+0000 7f0b03726800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.862+0000 7f0b03726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.862+0000 7f0b03726800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.862+0000 7f0b03726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:22.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.862+0000 7f0b03726800 20 started sync module instance, tier type = 2024-09-12T17:26:22.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.862+0000 7f0b03726800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:22.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.876+0000 7f0b03726800 20 add_watcher() i=0 2024-09-12T17:26:22.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.876+0000 7f0b03726800 20 add_watcher() i=1 2024-09-12T17:26:22.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.876+0000 7f0b03726800 20 add_watcher() i=2 2024-09-12T17:26:22.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.876+0000 7f0b03726800 20 add_watcher() i=3 2024-09-12T17:26:22.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.876+0000 7f0b03726800 20 add_watcher() i=4 2024-09-12T17:26:22.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.876+0000 7f0b03726800 20 add_watcher() i=5 2024-09-12T17:26:22.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.876+0000 7f0b03726800 20 add_watcher() i=6 2024-09-12T17:26:22.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.877+0000 7f0b03726800 20 add_watcher() i=7 2024-09-12T17:26:22.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.877+0000 7f0b03726800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:22.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.878+0000 7f09b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:22.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.879+0000 7f0b03726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:22.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.879+0000 7f0b03726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:22.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.879+0000 7f0b03726800 5 note: GC not initialized 2024-09-12T17:26:22.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.879+0000 7f09b4fe1640 20 reqs_thread_entry: start 2024-09-12T17:26:22.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.879+0000 7f0b03726800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:22.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.879+0000 7f0b03726800 20 Filter name: none 2024-09-12T17:26:22.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.879+0000 7f092e7fc640 20 reqs_thread_entry: start 2024-09-12T17:26:22.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.879+0000 7f0b03726800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:26:22.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.879+0000 7f0b03726800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.880+0000 7f0b03726800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:22.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.880+0000 7f0b03726800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:26:22.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.880+0000 7f0b03726800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:26:22.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.880+0000 7f0b03726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 : miss 2024-09-12T17:26:22.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.880+0000 7f0b03726800 20 rados->read ofs=0 len=0 2024-09-12T17:26:22.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.880+0000 7f0b03726800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:22.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.880+0000 7f0b03726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 info.flags=0x17 2024-09-12T17:26:22.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.880+0000 7f0b03726800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 to cache LRU end 2024-09-12T17:26:22.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.880+0000 7f0b03726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:22.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.880+0000 7f0b03726800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:26:22.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.880+0000 7f0b03726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 2024-09-12T17:26:22.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.880+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:22.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.881+0000 7f0b03726800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:26:22.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.881+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:22.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.882+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:22.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.882+0000 7f0b03726800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:26:22.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.882+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:22.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.882+0000 7f0b03726800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:26:22.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.882+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:22.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.883+0000 7f0b03726800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:26:22.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.883+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:22.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.883+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:22.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.884+0000 7f0b03726800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:26:22.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.884+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:22.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.884+0000 7f0b03726800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:26:22.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.884+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:22.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.885+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:22.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.886+0000 7f0b03726800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:26:22.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.886+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:22.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.887+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:22.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.887+0000 7f0b03726800 20 get_obj_state: octx=0x5594ea61c9b0 obj=check-bucket:e state=0x5594ea8c8db8 s->prefetch_data=0 2024-09-12T17:26:22.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.887+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:22.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.887+0000 7f0b03726800 20 get_obj_state: octx=0x5594ea62a990 obj=check-bucket:d state=0x5594ea8ca7f8 s->prefetch_data=0 2024-09-12T17:26:22.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.887+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:22.890 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.888+0000 7f0b03726800 20 get_obj_state: octx=0x5594ea8c9870 obj=check-bucket:c state=0x5594ea8c6d08 s->prefetch_data=0 2024-09-12T17:26:22.890 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.888+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:22.890 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.888+0000 7f0b03726800 20 get_obj_state: octx=0x5594ea8cc4f0 obj=check-bucket:f state=0x5594ea8c7868 s->prefetch_data=0 2024-09-12T17:26:22.890 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.888+0000 7f0b03726800 20 get_obj_state: setting s->obj_tag to tylnexi16x5cthj0lt9y9eocmtqgv0jd 2024-09-12T17:26:22.890 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.888+0000 7f0b03726800 20 get_obj_state_impl: setting s->olh_tag to bt7d43apx6mbn906b02hpj1md5a5i3r4 2024-09-12T17:26:22.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.888+0000 7f0b03726800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bt7d43apx6mbn906b02hpj1md5a5i3r4 2024-09-12T17:26:22.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.888+0000 7f0b03726800 20 get_obj_state: setting s->obj_tag to jo1izzkva9y6t84054n6m1rqeu22h6w2 2024-09-12T17:26:22.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.888+0000 7f0b03726800 20 get_obj_state_impl: setting s->olh_tag to iuziu0b09dlvu1locj6q5xlla2rp9v9r 2024-09-12T17:26:22.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.888+0000 7f0b03726800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=iuziu0b09dlvu1locj6q5xlla2rp9v9r 2024-09-12T17:26:22.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.888+0000 7f0b03726800 20 get_obj_state: setting s->obj_tag to nz6w3b9fbd3oyxu06qvi55tgiwsa13oe 2024-09-12T17:26:22.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.888+0000 7f0b03726800 20 get_obj_state_impl: setting s->olh_tag to 8w82wh3ggesyacr6p51rxbh6w5lty4z1 2024-09-12T17:26:22.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.888+0000 7f0b03726800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8w82wh3ggesyacr6p51rxbh6w5lty4z1 2024-09-12T17:26:22.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.888+0000 7f0b03726800 20 get_obj_state: setting s->obj_tag to gacbr5gyyvy9ep34t5k2hjjnfgm6mzg6 2024-09-12T17:26:22.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.888+0000 7f0b03726800 20 get_obj_state_impl: setting s->olh_tag to hkiqfi6oql0p72xoxgxt266tp2mpoprk 2024-09-12T17:26:22.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.888+0000 7f0b03726800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=hkiqfi6oql0p72xoxgxt266tp2mpoprk 2024-09-12T17:26:22.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.890+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:22.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.890+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:22.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.890+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:22.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.890+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:22.894 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.892+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:22.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.892+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:22.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.892+0000 7f0b03726800 20 olh_log_entry: epoch=3 op=3 key=d[db.QXwIRxddYgVajq9Zpi3Izav43pbi] 2024-09-12T17:26:22.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.892+0000 7f0b03726800 20 get_obj_state: octx=0x5594ea62a990 obj=check-bucket:_:db.QXwIRxddYgVajq9Zpi3Izav43pbi_d state=0x5594ea97e228 s->prefetch_data=0 2024-09-12T17:26:22.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.893+0000 7f0b03726800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:26:22.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.893+0000 7f0b03726800 20 olh_log_entry: epoch=2 op=3 key=f[G3gshhVdt9VP.CxowjbhG1bF5k9lol.] 2024-09-12T17:26:22.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.893+0000 7f0b03726800 20 get_obj_state: octx=0x5594ea8cc4f0 obj=check-bucket:_:G3gshhVdt9VP.CxowjbhG1bF5k9lol._f state=0x5594ea984f08 s->prefetch_data=0 2024-09-12T17:26:22.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.893+0000 7f0b03726800 10 manifest: total_size = 22 2024-09-12T17:26:22.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.893+0000 7f0b03726800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9044897826896099909 2024-09-12T17:26:22.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.893+0000 7f0b03726800 20 get_obj_state: octx=0x5594ea62a990 obj=check-bucket:_:db.QXwIRxddYgVajq9Zpi3Izav43pbi_d state=0x5594ea97e228 s->prefetch_data=0 2024-09-12T17:26:22.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.893+0000 7f0b03726800 20 prepare_atomic_modification: state is not atomic. state=0x5594ea97e228 2024-09-12T17:26:22.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.893+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:22.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.893+0000 7f0b03726800 10 manifest: total_size = 22 2024-09-12T17:26:22.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.893+0000 7f0b03726800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8017755386784777267 2024-09-12T17:26:22.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.893+0000 7f0b03726800 20 get_obj_state: octx=0x5594ea8cc4f0 obj=check-bucket:_:G3gshhVdt9VP.CxowjbhG1bF5k9lol._f state=0x5594ea984f08 s->prefetch_data=0 2024-09-12T17:26:22.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.893+0000 7f0b03726800 20 prepare_atomic_modification: state is not atomic. state=0x5594ea984f08 2024-09-12T17:26:22.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.893+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:22.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.895+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:22.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.895+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:22.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.895+0000 7f0b03726800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:26:22.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.895+0000 7f0b03726800 20 olh_log_entry: epoch=2 op=3 key=e[LsdETr42.0F7JdfTut0NamLyZwI9Bwx] 2024-09-12T17:26:22.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.895+0000 7f0b03726800 20 get_obj_state: octx=0x5594ea61c9b0 obj=check-bucket:_:LsdETr42.0F7JdfTut0NamLyZwI9Bwx_e state=0x5594ea976368 s->prefetch_data=0 2024-09-12T17:26:22.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.895+0000 7f0b03726800 20 olh_log_entry: epoch=3 op=3 key=c[UR4FzvbLcUzdUIiWeUkzz-IQZJ1HJRa] 2024-09-12T17:26:22.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.895+0000 7f0b03726800 20 get_obj_state: octx=0x5594ea8c9870 obj=check-bucket:_:UR4FzvbLcUzdUIiWeUkzz-IQZJ1HJRa_c state=0x5594ea98f138 s->prefetch_data=0 2024-09-12T17:26:22.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.896+0000 7f0b03726800 10 manifest: total_size = 11 2024-09-12T17:26:22.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.896+0000 7f0b03726800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12025596189648373969 2024-09-12T17:26:22.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.896+0000 7f0b03726800 20 get_obj_state: octx=0x5594ea61c9b0 obj=check-bucket:_:LsdETr42.0F7JdfTut0NamLyZwI9Bwx_e state=0x5594ea976368 s->prefetch_data=0 2024-09-12T17:26:22.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.896+0000 7f0b03726800 20 prepare_atomic_modification: state is not atomic. state=0x5594ea976368 2024-09-12T17:26:22.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.896+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:22.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.896+0000 7f0b03726800 10 manifest: total_size = 22 2024-09-12T17:26:22.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.896+0000 7f0b03726800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17563508718478483815 2024-09-12T17:26:22.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.896+0000 7f0b03726800 20 get_obj_state: octx=0x5594ea8c9870 obj=check-bucket:_:UR4FzvbLcUzdUIiWeUkzz-IQZJ1HJRa_c state=0x5594ea98f138 s->prefetch_data=0 2024-09-12T17:26:22.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.896+0000 7f0b03726800 20 prepare_atomic_modification: state is not atomic. state=0x5594ea98f138 2024-09-12T17:26:22.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.896+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:22.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.898+0000 7f0b03726800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:26:22.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.898+0000 7f0b03726800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:26:22.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.898+0000 7f0b03726800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:26:22.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.898+0000 7f0b03726800 5 delete_objs_inline: removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2__shadow:G3gshhVdt9VP.CxowjbhG1bF5k9lol._.caWcl98Lt-KfJOM1sFj35wgUFg5RL1E_0 2024-09-12T17:26:22.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.898+0000 7f0b03726800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:26:22.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.898+0000 7f0b03726800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:26:22.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.898+0000 7f0b03726800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:26:22.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.898+0000 7f0b03726800 5 delete_objs_inline: removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2__shadow:db.QXwIRxddYgVajq9Zpi3Izav43pbi_.TiveVeVVXMT_j0gvmbKH1ioJXh4f6z1_0 2024-09-12T17:26:22.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.899+0000 7f09e2ffd640 20 handle_completion(): completion ok for obj=d[db.QXwIRxddYgVajq9Zpi3Izav43pbi] 2024-09-12T17:26:22.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.899+0000 7f0b03726800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:26:22.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.899+0000 7f0b03726800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:26:22.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.899+0000 7f0b03726800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:26:22.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.899+0000 7f0b03726800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:26:22.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.899+0000 7f0b03726800 5 delete_objs_inline: removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2__shadow:UR4FzvbLcUzdUIiWeUkzz-IQZJ1HJRa_.LLVIWuwZsh8IEcZih2AilGoYAqCOcTk_0 2024-09-12T17:26:22.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.901+0000 7f0b03726800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:26:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.902+0000 7f0b03726800 20 get_obj_state: octx=0x5594ea8cc4f0 obj=check-bucket:f state=0x5594ea8c7868 s->prefetch_data=0 2024-09-12T17:26:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.902+0000 7f0b03726800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=hkiqfi6oql0p72xoxgxt266tp2mpoprk 2024-09-12T17:26:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.902+0000 7f0b03726800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:26:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.902+0000 7f0b03726800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:26:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.902+0000 7f0b03726800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:26:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.902+0000 7f0b03726800 5 delete_objs_inline: removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2__shadow:LsdETr42.0F7JdfTut0NamLyZwI9Bwx_.wvQcaHsiXKtCLgJVbCRVm8yrX13tP6o_0 2024-09-12T17:26:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.902+0000 7f09e27fc640 20 handle_completion(): completion ok for obj=f[G3gshhVdt9VP.CxowjbhG1bF5k9lol.] 2024-09-12T17:26:22.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.902+0000 7f0b03726800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:26:22.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.903+0000 7f09e27fc640 20 handle_completion(): completion ok for obj=e[LsdETr42.0F7JdfTut0NamLyZwI9Bwx] 2024-09-12T17:26:22.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.903+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:22.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.903+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:22.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.904+0000 7f09e27fc640 20 handle_completion(): completion ok for obj=c[UR4FzvbLcUzdUIiWeUkzz-IQZJ1HJRa] 2024-09-12T17:26:22.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.904+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:22.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.904+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:22.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.907+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:22.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.907+0000 7f0b03726800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:26:22.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.907+0000 7f0b03726800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:26:22.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.907+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:22.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.907+0000 7f0b03726800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:26:22.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.908+0000 7f0b03726800 20 get_obj_state: octx=0x5594ea61c9b0 obj=check-bucket:e state=0x5594ea8c8db8 s->prefetch_data=0 2024-09-12T17:26:22.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.908+0000 7f0b03726800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bt7d43apx6mbn906b02hpj1md5a5i3r4 2024-09-12T17:26:22.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.909+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:22.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.910+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:22.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.910+0000 7f0b03726800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T17:26:22.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.911+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:22.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.912+0000 7f0b03726800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:22.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.912+0000 7f0b03726800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T17:26:22.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.912+0000 7f0b03726800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:26:22.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.913+0000 7f09b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:22.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.915+0000 7f0b03726800 20 remove_watcher() i=0 2024-09-12T17:26:22.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.915+0000 7f0b03726800 2 removed watcher, disabling cache 2024-09-12T17:26:22.918 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.916+0000 7f0b03726800 20 remove_watcher() i=1 2024-09-12T17:26:22.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.917+0000 7f0b03726800 20 remove_watcher() i=2 2024-09-12T17:26:22.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.918+0000 7f0b03726800 20 remove_watcher() i=3 2024-09-12T17:26:22.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.919+0000 7f0b03726800 20 remove_watcher() i=4 2024-09-12T17:26:22.922 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.920+0000 7f0b03726800 20 remove_watcher() i=5 2024-09-12T17:26:22.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.921+0000 7f0b03726800 20 remove_watcher() i=6 2024-09-12T17:26:22.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:22.922+0000 7f0b03726800 20 remove_watcher() i=7 2024-09-12T17:26:22.947 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T17:26:22.947 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:23.004 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T17:26:23.004 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:23.005 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:26:23.039 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:23.039 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:23.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.259+0000 7f00a0c0b640 0 --2- 172.21.15.44:0/1976038541 >> [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] conn(0x559dc393a590 0x559dc3ab1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:26:23.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.278+0000 7f00ad723800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.279+0000 7f00ad723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.279+0000 7f00ad723800 20 realm 2024-09-12T17:26:23.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.279+0000 7f00ad723800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.280+0000 7f00ad723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.280+0000 7f00ad723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:23.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.280+0000 7f00ad723800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.280+0000 7f00ad723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.280+0000 7f00ad723800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.281+0000 7f00ad723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:23.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.281+0000 7f00ad723800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.281+0000 7f00ad723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:23.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.281+0000 7f00ad723800 20 searching for the correct realm 2024-09-12T17:26:23.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.283+0000 7f00a940c640 0 -- 172.21.15.44:0/1800687313 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7f00a4011bc0 msgr2=0x7f00a4027900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:23.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.287+0000 7f00a940c640 0 -- 172.21.15.44:0/1800687313 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7eff74083800 msgr2=0x7eff74085c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:23.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.292+0000 7f00ad723800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:23.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.292+0000 7f00ad723800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:23.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.292+0000 7f00ad723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:23.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.292+0000 7f00ad723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:23.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.292+0000 7f00ad723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:23.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.292+0000 7f00ad723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:23.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.292+0000 7f00ad723800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.292+0000 7f00ad723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.292+0000 7f00ad723800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.292+0000 7f00ad723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:23.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.292+0000 7f00ad723800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.293+0000 7f00ad723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:23.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.293+0000 7f00ad723800 20 zone default found 2024-09-12T17:26:23.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.293+0000 7f00ad723800 4 Realm: () 2024-09-12T17:26:23.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.293+0000 7f00ad723800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:23.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.293+0000 7f00ad723800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:23.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.293+0000 7f00ad723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:23.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.293+0000 7f00ad723800 20 zonegroup default 2024-09-12T17:26:23.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.293+0000 7f00ad723800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.293+0000 7f00ad723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.293+0000 7f00ad723800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.294+0000 7f00ad723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.294+0000 7f00ad723800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.294+0000 7f00ad723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.294+0000 7f00ad723800 20 started sync module instance, tier type = 2024-09-12T17:26:23.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.294+0000 7f00ad723800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:23.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.304+0000 7f00ad723800 20 add_watcher() i=0 2024-09-12T17:26:23.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.304+0000 7f00ad723800 20 add_watcher() i=1 2024-09-12T17:26:23.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.304+0000 7f00ad723800 20 add_watcher() i=2 2024-09-12T17:26:23.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.304+0000 7f00ad723800 20 add_watcher() i=3 2024-09-12T17:26:23.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.304+0000 7f00ad723800 20 add_watcher() i=4 2024-09-12T17:26:23.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.304+0000 7f00ad723800 20 add_watcher() i=5 2024-09-12T17:26:23.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.304+0000 7f00ad723800 20 add_watcher() i=6 2024-09-12T17:26:23.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.307+0000 7f00ad723800 20 add_watcher() i=7 2024-09-12T17:26:23.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.307+0000 7f00ad723800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:23.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.310+0000 7eff5ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:23.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.310+0000 7f00ad723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:23.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.310+0000 7f00ad723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:23.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.310+0000 7f00ad723800 5 note: GC not initialized 2024-09-12T17:26:23.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.310+0000 7eff5efe5640 20 reqs_thread_entry: start 2024-09-12T17:26:23.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.310+0000 7f00ad723800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:23.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.311+0000 7f00ad723800 20 Filter name: none 2024-09-12T17:26:23.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.311+0000 7eff5cfe1640 20 reqs_thread_entry: start 2024-09-12T17:26:23.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.311+0000 7f00ad723800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:26:23.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.311+0000 7f00ad723800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.311+0000 7f00ad723800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:23.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.311+0000 7f00ad723800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:26:23.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.311+0000 7f00ad723800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:26:23.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.311+0000 7f00ad723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 : miss 2024-09-12T17:26:23.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.311+0000 7f00ad723800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.312+0000 7f00ad723800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:23.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.312+0000 7f00ad723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 info.flags=0x17 2024-09-12T17:26:23.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.312+0000 7f00ad723800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 to cache LRU end 2024-09-12T17:26:23.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.312+0000 7f00ad723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:23.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.312+0000 7f00ad723800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:26:23.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.312+0000 7f00ad723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 2024-09-12T17:26:23.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.312+0000 7f00ad723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:23.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.312+0000 7f00ad723800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:26:23.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.312+0000 7f00ad723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:23.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.313+0000 7f00ad723800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:26:23.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.313+0000 7f00ad723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:23.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.313+0000 7f00ad723800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:26:23.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.313+0000 7f00ad723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:23.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.314+0000 7f00ad723800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:26:23.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.314+0000 7f00ad723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:23.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.315+0000 7f00ad723800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:26:23.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.315+0000 7f00ad723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:23.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.316+0000 7f00ad723800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:26:23.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.316+0000 7f00ad723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:23.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.316+0000 7f00ad723800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:26:23.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.316+0000 7f00ad723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:23.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.317+0000 7f00ad723800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:26:23.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.317+0000 7f00ad723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:23.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.317+0000 7f00ad723800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:26:23.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.317+0000 7f00ad723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:23.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.318+0000 7f00ad723800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:26:23.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.318+0000 7f00ad723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:23.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.318+0000 7f00ad723800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:26:23.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.318+0000 7f00ad723800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:26:23.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.319+0000 7eff5ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:23.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.321+0000 7f00ad723800 20 remove_watcher() i=0 2024-09-12T17:26:23.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.321+0000 7f00ad723800 2 removed watcher, disabling cache 2024-09-12T17:26:23.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.323+0000 7f00ad723800 20 remove_watcher() i=1 2024-09-12T17:26:23.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.324+0000 7f00ad723800 20 remove_watcher() i=2 2024-09-12T17:26:23.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.325+0000 7f00ad723800 20 remove_watcher() i=3 2024-09-12T17:26:23.328 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.326+0000 7f00ad723800 20 remove_watcher() i=4 2024-09-12T17:26:23.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.328+0000 7f00ad723800 20 remove_watcher() i=5 2024-09-12T17:26:23.330 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.329+0000 7f00ad723800 20 remove_watcher() i=6 2024-09-12T17:26:23.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.330+0000 7f00ad723800 20 remove_watcher() i=7 2024-09-12T17:26:23.374 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:26:23.406 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:23.406 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:23.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.443+0000 7f44df30a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.445+0000 7f44df30a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.445+0000 7f44df30a800 20 realm 2024-09-12T17:26:23.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.445+0000 7f44df30a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.445+0000 7f44df30a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.445+0000 7f44df30a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:23.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.445+0000 7f44df30a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.445+0000 7f44df30a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.445+0000 7f44df30a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.446+0000 7f44df30a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:23.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.446+0000 7f44df30a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.446+0000 7f44df30a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:23.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.446+0000 7f44df30a800 20 searching for the correct realm 2024-09-12T17:26:23.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.449+0000 7f44d45f3640 0 -- 172.21.15.44:0/3384110078 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f44cc080040 msgr2=0x7f44cc080420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:26:23.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.453+0000 7f44dcdf4640 0 -- 172.21.15.44:0/3384110078 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7f44cc080040 msgr2=0x7f43a8088980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.458+0000 7f44df30a800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.458+0000 7f44df30a800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.458+0000 7f44df30a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.458+0000 7f44df30a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.458+0000 7f44df30a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.458+0000 7f44df30a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.458+0000 7f44df30a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.458+0000 7f44df30a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.458+0000 7f44df30a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.458+0000 7f44df30a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.458+0000 7f44df30a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.459+0000 7f44df30a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.459+0000 7f44df30a800 20 zone default found 2024-09-12T17:26:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.459+0000 7f44df30a800 4 Realm: () 2024-09-12T17:26:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.459+0000 7f44df30a800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.459+0000 7f44df30a800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.459+0000 7f44df30a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.459+0000 7f44df30a800 20 zonegroup default 2024-09-12T17:26:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.459+0000 7f44df30a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.459+0000 7f44df30a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.459+0000 7f44df30a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.459+0000 7f44df30a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.459+0000 7f44df30a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.459+0000 7f44df30a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.460+0000 7f44df30a800 20 started sync module instance, tier type = 2024-09-12T17:26:23.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.460+0000 7f44df30a800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:23.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.470+0000 7f44df30a800 20 add_watcher() i=0 2024-09-12T17:26:23.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.470+0000 7f44df30a800 20 add_watcher() i=1 2024-09-12T17:26:23.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.470+0000 7f44df30a800 20 add_watcher() i=2 2024-09-12T17:26:23.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.470+0000 7f44df30a800 20 add_watcher() i=3 2024-09-12T17:26:23.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.470+0000 7f44df30a800 20 add_watcher() i=4 2024-09-12T17:26:23.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.470+0000 7f44df30a800 20 add_watcher() i=5 2024-09-12T17:26:23.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.471+0000 7f44df30a800 20 add_watcher() i=6 2024-09-12T17:26:23.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.471+0000 7f44df30a800 20 add_watcher() i=7 2024-09-12T17:26:23.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.471+0000 7f44df30a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:23.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.473+0000 7f43937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:23.475 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.473+0000 7f44df30a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:23.475 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.473+0000 7f44df30a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:23.475 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.473+0000 7f44df30a800 5 note: GC not initialized 2024-09-12T17:26:23.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.473+0000 7f43927e4640 20 reqs_thread_entry: start 2024-09-12T17:26:23.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.473+0000 7f44df30a800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:23.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.474+0000 7f44df30a800 20 Filter name: none 2024-09-12T17:26:23.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.474+0000 7f438b7fe640 20 reqs_thread_entry: start 2024-09-12T17:26:23.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.474+0000 7f44df30a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.474+0000 7f44df30a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:23.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.474+0000 7f44df30a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.475+0000 7f44df30a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:23.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.475+0000 7f44df30a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:23.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.475+0000 7f44df30a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:26:23.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.475+0000 7f44df30a800 20 INFO: main: starting shard=0 2024-09-12T17:26:23.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.475+0000 7f44df30a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:23.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.475+0000 7f44df30a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.475+0000 7f44df30a800 20 INFO: main: starting shard=1 2024-09-12T17:26:23.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.475+0000 7f44df30a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:23.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.475+0000 7f44df30a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.475+0000 7f44df30a800 20 INFO: main: starting shard=2 2024-09-12T17:26:23.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.476+0000 7f44df30a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:23.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.476+0000 7f44df30a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.476+0000 7f44df30a800 20 INFO: main: starting shard=3 2024-09-12T17:26:23.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.476+0000 7f44df30a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:23.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.476+0000 7f44df30a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.476+0000 7f44df30a800 20 INFO: main: starting shard=4 2024-09-12T17:26:23.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.476+0000 7f44df30a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:23.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.477+0000 7f44df30a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.477+0000 7f44df30a800 20 INFO: main: starting shard=5 2024-09-12T17:26:23.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.477+0000 7f44df30a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:23.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.477+0000 7f44df30a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.477+0000 7f44df30a800 20 INFO: main: starting shard=6 2024-09-12T17:26:23.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.477+0000 7f44df30a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:23.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.478+0000 7f44df30a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.478+0000 7f44df30a800 20 INFO: main: starting shard=7 2024-09-12T17:26:23.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.478+0000 7f44df30a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:23.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.478+0000 7f44df30a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.478+0000 7f44df30a800 20 INFO: main: starting shard=8 2024-09-12T17:26:23.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.478+0000 7f44df30a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:23.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.479+0000 7f44df30a800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:26:23.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.479+0000 7f44df30a800 20 INFO: main: starting shard=9 2024-09-12T17:26:23.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.479+0000 7f44df30a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:23.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.479+0000 7f44df30a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.479+0000 7f44df30a800 20 INFO: main: starting shard=10 2024-09-12T17:26:23.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.479+0000 7f44df30a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:23.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.480+0000 7f44df30a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.480+0000 7f44df30a800 20 INFO: main: done 2024-09-12T17:26:23.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.480+0000 7f43937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:23.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.483+0000 7f44df30a800 20 remove_watcher() i=0 2024-09-12T17:26:23.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.483+0000 7f44df30a800 2 removed watcher, disabling cache 2024-09-12T17:26:23.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.484+0000 7f44df30a800 20 remove_watcher() i=1 2024-09-12T17:26:23.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.485+0000 7f44df30a800 20 remove_watcher() i=2 2024-09-12T17:26:23.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.486+0000 7f44df30a800 20 remove_watcher() i=3 2024-09-12T17:26:23.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.487+0000 7f44df30a800 20 remove_watcher() i=4 2024-09-12T17:26:23.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.488+0000 7f44df30a800 20 remove_watcher() i=5 2024-09-12T17:26:23.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.489+0000 7f44df30a800 20 remove_watcher() i=6 2024-09-12T17:26:23.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.490+0000 7f44df30a800 20 remove_watcher() i=7 2024-09-12T17:26:23.505 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:26:23.536 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:23.536 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:23.575 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.573+0000 7f5372d34800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.575+0000 7f5372d34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.575+0000 7f5372d34800 20 realm 2024-09-12T17:26:23.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.575+0000 7f5372d34800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.575+0000 7f5372d34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.575+0000 7f5372d34800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:23.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.575+0000 7f5372d34800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.575+0000 7f5372d34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.575+0000 7f5372d34800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.576+0000 7f5372d34800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:23.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.576+0000 7f5372d34800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.576+0000 7f5372d34800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:23.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.576+0000 7f5372d34800 20 searching for the correct realm 2024-09-12T17:26:23.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.580+0000 7f536e2b6640 0 -- 172.21.15.44:0/3519758480 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55c95b074320 msgr2=0x55c95b076710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:23.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.583+0000 7f536eab7640 0 -- 172.21.15.44:0/3519758480 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f5364065cd0 msgr2=0x7f536409d680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:23.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.587+0000 7f5372d34800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:23.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.587+0000 7f5372d34800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:23.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.587+0000 7f5372d34800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:23.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.587+0000 7f5372d34800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:23.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.587+0000 7f5372d34800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:23.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.587+0000 7f5372d34800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:23.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.587+0000 7f5372d34800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.587+0000 7f5372d34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.587+0000 7f5372d34800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.588+0000 7f5372d34800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:23.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.588+0000 7f5372d34800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.588+0000 7f5372d34800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:23.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.588+0000 7f5372d34800 20 zone default found 2024-09-12T17:26:23.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.588+0000 7f5372d34800 4 Realm: () 2024-09-12T17:26:23.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.588+0000 7f5372d34800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:23.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.588+0000 7f5372d34800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:23.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.588+0000 7f5372d34800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:23.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.588+0000 7f5372d34800 20 zonegroup default 2024-09-12T17:26:23.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.588+0000 7f5372d34800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.588+0000 7f5372d34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.588+0000 7f5372d34800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.589+0000 7f5372d34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.589+0000 7f5372d34800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.589+0000 7f5372d34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.589+0000 7f5372d34800 20 started sync module instance, tier type = 2024-09-12T17:26:23.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.589+0000 7f5372d34800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:23.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.601+0000 7f5372d34800 20 add_watcher() i=0 2024-09-12T17:26:23.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.601+0000 7f5372d34800 20 add_watcher() i=1 2024-09-12T17:26:23.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.601+0000 7f5372d34800 20 add_watcher() i=2 2024-09-12T17:26:23.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.601+0000 7f5372d34800 20 add_watcher() i=3 2024-09-12T17:26:23.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.601+0000 7f5372d34800 20 add_watcher() i=4 2024-09-12T17:26:23.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.601+0000 7f5372d34800 20 add_watcher() i=5 2024-09-12T17:26:23.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.601+0000 7f5372d34800 20 add_watcher() i=6 2024-09-12T17:26:23.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.602+0000 7f5372d34800 20 add_watcher() i=7 2024-09-12T17:26:23.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.602+0000 7f5372d34800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:23.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.603+0000 7f52257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:23.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.603+0000 7f5372d34800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:23.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.603+0000 7f5372d34800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:23.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.604+0000 7f5372d34800 5 note: GC not initialized 2024-09-12T17:26:23.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.604+0000 7f519ffff640 20 reqs_thread_entry: start 2024-09-12T17:26:23.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.604+0000 7f5372d34800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:23.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.604+0000 7f5372d34800 20 Filter name: none 2024-09-12T17:26:23.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.604+0000 7f519dffb640 20 reqs_thread_entry: start 2024-09-12T17:26:23.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.604+0000 7f5372d34800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.604+0000 7f5372d34800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:23.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.604+0000 7f5372d34800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.605+0000 7f5372d34800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:23.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.605+0000 7f5372d34800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:23.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.605+0000 7f5372d34800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:26:23.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.605+0000 7f5372d34800 20 INFO: main: starting shard=0 2024-09-12T17:26:23.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.605+0000 7f5372d34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:23.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.606+0000 7f5372d34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.606+0000 7f5372d34800 20 INFO: main: starting shard=1 2024-09-12T17:26:23.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.606+0000 7f5372d34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:23.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.606+0000 7f5372d34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.606+0000 7f5372d34800 20 INFO: main: starting shard=2 2024-09-12T17:26:23.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.606+0000 7f5372d34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:23.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.607+0000 7f5372d34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.607+0000 7f5372d34800 20 INFO: main: starting shard=3 2024-09-12T17:26:23.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.607+0000 7f5372d34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:23.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.607+0000 7f5372d34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.607+0000 7f5372d34800 20 INFO: main: starting shard=4 2024-09-12T17:26:23.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.607+0000 7f5372d34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:23.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.608+0000 7f5372d34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.608+0000 7f5372d34800 20 INFO: main: starting shard=5 2024-09-12T17:26:23.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.608+0000 7f5372d34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:23.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.608+0000 7f5372d34800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:26:23.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.608+0000 7f5372d34800 20 INFO: main: starting shard=6 2024-09-12T17:26:23.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.608+0000 7f5372d34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:23.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.609+0000 7f5372d34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.609+0000 7f5372d34800 20 INFO: main: starting shard=7 2024-09-12T17:26:23.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.609+0000 7f5372d34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:23.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.609+0000 7f5372d34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.609+0000 7f5372d34800 20 INFO: main: starting shard=8 2024-09-12T17:26:23.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.609+0000 7f5372d34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:23.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.610+0000 7f5372d34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.610+0000 7f5372d34800 20 INFO: main: starting shard=9 2024-09-12T17:26:23.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.610+0000 7f5372d34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:23.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.610+0000 7f5372d34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.610+0000 7f5372d34800 20 INFO: main: starting shard=10 2024-09-12T17:26:23.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.610+0000 7f5372d34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:23.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.611+0000 7f5372d34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:23.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.611+0000 7f5372d34800 20 INFO: main: done 2024-09-12T17:26:23.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.611+0000 7f52257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:23.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.614+0000 7f5372d34800 20 remove_watcher() i=0 2024-09-12T17:26:23.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.614+0000 7f5372d34800 2 removed watcher, disabling cache 2024-09-12T17:26:23.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.615+0000 7f5372d34800 20 remove_watcher() i=1 2024-09-12T17:26:23.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.616+0000 7f5372d34800 20 remove_watcher() i=2 2024-09-12T17:26:23.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.617+0000 7f5372d34800 20 remove_watcher() i=3 2024-09-12T17:26:23.619 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.618+0000 7f5372d34800 20 remove_watcher() i=4 2024-09-12T17:26:23.620 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.619+0000 7f5372d34800 20 remove_watcher() i=5 2024-09-12T17:26:23.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.620+0000 7f5372d34800 20 remove_watcher() i=6 2024-09-12T17:26:23.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.621+0000 7f5372d34800 20 remove_watcher() i=7 2024-09-12T17:26:23.634 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T17:26:23.634 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:23.635 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:26:23.667 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:23.667 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:23.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.705+0000 7f3d02f25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.706+0000 7f3d02f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.706+0000 7f3d02f25800 20 realm 2024-09-12T17:26:23.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.706+0000 7f3d02f25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.706+0000 7f3d02f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.706+0000 7f3d02f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:23.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.706+0000 7f3d02f25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.707+0000 7f3d02f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.707+0000 7f3d02f25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.708+0000 7f3d02f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:23.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.708+0000 7f3d02f25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.708+0000 7f3d02f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:23.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.708+0000 7f3d02f25800 20 searching for the correct realm 2024-09-12T17:26:23.713 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.711+0000 7f3cfe3b4640 0 -- 172.21.15.44:0/2137941911 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55a65ce9d410 msgr2=0x55a65ce9f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:23.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.715+0000 7f3cfebb5640 0 -- 172.21.15.44:0/2137941911 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f3cf4023730 msgr2=0x7f3cf4066120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:23.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.922+0000 7f3d02f25800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:23.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.922+0000 7f3d02f25800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:23.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.922+0000 7f3d02f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:23.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.922+0000 7f3d02f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:23.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.922+0000 7f3d02f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:23.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.922+0000 7f3d02f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:23.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.922+0000 7f3d02f25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.922+0000 7f3d02f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.922+0000 7f3d02f25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.922+0000 7f3d02f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:23.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.922+0000 7f3d02f25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.923+0000 7f3d02f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:23.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.923+0000 7f3d02f25800 20 zone default found 2024-09-12T17:26:23.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.923+0000 7f3d02f25800 4 Realm: () 2024-09-12T17:26:23.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.923+0000 7f3d02f25800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:23.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.923+0000 7f3d02f25800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:23.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.923+0000 7f3d02f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:23.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.923+0000 7f3d02f25800 20 zonegroup default 2024-09-12T17:26:23.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.923+0000 7f3d02f25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.923+0000 7f3d02f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.923+0000 7f3d02f25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.923+0000 7f3d02f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.924+0000 7f3d02f25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.924+0000 7f3d02f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.924+0000 7f3d02f25800 20 started sync module instance, tier type = 2024-09-12T17:26:23.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.924+0000 7f3d02f25800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:23.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.937+0000 7f3d02f25800 20 add_watcher() i=0 2024-09-12T17:26:23.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.937+0000 7f3d02f25800 20 add_watcher() i=1 2024-09-12T17:26:23.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.937+0000 7f3d02f25800 20 add_watcher() i=2 2024-09-12T17:26:23.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.937+0000 7f3d02f25800 20 add_watcher() i=3 2024-09-12T17:26:23.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.937+0000 7f3d02f25800 20 add_watcher() i=4 2024-09-12T17:26:23.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.937+0000 7f3d02f25800 20 add_watcher() i=5 2024-09-12T17:26:23.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.937+0000 7f3d02f25800 20 add_watcher() i=6 2024-09-12T17:26:23.941 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.939+0000 7f3d02f25800 20 add_watcher() i=7 2024-09-12T17:26:23.941 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.939+0000 7f3d02f25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:23.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.941+0000 7f3bb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:23.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.942+0000 7f3d02f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:23.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.942+0000 7f3d02f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:23.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.942+0000 7f3d02f25800 5 note: GC not initialized 2024-09-12T17:26:23.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.942+0000 7f3bb4fe1640 20 reqs_thread_entry: start 2024-09-12T17:26:23.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.942+0000 7f3d02f25800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:23.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.942+0000 7f3d02f25800 20 Filter name: none 2024-09-12T17:26:23.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.942+0000 7f3badffb640 20 reqs_thread_entry: start 2024-09-12T17:26:23.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.942+0000 7f3d02f25800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:26:23.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.942+0000 7f3d02f25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.943+0000 7f3d02f25800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:23.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.943+0000 7f3d02f25800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:26:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.943+0000 7f3d02f25800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:26:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.943+0000 7f3d02f25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 : miss 2024-09-12T17:26:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.943+0000 7f3d02f25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.943+0000 7f3d02f25800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.943+0000 7f3d02f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 info.flags=0x17 2024-09-12T17:26:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.943+0000 7f3d02f25800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 to cache LRU end 2024-09-12T17:26:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.943+0000 7f3d02f25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.943+0000 7f3d02f25800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:26:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.943+0000 7f3d02f25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 2024-09-12T17:26:23.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.943+0000 7f3d02f25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:23.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.944+0000 7f3d02f25800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:26:23.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.944+0000 7f3d02f25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:23.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.944+0000 7f3d02f25800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:26:23.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.944+0000 7f3d02f25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:23.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.945+0000 7f3d02f25800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:26:23.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.945+0000 7f3d02f25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:23.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.945+0000 7f3d02f25800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:26:23.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.945+0000 7f3d02f25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:23.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.946+0000 7f3d02f25800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:26:23.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.946+0000 7f3d02f25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:23.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.946+0000 7f3d02f25800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T17:26:23.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.946+0000 7f3d02f25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:23.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.947+0000 7f3d02f25800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:26:23.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.947+0000 7f3d02f25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:23.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.947+0000 7f3d02f25800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:26:23.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.947+0000 7f3d02f25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:23.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.948+0000 7f3d02f25800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T17:26:23.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.948+0000 7f3d02f25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:23.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.948+0000 7f3d02f25800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:26:23.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.948+0000 7f3d02f25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:23.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.949+0000 7f3d02f25800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:26:23.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.949+0000 7f3d02f25800 1 NOTICE: finished all shards (2 entries found) 2024-09-12T17:26:23.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.949+0000 7f3bb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:23.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.952+0000 7f3d02f25800 20 remove_watcher() i=0 2024-09-12T17:26:23.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.952+0000 7f3d02f25800 2 removed watcher, disabling cache 2024-09-12T17:26:23.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.953+0000 7f3d02f25800 20 remove_watcher() i=1 2024-09-12T17:26:23.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.954+0000 7f3d02f25800 20 remove_watcher() i=2 2024-09-12T17:26:23.957 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.956+0000 7f3d02f25800 20 remove_watcher() i=3 2024-09-12T17:26:23.958 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.957+0000 7f3d02f25800 20 remove_watcher() i=4 2024-09-12T17:26:23.959 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.958+0000 7f3d02f25800 20 remove_watcher() i=5 2024-09-12T17:26:23.961 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.959+0000 7f3d02f25800 20 remove_watcher() i=6 2024-09-12T17:26:23.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:23.960+0000 7f3d02f25800 20 remove_watcher() i=7 2024-09-12T17:26:23.974 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T17:26:23.974 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:23.976 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:26:24.009 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:24.009 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:24.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.046+0000 7f2c7272a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.048+0000 7f2c7272a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.048+0000 7f2c7272a800 20 realm 2024-09-12T17:26:24.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.048+0000 7f2c7272a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.048+0000 7f2c7272a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.048+0000 7f2c7272a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:24.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.048+0000 7f2c7272a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.049+0000 7f2c7272a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.049+0000 7f2c7272a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.049+0000 7f2c7272a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:24.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.049+0000 7f2c7272a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.050+0000 7f2c7272a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:24.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.050+0000 7f2c7272a800 20 searching for the correct realm 2024-09-12T17:26:24.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.053+0000 7f2c6dcac640 0 -- 172.21.15.44:0/2179283238 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x5614b3cb33f0 msgr2=0x5614b3cb58b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:24.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.056+0000 7f2c6e4ad640 0 -- 172.21.15.44:0/2179283238 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f2c6401f430 msgr2=0x7f2c6401f890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:24.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:24.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 20 zone default found 2024-09-12T17:26:24.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 4 Realm: () 2024-09-12T17:26:24.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:24.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:24.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:24.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 20 zonegroup default 2024-09-12T17:26:24.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.061+0000 7f2c7272a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.062+0000 7f2c7272a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.062+0000 7f2c7272a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.062+0000 7f2c7272a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.062+0000 7f2c7272a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.062+0000 7f2c7272a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.062+0000 7f2c7272a800 20 started sync module instance, tier type = 2024-09-12T17:26:24.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.062+0000 7f2c7272a800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:24.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.074+0000 7f2c7272a800 20 add_watcher() i=0 2024-09-12T17:26:24.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.074+0000 7f2c7272a800 20 add_watcher() i=1 2024-09-12T17:26:24.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.074+0000 7f2c7272a800 20 add_watcher() i=2 2024-09-12T17:26:24.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.074+0000 7f2c7272a800 20 add_watcher() i=3 2024-09-12T17:26:24.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.074+0000 7f2c7272a800 20 add_watcher() i=4 2024-09-12T17:26:24.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.074+0000 7f2c7272a800 20 add_watcher() i=5 2024-09-12T17:26:24.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.075+0000 7f2c7272a800 20 add_watcher() i=6 2024-09-12T17:26:24.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.075+0000 7f2c7272a800 20 add_watcher() i=7 2024-09-12T17:26:24.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.075+0000 7f2c7272a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:24.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.077+0000 7f2b24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:24.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.077+0000 7f2c7272a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:24.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.077+0000 7f2c7272a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:24.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.077+0000 7f2c7272a800 5 note: GC not initialized 2024-09-12T17:26:24.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.077+0000 7f2a9f7fe640 20 reqs_thread_entry: start 2024-09-12T17:26:24.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.077+0000 7f2c7272a800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:24.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.077+0000 7f2c7272a800 20 Filter name: none 2024-09-12T17:26:24.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.078+0000 7f2a9d7fa640 20 reqs_thread_entry: start 2024-09-12T17:26:24.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.078+0000 7f2c7272a800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:26:24.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.078+0000 7f2c7272a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.078+0000 7f2c7272a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:24.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.078+0000 7f2c7272a800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:26:24.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.078+0000 7f2c7272a800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:26:24.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.078+0000 7f2c7272a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 : miss 2024-09-12T17:26:24.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.078+0000 7f2c7272a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.079+0000 7f2c7272a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:24.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.079+0000 7f2c7272a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 info.flags=0x17 2024-09-12T17:26:24.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.079+0000 7f2c7272a800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 to cache LRU end 2024-09-12T17:26:24.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.079+0000 7f2c7272a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:24.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.079+0000 7f2c7272a800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:26:24.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.079+0000 7f2c7272a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 2024-09-12T17:26:24.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.079+0000 7f2c7272a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:24.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.079+0000 7f2c7272a800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:26:24.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.079+0000 7f2c7272a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:24.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.080+0000 7f2c7272a800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T17:26:24.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.080+0000 7f2c7272a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:24.083 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.080+0000 7f2c7272a800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:26:24.083 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.080+0000 7f2c7272a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:24.083 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.081+0000 7f2c7272a800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:26:24.083 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.081+0000 7f2c7272a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:24.083 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.082+0000 7f2c7272a800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:26:24.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.082+0000 7f2c7272a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:24.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.082+0000 7f2c7272a800 20 get_obj_state: octx=0x5614b3a379a0 obj=check-bucket:d state=0x5614b3ce4e58 s->prefetch_data=0 2024-09-12T17:26:24.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.082+0000 7f2c7272a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:24.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.083+0000 7f2c7272a800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:26:24.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.083+0000 7f2c7272a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:24.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.083+0000 7f2c7272a800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:26:24.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.083+0000 7f2c7272a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:24.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.084+0000 7f2c7272a800 20 get_obj_state: octx=0x5614b3a45980 obj=check-bucket:c state=0x5614b3ce5f88 s->prefetch_data=0 2024-09-12T17:26:24.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.084+0000 7f2c7272a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:24.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.084+0000 7f2c7272a800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:26:24.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.084+0000 7f2c7272a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:24.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.084+0000 7f2c7272a800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T17:26:24.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.084+0000 7f2c7272a800 20 get_obj_state: setting s->obj_tag to jo1izzkva9y6t84054n6m1rqeu22h6w2 2024-09-12T17:26:24.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.084+0000 7f2c7272a800 20 get_obj_state_impl: setting s->olh_tag to iuziu0b09dlvu1locj6q5xlla2rp9v9r 2024-09-12T17:26:24.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.085+0000 7f2c7272a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:24.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.085+0000 7f2c7272a800 20 get_obj_state: setting s->obj_tag to nz6w3b9fbd3oyxu06qvi55tgiwsa13oe 2024-09-12T17:26:24.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.085+0000 7f2c7272a800 20 get_obj_state_impl: setting s->olh_tag to 8w82wh3ggesyacr6p51rxbh6w5lty4z1 2024-09-12T17:26:24.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.085+0000 7f2c7272a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:24.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.085+0000 7f2c7272a800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T17:26:24.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.085+0000 7f2c7272a800 20 olh_log_entry: epoch=4 op=3 key=c[3vzowQKEd0eTxbLtAu3Be6hr0qStGZ3] 2024-09-12T17:26:24.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.085+0000 7f2c7272a800 20 get_obj_state: octx=0x5614b3d3e9b0 obj=check-bucket:_:3vzowQKEd0eTxbLtAu3Be6hr0qStGZ3_c state=0x5614b3d42438 s->prefetch_data=0 2024-09-12T17:26:24.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.085+0000 7f2c7272a800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T17:26:24.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.085+0000 7f2c7272a800 20 olh_log_entry: epoch=4 op=3 key=d[vM3E3B.vL.i0cS2S2YeoPwBxsz6thTy] 2024-09-12T17:26:24.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.085+0000 7f2c7272a800 20 get_obj_state: octx=0x5614b3d1e9b0 obj=check-bucket:_:vM3E3B.vL.i0cS2S2YeoPwBxsz6thTy_d state=0x5614b3d4aa08 s->prefetch_data=0 2024-09-12T17:26:24.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.086+0000 7f2c7272a800 20 get_obj_state: octx=0x5614b3d1e9b0 obj=check-bucket:d state=0x5614b3d47828 s->prefetch_data=0 2024-09-12T17:26:24.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.086+0000 7f2c7272a800 20 get_obj_state: octx=0x5614b3d3e9b0 obj=check-bucket:c state=0x5614b3ce0c48 s->prefetch_data=0 2024-09-12T17:26:24.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.087+0000 7f2c7272a800 20 get_obj_state: setting s->obj_tag to jo1izzkva9y6t84054n6m1rqeu22h6w2 2024-09-12T17:26:24.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.087+0000 7f2c7272a800 20 get_obj_state_impl: setting s->olh_tag to iuziu0b09dlvu1locj6q5xlla2rp9v9r 2024-09-12T17:26:24.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.087+0000 7f2c7272a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=iuziu0b09dlvu1locj6q5xlla2rp9v9r 2024-09-12T17:26:24.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.087+0000 7f2c7272a800 20 get_obj_state: setting s->obj_tag to nz6w3b9fbd3oyxu06qvi55tgiwsa13oe 2024-09-12T17:26:24.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.087+0000 7f2c7272a800 20 get_obj_state_impl: setting s->olh_tag to 8w82wh3ggesyacr6p51rxbh6w5lty4z1 2024-09-12T17:26:24.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.087+0000 7f2c7272a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8w82wh3ggesyacr6p51rxbh6w5lty4z1 2024-09-12T17:26:24.093 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.091+0000 7f2c7272a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:24.093 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.092+0000 7f2c7272a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:24.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.094+0000 7f2c7272a800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:26:24.098 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.097+0000 7f2c7272a800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:26:24.098 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.097+0000 7f2c7272a800 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T17:26:24.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.098+0000 7f2b24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:24.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.100+0000 7f2c7272a800 20 remove_watcher() i=0 2024-09-12T17:26:24.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.100+0000 7f2c7272a800 2 removed watcher, disabling cache 2024-09-12T17:26:24.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.101+0000 7f2c7272a800 20 remove_watcher() i=1 2024-09-12T17:26:24.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.102+0000 7f2c7272a800 20 remove_watcher() i=2 2024-09-12T17:26:24.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.103+0000 7f2c7272a800 20 remove_watcher() i=3 2024-09-12T17:26:24.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.104+0000 7f2c7272a800 20 remove_watcher() i=4 2024-09-12T17:26:24.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.105+0000 7f2c7272a800 20 remove_watcher() i=5 2024-09-12T17:26:24.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.106+0000 7f2c7272a800 20 remove_watcher() i=6 2024-09-12T17:26:24.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.107+0000 7f2c7272a800 20 remove_watcher() i=7 2024-09-12T17:26:24.122 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:26:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:24.153 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:24.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.191+0000 7f896f124800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.192+0000 7f896f124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.192+0000 7f896f124800 20 realm 2024-09-12T17:26:24.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.192+0000 7f896f124800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.192+0000 7f896f124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.192+0000 7f896f124800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:24.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.192+0000 7f896f124800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.193+0000 7f896f124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.193+0000 7f896f124800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.193+0000 7f896f124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:24.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.193+0000 7f896f124800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.194+0000 7f896f124800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:24.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.194+0000 7f896f124800 20 searching for the correct realm 2024-09-12T17:26:24.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.197+0000 7f896b5d3640 0 -- 172.21.15.44:0/1587227832 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f8960044040 msgr2=0x7f8960045940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:24.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.200+0000 7f896add2640 0 -- 172.21.15.44:0/1587227832 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f8960057410 msgr2=0x7f8960057870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:24.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.205+0000 7f896f124800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:24.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.205+0000 7f896f124800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:24.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.205+0000 7f896f124800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:24.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.205+0000 7f896f124800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:24.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.205+0000 7f896f124800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:24.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.205+0000 7f896f124800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:24.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.205+0000 7f896f124800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.205+0000 7f896f124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.205+0000 7f896f124800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.205+0000 7f896f124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:24.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.205+0000 7f896f124800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.206+0000 7f896f124800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:24.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.206+0000 7f896f124800 20 zone default found 2024-09-12T17:26:24.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.206+0000 7f896f124800 4 Realm: () 2024-09-12T17:26:24.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.206+0000 7f896f124800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:24.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.206+0000 7f896f124800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:24.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.206+0000 7f896f124800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:24.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.206+0000 7f896f124800 20 zonegroup default 2024-09-12T17:26:24.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.206+0000 7f896f124800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.206+0000 7f896f124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.206+0000 7f896f124800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.206+0000 7f896f124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.206+0000 7f896f124800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.207+0000 7f896f124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.207+0000 7f896f124800 20 started sync module instance, tier type = 2024-09-12T17:26:24.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.207+0000 7f896f124800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:24.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.219+0000 7f896f124800 20 add_watcher() i=0 2024-09-12T17:26:24.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.219+0000 7f896f124800 20 add_watcher() i=1 2024-09-12T17:26:24.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.219+0000 7f896f124800 20 add_watcher() i=2 2024-09-12T17:26:24.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.219+0000 7f896f124800 20 add_watcher() i=3 2024-09-12T17:26:24.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.219+0000 7f896f124800 20 add_watcher() i=4 2024-09-12T17:26:24.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.219+0000 7f896f124800 20 add_watcher() i=5 2024-09-12T17:26:24.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.219+0000 7f896f124800 20 add_watcher() i=6 2024-09-12T17:26:24.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.220+0000 7f896f124800 20 add_watcher() i=7 2024-09-12T17:26:24.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.220+0000 7f896f124800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:24.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.221+0000 7f88217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:24.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.222+0000 7f896f124800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:24.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.222+0000 7f896f124800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:24.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.222+0000 7f896f124800 5 note: GC not initialized 2024-09-12T17:26:24.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.222+0000 7f879bfff640 20 reqs_thread_entry: start 2024-09-12T17:26:24.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.222+0000 7f896f124800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:24.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.222+0000 7f896f124800 20 Filter name: none 2024-09-12T17:26:24.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.222+0000 7f8799ffb640 20 reqs_thread_entry: start 2024-09-12T17:26:24.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.222+0000 7f896f124800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.223+0000 7f896f124800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:24.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.223+0000 7f896f124800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.223+0000 7f896f124800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:24.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.223+0000 7f896f124800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:24.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.223+0000 7f896f124800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:26:24.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.223+0000 7f896f124800 20 INFO: main: starting shard=0 2024-09-12T17:26:24.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.223+0000 7f896f124800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:24.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.223+0000 7f896f124800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.223+0000 7f896f124800 20 INFO: main: starting shard=1 2024-09-12T17:26:24.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.223+0000 7f896f124800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:24.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.224+0000 7f896f124800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.224+0000 7f896f124800 20 INFO: main: starting shard=2 2024-09-12T17:26:24.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.224+0000 7f896f124800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:24.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.224+0000 7f896f124800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.224+0000 7f896f124800 20 INFO: main: starting shard=3 2024-09-12T17:26:24.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.224+0000 7f896f124800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:24.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.225+0000 7f896f124800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.225+0000 7f896f124800 20 INFO: main: starting shard=4 2024-09-12T17:26:24.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.225+0000 7f896f124800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:24.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.225+0000 7f896f124800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.225+0000 7f896f124800 20 INFO: main: starting shard=5 2024-09-12T17:26:24.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.225+0000 7f896f124800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:24.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.226+0000 7f896f124800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.226+0000 7f896f124800 20 INFO: main: starting shard=6 2024-09-12T17:26:24.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.226+0000 7f896f124800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:24.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.227+0000 7f896f124800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.227+0000 7f896f124800 20 INFO: main: starting shard=7 2024-09-12T17:26:24.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.227+0000 7f896f124800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:24.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.227+0000 7f896f124800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.227+0000 7f896f124800 20 INFO: main: starting shard=8 2024-09-12T17:26:24.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.227+0000 7f896f124800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:24.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.228+0000 7f896f124800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.228+0000 7f896f124800 20 INFO: main: starting shard=9 2024-09-12T17:26:24.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.228+0000 7f896f124800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:24.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.228+0000 7f896f124800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.228+0000 7f896f124800 20 INFO: main: starting shard=10 2024-09-12T17:26:24.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.228+0000 7f896f124800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:24.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.228+0000 7f896f124800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.228+0000 7f896f124800 20 INFO: main: done 2024-09-12T17:26:24.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.229+0000 7f88217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:24.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.232+0000 7f896f124800 20 remove_watcher() i=0 2024-09-12T17:26:24.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.232+0000 7f896f124800 2 removed watcher, disabling cache 2024-09-12T17:26:24.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.233+0000 7f896f124800 20 remove_watcher() i=1 2024-09-12T17:26:24.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.234+0000 7f896f124800 20 remove_watcher() i=2 2024-09-12T17:26:24.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.235+0000 7f896f124800 20 remove_watcher() i=3 2024-09-12T17:26:24.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.236+0000 7f896f124800 20 remove_watcher() i=4 2024-09-12T17:26:24.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.237+0000 7f896f124800 20 remove_watcher() i=5 2024-09-12T17:26:24.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.238+0000 7f896f124800 20 remove_watcher() i=6 2024-09-12T17:26:24.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.239+0000 7f896f124800 20 remove_watcher() i=7 2024-09-12T17:26:24.253 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:26:24.285 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:24.285 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:24.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.322+0000 7f99ff80e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.323+0000 7f99ff80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.323+0000 7f99ff80e800 20 realm 2024-09-12T17:26:24.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.323+0000 7f99ff80e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.324+0000 7f99ff80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.324+0000 7f99ff80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:24.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.324+0000 7f99ff80e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.324+0000 7f99ff80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.324+0000 7f99ff80e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.325+0000 7f99ff80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:24.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.325+0000 7f99ff80e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.325+0000 7f99ff80e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:24.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.325+0000 7f99ff80e800 20 searching for the correct realm 2024-09-12T17:26:24.330 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.328+0000 7f99fa76a640 0 -- 172.21.15.44:0/357892151 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x558c515c3650 msgr2=0x558c515c5aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:24.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.332+0000 7f99fa76a640 0 -- 172.21.15.44:0/357892151 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f99ec071820 msgr2=0x7f99ec0677a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:24.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.335+0000 7f99ff80e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:24.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.335+0000 7f99ff80e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:24.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.335+0000 7f99ff80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:24.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.335+0000 7f99ff80e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:24.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.335+0000 7f99ff80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:24.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.335+0000 7f99ff80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.335+0000 7f99ff80e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.335+0000 7f99ff80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.335+0000 7f99ff80e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.336+0000 7f99ff80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.336+0000 7f99ff80e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.336+0000 7f99ff80e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.336+0000 7f99ff80e800 20 zone default found 2024-09-12T17:26:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.336+0000 7f99ff80e800 4 Realm: () 2024-09-12T17:26:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.336+0000 7f99ff80e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.336+0000 7f99ff80e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.336+0000 7f99ff80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.336+0000 7f99ff80e800 20 zonegroup default 2024-09-12T17:26:24.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.336+0000 7f99ff80e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.336+0000 7f99ff80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.336+0000 7f99ff80e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.337+0000 7f99ff80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.337+0000 7f99ff80e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.337+0000 7f99ff80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.337+0000 7f99ff80e800 20 started sync module instance, tier type = 2024-09-12T17:26:24.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.337+0000 7f99ff80e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:24.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.350+0000 7f99ff80e800 20 add_watcher() i=0 2024-09-12T17:26:24.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.350+0000 7f99ff80e800 20 add_watcher() i=1 2024-09-12T17:26:24.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.350+0000 7f99ff80e800 20 add_watcher() i=2 2024-09-12T17:26:24.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.350+0000 7f99ff80e800 20 add_watcher() i=3 2024-09-12T17:26:24.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.350+0000 7f99ff80e800 20 add_watcher() i=4 2024-09-12T17:26:24.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.350+0000 7f99ff80e800 20 add_watcher() i=5 2024-09-12T17:26:24.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.353+0000 7f99ff80e800 20 add_watcher() i=6 2024-09-12T17:26:24.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.353+0000 7f99ff80e800 20 add_watcher() i=7 2024-09-12T17:26:24.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.353+0000 7f99ff80e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:24.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.356+0000 7f98b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:24.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.356+0000 7f99ff80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:24.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.356+0000 7f99ff80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:24.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.356+0000 7f99ff80e800 5 note: GC not initialized 2024-09-12T17:26:24.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.356+0000 7f982bfff640 20 reqs_thread_entry: start 2024-09-12T17:26:24.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.356+0000 7f99ff80e800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:24.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.356+0000 7f99ff80e800 20 Filter name: none 2024-09-12T17:26:24.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.356+0000 7f9829ffb640 20 reqs_thread_entry: start 2024-09-12T17:26:24.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.357+0000 7f99ff80e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.357+0000 7f99ff80e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:24.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.357+0000 7f99ff80e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.357+0000 7f99ff80e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:24.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.357+0000 7f99ff80e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:24.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.357+0000 7f99ff80e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:26:24.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.357+0000 7f99ff80e800 20 INFO: main: starting shard=0 2024-09-12T17:26:24.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.357+0000 7f99ff80e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:24.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.358+0000 7f99ff80e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.358+0000 7f99ff80e800 20 INFO: main: starting shard=1 2024-09-12T17:26:24.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.358+0000 7f99ff80e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:24.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.358+0000 7f99ff80e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.358+0000 7f99ff80e800 20 INFO: main: starting shard=2 2024-09-12T17:26:24.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.358+0000 7f99ff80e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:24.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.359+0000 7f99ff80e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.359+0000 7f99ff80e800 20 INFO: main: starting shard=3 2024-09-12T17:26:24.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.359+0000 7f99ff80e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:24.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.359+0000 7f99ff80e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.359+0000 7f99ff80e800 20 INFO: main: starting shard=4 2024-09-12T17:26:24.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.359+0000 7f99ff80e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:24.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.360+0000 7f99ff80e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.360+0000 7f99ff80e800 20 INFO: main: starting shard=5 2024-09-12T17:26:24.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.360+0000 7f99ff80e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:24.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.360+0000 7f99ff80e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.360+0000 7f99ff80e800 20 INFO: main: starting shard=6 2024-09-12T17:26:24.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.360+0000 7f99ff80e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:24.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.361+0000 7f99ff80e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.361+0000 7f99ff80e800 20 INFO: main: starting shard=7 2024-09-12T17:26:24.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.361+0000 7f99ff80e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:24.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.361+0000 7f99ff80e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.361+0000 7f99ff80e800 20 INFO: main: starting shard=8 2024-09-12T17:26:24.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.361+0000 7f99ff80e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:24.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.362+0000 7f99ff80e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.362+0000 7f99ff80e800 20 INFO: main: starting shard=9 2024-09-12T17:26:24.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.362+0000 7f99ff80e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:24.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.362+0000 7f99ff80e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.362+0000 7f99ff80e800 20 INFO: main: starting shard=10 2024-09-12T17:26:24.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.362+0000 7f99ff80e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:24.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.363+0000 7f99ff80e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:24.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.363+0000 7f99ff80e800 20 INFO: main: done 2024-09-12T17:26:24.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.364+0000 7f98b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:24.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.366+0000 7f99ff80e800 20 remove_watcher() i=0 2024-09-12T17:26:24.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.366+0000 7f99ff80e800 2 removed watcher, disabling cache 2024-09-12T17:26:24.369 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.367+0000 7f99ff80e800 20 remove_watcher() i=1 2024-09-12T17:26:24.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.368+0000 7f99ff80e800 20 remove_watcher() i=2 2024-09-12T17:26:24.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.369+0000 7f99ff80e800 20 remove_watcher() i=3 2024-09-12T17:26:24.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.370+0000 7f99ff80e800 20 remove_watcher() i=4 2024-09-12T17:26:24.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.371+0000 7f99ff80e800 20 remove_watcher() i=5 2024-09-12T17:26:24.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.372+0000 7f99ff80e800 20 remove_watcher() i=6 2024-09-12T17:26:24.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.373+0000 7f99ff80e800 20 remove_watcher() i=7 2024-09-12T17:26:24.386 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T17:26:24.386 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:24.387 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:26:24.420 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:24.420 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:24.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.458+0000 7f3701614800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.459+0000 7f3701614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.459+0000 7f3701614800 20 realm 2024-09-12T17:26:24.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.459+0000 7f3701614800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.459+0000 7f3701614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.459+0000 7f3701614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:24.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.459+0000 7f3701614800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.459+0000 7f3701614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.459+0000 7f3701614800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.460+0000 7f3701614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:24.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.460+0000 7f3701614800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.461+0000 7f3701614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:24.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.461+0000 7f3701614800 20 searching for the correct realm 2024-09-12T17:26:24.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.463+0000 7f36f44ca640 0 -- 172.21.15.44:0/3873244743 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f36ec08b030 msgr2=0x7f36ec09b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:24.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.668+0000 7f36fcccb640 0 -- 172.21.15.44:0/3873244743 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f36e407a910 msgr2=0x7f36e4027020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:24.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.874+0000 7f3701614800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:24.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.874+0000 7f3701614800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:24.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.874+0000 7f3701614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:24.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.874+0000 7f3701614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:24.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.874+0000 7f3701614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:24.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.874+0000 7f3701614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:24.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.874+0000 7f3701614800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.875+0000 7f3701614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.875+0000 7f3701614800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.875+0000 7f3701614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:24.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.875+0000 7f3701614800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.876+0000 7f3701614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:24.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.876+0000 7f3701614800 20 zone default found 2024-09-12T17:26:24.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.876+0000 7f3701614800 4 Realm: () 2024-09-12T17:26:24.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.876+0000 7f3701614800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:24.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.876+0000 7f3701614800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:24.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.876+0000 7f3701614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:24.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.876+0000 7f3701614800 20 zonegroup default 2024-09-12T17:26:24.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.876+0000 7f3701614800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.876+0000 7f3701614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.876+0000 7f3701614800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.876+0000 7f3701614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.876+0000 7f3701614800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.877+0000 7f3701614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.877+0000 7f3701614800 20 started sync module instance, tier type = 2024-09-12T17:26:24.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.877+0000 7f3701614800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:24.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.891+0000 7f3701614800 20 add_watcher() i=0 2024-09-12T17:26:24.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.891+0000 7f3701614800 20 add_watcher() i=1 2024-09-12T17:26:24.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.891+0000 7f3701614800 20 add_watcher() i=2 2024-09-12T17:26:24.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.891+0000 7f3701614800 20 add_watcher() i=3 2024-09-12T17:26:24.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.891+0000 7f3701614800 20 add_watcher() i=4 2024-09-12T17:26:24.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.891+0000 7f3701614800 20 add_watcher() i=5 2024-09-12T17:26:24.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.891+0000 7f3701614800 20 add_watcher() i=6 2024-09-12T17:26:24.894 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.892+0000 7f3701614800 20 add_watcher() i=7 2024-09-12T17:26:24.894 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.892+0000 7f3701614800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:24.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.894+0000 7f35b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:24.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.894+0000 7f3701614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:24.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.894+0000 7f3701614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:24.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.895+0000 7f3701614800 5 note: GC not initialized 2024-09-12T17:26:24.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.895+0000 7f35b27e4640 20 reqs_thread_entry: start 2024-09-12T17:26:24.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.895+0000 7f3701614800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:24.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.895+0000 7f3701614800 20 Filter name: none 2024-09-12T17:26:24.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.895+0000 7f35ab7fe640 20 reqs_thread_entry: start 2024-09-12T17:26:24.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.895+0000 7f3701614800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:26:24.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.895+0000 7f3701614800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.896+0000 7f3701614800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:24.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.896+0000 7f3701614800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:26:24.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.896+0000 7f3701614800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:26:24.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.896+0000 7f3701614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 : miss 2024-09-12T17:26:24.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.896+0000 7f3701614800 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.896+0000 7f3701614800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:24.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.896+0000 7f3701614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 info.flags=0x17 2024-09-12T17:26:24.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.896+0000 7f3701614800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 to cache LRU end 2024-09-12T17:26:24.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.896+0000 7f3701614800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:24.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.896+0000 7f3701614800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:26:24.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.896+0000 7f3701614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 2024-09-12T17:26:24.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.896+0000 7f3701614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:24.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.897+0000 7f3701614800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:26:24.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.897+0000 7f3701614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:24.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.897+0000 7f3701614800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:26:24.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.897+0000 7f3701614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:24.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.898+0000 7f3701614800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:26:24.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.898+0000 7f3701614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:24.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.898+0000 7f3701614800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:26:24.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.898+0000 7f3701614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:24.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.899+0000 7f3701614800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:26:24.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.899+0000 7f3701614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:24.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.899+0000 7f3701614800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:26:24.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.900+0000 7f3701614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:24.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.900+0000 7f3701614800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:26:24.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.900+0000 7f3701614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:24.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.900+0000 7f3701614800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:26:24.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.900+0000 7f3701614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:24.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.901+0000 7f3701614800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:26:24.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.901+0000 7f3701614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:24.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.902+0000 7f3701614800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:26:24.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.902+0000 7f3701614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:24.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.902+0000 7f3701614800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:26:24.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.902+0000 7f3701614800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:26:24.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.903+0000 7f35b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:24.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.906+0000 7f3701614800 20 remove_watcher() i=0 2024-09-12T17:26:24.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.906+0000 7f3701614800 2 removed watcher, disabling cache 2024-09-12T17:26:24.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.907+0000 7f3701614800 20 remove_watcher() i=1 2024-09-12T17:26:24.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.908+0000 7f3701614800 20 remove_watcher() i=2 2024-09-12T17:26:24.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.909+0000 7f3701614800 20 remove_watcher() i=3 2024-09-12T17:26:24.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.910+0000 7f3701614800 20 remove_watcher() i=4 2024-09-12T17:26:24.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.911+0000 7f3701614800 20 remove_watcher() i=5 2024-09-12T17:26:24.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.913+0000 7f3701614800 20 remove_watcher() i=6 2024-09-12T17:26:24.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:24.914+0000 7f3701614800 20 remove_watcher() i=7 2024-09-12T17:26:24.927 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T17:26:24.927 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:24.980 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T17:26:24.980 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:26:25.182 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:26:25.588 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:26:27.056 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:26:27.058 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:26:27.093 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:27.093 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:27.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.136+0000 7f8aab335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.138+0000 7f8aab335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.138+0000 7f8aab335800 20 realm 2024-09-12T17:26:27.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.138+0000 7f8aab335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.139+0000 7f8aab335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.139+0000 7f8aab335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:27.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.139+0000 7f8aab335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.139+0000 7f8aab335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.139+0000 7f8aab335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.140+0000 7f8aab335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:27.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.140+0000 7f8aab335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.140+0000 7f8aab335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:27.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.140+0000 7f8aab335800 20 searching for the correct realm 2024-09-12T17:26:27.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.143+0000 7f8aa68e3640 0 -- 172.21.15.44:0/617950586 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f8a98058040 msgr2=0x7f8a98058930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:27.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.351+0000 7f8aa70e4640 0 -- 172.21.15.44:0/617950586 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f8a9c0664b0 msgr2=0x7f8a9c05c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:26:27.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.558+0000 7f8aab335800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:27.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.558+0000 7f8aab335800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:27.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.558+0000 7f8aab335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:27.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.558+0000 7f8aab335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:27.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.558+0000 7f8aab335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:27.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.558+0000 7f8aab335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:27.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.559+0000 7f8aab335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.559+0000 7f8aab335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.559+0000 7f8aab335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.559+0000 7f8aab335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:27.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.559+0000 7f8aab335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.560+0000 7f8aab335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:27.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.560+0000 7f8aab335800 20 zone default found 2024-09-12T17:26:27.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.560+0000 7f8aab335800 4 Realm: () 2024-09-12T17:26:27.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.560+0000 7f8aab335800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:27.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.560+0000 7f8aab335800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:27.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.560+0000 7f8aab335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:27.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.560+0000 7f8aab335800 20 zonegroup default 2024-09-12T17:26:27.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.560+0000 7f8aab335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.560+0000 7f8aab335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.560+0000 7f8aab335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.561+0000 7f8aab335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.561+0000 7f8aab335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.561+0000 7f8aab335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.561+0000 7f8aab335800 20 started sync module instance, tier type = 2024-09-12T17:26:27.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.561+0000 7f8aab335800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:27.575 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.574+0000 7f8aab335800 20 add_watcher() i=0 2024-09-12T17:26:27.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.574+0000 7f8aab335800 20 add_watcher() i=1 2024-09-12T17:26:27.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.574+0000 7f8aab335800 20 add_watcher() i=2 2024-09-12T17:26:27.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.574+0000 7f8aab335800 20 add_watcher() i=3 2024-09-12T17:26:27.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.574+0000 7f8aab335800 20 add_watcher() i=4 2024-09-12T17:26:27.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.574+0000 7f8aab335800 20 add_watcher() i=5 2024-09-12T17:26:27.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.574+0000 7f8aab335800 20 add_watcher() i=6 2024-09-12T17:26:27.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.575+0000 7f8aab335800 20 add_watcher() i=7 2024-09-12T17:26:27.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.575+0000 7f8aab335800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:27.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.577+0000 7f895dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:27.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.577+0000 7f8aab335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:27.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.577+0000 7f8aab335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:27.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.577+0000 7f8aab335800 5 note: GC not initialized 2024-09-12T17:26:27.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.578+0000 7f895cfe1640 20 reqs_thread_entry: start 2024-09-12T17:26:27.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.578+0000 7f8aab335800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:27.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.578+0000 7f8aab335800 20 Filter name: none 2024-09-12T17:26:27.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.578+0000 7f88d67fc640 20 reqs_thread_entry: start 2024-09-12T17:26:27.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.578+0000 7f8aab335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.578+0000 7f8aab335800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:27.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.578+0000 7f8aab335800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.579+0000 7f8aab335800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:27.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.579+0000 7f8aab335800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:27.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.579+0000 7f8aab335800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:26:27.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.579+0000 7f8aab335800 20 INFO: main: starting shard=0 2024-09-12T17:26:27.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.579+0000 7f8aab335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:27.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.580+0000 7f8aab335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.580+0000 7f8aab335800 20 INFO: main: starting shard=1 2024-09-12T17:26:27.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.580+0000 7f8aab335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:27.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.580+0000 7f8aab335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.580+0000 7f8aab335800 20 INFO: main: starting shard=2 2024-09-12T17:26:27.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.580+0000 7f8aab335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:27.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.581+0000 7f8aab335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.581+0000 7f8aab335800 20 INFO: main: starting shard=3 2024-09-12T17:26:27.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.581+0000 7f8aab335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:27.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.582+0000 7f8aab335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.582+0000 7f8aab335800 20 INFO: main: starting shard=4 2024-09-12T17:26:27.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.582+0000 7f8aab335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:27.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.583+0000 7f8aab335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.583+0000 7f8aab335800 20 INFO: main: starting shard=5 2024-09-12T17:26:27.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.583+0000 7f8aab335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:27.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.583+0000 7f8aab335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.583+0000 7f8aab335800 20 INFO: main: starting shard=6 2024-09-12T17:26:27.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.583+0000 7f8aab335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:27.586 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.584+0000 7f8aab335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.586 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.584+0000 7f8aab335800 20 INFO: main: starting shard=7 2024-09-12T17:26:27.586 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.584+0000 7f8aab335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:27.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.585+0000 7f8aab335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.585+0000 7f8aab335800 20 INFO: main: starting shard=8 2024-09-12T17:26:27.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.585+0000 7f8aab335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:27.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.586+0000 7f8aab335800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:26:27.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.586+0000 7f8aab335800 20 INFO: main: starting shard=9 2024-09-12T17:26:27.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.586+0000 7f8aab335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:27.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.586+0000 7f8aab335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.586+0000 7f8aab335800 20 INFO: main: starting shard=10 2024-09-12T17:26:27.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.586+0000 7f8aab335800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:27.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.587+0000 7f8aab335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.587+0000 7f8aab335800 20 INFO: main: done 2024-09-12T17:26:27.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.588+0000 7f895dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:27.593 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.591+0000 7f8aab335800 20 remove_watcher() i=0 2024-09-12T17:26:27.593 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.591+0000 7f8aab335800 2 removed watcher, disabling cache 2024-09-12T17:26:27.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.592+0000 7f8aab335800 20 remove_watcher() i=1 2024-09-12T17:26:27.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.593+0000 7f8aab335800 20 remove_watcher() i=2 2024-09-12T17:26:27.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.595+0000 7f8aab335800 20 remove_watcher() i=3 2024-09-12T17:26:27.598 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.596+0000 7f8aab335800 20 remove_watcher() i=4 2024-09-12T17:26:27.599 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.597+0000 7f8aab335800 20 remove_watcher() i=5 2024-09-12T17:26:27.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.599+0000 7f8aab335800 20 remove_watcher() i=6 2024-09-12T17:26:27.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.601+0000 7f8aab335800 20 remove_watcher() i=7 2024-09-12T17:26:27.677 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:26:27.679 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:26:27.712 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:27.713 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:27.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.753+0000 7f947c613800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.754+0000 7f947c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.754+0000 7f947c613800 20 realm 2024-09-12T17:26:27.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.754+0000 7f947c613800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.755+0000 7f947c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.755+0000 7f947c613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:27.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.755+0000 7f947c613800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.755+0000 7f947c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.755+0000 7f947c613800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.756+0000 7f947c613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:27.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.756+0000 7f947c613800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.756+0000 7f947c613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:27.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.756+0000 7f947c613800 20 searching for the correct realm 2024-09-12T17:26:27.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.760+0000 7f9477547640 0 -- 172.21.15.44:0/1743376716 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x56199bddd9e0 msgr2=0x56199bddfdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:27.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.763+0000 7f9477d48640 0 -- 172.21.15.44:0/1743376716 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f946c016b40 msgr2=0x7f946c0388e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:26:27.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.768+0000 7f947c613800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:27.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.768+0000 7f947c613800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:27.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.768+0000 7f947c613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:27.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.768+0000 7f947c613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:27.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.768+0000 7f947c613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:27.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.768+0000 7f947c613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:27.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.768+0000 7f947c613800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.768+0000 7f947c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.768+0000 7f947c613800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.768+0000 7f947c613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:27.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.768+0000 7f947c613800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.769+0000 7f947c613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:27.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.769+0000 7f947c613800 20 zone default found 2024-09-12T17:26:27.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.769+0000 7f947c613800 4 Realm: () 2024-09-12T17:26:27.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.769+0000 7f947c613800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:27.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.769+0000 7f947c613800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:27.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.769+0000 7f947c613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:27.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.769+0000 7f947c613800 20 zonegroup default 2024-09-12T17:26:27.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.769+0000 7f947c613800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.769+0000 7f947c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.769+0000 7f947c613800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.769+0000 7f947c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.769+0000 7f947c613800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.770+0000 7f947c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.770+0000 7f947c613800 20 started sync module instance, tier type = 2024-09-12T17:26:27.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.770+0000 7f947c613800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:27.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.781+0000 7f947c613800 20 add_watcher() i=0 2024-09-12T17:26:27.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.781+0000 7f947c613800 20 add_watcher() i=1 2024-09-12T17:26:27.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.781+0000 7f947c613800 20 add_watcher() i=2 2024-09-12T17:26:27.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.781+0000 7f947c613800 20 add_watcher() i=3 2024-09-12T17:26:27.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.781+0000 7f947c613800 20 add_watcher() i=4 2024-09-12T17:26:27.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.781+0000 7f947c613800 20 add_watcher() i=5 2024-09-12T17:26:27.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.783+0000 7f947c613800 20 add_watcher() i=6 2024-09-12T17:26:27.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.786+0000 7f947c613800 20 add_watcher() i=7 2024-09-12T17:26:27.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.786+0000 7f947c613800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:27.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.788+0000 7f932dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:27.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.789+0000 7f947c613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:27.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.789+0000 7f947c613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:27.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.789+0000 7f947c613800 5 note: GC not initialized 2024-09-12T17:26:27.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.789+0000 7f932cfe1640 20 reqs_thread_entry: start 2024-09-12T17:26:27.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.789+0000 7f947c613800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:27.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.789+0000 7f947c613800 20 Filter name: none 2024-09-12T17:26:27.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.789+0000 7f92a67fc640 20 reqs_thread_entry: start 2024-09-12T17:26:27.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.789+0000 7f947c613800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.790+0000 7f947c613800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:27.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.790+0000 7f947c613800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.790+0000 7f947c613800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:27.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.790+0000 7f947c613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:27.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.790+0000 7f947c613800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:26:27.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.790+0000 7f947c613800 20 INFO: main: starting shard=0 2024-09-12T17:26:27.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.790+0000 7f947c613800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:27.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.791+0000 7f947c613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.791+0000 7f947c613800 20 INFO: main: starting shard=1 2024-09-12T17:26:27.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.791+0000 7f947c613800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:27.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.791+0000 7f947c613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.791+0000 7f947c613800 20 INFO: main: starting shard=2 2024-09-12T17:26:27.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.791+0000 7f947c613800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:27.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.792+0000 7f947c613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.792+0000 7f947c613800 20 INFO: main: starting shard=3 2024-09-12T17:26:27.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.792+0000 7f947c613800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:27.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.792+0000 7f947c613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.792+0000 7f947c613800 20 INFO: main: starting shard=4 2024-09-12T17:26:27.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.792+0000 7f947c613800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:27.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.793+0000 7f947c613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.793+0000 7f947c613800 20 INFO: main: starting shard=5 2024-09-12T17:26:27.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.793+0000 7f947c613800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:27.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.793+0000 7f947c613800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:26:27.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.794+0000 7f947c613800 20 INFO: main: starting shard=6 2024-09-12T17:26:27.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.794+0000 7f947c613800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:27.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.794+0000 7f947c613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.794+0000 7f947c613800 20 INFO: main: starting shard=7 2024-09-12T17:26:27.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.794+0000 7f947c613800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:27.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.795+0000 7f947c613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.795+0000 7f947c613800 20 INFO: main: starting shard=8 2024-09-12T17:26:27.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.795+0000 7f947c613800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:27.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.795+0000 7f947c613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.795+0000 7f947c613800 20 INFO: main: starting shard=9 2024-09-12T17:26:27.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.795+0000 7f947c613800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:27.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.796+0000 7f947c613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.796+0000 7f947c613800 20 INFO: main: starting shard=10 2024-09-12T17:26:27.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.796+0000 7f947c613800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:27.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.796+0000 7f947c613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.796+0000 7f947c613800 20 INFO: main: done 2024-09-12T17:26:27.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.797+0000 7f932dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:27.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.800+0000 7f947c613800 20 remove_watcher() i=0 2024-09-12T17:26:27.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.800+0000 7f947c613800 2 removed watcher, disabling cache 2024-09-12T17:26:27.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.801+0000 7f947c613800 20 remove_watcher() i=1 2024-09-12T17:26:27.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.802+0000 7f947c613800 20 remove_watcher() i=2 2024-09-12T17:26:27.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.803+0000 7f947c613800 20 remove_watcher() i=3 2024-09-12T17:26:27.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.804+0000 7f947c613800 20 remove_watcher() i=4 2024-09-12T17:26:27.807 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.806+0000 7f947c613800 20 remove_watcher() i=5 2024-09-12T17:26:27.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.808+0000 7f947c613800 20 remove_watcher() i=6 2024-09-12T17:26:27.811 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.809+0000 7f947c613800 20 remove_watcher() i=7 2024-09-12T17:26:27.881 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:26:27.882 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:26:27.916 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:27.916 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:27.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.954+0000 7fe34760e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.958 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.956+0000 7fe34760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.958 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.956+0000 7fe34760e800 20 realm 2024-09-12T17:26:27.958 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.956+0000 7fe34760e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.959 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.956+0000 7fe34760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.959 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.956+0000 7fe34760e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:27.959 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.956+0000 7fe34760e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.959 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.956+0000 7fe34760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.959 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.956+0000 7fe34760e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.959 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.957+0000 7fe34760e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:27.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.957+0000 7fe34760e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.957+0000 7fe34760e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:27.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.957+0000 7fe34760e800 20 searching for the correct realm 2024-09-12T17:26:27.961 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.959+0000 7fe342ccb640 0 -- 172.21.15.44:0/847044314 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7fe33c0260a0 msgr2=0x7fe33c01a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:27.965 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.963+0000 7fe342ccb640 0 -- 172.21.15.44:0/847044314 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7fe20c0837d0 msgr2=0x7fe20c085c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:27.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.968+0000 7fe34760e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:27.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.968+0000 7fe34760e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:27.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.968+0000 7fe34760e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:27.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.968+0000 7fe34760e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:27.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.968+0000 7fe34760e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:27.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.968+0000 7fe34760e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:27.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.968+0000 7fe34760e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.968+0000 7fe34760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.968+0000 7fe34760e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.969+0000 7fe34760e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.969+0000 7fe34760e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.969+0000 7fe34760e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.969+0000 7fe34760e800 20 zone default found 2024-09-12T17:26:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.969+0000 7fe34760e800 4 Realm: () 2024-09-12T17:26:27.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.969+0000 7fe34760e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:27.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.969+0000 7fe34760e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:27.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.969+0000 7fe34760e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:27.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.969+0000 7fe34760e800 20 zonegroup default 2024-09-12T17:26:27.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.969+0000 7fe34760e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.969+0000 7fe34760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.969+0000 7fe34760e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.970+0000 7fe34760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.970+0000 7fe34760e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.970+0000 7fe34760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:27.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.970+0000 7fe34760e800 20 started sync module instance, tier type = 2024-09-12T17:26:27.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.970+0000 7fe34760e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:27.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.980+0000 7fe34760e800 20 add_watcher() i=0 2024-09-12T17:26:27.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.980+0000 7fe34760e800 20 add_watcher() i=1 2024-09-12T17:26:27.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.980+0000 7fe34760e800 20 add_watcher() i=2 2024-09-12T17:26:27.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.980+0000 7fe34760e800 20 add_watcher() i=3 2024-09-12T17:26:27.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.980+0000 7fe34760e800 20 add_watcher() i=4 2024-09-12T17:26:27.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.980+0000 7fe34760e800 20 add_watcher() i=5 2024-09-12T17:26:27.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.980+0000 7fe34760e800 20 add_watcher() i=6 2024-09-12T17:26:27.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.981+0000 7fe34760e800 20 add_watcher() i=7 2024-09-12T17:26:27.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.981+0000 7fe34760e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:27.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.982+0000 7fe1f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:27.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.983+0000 7fe34760e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:27.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.983+0000 7fe34760e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:27.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.983+0000 7fe34760e800 5 note: GC not initialized 2024-09-12T17:26:27.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.983+0000 7fe173fff640 20 reqs_thread_entry: start 2024-09-12T17:26:27.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.983+0000 7fe34760e800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:27.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.983+0000 7fe34760e800 20 Filter name: none 2024-09-12T17:26:27.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.983+0000 7fe171ffb640 20 reqs_thread_entry: start 2024-09-12T17:26:27.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.983+0000 7fe34760e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.984+0000 7fe34760e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:27.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.984+0000 7fe34760e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:27.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.984+0000 7fe34760e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:27.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.984+0000 7fe34760e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:27.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.984+0000 7fe34760e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:26:27.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.984+0000 7fe34760e800 20 INFO: main: starting shard=0 2024-09-12T17:26:27.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.984+0000 7fe34760e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:27.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.985+0000 7fe34760e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.985+0000 7fe34760e800 20 INFO: main: starting shard=1 2024-09-12T17:26:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.985+0000 7fe34760e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.985+0000 7fe34760e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:26:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.985+0000 7fe34760e800 20 INFO: main: starting shard=2 2024-09-12T17:26:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.985+0000 7fe34760e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.986+0000 7fe34760e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.986+0000 7fe34760e800 20 INFO: main: starting shard=3 2024-09-12T17:26:27.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.986+0000 7fe34760e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:27.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.987+0000 7fe34760e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.987+0000 7fe34760e800 20 INFO: main: starting shard=4 2024-09-12T17:26:27.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.987+0000 7fe34760e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:27.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.987+0000 7fe34760e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.987+0000 7fe34760e800 20 INFO: main: starting shard=5 2024-09-12T17:26:27.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.987+0000 7fe34760e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:27.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.988+0000 7fe34760e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.988+0000 7fe34760e800 20 INFO: main: starting shard=6 2024-09-12T17:26:27.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.988+0000 7fe34760e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:27.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.988+0000 7fe34760e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.988+0000 7fe34760e800 20 INFO: main: starting shard=7 2024-09-12T17:26:27.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.988+0000 7fe34760e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:27.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.989+0000 7fe34760e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.989+0000 7fe34760e800 20 INFO: main: starting shard=8 2024-09-12T17:26:27.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.989+0000 7fe34760e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.989+0000 7fe34760e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.989+0000 7fe34760e800 20 INFO: main: starting shard=9 2024-09-12T17:26:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.989+0000 7fe34760e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.990+0000 7fe34760e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.990+0000 7fe34760e800 20 INFO: main: starting shard=10 2024-09-12T17:26:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.990+0000 7fe34760e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.990+0000 7fe34760e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.990+0000 7fe34760e800 20 INFO: main: done 2024-09-12T17:26:27.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.991+0000 7fe1f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:27.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.994+0000 7fe34760e800 20 remove_watcher() i=0 2024-09-12T17:26:27.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.994+0000 7fe34760e800 2 removed watcher, disabling cache 2024-09-12T17:26:27.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.995+0000 7fe34760e800 20 remove_watcher() i=1 2024-09-12T17:26:27.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.996+0000 7fe34760e800 20 remove_watcher() i=2 2024-09-12T17:26:27.998 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.997+0000 7fe34760e800 20 remove_watcher() i=3 2024-09-12T17:26:27.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.998+0000 7fe34760e800 20 remove_watcher() i=4 2024-09-12T17:26:28.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:27.999+0000 7fe34760e800 20 remove_watcher() i=5 2024-09-12T17:26:28.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.000+0000 7fe34760e800 20 remove_watcher() i=6 2024-09-12T17:26:28.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.000+0000 7fe34760e800 20 remove_watcher() i=7 2024-09-12T17:26:28.070 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:26:28.071 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:26:28.105 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:28.105 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:28.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.142+0000 7fc88db25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.144+0000 7fc88db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.144+0000 7fc88db25800 20 realm 2024-09-12T17:26:28.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.144+0000 7fc88db25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.144+0000 7fc88db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.144+0000 7fc88db25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:28.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.144+0000 7fc88db25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.144+0000 7fc88db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.144+0000 7fc88db25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.145+0000 7fc88db25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:28.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.145+0000 7fc88db25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.145+0000 7fc88db25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:28.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.145+0000 7fc88db25800 20 searching for the correct realm 2024-09-12T17:26:28.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.148+0000 7fc888f32640 0 -- 172.21.15.44:0/2056327180 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fc87c07e070 msgr2=0x7fc87c0668b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:28.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.152+0000 7fc889733640 0 -- 172.21.15.44:0/2056327180 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fc8800601f0 msgr2=0x7fc88004f6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:26:28.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.358+0000 7fc88db25800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:28.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.358+0000 7fc88db25800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:28.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.358+0000 7fc88db25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:28.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.358+0000 7fc88db25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:28.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.358+0000 7fc88db25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:28.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.358+0000 7fc88db25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:28.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.358+0000 7fc88db25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.359+0000 7fc88db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.359+0000 7fc88db25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.359+0000 7fc88db25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:28.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.359+0000 7fc88db25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.359+0000 7fc88db25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:28.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.359+0000 7fc88db25800 20 zone default found 2024-09-12T17:26:28.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.359+0000 7fc88db25800 4 Realm: () 2024-09-12T17:26:28.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.359+0000 7fc88db25800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:28.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.359+0000 7fc88db25800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:28.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.359+0000 7fc88db25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:28.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.359+0000 7fc88db25800 20 zonegroup default 2024-09-12T17:26:28.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.359+0000 7fc88db25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.360+0000 7fc88db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.360+0000 7fc88db25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.360+0000 7fc88db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.360+0000 7fc88db25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.360+0000 7fc88db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:28.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.360+0000 7fc88db25800 20 started sync module instance, tier type = 2024-09-12T17:26:28.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.360+0000 7fc88db25800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:28.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.374+0000 7fc88db25800 20 add_watcher() i=0 2024-09-12T17:26:28.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.374+0000 7fc88db25800 20 add_watcher() i=1 2024-09-12T17:26:28.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.374+0000 7fc88db25800 20 add_watcher() i=2 2024-09-12T17:26:28.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.374+0000 7fc88db25800 20 add_watcher() i=3 2024-09-12T17:26:28.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.374+0000 7fc88db25800 20 add_watcher() i=4 2024-09-12T17:26:28.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.374+0000 7fc88db25800 20 add_watcher() i=5 2024-09-12T17:26:28.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.374+0000 7fc88db25800 20 add_watcher() i=6 2024-09-12T17:26:28.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.375+0000 7fc88db25800 20 add_watcher() i=7 2024-09-12T17:26:28.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.375+0000 7fc88db25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:28.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.377+0000 7fc73f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:28.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.377+0000 7fc88db25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:28.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.377+0000 7fc88db25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:28.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.377+0000 7fc88db25800 5 note: GC not initialized 2024-09-12T17:26:28.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.377+0000 7fc73e7e4640 20 reqs_thread_entry: start 2024-09-12T17:26:28.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.377+0000 7fc88db25800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:28.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.378+0000 7fc88db25800 20 Filter name: none 2024-09-12T17:26:28.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.378+0000 7fc6affff640 20 reqs_thread_entry: start 2024-09-12T17:26:28.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.378+0000 7fc88db25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.378+0000 7fc88db25800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:28.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.378+0000 7fc88db25800 20 rados->read ofs=0 len=0 2024-09-12T17:26:28.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.378+0000 7fc88db25800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:28.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.378+0000 7fc88db25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:28.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.378+0000 7fc88db25800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:26:28.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.379+0000 7fc88db25800 20 INFO: main: starting shard=0 2024-09-12T17:26:28.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.379+0000 7fc88db25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:28.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.379+0000 7fc88db25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:28.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.379+0000 7fc88db25800 20 INFO: main: starting shard=1 2024-09-12T17:26:28.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.379+0000 7fc88db25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:28.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.380+0000 7fc88db25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:28.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.380+0000 7fc88db25800 20 INFO: main: starting shard=2 2024-09-12T17:26:28.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.380+0000 7fc88db25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:28.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.380+0000 7fc88db25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:28.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.380+0000 7fc88db25800 20 INFO: main: starting shard=3 2024-09-12T17:26:28.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.380+0000 7fc88db25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:28.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.381+0000 7fc88db25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:28.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.381+0000 7fc88db25800 20 INFO: main: starting shard=4 2024-09-12T17:26:28.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.381+0000 7fc88db25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:28.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.381+0000 7fc88db25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:28.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.381+0000 7fc88db25800 20 INFO: main: starting shard=5 2024-09-12T17:26:28.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.381+0000 7fc88db25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:28.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.381+0000 7fc88db25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:28.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.381+0000 7fc88db25800 20 INFO: main: starting shard=6 2024-09-12T17:26:28.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.381+0000 7fc88db25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:28.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.382+0000 7fc88db25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:28.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.382+0000 7fc88db25800 20 INFO: main: starting shard=7 2024-09-12T17:26:28.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.382+0000 7fc88db25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:28.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.383+0000 7fc88db25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:28.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.383+0000 7fc88db25800 20 INFO: main: starting shard=8 2024-09-12T17:26:28.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.383+0000 7fc88db25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:28.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.383+0000 7fc88db25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:28.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.383+0000 7fc88db25800 20 INFO: main: starting shard=9 2024-09-12T17:26:28.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.383+0000 7fc88db25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:28.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.384+0000 7fc88db25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:26:28.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.384+0000 7fc88db25800 20 INFO: main: starting shard=10 2024-09-12T17:26:28.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.384+0000 7fc88db25800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:28.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.384+0000 7fc88db25800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:26:28.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.384+0000 7fc88db25800 20 INFO: main: done 2024-09-12T17:26:28.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.385+0000 7fc73f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:28.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.388+0000 7fc88db25800 20 remove_watcher() i=0 2024-09-12T17:26:28.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.388+0000 7fc88db25800 2 removed watcher, disabling cache 2024-09-12T17:26:28.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.390+0000 7fc88db25800 20 remove_watcher() i=1 2024-09-12T17:26:28.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.391+0000 7fc88db25800 20 remove_watcher() i=2 2024-09-12T17:26:28.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.392+0000 7fc88db25800 20 remove_watcher() i=3 2024-09-12T17:26:28.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.393+0000 7fc88db25800 20 remove_watcher() i=4 2024-09-12T17:26:28.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.394+0000 7fc88db25800 20 remove_watcher() i=5 2024-09-12T17:26:28.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.397+0000 7fc88db25800 20 remove_watcher() i=6 2024-09-12T17:26:28.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:28.398+0000 7fc88db25800 20 remove_watcher() i=7 2024-09-12T17:26:28.417 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:26:28.835 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:26:29.243 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:26:29.273 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:29.274 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:29.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.311+0000 7f243a52a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.315 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.313+0000 7f243a52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.315 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.313+0000 7f243a52a800 20 realm 2024-09-12T17:26:29.315 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.313+0000 7f243a52a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.315 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.313+0000 7f243a52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.315 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.313+0000 7f243a52a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:29.315 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.313+0000 7f243a52a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.315 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.313+0000 7f243a52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.316 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.313+0000 7f243a52a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.316 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.314+0000 7f243a52a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:29.316 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.314+0000 7f243a52a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.316 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.314+0000 7f243a52a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:29.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.314+0000 7f243a52a800 20 searching for the correct realm 2024-09-12T17:26:29.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.317+0000 7f2436aae640 0 -- 172.21.15.44:0/540679503 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f242c07f020 msgr2=0x7f242c0013d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:26:29.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.322+0000 7f24362ad640 0 -- 172.21.15.44:0/540679503 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f242c0dcb50 msgr2=0x7f242c05a970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:29.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.528+0000 7f243a52a800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:29.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.528+0000 7f243a52a800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:29.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.528+0000 7f243a52a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:29.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.528+0000 7f243a52a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:29.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.528+0000 7f243a52a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:29.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.528+0000 7f243a52a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:29.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.528+0000 7f243a52a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.528+0000 7f243a52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.529+0000 7f243a52a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.529+0000 7f243a52a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:29.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.529+0000 7f243a52a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.530+0000 7f243a52a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:29.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.530+0000 7f243a52a800 20 zone default found 2024-09-12T17:26:29.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.530+0000 7f243a52a800 4 Realm: () 2024-09-12T17:26:29.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.530+0000 7f243a52a800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:29.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.530+0000 7f243a52a800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:29.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.530+0000 7f243a52a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:29.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.530+0000 7f243a52a800 20 zonegroup default 2024-09-12T17:26:29.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.530+0000 7f243a52a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.530+0000 7f243a52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.530+0000 7f243a52a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.530+0000 7f243a52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.530+0000 7f243a52a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.531+0000 7f243a52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.531+0000 7f243a52a800 20 started sync module instance, tier type = 2024-09-12T17:26:29.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.531+0000 7f243a52a800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:29.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.543+0000 7f243a52a800 20 add_watcher() i=0 2024-09-12T17:26:29.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.543+0000 7f243a52a800 20 add_watcher() i=1 2024-09-12T17:26:29.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.543+0000 7f243a52a800 20 add_watcher() i=2 2024-09-12T17:26:29.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.543+0000 7f243a52a800 20 add_watcher() i=3 2024-09-12T17:26:29.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.543+0000 7f243a52a800 20 add_watcher() i=4 2024-09-12T17:26:29.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.543+0000 7f243a52a800 20 add_watcher() i=5 2024-09-12T17:26:29.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.544+0000 7f243a52a800 20 add_watcher() i=6 2024-09-12T17:26:29.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.544+0000 7f243a52a800 20 add_watcher() i=7 2024-09-12T17:26:29.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.544+0000 7f243a52a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:29.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.546+0000 7f22ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:29.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.547+0000 7f243a52a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:29.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.547+0000 7f243a52a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:29.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.547+0000 7f243a52a800 5 note: GC not initialized 2024-09-12T17:26:29.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.547+0000 7f22677fe640 20 reqs_thread_entry: start 2024-09-12T17:26:29.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.547+0000 7f243a52a800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:29.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.547+0000 7f243a52a800 20 Filter name: none 2024-09-12T17:26:29.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.547+0000 7f22657fa640 20 reqs_thread_entry: start 2024-09-12T17:26:29.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.547+0000 7f243a52a800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:26:29.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.547+0000 7f243a52a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.548+0000 7f243a52a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:29.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.548+0000 7f243a52a800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:26:29.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.548+0000 7f243a52a800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:26:29.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.548+0000 7f243a52a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 : miss 2024-09-12T17:26:29.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.548+0000 7f243a52a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.548+0000 7f243a52a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:29.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.548+0000 7f243a52a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 info.flags=0x17 2024-09-12T17:26:29.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.548+0000 7f243a52a800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 to cache LRU end 2024-09-12T17:26:29.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.548+0000 7f243a52a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:29.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.548+0000 7f243a52a800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:26:29.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.548+0000 7f243a52a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 2024-09-12T17:26:29.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.548+0000 7f243a52a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:29.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.549+0000 7f243a52a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:29.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.550+0000 7f243a52a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:29.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.550+0000 7f243a52a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:29.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.551+0000 7f243a52a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:29.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.551+0000 7f243a52a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:29.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.552+0000 7f243a52a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:29.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.552+0000 7f243a52a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:29.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.553+0000 7f243a52a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:29.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.554+0000 7f243a52a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:29.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.555+0000 7f243a52a800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:29.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.567+0000 7f22ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:29.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.570+0000 7f243a52a800 20 remove_watcher() i=0 2024-09-12T17:26:29.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.570+0000 7f243a52a800 2 removed watcher, disabling cache 2024-09-12T17:26:29.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.571+0000 7f243a52a800 20 remove_watcher() i=1 2024-09-12T17:26:29.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.572+0000 7f243a52a800 20 remove_watcher() i=2 2024-09-12T17:26:29.575 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.574+0000 7f243a52a800 20 remove_watcher() i=3 2024-09-12T17:26:29.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.575+0000 7f243a52a800 20 remove_watcher() i=4 2024-09-12T17:26:29.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.576+0000 7f243a52a800 20 remove_watcher() i=5 2024-09-12T17:26:29.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.577+0000 7f243a52a800 20 remove_watcher() i=6 2024-09-12T17:26:29.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.578+0000 7f243a52a800 20 remove_watcher() i=7 2024-09-12T17:26:29.593 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:26:29.629 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:29.631 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:29.669 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.667+0000 7faf1ac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.668+0000 7faf1ac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.671 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.668+0000 7faf1ac0e800 20 realm 2024-09-12T17:26:29.671 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.668+0000 7faf1ac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.671 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.669+0000 7faf1ac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.671 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.669+0000 7faf1ac0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:29.671 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.669+0000 7faf1ac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.669+0000 7faf1ac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.669+0000 7faf1ac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.670+0000 7faf1ac0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:29.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.670+0000 7faf1ac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.670+0000 7faf1ac0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:29.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.670+0000 7faf1ac0e800 20 searching for the correct realm 2024-09-12T17:26:29.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.672+0000 7faf1636b640 0 -- 172.21.15.44:0/2928685839 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7faf10029040 msgr2=0x7faf10029420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:26:29.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.878+0000 7faf16b6c640 0 -- 172.21.15.44:0/2928685839 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7faf0c060070 msgr2=0x7faf0c0b5940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:29.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.884+0000 7faf1ac0e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:29.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.884+0000 7faf1ac0e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:29.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.884+0000 7faf1ac0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:29.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.884+0000 7faf1ac0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:29.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.884+0000 7faf1ac0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:29.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.884+0000 7faf1ac0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:29.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.884+0000 7faf1ac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.884+0000 7faf1ac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.884+0000 7faf1ac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.885+0000 7faf1ac0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:29.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.885+0000 7faf1ac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.885+0000 7faf1ac0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:29.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.885+0000 7faf1ac0e800 20 zone default found 2024-09-12T17:26:29.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.885+0000 7faf1ac0e800 4 Realm: () 2024-09-12T17:26:29.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.885+0000 7faf1ac0e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:29.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.885+0000 7faf1ac0e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:29.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.885+0000 7faf1ac0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:29.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.885+0000 7faf1ac0e800 20 zonegroup default 2024-09-12T17:26:29.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.885+0000 7faf1ac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.885+0000 7faf1ac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.885+0000 7faf1ac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.886+0000 7faf1ac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.886+0000 7faf1ac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.886+0000 7faf1ac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:29.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.886+0000 7faf1ac0e800 20 started sync module instance, tier type = 2024-09-12T17:26:29.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.886+0000 7faf1ac0e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:29.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.899+0000 7faf1ac0e800 20 add_watcher() i=0 2024-09-12T17:26:29.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.899+0000 7faf1ac0e800 20 add_watcher() i=1 2024-09-12T17:26:29.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.899+0000 7faf1ac0e800 20 add_watcher() i=2 2024-09-12T17:26:29.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.899+0000 7faf1ac0e800 20 add_watcher() i=3 2024-09-12T17:26:29.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.899+0000 7faf1ac0e800 20 add_watcher() i=4 2024-09-12T17:26:29.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.899+0000 7faf1ac0e800 20 add_watcher() i=5 2024-09-12T17:26:29.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.899+0000 7faf1ac0e800 20 add_watcher() i=6 2024-09-12T17:26:29.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.900+0000 7faf1ac0e800 20 add_watcher() i=7 2024-09-12T17:26:29.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.900+0000 7faf1ac0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:29.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.902+0000 7fadccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:29.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.902+0000 7faf1ac0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:29.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.902+0000 7faf1ac0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:29.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.903+0000 7faf1ac0e800 5 note: GC not initialized 2024-09-12T17:26:29.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.903+0000 7fad477fe640 20 reqs_thread_entry: start 2024-09-12T17:26:29.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.903+0000 7faf1ac0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:29.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.903+0000 7faf1ac0e800 20 Filter name: none 2024-09-12T17:26:29.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.903+0000 7fad457fa640 20 reqs_thread_entry: start 2024-09-12T17:26:29.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.903+0000 7faf1ac0e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:26:29.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.903+0000 7faf1ac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.903+0000 7faf1ac0e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:29.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.903+0000 7faf1ac0e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:26:29.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.903+0000 7faf1ac0e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:26:29.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.903+0000 7faf1ac0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 : miss 2024-09-12T17:26:29.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.903+0000 7faf1ac0e800 20 rados->read ofs=0 len=0 2024-09-12T17:26:29.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.904+0000 7faf1ac0e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:29.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.904+0000 7faf1ac0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 info.flags=0x17 2024-09-12T17:26:29.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.904+0000 7faf1ac0e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 to cache LRU end 2024-09-12T17:26:29.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.904+0000 7faf1ac0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:26:29.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.904+0000 7faf1ac0e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:26:29.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.904+0000 7faf1ac0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2 2024-09-12T17:26:29.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.904+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.0 2024-09-12T17:26:29.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.905+0000 7faf1ac0e800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:26:29.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.905+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:29.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.905+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.2 2024-09-12T17:26:29.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.906+0000 7faf1ac0e800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:26:29.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.906+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.3 2024-09-12T17:26:29.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.906+0000 7faf1ac0e800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:26:29.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.906+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.4 2024-09-12T17:26:29.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.907+0000 7faf1ac0e800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:26:29.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.907+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:29.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.908+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.6 2024-09-12T17:26:29.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.908+0000 7faf1ac0e800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:26:29.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.908+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.7 2024-09-12T17:26:29.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.909+0000 7faf1ac0e800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:26:29.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.909+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:29.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.909+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.9 2024-09-12T17:26:29.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.910+0000 7faf1ac0e800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:26:29.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.910+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:29.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.911+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:29.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.911+0000 7faf1ac0e800 20 get_obj_state: octx=0x556b2ea379b0 obj=check-bucket:e state=0x556b2ece4668 s->prefetch_data=0 2024-09-12T17:26:29.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.911+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:29.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.912+0000 7faf1ac0e800 20 get_obj_state: octx=0x556b2ea45990 obj=check-bucket:d state=0x556b2ece8d18 s->prefetch_data=0 2024-09-12T17:26:29.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.912+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:29.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.912+0000 7faf1ac0e800 20 get_obj_state: octx=0x556b2ece6cb0 obj=check-bucket:c state=0x556b2ecea178 s->prefetch_data=0 2024-09-12T17:26:29.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.912+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:29.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.913+0000 7faf1ac0e800 20 get_obj_state: octx=0x556b2ece8570 obj=check-bucket:f state=0x556b2ece7618 s->prefetch_data=0 2024-09-12T17:26:29.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.913+0000 7faf1ac0e800 20 get_obj_state: setting s->obj_tag to qxnlm72lmytgu6erx7e5v7pj02qtgxfm 2024-09-12T17:26:29.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.913+0000 7faf1ac0e800 20 get_obj_state_impl: setting s->olh_tag to 092ptozq207y2qqko8afj733esmpfnx2 2024-09-12T17:26:29.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.913+0000 7faf1ac0e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=092ptozq207y2qqko8afj733esmpfnx2 2024-09-12T17:26:29.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.913+0000 7faf1ac0e800 20 get_obj_state: setting s->obj_tag to ulw9ods2055i0fc9umr70ik2eib071nf 2024-09-12T17:26:29.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.913+0000 7faf1ac0e800 20 get_obj_state_impl: setting s->olh_tag to nb5ki4vv3z2zoype8s6gwddakcwvmdhx 2024-09-12T17:26:29.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.913+0000 7faf1ac0e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nb5ki4vv3z2zoype8s6gwddakcwvmdhx 2024-09-12T17:26:29.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.913+0000 7faf1ac0e800 20 get_obj_state: setting s->obj_tag to ce2gp5u312bh4p250fsm02ql5ac1vyjv 2024-09-12T17:26:29.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.913+0000 7faf1ac0e800 20 get_obj_state_impl: setting s->olh_tag to 91mx157u26sde9jwrwfknlrs323c3uqe 2024-09-12T17:26:29.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.913+0000 7faf1ac0e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=91mx157u26sde9jwrwfknlrs323c3uqe 2024-09-12T17:26:29.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.913+0000 7faf1ac0e800 20 get_obj_state: setting s->obj_tag to 21qh2fw0v3zv61zjdcfte6a6w1xh11c2 2024-09-12T17:26:29.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.913+0000 7faf1ac0e800 20 get_obj_state_impl: setting s->olh_tag to g3vp133vu2xkjy8sj3jwp4qe5kosv7nd 2024-09-12T17:26:29.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.913+0000 7faf1ac0e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g3vp133vu2xkjy8sj3jwp4qe5kosv7nd 2024-09-12T17:26:29.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.914+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:29.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.914+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:29.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.914+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:29.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.915+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:29.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.917+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:29.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.917+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:29.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.918+0000 7faf1ac0e800 20 olh_log_entry: epoch=3 op=3 key=d[Fq.bnCyZaMO3J9kIoWAK04.BYaZGHmD] 2024-09-12T17:26:29.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.918+0000 7faf1ac0e800 20 get_obj_state: octx=0x556b2ea45990 obj=check-bucket:_:Fq.bnCyZaMO3J9kIoWAK04.BYaZGHmD_d state=0x556b2ed94628 s->prefetch_data=0 2024-09-12T17:26:29.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.918+0000 7faf1ac0e800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:26:29.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.918+0000 7faf1ac0e800 20 olh_log_entry: epoch=2 op=3 key=f[xzgORxy2YeR1cT0fZ-sF6bTsJ58auRb] 2024-09-12T17:26:29.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.918+0000 7faf1ac0e800 20 get_obj_state: octx=0x556b2ece8570 obj=check-bucket:_:xzgORxy2YeR1cT0fZ-sF6bTsJ58auRb_f state=0x556b2eda3b28 s->prefetch_data=0 2024-09-12T17:26:29.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.918+0000 7faf1ac0e800 10 manifest: total_size = 22 2024-09-12T17:26:29.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.918+0000 7faf1ac0e800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11469030406338184118 2024-09-12T17:26:29.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.918+0000 7faf1ac0e800 20 get_obj_state: octx=0x556b2ea45990 obj=check-bucket:_:Fq.bnCyZaMO3J9kIoWAK04.BYaZGHmD_d state=0x556b2ed94628 s->prefetch_data=0 2024-09-12T17:26:29.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.918+0000 7faf1ac0e800 20 prepare_atomic_modification: state is not atomic. state=0x556b2ed94628 2024-09-12T17:26:29.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.918+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:29.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.918+0000 7faf1ac0e800 10 manifest: total_size = 9 2024-09-12T17:26:29.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.918+0000 7faf1ac0e800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4592051194149418077 2024-09-12T17:26:29.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.918+0000 7faf1ac0e800 20 get_obj_state: octx=0x556b2ece8570 obj=check-bucket:_:xzgORxy2YeR1cT0fZ-sF6bTsJ58auRb_f state=0x556b2eda3b28 s->prefetch_data=0 2024-09-12T17:26:29.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.918+0000 7faf1ac0e800 20 prepare_atomic_modification: state is not atomic. state=0x556b2eda3b28 2024-09-12T17:26:29.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.918+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:29.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.920+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:29.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.920+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:29.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.920+0000 7faf1ac0e800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:26:29.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.920+0000 7faf1ac0e800 20 olh_log_entry: epoch=2 op=3 key=e[e.a5693QK66cMEx82mPok0Cxe0ntQ5N] 2024-09-12T17:26:29.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.920+0000 7faf1ac0e800 20 get_obj_state: octx=0x556b2ea379b0 obj=check-bucket:_:e.a5693QK66cMEx82mPok0Cxe0ntQ5N_e state=0x556b2edae9d8 s->prefetch_data=0 2024-09-12T17:26:29.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.921+0000 7faf1ac0e800 20 olh_log_entry: epoch=3 op=3 key=c[qHLmVnxKtlf8tntl4RMxp14jf5EYWCN] 2024-09-12T17:26:29.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.921+0000 7faf1ac0e800 20 get_obj_state: octx=0x556b2ece6cb0 obj=check-bucket:_:qHLmVnxKtlf8tntl4RMxp14jf5EYWCN_c state=0x556b2edb3978 s->prefetch_data=0 2024-09-12T17:26:29.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.921+0000 7faf1ac0e800 10 manifest: total_size = 12 2024-09-12T17:26:29.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.921+0000 7faf1ac0e800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11004240578205594746 2024-09-12T17:26:29.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.921+0000 7faf1ac0e800 20 get_obj_state: octx=0x556b2ea379b0 obj=check-bucket:_:e.a5693QK66cMEx82mPok0Cxe0ntQ5N_e state=0x556b2edae9d8 s->prefetch_data=0 2024-09-12T17:26:29.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.921+0000 7faf1ac0e800 20 prepare_atomic_modification: state is not atomic. state=0x556b2edae9d8 2024-09-12T17:26:29.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.921+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:29.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.921+0000 7faf1ac0e800 10 manifest: total_size = 22 2024-09-12T17:26:29.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.921+0000 7faf1ac0e800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1898778172577595277 2024-09-12T17:26:29.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.921+0000 7faf1ac0e800 20 get_obj_state: octx=0x556b2ece6cb0 obj=check-bucket:_:qHLmVnxKtlf8tntl4RMxp14jf5EYWCN_c state=0x556b2edb3978 s->prefetch_data=0 2024-09-12T17:26:29.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.921+0000 7faf1ac0e800 20 prepare_atomic_modification: state is not atomic. state=0x556b2edb3978 2024-09-12T17:26:29.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.921+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:29.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.923+0000 7faf1ac0e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:26:29.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.923+0000 7faf1ac0e800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T17:26:29.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.923+0000 7faf1ac0e800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:26:29.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.923+0000 7faf1ac0e800 5 delete_objs_inline: removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2__shadow:xzgORxy2YeR1cT0fZ-sF6bTsJ58auRb_.civNw0c94aVhudaGIL6XOduK3H9RoBX_0 2024-09-12T17:26:29.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.924+0000 7faf1ac0e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:26:29.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.924+0000 7faf1ac0e800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:26:29.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.924+0000 7faf1ac0e800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:26:29.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.924+0000 7faf1ac0e800 5 delete_objs_inline: removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2__shadow:e.a5693QK66cMEx82mPok0Cxe0ntQ5N_.prGc5uBn9RlqEi-Mq_nfZNDpMz5uIJu_0 2024-09-12T17:26:29.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.926+0000 7faf1ac0e800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:26:29.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.927+0000 7fadf97fa640 20 handle_completion(): completion ok for obj=f[xzgORxy2YeR1cT0fZ-sF6bTsJ58auRb] 2024-09-12T17:26:29.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.929+0000 7fadf9ffb640 20 handle_completion(): completion ok for obj=e[e.a5693QK66cMEx82mPok0Cxe0ntQ5N] 2024-09-12T17:26:29.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.929+0000 7faf1ac0e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:26:29.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.929+0000 7faf1ac0e800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:26:29.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.929+0000 7faf1ac0e800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:26:29.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.929+0000 7faf1ac0e800 5 delete_objs_inline: removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2__shadow:Fq.bnCyZaMO3J9kIoWAK04.BYaZGHmD_.LGpPI1n-ldpHX5ACWp-5IULgvG0200E_0 2024-09-12T17:26:29.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.931+0000 7faf1ac0e800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:26:29.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.931+0000 7faf1ac0e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:26:29.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.931+0000 7faf1ac0e800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:26:29.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.931+0000 7faf1ac0e800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:26:29.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.931+0000 7faf1ac0e800 5 delete_objs_inline: removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2__shadow:qHLmVnxKtlf8tntl4RMxp14jf5EYWCN_.Qh5LC6CQgJ2mlLvh4bDtol9YA4TPa4M_0 2024-09-12T17:26:29.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.931+0000 7faf1ac0e800 20 get_obj_state: octx=0x556b2ece8570 obj=check-bucket:f state=0x556b2ece7618 s->prefetch_data=0 2024-09-12T17:26:29.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.931+0000 7faf1ac0e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g3vp133vu2xkjy8sj3jwp4qe5kosv7nd 2024-09-12T17:26:29.936 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.934+0000 7fadf97fa640 20 handle_completion(): completion ok for obj=d[Fq.bnCyZaMO3J9kIoWAK04.BYaZGHmD] 2024-09-12T17:26:29.936 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.934+0000 7faf1ac0e800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:26:29.936 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.934+0000 7faf1ac0e800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:26:29.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.937+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:29.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.937+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:29.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.937+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:29.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.937+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:29.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.937+0000 7faf1ac0e800 20 get_obj_state: octx=0x556b2ea379b0 obj=check-bucket:e state=0x556b2ece4668 s->prefetch_data=0 2024-09-12T17:26:29.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.937+0000 7faf1ac0e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=092ptozq207y2qqko8afj733esmpfnx2 2024-09-12T17:26:29.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.937+0000 7fadf97fa640 20 handle_completion(): completion ok for obj=c[qHLmVnxKtlf8tntl4RMxp14jf5EYWCN] 2024-09-12T17:26:29.941 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.939+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.5 2024-09-12T17:26:29.941 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.939+0000 7faf1ac0e800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:26:29.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.945+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.8 2024-09-12T17:26:29.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.945+0000 7faf1ac0e800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:26:29.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.945+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:29.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.946+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:29.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.947+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.10 2024-09-12T17:26:29.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.947+0000 7faf1ac0e800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T17:26:29.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.948+0000 7faf1ac0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2.1 2024-09-12T17:26:29.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.948+0000 7faf1ac0e800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T17:26:29.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.948+0000 7faf1ac0e800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:26:29.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.948+0000 7fadccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:29.952 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.951+0000 7faf1ac0e800 20 remove_watcher() i=0 2024-09-12T17:26:29.952 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.951+0000 7faf1ac0e800 2 removed watcher, disabling cache 2024-09-12T17:26:29.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.952+0000 7faf1ac0e800 20 remove_watcher() i=1 2024-09-12T17:26:29.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.953+0000 7faf1ac0e800 20 remove_watcher() i=2 2024-09-12T17:26:29.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.954+0000 7faf1ac0e800 20 remove_watcher() i=3 2024-09-12T17:26:29.957 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.955+0000 7faf1ac0e800 20 remove_watcher() i=4 2024-09-12T17:26:29.958 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.956+0000 7faf1ac0e800 20 remove_watcher() i=5 2024-09-12T17:26:29.959 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.958+0000 7faf1ac0e800 20 remove_watcher() i=6 2024-09-12T17:26:29.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:29.958+0000 7faf1ac0e800 20 remove_watcher() i=7 2024-09-12T17:26:30.021 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:26:30.052 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:30.052 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:30.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.090+0000 7f3a60d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:30.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.092+0000 7f3a60d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:30.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.092+0000 7f3a60d2a800 20 realm 2024-09-12T17:26:30.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.092+0000 7f3a60d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:30.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.092+0000 7f3a60d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:30.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.092+0000 7f3a60d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:30.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.092+0000 7f3a60d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:30.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.092+0000 7f3a60d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:30.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.092+0000 7f3a60d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:30.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.093+0000 7f3a60d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:30.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.093+0000 7f3a60d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:30.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.093+0000 7f3a60d2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:30.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.093+0000 7f3a60d2a800 20 searching for the correct realm 2024-09-12T17:26:30.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.095+0000 7f3a5cada640 0 -- 172.21.15.44:0/2068507829 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x564200122450 msgr2=0x7f3a540a2e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:30.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.099+0000 7f3a5cada640 0 -- 172.21.15.44:0/2068507829 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7f3928083800 msgr2=0x7f3928085c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:30.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.104+0000 7f3a60d2a800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:26:30.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.104+0000 7f3a60d2a800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:26:30.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.104+0000 7f3a60d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:30.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.104+0000 7f3a60d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:30.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.104+0000 7f3a60d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:30.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.104+0000 7f3a60d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:30.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.105+0000 7f3a60d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:30.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.105+0000 7f3a60d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:30.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.105+0000 7f3a60d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:30.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.105+0000 7f3a60d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:30.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.105+0000 7f3a60d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:30.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.105+0000 7f3a60d2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:30.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.105+0000 7f3a60d2a800 20 zone default found 2024-09-12T17:26:30.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.105+0000 7f3a60d2a800 4 Realm: () 2024-09-12T17:26:30.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.105+0000 7f3a60d2a800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:26:30.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.105+0000 7f3a60d2a800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:26:30.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.105+0000 7f3a60d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:30.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.105+0000 7f3a60d2a800 20 zonegroup default 2024-09-12T17:26:30.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.105+0000 7f3a60d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:30.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.106+0000 7f3a60d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:30.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.106+0000 7f3a60d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:30.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.106+0000 7f3a60d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:30.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.106+0000 7f3a60d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:30.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.106+0000 7f3a60d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:30.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.106+0000 7f3a60d2a800 20 started sync module instance, tier type = 2024-09-12T17:26:30.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.106+0000 7f3a60d2a800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:26:30.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.121+0000 7f3a60d2a800 20 add_watcher() i=0 2024-09-12T17:26:30.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.121+0000 7f3a60d2a800 20 add_watcher() i=1 2024-09-12T17:26:30.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.121+0000 7f3a60d2a800 20 add_watcher() i=2 2024-09-12T17:26:30.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.121+0000 7f3a60d2a800 20 add_watcher() i=3 2024-09-12T17:26:30.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.121+0000 7f3a60d2a800 20 add_watcher() i=4 2024-09-12T17:26:30.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.121+0000 7f3a60d2a800 20 add_watcher() i=5 2024-09-12T17:26:30.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.121+0000 7f3a60d2a800 20 add_watcher() i=6 2024-09-12T17:26:30.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.122+0000 7f3a60d2a800 20 add_watcher() i=7 2024-09-12T17:26:30.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.122+0000 7f3a60d2a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:30.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.124+0000 7f3912fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:30.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.124+0000 7f3a60d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:30.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.124+0000 7f3a60d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:30.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.124+0000 7f3a60d2a800 5 note: GC not initialized 2024-09-12T17:26:30.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.124+0000 7f3911fe3640 20 reqs_thread_entry: start 2024-09-12T17:26:30.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.124+0000 7f3a60d2a800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:30.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.125+0000 7f3a60d2a800 20 Filter name: none 2024-09-12T17:26:30.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.125+0000 7f38837fe640 20 reqs_thread_entry: start 2024-09-12T17:26:30.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.125+0000 7f3a60d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:30.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.125+0000 7f3a60d2a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:30.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.125+0000 7f3a60d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:30.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.125+0000 7f3a60d2a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:30.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.125+0000 7f3a60d2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:30.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.125+0000 7f3a60d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:30.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.126+0000 7f3a60d2a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:26:30.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.126+0000 7f3a60d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:26:30.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.126+0000 7f3a60d2a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:26:30.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.126+0000 7f3a60d2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:26:30.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.128+0000 7f3912fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:30.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.130+0000 7f3a60d2a800 20 remove_watcher() i=0 2024-09-12T17:26:30.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.130+0000 7f3a60d2a800 2 removed watcher, disabling cache 2024-09-12T17:26:30.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.131+0000 7f3a60d2a800 20 remove_watcher() i=1 2024-09-12T17:26:30.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.132+0000 7f3a60d2a800 20 remove_watcher() i=2 2024-09-12T17:26:30.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.133+0000 7f3a60d2a800 20 remove_watcher() i=3 2024-09-12T17:26:30.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.134+0000 7f3a60d2a800 20 remove_watcher() i=4 2024-09-12T17:26:30.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.135+0000 7f3a60d2a800 20 remove_watcher() i=5 2024-09-12T17:26:30.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.136+0000 7f3a60d2a800 20 remove_watcher() i=6 2024-09-12T17:26:30.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:26:30.137+0000 7f3a60d2a800 20 remove_watcher() i=7 2024-09-12T17:26:30.151 INFO:tasks.workunit.client.0.smithi044.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:26:30.151 INFO:tasks.workunit.client.0.smithi044.stderr:Deleting bucket check-bucket 2024-09-12T17:26:30.188 INFO:tasks.workunit.client.0.smithi044.stderr:Completed bucket check tests 2024-09-12T17:26:30.189 INFO:tasks.workunit.client.0.smithi044.stdout:connected to http://localhost:80 2024-09-12T17:26:30.249 INFO:tasks.workunit.client.0.smithi044.stderr:+ deactivate 2024-09-12T17:26:30.249 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T17:26:30.249 INFO:tasks.workunit.client.0.smithi044.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:26:30.250 INFO:tasks.workunit.client.0.smithi044.stderr:+ export PATH 2024-09-12T17:26:30.250 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:26:30.250 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n '' ']' 2024-09-12T17:26:30.250 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:26:30.250 INFO:tasks.workunit.client.0.smithi044.stderr:+ hash -r 2024-09-12T17:26:30.250 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n '' ']' 2024-09-12T17:26:30.250 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:26:30.250 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:26:30.250 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset -f deactivate 2024-09-12T17:26:30.250 INFO:tasks.workunit.client.0.smithi044.stderr:+ echo OK. 2024-09-12T17:26:30.251 INFO:tasks.workunit.client.0.smithi044.stdout:OK. 2024-09-12T17:26:30.251 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:26:30.252 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:26:30.332 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T17:26:30.332 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:26:30.715 DEBUG:teuthology.parallel:result is None 2024-09-12T17:26:30.715 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:26:30.755 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:26:30.755 DEBUG:teuthology.orchestra.run.smithi044:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:26:30.824 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:26:30.824 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:26:30.834 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:26:30.834 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:26:30.834 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:26:30.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:26:30.894 INFO:teuthology.orchestra.run.smithi044.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:26:30.894 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:26:30.964 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:26:30.964 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:26:31.034 INFO:tasks.workunit:timeout=3h 2024-09-12T17:26:31.034 INFO:tasks.workunit:cleanup=True 2024-09-12T17:26:31.035 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:26:31.105 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:27:30.846 INFO:tasks.workunit.client.0.smithi044.stderr:Updating files: 91% (11570/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:27:31.728 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:27:31.728 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:27:31.728 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:27:31.728 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:27:31.728 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:27:31.728 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:27:31.729 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:27:31.729 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:27:31.729 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:27:31.729 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2024-09-12T17:27:31.729 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:27:31.729 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2024-09-12T17:27:31.729 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:27:31.730 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2024-09-12T17:27:31.730 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:27:31.730 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:27:31.730 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:27:31.730 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:27:31.734 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:27:31.803 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:27:31.806 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:27:31.806 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:27:31.855 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:27:31.905 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:27:31.945 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:27:31.947 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:27:31.947 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:27:31.986 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:27:31.990 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:27:31.990 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:27:32.061 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T17:27:32.062 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T17:27:32.062 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T17:27:32.146 INFO:tasks.workunit.client.0.smithi044.stdout:Running main() from gmock_main.cc 2024-09-12T17:27:32.146 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:27:32.146 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:27:32.146 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 11 tests from ClsLock 2024-09-12T17:27:32.147 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T17:27:33.416 INFO:tasks.workunit.client.0.smithi044.stdout:lock: mylock 2024-09-12T17:27:33.416 INFO:tasks.workunit.client.0.smithi044.stdout: lock_type: exclusive 2024-09-12T17:27:33.416 INFO:tasks.workunit.client.0.smithi044.stdout: tag: 2024-09-12T17:27:33.416 INFO:tasks.workunit.client.0.smithi044.stdout: lockers: 2024-09-12T17:27:33.416 INFO:tasks.workunit.client.0.smithi044.stdout: client.5241 expiration=2024-09-12T17:29:33.411313+0000 addr=v1:172.21.15.44:0/728213474 cookie= 2024-09-12T17:27:33.421 INFO:tasks.workunit.client.0.smithi044.stdout:lock: mylock 2024-09-12T17:27:33.421 INFO:tasks.workunit.client.0.smithi044.stdout: lock_type: shared 2024-09-12T17:27:33.421 INFO:tasks.workunit.client.0.smithi044.stdout: tag: 2024-09-12T17:27:33.421 INFO:tasks.workunit.client.0.smithi044.stdout: lockers: 2024-09-12T17:27:33.421 INFO:tasks.workunit.client.0.smithi044.stdout: client.5241 expiration=2024-09-12T17:29:33.419314+0000 addr=v1:172.21.15.44:0/728213474 cookie= 2024-09-12T17:27:33.421 INFO:tasks.workunit.client.0.smithi044.stdout: client.5250 expiration=0.000000 addr=v1:172.21.15.44:0/2272161784 cookie= 2024-09-12T17:27:33.422 INFO:tasks.workunit.client.0.smithi044.stdout:lock: mylock 2024-09-12T17:27:33.423 INFO:tasks.workunit.client.0.smithi044.stdout: lock_type: shared 2024-09-12T17:27:33.423 INFO:tasks.workunit.client.0.smithi044.stdout: tag: 2024-09-12T17:27:33.423 INFO:tasks.workunit.client.0.smithi044.stdout: lockers: 2024-09-12T17:27:33.423 INFO:tasks.workunit.client.0.smithi044.stdout: client.5250 expiration=0.000000 addr=v1:172.21.15.44:0/2272161784 cookie= 2024-09-12T17:27:34.231 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestMultiLocking (2086 ms) 2024-09-12T17:27:34.231 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T17:27:36.278 INFO:tasks.workunit.client.0.smithi044.stdout:lock: mylock 2024-09-12T17:27:36.278 INFO:tasks.workunit.client.0.smithi044.stdout: lock_type: shared 2024-09-12T17:27:36.279 INFO:tasks.workunit.client.0.smithi044.stdout: tag: 2024-09-12T17:27:36.279 INFO:tasks.workunit.client.0.smithi044.stdout: lockers: 2024-09-12T17:27:36.279 INFO:tasks.workunit.client.0.smithi044.stdout: client.5036 expiration=0.000000 addr=v1:172.21.15.44:0/697722176 cookie= 2024-09-12T17:27:36.282 INFO:tasks.workunit.client.0.smithi044.stdout:lock: mylock 2024-09-12T17:27:36.282 INFO:tasks.workunit.client.0.smithi044.stdout: lock_type: exclusive 2024-09-12T17:27:36.282 INFO:tasks.workunit.client.0.smithi044.stdout: tag: new_tag 2024-09-12T17:27:36.282 INFO:tasks.workunit.client.0.smithi044.stdout: lockers: 2024-09-12T17:27:36.282 INFO:tasks.workunit.client.0.smithi044.stdout: client.5253 expiration=0.000000 addr=v1:172.21.15.44:0/2931301373 cookie= 2024-09-12T17:27:37.251 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestMeta (3020 ms) 2024-09-12T17:27:37.251 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T17:27:39.273 INFO:tasks.workunit.client.0.smithi044.stdout:lock: mylock 2024-09-12T17:27:39.273 INFO:tasks.workunit.client.0.smithi044.stdout: lock_type: exclusive 2024-09-12T17:27:39.273 INFO:tasks.workunit.client.0.smithi044.stdout: tag: 2024-09-12T17:27:39.273 INFO:tasks.workunit.client.0.smithi044.stdout: lockers: 2024-09-12T17:27:39.275 INFO:tasks.workunit.client.0.smithi044.stdout:lock: mylock 2024-09-12T17:27:39.275 INFO:tasks.workunit.client.0.smithi044.stdout: lock_type: shared 2024-09-12T17:27:39.275 INFO:tasks.workunit.client.0.smithi044.stdout: tag: 2024-09-12T17:27:39.275 INFO:tasks.workunit.client.0.smithi044.stdout: lockers: 2024-09-12T17:27:39.275 INFO:tasks.workunit.client.0.smithi044.stdout: client.5042 expiration=0.000000 addr=v1:172.21.15.44:0/3022175960 cookie= 2024-09-12T17:27:39.275 INFO:tasks.workunit.client.0.smithi044.stdout: client.5042 expiration=0.000000 addr=v1:172.21.15.44:0/3022175960 cookie=new cookie 2024-09-12T17:27:40.265 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestCookie (3014 ms) 2024-09-12T17:27:40.266 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T17:27:43.291 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestMultipleLocks (3026 ms) 2024-09-12T17:27:43.291 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T17:27:51.321 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestLockDuration (8029 ms) 2024-09-12T17:27:51.321 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T17:27:54.352 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestAssertLocked (3031 ms) 2024-09-12T17:27:54.352 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T17:27:57.379 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestSetCookie (3027 ms) 2024-09-12T17:27:57.379 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T17:28:18.423 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestRenew (21044 ms) 2024-09-12T17:28:18.423 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T17:28:24.473 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6050 ms) 2024-09-12T17:28:24.473 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T17:28:31.566 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7093 ms) 2024-09-12T17:28:31.566 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T17:28:38.786 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (7220 ms) 2024-09-12T17:28:38.787 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 11 tests from ClsLock (66640 ms total) 2024-09-12T17:28:38.787 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:28:38.787 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:28:38.787 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 11 tests from 1 test suite ran. (66640 ms total) 2024-09-12T17:28:38.787 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 11 tests. 2024-09-12T17:28:38.791 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:28:38.791 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:28:38.837 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T17:28:38.840 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T17:28:38.840 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T17:28:38.925 INFO:tasks.workunit.client.0.smithi044.stdout:Running main() from gmock_main.cc 2024-09-12T17:28:38.925 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:28:38.925 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:28:38.926 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 4 tests from cls_log 2024-09-12T17:28:38.927 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T17:28:41.824 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_log.test_log_add_same_time (2899 ms) 2024-09-12T17:28:41.824 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T17:28:44.845 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_log.test_log_add_different_time (3022 ms) 2024-09-12T17:28:44.846 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T17:28:47.864 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_log.trim_by_time (3019 ms) 2024-09-12T17:28:47.864 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T17:28:50.898 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_log.trim_by_marker (3034 ms) 2024-09-12T17:28:50.898 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 4 tests from cls_log (11974 ms total) 2024-09-12T17:28:50.899 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:28:50.899 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:28:50.899 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 4 tests from 1 test suite ran. (11974 ms total) 2024-09-12T17:28:50.899 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 4 tests. 2024-09-12T17:28:50.902 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:28:50.902 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:28:50.947 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T17:28:50.948 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T17:28:50.948 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T17:28:51.036 INFO:tasks.workunit.client.0.smithi044.stdout:Running main() from gmock_main.cc 2024-09-12T17:28:51.036 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:28:51.036 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:28:51.036 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 10 tests from cls_refcount 2024-09-12T17:28:51.036 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T17:28:53.925 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.test_implicit (2889 ms) 2024-09-12T17:28:53.925 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T17:28:56.936 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3011 ms) 2024-09-12T17:28:56.937 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T17:29:06.008 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.test_put_snap (9072 ms) 2024-09-12T17:29:06.008 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T17:29:09.025 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.test_explicit (3017 ms) 2024-09-12T17:29:09.025 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.set 2024-09-12T17:29:12.043 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.set (3018 ms) 2024-09-12T17:29:12.043 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T17:29:19.080 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.test_implicit_ec (7036 ms) 2024-09-12T17:29:19.080 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T17:29:26.122 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7042 ms) 2024-09-12T17:29:26.122 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T17:29:38.179 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.test_put_snap_ec (12057 ms) 2024-09-12T17:29:38.180 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T17:29:45.203 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.test_explicit_ec (7025 ms) 2024-09-12T17:29:45.203 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T17:29:52.240 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_refcount.set_ec (7037 ms) 2024-09-12T17:29:52.241 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 10 tests from cls_refcount (61205 ms total) 2024-09-12T17:29:52.241 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:29:52.241 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:29:52.241 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 10 tests from 1 test suite ran. (61205 ms total) 2024-09-12T17:29:52.241 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 10 tests. 2024-09-12T17:29:52.244 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:29:52.244 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:29:52.288 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T17:29:52.289 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T17:29:52.290 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T17:29:52.376 INFO:tasks.workunit.client.0.smithi044.stdout:Running main() from gmock_main.cc 2024-09-12T17:29:52.376 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-12T17:29:52.376 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:29:52.377 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 18 tests from cls_rgw 2024-09-12T17:29:54.265 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T17:29:54.314 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.index_basic (49 ms) 2024-09-12T17:29:54.314 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T17:29:54.350 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (36 ms) 2024-09-12T17:29:54.350 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T17:29:54.394 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.index_remove_object (44 ms) 2024-09-12T17:29:54.395 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T17:29:55.889 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.index_suggest (1494 ms) 2024-09-12T17:29:55.889 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T17:29:55.895 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.index_suggest_complete (7 ms) 2024-09-12T17:29:55.895 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T17:29:55.922 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.index_list (26 ms) 2024-09-12T17:29:55.922 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T17:30:16.496 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.index_list_delimited (20574 ms) 2024-09-12T17:30:16.496 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T17:30:16.572 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.bi_list (77 ms) 2024-09-12T17:30:16.573 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T17:30:16.583 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2024-09-12T17:30:16.583 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T17:30:16.592 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.gc_list (10 ms) 2024-09-12T17:30:16.592 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T17:30:24.358 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.gc_defer (7766 ms) 2024-09-12T17:30:24.358 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T17:30:24.647 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.usage_basic (289 ms) 2024-09-12T17:30:24.647 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T17:30:24.648 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-09-12T17:30:24.648 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T17:30:24.743 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.usage_clear (94 ms) 2024-09-12T17:30:24.743 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T17:30:24.785 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.bi_log_trim (43 ms) 2024-09-12T17:30:24.785 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T17:30:24.801 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.index_racing_removes (16 ms) 2024-09-12T17:30:24.801 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T17:30:24.814 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.reshardlog_list (13 ms) 2024-09-12T17:30:24.815 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T17:30:24.825 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw.reshardlog_num (11 ms) 2024-09-12T17:30:25.358 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 18 tests from cls_rgw (30560 ms total) 2024-09-12T17:30:25.358 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:30:25.358 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:30:25.358 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 18 tests from 1 test suite ran. (32982 ms total) 2024-09-12T17:30:25.358 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 18 tests. 2024-09-12T17:30:25.361 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:30:25.362 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:30:25.404 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T17:30:25.406 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T17:30:25.406 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T17:30:25.491 INFO:tasks.workunit.client.0.smithi044.stdout:Running main() from gmock_main.cc 2024-09-12T17:30:25.491 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:30:25.492 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:30:25.492 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T17:30:25.492 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T17:30:27.373 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.init (1881 ms) 2024-09-12T17:30:27.373 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T17:30:27.401 INFO:tasks.workunit.client.0.smithi044.stderr:[ ] list info tag = chain-0 2024-09-12T17:30:27.401 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (28 ms) 2024-09-12T17:30:27.401 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T17:30:27.410 INFO:tasks.workunit.client.0.smithi044.stderr:[ ] next_marker is: = 0/4263 2024-09-12T17:30:27.410 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (10 ms) 2024-09-12T17:30:27.411 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T17:30:27.420 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (10 ms) 2024-09-12T17:30:27.420 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T17:30:27.494 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (74 ms) 2024-09-12T17:30:27.494 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T17:30:27.502 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (8 ms) 2024-09-12T17:30:27.502 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T17:30:27.509 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (7 ms) 2024-09-12T17:30:27.509 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T17:30:27.518 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (9 ms) 2024-09-12T17:30:27.518 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T17:30:28.393 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_gc.finalize (875 ms) 2024-09-12T17:30:28.393 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 9 tests from cls_rgw_gc (2902 ms total) 2024-09-12T17:30:28.393 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:30:28.394 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:30:28.394 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 9 tests from 1 test suite ran. (2902 ms total) 2024-09-12T17:30:28.394 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 9 tests. 2024-09-12T17:30:28.396 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:30:28.397 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:30:28.442 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T17:30:28.443 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T17:30:28.444 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T17:30:28.502 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:28.502 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:28.502 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T17:30:28.503 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:30:30.393 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T17:30:30.394 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T17:30:30.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.416+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~459T17PBVYD6.0 size=82690 2024-09-12T17:30:30.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.416+0000 7fece65ff780 1 > prepared multipart upload key=LSGN631FW1P8 upload=459T17PBVYD6 tag=O1CH27JQWRYZ type=write size=1131266 2024-09-12T17:30:30.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.417+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=MJE8OTVR79K3 type=del size=3684295 2024-09-12T17:30:30.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.419+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=KID9VJ7KX680 type=write size=383983 2024-09-12T17:30:30.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.420+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=U7W3S2U1NNEP type=del size=672279 2024-09-12T17:30:30.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.422+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=J0N91EBEFFCS type=del size=2060685 2024-09-12T17:30:30.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.424+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~D3LXAZ0RBDTU.0 size=1048576 2024-09-12T17:30:30.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.426+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~D3LXAZ0RBDTU.1 size=1048576 2024-09-12T17:30:30.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.427+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~D3LXAZ0RBDTU.2 size=922796 2024-09-12T17:30:30.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.427+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=D3LXAZ0RBDTU tag=FKBJKUNIW3HG type=write size=4068524 2024-09-12T17:30:30.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.428+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=EW57NJ9WSC2U type=del size=4115608 2024-09-12T17:30:30.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.430+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=J2TG3JB73G14 type=del size=1837264 2024-09-12T17:30:30.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.433+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~BRLVA3CANOPJ.0 size=727674 2024-09-12T17:30:30.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.433+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=BRLVA3CANOPJ tag=WTZ4FK100WYW type=write size=1776250 2024-09-12T17:30:30.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.435+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~5H1ZHVIIR4D9.0 size=878592 2024-09-12T17:30:30.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.435+0000 7fece65ff780 1 > prepared multipart upload key=LSGN631FW1P8 upload=5H1ZHVIIR4D9 tag=25VO4IU6SPYP type=write size=1927168 2024-09-12T17:30:30.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.437+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=MKIE67NIVZKX type=del size=2027896 2024-09-12T17:30:30.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.439+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~4NXH1KSQAC1W.0 size=1048576 2024-09-12T17:30:30.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.440+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~4NXH1KSQAC1W.1 size=1048576 2024-09-12T17:30:30.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.441+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~4NXH1KSQAC1W.2 size=354280 2024-09-12T17:30:30.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.441+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=4NXH1KSQAC1W tag=XMWQCPX3Y5WD type=write size=3500008 2024-09-12T17:30:30.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.443+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=A6L879S27R3I type=del size=2775230 2024-09-12T17:30:30.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.446+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~1YW1VO8NS6WK.0 size=1048576 2024-09-12T17:30:30.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.447+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~1YW1VO8NS6WK.1 size=1048576 2024-09-12T17:30:30.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.448+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~1YW1VO8NS6WK.2 size=438777 2024-09-12T17:30:30.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.448+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=1YW1VO8NS6WK tag=IC7DWZSEW4FR type=write size=3584505 2024-09-12T17:30:30.452 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.450+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~BI0MVQIMON10.0 size=1048576 2024-09-12T17:30:30.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.451+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~BI0MVQIMON10.1 size=1048576 2024-09-12T17:30:30.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.452+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~BI0MVQIMON10.2 size=226738 2024-09-12T17:30:30.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.452+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=BI0MVQIMON10 tag=BCGYF21365I8 type=write size=3372466 2024-09-12T17:30:30.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.455+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~19JOSTIOD2RW.0 size=1048576 2024-09-12T17:30:30.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.456+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~19JOSTIOD2RW.1 size=1048576 2024-09-12T17:30:30.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.457+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~19JOSTIOD2RW.2 size=290523 2024-09-12T17:30:30.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.457+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=19JOSTIOD2RW tag=V71SM749X8DH type=write size=3436251 2024-09-12T17:30:30.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.458+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~459T17PBVYD6.0 size=82690 2024-09-12T17:30:30.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.460+0000 7fece65ff780 1 < completed multipart upload key=LSGN631FW1P8 upload=459T17PBVYD6 tag=O1CH27JQWRYZ type=write size=1131266 2024-09-12T17:30:30.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.461+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=Y8SZBA1232H2 type=del size=816669 2024-09-12T17:30:30.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.463+0000 7fece65ff780 1 < canceled operation key=RKFRKIENSBTO tag=MJE8OTVR79K3 type=del size=3684295 2024-09-12T17:30:30.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.464+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=PUIOZ1U2QHHF type=del size=222791 2024-09-12T17:30:30.467 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.465+0000 7fece65ff780 1 < canceled operation key=I7TGK5A3JHH5 tag=KID9VJ7KX680 type=write size=383983 2024-09-12T17:30:30.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.468+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~JD913IB93FR7.0 size=821965 2024-09-12T17:30:30.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.468+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=JD913IB93FR7 tag=1Q59JWJW3FQG type=write size=1870541 2024-09-12T17:30:30.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.469+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=U7W3S2U1NNEP type=del 2024-09-12T17:30:30.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.472+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~4MK2C09HHUKF.0 size=179481 2024-09-12T17:30:30.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.472+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=4MK2C09HHUKF tag=J71YO2P0AAWJ type=write size=1228057 2024-09-12T17:30:30.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.473+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=J0N91EBEFFCS type=del 2024-09-12T17:30:30.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.474+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=OQUBO1MW0UI7 type=del size=3542912 2024-09-12T17:30:30.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.475+0000 7fece65ff780 1 < canceled part key=_multipart_RKFRKIENSBTO.2~D3LXAZ0RBDTU.0 size=1048576 2024-09-12T17:30:30.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.476+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~D3LXAZ0RBDTU.1 size=1048576 2024-09-12T17:30:30.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.477+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~D3LXAZ0RBDTU.2 size=922796 2024-09-12T17:30:30.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.479+0000 7fece65ff780 1 < canceled multipart upload key=RKFRKIENSBTO upload=D3LXAZ0RBDTU tag=FKBJKUNIW3HG type=write size=4068524 2024-09-12T17:30:30.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.480+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=7L6M28GHC4M0 type=del size=1387599 2024-09-12T17:30:30.483 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.482+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=EW57NJ9WSC2U type=del 2024-09-12T17:30:30.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.483+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=3U113785P6GU type=del size=2351433 2024-09-12T17:30:30.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.484+0000 7fece65ff780 1 < canceled operation key=FX8VJO1YXJ4H tag=J2TG3JB73G14 type=del size=1837264 2024-09-12T17:30:30.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.487+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~35T4ZCAN94Y0.0 size=1048576 2024-09-12T17:30:30.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.488+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~35T4ZCAN94Y0.1 size=1048576 2024-09-12T17:30:30.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.489+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~35T4ZCAN94Y0.2 size=189239 2024-09-12T17:30:30.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.489+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=35T4ZCAN94Y0 tag=1K267ADXBK0K type=write size=3334967 2024-09-12T17:30:30.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.490+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~BRLVA3CANOPJ.0 size=727674 2024-09-12T17:30:30.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.492+0000 7fece65ff780 1 < completed multipart upload key=5A7WPGW5P91B upload=BRLVA3CANOPJ tag=WTZ4FK100WYW type=write size=1776250 2024-09-12T17:30:30.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.493+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=7CR8WA2PG8AQ type=write size=238709 2024-09-12T17:30:30.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.496+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~5H1ZHVIIR4D9.0 size=878592 2024-09-12T17:30:30.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.498+0000 7fece65ff780 1 < completed multipart upload key=LSGN631FW1P8 upload=5H1ZHVIIR4D9 tag=25VO4IU6SPYP type=write size=1927168 2024-09-12T17:30:30.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.499+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=YUON7ZTPN0U1 type=del size=2949326 2024-09-12T17:30:30.503 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.502+0000 7fece65ff780 1 < suggested update operation key=4Z1N3433MC6A tag=MKIE67NIVZKX type=del size=2027896 2024-09-12T17:30:30.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.503+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=L6NWY0HL7UOV type=write size=502250 2024-09-12T17:30:30.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.505+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~4NXH1KSQAC1W.0 size=1048576 2024-09-12T17:30:30.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.506+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~4NXH1KSQAC1W.1 size=1048576 2024-09-12T17:30:30.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.507+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~4NXH1KSQAC1W.2 size=354280 2024-09-12T17:30:30.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.509+0000 7fece65ff780 1 < completed multipart upload key=2HTNXL56URAK upload=4NXH1KSQAC1W tag=XMWQCPX3Y5WD type=write size=3500008 2024-09-12T17:30:30.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.511+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=CTDFDGBTDISV type=del size=1996797 2024-09-12T17:30:30.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.512+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=A6L879S27R3I type=del 2024-09-12T17:30:30.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.515+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~LRL2J9EHJRHF.0 size=670865 2024-09-12T17:30:30.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.515+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=LRL2J9EHJRHF tag=LCEBV1XNF0WI type=write size=1719441 2024-09-12T17:30:30.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.516+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~1YW1VO8NS6WK.0 size=1048576 2024-09-12T17:30:30.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.517+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~1YW1VO8NS6WK.1 size=1048576 2024-09-12T17:30:30.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.518+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~1YW1VO8NS6WK.2 size=438777 2024-09-12T17:30:30.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.520+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=1YW1VO8NS6WK tag=IC7DWZSEW4FR type=write size=3584505 2024-09-12T17:30:30.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.522+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=5LN1TKE692CY type=del size=2818819 2024-09-12T17:30:30.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.523+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~BI0MVQIMON10.0 size=1048576 2024-09-12T17:30:30.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.525+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~BI0MVQIMON10.1 size=1048576 2024-09-12T17:30:30.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.526+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~BI0MVQIMON10.2 size=226738 2024-09-12T17:30:30.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.528+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=BI0MVQIMON10 tag=BCGYF21365I8 type=write size=3372466 2024-09-12T17:30:30.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.530+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=7031VNQII57G type=del size=1959761 2024-09-12T17:30:30.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.531+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~19JOSTIOD2RW.0 size=1048576 2024-09-12T17:30:30.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.532+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~19JOSTIOD2RW.1 size=1048576 2024-09-12T17:30:30.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.533+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~19JOSTIOD2RW.2 size=290523 2024-09-12T17:30:30.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.536+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=19JOSTIOD2RW tag=V71SM749X8DH type=write size=3436251 2024-09-12T17:30:30.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.537+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=WLJQOM43YXFE type=del size=1990744 2024-09-12T17:30:30.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.538+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=Y8SZBA1232H2 type=del 2024-09-12T17:30:30.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.542+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~QFBX7WG1FT07.0 size=1048576 2024-09-12T17:30:30.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.543+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~QFBX7WG1FT07.1 size=436653 2024-09-12T17:30:30.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.543+0000 7fece65ff780 1 > prepared multipart upload key=LSGN631FW1P8 upload=QFBX7WG1FT07 tag=3FYQ1DPPVMSV type=write size=2533805 2024-09-12T17:30:30.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.545+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=PUIOZ1U2QHHF type=del 2024-09-12T17:30:30.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.548+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~15BPVENELDST.0 size=1048576 2024-09-12T17:30:30.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.549+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~15BPVENELDST.1 size=940606 2024-09-12T17:30:30.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.549+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=15BPVENELDST tag=JWJ8QFCBM705 type=write size=3037758 2024-09-12T17:30:30.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.550+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~JD913IB93FR7.0 size=821965 2024-09-12T17:30:30.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.553+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=JD913IB93FR7 tag=1Q59JWJW3FQG type=write size=1870541 2024-09-12T17:30:30.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.555+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=6RWU42ERTJ23 type=del size=3175671 2024-09-12T17:30:30.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.558+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~4MK2C09HHUKF.0 size=179481 2024-09-12T17:30:30.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.560+0000 7fece65ff780 1 < completed multipart upload key=9KYNMM6W7RRM upload=4MK2C09HHUKF tag=J71YO2P0AAWJ type=write size=1228057 2024-09-12T17:30:30.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.562+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=BBM1X5S06IHH type=del size=1712947 2024-09-12T17:30:30.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.563+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=OQUBO1MW0UI7 type=del 2024-09-12T17:30:30.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.564+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=3YK8PXH7BQD3 type=write size=444326 2024-09-12T17:30:30.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.565+0000 7fece65ff780 -1 < failed to complete operation key=4Z1N3433MC6A tag=7L6M28GHC4M0 type=del size=1387599: (22) Invalid argument 2024-09-12T17:30:30.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.566+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=WU64IWJMO295 type=del size=2923206 2024-09-12T17:30:30.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.568+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=3U113785P6GU type=del 2024-09-12T17:30:30.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.569+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=5A4L0YSOOKM2 type=del size=3173064 2024-09-12T17:30:30.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.570+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~35T4ZCAN94Y0.0 size=1048576 2024-09-12T17:30:30.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.572+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~35T4ZCAN94Y0.1 size=1048576 2024-09-12T17:30:30.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.573+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~35T4ZCAN94Y0.2 size=189239 2024-09-12T17:30:30.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.575+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=35T4ZCAN94Y0 tag=1K267ADXBK0K type=write size=3334967 2024-09-12T17:30:30.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.576+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=TH7I3BDIOWQZ type=del size=212058 2024-09-12T17:30:30.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.578+0000 7fece65ff780 1 < canceled operation key=Y30269Q7R340 tag=7CR8WA2PG8AQ type=write size=238709 2024-09-12T17:30:30.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.579+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=8M0WTPO79E2B type=del size=183778 2024-09-12T17:30:30.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.580+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=YUON7ZTPN0U1 type=del 2024-09-12T17:30:30.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.582+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=L7IWBR51V2D2 type=write size=425934 2024-09-12T17:30:30.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.583+0000 7fece65ff780 1 < completed write operation key=W3MBKNIBLV7W tag=L6NWY0HL7UOV type=write size=502250 2024-09-12T17:30:30.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.586+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~QREF78IOAYVZ.0 size=923185 2024-09-12T17:30:30.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.586+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=QREF78IOAYVZ tag=FXJLVV8LKFSM type=write size=1971761 2024-09-12T17:30:30.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.587+0000 7fece65ff780 1 < completed delete operation key=5A7WPGW5P91B tag=CTDFDGBTDISV type=del 2024-09-12T17:30:30.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.588+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=67JX220G4Y8D type=del size=1959742 2024-09-12T17:30:30.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.590+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~LRL2J9EHJRHF.0 size=670865 2024-09-12T17:30:30.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.592+0000 7fece65ff780 1 < completed multipart upload key=FX8VJO1YXJ4H upload=LRL2J9EHJRHF tag=LCEBV1XNF0WI type=write size=1719441 2024-09-12T17:30:30.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.594+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=KB1YW3B2BKNJ type=del size=2792609 2024-09-12T17:30:30.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.595+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=5LN1TKE692CY type=del 2024-09-12T17:30:30.600 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.597+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~3N22K58DIKA8.0 size=1048576 2024-09-12T17:30:30.600 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.598+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~3N22K58DIKA8.1 size=228242 2024-09-12T17:30:30.600 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.598+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=3N22K58DIKA8 tag=QJ9CA9Y5A726 type=write size=2325394 2024-09-12T17:30:30.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.600+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=7031VNQII57G type=del 2024-09-12T17:30:30.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.601+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=6AQT1VQ97I2O type=del size=3047496 2024-09-12T17:30:30.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.602+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=WLJQOM43YXFE type=del 2024-09-12T17:30:30.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.603+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=XGE35S7AX20V type=write size=890118 2024-09-12T17:30:30.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.605+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~QFBX7WG1FT07.0 size=1048576 2024-09-12T17:30:30.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.606+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~QFBX7WG1FT07.1 size=436653 2024-09-12T17:30:30.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.608+0000 7fece65ff780 1 < completed multipart upload key=LSGN631FW1P8 upload=QFBX7WG1FT07 tag=3FYQ1DPPVMSV type=write size=2533805 2024-09-12T17:30:30.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.609+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=NDS09WT4XMDV type=del size=408341 2024-09-12T17:30:30.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.610+0000 7fece65ff780 1 < canceled part key=_multipart_ZEFSNR1IIA10.2~15BPVENELDST.0 size=1048576 2024-09-12T17:30:30.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.611+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~15BPVENELDST.1 size=940606 2024-09-12T17:30:30.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.613+0000 7fece65ff780 1 < canceled multipart upload key=ZEFSNR1IIA10 upload=15BPVENELDST tag=JWJ8QFCBM705 type=write size=3037758 2024-09-12T17:30:30.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.614+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=E0GEXPK9OAGQ type=del size=1853098 2024-09-12T17:30:30.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.616+0000 7fece65ff780 1 < canceled operation key=1G9VNO1V4IMW tag=6RWU42ERTJ23 type=del size=3175671 2024-09-12T17:30:30.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.617+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=EH33H4R52QZP type=del size=4088930 2024-09-12T17:30:30.620 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.618+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=BBM1X5S06IHH type=del 2024-09-12T17:30:30.621 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.620+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=Z5VT8NM46CNS type=del size=1871797 2024-09-12T17:30:30.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.621+0000 7fece65ff780 1 < completed write operation key=CEERZVBJQHP0 tag=3YK8PXH7BQD3 type=write size=444326 2024-09-12T17:30:30.624 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.622+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=FRATHNR2I223 type=del size=1388685 2024-09-12T17:30:30.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.623+0000 7fece65ff780 1 < completed delete operation key=IMCE9Z7P4S6R tag=WU64IWJMO295 type=del 2024-09-12T17:30:30.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.626+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~MP68R7JGC0JD.0 size=1048576 2024-09-12T17:30:30.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.627+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~MP68R7JGC0JD.1 size=204478 2024-09-12T17:30:30.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.627+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=MP68R7JGC0JD tag=09DLFX6Z5EEA type=write size=2301630 2024-09-12T17:30:30.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.628+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=5A4L0YSOOKM2 type=del 2024-09-12T17:30:30.631 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.629+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=PRZ2Q8G58L81 type=del size=2971011 2024-09-12T17:30:30.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.631+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=TH7I3BDIOWQZ type=del 2024-09-12T17:30:30.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.632+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=ZOLZZA8ATVCX type=del size=4132147 2024-09-12T17:30:30.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.633+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=8M0WTPO79E2B type=del 2024-09-12T17:30:30.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.635+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=T03XSC0PXHI8 type=del size=3110596 2024-09-12T17:30:30.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.637+0000 7fece65ff780 1 < suggested update operation key=5LAOX5H1AQWJ tag=L7IWBR51V2D2 type=write size=425934 2024-09-12T17:30:30.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.638+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=519BURP7JYRS type=del size=1697597 2024-09-12T17:30:30.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.639+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~QREF78IOAYVZ.0 size=923185 2024-09-12T17:30:30.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.642+0000 7fece65ff780 1 < completed multipart upload key=I31CKY20NO9S upload=QREF78IOAYVZ tag=FXJLVV8LKFSM type=write size=1971761 2024-09-12T17:30:30.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.645+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~8HMCKNPA2X7H.0 size=1048576 2024-09-12T17:30:30.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.646+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~8HMCKNPA2X7H.1 size=105567 2024-09-12T17:30:30.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.646+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=8HMCKNPA2X7H tag=4PRTC1F611MM type=write size=2202719 2024-09-12T17:30:30.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.649+0000 7fece65ff780 1 < suggested remove operation key=6CCPZ4TVIU5N tag=67JX220G4Y8D type=del 2024-09-12T17:30:30.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.650+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=SRG7POLYWFCD type=del size=3806395 2024-09-12T17:30:30.653 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.652+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=KB1YW3B2BKNJ type=del 2024-09-12T17:30:30.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.653+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=ZR7DBSWTKI2L type=del size=4179353 2024-09-12T17:30:30.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.654+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~3N22K58DIKA8.0 size=1048576 2024-09-12T17:30:30.657 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.656+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~3N22K58DIKA8.1 size=228242 2024-09-12T17:30:30.659 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.658+0000 7fece65ff780 1 < completed multipart upload key=IMCE9Z7P4S6R upload=3N22K58DIKA8 tag=QJ9CA9Y5A726 type=write size=2325394 2024-09-12T17:30:30.661 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.659+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=03NUMH091SSL type=del size=4050428 2024-09-12T17:30:30.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.661+0000 7fece65ff780 -1 < failed to complete operation key=5LAOX5H1AQWJ tag=6AQT1VQ97I2O type=del size=3047496: (22) Invalid argument 2024-09-12T17:30:30.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.662+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=IV1MTTLPPEKE type=del size=3049870 2024-09-12T17:30:30.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.665+0000 7fece65ff780 1 < suggested remove operation key=I7TGK5A3JHH5 tag=XGE35S7AX20V type=write 2024-09-12T17:30:30.668 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.666+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=BZD753PS20P2 type=write size=611435 2024-09-12T17:30:30.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.669+0000 7fece65ff780 1 < suggested remove operation key=UN6FLMRMAPUS tag=NDS09WT4XMDV type=del 2024-09-12T17:30:30.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.670+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=069ZEL6LB3MP type=del size=834213 2024-09-12T17:30:30.675 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.673+0000 7fece65ff780 1 < suggested remove operation key=2HTNXL56URAK tag=E0GEXPK9OAGQ type=del 2024-09-12T17:30:30.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.675+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~4FUQVHIOHUEZ.0 size=1048576 2024-09-12T17:30:30.678 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.676+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~4FUQVHIOHUEZ.1 size=485265 2024-09-12T17:30:30.678 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.676+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=4FUQVHIOHUEZ tag=QVLVL6XTY1R6 type=write size=2582417 2024-09-12T17:30:30.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.677+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=EH33H4R52QZP type=del 2024-09-12T17:30:30.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.680+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~SU4EWQK33BC2.0 size=294640 2024-09-12T17:30:30.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.680+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=SU4EWQK33BC2 tag=40K419PVLUKI type=write size=1343216 2024-09-12T17:30:30.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.681+0000 7fece65ff780 -1 < failed to complete operation key=I7TGK5A3JHH5 tag=Z5VT8NM46CNS type=del size=1871797: (22) Invalid argument 2024-09-12T17:30:30.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.682+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=JQDBN33IHVGP type=del size=3812986 2024-09-12T17:30:30.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.685+0000 7fece65ff780 1 < suggested update operation key=7AS5L998SDV7 tag=FRATHNR2I223 type=del size=1388685 2024-09-12T17:30:30.690 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.688+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=88ML31CER00O type=del size=3126035 2024-09-12T17:30:30.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.689+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~MP68R7JGC0JD.0 size=1048576 2024-09-12T17:30:30.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.690+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~MP68R7JGC0JD.1 size=204478 2024-09-12T17:30:30.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.692+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=MP68R7JGC0JD tag=09DLFX6Z5EEA type=write size=2301630 2024-09-12T17:30:30.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.695+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~CC682OXSWOX6.0 size=897167 2024-09-12T17:30:30.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.695+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=CC682OXSWOX6 tag=SIAD8Y1U4RW6 type=write size=1945743 2024-09-12T17:30:30.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.696+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=PRZ2Q8G58L81 type=del 2024-09-12T17:30:30.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.699+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~PLFOUTBXENUZ.0 size=1048576 2024-09-12T17:30:30.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.700+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~PLFOUTBXENUZ.1 size=679091 2024-09-12T17:30:30.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.700+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=PLFOUTBXENUZ tag=EH00C7LAMM3W type=write size=2776243 2024-09-12T17:30:30.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.701+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=ZOLZZA8ATVCX type=del 2024-09-12T17:30:30.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.703+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=X21AP0YZJ7MB type=del size=4154829 2024-09-12T17:30:30.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.704+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=T03XSC0PXHI8 type=del 2024-09-12T17:30:30.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.707+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~BTR46SWIA33Y.0 size=1048576 2024-09-12T17:30:30.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.708+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~BTR46SWIA33Y.1 size=671719 2024-09-12T17:30:30.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.708+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=BTR46SWIA33Y tag=NCO2V3GZGA8W type=write size=2768871 2024-09-12T17:30:30.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.709+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=519BURP7JYRS type=del 2024-09-12T17:30:30.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.711+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=1PIR0F5B7Z1F type=del size=1652480 2024-09-12T17:30:30.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.712+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~8HMCKNPA2X7H.0 size=1048576 2024-09-12T17:30:30.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.713+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~8HMCKNPA2X7H.1 size=105567 2024-09-12T17:30:30.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.715+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=8HMCKNPA2X7H tag=4PRTC1F611MM type=write size=2202719 2024-09-12T17:30:30.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.716+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=6K03S6WOVK36 type=del size=2675950 2024-09-12T17:30:30.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.717+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=SRG7POLYWFCD type=del 2024-09-12T17:30:30.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.720+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~WZDJFRS9TNU4.0 size=1048576 2024-09-12T17:30:30.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.721+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~WZDJFRS9TNU4.1 size=712739 2024-09-12T17:30:30.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.721+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=WZDJFRS9TNU4 tag=AV827R16Q763 type=write size=2809891 2024-09-12T17:30:30.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.722+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=ZR7DBSWTKI2L type=del 2024-09-12T17:30:30.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.723+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=J31FSMXZRC01 type=del size=3081968 2024-09-12T17:30:30.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.724+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=03NUMH091SSL type=del 2024-09-12T17:30:30.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.725+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=PZKME1A3PYZU type=del size=3892772 2024-09-12T17:30:30.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.727+0000 7fece65ff780 1 < suggested remove operation key=2HTNXL56URAK tag=IV1MTTLPPEKE type=del 2024-09-12T17:30:30.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.729+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=V1VZJUL1PEHA type=del size=568077 2024-09-12T17:30:30.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.730+0000 7fece65ff780 1 < completed write operation key=Y30269Q7R340 tag=BZD753PS20P2 type=write size=611435 2024-09-12T17:30:30.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.731+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=RG0PIEHUSPIC type=del size=457939 2024-09-12T17:30:30.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.732+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=069ZEL6LB3MP type=del 2024-09-12T17:30:30.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.734+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~OBRT8OCNMION.0 size=1048576 2024-09-12T17:30:30.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.735+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~OBRT8OCNMION.1 size=331362 2024-09-12T17:30:30.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.735+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=OBRT8OCNMION tag=IWRWVXZACJTD type=write size=2428514 2024-09-12T17:30:30.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.736+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~4FUQVHIOHUEZ.0 size=1048576 2024-09-12T17:30:30.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.737+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~4FUQVHIOHUEZ.1 size=485265 2024-09-12T17:30:30.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.739+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=4FUQVHIOHUEZ tag=QVLVL6XTY1R6 type=write size=2582417 2024-09-12T17:30:30.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.741+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~JIRM0MXTY136.0 size=327599 2024-09-12T17:30:30.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.741+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=JIRM0MXTY136 tag=H53ILYDNS9EO type=write size=1376175 2024-09-12T17:30:30.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.742+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~SU4EWQK33BC2.0 size=294640 2024-09-12T17:30:30.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.744+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=SU4EWQK33BC2 tag=40K419PVLUKI type=write size=1343216 2024-09-12T17:30:30.748 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.746+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~XUR0NXLMUM3F.0 size=816939 2024-09-12T17:30:30.748 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.746+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=XUR0NXLMUM3F tag=W3EE85HU1NTH type=write size=1865515 2024-09-12T17:30:30.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.747+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=JQDBN33IHVGP type=del 2024-09-12T17:30:30.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.750+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~OOJLM7KIUKRL.0 size=1048576 2024-09-12T17:30:30.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.750+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~OOJLM7KIUKRL.1 size=432106 2024-09-12T17:30:30.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.750+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=OOJLM7KIUKRL tag=HWEND5RUUCSV type=write size=2529258 2024-09-12T17:30:30.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.751+0000 7fece65ff780 -1 < no bi entry to suggest for operation key=2HTNXL56URAK tag=88ML31CER00O type=del size=3126035: (2) No such file or directory 2024-09-12T17:30:30.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.752+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=34HYABMM7BQL type=del size=2874819 2024-09-12T17:30:30.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.753+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~CC682OXSWOX6.0 size=897167 2024-09-12T17:30:30.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.755+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=CC682OXSWOX6 tag=SIAD8Y1U4RW6 type=write size=1945743 2024-09-12T17:30:30.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.758+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~BUUSZXGLGNVS.0 size=1048576 2024-09-12T17:30:30.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.758+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~BUUSZXGLGNVS.1 size=1048576 2024-09-12T17:30:30.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.759+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~BUUSZXGLGNVS.2 size=107747 2024-09-12T17:30:30.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.759+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=BUUSZXGLGNVS tag=8231MT9L6ONO type=write size=3253475 2024-09-12T17:30:30.762 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.761+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~PLFOUTBXENUZ.0 size=1048576 2024-09-12T17:30:30.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.761+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~PLFOUTBXENUZ.1 size=679091 2024-09-12T17:30:30.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.764+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=PLFOUTBXENUZ tag=EH00C7LAMM3W type=write size=2776243 2024-09-12T17:30:30.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.766+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~9Q291F1K0MOH.0 size=145628 2024-09-12T17:30:30.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.766+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=9Q291F1K0MOH tag=QJKXASKMDA9P type=write size=1194204 2024-09-12T17:30:30.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.767+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=X21AP0YZJ7MB type=del 2024-09-12T17:30:30.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.769+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=34VLEQEQ606J type=del size=2120675 2024-09-12T17:30:30.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.770+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~BTR46SWIA33Y.0 size=1048576 2024-09-12T17:30:30.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.770+0000 7fece65ff780 1 < canceled part key=_multipart_807GX4RQQLL4.2~BTR46SWIA33Y.1 size=671719 2024-09-12T17:30:30.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.773+0000 7fece65ff780 1 < canceled multipart upload key=807GX4RQQLL4 upload=BTR46SWIA33Y tag=NCO2V3GZGA8W type=write size=2768871 2024-09-12T17:30:30.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.774+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=AQSNDT2NF7LU type=write size=469313 2024-09-12T17:30:30.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.775+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=1PIR0F5B7Z1F type=del 2024-09-12T17:30:30.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.777+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=UTWHP4HYA7IU type=del size=3959316 2024-09-12T17:30:30.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.778+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=6K03S6WOVK36 type=del 2024-09-12T17:30:30.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.780+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~X82J33YB47SM.0 size=1048576 2024-09-12T17:30:30.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.781+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~X82J33YB47SM.1 size=1048576 2024-09-12T17:30:30.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.782+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~X82J33YB47SM.2 size=124349 2024-09-12T17:30:30.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.782+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=X82J33YB47SM tag=2FEAFUDAXJUG type=write size=3270077 2024-09-12T17:30:30.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.783+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~WZDJFRS9TNU4.0 size=1048576 2024-09-12T17:30:30.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.783+0000 7fece65ff780 1 < canceled part key=_multipart_1G9VNO1V4IMW.2~WZDJFRS9TNU4.1 size=712739 2024-09-12T17:30:30.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.785+0000 7fece65ff780 1 < canceled multipart upload key=1G9VNO1V4IMW upload=WZDJFRS9TNU4 tag=AV827R16Q763 type=write size=2809891 2024-09-12T17:30:30.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.787+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~FGPXDPOOIXN1.0 size=1048576 2024-09-12T17:30:30.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.788+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~FGPXDPOOIXN1.1 size=761866 2024-09-12T17:30:30.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.788+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=FGPXDPOOIXN1 tag=NGWMB6CXVYGJ type=write size=2859018 2024-09-12T17:30:30.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.790+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=J31FSMXZRC01 type=del 2024-09-12T17:30:30.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.792+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~GVXDDCQAL8MC.0 size=1029604 2024-09-12T17:30:30.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.792+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=GVXDDCQAL8MC tag=5EE7T1AB2XJO type=write size=2078180 2024-09-12T17:30:30.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.796+0000 7fece65ff780 1 < suggested remove operation key=9IGJG88NX1FS tag=PZKME1A3PYZU type=del 2024-09-12T17:30:30.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.797+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=1IM8U5DMJ3DD type=del size=3322155 2024-09-12T17:30:30.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.799+0000 7fece65ff780 1 < suggested remove operation key=OPMR1WMB14CA tag=V1VZJUL1PEHA type=del 2024-09-12T17:30:30.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.801+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=PAN89KUDBAWY type=del size=2802417 2024-09-12T17:30:30.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.802+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=RG0PIEHUSPIC type=del 2024-09-12T17:30:30.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.805+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~YWI91839Z2JL.0 size=1048576 2024-09-12T17:30:30.807 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.806+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~YWI91839Z2JL.1 size=1048576 2024-09-12T17:30:30.808 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.807+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~YWI91839Z2JL.2 size=454725 2024-09-12T17:30:30.808 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.807+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=YWI91839Z2JL tag=G3HTUQNN6H0Q type=write size=3600453 2024-09-12T17:30:30.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.808+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~OBRT8OCNMION.0 size=1048576 2024-09-12T17:30:30.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.809+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~OBRT8OCNMION.1 size=331362 2024-09-12T17:30:30.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.811+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=OBRT8OCNMION tag=IWRWVXZACJTD type=write size=2428514 2024-09-12T17:30:30.814 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.812+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=3UCC9FTN7IQM type=del size=1588409 2024-09-12T17:30:30.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.813+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~JIRM0MXTY136.0 size=327599 2024-09-12T17:30:30.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.815+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=JIRM0MXTY136 tag=H53ILYDNS9EO type=write size=1376175 2024-09-12T17:30:30.818 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.817+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=SAXOVJ6XVXVS type=del size=1711574 2024-09-12T17:30:30.819 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.817+0000 7fece65ff780 1 < canceled part key=_multipart_TLEZIJ4881G7.2~XUR0NXLMUM3F.0 size=816939 2024-09-12T17:30:30.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.819+0000 7fece65ff780 1 < canceled multipart upload key=TLEZIJ4881G7 upload=XUR0NXLMUM3F tag=W3EE85HU1NTH type=write size=1865515 2024-09-12T17:30:30.822 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.820+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=Z9Q7NBID9OS3 type=del size=2531357 2024-09-12T17:30:30.823 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.822+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~OOJLM7KIUKRL.0 size=1048576 2024-09-12T17:30:30.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.823+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~OOJLM7KIUKRL.1 size=432106 2024-09-12T17:30:30.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.825+0000 7fece65ff780 1 < completed multipart upload key=2HTNXL56URAK upload=OOJLM7KIUKRL tag=HWEND5RUUCSV type=write size=2529258 2024-09-12T17:30:30.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.827+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~U11X4M23X1T1.0 size=1048576 2024-09-12T17:30:30.829 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.828+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~U11X4M23X1T1.1 size=24851 2024-09-12T17:30:30.829 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.828+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=U11X4M23X1T1 tag=XBBGMO7OVAQB type=write size=2122003 2024-09-12T17:30:30.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.829+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=34HYABMM7BQL type=del 2024-09-12T17:30:30.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.831+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~4E84YTZVT2WE.0 size=1048576 2024-09-12T17:30:30.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.832+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~4E84YTZVT2WE.1 size=1048576 2024-09-12T17:30:30.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.833+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~4E84YTZVT2WE.2 size=49191 2024-09-12T17:30:30.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.833+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=4E84YTZVT2WE tag=EX2ST312BK1F type=write size=3194919 2024-09-12T17:30:30.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.834+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~BUUSZXGLGNVS.0 size=1048576 2024-09-12T17:30:30.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.835+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~BUUSZXGLGNVS.1 size=1048576 2024-09-12T17:30:30.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.836+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~BUUSZXGLGNVS.2 size=107747 2024-09-12T17:30:30.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.838+0000 7fece65ff780 1 < completed multipart upload key=2HTNXL56URAK upload=BUUSZXGLGNVS tag=8231MT9L6ONO type=write size=3253475 2024-09-12T17:30:30.841 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.840+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=N6AVOWXG981G type=write size=916597 2024-09-12T17:30:30.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.841+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~9Q291F1K0MOH.0 size=145628 2024-09-12T17:30:30.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.843+0000 7fece65ff780 1 < completed multipart upload key=Q00ZFG0BBDG5 upload=9Q291F1K0MOH tag=QJKXASKMDA9P type=write size=1194204 2024-09-12T17:30:30.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.845+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=VZX23Q030UX2 type=del size=2861630 2024-09-12T17:30:30.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.846+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=34VLEQEQ606J type=del 2024-09-12T17:30:30.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.847+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=CNWZIWFQVSZ4 type=del size=2460818 2024-09-12T17:30:30.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.849+0000 7fece65ff780 1 < completed write operation key=Q00ZFG0BBDG5 tag=AQSNDT2NF7LU type=write size=469313 2024-09-12T17:30:30.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.850+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=KUPMVC4YK5K9 type=write size=769352 2024-09-12T17:30:30.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.851+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=UTWHP4HYA7IU type=del 2024-09-12T17:30:30.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.853+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~HE8GIS8TE0RE.0 size=479084 2024-09-12T17:30:30.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.853+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=HE8GIS8TE0RE tag=AT0X29PWH7S9 type=write size=1527660 2024-09-12T17:30:30.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.855+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~X82J33YB47SM.0 size=1048576 2024-09-12T17:30:30.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.856+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~X82J33YB47SM.1 size=1048576 2024-09-12T17:30:30.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.857+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~X82J33YB47SM.2 size=124349 2024-09-12T17:30:30.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.859+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=X82J33YB47SM tag=2FEAFUDAXJUG type=write size=3270077 2024-09-12T17:30:30.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.860+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=8NBSL5RQ7VTZ type=del size=777214 2024-09-12T17:30:30.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.862+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~FGPXDPOOIXN1.0 size=1048576 2024-09-12T17:30:30.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.863+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~FGPXDPOOIXN1.1 size=761866 2024-09-12T17:30:30.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.865+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=FGPXDPOOIXN1 tag=NGWMB6CXVYGJ type=write size=2859018 2024-09-12T17:30:30.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.866+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=NOIJZQY6WM3H type=del size=3105529 2024-09-12T17:30:30.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.867+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~GVXDDCQAL8MC.0 size=1029604 2024-09-12T17:30:30.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.869+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=GVXDDCQAL8MC tag=5EE7T1AB2XJO type=write size=2078180 2024-09-12T17:30:30.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.871+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=SHIPRKGC22JO type=del size=2504495 2024-09-12T17:30:30.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.873+0000 7fece65ff780 1 < suggested update operation key=5A7WPGW5P91B tag=1IM8U5DMJ3DD type=del size=3322155 2024-09-12T17:30:30.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.875+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=NVKZ1PIO90PX type=del size=426633 2024-09-12T17:30:30.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.877+0000 7fece65ff780 1 < suggested remove operation key=LSGN631FW1P8 tag=PAN89KUDBAWY type=del 2024-09-12T17:30:30.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.879+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~DHBWONJQ0IES.0 size=1048576 2024-09-12T17:30:30.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.882+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~DHBWONJQ0IES.1 size=1048576 2024-09-12T17:30:30.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.883+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~DHBWONJQ0IES.2 size=815984 2024-09-12T17:30:30.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.883+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=DHBWONJQ0IES tag=K0EMEMFTOZGW type=write size=3961712 2024-09-12T17:30:30.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.884+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~YWI91839Z2JL.0 size=1048576 2024-09-12T17:30:30.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.885+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~YWI91839Z2JL.1 size=1048576 2024-09-12T17:30:30.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.886+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~YWI91839Z2JL.2 size=454725 2024-09-12T17:30:30.890 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.889+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=YWI91839Z2JL tag=G3HTUQNN6H0Q type=write size=3600453 2024-09-12T17:30:30.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.890+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=XD2XFU8J2ABU type=del size=67603 2024-09-12T17:30:30.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.891+0000 7fece65ff780 1 < completed delete operation key=OIHDAJMPUK4I tag=3UCC9FTN7IQM type=del 2024-09-12T17:30:30.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.894+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~FDH0TPNFK7VQ.0 size=1048576 2024-09-12T17:30:30.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.894+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~FDH0TPNFK7VQ.1 size=1048576 2024-09-12T17:30:30.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.895+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~FDH0TPNFK7VQ.2 size=55227 2024-09-12T17:30:30.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.895+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=FDH0TPNFK7VQ tag=E3P7RH0TWLR4 type=write size=3200955 2024-09-12T17:30:30.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.897+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=SAXOVJ6XVXVS type=del 2024-09-12T17:30:30.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.899+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~2QRBBWZMFGR7.0 size=1048576 2024-09-12T17:30:30.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.900+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~2QRBBWZMFGR7.1 size=1048576 2024-09-12T17:30:30.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.901+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~2QRBBWZMFGR7.2 size=584829 2024-09-12T17:30:30.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.901+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=2QRBBWZMFGR7 tag=4FBGPLINL47O type=write size=3730557 2024-09-12T17:30:30.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.902+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=Z9Q7NBID9OS3 type=del 2024-09-12T17:30:30.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.905+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~ETW4QSTIIKNL.0 size=1048576 2024-09-12T17:30:30.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.906+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~ETW4QSTIIKNL.1 size=1048576 2024-09-12T17:30:30.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.907+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~ETW4QSTIIKNL.2 size=120170 2024-09-12T17:30:30.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.907+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=ETW4QSTIIKNL tag=AZVMZ07H8OZM type=write size=3265898 2024-09-12T17:30:30.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.908+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~U11X4M23X1T1.0 size=1048576 2024-09-12T17:30:30.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.909+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~U11X4M23X1T1.1 size=24851 2024-09-12T17:30:30.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.911+0000 7fece65ff780 1 < completed multipart upload key=4Z1N3433MC6A upload=U11X4M23X1T1 tag=XBBGMO7OVAQB type=write size=2122003 2024-09-12T17:30:30.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.912+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=YIVJWFT0GBB4 type=del size=3477315 2024-09-12T17:30:30.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.913+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~4E84YTZVT2WE.0 size=1048576 2024-09-12T17:30:30.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.915+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~4E84YTZVT2WE.1 size=1048576 2024-09-12T17:30:30.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.916+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~4E84YTZVT2WE.2 size=49191 2024-09-12T17:30:30.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.918+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=4E84YTZVT2WE tag=EX2ST312BK1F type=write size=3194919 2024-09-12T17:30:30.922 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.921+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~32DG30AHSOJP.0 size=274596 2024-09-12T17:30:30.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.921+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=32DG30AHSOJP tag=SKPQIE1WRJ43 type=write size=1323172 2024-09-12T17:30:30.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.922+0000 7fece65ff780 1 < completed write operation key=Y1OT1OLGWB1Q tag=N6AVOWXG981G type=write size=916597 2024-09-12T17:30:30.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.923+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=RKC32VG3NCEL type=del size=3817040 2024-09-12T17:30:30.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.925+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=VZX23Q030UX2 type=del 2024-09-12T17:30:30.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.926+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=1JZT1U9TN86U type=write size=12884 2024-09-12T17:30:30.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.927+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=CNWZIWFQVSZ4 type=del 2024-09-12T17:30:30.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.928+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=NM3UWIW6C2QZ type=del size=2972058 2024-09-12T17:30:30.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.930+0000 7fece65ff780 1 < canceled operation key=4Z1N3433MC6A tag=KUPMVC4YK5K9 type=write size=769352 2024-09-12T17:30:30.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.932+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~MPSWVPEN8AVT.0 size=1048576 2024-09-12T17:30:30.935 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.933+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~MPSWVPEN8AVT.1 size=1048576 2024-09-12T17:30:30.935 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.934+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~MPSWVPEN8AVT.2 size=106555 2024-09-12T17:30:30.935 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.934+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=MPSWVPEN8AVT tag=493LWKMIW91B type=write size=3252283 2024-09-12T17:30:30.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.935+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~HE8GIS8TE0RE.0 size=479084 2024-09-12T17:30:30.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.937+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=HE8GIS8TE0RE tag=AT0X29PWH7S9 type=write size=1527660 2024-09-12T17:30:30.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.940+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~ULDRYON75YPT.0 size=975751 2024-09-12T17:30:30.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.940+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=ULDRYON75YPT tag=H2UXCY5HBDCP type=write size=2024327 2024-09-12T17:30:30.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.941+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=8NBSL5RQ7VTZ type=del 2024-09-12T17:30:30.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.943+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~SP5BLN29THH7.0 size=554305 2024-09-12T17:30:30.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.943+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=SP5BLN29THH7 tag=S97YSCRQAPRD type=write size=1602881 2024-09-12T17:30:30.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.944+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=NOIJZQY6WM3H type=del 2024-09-12T17:30:30.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.946+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~9ES90VVYZHUV.0 size=1048576 2024-09-12T17:30:30.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.947+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~9ES90VVYZHUV.1 size=955909 2024-09-12T17:30:30.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.947+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=9ES90VVYZHUV tag=42SDW7GJ7TFV type=write size=3053061 2024-09-12T17:30:30.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.949+0000 7fece65ff780 1 < canceled operation key=4Z1N3433MC6A tag=SHIPRKGC22JO type=del size=2504495 2024-09-12T17:30:30.952 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.951+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~7T9TQ5VCX1UK.0 size=1048576 2024-09-12T17:30:30.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.952+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~7T9TQ5VCX1UK.1 size=1048576 2024-09-12T17:30:30.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.953+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~7T9TQ5VCX1UK.2 size=955832 2024-09-12T17:30:30.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.953+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=7T9TQ5VCX1UK tag=88NX890VVJBX type=write size=4101560 2024-09-12T17:30:30.957 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.955+0000 7fece65ff780 1 < suggested remove operation key=QQNW20B28RJC tag=NVKZ1PIO90PX type=del 2024-09-12T17:30:30.959 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.958+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~AS83U4IWVRV2.0 size=1048576 2024-09-12T17:30:30.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.959+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~AS83U4IWVRV2.1 size=1048576 2024-09-12T17:30:30.961 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.960+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~AS83U4IWVRV2.2 size=826986 2024-09-12T17:30:30.964 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.960+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=AS83U4IWVRV2 tag=QB6OGU57UONP type=write size=3972714 2024-09-12T17:30:30.965 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.961+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~DHBWONJQ0IES.0 size=1048576 2024-09-12T17:30:30.965 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.962+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~DHBWONJQ0IES.1 size=1048576 2024-09-12T17:30:30.965 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.963+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~DHBWONJQ0IES.2 size=815984 2024-09-12T17:30:30.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.965+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=DHBWONJQ0IES tag=K0EMEMFTOZGW type=write size=3961712 2024-09-12T17:30:30.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.967+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~7LCH0TU3MKG5.0 size=1048576 2024-09-12T17:30:30.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.968+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~7LCH0TU3MKG5.1 size=773982 2024-09-12T17:30:30.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.968+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=7LCH0TU3MKG5 tag=FCCTAS0LBNLW type=write size=2871134 2024-09-12T17:30:30.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.970+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=XD2XFU8J2ABU type=del 2024-09-12T17:30:30.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.971+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=P8DBY8UMP7C2 type=del size=2255955 2024-09-12T17:30:30.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.974+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~FDH0TPNFK7VQ.0 size=1048576 2024-09-12T17:30:30.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.975+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~FDH0TPNFK7VQ.1 size=1048576 2024-09-12T17:30:30.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.976+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~FDH0TPNFK7VQ.2 size=55227 2024-09-12T17:30:30.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.978+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=FDH0TPNFK7VQ tag=E3P7RH0TWLR4 type=write size=3200955 2024-09-12T17:30:30.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.979+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=Y04X2AVV1S67 type=del size=1813615 2024-09-12T17:30:30.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.980+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~2QRBBWZMFGR7.0 size=1048576 2024-09-12T17:30:30.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.980+0000 7fece65ff780 1 < canceled part key=_multipart_KKU8T0CVS40V.2~2QRBBWZMFGR7.1 size=1048576 2024-09-12T17:30:30.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.980+0000 7fece65ff780 1 < canceled part key=_multipart_KKU8T0CVS40V.2~2QRBBWZMFGR7.2 size=584829 2024-09-12T17:30:30.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.982+0000 7fece65ff780 1 < canceled multipart upload key=KKU8T0CVS40V upload=2QRBBWZMFGR7 tag=4FBGPLINL47O type=write size=3730557 2024-09-12T17:30:30.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.984+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~XSS7ITZGC1K5.0 size=765215 2024-09-12T17:30:30.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.984+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=XSS7ITZGC1K5 tag=S6W3OJY5X93Y type=write size=1813791 2024-09-12T17:30:30.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.986+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~ETW4QSTIIKNL.0 size=1048576 2024-09-12T17:30:30.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.987+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~ETW4QSTIIKNL.1 size=1048576 2024-09-12T17:30:30.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.988+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~ETW4QSTIIKNL.2 size=120170 2024-09-12T17:30:30.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.990+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=ETW4QSTIIKNL tag=AZVMZ07H8OZM type=write size=3265898 2024-09-12T17:30:30.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.991+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=G31AYW24ORA0 type=del size=3490140 2024-09-12T17:30:30.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.992+0000 7fece65ff780 1 < canceled operation key=CEERZVBJQHP0 tag=YIVJWFT0GBB4 type=del size=3477315 2024-09-12T17:30:30.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.994+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~ACVUNHEA0EM8.0 size=1033438 2024-09-12T17:30:30.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.994+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=ACVUNHEA0EM8 tag=YZ8F1KNIBWPY type=write size=2082014 2024-09-12T17:30:30.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.996+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~32DG30AHSOJP.0 size=274596 2024-09-12T17:30:30.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:30.998+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=32DG30AHSOJP tag=SKPQIE1WRJ43 type=write size=1323172 2024-09-12T17:30:31.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.000+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~Z3AZ9TAY1EON.0 size=1048576 2024-09-12T17:30:31.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.001+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~Z3AZ9TAY1EON.1 size=374340 2024-09-12T17:30:31.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.001+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=Z3AZ9TAY1EON tag=G13T3X38XOL3 type=write size=2471492 2024-09-12T17:30:31.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.003+0000 7fece65ff780 1 < suggested update operation key=UCBB99EG8XK2 tag=RKC32VG3NCEL type=del size=3817040 2024-09-12T17:30:31.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.004+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=14JO1J18W82L type=del size=1630591 2024-09-12T17:30:31.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.007+0000 7fece65ff780 1 < suggested update operation key=TLEZIJ4881G7 tag=1JZT1U9TN86U type=write size=12884 2024-09-12T17:30:31.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.008+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=8UJE2HMLRDR6 type=write size=61725 2024-09-12T17:30:31.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.009+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=NM3UWIW6C2QZ type=del 2024-09-12T17:30:31.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.012+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~8H0A1916CO2I.0 size=182444 2024-09-12T17:30:31.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.012+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=8H0A1916CO2I tag=0NAZCIR4VXSA type=write size=1231020 2024-09-12T17:30:31.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.013+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~MPSWVPEN8AVT.0 size=1048576 2024-09-12T17:30:31.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.014+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~MPSWVPEN8AVT.1 size=1048576 2024-09-12T17:30:31.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.015+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~MPSWVPEN8AVT.2 size=106555 2024-09-12T17:30:31.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.017+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=MPSWVPEN8AVT tag=493LWKMIW91B type=write size=3252283 2024-09-12T17:30:31.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.018+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=123PRE9T27DQ type=del size=746393 2024-09-12T17:30:31.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.018+0000 7fece65ff780 1 < canceled part key=_multipart_5A7WPGW5P91B.2~ULDRYON75YPT.0 size=975751 2024-09-12T17:30:31.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.020+0000 7fece65ff780 1 < canceled multipart upload key=5A7WPGW5P91B upload=ULDRYON75YPT tag=H2UXCY5HBDCP type=write size=2024327 2024-09-12T17:30:31.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.022+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=RELRB16LIDKW type=write size=252157 2024-09-12T17:30:31.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.023+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~SP5BLN29THH7.0 size=554305 2024-09-12T17:30:31.027 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.025+0000 7fece65ff780 1 < completed multipart upload key=Q00ZFG0BBDG5 upload=SP5BLN29THH7 tag=S97YSCRQAPRD type=write size=1602881 2024-09-12T17:30:31.028 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.026+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=F85WSQR2GMN0 type=del size=324065 2024-09-12T17:30:31.028 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.027+0000 7fece65ff780 1 < canceled part key=_multipart_KKU8T0CVS40V.2~9ES90VVYZHUV.0 size=1048576 2024-09-12T17:30:31.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.028+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~9ES90VVYZHUV.1 size=955909 2024-09-12T17:30:31.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.030+0000 7fece65ff780 1 < canceled multipart upload key=KKU8T0CVS40V upload=9ES90VVYZHUV tag=42SDW7GJ7TFV type=write size=3053061 2024-09-12T17:30:31.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.031+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=P9VDGMQF62BR type=del size=2612012 2024-09-12T17:30:31.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.032+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~7T9TQ5VCX1UK.0 size=1048576 2024-09-12T17:30:31.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.034+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~7T9TQ5VCX1UK.1 size=1048576 2024-09-12T17:30:31.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.035+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~7T9TQ5VCX1UK.2 size=955832 2024-09-12T17:30:31.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.037+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=7T9TQ5VCX1UK tag=88NX890VVJBX type=write size=4101560 2024-09-12T17:30:31.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.039+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=KXP6JB5SHSAT type=del size=1724309 2024-09-12T17:30:31.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.040+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~AS83U4IWVRV2.0 size=1048576 2024-09-12T17:30:31.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.041+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~AS83U4IWVRV2.1 size=1048576 2024-09-12T17:30:31.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.042+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~AS83U4IWVRV2.2 size=826986 2024-09-12T17:30:31.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.044+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=AS83U4IWVRV2 tag=QB6OGU57UONP type=write size=3972714 2024-09-12T17:30:31.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.046+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~GQBR42QRXT1V.0 size=441530 2024-09-12T17:30:31.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.046+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=GQBR42QRXT1V tag=A2FDQCQLKKRR type=write size=1490106 2024-09-12T17:30:31.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.047+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~7LCH0TU3MKG5.0 size=1048576 2024-09-12T17:30:31.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.048+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~7LCH0TU3MKG5.1 size=773982 2024-09-12T17:30:31.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.050+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=7LCH0TU3MKG5 tag=FCCTAS0LBNLW type=write size=2871134 2024-09-12T17:30:31.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.053+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~BA41W7H7EYTF.0 size=99228 2024-09-12T17:30:31.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.053+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=BA41W7H7EYTF tag=CQHNBLHH9USQ type=write size=1147804 2024-09-12T17:30:31.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.054+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=P8DBY8UMP7C2 type=del 2024-09-12T17:30:31.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.055+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=NT20GZVV4AQW type=del size=2448089 2024-09-12T17:30:31.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.056+0000 7fece65ff780 -1 < failed to complete operation key=TLEZIJ4881G7 tag=Y04X2AVV1S67 type=del size=1813615: (22) Invalid argument 2024-09-12T17:30:31.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.058+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=PAO5BMMME3FE type=del size=3328664 2024-09-12T17:30:31.060 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.059+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~XSS7ITZGC1K5.0 size=765215 2024-09-12T17:30:31.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.061+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=XSS7ITZGC1K5 tag=S6W3OJY5X93Y type=write size=1813791 2024-09-12T17:30:31.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.062+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=LG2O02Q5OK4E type=del size=53609 2024-09-12T17:30:31.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.063+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=G31AYW24ORA0 type=del 2024-09-12T17:30:31.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.064+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=KF1JQ3XBHSDL type=del size=3819193 2024-09-12T17:30:31.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.065+0000 7fece65ff780 1 < canceled part key=_multipart_I7TGK5A3JHH5.2~ACVUNHEA0EM8.0 size=1033438 2024-09-12T17:30:31.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.067+0000 7fece65ff780 1 < canceled multipart upload key=I7TGK5A3JHH5 upload=ACVUNHEA0EM8 tag=YZ8F1KNIBWPY type=write size=2082014 2024-09-12T17:30:31.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.069+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~GV2M4L8RA5FQ.0 size=1048576 2024-09-12T17:30:31.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.070+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~GV2M4L8RA5FQ.1 size=1048576 2024-09-12T17:30:31.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.071+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~GV2M4L8RA5FQ.2 size=768618 2024-09-12T17:30:31.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.071+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=GV2M4L8RA5FQ tag=L297E0DZS4KF type=write size=3914346 2024-09-12T17:30:31.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.072+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~Z3AZ9TAY1EON.0 size=1048576 2024-09-12T17:30:31.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.073+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~Z3AZ9TAY1EON.1 size=374340 2024-09-12T17:30:31.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.075+0000 7fece65ff780 1 < completed multipart upload key=I31CKY20NO9S upload=Z3AZ9TAY1EON tag=G13T3X38XOL3 type=write size=2471492 2024-09-12T17:30:31.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.076+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=03VRLOC65H52 type=del size=434674 2024-09-12T17:30:31.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.077+0000 7fece65ff780 -1 < failed to complete operation key=TLEZIJ4881G7 tag=14JO1J18W82L type=del size=1630591: (22) Invalid argument 2024-09-12T17:30:31.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.079+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=1GGBWZQT3RW2 type=del size=1880285 2024-09-12T17:30:31.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.080+0000 7fece65ff780 1 < completed write operation key=FX8VJO1YXJ4H tag=8UJE2HMLRDR6 type=write size=61725 2024-09-12T17:30:31.083 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.081+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=S5WQT576H3A1 type=del size=595654 2024-09-12T17:30:31.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.082+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~8H0A1916CO2I.0 size=182444 2024-09-12T17:30:31.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.084+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=8H0A1916CO2I tag=0NAZCIR4VXSA type=write size=1231020 2024-09-12T17:30:31.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.087+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~AS1COGE3PRDM.0 size=1048576 2024-09-12T17:30:31.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.088+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~AS1COGE3PRDM.1 size=279591 2024-09-12T17:30:31.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.088+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=AS1COGE3PRDM tag=VY79K9Y3PR2Z type=write size=2376743 2024-09-12T17:30:31.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.090+0000 7fece65ff780 1 < suggested remove operation key=TLEZIJ4881G7 tag=123PRE9T27DQ type=del 2024-09-12T17:30:31.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.093+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~PZ522FXZBJMF.0 size=1048576 2024-09-12T17:30:31.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.094+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~PZ522FXZBJMF.1 size=1048576 2024-09-12T17:30:31.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.095+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~PZ522FXZBJMF.2 size=1047067 2024-09-12T17:30:31.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.095+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=PZ522FXZBJMF tag=FTF9XK3110B1 type=write size=4192795 2024-09-12T17:30:31.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.097+0000 7fece65ff780 1 < suggested update operation key=9KYNMM6W7RRM tag=RELRB16LIDKW type=write size=252157 2024-09-12T17:30:31.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.100+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~ZPFA4H8T9YD7.0 size=1048576 2024-09-12T17:30:31.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.100+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~ZPFA4H8T9YD7.1 size=599245 2024-09-12T17:30:31.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.100+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=ZPFA4H8T9YD7 tag=IP30AXDS450V type=write size=2696397 2024-09-12T17:30:31.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.102+0000 7fece65ff780 1 < completed delete operation key=OIHDAJMPUK4I tag=F85WSQR2GMN0 type=del 2024-09-12T17:30:31.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.104+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~M98GPPTIGKTX.0 size=1048576 2024-09-12T17:30:31.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.105+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~M98GPPTIGKTX.1 size=1048576 2024-09-12T17:30:31.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.106+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~M98GPPTIGKTX.2 size=424729 2024-09-12T17:30:31.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.106+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=M98GPPTIGKTX tag=2XBRADR15I33 type=write size=3570457 2024-09-12T17:30:31.110 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.108+0000 7fece65ff780 1 < suggested remove operation key=2HTNXL56URAK tag=P9VDGMQF62BR type=del 2024-09-12T17:30:31.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.109+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=EHJ7K0663II2 type=del size=1039583 2024-09-12T17:30:31.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.111+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=KXP6JB5SHSAT type=del 2024-09-12T17:30:31.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.112+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=SNWQZ6WJQP3U type=del size=1985968 2024-09-12T17:30:31.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.113+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~GQBR42QRXT1V.0 size=441530 2024-09-12T17:30:31.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.115+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=GQBR42QRXT1V tag=A2FDQCQLKKRR type=write size=1490106 2024-09-12T17:30:31.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.117+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~ZAASJF6L73OE.0 size=539990 2024-09-12T17:30:31.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.117+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=ZAASJF6L73OE tag=ZE776U9N4SSL type=write size=1588566 2024-09-12T17:30:31.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.119+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~BA41W7H7EYTF.0 size=99228 2024-09-12T17:30:31.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.121+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=BA41W7H7EYTF tag=CQHNBLHH9USQ type=write size=1147804 2024-09-12T17:30:31.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.122+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=AH37HKRQT2I5 type=del size=1947641 2024-09-12T17:30:31.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.125+0000 7fece65ff780 1 < suggested update operation key=6GUDX5I1AKNH tag=NT20GZVV4AQW type=del size=2448089 2024-09-12T17:30:31.129 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.127+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~NB4UNFXSZ0KG.0 size=1048576 2024-09-12T17:30:31.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.128+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~NB4UNFXSZ0KG.1 size=156288 2024-09-12T17:30:31.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.128+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=NB4UNFXSZ0KG tag=UIB3LB00FTLG type=write size=2253440 2024-09-12T17:30:31.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.131+0000 7fece65ff780 1 < suggested update operation key=YCNQL8CUUGW7 tag=PAO5BMMME3FE type=del size=3328664 2024-09-12T17:30:31.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.132+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=EZ7Q7XM43MA2 type=del size=1688655 2024-09-12T17:30:31.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.133+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=LG2O02Q5OK4E type=del 2024-09-12T17:30:31.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.134+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=BNUTWX2EWAMN type=del size=1432599 2024-09-12T17:30:31.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.136+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=KF1JQ3XBHSDL type=del 2024-09-12T17:30:31.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.139+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~PCT58MPPHJOD.0 size=1048576 2024-09-12T17:30:31.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.140+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~PCT58MPPHJOD.1 size=1048576 2024-09-12T17:30:31.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.141+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~PCT58MPPHJOD.2 size=856832 2024-09-12T17:30:31.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.141+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=PCT58MPPHJOD tag=N2MNDNREQ1G4 type=write size=4002560 2024-09-12T17:30:31.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.143+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~GV2M4L8RA5FQ.0 size=1048576 2024-09-12T17:30:31.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.143+0000 7fece65ff780 1 < canceled part key=_multipart_UN6FLMRMAPUS.2~GV2M4L8RA5FQ.1 size=1048576 2024-09-12T17:30:31.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.144+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~GV2M4L8RA5FQ.2 size=768618 2024-09-12T17:30:31.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.146+0000 7fece65ff780 1 < canceled multipart upload key=UN6FLMRMAPUS upload=GV2M4L8RA5FQ tag=L297E0DZS4KF type=write size=3914346 2024-09-12T17:30:31.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.148+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~BTJ1UKPN2XCS.0 size=1048576 2024-09-12T17:30:31.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.151+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~BTJ1UKPN2XCS.1 size=1048576 2024-09-12T17:30:31.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.152+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~BTJ1UKPN2XCS.2 size=749258 2024-09-12T17:30:31.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.152+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=BTJ1UKPN2XCS tag=LFN1JQORAKY4 type=write size=3894986 2024-09-12T17:30:31.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.154+0000 7fece65ff780 1 < suggested update operation key=ZEFSNR1IIA10 tag=03VRLOC65H52 type=del size=434674 2024-09-12T17:30:31.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.156+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=4ZGU04AU38BT type=del size=818734 2024-09-12T17:30:31.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.157+0000 7fece65ff780 1 < completed delete operation key=5A7WPGW5P91B tag=1GGBWZQT3RW2 type=del 2024-09-12T17:30:31.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.158+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=EPUK84J239NF type=write size=200469 2024-09-12T17:30:31.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.160+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=S5WQT576H3A1 type=del 2024-09-12T17:30:31.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.161+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=XK1D5F1U7491 type=del size=1016701 2024-09-12T17:30:31.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.161+0000 7fece65ff780 1 < canceled part key=_multipart_6CCPZ4TVIU5N.2~AS1COGE3PRDM.0 size=1048576 2024-09-12T17:30:31.164 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.162+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~AS1COGE3PRDM.1 size=279591 2024-09-12T17:30:31.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.165+0000 7fece65ff780 1 < canceled multipart upload key=6CCPZ4TVIU5N upload=AS1COGE3PRDM tag=VY79K9Y3PR2Z type=write size=2376743 2024-09-12T17:30:31.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.166+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=80KHNTFUH8QC type=del size=3954875 2024-09-12T17:30:31.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.167+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~PZ522FXZBJMF.0 size=1048576 2024-09-12T17:30:31.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.168+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~PZ522FXZBJMF.1 size=1048576 2024-09-12T17:30:31.171 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.169+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~PZ522FXZBJMF.2 size=1047067 2024-09-12T17:30:31.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.171+0000 7fece65ff780 1 < completed multipart upload key=I31CKY20NO9S upload=PZ522FXZBJMF tag=FTF9XK3110B1 type=write size=4192795 2024-09-12T17:30:31.174 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.172+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=SCJEMFRE3H08 type=del size=144150 2024-09-12T17:30:31.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.174+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~ZPFA4H8T9YD7.0 size=1048576 2024-09-12T17:30:31.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.175+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~ZPFA4H8T9YD7.1 size=599245 2024-09-12T17:30:31.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.177+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=ZPFA4H8T9YD7 tag=IP30AXDS450V type=write size=2696397 2024-09-12T17:30:31.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.178+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=9UW0V4N3K37Q type=del size=3066830 2024-09-12T17:30:31.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.178+0000 7fece65ff780 1 < canceled part key=_multipart_CBYI6C1ICE08.2~M98GPPTIGKTX.0 size=1048576 2024-09-12T17:30:31.181 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.179+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~M98GPPTIGKTX.1 size=1048576 2024-09-12T17:30:31.182 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.180+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~M98GPPTIGKTX.2 size=424729 2024-09-12T17:30:31.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.182+0000 7fece65ff780 1 < canceled multipart upload key=CBYI6C1ICE08 upload=M98GPPTIGKTX tag=2XBRADR15I33 type=write size=3570457 2024-09-12T17:30:31.185 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.183+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=VI2GB3LKHWUH type=del size=4009389 2024-09-12T17:30:31.186 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.185+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=EHJ7K0663II2 type=del 2024-09-12T17:30:31.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.186+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=M9EEGJBCO67E type=del size=1854481 2024-09-12T17:30:31.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.187+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=SNWQZ6WJQP3U type=del 2024-09-12T17:30:31.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.188+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=RR29WY00QW1Q type=del size=2997289 2024-09-12T17:30:31.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.190+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~ZAASJF6L73OE.0 size=539990 2024-09-12T17:30:31.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.192+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=ZAASJF6L73OE tag=ZE776U9N4SSL type=write size=1588566 2024-09-12T17:30:31.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.193+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=LS5GHNO0U3AX type=del size=1891079 2024-09-12T17:30:31.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.194+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=AH37HKRQT2I5 type=del 2024-09-12T17:30:31.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.196+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=LKHBQ2X4I9IN type=del size=1823436 2024-09-12T17:30:31.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.197+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~NB4UNFXSZ0KG.0 size=1048576 2024-09-12T17:30:31.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.198+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~NB4UNFXSZ0KG.1 size=156288 2024-09-12T17:30:31.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.200+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=NB4UNFXSZ0KG tag=UIB3LB00FTLG type=write size=2253440 2024-09-12T17:30:31.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.202+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~FG6653CNQSJJ.0 size=1048576 2024-09-12T17:30:31.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.203+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~FG6653CNQSJJ.1 size=1048576 2024-09-12T17:30:31.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.204+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~FG6653CNQSJJ.2 size=267357 2024-09-12T17:30:31.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.204+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=FG6653CNQSJJ tag=ZFA25SMQ9Q7F type=write size=3413085 2024-09-12T17:30:31.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.205+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=EZ7Q7XM43MA2 type=del 2024-09-12T17:30:31.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.207+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~50HSX3YX51NG.0 size=1048576 2024-09-12T17:30:31.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.208+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~50HSX3YX51NG.1 size=531791 2024-09-12T17:30:31.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.208+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=50HSX3YX51NG tag=P3MVY9W5GEXK type=write size=2628943 2024-09-12T17:30:31.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.209+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=BNUTWX2EWAMN type=del 2024-09-12T17:30:31.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.210+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=14QCPW7BVOGA type=del size=1773118 2024-09-12T17:30:31.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.212+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~PCT58MPPHJOD.0 size=1048576 2024-09-12T17:30:31.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.213+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~PCT58MPPHJOD.1 size=1048576 2024-09-12T17:30:31.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.214+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~PCT58MPPHJOD.2 size=856832 2024-09-12T17:30:31.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.216+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=PCT58MPPHJOD tag=N2MNDNREQ1G4 type=write size=4002560 2024-09-12T17:30:31.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.217+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=10KBMKUKYB1T type=del size=484272 2024-09-12T17:30:31.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.219+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~BTJ1UKPN2XCS.0 size=1048576 2024-09-12T17:30:31.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.220+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~BTJ1UKPN2XCS.1 size=1048576 2024-09-12T17:30:31.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.221+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~BTJ1UKPN2XCS.2 size=749258 2024-09-12T17:30:31.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.222+0000 7fece65ff780 1 < completed multipart upload key=W3MBKNIBLV7W upload=BTJ1UKPN2XCS tag=LFN1JQORAKY4 type=write size=3894986 2024-09-12T17:30:31.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.224+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=P84DQTEQI0H1 type=del size=2364819 2024-09-12T17:30:31.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.225+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=4ZGU04AU38BT type=del 2024-09-12T17:30:31.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.226+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=DRRARJ7N5RRA type=del size=4040988 2024-09-12T17:30:31.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.227+0000 7fece65ff780 1 < canceled operation key=CBYI6C1ICE08 tag=EPUK84J239NF type=write size=200469 2024-09-12T17:30:31.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.228+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=S8OEXLY6N7F2 type=del size=2847352 2024-09-12T17:30:31.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.230+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=XK1D5F1U7491 type=del 2024-09-12T17:30:31.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.232+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~QU1001NVA82C.0 size=1048576 2024-09-12T17:30:31.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.233+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~QU1001NVA82C.1 size=1048576 2024-09-12T17:30:31.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.234+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~QU1001NVA82C.2 size=695875 2024-09-12T17:30:31.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.234+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=QU1001NVA82C tag=PZHE09COREL2 type=write size=3841603 2024-09-12T17:30:31.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.235+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=80KHNTFUH8QC type=del 2024-09-12T17:30:31.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.236+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=X2CV92LGZR04 type=del size=3950197 2024-09-12T17:30:31.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.237+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=SCJEMFRE3H08 type=del 2024-09-12T17:30:31.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.239+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=3ZT7NHJ38R48 type=del size=3788388 2024-09-12T17:30:31.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.240+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=9UW0V4N3K37Q type=del 2024-09-12T17:30:31.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.242+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~AV1DREREBXBF.0 size=1048576 2024-09-12T17:30:31.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.243+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~AV1DREREBXBF.1 size=1048576 2024-09-12T17:30:31.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.244+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~AV1DREREBXBF.2 size=683201 2024-09-12T17:30:31.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.244+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=AV1DREREBXBF tag=J5V7FIIXV4KI type=write size=3828929 2024-09-12T17:30:31.246 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.245+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=VI2GB3LKHWUH type=del 2024-09-12T17:30:31.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.247+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~HGFZJS39ZU0U.0 size=1048576 2024-09-12T17:30:31.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.248+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~HGFZJS39ZU0U.1 size=115159 2024-09-12T17:30:31.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.248+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=HGFZJS39ZU0U tag=FWIX20DG03NI type=write size=2212311 2024-09-12T17:30:31.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.249+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=M9EEGJBCO67E type=del 2024-09-12T17:30:31.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.250+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=9RHPXRQMMW1V type=del size=572420 2024-09-12T17:30:31.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.253+0000 7fece65ff780 1 < suggested remove operation key=QQNW20B28RJC tag=RR29WY00QW1Q type=del 2024-09-12T17:30:31.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.254+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=YJ0ULM3JGH9L type=del size=3286864 2024-09-12T17:30:31.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.255+0000 7fece65ff780 1 < canceled operation key=CEERZVBJQHP0 tag=LS5GHNO0U3AX type=del size=1891079 2024-09-12T17:30:31.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.257+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~QTTWXV5TGH6D.0 size=1048576 2024-09-12T17:30:31.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.258+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~QTTWXV5TGH6D.1 size=237829 2024-09-12T17:30:31.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.258+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=QTTWXV5TGH6D tag=Z69WQB197M2U type=write size=2334981 2024-09-12T17:30:31.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.261+0000 7fece65ff780 1 < suggested remove operation key=KKU8T0CVS40V tag=LKHBQ2X4I9IN type=del 2024-09-12T17:30:31.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.262+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=N74L94TB2OWD type=del size=31807 2024-09-12T17:30:31.265 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.263+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~FG6653CNQSJJ.0 size=1048576 2024-09-12T17:30:31.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.265+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~FG6653CNQSJJ.1 size=1048576 2024-09-12T17:30:31.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.266+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~FG6653CNQSJJ.2 size=267357 2024-09-12T17:30:31.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.268+0000 7fece65ff780 1 < completed multipart upload key=IMCE9Z7P4S6R upload=FG6653CNQSJJ tag=ZFA25SMQ9Q7F type=write size=3413085 2024-09-12T17:30:31.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.270+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~C6ID1A9JDM9D.0 size=1048576 2024-09-12T17:30:31.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.271+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~C6ID1A9JDM9D.1 size=921209 2024-09-12T17:30:31.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.271+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=C6ID1A9JDM9D tag=GNUNMAP5QRUE type=write size=3018361 2024-09-12T17:30:31.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.273+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~50HSX3YX51NG.0 size=1048576 2024-09-12T17:30:31.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.274+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~50HSX3YX51NG.1 size=531791 2024-09-12T17:30:31.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.276+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=50HSX3YX51NG tag=P3MVY9W5GEXK type=write size=2628943 2024-09-12T17:30:31.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.277+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=S547OSBYW8PC type=del size=732315 2024-09-12T17:30:31.279 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.278+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=14QCPW7BVOGA type=del 2024-09-12T17:30:31.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.279+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=CIHL2AHQ6AUG type=del size=113828 2024-09-12T17:30:31.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.282+0000 7fece65ff780 1 < suggested remove operation key=Y30269Q7R340 tag=10KBMKUKYB1T type=del 2024-09-12T17:30:31.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.283+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=F53T4VWTVVBI type=del size=1964602 2024-09-12T17:30:31.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.284+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=P84DQTEQI0H1 type=del 2024-09-12T17:30:31.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.285+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=XYP44S1EYDCU type=del size=1310449 2024-09-12T17:30:31.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.286+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=DRRARJ7N5RRA type=del 2024-09-12T17:30:31.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.288+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=0GZHLUX1AZU4 type=del size=1076605 2024-09-12T17:30:31.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.289+0000 7fece65ff780 -1 < failed to complete operation key=QQNW20B28RJC tag=S8OEXLY6N7F2 type=del size=2847352: (22) Invalid argument 2024-09-12T17:30:31.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.290+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=086B5B3NQ7T3 type=del size=3851157 2024-09-12T17:30:31.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.291+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~QU1001NVA82C.0 size=1048576 2024-09-12T17:30:31.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.292+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~QU1001NVA82C.1 size=1048576 2024-09-12T17:30:31.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.293+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~QU1001NVA82C.2 size=695875 2024-09-12T17:30:31.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.295+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=QU1001NVA82C tag=PZHE09COREL2 type=write size=3841603 2024-09-12T17:30:31.298 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.296+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=BLH08FUGV0C6 type=write size=724093 2024-09-12T17:30:31.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.298+0000 7fece65ff780 1 < completed delete operation key=7AS5L998SDV7 tag=X2CV92LGZR04 type=del 2024-09-12T17:30:31.300 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.299+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=SBR6THH7OWC2 type=del size=1305029 2024-09-12T17:30:31.303 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.301+0000 7fece65ff780 1 < suggested update operation key=FX8VJO1YXJ4H tag=3ZT7NHJ38R48 type=del size=3788388 2024-09-12T17:30:31.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.303+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~JYB60OT84YWG.0 size=1048576 2024-09-12T17:30:31.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.304+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~JYB60OT84YWG.1 size=1048576 2024-09-12T17:30:31.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.305+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~JYB60OT84YWG.2 size=110271 2024-09-12T17:30:31.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.305+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=JYB60OT84YWG tag=G6A73V0PVB3Z type=write size=3255999 2024-09-12T17:30:31.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.306+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~AV1DREREBXBF.0 size=1048576 2024-09-12T17:30:31.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.307+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~AV1DREREBXBF.1 size=1048576 2024-09-12T17:30:31.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.308+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~AV1DREREBXBF.2 size=683201 2024-09-12T17:30:31.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.311+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=AV1DREREBXBF tag=J5V7FIIXV4KI type=write size=3828929 2024-09-12T17:30:31.314 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.313+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~96KKNG30M48W.0 size=487582 2024-09-12T17:30:31.314 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.313+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=96KKNG30M48W tag=SYMFY1GBFI0R type=write size=1536158 2024-09-12T17:30:31.316 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.314+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~HGFZJS39ZU0U.0 size=1048576 2024-09-12T17:30:31.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.315+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~HGFZJS39ZU0U.1 size=115159 2024-09-12T17:30:31.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.317+0000 7fece65ff780 1 < completed multipart upload key=9KYNMM6W7RRM upload=HGFZJS39ZU0U tag=FWIX20DG03NI type=write size=2212311 2024-09-12T17:30:31.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.318+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=IA6N28WLW7SP type=del size=2819634 2024-09-12T17:30:31.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.320+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=9RHPXRQMMW1V type=del 2024-09-12T17:30:31.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.321+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=NS5SXXS6QVVH type=del size=675951 2024-09-12T17:30:31.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.322+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=YJ0ULM3JGH9L type=del 2024-09-12T17:30:31.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.324+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~6LD9OX226H6T.0 size=1048576 2024-09-12T17:30:31.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.325+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~6LD9OX226H6T.1 size=284338 2024-09-12T17:30:31.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.325+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=6LD9OX226H6T tag=22CG3Q6I348X type=write size=2381490 2024-09-12T17:30:31.328 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.326+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~QTTWXV5TGH6D.0 size=1048576 2024-09-12T17:30:31.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.327+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~QTTWXV5TGH6D.1 size=237829 2024-09-12T17:30:31.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.329+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=QTTWXV5TGH6D tag=Z69WQB197M2U type=write size=2334981 2024-09-12T17:30:31.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.332+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~X82WVO4B9TKH.0 size=913994 2024-09-12T17:30:31.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.332+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=X82WVO4B9TKH tag=SEVW5PYOAB52 type=write size=1962570 2024-09-12T17:30:31.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.333+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=N74L94TB2OWD type=del 2024-09-12T17:30:31.337 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.335+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~CEZO99B50THH.0 size=377901 2024-09-12T17:30:31.337 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.335+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=CEZO99B50THH tag=8ZOI4YNY89W6 type=write size=1426477 2024-09-12T17:30:31.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.336+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~C6ID1A9JDM9D.0 size=1048576 2024-09-12T17:30:31.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.337+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~C6ID1A9JDM9D.1 size=921209 2024-09-12T17:30:31.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.339+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=C6ID1A9JDM9D tag=GNUNMAP5QRUE type=write size=3018361 2024-09-12T17:30:31.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.341+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~RQ3EE2L3L0P2.0 size=1048576 2024-09-12T17:30:31.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.342+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~RQ3EE2L3L0P2.1 size=214091 2024-09-12T17:30:31.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.342+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=RQ3EE2L3L0P2 tag=QM6SW3YR3JGS type=write size=2311243 2024-09-12T17:30:31.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.344+0000 7fece65ff780 1 < suggested remove operation key=9IGJG88NX1FS tag=S547OSBYW8PC type=del 2024-09-12T17:30:31.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.346+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=J19R66OH1P9E type=del size=1596076 2024-09-12T17:30:31.350 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.348+0000 7fece65ff780 1 < suggested update operation key=RKFRKIENSBTO tag=CIHL2AHQ6AUG type=del size=113828 2024-09-12T17:30:31.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.349+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=VE16LPO36QF2 type=del size=975228 2024-09-12T17:30:31.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.352+0000 7fece65ff780 1 < suggested remove operation key=7AS5L998SDV7 tag=F53T4VWTVVBI type=del 2024-09-12T17:30:31.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.353+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=T4J1KPU66DQI type=del size=1525170 2024-09-12T17:30:31.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.354+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=XYP44S1EYDCU type=del 2024-09-12T17:30:31.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.355+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=GJFKMLGFMR9U type=del size=4147331 2024-09-12T17:30:31.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.357+0000 7fece65ff780 -1 < failed to complete operation key=RKFRKIENSBTO tag=0GZHLUX1AZU4 type=del size=1076605: (22) Invalid argument 2024-09-12T17:30:31.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.358+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=Y8Z1EEM2F2WJ type=del size=2063948 2024-09-12T17:30:31.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.360+0000 7fece65ff780 1 < suggested remove operation key=Q00ZFG0BBDG5 tag=086B5B3NQ7T3 type=del 2024-09-12T17:30:31.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.363+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=QHLWBIH16SDF type=del size=2713753 2024-09-12T17:30:31.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.364+0000 7fece65ff780 1 < canceled operation key=807GX4RQQLL4 tag=BLH08FUGV0C6 type=write size=724093 2024-09-12T17:30:31.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.365+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=275AZI3ED8L7 type=del size=4036093 2024-09-12T17:30:31.368 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.366+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=SBR6THH7OWC2 type=del 2024-09-12T17:30:31.369 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.368+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=TPGJ6KL4GHRW type=del size=2711915 2024-09-12T17:30:31.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.369+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~JYB60OT84YWG.0 size=1048576 2024-09-12T17:30:31.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.370+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~JYB60OT84YWG.1 size=1048576 2024-09-12T17:30:31.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.370+0000 7fece65ff780 1 < canceled part key=_multipart_W3MBKNIBLV7W.2~JYB60OT84YWG.2 size=110271 2024-09-12T17:30:31.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.372+0000 7fece65ff780 1 < canceled multipart upload key=W3MBKNIBLV7W upload=JYB60OT84YWG tag=G6A73V0PVB3Z type=write size=3255999 2024-09-12T17:30:31.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.373+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=4LT3Q7CW9H97 type=del size=4077157 2024-09-12T17:30:31.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.374+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~96KKNG30M48W.0 size=487582 2024-09-12T17:30:31.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.376+0000 7fece65ff780 1 < completed multipart upload key=4Z1N3433MC6A upload=96KKNG30M48W tag=SYMFY1GBFI0R type=write size=1536158 2024-09-12T17:30:31.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.379+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~5FZ8XR82BZV2.0 size=1048576 2024-09-12T17:30:31.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.382+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~5FZ8XR82BZV2.1 size=1048576 2024-09-12T17:30:31.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.383+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~5FZ8XR82BZV2.2 size=980191 2024-09-12T17:30:31.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.383+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=5FZ8XR82BZV2 tag=OKLQX02F0HBB type=write size=4125919 2024-09-12T17:30:31.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.384+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=IA6N28WLW7SP type=del 2024-09-12T17:30:31.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.386+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=7H5RUI8XDWK1 type=del size=4062590 2024-09-12T17:30:31.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.388+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=NS5SXXS6QVVH type=del 2024-09-12T17:30:31.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.396+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~APG2XMGENCKS.0 size=1048576 2024-09-12T17:30:31.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.397+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~APG2XMGENCKS.1 size=157888 2024-09-12T17:30:31.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.397+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=APG2XMGENCKS tag=I249AIYSOJLT type=write size=2255040 2024-09-12T17:30:31.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.398+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~6LD9OX226H6T.0 size=1048576 2024-09-12T17:30:31.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.398+0000 7fece65ff780 1 < canceled part key=_multipart_9KYNMM6W7RRM.2~6LD9OX226H6T.1 size=284338 2024-09-12T17:30:31.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.400+0000 7fece65ff780 1 < canceled multipart upload key=9KYNMM6W7RRM upload=6LD9OX226H6T tag=22CG3Q6I348X type=write size=2381490 2024-09-12T17:30:31.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.404+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~NLTBTYRWU2VG.0 size=732471 2024-09-12T17:30:31.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.404+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=NLTBTYRWU2VG tag=O3GPU2SGNI73 type=write size=1781047 2024-09-12T17:30:31.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.405+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~X82WVO4B9TKH.0 size=913994 2024-09-12T17:30:31.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.408+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=X82WVO4B9TKH tag=SEVW5PYOAB52 type=write size=1962570 2024-09-12T17:30:31.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.410+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~341UZPY7JOD1.0 size=892572 2024-09-12T17:30:31.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.410+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=341UZPY7JOD1 tag=RH6I2EIRG9Y5 type=write size=1941148 2024-09-12T17:30:31.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.412+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~CEZO99B50THH.0 size=377901 2024-09-12T17:30:31.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.414+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=CEZO99B50THH tag=8ZOI4YNY89W6 type=write size=1426477 2024-09-12T17:30:31.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.415+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=N4O985BAAXI9 type=del size=1450994 2024-09-12T17:30:31.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.416+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~RQ3EE2L3L0P2.0 size=1048576 2024-09-12T17:30:31.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.417+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~RQ3EE2L3L0P2.1 size=214091 2024-09-12T17:30:31.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.419+0000 7fece65ff780 1 < completed multipart upload key=2HTNXL56URAK upload=RQ3EE2L3L0P2 tag=QM6SW3YR3JGS type=write size=2311243 2024-09-12T17:30:31.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.421+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~VMCZR10W7NEX.0 size=1048576 2024-09-12T17:30:31.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.422+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~VMCZR10W7NEX.1 size=1048576 2024-09-12T17:30:31.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.422+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~VMCZR10W7NEX.2 size=196419 2024-09-12T17:30:31.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.422+0000 7fece65ff780 1 > prepared multipart upload key=LSGN631FW1P8 upload=VMCZR10W7NEX tag=1XG5HXZSG51B type=write size=3342147 2024-09-12T17:30:31.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.425+0000 7fece65ff780 1 < suggested update operation key=9KYNMM6W7RRM tag=J19R66OH1P9E type=del size=1596076 2024-09-12T17:30:31.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.427+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=3XGAB5BUU7JK type=del size=3092624 2024-09-12T17:30:31.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.430+0000 7fece65ff780 1 < suggested remove operation key=OPMR1WMB14CA tag=VE16LPO36QF2 type=del 2024-09-12T17:30:31.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.431+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=U2C0UC806A3E type=del size=3885494 2024-09-12T17:30:31.435 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.434+0000 7fece65ff780 1 < suggested update operation key=5A7WPGW5P91B tag=T4J1KPU66DQI type=del size=1525170 2024-09-12T17:30:31.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.435+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=1Z0GXI35JLJ9 type=del size=1683228 2024-09-12T17:30:31.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.437+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=GJFKMLGFMR9U type=del 2024-09-12T17:30:31.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.438+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=A9PJ863DS6ZK type=del size=153275 2024-09-12T17:30:31.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.439+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=Y8Z1EEM2F2WJ type=del 2024-09-12T17:30:31.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.441+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~XH1VEOUJXJKK.0 size=1048576 2024-09-12T17:30:31.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.442+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~XH1VEOUJXJKK.1 size=137217 2024-09-12T17:30:31.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.442+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=XH1VEOUJXJKK tag=55AWEOH6DMZJ type=write size=2234369 2024-09-12T17:30:31.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.444+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=QHLWBIH16SDF type=del 2024-09-12T17:30:31.446 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.445+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=LWDWIZMMD3M9 type=del size=3043055 2024-09-12T17:30:31.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.446+0000 7fece65ff780 1 < canceled operation key=2HTNXL56URAK tag=275AZI3ED8L7 type=del size=4036093 2024-09-12T17:30:31.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.447+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=H5988EA9W1NX type=del size=2343889 2024-09-12T17:30:31.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.449+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=TPGJ6KL4GHRW type=del 2024-09-12T17:30:31.452 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.450+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=P29YAQ3OA2AQ type=del size=4053913 2024-09-12T17:30:31.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.451+0000 7fece65ff780 -1 < failed to complete operation key=9KYNMM6W7RRM tag=4LT3Q7CW9H97 type=del size=4077157: (22) Invalid argument 2024-09-12T17:30:31.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.453+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=6OX1OTTBQS1S type=del size=3984604 2024-09-12T17:30:31.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.454+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~5FZ8XR82BZV2.0 size=1048576 2024-09-12T17:30:31.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.455+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~5FZ8XR82BZV2.1 size=1048576 2024-09-12T17:30:31.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.456+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~5FZ8XR82BZV2.2 size=980191 2024-09-12T17:30:31.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.458+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=5FZ8XR82BZV2 tag=OKLQX02F0HBB type=write size=4125919 2024-09-12T17:30:31.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.460+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~PTX3GCU8EXON.0 size=1048576 2024-09-12T17:30:31.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.461+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~PTX3GCU8EXON.1 size=627605 2024-09-12T17:30:31.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.461+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=PTX3GCU8EXON tag=9W203A0BJMVC type=write size=2724757 2024-09-12T17:30:31.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.462+0000 7fece65ff780 1 < canceled operation key=1G9VNO1V4IMW tag=7H5RUI8XDWK1 type=del size=4062590 2024-09-12T17:30:31.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.463+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=4UVJ93CLLM4J type=del size=1001205 2024-09-12T17:30:31.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.464+0000 7fece65ff780 1 < canceled part key=_multipart_807GX4RQQLL4.2~APG2XMGENCKS.0 size=1048576 2024-09-12T17:30:31.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.465+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~APG2XMGENCKS.1 size=157888 2024-09-12T17:30:31.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.467+0000 7fece65ff780 1 < canceled multipart upload key=807GX4RQQLL4 upload=APG2XMGENCKS tag=I249AIYSOJLT type=write size=2255040 2024-09-12T17:30:31.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.469+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~Y1C6I0P2TL1O.0 size=1048576 2024-09-12T17:30:31.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.470+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~Y1C6I0P2TL1O.1 size=1048576 2024-09-12T17:30:31.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.471+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~Y1C6I0P2TL1O.2 size=332562 2024-09-12T17:30:31.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.471+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=Y1C6I0P2TL1O tag=OT0MNMBYBTMG type=write size=3478290 2024-09-12T17:30:31.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.472+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~NLTBTYRWU2VG.0 size=732471 2024-09-12T17:30:31.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.474+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=NLTBTYRWU2VG tag=O3GPU2SGNI73 type=write size=1781047 2024-09-12T17:30:31.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.477+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~7IXS3H9PVF8D.0 size=1048576 2024-09-12T17:30:31.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.478+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~7IXS3H9PVF8D.1 size=1048576 2024-09-12T17:30:31.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.479+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~7IXS3H9PVF8D.2 size=287319 2024-09-12T17:30:31.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.479+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=7IXS3H9PVF8D tag=0GCOOUJL0WUT type=write size=3433047 2024-09-12T17:30:31.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.480+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~341UZPY7JOD1.0 size=892572 2024-09-12T17:30:31.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.482+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=341UZPY7JOD1 tag=RH6I2EIRG9Y5 type=write size=1941148 2024-09-12T17:30:31.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.483+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=XBGZAE57ARZ0 type=del size=1940086 2024-09-12T17:30:31.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.485+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=N4O985BAAXI9 type=del 2024-09-12T17:30:31.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.487+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~S34F4E3EZ85W.0 size=5729 2024-09-12T17:30:31.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.487+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=S34F4E3EZ85W tag=543VH857OT6G type=write size=1054305 2024-09-12T17:30:31.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.488+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~VMCZR10W7NEX.0 size=1048576 2024-09-12T17:30:31.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.489+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~VMCZR10W7NEX.1 size=1048576 2024-09-12T17:30:31.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.490+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~VMCZR10W7NEX.2 size=196419 2024-09-12T17:30:31.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.492+0000 7fece65ff780 1 < completed multipart upload key=LSGN631FW1P8 upload=VMCZR10W7NEX tag=1XG5HXZSG51B type=write size=3342147 2024-09-12T17:30:31.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.495+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~UHK1GODLJPX2.0 size=1048576 2024-09-12T17:30:31.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.496+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~UHK1GODLJPX2.1 size=1048576 2024-09-12T17:30:31.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.497+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~UHK1GODLJPX2.2 size=175857 2024-09-12T17:30:31.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.497+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=UHK1GODLJPX2 tag=QM4CUH1KJM1T type=write size=3321585 2024-09-12T17:30:31.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.498+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=3XGAB5BUU7JK type=del 2024-09-12T17:30:31.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.499+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=A2MGFNQNZAFB type=del size=2034800 2024-09-12T17:30:31.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.500+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=U2C0UC806A3E type=del 2024-09-12T17:30:31.503 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.502+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=MRGWPOC9PMBQ type=del size=1516491 2024-09-12T17:30:31.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.503+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=1Z0GXI35JLJ9 type=del 2024-09-12T17:30:31.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.504+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=ASLERXEN2AB7 type=del size=2801091 2024-09-12T17:30:31.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.507+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=A9PJ863DS6ZK type=del 2024-09-12T17:30:31.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.509+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~ZWWE2O84JQYE.0 size=1048576 2024-09-12T17:30:31.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.510+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~ZWWE2O84JQYE.1 size=1048576 2024-09-12T17:30:31.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.511+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~ZWWE2O84JQYE.2 size=83106 2024-09-12T17:30:31.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.511+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=ZWWE2O84JQYE tag=EG6YXX8J61JN type=write size=3228834 2024-09-12T17:30:31.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.512+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~XH1VEOUJXJKK.0 size=1048576 2024-09-12T17:30:31.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.513+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~XH1VEOUJXJKK.1 size=137217 2024-09-12T17:30:31.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.515+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=XH1VEOUJXJKK tag=55AWEOH6DMZJ type=write size=2234369 2024-09-12T17:30:31.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.517+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=2RJ9CK2CXTC9 type=del size=424040 2024-09-12T17:30:31.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.518+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=LWDWIZMMD3M9 type=del 2024-09-12T17:30:31.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.519+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=OSUJ9RYM48VV type=del size=3690557 2024-09-12T17:30:31.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.520+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=H5988EA9W1NX type=del 2024-09-12T17:30:31.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.522+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=U3BJGPPZ0ZOD type=del size=3816216 2024-09-12T17:30:31.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.523+0000 7fece65ff780 1 < canceled operation key=UCBB99EG8XK2 tag=P29YAQ3OA2AQ type=del size=4053913 2024-09-12T17:30:31.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.524+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=6GHWG3E1U6YG type=del size=3365624 2024-09-12T17:30:31.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.526+0000 7fece65ff780 1 < canceled operation key=9IGJG88NX1FS tag=6OX1OTTBQS1S type=del size=3984604 2024-09-12T17:30:31.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.528+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~UD1ZPLLZNJEV.0 size=1048576 2024-09-12T17:30:31.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.529+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~UD1ZPLLZNJEV.1 size=83017 2024-09-12T17:30:31.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.529+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=UD1ZPLLZNJEV tag=RZNDPP0125O1 type=write size=2180169 2024-09-12T17:30:31.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.529+0000 7fece65ff780 1 < canceled part key=_multipart_CEERZVBJQHP0.2~PTX3GCU8EXON.0 size=1048576 2024-09-12T17:30:31.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.530+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~PTX3GCU8EXON.1 size=627605 2024-09-12T17:30:31.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.532+0000 7fece65ff780 1 < canceled multipart upload key=CEERZVBJQHP0 upload=PTX3GCU8EXON tag=9W203A0BJMVC type=write size=2724757 2024-09-12T17:30:31.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.533+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=ERYT1TXUD3YR type=del size=3420543 2024-09-12T17:30:31.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.535+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=4UVJ93CLLM4J type=del 2024-09-12T17:30:31.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.536+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=DG4CVMAFATBZ type=del size=3095181 2024-09-12T17:30:31.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.537+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~Y1C6I0P2TL1O.0 size=1048576 2024-09-12T17:30:31.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.538+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~Y1C6I0P2TL1O.1 size=1048576 2024-09-12T17:30:31.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.539+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~Y1C6I0P2TL1O.2 size=332562 2024-09-12T17:30:31.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.541+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=Y1C6I0P2TL1O tag=OT0MNMBYBTMG type=write size=3478290 2024-09-12T17:30:31.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.543+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~1WHM50WKGOSH.0 size=1048576 2024-09-12T17:30:31.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.544+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~1WHM50WKGOSH.1 size=979751 2024-09-12T17:30:31.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.544+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=1WHM50WKGOSH tag=45CE42RT05EE type=write size=3076903 2024-09-12T17:30:31.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.546+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~7IXS3H9PVF8D.0 size=1048576 2024-09-12T17:30:31.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.547+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~7IXS3H9PVF8D.1 size=1048576 2024-09-12T17:30:31.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.548+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~7IXS3H9PVF8D.2 size=287319 2024-09-12T17:30:31.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.550+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=7IXS3H9PVF8D tag=0GCOOUJL0WUT type=write size=3433047 2024-09-12T17:30:31.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.551+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=XPJM1N3Y45NZ type=del size=824363 2024-09-12T17:30:31.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.552+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=XBGZAE57ARZ0 type=del 2024-09-12T17:30:31.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.554+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~UJ8HGE5L4KFJ.0 size=1048576 2024-09-12T17:30:31.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.555+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~UJ8HGE5L4KFJ.1 size=32360 2024-09-12T17:30:31.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.555+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=UJ8HGE5L4KFJ tag=R2E8M3C8NDR3 type=write size=2129512 2024-09-12T17:30:31.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.557+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~S34F4E3EZ85W.0 size=5729 2024-09-12T17:30:31.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.558+0000 7fece65ff780 1 < completed multipart upload key=5A7WPGW5P91B upload=S34F4E3EZ85W tag=543VH857OT6G type=write size=1054305 2024-09-12T17:30:31.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.561+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~U7EUHF1NSXND.0 size=1048576 2024-09-12T17:30:31.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.562+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~U7EUHF1NSXND.1 size=530911 2024-09-12T17:30:31.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.562+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=U7EUHF1NSXND tag=A05O8G5EX6Q2 type=write size=2628063 2024-09-12T17:30:31.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.563+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~UHK1GODLJPX2.0 size=1048576 2024-09-12T17:30:31.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.564+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~UHK1GODLJPX2.1 size=1048576 2024-09-12T17:30:31.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.565+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~UHK1GODLJPX2.2 size=175857 2024-09-12T17:30:31.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.567+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=UHK1GODLJPX2 tag=QM4CUH1KJM1T type=write size=3321585 2024-09-12T17:30:31.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.568+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=R3U7GY57S1VY type=del size=2995175 2024-09-12T17:30:31.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.570+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=A2MGFNQNZAFB type=del 2024-09-12T17:30:31.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.572+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~8GQY9EJXUMAU.0 size=209823 2024-09-12T17:30:31.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.572+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=8GQY9EJXUMAU tag=FRNZHA9NMLQJ type=write size=1258399 2024-09-12T17:30:31.575 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.573+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=MRGWPOC9PMBQ type=del 2024-09-12T17:30:31.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.574+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=QJSEE6CQ19U8 type=del size=4025643 2024-09-12T17:30:31.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.576+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=ASLERXEN2AB7 type=del 2024-09-12T17:30:31.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.578+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~10AG5Y37B4ZP.0 size=1048576 2024-09-12T17:30:31.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.579+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~10AG5Y37B4ZP.1 size=1048576 2024-09-12T17:30:31.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.580+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~10AG5Y37B4ZP.2 size=300842 2024-09-12T17:30:31.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.580+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=10AG5Y37B4ZP tag=Z5HAJB2B4Z1Y type=write size=3446570 2024-09-12T17:30:31.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.581+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~ZWWE2O84JQYE.0 size=1048576 2024-09-12T17:30:31.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.582+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~ZWWE2O84JQYE.1 size=1048576 2024-09-12T17:30:31.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.583+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~ZWWE2O84JQYE.2 size=83106 2024-09-12T17:30:31.586 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.585+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=ZWWE2O84JQYE tag=EG6YXX8J61JN type=write size=3228834 2024-09-12T17:30:31.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.586+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=MJFW4PC9A2NI type=del size=2572297 2024-09-12T17:30:31.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.587+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=2RJ9CK2CXTC9 type=del 2024-09-12T17:30:31.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.590+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~6I29ASWNSG35.0 size=1048576 2024-09-12T17:30:31.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.591+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~6I29ASWNSG35.1 size=1048576 2024-09-12T17:30:31.593 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.592+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~6I29ASWNSG35.2 size=350967 2024-09-12T17:30:31.593 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.592+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=6I29ASWNSG35 tag=7PATJO8I0EI2 type=write size=3496695 2024-09-12T17:30:31.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.594+0000 7fece65ff780 1 < suggested remove operation key=2HTNXL56URAK tag=OSUJ9RYM48VV type=del 2024-09-12T17:30:31.598 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.596+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~DR4U7LCCQ6DT.0 size=1048576 2024-09-12T17:30:31.599 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.597+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~DR4U7LCCQ6DT.1 size=1029314 2024-09-12T17:30:31.599 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.597+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=DR4U7LCCQ6DT tag=QC9FRXT1T4QR type=write size=3126466 2024-09-12T17:30:31.600 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.598+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=U3BJGPPZ0ZOD type=del 2024-09-12T17:30:31.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.599+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=HQEGL69DBFYZ type=write size=896850 2024-09-12T17:30:31.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.601+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=6GHWG3E1U6YG type=del 2024-09-12T17:30:31.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.603+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~AT4OT0I0CU0D.0 size=775269 2024-09-12T17:30:31.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.603+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=AT4OT0I0CU0D tag=JE760T2STW8F type=write size=1823845 2024-09-12T17:30:31.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.603+0000 7fece65ff780 1 < canceled part key=_multipart_KKU8T0CVS40V.2~UD1ZPLLZNJEV.0 size=1048576 2024-09-12T17:30:31.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.604+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~UD1ZPLLZNJEV.1 size=83017 2024-09-12T17:30:31.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.606+0000 7fece65ff780 1 < canceled multipart upload key=KKU8T0CVS40V upload=UD1ZPLLZNJEV tag=RZNDPP0125O1 type=write size=2180169 2024-09-12T17:30:31.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.607+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=8FNCZX1KSKJ1 type=del size=3400794 2024-09-12T17:30:31.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.609+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=ERYT1TXUD3YR type=del 2024-09-12T17:30:31.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.610+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=0D04WESTMHNF type=del size=941027 2024-09-12T17:30:31.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.611+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=DG4CVMAFATBZ type=del 2024-09-12T17:30:31.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.613+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~GRFYIO9ZQC0Y.0 size=1048576 2024-09-12T17:30:31.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.614+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~GRFYIO9ZQC0Y.1 size=595883 2024-09-12T17:30:31.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.614+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=GRFYIO9ZQC0Y tag=0KDGWMY95M62 type=write size=2693035 2024-09-12T17:30:31.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.616+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~1WHM50WKGOSH.0 size=1048576 2024-09-12T17:30:31.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.617+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~1WHM50WKGOSH.1 size=979751 2024-09-12T17:30:31.621 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.620+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=1WHM50WKGOSH tag=45CE42RT05EE type=write size=3076903 2024-09-12T17:30:31.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.621+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=AWDXXXQAPMJ7 type=del size=2862315 2024-09-12T17:30:31.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.623+0000 7fece65ff780 1 < suggested update operation key=UN6FLMRMAPUS tag=XPJM1N3Y45NZ type=del size=824363 2024-09-12T17:30:31.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.624+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=8DNCH5AIK5L6 type=del size=1943792 2024-09-12T17:30:31.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.626+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~UJ8HGE5L4KFJ.0 size=1048576 2024-09-12T17:30:31.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.627+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~UJ8HGE5L4KFJ.1 size=32360 2024-09-12T17:30:31.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.629+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=UJ8HGE5L4KFJ tag=R2E8M3C8NDR3 type=write size=2129512 2024-09-12T17:30:31.631 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.630+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=AZ5MADEWTVQT type=write size=656294 2024-09-12T17:30:31.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.631+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~U7EUHF1NSXND.0 size=1048576 2024-09-12T17:30:31.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.632+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~U7EUHF1NSXND.1 size=530911 2024-09-12T17:30:31.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.634+0000 7fece65ff780 1 < completed multipart upload key=I31CKY20NO9S upload=U7EUHF1NSXND tag=A05O8G5EX6Q2 type=write size=2628063 2024-09-12T17:30:31.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.635+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=433N0ZLEFOS4 type=del size=3727316 2024-09-12T17:30:31.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.636+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=R3U7GY57S1VY type=del 2024-09-12T17:30:31.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.637+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=FTYGLOALXT00 type=del size=2053048 2024-09-12T17:30:31.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.639+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~8GQY9EJXUMAU.0 size=209823 2024-09-12T17:30:31.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.641+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=8GQY9EJXUMAU tag=FRNZHA9NMLQJ type=write size=1258399 2024-09-12T17:30:31.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.642+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=NHJ9M84V8KL6 type=del size=3874166 2024-09-12T17:30:31.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.643+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=QJSEE6CQ19U8 type=del 2024-09-12T17:30:31.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.645+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=9DH2ZQHH2FBM type=del size=2679379 2024-09-12T17:30:31.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.646+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~10AG5Y37B4ZP.0 size=1048576 2024-09-12T17:30:31.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.647+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~10AG5Y37B4ZP.1 size=1048576 2024-09-12T17:30:31.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.648+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~10AG5Y37B4ZP.2 size=300842 2024-09-12T17:30:31.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.650+0000 7fece65ff780 1 < completed multipart upload key=Q00ZFG0BBDG5 upload=10AG5Y37B4ZP tag=Z5HAJB2B4Z1Y type=write size=3446570 2024-09-12T17:30:31.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.653+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~IJX6ZSV38T4V.0 size=793392 2024-09-12T17:30:31.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.653+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=IJX6ZSV38T4V tag=Z0G22M5L5FP2 type=write size=1841968 2024-09-12T17:30:31.655 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.654+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=MJFW4PC9A2NI type=del 2024-09-12T17:30:31.657 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.655+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=MY5WS5K5YBPM type=del size=1371075 2024-09-12T17:30:31.658 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.656+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~6I29ASWNSG35.0 size=1048576 2024-09-12T17:30:31.659 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.657+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~6I29ASWNSG35.1 size=1048576 2024-09-12T17:30:31.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.658+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~6I29ASWNSG35.2 size=350967 2024-09-12T17:30:31.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.660+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=6I29ASWNSG35 tag=7PATJO8I0EI2 type=write size=3496695 2024-09-12T17:30:31.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.662+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=0BBTW3GX43LB type=del size=422654 2024-09-12T17:30:31.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.663+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~DR4U7LCCQ6DT.0 size=1048576 2024-09-12T17:30:31.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.664+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~DR4U7LCCQ6DT.1 size=1029314 2024-09-12T17:30:31.667 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.666+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=DR4U7LCCQ6DT tag=QC9FRXT1T4QR type=write size=3126466 2024-09-12T17:30:31.669 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.667+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=WCZXE59N2WMZ type=del size=2772981 2024-09-12T17:30:31.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.668+0000 7fece65ff780 1 < completed write operation key=5LAOX5H1AQWJ tag=HQEGL69DBFYZ type=write size=896850 2024-09-12T17:30:31.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.670+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~VUY9LJGFW53M.0 size=1048576 2024-09-12T17:30:31.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.671+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~VUY9LJGFW53M.1 size=150341 2024-09-12T17:30:31.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.671+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=VUY9LJGFW53M tag=PQABF9E8UJFT type=write size=2247493 2024-09-12T17:30:31.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.673+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~AT4OT0I0CU0D.0 size=775269 2024-09-12T17:30:31.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.675+0000 7fece65ff780 1 < completed multipart upload key=Q00ZFG0BBDG5 upload=AT4OT0I0CU0D tag=JE760T2STW8F type=write size=1823845 2024-09-12T17:30:31.678 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.677+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~03OFKM8QLT74.0 size=835934 2024-09-12T17:30:31.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.677+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=03OFKM8QLT74 tag=R3I3QFDH6OMQ type=write size=1884510 2024-09-12T17:30:31.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.678+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=8FNCZX1KSKJ1 type=del 2024-09-12T17:30:31.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.680+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~4INUK5AOPRRN.0 size=195518 2024-09-12T17:30:31.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.680+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=4INUK5AOPRRN tag=026V6DFUZZTO type=write size=1244094 2024-09-12T17:30:31.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.682+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=0D04WESTMHNF type=del 2024-09-12T17:30:31.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.683+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=TY2BZEB8XPSX type=del size=2143962 2024-09-12T17:30:31.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.684+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~GRFYIO9ZQC0Y.0 size=1048576 2024-09-12T17:30:31.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.685+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~GRFYIO9ZQC0Y.1 size=595883 2024-09-12T17:30:31.688 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.687+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=GRFYIO9ZQC0Y tag=0KDGWMY95M62 type=write size=2693035 2024-09-12T17:30:31.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.689+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~0PDFSOSUYW2N.0 size=1048576 2024-09-12T17:30:31.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.690+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~0PDFSOSUYW2N.1 size=826202 2024-09-12T17:30:31.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.690+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=0PDFSOSUYW2N tag=37PBYFDF0A12 type=write size=2923354 2024-09-12T17:30:31.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.693+0000 7fece65ff780 1 < suggested remove operation key=CBYI6C1ICE08 tag=AWDXXXQAPMJ7 type=del 2024-09-12T17:30:31.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.694+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=S9AJ3O19EPX7 type=del size=2865004 2024-09-12T17:30:31.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.696+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=8DNCH5AIK5L6 type=del 2024-09-12T17:30:31.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.697+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=HLKNWHA14YK7 type=write size=127657 2024-09-12T17:30:31.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.698+0000 7fece65ff780 1 < completed write operation key=7AS5L998SDV7 tag=AZ5MADEWTVQT type=write size=656294 2024-09-12T17:30:31.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.699+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=JYFJ02U53I2C type=write size=855707 2024-09-12T17:30:31.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.702+0000 7fece65ff780 1 < suggested remove operation key=OPMR1WMB14CA tag=433N0ZLEFOS4 type=del 2024-09-12T17:30:31.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.703+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=T6118JICH565 type=del size=1384598 2024-09-12T17:30:31.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.704+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=FTYGLOALXT00 type=del 2024-09-12T17:30:31.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.706+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~T4SS41JZ09H1.0 size=1048576 2024-09-12T17:30:31.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.707+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~T4SS41JZ09H1.1 size=1048576 2024-09-12T17:30:31.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.708+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~T4SS41JZ09H1.2 size=122020 2024-09-12T17:30:31.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.708+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=T4SS41JZ09H1 tag=4IX7PFC7KY3A type=write size=3267748 2024-09-12T17:30:31.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.710+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=NHJ9M84V8KL6 type=del 2024-09-12T17:30:31.713 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.711+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=JKQR9A774YMB type=del size=3852838 2024-09-12T17:30:31.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.712+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=9DH2ZQHH2FBM type=del 2024-09-12T17:30:31.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.714+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~NZS4BJYVW0D5.0 size=1048576 2024-09-12T17:30:31.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.715+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~NZS4BJYVW0D5.1 size=1048576 2024-09-12T17:30:31.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.716+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~NZS4BJYVW0D5.2 size=23656 2024-09-12T17:30:31.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.716+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=NZS4BJYVW0D5 tag=CE21MQFIEQ5Q type=write size=3169384 2024-09-12T17:30:31.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.718+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~IJX6ZSV38T4V.0 size=793392 2024-09-12T17:30:31.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.720+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=IJX6ZSV38T4V tag=Z0G22M5L5FP2 type=write size=1841968 2024-09-12T17:30:31.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.723+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~0P8FGKAGGEZI.0 size=1048576 2024-09-12T17:30:31.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.724+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~0P8FGKAGGEZI.1 size=1002677 2024-09-12T17:30:31.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.724+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=0P8FGKAGGEZI tag=HFU2R5AKO083 type=write size=3099829 2024-09-12T17:30:31.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.725+0000 7fece65ff780 1 < canceled operation key=Y1OT1OLGWB1Q tag=MY5WS5K5YBPM type=del size=1371075 2024-09-12T17:30:31.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.726+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=JJZLIOG03Y84 type=del size=3394560 2024-09-12T17:30:31.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.728+0000 7fece65ff780 1 < completed delete operation key=Q00ZFG0BBDG5 tag=0BBTW3GX43LB type=del 2024-09-12T17:30:31.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.729+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=WAF81HA2GC7O type=write size=953163 2024-09-12T17:30:31.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.730+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=WCZXE59N2WMZ type=del 2024-09-12T17:30:31.733 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.732+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=3XEE58IRZB02 type=del size=3904983 2024-09-12T17:30:31.733 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.732+0000 7fece65ff780 1 < canceled part key=_multipart_I31CKY20NO9S.2~VUY9LJGFW53M.0 size=1048576 2024-09-12T17:30:31.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.733+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~VUY9LJGFW53M.1 size=150341 2024-09-12T17:30:31.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.736+0000 7fece65ff780 1 < canceled multipart upload key=I31CKY20NO9S upload=VUY9LJGFW53M tag=PQABF9E8UJFT type=write size=2247493 2024-09-12T17:30:31.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.738+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=80W0T40TDDQL type=del size=2090713 2024-09-12T17:30:31.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.740+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~03OFKM8QLT74.0 size=835934 2024-09-12T17:30:31.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.742+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=03OFKM8QLT74 tag=R3I3QFDH6OMQ type=write size=1884510 2024-09-12T17:30:31.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.743+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=GSWN0XSLHWLR type=write size=202059 2024-09-12T17:30:31.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.744+0000 7fece65ff780 1 < canceled part key=_multipart_2HTNXL56URAK.2~4INUK5AOPRRN.0 size=195518 2024-09-12T17:30:31.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.747+0000 7fece65ff780 1 < canceled multipart upload key=2HTNXL56URAK upload=4INUK5AOPRRN tag=026V6DFUZZTO type=write size=1244094 2024-09-12T17:30:31.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.749+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=K5JYSLKMG4FG type=del size=3063135 2024-09-12T17:30:31.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.750+0000 7fece65ff780 1 < completed delete operation key=IMCE9Z7P4S6R tag=TY2BZEB8XPSX type=del 2024-09-12T17:30:31.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.751+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=HJSTMIAK3RT3 type=del size=621565 2024-09-12T17:30:31.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.753+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~0PDFSOSUYW2N.0 size=1048576 2024-09-12T17:30:31.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.754+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~0PDFSOSUYW2N.1 size=826202 2024-09-12T17:30:31.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.756+0000 7fece65ff780 1 < completed multipart upload key=4Z1N3433MC6A upload=0PDFSOSUYW2N tag=37PBYFDF0A12 type=write size=2923354 2024-09-12T17:30:31.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.757+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=QTSYWQHD2X6C type=del size=3871251 2024-09-12T17:30:31.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.759+0000 7fece65ff780 1 < suggested update operation key=FX8VJO1YXJ4H tag=S9AJ3O19EPX7 type=del size=2865004 2024-09-12T17:30:31.762 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.760+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=743S7N1UEEZZ type=del size=1050312 2024-09-12T17:30:31.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.762+0000 7fece65ff780 1 < completed write operation key=6CCPZ4TVIU5N tag=HLKNWHA14YK7 type=write size=127657 2024-09-12T17:30:31.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.764+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~1KWJZWW3PWTE.0 size=1048576 2024-09-12T17:30:31.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.765+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~1KWJZWW3PWTE.1 size=1048576 2024-09-12T17:30:31.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.765+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~1KWJZWW3PWTE.2 size=679420 2024-09-12T17:30:31.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.765+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=1KWJZWW3PWTE tag=AA1OY2MJVLX2 type=write size=3825148 2024-09-12T17:30:31.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.767+0000 7fece65ff780 1 < completed write operation key=RKFRKIENSBTO tag=JYFJ02U53I2C type=write size=855707 2024-09-12T17:30:31.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.768+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=I05DSVTZH9HQ type=del size=2291393 2024-09-12T17:30:31.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.769+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=T6118JICH565 type=del 2024-09-12T17:30:31.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.771+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~M0Y2LPL4WLSI.0 size=1048576 2024-09-12T17:30:31.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.772+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~M0Y2LPL4WLSI.1 size=1048576 2024-09-12T17:30:31.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.773+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~M0Y2LPL4WLSI.2 size=996750 2024-09-12T17:30:31.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.773+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=M0Y2LPL4WLSI tag=WHLAOW82ILF9 type=write size=4142478 2024-09-12T17:30:31.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.774+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~T4SS41JZ09H1.0 size=1048576 2024-09-12T17:30:31.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.775+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~T4SS41JZ09H1.1 size=1048576 2024-09-12T17:30:31.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.776+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~T4SS41JZ09H1.2 size=122020 2024-09-12T17:30:31.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.778+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=T4SS41JZ09H1 tag=4IX7PFC7KY3A type=write size=3267748 2024-09-12T17:30:31.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.780+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=CYP5OMRT4SDL type=del size=4041834 2024-09-12T17:30:31.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.781+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=JKQR9A774YMB type=del 2024-09-12T17:30:31.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.782+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=UKWCO2UATNNP type=write size=168934 2024-09-12T17:30:31.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.783+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~NZS4BJYVW0D5.0 size=1048576 2024-09-12T17:30:31.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.784+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~NZS4BJYVW0D5.1 size=1048576 2024-09-12T17:30:31.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.785+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~NZS4BJYVW0D5.2 size=23656 2024-09-12T17:30:31.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.787+0000 7fece65ff780 1 < completed multipart upload key=4Z1N3433MC6A upload=NZS4BJYVW0D5 tag=CE21MQFIEQ5Q type=write size=3169384 2024-09-12T17:30:31.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.788+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=KKQX09V1SAWB type=write size=449658 2024-09-12T17:30:31.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.790+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~0P8FGKAGGEZI.0 size=1048576 2024-09-12T17:30:31.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.791+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~0P8FGKAGGEZI.1 size=1002677 2024-09-12T17:30:31.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.793+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=0P8FGKAGGEZI tag=HFU2R5AKO083 type=write size=3099829 2024-09-12T17:30:31.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.795+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~T1KW6IHAUB5V.0 size=1048576 2024-09-12T17:30:31.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.796+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~T1KW6IHAUB5V.1 size=6865 2024-09-12T17:30:31.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.796+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=T1KW6IHAUB5V tag=JU97OR5DOIE0 type=write size=2104017 2024-09-12T17:30:31.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.797+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=JJZLIOG03Y84 type=del 2024-09-12T17:30:31.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.799+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~NAAIISB16C49.0 size=1048576 2024-09-12T17:30:31.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.800+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~NAAIISB16C49.1 size=87525 2024-09-12T17:30:31.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.800+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=NAAIISB16C49 tag=PDZLGJ0UHQFN type=write size=2184677 2024-09-12T17:30:31.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.802+0000 7fece65ff780 1 < suggested update operation key=7AS5L998SDV7 tag=WAF81HA2GC7O type=write size=953163 2024-09-12T17:30:31.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.804+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~URVWE7KZV8L7.0 size=1048576 2024-09-12T17:30:31.807 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.805+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~URVWE7KZV8L7.1 size=837943 2024-09-12T17:30:31.807 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.805+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=URVWE7KZV8L7 tag=UKTNSLB9PZLZ type=write size=2935095 2024-09-12T17:30:31.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.808+0000 7fece65ff780 1 < suggested remove operation key=5LAOX5H1AQWJ tag=3XEE58IRZB02 type=del 2024-09-12T17:30:31.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.810+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~FUDKIZ4E58K0.0 size=904494 2024-09-12T17:30:31.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.810+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=FUDKIZ4E58K0 tag=28O9F0GQ18B3 type=write size=1953070 2024-09-12T17:30:31.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.812+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=80W0T40TDDQL type=del 2024-09-12T17:30:31.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.814+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~SCC5NL9HFB0T.0 size=888018 2024-09-12T17:30:31.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.814+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=SCC5NL9HFB0T tag=L4I4MCS004I1 type=write size=1936594 2024-09-12T17:30:31.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.815+0000 7fece65ff780 1 < completed write operation key=QQNW20B28RJC tag=GSWN0XSLHWLR type=write size=202059 2024-09-12T17:30:31.819 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.817+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~5LRPQJZEKN05.0 size=1048576 2024-09-12T17:30:31.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.818+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~5LRPQJZEKN05.1 size=1048576 2024-09-12T17:30:31.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.819+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~5LRPQJZEKN05.2 size=238461 2024-09-12T17:30:31.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.819+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=5LRPQJZEKN05 tag=V1J7ISRIE4QK type=write size=3384189 2024-09-12T17:30:31.822 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.821+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=K5JYSLKMG4FG type=del 2024-09-12T17:30:31.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.823+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~VLZOVCHRSHQ9.0 size=1048576 2024-09-12T17:30:31.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.824+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~VLZOVCHRSHQ9.1 size=1048576 2024-09-12T17:30:31.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.825+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~VLZOVCHRSHQ9.2 size=537455 2024-09-12T17:30:31.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.825+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=VLZOVCHRSHQ9 tag=42K2HDMSK5KD type=write size=3683183 2024-09-12T17:30:31.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.826+0000 7fece65ff780 1 < canceled operation key=4Z1N3433MC6A tag=HJSTMIAK3RT3 type=del size=621565 2024-09-12T17:30:31.829 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.828+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=I8RPZCXT2635 type=del size=3439473 2024-09-12T17:30:31.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.829+0000 7fece65ff780 1 < completed delete operation key=IMCE9Z7P4S6R tag=QTSYWQHD2X6C type=del 2024-09-12T17:30:31.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.830+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=80ERV89HCU2H type=del size=246173 2024-09-12T17:30:31.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.831+0000 7fece65ff780 1 < completed delete operation key=Q00ZFG0BBDG5 tag=743S7N1UEEZZ type=del 2024-09-12T17:30:31.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.833+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=FYB3R1EBKNKM type=del size=3746364 2024-09-12T17:30:31.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.834+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~1KWJZWW3PWTE.0 size=1048576 2024-09-12T17:30:31.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.835+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~1KWJZWW3PWTE.1 size=1048576 2024-09-12T17:30:31.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.835+0000 7fece65ff780 1 < canceled part key=_multipart_2HTNXL56URAK.2~1KWJZWW3PWTE.2 size=679420 2024-09-12T17:30:31.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.837+0000 7fece65ff780 1 < canceled multipart upload key=2HTNXL56URAK upload=1KWJZWW3PWTE tag=AA1OY2MJVLX2 type=write size=3825148 2024-09-12T17:30:31.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.838+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=995S6PO3H38Y type=del size=1924255 2024-09-12T17:30:31.841 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.839+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=I05DSVTZH9HQ type=del 2024-09-12T17:30:31.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.840+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=TNLGBR12HIJJ type=del size=3573885 2024-09-12T17:30:31.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.842+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~M0Y2LPL4WLSI.0 size=1048576 2024-09-12T17:30:31.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.843+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~M0Y2LPL4WLSI.1 size=1048576 2024-09-12T17:30:31.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.844+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~M0Y2LPL4WLSI.2 size=996750 2024-09-12T17:30:31.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.846+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=M0Y2LPL4WLSI tag=WHLAOW82ILF9 type=write size=4142478 2024-09-12T17:30:31.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.847+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=83XYAIB9PMNE type=del size=1958007 2024-09-12T17:30:31.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.848+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=CYP5OMRT4SDL type=del 2024-09-12T17:30:31.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.851+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~A3Q9MFN1OO7H.0 size=1048576 2024-09-12T17:30:31.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.852+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~A3Q9MFN1OO7H.1 size=1048576 2024-09-12T17:30:31.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.853+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~A3Q9MFN1OO7H.2 size=73409 2024-09-12T17:30:31.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.853+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=A3Q9MFN1OO7H tag=E8M52YECUZS9 type=write size=3219137 2024-09-12T17:30:31.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.856+0000 7fece65ff780 1 < suggested remove operation key=6CCPZ4TVIU5N tag=UKWCO2UATNNP type=write 2024-09-12T17:30:31.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.857+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=3UZLXTFQUT5X type=write size=315982 2024-09-12T17:30:31.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.858+0000 7fece65ff780 1 < completed write operation key=QQNW20B28RJC tag=KKQX09V1SAWB type=write size=449658 2024-09-12T17:30:31.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.860+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~1JL3MYKNWIYS.0 size=1048576 2024-09-12T17:30:31.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.861+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~1JL3MYKNWIYS.1 size=839365 2024-09-12T17:30:31.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.861+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=1JL3MYKNWIYS tag=WO4AP93K3YMM type=write size=2936517 2024-09-12T17:30:31.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.863+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~T1KW6IHAUB5V.0 size=1048576 2024-09-12T17:30:31.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.864+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~T1KW6IHAUB5V.1 size=6865 2024-09-12T17:30:31.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.866+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=T1KW6IHAUB5V tag=JU97OR5DOIE0 type=write size=2104017 2024-09-12T17:30:31.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.868+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~PGP1V81KDR3Q.0 size=432909 2024-09-12T17:30:31.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.868+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=PGP1V81KDR3Q tag=XX7YC0VM8M48 type=write size=1481485 2024-09-12T17:30:31.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.869+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~NAAIISB16C49.0 size=1048576 2024-09-12T17:30:31.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.870+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~NAAIISB16C49.1 size=87525 2024-09-12T17:30:31.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.872+0000 7fece65ff780 1 < completed multipart upload key=FX8VJO1YXJ4H upload=NAAIISB16C49 tag=PDZLGJ0UHQFN type=write size=2184677 2024-09-12T17:30:31.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.875+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~UVLTQO37LJU1.0 size=1048576 2024-09-12T17:30:31.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.876+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~UVLTQO37LJU1.1 size=1048576 2024-09-12T17:30:31.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.877+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~UVLTQO37LJU1.2 size=123129 2024-09-12T17:30:31.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.877+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=UVLTQO37LJU1 tag=FQASY9LGHTT2 type=write size=3268857 2024-09-12T17:30:31.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.877+0000 7fece65ff780 1 < canceled part key=_multipart_6GUDX5I1AKNH.2~URVWE7KZV8L7.0 size=1048576 2024-09-12T17:30:31.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.878+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~URVWE7KZV8L7.1 size=837943 2024-09-12T17:30:31.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.880+0000 7fece65ff780 1 < canceled multipart upload key=6GUDX5I1AKNH upload=URVWE7KZV8L7 tag=UKTNSLB9PZLZ type=write size=2935095 2024-09-12T17:30:31.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.882+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~69MZXRDHJ34E.0 size=1048576 2024-09-12T17:30:31.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.883+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~69MZXRDHJ34E.1 size=1048576 2024-09-12T17:30:31.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.884+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~69MZXRDHJ34E.2 size=412315 2024-09-12T17:30:31.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.884+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=69MZXRDHJ34E tag=U6G6FFU1V3YN type=write size=3558043 2024-09-12T17:30:31.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.885+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~FUDKIZ4E58K0.0 size=904494 2024-09-12T17:30:31.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.887+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=FUDKIZ4E58K0 tag=28O9F0GQ18B3 type=write size=1953070 2024-09-12T17:30:31.890 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.888+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=K1DJBNQQ04SV type=del size=2309203 2024-09-12T17:30:31.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.890+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~SCC5NL9HFB0T.0 size=888018 2024-09-12T17:30:31.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.892+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=SCC5NL9HFB0T tag=L4I4MCS004I1 type=write size=1936594 2024-09-12T17:30:31.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.893+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=OYXY3PKJXZLJ type=del size=2695798 2024-09-12T17:30:31.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.894+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~5LRPQJZEKN05.0 size=1048576 2024-09-12T17:30:31.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.895+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~5LRPQJZEKN05.1 size=1048576 2024-09-12T17:30:31.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.896+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~5LRPQJZEKN05.2 size=238461 2024-09-12T17:30:31.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.898+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=5LRPQJZEKN05 tag=V1J7ISRIE4QK type=write size=3384189 2024-09-12T17:30:31.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.900+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=E6QKBG6MIQZP type=del size=2707626 2024-09-12T17:30:31.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.901+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~VLZOVCHRSHQ9.0 size=1048576 2024-09-12T17:30:31.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.902+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~VLZOVCHRSHQ9.1 size=1048576 2024-09-12T17:30:31.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.903+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~VLZOVCHRSHQ9.2 size=537455 2024-09-12T17:30:31.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.905+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=VLZOVCHRSHQ9 tag=42K2HDMSK5KD type=write size=3683183 2024-09-12T17:30:31.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.907+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=7MO6A22288MX type=write size=101317 2024-09-12T17:30:31.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.909+0000 7fece65ff780 1 < suggested update operation key=UCBB99EG8XK2 tag=I8RPZCXT2635 type=del size=3439473 2024-09-12T17:30:31.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.910+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=A1AOTZCJ6G52 type=del size=3955418 2024-09-12T17:30:31.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.912+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=80ERV89HCU2H type=del 2024-09-12T17:30:31.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.913+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=P61C43I1H3SV type=del size=3511538 2024-09-12T17:30:31.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.914+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=FYB3R1EBKNKM type=del 2024-09-12T17:30:31.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.915+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=J4PR99F1E0O2 type=del size=1840847 2024-09-12T17:30:31.918 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.916+0000 7fece65ff780 1 < canceled operation key=OPMR1WMB14CA tag=995S6PO3H38Y type=del size=1924255 2024-09-12T17:30:31.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.918+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=SUOWHUOQ12BS type=write size=774156 2024-09-12T17:30:31.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.919+0000 7fece65ff780 1 < canceled operation key=6GUDX5I1AKNH tag=TNLGBR12HIJJ type=del size=3573885 2024-09-12T17:30:31.922 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.920+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=HLFTHA16W4CS type=write size=855443 2024-09-12T17:30:31.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.922+0000 7fece65ff780 1 < suggested update operation key=Q00ZFG0BBDG5 tag=83XYAIB9PMNE type=del size=1958007 2024-09-12T17:30:31.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.924+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=FHX4JAA2J37K type=del size=27341 2024-09-12T17:30:31.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.925+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~A3Q9MFN1OO7H.0 size=1048576 2024-09-12T17:30:31.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.925+0000 7fece65ff780 1 < canceled part key=_multipart_2HTNXL56URAK.2~A3Q9MFN1OO7H.1 size=1048576 2024-09-12T17:30:31.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.927+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~A3Q9MFN1OO7H.2 size=73409 2024-09-12T17:30:31.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.929+0000 7fece65ff780 1 < canceled multipart upload key=2HTNXL56URAK upload=A3Q9MFN1OO7H tag=E8M52YECUZS9 type=write size=3219137 2024-09-12T17:30:31.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.930+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=QBMKXVF6JMBU type=del size=709309 2024-09-12T17:30:31.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.931+0000 7fece65ff780 1 < completed write operation key=I31CKY20NO9S tag=3UZLXTFQUT5X type=write size=315982 2024-09-12T17:30:31.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.932+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=ZMKK096LSF92 type=del size=823583 2024-09-12T17:30:31.935 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.934+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~1JL3MYKNWIYS.0 size=1048576 2024-09-12T17:30:31.936 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.935+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~1JL3MYKNWIYS.1 size=839365 2024-09-12T17:30:31.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.937+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=1JL3MYKNWIYS tag=WO4AP93K3YMM type=write size=2936517 2024-09-12T17:30:31.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.939+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~H4B72INAIK09.0 size=1048576 2024-09-12T17:30:31.941 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.940+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~H4B72INAIK09.1 size=1048576 2024-09-12T17:30:31.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.941+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~H4B72INAIK09.2 size=622597 2024-09-12T17:30:31.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.941+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=H4B72INAIK09 tag=8Q3V22EFG4C2 type=write size=3768325 2024-09-12T17:30:31.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.942+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~PGP1V81KDR3Q.0 size=432909 2024-09-12T17:30:31.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.944+0000 7fece65ff780 1 < completed multipart upload key=I31CKY20NO9S upload=PGP1V81KDR3Q tag=XX7YC0VM8M48 type=write size=1481485 2024-09-12T17:30:31.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.945+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=C0515GZ9LR0N type=del size=1063042 2024-09-12T17:30:31.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.947+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~UVLTQO37LJU1.0 size=1048576 2024-09-12T17:30:31.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.947+0000 7fece65ff780 1 < canceled part key=_multipart_OPMR1WMB14CA.2~UVLTQO37LJU1.1 size=1048576 2024-09-12T17:30:31.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.948+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~UVLTQO37LJU1.2 size=123129 2024-09-12T17:30:31.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.950+0000 7fece65ff780 1 < canceled multipart upload key=OPMR1WMB14CA upload=UVLTQO37LJU1 tag=FQASY9LGHTT2 type=write size=3268857 2024-09-12T17:30:31.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.952+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~7BS4RX4ICD6Y.0 size=949707 2024-09-12T17:30:31.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.952+0000 7fece65ff780 1 > prepared multipart upload key=Y30269Q7R340 upload=7BS4RX4ICD6Y tag=TF8HZ399BT5M type=write size=1998283 2024-09-12T17:30:31.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.953+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~69MZXRDHJ34E.0 size=1048576 2024-09-12T17:30:31.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.954+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~69MZXRDHJ34E.1 size=1048576 2024-09-12T17:30:31.957 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.955+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~69MZXRDHJ34E.2 size=412315 2024-09-12T17:30:31.959 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.957+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=69MZXRDHJ34E tag=U6G6FFU1V3YN type=write size=3558043 2024-09-12T17:30:31.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.958+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=1XKFN9UIMWVS type=del size=1021805 2024-09-12T17:30:31.961 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.960+0000 7fece65ff780 1 < completed delete operation key=OIHDAJMPUK4I tag=K1DJBNQQ04SV type=del 2024-09-12T17:30:31.964 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.962+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~EOB09FK663RH.0 size=1048576 2024-09-12T17:30:31.965 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.963+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~EOB09FK663RH.1 size=316763 2024-09-12T17:30:31.965 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.963+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=EOB09FK663RH tag=J02ULH9QU4IW type=write size=2413915 2024-09-12T17:30:31.966 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.964+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=OYXY3PKJXZLJ type=del 2024-09-12T17:30:31.968 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.967+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=BJ1RYJUNPQJR type=del size=3808173 2024-09-12T17:30:31.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.968+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=E6QKBG6MIQZP type=del 2024-09-12T17:30:31.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.970+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~3PQ2YC0UEU6C.0 size=1048576 2024-09-12T17:30:31.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.971+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~3PQ2YC0UEU6C.1 size=1048576 2024-09-12T17:30:31.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.972+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~3PQ2YC0UEU6C.2 size=707633 2024-09-12T17:30:31.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.972+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=3PQ2YC0UEU6C tag=0XNK6QNEER16 type=write size=3853361 2024-09-12T17:30:31.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.973+0000 7fece65ff780 1 < completed write operation key=IMCE9Z7P4S6R tag=7MO6A22288MX type=write size=101317 2024-09-12T17:30:31.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.975+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=1QJ1RH953ZEF type=del size=3417668 2024-09-12T17:30:31.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.977+0000 7fece65ff780 1 < suggested update operation key=7AS5L998SDV7 tag=A1AOTZCJ6G52 type=del size=3955418 2024-09-12T17:30:31.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.979+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~U9WM9LK1U116.0 size=1048576 2024-09-12T17:30:31.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.980+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~U9WM9LK1U116.1 size=1048576 2024-09-12T17:30:31.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.981+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~U9WM9LK1U116.2 size=558317 2024-09-12T17:30:31.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.981+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=U9WM9LK1U116 tag=ZN5N4KQ1ONZ4 type=write size=3704045 2024-09-12T17:30:31.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.982+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=P61C43I1H3SV type=del 2024-09-12T17:30:31.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.984+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=S798YQHKW7EP type=del size=1809138 2024-09-12T17:30:31.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.986+0000 7fece65ff780 1 < suggested remove operation key=9IGJG88NX1FS tag=J4PR99F1E0O2 type=del 2024-09-12T17:30:31.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.987+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=HN19EHFINJ8M type=del size=562035 2024-09-12T17:30:31.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.988+0000 7fece65ff780 1 < completed write operation key=5A7WPGW5P91B tag=SUOWHUOQ12BS type=write size=774156 2024-09-12T17:30:31.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.990+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=2GQDNQLZGI80 type=del size=344140 2024-09-12T17:30:31.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.991+0000 7fece65ff780 -1 < failed to complete operation key=9IGJG88NX1FS tag=HLFTHA16W4CS type=write size=855443: (22) Invalid argument 2024-09-12T17:30:31.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.993+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=STRKV3GT6M9H type=del size=2921160 2024-09-12T17:30:31.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.994+0000 7fece65ff780 -1 < failed to complete operation key=7AS5L998SDV7 tag=FHX4JAA2J37K type=del size=27341: (22) Invalid argument 2024-09-12T17:30:31.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.995+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=Y03DS9OMXOQ3 type=del size=1816895 2024-09-12T17:30:31.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.998+0000 7fece65ff780 1 < suggested remove operation key=807GX4RQQLL4 tag=QBMKXVF6JMBU type=del 2024-09-12T17:30:32.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:31.999+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=RIH8PFJGUBQG type=del size=32141 2024-09-12T17:30:32.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.001+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=ZMKK096LSF92 type=del 2024-09-12T17:30:32.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.003+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~6A189QFM94AT.0 size=274076 2024-09-12T17:30:32.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.003+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=6A189QFM94AT tag=RTPSR8MK71MH type=write size=1322652 2024-09-12T17:30:32.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.004+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~H4B72INAIK09.0 size=1048576 2024-09-12T17:30:32.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.005+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~H4B72INAIK09.1 size=1048576 2024-09-12T17:30:32.008 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.006+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~H4B72INAIK09.2 size=622597 2024-09-12T17:30:32.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.008+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=H4B72INAIK09 tag=8Q3V22EFG4C2 type=write size=3768325 2024-09-12T17:30:32.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.011+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~GTWRJ27PV8LX.0 size=1048576 2024-09-12T17:30:32.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.012+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~GTWRJ27PV8LX.1 size=1048576 2024-09-12T17:30:32.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.013+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~GTWRJ27PV8LX.2 size=1025511 2024-09-12T17:30:32.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.013+0000 7fece65ff780 1 > prepared multipart upload key=Y30269Q7R340 upload=GTWRJ27PV8LX tag=HDBYB4O7TH43 type=write size=4171239 2024-09-12T17:30:32.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.014+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=C0515GZ9LR0N type=del 2024-09-12T17:30:32.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.015+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=GNEMBUP838XV type=del size=3959944 2024-09-12T17:30:32.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.016+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~7BS4RX4ICD6Y.0 size=949707 2024-09-12T17:30:32.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.018+0000 7fece65ff780 1 < completed multipart upload key=Y30269Q7R340 upload=7BS4RX4ICD6Y tag=TF8HZ399BT5M type=write size=1998283 2024-09-12T17:30:32.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.019+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=SYT4BJIED1C9 type=write size=586976 2024-09-12T17:30:32.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.021+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=1XKFN9UIMWVS type=del 2024-09-12T17:30:32.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.022+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=T1V1ON1T1387 type=write size=596924 2024-09-12T17:30:32.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.023+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~EOB09FK663RH.0 size=1048576 2024-09-12T17:30:32.026 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.024+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~EOB09FK663RH.1 size=316763 2024-09-12T17:30:32.028 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.026+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=EOB09FK663RH tag=J02ULH9QU4IW type=write size=2413915 2024-09-12T17:30:32.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.027+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=FR73W47UHIGR type=write size=77048 2024-09-12T17:30:32.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.030+0000 7fece65ff780 1 < suggested update operation key=QQNW20B28RJC tag=BJ1RYJUNPQJR type=del size=3808173 2024-09-12T17:30:32.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.031+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=SVMNIVAW7TVA type=del size=470683 2024-09-12T17:30:32.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.032+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~3PQ2YC0UEU6C.0 size=1048576 2024-09-12T17:30:32.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.033+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~3PQ2YC0UEU6C.1 size=1048576 2024-09-12T17:30:32.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.034+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~3PQ2YC0UEU6C.2 size=707633 2024-09-12T17:30:32.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.037+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=3PQ2YC0UEU6C tag=0XNK6QNEER16 type=write size=3853361 2024-09-12T17:30:32.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.038+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=BWXZ2VGEFGO6 type=write size=453086 2024-09-12T17:30:32.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.039+0000 7fece65ff780 -1 < failed to complete operation key=7AS5L998SDV7 tag=1QJ1RH953ZEF type=del size=3417668: (22) Invalid argument 2024-09-12T17:30:32.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.040+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=GQPMSMHNTNDM type=del size=2633513 2024-09-12T17:30:32.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.042+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~U9WM9LK1U116.0 size=1048576 2024-09-12T17:30:32.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.042+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~U9WM9LK1U116.1 size=1048576 2024-09-12T17:30:32.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.043+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~U9WM9LK1U116.2 size=558317 2024-09-12T17:30:32.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.046+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=U9WM9LK1U116 tag=ZN5N4KQ1ONZ4 type=write size=3704045 2024-09-12T17:30:32.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.047+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=ADNYITAV0A8F type=write size=516318 2024-09-12T17:30:32.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.048+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=S798YQHKW7EP type=del 2024-09-12T17:30:32.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.049+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=B5ZZFD191YX0 type=del size=4091597 2024-09-12T17:30:32.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.051+0000 7fece65ff780 1 < completed delete operation key=5A7WPGW5P91B tag=HN19EHFINJ8M type=del 2024-09-12T17:30:32.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.053+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~DATISYPMDN6S.0 size=1048576 2024-09-12T17:30:32.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.054+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~DATISYPMDN6S.1 size=923346 2024-09-12T17:30:32.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.054+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=DATISYPMDN6S tag=2YFS2OYWZW77 type=write size=3020498 2024-09-12T17:30:32.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.055+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=2GQDNQLZGI80 type=del 2024-09-12T17:30:32.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.056+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=UY61V0REWA62 type=del size=3882404 2024-09-12T17:30:32.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.058+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=STRKV3GT6M9H type=del 2024-09-12T17:30:32.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.060+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~RYGSONZCVWXB.0 size=1048576 2024-09-12T17:30:32.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.061+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~RYGSONZCVWXB.1 size=1048576 2024-09-12T17:30:32.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.062+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~RYGSONZCVWXB.2 size=14221 2024-09-12T17:30:32.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.062+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=RYGSONZCVWXB tag=2CEIX4RQ03MV type=write size=3159949 2024-09-12T17:30:32.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.063+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=Y03DS9OMXOQ3 type=del 2024-09-12T17:30:32.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.065+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~HSJQ6NFZ95PA.0 size=1048576 2024-09-12T17:30:32.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.066+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~HSJQ6NFZ95PA.1 size=901397 2024-09-12T17:30:32.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.066+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=HSJQ6NFZ95PA tag=6YO1JMUDAD0J type=write size=2998549 2024-09-12T17:30:32.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.067+0000 7fece65ff780 1 < canceled operation key=Y1OT1OLGWB1Q tag=RIH8PFJGUBQG type=del size=32141 2024-09-12T17:30:32.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.069+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=NWTJN7EUBYXT type=del size=2744321 2024-09-12T17:30:32.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.070+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~6A189QFM94AT.0 size=274076 2024-09-12T17:30:32.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.072+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=6A189QFM94AT tag=RTPSR8MK71MH type=write size=1322652 2024-09-12T17:30:32.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.073+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=62OGNKC37HBO type=del size=1955947 2024-09-12T17:30:32.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.074+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~GTWRJ27PV8LX.0 size=1048576 2024-09-12T17:30:32.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.075+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~GTWRJ27PV8LX.1 size=1048576 2024-09-12T17:30:32.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.076+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~GTWRJ27PV8LX.2 size=1025511 2024-09-12T17:30:32.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.079+0000 7fece65ff780 1 < completed multipart upload key=Y30269Q7R340 upload=GTWRJ27PV8LX tag=HDBYB4O7TH43 type=write size=4171239 2024-09-12T17:30:32.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.080+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=EUVW1CBBFXFP type=write size=755504 2024-09-12T17:30:32.083 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.081+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=GNEMBUP838XV type=del 2024-09-12T17:30:32.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.083+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=QYQ6BNAAXRKR type=del size=3815471 2024-09-12T17:30:32.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.087+0000 7fece65ff780 1 < suggested update operation key=4Z1N3433MC6A tag=SYT4BJIED1C9 type=write size=586976 2024-09-12T17:30:32.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.089+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~TOQ0B144RXIM.0 size=364709 2024-09-12T17:30:32.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.089+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=TOQ0B144RXIM tag=C4IYCP19HRSP type=write size=1413285 2024-09-12T17:30:32.093 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.092+0000 7fece65ff780 1 < suggested update operation key=6CCPZ4TVIU5N tag=T1V1ON1T1387 type=write size=596924 2024-09-12T17:30:32.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.093+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=ZHY9GDT8FLDP type=write size=575745 2024-09-12T17:30:32.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.094+0000 7fece65ff780 1 < completed write operation key=UCBB99EG8XK2 tag=FR73W47UHIGR type=write size=77048 2024-09-12T17:30:32.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.096+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=9VSCILYDUF8J type=del size=1848650 2024-09-12T17:30:32.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.098+0000 7fece65ff780 1 < suggested remove operation key=Q00ZFG0BBDG5 tag=SVMNIVAW7TVA type=del 2024-09-12T17:30:32.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.102+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~74125V0YCB6P.0 size=1048576 2024-09-12T17:30:32.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.103+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~74125V0YCB6P.1 size=1048576 2024-09-12T17:30:32.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.104+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~74125V0YCB6P.2 size=762020 2024-09-12T17:30:32.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.104+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=74125V0YCB6P tag=53JT0TU86TU2 type=write size=3907748 2024-09-12T17:30:32.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.106+0000 7fece65ff780 1 < suggested update operation key=807GX4RQQLL4 tag=BWXZ2VGEFGO6 type=write size=453086 2024-09-12T17:30:32.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.107+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=UVVLA98N5S4E type=del size=2309845 2024-09-12T17:30:32.110 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.109+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=GQPMSMHNTNDM type=del 2024-09-12T17:30:32.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.110+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=3WEEK7LGZT1H type=del size=1343330 2024-09-12T17:30:32.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.111+0000 7fece65ff780 1 < completed write operation key=QQNW20B28RJC tag=ADNYITAV0A8F type=write size=516318 2024-09-12T17:30:32.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.112+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=YC2DKYH0ZJ33 type=del size=1511761 2024-09-12T17:30:32.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.113+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=B5ZZFD191YX0 type=del 2024-09-12T17:30:32.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.115+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=WYAGUMFFVDVT type=del size=4063283 2024-09-12T17:30:32.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.116+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~DATISYPMDN6S.0 size=1048576 2024-09-12T17:30:32.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.117+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~DATISYPMDN6S.1 size=923346 2024-09-12T17:30:32.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.119+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=DATISYPMDN6S tag=2YFS2OYWZW77 type=write size=3020498 2024-09-12T17:30:32.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.120+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=01WQ8ZQKJRF6 type=write size=59191 2024-09-12T17:30:32.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.121+0000 7fece65ff780 -1 < failed to complete operation key=4Z1N3433MC6A tag=UY61V0REWA62 type=del size=3882404: (22) Invalid argument 2024-09-12T17:30:32.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.122+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=3ETP8AJIRSQJ type=del size=2130971 2024-09-12T17:30:32.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.124+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~RYGSONZCVWXB.0 size=1048576 2024-09-12T17:30:32.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.125+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~RYGSONZCVWXB.1 size=1048576 2024-09-12T17:30:32.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.126+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~RYGSONZCVWXB.2 size=14221 2024-09-12T17:30:32.129 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.128+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=RYGSONZCVWXB tag=2CEIX4RQ03MV type=write size=3159949 2024-09-12T17:30:32.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.130+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~Z3MJCC8FNLR5.0 size=666357 2024-09-12T17:30:32.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.130+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=Z3MJCC8FNLR5 tag=S3OST1660K17 type=write size=1714933 2024-09-12T17:30:32.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.131+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~HSJQ6NFZ95PA.0 size=1048576 2024-09-12T17:30:32.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.132+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~HSJQ6NFZ95PA.1 size=901397 2024-09-12T17:30:32.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.134+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=HSJQ6NFZ95PA tag=6YO1JMUDAD0J type=write size=2998549 2024-09-12T17:30:32.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.135+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=J37KV5OSS216 type=del size=1178763 2024-09-12T17:30:32.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.138+0000 7fece65ff780 1 < suggested update operation key=5A7WPGW5P91B tag=NWTJN7EUBYXT type=del size=2744321 2024-09-12T17:30:32.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.140+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~TCSSJ1QC1XGY.0 size=694591 2024-09-12T17:30:32.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.140+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=TCSSJ1QC1XGY tag=FXEPCNM8HT4S type=write size=1743167 2024-09-12T17:30:32.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.141+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=62OGNKC37HBO type=del 2024-09-12T17:30:32.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.143+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~2S4MSLPXR72F.0 size=1048576 2024-09-12T17:30:32.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.144+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~2S4MSLPXR72F.1 size=1048576 2024-09-12T17:30:32.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.145+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~2S4MSLPXR72F.2 size=936474 2024-09-12T17:30:32.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.145+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=2S4MSLPXR72F tag=XKWUSILMKO5T type=write size=4082202 2024-09-12T17:30:32.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.146+0000 7fece65ff780 1 < completed write operation key=I31CKY20NO9S tag=EUVW1CBBFXFP type=write size=755504 2024-09-12T17:30:32.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.148+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=D4RSFLRGU7S4 type=del size=3505448 2024-09-12T17:30:32.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.150+0000 7fece65ff780 1 < suggested remove operation key=4Z1N3433MC6A tag=QYQ6BNAAXRKR type=del 2024-09-12T17:30:32.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.153+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~MWLRAH1B25EU.0 size=350854 2024-09-12T17:30:32.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.153+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=MWLRAH1B25EU tag=YJSMB5MVS0WJ type=write size=1399430 2024-09-12T17:30:32.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.154+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~TOQ0B144RXIM.0 size=364709 2024-09-12T17:30:32.157 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.156+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=TOQ0B144RXIM tag=C4IYCP19HRSP type=write size=1413285 2024-09-12T17:30:32.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.157+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=1M0MP4SRF1R1 type=del size=2966337 2024-09-12T17:30:32.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.161+0000 7fece65ff780 1 < suggested update operation key=807GX4RQQLL4 tag=ZHY9GDT8FLDP type=write size=575745 2024-09-12T17:30:32.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.162+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=B20WK8NGSKYN type=del size=3415910 2024-09-12T17:30:32.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.164+0000 7fece65ff780 1 < suggested update operation key=IMCE9Z7P4S6R tag=9VSCILYDUF8J type=del size=1848650 2024-09-12T17:30:32.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.165+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=LHZXDTCSPBRO type=write size=352425 2024-09-12T17:30:32.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.167+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~74125V0YCB6P.0 size=1048576 2024-09-12T17:30:32.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.168+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~74125V0YCB6P.1 size=1048576 2024-09-12T17:30:32.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.169+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~74125V0YCB6P.2 size=762020 2024-09-12T17:30:32.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.171+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=74125V0YCB6P tag=53JT0TU86TU2 type=write size=3907748 2024-09-12T17:30:32.174 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.172+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=N2YVO3OLZOP8 type=del size=2361837 2024-09-12T17:30:32.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.174+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=UVVLA98N5S4E type=del 2024-09-12T17:30:32.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.175+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=GM64DAVS0P5O type=del size=3047411 2024-09-12T17:30:32.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.176+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=3WEEK7LGZT1H type=del 2024-09-12T17:30:32.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.179+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~IN9KROT9RJFJ.0 size=369480 2024-09-12T17:30:32.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.179+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=IN9KROT9RJFJ tag=VGGFPCA8OOKT type=write size=1418056 2024-09-12T17:30:32.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.181+0000 7fece65ff780 1 < suggested update operation key=6GUDX5I1AKNH tag=YC2DKYH0ZJ33 type=del size=1511761 2024-09-12T17:30:32.185 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.183+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~3P72C8ULD9MU.0 size=313160 2024-09-12T17:30:32.185 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.183+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=3P72C8ULD9MU tag=8XFPCF5LLY79 type=write size=1361736 2024-09-12T17:30:32.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.186+0000 7fece65ff780 1 < completed delete operation key=OIHDAJMPUK4I tag=WYAGUMFFVDVT type=del 2024-09-12T17:30:32.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.188+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~J8US01MGMJJY.0 size=1048576 2024-09-12T17:30:32.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.189+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~J8US01MGMJJY.1 size=1048576 2024-09-12T17:30:32.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.190+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~J8US01MGMJJY.2 size=654005 2024-09-12T17:30:32.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.190+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=J8US01MGMJJY tag=4IEID4CQ3QXA type=write size=3799733 2024-09-12T17:30:32.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.193+0000 7fece65ff780 1 < suggested update operation key=1G9VNO1V4IMW tag=01WQ8ZQKJRF6 type=write size=59191 2024-09-12T17:30:32.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.194+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=3Z5W9RLZGJLM type=del size=4065074 2024-09-12T17:30:32.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.195+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=3ETP8AJIRSQJ type=del 2024-09-12T17:30:32.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.198+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~A8FI1ZA8LN4I.0 size=1048576 2024-09-12T17:30:32.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.199+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~A8FI1ZA8LN4I.1 size=13285 2024-09-12T17:30:32.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.199+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=A8FI1ZA8LN4I tag=0I0UU79RUIU8 type=write size=2110437 2024-09-12T17:30:32.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.200+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~Z3MJCC8FNLR5.0 size=666357 2024-09-12T17:30:32.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.202+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=Z3MJCC8FNLR5 tag=S3OST1660K17 type=write size=1714933 2024-09-12T17:30:32.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.203+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=RTWJ19N7ZGL4 type=del size=1795946 2024-09-12T17:30:32.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.205+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=J37KV5OSS216 type=del 2024-09-12T17:30:32.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.208+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~ABPV6F69RRW8.0 size=1048576 2024-09-12T17:30:32.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.209+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~ABPV6F69RRW8.1 size=1048576 2024-09-12T17:30:32.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.210+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~ABPV6F69RRW8.2 size=267251 2024-09-12T17:30:32.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.210+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=ABPV6F69RRW8 tag=FY3UH1GTNNDG type=write size=3412979 2024-09-12T17:30:32.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.211+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~TCSSJ1QC1XGY.0 size=694591 2024-09-12T17:30:32.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.213+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=TCSSJ1QC1XGY tag=FXEPCNM8HT4S type=write size=1743167 2024-09-12T17:30:32.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.216+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~W0LWCVIH7UA3.0 size=1048576 2024-09-12T17:30:32.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.217+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~W0LWCVIH7UA3.1 size=1048576 2024-09-12T17:30:32.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.218+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~W0LWCVIH7UA3.2 size=137605 2024-09-12T17:30:32.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.218+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=W0LWCVIH7UA3 tag=I3PY0RVKVNCR type=write size=3283333 2024-09-12T17:30:32.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.219+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~2S4MSLPXR72F.0 size=1048576 2024-09-12T17:30:32.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.220+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~2S4MSLPXR72F.1 size=1048576 2024-09-12T17:30:32.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.221+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~2S4MSLPXR72F.2 size=936474 2024-09-12T17:30:32.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.223+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=2S4MSLPXR72F tag=XKWUSILMKO5T type=write size=4082202 2024-09-12T17:30:32.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.224+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=U1LPAB9Z9QH0 type=write size=49403 2024-09-12T17:30:32.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.225+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=D4RSFLRGU7S4 type=del 2024-09-12T17:30:32.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.227+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=VCOJBO5QG490 type=del size=316043 2024-09-12T17:30:32.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.228+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~MWLRAH1B25EU.0 size=350854 2024-09-12T17:30:32.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.230+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=MWLRAH1B25EU tag=YJSMB5MVS0WJ type=write size=1399430 2024-09-12T17:30:32.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.232+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~2WGE3RCHD6W4.0 size=1048576 2024-09-12T17:30:32.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.233+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~2WGE3RCHD6W4.1 size=1048576 2024-09-12T17:30:32.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.234+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~2WGE3RCHD6W4.2 size=64748 2024-09-12T17:30:32.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.234+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=2WGE3RCHD6W4 tag=TE8WW20OI1JP type=write size=3210476 2024-09-12T17:30:32.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.235+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=1M0MP4SRF1R1 type=del 2024-09-12T17:30:32.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.238+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~P1UHGYV3T9YJ.0 size=1048576 2024-09-12T17:30:32.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.238+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~P1UHGYV3T9YJ.1 size=1048576 2024-09-12T17:30:32.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.240+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~P1UHGYV3T9YJ.2 size=353816 2024-09-12T17:30:32.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.240+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=P1UHGYV3T9YJ tag=EQU297XT79IP type=write size=3499544 2024-09-12T17:30:32.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.241+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=B20WK8NGSKYN type=del 2024-09-12T17:30:32.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.243+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~MHNWVMF4E49Z.0 size=1048576 2024-09-12T17:30:32.246 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.244+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~MHNWVMF4E49Z.1 size=735202 2024-09-12T17:30:32.246 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.244+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=MHNWVMF4E49Z tag=GYLBVH3Q8H3F type=write size=2832354 2024-09-12T17:30:32.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.246+0000 7fece65ff780 1 < completed write operation key=Y1OT1OLGWB1Q tag=LHZXDTCSPBRO type=write size=352425 2024-09-12T17:30:32.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.247+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=UO7AMSNF05WH type=del size=3420830 2024-09-12T17:30:32.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.249+0000 7fece65ff780 -1 < failed to complete operation key=1G9VNO1V4IMW tag=N2YVO3OLZOP8 type=del size=2361837: (22) Invalid argument 2024-09-12T17:30:32.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.251+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~29E9H1BEYT7E.0 size=1048576 2024-09-12T17:30:32.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.252+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~29E9H1BEYT7E.1 size=1048576 2024-09-12T17:30:32.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.253+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~29E9H1BEYT7E.2 size=636552 2024-09-12T17:30:32.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.253+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=29E9H1BEYT7E tag=JRUJESOZ26X6 type=write size=3782280 2024-09-12T17:30:32.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.254+0000 7fece65ff780 1 < completed delete operation key=7AS5L998SDV7 tag=GM64DAVS0P5O type=del 2024-09-12T17:30:32.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.256+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=DE91STR9TNDU type=del size=1859785 2024-09-12T17:30:32.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.257+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~IN9KROT9RJFJ.0 size=369480 2024-09-12T17:30:32.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.260+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=IN9KROT9RJFJ tag=VGGFPCA8OOKT type=write size=1418056 2024-09-12T17:30:32.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.261+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=WER87S2ZWE5B type=write size=1044179 2024-09-12T17:30:32.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.262+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~3P72C8ULD9MU.0 size=313160 2024-09-12T17:30:32.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.264+0000 7fece65ff780 1 < completed multipart upload key=W3MBKNIBLV7W upload=3P72C8ULD9MU tag=8XFPCF5LLY79 type=write size=1361736 2024-09-12T17:30:32.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.265+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=WZN1WR5RHNLQ type=del size=564761 2024-09-12T17:30:32.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.267+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~J8US01MGMJJY.0 size=1048576 2024-09-12T17:30:32.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.268+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~J8US01MGMJJY.1 size=1048576 2024-09-12T17:30:32.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.269+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~J8US01MGMJJY.2 size=654005 2024-09-12T17:30:32.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.271+0000 7fece65ff780 1 < completed multipart upload key=FX8VJO1YXJ4H upload=J8US01MGMJJY tag=4IEID4CQ3QXA type=write size=3799733 2024-09-12T17:30:32.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.272+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=7CJ945RW70GP type=write size=619064 2024-09-12T17:30:32.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.273+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=3Z5W9RLZGJLM type=del 2024-09-12T17:30:32.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.275+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=E4NE0I1L6UBK type=del size=1013398 2024-09-12T17:30:32.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.276+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~A8FI1ZA8LN4I.0 size=1048576 2024-09-12T17:30:32.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.277+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~A8FI1ZA8LN4I.1 size=13285 2024-09-12T17:30:32.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.279+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=A8FI1ZA8LN4I tag=0I0UU79RUIU8 type=write size=2110437 2024-09-12T17:30:32.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.280+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=9DVLU0BRAWYV type=del size=2681752 2024-09-12T17:30:32.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.281+0000 7fece65ff780 1 < canceled operation key=IMCE9Z7P4S6R tag=RTWJ19N7ZGL4 type=del size=1795946 2024-09-12T17:30:32.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.283+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~DV22SVPVRURN.0 size=1048576 2024-09-12T17:30:32.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.284+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~DV22SVPVRURN.1 size=1032376 2024-09-12T17:30:32.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.284+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=DV22SVPVRURN tag=NSXX9VGV0J5P type=write size=3129528 2024-09-12T17:30:32.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.285+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~ABPV6F69RRW8.0 size=1048576 2024-09-12T17:30:32.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.286+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~ABPV6F69RRW8.1 size=1048576 2024-09-12T17:30:32.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.286+0000 7fece65ff780 1 < canceled part key=_multipart_2HTNXL56URAK.2~ABPV6F69RRW8.2 size=267251 2024-09-12T17:30:32.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.288+0000 7fece65ff780 1 < canceled multipart upload key=2HTNXL56URAK upload=ABPV6F69RRW8 tag=FY3UH1GTNNDG type=write size=3412979 2024-09-12T17:30:32.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.289+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=IBY2SPK5AAP2 type=del size=2116414 2024-09-12T17:30:32.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.291+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~W0LWCVIH7UA3.0 size=1048576 2024-09-12T17:30:32.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.292+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~W0LWCVIH7UA3.1 size=1048576 2024-09-12T17:30:32.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.293+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~W0LWCVIH7UA3.2 size=137605 2024-09-12T17:30:32.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.295+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=W0LWCVIH7UA3 tag=I3PY0RVKVNCR type=write size=3283333 2024-09-12T17:30:32.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.297+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~EH0360JN8GSL.0 size=1048576 2024-09-12T17:30:32.300 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.298+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~EH0360JN8GSL.1 size=842292 2024-09-12T17:30:32.300 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.298+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=EH0360JN8GSL tag=DOI4RZ4IBP0H type=write size=2939444 2024-09-12T17:30:32.301 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.299+0000 7fece65ff780 1 < completed write operation key=OPMR1WMB14CA tag=U1LPAB9Z9QH0 type=write size=49403 2024-09-12T17:30:32.303 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.302+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~59HQKNCMVJ6E.0 size=1048576 2024-09-12T17:30:32.304 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.303+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~59HQKNCMVJ6E.1 size=1048576 2024-09-12T17:30:32.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.304+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~59HQKNCMVJ6E.2 size=289306 2024-09-12T17:30:32.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.304+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=59HQKNCMVJ6E tag=W7478WQSZQM2 type=write size=3435034 2024-09-12T17:30:32.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.305+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=VCOJBO5QG490 type=del 2024-09-12T17:30:32.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.306+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=TYB3JGTGNTDW type=del size=956665 2024-09-12T17:30:32.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.307+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~2WGE3RCHD6W4.0 size=1048576 2024-09-12T17:30:32.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.308+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~2WGE3RCHD6W4.1 size=1048576 2024-09-12T17:30:32.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.309+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~2WGE3RCHD6W4.2 size=64748 2024-09-12T17:30:32.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.312+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=2WGE3RCHD6W4 tag=TE8WW20OI1JP type=write size=3210476 2024-09-12T17:30:32.316 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.314+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~05OAIL3X96OG.0 size=1048576 2024-09-12T17:30:32.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.315+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~05OAIL3X96OG.1 size=54584 2024-09-12T17:30:32.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.315+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=05OAIL3X96OG tag=QOPISL9S4LKP type=write size=2151736 2024-09-12T17:30:32.318 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.316+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~P1UHGYV3T9YJ.0 size=1048576 2024-09-12T17:30:32.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.317+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~P1UHGYV3T9YJ.1 size=1048576 2024-09-12T17:30:32.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.319+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~P1UHGYV3T9YJ.2 size=353816 2024-09-12T17:30:32.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.321+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=P1UHGYV3T9YJ tag=EQU297XT79IP type=write size=3499544 2024-09-12T17:30:32.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.323+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=GC9ACWGIT8OD type=del size=1157650 2024-09-12T17:30:32.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.324+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~MHNWVMF4E49Z.0 size=1048576 2024-09-12T17:30:32.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.325+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~MHNWVMF4E49Z.1 size=735202 2024-09-12T17:30:32.328 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.327+0000 7fece65ff780 1 < completed multipart upload key=5A7WPGW5P91B upload=MHNWVMF4E49Z tag=GYLBVH3Q8H3F type=write size=2832354 2024-09-12T17:30:32.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.328+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=8WKRZNHD95Y9 type=del size=3058472 2024-09-12T17:30:32.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.329+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=UO7AMSNF05WH type=del 2024-09-12T17:30:32.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.331+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~KZ0AWPSQJKRS.0 size=1048576 2024-09-12T17:30:32.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.332+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~KZ0AWPSQJKRS.1 size=1048576 2024-09-12T17:30:32.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.333+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~KZ0AWPSQJKRS.2 size=159794 2024-09-12T17:30:32.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.333+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=KZ0AWPSQJKRS tag=QBXZWOD2DFOB type=write size=3305522 2024-09-12T17:30:32.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.334+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~29E9H1BEYT7E.0 size=1048576 2024-09-12T17:30:32.337 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.335+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~29E9H1BEYT7E.1 size=1048576 2024-09-12T17:30:32.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.336+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~29E9H1BEYT7E.2 size=636552 2024-09-12T17:30:32.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.339+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=29E9H1BEYT7E tag=JRUJESOZ26X6 type=write size=3782280 2024-09-12T17:30:32.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.341+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~ENRUNKE2XUZD.0 size=1048576 2024-09-12T17:30:32.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.342+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~ENRUNKE2XUZD.1 size=650165 2024-09-12T17:30:32.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.342+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=ENRUNKE2XUZD tag=3ML7HR4RRMDX type=write size=2747317 2024-09-12T17:30:32.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.344+0000 7fece65ff780 1 < suggested remove operation key=YCNQL8CUUGW7 tag=DE91STR9TNDU type=del 2024-09-12T17:30:32.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.346+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=LF5GIRED1I3L type=del size=3149519 2024-09-12T17:30:32.350 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.348+0000 7fece65ff780 1 < completed write operation key=Q00ZFG0BBDG5 tag=WER87S2ZWE5B type=write size=1044179 2024-09-12T17:30:32.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.349+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=O0YWTWX5WXJY type=del size=3067490 2024-09-12T17:30:32.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.351+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=WZN1WR5RHNLQ type=del 2024-09-12T17:30:32.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.353+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~R97BB7L4HOUD.0 size=1048576 2024-09-12T17:30:32.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.354+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~R97BB7L4HOUD.1 size=524961 2024-09-12T17:30:32.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.354+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=R97BB7L4HOUD tag=3WVKY5BRFP01 type=write size=2622113 2024-09-12T17:30:32.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.355+0000 7fece65ff780 1 < completed write operation key=5LAOX5H1AQWJ tag=7CJ945RW70GP type=write size=619064 2024-09-12T17:30:32.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.357+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~5G36NN1RDAD7.0 size=1048576 2024-09-12T17:30:32.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.358+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~5G36NN1RDAD7.1 size=219866 2024-09-12T17:30:32.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.358+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=5G36NN1RDAD7 tag=Q83LREIMCXVP type=write size=2317018 2024-09-12T17:30:32.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.359+0000 7fece65ff780 -1 < failed to complete operation key=YCNQL8CUUGW7 tag=E4NE0I1L6UBK type=del size=1013398: (22) Invalid argument 2024-09-12T17:30:32.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.361+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=DEDYXX47I8YA type=del size=3928386 2024-09-12T17:30:32.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.362+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=9DVLU0BRAWYV type=del 2024-09-12T17:30:32.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.363+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=U5CYBUHDLNSB type=del size=3723638 2024-09-12T17:30:32.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.364+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~DV22SVPVRURN.0 size=1048576 2024-09-12T17:30:32.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.365+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~DV22SVPVRURN.1 size=1032376 2024-09-12T17:30:32.369 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.367+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=DV22SVPVRURN tag=NSXX9VGV0J5P type=write size=3129528 2024-09-12T17:30:32.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.370+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~AJCDDT7HWRYK.0 size=1048576 2024-09-12T17:30:32.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.371+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~AJCDDT7HWRYK.1 size=898024 2024-09-12T17:30:32.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.371+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=AJCDDT7HWRYK tag=ZGW5W84ONK6I type=write size=2995176 2024-09-12T17:30:32.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.372+0000 7fece65ff780 1 < completed delete operation key=IMCE9Z7P4S6R tag=IBY2SPK5AAP2 type=del 2024-09-12T17:30:32.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.374+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~6P2O1ZZJ7T0X.0 size=1048576 2024-09-12T17:30:32.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.375+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~6P2O1ZZJ7T0X.1 size=531270 2024-09-12T17:30:32.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.375+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=6P2O1ZZJ7T0X tag=Z3548FR5R1A4 type=write size=2628422 2024-09-12T17:30:32.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.376+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~EH0360JN8GSL.0 size=1048576 2024-09-12T17:30:32.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.377+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~EH0360JN8GSL.1 size=842292 2024-09-12T17:30:32.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.379+0000 7fece65ff780 1 < completed multipart upload key=W3MBKNIBLV7W upload=EH0360JN8GSL tag=DOI4RZ4IBP0H type=write size=2939444 2024-09-12T17:30:32.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.381+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=9Y5O23GSH7ZH type=del size=4167088 2024-09-12T17:30:32.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.382+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~59HQKNCMVJ6E.0 size=1048576 2024-09-12T17:30:32.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.383+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~59HQKNCMVJ6E.1 size=1048576 2024-09-12T17:30:32.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.384+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~59HQKNCMVJ6E.2 size=289306 2024-09-12T17:30:32.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.386+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=59HQKNCMVJ6E tag=W7478WQSZQM2 type=write size=3435034 2024-09-12T17:30:32.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.387+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=NNUZZZ7VZORS type=write size=745846 2024-09-12T17:30:32.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.388+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=TYB3JGTGNTDW type=del 2024-09-12T17:30:32.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.390+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=QSIH3YRWA7BN type=del size=76759 2024-09-12T17:30:32.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.391+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~05OAIL3X96OG.0 size=1048576 2024-09-12T17:30:32.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.392+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~05OAIL3X96OG.1 size=54584 2024-09-12T17:30:32.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.394+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=05OAIL3X96OG tag=QOPISL9S4LKP type=write size=2151736 2024-09-12T17:30:32.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.396+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~ZAS9IU3GBSAQ.0 size=1048576 2024-09-12T17:30:32.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.397+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~ZAS9IU3GBSAQ.1 size=1048576 2024-09-12T17:30:32.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.398+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~ZAS9IU3GBSAQ.2 size=240943 2024-09-12T17:30:32.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.398+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=ZAS9IU3GBSAQ tag=WDTDRCMI6F27 type=write size=3386671 2024-09-12T17:30:32.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.400+0000 7fece65ff780 1 < suggested remove operation key=6GUDX5I1AKNH tag=GC9ACWGIT8OD type=del 2024-09-12T17:30:32.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.402+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~1J1F2Q4YF7X6.0 size=1018229 2024-09-12T17:30:32.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.402+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=1J1F2Q4YF7X6 tag=Z43FTSNY3O96 type=write size=2066805 2024-09-12T17:30:32.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.404+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=8WKRZNHD95Y9 type=del 2024-09-12T17:30:32.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.405+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=E23NWRWI54OJ type=write size=866699 2024-09-12T17:30:32.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.406+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~KZ0AWPSQJKRS.0 size=1048576 2024-09-12T17:30:32.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.407+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~KZ0AWPSQJKRS.1 size=1048576 2024-09-12T17:30:32.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.409+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~KZ0AWPSQJKRS.2 size=159794 2024-09-12T17:30:32.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.411+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=KZ0AWPSQJKRS tag=QBXZWOD2DFOB type=write size=3305522 2024-09-12T17:30:32.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.412+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=0L0H8WE3H4YS type=del size=1455750 2024-09-12T17:30:32.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.414+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~ENRUNKE2XUZD.0 size=1048576 2024-09-12T17:30:32.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.415+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~ENRUNKE2XUZD.1 size=650165 2024-09-12T17:30:32.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.417+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=ENRUNKE2XUZD tag=3ML7HR4RRMDX type=write size=2747317 2024-09-12T17:30:32.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.419+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~U9X9YQFTUQPU.0 size=1048576 2024-09-12T17:30:32.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.420+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~U9X9YQFTUQPU.1 size=1048576 2024-09-12T17:30:32.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.421+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~U9X9YQFTUQPU.2 size=139742 2024-09-12T17:30:32.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.421+0000 7fece65ff780 1 > prepared multipart upload key=Y30269Q7R340 upload=U9X9YQFTUQPU tag=PXYE7SLENB77 type=write size=3285470 2024-09-12T17:30:32.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.423+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=LF5GIRED1I3L type=del 2024-09-12T17:30:32.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.425+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~WB0HV1PHJN01.0 size=939252 2024-09-12T17:30:32.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.425+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=WB0HV1PHJN01 tag=WOZOCUD2VRS7 type=write size=1987828 2024-09-12T17:30:32.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.427+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=O0YWTWX5WXJY type=del 2024-09-12T17:30:32.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.429+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~V8Y5AMSZVRGT.0 size=1048576 2024-09-12T17:30:32.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.430+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~V8Y5AMSZVRGT.1 size=1048576 2024-09-12T17:30:32.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.431+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~V8Y5AMSZVRGT.2 size=541347 2024-09-12T17:30:32.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.431+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=V8Y5AMSZVRGT tag=05LG2YNEED0Z type=write size=3687075 2024-09-12T17:30:32.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.433+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~R97BB7L4HOUD.0 size=1048576 2024-09-12T17:30:32.436 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.435+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~R97BB7L4HOUD.1 size=524961 2024-09-12T17:30:32.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.437+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=R97BB7L4HOUD tag=3WVKY5BRFP01 type=write size=2622113 2024-09-12T17:30:32.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.438+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=KH9CFJ6H1U9J type=del size=29613 2024-09-12T17:30:32.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.440+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~5G36NN1RDAD7.0 size=1048576 2024-09-12T17:30:32.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.440+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~5G36NN1RDAD7.1 size=219866 2024-09-12T17:30:32.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.443+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=5G36NN1RDAD7 tag=Q83LREIMCXVP type=write size=2317018 2024-09-12T17:30:32.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.444+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=7B7BXTBMVO3E type=del size=506133 2024-09-12T17:30:32.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.446+0000 7fece65ff780 1 < suggested update operation key=W3MBKNIBLV7W tag=DEDYXX47I8YA type=del size=3928386 2024-09-12T17:30:32.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.448+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~Y0PZZ6UF0DTT.0 size=1048576 2024-09-12T17:30:32.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.449+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~Y0PZZ6UF0DTT.1 size=89313 2024-09-12T17:30:32.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.449+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=Y0PZZ6UF0DTT tag=G77VSQU5W4EM type=write size=2186465 2024-09-12T17:30:32.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.451+0000 7fece65ff780 1 < suggested remove operation key=ZEFSNR1IIA10 tag=U5CYBUHDLNSB type=del 2024-09-12T17:30:32.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.454+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~EDR22QAI21AW.0 size=1048576 2024-09-12T17:30:32.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.455+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~EDR22QAI21AW.1 size=342786 2024-09-12T17:30:32.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.455+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=EDR22QAI21AW tag=LEML7A898OZ0 type=write size=2439938 2024-09-12T17:30:32.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.456+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~AJCDDT7HWRYK.0 size=1048576 2024-09-12T17:30:32.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.457+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~AJCDDT7HWRYK.1 size=898024 2024-09-12T17:30:32.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.461+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=AJCDDT7HWRYK tag=ZGW5W84ONK6I type=write size=2995176 2024-09-12T17:30:32.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.462+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=SS0SUHGLNV49 type=del size=3807601 2024-09-12T17:30:32.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.463+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~6P2O1ZZJ7T0X.0 size=1048576 2024-09-12T17:30:32.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.464+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~6P2O1ZZJ7T0X.1 size=531270 2024-09-12T17:30:32.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.466+0000 7fece65ff780 1 < completed multipart upload key=9KYNMM6W7RRM upload=6P2O1ZZJ7T0X tag=Z3548FR5R1A4 type=write size=2628422 2024-09-12T17:30:32.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.469+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~T2A38UO3HWQ3.0 size=1048576 2024-09-12T17:30:32.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.470+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~T2A38UO3HWQ3.1 size=1048576 2024-09-12T17:30:32.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.470+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~T2A38UO3HWQ3.2 size=602588 2024-09-12T17:30:32.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.470+0000 7fece65ff780 1 > prepared multipart upload key=LSGN631FW1P8 upload=T2A38UO3HWQ3 tag=VDLEFH62GIBS type=write size=3748316 2024-09-12T17:30:32.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.472+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=9Y5O23GSH7ZH type=del 2024-09-12T17:30:32.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.474+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~72O92QUC3I9Q.0 size=62075 2024-09-12T17:30:32.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.474+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=72O92QUC3I9Q tag=OPYP8QPYFSAQ type=write size=1110651 2024-09-12T17:30:32.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.475+0000 7fece65ff780 1 < completed write operation key=7AS5L998SDV7 tag=NNUZZZ7VZORS type=write size=745846 2024-09-12T17:30:32.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.477+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=EMB2FO638O9D type=del size=2780503 2024-09-12T17:30:32.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.478+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=QSIH3YRWA7BN type=del 2024-09-12T17:30:32.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.480+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~J887R6KMAPJM.0 size=127138 2024-09-12T17:30:32.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.480+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=J887R6KMAPJM tag=M9FG2BYKACH0 type=write size=1175714 2024-09-12T17:30:32.483 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.481+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~ZAS9IU3GBSAQ.0 size=1048576 2024-09-12T17:30:32.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.482+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~ZAS9IU3GBSAQ.1 size=1048576 2024-09-12T17:30:32.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.483+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~ZAS9IU3GBSAQ.2 size=240943 2024-09-12T17:30:32.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.485+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=ZAS9IU3GBSAQ tag=WDTDRCMI6F27 type=write size=3386671 2024-09-12T17:30:32.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.486+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=5GEAL1BE2O5A type=del size=2960931 2024-09-12T17:30:32.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.488+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~1J1F2Q4YF7X6.0 size=1018229 2024-09-12T17:30:32.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.490+0000 7fece65ff780 1 < completed multipart upload key=Q00ZFG0BBDG5 upload=1J1F2Q4YF7X6 tag=Z43FTSNY3O96 type=write size=2066805 2024-09-12T17:30:32.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.493+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~VZYH1WBC32FU.0 size=1048576 2024-09-12T17:30:32.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.494+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~VZYH1WBC32FU.1 size=1048576 2024-09-12T17:30:32.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.495+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~VZYH1WBC32FU.2 size=86970 2024-09-12T17:30:32.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.495+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=VZYH1WBC32FU tag=LMZVF03LWE5X type=write size=3232698 2024-09-12T17:30:32.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.496+0000 7fece65ff780 1 < completed write operation key=Y1OT1OLGWB1Q tag=E23NWRWI54OJ type=write size=866699 2024-09-12T17:30:32.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.497+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=PW53I2CKCDRP type=del size=2841842 2024-09-12T17:30:32.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.499+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=0L0H8WE3H4YS type=del 2024-09-12T17:30:32.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.500+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=OWECD78QA8Z2 type=del size=2027414 2024-09-12T17:30:32.503 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.501+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~U9X9YQFTUQPU.0 size=1048576 2024-09-12T17:30:32.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.502+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~U9X9YQFTUQPU.1 size=1048576 2024-09-12T17:30:32.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.503+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~U9X9YQFTUQPU.2 size=139742 2024-09-12T17:30:32.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.505+0000 7fece65ff780 1 < completed multipart upload key=Y30269Q7R340 upload=U9X9YQFTUQPU tag=PXYE7SLENB77 type=write size=3285470 2024-09-12T17:30:32.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.507+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=21S5U80B5XBA type=write size=608184 2024-09-12T17:30:32.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.508+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~WB0HV1PHJN01.0 size=939252 2024-09-12T17:30:32.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.510+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=WB0HV1PHJN01 tag=WOZOCUD2VRS7 type=write size=1987828 2024-09-12T17:30:32.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.512+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~223A1W4PG2BV.0 size=1048576 2024-09-12T17:30:32.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.513+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~223A1W4PG2BV.1 size=677252 2024-09-12T17:30:32.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.513+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=223A1W4PG2BV tag=4I3FDMK5F02V type=write size=2774404 2024-09-12T17:30:32.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.514+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~V8Y5AMSZVRGT.0 size=1048576 2024-09-12T17:30:32.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.515+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~V8Y5AMSZVRGT.1 size=1048576 2024-09-12T17:30:32.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.516+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~V8Y5AMSZVRGT.2 size=541347 2024-09-12T17:30:32.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.518+0000 7fece65ff780 1 < completed multipart upload key=4Z1N3433MC6A upload=V8Y5AMSZVRGT tag=05LG2YNEED0Z type=write size=3687075 2024-09-12T17:30:32.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.521+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~4KIAOYMNCITP.0 size=1048576 2024-09-12T17:30:32.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.522+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~4KIAOYMNCITP.1 size=109596 2024-09-12T17:30:32.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.522+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=4KIAOYMNCITP tag=F8YA1ZZUOYQ7 type=write size=2206748 2024-09-12T17:30:32.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.523+0000 7fece65ff780 1 < completed delete operation key=IMCE9Z7P4S6R tag=KH9CFJ6H1U9J type=del 2024-09-12T17:30:32.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.524+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=5UI24R2P2AM4 type=del size=412689 2024-09-12T17:30:32.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.525+0000 7fece65ff780 1 < completed delete operation key=5A7WPGW5P91B tag=7B7BXTBMVO3E type=del 2024-09-12T17:30:32.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.527+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=EJJQ1EW2E561 type=del size=1515655 2024-09-12T17:30:32.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.528+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~Y0PZZ6UF0DTT.0 size=1048576 2024-09-12T17:30:32.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.529+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~Y0PZZ6UF0DTT.1 size=89313 2024-09-12T17:30:32.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.531+0000 7fece65ff780 1 < completed multipart upload key=W3MBKNIBLV7W upload=Y0PZZ6UF0DTT tag=G77VSQU5W4EM type=write size=2186465 2024-09-12T17:30:32.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.533+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~XOH7X7CX918P.0 size=1048576 2024-09-12T17:30:32.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.534+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~XOH7X7CX918P.1 size=72951 2024-09-12T17:30:32.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.534+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=XOH7X7CX918P tag=OVTUKF4VFUAT type=write size=2170103 2024-09-12T17:30:32.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.535+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~EDR22QAI21AW.0 size=1048576 2024-09-12T17:30:32.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.536+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~EDR22QAI21AW.1 size=342786 2024-09-12T17:30:32.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.538+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=EDR22QAI21AW tag=LEML7A898OZ0 type=write size=2439938 2024-09-12T17:30:32.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.540+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=4SDH9AARRAGE type=del size=2163493 2024-09-12T17:30:32.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.541+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=SS0SUHGLNV49 type=del 2024-09-12T17:30:32.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.543+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~Q5ZZC6AQGYTS.0 size=1048576 2024-09-12T17:30:32.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.544+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~Q5ZZC6AQGYTS.1 size=1048576 2024-09-12T17:30:32.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.545+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~Q5ZZC6AQGYTS.2 size=513053 2024-09-12T17:30:32.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.545+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=Q5ZZC6AQGYTS tag=1IPA1MT6TXUN type=write size=3658781 2024-09-12T17:30:32.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.546+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~T2A38UO3HWQ3.0 size=1048576 2024-09-12T17:30:32.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.547+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~T2A38UO3HWQ3.1 size=1048576 2024-09-12T17:30:32.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.549+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~T2A38UO3HWQ3.2 size=602588 2024-09-12T17:30:32.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.553+0000 7fece65ff780 1 < completed multipart upload key=LSGN631FW1P8 upload=T2A38UO3HWQ3 tag=VDLEFH62GIBS type=write size=3748316 2024-09-12T17:30:32.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.554+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=9PGMVFSCJKQH type=del size=2548751 2024-09-12T17:30:32.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.555+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~72O92QUC3I9Q.0 size=62075 2024-09-12T17:30:32.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.557+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=72O92QUC3I9Q tag=OPYP8QPYFSAQ type=write size=1110651 2024-09-12T17:30:32.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.559+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=MS4XM6HCSDJ5 type=del size=3510926 2024-09-12T17:30:32.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.561+0000 7fece65ff780 1 < suggested update operation key=W3MBKNIBLV7W tag=EMB2FO638O9D type=del size=2780503 2024-09-12T17:30:32.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.563+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~Q0MIOCOQGXGE.0 size=1048576 2024-09-12T17:30:32.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.564+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~Q0MIOCOQGXGE.1 size=1048576 2024-09-12T17:30:32.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.565+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~Q0MIOCOQGXGE.2 size=231769 2024-09-12T17:30:32.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.565+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=Q0MIOCOQGXGE tag=U4W53G2ZYBRL type=write size=3377497 2024-09-12T17:30:32.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.567+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~J887R6KMAPJM.0 size=127138 2024-09-12T17:30:32.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.569+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=J887R6KMAPJM tag=M9FG2BYKACH0 type=write size=1175714 2024-09-12T17:30:32.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.570+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=RKQVEC9XB9XW type=del size=3498776 2024-09-12T17:30:32.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.571+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=5GEAL1BE2O5A type=del 2024-09-12T17:30:32.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.575+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~TVYKQE62SJAJ.0 size=96040 2024-09-12T17:30:32.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.575+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=TVYKQE62SJAJ tag=NVGV8VVU36D0 type=write size=1144616 2024-09-12T17:30:32.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.576+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~VZYH1WBC32FU.0 size=1048576 2024-09-12T17:30:32.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.577+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~VZYH1WBC32FU.1 size=1048576 2024-09-12T17:30:32.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.578+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~VZYH1WBC32FU.2 size=86970 2024-09-12T17:30:32.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.580+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=VZYH1WBC32FU tag=LMZVF03LWE5X type=write size=3232698 2024-09-12T17:30:32.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.581+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=IR9HRXQ796HZ type=write size=497999 2024-09-12T17:30:32.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.583+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=PW53I2CKCDRP type=del 2024-09-12T17:30:32.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.584+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=RUAM6L40252I type=del size=688240 2024-09-12T17:30:32.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.585+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=OWECD78QA8Z2 type=del 2024-09-12T17:30:32.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.587+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~YWQ2DQVHOU2J.0 size=857891 2024-09-12T17:30:32.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.587+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=YWQ2DQVHOU2J tag=56WU85SUB43D type=write size=1906467 2024-09-12T17:30:32.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.588+0000 7fece65ff780 1 < completed write operation key=1G9VNO1V4IMW tag=21S5U80B5XBA type=write size=608184 2024-09-12T17:30:32.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.590+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=SNPR060GZVU0 type=del size=3194227 2024-09-12T17:30:32.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.591+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~223A1W4PG2BV.0 size=1048576 2024-09-12T17:30:32.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.592+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~223A1W4PG2BV.1 size=677252 2024-09-12T17:30:32.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.594+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=223A1W4PG2BV tag=4I3FDMK5F02V type=write size=2774404 2024-09-12T17:30:32.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.596+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~29SOC20ZHDPJ.0 size=1048576 2024-09-12T17:30:32.598 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.597+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~29SOC20ZHDPJ.1 size=703449 2024-09-12T17:30:32.599 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.597+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=29SOC20ZHDPJ tag=FGR92WAXVVW1 type=write size=2800601 2024-09-12T17:30:32.600 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.598+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~4KIAOYMNCITP.0 size=1048576 2024-09-12T17:30:32.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.599+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~4KIAOYMNCITP.1 size=109596 2024-09-12T17:30:32.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.601+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=4KIAOYMNCITP tag=F8YA1ZZUOYQ7 type=write size=2206748 2024-09-12T17:30:32.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.602+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=7XVKX2MIIJD7 type=del size=2177451 2024-09-12T17:30:32.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.605+0000 7fece65ff780 1 < suggested remove operation key=5LAOX5H1AQWJ tag=5UI24R2P2AM4 type=del 2024-09-12T17:30:32.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.606+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=RV6F3XXDRXSC type=write size=714099 2024-09-12T17:30:32.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.607+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=EJJQ1EW2E561 type=del 2024-09-12T17:30:32.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.608+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=C2XMEIUOSQTZ type=del size=3017352 2024-09-12T17:30:32.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.609+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~XOH7X7CX918P.0 size=1048576 2024-09-12T17:30:32.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.610+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~XOH7X7CX918P.1 size=72951 2024-09-12T17:30:32.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.612+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=XOH7X7CX918P tag=OVTUKF4VFUAT type=write size=2170103 2024-09-12T17:30:32.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.613+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=RCSVMMXN9HKS type=del size=3384400 2024-09-12T17:30:32.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.616+0000 7fece65ff780 1 < suggested update operation key=1G9VNO1V4IMW tag=4SDH9AARRAGE type=del size=2163493 2024-09-12T17:30:32.619 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.617+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=B09FYHAMTHVV type=del size=1611474 2024-09-12T17:30:32.620 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.619+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~Q5ZZC6AQGYTS.0 size=1048576 2024-09-12T17:30:32.621 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.620+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~Q5ZZC6AQGYTS.1 size=1048576 2024-09-12T17:30:32.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.621+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~Q5ZZC6AQGYTS.2 size=513053 2024-09-12T17:30:32.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.623+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=Q5ZZC6AQGYTS tag=1IPA1MT6TXUN type=write size=3658781 2024-09-12T17:30:32.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.626+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~PZU021WFDJC0.0 size=1048576 2024-09-12T17:30:32.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.627+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~PZU021WFDJC0.1 size=831515 2024-09-12T17:30:32.631 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.627+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=PZU021WFDJC0 tag=KQFBAVV7QS0Q type=write size=2928667 2024-09-12T17:30:32.631 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.629+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=9PGMVFSCJKQH type=del 2024-09-12T17:30:32.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.631+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~1UOLFTS3CA34.0 size=1048576 2024-09-12T17:30:32.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.632+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~1UOLFTS3CA34.1 size=1048576 2024-09-12T17:30:32.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.633+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~1UOLFTS3CA34.2 size=741155 2024-09-12T17:30:32.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.633+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=1UOLFTS3CA34 tag=KKURPKXZZYKK type=write size=3886883 2024-09-12T17:30:32.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.634+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=MS4XM6HCSDJ5 type=del 2024-09-12T17:30:32.637 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.636+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=6APFIXSF3Q5K type=del size=3572984 2024-09-12T17:30:32.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.637+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~Q0MIOCOQGXGE.0 size=1048576 2024-09-12T17:30:32.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.638+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~Q0MIOCOQGXGE.1 size=1048576 2024-09-12T17:30:32.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.638+0000 7fece65ff780 1 < canceled part key=_multipart_I31CKY20NO9S.2~Q0MIOCOQGXGE.2 size=231769 2024-09-12T17:30:32.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.640+0000 7fece65ff780 1 < canceled multipart upload key=I31CKY20NO9S upload=Q0MIOCOQGXGE tag=U4W53G2ZYBRL type=write size=3377497 2024-09-12T17:30:32.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.642+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~GVGQ5ZIFOM9R.0 size=762181 2024-09-12T17:30:32.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.642+0000 7fece65ff780 1 > prepared multipart upload key=LSGN631FW1P8 upload=GVGQ5ZIFOM9R tag=MLAY130OD4H7 type=write size=1810757 2024-09-12T17:30:32.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.644+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=RKQVEC9XB9XW type=del 2024-09-12T17:30:32.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.645+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=BWNAFM115C93 type=del size=1310538 2024-09-12T17:30:32.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.646+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~TVYKQE62SJAJ.0 size=96040 2024-09-12T17:30:32.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.648+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=TVYKQE62SJAJ tag=NVGV8VVU36D0 type=write size=1144616 2024-09-12T17:30:32.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.650+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~VHXPRC2NIK5C.0 size=1048576 2024-09-12T17:30:32.653 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.651+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~VHXPRC2NIK5C.1 size=1048576 2024-09-12T17:30:32.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.652+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~VHXPRC2NIK5C.2 size=782033 2024-09-12T17:30:32.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.652+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=VHXPRC2NIK5C tag=OG2FJ2AO99LN type=write size=3927761 2024-09-12T17:30:32.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.655+0000 7fece65ff780 1 < suggested update operation key=1G9VNO1V4IMW tag=IR9HRXQ796HZ type=write size=497999 2024-09-12T17:30:32.658 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.656+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=KLL1VNWBHVWP type=write size=839582 2024-09-12T17:30:32.659 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.657+0000 7fece65ff780 -1 < failed to complete operation key=5LAOX5H1AQWJ tag=RUAM6L40252I type=del size=688240: (22) Invalid argument 2024-09-12T17:30:32.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.659+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=OI3UBEPL80A8 type=del size=1152477 2024-09-12T17:30:32.661 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.659+0000 7fece65ff780 1 < canceled part key=_multipart_TLEZIJ4881G7.2~YWQ2DQVHOU2J.0 size=857891 2024-09-12T17:30:32.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.661+0000 7fece65ff780 1 < canceled multipart upload key=TLEZIJ4881G7 upload=YWQ2DQVHOU2J tag=56WU85SUB43D type=write size=1906467 2024-09-12T17:30:32.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.662+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=Z70O9P3JL5P4 type=del size=2305541 2024-09-12T17:30:32.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.664+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=SNPR060GZVU0 type=del 2024-09-12T17:30:32.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.665+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=N8II80JNYI7U type=write size=512952 2024-09-12T17:30:32.668 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.666+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~29SOC20ZHDPJ.0 size=1048576 2024-09-12T17:30:32.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.668+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~29SOC20ZHDPJ.1 size=703449 2024-09-12T17:30:32.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.672+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=29SOC20ZHDPJ tag=FGR92WAXVVW1 type=write size=2800601 2024-09-12T17:30:32.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.675+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~P1K0G51KUPBE.0 size=1048576 2024-09-12T17:30:32.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.676+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~P1K0G51KUPBE.1 size=123923 2024-09-12T17:30:32.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.676+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=P1K0G51KUPBE tag=0KXNJOGQVFYT type=write size=2221075 2024-09-12T17:30:32.678 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.677+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=7XVKX2MIIJD7 type=del 2024-09-12T17:30:32.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.678+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=6D3K0QE8F7KS type=del size=1230959 2024-09-12T17:30:32.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.679+0000 7fece65ff780 1 < completed write operation key=YCNQL8CUUGW7 tag=RV6F3XXDRXSC type=write size=714099 2024-09-12T17:30:32.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.680+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=YGB9AW2XQY9K type=del size=1885841 2024-09-12T17:30:32.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.681+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=C2XMEIUOSQTZ type=del 2024-09-12T17:30:32.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.683+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=6JED0I68M90Q type=del size=740180 2024-09-12T17:30:32.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.685+0000 7fece65ff780 1 < suggested update operation key=807GX4RQQLL4 tag=RCSVMMXN9HKS type=del size=3384400 2024-09-12T17:30:32.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.687+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~IXTVJBM7LSOR.0 size=395383 2024-09-12T17:30:32.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.687+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=IXTVJBM7LSOR tag=UDGWTHCJYXSF type=write size=1443959 2024-09-12T17:30:32.690 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.688+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=B09FYHAMTHVV type=del 2024-09-12T17:30:32.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.690+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~PHRJUBYBJJRW.0 size=1048576 2024-09-12T17:30:32.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.691+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~PHRJUBYBJJRW.1 size=1048576 2024-09-12T17:30:32.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.692+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~PHRJUBYBJJRW.2 size=444011 2024-09-12T17:30:32.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.692+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=PHRJUBYBJJRW tag=1YGB3YNET0N1 type=write size=3589739 2024-09-12T17:30:32.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.694+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~PZU021WFDJC0.0 size=1048576 2024-09-12T17:30:32.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.695+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~PZU021WFDJC0.1 size=831515 2024-09-12T17:30:32.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.697+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=PZU021WFDJC0 tag=KQFBAVV7QS0Q type=write size=2928667 2024-09-12T17:30:32.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.698+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=SNUTUFDX5IDO type=del size=380744 2024-09-12T17:30:32.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.699+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~1UOLFTS3CA34.0 size=1048576 2024-09-12T17:30:32.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.700+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~1UOLFTS3CA34.1 size=1048576 2024-09-12T17:30:32.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.701+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~1UOLFTS3CA34.2 size=741155 2024-09-12T17:30:32.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.703+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=1UOLFTS3CA34 tag=KKURPKXZZYKK type=write size=3886883 2024-09-12T17:30:32.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.704+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=6HO5BPVT2HEU type=del size=3712677 2024-09-12T17:30:32.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.705+0000 7fece65ff780 1 < canceled operation key=OPMR1WMB14CA tag=6APFIXSF3Q5K type=del size=3572984 2024-09-12T17:30:32.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.707+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~3BMILGMSYA4B.0 size=1048576 2024-09-12T17:30:32.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.708+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~3BMILGMSYA4B.1 size=225264 2024-09-12T17:30:32.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.708+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=3BMILGMSYA4B tag=MHZ55S433DH7 type=write size=2322416 2024-09-12T17:30:32.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.710+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~GVGQ5ZIFOM9R.0 size=762181 2024-09-12T17:30:32.713 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.711+0000 7fece65ff780 1 < completed multipart upload key=LSGN631FW1P8 upload=GVGQ5ZIFOM9R tag=MLAY130OD4H7 type=write size=1810757 2024-09-12T17:30:32.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.712+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=7RX4F8JM7DOO type=del size=1865620 2024-09-12T17:30:32.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.715+0000 7fece65ff780 1 < suggested update operation key=UCBB99EG8XK2 tag=BWNAFM115C93 type=del size=1310538 2024-09-12T17:30:32.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.716+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=VIH28RWMGQA2 type=del size=103218 2024-09-12T17:30:32.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.717+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~VHXPRC2NIK5C.0 size=1048576 2024-09-12T17:30:32.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.718+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~VHXPRC2NIK5C.1 size=1048576 2024-09-12T17:30:32.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.719+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~VHXPRC2NIK5C.2 size=782033 2024-09-12T17:30:32.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.721+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=VHXPRC2NIK5C tag=OG2FJ2AO99LN type=write size=3927761 2024-09-12T17:30:32.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.722+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=72FEZE3YLMU7 type=write size=754115 2024-09-12T17:30:32.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.723+0000 7fece65ff780 1 < completed write operation key=OPMR1WMB14CA tag=KLL1VNWBHVWP type=write size=839582 2024-09-12T17:30:32.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.724+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=DU1F22SW7RIV type=write size=469659 2024-09-12T17:30:32.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.727+0000 7fece65ff780 1 < suggested remove operation key=Q00ZFG0BBDG5 tag=OI3UBEPL80A8 type=del 2024-09-12T17:30:32.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.728+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=69F01F404V8Q type=del size=912056 2024-09-12T17:30:32.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.730+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=Z70O9P3JL5P4 type=del 2024-09-12T17:30:32.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.732+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~P3P59C8Q6SC2.0 size=738701 2024-09-12T17:30:32.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.732+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=P3P59C8Q6SC2 tag=3YLG6KNA4IFB type=write size=1787277 2024-09-12T17:30:32.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.733+0000 7fece65ff780 1 < completed write operation key=OIHDAJMPUK4I tag=N8II80JNYI7U type=write size=512952 2024-09-12T17:30:32.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.735+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=JNFY0XRAHLIK type=del size=3184044 2024-09-12T17:30:32.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.736+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~P1K0G51KUPBE.0 size=1048576 2024-09-12T17:30:32.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.737+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~P1K0G51KUPBE.1 size=123923 2024-09-12T17:30:32.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.739+0000 7fece65ff780 1 < completed multipart upload key=IMCE9Z7P4S6R upload=P1K0G51KUPBE tag=0KXNJOGQVFYT type=write size=2221075 2024-09-12T17:30:32.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.740+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=9S43VXY7JWVQ type=del size=3098709 2024-09-12T17:30:32.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.741+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=6D3K0QE8F7KS type=del 2024-09-12T17:30:32.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.742+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=2IH6Q24H0CKD type=write size=562423 2024-09-12T17:30:32.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.745+0000 7fece65ff780 1 < suggested remove operation key=9KYNMM6W7RRM tag=YGB9AW2XQY9K type=del 2024-09-12T17:30:32.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.746+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=0HNDM3KMNPCC type=del size=844860 2024-09-12T17:30:32.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.747+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=6JED0I68M90Q type=del 2024-09-12T17:30:32.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.749+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~LWKV5N72HCEE.0 size=1048576 2024-09-12T17:30:32.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.750+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~LWKV5N72HCEE.1 size=790682 2024-09-12T17:30:32.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.750+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=LWKV5N72HCEE tag=6HKA1K5A4TCC type=write size=2887834 2024-09-12T17:30:32.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.751+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~IXTVJBM7LSOR.0 size=395383 2024-09-12T17:30:32.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.753+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=IXTVJBM7LSOR tag=UDGWTHCJYXSF type=write size=1443959 2024-09-12T17:30:32.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.754+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=T88UQUI2CLLB type=del size=2915492 2024-09-12T17:30:32.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.755+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~PHRJUBYBJJRW.0 size=1048576 2024-09-12T17:30:32.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.756+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~PHRJUBYBJJRW.1 size=1048576 2024-09-12T17:30:32.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.757+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~PHRJUBYBJJRW.2 size=444011 2024-09-12T17:30:32.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.759+0000 7fece65ff780 1 < completed multipart upload key=IMCE9Z7P4S6R upload=PHRJUBYBJJRW tag=1YGB3YNET0N1 type=write size=3589739 2024-09-12T17:30:32.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.761+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~4QU86BOVZDFT.0 size=622735 2024-09-12T17:30:32.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.761+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=4QU86BOVZDFT tag=T4Y80MM6J9E7 type=write size=1671311 2024-09-12T17:30:32.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.762+0000 7fece65ff780 1 < canceled operation key=RKFRKIENSBTO tag=SNUTUFDX5IDO type=del size=380744 2024-09-12T17:30:32.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.765+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~WR93T29P7B62.0 size=1048576 2024-09-12T17:30:32.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.765+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~WR93T29P7B62.1 size=1048576 2024-09-12T17:30:32.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.766+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~WR93T29P7B62.2 size=446197 2024-09-12T17:30:32.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.766+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=WR93T29P7B62 tag=FVPVOUPZK8DH type=write size=3591925 2024-09-12T17:30:32.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.768+0000 7fece65ff780 1 < canceled operation key=W3MBKNIBLV7W tag=6HO5BPVT2HEU type=del size=3712677 2024-09-12T17:30:32.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.769+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=ISPNZ8T4EY8K type=write size=378217 2024-09-12T17:30:32.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.770+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~3BMILGMSYA4B.0 size=1048576 2024-09-12T17:30:32.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.771+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~3BMILGMSYA4B.1 size=225264 2024-09-12T17:30:32.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.773+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=3BMILGMSYA4B tag=MHZ55S433DH7 type=write size=2322416 2024-09-12T17:30:32.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.774+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=V8369JC0RW4B type=write size=606318 2024-09-12T17:30:32.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.775+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=7RX4F8JM7DOO type=del 2024-09-12T17:30:32.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.776+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=KGQ0QMPPL0F7 type=del size=3474982 2024-09-12T17:30:32.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.777+0000 7fece65ff780 -1 < failed to complete operation key=9KYNMM6W7RRM tag=VIH28RWMGQA2 type=del size=103218: (22) Invalid argument 2024-09-12T17:30:32.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.780+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~PC29OBJCYYZ7.0 size=792494 2024-09-12T17:30:32.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.780+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=PC29OBJCYYZ7 tag=34AA9R76NR19 type=write size=1841070 2024-09-12T17:30:32.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.781+0000 7fece65ff780 -1 < failed to complete operation key=Q00ZFG0BBDG5 tag=72FEZE3YLMU7 type=write size=754115: (22) Invalid argument 2024-09-12T17:30:32.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.783+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=ZYFYF15JEXP2 type=del size=372767 2024-09-12T17:30:32.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.785+0000 7fece65ff780 1 < completed write operation key=ZEFSNR1IIA10 tag=DU1F22SW7RIV type=write size=469659 2024-09-12T17:30:32.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.786+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=HGZHEJOGWXXF type=write size=122819 2024-09-12T17:30:32.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.788+0000 7fece65ff780 1 < suggested update operation key=Y1OT1OLGWB1Q tag=69F01F404V8Q type=del size=912056 2024-09-12T17:30:32.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.790+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=V2PYH0W6AB71 type=del size=3517532 2024-09-12T17:30:32.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.791+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~P3P59C8Q6SC2.0 size=738701 2024-09-12T17:30:32.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.793+0000 7fece65ff780 1 < completed multipart upload key=4Z1N3433MC6A upload=P3P59C8Q6SC2 tag=3YLG6KNA4IFB type=write size=1787277 2024-09-12T17:30:32.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.794+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=KRV6UNF1R6JN type=del size=484601 2024-09-12T17:30:32.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.795+0000 7fece65ff780 1 < canceled operation key=IMCE9Z7P4S6R tag=JNFY0XRAHLIK type=del size=3184044 2024-09-12T17:30:32.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.797+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=ZL9NNSHUYG0J type=write size=371121 2024-09-12T17:30:32.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.800+0000 7fece65ff780 1 < suggested remove operation key=1G9VNO1V4IMW tag=9S43VXY7JWVQ type=del 2024-09-12T17:30:32.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.801+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=JB2G96O8BV9I type=del size=3907813 2024-09-12T17:30:32.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.802+0000 7fece65ff780 -1 < failed to complete operation key=9KYNMM6W7RRM tag=2IH6Q24H0CKD type=write size=562423: (22) Invalid argument 2024-09-12T17:30:32.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.804+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~BZ9EQ9LEGTBW.0 size=1048576 2024-09-12T17:30:32.807 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.805+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~BZ9EQ9LEGTBW.1 size=1047526 2024-09-12T17:30:32.807 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.805+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=BZ9EQ9LEGTBW tag=YZE5UONYED0G type=write size=3144678 2024-09-12T17:30:32.808 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.807+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=0HNDM3KMNPCC type=del 2024-09-12T17:30:32.811 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.809+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~WF0IO2NQQPYB.0 size=1048576 2024-09-12T17:30:32.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.810+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~WF0IO2NQQPYB.1 size=574558 2024-09-12T17:30:32.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.810+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=WF0IO2NQQPYB tag=YRDSF0EZUC05 type=write size=2671710 2024-09-12T17:30:32.814 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.812+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~LWKV5N72HCEE.0 size=1048576 2024-09-12T17:30:32.814 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.812+0000 7fece65ff780 1 < canceled part key=_multipart_YCNQL8CUUGW7.2~LWKV5N72HCEE.1 size=790682 2024-09-12T17:30:32.816 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.814+0000 7fece65ff780 1 < canceled multipart upload key=YCNQL8CUUGW7 upload=LWKV5N72HCEE tag=6HKA1K5A4TCC type=write size=2887834 2024-09-12T17:30:32.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.815+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=HKJZXMHOLA1K type=del size=3545938 2024-09-12T17:30:32.819 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.818+0000 7fece65ff780 1 < suggested update operation key=4Z1N3433MC6A tag=T88UQUI2CLLB type=del size=2915492 2024-09-12T17:30:32.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.819+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=AWTSDXBVX5GF type=del size=126708 2024-09-12T17:30:32.822 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.821+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~4QU86BOVZDFT.0 size=622735 2024-09-12T17:30:32.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.823+0000 7fece65ff780 1 < completed multipart upload key=FX8VJO1YXJ4H upload=4QU86BOVZDFT tag=T4Y80MM6J9E7 type=write size=1671311 2024-09-12T17:30:32.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.824+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=KFDXICKR6NTM type=del size=2254623 2024-09-12T17:30:32.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.826+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~WR93T29P7B62.0 size=1048576 2024-09-12T17:30:32.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.827+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~WR93T29P7B62.1 size=1048576 2024-09-12T17:30:32.829 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.828+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~WR93T29P7B62.2 size=446197 2024-09-12T17:30:32.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.830+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=WR93T29P7B62 tag=FVPVOUPZK8DH type=write size=3591925 2024-09-12T17:30:32.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.831+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=YYJZ4EPVXEJQ type=del size=3972972 2024-09-12T17:30:32.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.832+0000 7fece65ff780 1 < canceled operation key=807GX4RQQLL4 tag=ISPNZ8T4EY8K type=write size=378217 2024-09-12T17:30:32.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.834+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=LS51QE866TEY type=del size=2562291 2024-09-12T17:30:32.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.835+0000 7fece65ff780 -1 < failed to complete operation key=Y1OT1OLGWB1Q tag=V8369JC0RW4B type=write size=606318: (22) Invalid argument 2024-09-12T17:30:32.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.837+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=JBDD2XWH8IXV type=write size=724407 2024-09-12T17:30:32.841 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.839+0000 7fece65ff780 1 < suggested update operation key=2HTNXL56URAK tag=KGQ0QMPPL0F7 type=del size=3474982 2024-09-12T17:30:32.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.841+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~KP52BJOJJWG6.0 size=1048576 2024-09-12T17:30:32.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.842+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~KP52BJOJJWG6.1 size=219272 2024-09-12T17:30:32.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.842+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=KP52BJOJJWG6 tag=MS67IV9ET10O type=write size=2316424 2024-09-12T17:30:32.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.843+0000 7fece65ff780 1 < canceled part key=_multipart_FX8VJO1YXJ4H.2~PC29OBJCYYZ7.0 size=792494 2024-09-12T17:30:32.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.845+0000 7fece65ff780 1 < canceled multipart upload key=FX8VJO1YXJ4H upload=PC29OBJCYYZ7 tag=34AA9R76NR19 type=write size=1841070 2024-09-12T17:30:32.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.846+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=0E3VP49DPK7A type=del size=173570 2024-09-12T17:30:32.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.849+0000 7fece65ff780 1 < suggested update operation key=2HTNXL56URAK tag=ZYFYF15JEXP2 type=del size=372767 2024-09-12T17:30:32.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.850+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=OHFNPL5FVRNI type=del size=998493 2024-09-12T17:30:32.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.852+0000 7fece65ff780 1 < suggested remove operation key=UN6FLMRMAPUS tag=HGZHEJOGWXXF type=write 2024-09-12T17:30:32.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.855+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~WUL9QL9NWVLC.0 size=1048576 2024-09-12T17:30:32.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.856+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~WUL9QL9NWVLC.1 size=325758 2024-09-12T17:30:32.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.856+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=WUL9QL9NWVLC tag=FSVDAD6EOBCJ type=write size=2422910 2024-09-12T17:30:32.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.857+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=V2PYH0W6AB71 type=del 2024-09-12T17:30:32.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.859+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~V1LWKWUX4GC0.0 size=1048576 2024-09-12T17:30:32.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.860+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~V1LWKWUX4GC0.1 size=1048576 2024-09-12T17:30:32.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.861+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~V1LWKWUX4GC0.2 size=1016389 2024-09-12T17:30:32.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.861+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=V1LWKWUX4GC0 tag=4X33IGW6RDQ5 type=write size=4162117 2024-09-12T17:30:32.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.862+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=KRV6UNF1R6JN type=del 2024-09-12T17:30:32.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.864+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=QLM1F9AKU9XV type=del size=1005269 2024-09-12T17:30:32.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.865+0000 7fece65ff780 1 < completed write operation key=LSGN631FW1P8 tag=ZL9NNSHUYG0J type=write size=371121 2024-09-12T17:30:32.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.867+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~4SC035DEFINH.0 size=837124 2024-09-12T17:30:32.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.867+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=4SC035DEFINH tag=72WJFV5P7EQ1 type=write size=1885700 2024-09-12T17:30:32.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.869+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=JB2G96O8BV9I type=del 2024-09-12T17:30:32.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.871+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~VH054BA0OHW1.0 size=1048576 2024-09-12T17:30:32.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.872+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~VH054BA0OHW1.1 size=1048576 2024-09-12T17:30:32.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.873+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~VH054BA0OHW1.2 size=630255 2024-09-12T17:30:32.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.873+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=VH054BA0OHW1 tag=VYYVOSXQ7CEF type=write size=3775983 2024-09-12T17:30:32.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.874+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~BZ9EQ9LEGTBW.0 size=1048576 2024-09-12T17:30:32.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.875+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~BZ9EQ9LEGTBW.1 size=1047526 2024-09-12T17:30:32.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.877+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=BZ9EQ9LEGTBW tag=YZE5UONYED0G type=write size=3144678 2024-09-12T17:30:32.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.879+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=XIXCZ5GZPZOX type=del size=321138 2024-09-12T17:30:32.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.880+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~WF0IO2NQQPYB.0 size=1048576 2024-09-12T17:30:32.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.882+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~WF0IO2NQQPYB.1 size=574558 2024-09-12T17:30:32.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.885+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=WF0IO2NQQPYB tag=YRDSF0EZUC05 type=write size=2671710 2024-09-12T17:30:32.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.886+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=JJ0UZE125E9B type=del size=3506438 2024-09-12T17:30:32.890 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.889+0000 7fece65ff780 1 < suggested remove operation key=Y1OT1OLGWB1Q tag=HKJZXMHOLA1K type=del 2024-09-12T17:30:32.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.890+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=SYFE2DVSMDFY type=del size=592639 2024-09-12T17:30:32.894 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.893+0000 7fece65ff780 1 < suggested update operation key=4Z1N3433MC6A tag=AWTSDXBVX5GF type=del size=126708 2024-09-12T17:30:32.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.895+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~G20RABBTT24S.0 size=1048576 2024-09-12T17:30:32.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.896+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~G20RABBTT24S.1 size=772245 2024-09-12T17:30:32.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.896+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=G20RABBTT24S tag=83GN7GB7DFJ9 type=write size=2869397 2024-09-12T17:30:32.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.897+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=KFDXICKR6NTM type=del 2024-09-12T17:30:32.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.899+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=8AYZRKR752UH type=del size=3681382 2024-09-12T17:30:32.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.900+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=YYJZ4EPVXEJQ type=del 2024-09-12T17:30:32.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.901+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=PK23CVWXXZDK type=del size=1315563 2024-09-12T17:30:32.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.905+0000 7fece65ff780 1 < suggested remove operation key=6CCPZ4TVIU5N tag=LS51QE866TEY type=del 2024-09-12T17:30:32.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.906+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=BWAXV0SRG8PI type=del size=3785220 2024-09-12T17:30:32.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.906+0000 7fece65ff780 -1 < no bi entry to suggest for operation key=UN6FLMRMAPUS tag=JBDD2XWH8IXV type=write size=724407: (2) No such file or directory 2024-09-12T17:30:32.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.908+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=D4IXA3DHU033 type=del size=3036467 2024-09-12T17:30:32.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.909+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~KP52BJOJJWG6.0 size=1048576 2024-09-12T17:30:32.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.910+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~KP52BJOJJWG6.1 size=219272 2024-09-12T17:30:32.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.912+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=KP52BJOJJWG6 tag=MS67IV9ET10O type=write size=2316424 2024-09-12T17:30:32.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.914+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=0WEND6ED88E3 type=write size=421301 2024-09-12T17:30:32.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.915+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=0E3VP49DPK7A type=del 2024-09-12T17:30:32.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.917+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~FWSMXZ5V8L5U.0 size=1048576 2024-09-12T17:30:32.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.918+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~FWSMXZ5V8L5U.1 size=1048576 2024-09-12T17:30:32.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.920+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~FWSMXZ5V8L5U.2 size=307917 2024-09-12T17:30:32.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.920+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=FWSMXZ5V8L5U tag=5G3S181C3AQR type=write size=3453645 2024-09-12T17:30:32.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.921+0000 7fece65ff780 1 < canceled operation key=RKFRKIENSBTO tag=OHFNPL5FVRNI type=del size=998493 2024-09-12T17:30:32.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.922+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=99EHM9ARJLMH type=del size=2955432 2024-09-12T17:30:32.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.924+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~WUL9QL9NWVLC.0 size=1048576 2024-09-12T17:30:32.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.925+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~WUL9QL9NWVLC.1 size=325758 2024-09-12T17:30:32.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.927+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=WUL9QL9NWVLC tag=FSVDAD6EOBCJ type=write size=2422910 2024-09-12T17:30:32.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.928+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=YM2J4EE2YWA5 type=del size=2375060 2024-09-12T17:30:32.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.930+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~V1LWKWUX4GC0.0 size=1048576 2024-09-12T17:30:32.932 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.931+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~V1LWKWUX4GC0.1 size=1048576 2024-09-12T17:30:32.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.932+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~V1LWKWUX4GC0.2 size=1016389 2024-09-12T17:30:32.935 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.934+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=V1LWKWUX4GC0 tag=4X33IGW6RDQ5 type=write size=4162117 2024-09-12T17:30:32.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.935+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=G5SWDIZQBG6W type=write size=292801 2024-09-12T17:30:32.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.936+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=QLM1F9AKU9XV type=del 2024-09-12T17:30:32.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.938+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~M1UGLCQGXWHF.0 size=1048576 2024-09-12T17:30:32.941 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.939+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~M1UGLCQGXWHF.1 size=708016 2024-09-12T17:30:32.941 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.939+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=M1UGLCQGXWHF tag=9P5RZY61WKKO type=write size=2805168 2024-09-12T17:30:32.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.941+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~4SC035DEFINH.0 size=837124 2024-09-12T17:30:32.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.943+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=4SC035DEFINH tag=72WJFV5P7EQ1 type=write size=1885700 2024-09-12T17:30:32.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.944+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=89RHWUAUO6DG type=write size=795900 2024-09-12T17:30:32.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.944+0000 7fece65ff780 1 < canceled part key=_multipart_UN6FLMRMAPUS.2~VH054BA0OHW1.0 size=1048576 2024-09-12T17:30:32.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.945+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~VH054BA0OHW1.1 size=1048576 2024-09-12T17:30:32.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.946+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~VH054BA0OHW1.2 size=630255 2024-09-12T17:30:32.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.948+0000 7fece65ff780 1 < canceled multipart upload key=UN6FLMRMAPUS upload=VH054BA0OHW1 tag=VYYVOSXQ7CEF type=write size=3775983 2024-09-12T17:30:32.952 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.950+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~803AB46EPWWZ.0 size=879579 2024-09-12T17:30:32.952 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.950+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=803AB46EPWWZ tag=I34FGND4AF1Q type=write size=1928155 2024-09-12T17:30:32.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.953+0000 7fece65ff780 1 < suggested remove operation key=OPMR1WMB14CA tag=XIXCZ5GZPZOX type=del 2024-09-12T17:30:32.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.954+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=RMACUJI7VF26 type=del size=150424 2024-09-12T17:30:32.957 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.955+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=JJ0UZE125E9B type=del 2024-09-12T17:30:32.958 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.956+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=PQ132Z952P29 type=write size=615268 2024-09-12T17:30:32.959 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.958+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=SYFE2DVSMDFY type=del 2024-09-12T17:30:32.961 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.959+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=B7474DQTGF9R type=write size=572961 2024-09-12T17:30:32.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.960+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~G20RABBTT24S.0 size=1048576 2024-09-12T17:30:32.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.961+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~G20RABBTT24S.1 size=772245 2024-09-12T17:30:32.965 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.963+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=G20RABBTT24S tag=83GN7GB7DFJ9 type=write size=2869397 2024-09-12T17:30:32.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.966+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~AMJFW1ILQRN7.0 size=1048576 2024-09-12T17:30:32.968 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.966+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~AMJFW1ILQRN7.1 size=1048576 2024-09-12T17:30:32.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.967+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~AMJFW1ILQRN7.2 size=973736 2024-09-12T17:30:32.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.967+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=AMJFW1ILQRN7 tag=ZK8K1VXT8BIT type=write size=4119464 2024-09-12T17:30:32.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.969+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=8AYZRKR752UH type=del 2024-09-12T17:30:32.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.970+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=TNHQ2B3Y05J2 type=del size=3361196 2024-09-12T17:30:32.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.971+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=PK23CVWXXZDK type=del 2024-09-12T17:30:32.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.973+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=6UE7LASS26E9 type=del size=2783436 2024-09-12T17:30:32.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.974+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=BWAXV0SRG8PI type=del 2024-09-12T17:30:32.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.977+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~D3WRC5KSUCFS.0 size=1048576 2024-09-12T17:30:32.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.978+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~D3WRC5KSUCFS.1 size=1048576 2024-09-12T17:30:32.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.979+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~D3WRC5KSUCFS.2 size=963114 2024-09-12T17:30:32.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.979+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=D3WRC5KSUCFS tag=N866UX0IHM71 type=write size=4108842 2024-09-12T17:30:32.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.980+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=D4IXA3DHU033 type=del 2024-09-12T17:30:32.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.982+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=QA3SMWY1768U type=del size=48653 2024-09-12T17:30:32.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.983+0000 7fece65ff780 1 < completed write operation key=QQNW20B28RJC tag=0WEND6ED88E3 type=write size=421301 2024-09-12T17:30:32.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.984+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=TY6Q1M46D5MR type=write size=373805 2024-09-12T17:30:32.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.985+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~FWSMXZ5V8L5U.0 size=1048576 2024-09-12T17:30:32.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.986+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~FWSMXZ5V8L5U.1 size=1048576 2024-09-12T17:30:32.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.987+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~FWSMXZ5V8L5U.2 size=307917 2024-09-12T17:30:32.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.989+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=FWSMXZ5V8L5U tag=5G3S181C3AQR type=write size=3453645 2024-09-12T17:30:32.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.990+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=D9K5KRBYN3U0 type=del size=3601761 2024-09-12T17:30:32.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.991+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=99EHM9ARJLMH type=del 2024-09-12T17:30:32.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.993+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=IIJB17T2NJO4 type=del size=277687 2024-09-12T17:30:32.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.994+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=YM2J4EE2YWA5 type=del 2024-09-12T17:30:32.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.995+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=F7HJW7RW0L9Y type=del size=1947539 2024-09-12T17:30:32.998 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.996+0000 7fece65ff780 1 < completed write operation key=4Z1N3433MC6A tag=G5SWDIZQBG6W type=write size=292801 2024-09-12T17:30:32.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.998+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=9LUKLK8EL22G type=del size=818106 2024-09-12T17:30:33.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:32.999+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~M1UGLCQGXWHF.0 size=1048576 2024-09-12T17:30:33.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.000+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~M1UGLCQGXWHF.1 size=708016 2024-09-12T17:30:33.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.001+0000 7fece65ff780 1 < completed multipart upload key=5A7WPGW5P91B upload=M1UGLCQGXWHF tag=9P5RZY61WKKO type=write size=2805168 2024-09-12T17:30:33.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.003+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=JN4QMDIDNV0Z type=del size=1126686 2024-09-12T17:30:33.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.004+0000 7fece65ff780 1 < completed write operation key=RKFRKIENSBTO tag=89RHWUAUO6DG type=write size=795900 2024-09-12T17:30:33.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.005+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=6HMWNT1YLH9A type=del size=3764743 2024-09-12T17:30:33.008 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.006+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~803AB46EPWWZ.0 size=879579 2024-09-12T17:30:33.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.008+0000 7fece65ff780 1 < completed multipart upload key=IMCE9Z7P4S6R upload=803AB46EPWWZ tag=I34FGND4AF1Q type=write size=1928155 2024-09-12T17:30:33.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.009+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=71ED9ET4OOKG type=del size=3442092 2024-09-12T17:30:33.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.011+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=RMACUJI7VF26 type=del 2024-09-12T17:30:33.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.012+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=I0EA1I3E8G85 type=del size=490148 2024-09-12T17:30:33.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.015+0000 7fece65ff780 1 < suggested remove operation key=Y1OT1OLGWB1Q tag=PQ132Z952P29 type=write 2024-09-12T17:30:33.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.017+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~QLCTBEAUZ6C4.0 size=341154 2024-09-12T17:30:33.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.017+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=QLCTBEAUZ6C4 tag=CPB95RPTU3WC type=write size=1389730 2024-09-12T17:30:33.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.018+0000 7fece65ff780 1 < completed write operation key=4Z1N3433MC6A tag=B7474DQTGF9R type=write size=572961 2024-09-12T17:30:33.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.019+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=HFQZNW0QY9CY type=del size=265586 2024-09-12T17:30:33.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.021+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~AMJFW1ILQRN7.0 size=1048576 2024-09-12T17:30:33.024 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.022+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~AMJFW1ILQRN7.1 size=1048576 2024-09-12T17:30:33.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.023+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~AMJFW1ILQRN7.2 size=973736 2024-09-12T17:30:33.027 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.025+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=AMJFW1ILQRN7 tag=ZK8K1VXT8BIT type=write size=4119464 2024-09-12T17:30:33.028 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.027+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=FVNDXX1T2QAX type=del size=1723050 2024-09-12T17:30:33.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.028+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=TNHQ2B3Y05J2 type=del 2024-09-12T17:30:33.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.029+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=SSD94SXNIABF type=write size=659863 2024-09-12T17:30:33.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.030+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=6UE7LASS26E9 type=del 2024-09-12T17:30:33.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.032+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=DYHRHU2MNTBM type=write size=650835 2024-09-12T17:30:33.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.033+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~D3WRC5KSUCFS.0 size=1048576 2024-09-12T17:30:33.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.033+0000 7fece65ff780 1 < canceled part key=_multipart_I31CKY20NO9S.2~D3WRC5KSUCFS.1 size=1048576 2024-09-12T17:30:33.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.034+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~D3WRC5KSUCFS.2 size=963114 2024-09-12T17:30:33.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.036+0000 7fece65ff780 1 < canceled multipart upload key=I31CKY20NO9S upload=D3WRC5KSUCFS tag=N866UX0IHM71 type=write size=4108842 2024-09-12T17:30:33.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.037+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=RZWBHJPANBE8 type=del size=1402295 2024-09-12T17:30:33.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.040+0000 7fece65ff780 1 < suggested update operation key=OPMR1WMB14CA tag=QA3SMWY1768U type=del size=48653 2024-09-12T17:30:33.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.042+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~VTT4WZ3JHEHX.0 size=1048576 2024-09-12T17:30:33.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.043+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~VTT4WZ3JHEHX.1 size=1048576 2024-09-12T17:30:33.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.044+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~VTT4WZ3JHEHX.2 size=409282 2024-09-12T17:30:33.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.044+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=VTT4WZ3JHEHX tag=H7HR18I78UAH type=write size=3555010 2024-09-12T17:30:33.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.045+0000 7fece65ff780 1 < completed write operation key=QQNW20B28RJC tag=TY6Q1M46D5MR type=write size=373805 2024-09-12T17:30:33.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.048+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~MXB6XC6YIXZE.0 size=1014539 2024-09-12T17:30:33.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.048+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=MXB6XC6YIXZE tag=J7T7TAY9RXHU type=write size=2063115 2024-09-12T17:30:33.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.049+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=D9K5KRBYN3U0 type=del 2024-09-12T17:30:33.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.051+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=CUPJ2VO7ERYQ type=del size=2496199 2024-09-12T17:30:33.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.052+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=IIJB17T2NJO4 type=del 2024-09-12T17:30:33.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.055+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~4KRV1VR3B66F.0 size=1048576 2024-09-12T17:30:33.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.056+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~4KRV1VR3B66F.1 size=1048576 2024-09-12T17:30:33.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.057+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~4KRV1VR3B66F.2 size=251053 2024-09-12T17:30:33.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.057+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=4KRV1VR3B66F tag=N82L6LM05663 type=write size=3396781 2024-09-12T17:30:33.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.058+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=F7HJW7RW0L9Y type=del 2024-09-12T17:30:33.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.060+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~2UNPPSDYZ62N.0 size=1048576 2024-09-12T17:30:33.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.061+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~2UNPPSDYZ62N.1 size=1048576 2024-09-12T17:30:33.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.062+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~2UNPPSDYZ62N.2 size=172329 2024-09-12T17:30:33.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.062+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=2UNPPSDYZ62N tag=ZUSW8HDLW2Y0 type=write size=3318057 2024-09-12T17:30:33.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.063+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=9LUKLK8EL22G type=del 2024-09-12T17:30:33.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.066+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~XE84R88OT5M7.0 size=582142 2024-09-12T17:30:33.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.066+0000 7fece65ff780 1 > prepared multipart upload key=Y30269Q7R340 upload=XE84R88OT5M7 tag=S3K36UIYUELD type=write size=1630718 2024-09-12T17:30:33.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.067+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=JN4QMDIDNV0Z type=del 2024-09-12T17:30:33.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.068+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=TCU5C6GWTIN4 type=del size=329416 2024-09-12T17:30:33.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.069+0000 7fece65ff780 1 < completed delete operation key=Q00ZFG0BBDG5 tag=6HMWNT1YLH9A type=del 2024-09-12T17:30:33.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.072+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~YG5IYSPN5OYA.0 size=1048576 2024-09-12T17:30:33.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.072+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~YG5IYSPN5OYA.1 size=516735 2024-09-12T17:30:33.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.072+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=YG5IYSPN5OYA tag=6ZFRG25WTU5C type=write size=2613887 2024-09-12T17:30:33.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.074+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=71ED9ET4OOKG type=del 2024-09-12T17:30:33.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.076+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~VU8GRSI6GNBJ.0 size=310973 2024-09-12T17:30:33.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.076+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=VU8GRSI6GNBJ tag=2FA97BFQQWJ5 type=write size=1359549 2024-09-12T17:30:33.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.078+0000 7fece65ff780 1 < suggested remove operation key=Y30269Q7R340 tag=I0EA1I3E8G85 type=del 2024-09-12T17:30:33.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.081+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~LG7D8SFTE21Y.0 size=933196 2024-09-12T17:30:33.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.081+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=LG7D8SFTE21Y tag=0TL4WHKHSU97 type=write size=1981772 2024-09-12T17:30:33.083 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.082+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~QLCTBEAUZ6C4.0 size=341154 2024-09-12T17:30:33.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.084+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=QLCTBEAUZ6C4 tag=CPB95RPTU3WC type=write size=1389730 2024-09-12T17:30:33.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.086+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~RPIFQFYYFLB1.0 size=179450 2024-09-12T17:30:33.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.086+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=RPIFQFYYFLB1 tag=Z515EQ9FB9IF type=write size=1228026 2024-09-12T17:30:33.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.089+0000 7fece65ff780 1 < suggested remove operation key=807GX4RQQLL4 tag=HFQZNW0QY9CY type=del 2024-09-12T17:30:33.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.090+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=E0EU53Z4K7FT type=del size=215090 2024-09-12T17:30:33.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.092+0000 7fece65ff780 1 < suggested remove operation key=9IGJG88NX1FS tag=FVNDXX1T2QAX type=del 2024-09-12T17:30:33.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.094+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~JLSU47AYLXL7.0 size=1048576 2024-09-12T17:30:33.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.095+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~JLSU47AYLXL7.1 size=695741 2024-09-12T17:30:33.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.095+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=JLSU47AYLXL7 tag=G9IJEMITCPO6 type=write size=2792893 2024-09-12T17:30:33.098 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.097+0000 7fece65ff780 -1 < failed to complete operation key=OPMR1WMB14CA tag=SSD94SXNIABF type=write size=659863: (22) Invalid argument 2024-09-12T17:30:33.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.099+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=G3RGMIB4JSRG type=del size=807777 2024-09-12T17:30:33.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.100+0000 7fece65ff780 1 < completed write operation key=OIHDAJMPUK4I tag=DYHRHU2MNTBM type=write size=650835 2024-09-12T17:30:33.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.102+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~BKNFLY921AUV.0 size=1048576 2024-09-12T17:30:33.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.103+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~BKNFLY921AUV.1 size=928528 2024-09-12T17:30:33.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.103+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=BKNFLY921AUV tag=V1IS7NWT4E3E type=write size=3025680 2024-09-12T17:30:33.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.104+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=RZWBHJPANBE8 type=del 2024-09-12T17:30:33.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.107+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~0XN114JSX9C9.0 size=1048576 2024-09-12T17:30:33.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.108+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~0XN114JSX9C9.1 size=1048576 2024-09-12T17:30:33.110 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.108+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~0XN114JSX9C9.2 size=742204 2024-09-12T17:30:33.110 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.109+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=0XN114JSX9C9 tag=BT2NMCLMAREH type=write size=3887932 2024-09-12T17:30:33.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.110+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~VTT4WZ3JHEHX.0 size=1048576 2024-09-12T17:30:33.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.111+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~VTT4WZ3JHEHX.1 size=1048576 2024-09-12T17:30:33.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.112+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~VTT4WZ3JHEHX.2 size=409282 2024-09-12T17:30:33.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.114+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=VTT4WZ3JHEHX tag=H7HR18I78UAH type=write size=3555010 2024-09-12T17:30:33.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.115+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=FUHW9KLZDZTW type=write size=893345 2024-09-12T17:30:33.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.116+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~MXB6XC6YIXZE.0 size=1014539 2024-09-12T17:30:33.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.118+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=MXB6XC6YIXZE tag=J7T7TAY9RXHU type=write size=2063115 2024-09-12T17:30:33.121 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.119+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=G1NZPU50BNUW type=write size=354388 2024-09-12T17:30:33.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.121+0000 7fece65ff780 1 < suggested remove operation key=5A7WPGW5P91B tag=CUPJ2VO7ERYQ type=del 2024-09-12T17:30:33.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.122+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=PA0BQ25RLMVW type=del size=3466235 2024-09-12T17:30:33.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.124+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~4KRV1VR3B66F.0 size=1048576 2024-09-12T17:30:33.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.125+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~4KRV1VR3B66F.1 size=1048576 2024-09-12T17:30:33.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.126+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~4KRV1VR3B66F.2 size=251053 2024-09-12T17:30:33.129 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.128+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=4KRV1VR3B66F tag=N82L6LM05663 type=write size=3396781 2024-09-12T17:30:33.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.129+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=1BVPASU979OP type=write size=539063 2024-09-12T17:30:33.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.130+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~2UNPPSDYZ62N.0 size=1048576 2024-09-12T17:30:33.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.131+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~2UNPPSDYZ62N.1 size=1048576 2024-09-12T17:30:33.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.132+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~2UNPPSDYZ62N.2 size=172329 2024-09-12T17:30:33.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.134+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=2UNPPSDYZ62N tag=ZUSW8HDLW2Y0 type=write size=3318057 2024-09-12T17:30:33.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.135+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=FYFGP30JSJGQ type=del size=4165977 2024-09-12T17:30:33.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.137+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~XE84R88OT5M7.0 size=582142 2024-09-12T17:30:33.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.139+0000 7fece65ff780 1 < completed multipart upload key=Y30269Q7R340 upload=XE84R88OT5M7 tag=S3K36UIYUELD type=write size=1630718 2024-09-12T17:30:33.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.141+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=G4HN2A6NHIES type=del size=3792641 2024-09-12T17:30:33.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.142+0000 7fece65ff780 1 < completed delete operation key=7AS5L998SDV7 tag=TCU5C6GWTIN4 type=del 2024-09-12T17:30:33.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.143+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=BGZOSUE0AQMV type=del size=3830790 2024-09-12T17:30:33.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.144+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~YG5IYSPN5OYA.0 size=1048576 2024-09-12T17:30:33.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.145+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~YG5IYSPN5OYA.1 size=516735 2024-09-12T17:30:33.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.147+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=YG5IYSPN5OYA tag=6ZFRG25WTU5C type=write size=2613887 2024-09-12T17:30:33.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.150+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~R12I4PT30CEY.0 size=1048576 2024-09-12T17:30:33.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.151+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~R12I4PT30CEY.1 size=436996 2024-09-12T17:30:33.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.151+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=R12I4PT30CEY tag=UTYAV3ZOV501 type=write size=2534148 2024-09-12T17:30:33.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.152+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~VU8GRSI6GNBJ.0 size=310973 2024-09-12T17:30:33.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.154+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=VU8GRSI6GNBJ tag=2FA97BFQQWJ5 type=write size=1359549 2024-09-12T17:30:33.157 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.155+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=C1VJ3P62MX36 type=del size=1584702 2024-09-12T17:30:33.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.156+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~LG7D8SFTE21Y.0 size=933196 2024-09-12T17:30:33.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.158+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=LG7D8SFTE21Y tag=0TL4WHKHSU97 type=write size=1981772 2024-09-12T17:30:33.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.160+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=SOQ7PC1VJX7O type=del size=550970 2024-09-12T17:30:33.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.161+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~RPIFQFYYFLB1.0 size=179450 2024-09-12T17:30:33.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.163+0000 7fece65ff780 1 < completed multipart upload key=9KYNMM6W7RRM upload=RPIFQFYYFLB1 tag=Z515EQ9FB9IF type=write size=1228026 2024-09-12T17:30:33.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.166+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~HLU3BWZENBGA.0 size=258786 2024-09-12T17:30:33.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.166+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=HLU3BWZENBGA tag=HYYB026COQ65 type=write size=1307362 2024-09-12T17:30:33.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.167+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=E0EU53Z4K7FT type=del 2024-09-12T17:30:33.171 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.170+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~9JB1Y0CS8TT0.0 size=1048576 2024-09-12T17:30:33.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.171+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~9JB1Y0CS8TT0.1 size=1048576 2024-09-12T17:30:33.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.172+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~9JB1Y0CS8TT0.2 size=785480 2024-09-12T17:30:33.174 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.172+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=9JB1Y0CS8TT0 tag=86LT6MPXTTNG type=write size=3931208 2024-09-12T17:30:33.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.173+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~JLSU47AYLXL7.0 size=1048576 2024-09-12T17:30:33.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.174+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~JLSU47AYLXL7.1 size=695741 2024-09-12T17:30:33.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.176+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=JLSU47AYLXL7 tag=G9IJEMITCPO6 type=write size=2792893 2024-09-12T17:30:33.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.177+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=QU3ZP6BWMUCH type=del size=2472379 2024-09-12T17:30:33.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.179+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=G3RGMIB4JSRG type=del 2024-09-12T17:30:33.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.181+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~GNNTVUU7ZOMJ.0 size=930514 2024-09-12T17:30:33.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.181+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=GNNTVUU7ZOMJ tag=SH5REQZFRRBC type=write size=1979090 2024-09-12T17:30:33.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.182+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~BKNFLY921AUV.0 size=1048576 2024-09-12T17:30:33.185 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.183+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~BKNFLY921AUV.1 size=928528 2024-09-12T17:30:33.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.185+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=BKNFLY921AUV tag=V1IS7NWT4E3E type=write size=3025680 2024-09-12T17:30:33.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.187+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~V7W1KRTX9TS6.0 size=1048576 2024-09-12T17:30:33.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.188+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~V7W1KRTX9TS6.1 size=833653 2024-09-12T17:30:33.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.188+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=V7W1KRTX9TS6 tag=VCO5M0L1TO88 type=write size=2930805 2024-09-12T17:30:33.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.189+0000 7fece65ff780 1 < canceled part key=_multipart_7AS5L998SDV7.2~0XN114JSX9C9.0 size=1048576 2024-09-12T17:30:33.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.189+0000 7fece65ff780 1 < canceled part key=_multipart_7AS5L998SDV7.2~0XN114JSX9C9.1 size=1048576 2024-09-12T17:30:33.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.190+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~0XN114JSX9C9.2 size=742204 2024-09-12T17:30:33.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.192+0000 7fece65ff780 1 < canceled multipart upload key=7AS5L998SDV7 upload=0XN114JSX9C9 tag=BT2NMCLMAREH type=write size=3887932 2024-09-12T17:30:33.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.194+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~HOQ3Z48ZRCM5.0 size=892712 2024-09-12T17:30:33.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.194+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=HOQ3Z48ZRCM5 tag=ZZ3YTESRA7YY type=write size=1941288 2024-09-12T17:30:33.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.195+0000 7fece65ff780 1 < completed write operation key=CEERZVBJQHP0 tag=FUHW9KLZDZTW type=write size=893345 2024-09-12T17:30:33.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.197+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~BOMZ4BKO3I8P.0 size=1048576 2024-09-12T17:30:33.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.198+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~BOMZ4BKO3I8P.1 size=948237 2024-09-12T17:30:33.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.198+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=BOMZ4BKO3I8P tag=CJRN3H7DY7HX type=write size=3045389 2024-09-12T17:30:33.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.199+0000 7fece65ff780 1 < completed write operation key=CEERZVBJQHP0 tag=G1NZPU50BNUW type=write size=354388 2024-09-12T17:30:33.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.201+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~QQC3KQWBTW7N.0 size=1048576 2024-09-12T17:30:33.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.202+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~QQC3KQWBTW7N.1 size=1048576 2024-09-12T17:30:33.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.203+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~QQC3KQWBTW7N.2 size=290717 2024-09-12T17:30:33.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.203+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=QQC3KQWBTW7N tag=6DL1GP0L8ZY2 type=write size=3436445 2024-09-12T17:30:33.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.206+0000 7fece65ff780 1 < suggested remove operation key=CEERZVBJQHP0 tag=PA0BQ25RLMVW type=del 2024-09-12T17:30:33.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.208+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~04YP6PEUMX99.0 size=1048576 2024-09-12T17:30:33.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.209+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~04YP6PEUMX99.1 size=215295 2024-09-12T17:30:33.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.209+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=04YP6PEUMX99 tag=4YTF5Z0WR0SF type=write size=2312447 2024-09-12T17:30:33.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.212+0000 7fece65ff780 1 < suggested update operation key=Y30269Q7R340 tag=1BVPASU979OP type=write size=539063 2024-09-12T17:30:33.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.215+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~WJYO98PE2W0B.0 size=1048576 2024-09-12T17:30:33.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.216+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~WJYO98PE2W0B.1 size=660696 2024-09-12T17:30:33.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.216+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=WJYO98PE2W0B tag=6TKMSW3EEMCY type=write size=2757848 2024-09-12T17:30:33.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.217+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=FYFGP30JSJGQ type=del 2024-09-12T17:30:33.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.218+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=GF96356ZD9AW type=del size=1186453 2024-09-12T17:30:33.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.219+0000 7fece65ff780 -1 < failed to complete operation key=Y30269Q7R340 tag=G4HN2A6NHIES type=del size=3792641: (22) Invalid argument 2024-09-12T17:30:33.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.221+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=JX11JDY2EAUT type=del size=1465336 2024-09-12T17:30:33.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.223+0000 7fece65ff780 1 < suggested remove operation key=807GX4RQQLL4 tag=BGZOSUE0AQMV type=del 2024-09-12T17:30:33.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.224+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=EN3IZHUH9WJK type=del size=2144813 2024-09-12T17:30:33.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.226+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~R12I4PT30CEY.0 size=1048576 2024-09-12T17:30:33.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.227+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~R12I4PT30CEY.1 size=436996 2024-09-12T17:30:33.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.229+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=R12I4PT30CEY tag=UTYAV3ZOV501 type=write size=2534148 2024-09-12T17:30:33.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.230+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=B1JV0CVQTN6T type=del size=2721923 2024-09-12T17:30:33.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.231+0000 7fece65ff780 1 < completed delete operation key=5A7WPGW5P91B tag=C1VJ3P62MX36 type=del 2024-09-12T17:30:33.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.232+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=Y4ZQG4U87A45 type=write size=300770 2024-09-12T17:30:33.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.233+0000 7fece65ff780 -1 < failed to complete operation key=Y30269Q7R340 tag=SOQ7PC1VJX7O type=del size=550970: (22) Invalid argument 2024-09-12T17:30:33.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.236+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~CPJN9L9K0Y1O.0 size=1048576 2024-09-12T17:30:33.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.237+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~CPJN9L9K0Y1O.1 size=1048576 2024-09-12T17:30:33.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.238+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~CPJN9L9K0Y1O.2 size=251627 2024-09-12T17:30:33.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.238+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=CPJN9L9K0Y1O tag=YBMAO22TRSNI type=write size=3397355 2024-09-12T17:30:33.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.239+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~HLU3BWZENBGA.0 size=258786 2024-09-12T17:30:33.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.241+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=HLU3BWZENBGA tag=HYYB026COQ65 type=write size=1307362 2024-09-12T17:30:33.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.243+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~BA4EUS42QP9V.0 size=1048576 2024-09-12T17:30:33.246 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.245+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~BA4EUS42QP9V.1 size=306320 2024-09-12T17:30:33.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.245+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=BA4EUS42QP9V tag=774R5CNNA7MB type=write size=2403472 2024-09-12T17:30:33.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.246+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~9JB1Y0CS8TT0.0 size=1048576 2024-09-12T17:30:33.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.247+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~9JB1Y0CS8TT0.1 size=1048576 2024-09-12T17:30:33.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.247+0000 7fece65ff780 1 < canceled part key=_multipart_OIHDAJMPUK4I.2~9JB1Y0CS8TT0.2 size=785480 2024-09-12T17:30:33.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.249+0000 7fece65ff780 1 < canceled multipart upload key=OIHDAJMPUK4I upload=9JB1Y0CS8TT0 tag=86LT6MPXTTNG type=write size=3931208 2024-09-12T17:30:33.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.252+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~3P3XZBY099GC.0 size=271656 2024-09-12T17:30:33.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.252+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=3P3XZBY099GC tag=NT1467HL5K1Y type=write size=1320232 2024-09-12T17:30:33.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.253+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=QU3ZP6BWMUCH type=del 2024-09-12T17:30:33.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.255+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=EUY30G1CT8PE type=del size=1336204 2024-09-12T17:30:33.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.256+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~GNNTVUU7ZOMJ.0 size=930514 2024-09-12T17:30:33.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.258+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=GNNTVUU7ZOMJ tag=SH5REQZFRRBC type=write size=1979090 2024-09-12T17:30:33.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.259+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=N1AYJTQ3M5OA type=write size=450830 2024-09-12T17:30:33.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.260+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~V7W1KRTX9TS6.0 size=1048576 2024-09-12T17:30:33.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.261+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~V7W1KRTX9TS6.1 size=833653 2024-09-12T17:30:33.265 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.263+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=V7W1KRTX9TS6 tag=VCO5M0L1TO88 type=write size=2930805 2024-09-12T17:30:33.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.265+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=C654FSKTN0N6 type=del size=3241279 2024-09-12T17:30:33.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.266+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~HOQ3Z48ZRCM5.0 size=892712 2024-09-12T17:30:33.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.268+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=HOQ3Z48ZRCM5 tag=ZZ3YTESRA7YY type=write size=1941288 2024-09-12T17:30:33.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.269+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=33QZORD5TDXB type=del size=2436640 2024-09-12T17:30:33.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.270+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~BOMZ4BKO3I8P.0 size=1048576 2024-09-12T17:30:33.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.271+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~BOMZ4BKO3I8P.1 size=948237 2024-09-12T17:30:33.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.273+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=BOMZ4BKO3I8P tag=CJRN3H7DY7HX type=write size=3045389 2024-09-12T17:30:33.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.275+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=1VHFD06S1BGU type=del size=1093236 2024-09-12T17:30:33.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.276+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~QQC3KQWBTW7N.0 size=1048576 2024-09-12T17:30:33.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.277+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~QQC3KQWBTW7N.1 size=1048576 2024-09-12T17:30:33.279 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.278+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~QQC3KQWBTW7N.2 size=290717 2024-09-12T17:30:33.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.279+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=QQC3KQWBTW7N tag=6DL1GP0L8ZY2 type=write size=3436445 2024-09-12T17:30:33.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.281+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=G8B3WF1L4P9X type=del size=731266 2024-09-12T17:30:33.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.282+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~04YP6PEUMX99.0 size=1048576 2024-09-12T17:30:33.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.283+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~04YP6PEUMX99.1 size=215295 2024-09-12T17:30:33.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.285+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=04YP6PEUMX99 tag=4YTF5Z0WR0SF type=write size=2312447 2024-09-12T17:30:33.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.287+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~LTC10P97TDFE.0 size=909265 2024-09-12T17:30:33.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.287+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=LTC10P97TDFE tag=7VXN6QJMCYY5 type=write size=1957841 2024-09-12T17:30:33.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.288+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~WJYO98PE2W0B.0 size=1048576 2024-09-12T17:30:33.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.289+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~WJYO98PE2W0B.1 size=660696 2024-09-12T17:30:33.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.291+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=WJYO98PE2W0B tag=6TKMSW3EEMCY type=write size=2757848 2024-09-12T17:30:33.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.292+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=ZQSOFHPBSIKS type=write size=854795 2024-09-12T17:30:33.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.293+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=GF96356ZD9AW type=del 2024-09-12T17:30:33.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.295+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=7Y53HOYLGU6U type=del size=3447919 2024-09-12T17:30:33.298 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.297+0000 7fece65ff780 1 < suggested update operation key=I31CKY20NO9S tag=JX11JDY2EAUT type=del size=1465336 2024-09-12T17:30:33.300 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.298+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=5HM7V8Q5I14B type=del size=305284 2024-09-12T17:30:33.301 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.299+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=EN3IZHUH9WJK type=del 2024-09-12T17:30:33.302 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.301+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=UABST22H7WLP type=del size=789931 2024-09-12T17:30:33.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.303+0000 7fece65ff780 1 < suggested update operation key=5LAOX5H1AQWJ tag=B1JV0CVQTN6T type=del size=2721923 2024-09-12T17:30:33.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.305+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~LQJ6W92VRED2.0 size=1048576 2024-09-12T17:30:33.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.306+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~LQJ6W92VRED2.1 size=556073 2024-09-12T17:30:33.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.306+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=LQJ6W92VRED2 tag=LBDUO4S43KKC type=write size=2653225 2024-09-12T17:30:33.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.307+0000 7fece65ff780 1 < completed write operation key=OIHDAJMPUK4I tag=Y4ZQG4U87A45 type=write size=300770 2024-09-12T17:30:33.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.309+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=I3E4LPY32F4G type=del size=1628940 2024-09-12T17:30:33.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.310+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~CPJN9L9K0Y1O.0 size=1048576 2024-09-12T17:30:33.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.311+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~CPJN9L9K0Y1O.1 size=1048576 2024-09-12T17:30:33.314 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.312+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~CPJN9L9K0Y1O.2 size=251627 2024-09-12T17:30:33.316 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.315+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=CPJN9L9K0Y1O tag=YBMAO22TRSNI type=write size=3397355 2024-09-12T17:30:33.318 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.317+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~WM888S9Z9PUK.0 size=1048576 2024-09-12T17:30:33.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.318+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~WM888S9Z9PUK.1 size=460556 2024-09-12T17:30:33.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.318+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=WM888S9Z9PUK tag=MBJR2PDR3PXI type=write size=2557708 2024-09-12T17:30:33.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.319+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~BA4EUS42QP9V.0 size=1048576 2024-09-12T17:30:33.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.320+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~BA4EUS42QP9V.1 size=306320 2024-09-12T17:30:33.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.323+0000 7fece65ff780 1 < completed multipart upload key=9KYNMM6W7RRM upload=BA4EUS42QP9V tag=774R5CNNA7MB type=write size=2403472 2024-09-12T17:30:33.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.325+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~53ZCL8KMUBB2.0 size=1048576 2024-09-12T17:30:33.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.326+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~53ZCL8KMUBB2.1 size=340598 2024-09-12T17:30:33.328 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.326+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=53ZCL8KMUBB2 tag=BTPK1R26CIQS type=write size=2437750 2024-09-12T17:30:33.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.327+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~3P3XZBY099GC.0 size=271656 2024-09-12T17:30:33.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.330+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=3P3XZBY099GC tag=NT1467HL5K1Y type=write size=1320232 2024-09-12T17:30:33.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.332+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~S0IX1L1BY7XZ.0 size=1048576 2024-09-12T17:30:33.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.333+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~S0IX1L1BY7XZ.1 size=1048576 2024-09-12T17:30:33.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.334+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~S0IX1L1BY7XZ.2 size=238593 2024-09-12T17:30:33.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.334+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=S0IX1L1BY7XZ tag=A3QI8FN9KC3Q type=write size=3384321 2024-09-12T17:30:33.337 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.335+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=EUY30G1CT8PE type=del 2024-09-12T17:30:33.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.337+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~RFL63I0CJKJ2.0 size=1048576 2024-09-12T17:30:33.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.339+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~RFL63I0CJKJ2.1 size=1048576 2024-09-12T17:30:33.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.340+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~RFL63I0CJKJ2.2 size=992416 2024-09-12T17:30:33.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.340+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=RFL63I0CJKJ2 tag=SLDDD6GPUT7P type=write size=4138144 2024-09-12T17:30:33.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.341+0000 7fece65ff780 1 < completed write operation key=TLEZIJ4881G7 tag=N1AYJTQ3M5OA type=write size=450830 2024-09-12T17:30:33.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.344+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~TZO0A8HMHCAR.0 size=1048576 2024-09-12T17:30:33.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.345+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~TZO0A8HMHCAR.1 size=665406 2024-09-12T17:30:33.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.345+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=TZO0A8HMHCAR tag=LNROH28QFL3K type=write size=2762558 2024-09-12T17:30:33.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.347+0000 7fece65ff780 1 < suggested remove operation key=I31CKY20NO9S tag=C654FSKTN0N6 type=del 2024-09-12T17:30:33.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.350+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~K4RPXCQWCUNE.0 size=1048576 2024-09-12T17:30:33.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.351+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~K4RPXCQWCUNE.1 size=1048576 2024-09-12T17:30:33.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.352+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~K4RPXCQWCUNE.2 size=991478 2024-09-12T17:30:33.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.352+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=K4RPXCQWCUNE tag=GKOF3IYA8460 type=write size=4137206 2024-09-12T17:30:33.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.353+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=33QZORD5TDXB type=del 2024-09-12T17:30:33.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.356+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~QU5I5P4FG2AK.0 size=790619 2024-09-12T17:30:33.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.356+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=QU5I5P4FG2AK tag=CMFWPO3VTFA4 type=write size=1839195 2024-09-12T17:30:33.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.358+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=1VHFD06S1BGU type=del 2024-09-12T17:30:33.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.360+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=K6VAL4ABXL2L type=del size=3343508 2024-09-12T17:30:33.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.361+0000 7fece65ff780 -1 < failed to complete operation key=5LAOX5H1AQWJ tag=G8B3WF1L4P9X type=del size=731266: (22) Invalid argument 2024-09-12T17:30:33.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.362+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=XH2K5880J6NR type=del size=1554257 2024-09-12T17:30:33.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.363+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~LTC10P97TDFE.0 size=909265 2024-09-12T17:30:33.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.365+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=LTC10P97TDFE tag=7VXN6QJMCYY5 type=write size=1957841 2024-09-12T17:30:33.368 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.367+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=NY4Y0336VUGX type=del size=3718295 2024-09-12T17:30:33.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.369+0000 7fece65ff780 1 < completed write operation key=7AS5L998SDV7 tag=ZQSOFHPBSIKS type=write size=854795 2024-09-12T17:30:33.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.373+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~KXAA1A3TCWUH.0 size=1048576 2024-09-12T17:30:33.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.375+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~KXAA1A3TCWUH.1 size=581809 2024-09-12T17:30:33.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.375+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=KXAA1A3TCWUH tag=0I06B1KLJSQT type=write size=2678961 2024-09-12T17:30:33.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.376+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=7Y53HOYLGU6U type=del 2024-09-12T17:30:33.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.377+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=8NF7WERU0VM9 type=del size=2789178 2024-09-12T17:30:33.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.378+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=5HM7V8Q5I14B type=del 2024-09-12T17:30:33.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.380+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~DLQ43SIAWNZ5.0 size=1048576 2024-09-12T17:30:33.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.381+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~DLQ43SIAWNZ5.1 size=1048576 2024-09-12T17:30:33.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.384+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~DLQ43SIAWNZ5.2 size=43811 2024-09-12T17:30:33.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.384+0000 7fece65ff780 1 > prepared multipart upload key=LSGN631FW1P8 upload=DLQ43SIAWNZ5 tag=Q4AWPXYEKF47 type=write size=3189539 2024-09-12T17:30:33.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.385+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=UABST22H7WLP type=del 2024-09-12T17:30:33.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.387+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=9MBYKGIT3CB9 type=write size=265628 2024-09-12T17:30:33.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.388+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~LQJ6W92VRED2.0 size=1048576 2024-09-12T17:30:33.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.388+0000 7fece65ff780 1 < canceled part key=_multipart_6CCPZ4TVIU5N.2~LQJ6W92VRED2.1 size=556073 2024-09-12T17:30:33.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.390+0000 7fece65ff780 1 < canceled multipart upload key=6CCPZ4TVIU5N upload=LQJ6W92VRED2 tag=LBDUO4S43KKC type=write size=2653225 2024-09-12T17:30:33.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.392+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~V77RUMYBU322.0 size=897404 2024-09-12T17:30:33.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.392+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=V77RUMYBU322 tag=3MSZT99BHGVP type=write size=1945980 2024-09-12T17:30:33.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.394+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=I3E4LPY32F4G type=del 2024-09-12T17:30:33.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.395+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=S34M1NTP8Z3D type=del size=583462 2024-09-12T17:30:33.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.397+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~WM888S9Z9PUK.0 size=1048576 2024-09-12T17:30:33.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.398+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~WM888S9Z9PUK.1 size=460556 2024-09-12T17:30:33.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.400+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=WM888S9Z9PUK tag=MBJR2PDR3PXI type=write size=2557708 2024-09-12T17:30:33.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.401+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=T9T2D1T3H8VJ type=del size=1342900 2024-09-12T17:30:33.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.403+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~53ZCL8KMUBB2.0 size=1048576 2024-09-12T17:30:33.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.404+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~53ZCL8KMUBB2.1 size=340598 2024-09-12T17:30:33.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.406+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=53ZCL8KMUBB2 tag=BTPK1R26CIQS type=write size=2437750 2024-09-12T17:30:33.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.408+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~3TK9O7UN1W77.0 size=1048576 2024-09-12T17:30:33.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.409+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~3TK9O7UN1W77.1 size=645374 2024-09-12T17:30:33.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.409+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=3TK9O7UN1W77 tag=6MDEHJK3A5IE type=write size=2742526 2024-09-12T17:30:33.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.411+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~S0IX1L1BY7XZ.0 size=1048576 2024-09-12T17:30:33.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.412+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~S0IX1L1BY7XZ.1 size=1048576 2024-09-12T17:30:33.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.413+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~S0IX1L1BY7XZ.2 size=238593 2024-09-12T17:30:33.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.415+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=S0IX1L1BY7XZ tag=A3QI8FN9KC3Q type=write size=3384321 2024-09-12T17:30:33.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.417+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=DQPNU7I82UIK type=write size=844798 2024-09-12T17:30:33.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.418+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~RFL63I0CJKJ2.0 size=1048576 2024-09-12T17:30:33.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.419+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~RFL63I0CJKJ2.1 size=1048576 2024-09-12T17:30:33.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.419+0000 7fece65ff780 1 < canceled part key=_multipart_9KYNMM6W7RRM.2~RFL63I0CJKJ2.2 size=992416 2024-09-12T17:30:33.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.421+0000 7fece65ff780 1 < canceled multipart upload key=9KYNMM6W7RRM upload=RFL63I0CJKJ2 tag=SLDDD6GPUT7P type=write size=4138144 2024-09-12T17:30:33.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.422+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=38T31I79WQGE type=del size=656096 2024-09-12T17:30:33.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.423+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~TZO0A8HMHCAR.0 size=1048576 2024-09-12T17:30:33.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.424+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~TZO0A8HMHCAR.1 size=665406 2024-09-12T17:30:33.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.426+0000 7fece65ff780 1 < completed multipart upload key=IMCE9Z7P4S6R upload=TZO0A8HMHCAR tag=LNROH28QFL3K type=write size=2762558 2024-09-12T17:30:33.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.428+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=0UWCB8EHK8L0 type=write size=210090 2024-09-12T17:30:33.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.429+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~K4RPXCQWCUNE.0 size=1048576 2024-09-12T17:30:33.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.430+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~K4RPXCQWCUNE.1 size=1048576 2024-09-12T17:30:33.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.431+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~K4RPXCQWCUNE.2 size=991478 2024-09-12T17:30:33.435 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.433+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=K4RPXCQWCUNE tag=GKOF3IYA8460 type=write size=4137206 2024-09-12T17:30:33.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.436+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~V3B9M7EED20I.0 size=1048576 2024-09-12T17:30:33.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.437+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~V3B9M7EED20I.1 size=102430 2024-09-12T17:30:33.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.437+0000 7fece65ff780 1 > prepared multipart upload key=LSGN631FW1P8 upload=V3B9M7EED20I tag=GEVETTZYX0BS type=write size=2199582 2024-09-12T17:30:33.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.438+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~QU5I5P4FG2AK.0 size=790619 2024-09-12T17:30:33.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.440+0000 7fece65ff780 1 < completed multipart upload key=IMCE9Z7P4S6R upload=QU5I5P4FG2AK tag=CMFWPO3VTFA4 type=write size=1839195 2024-09-12T17:30:33.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.441+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=QYDVLJXM6FA4 type=del size=3663133 2024-09-12T17:30:33.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.442+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=K6VAL4ABXL2L type=del 2024-09-12T17:30:33.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.443+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=7J9SRT9W6CUL type=del size=2833016 2024-09-12T17:30:33.446 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.444+0000 7fece65ff780 1 < canceled operation key=Q00ZFG0BBDG5 tag=XH2K5880J6NR type=del size=1554257 2024-09-12T17:30:33.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.445+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=2T3ST1QLUSI5 type=del size=3555764 2024-09-12T17:30:33.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.447+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=NY4Y0336VUGX type=del 2024-09-12T17:30:33.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.449+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~DIZ62MIFPJQS.0 size=766514 2024-09-12T17:30:33.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.449+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=DIZ62MIFPJQS tag=AL7MB2H68E9S type=write size=1815090 2024-09-12T17:30:33.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.449+0000 7fece65ff780 1 < canceled part key=_multipart_I7TGK5A3JHH5.2~KXAA1A3TCWUH.0 size=1048576 2024-09-12T17:30:33.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.450+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~KXAA1A3TCWUH.1 size=581809 2024-09-12T17:30:33.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.452+0000 7fece65ff780 1 < canceled multipart upload key=I7TGK5A3JHH5 upload=KXAA1A3TCWUH tag=0I06B1KLJSQT type=write size=2678961 2024-09-12T17:30:33.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.453+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=MO0TTZP2Y5U5 type=del size=1513644 2024-09-12T17:30:33.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.454+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=8NF7WERU0VM9 type=del 2024-09-12T17:30:33.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.455+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=389GOM8BWCTW type=del size=3144840 2024-09-12T17:30:33.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.456+0000 7fece65ff780 1 < canceled part key=_multipart_LSGN631FW1P8.2~DLQ43SIAWNZ5.0 size=1048576 2024-09-12T17:30:33.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.457+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~DLQ43SIAWNZ5.1 size=1048576 2024-09-12T17:30:33.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.458+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~DLQ43SIAWNZ5.2 size=43811 2024-09-12T17:30:33.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.460+0000 7fece65ff780 1 < canceled multipart upload key=LSGN631FW1P8 upload=DLQ43SIAWNZ5 tag=Q4AWPXYEKF47 type=write size=3189539 2024-09-12T17:30:33.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.463+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~JH2WXCLS8V7T.0 size=1048576 2024-09-12T17:30:33.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.464+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~JH2WXCLS8V7T.1 size=978015 2024-09-12T17:30:33.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.464+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=JH2WXCLS8V7T tag=A86YUMASXLT5 type=write size=3075167 2024-09-12T17:30:33.467 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.466+0000 7fece65ff780 1 < completed write operation key=KKU8T0CVS40V tag=9MBYKGIT3CB9 type=write size=265628 2024-09-12T17:30:33.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.467+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=9F9G2HNGNGT0 type=write size=484212 2024-09-12T17:30:33.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.468+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~V77RUMYBU322.0 size=897404 2024-09-12T17:30:33.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.470+0000 7fece65ff780 1 < completed multipart upload key=4Z1N3433MC6A upload=V77RUMYBU322 tag=3MSZT99BHGVP type=write size=1945980 2024-09-12T17:30:33.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.472+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~ZXL5HJ2SLWA9.0 size=178095 2024-09-12T17:30:33.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.472+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=ZXL5HJ2SLWA9 tag=2O8OS3BNEQO5 type=write size=1226671 2024-09-12T17:30:33.475 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.474+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=S34M1NTP8Z3D type=del 2024-09-12T17:30:33.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.475+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=5RHRIG6E11A4 type=del size=3887859 2024-09-12T17:30:33.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.476+0000 7fece65ff780 1 < completed delete operation key=Q00ZFG0BBDG5 tag=T9T2D1T3H8VJ type=del 2024-09-12T17:30:33.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.477+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=WH0Z0AQQX7AJ type=del size=3291280 2024-09-12T17:30:33.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.478+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~3TK9O7UN1W77.0 size=1048576 2024-09-12T17:30:33.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.479+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~3TK9O7UN1W77.1 size=645374 2024-09-12T17:30:33.483 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.481+0000 7fece65ff780 1 < completed multipart upload key=9KYNMM6W7RRM upload=3TK9O7UN1W77 tag=6MDEHJK3A5IE type=write size=2742526 2024-09-12T17:30:33.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.482+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=H1QQK5U9L292 type=del size=1263982 2024-09-12T17:30:33.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.484+0000 7fece65ff780 1 < canceled operation key=IMCE9Z7P4S6R tag=DQPNU7I82UIK type=write size=844798 2024-09-12T17:30:33.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.485+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=T1JQWRDTC03O type=del size=1434380 2024-09-12T17:30:33.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.486+0000 7fece65ff780 1 < completed delete operation key=Q00ZFG0BBDG5 tag=38T31I79WQGE type=del 2024-09-12T17:30:33.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.487+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=NOESXF4P84TW type=write size=222715 2024-09-12T17:30:33.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.489+0000 7fece65ff780 1 < completed write operation key=LSGN631FW1P8 tag=0UWCB8EHK8L0 type=write size=210090 2024-09-12T17:30:33.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.491+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=7BMMITXEN6SR type=del size=2085785 2024-09-12T17:30:33.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.492+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~V3B9M7EED20I.0 size=1048576 2024-09-12T17:30:33.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.492+0000 7fece65ff780 1 < canceled part key=_multipart_LSGN631FW1P8.2~V3B9M7EED20I.1 size=102430 2024-09-12T17:30:33.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.494+0000 7fece65ff780 1 < canceled multipart upload key=LSGN631FW1P8 upload=V3B9M7EED20I tag=GEVETTZYX0BS type=write size=2199582 2024-09-12T17:30:33.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.495+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=ZOPU0XJCBN7C type=del size=100304 2024-09-12T17:30:33.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.497+0000 7fece65ff780 1 < suggested update operation key=Q00ZFG0BBDG5 tag=QYDVLJXM6FA4 type=del size=3663133 2024-09-12T17:30:33.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.500+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~E91XJHHH969B.0 size=1048576 2024-09-12T17:30:33.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.501+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~E91XJHHH969B.1 size=816355 2024-09-12T17:30:33.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.501+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=E91XJHHH969B tag=C2U3HYYVD7OQ type=write size=2913507 2024-09-12T17:30:33.503 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.502+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=7J9SRT9W6CUL type=del 2024-09-12T17:30:33.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.504+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~RZNUDN1GYBL0.0 size=1048576 2024-09-12T17:30:33.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.505+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~RZNUDN1GYBL0.1 size=50954 2024-09-12T17:30:33.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.505+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=RZNUDN1GYBL0 tag=U0G7ZYUE5F05 type=write size=2148106 2024-09-12T17:30:33.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.506+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=2T3ST1QLUSI5 type=del 2024-09-12T17:30:33.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.508+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=QPPE1LW7LKAT type=del size=711983 2024-09-12T17:30:33.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.509+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~DIZ62MIFPJQS.0 size=766514 2024-09-12T17:30:33.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.511+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=DIZ62MIFPJQS tag=AL7MB2H68E9S type=write size=1815090 2024-09-12T17:30:33.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.512+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=L8GACCMQ11DZ type=del size=2590655 2024-09-12T17:30:33.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.513+0000 7fece65ff780 1 < completed delete operation key=7AS5L998SDV7 tag=MO0TTZP2Y5U5 type=del 2024-09-12T17:30:33.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.516+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~9TLPL66QE6KB.0 size=1048576 2024-09-12T17:30:33.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.517+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~9TLPL66QE6KB.1 size=445820 2024-09-12T17:30:33.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.517+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=9TLPL66QE6KB tag=OZ500YNBX7MP type=write size=2542972 2024-09-12T17:30:33.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.518+0000 7fece65ff780 1 < canceled operation key=6CCPZ4TVIU5N tag=389GOM8BWCTW type=del size=3144840 2024-09-12T17:30:33.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.520+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~LY3EBELTSBEP.0 size=1048576 2024-09-12T17:30:33.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.521+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~LY3EBELTSBEP.1 size=1048576 2024-09-12T17:30:33.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.522+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~LY3EBELTSBEP.2 size=941585 2024-09-12T17:30:33.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.522+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=LY3EBELTSBEP tag=V781U5MZWPSE type=write size=4087313 2024-09-12T17:30:33.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.523+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~JH2WXCLS8V7T.0 size=1048576 2024-09-12T17:30:33.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.526+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~JH2WXCLS8V7T.1 size=978015 2024-09-12T17:30:33.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.528+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=JH2WXCLS8V7T tag=A86YUMASXLT5 type=write size=3075167 2024-09-12T17:30:33.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.530+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~4C922REOLXIR.0 size=1048576 2024-09-12T17:30:33.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.532+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~4C922REOLXIR.1 size=1048576 2024-09-12T17:30:33.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.533+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~4C922REOLXIR.2 size=1036603 2024-09-12T17:30:33.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.533+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=4C922REOLXIR tag=LHHB9H4B3GAX type=write size=4182331 2024-09-12T17:30:33.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.536+0000 7fece65ff780 1 < suggested remove operation key=1G9VNO1V4IMW tag=9F9G2HNGNGT0 type=write 2024-09-12T17:30:33.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.537+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=7DO40DMGV5FL type=del size=2314261 2024-09-12T17:30:33.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.539+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~ZXL5HJ2SLWA9.0 size=178095 2024-09-12T17:30:33.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.541+0000 7fece65ff780 1 < completed multipart upload key=IMCE9Z7P4S6R upload=ZXL5HJ2SLWA9 tag=2O8OS3BNEQO5 type=write size=1226671 2024-09-12T17:30:33.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.544+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~YASW8OGRSEVU.0 size=1048576 2024-09-12T17:30:33.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.545+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~YASW8OGRSEVU.1 size=1048576 2024-09-12T17:30:33.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.546+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~YASW8OGRSEVU.2 size=699706 2024-09-12T17:30:33.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.546+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=YASW8OGRSEVU tag=MV2DCGVL1YZ0 type=write size=3845434 2024-09-12T17:30:33.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.547+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=5RHRIG6E11A4 type=del 2024-09-12T17:30:33.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.548+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=PE8RTOBMO76C type=del size=2788384 2024-09-12T17:30:33.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.550+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=WH0Z0AQQX7AJ type=del 2024-09-12T17:30:33.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.551+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=CQKQXN13AC3A type=del size=2184262 2024-09-12T17:30:33.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.552+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=H1QQK5U9L292 type=del 2024-09-12T17:30:33.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.555+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~SGMO6QF7C43F.0 size=1048576 2024-09-12T17:30:33.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.556+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~SGMO6QF7C43F.1 size=1048576 2024-09-12T17:30:33.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.557+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~SGMO6QF7C43F.2 size=580169 2024-09-12T17:30:33.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.557+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=SGMO6QF7C43F tag=O9VRD6XPP33H type=write size=3725897 2024-09-12T17:30:33.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.558+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=T1JQWRDTC03O type=del 2024-09-12T17:30:33.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.559+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=W1482YP2M41E type=del size=1295566 2024-09-12T17:30:33.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.561+0000 7fece65ff780 1 < completed write operation key=Y1OT1OLGWB1Q tag=NOESXF4P84TW type=write size=222715 2024-09-12T17:30:33.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.563+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~LQLZ7GGQLCHX.0 size=156203 2024-09-12T17:30:33.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.563+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=LQLZ7GGQLCHX tag=LCBPORC3KE3K type=write size=1204779 2024-09-12T17:30:33.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.564+0000 7fece65ff780 -1 < no bi entry to suggest for operation key=1G9VNO1V4IMW tag=7BMMITXEN6SR type=del size=2085785: (2) No such file or directory 2024-09-12T17:30:33.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.566+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~YXU1CKBGK1C8.0 size=1048576 2024-09-12T17:30:33.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.567+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~YXU1CKBGK1C8.1 size=803217 2024-09-12T17:30:33.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.567+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=YXU1CKBGK1C8 tag=A460CGODCGP3 type=write size=2900369 2024-09-12T17:30:33.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.569+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=ZOPU0XJCBN7C type=del 2024-09-12T17:30:33.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.572+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~PJBR8CYEQ0R0.0 size=256442 2024-09-12T17:30:33.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.572+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=PJBR8CYEQ0R0 tag=YB8OSTE6KYBW type=write size=1305018 2024-09-12T17:30:33.575 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.573+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~E91XJHHH969B.0 size=1048576 2024-09-12T17:30:33.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.574+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~E91XJHHH969B.1 size=816355 2024-09-12T17:30:33.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.577+0000 7fece65ff780 1 < completed multipart upload key=2HTNXL56URAK upload=E91XJHHH969B tag=C2U3HYYVD7OQ type=write size=2913507 2024-09-12T17:30:33.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.579+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~91683OX2S7R9.0 size=1048576 2024-09-12T17:30:33.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.580+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~91683OX2S7R9.1 size=895982 2024-09-12T17:30:33.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.580+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=91683OX2S7R9 tag=6BT27B1PXHOC type=write size=2993134 2024-09-12T17:30:33.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.582+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~RZNUDN1GYBL0.0 size=1048576 2024-09-12T17:30:33.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.583+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~RZNUDN1GYBL0.1 size=50954 2024-09-12T17:30:33.586 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.585+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=RZNUDN1GYBL0 tag=U0G7ZYUE5F05 type=write size=2148106 2024-09-12T17:30:33.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.587+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~NWYOTEW4745X.0 size=1048576 2024-09-12T17:30:33.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.588+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~NWYOTEW4745X.1 size=1048576 2024-09-12T17:30:33.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.589+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~NWYOTEW4745X.2 size=575631 2024-09-12T17:30:33.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.589+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=NWYOTEW4745X tag=H3PFWZAQ55Z6 type=write size=3721359 2024-09-12T17:30:33.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.590+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=QPPE1LW7LKAT type=del 2024-09-12T17:30:33.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.593+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~VUVWTGPF1I5J.0 size=1048576 2024-09-12T17:30:33.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.594+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~VUVWTGPF1I5J.1 size=330741 2024-09-12T17:30:33.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.594+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=VUVWTGPF1I5J tag=YN913F0ZONAK type=write size=2427893 2024-09-12T17:30:33.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.595+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=L8GACCMQ11DZ type=del 2024-09-12T17:30:33.599 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.597+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~R8O5UZ9RQTUC.0 size=1048576 2024-09-12T17:30:33.600 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.598+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~R8O5UZ9RQTUC.1 size=1048576 2024-09-12T17:30:33.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.599+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~R8O5UZ9RQTUC.2 size=837216 2024-09-12T17:30:33.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.599+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=R8O5UZ9RQTUC tag=YK5IV3PNZ1KS type=write size=3982944 2024-09-12T17:30:33.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.600+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~9TLPL66QE6KB.0 size=1048576 2024-09-12T17:30:33.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.601+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~9TLPL66QE6KB.1 size=445820 2024-09-12T17:30:33.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.604+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=9TLPL66QE6KB tag=OZ500YNBX7MP type=write size=2542972 2024-09-12T17:30:33.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.605+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=B9LPDCB47W8E type=del size=3606009 2024-09-12T17:30:33.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.606+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~LY3EBELTSBEP.0 size=1048576 2024-09-12T17:30:33.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.607+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~LY3EBELTSBEP.1 size=1048576 2024-09-12T17:30:33.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.608+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~LY3EBELTSBEP.2 size=941585 2024-09-12T17:30:33.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.611+0000 7fece65ff780 1 < completed multipart upload key=4Z1N3433MC6A upload=LY3EBELTSBEP tag=V781U5MZWPSE type=write size=4087313 2024-09-12T17:30:33.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.614+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~4WFXDWSMBSZH.0 size=1048576 2024-09-12T17:30:33.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.614+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~4WFXDWSMBSZH.1 size=942379 2024-09-12T17:30:33.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.615+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=4WFXDWSMBSZH tag=M3AFP2T87OTZ type=write size=3039531 2024-09-12T17:30:33.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.616+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~4C922REOLXIR.0 size=1048576 2024-09-12T17:30:33.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.617+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~4C922REOLXIR.1 size=1048576 2024-09-12T17:30:33.619 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.618+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~4C922REOLXIR.2 size=1036603 2024-09-12T17:30:33.621 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.620+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=4C922REOLXIR tag=LHHB9H4B3GAX type=write size=4182331 2024-09-12T17:30:33.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.622+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~IY5A16AOCO3O.0 size=1048576 2024-09-12T17:30:33.624 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.623+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~IY5A16AOCO3O.1 size=1048576 2024-09-12T17:30:33.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.624+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~IY5A16AOCO3O.2 size=189585 2024-09-12T17:30:33.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.624+0000 7fece65ff780 1 > prepared multipart upload key=LSGN631FW1P8 upload=IY5A16AOCO3O tag=Q2CXLMVSCKB4 type=write size=3335313 2024-09-12T17:30:33.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.625+0000 7fece65ff780 1 < completed delete operation key=Q00ZFG0BBDG5 tag=7DO40DMGV5FL type=del 2024-09-12T17:30:33.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.627+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~2D1DSLRE4F63.0 size=1048576 2024-09-12T17:30:33.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.628+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~2D1DSLRE4F63.1 size=1040437 2024-09-12T17:30:33.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.628+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=2D1DSLRE4F63 tag=2YX86UNACUKK type=write size=3137589 2024-09-12T17:30:33.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.628+0000 7fece65ff780 1 < canceled part key=_multipart_ZEFSNR1IIA10.2~YASW8OGRSEVU.0 size=1048576 2024-09-12T17:30:33.631 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.629+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~YASW8OGRSEVU.1 size=1048576 2024-09-12T17:30:33.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.630+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~YASW8OGRSEVU.2 size=699706 2024-09-12T17:30:33.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.632+0000 7fece65ff780 1 < canceled multipart upload key=ZEFSNR1IIA10 upload=YASW8OGRSEVU tag=MV2DCGVL1YZ0 type=write size=3845434 2024-09-12T17:30:33.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.633+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=UNZGEOKZAVPP type=write size=127752 2024-09-12T17:30:33.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.634+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=PE8RTOBMO76C type=del 2024-09-12T17:30:33.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.636+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~HM8IKNY0EM6D.0 size=1048576 2024-09-12T17:30:33.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.637+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~HM8IKNY0EM6D.1 size=995692 2024-09-12T17:30:33.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.637+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=HM8IKNY0EM6D tag=WE00L0ZRUH1K type=write size=3092844 2024-09-12T17:30:33.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.639+0000 7fece65ff780 1 < suggested update operation key=UN6FLMRMAPUS tag=CQKQXN13AC3A type=del size=2184262 2024-09-12T17:30:33.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.641+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=QT668XGIFKVB type=del size=3556384 2024-09-12T17:30:33.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.642+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~SGMO6QF7C43F.0 size=1048576 2024-09-12T17:30:33.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.643+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~SGMO6QF7C43F.1 size=1048576 2024-09-12T17:30:33.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.644+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~SGMO6QF7C43F.2 size=580169 2024-09-12T17:30:33.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.646+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=SGMO6QF7C43F tag=O9VRD6XPP33H type=write size=3725897 2024-09-12T17:30:33.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.648+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~CI506SHAA9S4.0 size=1048576 2024-09-12T17:30:33.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.649+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~CI506SHAA9S4.1 size=598241 2024-09-12T17:30:33.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.649+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=CI506SHAA9S4 tag=JF17WV43KA35 type=write size=2695393 2024-09-12T17:30:33.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.650+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=W1482YP2M41E type=del 2024-09-12T17:30:33.653 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.652+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=O4LI49A7Q3KC type=del size=2820983 2024-09-12T17:30:33.655 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.653+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~LQLZ7GGQLCHX.0 size=156203 2024-09-12T17:30:33.657 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.655+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=LQLZ7GGQLCHX tag=LCBPORC3KE3K type=write size=1204779 2024-09-12T17:30:33.658 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.656+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=IQPDDOYF7JLW type=write size=367588 2024-09-12T17:30:33.658 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.657+0000 7fece65ff780 1 < canceled part key=_multipart_2HTNXL56URAK.2~YXU1CKBGK1C8.0 size=1048576 2024-09-12T17:30:33.659 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.657+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~YXU1CKBGK1C8.1 size=803217 2024-09-12T17:30:33.661 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.659+0000 7fece65ff780 1 < canceled multipart upload key=2HTNXL56URAK upload=YXU1CKBGK1C8 tag=A460CGODCGP3 type=write size=2900369 2024-09-12T17:30:33.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.662+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~HO7W5FNG2C8Q.0 size=1048576 2024-09-12T17:30:33.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.662+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~HO7W5FNG2C8Q.1 size=171465 2024-09-12T17:30:33.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.662+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=HO7W5FNG2C8Q tag=WO25FEHEGXOZ type=write size=2268617 2024-09-12T17:30:33.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.664+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~PJBR8CYEQ0R0.0 size=256442 2024-09-12T17:30:33.667 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.666+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=PJBR8CYEQ0R0 tag=YB8OSTE6KYBW type=write size=1305018 2024-09-12T17:30:33.668 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.667+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=0T4WHZBU86ZA type=del size=3113709 2024-09-12T17:30:33.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.668+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~91683OX2S7R9.0 size=1048576 2024-09-12T17:30:33.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.669+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~91683OX2S7R9.1 size=895982 2024-09-12T17:30:33.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.671+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=91683OX2S7R9 tag=6BT27B1PXHOC type=write size=2993134 2024-09-12T17:30:33.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.672+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=TO4WEONJ3NWV type=del size=2519295 2024-09-12T17:30:33.675 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.673+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~NWYOTEW4745X.0 size=1048576 2024-09-12T17:30:33.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.674+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~NWYOTEW4745X.1 size=1048576 2024-09-12T17:30:33.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.675+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~NWYOTEW4745X.2 size=575631 2024-09-12T17:30:33.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.677+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=NWYOTEW4745X tag=H3PFWZAQ55Z6 type=write size=3721359 2024-09-12T17:30:33.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.678+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=3472KS606DLG type=del size=1594048 2024-09-12T17:30:33.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.679+0000 7fece65ff780 1 < canceled part key=_multipart_RKFRKIENSBTO.2~VUVWTGPF1I5J.0 size=1048576 2024-09-12T17:30:33.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.680+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~VUVWTGPF1I5J.1 size=330741 2024-09-12T17:30:33.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.682+0000 7fece65ff780 1 < canceled multipart upload key=RKFRKIENSBTO upload=VUVWTGPF1I5J tag=YN913F0ZONAK type=write size=2427893 2024-09-12T17:30:33.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.683+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=WQ37FD99HEUH type=del size=4128852 2024-09-12T17:30:33.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.684+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~R8O5UZ9RQTUC.0 size=1048576 2024-09-12T17:30:33.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.685+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~R8O5UZ9RQTUC.1 size=1048576 2024-09-12T17:30:33.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.686+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~R8O5UZ9RQTUC.2 size=837216 2024-09-12T17:30:33.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.688+0000 7fece65ff780 1 < completed multipart upload key=Q00ZFG0BBDG5 upload=R8O5UZ9RQTUC tag=YK5IV3PNZ1KS type=write size=3982944 2024-09-12T17:30:33.690 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.689+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=WV9EOIQ4XN0O type=del size=1916076 2024-09-12T17:30:33.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.690+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=B9LPDCB47W8E type=del 2024-09-12T17:30:33.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.691+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=W2VLV0BX5Z90 type=del size=503349 2024-09-12T17:30:33.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.692+0000 7fece65ff780 1 < canceled part key=_multipart_YCNQL8CUUGW7.2~4WFXDWSMBSZH.0 size=1048576 2024-09-12T17:30:33.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.693+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~4WFXDWSMBSZH.1 size=942379 2024-09-12T17:30:33.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.695+0000 7fece65ff780 1 < canceled multipart upload key=YCNQL8CUUGW7 upload=4WFXDWSMBSZH tag=M3AFP2T87OTZ type=write size=3039531 2024-09-12T17:30:33.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.696+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=3Q1QQQDFBAQP type=del size=3418365 2024-09-12T17:30:33.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.697+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~IY5A16AOCO3O.0 size=1048576 2024-09-12T17:30:33.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.697+0000 7fece65ff780 1 < canceled part key=_multipart_LSGN631FW1P8.2~IY5A16AOCO3O.1 size=1048576 2024-09-12T17:30:33.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.697+0000 7fece65ff780 1 < canceled part key=_multipart_LSGN631FW1P8.2~IY5A16AOCO3O.2 size=189585 2024-09-12T17:30:33.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.699+0000 7fece65ff780 1 < canceled multipart upload key=LSGN631FW1P8 upload=IY5A16AOCO3O tag=Q2CXLMVSCKB4 type=write size=3335313 2024-09-12T17:30:33.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.700+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=38QF1XUQIT73 type=del size=2339035 2024-09-12T17:30:33.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.702+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~2D1DSLRE4F63.0 size=1048576 2024-09-12T17:30:33.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.703+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~2D1DSLRE4F63.1 size=1040437 2024-09-12T17:30:33.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.705+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=2D1DSLRE4F63 tag=2YX86UNACUKK type=write size=3137589 2024-09-12T17:30:33.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.707+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~LTZZRRXNHD2H.0 size=1048576 2024-09-12T17:30:33.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.708+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~LTZZRRXNHD2H.1 size=347093 2024-09-12T17:30:33.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.708+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=LTZZRRXNHD2H tag=PUHJ5EWD0KWD type=write size=2444245 2024-09-12T17:30:33.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.711+0000 7fece65ff780 1 < suggested remove operation key=YCNQL8CUUGW7 tag=UNZGEOKZAVPP type=write 2024-09-12T17:30:33.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.712+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=JD9RBV1ZDI4H type=del size=1991360 2024-09-12T17:30:33.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.714+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~HM8IKNY0EM6D.0 size=1048576 2024-09-12T17:30:33.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.715+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~HM8IKNY0EM6D.1 size=995692 2024-09-12T17:30:33.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.717+0000 7fece65ff780 1 < completed multipart upload key=9KYNMM6W7RRM upload=HM8IKNY0EM6D tag=WE00L0ZRUH1K type=write size=3092844 2024-09-12T17:30:33.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.718+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=6MEQN7622XRQ type=del size=955720 2024-09-12T17:30:33.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.721+0000 7fece65ff780 1 < suggested update operation key=Q00ZFG0BBDG5 tag=QT668XGIFKVB type=del size=3556384 2024-09-12T17:30:33.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.722+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=FB9I3HD8WFM7 type=del size=2988191 2024-09-12T17:30:33.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.724+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~CI506SHAA9S4.0 size=1048576 2024-09-12T17:30:33.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.725+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~CI506SHAA9S4.1 size=598241 2024-09-12T17:30:33.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.727+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=CI506SHAA9S4 tag=JF17WV43KA35 type=write size=2695393 2024-09-12T17:30:33.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.729+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~DNRP112U895G.0 size=151509 2024-09-12T17:30:33.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.729+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=DNRP112U895G tag=ZX6XJIKLO9QN type=write size=1200085 2024-09-12T17:30:33.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.730+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=O4LI49A7Q3KC type=del 2024-09-12T17:30:33.733 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.731+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=ZSE8P4AP73ZA type=del size=3133488 2024-09-12T17:30:33.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.732+0000 7fece65ff780 1 < completed write operation key=UCBB99EG8XK2 tag=IQPDDOYF7JLW type=write size=367588 2024-09-12T17:30:33.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.733+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=MF72HG7JW17G type=write size=193099 2024-09-12T17:30:33.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.735+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~HO7W5FNG2C8Q.0 size=1048576 2024-09-12T17:30:33.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.736+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~HO7W5FNG2C8Q.1 size=171465 2024-09-12T17:30:33.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.738+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=HO7W5FNG2C8Q tag=WO25FEHEGXOZ type=write size=2268617 2024-09-12T17:30:33.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.739+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=4OEKBLX98HSS type=del size=2430780 2024-09-12T17:30:33.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.740+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=0T4WHZBU86ZA type=del 2024-09-12T17:30:33.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.742+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=MX45ZVLKQJ4F type=del size=3190646 2024-09-12T17:30:33.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.744+0000 7fece65ff780 1 < suggested remove operation key=RKFRKIENSBTO tag=TO4WEONJ3NWV type=del 2024-09-12T17:30:33.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.745+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=X8O8I22FLI5G type=del size=884254 2024-09-12T17:30:33.748 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.747+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=3472KS606DLG type=del 2024-09-12T17:30:33.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.748+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=1GC1WCM9E8WN type=write size=859273 2024-09-12T17:30:33.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.749+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=WQ37FD99HEUH type=del 2024-09-12T17:30:33.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.751+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~LLWE426O6IJP.0 size=940942 2024-09-12T17:30:33.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.751+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=LLWE426O6IJP tag=ALXWQB2T9ZTT type=write size=1989518 2024-09-12T17:30:33.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.753+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=WV9EOIQ4XN0O type=del 2024-09-12T17:30:33.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.755+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~NFIOSAIUFJ7G.0 size=1048576 2024-09-12T17:30:33.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.756+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~NFIOSAIUFJ7G.1 size=1048576 2024-09-12T17:30:33.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.757+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~NFIOSAIUFJ7G.2 size=308263 2024-09-12T17:30:33.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.757+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=NFIOSAIUFJ7G tag=SXA4R5CLKM7F type=write size=3453991 2024-09-12T17:30:33.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.759+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=W2VLV0BX5Z90 type=del 2024-09-12T17:30:33.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.760+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=GO7YZQWTZEPR type=del size=9924 2024-09-12T17:30:33.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.761+0000 7fece65ff780 1 < completed delete operation key=IMCE9Z7P4S6R tag=3Q1QQQDFBAQP type=del 2024-09-12T17:30:33.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.762+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=5RPVZSWEO5FB type=del size=124121 2024-09-12T17:30:33.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.764+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=38QF1XUQIT73 type=del 2024-09-12T17:30:33.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.765+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=E48NA4XXA9D9 type=del size=3073265 2024-09-12T17:30:33.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.766+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~LTZZRRXNHD2H.0 size=1048576 2024-09-12T17:30:33.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.767+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~LTZZRRXNHD2H.1 size=347093 2024-09-12T17:30:33.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.769+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=LTZZRRXNHD2H tag=PUHJ5EWD0KWD type=write size=2444245 2024-09-12T17:30:33.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.770+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=F5FGGTR224MU type=write size=365170 2024-09-12T17:30:33.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.771+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=JD9RBV1ZDI4H type=del 2024-09-12T17:30:33.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.773+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=01RCYR7QQ1TH type=write size=944311 2024-09-12T17:30:33.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.774+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=6MEQN7622XRQ type=del 2024-09-12T17:30:33.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.776+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~G9XOBJL89B5F.0 size=207460 2024-09-12T17:30:33.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.776+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=G9XOBJL89B5F tag=WHMCYOV1FA7D type=write size=1256036 2024-09-12T17:30:33.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.778+0000 7fece65ff780 1 < suggested remove operation key=4Z1N3433MC6A tag=FB9I3HD8WFM7 type=del 2024-09-12T17:30:33.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.779+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=RKAP14R9L2M3 type=del size=945302 2024-09-12T17:30:33.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.780+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~DNRP112U895G.0 size=151509 2024-09-12T17:30:33.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.782+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=DNRP112U895G tag=ZX6XJIKLO9QN type=write size=1200085 2024-09-12T17:30:33.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.783+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=CHJQ6ZRDDXR0 type=del size=2734099 2024-09-12T17:30:33.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.784+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=ZSE8P4AP73ZA type=del 2024-09-12T17:30:33.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.786+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=964KENK47Q2X type=del size=4068208 2024-09-12T17:30:33.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.787+0000 7fece65ff780 1 < completed write operation key=6GUDX5I1AKNH tag=MF72HG7JW17G type=write size=193099 2024-09-12T17:30:33.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.789+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~7WUG9FZJAIVE.0 size=1048576 2024-09-12T17:30:33.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.790+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~7WUG9FZJAIVE.1 size=450528 2024-09-12T17:30:33.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.790+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=7WUG9FZJAIVE tag=7SWFLVQ8TOI1 type=write size=2547680 2024-09-12T17:30:33.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.791+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=4OEKBLX98HSS type=del 2024-09-12T17:30:33.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.792+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=TMYQJVV0EYCJ type=del size=3858545 2024-09-12T17:30:33.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.793+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=MX45ZVLKQJ4F type=del 2024-09-12T17:30:33.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.795+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=C4KVW2AQ6S1T type=del size=1064099 2024-09-12T17:30:33.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.796+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=X8O8I22FLI5G type=del 2024-09-12T17:30:33.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.797+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=VO06HWB7AUPP type=write size=632188 2024-09-12T17:30:33.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.799+0000 7fece65ff780 1 < suggested remove operation key=ZEFSNR1IIA10 tag=1GC1WCM9E8WN type=write 2024-09-12T17:30:33.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.802+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~BH2GQ26SNGJD.0 size=1048576 2024-09-12T17:30:33.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.803+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~BH2GQ26SNGJD.1 size=1048576 2024-09-12T17:30:33.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.804+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~BH2GQ26SNGJD.2 size=290273 2024-09-12T17:30:33.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.804+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=BH2GQ26SNGJD tag=5NECG05S643U type=write size=3436001 2024-09-12T17:30:33.807 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.805+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~LLWE426O6IJP.0 size=940942 2024-09-12T17:30:33.809 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.807+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=LLWE426O6IJP tag=ALXWQB2T9ZTT type=write size=1989518 2024-09-12T17:30:33.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.808+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=M5MFRZLFK4EG type=write size=230620 2024-09-12T17:30:33.811 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.810+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~NFIOSAIUFJ7G.0 size=1048576 2024-09-12T17:30:33.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.810+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~NFIOSAIUFJ7G.1 size=1048576 2024-09-12T17:30:33.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.811+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~NFIOSAIUFJ7G.2 size=308263 2024-09-12T17:30:33.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.813+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=NFIOSAIUFJ7G tag=SXA4R5CLKM7F type=write size=3453991 2024-09-12T17:30:33.816 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.815+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=ZITZG1JZA1HL type=write size=679443 2024-09-12T17:30:33.822 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.817+0000 7fece65ff780 1 < suggested remove operation key=W3MBKNIBLV7W tag=GO7YZQWTZEPR type=del 2024-09-12T17:30:33.822 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.820+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~RX62LGJ9A314.0 size=1048576 2024-09-12T17:30:33.822 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.821+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~RX62LGJ9A314.1 size=672887 2024-09-12T17:30:33.822 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.821+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=RX62LGJ9A314 tag=O9UFE5SH20SS type=write size=2770039 2024-09-12T17:30:33.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.823+0000 7fece65ff780 1 < suggested update operation key=9IGJG88NX1FS tag=5RPVZSWEO5FB type=del size=124121 2024-09-12T17:30:33.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.825+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=KY0QQPC0YDHV type=write size=767520 2024-09-12T17:30:33.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.826+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=E48NA4XXA9D9 type=del 2024-09-12T17:30:33.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.828+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=39M9LQNOQKWP type=del size=3116823 2024-09-12T17:30:33.831 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.829+0000 7fece65ff780 1 < canceled operation key=5A7WPGW5P91B tag=F5FGGTR224MU type=write size=365170 2024-09-12T17:30:33.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.830+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=3SL2WPPZAXL7 type=write size=647780 2024-09-12T17:30:33.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.832+0000 7fece65ff780 1 < completed write operation key=Y1OT1OLGWB1Q tag=01RCYR7QQ1TH type=write size=944311 2024-09-12T17:30:33.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.833+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=R8A05GWX3PY5 type=del size=942334 2024-09-12T17:30:33.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.835+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~G9XOBJL89B5F.0 size=207460 2024-09-12T17:30:33.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.838+0000 7fece65ff780 1 < completed multipart upload key=FX8VJO1YXJ4H upload=G9XOBJL89B5F tag=WHMCYOV1FA7D type=write size=1256036 2024-09-12T17:30:33.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.841+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~SVNI98NAT0K8.0 size=1048576 2024-09-12T17:30:33.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.842+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~SVNI98NAT0K8.1 size=700186 2024-09-12T17:30:33.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.842+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=SVNI98NAT0K8 tag=V24AAQCXBBI3 type=write size=2797338 2024-09-12T17:30:33.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.843+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=RKAP14R9L2M3 type=del 2024-09-12T17:30:33.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.845+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=FNP4600YKVO6 type=del size=3617944 2024-09-12T17:30:33.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.845+0000 7fece65ff780 -1 < no bi entry to suggest for operation key=W3MBKNIBLV7W tag=CHJQ6ZRDDXR0 type=del size=2734099: (2) No such file or directory 2024-09-12T17:30:33.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.847+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=E4LKCE1G858E type=del size=482441 2024-09-12T17:30:33.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.848+0000 7fece65ff780 1 < completed delete operation key=7AS5L998SDV7 tag=964KENK47Q2X type=del 2024-09-12T17:30:33.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.851+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~C252R57T1V0F.0 size=1048576 2024-09-12T17:30:33.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.852+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~C252R57T1V0F.1 size=1048576 2024-09-12T17:30:33.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.853+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~C252R57T1V0F.2 size=101862 2024-09-12T17:30:33.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.853+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=C252R57T1V0F tag=D2785FT45H02 type=write size=3247590 2024-09-12T17:30:33.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.853+0000 7fece65ff780 1 < canceled part key=_multipart_UCBB99EG8XK2.2~7WUG9FZJAIVE.0 size=1048576 2024-09-12T17:30:33.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.854+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~7WUG9FZJAIVE.1 size=450528 2024-09-12T17:30:33.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.857+0000 7fece65ff780 1 < canceled multipart upload key=UCBB99EG8XK2 upload=7WUG9FZJAIVE tag=7SWFLVQ8TOI1 type=write size=2547680 2024-09-12T17:30:33.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.858+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=9LZNLVSEC7CC type=del size=146797 2024-09-12T17:30:33.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.859+0000 7fece65ff780 1 < canceled operation key=I7TGK5A3JHH5 tag=TMYQJVV0EYCJ type=del size=3858545 2024-09-12T17:30:33.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.861+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~MPMPAD3P0NA1.0 size=1048576 2024-09-12T17:30:33.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.862+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~MPMPAD3P0NA1.1 size=1048576 2024-09-12T17:30:33.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.863+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~MPMPAD3P0NA1.2 size=299619 2024-09-12T17:30:33.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.863+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=MPMPAD3P0NA1 tag=LEA3QHOI900I type=write size=3445347 2024-09-12T17:30:33.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.865+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=C4KVW2AQ6S1T type=del 2024-09-12T17:30:33.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.867+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~9IS0MJLB5SNM.0 size=89525 2024-09-12T17:30:33.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.867+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=9IS0MJLB5SNM tag=3FBLVG6B49F3 type=write size=1138101 2024-09-12T17:30:33.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.869+0000 7fece65ff780 1 < completed write operation key=CBYI6C1ICE08 tag=VO06HWB7AUPP type=write size=632188 2024-09-12T17:30:33.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.871+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~8RDV1Z3GN3VG.0 size=1048576 2024-09-12T17:30:33.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.872+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~8RDV1Z3GN3VG.1 size=1048576 2024-09-12T17:30:33.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.873+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~8RDV1Z3GN3VG.2 size=87415 2024-09-12T17:30:33.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.873+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=8RDV1Z3GN3VG tag=7O9NDH40PT7J type=write size=3233143 2024-09-12T17:30:33.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.874+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~BH2GQ26SNGJD.0 size=1048576 2024-09-12T17:30:33.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.875+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~BH2GQ26SNGJD.1 size=1048576 2024-09-12T17:30:33.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.876+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~BH2GQ26SNGJD.2 size=290273 2024-09-12T17:30:33.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.878+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=BH2GQ26SNGJD tag=5NECG05S643U type=write size=3436001 2024-09-12T17:30:33.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.879+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=FUN2N0I41017 type=del size=1762820 2024-09-12T17:30:33.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.880+0000 7fece65ff780 1 < completed write operation key=RKFRKIENSBTO tag=M5MFRZLFK4EG type=write size=230620 2024-09-12T17:30:33.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.882+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=EZDILTDL97DJ type=del size=521788 2024-09-12T17:30:33.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.883+0000 7fece65ff780 1 < completed write operation key=ZEFSNR1IIA10 tag=ZITZG1JZA1HL type=write size=679443 2024-09-12T17:30:33.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.884+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=IB3Q9JNJ2U96 type=write size=893377 2024-09-12T17:30:33.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.885+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~RX62LGJ9A314.0 size=1048576 2024-09-12T17:30:33.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.886+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~RX62LGJ9A314.1 size=672887 2024-09-12T17:30:33.890 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.888+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=RX62LGJ9A314 tag=O9UFE5SH20SS type=write size=2770039 2024-09-12T17:30:33.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.890+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=0RBH0SZNEY77 type=write size=265773 2024-09-12T17:30:33.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.891+0000 7fece65ff780 1 < completed write operation key=Y30269Q7R340 tag=KY0QQPC0YDHV type=write size=767520 2024-09-12T17:30:33.894 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.892+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=WCCJ4ZV9ASOA type=del size=2002136 2024-09-12T17:30:33.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.893+0000 7fece65ff780 1 < canceled operation key=5A7WPGW5P91B tag=39M9LQNOQKWP type=del size=3116823 2024-09-12T17:30:33.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.895+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=7JFRK5XEV68Y type=del size=4042386 2024-09-12T17:30:33.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.896+0000 7fece65ff780 1 < completed write operation key=OIHDAJMPUK4I tag=3SL2WPPZAXL7 type=write size=647780 2024-09-12T17:30:33.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.899+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=2548BEQX1R0Y type=del size=225832 2024-09-12T17:30:33.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.901+0000 7fece65ff780 1 < suggested update operation key=Y1OT1OLGWB1Q tag=R8A05GWX3PY5 type=del size=942334 2024-09-12T17:30:33.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.902+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=QQMZ6DY9XKXN type=del size=248092 2024-09-12T17:30:33.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.903+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~SVNI98NAT0K8.0 size=1048576 2024-09-12T17:30:33.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.903+0000 7fece65ff780 1 < canceled part key=_multipart_7AS5L998SDV7.2~SVNI98NAT0K8.1 size=700186 2024-09-12T17:30:33.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.905+0000 7fece65ff780 1 < canceled multipart upload key=7AS5L998SDV7 upload=SVNI98NAT0K8 tag=V24AAQCXBBI3 type=write size=2797338 2024-09-12T17:30:33.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.908+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~ZK1R460SX6G0.0 size=200212 2024-09-12T17:30:33.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.908+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=ZK1R460SX6G0 tag=2D2IC6X1TLQF type=write size=1248788 2024-09-12T17:30:33.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.910+0000 7fece65ff780 1 < suggested remove operation key=TLEZIJ4881G7 tag=FNP4600YKVO6 type=del 2024-09-12T17:30:33.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.912+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~IDPCLUSP455W.0 size=1048576 2024-09-12T17:30:33.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.913+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~IDPCLUSP455W.1 size=1048576 2024-09-12T17:30:33.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.914+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~IDPCLUSP455W.2 size=147442 2024-09-12T17:30:33.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.914+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=IDPCLUSP455W tag=5P2JQXEWGL73 type=write size=3293170 2024-09-12T17:30:33.918 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.916+0000 7fece65ff780 1 < suggested remove operation key=QQNW20B28RJC tag=E4LKCE1G858E type=del 2024-09-12T17:30:33.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.918+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=9PRTX32CILQV type=del size=3656099 2024-09-12T17:30:33.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.919+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~C252R57T1V0F.0 size=1048576 2024-09-12T17:30:33.922 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.920+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~C252R57T1V0F.1 size=1048576 2024-09-12T17:30:33.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.921+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~C252R57T1V0F.2 size=101862 2024-09-12T17:30:33.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.923+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=C252R57T1V0F tag=D2785FT45H02 type=write size=3247590 2024-09-12T17:30:33.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.925+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~UIHGDU8Q9W1M.0 size=109125 2024-09-12T17:30:33.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.925+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=UIHGDU8Q9W1M tag=YLU5IMBCGGDO type=write size=1157701 2024-09-12T17:30:33.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.927+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=9LZNLVSEC7CC type=del 2024-09-12T17:30:33.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.929+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~9Y5D24KD2D2M.0 size=1048576 2024-09-12T17:30:33.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.930+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~9Y5D24KD2D2M.1 size=1048576 2024-09-12T17:30:33.932 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.931+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~9Y5D24KD2D2M.2 size=1025738 2024-09-12T17:30:33.932 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.931+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=9Y5D24KD2D2M tag=2VTEKYOEGB68 type=write size=4171466 2024-09-12T17:30:33.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.932+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~MPMPAD3P0NA1.0 size=1048576 2024-09-12T17:30:33.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.933+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~MPMPAD3P0NA1.1 size=1048576 2024-09-12T17:30:33.935 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.934+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~MPMPAD3P0NA1.2 size=299619 2024-09-12T17:30:33.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.936+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=MPMPAD3P0NA1 tag=LEA3QHOI900I type=write size=3445347 2024-09-12T17:30:33.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.938+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~CBD8TIFB0YYJ.0 size=737094 2024-09-12T17:30:33.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.938+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=CBD8TIFB0YYJ tag=7DAS72K8OOHI type=write size=1785670 2024-09-12T17:30:33.941 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.940+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~9IS0MJLB5SNM.0 size=89525 2024-09-12T17:30:33.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.942+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=9IS0MJLB5SNM tag=3FBLVG6B49F3 type=write size=1138101 2024-09-12T17:30:33.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.943+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=L7VS9V8RR1BT type=del size=1704986 2024-09-12T17:30:33.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.944+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~8RDV1Z3GN3VG.0 size=1048576 2024-09-12T17:30:33.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.944+0000 7fece65ff780 1 < canceled part key=_multipart_807GX4RQQLL4.2~8RDV1Z3GN3VG.1 size=1048576 2024-09-12T17:30:33.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.945+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~8RDV1Z3GN3VG.2 size=87415 2024-09-12T17:30:33.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.947+0000 7fece65ff780 1 < canceled multipart upload key=807GX4RQQLL4 upload=8RDV1Z3GN3VG tag=7O9NDH40PT7J type=write size=3233143 2024-09-12T17:30:33.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.949+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=N1RRBY50I6PR type=del size=1067336 2024-09-12T17:30:33.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.950+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=FUN2N0I41017 type=del 2024-09-12T17:30:33.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.951+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=UP8UTV5VLX7Y type=del size=11963 2024-09-12T17:30:33.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.952+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=EZDILTDL97DJ type=del 2024-09-12T17:30:33.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.955+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~ESX3RAA13Z43.0 size=534494 2024-09-12T17:30:33.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.955+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=ESX3RAA13Z43 tag=06U5MK19N7BQ type=write size=1583070 2024-09-12T17:30:33.959 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.958+0000 7fece65ff780 1 < suggested update operation key=Q00ZFG0BBDG5 tag=IB3Q9JNJ2U96 type=write size=893377 2024-09-12T17:30:33.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.960+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~NR9CS8X92FQP.0 size=1048576 2024-09-12T17:30:33.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.961+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~NR9CS8X92FQP.1 size=1048576 2024-09-12T17:30:33.964 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.962+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~NR9CS8X92FQP.2 size=347591 2024-09-12T17:30:33.964 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.962+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=NR9CS8X92FQP tag=GDKDLQFYFEQD type=write size=3493319 2024-09-12T17:30:33.965 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.963+0000 7fece65ff780 1 < completed write operation key=Y30269Q7R340 tag=0RBH0SZNEY77 type=write size=265773 2024-09-12T17:30:33.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.966+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~M4RI3K8BR2IL.0 size=1015723 2024-09-12T17:30:33.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.966+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=M4RI3K8BR2IL tag=GXZ0L0ZXK8VE type=write size=2064299 2024-09-12T17:30:33.968 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.967+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=WCCJ4ZV9ASOA type=del 2024-09-12T17:30:33.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.969+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~9QVNII7S15RL.0 size=364960 2024-09-12T17:30:33.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.969+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=9QVNII7S15RL tag=21MUGBEU2A9M type=write size=1413536 2024-09-12T17:30:33.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.970+0000 7fece65ff780 -1 < no bi entry to suggest for operation key=TLEZIJ4881G7 tag=7JFRK5XEV68Y type=del size=4042386: (2) No such file or directory 2024-09-12T17:30:33.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.972+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~6XHNOP9EE72Q.0 size=1048576 2024-09-12T17:30:33.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.973+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~6XHNOP9EE72Q.1 size=404677 2024-09-12T17:30:33.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.973+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=6XHNOP9EE72Q tag=8ISE48616KW8 type=write size=2501829 2024-09-12T17:30:33.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.974+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=2548BEQX1R0Y type=del 2024-09-12T17:30:33.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.976+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~1K95RVBGP4W7.0 size=362308 2024-09-12T17:30:33.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.976+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=1K95RVBGP4W7 tag=6W2TUMSUZGBX type=write size=1410884 2024-09-12T17:30:33.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.977+0000 7fece65ff780 -1 < failed to complete operation key=QQNW20B28RJC tag=QQMZ6DY9XKXN type=del size=248092: (22) Invalid argument 2024-09-12T17:30:33.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.979+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=6FU0WHRANPGQ type=del size=3394573 2024-09-12T17:30:33.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.980+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~ZK1R460SX6G0.0 size=200212 2024-09-12T17:30:33.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.982+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=ZK1R460SX6G0 tag=2D2IC6X1TLQF type=write size=1248788 2024-09-12T17:30:33.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.984+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=282EUAZC8EV4 type=del size=771694 2024-09-12T17:30:33.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.985+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~IDPCLUSP455W.0 size=1048576 2024-09-12T17:30:33.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.986+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~IDPCLUSP455W.1 size=1048576 2024-09-12T17:30:33.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.987+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~IDPCLUSP455W.2 size=147442 2024-09-12T17:30:33.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.990+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=IDPCLUSP455W tag=5P2JQXEWGL73 type=write size=3293170 2024-09-12T17:30:33.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.992+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~NWTGH0RBR4HI.0 size=1048576 2024-09-12T17:30:33.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.993+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~NWTGH0RBR4HI.1 size=1048576 2024-09-12T17:30:33.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.994+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~NWTGH0RBR4HI.2 size=865418 2024-09-12T17:30:33.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.994+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=NWTGH0RBR4HI tag=EA6UF2RAOMAP type=write size=4011146 2024-09-12T17:30:33.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.995+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=9PRTX32CILQV type=del 2024-09-12T17:30:33.998 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.997+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=M80DZLP28GPM type=write size=678171 2024-09-12T17:30:34.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:33.998+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~UIHGDU8Q9W1M.0 size=109125 2024-09-12T17:30:34.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.000+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=UIHGDU8Q9W1M tag=YLU5IMBCGGDO type=write size=1157701 2024-09-12T17:30:34.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.003+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~TRRE9WUGG8HB.0 size=1048576 2024-09-12T17:30:34.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.004+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~TRRE9WUGG8HB.1 size=895781 2024-09-12T17:30:34.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.004+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=TRRE9WUGG8HB tag=CCDID6QQILZK type=write size=2992933 2024-09-12T17:30:34.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.005+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~9Y5D24KD2D2M.0 size=1048576 2024-09-12T17:30:34.008 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.006+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~9Y5D24KD2D2M.1 size=1048576 2024-09-12T17:30:34.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.007+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~9Y5D24KD2D2M.2 size=1025738 2024-09-12T17:30:34.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.010+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=9Y5D24KD2D2M tag=2VTEKYOEGB68 type=write size=4171466 2024-09-12T17:30:34.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.011+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=293R4HBDADTJ type=write size=476974 2024-09-12T17:30:34.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.012+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~CBD8TIFB0YYJ.0 size=737094 2024-09-12T17:30:34.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.014+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=CBD8TIFB0YYJ tag=7DAS72K8OOHI type=write size=1785670 2024-09-12T17:30:34.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.016+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=HS1QN2407KXW type=write size=77881 2024-09-12T17:30:34.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.017+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=L7VS9V8RR1BT type=del 2024-09-12T17:30:34.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.019+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~CDMC3FKJNA24.0 size=1048576 2024-09-12T17:30:34.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.020+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~CDMC3FKJNA24.1 size=1048576 2024-09-12T17:30:34.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.021+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~CDMC3FKJNA24.2 size=324848 2024-09-12T17:30:34.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.021+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=CDMC3FKJNA24 tag=5MBXUMT0W82F type=write size=3470576 2024-09-12T17:30:34.024 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.022+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=N1RRBY50I6PR type=del 2024-09-12T17:30:34.026 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.024+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~ZKO9E3JRFK79.0 size=1048576 2024-09-12T17:30:34.027 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.025+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~ZKO9E3JRFK79.1 size=356401 2024-09-12T17:30:34.027 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.025+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=ZKO9E3JRFK79 tag=J429TO31OZ52 type=write size=2453553 2024-09-12T17:30:34.028 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.027+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=UP8UTV5VLX7Y type=del 2024-09-12T17:30:34.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.029+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~GIFT98BLPIS0.0 size=1048576 2024-09-12T17:30:34.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.030+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~GIFT98BLPIS0.1 size=1048576 2024-09-12T17:30:34.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.031+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~GIFT98BLPIS0.2 size=323062 2024-09-12T17:30:34.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.031+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=GIFT98BLPIS0 tag=HVDEAJPLC0EZ type=write size=3468790 2024-09-12T17:30:34.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.032+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~ESX3RAA13Z43.0 size=534494 2024-09-12T17:30:34.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.034+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=ESX3RAA13Z43 tag=06U5MK19N7BQ type=write size=1583070 2024-09-12T17:30:34.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.035+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=QGES6GLBBUW4 type=del size=793117 2024-09-12T17:30:34.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.036+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~NR9CS8X92FQP.0 size=1048576 2024-09-12T17:30:34.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.037+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~NR9CS8X92FQP.1 size=1048576 2024-09-12T17:30:34.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.038+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~NR9CS8X92FQP.2 size=347591 2024-09-12T17:30:34.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.040+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=NR9CS8X92FQP tag=GDKDLQFYFEQD type=write size=3493319 2024-09-12T17:30:34.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.042+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~LYHV8KOWPFAD.0 size=1048576 2024-09-12T17:30:34.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.043+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~LYHV8KOWPFAD.1 size=597403 2024-09-12T17:30:34.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.043+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=LYHV8KOWPFAD tag=KYPZYV037D62 type=write size=2694555 2024-09-12T17:30:34.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.045+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~M4RI3K8BR2IL.0 size=1015723 2024-09-12T17:30:34.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.047+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=M4RI3K8BR2IL tag=GXZ0L0ZXK8VE type=write size=2064299 2024-09-12T17:30:34.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.048+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=UJZUU85PEAWN type=del size=2776009 2024-09-12T17:30:34.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.048+0000 7fece65ff780 1 < canceled part key=_multipart_9KYNMM6W7RRM.2~9QVNII7S15RL.0 size=364960 2024-09-12T17:30:34.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.050+0000 7fece65ff780 1 < canceled multipart upload key=9KYNMM6W7RRM upload=9QVNII7S15RL tag=21MUGBEU2A9M type=write size=1413536 2024-09-12T17:30:34.053 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.051+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=ZQNV7W9322QD type=del size=1976962 2024-09-12T17:30:34.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.053+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~6XHNOP9EE72Q.0 size=1048576 2024-09-12T17:30:34.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.053+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~6XHNOP9EE72Q.1 size=404677 2024-09-12T17:30:34.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.056+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=6XHNOP9EE72Q tag=8ISE48616KW8 type=write size=2501829 2024-09-12T17:30:34.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.057+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=VL8IG75BW41V type=del size=3336545 2024-09-12T17:30:34.060 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.058+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~1K95RVBGP4W7.0 size=362308 2024-09-12T17:30:34.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.060+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=1K95RVBGP4W7 tag=6W2TUMSUZGBX type=write size=1410884 2024-09-12T17:30:34.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.062+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~SQECJ5TXW1D1.0 size=898424 2024-09-12T17:30:34.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.062+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=SQECJ5TXW1D1 tag=2WY4L1V8HSIC type=write size=1947000 2024-09-12T17:30:34.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.063+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=6FU0WHRANPGQ type=del 2024-09-12T17:30:34.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.065+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=M92GWTK8QSKC type=del size=1872103 2024-09-12T17:30:34.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.066+0000 7fece65ff780 1 < canceled operation key=5LAOX5H1AQWJ tag=282EUAZC8EV4 type=del size=771694 2024-09-12T17:30:34.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.067+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=Z27WQLDIWII4 type=del size=3861095 2024-09-12T17:30:34.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.068+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~NWTGH0RBR4HI.0 size=1048576 2024-09-12T17:30:34.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.069+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~NWTGH0RBR4HI.1 size=1048576 2024-09-12T17:30:34.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.072+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~NWTGH0RBR4HI.2 size=865418 2024-09-12T17:30:34.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.074+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=NWTGH0RBR4HI tag=EA6UF2RAOMAP type=write size=4011146 2024-09-12T17:30:34.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.076+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~95KU8DJ28YKJ.0 size=1048576 2024-09-12T17:30:34.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.077+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~95KU8DJ28YKJ.1 size=1048576 2024-09-12T17:30:34.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.078+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~95KU8DJ28YKJ.2 size=477552 2024-09-12T17:30:34.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.078+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=95KU8DJ28YKJ tag=FVQKH5X11PA4 type=write size=3623280 2024-09-12T17:30:34.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.079+0000 7fece65ff780 1 < completed write operation key=IMCE9Z7P4S6R tag=M80DZLP28GPM type=write size=678171 2024-09-12T17:30:34.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.081+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=02R32MY99HKK type=del size=3133284 2024-09-12T17:30:34.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.082+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~TRRE9WUGG8HB.0 size=1048576 2024-09-12T17:30:34.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.083+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~TRRE9WUGG8HB.1 size=895781 2024-09-12T17:30:34.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.085+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=TRRE9WUGG8HB tag=CCDID6QQILZK type=write size=2992933 2024-09-12T17:30:34.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.088+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~JLGMIE8U2Z5Z.0 size=1048576 2024-09-12T17:30:34.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.088+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~JLGMIE8U2Z5Z.1 size=1048576 2024-09-12T17:30:34.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.090+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~JLGMIE8U2Z5Z.2 size=295975 2024-09-12T17:30:34.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.090+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=JLGMIE8U2Z5Z tag=ORNQ62L4Y321 type=write size=3441703 2024-09-12T17:30:34.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.091+0000 7fece65ff780 1 < completed write operation key=UCBB99EG8XK2 tag=293R4HBDADTJ type=write size=476974 2024-09-12T17:30:34.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.092+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=VN19IZ4DT1FJ type=del size=960304 2024-09-12T17:30:34.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.093+0000 7fece65ff780 1 < completed write operation key=UCBB99EG8XK2 tag=HS1QN2407KXW type=write size=77881 2024-09-12T17:30:34.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.096+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~PA9KFR1EL77L.0 size=1048576 2024-09-12T17:30:34.098 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.096+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~PA9KFR1EL77L.1 size=104528 2024-09-12T17:30:34.098 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.096+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=PA9KFR1EL77L tag=EY7XS9IMH393 type=write size=2201680 2024-09-12T17:30:34.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.098+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~CDMC3FKJNA24.0 size=1048576 2024-09-12T17:30:34.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.099+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~CDMC3FKJNA24.1 size=1048576 2024-09-12T17:30:34.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.100+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~CDMC3FKJNA24.2 size=324848 2024-09-12T17:30:34.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.102+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=CDMC3FKJNA24 tag=5MBXUMT0W82F type=write size=3470576 2024-09-12T17:30:34.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.103+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=1NODQPYS4IYH type=del size=4061478 2024-09-12T17:30:34.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.104+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~ZKO9E3JRFK79.0 size=1048576 2024-09-12T17:30:34.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.105+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~ZKO9E3JRFK79.1 size=356401 2024-09-12T17:30:34.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.107+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=ZKO9E3JRFK79 tag=J429TO31OZ52 type=write size=2453553 2024-09-12T17:30:34.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.109+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~0463VQZ3YZN1.0 size=781515 2024-09-12T17:30:34.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.109+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=0463VQZ3YZN1 tag=DJYHS223FAFD type=write size=1830091 2024-09-12T17:30:34.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.110+0000 7fece65ff780 1 < canceled part key=_multipart_CBYI6C1ICE08.2~GIFT98BLPIS0.0 size=1048576 2024-09-12T17:30:34.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.110+0000 7fece65ff780 1 < canceled part key=_multipart_CBYI6C1ICE08.2~GIFT98BLPIS0.1 size=1048576 2024-09-12T17:30:34.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.110+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~GIFT98BLPIS0.2 size=323062 2024-09-12T17:30:34.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.112+0000 7fece65ff780 1 < canceled multipart upload key=CBYI6C1ICE08 upload=GIFT98BLPIS0 tag=HVDEAJPLC0EZ type=write size=3468790 2024-09-12T17:30:34.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.113+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=SJK2S8CTFF8I type=del size=13072 2024-09-12T17:30:34.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.116+0000 7fece65ff780 1 < suggested remove operation key=6GUDX5I1AKNH tag=QGES6GLBBUW4 type=del 2024-09-12T17:30:34.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.117+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=ZX2I5FA34S4X type=del size=569644 2024-09-12T17:30:34.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.118+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~LYHV8KOWPFAD.0 size=1048576 2024-09-12T17:30:34.121 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.119+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~LYHV8KOWPFAD.1 size=597403 2024-09-12T17:30:34.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.121+0000 7fece65ff780 1 < completed multipart upload key=Q00ZFG0BBDG5 upload=LYHV8KOWPFAD tag=KYPZYV037D62 type=write size=2694555 2024-09-12T17:30:34.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.122+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=XS8BR9C64BI0 type=del size=752494 2024-09-12T17:30:34.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.123+0000 7fece65ff780 1 < completed delete operation key=IMCE9Z7P4S6R tag=UJZUU85PEAWN type=del 2024-09-12T17:30:34.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.125+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~QGD6JR120DDI.0 size=1048576 2024-09-12T17:30:34.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.126+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~QGD6JR120DDI.1 size=1048576 2024-09-12T17:30:34.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.127+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~QGD6JR120DDI.2 size=696351 2024-09-12T17:30:34.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.127+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=QGD6JR120DDI tag=V0OK9U10CDCL type=write size=3842079 2024-09-12T17:30:34.129 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.128+0000 7fece65ff780 1 < completed delete operation key=OIHDAJMPUK4I tag=ZQNV7W9322QD type=del 2024-09-12T17:30:34.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.129+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=GGJWRAFFUH03 type=write size=746874 2024-09-12T17:30:34.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.130+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=VL8IG75BW41V type=del 2024-09-12T17:30:34.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.131+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=N70MWOPK5U02 type=del size=1038953 2024-09-12T17:30:34.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.132+0000 7fece65ff780 1 < canceled part key=_multipart_OPMR1WMB14CA.2~SQECJ5TXW1D1.0 size=898424 2024-09-12T17:30:34.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.133+0000 7fece65ff780 1 < canceled multipart upload key=OPMR1WMB14CA upload=SQECJ5TXW1D1 tag=2WY4L1V8HSIC type=write size=1947000 2024-09-12T17:30:34.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.136+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~XG7L4S11YCX7.0 size=796378 2024-09-12T17:30:34.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.136+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=XG7L4S11YCX7 tag=AKRJX80OH035 type=write size=1844954 2024-09-12T17:30:34.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.137+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=M92GWTK8QSKC type=del 2024-09-12T17:30:34.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.138+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=TO50VZVQIKF5 type=del size=874163 2024-09-12T17:30:34.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.139+0000 7fece65ff780 1 < canceled operation key=Y30269Q7R340 tag=Z27WQLDIWII4 type=del size=3861095 2024-09-12T17:30:34.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.140+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=1CXR4F7DI0E0 type=del size=12970 2024-09-12T17:30:34.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.142+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~95KU8DJ28YKJ.0 size=1048576 2024-09-12T17:30:34.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.143+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~95KU8DJ28YKJ.1 size=1048576 2024-09-12T17:30:34.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.144+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~95KU8DJ28YKJ.2 size=477552 2024-09-12T17:30:34.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.146+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=95KU8DJ28YKJ tag=FVQKH5X11PA4 type=write size=3623280 2024-09-12T17:30:34.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.147+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=F5NPF86SBCZQ type=del size=630897 2024-09-12T17:30:34.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.148+0000 7fece65ff780 -1 < no bi entry to suggest for operation key=6GUDX5I1AKNH tag=02R32MY99HKK type=del size=3133284: (2) No such file or directory 2024-09-12T17:30:34.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.149+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=RZEZOPDCZYPT type=del size=603347 2024-09-12T17:30:34.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.150+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~JLGMIE8U2Z5Z.0 size=1048576 2024-09-12T17:30:34.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.151+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~JLGMIE8U2Z5Z.1 size=1048576 2024-09-12T17:30:34.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.151+0000 7fece65ff780 1 < canceled part key=_multipart_I7TGK5A3JHH5.2~JLGMIE8U2Z5Z.2 size=295975 2024-09-12T17:30:34.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.153+0000 7fece65ff780 1 < canceled multipart upload key=I7TGK5A3JHH5 upload=JLGMIE8U2Z5Z tag=ORNQ62L4Y321 type=write size=3441703 2024-09-12T17:30:34.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.155+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=6BNZ9D1ZCXYT type=del size=2838744 2024-09-12T17:30:34.157 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.156+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=VN19IZ4DT1FJ type=del 2024-09-12T17:30:34.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.158+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~SNEJS1MQA2BH.0 size=1048576 2024-09-12T17:30:34.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.159+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~SNEJS1MQA2BH.1 size=529063 2024-09-12T17:30:34.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.159+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=SNEJS1MQA2BH tag=8ZTLC1ZAVT2V type=write size=2626215 2024-09-12T17:30:34.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.161+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~PA9KFR1EL77L.0 size=1048576 2024-09-12T17:30:34.164 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.162+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~PA9KFR1EL77L.1 size=104528 2024-09-12T17:30:34.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.164+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=PA9KFR1EL77L tag=EY7XS9IMH393 type=write size=2201680 2024-09-12T17:30:34.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.165+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=HK315C31LQZE type=del size=4148430 2024-09-12T17:30:34.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.167+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=1NODQPYS4IYH type=del 2024-09-12T17:30:34.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.168+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=W9MXBJ1MDM0A type=del size=2999197 2024-09-12T17:30:34.171 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.169+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~0463VQZ3YZN1.0 size=781515 2024-09-12T17:30:34.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.172+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=0463VQZ3YZN1 tag=DJYHS223FAFD type=write size=1830091 2024-09-12T17:30:34.174 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.173+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=71N9I9F4BG4U type=write size=212516 2024-09-12T17:30:34.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.174+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=SJK2S8CTFF8I type=del 2024-09-12T17:30:34.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.177+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~VTB4FR4SPZ21.0 size=1048576 2024-09-12T17:30:34.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.178+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~VTB4FR4SPZ21.1 size=945556 2024-09-12T17:30:34.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.178+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=VTB4FR4SPZ21 tag=3KCVMBZJ8M10 type=write size=3042708 2024-09-12T17:30:34.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.179+0000 7fece65ff780 1 < completed delete operation key=7AS5L998SDV7 tag=ZX2I5FA34S4X type=del 2024-09-12T17:30:34.182 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.180+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=CJ3AXNLDHFJS type=del size=1462455 2024-09-12T17:30:34.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.182+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=XS8BR9C64BI0 type=del 2024-09-12T17:30:34.185 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.183+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=3QX77661V0TS type=del size=3904992 2024-09-12T17:30:34.186 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.185+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~QGD6JR120DDI.0 size=1048576 2024-09-12T17:30:34.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.187+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~QGD6JR120DDI.1 size=1048576 2024-09-12T17:30:34.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.188+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~QGD6JR120DDI.2 size=696351 2024-09-12T17:30:34.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.191+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=QGD6JR120DDI tag=V0OK9U10CDCL type=write size=3842079 2024-09-12T17:30:34.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.192+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=ZAQTV83QJTQC type=write size=464344 2024-09-12T17:30:34.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.193+0000 7fece65ff780 1 < canceled operation key=Q00ZFG0BBDG5 tag=GGJWRAFFUH03 type=write size=746874 2024-09-12T17:30:34.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.196+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~DKNKHFBKIOU7.0 size=1048576 2024-09-12T17:30:34.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.197+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~DKNKHFBKIOU7.1 size=1048576 2024-09-12T17:30:34.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.198+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~DKNKHFBKIOU7.2 size=80317 2024-09-12T17:30:34.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.198+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=DKNKHFBKIOU7 tag=M3CD1L6HSTD8 type=write size=3226045 2024-09-12T17:30:34.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.199+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=N70MWOPK5U02 type=del 2024-09-12T17:30:34.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.200+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=V7FPS65JSZLJ type=del size=517374 2024-09-12T17:30:34.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.202+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~XG7L4S11YCX7.0 size=796378 2024-09-12T17:30:34.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.204+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=XG7L4S11YCX7 tag=AKRJX80OH035 type=write size=1844954 2024-09-12T17:30:34.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.205+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=JAO33C6OPLLX type=del size=2112020 2024-09-12T17:30:34.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.206+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=TO50VZVQIKF5 type=del 2024-09-12T17:30:34.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.208+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=8UIM9Y3ORGLW type=del size=3222046 2024-09-12T17:30:34.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.209+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=1CXR4F7DI0E0 type=del 2024-09-12T17:30:34.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.210+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=OIR2S37IUZXP type=write size=501811 2024-09-12T17:30:34.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.212+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=F5NPF86SBCZQ type=del 2024-09-12T17:30:34.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.213+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=KY602HJ939IZ type=del size=2041449 2024-09-12T17:30:34.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.214+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=RZEZOPDCZYPT type=del 2024-09-12T17:30:34.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.215+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=CI42315XDHAR type=del size=3398069 2024-09-12T17:30:34.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.217+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=6BNZ9D1ZCXYT type=del 2024-09-12T17:30:34.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.219+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~Z5NTH4F805UU.0 size=1048576 2024-09-12T17:30:34.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.220+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~Z5NTH4F805UU.1 size=1048576 2024-09-12T17:30:34.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.221+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~Z5NTH4F805UU.2 size=193173 2024-09-12T17:30:34.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.221+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=Z5NTH4F805UU tag=ON1389YBOIJW type=write size=3338901 2024-09-12T17:30:34.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.222+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~SNEJS1MQA2BH.0 size=1048576 2024-09-12T17:30:34.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.222+0000 7fece65ff780 1 < canceled part key=_multipart_CBYI6C1ICE08.2~SNEJS1MQA2BH.1 size=529063 2024-09-12T17:30:34.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.224+0000 7fece65ff780 1 < canceled multipart upload key=CBYI6C1ICE08 upload=SNEJS1MQA2BH tag=8ZTLC1ZAVT2V type=write size=2626215 2024-09-12T17:30:34.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.226+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~CZSKQ3JOXMJ6.0 size=1048576 2024-09-12T17:30:34.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.228+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~CZSKQ3JOXMJ6.1 size=1048576 2024-09-12T17:30:34.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.229+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~CZSKQ3JOXMJ6.2 size=138670 2024-09-12T17:30:34.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.229+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=CZSKQ3JOXMJ6 tag=YETAE2WVTZGM type=write size=3284398 2024-09-12T17:30:34.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.231+0000 7fece65ff780 1 < suggested remove operation key=6CCPZ4TVIU5N tag=HK315C31LQZE type=del 2024-09-12T17:30:34.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.233+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~ZD0TBSREOHZ1.0 size=559826 2024-09-12T17:30:34.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.233+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=ZD0TBSREOHZ1 tag=4SKI8IQP14Z6 type=write size=1608402 2024-09-12T17:30:34.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.234+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=W9MXBJ1MDM0A type=del 2024-09-12T17:30:34.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.236+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=HPW599243FQO type=del size=3150102 2024-09-12T17:30:34.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.239+0000 7fece65ff780 1 < suggested update operation key=CEERZVBJQHP0 tag=71N9I9F4BG4U type=write size=212516 2024-09-12T17:30:34.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.241+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=5ELWPR23S3Q9 type=del size=3867481 2024-09-12T17:30:34.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.242+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~VTB4FR4SPZ21.0 size=1048576 2024-09-12T17:30:34.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.243+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~VTB4FR4SPZ21.1 size=945556 2024-09-12T17:30:34.246 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.245+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=VTB4FR4SPZ21 tag=3KCVMBZJ8M10 type=write size=3042708 2024-09-12T17:30:34.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.246+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=8P4GZVO9IYL0 type=del size=1059174 2024-09-12T17:30:34.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.247+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=CJ3AXNLDHFJS type=del 2024-09-12T17:30:34.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.248+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=T10FOUGRSNRF type=del size=3992053 2024-09-12T17:30:34.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.249+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=3QX77661V0TS type=del 2024-09-12T17:30:34.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.252+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~QCF42XQ4H2CG.0 size=1048576 2024-09-12T17:30:34.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.253+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~QCF42XQ4H2CG.1 size=1048576 2024-09-12T17:30:34.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.254+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~QCF42XQ4H2CG.2 size=104122 2024-09-12T17:30:34.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.254+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=QCF42XQ4H2CG tag=O3FTX06VDRRF type=write size=3249850 2024-09-12T17:30:34.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.255+0000 7fece65ff780 1 < canceled operation key=OPMR1WMB14CA tag=ZAQTV83QJTQC type=write size=464344 2024-09-12T17:30:34.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.256+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=IJ8P0KQ48PL9 type=write size=275084 2024-09-12T17:30:34.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.258+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~DKNKHFBKIOU7.0 size=1048576 2024-09-12T17:30:34.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.259+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~DKNKHFBKIOU7.1 size=1048576 2024-09-12T17:30:34.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.260+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~DKNKHFBKIOU7.2 size=80317 2024-09-12T17:30:34.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.262+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=DKNKHFBKIOU7 tag=M3CD1L6HSTD8 type=write size=3226045 2024-09-12T17:30:34.265 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.263+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=QIB4FGNCM0M2 type=write size=896899 2024-09-12T17:30:34.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.264+0000 7fece65ff780 1 < completed delete operation key=IMCE9Z7P4S6R tag=V7FPS65JSZLJ type=del 2024-09-12T17:30:34.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.267+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~K05Z258X106U.0 size=1048576 2024-09-12T17:30:34.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.268+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~K05Z258X106U.1 size=599467 2024-09-12T17:30:34.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.268+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=K05Z258X106U tag=2HMYGTREJF6K type=write size=2696619 2024-09-12T17:30:34.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.269+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=JAO33C6OPLLX type=del 2024-09-12T17:30:34.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.272+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~O6W51LCP39G5.0 size=1048576 2024-09-12T17:30:34.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.273+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~O6W51LCP39G5.1 size=1048576 2024-09-12T17:30:34.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.274+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~O6W51LCP39G5.2 size=205230 2024-09-12T17:30:34.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.274+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=O6W51LCP39G5 tag=LHNIPTLY80J6 type=write size=3350958 2024-09-12T17:30:34.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.275+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=8UIM9Y3ORGLW type=del 2024-09-12T17:30:34.279 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.277+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~0ELEGITI0D08.0 size=567392 2024-09-12T17:30:34.279 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.277+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=0ELEGITI0D08 tag=S077H0D8OHJN type=write size=1615968 2024-09-12T17:30:34.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.278+0000 7fece65ff780 1 < completed write operation key=5A7WPGW5P91B tag=OIR2S37IUZXP type=write size=501811 2024-09-12T17:30:34.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.281+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~1Q7BCE7J9RQX.0 size=1048576 2024-09-12T17:30:34.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.282+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~1Q7BCE7J9RQX.1 size=790555 2024-09-12T17:30:34.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.282+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=1Q7BCE7J9RQX tag=GF3MHWABMJG1 type=write size=2887707 2024-09-12T17:30:34.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.283+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=KY602HJ939IZ type=del 2024-09-12T17:30:34.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.284+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=VWEJQ20OGV47 type=del size=2178339 2024-09-12T17:30:34.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.286+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=CI42315XDHAR type=del 2024-09-12T17:30:34.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.287+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=I8H9T4FG758C type=del size=780922 2024-09-12T17:30:34.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.288+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~Z5NTH4F805UU.0 size=1048576 2024-09-12T17:30:34.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.289+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~Z5NTH4F805UU.1 size=1048576 2024-09-12T17:30:34.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.290+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~Z5NTH4F805UU.2 size=193173 2024-09-12T17:30:34.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.293+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=Z5NTH4F805UU tag=ON1389YBOIJW type=write size=3338901 2024-09-12T17:30:34.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.294+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=7AWFNKHH15FN type=write size=825673 2024-09-12T17:30:34.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.294+0000 7fece65ff780 1 < canceled part key=_multipart_4Z1N3433MC6A.2~CZSKQ3JOXMJ6.0 size=1048576 2024-09-12T17:30:34.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.295+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~CZSKQ3JOXMJ6.1 size=1048576 2024-09-12T17:30:34.298 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.296+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~CZSKQ3JOXMJ6.2 size=138670 2024-09-12T17:30:34.300 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.298+0000 7fece65ff780 1 < canceled multipart upload key=4Z1N3433MC6A upload=CZSKQ3JOXMJ6 tag=YETAE2WVTZGM type=write size=3284398 2024-09-12T17:30:34.301 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.299+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=2UPWW150RBVG type=del size=2003970 2024-09-12T17:30:34.302 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.301+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~ZD0TBSREOHZ1.0 size=559826 2024-09-12T17:30:34.304 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.303+0000 7fece65ff780 1 < completed multipart upload key=I31CKY20NO9S upload=ZD0TBSREOHZ1 tag=4SKI8IQP14Z6 type=write size=1608402 2024-09-12T17:30:34.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.304+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=OWV5X3NPXI42 type=del size=1456289 2024-09-12T17:30:34.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.306+0000 7fece65ff780 1 < canceled operation key=W3MBKNIBLV7W tag=HPW599243FQO type=del size=3150102 2024-09-12T17:30:34.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.308+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~NYOWFUUPI45X.0 size=357179 2024-09-12T17:30:34.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.308+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=NYOWFUUPI45X tag=S5QGDSSWPG5F type=write size=1405755 2024-09-12T17:30:34.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.310+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=5ELWPR23S3Q9 type=del 2024-09-12T17:30:34.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.311+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=A4HSLXPFRWM3 type=del size=3857713 2024-09-12T17:30:34.314 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.312+0000 7fece65ff780 1 < canceled operation key=I7TGK5A3JHH5 tag=8P4GZVO9IYL0 type=del size=1059174 2024-09-12T17:30:34.316 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.314+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~LKIU62JZYWH3.0 size=1048576 2024-09-12T17:30:34.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.315+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~LKIU62JZYWH3.1 size=299341 2024-09-12T17:30:34.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.315+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=LKIU62JZYWH3 tag=27ZZ4E0ORU8Y type=write size=2396493 2024-09-12T17:30:34.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.318+0000 7fece65ff780 1 < suggested remove operation key=RKFRKIENSBTO tag=T10FOUGRSNRF type=del 2024-09-12T17:30:34.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.319+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=ZWHMV59Q4IY2 type=write size=130922 2024-09-12T17:30:34.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.321+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~QCF42XQ4H2CG.0 size=1048576 2024-09-12T17:30:34.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.322+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~QCF42XQ4H2CG.1 size=1048576 2024-09-12T17:30:34.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.323+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~QCF42XQ4H2CG.2 size=104122 2024-09-12T17:30:34.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.325+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=QCF42XQ4H2CG tag=O3FTX06VDRRF type=write size=3249850 2024-09-12T17:30:34.328 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.327+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=JRFDDDC43RGN type=del size=3269744 2024-09-12T17:30:34.330 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.328+0000 7fece65ff780 1 < completed write operation key=OPMR1WMB14CA tag=IJ8P0KQ48PL9 type=write size=275084 2024-09-12T17:30:34.332 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.330+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~DHTGB80I22Q1.0 size=1048576 2024-09-12T17:30:34.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.331+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~DHTGB80I22Q1.1 size=1048576 2024-09-12T17:30:34.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.332+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~DHTGB80I22Q1.2 size=417753 2024-09-12T17:30:34.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.332+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=DHTGB80I22Q1 tag=1Z0IYP2CD90N type=write size=3563481 2024-09-12T17:30:34.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.334+0000 7fece65ff780 1 < completed write operation key=6GUDX5I1AKNH tag=QIB4FGNCM0M2 type=write size=896899 2024-09-12T17:30:34.337 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.335+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=9KAVGTAW15K4 type=write size=71706 2024-09-12T17:30:34.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.337+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~K05Z258X106U.0 size=1048576 2024-09-12T17:30:34.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.338+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~K05Z258X106U.1 size=599467 2024-09-12T17:30:34.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.340+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=K05Z258X106U tag=2HMYGTREJF6K type=write size=2696619 2024-09-12T17:30:34.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.342+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~IAXLQ31QS0AC.0 size=329595 2024-09-12T17:30:34.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.342+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=IAXLQ31QS0AC tag=49Y9412I8GFU type=write size=1378171 2024-09-12T17:30:34.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.345+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~O6W51LCP39G5.0 size=1048576 2024-09-12T17:30:34.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.346+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~O6W51LCP39G5.1 size=1048576 2024-09-12T17:30:34.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.347+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~O6W51LCP39G5.2 size=205230 2024-09-12T17:30:34.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.349+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=O6W51LCP39G5 tag=LHNIPTLY80J6 type=write size=3350958 2024-09-12T17:30:34.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.350+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=5SDXUVVVYWX6 type=del size=2197288 2024-09-12T17:30:34.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.352+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~0ELEGITI0D08.0 size=567392 2024-09-12T17:30:34.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.354+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=0ELEGITI0D08 tag=S077H0D8OHJN type=write size=1615968 2024-09-12T17:30:34.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.356+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~51R5Q0BD9A7H.0 size=1048576 2024-09-12T17:30:34.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.357+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~51R5Q0BD9A7H.1 size=680158 2024-09-12T17:30:34.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.357+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=51R5Q0BD9A7H tag=0373UHPGOA1N type=write size=2777310 2024-09-12T17:30:34.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.358+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~1Q7BCE7J9RQX.0 size=1048576 2024-09-12T17:30:34.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.359+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~1Q7BCE7J9RQX.1 size=790555 2024-09-12T17:30:34.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.361+0000 7fece65ff780 1 < completed multipart upload key=5A7WPGW5P91B upload=1Q7BCE7J9RQX tag=GF3MHWABMJG1 type=write size=2887707 2024-09-12T17:30:34.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.363+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=FTRY57OJRLS3 type=del size=195682 2024-09-12T17:30:34.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.364+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=VWEJQ20OGV47 type=del 2024-09-12T17:30:34.368 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.366+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~X3BO4LMP0TRF.0 size=1048576 2024-09-12T17:30:34.369 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.367+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~X3BO4LMP0TRF.1 size=478480 2024-09-12T17:30:34.369 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.367+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=X3BO4LMP0TRF tag=5V25ALLDAF0H type=write size=2575632 2024-09-12T17:30:34.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.368+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=I8H9T4FG758C type=del 2024-09-12T17:30:34.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.369+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=JU0E1H4XBWKR type=del size=2600643 2024-09-12T17:30:34.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.371+0000 7fece65ff780 1 < completed write operation key=807GX4RQQLL4 tag=7AWFNKHH15FN type=write size=825673 2024-09-12T17:30:34.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.373+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~6VEFW11EVFR2.0 size=1048576 2024-09-12T17:30:34.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.374+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~6VEFW11EVFR2.1 size=1048576 2024-09-12T17:30:34.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.375+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~6VEFW11EVFR2.2 size=38639 2024-09-12T17:30:34.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.375+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=6VEFW11EVFR2 tag=I029THXTBOG4 type=write size=3184367 2024-09-12T17:30:34.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.377+0000 7fece65ff780 1 < suggested update operation key=LSGN631FW1P8 tag=2UPWW150RBVG type=del size=2003970 2024-09-12T17:30:34.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.379+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=UZWT39IE40QX type=del size=1603037 2024-09-12T17:30:34.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.380+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=OWV5X3NPXI42 type=del 2024-09-12T17:30:34.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.381+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=KUS0MH0WJNT1 type=write size=285117 2024-09-12T17:30:34.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.383+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~NYOWFUUPI45X.0 size=357179 2024-09-12T17:30:34.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.385+0000 7fece65ff780 1 < completed multipart upload key=FX8VJO1YXJ4H upload=NYOWFUUPI45X tag=S5QGDSSWPG5F type=write size=1405755 2024-09-12T17:30:34.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.387+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~9P3NSWNWH62X.0 size=1048576 2024-09-12T17:30:34.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.388+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~9P3NSWNWH62X.1 size=1048576 2024-09-12T17:30:34.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.389+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~9P3NSWNWH62X.2 size=264140 2024-09-12T17:30:34.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.389+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=9P3NSWNWH62X tag=RV6GZO48ZOS7 type=write size=3409868 2024-09-12T17:30:34.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.390+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=A4HSLXPFRWM3 type=del 2024-09-12T17:30:34.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.391+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=17IY9WJB21BK type=del size=274508 2024-09-12T17:30:34.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.392+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~LKIU62JZYWH3.0 size=1048576 2024-09-12T17:30:34.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.393+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~LKIU62JZYWH3.1 size=299341 2024-09-12T17:30:34.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.395+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=LKIU62JZYWH3 tag=27ZZ4E0ORU8Y type=write size=2396493 2024-09-12T17:30:34.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.397+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=4WWTM3DPHAOS type=del size=3419575 2024-09-12T17:30:34.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.398+0000 7fece65ff780 1 < completed write operation key=I7TGK5A3JHH5 tag=ZWHMV59Q4IY2 type=write size=130922 2024-09-12T17:30:34.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.400+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~1BDMCIJDD6TM.0 size=1048576 2024-09-12T17:30:34.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.401+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~1BDMCIJDD6TM.1 size=74338 2024-09-12T17:30:34.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.401+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=1BDMCIJDD6TM tag=9GK9SOH4YB2S type=write size=2171490 2024-09-12T17:30:34.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.402+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=JRFDDDC43RGN type=del 2024-09-12T17:30:34.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.403+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=7T7TFLXE6INS type=del size=678007 2024-09-12T17:30:34.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.404+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~DHTGB80I22Q1.0 size=1048576 2024-09-12T17:30:34.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.405+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~DHTGB80I22Q1.1 size=1048576 2024-09-12T17:30:34.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.406+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~DHTGB80I22Q1.2 size=417753 2024-09-12T17:30:34.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.408+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=DHTGB80I22Q1 tag=1Z0IYP2CD90N type=write size=3563481 2024-09-12T17:30:34.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.410+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=YEQGHF2KYH9K type=del size=2689390 2024-09-12T17:30:34.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.411+0000 7fece65ff780 1 < completed write operation key=RKFRKIENSBTO tag=9KAVGTAW15K4 type=write size=71706 2024-09-12T17:30:34.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.412+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=G9IMNM2NCQYT type=del size=2812165 2024-09-12T17:30:34.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.414+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~IAXLQ31QS0AC.0 size=329595 2024-09-12T17:30:34.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.415+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=IAXLQ31QS0AC tag=49Y9412I8GFU type=write size=1378171 2024-09-12T17:30:34.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.417+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=FIVJRL8ZNDVZ type=del size=371018 2024-09-12T17:30:34.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.418+0000 7fece65ff780 1 < completed delete operation key=7AS5L998SDV7 tag=5SDXUVVVYWX6 type=del 2024-09-12T17:30:34.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.420+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=A2LT8QKFWMDU type=write size=884684 2024-09-12T17:30:34.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.420+0000 7fece65ff780 1 < canceled part key=_multipart_RKFRKIENSBTO.2~51R5Q0BD9A7H.0 size=1048576 2024-09-12T17:30:34.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.421+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~51R5Q0BD9A7H.1 size=680158 2024-09-12T17:30:34.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.425+0000 7fece65ff780 1 < canceled multipart upload key=RKFRKIENSBTO upload=51R5Q0BD9A7H tag=0373UHPGOA1N type=write size=2777310 2024-09-12T17:30:34.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.426+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=0OR1JAFAGNHK type=del size=3710682 2024-09-12T17:30:34.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.427+0000 7fece65ff780 1 < canceled operation key=2HTNXL56URAK tag=FTRY57OJRLS3 type=del size=195682 2024-09-12T17:30:34.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.428+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=Q7O630QIBY48 type=del size=3662273 2024-09-12T17:30:34.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.430+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~X3BO4LMP0TRF.0 size=1048576 2024-09-12T17:30:34.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.431+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~X3BO4LMP0TRF.1 size=478480 2024-09-12T17:30:34.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.433+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=X3BO4LMP0TRF tag=5V25ALLDAF0H type=write size=2575632 2024-09-12T17:30:34.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.435+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~S1ATX6BB3OQB.0 size=1048576 2024-09-12T17:30:34.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.436+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~S1ATX6BB3OQB.1 size=1048576 2024-09-12T17:30:34.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.437+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~S1ATX6BB3OQB.2 size=638736 2024-09-12T17:30:34.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.437+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=S1ATX6BB3OQB tag=N5L6X5L6GLLE type=write size=3784464 2024-09-12T17:30:34.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.440+0000 7fece65ff780 1 < suggested update operation key=UCBB99EG8XK2 tag=JU0E1H4XBWKR type=del size=2600643 2024-09-12T17:30:34.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.441+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=5FXEED35H7YO type=del size=2605633 2024-09-12T17:30:34.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.442+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~6VEFW11EVFR2.0 size=1048576 2024-09-12T17:30:34.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.442+0000 7fece65ff780 1 < canceled part key=_multipart_4Z1N3433MC6A.2~6VEFW11EVFR2.1 size=1048576 2024-09-12T17:30:34.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.443+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~6VEFW11EVFR2.2 size=38639 2024-09-12T17:30:34.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.445+0000 7fece65ff780 1 < canceled multipart upload key=4Z1N3433MC6A upload=6VEFW11EVFR2 tag=I029THXTBOG4 type=write size=3184367 2024-09-12T17:30:34.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.447+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=22X7I8PG5ND8 type=del size=414326 2024-09-12T17:30:34.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.448+0000 7fece65ff780 1 < canceled operation key=2HTNXL56URAK tag=UZWT39IE40QX type=del size=1603037 2024-09-12T17:30:34.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.449+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=9M6V4VKVDM0K type=del size=1009548 2024-09-12T17:30:34.452 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.451+0000 7fece65ff780 1 < completed write operation key=CBYI6C1ICE08 tag=KUS0MH0WJNT1 type=write size=285117 2024-09-12T17:30:34.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.453+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~HAGPHIYLTY5I.0 size=687924 2024-09-12T17:30:34.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.453+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=HAGPHIYLTY5I tag=CKKJ05Y2T6VM type=write size=1736500 2024-09-12T17:30:34.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.454+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~9P3NSWNWH62X.0 size=1048576 2024-09-12T17:30:34.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.454+0000 7fece65ff780 1 < canceled part key=_multipart_RKFRKIENSBTO.2~9P3NSWNWH62X.1 size=1048576 2024-09-12T17:30:34.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.455+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~9P3NSWNWH62X.2 size=264140 2024-09-12T17:30:34.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.457+0000 7fece65ff780 1 < canceled multipart upload key=RKFRKIENSBTO upload=9P3NSWNWH62X tag=RV6GZO48ZOS7 type=write size=3409868 2024-09-12T17:30:34.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.460+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~GT3VFMCEH20M.0 size=83486 2024-09-12T17:30:34.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.460+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=GT3VFMCEH20M tag=IDPT977M62M7 type=write size=1132062 2024-09-12T17:30:34.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.461+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=17IY9WJB21BK type=del 2024-09-12T17:30:34.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.462+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=B26YLP1EB0EQ type=del size=1850558 2024-09-12T17:30:34.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.464+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=4WWTM3DPHAOS type=del 2024-09-12T17:30:34.467 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.465+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=BJQPQE98TK41 type=del size=3115993 2024-09-12T17:30:34.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.467+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~1BDMCIJDD6TM.0 size=1048576 2024-09-12T17:30:34.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.468+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~1BDMCIJDD6TM.1 size=74338 2024-09-12T17:30:34.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.471+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=1BDMCIJDD6TM tag=9GK9SOH4YB2S type=write size=2171490 2024-09-12T17:30:34.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.472+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=02JB2A2IWXOD type=del size=33581 2024-09-12T17:30:34.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.475+0000 7fece65ff780 1 < suggested remove operation key=6GUDX5I1AKNH tag=7T7TFLXE6INS type=del 2024-09-12T17:30:34.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.478+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~4XIJLTPL17UP.0 size=1048576 2024-09-12T17:30:34.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.479+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~4XIJLTPL17UP.1 size=523600 2024-09-12T17:30:34.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.479+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=4XIJLTPL17UP tag=KAZB3NKUDTF7 type=write size=2620752 2024-09-12T17:30:34.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.482+0000 7fece65ff780 1 < suggested update operation key=ZEFSNR1IIA10 tag=YEQGHF2KYH9K type=del size=2689390 2024-09-12T17:30:34.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.483+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=MRV3L8RN0U0X type=del size=1742082 2024-09-12T17:30:34.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.485+0000 7fece65ff780 1 < canceled operation key=OPMR1WMB14CA tag=G9IMNM2NCQYT type=del size=2812165 2024-09-12T17:30:34.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.487+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~Z2A0UB2RSK4P.0 size=658461 2024-09-12T17:30:34.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.487+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=Z2A0UB2RSK4P tag=MSHJQTGU93GD type=write size=1707037 2024-09-12T17:30:34.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.488+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=FIVJRL8ZNDVZ type=del 2024-09-12T17:30:34.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.491+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~T0I4F76RTM0V.0 size=1048576 2024-09-12T17:30:34.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.492+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~T0I4F76RTM0V.1 size=343967 2024-09-12T17:30:34.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.492+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=T0I4F76RTM0V tag=LH9TCH0Z97AY type=write size=2441119 2024-09-12T17:30:34.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.493+0000 7fece65ff780 1 < completed write operation key=FX8VJO1YXJ4H tag=A2LT8QKFWMDU type=write size=884684 2024-09-12T17:30:34.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.494+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=4846P1XP62SL type=write size=33127 2024-09-12T17:30:34.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.495+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=0OR1JAFAGNHK type=del 2024-09-12T17:30:34.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.497+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~YNKT72CXFZSE.0 size=1048576 2024-09-12T17:30:34.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.498+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~YNKT72CXFZSE.1 size=1048576 2024-09-12T17:30:34.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.500+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~YNKT72CXFZSE.2 size=568367 2024-09-12T17:30:34.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.500+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=YNKT72CXFZSE tag=L3TSS22KVHEX type=write size=3714095 2024-09-12T17:30:34.503 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.501+0000 7fece65ff780 1 < completed delete operation key=5A7WPGW5P91B tag=Q7O630QIBY48 type=del 2024-09-12T17:30:34.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.502+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=0GDX45U5PP1D type=del size=101916 2024-09-12T17:30:34.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.503+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~S1ATX6BB3OQB.0 size=1048576 2024-09-12T17:30:34.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.504+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~S1ATX6BB3OQB.1 size=1048576 2024-09-12T17:30:34.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.505+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~S1ATX6BB3OQB.2 size=638736 2024-09-12T17:30:34.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.507+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=S1ATX6BB3OQB tag=N5L6X5L6GLLE type=write size=3784464 2024-09-12T17:30:34.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.508+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=8XZVOX9DIPF5 type=del size=1234529 2024-09-12T17:30:34.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.511+0000 7fece65ff780 1 < suggested remove operation key=UN6FLMRMAPUS tag=5FXEED35H7YO type=del 2024-09-12T17:30:34.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.513+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~X1VYKLFB9ZZK.0 size=1048576 2024-09-12T17:30:34.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.514+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~X1VYKLFB9ZZK.1 size=824709 2024-09-12T17:30:34.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.514+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=X1VYKLFB9ZZK tag=PH2HOC5UTDY0 type=write size=2921861 2024-09-12T17:30:34.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.515+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=22X7I8PG5ND8 type=del 2024-09-12T17:30:34.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.517+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~U7ODLA607KPN.0 size=373115 2024-09-12T17:30:34.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.517+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=U7ODLA607KPN tag=GW8WRTHJX3OJ type=write size=1421691 2024-09-12T17:30:34.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.518+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=9M6V4VKVDM0K type=del 2024-09-12T17:30:34.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.519+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=9M0N7EMF6PJ9 type=write size=613943 2024-09-12T17:30:34.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.520+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~HAGPHIYLTY5I.0 size=687924 2024-09-12T17:30:34.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.523+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=HAGPHIYLTY5I tag=CKKJ05Y2T6VM type=write size=1736500 2024-09-12T17:30:34.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.525+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~60RTESQIH5DK.0 size=1048576 2024-09-12T17:30:34.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.526+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~60RTESQIH5DK.1 size=1048576 2024-09-12T17:30:34.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.527+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~60RTESQIH5DK.2 size=1044284 2024-09-12T17:30:34.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.527+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=60RTESQIH5DK tag=9UYJSJAUB4GQ type=write size=4190012 2024-09-12T17:30:34.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.527+0000 7fece65ff780 1 < canceled part key=_multipart_6GUDX5I1AKNH.2~GT3VFMCEH20M.0 size=83486 2024-09-12T17:30:34.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.530+0000 7fece65ff780 1 < canceled multipart upload key=6GUDX5I1AKNH upload=GT3VFMCEH20M tag=IDPT977M62M7 type=write size=1132062 2024-09-12T17:30:34.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.532+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~C2W1ODRQWBOM.0 size=1048576 2024-09-12T17:30:34.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.533+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~C2W1ODRQWBOM.1 size=1048576 2024-09-12T17:30:34.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.534+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~C2W1ODRQWBOM.2 size=567524 2024-09-12T17:30:34.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.534+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=C2W1ODRQWBOM tag=ZRZEP0ZMYGL4 type=write size=3713252 2024-09-12T17:30:34.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.535+0000 7fece65ff780 1 < completed delete operation key=OIHDAJMPUK4I tag=B26YLP1EB0EQ type=del 2024-09-12T17:30:34.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.536+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=KRZPRMIRTTT0 type=del size=2967604 2024-09-12T17:30:34.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.537+0000 7fece65ff780 -1 < no bi entry to suggest for operation key=UN6FLMRMAPUS tag=BJQPQE98TK41 type=del size=3115993: (2) No such file or directory 2024-09-12T17:30:34.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.538+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=FVQAH0NZ86J4 type=del size=4064620 2024-09-12T17:30:34.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.539+0000 7fece65ff780 -1 < failed to complete operation key=6GUDX5I1AKNH tag=02JB2A2IWXOD type=del size=33581: (22) Invalid argument 2024-09-12T17:30:34.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.540+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=I70PMRL7JWMJ type=del size=1208463 2024-09-12T17:30:34.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.541+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~4XIJLTPL17UP.0 size=1048576 2024-09-12T17:30:34.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.542+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~4XIJLTPL17UP.1 size=523600 2024-09-12T17:30:34.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.546+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=4XIJLTPL17UP tag=KAZB3NKUDTF7 type=write size=2620752 2024-09-12T17:30:34.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.547+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=BPUEEEA2UOBB type=write size=112219 2024-09-12T17:30:34.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.548+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=MRV3L8RN0U0X type=del 2024-09-12T17:30:34.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.550+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~O3WJOPEUYHW7.0 size=1048576 2024-09-12T17:30:34.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.551+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~O3WJOPEUYHW7.1 size=106476 2024-09-12T17:30:34.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.551+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=O3WJOPEUYHW7 tag=87WNAOSTB9VS type=write size=2203628 2024-09-12T17:30:34.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.552+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~Z2A0UB2RSK4P.0 size=658461 2024-09-12T17:30:34.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.554+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=Z2A0UB2RSK4P tag=MSHJQTGU93GD type=write size=1707037 2024-09-12T17:30:34.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.555+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=U7B4WW0FC4AC type=del size=3816565 2024-09-12T17:30:34.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.557+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~T0I4F76RTM0V.0 size=1048576 2024-09-12T17:30:34.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.557+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~T0I4F76RTM0V.1 size=343967 2024-09-12T17:30:34.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.559+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=T0I4F76RTM0V tag=LH9TCH0Z97AY type=write size=2441119 2024-09-12T17:30:34.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.560+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=MNCW3N9ETVZJ type=del size=3609344 2024-09-12T17:30:34.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.562+0000 7fece65ff780 1 < completed write operation key=CEERZVBJQHP0 tag=4846P1XP62SL type=write size=33127 2024-09-12T17:30:34.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.563+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=ZO5FYVLJW6BT type=del size=1219565 2024-09-12T17:30:34.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.564+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~YNKT72CXFZSE.0 size=1048576 2024-09-12T17:30:34.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.565+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~YNKT72CXFZSE.1 size=1048576 2024-09-12T17:30:34.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.566+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~YNKT72CXFZSE.2 size=568367 2024-09-12T17:30:34.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.568+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=YNKT72CXFZSE tag=L3TSS22KVHEX type=write size=3714095 2024-09-12T17:30:34.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.569+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=00QNDTVPFK6S type=write size=430138 2024-09-12T17:30:34.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.571+0000 7fece65ff780 1 < suggested remove operation key=OPMR1WMB14CA tag=0GDX45U5PP1D type=del 2024-09-12T17:30:34.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.573+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=R49XFXVC668I type=del size=3627567 2024-09-12T17:30:34.575 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.574+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=8XZVOX9DIPF5 type=del 2024-09-12T17:30:34.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.576+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~1SYXR6FWE872.0 size=1048576 2024-09-12T17:30:34.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.577+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~1SYXR6FWE872.1 size=92989 2024-09-12T17:30:34.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.577+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=1SYXR6FWE872 tag=EGTI2J0S1WW8 type=write size=2190141 2024-09-12T17:30:34.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.578+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~X1VYKLFB9ZZK.0 size=1048576 2024-09-12T17:30:34.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.579+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~X1VYKLFB9ZZK.1 size=824709 2024-09-12T17:30:34.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.582+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=X1VYKLFB9ZZK tag=PH2HOC5UTDY0 type=write size=2921861 2024-09-12T17:30:34.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.583+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=LAQEV6MZNILK type=del size=3056091 2024-09-12T17:30:34.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.584+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~U7ODLA607KPN.0 size=373115 2024-09-12T17:30:34.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.586+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=U7ODLA607KPN tag=GW8WRTHJX3OJ type=write size=1421691 2024-09-12T17:30:34.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.587+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=2QQEXFGYESFP type=del size=2200942 2024-09-12T17:30:34.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.589+0000 7fece65ff780 1 < suggested update operation key=IMCE9Z7P4S6R tag=9M0N7EMF6PJ9 type=write size=613943 2024-09-12T17:30:34.593 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.592+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~639NXR08RII1.0 size=1048576 2024-09-12T17:30:34.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.593+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~639NXR08RII1.1 size=51707 2024-09-12T17:30:34.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.593+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=639NXR08RII1 tag=GWM733I1HZ76 type=write size=2148859 2024-09-12T17:30:34.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.594+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~60RTESQIH5DK.0 size=1048576 2024-09-12T17:30:34.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.595+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~60RTESQIH5DK.1 size=1048576 2024-09-12T17:30:34.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.596+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~60RTESQIH5DK.2 size=1044284 2024-09-12T17:30:34.599 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.598+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=60RTESQIH5DK tag=9UYJSJAUB4GQ type=write size=4190012 2024-09-12T17:30:34.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.600+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~CWODYCJRAOWO.0 size=1048576 2024-09-12T17:30:34.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.601+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~CWODYCJRAOWO.1 size=1048576 2024-09-12T17:30:34.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.602+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~CWODYCJRAOWO.2 size=548247 2024-09-12T17:30:34.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.602+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=CWODYCJRAOWO tag=SDYU6OT6UKON type=write size=3693975 2024-09-12T17:30:34.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.603+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~C2W1ODRQWBOM.0 size=1048576 2024-09-12T17:30:34.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.604+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~C2W1ODRQWBOM.1 size=1048576 2024-09-12T17:30:34.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.605+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~C2W1ODRQWBOM.2 size=567524 2024-09-12T17:30:34.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.607+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=C2W1ODRQWBOM tag=ZRZEP0ZMYGL4 type=write size=3713252 2024-09-12T17:30:34.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.609+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~H5QVT11BYHGZ.0 size=1048576 2024-09-12T17:30:34.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.610+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~H5QVT11BYHGZ.1 size=1048576 2024-09-12T17:30:34.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.611+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~H5QVT11BYHGZ.2 size=936712 2024-09-12T17:30:34.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.611+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=H5QVT11BYHGZ tag=U77UMSFRIDAY type=write size=4082440 2024-09-12T17:30:34.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.612+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=KRZPRMIRTTT0 type=del 2024-09-12T17:30:34.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.613+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=2QP3HG58Q4U4 type=del size=3817258 2024-09-12T17:30:34.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.616+0000 7fece65ff780 1 < suggested remove operation key=807GX4RQQLL4 tag=FVQAH0NZ86J4 type=del 2024-09-12T17:30:34.619 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.618+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~F0P5O2PMTBXK.0 size=327225 2024-09-12T17:30:34.620 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.618+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=F0P5O2PMTBXK tag=DS4P9YS6GJ5K type=write size=1375801 2024-09-12T17:30:34.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.620+0000 7fece65ff780 1 < suggested remove operation key=9IGJG88NX1FS tag=I70PMRL7JWMJ type=del 2024-09-12T17:30:34.624 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.622+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~RB8HQT45GZVX.0 size=1048576 2024-09-12T17:30:34.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.623+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~RB8HQT45GZVX.1 size=1048576 2024-09-12T17:30:34.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.624+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~RB8HQT45GZVX.2 size=378497 2024-09-12T17:30:34.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.624+0000 7fece65ff780 1 > prepared multipart upload key=LSGN631FW1P8 upload=RB8HQT45GZVX tag=6EYKONK3BRST type=write size=3524225 2024-09-12T17:30:34.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.626+0000 7fece65ff780 1 < completed write operation key=QQNW20B28RJC tag=BPUEEEA2UOBB type=write size=112219 2024-09-12T17:30:34.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.628+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~L4UTKP5QZ70T.0 size=1048576 2024-09-12T17:30:34.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.629+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~L4UTKP5QZ70T.1 size=1048576 2024-09-12T17:30:34.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.630+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~L4UTKP5QZ70T.2 size=119797 2024-09-12T17:30:34.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.630+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=L4UTKP5QZ70T tag=T5NG5MSJIFB6 type=write size=3265525 2024-09-12T17:30:34.637 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.631+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~O3WJOPEUYHW7.0 size=1048576 2024-09-12T17:30:34.637 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.632+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~O3WJOPEUYHW7.1 size=106476 2024-09-12T17:30:34.637 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.635+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=O3WJOPEUYHW7 tag=87WNAOSTB9VS type=write size=2203628 2024-09-12T17:30:34.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.637+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~5XUE8KTG7S62.0 size=1048576 2024-09-12T17:30:34.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.638+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~5XUE8KTG7S62.1 size=748796 2024-09-12T17:30:34.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.638+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=5XUE8KTG7S62 tag=0YNF6ICK8BLT type=write size=2845948 2024-09-12T17:30:34.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.639+0000 7fece65ff780 1 < completed delete operation key=Q00ZFG0BBDG5 tag=U7B4WW0FC4AC type=del 2024-09-12T17:30:34.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.641+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=A6NWXK13OIBY type=del size=3004404 2024-09-12T17:30:34.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.642+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=MNCW3N9ETVZJ type=del 2024-09-12T17:30:34.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.643+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=WD1SSZOKVL0A type=write size=91077 2024-09-12T17:30:34.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.645+0000 7fece65ff780 1 < suggested remove operation key=4Z1N3433MC6A tag=ZO5FYVLJW6BT type=del 2024-09-12T17:30:34.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.646+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=BUB2PWTJ20XT type=del size=3587274 2024-09-12T17:30:34.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.648+0000 7fece65ff780 1 < completed write operation key=Q00ZFG0BBDG5 tag=00QNDTVPFK6S type=write size=430138 2024-09-12T17:30:34.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.650+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~GL18Z0IJ9C2S.0 size=1048576 2024-09-12T17:30:34.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.651+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~GL18Z0IJ9C2S.1 size=140576 2024-09-12T17:30:34.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.651+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=GL18Z0IJ9C2S tag=D5DP0KZ9J8O6 type=write size=2237728 2024-09-12T17:30:34.655 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.653+0000 7fece65ff780 1 < suggested remove operation key=CEERZVBJQHP0 tag=R49XFXVC668I type=del 2024-09-12T17:30:34.657 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.655+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=9SM1TXE6O9GM type=del size=3120686 2024-09-12T17:30:34.658 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.656+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~1SYXR6FWE872.0 size=1048576 2024-09-12T17:30:34.658 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.656+0000 7fece65ff780 1 < canceled part key=_multipart_YCNQL8CUUGW7.2~1SYXR6FWE872.1 size=92989 2024-09-12T17:30:34.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.658+0000 7fece65ff780 1 < canceled multipart upload key=YCNQL8CUUGW7 upload=1SYXR6FWE872 tag=EGTI2J0S1WW8 type=write size=2190141 2024-09-12T17:30:34.661 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.660+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=0YRJ7DHD2TR6 type=del size=3462556 2024-09-12T17:30:34.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.661+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=LAQEV6MZNILK type=del 2024-09-12T17:30:34.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.663+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~5I625G1B82NZ.0 size=1048576 2024-09-12T17:30:34.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.664+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~5I625G1B82NZ.1 size=667535 2024-09-12T17:30:34.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.664+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=5I625G1B82NZ tag=1S5EI4D9ZE0M type=write size=2764687 2024-09-12T17:30:34.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.665+0000 7fece65ff780 -1 < failed to complete operation key=9IGJG88NX1FS tag=2QQEXFGYESFP type=del size=2200942: (22) Invalid argument 2024-09-12T17:30:34.669 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.667+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~NH7FT42R4271.0 size=1048576 2024-09-12T17:30:34.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.669+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~NH7FT42R4271.1 size=513632 2024-09-12T17:30:34.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.669+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=NH7FT42R4271 tag=D3HPDVW6OE2K type=write size=2610784 2024-09-12T17:30:34.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.670+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~639NXR08RII1.0 size=1048576 2024-09-12T17:30:34.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.671+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~639NXR08RII1.1 size=51707 2024-09-12T17:30:34.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.674+0000 7fece65ff780 1 < completed multipart upload key=Q00ZFG0BBDG5 upload=639NXR08RII1 tag=GWM733I1HZ76 type=write size=2148859 2024-09-12T17:30:34.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.675+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=3850FKEPY160 type=del size=1385670 2024-09-12T17:30:34.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.676+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~CWODYCJRAOWO.0 size=1048576 2024-09-12T17:30:34.678 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.677+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~CWODYCJRAOWO.1 size=1048576 2024-09-12T17:30:34.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.678+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~CWODYCJRAOWO.2 size=548247 2024-09-12T17:30:34.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.680+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=CWODYCJRAOWO tag=SDYU6OT6UKON type=write size=3693975 2024-09-12T17:30:34.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.681+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=FWE0BPIMSRRL type=del size=1955812 2024-09-12T17:30:34.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.682+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~H5QVT11BYHGZ.0 size=1048576 2024-09-12T17:30:34.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.683+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~H5QVT11BYHGZ.1 size=1048576 2024-09-12T17:30:34.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.684+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~H5QVT11BYHGZ.2 size=936712 2024-09-12T17:30:34.688 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.686+0000 7fece65ff780 1 < completed multipart upload key=9KYNMM6W7RRM upload=H5QVT11BYHGZ tag=U77UMSFRIDAY type=write size=4082440 2024-09-12T17:30:34.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.688+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=Z17QR7BAKT8K type=del size=1301404 2024-09-12T17:30:34.690 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.689+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=2QP3HG58Q4U4 type=del 2024-09-12T17:30:34.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.691+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~BMCB7NN8B6OK.0 size=1048576 2024-09-12T17:30:34.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.692+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~BMCB7NN8B6OK.1 size=870830 2024-09-12T17:30:34.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.692+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=BMCB7NN8B6OK tag=NGG65EVGCADP type=write size=2967982 2024-09-12T17:30:34.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.693+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~F0P5O2PMTBXK.0 size=327225 2024-09-12T17:30:34.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.695+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=F0P5O2PMTBXK tag=DS4P9YS6GJ5K type=write size=1375801 2024-09-12T17:30:34.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.697+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=RA8NBL167GHW type=del size=286198 2024-09-12T17:30:34.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.698+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~RB8HQT45GZVX.0 size=1048576 2024-09-12T17:30:34.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.699+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~RB8HQT45GZVX.1 size=1048576 2024-09-12T17:30:34.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.699+0000 7fece65ff780 1 < canceled part key=_multipart_LSGN631FW1P8.2~RB8HQT45GZVX.2 size=378497 2024-09-12T17:30:34.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.701+0000 7fece65ff780 1 < canceled multipart upload key=LSGN631FW1P8 upload=RB8HQT45GZVX tag=6EYKONK3BRST type=write size=3524225 2024-09-12T17:30:34.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.702+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=XII5OARFDUA7 type=write size=527482 2024-09-12T17:30:34.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.703+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~L4UTKP5QZ70T.0 size=1048576 2024-09-12T17:30:34.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.705+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~L4UTKP5QZ70T.1 size=1048576 2024-09-12T17:30:34.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.706+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~L4UTKP5QZ70T.2 size=119797 2024-09-12T17:30:34.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.708+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=L4UTKP5QZ70T tag=T5NG5MSJIFB6 type=write size=3265525 2024-09-12T17:30:34.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.709+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=TZD9LUIJKY1I type=del size=24288 2024-09-12T17:30:34.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.710+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~5XUE8KTG7S62.0 size=1048576 2024-09-12T17:30:34.713 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.711+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~5XUE8KTG7S62.1 size=748796 2024-09-12T17:30:34.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.713+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=5XUE8KTG7S62 tag=0YNF6ICK8BLT type=write size=2845948 2024-09-12T17:30:34.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.715+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=I2UMPDHJWRKA type=del size=107916 2024-09-12T17:30:34.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.716+0000 7fece65ff780 1 < completed delete operation key=5A7WPGW5P91B tag=A6NWXK13OIBY type=del 2024-09-12T17:30:34.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.717+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=WOM04D130ZBM type=del size=466279 2024-09-12T17:30:34.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.718+0000 7fece65ff780 1 < completed write operation key=YCNQL8CUUGW7 tag=WD1SSZOKVL0A type=write size=91077 2024-09-12T17:30:34.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.720+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=ITJU00GDNV47 type=del size=1308424 2024-09-12T17:30:34.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.721+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=BUB2PWTJ20XT type=del 2024-09-12T17:30:34.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.722+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=KMBBD20J30V0 type=del size=3990175 2024-09-12T17:30:34.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.723+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~GL18Z0IJ9C2S.0 size=1048576 2024-09-12T17:30:34.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.724+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~GL18Z0IJ9C2S.1 size=140576 2024-09-12T17:30:34.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.727+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=GL18Z0IJ9C2S tag=D5DP0KZ9J8O6 type=write size=2237728 2024-09-12T17:30:34.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.728+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=2MTIZK40YTQF type=write size=981561 2024-09-12T17:30:34.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.729+0000 7fece65ff780 1 < completed delete operation key=IMCE9Z7P4S6R tag=9SM1TXE6O9GM type=del 2024-09-12T17:30:34.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.730+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=J74KV4JC21MA type=del size=2986730 2024-09-12T17:30:34.733 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.731+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=0YRJ7DHD2TR6 type=del 2024-09-12T17:30:34.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.733+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=9879KWUYM817 type=write size=414233 2024-09-12T17:30:34.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.734+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~5I625G1B82NZ.0 size=1048576 2024-09-12T17:30:34.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.735+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~5I625G1B82NZ.1 size=667535 2024-09-12T17:30:34.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.737+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=5I625G1B82NZ tag=1S5EI4D9ZE0M type=write size=2764687 2024-09-12T17:30:34.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.738+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=7N5OQ0M6WQQW type=write size=353872 2024-09-12T17:30:34.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.740+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~NH7FT42R4271.0 size=1048576 2024-09-12T17:30:34.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.741+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~NH7FT42R4271.1 size=513632 2024-09-12T17:30:34.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.743+0000 7fece65ff780 1 < completed multipart upload key=IMCE9Z7P4S6R upload=NH7FT42R4271 tag=D3HPDVW6OE2K type=write size=2610784 2024-09-12T17:30:34.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.744+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=MF457ADMMK9W type=del size=4149510 2024-09-12T17:30:34.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.745+0000 7fece65ff780 1 < canceled operation key=OPMR1WMB14CA tag=3850FKEPY160 type=del size=1385670 2024-09-12T17:30:34.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.747+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~H0MAT23IRX92.0 size=1048576 2024-09-12T17:30:34.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.748+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~H0MAT23IRX92.1 size=960918 2024-09-12T17:30:34.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.748+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=H0MAT23IRX92 tag=UWF7KKMOP4H2 type=write size=3058070 2024-09-12T17:30:34.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.749+0000 7fece65ff780 1 < canceled operation key=9IGJG88NX1FS tag=FWE0BPIMSRRL type=del size=1955812 2024-09-12T17:30:34.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.755+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=ZEOVZWFR04OI type=del size=3839161 2024-09-12T17:30:34.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.756+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=Z17QR7BAKT8K type=del 2024-09-12T17:30:34.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.758+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~HDZO4BWC13H0.0 size=1048576 2024-09-12T17:30:34.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.759+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~HDZO4BWC13H0.1 size=1048576 2024-09-12T17:30:34.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.760+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~HDZO4BWC13H0.2 size=378608 2024-09-12T17:30:34.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.760+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=HDZO4BWC13H0 tag=Z6PSDH03A53Q type=write size=3524336 2024-09-12T17:30:34.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.762+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~BMCB7NN8B6OK.0 size=1048576 2024-09-12T17:30:34.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.763+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~BMCB7NN8B6OK.1 size=870830 2024-09-12T17:30:34.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.765+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=BMCB7NN8B6OK tag=NGG65EVGCADP type=write size=2967982 2024-09-12T17:30:34.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.767+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~452I62J4RCNP.0 size=717219 2024-09-12T17:30:34.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.767+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=452I62J4RCNP tag=SM03LVHLGO6W type=write size=1765795 2024-09-12T17:30:34.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.768+0000 7fece65ff780 1 < completed delete operation key=OIHDAJMPUK4I tag=RA8NBL167GHW type=del 2024-09-12T17:30:34.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.769+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=H265QQD602GO type=write size=363628 2024-09-12T17:30:34.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.771+0000 7fece65ff780 1 < suggested remove operation key=807GX4RQQLL4 tag=XII5OARFDUA7 type=write 2024-09-12T17:30:34.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.774+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=WEP63W5UNRGU type=del size=1652426 2024-09-12T17:30:34.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.775+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=TZD9LUIJKY1I type=del 2024-09-12T17:30:34.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.776+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=JSGAHHZYNIVN type=del size=1257956 2024-09-12T17:30:34.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.777+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=I2UMPDHJWRKA type=del 2024-09-12T17:30:34.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.779+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~X2GQ9SIAIQLL.0 size=329922 2024-09-12T17:30:34.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.779+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=X2GQ9SIAIQLL tag=HI479LY97XJE type=write size=1378498 2024-09-12T17:30:34.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.781+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=WOM04D130ZBM type=del 2024-09-12T17:30:34.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.783+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~2R9OENK7QMCM.0 size=1048576 2024-09-12T17:30:34.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.784+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~2R9OENK7QMCM.1 size=17431 2024-09-12T17:30:34.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.784+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=2R9OENK7QMCM tag=KALYG50GFSXW type=write size=2114583 2024-09-12T17:30:34.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.786+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=ITJU00GDNV47 type=del 2024-09-12T17:30:34.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.787+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=AWX8TCB4HZ8W type=del size=3740632 2024-09-12T17:30:34.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.788+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=KMBBD20J30V0 type=del 2024-09-12T17:30:34.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.790+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~P8BQF4QGG329.0 size=1048576 2024-09-12T17:30:34.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.791+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~P8BQF4QGG329.1 size=1048576 2024-09-12T17:30:34.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.792+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~P8BQF4QGG329.2 size=1038331 2024-09-12T17:30:34.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.792+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=P8BQF4QGG329 tag=Q8MI8B83ID60 type=write size=4184059 2024-09-12T17:30:34.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.794+0000 7fece65ff780 1 < suggested remove operation key=7AS5L998SDV7 tag=2MTIZK40YTQF type=write 2024-09-12T17:30:34.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.797+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~9D30HRV7QNRL.0 size=1048576 2024-09-12T17:30:34.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.798+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~9D30HRV7QNRL.1 size=1048576 2024-09-12T17:30:34.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.798+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~9D30HRV7QNRL.2 size=654283 2024-09-12T17:30:34.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.798+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=9D30HRV7QNRL tag=J47S9D7NQ9U3 type=write size=3800011 2024-09-12T17:30:34.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.801+0000 7fece65ff780 1 < suggested remove operation key=TLEZIJ4881G7 tag=J74KV4JC21MA type=del 2024-09-12T17:30:34.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.804+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~J4QQF45FST85.0 size=752702 2024-09-12T17:30:34.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.804+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=J4QQF45FST85 tag=ES732OL1G74L type=write size=1801278 2024-09-12T17:30:34.808 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.806+0000 7fece65ff780 1 < completed write operation key=I7TGK5A3JHH5 tag=9879KWUYM817 type=write size=414233 2024-09-12T17:30:34.809 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.807+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=XMR3L8UA85WV type=del size=2934452 2024-09-12T17:30:34.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.808+0000 7fece65ff780 1 < completed write operation key=5A7WPGW5P91B tag=7N5OQ0M6WQQW type=write size=353872 2024-09-12T17:30:34.811 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.809+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=3K7A2933I9FW type=del size=321660 2024-09-12T17:30:34.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.811+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=MF457ADMMK9W type=del 2024-09-12T17:30:34.814 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.812+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=2JEBN5RPP3D7 type=del size=4128410 2024-09-12T17:30:34.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.814+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~H0MAT23IRX92.0 size=1048576 2024-09-12T17:30:34.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.815+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~H0MAT23IRX92.1 size=960918 2024-09-12T17:30:34.819 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.817+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=H0MAT23IRX92 tag=UWF7KKMOP4H2 type=write size=3058070 2024-09-12T17:30:34.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.818+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=VDKCA06BSR04 type=write size=960732 2024-09-12T17:30:34.822 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.821+0000 7fece65ff780 1 < suggested remove operation key=OPMR1WMB14CA tag=ZEOVZWFR04OI type=del 2024-09-12T17:30:34.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.823+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~5V8H0232FR5G.0 size=1048576 2024-09-12T17:30:34.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.824+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~5V8H0232FR5G.1 size=1048576 2024-09-12T17:30:34.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.827+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~5V8H0232FR5G.2 size=17059 2024-09-12T17:30:34.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.827+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=5V8H0232FR5G tag=VGL4NMC1RNDS type=write size=3162787 2024-09-12T17:30:34.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.828+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~HDZO4BWC13H0.0 size=1048576 2024-09-12T17:30:34.831 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.829+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~HDZO4BWC13H0.1 size=1048576 2024-09-12T17:30:34.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.830+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~HDZO4BWC13H0.2 size=378608 2024-09-12T17:30:34.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.832+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=HDZO4BWC13H0 tag=Z6PSDH03A53Q type=write size=3524336 2024-09-12T17:30:34.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.834+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=B0IRJ9FQRYDA type=del size=1322456 2024-09-12T17:30:34.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.835+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~452I62J4RCNP.0 size=717219 2024-09-12T17:30:34.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.837+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=452I62J4RCNP tag=SM03LVHLGO6W type=write size=1765795 2024-09-12T17:30:34.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.839+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~N7Z3KRBSS2BS.0 size=43701 2024-09-12T17:30:34.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.839+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=N7Z3KRBSS2BS tag=CMPNBE1CP73L type=write size=1092277 2024-09-12T17:30:34.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.840+0000 7fece65ff780 -1 < failed to complete operation key=TLEZIJ4881G7 tag=H265QQD602GO type=write size=363628: (22) Invalid argument 2024-09-12T17:30:34.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.842+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=NXLRY7L4GT3M type=del size=2629739 2024-09-12T17:30:34.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.843+0000 7fece65ff780 1 < canceled operation key=I7TGK5A3JHH5 tag=WEP63W5UNRGU type=del size=1652426 2024-09-12T17:30:34.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.844+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=JVOQE03YS639 type=write size=896618 2024-09-12T17:30:34.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.845+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=JSGAHHZYNIVN type=del 2024-09-12T17:30:34.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.847+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=30RLVU8O9AN8 type=del size=4051994 2024-09-12T17:30:34.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.847+0000 7fece65ff780 1 < canceled part key=_multipart_KKU8T0CVS40V.2~X2GQ9SIAIQLL.0 size=329922 2024-09-12T17:30:34.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.849+0000 7fece65ff780 1 < canceled multipart upload key=KKU8T0CVS40V upload=X2GQ9SIAIQLL tag=HI479LY97XJE type=write size=1378498 2024-09-12T17:30:34.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.852+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~8OK702CXQXT7.0 size=553221 2024-09-12T17:30:34.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.852+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=8OK702CXQXT7 tag=QWEKZ326CDSY type=write size=1601797 2024-09-12T17:30:34.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.852+0000 7fece65ff780 1 < canceled part key=_multipart_6CCPZ4TVIU5N.2~2R9OENK7QMCM.0 size=1048576 2024-09-12T17:30:34.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.853+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~2R9OENK7QMCM.1 size=17431 2024-09-12T17:30:34.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.855+0000 7fece65ff780 1 < canceled multipart upload key=6CCPZ4TVIU5N upload=2R9OENK7QMCM tag=KALYG50GFSXW type=write size=2114583 2024-09-12T17:30:34.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.858+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~HG32BS94XVWO.0 size=1048576 2024-09-12T17:30:34.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.859+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~HG32BS94XVWO.1 size=993088 2024-09-12T17:30:34.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.859+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=HG32BS94XVWO tag=9QJFIUMNVZF9 type=write size=3090240 2024-09-12T17:30:34.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.860+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=AWX8TCB4HZ8W type=del 2024-09-12T17:30:34.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.863+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~F50LI8MDQVGJ.0 size=1048576 2024-09-12T17:30:34.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.864+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~F50LI8MDQVGJ.1 size=728019 2024-09-12T17:30:34.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.864+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=F50LI8MDQVGJ tag=XDLRUH1GAPBE type=write size=2825171 2024-09-12T17:30:34.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.866+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~P8BQF4QGG329.0 size=1048576 2024-09-12T17:30:34.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.866+0000 7fece65ff780 1 < canceled part key=_multipart_2HTNXL56URAK.2~P8BQF4QGG329.1 size=1048576 2024-09-12T17:30:34.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.867+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~P8BQF4QGG329.2 size=1038331 2024-09-12T17:30:34.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.869+0000 7fece65ff780 1 < canceled multipart upload key=2HTNXL56URAK upload=P8BQF4QGG329 tag=Q8MI8B83ID60 type=write size=4184059 2024-09-12T17:30:34.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.870+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=H9B6CA7958SC type=del size=3090168 2024-09-12T17:30:34.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.871+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~9D30HRV7QNRL.0 size=1048576 2024-09-12T17:30:34.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.872+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~9D30HRV7QNRL.1 size=1048576 2024-09-12T17:30:34.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.873+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~9D30HRV7QNRL.2 size=654283 2024-09-12T17:30:34.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.875+0000 7fece65ff780 1 < completed multipart upload key=I31CKY20NO9S upload=9D30HRV7QNRL tag=J47S9D7NQ9U3 type=write size=3800011 2024-09-12T17:30:34.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.877+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=05O74ABY11R4 type=del size=972280 2024-09-12T17:30:34.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.878+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~J4QQF45FST85.0 size=752702 2024-09-12T17:30:34.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.880+0000 7fece65ff780 1 < completed multipart upload key=Q00ZFG0BBDG5 upload=J4QQF45FST85 tag=ES732OL1G74L type=write size=1801278 2024-09-12T17:30:34.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.881+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=YZ9TF9ZG5BWY type=del size=2436762 2024-09-12T17:30:34.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.883+0000 7fece65ff780 1 < suggested remove operation key=YCNQL8CUUGW7 tag=XMR3L8UA85WV type=del 2024-09-12T17:30:34.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.886+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~82NTTI0A210D.0 size=1048576 2024-09-12T17:30:34.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.887+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~82NTTI0A210D.1 size=873359 2024-09-12T17:30:34.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.887+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=82NTTI0A210D tag=G63UJZEVMYOI type=write size=2970511 2024-09-12T17:30:34.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.888+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=3K7A2933I9FW type=del 2024-09-12T17:30:34.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.890+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~IJJHUZV4SNHO.0 size=411676 2024-09-12T17:30:34.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.890+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=IJJHUZV4SNHO tag=I2YOAA0HCFLS type=write size=1460252 2024-09-12T17:30:34.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.891+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=2JEBN5RPP3D7 type=del 2024-09-12T17:30:34.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.894+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~IVRJSIK01HD0.0 size=1016420 2024-09-12T17:30:34.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.894+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=IVRJSIK01HD0 tag=ELBN30324R8A type=write size=2064996 2024-09-12T17:30:34.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.896+0000 7fece65ff780 1 < completed write operation key=TLEZIJ4881G7 tag=VDKCA06BSR04 type=write size=960732 2024-09-12T17:30:34.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.897+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=ZN4D8SMYMWLT type=del size=3393663 2024-09-12T17:30:34.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.898+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~5V8H0232FR5G.0 size=1048576 2024-09-12T17:30:34.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.899+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~5V8H0232FR5G.1 size=1048576 2024-09-12T17:30:34.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.900+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~5V8H0232FR5G.2 size=17059 2024-09-12T17:30:34.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.902+0000 7fece65ff780 1 < completed multipart upload key=2HTNXL56URAK upload=5V8H0232FR5G tag=VGL4NMC1RNDS type=write size=3162787 2024-09-12T17:30:34.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.904+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=NLBSZQRVXY72 type=del size=842091 2024-09-12T17:30:34.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.905+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=B0IRJ9FQRYDA type=del 2024-09-12T17:30:34.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.906+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=IUL2MHMBY8GP type=del size=2808390 2024-09-12T17:30:34.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.908+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~N7Z3KRBSS2BS.0 size=43701 2024-09-12T17:30:34.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.910+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=N7Z3KRBSS2BS tag=CMPNBE1CP73L type=write size=1092277 2024-09-12T17:30:34.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.912+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~FH2ER1UTAJJB.0 size=1048576 2024-09-12T17:30:34.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.913+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~FH2ER1UTAJJB.1 size=1048576 2024-09-12T17:30:34.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.914+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~FH2ER1UTAJJB.2 size=73892 2024-09-12T17:30:34.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.914+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=FH2ER1UTAJJB tag=6BLJNLYJDU89 type=write size=3219620 2024-09-12T17:30:34.918 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.916+0000 7fece65ff780 1 < suggested update operation key=OIHDAJMPUK4I tag=NXLRY7L4GT3M type=del size=2629739 2024-09-12T17:30:34.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.917+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=UZVGRRIY7IG3 type=del size=1747720 2024-09-12T17:30:34.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.919+0000 7fece65ff780 1 < completed write operation key=QQNW20B28RJC tag=JVOQE03YS639 type=write size=896618 2024-09-12T17:30:34.922 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.921+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~D8YGF20QUI1I.0 size=1048576 2024-09-12T17:30:34.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.922+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~D8YGF20QUI1I.1 size=1048576 2024-09-12T17:30:34.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.923+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~D8YGF20QUI1I.2 size=143741 2024-09-12T17:30:34.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.923+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=D8YGF20QUI1I tag=24CIF6LJA0D3 type=write size=3289469 2024-09-12T17:30:34.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.924+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=30RLVU8O9AN8 type=del 2024-09-12T17:30:34.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.926+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=JJRWCO2S7TXR type=del size=1150501 2024-09-12T17:30:34.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.927+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~8OK702CXQXT7.0 size=553221 2024-09-12T17:30:34.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.929+0000 7fece65ff780 1 < completed multipart upload key=Q00ZFG0BBDG5 upload=8OK702CXQXT7 tag=QWEKZ326CDSY type=write size=1601797 2024-09-12T17:30:34.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.931+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~GMXNIM6FVHNN.0 size=778857 2024-09-12T17:30:34.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.931+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=GMXNIM6FVHNN tag=WNHPQQY5ME9H type=write size=1827433 2024-09-12T17:30:34.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.932+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~HG32BS94XVWO.0 size=1048576 2024-09-12T17:30:34.935 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.933+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~HG32BS94XVWO.1 size=993088 2024-09-12T17:30:34.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.935+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=HG32BS94XVWO tag=9QJFIUMNVZF9 type=write size=3090240 2024-09-12T17:30:34.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.937+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=KUY6DFNJCTFG type=del size=704317 2024-09-12T17:30:34.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.938+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~F50LI8MDQVGJ.0 size=1048576 2024-09-12T17:30:34.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.939+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~F50LI8MDQVGJ.1 size=728019 2024-09-12T17:30:34.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.941+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=F50LI8MDQVGJ tag=XDLRUH1GAPBE type=write size=2825171 2024-09-12T17:30:34.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.942+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=W0YMH1SRKBFB type=del size=2212137 2024-09-12T17:30:34.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.943+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=H9B6CA7958SC type=del 2024-09-12T17:30:34.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.944+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=4XAKCYQK8I5Z type=del size=1095444 2024-09-12T17:30:34.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.946+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=05O74ABY11R4 type=del 2024-09-12T17:30:34.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.947+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=0TUY58X8M0KX type=write size=436360 2024-09-12T17:30:34.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.949+0000 7fece65ff780 1 < suggested update operation key=CEERZVBJQHP0 tag=YZ9TF9ZG5BWY type=del size=2436762 2024-09-12T17:30:34.952 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.951+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=C1EV91ZYXZZD type=del size=3419366 2024-09-12T17:30:34.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.952+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~82NTTI0A210D.0 size=1048576 2024-09-12T17:30:34.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.953+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~82NTTI0A210D.1 size=873359 2024-09-12T17:30:34.957 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.955+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=82NTTI0A210D tag=G63UJZEVMYOI type=write size=2970511 2024-09-12T17:30:34.958 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.956+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=CYG3SM4RD5UB type=del size=2023141 2024-09-12T17:30:34.958 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.957+0000 7fece65ff780 1 < canceled part key=_multipart_I31CKY20NO9S.2~IJJHUZV4SNHO.0 size=411676 2024-09-12T17:30:34.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.959+0000 7fece65ff780 1 < canceled multipart upload key=I31CKY20NO9S upload=IJJHUZV4SNHO tag=I2YOAA0HCFLS type=write size=1460252 2024-09-12T17:30:34.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.961+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~69EYLLI6AJFO.0 size=1048576 2024-09-12T17:30:34.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.962+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~69EYLLI6AJFO.1 size=606590 2024-09-12T17:30:34.964 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.962+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=69EYLLI6AJFO tag=3ZTBQT1A7YNH type=write size=2703742 2024-09-12T17:30:34.964 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.962+0000 7fece65ff780 1 < canceled part key=_multipart_TLEZIJ4881G7.2~IVRJSIK01HD0.0 size=1016420 2024-09-12T17:30:34.966 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.965+0000 7fece65ff780 1 < canceled multipart upload key=TLEZIJ4881G7 upload=IVRJSIK01HD0 tag=ELBN30324R8A type=write size=2064996 2024-09-12T17:30:34.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.966+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=VOQA319ONEH3 type=write size=878927 2024-09-12T17:30:34.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.967+0000 7fece65ff780 1 < canceled operation key=I31CKY20NO9S tag=ZN4D8SMYMWLT type=del size=3393663 2024-09-12T17:30:34.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.969+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~I5JG62NIARZH.0 size=292640 2024-09-12T17:30:34.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.969+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=I5JG62NIARZH tag=337Q08TZADFZ type=write size=1341216 2024-09-12T17:30:34.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.971+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=NLBSZQRVXY72 type=del 2024-09-12T17:30:34.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.972+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=CV6LKB7J4AYG type=write size=367843 2024-09-12T17:30:34.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.975+0000 7fece65ff780 1 < suggested update operation key=I31CKY20NO9S tag=IUL2MHMBY8GP type=del size=2808390 2024-09-12T17:30:34.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.977+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~686X8VQI5FKA.0 size=1048576 2024-09-12T17:30:34.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.978+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~686X8VQI5FKA.1 size=1048576 2024-09-12T17:30:34.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.979+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~686X8VQI5FKA.2 size=245028 2024-09-12T17:30:34.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.979+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=686X8VQI5FKA tag=RWMQJKHPBICT type=write size=3390756 2024-09-12T17:30:34.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.980+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~FH2ER1UTAJJB.0 size=1048576 2024-09-12T17:30:34.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.981+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~FH2ER1UTAJJB.1 size=1048576 2024-09-12T17:30:34.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.982+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~FH2ER1UTAJJB.2 size=73892 2024-09-12T17:30:34.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.984+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=FH2ER1UTAJJB tag=6BLJNLYJDU89 type=write size=3219620 2024-09-12T17:30:34.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.986+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=ZNDR15JP573A type=del size=564451 2024-09-12T17:30:34.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.987+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=UZVGRRIY7IG3 type=del 2024-09-12T17:30:34.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.988+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=DXF8FSH4I97A type=write size=547457 2024-09-12T17:30:34.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.989+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~D8YGF20QUI1I.0 size=1048576 2024-09-12T17:30:34.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.990+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~D8YGF20QUI1I.1 size=1048576 2024-09-12T17:30:34.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.991+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~D8YGF20QUI1I.2 size=143741 2024-09-12T17:30:34.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.993+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=D8YGF20QUI1I tag=24CIF6LJA0D3 type=write size=3289469 2024-09-12T17:30:34.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.995+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=NDXUY1HM8R0D type=del size=2969196 2024-09-12T17:30:34.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.996+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=JJRWCO2S7TXR type=del 2024-09-12T17:30:34.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.997+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=T7OAN5HUCL7I type=del size=130483 2024-09-12T17:30:35.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:34.998+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~GMXNIM6FVHNN.0 size=778857 2024-09-12T17:30:35.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.000+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=GMXNIM6FVHNN tag=WNHPQQY5ME9H type=write size=1827433 2024-09-12T17:30:35.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.001+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=X3FXM3XLXRM9 type=write size=768185 2024-09-12T17:30:35.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.004+0000 7fece65ff780 1 < suggested update operation key=RKFRKIENSBTO tag=KUY6DFNJCTFG type=del size=704317 2024-09-12T17:30:35.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.005+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=OUF36C93ZBP1 type=del size=1817314 2024-09-12T17:30:35.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.006+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=W0YMH1SRKBFB type=del 2024-09-12T17:30:35.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.008+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~X5XFQN6DZ4E2.0 size=722897 2024-09-12T17:30:35.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.008+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=X5XFQN6DZ4E2 tag=HAE3YB00CF4D type=write size=1771473 2024-09-12T17:30:35.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.010+0000 7fece65ff780 1 < completed delete operation key=IMCE9Z7P4S6R tag=4XAKCYQK8I5Z type=del 2024-09-12T17:30:35.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.011+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=IBT6E2T4K8KS type=del size=1957148 2024-09-12T17:30:35.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.014+0000 7fece65ff780 1 < suggested update operation key=TLEZIJ4881G7 tag=0TUY58X8M0KX type=write size=436360 2024-09-12T17:30:35.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.015+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=Z85U8TVJ34GF type=del size=1598764 2024-09-12T17:30:35.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.017+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=C1EV91ZYXZZD type=del 2024-09-12T17:30:35.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.018+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=065KXG3J9L5Y type=del size=225826 2024-09-12T17:30:35.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.020+0000 7fece65ff780 1 < suggested update operation key=4Z1N3433MC6A tag=CYG3SM4RD5UB type=del size=2023141 2024-09-12T17:30:35.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.022+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=F733W8PI41GW type=del size=954039 2024-09-12T17:30:35.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.023+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~69EYLLI6AJFO.0 size=1048576 2024-09-12T17:30:35.026 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.024+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~69EYLLI6AJFO.1 size=606590 2024-09-12T17:30:35.028 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.027+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=69EYLLI6AJFO tag=3ZTBQT1A7YNH type=write size=2703742 2024-09-12T17:30:35.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.029+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~A09X19CGTJKU.0 size=1048576 2024-09-12T17:30:35.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.030+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~A09X19CGTJKU.1 size=1048576 2024-09-12T17:30:35.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.031+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~A09X19CGTJKU.2 size=354129 2024-09-12T17:30:35.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.031+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=A09X19CGTJKU tag=R8R0O5KXPJS6 type=write size=3499857 2024-09-12T17:30:35.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.033+0000 7fece65ff780 1 < completed write operation key=9IGJG88NX1FS tag=VOQA319ONEH3 type=write size=878927 2024-09-12T17:30:35.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.035+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~1TPP0XR5B19R.0 size=420357 2024-09-12T17:30:35.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.035+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=1TPP0XR5B19R tag=OT0UQTFYIXKV type=write size=1468933 2024-09-12T17:30:35.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.037+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~I5JG62NIARZH.0 size=292640 2024-09-12T17:30:35.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.040+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=I5JG62NIARZH tag=337Q08TZADFZ type=write size=1341216 2024-09-12T17:30:35.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.043+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~PSUKV9W9ATNC.0 size=225265 2024-09-12T17:30:35.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.043+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=PSUKV9W9ATNC tag=UT5JYKD67ATD type=write size=1273841 2024-09-12T17:30:35.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.044+0000 7fece65ff780 1 < completed write operation key=6GUDX5I1AKNH tag=CV6LKB7J4AYG type=write size=367843 2024-09-12T17:30:35.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.047+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~ITM1MXJIHFKX.0 size=1048576 2024-09-12T17:30:35.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.048+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~ITM1MXJIHFKX.1 size=1048576 2024-09-12T17:30:35.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.049+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~ITM1MXJIHFKX.2 size=322429 2024-09-12T17:30:35.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.049+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=ITM1MXJIHFKX tag=VX6UYOZA7S5J type=write size=3468157 2024-09-12T17:30:35.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.050+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~686X8VQI5FKA.0 size=1048576 2024-09-12T17:30:35.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.051+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~686X8VQI5FKA.1 size=1048576 2024-09-12T17:30:35.053 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.052+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~686X8VQI5FKA.2 size=245028 2024-09-12T17:30:35.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.054+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=686X8VQI5FKA tag=RWMQJKHPBICT type=write size=3390756 2024-09-12T17:30:35.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.056+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~38OQ4FY1NU1I.0 size=1048576 2024-09-12T17:30:35.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.057+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~38OQ4FY1NU1I.1 size=1048576 2024-09-12T17:30:35.060 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.058+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~38OQ4FY1NU1I.2 size=187473 2024-09-12T17:30:35.060 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.058+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=38OQ4FY1NU1I tag=LOU350J7XXIX type=write size=3333201 2024-09-12T17:30:35.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.059+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=ZNDR15JP573A type=del 2024-09-12T17:30:35.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.061+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=C06Q8TCK1R80 type=del size=2708413 2024-09-12T17:30:35.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.062+0000 7fece65ff780 -1 < failed to complete operation key=TLEZIJ4881G7 tag=DXF8FSH4I97A type=write size=547457: (22) Invalid argument 2024-09-12T17:30:35.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.064+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~OS9BHBVBPMPC.0 size=808615 2024-09-12T17:30:35.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.064+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=OS9BHBVBPMPC tag=NWPMZ3KQSAT9 type=write size=1857191 2024-09-12T17:30:35.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.065+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=NDXUY1HM8R0D type=del 2024-09-12T17:30:35.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.067+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=034ZQ3Y8LG2G type=del size=3585350 2024-09-12T17:30:35.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.068+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=T7OAN5HUCL7I type=del 2024-09-12T17:30:35.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.069+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=B049M8SH3ZLI type=del size=4108099 2024-09-12T17:30:35.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.070+0000 7fece65ff780 -1 < failed to complete operation key=RKFRKIENSBTO tag=X3FXM3XLXRM9 type=write size=768185: (22) Invalid argument 2024-09-12T17:30:35.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.073+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~Y2SKV2ZKC47J.0 size=1048576 2024-09-12T17:30:35.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.074+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~Y2SKV2ZKC47J.1 size=401248 2024-09-12T17:30:35.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.074+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=Y2SKV2ZKC47J tag=6QFB30POUK0K type=write size=2498400 2024-09-12T17:30:35.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.075+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=OUF36C93ZBP1 type=del 2024-09-12T17:30:35.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.077+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~3LPU0630ENX3.0 size=1048576 2024-09-12T17:30:35.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.078+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~3LPU0630ENX3.1 size=507225 2024-09-12T17:30:35.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.078+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=3LPU0630ENX3 tag=EYKJQ6BBH331 type=write size=2604377 2024-09-12T17:30:35.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.080+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~X5XFQN6DZ4E2.0 size=722897 2024-09-12T17:30:35.083 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.082+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=X5XFQN6DZ4E2 tag=HAE3YB00CF4D type=write size=1771473 2024-09-12T17:30:35.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.083+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=5A9ZD08O8MYC type=del size=2178430 2024-09-12T17:30:35.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.085+0000 7fece65ff780 1 < suggested update operation key=QQNW20B28RJC tag=IBT6E2T4K8KS type=del size=1957148 2024-09-12T17:30:35.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.088+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~910OD6UDWTBO.0 size=1048576 2024-09-12T17:30:35.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.089+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~910OD6UDWTBO.1 size=130471 2024-09-12T17:30:35.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.089+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=910OD6UDWTBO tag=2D2VTFM7O5HI type=write size=2227623 2024-09-12T17:30:35.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.090+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=Z85U8TVJ34GF type=del 2024-09-12T17:30:35.093 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.091+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=7YPPE4BYTXJF type=del size=204915 2024-09-12T17:30:35.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.093+0000 7fece65ff780 -1 < failed to complete operation key=QQNW20B28RJC tag=065KXG3J9L5Y type=del size=225826: (22) Invalid argument 2024-09-12T17:30:35.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.094+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=ZHL379R01EWX type=del size=2440611 2024-09-12T17:30:35.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.096+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=F733W8PI41GW type=del 2024-09-12T17:30:35.098 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.097+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=PYY454G6OF4A type=del size=1376989 2024-09-12T17:30:35.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.098+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~A09X19CGTJKU.0 size=1048576 2024-09-12T17:30:35.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.100+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~A09X19CGTJKU.1 size=1048576 2024-09-12T17:30:35.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.101+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~A09X19CGTJKU.2 size=354129 2024-09-12T17:30:35.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.103+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=A09X19CGTJKU tag=R8R0O5KXPJS6 type=write size=3499857 2024-09-12T17:30:35.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.105+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~9FIJUI54S7XQ.0 size=1048576 2024-09-12T17:30:35.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.106+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~9FIJUI54S7XQ.1 size=1048576 2024-09-12T17:30:35.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.107+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~9FIJUI54S7XQ.2 size=762965 2024-09-12T17:30:35.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.107+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=9FIJUI54S7XQ tag=8N0QKW9VCGWB type=write size=3908693 2024-09-12T17:30:35.110 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.109+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~1TPP0XR5B19R.0 size=420357 2024-09-12T17:30:35.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.111+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=1TPP0XR5B19R tag=OT0UQTFYIXKV type=write size=1468933 2024-09-12T17:30:35.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.113+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~EYW3OY9GR9YD.0 size=1048576 2024-09-12T17:30:35.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.114+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~EYW3OY9GR9YD.1 size=392262 2024-09-12T17:30:35.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.114+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=EYW3OY9GR9YD tag=WHENV6ZDZHP6 type=write size=2489414 2024-09-12T17:30:35.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.115+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~PSUKV9W9ATNC.0 size=225265 2024-09-12T17:30:35.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.118+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=PSUKV9W9ATNC tag=UT5JYKD67ATD type=write size=1273841 2024-09-12T17:30:35.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.120+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~OC0TVPEA6E64.0 size=136060 2024-09-12T17:30:35.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.120+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=OC0TVPEA6E64 tag=TQQ3UA1H0PM3 type=write size=1184636 2024-09-12T17:30:35.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.121+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~ITM1MXJIHFKX.0 size=1048576 2024-09-12T17:30:35.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.124+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~ITM1MXJIHFKX.1 size=1048576 2024-09-12T17:30:35.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.125+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~ITM1MXJIHFKX.2 size=322429 2024-09-12T17:30:35.129 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.127+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=ITM1MXJIHFKX tag=VX6UYOZA7S5J type=write size=3468157 2024-09-12T17:30:35.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.129+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~S77SN352TRBK.0 size=1048576 2024-09-12T17:30:35.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.130+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~S77SN352TRBK.1 size=1048576 2024-09-12T17:30:35.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.133+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~S77SN352TRBK.2 size=118302 2024-09-12T17:30:35.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.133+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=S77SN352TRBK tag=0XCPEQ591SP6 type=write size=3264030 2024-09-12T17:30:35.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.135+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~38OQ4FY1NU1I.0 size=1048576 2024-09-12T17:30:35.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.138+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~38OQ4FY1NU1I.1 size=1048576 2024-09-12T17:30:35.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.139+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~38OQ4FY1NU1I.2 size=187473 2024-09-12T17:30:35.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.141+0000 7fece65ff780 1 < completed multipart upload key=5A7WPGW5P91B upload=38OQ4FY1NU1I tag=LOU350J7XXIX type=write size=3333201 2024-09-12T17:30:35.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.143+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~YZD6FS42MEV7.0 size=1048576 2024-09-12T17:30:35.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.144+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~YZD6FS42MEV7.1 size=954212 2024-09-12T17:30:35.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.144+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=YZD6FS42MEV7 tag=PHT2GR5292UY type=write size=3051364 2024-09-12T17:30:35.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.147+0000 7fece65ff780 1 < suggested remove operation key=RKFRKIENSBTO tag=C06Q8TCK1R80 type=del 2024-09-12T17:30:35.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.150+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~K0YCTN79TVID.0 size=1048576 2024-09-12T17:30:35.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.151+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~K0YCTN79TVID.1 size=314968 2024-09-12T17:30:35.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.151+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=K0YCTN79TVID tag=UIKGZEXMBBIQ type=write size=2412120 2024-09-12T17:30:35.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.152+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~OS9BHBVBPMPC.0 size=808615 2024-09-12T17:30:35.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.154+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=OS9BHBVBPMPC tag=NWPMZ3KQSAT9 type=write size=1857191 2024-09-12T17:30:35.157 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.155+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=7YTW4C0O7TQV type=del size=714837 2024-09-12T17:30:35.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.157+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=034ZQ3Y8LG2G type=del 2024-09-12T17:30:35.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.158+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=K15QDZL45OMZ type=del size=815879 2024-09-12T17:30:35.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.159+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=B049M8SH3ZLI type=del 2024-09-12T17:30:35.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.162+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~ZWN5UDH4HKR6.0 size=1048576 2024-09-12T17:30:35.164 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.163+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~ZWN5UDH4HKR6.1 size=1048576 2024-09-12T17:30:35.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.163+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~ZWN5UDH4HKR6.2 size=874985 2024-09-12T17:30:35.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.163+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=ZWN5UDH4HKR6 tag=WD4CNWAZQXS6 type=write size=4020713 2024-09-12T17:30:35.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.165+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~Y2SKV2ZKC47J.0 size=1048576 2024-09-12T17:30:35.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.166+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~Y2SKV2ZKC47J.1 size=401248 2024-09-12T17:30:35.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.168+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=Y2SKV2ZKC47J tag=6QFB30POUK0K type=write size=2498400 2024-09-12T17:30:35.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.171+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~TTQCPZ4MOWVX.0 size=339204 2024-09-12T17:30:35.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.171+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=TTQCPZ4MOWVX tag=2KLMFV44UULS type=write size=1387780 2024-09-12T17:30:35.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.172+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~3LPU0630ENX3.0 size=1048576 2024-09-12T17:30:35.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.173+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~3LPU0630ENX3.1 size=507225 2024-09-12T17:30:35.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.175+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=3LPU0630ENX3 tag=EYKJQ6BBH331 type=write size=2604377 2024-09-12T17:30:35.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.177+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=V92Q9BON0QUB type=del size=3032762 2024-09-12T17:30:35.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.178+0000 7fece65ff780 1 < completed delete operation key=IMCE9Z7P4S6R tag=5A9ZD08O8MYC type=del 2024-09-12T17:30:35.181 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.179+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=IX5YS258QWTW type=del size=502285 2024-09-12T17:30:35.182 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.180+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~910OD6UDWTBO.0 size=1048576 2024-09-12T17:30:35.182 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.180+0000 7fece65ff780 1 < canceled part key=_multipart_6GUDX5I1AKNH.2~910OD6UDWTBO.1 size=130471 2024-09-12T17:30:35.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.182+0000 7fece65ff780 1 < canceled multipart upload key=6GUDX5I1AKNH upload=910OD6UDWTBO tag=2D2VTFM7O5HI type=write size=2227623 2024-09-12T17:30:35.185 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.184+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=ILXHTX4VKWS8 type=del size=3532449 2024-09-12T17:30:35.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.186+0000 7fece65ff780 1 < suggested remove operation key=6GUDX5I1AKNH tag=7YPPE4BYTXJF type=del 2024-09-12T17:30:35.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.189+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~COKJZHMSVLMW.0 size=1048576 2024-09-12T17:30:35.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.190+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~COKJZHMSVLMW.1 size=1048576 2024-09-12T17:30:35.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.191+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~COKJZHMSVLMW.2 size=50860 2024-09-12T17:30:35.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.191+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=COKJZHMSVLMW tag=K5VZH11SUN1T type=write size=3196588 2024-09-12T17:30:35.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.192+0000 7fece65ff780 1 < canceled operation key=4Z1N3433MC6A tag=ZHL379R01EWX type=del size=2440611 2024-09-12T17:30:35.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.194+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~FKIS24NS3DIC.0 size=1048576 2024-09-12T17:30:35.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.195+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~FKIS24NS3DIC.1 size=798956 2024-09-12T17:30:35.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.195+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=FKIS24NS3DIC tag=MK70AJM2JVF9 type=write size=2896108 2024-09-12T17:30:35.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.197+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=PYY454G6OF4A type=del 2024-09-12T17:30:35.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.198+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=1WT05609U2N7 type=del size=317591 2024-09-12T17:30:35.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.199+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~9FIJUI54S7XQ.0 size=1048576 2024-09-12T17:30:35.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.200+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~9FIJUI54S7XQ.1 size=1048576 2024-09-12T17:30:35.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.200+0000 7fece65ff780 1 < canceled part key=_multipart_9KYNMM6W7RRM.2~9FIJUI54S7XQ.2 size=762965 2024-09-12T17:30:35.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.203+0000 7fece65ff780 1 < canceled multipart upload key=9KYNMM6W7RRM upload=9FIJUI54S7XQ tag=8N0QKW9VCGWB type=write size=3908693 2024-09-12T17:30:35.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.204+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=3JGOEMT9K6RO type=del size=662536 2024-09-12T17:30:35.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.206+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~EYW3OY9GR9YD.0 size=1048576 2024-09-12T17:30:35.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.207+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~EYW3OY9GR9YD.1 size=392262 2024-09-12T17:30:35.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.209+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=EYW3OY9GR9YD tag=WHENV6ZDZHP6 type=write size=2489414 2024-09-12T17:30:35.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.211+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=SWBNJIHZYQ17 type=del size=3051515 2024-09-12T17:30:35.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.212+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~OC0TVPEA6E64.0 size=136060 2024-09-12T17:30:35.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.214+0000 7fece65ff780 1 < completed multipart upload key=W3MBKNIBLV7W upload=OC0TVPEA6E64 tag=TQQ3UA1H0PM3 type=write size=1184636 2024-09-12T17:30:35.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.215+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=QWL2MPESEK34 type=del size=3423933 2024-09-12T17:30:35.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.217+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~S77SN352TRBK.0 size=1048576 2024-09-12T17:30:35.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.217+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~S77SN352TRBK.1 size=1048576 2024-09-12T17:30:35.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.218+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~S77SN352TRBK.2 size=118302 2024-09-12T17:30:35.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.220+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=S77SN352TRBK tag=0XCPEQ591SP6 type=write size=3264030 2024-09-12T17:30:35.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.222+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=GUY0J6HL6XOT type=del size=723651 2024-09-12T17:30:35.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.222+0000 7fece65ff780 1 < canceled part key=_multipart_5A7WPGW5P91B.2~YZD6FS42MEV7.0 size=1048576 2024-09-12T17:30:35.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.223+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~YZD6FS42MEV7.1 size=954212 2024-09-12T17:30:35.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.225+0000 7fece65ff780 1 < canceled multipart upload key=5A7WPGW5P91B upload=YZD6FS42MEV7 tag=PHT2GR5292UY type=write size=3051364 2024-09-12T17:30:35.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.226+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=EUL57H49D3JM type=write size=568648 2024-09-12T17:30:35.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.228+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~K0YCTN79TVID.0 size=1048576 2024-09-12T17:30:35.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.229+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~K0YCTN79TVID.1 size=314968 2024-09-12T17:30:35.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.231+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=K0YCTN79TVID tag=UIKGZEXMBBIQ type=write size=2412120 2024-09-12T17:30:35.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.232+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=NY18NSAP1RHL type=del size=371848 2024-09-12T17:30:35.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.234+0000 7fece65ff780 1 < suggested update operation key=4Z1N3433MC6A tag=7YTW4C0O7TQV type=del size=714837 2024-09-12T17:30:35.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.236+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=6AS9BMOUHSTA type=write size=513341 2024-09-12T17:30:35.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.237+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=K15QDZL45OMZ type=del 2024-09-12T17:30:35.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.239+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~JTHIKQ86MPWT.0 size=1048576 2024-09-12T17:30:35.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.240+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~JTHIKQ86MPWT.1 size=1048576 2024-09-12T17:30:35.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.241+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~JTHIKQ86MPWT.2 size=399112 2024-09-12T17:30:35.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.241+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=JTHIKQ86MPWT tag=NCI4T82R31QE type=write size=3544840 2024-09-12T17:30:35.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.243+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~ZWN5UDH4HKR6.0 size=1048576 2024-09-12T17:30:35.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.244+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~ZWN5UDH4HKR6.1 size=1048576 2024-09-12T17:30:35.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.245+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~ZWN5UDH4HKR6.2 size=874985 2024-09-12T17:30:35.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.247+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=ZWN5UDH4HKR6 tag=WD4CNWAZQXS6 type=write size=4020713 2024-09-12T17:30:35.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.249+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~FONJ0TR9M89E.0 size=1048576 2024-09-12T17:30:35.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.250+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~FONJ0TR9M89E.1 size=548211 2024-09-12T17:30:35.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.250+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=FONJ0TR9M89E tag=6L6670TIHN4H type=write size=2645363 2024-09-12T17:30:35.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.251+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~TTQCPZ4MOWVX.0 size=339204 2024-09-12T17:30:35.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.255+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=TTQCPZ4MOWVX tag=2KLMFV44UULS type=write size=1387780 2024-09-12T17:30:35.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.256+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=ZZE98A35KSAR type=del size=294365 2024-09-12T17:30:35.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.258+0000 7fece65ff780 1 < suggested remove operation key=5LAOX5H1AQWJ tag=V92Q9BON0QUB type=del 2024-09-12T17:30:35.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.260+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~QDB69D2OWU6F.0 size=1048576 2024-09-12T17:30:35.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.261+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~QDB69D2OWU6F.1 size=474649 2024-09-12T17:30:35.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.261+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=QDB69D2OWU6F tag=X6DP33NS6BEL type=write size=2571801 2024-09-12T17:30:35.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.262+0000 7fece65ff780 1 < completed delete operation key=7AS5L998SDV7 tag=IX5YS258QWTW type=del 2024-09-12T17:30:35.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.265+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~70ILNXN1P1DB.0 size=1048576 2024-09-12T17:30:35.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.266+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~70ILNXN1P1DB.1 size=1048576 2024-09-12T17:30:35.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.267+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~70ILNXN1P1DB.2 size=838430 2024-09-12T17:30:35.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.267+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=70ILNXN1P1DB tag=24R2PN4XXRRK type=write size=3984158 2024-09-12T17:30:35.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.268+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=ILXHTX4VKWS8 type=del 2024-09-12T17:30:35.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.270+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~R6948NDCRM9B.0 size=1048576 2024-09-12T17:30:35.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.272+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~R6948NDCRM9B.1 size=1048576 2024-09-12T17:30:35.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.273+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~R6948NDCRM9B.2 size=635276 2024-09-12T17:30:35.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.273+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=R6948NDCRM9B tag=PMX6KLCPL61X type=write size=3781004 2024-09-12T17:30:35.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.274+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~COKJZHMSVLMW.0 size=1048576 2024-09-12T17:30:35.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.275+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~COKJZHMSVLMW.1 size=1048576 2024-09-12T17:30:35.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.276+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~COKJZHMSVLMW.2 size=50860 2024-09-12T17:30:35.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.279+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=COKJZHMSVLMW tag=K5VZH11SUN1T type=write size=3196588 2024-09-12T17:30:35.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.282+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~5KWHS6WCWTFA.0 size=1048576 2024-09-12T17:30:35.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.283+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~5KWHS6WCWTFA.1 size=564301 2024-09-12T17:30:35.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.283+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=5KWHS6WCWTFA tag=XEYQZ9BG0HNX type=write size=2661453 2024-09-12T17:30:35.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.284+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~FKIS24NS3DIC.0 size=1048576 2024-09-12T17:30:35.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.285+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~FKIS24NS3DIC.1 size=798956 2024-09-12T17:30:35.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.287+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=FKIS24NS3DIC tag=MK70AJM2JVF9 type=write size=2896108 2024-09-12T17:30:35.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.288+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=H9236CMP79MG type=write size=382639 2024-09-12T17:30:35.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.291+0000 7fece65ff780 1 < suggested remove operation key=1G9VNO1V4IMW tag=1WT05609U2N7 type=del 2024-09-12T17:30:35.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.293+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~6G9CZ3ECMODO.0 size=197541 2024-09-12T17:30:35.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.293+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=6G9CZ3ECMODO tag=NC5N161MF293 type=write size=1246117 2024-09-12T17:30:35.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.294+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=3JGOEMT9K6RO type=del 2024-09-12T17:30:35.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.295+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=656MZYEKK63Y type=del size=2626235 2024-09-12T17:30:35.298 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.297+0000 7fece65ff780 -1 < failed to complete operation key=4Z1N3433MC6A tag=SWBNJIHZYQ17 type=del size=3051515: (22) Invalid argument 2024-09-12T17:30:35.301 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.299+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~PCZM3QKYT7X8.0 size=1048576 2024-09-12T17:30:35.302 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.300+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~PCZM3QKYT7X8.1 size=531658 2024-09-12T17:30:35.302 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.300+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=PCZM3QKYT7X8 tag=EACFBT4WZNTY type=write size=2628810 2024-09-12T17:30:35.303 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.302+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=QWL2MPESEK34 type=del 2024-09-12T17:30:35.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.305+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~FT34AVR1K3FI.0 size=1048576 2024-09-12T17:30:35.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.306+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~FT34AVR1K3FI.1 size=693294 2024-09-12T17:30:35.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.306+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=FT34AVR1K3FI tag=MPCNETXP7J0E type=write size=2790446 2024-09-12T17:30:35.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.307+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=GUY0J6HL6XOT type=del 2024-09-12T17:30:35.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.309+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~T0FA31BID4HG.0 size=1048576 2024-09-12T17:30:35.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.310+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~T0FA31BID4HG.1 size=995852 2024-09-12T17:30:35.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.310+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=T0FA31BID4HG tag=DMKDVE6NDMOX type=write size=3093004 2024-09-12T17:30:35.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.312+0000 7fece65ff780 1 < completed write operation key=IMCE9Z7P4S6R tag=EUL57H49D3JM type=write size=568648 2024-09-12T17:30:35.314 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.313+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=BR2YTLTCA0K6 type=del size=1764667 2024-09-12T17:30:35.316 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.314+0000 7fece65ff780 -1 < failed to complete operation key=5LAOX5H1AQWJ tag=NY18NSAP1RHL type=del size=371848: (22) Invalid argument 2024-09-12T17:30:35.318 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.316+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~DS2N4U9FGE5K.0 size=1048576 2024-09-12T17:30:35.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.317+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~DS2N4U9FGE5K.1 size=1048576 2024-09-12T17:30:35.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.318+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~DS2N4U9FGE5K.2 size=75348 2024-09-12T17:30:35.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.318+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=DS2N4U9FGE5K tag=M5RU6YCE10TE type=write size=3221076 2024-09-12T17:30:35.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.319+0000 7fece65ff780 1 < completed write operation key=IMCE9Z7P4S6R tag=6AS9BMOUHSTA type=write size=513341 2024-09-12T17:30:35.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.321+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=N47B2BOUSZGN type=del size=638959 2024-09-12T17:30:35.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.322+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~JTHIKQ86MPWT.0 size=1048576 2024-09-12T17:30:35.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.323+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~JTHIKQ86MPWT.1 size=1048576 2024-09-12T17:30:35.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.324+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~JTHIKQ86MPWT.2 size=399112 2024-09-12T17:30:35.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.326+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=JTHIKQ86MPWT tag=NCI4T82R31QE type=write size=3544840 2024-09-12T17:30:35.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.327+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=M9FSKJ141O8J type=del size=2682056 2024-09-12T17:30:35.330 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.329+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~FONJ0TR9M89E.0 size=1048576 2024-09-12T17:30:35.332 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.330+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~FONJ0TR9M89E.1 size=548211 2024-09-12T17:30:35.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.332+0000 7fece65ff780 1 < completed multipart upload key=9KYNMM6W7RRM upload=FONJ0TR9M89E tag=6L6670TIHN4H type=write size=2645363 2024-09-12T17:30:35.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.333+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=ZZV0T4HBIHIO type=write size=116257 2024-09-12T17:30:35.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.335+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=ZZE98A35KSAR type=del 2024-09-12T17:30:35.337 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.336+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=84EHXTE91PAA type=del size=2072482 2024-09-12T17:30:35.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.337+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~QDB69D2OWU6F.0 size=1048576 2024-09-12T17:30:35.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.338+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~QDB69D2OWU6F.1 size=474649 2024-09-12T17:30:35.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.340+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=QDB69D2OWU6F tag=X6DP33NS6BEL type=write size=2571801 2024-09-12T17:30:35.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.342+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~F40BVCFVE59B.0 size=963192 2024-09-12T17:30:35.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.342+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=F40BVCFVE59B tag=VQF3LNYZZ6BX type=write size=2011768 2024-09-12T17:30:35.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.344+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~70ILNXN1P1DB.0 size=1048576 2024-09-12T17:30:35.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.344+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~70ILNXN1P1DB.1 size=1048576 2024-09-12T17:30:35.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.345+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~70ILNXN1P1DB.2 size=838430 2024-09-12T17:30:35.350 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.347+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=70ILNXN1P1DB tag=24R2PN4XXRRK type=write size=3984158 2024-09-12T17:30:35.350 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.349+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=S9L3MGVS3H9B type=write size=864886 2024-09-12T17:30:35.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.350+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~R6948NDCRM9B.0 size=1048576 2024-09-12T17:30:35.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.351+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~R6948NDCRM9B.1 size=1048576 2024-09-12T17:30:35.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.352+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~R6948NDCRM9B.2 size=635276 2024-09-12T17:30:35.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.354+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=R6948NDCRM9B tag=PMX6KLCPL61X type=write size=3781004 2024-09-12T17:30:35.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.355+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=Q5I8BKUIRT51 type=write size=144011 2024-09-12T17:30:35.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.356+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~5KWHS6WCWTFA.0 size=1048576 2024-09-12T17:30:35.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.357+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~5KWHS6WCWTFA.1 size=564301 2024-09-12T17:30:35.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.359+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=5KWHS6WCWTFA tag=XEYQZ9BG0HNX type=write size=2661453 2024-09-12T17:30:35.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.361+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~V09XG1D1XPHE.0 size=1048576 2024-09-12T17:30:35.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.362+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~V09XG1D1XPHE.1 size=1048576 2024-09-12T17:30:35.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.363+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~V09XG1D1XPHE.2 size=454159 2024-09-12T17:30:35.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.363+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=V09XG1D1XPHE tag=RNNCASDHDD10 type=write size=3599887 2024-09-12T17:30:35.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.365+0000 7fece65ff780 1 < completed write operation key=UN6FLMRMAPUS tag=H9236CMP79MG type=write size=382639 2024-09-12T17:30:35.369 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.367+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~2HLX7C8WDPC4.0 size=1048576 2024-09-12T17:30:35.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.369+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~2HLX7C8WDPC4.1 size=1048576 2024-09-12T17:30:35.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.370+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~2HLX7C8WDPC4.2 size=997367 2024-09-12T17:30:35.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.370+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=2HLX7C8WDPC4 tag=712LJ6SQQWP1 type=write size=4143095 2024-09-12T17:30:35.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.371+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~6G9CZ3ECMODO.0 size=197541 2024-09-12T17:30:35.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.373+0000 7fece65ff780 1 < completed multipart upload key=FX8VJO1YXJ4H upload=6G9CZ3ECMODO tag=NC5N161MF293 type=write size=1246117 2024-09-12T17:30:35.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.374+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=3849FEAEUVL1 type=write size=4737 2024-09-12T17:30:35.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.376+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=656MZYEKK63Y type=del 2024-09-12T17:30:35.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.377+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=X3GX9JRDYPIX type=del size=1219757 2024-09-12T17:30:35.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.378+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~PCZM3QKYT7X8.0 size=1048576 2024-09-12T17:30:35.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.379+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~PCZM3QKYT7X8.1 size=531658 2024-09-12T17:30:35.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.381+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=PCZM3QKYT7X8 tag=EACFBT4WZNTY type=write size=2628810 2024-09-12T17:30:35.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.382+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=CLFAGGPQRCDT type=write size=541854 2024-09-12T17:30:35.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.382+0000 7fece65ff780 1 < canceled part key=_multipart_IMCE9Z7P4S6R.2~FT34AVR1K3FI.0 size=1048576 2024-09-12T17:30:35.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.383+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~FT34AVR1K3FI.1 size=693294 2024-09-12T17:30:35.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.386+0000 7fece65ff780 1 < canceled multipart upload key=IMCE9Z7P4S6R upload=FT34AVR1K3FI tag=MPCNETXP7J0E type=write size=2790446 2024-09-12T17:30:35.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.387+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=P30AGYYOE6GW type=del size=4130338 2024-09-12T17:30:35.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.388+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~T0FA31BID4HG.0 size=1048576 2024-09-12T17:30:35.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.389+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~T0FA31BID4HG.1 size=995852 2024-09-12T17:30:35.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.391+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=T0FA31BID4HG tag=DMKDVE6NDMOX type=write size=3093004 2024-09-12T17:30:35.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.392+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=9STTO28NL7PP type=del size=209155 2024-09-12T17:30:35.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.394+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=BR2YTLTCA0K6 type=del 2024-09-12T17:30:35.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.396+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~4CQ8JAJWD8WK.0 size=1048576 2024-09-12T17:30:35.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.396+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~4CQ8JAJWD8WK.1 size=1048576 2024-09-12T17:30:35.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.397+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~4CQ8JAJWD8WK.2 size=786295 2024-09-12T17:30:35.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.397+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=4CQ8JAJWD8WK tag=YXY9ZTY9DN2X type=write size=3932023 2024-09-12T17:30:35.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.399+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~DS2N4U9FGE5K.0 size=1048576 2024-09-12T17:30:35.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.400+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~DS2N4U9FGE5K.1 size=1048576 2024-09-12T17:30:35.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.401+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~DS2N4U9FGE5K.2 size=75348 2024-09-12T17:30:35.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.403+0000 7fece65ff780 1 < completed multipart upload key=FX8VJO1YXJ4H upload=DS2N4U9FGE5K tag=M5RU6YCE10TE type=write size=3221076 2024-09-12T17:30:35.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.405+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~AN5VPVPGULL5.0 size=1016474 2024-09-12T17:30:35.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.405+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=AN5VPVPGULL5 tag=EYI001XPDKIU type=write size=2065050 2024-09-12T17:30:35.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.406+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=N47B2BOUSZGN type=del 2024-09-12T17:30:35.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.408+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~8D1X68MSXXYD.0 size=1048576 2024-09-12T17:30:35.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.409+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~8D1X68MSXXYD.1 size=1048576 2024-09-12T17:30:35.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.410+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~8D1X68MSXXYD.2 size=81484 2024-09-12T17:30:35.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.410+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=8D1X68MSXXYD tag=ZZS3DQ4DOQ67 type=write size=3227212 2024-09-12T17:30:35.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.411+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=M9FSKJ141O8J type=del 2024-09-12T17:30:35.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.412+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=WTTCMQKOUHX4 type=write size=99911 2024-09-12T17:30:35.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.413+0000 7fece65ff780 1 < completed write operation key=2HTNXL56URAK tag=ZZV0T4HBIHIO type=write size=116257 2024-09-12T17:30:35.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.415+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~UD4D46MFBQR5.0 size=1048576 2024-09-12T17:30:35.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.416+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~UD4D46MFBQR5.1 size=1048576 2024-09-12T17:30:35.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.417+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~UD4D46MFBQR5.2 size=871602 2024-09-12T17:30:35.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.417+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=UD4D46MFBQR5 tag=QWONEZLX9HY9 type=write size=4017330 2024-09-12T17:30:35.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.418+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=84EHXTE91PAA type=del 2024-09-12T17:30:35.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.421+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~AD42ZT6A36NJ.0 size=468665 2024-09-12T17:30:35.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.421+0000 7fece65ff780 1 > prepared multipart upload key=Y30269Q7R340 upload=AD42ZT6A36NJ tag=K06EUNZ4Q33F type=write size=1517241 2024-09-12T17:30:35.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.422+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~F40BVCFVE59B.0 size=963192 2024-09-12T17:30:35.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.424+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=F40BVCFVE59B tag=VQF3LNYZZ6BX type=write size=2011768 2024-09-12T17:30:35.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.426+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~5NQWCMB7ZTQQ.0 size=1048576 2024-09-12T17:30:35.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.427+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~5NQWCMB7ZTQQ.1 size=1048576 2024-09-12T17:30:35.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.427+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~5NQWCMB7ZTQQ.2 size=9053 2024-09-12T17:30:35.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.427+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=5NQWCMB7ZTQQ tag=EBU13IOPB3JN type=write size=3154781 2024-09-12T17:30:35.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.429+0000 7fece65ff780 1 < completed write operation key=807GX4RQQLL4 tag=S9L3MGVS3H9B type=write size=864886 2024-09-12T17:30:35.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.430+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=HDA2LCIDC2BP type=del size=736097 2024-09-12T17:30:35.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.431+0000 7fece65ff780 1 < completed write operation key=UCBB99EG8XK2 tag=Q5I8BKUIRT51 type=write size=144011 2024-09-12T17:30:35.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.432+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=UK05POZE3V2P type=del size=2024168 2024-09-12T17:30:35.435 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.433+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~V09XG1D1XPHE.0 size=1048576 2024-09-12T17:30:35.435 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.433+0000 7fece65ff780 1 < canceled part key=_multipart_5A7WPGW5P91B.2~V09XG1D1XPHE.1 size=1048576 2024-09-12T17:30:35.435 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.433+0000 7fece65ff780 1 < canceled part key=_multipart_5A7WPGW5P91B.2~V09XG1D1XPHE.2 size=454159 2024-09-12T17:30:35.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.436+0000 7fece65ff780 1 < canceled multipart upload key=5A7WPGW5P91B upload=V09XG1D1XPHE tag=RNNCASDHDD10 type=write size=3599887 2024-09-12T17:30:35.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.438+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~W4IHPP01B6WP.0 size=1048576 2024-09-12T17:30:35.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.439+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~W4IHPP01B6WP.1 size=1048576 2024-09-12T17:30:35.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.440+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~W4IHPP01B6WP.2 size=1008372 2024-09-12T17:30:35.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.440+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=W4IHPP01B6WP tag=5OV0I0YXCQ8B type=write size=4154100 2024-09-12T17:30:35.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.441+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~2HLX7C8WDPC4.0 size=1048576 2024-09-12T17:30:35.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.442+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~2HLX7C8WDPC4.1 size=1048576 2024-09-12T17:30:35.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.444+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~2HLX7C8WDPC4.2 size=997367 2024-09-12T17:30:35.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.446+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=2HLX7C8WDPC4 tag=712LJ6SQQWP1 type=write size=4143095 2024-09-12T17:30:35.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.448+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~81O49E2N46Z4.0 size=1048576 2024-09-12T17:30:35.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.449+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~81O49E2N46Z4.1 size=665877 2024-09-12T17:30:35.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.449+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=81O49E2N46Z4 tag=KZM27QR8F4CR type=write size=2763029 2024-09-12T17:30:35.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.451+0000 7fece65ff780 1 < suggested update operation key=6CCPZ4TVIU5N tag=3849FEAEUVL1 type=write size=4737 2024-09-12T17:30:35.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.453+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~1J76AD0WZ3UF.0 size=1048576 2024-09-12T17:30:35.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.454+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~1J76AD0WZ3UF.1 size=1048576 2024-09-12T17:30:35.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.455+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~1J76AD0WZ3UF.2 size=688992 2024-09-12T17:30:35.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.455+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=1J76AD0WZ3UF tag=5X5FAUD3U138 type=write size=3834720 2024-09-12T17:30:35.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.456+0000 7fece65ff780 1 < canceled operation key=7AS5L998SDV7 tag=X3GX9JRDYPIX type=del size=1219757 2024-09-12T17:30:35.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.458+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=4VY73S33IXUU type=del size=2543316 2024-09-12T17:30:35.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.459+0000 7fece65ff780 1 < completed write operation key=RKFRKIENSBTO tag=CLFAGGPQRCDT type=write size=541854 2024-09-12T17:30:35.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.461+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~EWJ9W5VOWSGG.0 size=1048576 2024-09-12T17:30:35.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.462+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~EWJ9W5VOWSGG.1 size=824677 2024-09-12T17:30:35.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.462+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=EWJ9W5VOWSGG tag=FE7X04I10X0W type=write size=2921829 2024-09-12T17:30:35.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.464+0000 7fece65ff780 1 < suggested update operation key=807GX4RQQLL4 tag=P30AGYYOE6GW type=del size=4130338 2024-09-12T17:30:35.467 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.466+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=XNK2ETHXFJQT type=write size=578811 2024-09-12T17:30:35.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.467+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=9STTO28NL7PP type=del 2024-09-12T17:30:35.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.468+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=K4GEE6T4M2QY type=del size=3794437 2024-09-12T17:30:35.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.470+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~4CQ8JAJWD8WK.0 size=1048576 2024-09-12T17:30:35.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.471+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~4CQ8JAJWD8WK.1 size=1048576 2024-09-12T17:30:35.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.472+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~4CQ8JAJWD8WK.2 size=786295 2024-09-12T17:30:35.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.474+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=4CQ8JAJWD8WK tag=YXY9ZTY9DN2X type=write size=3932023 2024-09-12T17:30:35.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.475+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=IQAN2ZQZE3DZ type=del size=4106422 2024-09-12T17:30:35.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.477+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~AN5VPVPGULL5.0 size=1016474 2024-09-12T17:30:35.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.480+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=AN5VPVPGULL5 tag=EYI001XPDKIU type=write size=2065050 2024-09-12T17:30:35.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.482+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=3380EQUV2OZ9 type=del size=1689265 2024-09-12T17:30:35.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.484+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~8D1X68MSXXYD.0 size=1048576 2024-09-12T17:30:35.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.485+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~8D1X68MSXXYD.1 size=1048576 2024-09-12T17:30:35.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.486+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~8D1X68MSXXYD.2 size=81484 2024-09-12T17:30:35.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.488+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=8D1X68MSXXYD tag=ZZS3DQ4DOQ67 type=write size=3227212 2024-09-12T17:30:35.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.491+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~8AP0PWMB21K7.0 size=1048576 2024-09-12T17:30:35.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.492+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~8AP0PWMB21K7.1 size=1048576 2024-09-12T17:30:35.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.493+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~8AP0PWMB21K7.2 size=727688 2024-09-12T17:30:35.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.493+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=8AP0PWMB21K7 tag=HYGHYHUN6Z5U type=write size=3873416 2024-09-12T17:30:35.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.494+0000 7fece65ff780 1 < completed write operation key=I31CKY20NO9S tag=WTTCMQKOUHX4 type=write size=99911 2024-09-12T17:30:35.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.496+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~QCSC3MWJ9OXZ.0 size=1048576 2024-09-12T17:30:35.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.497+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~QCSC3MWJ9OXZ.1 size=230502 2024-09-12T17:30:35.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.497+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=QCSC3MWJ9OXZ tag=9JUTPL3N4CRD type=write size=2327654 2024-09-12T17:30:35.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.499+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~UD4D46MFBQR5.0 size=1048576 2024-09-12T17:30:35.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.500+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~UD4D46MFBQR5.1 size=1048576 2024-09-12T17:30:35.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.501+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~UD4D46MFBQR5.2 size=871602 2024-09-12T17:30:35.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.503+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=UD4D46MFBQR5 tag=QWONEZLX9HY9 type=write size=4017330 2024-09-12T17:30:35.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.505+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=2OT1ECXLSLKP type=del size=2581969 2024-09-12T17:30:35.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.505+0000 7fece65ff780 1 < canceled part key=_multipart_Y30269Q7R340.2~AD42ZT6A36NJ.0 size=468665 2024-09-12T17:30:35.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.507+0000 7fece65ff780 1 < canceled multipart upload key=Y30269Q7R340 upload=AD42ZT6A36NJ tag=K06EUNZ4Q33F type=write size=1517241 2024-09-12T17:30:35.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.510+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~8ES07ZYHGWMY.0 size=1048576 2024-09-12T17:30:35.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.511+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~8ES07ZYHGWMY.1 size=756239 2024-09-12T17:30:35.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.511+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=8ES07ZYHGWMY tag=C9OBV3VKKO05 type=write size=2853391 2024-09-12T17:30:35.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.512+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~5NQWCMB7ZTQQ.0 size=1048576 2024-09-12T17:30:35.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.513+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~5NQWCMB7ZTQQ.1 size=1048576 2024-09-12T17:30:35.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.515+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~5NQWCMB7ZTQQ.2 size=9053 2024-09-12T17:30:35.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.517+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=5NQWCMB7ZTQQ tag=EBU13IOPB3JN type=write size=3154781 2024-09-12T17:30:35.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.519+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~9AZ9AI296MK6.0 size=1048576 2024-09-12T17:30:35.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.520+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~9AZ9AI296MK6.1 size=1048576 2024-09-12T17:30:35.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.521+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~9AZ9AI296MK6.2 size=78730 2024-09-12T17:30:35.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.521+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=9AZ9AI296MK6 tag=FDO4FYZO0MEO type=write size=3224458 2024-09-12T17:30:35.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.522+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=HDA2LCIDC2BP type=del 2024-09-12T17:30:35.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.524+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=YL8ET6348RBJ type=del size=3827668 2024-09-12T17:30:35.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.525+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=UK05POZE3V2P type=del 2024-09-12T17:30:35.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.526+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=ZBXUWS83ULET type=del size=1662873 2024-09-12T17:30:35.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.527+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~W4IHPP01B6WP.0 size=1048576 2024-09-12T17:30:35.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.528+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~W4IHPP01B6WP.1 size=1048576 2024-09-12T17:30:35.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.529+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~W4IHPP01B6WP.2 size=1008372 2024-09-12T17:30:35.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.531+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=W4IHPP01B6WP tag=5OV0I0YXCQ8B type=write size=4154100 2024-09-12T17:30:35.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.532+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=A0FSIBD2Z95Z type=del size=2292993 2024-09-12T17:30:35.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.534+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~81O49E2N46Z4.0 size=1048576 2024-09-12T17:30:35.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.535+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~81O49E2N46Z4.1 size=665877 2024-09-12T17:30:35.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.537+0000 7fece65ff780 1 < completed multipart upload key=Q00ZFG0BBDG5 upload=81O49E2N46Z4 tag=KZM27QR8F4CR type=write size=2763029 2024-09-12T17:30:35.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.539+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~BKOPRWZUQJB3.0 size=1048576 2024-09-12T17:30:35.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.540+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~BKOPRWZUQJB3.1 size=719928 2024-09-12T17:30:35.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.540+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=BKOPRWZUQJB3 tag=N87AW5RRDNSG type=write size=2817080 2024-09-12T17:30:35.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.541+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~1J76AD0WZ3UF.0 size=1048576 2024-09-12T17:30:35.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.542+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~1J76AD0WZ3UF.1 size=1048576 2024-09-12T17:30:35.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.543+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~1J76AD0WZ3UF.2 size=688992 2024-09-12T17:30:35.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.545+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=1J76AD0WZ3UF tag=5X5FAUD3U138 type=write size=3834720 2024-09-12T17:30:35.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.547+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=MZM8OYF48W5P type=write size=963545 2024-09-12T17:30:35.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.548+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=4VY73S33IXUU type=del 2024-09-12T17:30:35.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.549+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=LLVXVTPS3YSM type=del size=3987709 2024-09-12T17:30:35.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.550+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~EWJ9W5VOWSGG.0 size=1048576 2024-09-12T17:30:35.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.550+0000 7fece65ff780 1 < canceled part key=_multipart_4Z1N3433MC6A.2~EWJ9W5VOWSGG.1 size=824677 2024-09-12T17:30:35.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.552+0000 7fece65ff780 1 < canceled multipart upload key=4Z1N3433MC6A upload=EWJ9W5VOWSGG tag=FE7X04I10X0W type=write size=2921829 2024-09-12T17:30:35.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.555+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~KCADX2JVM7R0.0 size=1048576 2024-09-12T17:30:35.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.556+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~KCADX2JVM7R0.1 size=835125 2024-09-12T17:30:35.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.556+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=KCADX2JVM7R0 tag=78ISWSV6KJJ2 type=write size=2932277 2024-09-12T17:30:35.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.557+0000 7fece65ff780 1 < completed write operation key=1G9VNO1V4IMW tag=XNK2ETHXFJQT type=write size=578811 2024-09-12T17:30:35.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.559+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~ZCJJEGZXVS35.0 size=14216 2024-09-12T17:30:35.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.559+0000 7fece65ff780 1 > prepared multipart upload key=Y30269Q7R340 upload=ZCJJEGZXVS35 tag=G2WVE6KUAIB4 type=write size=1062792 2024-09-12T17:30:35.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.560+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=K4GEE6T4M2QY type=del 2024-09-12T17:30:35.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.563+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~2VWNJDICBE2T.0 size=1048576 2024-09-12T17:30:35.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.564+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~2VWNJDICBE2T.1 size=1048576 2024-09-12T17:30:35.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.565+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~2VWNJDICBE2T.2 size=923493 2024-09-12T17:30:35.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.565+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=2VWNJDICBE2T tag=S15AUZUBGMH3 type=write size=4069221 2024-09-12T17:30:35.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.566+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=IQAN2ZQZE3DZ type=del 2024-09-12T17:30:35.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.567+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=07W7OY7802B3 type=del size=4186862 2024-09-12T17:30:35.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.568+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=3380EQUV2OZ9 type=del 2024-09-12T17:30:35.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.570+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=FN9LNS0ZQOEA type=del size=1512312 2024-09-12T17:30:35.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.571+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~8AP0PWMB21K7.0 size=1048576 2024-09-12T17:30:35.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.572+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~8AP0PWMB21K7.1 size=1048576 2024-09-12T17:30:35.575 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.573+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~8AP0PWMB21K7.2 size=727688 2024-09-12T17:30:35.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.575+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=8AP0PWMB21K7 tag=HYGHYHUN6Z5U type=write size=3873416 2024-09-12T17:30:35.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.576+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=AOR4O8LFQDV4 type=del size=1412121 2024-09-12T17:30:35.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.578+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~QCSC3MWJ9OXZ.0 size=1048576 2024-09-12T17:30:35.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.578+0000 7fece65ff780 1 < canceled part key=_multipart_6GUDX5I1AKNH.2~QCSC3MWJ9OXZ.1 size=230502 2024-09-12T17:30:35.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.580+0000 7fece65ff780 1 < canceled multipart upload key=6GUDX5I1AKNH upload=QCSC3MWJ9OXZ tag=9JUTPL3N4CRD type=write size=2327654 2024-09-12T17:30:35.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.581+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=UHVWIP3OEI48 type=del size=1302348 2024-09-12T17:30:35.586 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.582+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=2OT1ECXLSLKP type=del 2024-09-12T17:30:35.586 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.584+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=ARFFWVMTT4MI type=del size=2704148 2024-09-12T17:30:35.586 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.585+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~8ES07ZYHGWMY.0 size=1048576 2024-09-12T17:30:35.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.586+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~8ES07ZYHGWMY.1 size=756239 2024-09-12T17:30:35.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.588+0000 7fece65ff780 1 < completed multipart upload key=IMCE9Z7P4S6R upload=8ES07ZYHGWMY tag=C9OBV3VKKO05 type=write size=2853391 2024-09-12T17:30:35.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.589+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=1GG05530A95I type=del size=1548259 2024-09-12T17:30:35.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.590+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~9AZ9AI296MK6.0 size=1048576 2024-09-12T17:30:35.593 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.591+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~9AZ9AI296MK6.1 size=1048576 2024-09-12T17:30:35.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.593+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~9AZ9AI296MK6.2 size=78730 2024-09-12T17:30:35.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.595+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=9AZ9AI296MK6 tag=FDO4FYZO0MEO type=write size=3224458 2024-09-12T17:30:35.600 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.597+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=JG204IF7OT20 type=del size=2399400 2024-09-12T17:30:35.600 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.599+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=YL8ET6348RBJ type=del 2024-09-12T17:30:35.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.601+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~M3A8QP2R13HJ.0 size=1048576 2024-09-12T17:30:35.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.602+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~M3A8QP2R13HJ.1 size=139223 2024-09-12T17:30:35.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.602+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=M3A8QP2R13HJ tag=YMVC9SLE39U0 type=write size=2236375 2024-09-12T17:30:35.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.603+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=ZBXUWS83ULET type=del 2024-09-12T17:30:35.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.604+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=7QB2NHBNZRY6 type=del size=1875686 2024-09-12T17:30:35.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.605+0000 7fece65ff780 1 < completed delete operation key=5A7WPGW5P91B tag=A0FSIBD2Z95Z type=del 2024-09-12T17:30:35.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.607+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=3R7LONHOY4WK type=del size=3729052 2024-09-12T17:30:35.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.608+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~BKOPRWZUQJB3.0 size=1048576 2024-09-12T17:30:35.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.609+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~BKOPRWZUQJB3.1 size=719928 2024-09-12T17:30:35.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.612+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=BKOPRWZUQJB3 tag=N87AW5RRDNSG type=write size=2817080 2024-09-12T17:30:35.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.613+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=1SAO3577DUTN type=del size=3899761 2024-09-12T17:30:35.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.615+0000 7fece65ff780 1 < suggested remove operation key=6GUDX5I1AKNH tag=MZM8OYF48W5P type=write 2024-09-12T17:30:35.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.616+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=1BWR0Z6A17CD type=del size=2489053 2024-09-12T17:30:35.619 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.618+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=LLVXVTPS3YSM type=del 2024-09-12T17:30:35.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.620+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~7IE0CAI2HXJL.0 size=1048576 2024-09-12T17:30:35.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.621+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~7IE0CAI2HXJL.1 size=404963 2024-09-12T17:30:35.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.621+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=7IE0CAI2HXJL tag=G5V2ZU6MRPII type=write size=2502115 2024-09-12T17:30:35.624 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.622+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~KCADX2JVM7R0.0 size=1048576 2024-09-12T17:30:35.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.623+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~KCADX2JVM7R0.1 size=835125 2024-09-12T17:30:35.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.625+0000 7fece65ff780 1 < completed multipart upload key=IMCE9Z7P4S6R upload=KCADX2JVM7R0 tag=78ISWSV6KJJ2 type=write size=2932277 2024-09-12T17:30:35.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.626+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=HQ6L3VHZ6DR4 type=del size=1771542 2024-09-12T17:30:35.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.627+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~ZCJJEGZXVS35.0 size=14216 2024-09-12T17:30:35.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.630+0000 7fece65ff780 1 < completed multipart upload key=Y30269Q7R340 upload=ZCJJEGZXVS35 tag=G2WVE6KUAIB4 type=write size=1062792 2024-09-12T17:30:35.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.632+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~MRNVMHVE7NZ1.0 size=7122 2024-09-12T17:30:35.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.632+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=MRNVMHVE7NZ1 tag=6AK9ZVAKOWHD type=write size=1055698 2024-09-12T17:30:35.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.632+0000 7fece65ff780 1 < canceled part key=_multipart_KKU8T0CVS40V.2~2VWNJDICBE2T.0 size=1048576 2024-09-12T17:30:35.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.633+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~2VWNJDICBE2T.1 size=1048576 2024-09-12T17:30:35.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.634+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~2VWNJDICBE2T.2 size=923493 2024-09-12T17:30:35.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.636+0000 7fece65ff780 1 < canceled multipart upload key=KKU8T0CVS40V upload=2VWNJDICBE2T tag=S15AUZUBGMH3 type=write size=4069221 2024-09-12T17:30:35.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.637+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=R02IKWJYFG95 type=del size=266323 2024-09-12T17:30:35.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.638+0000 7fece65ff780 1 < canceled operation key=2HTNXL56URAK tag=07W7OY7802B3 type=del size=4186862 2024-09-12T17:30:35.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.640+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=FVL1FDCN5TWG type=write size=625106 2024-09-12T17:30:35.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.641+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=FN9LNS0ZQOEA type=del 2024-09-12T17:30:35.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.643+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~RL8J5S40WVKJ.0 size=1048576 2024-09-12T17:30:35.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.644+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~RL8J5S40WVKJ.1 size=638004 2024-09-12T17:30:35.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.644+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=RL8J5S40WVKJ tag=F7UH3G1A3UM4 type=write size=2735156 2024-09-12T17:30:35.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.645+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=AOR4O8LFQDV4 type=del 2024-09-12T17:30:35.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.647+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=DZ46OU63RD9P type=write size=860171 2024-09-12T17:30:35.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.648+0000 7fece65ff780 1 < canceled operation key=Q00ZFG0BBDG5 tag=UHVWIP3OEI48 type=del size=1302348 2024-09-12T17:30:35.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.649+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=R3JP0NVJB1NR type=del size=3521192 2024-09-12T17:30:35.653 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.652+0000 7fece65ff780 1 < suggested remove operation key=Q00ZFG0BBDG5 tag=ARFFWVMTT4MI type=del 2024-09-12T17:30:35.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.653+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=GRGB7UE0VIMZ type=del size=2863605 2024-09-12T17:30:35.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.654+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=1GG05530A95I type=del 2024-09-12T17:30:35.657 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.656+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=ESTGQVLRYFY2 type=del size=1003583 2024-09-12T17:30:35.658 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.657+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=JG204IF7OT20 type=del 2024-09-12T17:30:35.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.658+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=MXVOX1U2GJ6P type=del size=2905290 2024-09-12T17:30:35.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.658+0000 7fece65ff780 1 < canceled part key=_multipart_I31CKY20NO9S.2~M3A8QP2R13HJ.0 size=1048576 2024-09-12T17:30:35.661 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.660+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~M3A8QP2R13HJ.1 size=139223 2024-09-12T17:30:35.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.662+0000 7fece65ff780 1 < canceled multipart upload key=I31CKY20NO9S upload=M3A8QP2R13HJ tag=YMVC9SLE39U0 type=write size=2236375 2024-09-12T17:30:35.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.663+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=7Q11B49ZALVV type=del size=1041104 2024-09-12T17:30:35.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.665+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=7QB2NHBNZRY6 type=del 2024-09-12T17:30:35.667 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.666+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=JGODZ6ZJKWYZ type=del size=1266671 2024-09-12T17:30:35.668 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.667+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=3R7LONHOY4WK type=del 2024-09-12T17:30:35.671 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.669+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~6IMW9FO800F5.0 size=1048576 2024-09-12T17:30:35.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.670+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~6IMW9FO800F5.1 size=834832 2024-09-12T17:30:35.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.670+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=6IMW9FO800F5 tag=1DC7JNOJM32M type=write size=2931984 2024-09-12T17:30:35.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.671+0000 7fece65ff780 1 < completed delete operation key=7AS5L998SDV7 tag=1SAO3577DUTN type=del 2024-09-12T17:30:35.675 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.674+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~UMK1JW4Y1GH2.0 size=1048576 2024-09-12T17:30:35.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.675+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~UMK1JW4Y1GH2.1 size=102821 2024-09-12T17:30:35.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.675+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=UMK1JW4Y1GH2 tag=VPR4VMW9IUA3 type=write size=2199973 2024-09-12T17:30:35.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.677+0000 7fece65ff780 1 < suggested remove operation key=UCBB99EG8XK2 tag=1BWR0Z6A17CD type=del 2024-09-12T17:30:35.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.679+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=Q7B2S4S6EQYK type=del size=364418 2024-09-12T17:30:35.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.680+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~7IE0CAI2HXJL.0 size=1048576 2024-09-12T17:30:35.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.681+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~7IE0CAI2HXJL.1 size=404963 2024-09-12T17:30:35.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.683+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=7IE0CAI2HXJL tag=G5V2ZU6MRPII type=write size=2502115 2024-09-12T17:30:35.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.686+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~0MHYYQBR4C6T.0 size=1048576 2024-09-12T17:30:35.688 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.687+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~0MHYYQBR4C6T.1 size=1048576 2024-09-12T17:30:35.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.688+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~0MHYYQBR4C6T.2 size=332716 2024-09-12T17:30:35.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.688+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=0MHYYQBR4C6T tag=CJTMF8ZGTZSQ type=write size=3478444 2024-09-12T17:30:35.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.690+0000 7fece65ff780 1 < suggested remove operation key=OPMR1WMB14CA tag=HQ6L3VHZ6DR4 type=del 2024-09-12T17:30:35.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.691+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=G1IGH8ST023C type=del size=2385124 2024-09-12T17:30:35.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.692+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~MRNVMHVE7NZ1.0 size=7122 2024-09-12T17:30:35.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.694+0000 7fece65ff780 1 < completed multipart upload key=5A7WPGW5P91B upload=MRNVMHVE7NZ1 tag=6AK9ZVAKOWHD type=write size=1055698 2024-09-12T17:30:35.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.696+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=EL813GD8G37B type=del size=3439200 2024-09-12T17:30:35.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.697+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=R02IKWJYFG95 type=del 2024-09-12T17:30:35.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.698+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=DVVBV4NBI2MR type=del size=1974123 2024-09-12T17:30:35.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.699+0000 7fece65ff780 1 < canceled operation key=5LAOX5H1AQWJ tag=FVL1FDCN5TWG type=write size=625106 2024-09-12T17:30:35.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.701+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=M3SATFPYFLWB type=del size=865594 2024-09-12T17:30:35.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.702+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~RL8J5S40WVKJ.0 size=1048576 2024-09-12T17:30:35.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.703+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~RL8J5S40WVKJ.1 size=638004 2024-09-12T17:30:35.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.705+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=RL8J5S40WVKJ tag=F7UH3G1A3UM4 type=write size=2735156 2024-09-12T17:30:35.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.706+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=UC8J2S22TQH5 type=del size=1607510 2024-09-12T17:30:35.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.707+0000 7fece65ff780 1 < completed write operation key=ZEFSNR1IIA10 tag=DZ46OU63RD9P type=write size=860171 2024-09-12T17:30:35.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.709+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=YS3P59O501NV type=del size=3495245 2024-09-12T17:30:35.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.710+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=R3JP0NVJB1NR type=del 2024-09-12T17:30:35.713 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.711+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=604EVU43XUL3 type=del size=2137130 2024-09-12T17:30:35.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.712+0000 7fece65ff780 -1 < failed to complete operation key=OPMR1WMB14CA tag=GRGB7UE0VIMZ type=del size=2863605: (22) Invalid argument 2024-09-12T17:30:35.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.716+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~4VVOOTXALM6U.0 size=949102 2024-09-12T17:30:35.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.716+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=4VVOOTXALM6U tag=7LAS9DKTX96N type=write size=1997678 2024-09-12T17:30:35.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.720+0000 7fece65ff780 1 < suggested remove operation key=QQNW20B28RJC tag=ESTGQVLRYFY2 type=del 2024-09-12T17:30:35.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.721+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=SQEV5CVPNE5X type=del size=3219256 2024-09-12T17:30:35.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.723+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=MXVOX1U2GJ6P type=del 2024-09-12T17:30:35.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.724+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=OPWFLARI3JTZ type=write size=261249 2024-09-12T17:30:35.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.725+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=7Q11B49ZALVV type=del 2024-09-12T17:30:35.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.726+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=R4GW163U9UZI type=del size=3612205 2024-09-12T17:30:35.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.729+0000 7fece65ff780 1 < suggested update operation key=UN6FLMRMAPUS tag=JGODZ6ZJKWYZ type=del size=1266671 2024-09-12T17:30:35.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.730+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=FQ105NBQ9E2P type=del size=35136 2024-09-12T17:30:35.733 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.732+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~6IMW9FO800F5.0 size=1048576 2024-09-12T17:30:35.733 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.732+0000 7fece65ff780 1 < canceled part key=_multipart_5A7WPGW5P91B.2~6IMW9FO800F5.1 size=834832 2024-09-12T17:30:35.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.734+0000 7fece65ff780 1 < canceled multipart upload key=5A7WPGW5P91B upload=6IMW9FO800F5 tag=1DC7JNOJM32M type=write size=2931984 2024-09-12T17:30:35.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.735+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=2BD758CROZW5 type=del size=3575201 2024-09-12T17:30:35.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.736+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~UMK1JW4Y1GH2.0 size=1048576 2024-09-12T17:30:35.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.738+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~UMK1JW4Y1GH2.1 size=102821 2024-09-12T17:30:35.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.740+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=UMK1JW4Y1GH2 tag=VPR4VMW9IUA3 type=write size=2199973 2024-09-12T17:30:35.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.743+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~H1PKYCPYCU5A.0 size=1048576 2024-09-12T17:30:35.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.744+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~H1PKYCPYCU5A.1 size=391393 2024-09-12T17:30:35.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.744+0000 7fece65ff780 1 > prepared multipart upload key=LSGN631FW1P8 upload=H1PKYCPYCU5A tag=0F5QBY4Y6IGD type=write size=2488545 2024-09-12T17:30:35.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.745+0000 7fece65ff780 1 < completed delete operation key=Q00ZFG0BBDG5 tag=Q7B2S4S6EQYK type=del 2024-09-12T17:30:35.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.748+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~LQ33C03UK256.0 size=1048576 2024-09-12T17:30:35.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.749+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~LQ33C03UK256.1 size=714045 2024-09-12T17:30:35.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.749+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=LQ33C03UK256 tag=21QSCSAA9XG8 type=write size=2811197 2024-09-12T17:30:35.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.750+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~0MHYYQBR4C6T.0 size=1048576 2024-09-12T17:30:35.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.750+0000 7fece65ff780 1 < canceled part key=_multipart_TLEZIJ4881G7.2~0MHYYQBR4C6T.1 size=1048576 2024-09-12T17:30:35.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.751+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~0MHYYQBR4C6T.2 size=332716 2024-09-12T17:30:35.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.753+0000 7fece65ff780 1 < canceled multipart upload key=TLEZIJ4881G7 upload=0MHYYQBR4C6T tag=CJTMF8ZGTZSQ type=write size=3478444 2024-09-12T17:30:35.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.755+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=6JMJ6DZIHM56 type=del size=3053818 2024-09-12T17:30:35.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.756+0000 7fece65ff780 1 < canceled operation key=RKFRKIENSBTO tag=G1IGH8ST023C type=del size=2385124 2024-09-12T17:30:35.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.758+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~G7M8C6IP2JEC.0 size=1048576 2024-09-12T17:30:35.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.759+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~G7M8C6IP2JEC.1 size=793366 2024-09-12T17:30:35.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.759+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=G7M8C6IP2JEC tag=B1IU48NVVZWW type=write size=2890518 2024-09-12T17:30:35.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.760+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=EL813GD8G37B type=del 2024-09-12T17:30:35.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.761+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=BEJPRTKA8B8O type=del size=4030182 2024-09-12T17:30:35.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.763+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=DVVBV4NBI2MR type=del 2024-09-12T17:30:35.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.764+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=LN0515H95JK6 type=write size=366597 2024-09-12T17:30:35.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.766+0000 7fece65ff780 1 < suggested update operation key=UCBB99EG8XK2 tag=M3SATFPYFLWB type=del size=865594 2024-09-12T17:30:35.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.767+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=4ILRLD2DI58K type=del size=811991 2024-09-12T17:30:35.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.768+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=UC8J2S22TQH5 type=del 2024-09-12T17:30:35.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.771+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~JCP3SSDUX4GG.0 size=72346 2024-09-12T17:30:35.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.771+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=JCP3SSDUX4GG tag=SQR99EWNQCM6 type=write size=1120922 2024-09-12T17:30:35.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.772+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=YS3P59O501NV type=del 2024-09-12T17:30:35.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.773+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=RL3WVQMC2X33 type=del size=318450 2024-09-12T17:30:35.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.774+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=604EVU43XUL3 type=del 2024-09-12T17:30:35.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.775+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=9FX078CWIQ1X type=del size=3277188 2024-09-12T17:30:35.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.777+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~4VVOOTXALM6U.0 size=949102 2024-09-12T17:30:35.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.779+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=4VVOOTXALM6U tag=7LAS9DKTX96N type=write size=1997678 2024-09-12T17:30:35.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.781+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~N1DL85GLB0C3.0 size=1048576 2024-09-12T17:30:35.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.782+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~N1DL85GLB0C3.1 size=1048576 2024-09-12T17:30:35.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.783+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~N1DL85GLB0C3.2 size=560117 2024-09-12T17:30:35.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.783+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=N1DL85GLB0C3 tag=LUY4OLWTPIN3 type=write size=3705845 2024-09-12T17:30:35.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.784+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=SQEV5CVPNE5X type=del 2024-09-12T17:30:35.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.785+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=SXDSWGADSM27 type=write size=228021 2024-09-12T17:30:35.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.787+0000 7fece65ff780 1 < completed write operation key=6GUDX5I1AKNH tag=OPWFLARI3JTZ type=write size=261249 2024-09-12T17:30:35.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.788+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=4NQTTU9141HM type=del size=4003360 2024-09-12T17:30:35.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.790+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=R4GW163U9UZI type=del 2024-09-12T17:30:35.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.791+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=WGWVKU1P41MK type=write size=546561 2024-09-12T17:30:35.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.792+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=FQ105NBQ9E2P type=del 2024-09-12T17:30:35.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.793+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=O4A1GDB61GZ4 type=del size=3693975 2024-09-12T17:30:35.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.796+0000 7fece65ff780 1 < suggested remove operation key=Y30269Q7R340 tag=2BD758CROZW5 type=del 2024-09-12T17:30:35.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.797+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=YBEYJ10Z3BOK type=del size=1777270 2024-09-12T17:30:35.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.799+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~H1PKYCPYCU5A.0 size=1048576 2024-09-12T17:30:35.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.800+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~H1PKYCPYCU5A.1 size=391393 2024-09-12T17:30:35.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.802+0000 7fece65ff780 1 < completed multipart upload key=LSGN631FW1P8 upload=H1PKYCPYCU5A tag=0F5QBY4Y6IGD type=write size=2488545 2024-09-12T17:30:35.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.803+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=70L06NPFUL0D type=del size=2568022 2024-09-12T17:30:35.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.804+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~LQ33C03UK256.0 size=1048576 2024-09-12T17:30:35.807 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.806+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~LQ33C03UK256.1 size=714045 2024-09-12T17:30:35.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.808+0000 7fece65ff780 1 < completed multipart upload key=9KYNMM6W7RRM upload=LQ33C03UK256 tag=21QSCSAA9XG8 type=write size=2811197 2024-09-12T17:30:35.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.810+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~0CWJEA7WMLKE.0 size=864825 2024-09-12T17:30:35.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.810+0000 7fece65ff780 1 > prepared multipart upload key=LSGN631FW1P8 upload=0CWJEA7WMLKE tag=NCHFA6IG8EKM type=write size=1913401 2024-09-12T17:30:35.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.813+0000 7fece65ff780 1 < suggested remove operation key=OIHDAJMPUK4I tag=6JMJ6DZIHM56 type=del 2024-09-12T17:30:35.818 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.816+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~LTBBXQ07XOXV.0 size=1048576 2024-09-12T17:30:35.818 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.817+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~LTBBXQ07XOXV.1 size=1048576 2024-09-12T17:30:35.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.818+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~LTBBXQ07XOXV.2 size=957617 2024-09-12T17:30:35.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.818+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=LTBBXQ07XOXV tag=DPDY46CSIAGP type=write size=4103345 2024-09-12T17:30:35.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.820+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~G7M8C6IP2JEC.0 size=1048576 2024-09-12T17:30:35.822 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.821+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~G7M8C6IP2JEC.1 size=793366 2024-09-12T17:30:35.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.823+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=G7M8C6IP2JEC tag=B1IU48NVVZWW type=write size=2890518 2024-09-12T17:30:35.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.824+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=SJKFZ6CIZTB8 type=del size=3219197 2024-09-12T17:30:35.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.826+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=BEJPRTKA8B8O type=del 2024-09-12T17:30:35.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.828+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~B0A05JZ9VPV2.0 size=536333 2024-09-12T17:30:35.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.828+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=B0A05JZ9VPV2 tag=EDBQ3AUD2R0M type=write size=1584909 2024-09-12T17:30:35.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.830+0000 7fece65ff780 1 < completed write operation key=RKFRKIENSBTO tag=LN0515H95JK6 type=write size=366597 2024-09-12T17:30:35.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.832+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~41BCFINGRX0S.0 size=1048576 2024-09-12T17:30:35.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.833+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~41BCFINGRX0S.1 size=1048576 2024-09-12T17:30:35.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.834+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~41BCFINGRX0S.2 size=43868 2024-09-12T17:30:35.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.834+0000 7fece65ff780 1 > prepared multipart upload key=Y30269Q7R340 upload=41BCFINGRX0S tag=DBNA29XGIXRV type=write size=3189596 2024-09-12T17:30:35.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.835+0000 7fece65ff780 1 < canceled operation key=Q00ZFG0BBDG5 tag=4ILRLD2DI58K type=del size=811991 2024-09-12T17:30:35.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.837+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=TSV3Q0S0QZ21 type=del size=2439562 2024-09-12T17:30:35.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.838+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~JCP3SSDUX4GG.0 size=72346 2024-09-12T17:30:35.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.841+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=JCP3SSDUX4GG tag=SQR99EWNQCM6 type=write size=1120922 2024-09-12T17:30:35.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.843+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=2XFS3KJ5OXOH type=del size=3603298 2024-09-12T17:30:35.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.844+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=RL3WVQMC2X33 type=del 2024-09-12T17:30:35.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.846+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~M1SJTHTX1D9S.0 size=1048576 2024-09-12T17:30:35.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.847+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~M1SJTHTX1D9S.1 size=401280 2024-09-12T17:30:35.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.847+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=M1SJTHTX1D9S tag=6AUEUC0XBHZP type=write size=2498432 2024-09-12T17:30:35.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.848+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=9FX078CWIQ1X type=del 2024-09-12T17:30:35.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.849+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=V6E6U9ER2XO1 type=del size=1642433 2024-09-12T17:30:35.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.850+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~N1DL85GLB0C3.0 size=1048576 2024-09-12T17:30:35.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.851+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~N1DL85GLB0C3.1 size=1048576 2024-09-12T17:30:35.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.853+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~N1DL85GLB0C3.2 size=560117 2024-09-12T17:30:35.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.855+0000 7fece65ff780 1 < completed multipart upload key=9KYNMM6W7RRM upload=N1DL85GLB0C3 tag=LUY4OLWTPIN3 type=write size=3705845 2024-09-12T17:30:35.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.857+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~KZ86ILF2UUXW.0 size=1048576 2024-09-12T17:30:35.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.858+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~KZ86ILF2UUXW.1 size=1048576 2024-09-12T17:30:35.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.859+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~KZ86ILF2UUXW.2 size=582668 2024-09-12T17:30:35.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.859+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=KZ86ILF2UUXW tag=QND3LI3HBH1G type=write size=3728396 2024-09-12T17:30:35.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.860+0000 7fece65ff780 1 < completed write operation key=9KYNMM6W7RRM tag=SXDSWGADSM27 type=write size=228021 2024-09-12T17:30:35.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.862+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~7EP2O9B3OF2I.0 size=118527 2024-09-12T17:30:35.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.862+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=7EP2O9B3OF2I tag=U9ISYNTH7QWC type=write size=1167103 2024-09-12T17:30:35.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.863+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=4NQTTU9141HM type=del 2024-09-12T17:30:35.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.864+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=KW92DL25ZHOC type=del size=106303 2024-09-12T17:30:35.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.867+0000 7fece65ff780 1 < suggested update operation key=2HTNXL56URAK tag=WGWVKU1P41MK type=write size=546561 2024-09-12T17:30:35.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.868+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=4AFDUZRG1BDE type=del size=1466784 2024-09-12T17:30:35.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.869+0000 7fece65ff780 1 < canceled operation key=9KYNMM6W7RRM tag=O4A1GDB61GZ4 type=del size=3693975 2024-09-12T17:30:35.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.870+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=WXSCEEBD9STC type=del size=3090407 2024-09-12T17:30:35.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.871+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=YBEYJ10Z3BOK type=del 2024-09-12T17:30:35.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.873+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=4C2RAG15UOZN type=del size=2508644 2024-09-12T17:30:35.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.874+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=70L06NPFUL0D type=del 2024-09-12T17:30:35.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.875+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=3OMYP341QNWU type=del size=249643 2024-09-12T17:30:35.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.876+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~0CWJEA7WMLKE.0 size=864825 2024-09-12T17:30:35.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.878+0000 7fece65ff780 1 < completed multipart upload key=LSGN631FW1P8 upload=0CWJEA7WMLKE tag=NCHFA6IG8EKM type=write size=1913401 2024-09-12T17:30:35.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.880+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=KI2UMB84RYJ5 type=del size=3081092 2024-09-12T17:30:35.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.881+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~LTBBXQ07XOXV.0 size=1048576 2024-09-12T17:30:35.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.882+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~LTBBXQ07XOXV.1 size=1048576 2024-09-12T17:30:35.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.883+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~LTBBXQ07XOXV.2 size=957617 2024-09-12T17:30:35.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.885+0000 7fece65ff780 1 < completed multipart upload key=Q00ZFG0BBDG5 upload=LTBBXQ07XOXV tag=DPDY46CSIAGP type=write size=4103345 2024-09-12T17:30:35.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.888+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~NOHKOLRMIZMF.0 size=1048576 2024-09-12T17:30:35.890 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.889+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~NOHKOLRMIZMF.1 size=1048576 2024-09-12T17:30:35.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.890+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~NOHKOLRMIZMF.2 size=178393 2024-09-12T17:30:35.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.890+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=NOHKOLRMIZMF tag=N0JLB1ARZLC4 type=write size=3324121 2024-09-12T17:30:35.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.891+0000 7fece65ff780 1 < canceled operation key=5LAOX5H1AQWJ tag=SJKFZ6CIZTB8 type=del size=3219197 2024-09-12T17:30:35.894 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.892+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=SGH6YLXXBPS2 type=write size=984912 2024-09-12T17:30:35.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.893+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~B0A05JZ9VPV2.0 size=536333 2024-09-12T17:30:35.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.895+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=B0A05JZ9VPV2 tag=EDBQ3AUD2R0M type=write size=1584909 2024-09-12T17:30:35.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.897+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=3EVEV3IY6XK8 type=del size=155242 2024-09-12T17:30:35.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.898+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~41BCFINGRX0S.0 size=1048576 2024-09-12T17:30:35.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.899+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~41BCFINGRX0S.1 size=1048576 2024-09-12T17:30:35.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.900+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~41BCFINGRX0S.2 size=43868 2024-09-12T17:30:35.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.902+0000 7fece65ff780 1 < completed multipart upload key=Y30269Q7R340 upload=41BCFINGRX0S tag=DBNA29XGIXRV type=write size=3189596 2024-09-12T17:30:35.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.904+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~HMRBTJSPEAFH.0 size=1048576 2024-09-12T17:30:35.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.905+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~HMRBTJSPEAFH.1 size=503924 2024-09-12T17:30:35.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.905+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=HMRBTJSPEAFH tag=DX0DTQKBQNR6 type=write size=2601076 2024-09-12T17:30:35.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.906+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=TSV3Q0S0QZ21 type=del 2024-09-12T17:30:35.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.907+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=536A8MV3JURC type=write size=359793 2024-09-12T17:30:35.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.909+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=2XFS3KJ5OXOH type=del 2024-09-12T17:30:35.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.911+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=OTXK55ZI837W type=del size=2023804 2024-09-12T17:30:35.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.913+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~M1SJTHTX1D9S.0 size=1048576 2024-09-12T17:30:35.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.914+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~M1SJTHTX1D9S.1 size=401280 2024-09-12T17:30:35.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.916+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=M1SJTHTX1D9S tag=6AUEUC0XBHZP type=write size=2498432 2024-09-12T17:30:35.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.918+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~AHKVM5G4DC0F.0 size=1048576 2024-09-12T17:30:35.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.919+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~AHKVM5G4DC0F.1 size=1048576 2024-09-12T17:30:35.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.920+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~AHKVM5G4DC0F.2 size=298266 2024-09-12T17:30:35.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.920+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=AHKVM5G4DC0F tag=GIAMNU1AJT0B type=write size=3443994 2024-09-12T17:30:35.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.921+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=V6E6U9ER2XO1 type=del 2024-09-12T17:30:35.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.922+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=KSJ0F2KJ1TD9 type=write size=781873 2024-09-12T17:30:35.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.924+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~KZ86ILF2UUXW.0 size=1048576 2024-09-12T17:30:35.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.925+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~KZ86ILF2UUXW.1 size=1048576 2024-09-12T17:30:35.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.926+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~KZ86ILF2UUXW.2 size=582668 2024-09-12T17:30:35.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.928+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=KZ86ILF2UUXW tag=QND3LI3HBH1G type=write size=3728396 2024-09-12T17:30:35.932 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.930+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~OEHAOZF6NILO.0 size=1048576 2024-09-12T17:30:35.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.931+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~OEHAOZF6NILO.1 size=71631 2024-09-12T17:30:35.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.931+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=OEHAOZF6NILO tag=J12DAKTHPTJW type=write size=2168783 2024-09-12T17:30:35.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.933+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~7EP2O9B3OF2I.0 size=118527 2024-09-12T17:30:35.936 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.935+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=7EP2O9B3OF2I tag=U9ISYNTH7QWC type=write size=1167103 2024-09-12T17:30:35.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.936+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=HWVF3YSMV7NW type=del size=1381796 2024-09-12T17:30:35.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.939+0000 7fece65ff780 1 < suggested update operation key=IMCE9Z7P4S6R tag=KW92DL25ZHOC type=del size=106303 2024-09-12T17:30:35.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.941+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~NDU4ASY7UOC0.0 size=591931 2024-09-12T17:30:35.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.941+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=NDU4ASY7UOC0 tag=V7DMJ0QBYHH2 type=write size=1640507 2024-09-12T17:30:35.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.942+0000 7fece65ff780 1 < completed delete operation key=OIHDAJMPUK4I tag=4AFDUZRG1BDE type=del 2024-09-12T17:30:35.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.944+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=4P9AA20YASCS type=write size=68889 2024-09-12T17:30:35.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.945+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=WXSCEEBD9STC type=del 2024-09-12T17:30:35.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.946+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=OKBH1UUZBA2K type=del size=2670748 2024-09-12T17:30:35.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.947+0000 7fece65ff780 1 < canceled operation key=9KYNMM6W7RRM tag=4C2RAG15UOZN type=del size=2508644 2024-09-12T17:30:35.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.949+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~543UBOFXBITK.0 size=1048576 2024-09-12T17:30:35.952 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.950+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~543UBOFXBITK.1 size=1048576 2024-09-12T17:30:35.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.951+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~543UBOFXBITK.2 size=146388 2024-09-12T17:30:35.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.951+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=543UBOFXBITK tag=ZEOB85SM9SA7 type=write size=3292116 2024-09-12T17:30:35.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.953+0000 7fece65ff780 1 < canceled operation key=KKU8T0CVS40V tag=3OMYP341QNWU type=del size=249643 2024-09-12T17:30:35.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.954+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=5RPNWRIHFSR1 type=del size=2523476 2024-09-12T17:30:35.958 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.957+0000 7fece65ff780 1 < canceled operation key=OIHDAJMPUK4I tag=KI2UMB84RYJ5 type=del size=3081092 2024-09-12T17:30:35.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.958+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=9GKSTD0A0C3F type=del size=553363 2024-09-12T17:30:35.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.958+0000 7fece65ff780 1 < canceled part key=_multipart_CBYI6C1ICE08.2~NOHKOLRMIZMF.0 size=1048576 2024-09-12T17:30:35.961 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.959+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~NOHKOLRMIZMF.1 size=1048576 2024-09-12T17:30:35.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.960+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~NOHKOLRMIZMF.2 size=178393 2024-09-12T17:30:35.964 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.962+0000 7fece65ff780 1 < canceled multipart upload key=CBYI6C1ICE08 upload=NOHKOLRMIZMF tag=N0JLB1ARZLC4 type=write size=3324121 2024-09-12T17:30:35.966 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.965+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~Z0RIS2UUEUYI.0 size=1048576 2024-09-12T17:30:35.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.966+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~Z0RIS2UUEUYI.1 size=514964 2024-09-12T17:30:35.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.966+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=Z0RIS2UUEUYI tag=Z6EU5PT3K83K type=write size=2612116 2024-09-12T17:30:35.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.967+0000 7fece65ff780 1 < completed write operation key=6CCPZ4TVIU5N tag=SGH6YLXXBPS2 type=write size=984912 2024-09-12T17:30:35.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.970+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~ZJMAWT3KYY0O.0 size=1048576 2024-09-12T17:30:35.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.971+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~ZJMAWT3KYY0O.1 size=1048576 2024-09-12T17:30:35.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.971+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~ZJMAWT3KYY0O.2 size=642262 2024-09-12T17:30:35.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.971+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=ZJMAWT3KYY0O tag=AKIJNLY8CL3H type=write size=3787990 2024-09-12T17:30:35.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.974+0000 7fece65ff780 1 < suggested remove operation key=OIHDAJMPUK4I tag=3EVEV3IY6XK8 type=del 2024-09-12T17:30:35.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.975+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=9XL327MY3ZOE type=write size=599016 2024-09-12T17:30:35.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.977+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~HMRBTJSPEAFH.0 size=1048576 2024-09-12T17:30:35.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.978+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~HMRBTJSPEAFH.1 size=503924 2024-09-12T17:30:35.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.980+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=HMRBTJSPEAFH tag=DX0DTQKBQNR6 type=write size=2601076 2024-09-12T17:30:35.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.982+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~DX1BNJZKZYEA.0 size=1005755 2024-09-12T17:30:35.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.982+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=DX1BNJZKZYEA tag=VF076YMC6VKM type=write size=2054331 2024-09-12T17:30:35.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.983+0000 7fece65ff780 1 < completed write operation key=ZEFSNR1IIA10 tag=536A8MV3JURC type=write size=359793 2024-09-12T17:30:35.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.984+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=JDUZ803MNCTC type=del size=2187778 2024-09-12T17:30:35.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.986+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=OTXK55ZI837W type=del 2024-09-12T17:30:35.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.987+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=Y490SPURA65D type=write size=534141 2024-09-12T17:30:35.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.988+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~AHKVM5G4DC0F.0 size=1048576 2024-09-12T17:30:35.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.989+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~AHKVM5G4DC0F.1 size=1048576 2024-09-12T17:30:35.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.990+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~AHKVM5G4DC0F.2 size=298266 2024-09-12T17:30:35.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.992+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=AHKVM5G4DC0F tag=GIAMNU1AJT0B type=write size=3443994 2024-09-12T17:30:35.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.994+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~RQG0XJDLJ2FB.0 size=1048576 2024-09-12T17:30:35.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.995+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~RQG0XJDLJ2FB.1 size=1048576 2024-09-12T17:30:35.998 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.996+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~RQG0XJDLJ2FB.2 size=201172 2024-09-12T17:30:35.998 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.996+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=RQG0XJDLJ2FB tag=M927CSVEUE2P type=write size=3346900 2024-09-12T17:30:36.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.998+0000 7fece65ff780 1 < suggested update operation key=UCBB99EG8XK2 tag=KSJ0F2KJ1TD9 type=write size=781873 2024-09-12T17:30:36.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:35.999+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=GJUOFD5X18FG type=write size=51765 2024-09-12T17:30:36.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.000+0000 7fece65ff780 1 < canceled part key=_multipart_Q00ZFG0BBDG5.2~OEHAOZF6NILO.0 size=1048576 2024-09-12T17:30:36.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.001+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~OEHAOZF6NILO.1 size=71631 2024-09-12T17:30:36.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.003+0000 7fece65ff780 1 < canceled multipart upload key=Q00ZFG0BBDG5 upload=OEHAOZF6NILO tag=J12DAKTHPTJW type=write size=2168783 2024-09-12T17:30:36.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.004+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=4FOINOUANJFP type=write size=98620 2024-09-12T17:30:36.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.005+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=HWVF3YSMV7NW type=del 2024-09-12T17:30:36.008 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.006+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=DH4YZ3YPRH9O type=write size=844989 2024-09-12T17:30:36.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.007+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~NDU4ASY7UOC0.0 size=591931 2024-09-12T17:30:36.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.010+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=NDU4ASY7UOC0 tag=V7DMJ0QBYHH2 type=write size=1640507 2024-09-12T17:30:36.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.011+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=MT3K4EBAQWEE type=write size=353024 2024-09-12T17:30:36.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.012+0000 7fece65ff780 1 < completed write operation key=IMCE9Z7P4S6R tag=4P9AA20YASCS type=write size=68889 2024-09-12T17:30:36.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.014+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=WSQ1JYTEXW7G type=del size=155182 2024-09-12T17:30:36.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.015+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=OKBH1UUZBA2K type=del 2024-09-12T17:30:36.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.017+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=YTQ69RL9LR30 type=del size=673792 2024-09-12T17:30:36.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.018+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~543UBOFXBITK.0 size=1048576 2024-09-12T17:30:36.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.019+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~543UBOFXBITK.1 size=1048576 2024-09-12T17:30:36.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.020+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~543UBOFXBITK.2 size=146388 2024-09-12T17:30:36.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.022+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=543UBOFXBITK tag=ZEOB85SM9SA7 type=write size=3292116 2024-09-12T17:30:36.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.023+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=R9VBEQRZNV9S type=del size=2664416 2024-09-12T17:30:36.026 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.024+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=5RPNWRIHFSR1 type=del 2024-09-12T17:30:36.027 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.026+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=70YE33C8XS7S type=del size=102648 2024-09-12T17:30:36.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.027+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=9GKSTD0A0C3F type=del 2024-09-12T17:30:36.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.029+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~OGDBJ05VMNI0.0 size=1048576 2024-09-12T17:30:36.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.030+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~OGDBJ05VMNI0.1 size=938970 2024-09-12T17:30:36.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.030+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=OGDBJ05VMNI0 tag=JXV1C51JFMKL type=write size=3036122 2024-09-12T17:30:36.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.031+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~Z0RIS2UUEUYI.0 size=1048576 2024-09-12T17:30:36.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.032+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~Z0RIS2UUEUYI.1 size=514964 2024-09-12T17:30:36.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.034+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=Z0RIS2UUEUYI tag=Z6EU5PT3K83K type=write size=2612116 2024-09-12T17:30:36.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.035+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=47BP103ZWK9S type=del size=661786 2024-09-12T17:30:36.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.037+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~ZJMAWT3KYY0O.0 size=1048576 2024-09-12T17:30:36.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.037+0000 7fece65ff780 1 < canceled part key=_multipart_ZEFSNR1IIA10.2~ZJMAWT3KYY0O.1 size=1048576 2024-09-12T17:30:36.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.037+0000 7fece65ff780 1 < canceled part key=_multipart_ZEFSNR1IIA10.2~ZJMAWT3KYY0O.2 size=642262 2024-09-12T17:30:36.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.039+0000 7fece65ff780 1 < canceled multipart upload key=ZEFSNR1IIA10 upload=ZJMAWT3KYY0O tag=AKIJNLY8CL3H type=write size=3787990 2024-09-12T17:30:36.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.040+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=6W8LNZKIKHBW type=del size=1444573 2024-09-12T17:30:36.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.043+0000 7fece65ff780 1 < suggested remove operation key=1G9VNO1V4IMW tag=9XL327MY3ZOE type=write 2024-09-12T17:30:36.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.045+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~KT7IJO8OPPCY.0 size=1048576 2024-09-12T17:30:36.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.046+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~KT7IJO8OPPCY.1 size=756712 2024-09-12T17:30:36.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.046+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=KT7IJO8OPPCY tag=7X1XCSN5IOBL type=write size=2853864 2024-09-12T17:30:36.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.048+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~DX1BNJZKZYEA.0 size=1005755 2024-09-12T17:30:36.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.050+0000 7fece65ff780 1 < completed multipart upload key=Q00ZFG0BBDG5 upload=DX1BNJZKZYEA tag=VF076YMC6VKM type=write size=2054331 2024-09-12T17:30:36.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.052+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~AO757XUIS6KO.0 size=1048576 2024-09-12T17:30:36.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.053+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~AO757XUIS6KO.1 size=1048576 2024-09-12T17:30:36.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.054+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~AO757XUIS6KO.2 size=529316 2024-09-12T17:30:36.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.054+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=AO757XUIS6KO tag=PU7FA6ODINAW type=write size=3675044 2024-09-12T17:30:36.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.055+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=JDUZ803MNCTC type=del 2024-09-12T17:30:36.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.057+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=GNZ46O7TX4JO type=del size=3521699 2024-09-12T17:30:36.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.059+0000 7fece65ff780 1 < suggested remove operation key=QQNW20B28RJC tag=Y490SPURA65D type=write 2024-09-12T17:30:36.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.060+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=V7RUR5QH5TUP type=del size=2676439 2024-09-12T17:30:36.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.062+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~RQG0XJDLJ2FB.0 size=1048576 2024-09-12T17:30:36.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.063+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~RQG0XJDLJ2FB.1 size=1048576 2024-09-12T17:30:36.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.064+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~RQG0XJDLJ2FB.2 size=201172 2024-09-12T17:30:36.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.066+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=RQG0XJDLJ2FB tag=M927CSVEUE2P type=write size=3346900 2024-09-12T17:30:36.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.067+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=QBUVD4Y8S3XN type=del size=35363 2024-09-12T17:30:36.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.068+0000 7fece65ff780 1 < completed write operation key=KKU8T0CVS40V tag=GJUOFD5X18FG type=write size=51765 2024-09-12T17:30:36.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.071+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~1XM4SKOIS4LD.0 size=1048576 2024-09-12T17:30:36.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.073+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~1XM4SKOIS4LD.1 size=1048576 2024-09-12T17:30:36.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.074+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~1XM4SKOIS4LD.2 size=67277 2024-09-12T17:30:36.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.074+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=1XM4SKOIS4LD tag=G03JSVCMHBGR type=write size=3213005 2024-09-12T17:30:36.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.075+0000 7fece65ff780 -1 < failed to complete operation key=1G9VNO1V4IMW tag=4FOINOUANJFP type=write size=98620: (22) Invalid argument 2024-09-12T17:30:36.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.077+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=1L9KH0ZZ2CVR type=write size=818633 2024-09-12T17:30:36.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.078+0000 7fece65ff780 1 < completed write operation key=RKFRKIENSBTO tag=DH4YZ3YPRH9O type=write size=844989 2024-09-12T17:30:36.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.080+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~T17HFENC9V9V.0 size=1048576 2024-09-12T17:30:36.083 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.081+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~T17HFENC9V9V.1 size=1048576 2024-09-12T17:30:36.083 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.082+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~T17HFENC9V9V.2 size=213208 2024-09-12T17:30:36.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.082+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=T17HFENC9V9V tag=9QADV4SZM0D8 type=write size=3358936 2024-09-12T17:30:36.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.083+0000 7fece65ff780 1 < completed write operation key=6CCPZ4TVIU5N tag=MT3K4EBAQWEE type=write size=353024 2024-09-12T17:30:36.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.084+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=I2FGJ9TZ9QLN type=del size=1426000 2024-09-12T17:30:36.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.086+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=WSQ1JYTEXW7G type=del 2024-09-12T17:30:36.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.087+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=3Y7KN5DNTZZQ type=del size=61480 2024-09-12T17:30:36.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.088+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=YTQ69RL9LR30 type=del 2024-09-12T17:30:36.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.090+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~C3B7OYVX3ST1.0 size=1048576 2024-09-12T17:30:36.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.091+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~C3B7OYVX3ST1.1 size=1048576 2024-09-12T17:30:36.093 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.092+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~C3B7OYVX3ST1.2 size=688589 2024-09-12T17:30:36.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.092+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=C3B7OYVX3ST1 tag=G3AD91YF4W23 type=write size=3834317 2024-09-12T17:30:36.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.093+0000 7fece65ff780 1 < completed delete operation key=5A7WPGW5P91B tag=R9VBEQRZNV9S type=del 2024-09-12T17:30:36.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.095+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~BSDYACVMWHE0.0 size=632298 2024-09-12T17:30:36.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.095+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=BSDYACVMWHE0 tag=P9MM7D65HSMD type=write size=1680874 2024-09-12T17:30:36.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.098+0000 7fece65ff780 1 < suggested remove operation key=7AS5L998SDV7 tag=70YE33C8XS7S type=del 2024-09-12T17:30:36.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.101+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~GBIIK8GRFJWP.0 size=1048576 2024-09-12T17:30:36.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.102+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~GBIIK8GRFJWP.1 size=1048576 2024-09-12T17:30:36.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.103+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~GBIIK8GRFJWP.2 size=26184 2024-09-12T17:30:36.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.103+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=GBIIK8GRFJWP tag=GD7D8HN8GIVJ type=write size=3171912 2024-09-12T17:30:36.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.104+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~OGDBJ05VMNI0.0 size=1048576 2024-09-12T17:30:36.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.105+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~OGDBJ05VMNI0.1 size=938970 2024-09-12T17:30:36.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.107+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=OGDBJ05VMNI0 tag=JXV1C51JFMKL type=write size=3036122 2024-09-12T17:30:36.110 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.108+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=KGM43FDAZ18A type=del size=2913037 2024-09-12T17:30:36.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.110+0000 7fece65ff780 -1 < failed to complete operation key=QQNW20B28RJC tag=47BP103ZWK9S type=del size=661786: (22) Invalid argument 2024-09-12T17:30:36.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.111+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=3WUH090YG7AR type=write size=339254 2024-09-12T17:30:36.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.112+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=6W8LNZKIKHBW type=del 2024-09-12T17:30:36.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.113+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=4P7O2X3EIVP2 type=del size=3036383 2024-09-12T17:30:36.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.114+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~KT7IJO8OPPCY.0 size=1048576 2024-09-12T17:30:36.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.115+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~KT7IJO8OPPCY.1 size=756712 2024-09-12T17:30:36.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.117+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=KT7IJO8OPPCY tag=7X1XCSN5IOBL type=write size=2853864 2024-09-12T17:30:36.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.119+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=EHYND03947NU type=del size=3075063 2024-09-12T17:30:36.121 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.119+0000 7fece65ff780 1 < canceled part key=_multipart_CEERZVBJQHP0.2~AO757XUIS6KO.0 size=1048576 2024-09-12T17:30:36.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.120+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~AO757XUIS6KO.1 size=1048576 2024-09-12T17:30:36.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.121+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~AO757XUIS6KO.2 size=529316 2024-09-12T17:30:36.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.123+0000 7fece65ff780 1 < canceled multipart upload key=CEERZVBJQHP0 upload=AO757XUIS6KO tag=PU7FA6ODINAW type=write size=3675044 2024-09-12T17:30:36.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.125+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~I0HRNP0ETM7P.0 size=1048576 2024-09-12T17:30:36.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.126+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~I0HRNP0ETM7P.1 size=1048576 2024-09-12T17:30:36.129 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.127+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~I0HRNP0ETM7P.2 size=636664 2024-09-12T17:30:36.129 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.127+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=I0HRNP0ETM7P tag=ODOK6AQHXXRM type=write size=3782392 2024-09-12T17:30:36.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.129+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=GNZ46O7TX4JO type=del 2024-09-12T17:30:36.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.130+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=U1SJYA11CJZ7 type=del size=1753965 2024-09-12T17:30:36.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.131+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=V7RUR5QH5TUP type=del 2024-09-12T17:30:36.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.132+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=M3H306H9YYUJ type=del size=3761485 2024-09-12T17:30:36.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.135+0000 7fece65ff780 1 < suggested remove operation key=UCBB99EG8XK2 tag=QBUVD4Y8S3XN type=del 2024-09-12T17:30:36.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.137+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~PM8YNVP0STSR.0 size=1048576 2024-09-12T17:30:36.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.138+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~PM8YNVP0STSR.1 size=1048576 2024-09-12T17:30:36.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.139+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~PM8YNVP0STSR.2 size=663543 2024-09-12T17:30:36.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.139+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=PM8YNVP0STSR tag=2Z468USBMLG1 type=write size=3809271 2024-09-12T17:30:36.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.140+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~1XM4SKOIS4LD.0 size=1048576 2024-09-12T17:30:36.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.141+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~1XM4SKOIS4LD.1 size=1048576 2024-09-12T17:30:36.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.142+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~1XM4SKOIS4LD.2 size=67277 2024-09-12T17:30:36.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.145+0000 7fece65ff780 1 < completed multipart upload key=9KYNMM6W7RRM upload=1XM4SKOIS4LD tag=G03JSVCMHBGR type=write size=3213005 2024-09-12T17:30:36.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.146+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=7G2AF4NYUQIA type=del size=4031547 2024-09-12T17:30:36.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.148+0000 7fece65ff780 1 < suggested remove operation key=807GX4RQQLL4 tag=1L9KH0ZZ2CVR type=write 2024-09-12T17:30:36.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.150+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~EE5EDXZDZQ2G.0 size=1048576 2024-09-12T17:30:36.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.151+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~EE5EDXZDZQ2G.1 size=673527 2024-09-12T17:30:36.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.151+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=EE5EDXZDZQ2G tag=DSUE4EKBTUFD type=write size=2770679 2024-09-12T17:30:36.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.153+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~T17HFENC9V9V.0 size=1048576 2024-09-12T17:30:36.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.154+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~T17HFENC9V9V.1 size=1048576 2024-09-12T17:30:36.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.154+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~T17HFENC9V9V.2 size=213208 2024-09-12T17:30:36.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.156+0000 7fece65ff780 1 < completed multipart upload key=4Z1N3433MC6A upload=T17HFENC9V9V tag=9QADV4SZM0D8 type=write size=3358936 2024-09-12T17:30:36.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.158+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=YNIG7VXPP1OV type=del size=3145483 2024-09-12T17:30:36.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.159+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=I2FGJ9TZ9QLN type=del 2024-09-12T17:30:36.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.160+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=09KVCD2NDICV type=del size=2742928 2024-09-12T17:30:36.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.161+0000 7fece65ff780 -1 < failed to complete operation key=UCBB99EG8XK2 tag=3Y7KN5DNTZZQ type=del size=61480: (22) Invalid argument 2024-09-12T17:30:36.164 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.162+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=Y5DNLTIOJLO3 type=del size=2371722 2024-09-12T17:30:36.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.164+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~C3B7OYVX3ST1.0 size=1048576 2024-09-12T17:30:36.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.164+0000 7fece65ff780 1 < canceled part key=_multipart_TLEZIJ4881G7.2~C3B7OYVX3ST1.1 size=1048576 2024-09-12T17:30:36.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.165+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~C3B7OYVX3ST1.2 size=688589 2024-09-12T17:30:36.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.167+0000 7fece65ff780 1 < canceled multipart upload key=TLEZIJ4881G7 upload=C3B7OYVX3ST1 tag=G3AD91YF4W23 type=write size=3834317 2024-09-12T17:30:36.171 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.169+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~FOOZ6P39WVLM.0 size=1048576 2024-09-12T17:30:36.171 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.170+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~FOOZ6P39WVLM.1 size=926094 2024-09-12T17:30:36.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.170+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=FOOZ6P39WVLM tag=8HGRJAVKVPUE type=write size=3023246 2024-09-12T17:30:36.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.171+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~BSDYACVMWHE0.0 size=632298 2024-09-12T17:30:36.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.173+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=BSDYACVMWHE0 tag=P9MM7D65HSMD type=write size=1680874 2024-09-12T17:30:36.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.174+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=EF2J8ZM8NG6G type=del size=1401820 2024-09-12T17:30:36.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.176+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~GBIIK8GRFJWP.0 size=1048576 2024-09-12T17:30:36.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.177+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~GBIIK8GRFJWP.1 size=1048576 2024-09-12T17:30:36.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.179+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~GBIIK8GRFJWP.2 size=26184 2024-09-12T17:30:36.182 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.181+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=GBIIK8GRFJWP tag=GD7D8HN8GIVJ type=write size=3171912 2024-09-12T17:30:36.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.182+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=HSA599LG0FGZ type=del size=2646433 2024-09-12T17:30:36.185 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.184+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=KGM43FDAZ18A type=del 2024-09-12T17:30:36.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.186+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~7JSY5NJSHGX6.0 size=935778 2024-09-12T17:30:36.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.186+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=7JSY5NJSHGX6 tag=BYBC6LR3IKO1 type=write size=1984354 2024-09-12T17:30:36.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.189+0000 7fece65ff780 1 < completed write operation key=9IGJG88NX1FS tag=3WUH090YG7AR type=write size=339254 2024-09-12T17:30:36.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.193+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~12T6BUH4Z85Z.0 size=679745 2024-09-12T17:30:36.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.193+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=12T6BUH4Z85Z tag=SZI1RRK8CA52 type=write size=1728321 2024-09-12T17:30:36.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.194+0000 7fece65ff780 1 < canceled operation key=I7TGK5A3JHH5 tag=4P7O2X3EIVP2 type=del size=3036383 2024-09-12T17:30:36.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.196+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=S0X1DBYZF2IC type=del size=1143696 2024-09-12T17:30:36.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.197+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=EHYND03947NU type=del 2024-09-12T17:30:36.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.199+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=DH91LSU7MHJ6 type=del size=2875554 2024-09-12T17:30:36.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.200+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~I0HRNP0ETM7P.0 size=1048576 2024-09-12T17:30:36.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.202+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~I0HRNP0ETM7P.1 size=1048576 2024-09-12T17:30:36.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.203+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~I0HRNP0ETM7P.2 size=636664 2024-09-12T17:30:36.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.205+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=I0HRNP0ETM7P tag=ODOK6AQHXXRM type=write size=3782392 2024-09-12T17:30:36.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.207+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=XGDY8684HZC7 type=del size=2748126 2024-09-12T17:30:36.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.208+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=U1SJYA11CJZ7 type=del 2024-09-12T17:30:36.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.210+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=KWUIZ3D24Y4E type=del size=2273440 2024-09-12T17:30:36.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.213+0000 7fece65ff780 1 < suggested update operation key=CEERZVBJQHP0 tag=M3H306H9YYUJ type=del size=3761485 2024-09-12T17:30:36.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.214+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=A7LMZHR1FUZI type=del size=3473700 2024-09-12T17:30:36.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.216+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~PM8YNVP0STSR.0 size=1048576 2024-09-12T17:30:36.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.217+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~PM8YNVP0STSR.1 size=1048576 2024-09-12T17:30:36.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.218+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~PM8YNVP0STSR.2 size=663543 2024-09-12T17:30:36.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.220+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=PM8YNVP0STSR tag=2Z468USBMLG1 type=write size=3809271 2024-09-12T17:30:36.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.223+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~IHZ0RFQRH9AX.0 size=458801 2024-09-12T17:30:36.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.223+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=IHZ0RFQRH9AX tag=FR3BT2VBTDF3 type=write size=1507377 2024-09-12T17:30:36.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.224+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=7G2AF4NYUQIA type=del 2024-09-12T17:30:36.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.227+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~F2V3LPDQ4FLA.0 size=1048576 2024-09-12T17:30:36.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.229+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~F2V3LPDQ4FLA.1 size=1048576 2024-09-12T17:30:36.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.230+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~F2V3LPDQ4FLA.2 size=622459 2024-09-12T17:30:36.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.230+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=F2V3LPDQ4FLA tag=2UJ6RFFQVCJG type=write size=3768187 2024-09-12T17:30:36.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.231+0000 7fece65ff780 1 < canceled part key=_multipart_5LAOX5H1AQWJ.2~EE5EDXZDZQ2G.0 size=1048576 2024-09-12T17:30:36.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.232+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~EE5EDXZDZQ2G.1 size=673527 2024-09-12T17:30:36.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.234+0000 7fece65ff780 1 < canceled multipart upload key=5LAOX5H1AQWJ upload=EE5EDXZDZQ2G tag=DSUE4EKBTUFD type=write size=2770679 2024-09-12T17:30:36.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.235+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=2OJKHR88HP4V type=write size=335742 2024-09-12T17:30:36.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.237+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=YNIG7VXPP1OV type=del 2024-09-12T17:30:36.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.239+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~1B72NI25RYI6.0 size=281444 2024-09-12T17:30:36.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.239+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=1B72NI25RYI6 tag=IXZIZG3YXIZF type=write size=1330020 2024-09-12T17:30:36.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.242+0000 7fece65ff780 1 < suggested update operation key=FX8VJO1YXJ4H tag=09KVCD2NDICV type=del size=2742928 2024-09-12T17:30:36.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.243+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=KJH6B2A3VZFX type=del size=908055 2024-09-12T17:30:36.246 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.244+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=Y5DNLTIOJLO3 type=del 2024-09-12T17:30:36.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.246+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=3ZU30FI1ZNOG type=del size=2105507 2024-09-12T17:30:36.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.247+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~FOOZ6P39WVLM.0 size=1048576 2024-09-12T17:30:36.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.247+0000 7fece65ff780 1 < canceled part key=_multipart_I7TGK5A3JHH5.2~FOOZ6P39WVLM.1 size=926094 2024-09-12T17:30:36.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.249+0000 7fece65ff780 1 < canceled multipart upload key=I7TGK5A3JHH5 upload=FOOZ6P39WVLM tag=8HGRJAVKVPUE type=write size=3023246 2024-09-12T17:30:36.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.252+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~K6LBLO5IB7K7.0 size=1048576 2024-09-12T17:30:36.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.253+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~K6LBLO5IB7K7.1 size=1048576 2024-09-12T17:30:36.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.254+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~K6LBLO5IB7K7.2 size=428077 2024-09-12T17:30:36.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.254+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=K6LBLO5IB7K7 tag=24J9HY2ZFJKZ type=write size=3573805 2024-09-12T17:30:36.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.255+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=EF2J8ZM8NG6G type=del 2024-09-12T17:30:36.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.258+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~LFO5B4E01DH4.0 size=685137 2024-09-12T17:30:36.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.258+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=LFO5B4E01DH4 tag=G37QRNK94CO2 type=write size=1733713 2024-09-12T17:30:36.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.259+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=HSA599LG0FGZ type=del 2024-09-12T17:30:36.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.261+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=DVNDSREJZASB type=del size=1055148 2024-09-12T17:30:36.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.262+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~7JSY5NJSHGX6.0 size=935778 2024-09-12T17:30:36.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.264+0000 7fece65ff780 1 < completed multipart upload key=IMCE9Z7P4S6R upload=7JSY5NJSHGX6 tag=BYBC6LR3IKO1 type=write size=1984354 2024-09-12T17:30:36.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.266+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=VMS6Y0HNAI5S type=del size=650119 2024-09-12T17:30:36.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.266+0000 7fece65ff780 1 < canceled part key=_multipart_5LAOX5H1AQWJ.2~12T6BUH4Z85Z.0 size=679745 2024-09-12T17:30:36.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.268+0000 7fece65ff780 1 < canceled multipart upload key=5LAOX5H1AQWJ upload=12T6BUH4Z85Z tag=SZI1RRK8CA52 type=write size=1728321 2024-09-12T17:30:36.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.271+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~ZS4V9JCMJ80A.0 size=1048576 2024-09-12T17:30:36.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.272+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~ZS4V9JCMJ80A.1 size=1048576 2024-09-12T17:30:36.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.273+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~ZS4V9JCMJ80A.2 size=158884 2024-09-12T17:30:36.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.273+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=ZS4V9JCMJ80A tag=CBKEN2QCENJ4 type=write size=3304612 2024-09-12T17:30:36.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.274+0000 7fece65ff780 1 < canceled operation key=6CCPZ4TVIU5N tag=S0X1DBYZF2IC type=del size=1143696 2024-09-12T17:30:36.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.275+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=R5FQ4X7GSHWU type=del size=574530 2024-09-12T17:30:36.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.277+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=DH91LSU7MHJ6 type=del 2024-09-12T17:30:36.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.278+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=SB0XIJQ11GY8 type=del size=3073062 2024-09-12T17:30:36.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.279+0000 7fece65ff780 1 < canceled operation key=6CCPZ4TVIU5N tag=XGDY8684HZC7 type=del size=2748126 2024-09-12T17:30:36.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.280+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=80XVRITNJITC type=write size=453669 2024-09-12T17:30:36.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.282+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=KWUIZ3D24Y4E type=del 2024-09-12T17:30:36.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.283+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=GNAYH9DA72N5 type=del size=1945496 2024-09-12T17:30:36.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.284+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=A7LMZHR1FUZI type=del 2024-09-12T17:30:36.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.285+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=66E4ANCJ4HB8 type=write size=370358 2024-09-12T17:30:36.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.287+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~IHZ0RFQRH9AX.0 size=458801 2024-09-12T17:30:36.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.288+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=IHZ0RFQRH9AX tag=FR3BT2VBTDF3 type=write size=1507377 2024-09-12T17:30:36.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.290+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=JPI7B8N2QGZP type=write size=138210 2024-09-12T17:30:36.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.291+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~F2V3LPDQ4FLA.0 size=1048576 2024-09-12T17:30:36.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.292+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~F2V3LPDQ4FLA.1 size=1048576 2024-09-12T17:30:36.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.293+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~F2V3LPDQ4FLA.2 size=622459 2024-09-12T17:30:36.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.295+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=F2V3LPDQ4FLA tag=2UJ6RFFQVCJG type=write size=3768187 2024-09-12T17:30:36.298 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.296+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=A8BFSSZUESHM type=write size=355643 2024-09-12T17:30:36.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.297+0000 7fece65ff780 1 < completed write operation key=9IGJG88NX1FS tag=2OJKHR88HP4V type=write size=335742 2024-09-12T17:30:36.300 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.299+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=O7BII41QZH1C type=del size=429144 2024-09-12T17:30:36.301 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.300+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~1B72NI25RYI6.0 size=281444 2024-09-12T17:30:36.303 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.302+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=1B72NI25RYI6 tag=IXZIZG3YXIZF type=write size=1330020 2024-09-12T17:30:36.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.304+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~S30NKVD600WP.0 size=1048576 2024-09-12T17:30:36.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.305+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~S30NKVD600WP.1 size=438260 2024-09-12T17:30:36.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.305+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=S30NKVD600WP tag=F5JXWJJC6Y57 type=write size=2535412 2024-09-12T17:30:36.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.306+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=KJH6B2A3VZFX type=del 2024-09-12T17:30:36.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.307+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=EO0876WZZ46J type=write size=1045279 2024-09-12T17:30:36.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.308+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=3ZU30FI1ZNOG type=del 2024-09-12T17:30:36.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.311+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~HBI01X18Q2H3.0 size=1048576 2024-09-12T17:30:36.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.312+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~HBI01X18Q2H3.1 size=575272 2024-09-12T17:30:36.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.312+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=HBI01X18Q2H3 tag=RJQI4SGMX1UX type=write size=2672424 2024-09-12T17:30:36.314 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.313+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~K6LBLO5IB7K7.0 size=1048576 2024-09-12T17:30:36.315 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.314+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~K6LBLO5IB7K7.1 size=1048576 2024-09-12T17:30:36.318 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.316+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~K6LBLO5IB7K7.2 size=428077 2024-09-12T17:30:36.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.318+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=K6LBLO5IB7K7 tag=24J9HY2ZFJKZ type=write size=3573805 2024-09-12T17:30:36.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.320+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~8V2BOPWJU94X.0 size=1048576 2024-09-12T17:30:36.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.321+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~8V2BOPWJU94X.1 size=646700 2024-09-12T17:30:36.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.321+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=8V2BOPWJU94X tag=1XWL8LMVXCEG type=write size=2743852 2024-09-12T17:30:36.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.322+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~LFO5B4E01DH4.0 size=685137 2024-09-12T17:30:36.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.324+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=LFO5B4E01DH4 tag=G37QRNK94CO2 type=write size=1733713 2024-09-12T17:30:36.328 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.326+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~Y6WNWUXR1UA9.0 size=969957 2024-09-12T17:30:36.328 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.326+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=Y6WNWUXR1UA9 tag=6G6FQ6UWJV88 type=write size=2018533 2024-09-12T17:30:36.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.327+0000 7fece65ff780 1 < completed delete operation key=OIHDAJMPUK4I tag=DVNDSREJZASB type=del 2024-09-12T17:30:36.330 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.328+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=6O85F6SVRFPS type=del size=4188433 2024-09-12T17:30:36.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.330+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=VMS6Y0HNAI5S type=del 2024-09-12T17:30:36.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.332+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~T32FZLP8QZMB.0 size=217550 2024-09-12T17:30:36.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.332+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=T32FZLP8QZMB tag=E8X24ZML6HN9 type=write size=1266126 2024-09-12T17:30:36.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.333+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~ZS4V9JCMJ80A.0 size=1048576 2024-09-12T17:30:36.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.334+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~ZS4V9JCMJ80A.1 size=1048576 2024-09-12T17:30:36.337 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.335+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~ZS4V9JCMJ80A.2 size=158884 2024-09-12T17:30:36.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.337+0000 7fece65ff780 1 < completed multipart upload key=I31CKY20NO9S upload=ZS4V9JCMJ80A tag=CBKEN2QCENJ4 type=write size=3304612 2024-09-12T17:30:36.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.340+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=5TBILCSYH7EY type=del size=3899347 2024-09-12T17:30:36.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.341+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=R5FQ4X7GSHWU type=del 2024-09-12T17:30:36.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.342+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=W8BB6HKBYDLX type=del size=1104612 2024-09-12T17:30:36.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.343+0000 7fece65ff780 1 < completed delete operation key=IMCE9Z7P4S6R tag=SB0XIJQ11GY8 type=del 2024-09-12T17:30:36.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.346+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~KJ4M1BJJUB6J.0 size=1048576 2024-09-12T17:30:36.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.347+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~KJ4M1BJJUB6J.1 size=315383 2024-09-12T17:30:36.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.347+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=KJ4M1BJJUB6J tag=U98R63EY24LH type=write size=2412535 2024-09-12T17:30:36.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.348+0000 7fece65ff780 1 < completed write operation key=6CCPZ4TVIU5N tag=80XVRITNJITC type=write size=453669 2024-09-12T17:30:36.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.349+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=0O1J6UY50YKQ type=del size=2838112 2024-09-12T17:30:36.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.350+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=GNAYH9DA72N5 type=del 2024-09-12T17:30:36.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.352+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=ODZKU3NEPBR0 type=del size=2213863 2024-09-12T17:30:36.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.353+0000 7fece65ff780 1 < completed write operation key=CEERZVBJQHP0 tag=66E4ANCJ4HB8 type=write size=370358 2024-09-12T17:30:36.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.354+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=BRIA9TSOYCLA type=del size=3913885 2024-09-12T17:30:36.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.355+0000 7fece65ff780 1 < completed write operation key=6GUDX5I1AKNH tag=JPI7B8N2QGZP type=write size=138210 2024-09-12T17:30:36.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.357+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=F0TSPW3ZN89G type=del size=574289 2024-09-12T17:30:36.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.358+0000 7fece65ff780 1 < completed write operation key=1G9VNO1V4IMW tag=A8BFSSZUESHM type=write size=355643 2024-09-12T17:30:36.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.359+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=2KT1G6HB024D type=del size=656324 2024-09-12T17:30:36.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.361+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=O7BII41QZH1C type=del 2024-09-12T17:30:36.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.363+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~OWGS0D8NF0GL.0 size=505839 2024-09-12T17:30:36.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.363+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=OWGS0D8NF0GL tag=XULYQMNMKICL type=write size=1554415 2024-09-12T17:30:36.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.364+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~S30NKVD600WP.0 size=1048576 2024-09-12T17:30:36.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.365+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~S30NKVD600WP.1 size=438260 2024-09-12T17:30:36.369 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.367+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=S30NKVD600WP tag=F5JXWJJC6Y57 type=write size=2535412 2024-09-12T17:30:36.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.369+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=SDCJ1RFYAGKU type=del size=885380 2024-09-12T17:30:36.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.370+0000 7fece65ff780 1 < completed write operation key=7AS5L998SDV7 tag=EO0876WZZ46J type=write size=1045279 2024-09-12T17:30:36.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.371+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=H9BMY4HJVLRQ type=del size=71386 2024-09-12T17:30:36.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.372+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~HBI01X18Q2H3.0 size=1048576 2024-09-12T17:30:36.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.373+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~HBI01X18Q2H3.1 size=575272 2024-09-12T17:30:36.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.375+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=HBI01X18Q2H3 tag=RJQI4SGMX1UX type=write size=2672424 2024-09-12T17:30:36.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.378+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~GNYL5K40VOI2.0 size=1048576 2024-09-12T17:30:36.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.379+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~GNYL5K40VOI2.1 size=1048576 2024-09-12T17:30:36.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.380+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~GNYL5K40VOI2.2 size=377945 2024-09-12T17:30:36.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.380+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=GNYL5K40VOI2 tag=3ZIBNS0NJXX5 type=write size=3523673 2024-09-12T17:30:36.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.381+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~8V2BOPWJU94X.0 size=1048576 2024-09-12T17:30:36.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.382+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~8V2BOPWJU94X.1 size=646700 2024-09-12T17:30:36.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.384+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=8V2BOPWJU94X tag=1XWL8LMVXCEG type=write size=2743852 2024-09-12T17:30:36.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.386+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=NU3YFGA65BED type=del size=1342712 2024-09-12T17:30:36.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.387+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~Y6WNWUXR1UA9.0 size=969957 2024-09-12T17:30:36.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.389+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=Y6WNWUXR1UA9 tag=6G6FQ6UWJV88 type=write size=2018533 2024-09-12T17:30:36.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.390+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=UZ0PC0BGI1L8 type=write size=955786 2024-09-12T17:30:36.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.392+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=6O85F6SVRFPS type=del 2024-09-12T17:30:36.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.393+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=NXJ5T33DYS7L type=del size=1152263 2024-09-12T17:30:36.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.394+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~T32FZLP8QZMB.0 size=217550 2024-09-12T17:30:36.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.396+0000 7fece65ff780 1 < completed multipart upload key=2HTNXL56URAK upload=T32FZLP8QZMB tag=E8X24ZML6HN9 type=write size=1266126 2024-09-12T17:30:36.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.398+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~0ELL04IRGMJ8.0 size=207163 2024-09-12T17:30:36.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.398+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=0ELL04IRGMJ8 tag=T93Z186FWCU3 type=write size=1255739 2024-09-12T17:30:36.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.400+0000 7fece65ff780 1 < canceled operation key=1G9VNO1V4IMW tag=5TBILCSYH7EY type=del size=3899347 2024-09-12T17:30:36.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.402+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~91C1QA5FLZOE.0 size=559066 2024-09-12T17:30:36.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.402+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=91C1QA5FLZOE tag=HPFXB8IX6RWV type=write size=1607642 2024-09-12T17:30:36.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.403+0000 7fece65ff780 1 < completed delete operation key=7AS5L998SDV7 tag=W8BB6HKBYDLX type=del 2024-09-12T17:30:36.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.405+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=2J7F80TLHB66 type=del size=2623925 2024-09-12T17:30:36.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.406+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~KJ4M1BJJUB6J.0 size=1048576 2024-09-12T17:30:36.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.407+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~KJ4M1BJJUB6J.1 size=315383 2024-09-12T17:30:36.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.410+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=KJ4M1BJJUB6J tag=U98R63EY24LH type=write size=2412535 2024-09-12T17:30:36.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.412+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~ZTZ5C4N6GN71.0 size=1048576 2024-09-12T17:30:36.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.414+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~ZTZ5C4N6GN71.1 size=1048576 2024-09-12T17:30:36.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.415+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~ZTZ5C4N6GN71.2 size=374045 2024-09-12T17:30:36.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.415+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=ZTZ5C4N6GN71 tag=CZKKJQBM5QBS type=write size=3519773 2024-09-12T17:30:36.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.416+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=0O1J6UY50YKQ type=del 2024-09-12T17:30:36.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.418+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=0782BLL4IQ5I type=write size=432295 2024-09-12T17:30:36.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.419+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=ODZKU3NEPBR0 type=del 2024-09-12T17:30:36.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.421+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=3NCZ6HY1LUCX type=del size=4109094 2024-09-12T17:30:36.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.422+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=BRIA9TSOYCLA type=del 2024-09-12T17:30:36.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.424+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=EF5H703P213O type=del size=3656425 2024-09-12T17:30:36.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.426+0000 7fece65ff780 1 < canceled operation key=CEERZVBJQHP0 tag=F0TSPW3ZN89G type=del size=574289 2024-09-12T17:30:36.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.428+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~KXIQ5E1RPC5N.0 size=1048576 2024-09-12T17:30:36.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.429+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~KXIQ5E1RPC5N.1 size=1048576 2024-09-12T17:30:36.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.431+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~KXIQ5E1RPC5N.2 size=76153 2024-09-12T17:30:36.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.431+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=KXIQ5E1RPC5N tag=X6RVSY542R65 type=write size=3221881 2024-09-12T17:30:36.435 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.433+0000 7fece65ff780 1 < suggested update operation key=UCBB99EG8XK2 tag=2KT1G6HB024D type=del size=656324 2024-09-12T17:30:36.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.436+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~57PP395G2SBF.0 size=1048576 2024-09-12T17:30:36.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.438+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~57PP395G2SBF.1 size=702235 2024-09-12T17:30:36.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.438+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=57PP395G2SBF tag=GUSQGVKYWRB7 type=write size=2799387 2024-09-12T17:30:36.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.439+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~OWGS0D8NF0GL.0 size=505839 2024-09-12T17:30:36.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.442+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=OWGS0D8NF0GL tag=XULYQMNMKICL type=write size=1554415 2024-09-12T17:30:36.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.444+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~YH0N3R4ICH82.0 size=1048576 2024-09-12T17:30:36.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.445+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~YH0N3R4ICH82.1 size=1048576 2024-09-12T17:30:36.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.446+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~YH0N3R4ICH82.2 size=390012 2024-09-12T17:30:36.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.446+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=YH0N3R4ICH82 tag=49E4M3CYR2OY type=write size=3535740 2024-09-12T17:30:36.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.447+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=SDCJ1RFYAGKU type=del 2024-09-12T17:30:36.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.448+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=7E44EROAY2KB type=del size=1217335 2024-09-12T17:30:36.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.450+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=H9BMY4HJVLRQ type=del 2024-09-12T17:30:36.452 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.451+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=HQOIX21V58FY type=del size=616322 2024-09-12T17:30:36.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.452+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~GNYL5K40VOI2.0 size=1048576 2024-09-12T17:30:36.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.453+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~GNYL5K40VOI2.1 size=1048576 2024-09-12T17:30:36.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.454+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~GNYL5K40VOI2.2 size=377945 2024-09-12T17:30:36.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.457+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=GNYL5K40VOI2 tag=3ZIBNS0NJXX5 type=write size=3523673 2024-09-12T17:30:36.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.458+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=1IF0F00WD9IE type=write size=300721 2024-09-12T17:30:36.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.460+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=NU3YFGA65BED type=del 2024-09-12T17:30:36.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.461+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=IV21XB3TNPP0 type=del size=2806258 2024-09-12T17:30:36.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.462+0000 7fece65ff780 1 < completed write operation key=6GUDX5I1AKNH tag=UZ0PC0BGI1L8 type=write size=955786 2024-09-12T17:30:36.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.465+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~HU9VCCF5EIG1.0 size=961349 2024-09-12T17:30:36.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.465+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=HU9VCCF5EIG1 tag=XNH63GCCXDSB type=write size=2009925 2024-09-12T17:30:36.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.468+0000 7fece65ff780 1 < suggested remove operation key=6CCPZ4TVIU5N tag=NXJ5T33DYS7L type=del 2024-09-12T17:30:36.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.469+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=18WLYWV24VCS type=del size=3222769 2024-09-12T17:30:36.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.470+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~0ELL04IRGMJ8.0 size=207163 2024-09-12T17:30:36.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.473+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=0ELL04IRGMJ8 tag=T93Z186FWCU3 type=write size=1255739 2024-09-12T17:30:36.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.475+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~OAY43K03I2K6.0 size=1048576 2024-09-12T17:30:36.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.476+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~OAY43K03I2K6.1 size=389558 2024-09-12T17:30:36.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.476+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=OAY43K03I2K6 tag=UY0OHVWXB73D type=write size=2486710 2024-09-12T17:30:36.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.477+0000 7fece65ff780 1 < canceled part key=_multipart_OPMR1WMB14CA.2~91C1QA5FLZOE.0 size=559066 2024-09-12T17:30:36.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.479+0000 7fece65ff780 1 < canceled multipart upload key=OPMR1WMB14CA upload=91C1QA5FLZOE tag=HPFXB8IX6RWV type=write size=1607642 2024-09-12T17:30:36.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.480+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=D7VN2QEFSTO0 type=del size=901315 2024-09-12T17:30:36.483 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.481+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=2J7F80TLHB66 type=del 2024-09-12T17:30:36.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.483+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=UWANCVC6YJD8 type=del size=520854 2024-09-12T17:30:36.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.483+0000 7fece65ff780 1 < canceled part key=_multipart_6CCPZ4TVIU5N.2~ZTZ5C4N6GN71.0 size=1048576 2024-09-12T17:30:36.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.484+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~ZTZ5C4N6GN71.1 size=1048576 2024-09-12T17:30:36.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.484+0000 7fece65ff780 1 < canceled part key=_multipart_6CCPZ4TVIU5N.2~ZTZ5C4N6GN71.2 size=374045 2024-09-12T17:30:36.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.487+0000 7fece65ff780 1 < canceled multipart upload key=6CCPZ4TVIU5N upload=ZTZ5C4N6GN71 tag=CZKKJQBM5QBS type=write size=3519773 2024-09-12T17:30:36.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.489+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~I62WPITWTWA9.0 size=1048576 2024-09-12T17:30:36.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.490+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~I62WPITWTWA9.1 size=81008 2024-09-12T17:30:36.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.490+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=I62WPITWTWA9 tag=87GL8T27TJF8 type=write size=2178160 2024-09-12T17:30:36.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.491+0000 7fece65ff780 1 < canceled operation key=Y30269Q7R340 tag=0782BLL4IQ5I type=write size=432295 2024-09-12T17:30:36.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.492+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=WH64602DXXY5 type=del size=3977187 2024-09-12T17:30:36.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.494+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=3NCZ6HY1LUCX type=del 2024-09-12T17:30:36.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.495+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=5YLBKUH6RL8O type=del size=2279246 2024-09-12T17:30:36.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.496+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=EF5H703P213O type=del 2024-09-12T17:30:36.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.497+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=GYA3CE26U811 type=write size=409284 2024-09-12T17:30:36.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.499+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~KXIQ5E1RPC5N.0 size=1048576 2024-09-12T17:30:36.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.500+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~KXIQ5E1RPC5N.1 size=1048576 2024-09-12T17:30:36.503 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.501+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~KXIQ5E1RPC5N.2 size=76153 2024-09-12T17:30:36.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.503+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=KXIQ5E1RPC5N tag=X6RVSY542R65 type=write size=3221881 2024-09-12T17:30:36.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.504+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=IAVD0ZPSRUOA type=del size=3197828 2024-09-12T17:30:36.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.505+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~57PP395G2SBF.0 size=1048576 2024-09-12T17:30:36.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.506+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~57PP395G2SBF.1 size=702235 2024-09-12T17:30:36.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.508+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=57PP395G2SBF tag=GUSQGVKYWRB7 type=write size=2799387 2024-09-12T17:30:36.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.511+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~3XONH8QA8HNX.0 size=1048576 2024-09-12T17:30:36.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.512+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~3XONH8QA8HNX.1 size=1048576 2024-09-12T17:30:36.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.513+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~3XONH8QA8HNX.2 size=744994 2024-09-12T17:30:36.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.513+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=3XONH8QA8HNX tag=P2Q5IH0OC8SJ type=write size=3890722 2024-09-12T17:30:36.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.513+0000 7fece65ff780 1 < canceled part key=_multipart_1G9VNO1V4IMW.2~YH0N3R4ICH82.0 size=1048576 2024-09-12T17:30:36.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.514+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~YH0N3R4ICH82.1 size=1048576 2024-09-12T17:30:36.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.515+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~YH0N3R4ICH82.2 size=390012 2024-09-12T17:30:36.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.517+0000 7fece65ff780 1 < canceled multipart upload key=1G9VNO1V4IMW upload=YH0N3R4ICH82 tag=49E4M3CYR2OY type=write size=3535740 2024-09-12T17:30:36.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.520+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~8XZ4JEOZK8O3.0 size=152793 2024-09-12T17:30:36.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.520+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=8XZ4JEOZK8O3 tag=IMH64E2AQI3T type=write size=1201369 2024-09-12T17:30:36.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.521+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=7E44EROAY2KB type=del 2024-09-12T17:30:36.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.522+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=5MC3R9FGW8QD type=del size=1265210 2024-09-12T17:30:36.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.523+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=HQOIX21V58FY type=del 2024-09-12T17:30:36.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.525+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=88R6KMP9530V type=del size=941364 2024-09-12T17:30:36.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.526+0000 7fece65ff780 1 < completed write operation key=9KYNMM6W7RRM tag=1IF0F00WD9IE type=write size=300721 2024-09-12T17:30:36.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.527+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=W0XGQV34TXYK type=del size=1316702 2024-09-12T17:30:36.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.528+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=IV21XB3TNPP0 type=del 2024-09-12T17:30:36.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.531+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~YQIV2V5WE2MG.0 size=1048576 2024-09-12T17:30:36.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.532+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~YQIV2V5WE2MG.1 size=1048576 2024-09-12T17:30:36.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.533+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~YQIV2V5WE2MG.2 size=109609 2024-09-12T17:30:36.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.533+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=YQIV2V5WE2MG tag=KP4D61ZRODEL type=write size=3255337 2024-09-12T17:30:36.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.534+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~HU9VCCF5EIG1.0 size=961349 2024-09-12T17:30:36.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.536+0000 7fece65ff780 1 < completed multipart upload key=4Z1N3433MC6A upload=HU9VCCF5EIG1 tag=XNH63GCCXDSB type=write size=2009925 2024-09-12T17:30:36.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.537+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=B2FH9GJ6ALP0 type=del size=1762498 2024-09-12T17:30:36.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.538+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=18WLYWV24VCS type=del 2024-09-12T17:30:36.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.541+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~O6GG5CJFPF5X.0 size=80628 2024-09-12T17:30:36.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.541+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=O6GG5CJFPF5X tag=5AWI6YN1ZYG0 type=write size=1129204 2024-09-12T17:30:36.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.542+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~OAY43K03I2K6.0 size=1048576 2024-09-12T17:30:36.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.543+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~OAY43K03I2K6.1 size=389558 2024-09-12T17:30:36.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.545+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=OAY43K03I2K6 tag=UY0OHVWXB73D type=write size=2486710 2024-09-12T17:30:36.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.546+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=J70V5XV3H2MJ type=write size=988773 2024-09-12T17:30:36.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.547+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=D7VN2QEFSTO0 type=del 2024-09-12T17:30:36.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.550+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~ULXRZBDZR04N.0 size=1048576 2024-09-12T17:30:36.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.550+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~ULXRZBDZR04N.1 size=347978 2024-09-12T17:30:36.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.551+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=ULXRZBDZR04N tag=4I06ZF68SA7O type=write size=2445130 2024-09-12T17:30:36.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.552+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=UWANCVC6YJD8 type=del 2024-09-12T17:30:36.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.553+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=J9L6K2XAB5NG type=del size=2915518 2024-09-12T17:30:36.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.554+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~I62WPITWTWA9.0 size=1048576 2024-09-12T17:30:36.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.555+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~I62WPITWTWA9.1 size=81008 2024-09-12T17:30:36.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.558+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=I62WPITWTWA9 tag=87GL8T27TJF8 type=write size=2178160 2024-09-12T17:30:36.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.559+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=1A1NLOGWXZD5 type=del size=1210720 2024-09-12T17:30:36.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.561+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=WH64602DXXY5 type=del 2024-09-12T17:30:36.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.562+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=6KA3PSFSMTBA type=write size=570112 2024-09-12T17:30:36.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.563+0000 7fece65ff780 1 < canceled operation key=W3MBKNIBLV7W tag=5YLBKUH6RL8O type=del size=2279246 2024-09-12T17:30:36.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.564+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=1LHWYJK82N9K type=del size=1162335 2024-09-12T17:30:36.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.565+0000 7fece65ff780 1 < completed write operation key=UN6FLMRMAPUS tag=GYA3CE26U811 type=write size=409284 2024-09-12T17:30:36.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.567+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=QO60MCYLG8XF type=write size=228733 2024-09-12T17:30:36.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.568+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=IAVD0ZPSRUOA type=del 2024-09-12T17:30:36.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.569+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=4SGNJZ7PCBLJ type=del size=440845 2024-09-12T17:30:36.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.569+0000 7fece65ff780 1 < canceled part key=_multipart_2HTNXL56URAK.2~3XONH8QA8HNX.0 size=1048576 2024-09-12T17:30:36.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.569+0000 7fece65ff780 1 < canceled part key=_multipart_2HTNXL56URAK.2~3XONH8QA8HNX.1 size=1048576 2024-09-12T17:30:36.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.570+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~3XONH8QA8HNX.2 size=744994 2024-09-12T17:30:36.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.572+0000 7fece65ff780 1 < canceled multipart upload key=2HTNXL56URAK upload=3XONH8QA8HNX tag=P2Q5IH0OC8SJ type=write size=3890722 2024-09-12T17:30:36.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.575+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~M3401DAG2SBT.0 size=1048576 2024-09-12T17:30:36.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.576+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~M3401DAG2SBT.1 size=242322 2024-09-12T17:30:36.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.576+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=M3401DAG2SBT tag=2FUTP339EZLA type=write size=2339474 2024-09-12T17:30:36.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.577+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~8XZ4JEOZK8O3.0 size=152793 2024-09-12T17:30:36.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.579+0000 7fece65ff780 1 < completed multipart upload key=4Z1N3433MC6A upload=8XZ4JEOZK8O3 tag=IMH64E2AQI3T type=write size=1201369 2024-09-12T17:30:36.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.581+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~VCM9EJFYH51F.0 size=1048576 2024-09-12T17:30:36.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.582+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~VCM9EJFYH51F.1 size=1048347 2024-09-12T17:30:36.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.582+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=VCM9EJFYH51F tag=1SGS1DL7201U type=write size=3145499 2024-09-12T17:30:36.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.583+0000 7fece65ff780 1 < completed delete operation key=7AS5L998SDV7 tag=5MC3R9FGW8QD type=del 2024-09-12T17:30:36.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.585+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~NI5EOZX3YGKY.0 size=1048576 2024-09-12T17:30:36.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.586+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~NI5EOZX3YGKY.1 size=861490 2024-09-12T17:30:36.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.586+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=NI5EOZX3YGKY tag=0M2325RSMKHE type=write size=2958642 2024-09-12T17:30:36.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.588+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=88R6KMP9530V type=del 2024-09-12T17:30:36.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.589+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=UURUD099ACW9 type=write size=302857 2024-09-12T17:30:36.593 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.592+0000 7fece65ff780 1 < suggested remove operation key=TLEZIJ4881G7 tag=W0XGQV34TXYK type=del 2024-09-12T17:30:36.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.593+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=BK0NZ09E1CF3 type=del size=3929405 2024-09-12T17:30:36.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.594+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~YQIV2V5WE2MG.0 size=1048576 2024-09-12T17:30:36.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.595+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~YQIV2V5WE2MG.1 size=1048576 2024-09-12T17:30:36.598 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.596+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~YQIV2V5WE2MG.2 size=109609 2024-09-12T17:30:36.600 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.598+0000 7fece65ff780 1 < completed multipart upload key=5A7WPGW5P91B upload=YQIV2V5WE2MG tag=KP4D61ZRODEL type=write size=3255337 2024-09-12T17:30:36.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.601+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~DA9QKFWB52PI.0 size=393815 2024-09-12T17:30:36.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.601+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=DA9QKFWB52PI tag=7H1PT81MXWD0 type=write size=1442391 2024-09-12T17:30:36.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.602+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=B2FH9GJ6ALP0 type=del 2024-09-12T17:30:36.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.604+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~DAPLQ6FI7MCQ.0 size=218338 2024-09-12T17:30:36.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.604+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=DAPLQ6FI7MCQ tag=I9ERED3EP01C type=write size=1266914 2024-09-12T17:30:36.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.605+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~O6GG5CJFPF5X.0 size=80628 2024-09-12T17:30:36.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.607+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=O6GG5CJFPF5X tag=5AWI6YN1ZYG0 type=write size=1129204 2024-09-12T17:30:36.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.608+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=CA3RRF1PQ44N type=del size=3093342 2024-09-12T17:30:36.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.611+0000 7fece65ff780 1 < suggested update operation key=Y30269Q7R340 tag=J70V5XV3H2MJ type=write size=988773 2024-09-12T17:30:36.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.612+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=WJU5B29C3DBN type=del size=3490197 2024-09-12T17:30:36.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.613+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~ULXRZBDZR04N.0 size=1048576 2024-09-12T17:30:36.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.613+0000 7fece65ff780 1 < canceled part key=_multipart_CEERZVBJQHP0.2~ULXRZBDZR04N.1 size=347978 2024-09-12T17:30:36.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.615+0000 7fece65ff780 1 < canceled multipart upload key=CEERZVBJQHP0 upload=ULXRZBDZR04N tag=4I06ZF68SA7O type=write size=2445130 2024-09-12T17:30:36.619 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.617+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~233Y63LB35VE.0 size=1048576 2024-09-12T17:30:36.620 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.618+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~233Y63LB35VE.1 size=1048576 2024-09-12T17:30:36.621 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.619+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~233Y63LB35VE.2 size=133084 2024-09-12T17:30:36.621 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.619+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=233Y63LB35VE tag=LANIDL9C3M2C type=write size=3278812 2024-09-12T17:30:36.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.620+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=J9L6K2XAB5NG type=del 2024-09-12T17:30:36.624 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.623+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~U92RJ43VF3CL.0 size=99378 2024-09-12T17:30:36.624 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.623+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=U92RJ43VF3CL tag=XJR3P71JO9S3 type=write size=1147954 2024-09-12T17:30:36.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.624+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=1A1NLOGWXZD5 type=del 2024-09-12T17:30:36.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.625+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=R7NAEE9U11Q5 type=del size=3044521 2024-09-12T17:30:36.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.626+0000 7fece65ff780 1 < completed write operation key=OIHDAJMPUK4I tag=6KA3PSFSMTBA type=write size=570112 2024-09-12T17:30:36.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.627+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=W8980JQVB5ZH type=del size=1847088 2024-09-12T17:30:36.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.629+0000 7fece65ff780 1 < canceled operation key=Q00ZFG0BBDG5 tag=1LHWYJK82N9K type=del size=1162335 2024-09-12T17:30:36.631 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.630+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=5GVZIMFEXTCZ type=del size=3655420 2024-09-12T17:30:36.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.631+0000 7fece65ff780 1 < canceled operation key=CBYI6C1ICE08 tag=QO60MCYLG8XF type=write size=228733 2024-09-12T17:30:36.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.632+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=E5FKDKDUZWFB type=del size=3631068 2024-09-12T17:30:36.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.634+0000 7fece65ff780 1 < completed delete operation key=7AS5L998SDV7 tag=4SGNJZ7PCBLJ type=del 2024-09-12T17:30:36.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.636+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~7E3AM6B9ZM3O.0 size=1048576 2024-09-12T17:30:36.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.637+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~7E3AM6B9ZM3O.1 size=1048576 2024-09-12T17:30:36.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.638+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~7E3AM6B9ZM3O.2 size=510455 2024-09-12T17:30:36.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.638+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=7E3AM6B9ZM3O tag=0BEYVUNQ29IA type=write size=3656183 2024-09-12T17:30:36.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.639+0000 7fece65ff780 1 < canceled part key=_multipart_Y1OT1OLGWB1Q.2~M3401DAG2SBT.0 size=1048576 2024-09-12T17:30:36.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.640+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~M3401DAG2SBT.1 size=242322 2024-09-12T17:30:36.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.642+0000 7fece65ff780 1 < canceled multipart upload key=Y1OT1OLGWB1Q upload=M3401DAG2SBT tag=2FUTP339EZLA type=write size=2339474 2024-09-12T17:30:36.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.643+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=LZ0HKB3981HU type=del size=761808 2024-09-12T17:30:36.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.644+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~VCM9EJFYH51F.0 size=1048576 2024-09-12T17:30:36.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.647+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~VCM9EJFYH51F.1 size=1048347 2024-09-12T17:30:36.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.649+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=VCM9EJFYH51F tag=1SGS1DL7201U type=write size=3145499 2024-09-12T17:30:36.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.650+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=FGENZ59N0WB6 type=del size=2228495 2024-09-12T17:30:36.653 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.651+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~NI5EOZX3YGKY.0 size=1048576 2024-09-12T17:30:36.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.652+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~NI5EOZX3YGKY.1 size=861490 2024-09-12T17:30:36.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.654+0000 7fece65ff780 1 < completed multipart upload key=2HTNXL56URAK upload=NI5EOZX3YGKY tag=0M2325RSMKHE type=write size=2958642 2024-09-12T17:30:36.658 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.657+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~2QPIKOPTDEBZ.0 size=1048576 2024-09-12T17:30:36.659 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.658+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~2QPIKOPTDEBZ.1 size=876765 2024-09-12T17:30:36.659 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.658+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=2QPIKOPTDEBZ tag=LW18VOS9474E type=write size=2973917 2024-09-12T17:30:36.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.659+0000 7fece65ff780 1 < completed write operation key=QQNW20B28RJC tag=UURUD099ACW9 type=write size=302857 2024-09-12T17:30:36.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.661+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~UBGGKUPVLTIA.0 size=1036662 2024-09-12T17:30:36.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.661+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=UBGGKUPVLTIA tag=LVP01ZYBK7IQ type=write size=2085238 2024-09-12T17:30:36.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.662+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=BK0NZ09E1CF3 type=del 2024-09-12T17:30:36.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.665+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~RWM9TQ30APY2.0 size=1048576 2024-09-12T17:30:36.668 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.666+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~RWM9TQ30APY2.1 size=476809 2024-09-12T17:30:36.668 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.666+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=RWM9TQ30APY2 tag=M92F22Z6GGAE type=write size=2573961 2024-09-12T17:30:36.669 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.667+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~DA9QKFWB52PI.0 size=393815 2024-09-12T17:30:36.671 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.669+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=DA9QKFWB52PI tag=7H1PT81MXWD0 type=write size=1442391 2024-09-12T17:30:36.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.670+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=029SJJ3CSHN5 type=del size=2787412 2024-09-12T17:30:36.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.672+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~DAPLQ6FI7MCQ.0 size=218338 2024-09-12T17:30:36.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.675+0000 7fece65ff780 1 < completed multipart upload key=IMCE9Z7P4S6R upload=DAPLQ6FI7MCQ tag=I9ERED3EP01C type=write size=1266914 2024-09-12T17:30:36.678 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.676+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=46YSP82RQSE1 type=del size=1580610 2024-09-12T17:30:36.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.679+0000 7fece65ff780 1 < suggested remove operation key=4Z1N3433MC6A tag=CA3RRF1PQ44N type=del 2024-09-12T17:30:36.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.680+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=A026FQ6UAXFA type=del size=1665575 2024-09-12T17:30:36.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.681+0000 7fece65ff780 1 < canceled operation key=9KYNMM6W7RRM tag=WJU5B29C3DBN type=del size=3490197 2024-09-12T17:30:36.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.684+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~XDD2E3U9KURW.0 size=1048576 2024-09-12T17:30:36.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.685+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~XDD2E3U9KURW.1 size=1048576 2024-09-12T17:30:36.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.686+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~XDD2E3U9KURW.2 size=717564 2024-09-12T17:30:36.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.686+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=XDD2E3U9KURW tag=6MP862O5IMTK type=write size=3863292 2024-09-12T17:30:36.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.687+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~233Y63LB35VE.0 size=1048576 2024-09-12T17:30:36.690 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.688+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~233Y63LB35VE.1 size=1048576 2024-09-12T17:30:36.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.689+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~233Y63LB35VE.2 size=133084 2024-09-12T17:30:36.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.691+0000 7fece65ff780 1 < completed multipart upload key=I31CKY20NO9S upload=233Y63LB35VE tag=LANIDL9C3M2C type=write size=3278812 2024-09-12T17:30:36.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.692+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=V6VWEJ2XS8RT type=del size=2042363 2024-09-12T17:30:36.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.694+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~U92RJ43VF3CL.0 size=99378 2024-09-12T17:30:36.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.696+0000 7fece65ff780 1 < completed multipart upload key=2HTNXL56URAK upload=U92RJ43VF3CL tag=XJR3P71JO9S3 type=write size=1147954 2024-09-12T17:30:36.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.700+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~88EOUS3IHPL5.0 size=559475 2024-09-12T17:30:36.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.700+0000 7fece65ff780 1 > prepared multipart upload key=Y30269Q7R340 upload=88EOUS3IHPL5 tag=2WOU2P5J222P type=write size=1608051 2024-09-12T17:30:36.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.701+0000 7fece65ff780 1 < canceled operation key=Y30269Q7R340 tag=R7NAEE9U11Q5 type=del size=3044521 2024-09-12T17:30:36.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.703+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=80A2HHRZYS18 type=del size=1859696 2024-09-12T17:30:36.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.704+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=W8980JQVB5ZH type=del 2024-09-12T17:30:36.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.706+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=M2K9L868GFD4 type=del size=2583319 2024-09-12T17:30:36.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.707+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=5GVZIMFEXTCZ type=del 2024-09-12T17:30:36.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.708+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=IQD9DKTGKXHY type=write size=123990 2024-09-12T17:30:36.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.709+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=E5FKDKDUZWFB type=del 2024-09-12T17:30:36.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.711+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=BFRLEPA1COZ1 type=del size=4050267 2024-09-12T17:30:36.713 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.712+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~7E3AM6B9ZM3O.0 size=1048576 2024-09-12T17:30:36.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.713+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~7E3AM6B9ZM3O.1 size=1048576 2024-09-12T17:30:36.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.715+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~7E3AM6B9ZM3O.2 size=510455 2024-09-12T17:30:36.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.717+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=7E3AM6B9ZM3O tag=0BEYVUNQ29IA type=write size=3656183 2024-09-12T17:30:36.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.718+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=N8MQN8PLA90I type=del size=2959543 2024-09-12T17:30:36.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.720+0000 7fece65ff780 1 < canceled operation key=KKU8T0CVS40V tag=LZ0HKB3981HU type=del size=761808 2024-09-12T17:30:36.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.721+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=ZAXPO592RQV4 type=del size=1576433 2024-09-12T17:30:36.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.722+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=FGENZ59N0WB6 type=del 2024-09-12T17:30:36.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.724+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=7YAE8O2B3Q6U type=del size=2079658 2024-09-12T17:30:36.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.725+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~2QPIKOPTDEBZ.0 size=1048576 2024-09-12T17:30:36.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.727+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~2QPIKOPTDEBZ.1 size=876765 2024-09-12T17:30:36.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.729+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=2QPIKOPTDEBZ tag=LW18VOS9474E type=write size=2973917 2024-09-12T17:30:36.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.731+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~9S2K8KAHOLH2.0 size=558683 2024-09-12T17:30:36.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.731+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=9S2K8KAHOLH2 tag=VW740C8L4D3C type=write size=1607259 2024-09-12T17:30:36.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.732+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~UBGGKUPVLTIA.0 size=1036662 2024-09-12T17:30:36.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.735+0000 7fece65ff780 1 < completed multipart upload key=I31CKY20NO9S upload=UBGGKUPVLTIA tag=LVP01ZYBK7IQ type=write size=2085238 2024-09-12T17:30:36.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.736+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=ADRNN3CGXMMR type=del size=3940048 2024-09-12T17:30:36.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.737+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~RWM9TQ30APY2.0 size=1048576 2024-09-12T17:30:36.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.738+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~RWM9TQ30APY2.1 size=476809 2024-09-12T17:30:36.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.741+0000 7fece65ff780 1 < completed multipart upload key=9KYNMM6W7RRM upload=RWM9TQ30APY2 tag=M92F22Z6GGAE type=write size=2573961 2024-09-12T17:30:36.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.742+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=K8KQVEVUDY1F type=del size=3965730 2024-09-12T17:30:36.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.743+0000 7fece65ff780 1 < canceled operation key=OPMR1WMB14CA tag=029SJJ3CSHN5 type=del size=2787412 2024-09-12T17:30:36.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.746+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~AVTKZKQC0855.0 size=1048576 2024-09-12T17:30:36.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.747+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~AVTKZKQC0855.1 size=367363 2024-09-12T17:30:36.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.747+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=AVTKZKQC0855 tag=GWH61D76WKZG type=write size=2464515 2024-09-12T17:30:36.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.749+0000 7fece65ff780 1 < suggested remove operation key=YCNQL8CUUGW7 tag=46YSP82RQSE1 type=del 2024-09-12T17:30:36.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.751+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=D7X423BEWKRY type=del size=3465215 2024-09-12T17:30:36.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.752+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=A026FQ6UAXFA type=del 2024-09-12T17:30:36.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.754+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~TC60QU8NRKEE.0 size=1048576 2024-09-12T17:30:36.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.755+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~TC60QU8NRKEE.1 size=898505 2024-09-12T17:30:36.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.755+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=TC60QU8NRKEE tag=VYAQNBTG65XY type=write size=2995657 2024-09-12T17:30:36.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.756+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~XDD2E3U9KURW.0 size=1048576 2024-09-12T17:30:36.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.757+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~XDD2E3U9KURW.1 size=1048576 2024-09-12T17:30:36.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.758+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~XDD2E3U9KURW.2 size=717564 2024-09-12T17:30:36.762 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.760+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=XDD2E3U9KURW tag=6MP862O5IMTK type=write size=3863292 2024-09-12T17:30:36.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.761+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=Q2GACG7R31W0 type=write size=266170 2024-09-12T17:30:36.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.763+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=V6VWEJ2XS8RT type=del 2024-09-12T17:30:36.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.764+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=IQGL3E4CHU6I type=del size=3700299 2024-09-12T17:30:36.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.765+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~88EOUS3IHPL5.0 size=559475 2024-09-12T17:30:36.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.767+0000 7fece65ff780 1 < completed multipart upload key=Y30269Q7R340 upload=88EOUS3IHPL5 tag=2WOU2P5J222P type=write size=1608051 2024-09-12T17:30:36.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.768+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=13FOVD9U5GJO type=del size=1803966 2024-09-12T17:30:36.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.770+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=80A2HHRZYS18 type=del 2024-09-12T17:30:36.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.771+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=68EOS3T4V0BV type=write size=285590 2024-09-12T17:30:36.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.774+0000 7fece65ff780 1 < suggested update operation key=9KYNMM6W7RRM tag=M2K9L868GFD4 type=del size=2583319 2024-09-12T17:30:36.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.776+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~JDR1CSOB4H00.0 size=1048576 2024-09-12T17:30:36.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.777+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~JDR1CSOB4H00.1 size=1048576 2024-09-12T17:30:36.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.778+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~JDR1CSOB4H00.2 size=958073 2024-09-12T17:30:36.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.778+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=JDR1CSOB4H00 tag=N9B5GU5HK133 type=write size=4103801 2024-09-12T17:30:36.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.780+0000 7fece65ff780 1 < suggested remove operation key=IMCE9Z7P4S6R tag=IQD9DKTGKXHY type=write 2024-09-12T17:30:36.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.782+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=MG5P4M98ZYQU type=write size=736443 2024-09-12T17:30:36.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.784+0000 7fece65ff780 1 < suggested remove operation key=5LAOX5H1AQWJ tag=BFRLEPA1COZ1 type=del 2024-09-12T17:30:36.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.785+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=ZFHU4HM5V0PX type=del size=914215 2024-09-12T17:30:36.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.788+0000 7fece65ff780 1 < suggested update operation key=I7TGK5A3JHH5 tag=N8MQN8PLA90I type=del size=2959543 2024-09-12T17:30:36.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.789+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=7O3TT2ZPVYIQ type=del size=1531419 2024-09-12T17:30:36.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.790+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=ZAXPO592RQV4 type=del 2024-09-12T17:30:36.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.793+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~X194SRZS0SZO.0 size=697956 2024-09-12T17:30:36.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.793+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=X194SRZS0SZO tag=512D73LW5TNR type=write size=1746532 2024-09-12T17:30:36.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.794+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=7YAE8O2B3Q6U type=del 2024-09-12T17:30:36.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.796+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=XEH2Q82Q4P28 type=write size=70347 2024-09-12T17:30:36.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.798+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~9S2K8KAHOLH2.0 size=558683 2024-09-12T17:30:36.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.800+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=9S2K8KAHOLH2 tag=VW740C8L4D3C type=write size=1607259 2024-09-12T17:30:36.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.801+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=EQJ7NSYMS6I0 type=del size=2937905 2024-09-12T17:30:36.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.804+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=ADRNN3CGXMMR type=del 2024-09-12T17:30:36.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.805+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=DA9Z2HOBCX8T type=del size=1991486 2024-09-12T17:30:36.809 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.808+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=K8KQVEVUDY1F type=del 2024-09-12T17:30:36.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.811+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~2JH711JZSQAQ.0 size=1048576 2024-09-12T17:30:36.814 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.812+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~2JH711JZSQAQ.1 size=1048576 2024-09-12T17:30:36.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.813+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~2JH711JZSQAQ.2 size=347926 2024-09-12T17:30:36.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.813+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=2JH711JZSQAQ tag=12TRMSM4O0WZ type=write size=3493654 2024-09-12T17:30:36.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.814+0000 7fece65ff780 1 < canceled part key=_multipart_6CCPZ4TVIU5N.2~AVTKZKQC0855.0 size=1048576 2024-09-12T17:30:36.816 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.814+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~AVTKZKQC0855.1 size=367363 2024-09-12T17:30:36.818 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.816+0000 7fece65ff780 1 < canceled multipart upload key=6CCPZ4TVIU5N upload=AVTKZKQC0855 tag=GWH61D76WKZG type=write size=2464515 2024-09-12T17:30:36.819 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.818+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=ZOHLB7A2XDRG type=del size=2589091 2024-09-12T17:30:36.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.819+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=D7X423BEWKRY type=del 2024-09-12T17:30:36.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.820+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=DATT1LOP00C6 type=write size=758894 2024-09-12T17:30:36.822 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.820+0000 7fece65ff780 1 < canceled part key=_multipart_5LAOX5H1AQWJ.2~TC60QU8NRKEE.0 size=1048576 2024-09-12T17:30:36.822 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.820+0000 7fece65ff780 1 < canceled part key=_multipart_5LAOX5H1AQWJ.2~TC60QU8NRKEE.1 size=898505 2024-09-12T17:30:36.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.822+0000 7fece65ff780 1 < canceled multipart upload key=5LAOX5H1AQWJ upload=TC60QU8NRKEE tag=VYAQNBTG65XY type=write size=2995657 2024-09-12T17:30:36.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.823+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=6MHPTVQDS3I9 type=del size=64578 2024-09-12T17:30:36.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.826+0000 7fece65ff780 1 < suggested remove operation key=I31CKY20NO9S tag=Q2GACG7R31W0 type=write 2024-09-12T17:30:36.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.828+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~AXBJRGMBPKVC.0 size=1048576 2024-09-12T17:30:36.831 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.829+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~AXBJRGMBPKVC.1 size=1048576 2024-09-12T17:30:36.831 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.830+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~AXBJRGMBPKVC.2 size=950537 2024-09-12T17:30:36.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.830+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=AXBJRGMBPKVC tag=9ZYB1Q1FDZPB type=write size=4096265 2024-09-12T17:30:36.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.831+0000 7fece65ff780 1 < canceled operation key=OPMR1WMB14CA tag=IQGL3E4CHU6I type=del size=3700299 2024-09-12T17:30:36.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.833+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=AVPZXJ0JY2AE type=del size=3723495 2024-09-12T17:30:36.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.833+0000 7fece65ff780 -1 < no bi entry to suggest for operation key=5LAOX5H1AQWJ tag=13FOVD9U5GJO type=del size=1803966: (2) No such file or directory 2024-09-12T17:30:36.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.834+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=MNTM6PZPD04Y type=write size=948627 2024-09-12T17:30:36.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.836+0000 7fece65ff780 1 < completed write operation key=4Z1N3433MC6A tag=68EOS3T4V0BV type=write size=285590 2024-09-12T17:30:36.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.837+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=J315UME1RG71 type=write size=379090 2024-09-12T17:30:36.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.837+0000 7fece65ff780 1 < canceled part key=_multipart_YCNQL8CUUGW7.2~JDR1CSOB4H00.0 size=1048576 2024-09-12T17:30:36.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.838+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~JDR1CSOB4H00.1 size=1048576 2024-09-12T17:30:36.841 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.839+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~JDR1CSOB4H00.2 size=958073 2024-09-12T17:30:36.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.841+0000 7fece65ff780 1 < canceled multipart upload key=YCNQL8CUUGW7 upload=JDR1CSOB4H00 tag=N9B5GU5HK133 type=write size=4103801 2024-09-12T17:30:36.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.843+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=APW2PDJMO8EF type=del size=1693419 2024-09-12T17:30:36.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.844+0000 7fece65ff780 1 < completed write operation key=9IGJG88NX1FS tag=MG5P4M98ZYQU type=write size=736443 2024-09-12T17:30:36.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.845+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=QCYCDX97ZMIN type=del size=2481133 2024-09-12T17:30:36.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.846+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=ZFHU4HM5V0PX type=del 2024-09-12T17:30:36.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.848+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=1OJW6YO5F73C type=del size=4047044 2024-09-12T17:30:36.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.851+0000 7fece65ff780 1 < suggested remove operation key=W3MBKNIBLV7W tag=7O3TT2ZPVYIQ type=del 2024-09-12T17:30:36.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.852+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=AW0MFP4X9VMY type=del size=3922109 2024-09-12T17:30:36.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.854+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~X194SRZS0SZO.0 size=697956 2024-09-12T17:30:36.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.856+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=X194SRZS0SZO tag=512D73LW5TNR type=write size=1746532 2024-09-12T17:30:36.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.857+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=GKE1WRPCP62K type=del size=637091 2024-09-12T17:30:36.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.859+0000 7fece65ff780 1 < completed write operation key=4Z1N3433MC6A tag=XEH2Q82Q4P28 type=write size=70347 2024-09-12T17:30:36.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.861+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~3FJOJVBKIHR6.0 size=726090 2024-09-12T17:30:36.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.861+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=3FJOJVBKIHR6 tag=KGUGZGJY4MVO type=write size=1774666 2024-09-12T17:30:36.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.863+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=EQJ7NSYMS6I0 type=del 2024-09-12T17:30:36.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.865+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~SNELL7GGU88R.0 size=1048576 2024-09-12T17:30:36.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.866+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~SNELL7GGU88R.1 size=1048576 2024-09-12T17:30:36.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.867+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~SNELL7GGU88R.2 size=703410 2024-09-12T17:30:36.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.867+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=SNELL7GGU88R tag=OUAKEAUINM6L type=write size=3849138 2024-09-12T17:30:36.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.869+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=DA9Z2HOBCX8T type=del 2024-09-12T17:30:36.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.871+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~DS94N9UPLVQA.0 size=1048576 2024-09-12T17:30:36.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.872+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~DS94N9UPLVQA.1 size=1048576 2024-09-12T17:30:36.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.873+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~DS94N9UPLVQA.2 size=304325 2024-09-12T17:30:36.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.873+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=DS94N9UPLVQA tag=52X8M4MQ1P93 type=write size=3450053 2024-09-12T17:30:36.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.875+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~2JH711JZSQAQ.0 size=1048576 2024-09-12T17:30:36.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.876+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~2JH711JZSQAQ.1 size=1048576 2024-09-12T17:30:36.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.877+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~2JH711JZSQAQ.2 size=347926 2024-09-12T17:30:36.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.879+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=2JH711JZSQAQ tag=12TRMSM4O0WZ type=write size=3493654 2024-09-12T17:30:36.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.881+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=EVHDED2SUEVH type=del size=1014669 2024-09-12T17:30:36.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.882+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=ZOHLB7A2XDRG type=del 2024-09-12T17:30:36.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.885+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~2WHC9I14XSCQ.0 size=199756 2024-09-12T17:30:36.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.885+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=2WHC9I14XSCQ tag=CEL9JU5Y2K1H type=write size=1248332 2024-09-12T17:30:36.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.886+0000 7fece65ff780 1 < completed write operation key=Q00ZFG0BBDG5 tag=DATT1LOP00C6 type=write size=758894 2024-09-12T17:30:36.890 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.889+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~XDGU391YL77S.0 size=1048576 2024-09-12T17:30:36.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.890+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~XDGU391YL77S.1 size=58588 2024-09-12T17:30:36.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.890+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=XDGU391YL77S tag=G5SXSHB5NSCJ type=write size=2155740 2024-09-12T17:30:36.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.891+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=6MHPTVQDS3I9 type=del 2024-09-12T17:30:36.894 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.893+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=AU4GBOQFW91N type=del size=3588924 2024-09-12T17:30:36.894 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.893+0000 7fece65ff780 1 < canceled part key=_multipart_1G9VNO1V4IMW.2~AXBJRGMBPKVC.0 size=1048576 2024-09-12T17:30:36.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.895+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~AXBJRGMBPKVC.1 size=1048576 2024-09-12T17:30:36.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.895+0000 7fece65ff780 1 < canceled part key=_multipart_1G9VNO1V4IMW.2~AXBJRGMBPKVC.2 size=950537 2024-09-12T17:30:36.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.897+0000 7fece65ff780 1 < canceled multipart upload key=1G9VNO1V4IMW upload=AXBJRGMBPKVC tag=9ZYB1Q1FDZPB type=write size=4096265 2024-09-12T17:30:36.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.900+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~TINN6IKONNR7.0 size=1048576 2024-09-12T17:30:36.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.901+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~TINN6IKONNR7.1 size=498485 2024-09-12T17:30:36.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.901+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=TINN6IKONNR7 tag=1A96W0IB0P5D type=write size=2595637 2024-09-12T17:30:36.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.902+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=AVPZXJ0JY2AE type=del 2024-09-12T17:30:36.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.904+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=TTTAC324EDSS type=del size=1450933 2024-09-12T17:30:36.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.905+0000 7fece65ff780 1 < completed write operation key=TLEZIJ4881G7 tag=MNTM6PZPD04Y type=write size=948627 2024-09-12T17:30:36.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.907+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=BFFO3RE3PA3E type=del size=4106353 2024-09-12T17:30:36.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.908+0000 7fece65ff780 1 < completed write operation key=OPMR1WMB14CA tag=J315UME1RG71 type=write size=379090 2024-09-12T17:30:36.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.909+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=MB0K3M5COY3C type=del size=2211216 2024-09-12T17:30:36.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.912+0000 7fece65ff780 1 < suggested remove operation key=7AS5L998SDV7 tag=APW2PDJMO8EF type=del 2024-09-12T17:30:36.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.914+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~FWT7LMGHS1IW.0 size=229956 2024-09-12T17:30:36.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.914+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=FWT7LMGHS1IW tag=AGKKQX0N3LC0 type=write size=1278532 2024-09-12T17:30:36.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.917+0000 7fece65ff780 1 < suggested update operation key=9IGJG88NX1FS tag=QCYCDX97ZMIN type=del size=2481133 2024-09-12T17:30:36.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.918+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=ANWFZARKP8SC type=write size=175468 2024-09-12T17:30:36.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.920+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=1OJW6YO5F73C type=del 2024-09-12T17:30:36.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.921+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=LHDL4EZ4I0DY type=write size=218105 2024-09-12T17:30:36.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.924+0000 7fece65ff780 1 < suggested remove operation key=9KYNMM6W7RRM tag=AW0MFP4X9VMY type=del 2024-09-12T17:30:36.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.925+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=7ROZH6NQUP0C type=del size=1507324 2024-09-12T17:30:36.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.929+0000 7fece65ff780 1 < suggested remove operation key=KKU8T0CVS40V tag=GKE1WRPCP62K type=del 2024-09-12T17:30:36.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.931+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~BIE7LYS1GJX4.0 size=1048576 2024-09-12T17:30:36.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.932+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~BIE7LYS1GJX4.1 size=1048576 2024-09-12T17:30:36.935 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.933+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~BIE7LYS1GJX4.2 size=477245 2024-09-12T17:30:36.935 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.933+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=BIE7LYS1GJX4 tag=78HJ0S5OG9M0 type=write size=3622973 2024-09-12T17:30:36.936 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.934+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~3FJOJVBKIHR6.0 size=726090 2024-09-12T17:30:36.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.936+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=3FJOJVBKIHR6 tag=KGUGZGJY4MVO type=write size=1774666 2024-09-12T17:30:36.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.937+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=EJURJK8U969I type=del size=2714201 2024-09-12T17:30:36.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.939+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~SNELL7GGU88R.0 size=1048576 2024-09-12T17:30:36.941 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.939+0000 7fece65ff780 1 < canceled part key=_multipart_2HTNXL56URAK.2~SNELL7GGU88R.1 size=1048576 2024-09-12T17:30:36.941 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.940+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~SNELL7GGU88R.2 size=703410 2024-09-12T17:30:36.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.942+0000 7fece65ff780 1 < canceled multipart upload key=2HTNXL56URAK upload=SNELL7GGU88R tag=OUAKEAUINM6L type=write size=3849138 2024-09-12T17:30:36.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.944+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~JC69P4T3QNQU.0 size=1048576 2024-09-12T17:30:36.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.945+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~JC69P4T3QNQU.1 size=1009479 2024-09-12T17:30:36.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.945+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=JC69P4T3QNQU tag=TWHVJ19C9B7N type=write size=3106631 2024-09-12T17:30:36.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.946+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~DS94N9UPLVQA.0 size=1048576 2024-09-12T17:30:36.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.947+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~DS94N9UPLVQA.1 size=1048576 2024-09-12T17:30:36.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.948+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~DS94N9UPLVQA.2 size=304325 2024-09-12T17:30:36.952 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.950+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=DS94N9UPLVQA tag=52X8M4MQ1P93 type=write size=3450053 2024-09-12T17:30:36.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.952+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~WHRMOMAOCXRO.0 size=1048576 2024-09-12T17:30:36.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.953+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~WHRMOMAOCXRO.1 size=1048576 2024-09-12T17:30:36.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.954+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~WHRMOMAOCXRO.2 size=768339 2024-09-12T17:30:36.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.954+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=WHRMOMAOCXRO tag=FDG6HTIR7TOB type=write size=3914067 2024-09-12T17:30:36.957 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.956+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=EVHDED2SUEVH type=del 2024-09-12T17:30:36.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.958+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~WQ0EY8W5THBM.0 size=1048576 2024-09-12T17:30:36.961 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.959+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~WQ0EY8W5THBM.1 size=525421 2024-09-12T17:30:36.961 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.959+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=WQ0EY8W5THBM tag=T3R00QOPLDV1 type=write size=2622573 2024-09-12T17:30:36.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.960+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~2WHC9I14XSCQ.0 size=199756 2024-09-12T17:30:36.964 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.963+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=2WHC9I14XSCQ tag=CEL9JU5Y2K1H type=write size=1248332 2024-09-12T17:30:36.966 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.965+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~N2LNYWRL04QO.0 size=511792 2024-09-12T17:30:36.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.965+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=N2LNYWRL04QO tag=J0326VIAGZOQ type=write size=1560368 2024-09-12T17:30:36.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.966+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~XDGU391YL77S.0 size=1048576 2024-09-12T17:30:36.968 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.967+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~XDGU391YL77S.1 size=58588 2024-09-12T17:30:36.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.969+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=XDGU391YL77S tag=G5SXSHB5NSCJ type=write size=2155740 2024-09-12T17:30:36.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.971+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~72CLTU1KB6Q6.0 size=1048576 2024-09-12T17:30:36.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.974+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~72CLTU1KB6Q6.1 size=243968 2024-09-12T17:30:36.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.974+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=72CLTU1KB6Q6 tag=71XXTTY7OYHI type=write size=2341120 2024-09-12T17:30:36.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.975+0000 7fece65ff780 1 < completed delete operation key=OIHDAJMPUK4I tag=AU4GBOQFW91N type=del 2024-09-12T17:30:36.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.978+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~8N6D2DP5CW7B.0 size=868636 2024-09-12T17:30:36.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.978+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=8N6D2DP5CW7B tag=NVTYM35VDY57 type=write size=1917212 2024-09-12T17:30:36.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.979+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~TINN6IKONNR7.0 size=1048576 2024-09-12T17:30:36.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.980+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~TINN6IKONNR7.1 size=498485 2024-09-12T17:30:36.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.982+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=TINN6IKONNR7 tag=1A96W0IB0P5D type=write size=2595637 2024-09-12T17:30:36.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.984+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=XPYDK2KQPQXT type=del size=2422307 2024-09-12T17:30:36.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.985+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=TTTAC324EDSS type=del 2024-09-12T17:30:36.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.986+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=TM90YR7XILYE type=del size=1942560 2024-09-12T17:30:36.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.987+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=BFFO3RE3PA3E type=del 2024-09-12T17:30:36.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.989+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=E8BLF4XLA3H6 type=del size=2726638 2024-09-12T17:30:36.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.990+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=MB0K3M5COY3C type=del 2024-09-12T17:30:36.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.993+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~8UT3ZX7IUZM0.0 size=1048576 2024-09-12T17:30:36.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.994+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~8UT3ZX7IUZM0.1 size=1035871 2024-09-12T17:30:36.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.994+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=8UT3ZX7IUZM0 tag=F0FBNJEJSAB1 type=write size=3133023 2024-09-12T17:30:36.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.995+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~FWT7LMGHS1IW.0 size=229956 2024-09-12T17:30:36.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.997+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=FWT7LMGHS1IW tag=AGKKQX0N3LC0 type=write size=1278532 2024-09-12T17:30:37.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:36.999+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=NOX1UIB1WPR8 type=del size=2112853 2024-09-12T17:30:37.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.000+0000 7fece65ff780 1 < completed write operation key=9IGJG88NX1FS tag=ANWFZARKP8SC type=write size=175468 2024-09-12T17:30:37.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.003+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~1AXRFTIL0TI8.0 size=31927 2024-09-12T17:30:37.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.003+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=1AXRFTIL0TI8 tag=U5JTN4SXKYJD type=write size=1080503 2024-09-12T17:30:37.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.005+0000 7fece65ff780 1 < suggested remove operation key=UN6FLMRMAPUS tag=LHDL4EZ4I0DY type=write 2024-09-12T17:30:37.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.008+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~ZVUJ78ZLXO0F.0 size=1048576 2024-09-12T17:30:37.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.009+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~ZVUJ78ZLXO0F.1 size=1048576 2024-09-12T17:30:37.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.010+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~ZVUJ78ZLXO0F.2 size=242265 2024-09-12T17:30:37.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.010+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=ZVUJ78ZLXO0F tag=82466MJSGQJA type=write size=3387993 2024-09-12T17:30:37.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.011+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=7ROZH6NQUP0C type=del 2024-09-12T17:30:37.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.013+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=JEDJYR071PM6 type=del size=4022804 2024-09-12T17:30:37.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.014+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~BIE7LYS1GJX4.0 size=1048576 2024-09-12T17:30:37.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.015+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~BIE7LYS1GJX4.1 size=1048576 2024-09-12T17:30:37.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.016+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~BIE7LYS1GJX4.2 size=477245 2024-09-12T17:30:37.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.018+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=BIE7LYS1GJX4 tag=78HJ0S5OG9M0 type=write size=3622973 2024-09-12T17:30:37.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.019+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=PZITGO5MQ521 type=del size=1106370 2024-09-12T17:30:37.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.020+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=EJURJK8U969I type=del 2024-09-12T17:30:37.024 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.022+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~286E6IGOKBEF.0 size=664970 2024-09-12T17:30:37.024 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.022+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=286E6IGOKBEF tag=BYRKQJSWSQGU type=write size=1713546 2024-09-12T17:30:37.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.024+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~JC69P4T3QNQU.0 size=1048576 2024-09-12T17:30:37.026 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.025+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~JC69P4T3QNQU.1 size=1009479 2024-09-12T17:30:37.028 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.027+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=JC69P4T3QNQU tag=TWHVJ19C9B7N type=write size=3106631 2024-09-12T17:30:37.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.028+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=R3YFH42C2U7V type=del size=702691 2024-09-12T17:30:37.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.029+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~WHRMOMAOCXRO.0 size=1048576 2024-09-12T17:30:37.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.029+0000 7fece65ff780 1 < canceled part key=_multipart_ZEFSNR1IIA10.2~WHRMOMAOCXRO.1 size=1048576 2024-09-12T17:30:37.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.030+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~WHRMOMAOCXRO.2 size=768339 2024-09-12T17:30:37.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.032+0000 7fece65ff780 1 < canceled multipart upload key=ZEFSNR1IIA10 upload=WHRMOMAOCXRO tag=FDG6HTIR7TOB type=write size=3914067 2024-09-12T17:30:37.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.033+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=Z35DMFP20XGO type=write size=293336 2024-09-12T17:30:37.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.034+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~WQ0EY8W5THBM.0 size=1048576 2024-09-12T17:30:37.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.034+0000 7fece65ff780 1 < canceled part key=_multipart_IMCE9Z7P4S6R.2~WQ0EY8W5THBM.1 size=525421 2024-09-12T17:30:37.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.037+0000 7fece65ff780 1 < canceled multipart upload key=IMCE9Z7P4S6R upload=WQ0EY8W5THBM tag=T3R00QOPLDV1 type=write size=2622573 2024-09-12T17:30:37.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.039+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~TC5XIEF7ML2W.0 size=1048576 2024-09-12T17:30:37.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.040+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~TC5XIEF7ML2W.1 size=736908 2024-09-12T17:30:37.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.040+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=TC5XIEF7ML2W tag=WC2M9OW4NDBB type=write size=2834060 2024-09-12T17:30:37.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.042+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~N2LNYWRL04QO.0 size=511792 2024-09-12T17:30:37.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.044+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=N2LNYWRL04QO tag=J0326VIAGZOQ type=write size=1560368 2024-09-12T17:30:37.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.047+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=DQI7BP6HIDGS type=del size=3317428 2024-09-12T17:30:37.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.048+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~72CLTU1KB6Q6.0 size=1048576 2024-09-12T17:30:37.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.049+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~72CLTU1KB6Q6.1 size=243968 2024-09-12T17:30:37.053 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.052+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=72CLTU1KB6Q6 tag=71XXTTY7OYHI type=write size=2341120 2024-09-12T17:30:37.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.053+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=KVT4DSV54NGB type=del size=3869146 2024-09-12T17:30:37.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.054+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~8N6D2DP5CW7B.0 size=868636 2024-09-12T17:30:37.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.056+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=8N6D2DP5CW7B tag=NVTYM35VDY57 type=write size=1917212 2024-09-12T17:30:37.060 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.059+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~3CQEMMUP7ULH.0 size=1048576 2024-09-12T17:30:37.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.060+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~3CQEMMUP7ULH.1 size=410625 2024-09-12T17:30:37.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.060+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=3CQEMMUP7ULH tag=W3F40COOHCZ8 type=write size=2507777 2024-09-12T17:30:37.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.063+0000 7fece65ff780 1 < suggested remove operation key=2HTNXL56URAK tag=XPYDK2KQPQXT type=del 2024-09-12T17:30:37.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.065+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~0MK069F4OC2P.0 size=1048576 2024-09-12T17:30:37.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.066+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~0MK069F4OC2P.1 size=1048576 2024-09-12T17:30:37.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.067+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~0MK069F4OC2P.2 size=290249 2024-09-12T17:30:37.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.067+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=0MK069F4OC2P tag=X8NUB0VP99T6 type=write size=3435977 2024-09-12T17:30:37.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.069+0000 7fece65ff780 -1 < failed to complete operation key=UN6FLMRMAPUS tag=TM90YR7XILYE type=del size=1942560: (22) Invalid argument 2024-09-12T17:30:37.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.070+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=765WGLG98PUZ type=del size=139815 2024-09-12T17:30:37.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.073+0000 7fece65ff780 1 < suggested update operation key=QQNW20B28RJC tag=E8BLF4XLA3H6 type=del size=2726638 2024-09-12T17:30:37.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.075+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~GDB0OUP5IR1J.0 size=1048576 2024-09-12T17:30:37.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.076+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~GDB0OUP5IR1J.1 size=367078 2024-09-12T17:30:37.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.076+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=GDB0OUP5IR1J tag=ZO74Q4CVXQ5C type=write size=2464230 2024-09-12T17:30:37.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.078+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~8UT3ZX7IUZM0.0 size=1048576 2024-09-12T17:30:37.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.079+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~8UT3ZX7IUZM0.1 size=1035871 2024-09-12T17:30:37.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.081+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=8UT3ZX7IUZM0 tag=F0FBNJEJSAB1 type=write size=3133023 2024-09-12T17:30:37.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.083+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=9EICMYT3Z92Z type=del size=3402950 2024-09-12T17:30:37.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.084+0000 7fece65ff780 1 < completed delete operation key=OIHDAJMPUK4I tag=NOX1UIB1WPR8 type=del 2024-09-12T17:30:37.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.085+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=XM41VGQBUYUJ type=del size=1794193 2024-09-12T17:30:37.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.086+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~1AXRFTIL0TI8.0 size=31927 2024-09-12T17:30:37.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.088+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=1AXRFTIL0TI8 tag=U5JTN4SXKYJD type=write size=1080503 2024-09-12T17:30:37.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.091+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~ZKCIT5D5MIJI.0 size=1048576 2024-09-12T17:30:37.093 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.092+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~ZKCIT5D5MIJI.1 size=1048576 2024-09-12T17:30:37.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.093+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~ZKCIT5D5MIJI.2 size=84812 2024-09-12T17:30:37.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.093+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=ZKCIT5D5MIJI tag=4LZN1QWHKZT1 type=write size=3230540 2024-09-12T17:30:37.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.094+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~ZVUJ78ZLXO0F.0 size=1048576 2024-09-12T17:30:37.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.095+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~ZVUJ78ZLXO0F.1 size=1048576 2024-09-12T17:30:37.098 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.096+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~ZVUJ78ZLXO0F.2 size=242265 2024-09-12T17:30:37.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.098+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=ZVUJ78ZLXO0F tag=82466MJSGQJA type=write size=3387993 2024-09-12T17:30:37.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.101+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~J3KUIWR3EOSR.0 size=183183 2024-09-12T17:30:37.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.101+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=J3KUIWR3EOSR tag=0C1F8XLJR2FP type=write size=1231759 2024-09-12T17:30:37.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.103+0000 7fece65ff780 1 < suggested update operation key=FX8VJO1YXJ4H tag=JEDJYR071PM6 type=del size=4022804 2024-09-12T17:30:37.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.105+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~T3QUUDTMHNN1.0 size=174093 2024-09-12T17:30:37.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.105+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=T3QUUDTMHNN1 tag=SEDN5J79Y2SU type=write size=1222669 2024-09-12T17:30:37.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.106+0000 7fece65ff780 1 < completed delete operation key=7AS5L998SDV7 tag=PZITGO5MQ521 type=del 2024-09-12T17:30:37.110 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.108+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~5GP6BFBX8A8Y.0 size=1048576 2024-09-12T17:30:37.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.109+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~5GP6BFBX8A8Y.1 size=1048576 2024-09-12T17:30:37.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.110+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~5GP6BFBX8A8Y.2 size=742801 2024-09-12T17:30:37.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.110+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=5GP6BFBX8A8Y tag=7PZ0IXHUHYFG type=write size=3888529 2024-09-12T17:30:37.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.111+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~286E6IGOKBEF.0 size=664970 2024-09-12T17:30:37.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.113+0000 7fece65ff780 1 < completed multipart upload key=9KYNMM6W7RRM upload=286E6IGOKBEF tag=BYRKQJSWSQGU type=write size=1713546 2024-09-12T17:30:37.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.116+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~GNYIOR644OB9.0 size=1048576 2024-09-12T17:30:37.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.117+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~GNYIOR644OB9.1 size=1042425 2024-09-12T17:30:37.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.117+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=GNYIOR644OB9 tag=X3C7IS1KVAGW type=write size=3139577 2024-09-12T17:30:37.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.118+0000 7fece65ff780 1 < canceled operation key=4Z1N3433MC6A tag=R3YFH42C2U7V type=del size=702691 2024-09-12T17:30:37.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.121+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~SFV7PHV7BPUH.0 size=1048576 2024-09-12T17:30:37.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.122+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~SFV7PHV7BPUH.1 size=552845 2024-09-12T17:30:37.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.122+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=SFV7PHV7BPUH tag=K4L00PH6133H type=write size=2649997 2024-09-12T17:30:37.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.123+0000 7fece65ff780 1 < canceled operation key=W3MBKNIBLV7W tag=Z35DMFP20XGO type=write size=293336 2024-09-12T17:30:37.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.124+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=V5P648FQTA1Q type=del size=3262754 2024-09-12T17:30:37.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.126+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~TC5XIEF7ML2W.0 size=1048576 2024-09-12T17:30:37.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.127+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~TC5XIEF7ML2W.1 size=736908 2024-09-12T17:30:37.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.129+0000 7fece65ff780 1 < completed multipart upload key=IMCE9Z7P4S6R upload=TC5XIEF7ML2W tag=WC2M9OW4NDBB type=write size=2834060 2024-09-12T17:30:37.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.130+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=UUQ27V1IIGTN type=del size=1410603 2024-09-12T17:30:37.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.131+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=DQI7BP6HIDGS type=del 2024-09-12T17:30:37.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.133+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=0D4NVLOB6NYR type=write size=233807 2024-09-12T17:30:37.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.134+0000 7fece65ff780 1 < canceled operation key=OPMR1WMB14CA tag=KVT4DSV54NGB type=del size=3869146 2024-09-12T17:30:37.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.135+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=OXA26W3TCWR2 type=del size=2970751 2024-09-12T17:30:37.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.136+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~3CQEMMUP7ULH.0 size=1048576 2024-09-12T17:30:37.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.137+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~3CQEMMUP7ULH.1 size=410625 2024-09-12T17:30:37.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.139+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=3CQEMMUP7ULH tag=W3F40COOHCZ8 type=write size=2507777 2024-09-12T17:30:37.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.140+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=88WPV4ZHWN3Y type=write size=992536 2024-09-12T17:30:37.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.142+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~0MK069F4OC2P.0 size=1048576 2024-09-12T17:30:37.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.143+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~0MK069F4OC2P.1 size=1048576 2024-09-12T17:30:37.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.144+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~0MK069F4OC2P.2 size=290249 2024-09-12T17:30:37.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.146+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=0MK069F4OC2P tag=X8NUB0VP99T6 type=write size=3435977 2024-09-12T17:30:37.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.148+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~R2CTALEG953M.0 size=1048576 2024-09-12T17:30:37.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.149+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~R2CTALEG953M.1 size=655568 2024-09-12T17:30:37.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.149+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=R2CTALEG953M tag=6IXR70CI8N0E type=write size=2752720 2024-09-12T17:30:37.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.150+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=765WGLG98PUZ type=del 2024-09-12T17:30:37.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.151+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=4CNX51KR6F0E type=write size=646765 2024-09-12T17:30:37.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.153+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~GDB0OUP5IR1J.0 size=1048576 2024-09-12T17:30:37.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.154+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~GDB0OUP5IR1J.1 size=367078 2024-09-12T17:30:37.157 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.156+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=GDB0OUP5IR1J tag=ZO74Q4CVXQ5C type=write size=2464230 2024-09-12T17:30:37.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.157+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=4LUE9HAD7LAP type=write size=250934 2024-09-12T17:30:37.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.158+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=9EICMYT3Z92Z type=del 2024-09-12T17:30:37.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.160+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=8S098N0QXLGC type=del size=882436 2024-09-12T17:30:37.164 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.162+0000 7fece65ff780 1 < suggested update operation key=I7TGK5A3JHH5 tag=XM41VGQBUYUJ type=del size=1794193 2024-09-12T17:30:37.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.165+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=TYM0DVNXCDTD type=del size=2274827 2024-09-12T17:30:37.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.166+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~ZKCIT5D5MIJI.0 size=1048576 2024-09-12T17:30:37.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.168+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~ZKCIT5D5MIJI.1 size=1048576 2024-09-12T17:30:37.171 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.169+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~ZKCIT5D5MIJI.2 size=84812 2024-09-12T17:30:37.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.172+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=ZKCIT5D5MIJI tag=4LZN1QWHKZT1 type=write size=3230540 2024-09-12T17:30:37.174 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.173+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=J7MQZZNWG7US type=del size=3346108 2024-09-12T17:30:37.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.173+0000 7fece65ff780 1 < canceled part key=_multipart_IMCE9Z7P4S6R.2~J3KUIWR3EOSR.0 size=183183 2024-09-12T17:30:37.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.175+0000 7fece65ff780 1 < canceled multipart upload key=IMCE9Z7P4S6R upload=J3KUIWR3EOSR tag=0C1F8XLJR2FP type=write size=1231759 2024-09-12T17:30:37.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.176+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=T04KDC7RODT2 type=del size=676061 2024-09-12T17:30:37.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.178+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~T3QUUDTMHNN1.0 size=174093 2024-09-12T17:30:37.181 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.180+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=T3QUUDTMHNN1 tag=SEDN5J79Y2SU type=write size=1222669 2024-09-12T17:30:37.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.182+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~3CAUXCOJRV7M.0 size=1048576 2024-09-12T17:30:37.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.183+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~3CAUXCOJRV7M.1 size=1048576 2024-09-12T17:30:37.186 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.184+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~3CAUXCOJRV7M.2 size=574209 2024-09-12T17:30:37.186 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.184+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=3CAUXCOJRV7M tag=V61TF7310L1S type=write size=3719937 2024-09-12T17:30:37.186 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.184+0000 7fece65ff780 1 < canceled part key=_multipart_TLEZIJ4881G7.2~5GP6BFBX8A8Y.0 size=1048576 2024-09-12T17:30:37.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.185+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~5GP6BFBX8A8Y.1 size=1048576 2024-09-12T17:30:37.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.185+0000 7fece65ff780 1 < canceled part key=_multipart_TLEZIJ4881G7.2~5GP6BFBX8A8Y.2 size=742801 2024-09-12T17:30:37.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.187+0000 7fece65ff780 1 < canceled multipart upload key=TLEZIJ4881G7 upload=5GP6BFBX8A8Y tag=7PZ0IXHUHYFG type=write size=3888529 2024-09-12T17:30:37.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.188+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=6A02825BCNL2 type=write size=155207 2024-09-12T17:30:37.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.190+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~GNYIOR644OB9.0 size=1048576 2024-09-12T17:30:37.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.191+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~GNYIOR644OB9.1 size=1042425 2024-09-12T17:30:37.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.193+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=GNYIOR644OB9 tag=X3C7IS1KVAGW type=write size=3139577 2024-09-12T17:30:37.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.194+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=EX02JJSJUVIL type=del size=1631304 2024-09-12T17:30:37.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.194+0000 7fece65ff780 1 < canceled part key=_multipart_6GUDX5I1AKNH.2~SFV7PHV7BPUH.0 size=1048576 2024-09-12T17:30:37.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.195+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~SFV7PHV7BPUH.1 size=552845 2024-09-12T17:30:37.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.197+0000 7fece65ff780 1 < canceled multipart upload key=6GUDX5I1AKNH upload=SFV7PHV7BPUH tag=K4L00PH6133H type=write size=2649997 2024-09-12T17:30:37.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.198+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=KYV5OHXAZKWR type=write size=689673 2024-09-12T17:30:37.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.201+0000 7fece65ff780 1 < suggested update operation key=Y1OT1OLGWB1Q tag=V5P648FQTA1Q type=del size=3262754 2024-09-12T17:30:37.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.202+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=ZXWOERKCOI7P type=del size=778664 2024-09-12T17:30:37.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.203+0000 7fece65ff780 1 < canceled operation key=7AS5L998SDV7 tag=UUQ27V1IIGTN type=del size=1410603 2024-09-12T17:30:37.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.204+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=LUNIVIYHMLZO type=del size=3098468 2024-09-12T17:30:37.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.205+0000 7fece65ff780 1 < completed write operation key=UCBB99EG8XK2 tag=0D4NVLOB6NYR type=write size=233807 2024-09-12T17:30:37.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.207+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=4E98OE9GVKSL type=del size=1741102 2024-09-12T17:30:37.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.209+0000 7fece65ff780 1 < suggested update operation key=UN6FLMRMAPUS tag=OXA26W3TCWR2 type=del size=2970751 2024-09-12T17:30:37.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.211+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~9AEWRSY13912.0 size=1048576 2024-09-12T17:30:37.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.212+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~9AEWRSY13912.1 size=1048576 2024-09-12T17:30:37.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.213+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~9AEWRSY13912.2 size=639272 2024-09-12T17:30:37.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.213+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=9AEWRSY13912 tag=GFV16JVC01WX type=write size=3785000 2024-09-12T17:30:37.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.215+0000 7fece65ff780 1 < suggested remove operation key=5LAOX5H1AQWJ tag=88WPV4ZHWN3Y type=write 2024-09-12T17:30:37.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.216+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=OAMCPMGGA6JM type=write size=461324 2024-09-12T17:30:37.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.218+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~R2CTALEG953M.0 size=1048576 2024-09-12T17:30:37.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.218+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~R2CTALEG953M.1 size=655568 2024-09-12T17:30:37.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.221+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=R2CTALEG953M tag=6IXR70CI8N0E type=write size=2752720 2024-09-12T17:30:37.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.223+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~7EY0EGOS6JPO.0 size=1048576 2024-09-12T17:30:37.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.224+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~7EY0EGOS6JPO.1 size=684546 2024-09-12T17:30:37.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.224+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=7EY0EGOS6JPO tag=YK0REUVYUU03 type=write size=2781698 2024-09-12T17:30:37.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.225+0000 7fece65ff780 1 < completed write operation key=Y30269Q7R340 tag=4CNX51KR6F0E type=write size=646765 2024-09-12T17:30:37.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.226+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=PIDJPN02TRSX type=del size=2268715 2024-09-12T17:30:37.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.229+0000 7fece65ff780 1 < suggested remove operation key=1G9VNO1V4IMW tag=4LUE9HAD7LAP type=write 2024-09-12T17:30:37.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.230+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=O8AOZ476B9B6 type=del size=155331 2024-09-12T17:30:37.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.232+0000 7fece65ff780 1 < suggested remove operation key=2HTNXL56URAK tag=8S098N0QXLGC type=del 2024-09-12T17:30:37.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.234+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=B3JU53O06YF9 type=write size=249712 2024-09-12T17:30:37.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.235+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=TYM0DVNXCDTD type=del 2024-09-12T17:30:37.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.237+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~E4FMIV0S3E8B.0 size=248189 2024-09-12T17:30:37.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.237+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=E4FMIV0S3E8B tag=CX6HBUA7RUG7 type=write size=1296765 2024-09-12T17:30:37.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.240+0000 7fece65ff780 1 < suggested update operation key=LSGN631FW1P8 tag=J7MQZZNWG7US type=del size=3346108 2024-09-12T17:30:37.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.242+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~WO9WGCY2NJVR.0 size=359917 2024-09-12T17:30:37.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.242+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=WO9WGCY2NJVR tag=PR4YH95KO1FO type=write size=1408493 2024-09-12T17:30:37.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.243+0000 7fece65ff780 -1 < failed to complete operation key=LSGN631FW1P8 tag=T04KDC7RODT2 type=del size=676061: (22) Invalid argument 2024-09-12T17:30:37.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.244+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=F44EU40N3G11 type=del size=2632675 2024-09-12T17:30:37.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.245+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~3CAUXCOJRV7M.0 size=1048576 2024-09-12T17:30:37.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.246+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~3CAUXCOJRV7M.1 size=1048576 2024-09-12T17:30:37.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.246+0000 7fece65ff780 1 < canceled part key=_multipart_CEERZVBJQHP0.2~3CAUXCOJRV7M.2 size=574209 2024-09-12T17:30:37.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.248+0000 7fece65ff780 1 < canceled multipart upload key=CEERZVBJQHP0 upload=3CAUXCOJRV7M tag=V61TF7310L1S type=write size=3719937 2024-09-12T17:30:37.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.249+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=XM3U3UZVLRV8 type=write size=867036 2024-09-12T17:30:37.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.251+0000 7fece65ff780 1 < completed write operation key=9KYNMM6W7RRM tag=6A02825BCNL2 type=write size=155207 2024-09-12T17:30:37.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.252+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=3RJDGKSCF2LR type=del size=3114740 2024-09-12T17:30:37.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.253+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=EX02JJSJUVIL type=del 2024-09-12T17:30:37.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.254+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=HL2VZK83F3RQ type=del size=3119255 2024-09-12T17:30:37.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.255+0000 7fece65ff780 1 < completed write operation key=KKU8T0CVS40V tag=KYV5OHXAZKWR type=write size=689673 2024-09-12T17:30:37.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.256+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=5Z4ITNQFQSS0 type=del size=1216748 2024-09-12T17:30:37.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.257+0000 7fece65ff780 -1 < no bi entry to suggest for operation key=5LAOX5H1AQWJ tag=ZXWOERKCOI7P type=del size=778664: (2) No such file or directory 2024-09-12T17:30:37.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.258+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=4GJZ8DENYYQZ type=del size=330049 2024-09-12T17:30:37.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.259+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=LUNIVIYHMLZO type=del 2024-09-12T17:30:37.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.260+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=32IHKAHIDIFU type=del size=1542161 2024-09-12T17:30:37.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.262+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=4E98OE9GVKSL type=del 2024-09-12T17:30:37.265 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.264+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~JA83ISY481Z2.0 size=1048576 2024-09-12T17:30:37.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.265+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~JA83ISY481Z2.1 size=1048576 2024-09-12T17:30:37.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.266+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~JA83ISY481Z2.2 size=1011618 2024-09-12T17:30:37.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.266+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=JA83ISY481Z2 tag=TMLS92TKSJX2 type=write size=4157346 2024-09-12T17:30:37.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.267+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~9AEWRSY13912.0 size=1048576 2024-09-12T17:30:37.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.268+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~9AEWRSY13912.1 size=1048576 2024-09-12T17:30:37.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.269+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~9AEWRSY13912.2 size=639272 2024-09-12T17:30:37.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.271+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=9AEWRSY13912 tag=GFV16JVC01WX type=write size=3785000 2024-09-12T17:30:37.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.272+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=WNR4TDQ96HEO type=del size=1591968 2024-09-12T17:30:37.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.273+0000 7fece65ff780 -1 < failed to complete operation key=1G9VNO1V4IMW tag=OAMCPMGGA6JM type=write size=461324: (22) Invalid argument 2024-09-12T17:30:37.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.274+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=IIYTHKQ0I202 type=del size=1622429 2024-09-12T17:30:37.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.276+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~7EY0EGOS6JPO.0 size=1048576 2024-09-12T17:30:37.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.276+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~7EY0EGOS6JPO.1 size=684546 2024-09-12T17:30:37.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.279+0000 7fece65ff780 1 < completed multipart upload key=FX8VJO1YXJ4H upload=7EY0EGOS6JPO tag=YK0REUVYUU03 type=write size=2781698 2024-09-12T17:30:37.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.280+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=R91I2KI7IO4P type=del size=2793503 2024-09-12T17:30:37.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.282+0000 7fece65ff780 -1 < failed to complete operation key=2HTNXL56URAK tag=PIDJPN02TRSX type=del size=2268715: (22) Invalid argument 2024-09-12T17:30:37.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.283+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=YL3R21VQYD66 type=del size=1079174 2024-09-12T17:30:37.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.284+0000 7fece65ff780 1 < completed delete operation key=Q00ZFG0BBDG5 tag=O8AOZ476B9B6 type=del 2024-09-12T17:30:37.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.286+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~HEJ96MRRZAAZ.0 size=649891 2024-09-12T17:30:37.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.286+0000 7fece65ff780 1 > prepared multipart upload key=Y30269Q7R340 upload=HEJ96MRRZAAZ tag=F9KL4CULPCJF type=write size=1698467 2024-09-12T17:30:37.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.287+0000 7fece65ff780 1 < completed write operation key=ZEFSNR1IIA10 tag=B3JU53O06YF9 type=write size=249712 2024-09-12T17:30:37.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.288+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=97XI5BOR0NJ0 type=del size=4157306 2024-09-12T17:30:37.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.290+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~E4FMIV0S3E8B.0 size=248189 2024-09-12T17:30:37.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.292+0000 7fece65ff780 1 < completed multipart upload key=FX8VJO1YXJ4H upload=E4FMIV0S3E8B tag=CX6HBUA7RUG7 type=write size=1296765 2024-09-12T17:30:37.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.294+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~4ZO252B20FB0.0 size=1048576 2024-09-12T17:30:37.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.295+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~4ZO252B20FB0.1 size=1048576 2024-09-12T17:30:37.298 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.296+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~4ZO252B20FB0.2 size=340319 2024-09-12T17:30:37.298 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.296+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=4ZO252B20FB0 tag=4HIKTY5V10V6 type=write size=3486047 2024-09-12T17:30:37.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.297+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~WO9WGCY2NJVR.0 size=359917 2024-09-12T17:30:37.301 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.299+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=WO9WGCY2NJVR tag=PR4YH95KO1FO type=write size=1408493 2024-09-12T17:30:37.302 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.301+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=JLXXNZ0SMV26 type=del size=2056157 2024-09-12T17:30:37.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.303+0000 7fece65ff780 1 < suggested update operation key=UN6FLMRMAPUS tag=F44EU40N3G11 type=del size=2632675 2024-09-12T17:30:37.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.304+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=LN2FT2J0C0RZ type=del size=429543 2024-09-12T17:30:37.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.306+0000 7fece65ff780 1 < completed write operation key=FX8VJO1YXJ4H tag=XM3U3UZVLRV8 type=write size=867036 2024-09-12T17:30:37.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.308+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~XXEV3EX0JFJX.0 size=1048576 2024-09-12T17:30:37.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.309+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~XXEV3EX0JFJX.1 size=1048576 2024-09-12T17:30:37.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.310+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~XXEV3EX0JFJX.2 size=126795 2024-09-12T17:30:37.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.310+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=XXEV3EX0JFJX tag=ZJPT5M9WF6K0 type=write size=3272523 2024-09-12T17:30:37.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.312+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=3RJDGKSCF2LR type=del 2024-09-12T17:30:37.315 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.314+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~UPAU5ZGGHLGO.0 size=1048576 2024-09-12T17:30:37.316 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.315+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~UPAU5ZGGHLGO.1 size=1048576 2024-09-12T17:30:37.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.316+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~UPAU5ZGGHLGO.2 size=955291 2024-09-12T17:30:37.318 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.316+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=UPAU5ZGGHLGO tag=BWPKX989PIDR type=write size=4101019 2024-09-12T17:30:37.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.317+0000 7fece65ff780 1 < canceled operation key=I31CKY20NO9S tag=HL2VZK83F3RQ type=del size=3119255 2024-09-12T17:30:37.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.320+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~BH8OZPSV4KY0.0 size=800580 2024-09-12T17:30:37.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.320+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=BH8OZPSV4KY0 tag=9OYITI6IV1LL type=write size=1849156 2024-09-12T17:30:37.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.322+0000 7fece65ff780 1 < suggested remove operation key=UCBB99EG8XK2 tag=5Z4ITNQFQSS0 type=del 2024-09-12T17:30:37.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.325+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~0CLTRE2OSPF6.0 size=1048576 2024-09-12T17:30:37.328 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.326+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~0CLTRE2OSPF6.1 size=1048576 2024-09-12T17:30:37.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.327+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~0CLTRE2OSPF6.2 size=856531 2024-09-12T17:30:37.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.327+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=0CLTRE2OSPF6 tag=5GDJVTPYU0S0 type=write size=4002259 2024-09-12T17:30:37.332 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.330+0000 7fece65ff780 1 < suggested update operation key=6GUDX5I1AKNH tag=4GJZ8DENYYQZ type=del size=330049 2024-09-12T17:30:37.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.333+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~IAKUATN4ZU9J.0 size=977878 2024-09-12T17:30:37.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.333+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=IAKUATN4ZU9J tag=ULQL9LW75NWP type=write size=2026454 2024-09-12T17:30:37.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.334+0000 7fece65ff780 1 < completed delete operation key=OIHDAJMPUK4I tag=32IHKAHIDIFU type=del 2024-09-12T17:30:37.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.336+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~JDGTTZAINTZT.0 size=502137 2024-09-12T17:30:37.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.336+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=JDGTTZAINTZT tag=J2HUFV6ISI1E type=write size=1550713 2024-09-12T17:30:37.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.338+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~JA83ISY481Z2.0 size=1048576 2024-09-12T17:30:37.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.339+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~JA83ISY481Z2.1 size=1048576 2024-09-12T17:30:37.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.340+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~JA83ISY481Z2.2 size=1011618 2024-09-12T17:30:37.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.343+0000 7fece65ff780 1 < completed multipart upload key=5A7WPGW5P91B upload=JA83ISY481Z2 tag=TMLS92TKSJX2 type=write size=4157346 2024-09-12T17:30:37.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.344+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=9X8OQLQGDM9U type=write size=216765 2024-09-12T17:30:37.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.346+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=WNR4TDQ96HEO type=del 2024-09-12T17:30:37.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.347+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=F4H50KMH3HS6 type=del size=802006 2024-09-12T17:30:37.350 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.349+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=IIYTHKQ0I202 type=del 2024-09-12T17:30:37.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.351+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~UUD2QSAWFRBS.0 size=1048576 2024-09-12T17:30:37.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.352+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~UUD2QSAWFRBS.1 size=1048576 2024-09-12T17:30:37.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.353+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~UUD2QSAWFRBS.2 size=297513 2024-09-12T17:30:37.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.353+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=UUD2QSAWFRBS tag=C1EY6KF185TH type=write size=3443241 2024-09-12T17:30:37.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.355+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=R91I2KI7IO4P type=del 2024-09-12T17:30:37.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.358+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~OIZB653L1PIT.0 size=1048576 2024-09-12T17:30:37.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.359+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~OIZB653L1PIT.1 size=999828 2024-09-12T17:30:37.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.359+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=OIZB653L1PIT tag=2UUK2OFDRNCU type=write size=3096980 2024-09-12T17:30:37.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.360+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=YL3R21VQYD66 type=del 2024-09-12T17:30:37.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.362+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=9S1DEUI8ZN4A type=del size=3848434 2024-09-12T17:30:37.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.363+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~HEJ96MRRZAAZ.0 size=649891 2024-09-12T17:30:37.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.365+0000 7fece65ff780 1 < completed multipart upload key=Y30269Q7R340 upload=HEJ96MRRZAAZ tag=F9KL4CULPCJF type=write size=1698467 2024-09-12T17:30:37.368 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.367+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=Z0J6JF74KNID type=write size=378165 2024-09-12T17:30:37.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.368+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=97XI5BOR0NJ0 type=del 2024-09-12T17:30:37.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.370+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=69Q3EYHDQ87T type=del size=3333228 2024-09-12T17:30:37.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.371+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~4ZO252B20FB0.0 size=1048576 2024-09-12T17:30:37.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.371+0000 7fece65ff780 1 < canceled part key=_multipart_2HTNXL56URAK.2~4ZO252B20FB0.1 size=1048576 2024-09-12T17:30:37.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.372+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~4ZO252B20FB0.2 size=340319 2024-09-12T17:30:37.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.374+0000 7fece65ff780 1 < canceled multipart upload key=2HTNXL56URAK upload=4ZO252B20FB0 tag=4HIKTY5V10V6 type=write size=3486047 2024-09-12T17:30:37.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.376+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~S2Z99L8GFT03.0 size=1048576 2024-09-12T17:30:37.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.377+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~S2Z99L8GFT03.1 size=413418 2024-09-12T17:30:37.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.377+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=S2Z99L8GFT03 tag=8NQ2TZCMQHC3 type=write size=2510570 2024-09-12T17:30:37.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.378+0000 7fece65ff780 1 < completed delete operation key=Q00ZFG0BBDG5 tag=JLXXNZ0SMV26 type=del 2024-09-12T17:30:37.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.380+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~GD0HQTBSN19N.0 size=1048576 2024-09-12T17:30:37.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.381+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~GD0HQTBSN19N.1 size=1048576 2024-09-12T17:30:37.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.382+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~GD0HQTBSN19N.2 size=142939 2024-09-12T17:30:37.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.382+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=GD0HQTBSN19N tag=QT3FRW6A72TY type=write size=3288667 2024-09-12T17:30:37.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.385+0000 7fece65ff780 1 < suggested remove operation key=RKFRKIENSBTO tag=LN2FT2J0C0RZ type=del 2024-09-12T17:30:37.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.387+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~KN584L6TZ0O9.0 size=1048576 2024-09-12T17:30:37.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.388+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~KN584L6TZ0O9.1 size=1048576 2024-09-12T17:30:37.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.389+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~KN584L6TZ0O9.2 size=635754 2024-09-12T17:30:37.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.389+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=KN584L6TZ0O9 tag=Q88249EKLSCA type=write size=3781482 2024-09-12T17:30:37.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.390+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~XXEV3EX0JFJX.0 size=1048576 2024-09-12T17:30:37.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.392+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~XXEV3EX0JFJX.1 size=1048576 2024-09-12T17:30:37.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.393+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~XXEV3EX0JFJX.2 size=126795 2024-09-12T17:30:37.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.395+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=XXEV3EX0JFJX tag=ZJPT5M9WF6K0 type=write size=3272523 2024-09-12T17:30:37.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.396+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=YTAOXDPSW6O2 type=write size=479901 2024-09-12T17:30:37.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.397+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~UPAU5ZGGHLGO.0 size=1048576 2024-09-12T17:30:37.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.398+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~UPAU5ZGGHLGO.1 size=1048576 2024-09-12T17:30:37.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.401+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~UPAU5ZGGHLGO.2 size=955291 2024-09-12T17:30:37.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.403+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=UPAU5ZGGHLGO tag=BWPKX989PIDR type=write size=4101019 2024-09-12T17:30:37.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.404+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=415JDBYYV5BF type=del size=3579131 2024-09-12T17:30:37.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.406+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~BH8OZPSV4KY0.0 size=800580 2024-09-12T17:30:37.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.408+0000 7fece65ff780 1 < completed multipart upload key=W3MBKNIBLV7W upload=BH8OZPSV4KY0 tag=9OYITI6IV1LL type=write size=1849156 2024-09-12T17:30:37.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.410+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~KZ7ZIRPUDUXK.0 size=1048576 2024-09-12T17:30:37.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.411+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~KZ7ZIRPUDUXK.1 size=247409 2024-09-12T17:30:37.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.411+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=KZ7ZIRPUDUXK tag=OZRFBTZVEH0Q type=write size=2344561 2024-09-12T17:30:37.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.412+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~0CLTRE2OSPF6.0 size=1048576 2024-09-12T17:30:37.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.413+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~0CLTRE2OSPF6.1 size=1048576 2024-09-12T17:30:37.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.414+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~0CLTRE2OSPF6.2 size=856531 2024-09-12T17:30:37.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.416+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=0CLTRE2OSPF6 tag=5GDJVTPYU0S0 type=write size=4002259 2024-09-12T17:30:37.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.419+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~ENYVIOI6G8ZF.0 size=667568 2024-09-12T17:30:37.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.419+0000 7fece65ff780 1 > prepared multipart upload key=Y30269Q7R340 upload=ENYVIOI6G8ZF tag=P26H4U9XBC2J type=write size=1716144 2024-09-12T17:30:37.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.420+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~IAKUATN4ZU9J.0 size=977878 2024-09-12T17:30:37.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.422+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=IAKUATN4ZU9J tag=ULQL9LW75NWP type=write size=2026454 2024-09-12T17:30:37.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.425+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~AP8JIEFI9MH7.0 size=60731 2024-09-12T17:30:37.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.425+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=AP8JIEFI9MH7 tag=P9ACZIC30ZU0 type=write size=1109307 2024-09-12T17:30:37.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.426+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~JDGTTZAINTZT.0 size=502137 2024-09-12T17:30:37.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.428+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=JDGTTZAINTZT tag=J2HUFV6ISI1E type=write size=1550713 2024-09-12T17:30:37.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.431+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~UA7XAJYZ5491.0 size=1048576 2024-09-12T17:30:37.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.432+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~UA7XAJYZ5491.1 size=1048576 2024-09-12T17:30:37.435 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.433+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~UA7XAJYZ5491.2 size=805338 2024-09-12T17:30:37.435 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.433+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=UA7XAJYZ5491 tag=GD85FGP6111Y type=write size=3951066 2024-09-12T17:30:37.436 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.435+0000 7fece65ff780 1 < completed write operation key=1G9VNO1V4IMW tag=9X8OQLQGDM9U type=write size=216765 2024-09-12T17:30:37.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.436+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=PWXADDYQHUPO type=del size=3080587 2024-09-12T17:30:37.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.439+0000 7fece65ff780 1 < suggested update operation key=Y1OT1OLGWB1Q tag=F4H50KMH3HS6 type=del size=802006 2024-09-12T17:30:37.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.441+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~6S2TJAG57UO2.0 size=727779 2024-09-12T17:30:37.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.441+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=6S2TJAG57UO2 tag=ELZZ29729Y4J type=write size=1776355 2024-09-12T17:30:37.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.442+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~UUD2QSAWFRBS.0 size=1048576 2024-09-12T17:30:37.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.443+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~UUD2QSAWFRBS.1 size=1048576 2024-09-12T17:30:37.446 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.444+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~UUD2QSAWFRBS.2 size=297513 2024-09-12T17:30:37.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.446+0000 7fece65ff780 1 < completed multipart upload key=W3MBKNIBLV7W upload=UUD2QSAWFRBS tag=C1EY6KF185TH type=write size=3443241 2024-09-12T17:30:37.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.448+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=XIOP5C3D40AN type=del size=950332 2024-09-12T17:30:37.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.449+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~OIZB653L1PIT.0 size=1048576 2024-09-12T17:30:37.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.450+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~OIZB653L1PIT.1 size=999828 2024-09-12T17:30:37.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.452+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=OIZB653L1PIT tag=2UUK2OFDRNCU type=write size=3096980 2024-09-12T17:30:37.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.453+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=LFBN9NPQIPR8 type=del size=3634178 2024-09-12T17:30:37.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.454+0000 7fece65ff780 1 < canceled operation key=7AS5L998SDV7 tag=9S1DEUI8ZN4A type=del size=3848434 2024-09-12T17:30:37.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.455+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=KBPHPPJNVMDH type=del size=1729556 2024-09-12T17:30:37.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.457+0000 7fece65ff780 1 < completed write operation key=W3MBKNIBLV7W tag=Z0J6JF74KNID type=write size=378165 2024-09-12T17:30:37.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.459+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~N28DRNOZPP1O.0 size=1048576 2024-09-12T17:30:37.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.460+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~N28DRNOZPP1O.1 size=1048576 2024-09-12T17:30:37.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.461+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~N28DRNOZPP1O.2 size=436198 2024-09-12T17:30:37.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.461+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=N28DRNOZPP1O tag=3Q1AUYE5VB1A type=write size=3581926 2024-09-12T17:30:37.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.463+0000 7fece65ff780 1 < suggested update operation key=4Z1N3433MC6A tag=69Q3EYHDQ87T type=del size=3333228 2024-09-12T17:30:37.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.465+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=3HGN3IW85A0X type=write size=223547 2024-09-12T17:30:37.467 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.465+0000 7fece65ff780 1 < canceled part key=_multipart_W3MBKNIBLV7W.2~S2Z99L8GFT03.0 size=1048576 2024-09-12T17:30:37.467 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.466+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~S2Z99L8GFT03.1 size=413418 2024-09-12T17:30:37.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.468+0000 7fece65ff780 1 < canceled multipart upload key=W3MBKNIBLV7W upload=S2Z99L8GFT03 tag=8NQ2TZCMQHC3 type=write size=2510570 2024-09-12T17:30:37.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.470+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~XDB2DJ2SHAIB.0 size=266472 2024-09-12T17:30:37.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.470+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=XDB2DJ2SHAIB tag=IRMTZ7U58H5D type=write size=1315048 2024-09-12T17:30:37.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.471+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~GD0HQTBSN19N.0 size=1048576 2024-09-12T17:30:37.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.473+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~GD0HQTBSN19N.1 size=1048576 2024-09-12T17:30:37.475 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.474+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~GD0HQTBSN19N.2 size=142939 2024-09-12T17:30:37.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.476+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=GD0HQTBSN19N tag=QT3FRW6A72TY type=write size=3288667 2024-09-12T17:30:37.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.478+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~X2AS4DBKAS96.0 size=1048576 2024-09-12T17:30:37.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.479+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~X2AS4DBKAS96.1 size=890315 2024-09-12T17:30:37.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.479+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=X2AS4DBKAS96 tag=03IN5VAIGYBX type=write size=2987467 2024-09-12T17:30:37.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.480+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~KN584L6TZ0O9.0 size=1048576 2024-09-12T17:30:37.483 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.481+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~KN584L6TZ0O9.1 size=1048576 2024-09-12T17:30:37.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.482+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~KN584L6TZ0O9.2 size=635754 2024-09-12T17:30:37.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.484+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=KN584L6TZ0O9 tag=Q88249EKLSCA type=write size=3781482 2024-09-12T17:30:37.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.486+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=0CHSWFHXKDUS type=del size=2684553 2024-09-12T17:30:37.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.488+0000 7fece65ff780 1 < suggested remove operation key=CEERZVBJQHP0 tag=YTAOXDPSW6O2 type=write 2024-09-12T17:30:37.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.490+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~0LZ30JDC98NR.0 size=224867 2024-09-12T17:30:37.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.490+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=0LZ30JDC98NR tag=3CTL8DBQ1FYV type=write size=1273443 2024-09-12T17:30:37.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.491+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=415JDBYYV5BF type=del 2024-09-12T17:30:37.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.493+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=SIAEJIBJ313R type=write size=685578 2024-09-12T17:30:37.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.494+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~KZ7ZIRPUDUXK.0 size=1048576 2024-09-12T17:30:37.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.495+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~KZ7ZIRPUDUXK.1 size=247409 2024-09-12T17:30:37.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.497+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=KZ7ZIRPUDUXK tag=OZRFBTZVEH0Q type=write size=2344561 2024-09-12T17:30:37.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.498+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=FRJ6T5QTOAN2 type=del size=850946 2024-09-12T17:30:37.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.500+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~ENYVIOI6G8ZF.0 size=667568 2024-09-12T17:30:37.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.502+0000 7fece65ff780 1 < completed multipart upload key=Y30269Q7R340 upload=ENYVIOI6G8ZF tag=P26H4U9XBC2J type=write size=1716144 2024-09-12T17:30:37.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.504+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=RR65PSLOED9E type=write size=12096 2024-09-12T17:30:37.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.506+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~AP8JIEFI9MH7.0 size=60731 2024-09-12T17:30:37.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.508+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=AP8JIEFI9MH7 tag=P9ACZIC30ZU0 type=write size=1109307 2024-09-12T17:30:37.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.509+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=K7ZX5HIQBECQ type=del size=2491260 2024-09-12T17:30:37.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.510+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~UA7XAJYZ5491.0 size=1048576 2024-09-12T17:30:37.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.511+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~UA7XAJYZ5491.1 size=1048576 2024-09-12T17:30:37.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.512+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~UA7XAJYZ5491.2 size=805338 2024-09-12T17:30:37.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.514+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=UA7XAJYZ5491 tag=GD85FGP6111Y type=write size=3951066 2024-09-12T17:30:37.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.515+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=W774N68MDP9A type=del size=3731374 2024-09-12T17:30:37.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.517+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=PWXADDYQHUPO type=del 2024-09-12T17:30:37.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.518+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=T00Z261TZBY8 type=del size=3900892 2024-09-12T17:30:37.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.521+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~6S2TJAG57UO2.0 size=727779 2024-09-12T17:30:37.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.523+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=6S2TJAG57UO2 tag=ELZZ29729Y4J type=write size=1776355 2024-09-12T17:30:37.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.525+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~WE0JW206Y6EW.0 size=1048576 2024-09-12T17:30:37.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.526+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~WE0JW206Y6EW.1 size=148654 2024-09-12T17:30:37.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.526+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=WE0JW206Y6EW tag=P1PH61FBFBCM type=write size=2245806 2024-09-12T17:30:37.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.527+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=XIOP5C3D40AN type=del 2024-09-12T17:30:37.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.530+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~T5NP3SHT1RDK.0 size=1048576 2024-09-12T17:30:37.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.531+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~T5NP3SHT1RDK.1 size=1048576 2024-09-12T17:30:37.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.532+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~T5NP3SHT1RDK.2 size=952915 2024-09-12T17:30:37.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.532+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=T5NP3SHT1RDK tag=RJTW1CI4CA7Z type=write size=4098643 2024-09-12T17:30:37.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.533+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=LFBN9NPQIPR8 type=del 2024-09-12T17:30:37.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.534+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=6RZOR1GZUX9D type=del size=1828479 2024-09-12T17:30:37.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.535+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=KBPHPPJNVMDH type=del 2024-09-12T17:30:37.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.536+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=47AA5K23K134 type=write size=490133 2024-09-12T17:30:37.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.538+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~N28DRNOZPP1O.0 size=1048576 2024-09-12T17:30:37.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.539+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~N28DRNOZPP1O.1 size=1048576 2024-09-12T17:30:37.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.540+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~N28DRNOZPP1O.2 size=436198 2024-09-12T17:30:37.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.541+0000 7fece65ff780 1 < completed multipart upload key=4Z1N3433MC6A upload=N28DRNOZPP1O tag=3Q1AUYE5VB1A type=write size=3581926 2024-09-12T17:30:37.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.543+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=4GUN6480XXKW type=del size=212924 2024-09-12T17:30:37.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.544+0000 7fece65ff780 1 < completed write operation key=RKFRKIENSBTO tag=3HGN3IW85A0X type=write size=223547 2024-09-12T17:30:37.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.545+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=RPXBV9X3PUYJ type=write size=91447 2024-09-12T17:30:37.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.546+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~XDB2DJ2SHAIB.0 size=266472 2024-09-12T17:30:37.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.548+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=XDB2DJ2SHAIB tag=IRMTZ7U58H5D type=write size=1315048 2024-09-12T17:30:37.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.550+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~176PPNA1792J.0 size=1048576 2024-09-12T17:30:37.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.551+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~176PPNA1792J.1 size=97604 2024-09-12T17:30:37.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.551+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=176PPNA1792J tag=NVW2HB5I83UM type=write size=2194756 2024-09-12T17:30:37.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.553+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~X2AS4DBKAS96.0 size=1048576 2024-09-12T17:30:37.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.553+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~X2AS4DBKAS96.1 size=890315 2024-09-12T17:30:37.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.555+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=X2AS4DBKAS96 tag=03IN5VAIGYBX type=write size=2987467 2024-09-12T17:30:37.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.558+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~W2HYVU7L5BD1.0 size=1048576 2024-09-12T17:30:37.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.559+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~W2HYVU7L5BD1.1 size=1048576 2024-09-12T17:30:37.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.559+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~W2HYVU7L5BD1.2 size=146164 2024-09-12T17:30:37.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.559+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=W2HYVU7L5BD1 tag=60R8X5ZTWAS5 type=write size=3291892 2024-09-12T17:30:37.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.562+0000 7fece65ff780 1 < suggested update operation key=QQNW20B28RJC tag=0CHSWFHXKDUS type=del size=2684553 2024-09-12T17:30:37.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.563+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=RN3TFBX75P68 type=write size=384392 2024-09-12T17:30:37.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.564+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~0LZ30JDC98NR.0 size=224867 2024-09-12T17:30:37.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.566+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=0LZ30JDC98NR tag=3CTL8DBQ1FYV type=write size=1273443 2024-09-12T17:30:37.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.567+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=DUEXTEI7UM9V type=del size=831285 2024-09-12T17:30:37.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.568+0000 7fece65ff780 1 < completed write operation key=2HTNXL56URAK tag=SIAEJIBJ313R type=write size=685578 2024-09-12T17:30:37.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.570+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=6SOGDDRR7A7B type=del size=1897746 2024-09-12T17:30:37.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.571+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=FRJ6T5QTOAN2 type=del 2024-09-12T17:30:37.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.572+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=8XCJ7Y2PBYJK type=del size=2676035 2024-09-12T17:30:37.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.574+0000 7fece65ff780 1 < suggested update operation key=6GUDX5I1AKNH tag=RR65PSLOED9E type=write size=12096 2024-09-12T17:30:37.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.576+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~T0TGO9HFBIGF.0 size=1048576 2024-09-12T17:30:37.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.577+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~T0TGO9HFBIGF.1 size=1048576 2024-09-12T17:30:37.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.578+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~T0TGO9HFBIGF.2 size=590316 2024-09-12T17:30:37.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.578+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=T0TGO9HFBIGF tag=VEAD9RUWZC5F type=write size=3736044 2024-09-12T17:30:37.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.579+0000 7fece65ff780 -1 < failed to complete operation key=QQNW20B28RJC tag=K7ZX5HIQBECQ type=del size=2491260: (22) Invalid argument 2024-09-12T17:30:37.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.581+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~AI4KN6WPE2PZ.0 size=193388 2024-09-12T17:30:37.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.581+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=AI4KN6WPE2PZ tag=GFTJSAH78MF2 type=write size=1241964 2024-09-12T17:30:37.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.583+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=W774N68MDP9A type=del 2024-09-12T17:30:37.586 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.585+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~T71NWVBILTAH.0 size=1048576 2024-09-12T17:30:37.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.586+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~T71NWVBILTAH.1 size=1048576 2024-09-12T17:30:37.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.587+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~T71NWVBILTAH.2 size=606760 2024-09-12T17:30:37.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.587+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=T71NWVBILTAH tag=DU6A7N4A6BBB type=write size=3752488 2024-09-12T17:30:37.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.589+0000 7fece65ff780 1 < suggested remove operation key=I31CKY20NO9S tag=T00Z261TZBY8 type=del 2024-09-12T17:30:37.593 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.591+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~2X6KYLDPRZVQ.0 size=1048576 2024-09-12T17:30:37.593 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.592+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~2X6KYLDPRZVQ.1 size=1048576 2024-09-12T17:30:37.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.593+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~2X6KYLDPRZVQ.2 size=389737 2024-09-12T17:30:37.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.593+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=2X6KYLDPRZVQ tag=PTD97E7MM582 type=write size=3535465 2024-09-12T17:30:37.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.594+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~WE0JW206Y6EW.0 size=1048576 2024-09-12T17:30:37.600 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.595+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~WE0JW206Y6EW.1 size=148654 2024-09-12T17:30:37.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.597+0000 7fece65ff780 1 < completed multipart upload key=I31CKY20NO9S upload=WE0JW206Y6EW tag=P1PH61FBFBCM type=write size=2245806 2024-09-12T17:30:37.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.598+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=TMUBMTBQ0WR5 type=del size=1811732 2024-09-12T17:30:37.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.600+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~T5NP3SHT1RDK.0 size=1048576 2024-09-12T17:30:37.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.600+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~T5NP3SHT1RDK.1 size=1048576 2024-09-12T17:30:37.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.601+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~T5NP3SHT1RDK.2 size=952915 2024-09-12T17:30:37.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.603+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=T5NP3SHT1RDK tag=RJTW1CI4CA7Z type=write size=4098643 2024-09-12T17:30:37.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.605+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~FI3U9IEKKEBV.0 size=1048576 2024-09-12T17:30:37.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.606+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~FI3U9IEKKEBV.1 size=937926 2024-09-12T17:30:37.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.606+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=FI3U9IEKKEBV tag=80NISOWZZCSW type=write size=3035078 2024-09-12T17:30:37.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.609+0000 7fece65ff780 1 < suggested update operation key=W3MBKNIBLV7W tag=6RZOR1GZUX9D type=del size=1828479 2024-09-12T17:30:37.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.610+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=927OOXP9UYRE type=write size=608340 2024-09-12T17:30:37.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.611+0000 7fece65ff780 1 < completed write operation key=807GX4RQQLL4 tag=47AA5K23K134 type=write size=490133 2024-09-12T17:30:37.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.613+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=5IV0ZC0PGR3I type=del size=1039247 2024-09-12T17:30:37.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.615+0000 7fece65ff780 1 < suggested remove operation key=4Z1N3433MC6A tag=4GUN6480XXKW type=del 2024-09-12T17:30:37.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.616+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=TDH842C2NC8Z type=write size=491965 2024-09-12T17:30:37.619 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.617+0000 7fece65ff780 1 < completed write operation key=YCNQL8CUUGW7 tag=RPXBV9X3PUYJ type=write size=91447 2024-09-12T17:30:37.620 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.618+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=EJIB0LI48T1R type=write size=825101 2024-09-12T17:30:37.621 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.620+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~176PPNA1792J.0 size=1048576 2024-09-12T17:30:37.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.621+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~176PPNA1792J.1 size=97604 2024-09-12T17:30:37.624 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.623+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=176PPNA1792J tag=NVW2HB5I83UM type=write size=2194756 2024-09-12T17:30:37.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.624+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=IWQYOGLD1BB2 type=del size=3869949 2024-09-12T17:30:37.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.625+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~W2HYVU7L5BD1.0 size=1048576 2024-09-12T17:30:37.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.626+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~W2HYVU7L5BD1.1 size=1048576 2024-09-12T17:30:37.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.628+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~W2HYVU7L5BD1.2 size=146164 2024-09-12T17:30:37.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.633+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=W2HYVU7L5BD1 tag=60R8X5ZTWAS5 type=write size=3291892 2024-09-12T17:30:37.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.634+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=AJ5LY7DSSQGU type=del size=3079056 2024-09-12T17:30:37.637 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.636+0000 7fece65ff780 1 < completed write operation key=9KYNMM6W7RRM tag=RN3TFBX75P68 type=write size=384392 2024-09-12T17:30:37.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.638+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~4Y07KSECQJJ0.0 size=162149 2024-09-12T17:30:37.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.638+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=4Y07KSECQJJ0 tag=GWJ37C70AFTK type=write size=1210725 2024-09-12T17:30:37.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.639+0000 7fece65ff780 1 < canceled operation key=Q00ZFG0BBDG5 tag=DUEXTEI7UM9V type=del size=831285 2024-09-12T17:30:37.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.641+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=1JP832DR361L type=del size=3931009 2024-09-12T17:30:37.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.643+0000 7fece65ff780 1 < suggested update operation key=W3MBKNIBLV7W tag=6SOGDDRR7A7B type=del size=1897746 2024-09-12T17:30:37.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.645+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~GXPPG2LZ58VC.0 size=1048576 2024-09-12T17:30:37.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.646+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~GXPPG2LZ58VC.1 size=1048576 2024-09-12T17:30:37.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.647+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~GXPPG2LZ58VC.2 size=563786 2024-09-12T17:30:37.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.647+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=GXPPG2LZ58VC tag=V5XMQNV9PKMG type=write size=3709514 2024-09-12T17:30:37.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.649+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=8XCJ7Y2PBYJK type=del 2024-09-12T17:30:37.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.650+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=EUTSA1X1D35X type=del size=970015 2024-09-12T17:30:37.653 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.651+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~T0TGO9HFBIGF.0 size=1048576 2024-09-12T17:30:37.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.652+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~T0TGO9HFBIGF.1 size=1048576 2024-09-12T17:30:37.655 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.653+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~T0TGO9HFBIGF.2 size=590316 2024-09-12T17:30:37.657 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.655+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=T0TGO9HFBIGF tag=VEAD9RUWZC5F type=write size=3736044 2024-09-12T17:30:37.659 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.658+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~4VAYHW21P6OV.0 size=992125 2024-09-12T17:30:37.659 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.658+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=4VAYHW21P6OV tag=O1U79SNDS5DF type=write size=2040701 2024-09-12T17:30:37.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.659+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~AI4KN6WPE2PZ.0 size=193388 2024-09-12T17:30:37.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.661+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=AI4KN6WPE2PZ tag=GFTJSAH78MF2 type=write size=1241964 2024-09-12T17:30:37.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.662+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=S0OCFQPCUB4J type=del size=1034794 2024-09-12T17:30:37.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.663+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~T71NWVBILTAH.0 size=1048576 2024-09-12T17:30:37.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.664+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~T71NWVBILTAH.1 size=1048576 2024-09-12T17:30:37.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.664+0000 7fece65ff780 1 < canceled part key=_multipart_9IGJG88NX1FS.2~T71NWVBILTAH.2 size=606760 2024-09-12T17:30:37.668 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.667+0000 7fece65ff780 1 < canceled multipart upload key=9IGJG88NX1FS upload=T71NWVBILTAH tag=DU6A7N4A6BBB type=write size=3752488 2024-09-12T17:30:37.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.669+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~IXMZL1VG99A4.0 size=1048576 2024-09-12T17:30:37.671 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.670+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~IXMZL1VG99A4.1 size=1048576 2024-09-12T17:30:37.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.671+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~IXMZL1VG99A4.2 size=591396 2024-09-12T17:30:37.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.671+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=IXMZL1VG99A4 tag=UDYCLU1H4PJ4 type=write size=3737124 2024-09-12T17:30:37.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.672+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~2X6KYLDPRZVQ.0 size=1048576 2024-09-12T17:30:37.675 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.673+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~2X6KYLDPRZVQ.1 size=1048576 2024-09-12T17:30:37.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.674+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~2X6KYLDPRZVQ.2 size=389737 2024-09-12T17:30:37.678 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.677+0000 7fece65ff780 1 < completed multipart upload key=9KYNMM6W7RRM upload=2X6KYLDPRZVQ tag=PTD97E7MM582 type=write size=3535465 2024-09-12T17:30:37.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.679+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~07I4LE3ATQ33.0 size=1048576 2024-09-12T17:30:37.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.680+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~07I4LE3ATQ33.1 size=512530 2024-09-12T17:30:37.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.680+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=07I4LE3ATQ33 tag=0SCLEB4HBVHY type=write size=2609682 2024-09-12T17:30:37.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.681+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=TMUBMTBQ0WR5 type=del 2024-09-12T17:30:37.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.684+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~XPQM9BBDW7RU.0 size=1048576 2024-09-12T17:30:37.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.684+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~XPQM9BBDW7RU.1 size=1048576 2024-09-12T17:30:37.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.685+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~XPQM9BBDW7RU.2 size=624858 2024-09-12T17:30:37.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.685+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=XPQM9BBDW7RU tag=K0RWGTRCP3LW type=write size=3770586 2024-09-12T17:30:37.688 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.687+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~FI3U9IEKKEBV.0 size=1048576 2024-09-12T17:30:37.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.688+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~FI3U9IEKKEBV.1 size=937926 2024-09-12T17:30:37.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.690+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=FI3U9IEKKEBV tag=80NISOWZZCSW type=write size=3035078 2024-09-12T17:30:37.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.692+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~Z3X7OWHA338Y.0 size=1048576 2024-09-12T17:30:37.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.693+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~Z3X7OWHA338Y.1 size=526671 2024-09-12T17:30:37.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.693+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=Z3X7OWHA338Y tag=YKNMXVG5ZXGY type=write size=2623823 2024-09-12T17:30:37.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.694+0000 7fece65ff780 1 < completed write operation key=QQNW20B28RJC tag=927OOXP9UYRE type=write size=608340 2024-09-12T17:30:37.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.695+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=0V20V1PPB06B type=del size=191726 2024-09-12T17:30:37.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.696+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=5IV0ZC0PGR3I type=del 2024-09-12T17:30:37.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.698+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=GECH983ZROKR type=write size=353623 2024-09-12T17:30:37.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.700+0000 7fece65ff780 1 < suggested remove operation key=9IGJG88NX1FS tag=TDH842C2NC8Z type=write 2024-09-12T17:30:37.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.702+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~KU61297GI73R.0 size=1048576 2024-09-12T17:30:37.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.703+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~KU61297GI73R.1 size=529791 2024-09-12T17:30:37.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.703+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=KU61297GI73R tag=LM1QS5Z7SRBF type=write size=2626943 2024-09-12T17:30:37.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.704+0000 7fece65ff780 1 < completed write operation key=7AS5L998SDV7 tag=EJIB0LI48T1R type=write size=825101 2024-09-12T17:30:37.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.706+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=VM1U88CAVZR3 type=write size=770625 2024-09-12T17:30:37.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.707+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=IWQYOGLD1BB2 type=del 2024-09-12T17:30:37.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.708+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=N19CD0H2EIAV type=del size=649485 2024-09-12T17:30:37.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.709+0000 7fece65ff780 1 < completed delete operation key=5A7WPGW5P91B tag=AJ5LY7DSSQGU type=del 2024-09-12T17:30:37.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.711+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=4NVGDX5CJMV7 type=del size=68144 2024-09-12T17:30:37.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.712+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~4Y07KSECQJJ0.0 size=162149 2024-09-12T17:30:37.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.714+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=4Y07KSECQJJ0 tag=GWJ37C70AFTK type=write size=1210725 2024-09-12T17:30:37.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.715+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=H7B1XTJR1X9O type=write size=620588 2024-09-12T17:30:37.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.716+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=1JP832DR361L type=del 2024-09-12T17:30:37.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.717+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=B9T6UD6NDHRH type=write size=984750 2024-09-12T17:30:37.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.719+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~GXPPG2LZ58VC.0 size=1048576 2024-09-12T17:30:37.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.720+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~GXPPG2LZ58VC.1 size=1048576 2024-09-12T17:30:37.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.721+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~GXPPG2LZ58VC.2 size=563786 2024-09-12T17:30:37.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.723+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=GXPPG2LZ58VC tag=V5XMQNV9PKMG type=write size=3709514 2024-09-12T17:30:37.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.725+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~CDORQPC0HYOH.0 size=55519 2024-09-12T17:30:37.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.725+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=CDORQPC0HYOH tag=MGFUUBK0EI0M type=write size=1104095 2024-09-12T17:30:37.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.726+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=EUTSA1X1D35X type=del 2024-09-12T17:30:37.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.727+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=K76ZHHXPG89Y type=del size=1190895 2024-09-12T17:30:37.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.729+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~4VAYHW21P6OV.0 size=992125 2024-09-12T17:30:37.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.731+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=4VAYHW21P6OV tag=O1U79SNDS5DF type=write size=2040701 2024-09-12T17:30:37.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.733+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~UIVBJH0JBE8P.0 size=584702 2024-09-12T17:30:37.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.733+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=UIVBJH0JBE8P tag=N5QU74CKXXQ0 type=write size=1633278 2024-09-12T17:30:37.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.734+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=S0OCFQPCUB4J type=del 2024-09-12T17:30:37.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.735+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=1JNFTGYPKHUH type=del size=217329 2024-09-12T17:30:37.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.736+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~IXMZL1VG99A4.0 size=1048576 2024-09-12T17:30:37.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.737+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~IXMZL1VG99A4.1 size=1048576 2024-09-12T17:30:37.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.738+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~IXMZL1VG99A4.2 size=591396 2024-09-12T17:30:37.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.740+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=IXMZL1VG99A4 tag=UDYCLU1H4PJ4 type=write size=3737124 2024-09-12T17:30:37.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.743+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~9VBNWDIOBIT7.0 size=498516 2024-09-12T17:30:37.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.743+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=9VBNWDIOBIT7 tag=RF2EQI9P150M type=write size=1547092 2024-09-12T17:30:37.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.745+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~07I4LE3ATQ33.0 size=1048576 2024-09-12T17:30:37.748 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.746+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~07I4LE3ATQ33.1 size=512530 2024-09-12T17:30:37.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.748+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=07I4LE3ATQ33 tag=0SCLEB4HBVHY type=write size=2609682 2024-09-12T17:30:37.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.749+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=Q52G8UUEX9QC type=del size=146064 2024-09-12T17:30:37.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.751+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~XPQM9BBDW7RU.0 size=1048576 2024-09-12T17:30:37.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.752+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~XPQM9BBDW7RU.1 size=1048576 2024-09-12T17:30:37.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.753+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~XPQM9BBDW7RU.2 size=624858 2024-09-12T17:30:37.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.755+0000 7fece65ff780 1 < completed multipart upload key=W3MBKNIBLV7W upload=XPQM9BBDW7RU tag=K0RWGTRCP3LW type=write size=3770586 2024-09-12T17:30:37.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.757+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=TYGDNZTWJZ8W type=write size=119187 2024-09-12T17:30:37.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.758+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~Z3X7OWHA338Y.0 size=1048576 2024-09-12T17:30:37.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.759+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~Z3X7OWHA338Y.1 size=526671 2024-09-12T17:30:37.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.761+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=Z3X7OWHA338Y tag=YKNMXVG5ZXGY type=write size=2623823 2024-09-12T17:30:37.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.763+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~VU4CV8C9PXOG.0 size=1048576 2024-09-12T17:30:37.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.764+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~VU4CV8C9PXOG.1 size=1048576 2024-09-12T17:30:37.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.765+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~VU4CV8C9PXOG.2 size=602025 2024-09-12T17:30:37.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.765+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=VU4CV8C9PXOG tag=10VZ02GTMPW5 type=write size=3747753 2024-09-12T17:30:37.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.768+0000 7fece65ff780 1 < suggested remove operation key=7AS5L998SDV7 tag=0V20V1PPB06B type=del 2024-09-12T17:30:37.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.770+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~2111X5VXL1DY.0 size=1048576 2024-09-12T17:30:37.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.771+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~2111X5VXL1DY.1 size=1048576 2024-09-12T17:30:37.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.772+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~2111X5VXL1DY.2 size=917538 2024-09-12T17:30:37.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.772+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=2111X5VXL1DY tag=AOVUK6ZZJ3GO type=write size=4063266 2024-09-12T17:30:37.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.774+0000 7fece65ff780 1 < suggested update operation key=QQNW20B28RJC tag=GECH983ZROKR type=write size=353623 2024-09-12T17:30:37.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.775+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=I81CSIL9PS0V type=write size=622674 2024-09-12T17:30:37.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.776+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~KU61297GI73R.0 size=1048576 2024-09-12T17:30:37.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.777+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~KU61297GI73R.1 size=529791 2024-09-12T17:30:37.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.779+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=KU61297GI73R tag=LM1QS5Z7SRBF type=write size=2626943 2024-09-12T17:30:37.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.781+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=LN67UDP2J4L3 type=del size=4158984 2024-09-12T17:30:37.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.782+0000 7fece65ff780 1 < completed write operation key=UCBB99EG8XK2 tag=VM1U88CAVZR3 type=write size=770625 2024-09-12T17:30:37.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.784+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~B8OL1WNXYR3K.0 size=1013353 2024-09-12T17:30:37.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.784+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=B8OL1WNXYR3K tag=33UFOXZ561QW type=write size=2061929 2024-09-12T17:30:37.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.787+0000 7fece65ff780 1 < suggested remove operation key=FX8VJO1YXJ4H tag=N19CD0H2EIAV type=del 2024-09-12T17:30:37.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.789+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~TURY4TXMZXWM.0 size=1048576 2024-09-12T17:30:37.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.790+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~TURY4TXMZXWM.1 size=261624 2024-09-12T17:30:37.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.790+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=TURY4TXMZXWM tag=1R802LHE0KON type=write size=2358776 2024-09-12T17:30:37.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.791+0000 7fece65ff780 -1 < failed to complete operation key=7AS5L998SDV7 tag=4NVGDX5CJMV7 type=del size=68144: (22) Invalid argument 2024-09-12T17:30:37.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.792+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=6NNW28UDIGWF type=write size=124339 2024-09-12T17:30:37.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.795+0000 7fece65ff780 1 < suggested remove operation key=RKFRKIENSBTO tag=H7B1XTJR1X9O type=write 2024-09-12T17:30:37.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.796+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=QCLO5CL2E27Y type=del size=1212405 2024-09-12T17:30:37.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.797+0000 7fece65ff780 -1 < failed to complete operation key=RKFRKIENSBTO tag=B9T6UD6NDHRH type=write size=984750: (22) Invalid argument 2024-09-12T17:30:37.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.799+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=BC8UK7CSS6AL type=del size=2233073 2024-09-12T17:30:37.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.800+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~CDORQPC0HYOH.0 size=55519 2024-09-12T17:30:37.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.802+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=CDORQPC0HYOH tag=MGFUUBK0EI0M type=write size=1104095 2024-09-12T17:30:37.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.803+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=JZ5C36IX35FN type=del size=1441340 2024-09-12T17:30:37.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.804+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=K76ZHHXPG89Y type=del 2024-09-12T17:30:37.808 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.807+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=3JIN3BPZO8AC type=del size=2273137 2024-09-12T17:30:37.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.808+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~UIVBJH0JBE8P.0 size=584702 2024-09-12T17:30:37.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.811+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=UIVBJH0JBE8P tag=N5QU74CKXXQ0 type=write size=1633278 2024-09-12T17:30:37.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.813+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~R9GWP4IA8979.0 size=1048576 2024-09-12T17:30:37.816 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.814+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~R9GWP4IA8979.1 size=194023 2024-09-12T17:30:37.816 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.814+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=R9GWP4IA8979 tag=E3XOI9SGANMP type=write size=2291175 2024-09-12T17:30:37.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.816+0000 7fece65ff780 1 < canceled operation key=UCBB99EG8XK2 tag=1JNFTGYPKHUH type=del size=217329 2024-09-12T17:30:37.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.819+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~NHD4YM3VZ79V.0 size=1048576 2024-09-12T17:30:37.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.820+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~NHD4YM3VZ79V.1 size=1048576 2024-09-12T17:30:37.822 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.821+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~NHD4YM3VZ79V.2 size=143106 2024-09-12T17:30:37.822 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.821+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=NHD4YM3VZ79V tag=ERKFHTE79C4R type=write size=3288834 2024-09-12T17:30:37.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.822+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~9VBNWDIOBIT7.0 size=498516 2024-09-12T17:30:37.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.825+0000 7fece65ff780 1 < completed multipart upload key=FX8VJO1YXJ4H upload=9VBNWDIOBIT7 tag=RF2EQI9P150M type=write size=1547092 2024-09-12T17:30:37.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.826+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=YHUT9HX0SJZP type=del size=3626682 2024-09-12T17:30:37.829 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.828+0000 7fece65ff780 1 < canceled operation key=9IGJG88NX1FS tag=Q52G8UUEX9QC type=del size=146064 2024-09-12T17:30:37.831 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.829+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=VZZ2QZ82QMKQ type=del size=125521 2024-09-12T17:30:37.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.831+0000 7fece65ff780 1 < completed write operation key=2HTNXL56URAK tag=TYGDNZTWJZ8W type=write size=119187 2024-09-12T17:30:37.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.832+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=G31O694JA8TL type=del size=2778376 2024-09-12T17:30:37.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.834+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~VU4CV8C9PXOG.0 size=1048576 2024-09-12T17:30:37.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.835+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~VU4CV8C9PXOG.1 size=1048576 2024-09-12T17:30:37.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.835+0000 7fece65ff780 1 < canceled part key=_multipart_FX8VJO1YXJ4H.2~VU4CV8C9PXOG.2 size=602025 2024-09-12T17:30:37.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.837+0000 7fece65ff780 1 < canceled multipart upload key=FX8VJO1YXJ4H upload=VU4CV8C9PXOG tag=10VZ02GTMPW5 type=write size=3747753 2024-09-12T17:30:37.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.838+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=3RPHS5YTEN47 type=del size=3574793 2024-09-12T17:30:37.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.840+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~2111X5VXL1DY.0 size=1048576 2024-09-12T17:30:37.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.841+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~2111X5VXL1DY.1 size=1048576 2024-09-12T17:30:37.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.842+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~2111X5VXL1DY.2 size=917538 2024-09-12T17:30:37.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.845+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=2111X5VXL1DY tag=AOVUK6ZZJ3GO type=write size=4063266 2024-09-12T17:30:37.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.847+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~OVHPEBFDMXS3.0 size=1048576 2024-09-12T17:30:37.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.848+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~OVHPEBFDMXS3.1 size=987244 2024-09-12T17:30:37.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.848+0000 7fece65ff780 1 > prepared multipart upload key=Y30269Q7R340 upload=OVHPEBFDMXS3 tag=W5FMZGJVHMBN type=write size=3084396 2024-09-12T17:30:37.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.850+0000 7fece65ff780 1 < completed write operation key=LSGN631FW1P8 tag=I81CSIL9PS0V type=write size=622674 2024-09-12T17:30:37.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.852+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~GBILH9Y09E5Y.0 size=565471 2024-09-12T17:30:37.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.852+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=GBILH9Y09E5Y tag=U3QR41Z6XW07 type=write size=1614047 2024-09-12T17:30:37.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.854+0000 7fece65ff780 1 < canceled operation key=ZEFSNR1IIA10 tag=LN67UDP2J4L3 type=del size=4158984 2024-09-12T17:30:37.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.855+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=6P9V6M7D8B91 type=del size=1497904 2024-09-12T17:30:37.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.857+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~B8OL1WNXYR3K.0 size=1013353 2024-09-12T17:30:37.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.859+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=B8OL1WNXYR3K tag=33UFOXZ561QW type=write size=2061929 2024-09-12T17:30:37.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.861+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=7LKEVT3AU1ZT type=write size=723543 2024-09-12T17:30:37.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.862+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~TURY4TXMZXWM.0 size=1048576 2024-09-12T17:30:37.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.863+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~TURY4TXMZXWM.1 size=261624 2024-09-12T17:30:37.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.865+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=TURY4TXMZXWM tag=1R802LHE0KON type=write size=2358776 2024-09-12T17:30:37.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.869+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~RFO5W9TD0VZ6.0 size=671431 2024-09-12T17:30:37.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.869+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=RFO5W9TD0VZ6 tag=HJFXLT9WFVBF type=write size=1720007 2024-09-12T17:30:37.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.870+0000 7fece65ff780 1 < completed write operation key=CBYI6C1ICE08 tag=6NNW28UDIGWF type=write size=124339 2024-09-12T17:30:37.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.872+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=WCSRSEEXEURH type=del size=313052 2024-09-12T17:30:37.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.874+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=QCLO5CL2E27Y type=del 2024-09-12T17:30:37.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.875+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=W517CQQOBMCO type=del size=2939080 2024-09-12T17:30:37.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.877+0000 7fece65ff780 1 < suggested update operation key=RKFRKIENSBTO tag=BC8UK7CSS6AL type=del size=2233073 2024-09-12T17:30:37.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.879+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~4G5RCNH3IKFT.0 size=1048576 2024-09-12T17:30:37.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.880+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~4G5RCNH3IKFT.1 size=172899 2024-09-12T17:30:37.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.880+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=4G5RCNH3IKFT tag=7NP1MI5YA0L6 type=write size=2270051 2024-09-12T17:30:37.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.882+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=JZ5C36IX35FN type=del 2024-09-12T17:30:37.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.883+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=BBTERDNQBVIV type=del size=2189410 2024-09-12T17:30:37.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.884+0000 7fece65ff780 1 < canceled operation key=W3MBKNIBLV7W tag=3JIN3BPZO8AC type=del size=2273137 2024-09-12T17:30:37.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.885+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=Y14NLLQLL1PE type=del size=182416 2024-09-12T17:30:37.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.887+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~R9GWP4IA8979.0 size=1048576 2024-09-12T17:30:37.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.887+0000 7fece65ff780 1 < canceled part key=_multipart_I31CKY20NO9S.2~R9GWP4IA8979.1 size=194023 2024-09-12T17:30:37.890 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.889+0000 7fece65ff780 1 < canceled multipart upload key=I31CKY20NO9S upload=R9GWP4IA8979 tag=E3XOI9SGANMP type=write size=2291175 2024-09-12T17:30:37.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.891+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~W7NVQSY09LGG.0 size=1048576 2024-09-12T17:30:37.894 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.892+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~W7NVQSY09LGG.1 size=1048576 2024-09-12T17:30:37.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.893+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~W7NVQSY09LGG.2 size=679387 2024-09-12T17:30:37.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.893+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=W7NVQSY09LGG tag=IQH1UDYZMG6Z type=write size=3825115 2024-09-12T17:30:37.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.895+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~NHD4YM3VZ79V.0 size=1048576 2024-09-12T17:30:37.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.896+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~NHD4YM3VZ79V.1 size=1048576 2024-09-12T17:30:37.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.897+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~NHD4YM3VZ79V.2 size=143106 2024-09-12T17:30:37.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.899+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=NHD4YM3VZ79V tag=ERKFHTE79C4R type=write size=3288834 2024-09-12T17:30:37.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.902+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~IEAH83OS0A03.0 size=1048576 2024-09-12T17:30:37.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.903+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~IEAH83OS0A03.1 size=626998 2024-09-12T17:30:37.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.903+0000 7fece65ff780 1 > prepared multipart upload key=LSGN631FW1P8 upload=IEAH83OS0A03 tag=PKRTYVTZX341 type=write size=2724150 2024-09-12T17:30:37.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.904+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=YHUT9HX0SJZP type=del 2024-09-12T17:30:37.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.907+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~PD9N22TXLC0I.0 size=1048576 2024-09-12T17:30:37.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.908+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~PD9N22TXLC0I.1 size=1048576 2024-09-12T17:30:37.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.908+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~PD9N22TXLC0I.2 size=68507 2024-09-12T17:30:37.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.908+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=PD9N22TXLC0I tag=2MDL8L2TIEDH type=write size=3214235 2024-09-12T17:30:37.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.910+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=VZZ2QZ82QMKQ type=del 2024-09-12T17:30:37.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.911+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=TT10ZVEYDVGE type=del size=1859332 2024-09-12T17:30:37.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.912+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=G31O694JA8TL type=del 2024-09-12T17:30:37.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.914+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=QPXKK1YXO65E type=write size=469588 2024-09-12T17:30:37.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.915+0000 7fece65ff780 1 < canceled operation key=LSGN631FW1P8 tag=3RPHS5YTEN47 type=del size=3574793 2024-09-12T17:30:37.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.917+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~QJ33PXFB4D2B.0 size=1048576 2024-09-12T17:30:37.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.918+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~QJ33PXFB4D2B.1 size=1048576 2024-09-12T17:30:37.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.919+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~QJ33PXFB4D2B.2 size=994922 2024-09-12T17:30:37.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.919+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=QJ33PXFB4D2B tag=WP6OR0Z4HNT5 type=write size=4140650 2024-09-12T17:30:37.922 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.920+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~OVHPEBFDMXS3.0 size=1048576 2024-09-12T17:30:37.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.921+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~OVHPEBFDMXS3.1 size=987244 2024-09-12T17:30:37.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.923+0000 7fece65ff780 1 < completed multipart upload key=Y30269Q7R340 upload=OVHPEBFDMXS3 tag=W5FMZGJVHMBN type=write size=3084396 2024-09-12T17:30:37.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.925+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=KA15TOCA4BQ9 type=del size=3044697 2024-09-12T17:30:37.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.926+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~GBILH9Y09E5Y.0 size=565471 2024-09-12T17:30:37.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.928+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=GBILH9Y09E5Y tag=U3QR41Z6XW07 type=write size=1614047 2024-09-12T17:30:37.932 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.930+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~1DJLXKKUGWEP.0 size=1048576 2024-09-12T17:30:37.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.931+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~1DJLXKKUGWEP.1 size=978399 2024-09-12T17:30:37.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.931+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=1DJLXKKUGWEP tag=WYLMGLXPFS7D type=write size=3075551 2024-09-12T17:30:37.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.932+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=6P9V6M7D8B91 type=del 2024-09-12T17:30:37.936 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.935+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~2H99AE5QMHGM.0 size=1048576 2024-09-12T17:30:37.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.936+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~2H99AE5QMHGM.1 size=1048576 2024-09-12T17:30:37.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.936+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~2H99AE5QMHGM.2 size=142770 2024-09-12T17:30:37.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.936+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=2H99AE5QMHGM tag=J31GKSEY7IE2 type=write size=3288498 2024-09-12T17:30:37.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.938+0000 7fece65ff780 1 < completed write operation key=OIHDAJMPUK4I tag=7LKEVT3AU1ZT type=write size=723543 2024-09-12T17:30:37.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.940+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~60EZLRJ02UV3.0 size=1048576 2024-09-12T17:30:37.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.941+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~60EZLRJ02UV3.1 size=1048576 2024-09-12T17:30:37.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.942+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~60EZLRJ02UV3.2 size=1008326 2024-09-12T17:30:37.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.942+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=60EZLRJ02UV3 tag=72M169J7EZSA type=write size=4154054 2024-09-12T17:30:37.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.944+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~RFO5W9TD0VZ6.0 size=671431 2024-09-12T17:30:37.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.946+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=RFO5W9TD0VZ6 tag=HJFXLT9WFVBF type=write size=1720007 2024-09-12T17:30:37.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.948+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=H0SBW30QPPKS type=del size=488821 2024-09-12T17:30:37.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.949+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=WCSRSEEXEURH type=del 2024-09-12T17:30:37.952 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.950+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=FC3KUADXIHEW type=write size=127374 2024-09-12T17:30:37.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.952+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=W517CQQOBMCO type=del 2024-09-12T17:30:37.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.955+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~Q55HFWPITJZJ.0 size=1048576 2024-09-12T17:30:37.957 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.956+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~Q55HFWPITJZJ.1 size=571602 2024-09-12T17:30:37.957 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.956+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=Q55HFWPITJZJ tag=9Y7AZ2XTOLTX type=write size=2668754 2024-09-12T17:30:37.958 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.956+0000 7fece65ff780 1 < canceled part key=_multipart_I7TGK5A3JHH5.2~4G5RCNH3IKFT.0 size=1048576 2024-09-12T17:30:37.959 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.957+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~4G5RCNH3IKFT.1 size=172899 2024-09-12T17:30:37.961 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.960+0000 7fece65ff780 1 < canceled multipart upload key=I7TGK5A3JHH5 upload=4G5RCNH3IKFT tag=7NP1MI5YA0L6 type=write size=2270051 2024-09-12T17:30:37.964 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.962+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~06KFZRTQB976.0 size=1048576 2024-09-12T17:30:37.965 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.963+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~06KFZRTQB976.1 size=1043136 2024-09-12T17:30:37.965 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.963+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=06KFZRTQB976 tag=MCD82KZC39ON type=write size=3140288 2024-09-12T17:30:37.966 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.964+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=BBTERDNQBVIV type=del 2024-09-12T17:30:37.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.966+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=7PE0EMJ1RB89 type=del size=431962 2024-09-12T17:30:37.968 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.967+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=Y14NLLQLL1PE type=del 2024-09-12T17:30:37.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.968+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=NQLH27U6I91Z type=write size=932888 2024-09-12T17:30:37.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.969+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~W7NVQSY09LGG.0 size=1048576 2024-09-12T17:30:37.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.971+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~W7NVQSY09LGG.1 size=1048576 2024-09-12T17:30:37.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.972+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~W7NVQSY09LGG.2 size=679387 2024-09-12T17:30:37.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.974+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=W7NVQSY09LGG tag=IQH1UDYZMG6Z type=write size=3825115 2024-09-12T17:30:37.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.975+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=5JCA7NP1TGV1 type=del size=1493448 2024-09-12T17:30:37.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.976+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~IEAH83OS0A03.0 size=1048576 2024-09-12T17:30:37.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.977+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~IEAH83OS0A03.1 size=626998 2024-09-12T17:30:37.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.980+0000 7fece65ff780 1 < completed multipart upload key=LSGN631FW1P8 upload=IEAH83OS0A03 tag=PKRTYVTZX341 type=write size=2724150 2024-09-12T17:30:37.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.981+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=X45ILB8PWSEQ type=del size=2135835 2024-09-12T17:30:37.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.982+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~PD9N22TXLC0I.0 size=1048576 2024-09-12T17:30:37.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.982+0000 7fece65ff780 1 < canceled part key=_multipart_W3MBKNIBLV7W.2~PD9N22TXLC0I.1 size=1048576 2024-09-12T17:30:37.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.984+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~PD9N22TXLC0I.2 size=68507 2024-09-12T17:30:37.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.986+0000 7fece65ff780 1 < canceled multipart upload key=W3MBKNIBLV7W upload=PD9N22TXLC0I tag=2MDL8L2TIEDH type=write size=3214235 2024-09-12T17:30:37.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.989+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~3UOQJJRUB6LY.0 size=1048576 2024-09-12T17:30:37.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.990+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~3UOQJJRUB6LY.1 size=1048576 2024-09-12T17:30:37.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.991+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~3UOQJJRUB6LY.2 size=207951 2024-09-12T17:30:37.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.991+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=3UOQJJRUB6LY tag=BTFHX4OBW9JL type=write size=3353679 2024-09-12T17:30:37.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.994+0000 7fece65ff780 1 < suggested remove operation key=OPMR1WMB14CA tag=TT10ZVEYDVGE type=del 2024-09-12T17:30:37.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.995+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=UVUG2VM21SJ4 type=del size=988295 2024-09-12T17:30:37.998 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.996+0000 7fece65ff780 1 < completed write operation key=2HTNXL56URAK tag=QPXKK1YXO65E type=write size=469588 2024-09-12T17:30:37.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.998+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=W7DQ1DURB0O5 type=write size=353665 2024-09-12T17:30:38.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:37.999+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~QJ33PXFB4D2B.0 size=1048576 2024-09-12T17:30:38.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.000+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~QJ33PXFB4D2B.1 size=1048576 2024-09-12T17:30:38.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.001+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~QJ33PXFB4D2B.2 size=994922 2024-09-12T17:30:38.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.003+0000 7fece65ff780 1 < completed multipart upload key=W3MBKNIBLV7W upload=QJ33PXFB4D2B tag=WP6OR0Z4HNT5 type=write size=4140650 2024-09-12T17:30:38.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.005+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~KLX47SDA2RVB.0 size=1048576 2024-09-12T17:30:38.008 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.006+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~KLX47SDA2RVB.1 size=387971 2024-09-12T17:30:38.008 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.006+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=KLX47SDA2RVB tag=2GA10G0DD9HQ type=write size=2485123 2024-09-12T17:30:38.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.008+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=KA15TOCA4BQ9 type=del 2024-09-12T17:30:38.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.010+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~I5W95MXTO36S.0 size=412647 2024-09-12T17:30:38.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.010+0000 7fece65ff780 1 > prepared multipart upload key=Y30269Q7R340 upload=I5W95MXTO36S tag=TQO6KXO6NTDV type=write size=1461223 2024-09-12T17:30:38.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.011+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~1DJLXKKUGWEP.0 size=1048576 2024-09-12T17:30:38.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.011+0000 7fece65ff780 1 < canceled part key=_multipart_YCNQL8CUUGW7.2~1DJLXKKUGWEP.1 size=978399 2024-09-12T17:30:38.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.013+0000 7fece65ff780 1 < canceled multipart upload key=YCNQL8CUUGW7 upload=1DJLXKKUGWEP tag=WYLMGLXPFS7D type=write size=3075551 2024-09-12T17:30:38.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.014+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=VM3KCIQWZ4TT type=del size=2538184 2024-09-12T17:30:38.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.016+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~2H99AE5QMHGM.0 size=1048576 2024-09-12T17:30:38.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.017+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~2H99AE5QMHGM.1 size=1048576 2024-09-12T17:30:38.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.018+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~2H99AE5QMHGM.2 size=142770 2024-09-12T17:30:38.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.020+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=2H99AE5QMHGM tag=J31GKSEY7IE2 type=write size=3288498 2024-09-12T17:30:38.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.021+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=CTWBF4Y057LK type=write size=740727 2024-09-12T17:30:38.024 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.022+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~60EZLRJ02UV3.0 size=1048576 2024-09-12T17:30:38.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.023+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~60EZLRJ02UV3.1 size=1048576 2024-09-12T17:30:38.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.023+0000 7fece65ff780 1 < canceled part key=_multipart_I7TGK5A3JHH5.2~60EZLRJ02UV3.2 size=1008326 2024-09-12T17:30:38.027 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.025+0000 7fece65ff780 1 < canceled multipart upload key=I7TGK5A3JHH5 upload=60EZLRJ02UV3 tag=72M169J7EZSA type=write size=4154054 2024-09-12T17:30:38.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.028+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~IA34EF911OM4.0 size=1048576 2024-09-12T17:30:38.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.029+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~IA34EF911OM4.1 size=538631 2024-09-12T17:30:38.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.029+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=IA34EF911OM4 tag=H3LI4BRJUWOD type=write size=2635783 2024-09-12T17:30:38.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.031+0000 7fece65ff780 1 < suggested remove operation key=ZEFSNR1IIA10 tag=H0SBW30QPPKS type=del 2024-09-12T17:30:38.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.032+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=CIATUFUVMLYI type=del size=293196 2024-09-12T17:30:38.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.034+0000 7fece65ff780 1 < completed write operation key=I7TGK5A3JHH5 tag=FC3KUADXIHEW type=write size=127374 2024-09-12T17:30:38.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.035+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=P702N6R6KVXO type=del size=3003533 2024-09-12T17:30:38.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.036+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~Q55HFWPITJZJ.0 size=1048576 2024-09-12T17:30:38.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.036+0000 7fece65ff780 1 < canceled part key=_multipart_OIHDAJMPUK4I.2~Q55HFWPITJZJ.1 size=571602 2024-09-12T17:30:38.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.038+0000 7fece65ff780 1 < canceled multipart upload key=OIHDAJMPUK4I upload=Q55HFWPITJZJ tag=9Y7AZ2XTOLTX type=write size=2668754 2024-09-12T17:30:38.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.039+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=M2MKWYDYEQRO type=write size=274159 2024-09-12T17:30:38.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.041+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~06KFZRTQB976.0 size=1048576 2024-09-12T17:30:38.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.043+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~06KFZRTQB976.1 size=1043136 2024-09-12T17:30:38.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.045+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=06KFZRTQB976 tag=MCD82KZC39ON type=write size=3140288 2024-09-12T17:30:38.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.047+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=T6OCFLHE6M70 type=del size=3015156 2024-09-12T17:30:38.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.048+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=7PE0EMJ1RB89 type=del 2024-09-12T17:30:38.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.049+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=LIYHDXXX0FTL type=del size=1382013 2024-09-12T17:30:38.053 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.051+0000 7fece65ff780 1 < canceled operation key=Q00ZFG0BBDG5 tag=NQLH27U6I91Z type=write size=932888 2024-09-12T17:30:38.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.052+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=M0ETRVB9EBDA type=del size=3123374 2024-09-12T17:30:38.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.054+0000 7fece65ff780 1 < suggested remove operation key=RKFRKIENSBTO tag=5JCA7NP1TGV1 type=del 2024-09-12T17:30:38.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.056+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=82UTB67BSH0G type=write size=684024 2024-09-12T17:30:38.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.057+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=X45ILB8PWSEQ type=del 2024-09-12T17:30:38.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.058+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=JVM47L14Z41A type=write size=727561 2024-09-12T17:30:38.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.059+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~3UOQJJRUB6LY.0 size=1048576 2024-09-12T17:30:38.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.060+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~3UOQJJRUB6LY.1 size=1048576 2024-09-12T17:30:38.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.061+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~3UOQJJRUB6LY.2 size=207951 2024-09-12T17:30:38.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.063+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=3UOQJJRUB6LY tag=BTFHX4OBW9JL type=write size=3353679 2024-09-12T17:30:38.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.065+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~2OLDBL6ZM1BM.0 size=1048576 2024-09-12T17:30:38.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.066+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~2OLDBL6ZM1BM.1 size=1048576 2024-09-12T17:30:38.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.067+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~2OLDBL6ZM1BM.2 size=242891 2024-09-12T17:30:38.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.067+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=2OLDBL6ZM1BM tag=6ESU3FPYK7KQ type=write size=3388619 2024-09-12T17:30:38.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.069+0000 7fece65ff780 1 < canceled operation key=YCNQL8CUUGW7 tag=UVUG2VM21SJ4 type=del size=988295 2024-09-12T17:30:38.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.070+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=KGFG2V0C70I9 type=write size=311332 2024-09-12T17:30:38.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.073+0000 7fece65ff780 1 < suggested update operation key=1G9VNO1V4IMW tag=W7DQ1DURB0O5 type=write size=353665 2024-09-12T17:30:38.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.074+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=1OSKB38WKIW1 type=write size=287746 2024-09-12T17:30:38.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.075+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~KLX47SDA2RVB.0 size=1048576 2024-09-12T17:30:38.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.076+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~KLX47SDA2RVB.1 size=387971 2024-09-12T17:30:38.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.078+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=KLX47SDA2RVB tag=2GA10G0DD9HQ type=write size=2485123 2024-09-12T17:30:38.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.080+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=TKFGU6DV5USL type=write size=336558 2024-09-12T17:30:38.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.081+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~I5W95MXTO36S.0 size=412647 2024-09-12T17:30:38.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.083+0000 7fece65ff780 1 < completed multipart upload key=Y30269Q7R340 upload=I5W95MXTO36S tag=TQO6KXO6NTDV type=write size=1461223 2024-09-12T17:30:38.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.084+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=3F7IG03HHR6Y type=del size=1483763 2024-09-12T17:30:38.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.085+0000 7fece65ff780 1 < completed delete operation key=7AS5L998SDV7 tag=VM3KCIQWZ4TT type=del 2024-09-12T17:30:38.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.087+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=9RM30Z1LPLSO type=write size=706987 2024-09-12T17:30:38.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.088+0000 7fece65ff780 1 < completed write operation key=KKU8T0CVS40V tag=CTWBF4Y057LK type=write size=740727 2024-09-12T17:30:38.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.090+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~R5JKA1GHO0U3.0 size=1048576 2024-09-12T17:30:38.093 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.091+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~R5JKA1GHO0U3.1 size=1048576 2024-09-12T17:30:38.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.092+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~R5JKA1GHO0U3.2 size=780374 2024-09-12T17:30:38.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.092+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=R5JKA1GHO0U3 tag=1I1G76OEEUIN type=write size=3926102 2024-09-12T17:30:38.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.093+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~IA34EF911OM4.0 size=1048576 2024-09-12T17:30:38.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.094+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~IA34EF911OM4.1 size=538631 2024-09-12T17:30:38.098 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.096+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=IA34EF911OM4 tag=H3LI4BRJUWOD type=write size=2635783 2024-09-12T17:30:38.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.097+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=UNUQBR09P1R9 type=del size=736661 2024-09-12T17:30:38.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.100+0000 7fece65ff780 1 < suggested update operation key=1G9VNO1V4IMW tag=CIATUFUVMLYI type=del size=293196 2024-09-12T17:30:38.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.102+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~5RNCX466XWCF.0 size=1048576 2024-09-12T17:30:38.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.103+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~5RNCX466XWCF.1 size=1048576 2024-09-12T17:30:38.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.104+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~5RNCX466XWCF.2 size=581566 2024-09-12T17:30:38.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.104+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=5RNCX466XWCF tag=N6CB5ND22Q73 type=write size=3727294 2024-09-12T17:30:38.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.107+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=P702N6R6KVXO type=del 2024-09-12T17:30:38.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.108+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=HEOE8YA1STJ2 type=del size=304133 2024-09-12T17:30:38.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.109+0000 7fece65ff780 1 < completed write operation key=4Z1N3433MC6A tag=M2MKWYDYEQRO type=write size=274159 2024-09-12T17:30:38.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.110+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=6UYJUTKQF7TA type=write size=128779 2024-09-12T17:30:38.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.112+0000 7fece65ff780 1 < canceled operation key=807GX4RQQLL4 tag=T6OCFLHE6M70 type=del size=3015156 2024-09-12T17:30:38.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.114+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~7NZ6XUMPGA47.0 size=1048576 2024-09-12T17:30:38.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.115+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~7NZ6XUMPGA47.1 size=1048576 2024-09-12T17:30:38.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.116+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~7NZ6XUMPGA47.2 size=1035155 2024-09-12T17:30:38.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.116+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=7NZ6XUMPGA47 tag=HPTOWY9GMHXD type=write size=4180883 2024-09-12T17:30:38.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.117+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=LIYHDXXX0FTL type=del 2024-09-12T17:30:38.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.118+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=CUR8PQ35L9BK type=del size=3234209 2024-09-12T17:30:38.121 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.120+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=M0ETRVB9EBDA type=del 2024-09-12T17:30:38.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.121+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=9Q0PNW8D2MN3 type=del size=2463261 2024-09-12T17:30:38.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.124+0000 7fece65ff780 1 < suggested remove operation key=I31CKY20NO9S tag=82UTB67BSH0G type=write 2024-09-12T17:30:38.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.125+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=P2XJ1U0F8XEL type=del size=2629142 2024-09-12T17:30:38.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.126+0000 7fece65ff780 1 < completed write operation key=LSGN631FW1P8 tag=JVM47L14Z41A type=write size=727561 2024-09-12T17:30:38.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.128+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~B2KKMTTK7H3P.0 size=1048576 2024-09-12T17:30:38.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.129+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~B2KKMTTK7H3P.1 size=482031 2024-09-12T17:30:38.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.129+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=B2KKMTTK7H3P tag=M9IRO84XUO1U type=write size=2579183 2024-09-12T17:30:38.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.131+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~2OLDBL6ZM1BM.0 size=1048576 2024-09-12T17:30:38.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.132+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~2OLDBL6ZM1BM.1 size=1048576 2024-09-12T17:30:38.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.132+0000 7fece65ff780 1 < canceled part key=_multipart_I7TGK5A3JHH5.2~2OLDBL6ZM1BM.2 size=242891 2024-09-12T17:30:38.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.134+0000 7fece65ff780 1 < canceled multipart upload key=I7TGK5A3JHH5 upload=2OLDBL6ZM1BM tag=6ESU3FPYK7KQ type=write size=3388619 2024-09-12T17:30:38.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.135+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=M4E5OPGDQ4LJ type=del size=3650083 2024-09-12T17:30:38.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.136+0000 7fece65ff780 -1 < failed to complete operation key=1G9VNO1V4IMW tag=KGFG2V0C70I9 type=write size=311332: (22) Invalid argument 2024-09-12T17:30:38.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.137+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=HTVQ0XZ3XIZ7 type=del size=1034305 2024-09-12T17:30:38.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.138+0000 7fece65ff780 1 < completed write operation key=UN6FLMRMAPUS tag=1OSKB38WKIW1 type=write size=287746 2024-09-12T17:30:38.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.140+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~GDUT3BCFNBOG.0 size=272698 2024-09-12T17:30:38.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.140+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=GDUT3BCFNBOG tag=50EK5DOTTSZM type=write size=1321274 2024-09-12T17:30:38.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.143+0000 7fece65ff780 1 < suggested update operation key=Q00ZFG0BBDG5 tag=TKFGU6DV5USL type=write size=336558 2024-09-12T17:30:38.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.145+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~5TUXB2K0T3CH.0 size=1048576 2024-09-12T17:30:38.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.146+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~5TUXB2K0T3CH.1 size=1048576 2024-09-12T17:30:38.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.147+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~5TUXB2K0T3CH.2 size=529009 2024-09-12T17:30:38.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.147+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=5TUXB2K0T3CH tag=OIWBD2QXIA8R type=write size=3674737 2024-09-12T17:30:38.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.149+0000 7fece65ff780 1 < suggested remove operation key=ZEFSNR1IIA10 tag=3F7IG03HHR6Y type=del 2024-09-12T17:30:38.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.152+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~10CNR7AFM32P.0 size=250437 2024-09-12T17:30:38.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.152+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=10CNR7AFM32P tag=PAZYPICM9UJF type=write size=1299013 2024-09-12T17:30:38.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.152+0000 7fece65ff780 -1 < no bi entry to suggest for operation key=I31CKY20NO9S tag=9RM30Z1LPLSO type=write size=706987: (2) No such file or directory 2024-09-12T17:30:38.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.154+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=DQRY08RNDRLP type=del size=2044357 2024-09-12T17:30:38.157 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.155+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~R5JKA1GHO0U3.0 size=1048576 2024-09-12T17:30:38.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.156+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~R5JKA1GHO0U3.1 size=1048576 2024-09-12T17:30:38.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.157+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~R5JKA1GHO0U3.2 size=780374 2024-09-12T17:30:38.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.159+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=R5JKA1GHO0U3 tag=1I1G76OEEUIN type=write size=3926102 2024-09-12T17:30:38.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.161+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=LU5GU7XB83XN type=del size=3154324 2024-09-12T17:30:38.164 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.162+0000 7fece65ff780 1 < canceled operation key=OIHDAJMPUK4I tag=UNUQBR09P1R9 type=del size=736661 2024-09-12T17:30:38.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.163+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=FPC2O2AEXTWR type=del size=695387 2024-09-12T17:30:38.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.164+0000 7fece65ff780 1 < canceled part key=_multipart_FX8VJO1YXJ4H.2~5RNCX466XWCF.0 size=1048576 2024-09-12T17:30:38.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.165+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~5RNCX466XWCF.1 size=1048576 2024-09-12T17:30:38.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.166+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~5RNCX466XWCF.2 size=581566 2024-09-12T17:30:38.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.167+0000 7fece65ff780 1 < canceled multipart upload key=FX8VJO1YXJ4H upload=5RNCX466XWCF tag=N6CB5ND22Q73 type=write size=3727294 2024-09-12T17:30:38.171 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.170+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~HEZTB4CYI49T.0 size=1048576 2024-09-12T17:30:38.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.171+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~HEZTB4CYI49T.1 size=282729 2024-09-12T17:30:38.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.171+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=HEZTB4CYI49T tag=R8EVKDI7R190 type=write size=2379881 2024-09-12T17:30:38.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.172+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=HEOE8YA1STJ2 type=del 2024-09-12T17:30:38.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.173+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=151W14WIM4M6 type=del size=3329299 2024-09-12T17:30:38.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.174+0000 7fece65ff780 1 < completed write operation key=9IGJG88NX1FS tag=6UYJUTKQF7TA type=write size=128779 2024-09-12T17:30:38.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.175+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=7C8O3AKVPLHQ type=del size=3807209 2024-09-12T17:30:38.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.176+0000 7fece65ff780 1 < canceled part key=_multipart_Q00ZFG0BBDG5.2~7NZ6XUMPGA47.0 size=1048576 2024-09-12T17:30:38.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.177+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~7NZ6XUMPGA47.1 size=1048576 2024-09-12T17:30:38.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.178+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~7NZ6XUMPGA47.2 size=1035155 2024-09-12T17:30:38.181 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.180+0000 7fece65ff780 1 < canceled multipart upload key=Q00ZFG0BBDG5 upload=7NZ6XUMPGA47 tag=HPTOWY9GMHXD type=write size=4180883 2024-09-12T17:30:38.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.181+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=UQ19R01VIBK4 type=del size=1312346 2024-09-12T17:30:38.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.182+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=CUR8PQ35L9BK type=del 2024-09-12T17:30:38.185 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.184+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=C12WPVEENI9L type=del size=2948781 2024-09-12T17:30:38.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.185+0000 7fece65ff780 -1 < failed to complete operation key=Q00ZFG0BBDG5 tag=9Q0PNW8D2MN3 type=del size=2463261: (22) Invalid argument 2024-09-12T17:30:38.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.187+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=HHRXKO1JP0X6 type=del size=2797525 2024-09-12T17:30:38.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.188+0000 7fece65ff780 1 < canceled operation key=OPMR1WMB14CA tag=P2XJ1U0F8XEL type=del size=2629142 2024-09-12T17:30:38.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.191+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~H4104Y22BOFN.0 size=1048576 2024-09-12T17:30:38.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.192+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~H4104Y22BOFN.1 size=910191 2024-09-12T17:30:38.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.192+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=H4104Y22BOFN tag=TW9CH3ZWBCWH type=write size=3007343 2024-09-12T17:30:38.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.193+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~B2KKMTTK7H3P.0 size=1048576 2024-09-12T17:30:38.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.194+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~B2KKMTTK7H3P.1 size=482031 2024-09-12T17:30:38.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.196+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=B2KKMTTK7H3P tag=M9IRO84XUO1U type=write size=2579183 2024-09-12T17:30:38.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.199+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~CKL8321Y41AU.0 size=1048576 2024-09-12T17:30:38.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.200+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~CKL8321Y41AU.1 size=1048576 2024-09-12T17:30:38.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.200+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~CKL8321Y41AU.2 size=644739 2024-09-12T17:30:38.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.200+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=CKL8321Y41AU tag=XB7WPCR0Z38F type=write size=3790467 2024-09-12T17:30:38.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.203+0000 7fece65ff780 1 < suggested update operation key=6CCPZ4TVIU5N tag=M4E5OPGDQ4LJ type=del size=3650083 2024-09-12T17:30:38.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.204+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=0NTG7NG6C2SL type=write size=277482 2024-09-12T17:30:38.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.205+0000 7fece65ff780 1 < completed delete operation key=LSGN631FW1P8 tag=HTVQ0XZ3XIZ7 type=del 2024-09-12T17:30:38.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.206+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=A1RLOPQD6QZM type=del size=181451 2024-09-12T17:30:38.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.208+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~GDUT3BCFNBOG.0 size=272698 2024-09-12T17:30:38.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.210+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=GDUT3BCFNBOG tag=50EK5DOTTSZM type=write size=1321274 2024-09-12T17:30:38.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.212+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~5B37B99UN1W3.0 size=105575 2024-09-12T17:30:38.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.212+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=5B37B99UN1W3 tag=H4ANLB96WIU1 type=write size=1154151 2024-09-12T17:30:38.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.214+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~5TUXB2K0T3CH.0 size=1048576 2024-09-12T17:30:38.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.215+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~5TUXB2K0T3CH.1 size=1048576 2024-09-12T17:30:38.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.215+0000 7fece65ff780 1 < canceled part key=_multipart_I31CKY20NO9S.2~5TUXB2K0T3CH.2 size=529009 2024-09-12T17:30:38.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.217+0000 7fece65ff780 1 < canceled multipart upload key=I31CKY20NO9S upload=5TUXB2K0T3CH tag=OIWBD2QXIA8R type=write size=3674737 2024-09-12T17:30:38.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.218+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=TRJHUJ0LKXBK type=del size=2590146 2024-09-12T17:30:38.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.219+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~10CNR7AFM32P.0 size=250437 2024-09-12T17:30:38.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.221+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=10CNR7AFM32P tag=PAZYPICM9UJF type=write size=1299013 2024-09-12T17:30:38.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.223+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=FJGPBOJB1XG5 type=del size=914747 2024-09-12T17:30:38.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.225+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=DQRY08RNDRLP type=del 2024-09-12T17:30:38.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.229+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~KCD5K16E0QSA.0 size=1048576 2024-09-12T17:30:38.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.231+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~KCD5K16E0QSA.1 size=1048576 2024-09-12T17:30:38.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.232+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~KCD5K16E0QSA.2 size=1005798 2024-09-12T17:30:38.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.232+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=KCD5K16E0QSA tag=QB2NUTZ7UM5S type=write size=4151526 2024-09-12T17:30:38.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.233+0000 7fece65ff780 1 < canceled operation key=W3MBKNIBLV7W tag=LU5GU7XB83XN type=del size=3154324 2024-09-12T17:30:38.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.234+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=DZ6DRR1WFEI0 type=del size=2985877 2024-09-12T17:30:38.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.235+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=FPC2O2AEXTWR type=del 2024-09-12T17:30:38.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.238+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~TEOOUAKR9RVU.0 size=231162 2024-09-12T17:30:38.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.238+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=TEOOUAKR9RVU tag=6KTQUSP46ROK type=write size=1279738 2024-09-12T17:30:38.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.238+0000 7fece65ff780 1 < canceled part key=_multipart_KKU8T0CVS40V.2~HEZTB4CYI49T.0 size=1048576 2024-09-12T17:30:38.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.239+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~HEZTB4CYI49T.1 size=282729 2024-09-12T17:30:38.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.241+0000 7fece65ff780 1 < canceled multipart upload key=KKU8T0CVS40V upload=HEZTB4CYI49T tag=R8EVKDI7R190 type=write size=2379881 2024-09-12T17:30:38.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.243+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=0HKNU8L9T3JI type=del size=1547388 2024-09-12T17:30:38.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.244+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=151W14WIM4M6 type=del 2024-09-12T17:30:38.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.245+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=03GCW07HJU8W type=del size=2763098 2024-09-12T17:30:38.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.247+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=7C8O3AKVPLHQ type=del 2024-09-12T17:30:38.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.249+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~APTERZEYK3VM.0 size=594295 2024-09-12T17:30:38.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.249+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=APTERZEYK3VM tag=8RUXA2OKM51D type=write size=1642871 2024-09-12T17:30:38.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.251+0000 7fece65ff780 1 < suggested remove operation key=FX8VJO1YXJ4H tag=UQ19R01VIBK4 type=del 2024-09-12T17:30:38.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.253+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=ZQQJBUQ91FZE type=write size=914013 2024-09-12T17:30:38.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.254+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=C12WPVEENI9L type=del 2024-09-12T17:30:38.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.256+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~QKW487BGL9Q6.0 size=1048576 2024-09-12T17:30:38.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.257+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~QKW487BGL9Q6.1 size=1048576 2024-09-12T17:30:38.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.259+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~QKW487BGL9Q6.2 size=773930 2024-09-12T17:30:38.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.259+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=QKW487BGL9Q6 tag=Z84Q9SMCEF6M type=write size=3919658 2024-09-12T17:30:38.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.260+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=HHRXKO1JP0X6 type=del 2024-09-12T17:30:38.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.261+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=J467KQV24OUI type=write size=933410 2024-09-12T17:30:38.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.263+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~H4104Y22BOFN.0 size=1048576 2024-09-12T17:30:38.265 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.264+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~H4104Y22BOFN.1 size=910191 2024-09-12T17:30:38.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.266+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=H4104Y22BOFN tag=TW9CH3ZWBCWH type=write size=3007343 2024-09-12T17:30:38.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.267+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=DBQY1PLUDW0D type=del size=243595 2024-09-12T17:30:38.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.268+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~CKL8321Y41AU.0 size=1048576 2024-09-12T17:30:38.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.269+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~CKL8321Y41AU.1 size=1048576 2024-09-12T17:30:38.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.270+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~CKL8321Y41AU.2 size=644739 2024-09-12T17:30:38.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.272+0000 7fece65ff780 1 < completed multipart upload key=IMCE9Z7P4S6R upload=CKL8321Y41AU tag=XB7WPCR0Z38F type=write size=3790467 2024-09-12T17:30:38.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.274+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~YL2PDW0UGXGO.0 size=459571 2024-09-12T17:30:38.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.274+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=YL2PDW0UGXGO tag=VXKBU03BFH4T type=write size=1508147 2024-09-12T17:30:38.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.276+0000 7fece65ff780 1 < completed write operation key=I7TGK5A3JHH5 tag=0NTG7NG6C2SL type=write size=277482 2024-09-12T17:30:38.279 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.278+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~TZR0X02WGWDK.0 size=1043459 2024-09-12T17:30:38.279 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.278+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=TZR0X02WGWDK tag=FYQXAHHM9N0A type=write size=2092035 2024-09-12T17:30:38.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.279+0000 7fece65ff780 1 < completed delete operation key=5A7WPGW5P91B tag=A1RLOPQD6QZM type=del 2024-09-12T17:30:38.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.280+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=8E93XV6NIOFP type=del size=797859 2024-09-12T17:30:38.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.281+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~5B37B99UN1W3.0 size=105575 2024-09-12T17:30:38.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.283+0000 7fece65ff780 1 < completed multipart upload key=FX8VJO1YXJ4H upload=5B37B99UN1W3 tag=H4ANLB96WIU1 type=write size=1154151 2024-09-12T17:30:38.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.285+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~QDP33FE8UKJV.0 size=26739 2024-09-12T17:30:38.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.285+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=QDP33FE8UKJV tag=D37I39MGC502 type=write size=1075315 2024-09-12T17:30:38.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.286+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=TRJHUJ0LKXBK type=del 2024-09-12T17:30:38.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.288+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=AL9LU7ZZVFIC type=del size=2486348 2024-09-12T17:30:38.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.289+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=FJGPBOJB1XG5 type=del 2024-09-12T17:30:38.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.291+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~ISCSXGLBDWP8.0 size=655051 2024-09-12T17:30:38.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.291+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=ISCSXGLBDWP8 tag=SGDCO4U8A1T1 type=write size=1703627 2024-09-12T17:30:38.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.292+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~KCD5K16E0QSA.0 size=1048576 2024-09-12T17:30:38.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.294+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~KCD5K16E0QSA.1 size=1048576 2024-09-12T17:30:38.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.294+0000 7fece65ff780 1 < canceled part key=_multipart_6GUDX5I1AKNH.2~KCD5K16E0QSA.2 size=1005798 2024-09-12T17:30:38.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.296+0000 7fece65ff780 1 < canceled multipart upload key=6GUDX5I1AKNH upload=KCD5K16E0QSA tag=QB2NUTZ7UM5S type=write size=4151526 2024-09-12T17:30:38.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.298+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~SD0BP8JWQA6D.0 size=394125 2024-09-12T17:30:38.300 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.298+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=SD0BP8JWQA6D tag=ENRK1RMG0G8B type=write size=1442701 2024-09-12T17:30:38.302 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.300+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=DZ6DRR1WFEI0 type=del 2024-09-12T17:30:38.304 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.303+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~BXR4KFQK3296.0 size=405381 2024-09-12T17:30:38.304 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.303+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=BXR4KFQK3296 tag=UTP2TSZMNYZ2 type=write size=1453957 2024-09-12T17:30:38.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.304+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~TEOOUAKR9RVU.0 size=231162 2024-09-12T17:30:38.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.306+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=TEOOUAKR9RVU tag=6KTQUSP46ROK type=write size=1279738 2024-09-12T17:30:38.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.308+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~E6IY4KUZD5VH.0 size=1048576 2024-09-12T17:30:38.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.309+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~E6IY4KUZD5VH.1 size=1048576 2024-09-12T17:30:38.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.310+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~E6IY4KUZD5VH.2 size=748619 2024-09-12T17:30:38.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.310+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=E6IY4KUZD5VH tag=ENT9E4SY9FBA type=write size=3894347 2024-09-12T17:30:38.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.312+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=0HKNU8L9T3JI type=del 2024-09-12T17:30:38.314 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.313+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=N1R6HX035XF1 type=del size=329237 2024-09-12T17:30:38.316 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.314+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=03GCW07HJU8W type=del 2024-09-12T17:30:38.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.315+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=1QBZHXGP0Q07 type=del size=1192259 2024-09-12T17:30:38.318 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.317+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~APTERZEYK3VM.0 size=594295 2024-09-12T17:30:38.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.318+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=APTERZEYK3VM tag=8RUXA2OKM51D type=write size=1642871 2024-09-12T17:30:38.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.320+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=DJGMDMSLQG1C type=write size=142582 2024-09-12T17:30:38.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.322+0000 7fece65ff780 1 < suggested remove operation key=6CCPZ4TVIU5N tag=ZQQJBUQ91FZE type=write 2024-09-12T17:30:38.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.323+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=CACOHJHAJK7Z type=del size=2591859 2024-09-12T17:30:38.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.324+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~QKW487BGL9Q6.0 size=1048576 2024-09-12T17:30:38.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.325+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~QKW487BGL9Q6.1 size=1048576 2024-09-12T17:30:38.328 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.326+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~QKW487BGL9Q6.2 size=773930 2024-09-12T17:30:38.330 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.328+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=QKW487BGL9Q6 tag=Z84Q9SMCEF6M type=write size=3919658 2024-09-12T17:30:38.332 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.331+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~V0JYVVU6J7JQ.0 size=1048576 2024-09-12T17:30:38.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.331+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~V0JYVVU6J7JQ.1 size=1048576 2024-09-12T17:30:38.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.332+0000 7fece65ff780 1 > prepared part key=_multipart_IMCE9Z7P4S6R.2~V0JYVVU6J7JQ.2 size=829627 2024-09-12T17:30:38.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.332+0000 7fece65ff780 1 > prepared multipart upload key=IMCE9Z7P4S6R upload=V0JYVVU6J7JQ tag=K6MCBJ4X29WH type=write size=3975355 2024-09-12T17:30:38.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.334+0000 7fece65ff780 1 < completed write operation key=KKU8T0CVS40V tag=J467KQV24OUI type=write size=933410 2024-09-12T17:30:38.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.335+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=FOKMCZX678DC type=del size=900251 2024-09-12T17:30:38.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.336+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=DBQY1PLUDW0D type=del 2024-09-12T17:30:38.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.338+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=2YITBXPJSH0W type=del size=3735815 2024-09-12T17:30:38.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.339+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~YL2PDW0UGXGO.0 size=459571 2024-09-12T17:30:38.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.341+0000 7fece65ff780 1 < completed multipart upload key=4Z1N3433MC6A upload=YL2PDW0UGXGO tag=VXKBU03BFH4T type=write size=1508147 2024-09-12T17:30:38.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.342+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=03JT0WEGTIEK type=del size=1094782 2024-09-12T17:30:38.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.344+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~TZR0X02WGWDK.0 size=1043459 2024-09-12T17:30:38.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.346+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=TZR0X02WGWDK tag=FYQXAHHM9N0A type=write size=2092035 2024-09-12T17:30:38.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.348+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=HFG7KOGL01I3 type=del size=3748870 2024-09-12T17:30:38.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.349+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=8E93XV6NIOFP type=del 2024-09-12T17:30:38.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.352+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~745DPM9JR758.0 size=1048576 2024-09-12T17:30:38.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.353+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~745DPM9JR758.1 size=1048576 2024-09-12T17:30:38.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.354+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~745DPM9JR758.2 size=1013557 2024-09-12T17:30:38.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.354+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=745DPM9JR758 tag=KP3SEBWHJ27V type=write size=4159285 2024-09-12T17:30:38.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.355+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~QDP33FE8UKJV.0 size=26739 2024-09-12T17:30:38.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.357+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=QDP33FE8UKJV tag=D37I39MGC502 type=write size=1075315 2024-09-12T17:30:38.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.359+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=OS1PD260I66D type=del size=3072904 2024-09-12T17:30:38.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.360+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=AL9LU7ZZVFIC type=del 2024-09-12T17:30:38.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.362+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~KB9J1DACE77Y.0 size=1048576 2024-09-12T17:30:38.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.364+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~KB9J1DACE77Y.1 size=191975 2024-09-12T17:30:38.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.364+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=KB9J1DACE77Y tag=VAQEFRHTGDLO type=write size=2289127 2024-09-12T17:30:38.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.365+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~ISCSXGLBDWP8.0 size=655051 2024-09-12T17:30:38.368 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.367+0000 7fece65ff780 1 < completed multipart upload key=Q00ZFG0BBDG5 upload=ISCSXGLBDWP8 tag=SGDCO4U8A1T1 type=write size=1703627 2024-09-12T17:30:38.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.368+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=KEYUK65IRYRN type=del size=1511390 2024-09-12T17:30:38.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.370+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~SD0BP8JWQA6D.0 size=394125 2024-09-12T17:30:38.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.372+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=SD0BP8JWQA6D tag=ENRK1RMG0G8B type=write size=1442701 2024-09-12T17:30:38.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.373+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=GQ3FD4Z3BO9M type=write size=726051 2024-09-12T17:30:38.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.374+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~BXR4KFQK3296.0 size=405381 2024-09-12T17:30:38.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.376+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=BXR4KFQK3296 tag=UTP2TSZMNYZ2 type=write size=1453957 2024-09-12T17:30:38.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.377+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=DH3S5R0TXVLW type=write size=980491 2024-09-12T17:30:38.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.378+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~E6IY4KUZD5VH.0 size=1048576 2024-09-12T17:30:38.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.379+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~E6IY4KUZD5VH.1 size=1048576 2024-09-12T17:30:38.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.381+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~E6IY4KUZD5VH.2 size=748619 2024-09-12T17:30:38.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.383+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=E6IY4KUZD5VH tag=ENT9E4SY9FBA type=write size=3894347 2024-09-12T17:30:38.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.386+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~W4T249NA4SYR.0 size=1048576 2024-09-12T17:30:38.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.387+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~W4T249NA4SYR.1 size=1036657 2024-09-12T17:30:38.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.387+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=W4T249NA4SYR tag=4WBWLGKZEO9H type=write size=3133809 2024-09-12T17:30:38.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.388+0000 7fece65ff780 -1 < failed to complete operation key=6CCPZ4TVIU5N tag=N1R6HX035XF1 type=del size=329237: (22) Invalid argument 2024-09-12T17:30:38.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.390+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=YWB1NUT2PFUR type=del size=119049 2024-09-12T17:30:38.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.392+0000 7fece65ff780 1 < suggested update operation key=TLEZIJ4881G7 tag=1QBZHXGP0Q07 type=del size=1192259 2024-09-12T17:30:38.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.394+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=JW880YE5ZAYS type=del size=679029 2024-09-12T17:30:38.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.395+0000 7fece65ff780 1 < completed write operation key=OPMR1WMB14CA tag=DJGMDMSLQG1C type=write size=142582 2024-09-12T17:30:38.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.396+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=W5594UTLVATN type=del size=2074797 2024-09-12T17:30:38.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.398+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=CACOHJHAJK7Z type=del 2024-09-12T17:30:38.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.400+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~SJ385KQ0BG3O.0 size=1048576 2024-09-12T17:30:38.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.401+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~SJ385KQ0BG3O.1 size=335417 2024-09-12T17:30:38.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.401+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=SJ385KQ0BG3O tag=T314RUH816S9 type=write size=2432569 2024-09-12T17:30:38.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.402+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~V0JYVVU6J7JQ.0 size=1048576 2024-09-12T17:30:38.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.404+0000 7fece65ff780 1 < completed part key=_multipart_IMCE9Z7P4S6R.2~V0JYVVU6J7JQ.1 size=1048576 2024-09-12T17:30:38.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.404+0000 7fece65ff780 1 < canceled part key=_multipart_IMCE9Z7P4S6R.2~V0JYVVU6J7JQ.2 size=829627 2024-09-12T17:30:38.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.406+0000 7fece65ff780 1 < canceled multipart upload key=IMCE9Z7P4S6R upload=V0JYVVU6J7JQ tag=K6MCBJ4X29WH type=write size=3975355 2024-09-12T17:30:38.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.408+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~RY2L79DV3FF8.0 size=163077 2024-09-12T17:30:38.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.408+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=RY2L79DV3FF8 tag=VY2C3KTKO8K9 type=write size=1211653 2024-09-12T17:30:38.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.410+0000 7fece65ff780 1 < completed delete operation key=IMCE9Z7P4S6R tag=FOKMCZX678DC type=del 2024-09-12T17:30:38.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.411+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=RLJU9FP05LTV type=del size=980787 2024-09-12T17:30:38.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.412+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=2YITBXPJSH0W type=del 2024-09-12T17:30:38.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.413+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=H5VTAI1Q5YHI type=del size=676692 2024-09-12T17:30:38.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.416+0000 7fece65ff780 1 < suggested remove operation key=LSGN631FW1P8 tag=03JT0WEGTIEK type=del 2024-09-12T17:30:38.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.418+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~VUT5O1IAHHDA.0 size=1048576 2024-09-12T17:30:38.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.420+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~VUT5O1IAHHDA.1 size=978744 2024-09-12T17:30:38.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.420+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=VUT5O1IAHHDA tag=V4ILVW1B3DAC type=write size=3075896 2024-09-12T17:30:38.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.421+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=HFG7KOGL01I3 type=del 2024-09-12T17:30:38.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.423+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~DS1D3I9HZ8F6.0 size=1048576 2024-09-12T17:30:38.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.424+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~DS1D3I9HZ8F6.1 size=724885 2024-09-12T17:30:38.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.424+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=DS1D3I9HZ8F6 tag=5T7FVTYB66W4 type=write size=2822037 2024-09-12T17:30:38.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.426+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~745DPM9JR758.0 size=1048576 2024-09-12T17:30:38.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.427+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~745DPM9JR758.1 size=1048576 2024-09-12T17:30:38.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.428+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~745DPM9JR758.2 size=1013557 2024-09-12T17:30:38.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.430+0000 7fece65ff780 1 < completed multipart upload key=FX8VJO1YXJ4H upload=745DPM9JR758 tag=KP3SEBWHJ27V type=write size=4159285 2024-09-12T17:30:38.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.431+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=5ITCQB1M56PB type=write size=737081 2024-09-12T17:30:38.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.433+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=OS1PD260I66D type=del 2024-09-12T17:30:38.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.435+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~NXSXGYK7XL8S.0 size=980430 2024-09-12T17:30:38.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.435+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=NXSXGYK7XL8S tag=VEXVZEA0Q80H type=write size=2029006 2024-09-12T17:30:38.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.437+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~KB9J1DACE77Y.0 size=1048576 2024-09-12T17:30:38.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.437+0000 7fece65ff780 1 < canceled part key=_multipart_6CCPZ4TVIU5N.2~KB9J1DACE77Y.1 size=191975 2024-09-12T17:30:38.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.439+0000 7fece65ff780 1 < canceled multipart upload key=6CCPZ4TVIU5N upload=KB9J1DACE77Y tag=VAQEFRHTGDLO type=write size=2289127 2024-09-12T17:30:38.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.440+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=DBHS1WCFXZ7F type=del size=3200743 2024-09-12T17:30:38.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.441+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=KEYUK65IRYRN type=del 2024-09-12T17:30:38.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.444+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~C0O8UCR90FNT.0 size=1048576 2024-09-12T17:30:38.446 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.445+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~C0O8UCR90FNT.1 size=1048576 2024-09-12T17:30:38.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.446+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~C0O8UCR90FNT.2 size=785101 2024-09-12T17:30:38.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.446+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=C0O8UCR90FNT tag=8U5DU2JI15FX type=write size=3930829 2024-09-12T17:30:38.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.447+0000 7fece65ff780 1 < completed write operation key=9IGJG88NX1FS tag=GQ3FD4Z3BO9M type=write size=726051 2024-09-12T17:30:38.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.448+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=A80OTJRFVID4 type=write size=138701 2024-09-12T17:30:38.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.449+0000 7fece65ff780 1 < completed write operation key=W3MBKNIBLV7W tag=DH3S5R0TXVLW type=write size=980491 2024-09-12T17:30:38.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.452+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~UGR8JTTZ2TDR.0 size=1048576 2024-09-12T17:30:38.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.453+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~UGR8JTTZ2TDR.1 size=12960 2024-09-12T17:30:38.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.453+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=UGR8JTTZ2TDR tag=FYLRC2LG8GP9 type=write size=2110112 2024-09-12T17:30:38.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.454+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~W4T249NA4SYR.0 size=1048576 2024-09-12T17:30:38.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.455+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~W4T249NA4SYR.1 size=1036657 2024-09-12T17:30:38.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.457+0000 7fece65ff780 1 < completed multipart upload key=W3MBKNIBLV7W upload=W4T249NA4SYR tag=4WBWLGKZEO9H type=write size=3133809 2024-09-12T17:30:38.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.458+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=2WFC7M752M22 type=del size=570929 2024-09-12T17:30:38.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.460+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=YWB1NUT2PFUR type=del 2024-09-12T17:30:38.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.461+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=545PJCF7043M type=del size=3600932 2024-09-12T17:30:38.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.463+0000 7fece65ff780 1 < suggested update operation key=W3MBKNIBLV7W tag=JW880YE5ZAYS type=del size=679029 2024-09-12T17:30:38.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.467+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~O6YAIB6LIXET.0 size=1048576 2024-09-12T17:30:38.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.468+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~O6YAIB6LIXET.1 size=1048576 2024-09-12T17:30:38.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.469+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~O6YAIB6LIXET.2 size=101784 2024-09-12T17:30:38.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.469+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=O6YAIB6LIXET tag=KYMWM2V1WQN3 type=write size=3247512 2024-09-12T17:30:38.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.470+0000 7fece65ff780 1 < completed delete operation key=OIHDAJMPUK4I tag=W5594UTLVATN type=del 2024-09-12T17:30:38.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.471+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=C4K0H5YOI2EB type=del size=1809549 2024-09-12T17:30:38.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.472+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~SJ385KQ0BG3O.0 size=1048576 2024-09-12T17:30:38.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.472+0000 7fece65ff780 1 < canceled part key=_multipart_KKU8T0CVS40V.2~SJ385KQ0BG3O.1 size=335417 2024-09-12T17:30:38.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.474+0000 7fece65ff780 1 < canceled multipart upload key=KKU8T0CVS40V upload=SJ385KQ0BG3O tag=T314RUH816S9 type=write size=2432569 2024-09-12T17:30:38.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.475+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=VUM3PF0ZN1RJ type=del size=847942 2024-09-12T17:30:38.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.477+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~RY2L79DV3FF8.0 size=163077 2024-09-12T17:30:38.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.478+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=RY2L79DV3FF8 tag=VY2C3KTKO8K9 type=write size=1211653 2024-09-12T17:30:38.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.480+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=GSS76GT4IYRQ type=del size=3273755 2024-09-12T17:30:38.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.481+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=RLJU9FP05LTV type=del 2024-09-12T17:30:38.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.482+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=HBULJGU3WCK3 type=del size=665388 2024-09-12T17:30:38.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.483+0000 7fece65ff780 1 < canceled operation key=UCBB99EG8XK2 tag=H5VTAI1Q5YHI type=del size=676692 2024-09-12T17:30:38.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.484+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=V58SEOT8E5J8 type=del size=591529 2024-09-12T17:30:38.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.486+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~VUT5O1IAHHDA.0 size=1048576 2024-09-12T17:30:38.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.487+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~VUT5O1IAHHDA.1 size=978744 2024-09-12T17:30:38.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.489+0000 7fece65ff780 1 < completed multipart upload key=5A7WPGW5P91B upload=VUT5O1IAHHDA tag=V4ILVW1B3DAC type=write size=3075896 2024-09-12T17:30:38.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.490+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=TE6F3CCYRSOB type=del size=3787857 2024-09-12T17:30:38.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.491+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~DS1D3I9HZ8F6.0 size=1048576 2024-09-12T17:30:38.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.492+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~DS1D3I9HZ8F6.1 size=724885 2024-09-12T17:30:38.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.494+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=DS1D3I9HZ8F6 tag=5T7FVTYB66W4 type=write size=2822037 2024-09-12T17:30:38.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.497+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~JPGHWRWHCJ0N.0 size=1048576 2024-09-12T17:30:38.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.498+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~JPGHWRWHCJ0N.1 size=1048576 2024-09-12T17:30:38.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.499+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~JPGHWRWHCJ0N.2 size=19407 2024-09-12T17:30:38.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.499+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=JPGHWRWHCJ0N tag=JZMZSH9RQBEN type=write size=3165135 2024-09-12T17:30:38.503 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.501+0000 7fece65ff780 1 < suggested remove operation key=UN6FLMRMAPUS tag=5ITCQB1M56PB type=write 2024-09-12T17:30:38.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.503+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~IQNINH0L37C0.0 size=812559 2024-09-12T17:30:38.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.503+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=IQNINH0L37C0 tag=3B8R6HU1KHH0 type=write size=1861135 2024-09-12T17:30:38.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.505+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~NXSXGYK7XL8S.0 size=980430 2024-09-12T17:30:38.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.507+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=NXSXGYK7XL8S tag=VEXVZEA0Q80H type=write size=2029006 2024-09-12T17:30:38.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.508+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=3346JVVFI677 type=del size=1410746 2024-09-12T17:30:38.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.509+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=DBHS1WCFXZ7F type=del 2024-09-12T17:30:38.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.510+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=6AGRMCWJRXIC type=del size=2700740 2024-09-12T17:30:38.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.511+0000 7fece65ff780 1 < canceled part key=_multipart_I7TGK5A3JHH5.2~C0O8UCR90FNT.0 size=1048576 2024-09-12T17:30:38.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.512+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~C0O8UCR90FNT.1 size=1048576 2024-09-12T17:30:38.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.513+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~C0O8UCR90FNT.2 size=785101 2024-09-12T17:30:38.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.515+0000 7fece65ff780 1 < canceled multipart upload key=I7TGK5A3JHH5 upload=C0O8UCR90FNT tag=8U5DU2JI15FX type=write size=3930829 2024-09-12T17:30:38.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.517+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~WJKRVDNX2K21.0 size=1005220 2024-09-12T17:30:38.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.517+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=WJKRVDNX2K21 tag=C0PMJNDIOXRT type=write size=2053796 2024-09-12T17:30:38.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.518+0000 7fece65ff780 1 < completed write operation key=5A7WPGW5P91B tag=A80OTJRFVID4 type=write size=138701 2024-09-12T17:30:38.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.519+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=U52ACUYT1IKI type=del size=3770698 2024-09-12T17:30:38.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.520+0000 7fece65ff780 1 < canceled part key=_multipart_9IGJG88NX1FS.2~UGR8JTTZ2TDR.0 size=1048576 2024-09-12T17:30:38.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.521+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~UGR8JTTZ2TDR.1 size=12960 2024-09-12T17:30:38.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.523+0000 7fece65ff780 1 < canceled multipart upload key=9IGJG88NX1FS upload=UGR8JTTZ2TDR tag=FYLRC2LG8GP9 type=write size=2110112 2024-09-12T17:30:38.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.524+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=5W3C2Y70OZV6 type=del size=1907865 2024-09-12T17:30:38.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.525+0000 7fece65ff780 1 < canceled operation key=I7TGK5A3JHH5 tag=2WFC7M752M22 type=del size=570929 2024-09-12T17:30:38.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.526+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=EKQQ487UT94P type=del size=1747087 2024-09-12T17:30:38.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.527+0000 7fece65ff780 1 < canceled operation key=KKU8T0CVS40V tag=545PJCF7043M type=del size=3600932 2024-09-12T17:30:38.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.530+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~U6KXWYFPOY4T.0 size=172910 2024-09-12T17:30:38.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.530+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=U6KXWYFPOY4T tag=FH14GEXX2VWT type=write size=1221486 2024-09-12T17:30:38.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.530+0000 7fece65ff780 1 < canceled part key=_multipart_ZEFSNR1IIA10.2~O6YAIB6LIXET.0 size=1048576 2024-09-12T17:30:38.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.531+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~O6YAIB6LIXET.1 size=1048576 2024-09-12T17:30:38.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.531+0000 7fece65ff780 1 < canceled part key=_multipart_ZEFSNR1IIA10.2~O6YAIB6LIXET.2 size=101784 2024-09-12T17:30:38.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.533+0000 7fece65ff780 1 < canceled multipart upload key=ZEFSNR1IIA10 upload=O6YAIB6LIXET tag=KYMWM2V1WQN3 type=write size=3247512 2024-09-12T17:30:38.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.535+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~17OCK8EA7UOT.0 size=1048576 2024-09-12T17:30:38.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.536+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~17OCK8EA7UOT.1 size=542714 2024-09-12T17:30:38.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.536+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=17OCK8EA7UOT tag=6GUUYQENDHHU type=write size=2639866 2024-09-12T17:30:38.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.538+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=C4K0H5YOI2EB type=del 2024-09-12T17:30:38.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.539+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=ZAD3QP7S9ZYU type=del size=3470130 2024-09-12T17:30:38.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.540+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=VUM3PF0ZN1RJ type=del 2024-09-12T17:30:38.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.541+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=YS67LS83AAN3 type=write size=697660 2024-09-12T17:30:38.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.544+0000 7fece65ff780 1 < suggested update operation key=7AS5L998SDV7 tag=GSS76GT4IYRQ type=del size=3273755 2024-09-12T17:30:38.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.547+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~SZ44WHQ5F5UV.0 size=1048576 2024-09-12T17:30:38.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.548+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~SZ44WHQ5F5UV.1 size=1048576 2024-09-12T17:30:38.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.549+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~SZ44WHQ5F5UV.2 size=200184 2024-09-12T17:30:38.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.549+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=SZ44WHQ5F5UV tag=KNFAVX5QXDV3 type=write size=3345912 2024-09-12T17:30:38.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.551+0000 7fece65ff780 1 < suggested remove operation key=IMCE9Z7P4S6R tag=HBULJGU3WCK3 type=del 2024-09-12T17:30:38.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.553+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=O4GZ7J5EWS1M type=write size=75465 2024-09-12T17:30:38.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.554+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=V58SEOT8E5J8 type=del 2024-09-12T17:30:38.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.555+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=W8Z673FIE6X7 type=write size=620590 2024-09-12T17:30:38.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.556+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=TE6F3CCYRSOB type=del 2024-09-12T17:30:38.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.557+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=T5OCY20T1QS7 type=write size=654888 2024-09-12T17:30:38.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.558+0000 7fece65ff780 1 < canceled part key=_multipart_CBYI6C1ICE08.2~JPGHWRWHCJ0N.0 size=1048576 2024-09-12T17:30:38.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.559+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~JPGHWRWHCJ0N.1 size=1048576 2024-09-12T17:30:38.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.560+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~JPGHWRWHCJ0N.2 size=19407 2024-09-12T17:30:38.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.562+0000 7fece65ff780 1 < canceled multipart upload key=CBYI6C1ICE08 upload=JPGHWRWHCJ0N tag=JZMZSH9RQBEN type=write size=3165135 2024-09-12T17:30:38.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.563+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=AU14C31HGH3F type=del size=4032330 2024-09-12T17:30:38.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.564+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~IQNINH0L37C0.0 size=812559 2024-09-12T17:30:38.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.567+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=IQNINH0L37C0 tag=3B8R6HU1KHH0 type=write size=1861135 2024-09-12T17:30:38.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.569+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~YA8357LW1XST.0 size=1048576 2024-09-12T17:30:38.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.570+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~YA8357LW1XST.1 size=993113 2024-09-12T17:30:38.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.570+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=YA8357LW1XST tag=YCLKTIQSL703 type=write size=3090265 2024-09-12T17:30:38.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.571+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=3346JVVFI677 type=del 2024-09-12T17:30:38.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.572+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=IS7SWDRUZ4LI type=del size=2600382 2024-09-12T17:30:38.575 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.574+0000 7fece65ff780 1 < completed delete operation key=Q00ZFG0BBDG5 tag=6AGRMCWJRXIC type=del 2024-09-12T17:30:38.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.576+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~M968D3UWUZ7L.0 size=1019884 2024-09-12T17:30:38.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.576+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=M968D3UWUZ7L tag=OVAPPHKLNXJO type=write size=2068460 2024-09-12T17:30:38.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.577+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~WJKRVDNX2K21.0 size=1005220 2024-09-12T17:30:38.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.579+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=WJKRVDNX2K21 tag=C0PMJNDIOXRT type=write size=2053796 2024-09-12T17:30:38.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.583+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~OYDKW9371JJV.0 size=24699 2024-09-12T17:30:38.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.583+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=OYDKW9371JJV tag=EQZ2BH2VN63L type=write size=1073275 2024-09-12T17:30:38.586 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.585+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=U52ACUYT1IKI type=del 2024-09-12T17:30:38.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.587+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~GXC84QXM7LWT.0 size=1048576 2024-09-12T17:30:38.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.588+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~GXC84QXM7LWT.1 size=538205 2024-09-12T17:30:38.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.588+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=GXC84QXM7LWT tag=BKHY9DJEKE1A type=write size=2635357 2024-09-12T17:30:38.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.590+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=5W3C2Y70OZV6 type=del 2024-09-12T17:30:38.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.591+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=Z1CKN8379SV0 type=del size=238546 2024-09-12T17:30:38.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.592+0000 7fece65ff780 1 < canceled operation key=UN6FLMRMAPUS tag=EKQQ487UT94P type=del size=1747087 2024-09-12T17:30:38.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.593+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=PN77M2W0JCSQ type=del size=4084312 2024-09-12T17:30:38.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.595+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~U6KXWYFPOY4T.0 size=172910 2024-09-12T17:30:38.598 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.597+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=U6KXWYFPOY4T tag=FH14GEXX2VWT type=write size=1221486 2024-09-12T17:30:38.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.605+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~XY3UPJZP77BY.0 size=1048576 2024-09-12T17:30:38.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.606+0000 7fece65ff780 1 > prepared part key=_multipart_LSGN631FW1P8.2~XY3UPJZP77BY.1 size=143996 2024-09-12T17:30:38.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.606+0000 7fece65ff780 1 > prepared multipart upload key=LSGN631FW1P8 upload=XY3UPJZP77BY tag=X4FC1Y5XGJD1 type=write size=2241148 2024-09-12T17:30:38.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.607+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~17OCK8EA7UOT.0 size=1048576 2024-09-12T17:30:38.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.608+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~17OCK8EA7UOT.1 size=542714 2024-09-12T17:30:38.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.610+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=17OCK8EA7UOT tag=6GUUYQENDHHU type=write size=2639866 2024-09-12T17:30:38.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.611+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=4AWZSJ5MMJDA type=del size=2130319 2024-09-12T17:30:38.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.613+0000 7fece65ff780 1 < completed delete operation key=W3MBKNIBLV7W tag=ZAD3QP7S9ZYU type=del 2024-09-12T17:30:38.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.614+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=FSJKLCWGIM8V type=del size=1993849 2024-09-12T17:30:38.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.615+0000 7fece65ff780 -1 < failed to complete operation key=IMCE9Z7P4S6R tag=YS67LS83AAN3 type=write size=697660: (22) Invalid argument 2024-09-12T17:30:38.619 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.617+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~FNED1IP79X8S.0 size=1048576 2024-09-12T17:30:38.621 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.618+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~FNED1IP79X8S.1 size=1048576 2024-09-12T17:30:38.621 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.619+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~FNED1IP79X8S.2 size=809621 2024-09-12T17:30:38.621 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.619+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=FNED1IP79X8S tag=9MDT65RSIXE2 type=write size=3955349 2024-09-12T17:30:38.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.621+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~SZ44WHQ5F5UV.0 size=1048576 2024-09-12T17:30:38.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.622+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~SZ44WHQ5F5UV.1 size=1048576 2024-09-12T17:30:38.624 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.623+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~SZ44WHQ5F5UV.2 size=200184 2024-09-12T17:30:38.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.625+0000 7fece65ff780 1 < completed multipart upload key=W3MBKNIBLV7W upload=SZ44WHQ5F5UV tag=KNFAVX5QXDV3 type=write size=3345912 2024-09-12T17:30:38.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.626+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=TN5V8X2JRI10 type=del size=713166 2024-09-12T17:30:38.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.629+0000 7fece65ff780 1 < suggested update operation key=QQNW20B28RJC tag=O4GZ7J5EWS1M type=write size=75465 2024-09-12T17:30:38.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.630+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=0YXMXWDCCTZ2 type=del size=2291083 2024-09-12T17:30:38.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.631+0000 7fece65ff780 1 < completed write operation key=2HTNXL56URAK tag=W8Z673FIE6X7 type=write size=620590 2024-09-12T17:30:38.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.633+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~438TT7DP41V8.0 size=627900 2024-09-12T17:30:38.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.633+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=438TT7DP41V8 tag=HJ4N5X245455 type=write size=1676476 2024-09-12T17:30:38.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.635+0000 7fece65ff780 1 < completed write operation key=OPMR1WMB14CA tag=T5OCY20T1QS7 type=write size=654888 2024-09-12T17:30:38.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.637+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~4E2PBRQRG4TH.0 size=1048576 2024-09-12T17:30:38.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.638+0000 7fece65ff780 1 > prepared part key=_multipart_9KYNMM6W7RRM.2~4E2PBRQRG4TH.1 size=44338 2024-09-12T17:30:38.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.638+0000 7fece65ff780 1 > prepared multipart upload key=9KYNMM6W7RRM upload=4E2PBRQRG4TH tag=H9F8UP72HYEY type=write size=2141490 2024-09-12T17:30:38.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.639+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=AU14C31HGH3F type=del 2024-09-12T17:30:38.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.641+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=H6OZKX4EF4A6 type=del size=3220515 2024-09-12T17:30:38.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.642+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~YA8357LW1XST.0 size=1048576 2024-09-12T17:30:38.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.643+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~YA8357LW1XST.1 size=993113 2024-09-12T17:30:38.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.645+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=YA8357LW1XST tag=YCLKTIQSL703 type=write size=3090265 2024-09-12T17:30:38.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.646+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=QBBFBIDN9BIU type=del size=2629138 2024-09-12T17:30:38.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.648+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=IS7SWDRUZ4LI type=del 2024-09-12T17:30:38.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.649+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=AXB0Y2JA122T type=del size=3027031 2024-09-12T17:30:38.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.651+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~M968D3UWUZ7L.0 size=1019884 2024-09-12T17:30:38.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.653+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=M968D3UWUZ7L tag=OVAPPHKLNXJO type=write size=2068460 2024-09-12T17:30:38.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.654+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=TKJUWEVAM4LG type=del size=1827567 2024-09-12T17:30:38.657 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.656+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~OYDKW9371JJV.0 size=24699 2024-09-12T17:30:38.659 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.658+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=OYDKW9371JJV tag=EQZ2BH2VN63L type=write size=1073275 2024-09-12T17:30:38.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.659+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=RJF1T11KACCX type=del size=1536872 2024-09-12T17:30:38.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.660+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~GXC84QXM7LWT.0 size=1048576 2024-09-12T17:30:38.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.661+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~GXC84QXM7LWT.1 size=538205 2024-09-12T17:30:38.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.663+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=GXC84QXM7LWT tag=BKHY9DJEKE1A type=write size=2635357 2024-09-12T17:30:38.667 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.665+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~8W3N2KQJFSEP.0 size=987220 2024-09-12T17:30:38.667 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.665+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=8W3N2KQJFSEP tag=JQ0Y4791DI4W type=write size=2035796 2024-09-12T17:30:38.668 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.667+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=Z1CKN8379SV0 type=del 2024-09-12T17:30:38.669 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.668+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=J1Q0I3X1VHYT type=write size=659035 2024-09-12T17:30:38.671 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.669+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=PN77M2W0JCSQ type=del 2024-09-12T17:30:38.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.670+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=S1SFU2N5APCN type=del size=1732989 2024-09-12T17:30:38.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.672+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~XY3UPJZP77BY.0 size=1048576 2024-09-12T17:30:38.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.673+0000 7fece65ff780 1 < completed part key=_multipart_LSGN631FW1P8.2~XY3UPJZP77BY.1 size=143996 2024-09-12T17:30:38.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.675+0000 7fece65ff780 1 < completed multipart upload key=LSGN631FW1P8 upload=XY3UPJZP77BY tag=X4FC1Y5XGJD1 type=write size=2241148 2024-09-12T17:30:38.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.677+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~TYMBQWVH4GU1.0 size=1048576 2024-09-12T17:30:38.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.678+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~TYMBQWVH4GU1.1 size=1048576 2024-09-12T17:30:38.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.679+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~TYMBQWVH4GU1.2 size=138492 2024-09-12T17:30:38.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.679+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=TYMBQWVH4GU1 tag=5XLOFVYQAWIE type=write size=3284220 2024-09-12T17:30:38.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.681+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=4AWZSJ5MMJDA type=del 2024-09-12T17:30:38.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.683+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~XNDYD9RIZTIV.0 size=1048576 2024-09-12T17:30:38.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.684+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~XNDYD9RIZTIV.1 size=755940 2024-09-12T17:30:38.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.684+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=XNDYD9RIZTIV tag=26N573MYXZN5 type=write size=2853092 2024-09-12T17:30:38.688 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.686+0000 7fece65ff780 1 < suggested remove operation key=CBYI6C1ICE08 tag=FSJKLCWGIM8V type=del 2024-09-12T17:30:38.690 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.689+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~HD7AJ2BZVFS6.0 size=843388 2024-09-12T17:30:38.690 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.689+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=HD7AJ2BZVFS6 tag=TDR888N46A69 type=write size=1891964 2024-09-12T17:30:38.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.690+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~FNED1IP79X8S.0 size=1048576 2024-09-12T17:30:38.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.691+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~FNED1IP79X8S.1 size=1048576 2024-09-12T17:30:38.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.692+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~FNED1IP79X8S.2 size=809621 2024-09-12T17:30:38.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.694+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=FNED1IP79X8S tag=9MDT65RSIXE2 type=write size=3955349 2024-09-12T17:30:38.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.695+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=30AY4UZPYFGS type=del size=2520823 2024-09-12T17:30:38.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.696+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=TN5V8X2JRI10 type=del 2024-09-12T17:30:38.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.698+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~XHDZA76PUF5S.0 size=521411 2024-09-12T17:30:38.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.698+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=XHDZA76PUF5S tag=EJTW06O0OMWQ type=write size=1569987 2024-09-12T17:30:38.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.699+0000 7fece65ff780 1 < completed delete operation key=4Z1N3433MC6A tag=0YXMXWDCCTZ2 type=del 2024-09-12T17:30:38.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.701+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=KNMW1O955JE9 type=del size=1443105 2024-09-12T17:30:38.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.702+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~438TT7DP41V8.0 size=627900 2024-09-12T17:30:38.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.705+0000 7fece65ff780 1 < completed multipart upload key=I31CKY20NO9S upload=438TT7DP41V8 tag=HJ4N5X245455 type=write size=1676476 2024-09-12T17:30:38.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.706+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=0LXTXI0DI3T1 type=del size=4061991 2024-09-12T17:30:38.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.706+0000 7fece65ff780 1 < canceled part key=_multipart_9KYNMM6W7RRM.2~4E2PBRQRG4TH.0 size=1048576 2024-09-12T17:30:38.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.707+0000 7fece65ff780 1 < completed part key=_multipart_9KYNMM6W7RRM.2~4E2PBRQRG4TH.1 size=44338 2024-09-12T17:30:38.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.709+0000 7fece65ff780 1 < canceled multipart upload key=9KYNMM6W7RRM upload=4E2PBRQRG4TH tag=H9F8UP72HYEY type=write size=2141490 2024-09-12T17:30:38.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.710+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=OPDO1TZ3X37V type=write size=21538 2024-09-12T17:30:38.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.713+0000 7fece65ff780 1 < suggested update operation key=UCBB99EG8XK2 tag=H6OZKX4EF4A6 type=del size=3220515 2024-09-12T17:30:38.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.714+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=D09MLE609JDT type=del size=2517783 2024-09-12T17:30:38.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.715+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=QBBFBIDN9BIU type=del 2024-09-12T17:30:38.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.717+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~7PBXOHMBCFAB.0 size=727615 2024-09-12T17:30:38.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.717+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=7PBXOHMBCFAB tag=UWQ8DHAOTWY3 type=write size=1776191 2024-09-12T17:30:38.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.718+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=AXB0Y2JA122T type=del 2024-09-12T17:30:38.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.719+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=IWBEF6OCKOG7 type=del size=1301631 2024-09-12T17:30:38.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.721+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=TKJUWEVAM4LG type=del 2024-09-12T17:30:38.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.722+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=NO92JDD3ZL5A type=write size=1048083 2024-09-12T17:30:38.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.723+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=RJF1T11KACCX type=del 2024-09-12T17:30:38.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.725+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~3K4G14CDEM8G.0 size=989814 2024-09-12T17:30:38.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.725+0000 7fece65ff780 1 > prepared multipart upload key=Y30269Q7R340 upload=3K4G14CDEM8G tag=NF2I7IEJ674W type=write size=2038390 2024-09-12T17:30:38.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.725+0000 7fece65ff780 1 < canceled part key=_multipart_OPMR1WMB14CA.2~8W3N2KQJFSEP.0 size=987220 2024-09-12T17:30:38.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.727+0000 7fece65ff780 1 < canceled multipart upload key=OPMR1WMB14CA upload=8W3N2KQJFSEP tag=JQ0Y4791DI4W type=write size=2035796 2024-09-12T17:30:38.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.728+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=DJ64HZKJHE3B type=del size=4127909 2024-09-12T17:30:38.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.730+0000 7fece65ff780 1 < completed write operation key=4Z1N3433MC6A tag=J1Q0I3X1VHYT type=write size=659035 2024-09-12T17:30:38.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.731+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=CGRY8XX08YOR type=del size=979621 2024-09-12T17:30:38.733 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.732+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=S1SFU2N5APCN type=del 2024-09-12T17:30:38.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.734+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~2P7AE27M8F80.0 size=241224 2024-09-12T17:30:38.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.734+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=2P7AE27M8F80 tag=BNAIMSHBBTIH type=write size=1289800 2024-09-12T17:30:38.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.735+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~TYMBQWVH4GU1.0 size=1048576 2024-09-12T17:30:38.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.736+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~TYMBQWVH4GU1.1 size=1048576 2024-09-12T17:30:38.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.736+0000 7fece65ff780 1 < canceled part key=_multipart_YCNQL8CUUGW7.2~TYMBQWVH4GU1.2 size=138492 2024-09-12T17:30:38.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.739+0000 7fece65ff780 1 < canceled multipart upload key=YCNQL8CUUGW7 upload=TYMBQWVH4GU1 tag=5XLOFVYQAWIE type=write size=3284220 2024-09-12T17:30:38.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.740+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=8YV59YIY4AVW type=write size=272026 2024-09-12T17:30:38.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.741+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~XNDYD9RIZTIV.0 size=1048576 2024-09-12T17:30:38.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.741+0000 7fece65ff780 1 < canceled part key=_multipart_TLEZIJ4881G7.2~XNDYD9RIZTIV.1 size=755940 2024-09-12T17:30:38.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.743+0000 7fece65ff780 1 < canceled multipart upload key=TLEZIJ4881G7 upload=XNDYD9RIZTIV tag=26N573MYXZN5 type=write size=2853092 2024-09-12T17:30:38.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.745+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~TRZNKPJ69A9K.0 size=1048576 2024-09-12T17:30:38.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.746+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~TRZNKPJ69A9K.1 size=1048576 2024-09-12T17:30:38.748 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.747+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~TRZNKPJ69A9K.2 size=246989 2024-09-12T17:30:38.748 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.747+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=TRZNKPJ69A9K tag=EUVMBS0V94AI type=write size=3392717 2024-09-12T17:30:38.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.748+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~HD7AJ2BZVFS6.0 size=843388 2024-09-12T17:30:38.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.750+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=HD7AJ2BZVFS6 tag=TDR888N46A69 type=write size=1891964 2024-09-12T17:30:38.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.752+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~EB1PKTSZJ24S.0 size=1048576 2024-09-12T17:30:38.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.753+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~EB1PKTSZJ24S.1 size=1048576 2024-09-12T17:30:38.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.754+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~EB1PKTSZJ24S.2 size=648215 2024-09-12T17:30:38.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.754+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=EB1PKTSZJ24S tag=W7I50EY0QBTQ type=write size=3793943 2024-09-12T17:30:38.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.755+0000 7fece65ff780 1 < canceled operation key=FX8VJO1YXJ4H tag=30AY4UZPYFGS type=del size=2520823 2024-09-12T17:30:38.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.756+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=K4V9FG5GQ3W4 type=write size=162746 2024-09-12T17:30:38.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.757+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~XHDZA76PUF5S.0 size=521411 2024-09-12T17:30:38.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.759+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=XHDZA76PUF5S tag=EJTW06O0OMWQ type=write size=1569987 2024-09-12T17:30:38.762 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.760+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=VG1I1NIOK6FU type=del size=2698729 2024-09-12T17:30:38.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.762+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=KNMW1O955JE9 type=del 2024-09-12T17:30:38.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.763+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=L9R65X35B45K type=del size=260927 2024-09-12T17:30:38.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.764+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=0LXTXI0DI3T1 type=del 2024-09-12T17:30:38.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.765+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=XGK5ONJ7NA8M type=del size=3868145 2024-09-12T17:30:38.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.766+0000 7fece65ff780 1 < completed write operation key=I31CKY20NO9S tag=OPDO1TZ3X37V type=write size=21538 2024-09-12T17:30:38.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.768+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=VMKEEITQ6SB1 type=write size=231933 2024-09-12T17:30:38.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.769+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=D09MLE609JDT type=del 2024-09-12T17:30:38.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.770+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=9T5152N7RXX3 type=write size=390570 2024-09-12T17:30:38.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.771+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~7PBXOHMBCFAB.0 size=727615 2024-09-12T17:30:38.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.773+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=7PBXOHMBCFAB tag=UWQ8DHAOTWY3 type=write size=1776191 2024-09-12T17:30:38.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.775+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~78QUQ6I9Y7IM.0 size=1048576 2024-09-12T17:30:38.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.776+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~78QUQ6I9Y7IM.1 size=944255 2024-09-12T17:30:38.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.776+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=78QUQ6I9Y7IM tag=LRPS2L5SWXAK type=write size=3041407 2024-09-12T17:30:38.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.778+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=IWBEF6OCKOG7 type=del 2024-09-12T17:30:38.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.779+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=V50K9SXFP2S7 type=del size=3520575 2024-09-12T17:30:38.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.780+0000 7fece65ff780 1 < completed write operation key=RKFRKIENSBTO tag=NO92JDD3ZL5A type=write size=1048083 2024-09-12T17:30:38.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.782+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~R86D3EHVJSFZ.0 size=1048576 2024-09-12T17:30:38.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.783+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~R86D3EHVJSFZ.1 size=442005 2024-09-12T17:30:38.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.783+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=R86D3EHVJSFZ tag=UBJBCBQF4MJB type=write size=2539157 2024-09-12T17:30:38.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.785+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~3K4G14CDEM8G.0 size=989814 2024-09-12T17:30:38.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.787+0000 7fece65ff780 1 < completed multipart upload key=Y30269Q7R340 upload=3K4G14CDEM8G tag=NF2I7IEJ674W type=write size=2038390 2024-09-12T17:30:38.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.788+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=8PDKQN5616X8 type=del size=3157859 2024-09-12T17:30:38.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.790+0000 7fece65ff780 1 < suggested update operation key=6CCPZ4TVIU5N tag=DJ64HZKJHE3B type=del size=4127909 2024-09-12T17:30:38.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.792+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~HKU97DB19PSS.0 size=645170 2024-09-12T17:30:38.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.792+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=HKU97DB19PSS tag=317O1QEJXEHA type=write size=1693746 2024-09-12T17:30:38.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.794+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=CGRY8XX08YOR type=del 2024-09-12T17:30:38.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.795+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=LC5FW1ADLHWQ type=del size=1287720 2024-09-12T17:30:38.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.796+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~2P7AE27M8F80.0 size=241224 2024-09-12T17:30:38.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.798+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=2P7AE27M8F80 tag=BNAIMSHBBTIH type=write size=1289800 2024-09-12T17:30:38.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.801+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~BZPNTEKQUJ63.0 size=1048576 2024-09-12T17:30:38.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.802+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~BZPNTEKQUJ63.1 size=609377 2024-09-12T17:30:38.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.802+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=BZPNTEKQUJ63 tag=Z0S84JM3G1GQ type=write size=2706529 2024-09-12T17:30:38.807 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.805+0000 7fece65ff780 1 < suggested update operation key=W3MBKNIBLV7W tag=8YV59YIY4AVW type=write size=272026 2024-09-12T17:30:38.808 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.806+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=YJHIKJO2BP2E type=write size=1003984 2024-09-12T17:30:38.809 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.808+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~TRZNKPJ69A9K.0 size=1048576 2024-09-12T17:30:38.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.809+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~TRZNKPJ69A9K.1 size=1048576 2024-09-12T17:30:38.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.810+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~TRZNKPJ69A9K.2 size=246989 2024-09-12T17:30:38.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.813+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=TRZNKPJ69A9K tag=EUVMBS0V94AI type=write size=3392717 2024-09-12T17:30:38.816 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.815+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=F4TO49DDP8CI type=del size=2442844 2024-09-12T17:30:38.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.816+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~EB1PKTSZJ24S.0 size=1048576 2024-09-12T17:30:38.818 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.817+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~EB1PKTSZJ24S.1 size=1048576 2024-09-12T17:30:38.819 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.818+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~EB1PKTSZJ24S.2 size=648215 2024-09-12T17:30:38.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.823+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=EB1PKTSZJ24S tag=W7I50EY0QBTQ type=write size=3793943 2024-09-12T17:30:38.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.825+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~Q3IUOAAJ7L6A.0 size=386670 2024-09-12T17:30:38.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.825+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=Q3IUOAAJ7L6A tag=Q7Q5VQ9ZTH84 type=write size=1435246 2024-09-12T17:30:38.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.826+0000 7fece65ff780 1 < completed write operation key=LSGN631FW1P8 tag=K4V9FG5GQ3W4 type=write size=162746 2024-09-12T17:30:38.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.828+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~N5KNWH351FMP.0 size=1048576 2024-09-12T17:30:38.831 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.829+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~N5KNWH351FMP.1 size=18724 2024-09-12T17:30:38.831 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.829+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=N5KNWH351FMP tag=TODJ1FXWB9OG type=write size=2115876 2024-09-12T17:30:38.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.830+0000 7fece65ff780 1 < completed delete operation key=5A7WPGW5P91B tag=VG1I1NIOK6FU type=del 2024-09-12T17:30:38.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.832+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~VWGTQVPR4F9D.0 size=1048576 2024-09-12T17:30:38.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.833+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~VWGTQVPR4F9D.1 size=1048576 2024-09-12T17:30:38.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.834+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~VWGTQVPR4F9D.2 size=183618 2024-09-12T17:30:38.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.834+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=VWGTQVPR4F9D tag=Z3TQ6QXQEB7R type=write size=3329346 2024-09-12T17:30:38.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.836+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=L9R65X35B45K type=del 2024-09-12T17:30:38.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.838+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~CTJ1CB1HBRGN.0 size=1048576 2024-09-12T17:30:38.841 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.839+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~CTJ1CB1HBRGN.1 size=294048 2024-09-12T17:30:38.841 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.839+0000 7fece65ff780 1 > prepared multipart upload key=Y30269Q7R340 upload=CTJ1CB1HBRGN tag=WAIQWZ6W496D type=write size=2391200 2024-09-12T17:30:38.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.840+0000 7fece65ff780 1 < canceled operation key=UN6FLMRMAPUS tag=XGK5ONJ7NA8M type=del size=3868145 2024-09-12T17:30:38.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.841+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=GKWL05FJKDLM type=del size=4060121 2024-09-12T17:30:38.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.843+0000 7fece65ff780 1 < completed write operation key=LSGN631FW1P8 tag=VMKEEITQ6SB1 type=write size=231933 2024-09-12T17:30:38.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.845+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~3NJH4OZJJXBU.0 size=1048576 2024-09-12T17:30:38.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.846+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~3NJH4OZJJXBU.1 size=792022 2024-09-12T17:30:38.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.846+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=3NJH4OZJJXBU tag=HR7DNPZQ612J type=write size=2889174 2024-09-12T17:30:38.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.847+0000 7fece65ff780 1 < completed write operation key=KKU8T0CVS40V tag=9T5152N7RXX3 type=write size=390570 2024-09-12T17:30:38.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.849+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~I1D5WJCX410W.0 size=43550 2024-09-12T17:30:38.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.849+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=I1D5WJCX410W tag=0DHUYJECD6BE type=write size=1092126 2024-09-12T17:30:38.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.851+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~78QUQ6I9Y7IM.0 size=1048576 2024-09-12T17:30:38.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.852+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~78QUQ6I9Y7IM.1 size=944255 2024-09-12T17:30:38.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.854+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=78QUQ6I9Y7IM tag=LRPS2L5SWXAK type=write size=3041407 2024-09-12T17:30:38.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.856+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~HY3EF05L4MKK.0 size=1048576 2024-09-12T17:30:38.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.857+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~HY3EF05L4MKK.1 size=1048576 2024-09-12T17:30:38.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.858+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~HY3EF05L4MKK.2 size=198739 2024-09-12T17:30:38.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.858+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=HY3EF05L4MKK tag=A9NT17HRHTCX type=write size=3344467 2024-09-12T17:30:38.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.859+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=V50K9SXFP2S7 type=del 2024-09-12T17:30:38.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.860+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=XH9DBDI36R2P type=del size=955087 2024-09-12T17:30:38.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.862+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~R86D3EHVJSFZ.0 size=1048576 2024-09-12T17:30:38.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.863+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~R86D3EHVJSFZ.1 size=442005 2024-09-12T17:30:38.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.865+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=R86D3EHVJSFZ tag=UBJBCBQF4MJB type=write size=2539157 2024-09-12T17:30:38.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.867+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=NCZ8AS5L9WHO type=del size=3239939 2024-09-12T17:30:38.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.868+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=8PDKQN5616X8 type=del 2024-09-12T17:30:38.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.871+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~M4V76DIJ0MAT.0 size=1048576 2024-09-12T17:30:38.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.872+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~M4V76DIJ0MAT.1 size=233406 2024-09-12T17:30:38.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.872+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=M4V76DIJ0MAT tag=7Z0N800FU799 type=write size=2330558 2024-09-12T17:30:38.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.873+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~HKU97DB19PSS.0 size=645170 2024-09-12T17:30:38.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.875+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=HKU97DB19PSS tag=317O1QEJXEHA type=write size=1693746 2024-09-12T17:30:38.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.876+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=SUX920QKWEFJ type=del size=4113955 2024-09-12T17:30:38.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.878+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=LC5FW1ADLHWQ type=del 2024-09-12T17:30:38.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.879+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=O9EM72Y7JR6Q type=del size=2219972 2024-09-12T17:30:38.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.880+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~BZPNTEKQUJ63.0 size=1048576 2024-09-12T17:30:38.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.881+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~BZPNTEKQUJ63.1 size=609377 2024-09-12T17:30:38.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.883+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=BZPNTEKQUJ63 tag=Z0S84JM3G1GQ type=write size=2706529 2024-09-12T17:30:38.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.884+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=3LH74AH3A006 type=del size=2791080 2024-09-12T17:30:38.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.886+0000 7fece65ff780 1 < suggested remove operation key=YCNQL8CUUGW7 tag=YJHIKJO2BP2E type=write 2024-09-12T17:30:38.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.887+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=Y0EOGTCM6QE6 type=del size=610928 2024-09-12T17:30:38.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.890+0000 7fece65ff780 1 < suggested remove operation key=ZEFSNR1IIA10 tag=F4TO49DDP8CI type=del 2024-09-12T17:30:38.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.891+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=W1Q4QC5RWG0U type=del size=4025420 2024-09-12T17:30:38.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.892+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~Q3IUOAAJ7L6A.0 size=386670 2024-09-12T17:30:38.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.894+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=Q3IUOAAJ7L6A tag=Q7Q5VQ9ZTH84 type=write size=1435246 2024-09-12T17:30:38.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.895+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=9TKQ5G2Z1NFB type=del size=2677509 2024-09-12T17:30:38.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.895+0000 7fece65ff780 1 < canceled part key=_multipart_TLEZIJ4881G7.2~N5KNWH351FMP.0 size=1048576 2024-09-12T17:30:38.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.895+0000 7fece65ff780 1 < canceled part key=_multipart_TLEZIJ4881G7.2~N5KNWH351FMP.1 size=18724 2024-09-12T17:30:38.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.897+0000 7fece65ff780 1 < canceled multipart upload key=TLEZIJ4881G7 upload=N5KNWH351FMP tag=TODJ1FXWB9OG type=write size=2115876 2024-09-12T17:30:38.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.899+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~NNZ8C8VVB2KU.0 size=1048576 2024-09-12T17:30:38.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.900+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~NNZ8C8VVB2KU.1 size=1048179 2024-09-12T17:30:38.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.900+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=NNZ8C8VVB2KU tag=Q5QK7P6ISHQC type=write size=3145331 2024-09-12T17:30:38.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.900+0000 7fece65ff780 1 < canceled part key=_multipart_TLEZIJ4881G7.2~VWGTQVPR4F9D.0 size=1048576 2024-09-12T17:30:38.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.901+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~VWGTQVPR4F9D.1 size=1048576 2024-09-12T17:30:38.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.902+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~VWGTQVPR4F9D.2 size=183618 2024-09-12T17:30:38.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.904+0000 7fece65ff780 1 < canceled multipart upload key=TLEZIJ4881G7 upload=VWGTQVPR4F9D tag=Z3TQ6QXQEB7R type=write size=3329346 2024-09-12T17:30:38.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.905+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=Z1AFF85I1ZQ1 type=del size=747462 2024-09-12T17:30:38.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.906+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~CTJ1CB1HBRGN.0 size=1048576 2024-09-12T17:30:38.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.907+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~CTJ1CB1HBRGN.1 size=294048 2024-09-12T17:30:38.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.909+0000 7fece65ff780 1 < completed multipart upload key=Y30269Q7R340 upload=CTJ1CB1HBRGN tag=WAIQWZ6W496D type=write size=2391200 2024-09-12T17:30:38.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.910+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=E0AC6QPBEXYF type=write size=113024 2024-09-12T17:30:38.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.911+0000 7fece65ff780 -1 < failed to complete operation key=ZEFSNR1IIA10 tag=GKWL05FJKDLM type=del size=4060121: (22) Invalid argument 2024-09-12T17:30:38.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.913+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=5S44RS5K33AY type=del size=1579754 2024-09-12T17:30:38.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.914+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~3NJH4OZJJXBU.0 size=1048576 2024-09-12T17:30:38.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.915+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~3NJH4OZJJXBU.1 size=792022 2024-09-12T17:30:38.918 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.917+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=3NJH4OZJJXBU tag=HR7DNPZQ612J type=write size=2889174 2024-09-12T17:30:38.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.919+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~4XFC0TZSTSKQ.0 size=1048576 2024-09-12T17:30:38.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.920+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~4XFC0TZSTSKQ.1 size=127504 2024-09-12T17:30:38.922 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.920+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=4XFC0TZSTSKQ tag=70OY1LAQ36KH type=write size=2224656 2024-09-12T17:30:38.922 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.920+0000 7fece65ff780 1 < canceled part key=_multipart_UN6FLMRMAPUS.2~I1D5WJCX410W.0 size=43550 2024-09-12T17:30:38.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.923+0000 7fece65ff780 1 < canceled multipart upload key=UN6FLMRMAPUS upload=I1D5WJCX410W tag=0DHUYJECD6BE type=write size=1092126 2024-09-12T17:30:38.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.924+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=RHM94HJZGZQM type=del size=1979829 2024-09-12T17:30:38.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.925+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~HY3EF05L4MKK.0 size=1048576 2024-09-12T17:30:38.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.926+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~HY3EF05L4MKK.1 size=1048576 2024-09-12T17:30:38.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.927+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~HY3EF05L4MKK.2 size=198739 2024-09-12T17:30:38.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.929+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=HY3EF05L4MKK tag=A9NT17HRHTCX type=write size=3344467 2024-09-12T17:30:38.932 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.930+0000 7fece65ff780 1 > prepared operation key=4Z1N3433MC6A tag=Z2I1LIGGJLI0 type=del size=515907 2024-09-12T17:30:38.936 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.934+0000 7fece65ff780 1 < suggested remove operation key=9IGJG88NX1FS tag=XH9DBDI36R2P type=del 2024-09-12T17:30:38.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.935+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=XECYUHYBNGEC type=del size=1999760 2024-09-12T17:30:38.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.936+0000 7fece65ff780 1 < completed delete operation key=9KYNMM6W7RRM tag=NCZ8AS5L9WHO type=del 2024-09-12T17:30:38.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.938+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=JX1CLOV1QJKU type=write size=42863 2024-09-12T17:30:38.941 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.939+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~M4V76DIJ0MAT.0 size=1048576 2024-09-12T17:30:38.941 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.940+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~M4V76DIJ0MAT.1 size=233406 2024-09-12T17:30:38.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.942+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=M4V76DIJ0MAT tag=7Z0N800FU799 type=write size=2330558 2024-09-12T17:30:38.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.944+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~2A2PELB5LS4B.0 size=338710 2024-09-12T17:30:38.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.944+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=2A2PELB5LS4B tag=KV4LIJ0X3FGT type=write size=1387286 2024-09-12T17:30:38.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.946+0000 7fece65ff780 1 < suggested update operation key=807GX4RQQLL4 tag=SUX920QKWEFJ type=del size=4113955 2024-09-12T17:30:38.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.949+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~UPQFT3JZK1MN.0 size=201499 2024-09-12T17:30:38.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.949+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=UPQFT3JZK1MN tag=J6PYIMOYM1TB type=write size=1250075 2024-09-12T17:30:38.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.950+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=O9EM72Y7JR6Q type=del 2024-09-12T17:30:38.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.952+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~8940GD761OTI.0 size=1048576 2024-09-12T17:30:38.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.953+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~8940GD761OTI.1 size=70505 2024-09-12T17:30:38.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.953+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=8940GD761OTI tag=KEIOREMGBZWQ type=write size=2167657 2024-09-12T17:30:38.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.954+0000 7fece65ff780 1 < canceled operation key=UN6FLMRMAPUS tag=3LH74AH3A006 type=del size=2791080 2024-09-12T17:30:38.957 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.955+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=NKA1G2VBC8TN type=del size=3939369 2024-09-12T17:30:38.958 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.956+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=Y0EOGTCM6QE6 type=del 2024-09-12T17:30:38.959 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.957+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=U7J996F6X74K type=write size=469619 2024-09-12T17:30:38.961 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.960+0000 7fece65ff780 1 < suggested update operation key=6GUDX5I1AKNH tag=W1Q4QC5RWG0U type=del size=4025420 2024-09-12T17:30:38.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.962+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~5FZQBVV95YDD.0 size=955007 2024-09-12T17:30:38.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.962+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=5FZQBVV95YDD tag=B01VRFCCZRO1 type=write size=2003583 2024-09-12T17:30:38.965 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.963+0000 7fece65ff780 1 < completed delete operation key=Y30269Q7R340 tag=9TKQ5G2Z1NFB type=del 2024-09-12T17:30:38.966 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.964+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=MMLDM4K0YA2E type=del size=274230 2024-09-12T17:30:38.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.965+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~NNZ8C8VVB2KU.0 size=1048576 2024-09-12T17:30:38.968 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.966+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~NNZ8C8VVB2KU.1 size=1048179 2024-09-12T17:30:38.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.968+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=NNZ8C8VVB2KU tag=Q5QK7P6ISHQC type=write size=3145331 2024-09-12T17:30:38.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.971+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~2A6I3K36QU6Y.0 size=724169 2024-09-12T17:30:38.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.971+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=2A6I3K36QU6Y tag=03A0HGMQGRNL type=write size=1772745 2024-09-12T17:30:38.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.972+0000 7fece65ff780 -1 < failed to complete operation key=807GX4RQQLL4 tag=Z1AFF85I1ZQ1 type=del size=747462: (22) Invalid argument 2024-09-12T17:30:38.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.974+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~HHZOAL10K2XG.0 size=683713 2024-09-12T17:30:38.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.974+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=HHZOAL10K2XG tag=AM13C8T7R4KA type=write size=1732289 2024-09-12T17:30:38.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.975+0000 7fece65ff780 1 < completed write operation key=I7TGK5A3JHH5 tag=E0AC6QPBEXYF type=write size=113024 2024-09-12T17:30:38.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.978+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~10405A9F1CIS.0 size=1048576 2024-09-12T17:30:38.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.979+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~10405A9F1CIS.1 size=1048576 2024-09-12T17:30:38.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.980+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~10405A9F1CIS.2 size=625954 2024-09-12T17:30:38.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.980+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=10405A9F1CIS tag=X2VBXUX9D5WZ type=write size=3771682 2024-09-12T17:30:38.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.981+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=5S44RS5K33AY type=del 2024-09-12T17:30:38.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.982+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=BRUQBL652SJJ type=del size=1352550 2024-09-12T17:30:38.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.983+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~4XFC0TZSTSKQ.0 size=1048576 2024-09-12T17:30:38.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.984+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~4XFC0TZSTSKQ.1 size=127504 2024-09-12T17:30:38.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.986+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=4XFC0TZSTSKQ tag=70OY1LAQ36KH type=write size=2224656 2024-09-12T17:30:38.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.988+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=J2KMEVSQWUYR type=del size=1508756 2024-09-12T17:30:38.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.989+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=RHM94HJZGZQM type=del 2024-09-12T17:30:38.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.990+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=EH01BBR6ZVFR type=del size=3905520 2024-09-12T17:30:38.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.992+0000 7fece65ff780 1 < suggested remove operation key=4Z1N3433MC6A tag=Z2I1LIGGJLI0 type=del 2024-09-12T17:30:38.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.994+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=8LRA8E65WCR7 type=del size=3155487 2024-09-12T17:30:38.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.995+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=XECYUHYBNGEC type=del 2024-09-12T17:30:38.998 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.996+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=K23072KY1ZOB type=del size=693819 2024-09-12T17:30:38.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.997+0000 7fece65ff780 -1 < failed to complete operation key=6GUDX5I1AKNH tag=JX1CLOV1QJKU type=write size=42863: (22) Invalid argument 2024-09-12T17:30:39.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:38.999+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=JCRY62EU4FA0 type=del size=1936329 2024-09-12T17:30:39.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.000+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~2A2PELB5LS4B.0 size=338710 2024-09-12T17:30:39.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.002+0000 7fece65ff780 1 < completed multipart upload key=2HTNXL56URAK upload=2A2PELB5LS4B tag=KV4LIJ0X3FGT type=write size=1387286 2024-09-12T17:30:39.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.004+0000 7fece65ff780 1 > prepared part key=_multipart_4Z1N3433MC6A.2~5KEUDNB09XOU.0 size=363401 2024-09-12T17:30:39.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.004+0000 7fece65ff780 1 > prepared multipart upload key=4Z1N3433MC6A upload=5KEUDNB09XOU tag=19IXPI5STN9N type=write size=1411977 2024-09-12T17:30:39.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.006+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~UPQFT3JZK1MN.0 size=201499 2024-09-12T17:30:39.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.008+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=UPQFT3JZK1MN tag=J6PYIMOYM1TB type=write size=1250075 2024-09-12T17:30:39.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.010+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~3BI7EHVV4EIY.0 size=555468 2024-09-12T17:30:39.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.010+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=3BI7EHVV4EIY tag=OMH0JGTUI047 type=write size=1604044 2024-09-12T17:30:39.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.011+0000 7fece65ff780 1 < canceled part key=_multipart_5LAOX5H1AQWJ.2~8940GD761OTI.0 size=1048576 2024-09-12T17:30:39.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.012+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~8940GD761OTI.1 size=70505 2024-09-12T17:30:39.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.014+0000 7fece65ff780 1 < canceled multipart upload key=5LAOX5H1AQWJ upload=8940GD761OTI tag=KEIOREMGBZWQ type=write size=2167657 2024-09-12T17:30:39.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.016+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~TY81CRVO3A5S.0 size=1048576 2024-09-12T17:30:39.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.017+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~TY81CRVO3A5S.1 size=344187 2024-09-12T17:30:39.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.017+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=TY81CRVO3A5S tag=TILY85X46XYD type=write size=2441339 2024-09-12T17:30:39.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.019+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=NKA1G2VBC8TN type=del 2024-09-12T17:30:39.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.020+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=XK7Y8SOFH30R type=del size=2076869 2024-09-12T17:30:39.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.021+0000 7fece65ff780 1 < completed write operation key=5LAOX5H1AQWJ tag=U7J996F6X74K type=write size=469619 2024-09-12T17:30:39.024 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.022+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=38JFHBZISJ56 type=del size=2555226 2024-09-12T17:30:39.024 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.023+0000 7fece65ff780 1 < canceled part key=_multipart_2HTNXL56URAK.2~5FZQBVV95YDD.0 size=955007 2024-09-12T17:30:39.026 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.025+0000 7fece65ff780 1 < canceled multipart upload key=2HTNXL56URAK upload=5FZQBVV95YDD tag=B01VRFCCZRO1 type=write size=2003583 2024-09-12T17:30:39.027 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.026+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=H23915XP2AOK type=write size=946159 2024-09-12T17:30:39.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.027+0000 7fece65ff780 1 < completed delete operation key=9IGJG88NX1FS tag=MMLDM4K0YA2E type=del 2024-09-12T17:30:39.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.028+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=BD51QH6MBIE7 type=write size=955214 2024-09-12T17:30:39.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.030+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~2A6I3K36QU6Y.0 size=724169 2024-09-12T17:30:39.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.032+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=2A6I3K36QU6Y tag=03A0HGMQGRNL type=write size=1772745 2024-09-12T17:30:39.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.033+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=Z1MHH12538NG type=del size=2332291 2024-09-12T17:30:39.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.034+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~HHZOAL10K2XG.0 size=683713 2024-09-12T17:30:39.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.036+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=HHZOAL10K2XG tag=AM13C8T7R4KA type=write size=1732289 2024-09-12T17:30:39.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.037+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=K7WZJOM0C1EE type=write size=170184 2024-09-12T17:30:39.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.039+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~10405A9F1CIS.0 size=1048576 2024-09-12T17:30:39.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.040+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~10405A9F1CIS.1 size=1048576 2024-09-12T17:30:39.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.041+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~10405A9F1CIS.2 size=625954 2024-09-12T17:30:39.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.043+0000 7fece65ff780 1 < completed multipart upload key=W3MBKNIBLV7W upload=10405A9F1CIS tag=X2VBXUX9D5WZ type=write size=3771682 2024-09-12T17:30:39.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.045+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~BKR5MISES2AD.0 size=606950 2024-09-12T17:30:39.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.045+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=BKR5MISES2AD tag=UUWCQ35YO0ON type=write size=1655526 2024-09-12T17:30:39.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.046+0000 7fece65ff780 1 < completed delete operation key=CBYI6C1ICE08 tag=BRUQBL652SJJ type=del 2024-09-12T17:30:39.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.048+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=GYNMT44Q660J type=del size=4060377 2024-09-12T17:30:39.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.050+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=J2KMEVSQWUYR type=del 2024-09-12T17:30:39.053 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.052+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=UGROUPNSLPW6 type=del size=3875820 2024-09-12T17:30:39.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.053+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=EH01BBR6ZVFR type=del 2024-09-12T17:30:39.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.055+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=BVVCKH2044CM type=del size=2498598 2024-09-12T17:30:39.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.056+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=8LRA8E65WCR7 type=del 2024-09-12T17:30:39.060 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.059+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~4Q5Z7DFYDHWW.0 size=1048576 2024-09-12T17:30:39.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.060+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~4Q5Z7DFYDHWW.1 size=860062 2024-09-12T17:30:39.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.060+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=4Q5Z7DFYDHWW tag=DZ0MVGEL9I8I type=write size=2957214 2024-09-12T17:30:39.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.061+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=K23072KY1ZOB type=del 2024-09-12T17:30:39.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.063+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=COF58C20GTXI type=del size=293614 2024-09-12T17:30:39.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.065+0000 7fece65ff780 1 < suggested remove operation key=RKFRKIENSBTO tag=JCRY62EU4FA0 type=del 2024-09-12T17:30:39.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.067+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=ISSEUHTFR53G type=del size=3248962 2024-09-12T17:30:39.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.068+0000 7fece65ff780 1 < completed part key=_multipart_4Z1N3433MC6A.2~5KEUDNB09XOU.0 size=363401 2024-09-12T17:30:39.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.070+0000 7fece65ff780 1 < completed multipart upload key=4Z1N3433MC6A upload=5KEUDNB09XOU tag=19IXPI5STN9N type=write size=1411977 2024-09-12T17:30:39.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.072+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=OA0H5FB3X2K8 type=del size=3084492 2024-09-12T17:30:39.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.073+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~3BI7EHVV4EIY.0 size=555468 2024-09-12T17:30:39.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.075+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=3BI7EHVV4EIY tag=OMH0JGTUI047 type=write size=1604044 2024-09-12T17:30:39.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.077+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~SUGPSGV85Q9Z.0 size=1048576 2024-09-12T17:30:39.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.078+0000 7fece65ff780 1 > prepared part key=_multipart_TLEZIJ4881G7.2~SUGPSGV85Q9Z.1 size=813144 2024-09-12T17:30:39.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.078+0000 7fece65ff780 1 > prepared multipart upload key=TLEZIJ4881G7 upload=SUGPSGV85Q9Z tag=4MTCFY7MAUAA type=write size=2910296 2024-09-12T17:30:39.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.079+0000 7fece65ff780 1 < canceled part key=_multipart_CBYI6C1ICE08.2~TY81CRVO3A5S.0 size=1048576 2024-09-12T17:30:39.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.080+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~TY81CRVO3A5S.1 size=344187 2024-09-12T17:30:39.083 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.082+0000 7fece65ff780 1 < canceled multipart upload key=CBYI6C1ICE08 upload=TY81CRVO3A5S tag=TILY85X46XYD type=write size=2441339 2024-09-12T17:30:39.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.083+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=5JQXO7ZVBZ6K type=del size=500343 2024-09-12T17:30:39.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.084+0000 7fece65ff780 -1 < failed to complete operation key=RKFRKIENSBTO tag=XK7Y8SOFH30R type=del size=2076869: (22) Invalid argument 2024-09-12T17:30:39.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.085+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=RASNYKGHYJHH type=del size=3657098 2024-09-12T17:30:39.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.086+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=38JFHBZISJ56 type=del 2024-09-12T17:30:39.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.089+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~M9WAI2IW5G9O.0 size=1048576 2024-09-12T17:30:39.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.090+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~M9WAI2IW5G9O.1 size=1048576 2024-09-12T17:30:39.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.091+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~M9WAI2IW5G9O.2 size=293611 2024-09-12T17:30:39.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.091+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=M9WAI2IW5G9O tag=8GOIK2C7JH21 type=write size=3439339 2024-09-12T17:30:39.093 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.092+0000 7fece65ff780 1 < completed write operation key=W3MBKNIBLV7W tag=H23915XP2AOK type=write size=946159 2024-09-12T17:30:39.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.095+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~EXHAA9GWSUMB.0 size=364863 2024-09-12T17:30:39.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.095+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=EXHAA9GWSUMB tag=599T3QPUQEE2 type=write size=1413439 2024-09-12T17:30:39.098 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.096+0000 7fece65ff780 1 < completed write operation key=UN6FLMRMAPUS tag=BD51QH6MBIE7 type=write size=955214 2024-09-12T17:30:39.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.098+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~YCRM8L0DXDSP.0 size=1033987 2024-09-12T17:30:39.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.098+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=YCRM8L0DXDSP tag=YZKGQ1PSLFGG type=write size=2082563 2024-09-12T17:30:39.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.099+0000 7fece65ff780 1 < completed delete operation key=6CCPZ4TVIU5N tag=Z1MHH12538NG type=del 2024-09-12T17:30:39.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.102+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~6KB4EPN7V0MU.0 size=1048576 2024-09-12T17:30:39.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.103+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~6KB4EPN7V0MU.1 size=409624 2024-09-12T17:30:39.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.103+0000 7fece65ff780 1 > prepared multipart upload key=Y30269Q7R340 upload=6KB4EPN7V0MU tag=HSJQ6FY77BGF type=write size=2506776 2024-09-12T17:30:39.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.105+0000 7fece65ff780 1 < suggested remove operation key=YCNQL8CUUGW7 tag=K7WZJOM0C1EE type=write 2024-09-12T17:30:39.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.107+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=D6FS1ITPYAAM type=del size=2074963 2024-09-12T17:30:39.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.108+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~BKR5MISES2AD.0 size=606950 2024-09-12T17:30:39.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.110+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=BKR5MISES2AD tag=UUWCQ35YO0ON type=write size=1655526 2024-09-12T17:30:39.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.111+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=WU07UV4BV2VP type=del size=270662 2024-09-12T17:30:39.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.113+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=GYNMT44Q660J type=del 2024-09-12T17:30:39.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.114+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=HWJEZW5SDUNR type=del size=1245385 2024-09-12T17:30:39.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.115+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=UGROUPNSLPW6 type=del 2024-09-12T17:30:39.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.117+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~8ICCMGAKBCXA.0 size=1048576 2024-09-12T17:30:39.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.118+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~8ICCMGAKBCXA.1 size=1048576 2024-09-12T17:30:39.121 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.119+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~8ICCMGAKBCXA.2 size=428913 2024-09-12T17:30:39.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.119+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=8ICCMGAKBCXA tag=N5U63707KGUE type=write size=3574641 2024-09-12T17:30:39.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.121+0000 7fece65ff780 1 < completed delete operation key=5LAOX5H1AQWJ tag=BVVCKH2044CM type=del 2024-09-12T17:30:39.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.123+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~GJLQKTUECQFQ.0 size=1048576 2024-09-12T17:30:39.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.124+0000 7fece65ff780 1 > prepared part key=_multipart_6GUDX5I1AKNH.2~GJLQKTUECQFQ.1 size=760571 2024-09-12T17:30:39.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.124+0000 7fece65ff780 1 > prepared multipart upload key=6GUDX5I1AKNH upload=GJLQKTUECQFQ tag=ERL2DMGS8JEI type=write size=2857723 2024-09-12T17:30:39.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.125+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~4Q5Z7DFYDHWW.0 size=1048576 2024-09-12T17:30:39.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.126+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~4Q5Z7DFYDHWW.1 size=860062 2024-09-12T17:30:39.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.128+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=4Q5Z7DFYDHWW tag=DZ0MVGEL9I8I type=write size=2957214 2024-09-12T17:30:39.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.129+0000 7fece65ff780 1 > prepared operation key=LSGN631FW1P8 tag=XTA1K0EKFE7Y type=write size=737925 2024-09-12T17:30:39.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.132+0000 7fece65ff780 1 < suggested update operation key=6CCPZ4TVIU5N tag=COF58C20GTXI type=del size=293614 2024-09-12T17:30:39.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.133+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=4RDL3EDIMVKJ type=del size=1639886 2024-09-12T17:30:39.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.134+0000 7fece65ff780 1 < completed delete operation key=5A7WPGW5P91B tag=ISSEUHTFR53G type=del 2024-09-12T17:30:39.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.136+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=W26XSDZOED0O type=del size=3502099 2024-09-12T17:30:39.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.137+0000 7fece65ff780 -1 < failed to complete operation key=6CCPZ4TVIU5N tag=OA0H5FB3X2K8 type=del size=3084492: (22) Invalid argument 2024-09-12T17:30:39.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.138+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=6VV0H12AHECS type=del size=30370 2024-09-12T17:30:39.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.139+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~SUGPSGV85Q9Z.0 size=1048576 2024-09-12T17:30:39.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.140+0000 7fece65ff780 1 < completed part key=_multipart_TLEZIJ4881G7.2~SUGPSGV85Q9Z.1 size=813144 2024-09-12T17:30:39.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.142+0000 7fece65ff780 1 < completed multipart upload key=TLEZIJ4881G7 upload=SUGPSGV85Q9Z tag=4MTCFY7MAUAA type=write size=2910296 2024-09-12T17:30:39.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.144+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~CRQWFCKJL1EZ.0 size=1048576 2024-09-12T17:30:39.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.145+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~CRQWFCKJL1EZ.1 size=1024532 2024-09-12T17:30:39.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.145+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=CRQWFCKJL1EZ tag=LQ8IBM1Z8YGU type=write size=3121684 2024-09-12T17:30:39.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.146+0000 7fece65ff780 1 < completed delete operation key=Q00ZFG0BBDG5 tag=5JQXO7ZVBZ6K type=del 2024-09-12T17:30:39.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.148+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~4SJ11VFQQYOH.0 size=745515 2024-09-12T17:30:39.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.148+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=4SJ11VFQQYOH tag=U72J46G7VF3K type=write size=1794091 2024-09-12T17:30:39.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.150+0000 7fece65ff780 1 < canceled operation key=I31CKY20NO9S tag=RASNYKGHYJHH type=del size=3657098 2024-09-12T17:30:39.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.151+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=Q4DR98V9UIDM type=del size=3183428 2024-09-12T17:30:39.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.152+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~M9WAI2IW5G9O.0 size=1048576 2024-09-12T17:30:39.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.153+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~M9WAI2IW5G9O.1 size=1048576 2024-09-12T17:30:39.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.154+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~M9WAI2IW5G9O.2 size=293611 2024-09-12T17:30:39.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.156+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=M9WAI2IW5G9O tag=8GOIK2C7JH21 type=write size=3439339 2024-09-12T17:30:39.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.157+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=TQNXGX4ZAGIJ type=write size=881794 2024-09-12T17:30:39.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.158+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~EXHAA9GWSUMB.0 size=364863 2024-09-12T17:30:39.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.160+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=EXHAA9GWSUMB tag=599T3QPUQEE2 type=write size=1413439 2024-09-12T17:30:39.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.161+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=J3HFRXZO2YGE type=del size=1406346 2024-09-12T17:30:39.164 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.162+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~YCRM8L0DXDSP.0 size=1033987 2024-09-12T17:30:39.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.164+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=YCRM8L0DXDSP tag=YZKGQ1PSLFGG type=write size=2082563 2024-09-12T17:30:39.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.168+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~QK0DTLMIICPJ.0 size=1048576 2024-09-12T17:30:39.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.169+0000 7fece65ff780 1 > prepared part key=_multipart_Y30269Q7R340.2~QK0DTLMIICPJ.1 size=755920 2024-09-12T17:30:39.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.169+0000 7fece65ff780 1 > prepared multipart upload key=Y30269Q7R340 upload=QK0DTLMIICPJ tag=4M1JBHZW378R type=write size=2853072 2024-09-12T17:30:39.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.171+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~6KB4EPN7V0MU.0 size=1048576 2024-09-12T17:30:39.174 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.172+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~6KB4EPN7V0MU.1 size=409624 2024-09-12T17:30:39.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.175+0000 7fece65ff780 1 < completed multipart upload key=Y30269Q7R340 upload=6KB4EPN7V0MU tag=HSJQ6FY77BGF type=write size=2506776 2024-09-12T17:30:39.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.177+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~8RKQ1VDFTNPC.0 size=25835 2024-09-12T17:30:39.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.177+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=8RKQ1VDFTNPC tag=MWRLTSZCLSLH type=write size=1074411 2024-09-12T17:30:39.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.178+0000 7fece65ff780 1 < completed delete operation key=OIHDAJMPUK4I tag=D6FS1ITPYAAM type=del 2024-09-12T17:30:39.182 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.180+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~S2IEZGU7SXJR.0 size=1048576 2024-09-12T17:30:39.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.181+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~S2IEZGU7SXJR.1 size=1048576 2024-09-12T17:30:39.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.182+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~S2IEZGU7SXJR.2 size=38783 2024-09-12T17:30:39.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.182+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=S2IEZGU7SXJR tag=S05G72OQZ5DT type=write size=3184511 2024-09-12T17:30:39.185 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.183+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=WU07UV4BV2VP type=del 2024-09-12T17:30:39.186 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.185+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=6MCVGWRATEUH type=write size=923853 2024-09-12T17:30:39.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.186+0000 7fece65ff780 1 < completed delete operation key=5A7WPGW5P91B tag=HWJEZW5SDUNR type=del 2024-09-12T17:30:39.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.188+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~NLANO9QR6N1U.0 size=1048576 2024-09-12T17:30:39.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.189+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~NLANO9QR6N1U.1 size=1048576 2024-09-12T17:30:39.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.190+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~NLANO9QR6N1U.2 size=612910 2024-09-12T17:30:39.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.190+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=NLANO9QR6N1U tag=2QYNMTFLOFEG type=write size=3758638 2024-09-12T17:30:39.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.191+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~8ICCMGAKBCXA.0 size=1048576 2024-09-12T17:30:39.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.192+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~8ICCMGAKBCXA.1 size=1048576 2024-09-12T17:30:39.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.192+0000 7fece65ff780 1 < canceled part key=_multipart_1G9VNO1V4IMW.2~8ICCMGAKBCXA.2 size=428913 2024-09-12T17:30:39.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.194+0000 7fece65ff780 1 < canceled multipart upload key=1G9VNO1V4IMW upload=8ICCMGAKBCXA tag=N5U63707KGUE type=write size=3574641 2024-09-12T17:30:39.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.196+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=M1F5BSYLT2LN type=del size=1909832 2024-09-12T17:30:39.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.197+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~GJLQKTUECQFQ.0 size=1048576 2024-09-12T17:30:39.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.198+0000 7fece65ff780 1 < completed part key=_multipart_6GUDX5I1AKNH.2~GJLQKTUECQFQ.1 size=760571 2024-09-12T17:30:39.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.200+0000 7fece65ff780 1 < completed multipart upload key=6GUDX5I1AKNH upload=GJLQKTUECQFQ tag=ERL2DMGS8JEI type=write size=2857723 2024-09-12T17:30:39.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.202+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=5K2LH4PKKHRM type=del size=678605 2024-09-12T17:30:39.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.203+0000 7fece65ff780 1 < completed write operation key=LSGN631FW1P8 tag=XTA1K0EKFE7Y type=write size=737925 2024-09-12T17:30:39.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.205+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~BZSSIVG9JPCI.0 size=1048576 2024-09-12T17:30:39.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.206+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~BZSSIVG9JPCI.1 size=1048576 2024-09-12T17:30:39.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.208+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~BZSSIVG9JPCI.2 size=562002 2024-09-12T17:30:39.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.208+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=BZSSIVG9JPCI tag=XB7QUA2WIRL2 type=write size=3707730 2024-09-12T17:30:39.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.210+0000 7fece65ff780 1 < suggested remove operation key=QQNW20B28RJC tag=4RDL3EDIMVKJ type=del 2024-09-12T17:30:39.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.213+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~1FWFVBSZDMHF.0 size=989260 2024-09-12T17:30:39.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.213+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=1FWFVBSZDMHF tag=ZJOHKSSRGOXC type=write size=2037836 2024-09-12T17:30:39.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.214+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=W26XSDZOED0O type=del 2024-09-12T17:30:39.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.215+0000 7fece65ff780 1 > prepared operation key=ZEFSNR1IIA10 tag=PY3KU8P7FSO1 type=del size=513956 2024-09-12T17:30:39.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.217+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=6VV0H12AHECS type=del 2024-09-12T17:30:39.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.219+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~VS037HJD3RVA.0 size=376096 2024-09-12T17:30:39.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.219+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=VS037HJD3RVA tag=VT3OZI41KAV3 type=write size=1424672 2024-09-12T17:30:39.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.221+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~CRQWFCKJL1EZ.0 size=1048576 2024-09-12T17:30:39.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.222+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~CRQWFCKJL1EZ.1 size=1024532 2024-09-12T17:30:39.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.224+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=CRQWFCKJL1EZ tag=LQ8IBM1Z8YGU type=write size=3121684 2024-09-12T17:30:39.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.225+0000 7fece65ff780 1 > prepared operation key=9KYNMM6W7RRM tag=2JEKI857VGXY type=write size=119355 2024-09-12T17:30:39.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.226+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~4SJ11VFQQYOH.0 size=745515 2024-09-12T17:30:39.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.228+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=4SJ11VFQQYOH tag=U72J46G7VF3K type=write size=1794091 2024-09-12T17:30:39.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.230+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=V1VB603REAKO type=del size=2110764 2024-09-12T17:30:39.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.231+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=Q4DR98V9UIDM type=del 2024-09-12T17:30:39.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.233+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~JB3ZKDPRCSMG.0 size=974131 2024-09-12T17:30:39.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.233+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=JB3ZKDPRCSMG tag=N7MTT0FZQC9T type=write size=2022707 2024-09-12T17:30:39.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.234+0000 7fece65ff780 1 < completed write operation key=KKU8T0CVS40V tag=TQNXGX4ZAGIJ type=write size=881794 2024-09-12T17:30:39.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.236+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=Y3MWHQKYI1A3 type=del size=277269 2024-09-12T17:30:39.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.237+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=J3HFRXZO2YGE type=del 2024-09-12T17:30:39.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.238+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=L8JJSUPET96N type=del size=1324576 2024-09-12T17:30:39.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.239+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~QK0DTLMIICPJ.0 size=1048576 2024-09-12T17:30:39.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.240+0000 7fece65ff780 1 < completed part key=_multipart_Y30269Q7R340.2~QK0DTLMIICPJ.1 size=755920 2024-09-12T17:30:39.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.242+0000 7fece65ff780 1 < completed multipart upload key=Y30269Q7R340 upload=QK0DTLMIICPJ tag=4M1JBHZW378R type=write size=2853072 2024-09-12T17:30:39.246 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.244+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~FTBP51G97OE1.0 size=1048576 2024-09-12T17:30:39.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.245+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~FTBP51G97OE1.1 size=284579 2024-09-12T17:30:39.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.245+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=FTBP51G97OE1 tag=889IVSNVQ2M9 type=write size=2381731 2024-09-12T17:30:39.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.247+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~8RKQ1VDFTNPC.0 size=25835 2024-09-12T17:30:39.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.249+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=8RKQ1VDFTNPC tag=MWRLTSZCLSLH type=write size=1074411 2024-09-12T17:30:39.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.250+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=FTPM59ZDJ4YT type=del size=4054884 2024-09-12T17:30:39.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.251+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~S2IEZGU7SXJR.0 size=1048576 2024-09-12T17:30:39.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.252+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~S2IEZGU7SXJR.1 size=1048576 2024-09-12T17:30:39.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.253+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~S2IEZGU7SXJR.2 size=38783 2024-09-12T17:30:39.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.255+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=S2IEZGU7SXJR tag=S05G72OQZ5DT type=write size=3184511 2024-09-12T17:30:39.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.257+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~KGPG400M0WVB.0 size=1048576 2024-09-12T17:30:39.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.259+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~KGPG400M0WVB.1 size=659892 2024-09-12T17:30:39.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.259+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=KGPG400M0WVB tag=233BLFBV77L9 type=write size=2757044 2024-09-12T17:30:39.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.261+0000 7fece65ff780 1 < suggested update operation key=5A7WPGW5P91B tag=6MCVGWRATEUH type=write size=923853 2024-09-12T17:30:39.265 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.263+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~2EHQ104P1VBG.0 size=1048576 2024-09-12T17:30:39.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.264+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~2EHQ104P1VBG.1 size=1015365 2024-09-12T17:30:39.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.264+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=2EHQ104P1VBG tag=RLQXQYXZH69G type=write size=3112517 2024-09-12T17:30:39.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.265+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~NLANO9QR6N1U.0 size=1048576 2024-09-12T17:30:39.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.267+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~NLANO9QR6N1U.1 size=1048576 2024-09-12T17:30:39.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.267+0000 7fece65ff780 1 < canceled part key=_multipart_CEERZVBJQHP0.2~NLANO9QR6N1U.2 size=612910 2024-09-12T17:30:39.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.269+0000 7fece65ff780 1 < canceled multipart upload key=CEERZVBJQHP0 upload=NLANO9QR6N1U tag=2QYNMTFLOFEG type=write size=3758638 2024-09-12T17:30:39.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.271+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~8M4O9989O5I9.0 size=984840 2024-09-12T17:30:39.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.271+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=8M4O9989O5I9 tag=4YBJSA9CT1CB type=write size=2033416 2024-09-12T17:30:39.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.273+0000 7fece65ff780 1 < suggested update operation key=KKU8T0CVS40V tag=M1F5BSYLT2LN type=del size=1909832 2024-09-12T17:30:39.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.275+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=F87SHEMJDNYX type=del size=2788057 2024-09-12T17:30:39.279 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.277+0000 7fece65ff780 1 < suggested remove operation key=KKU8T0CVS40V tag=5K2LH4PKKHRM type=del 2024-09-12T17:30:39.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.279+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~96JAA52SMSXB.0 size=1048576 2024-09-12T17:30:39.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.280+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~96JAA52SMSXB.1 size=779110 2024-09-12T17:30:39.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.280+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=96JAA52SMSXB tag=2ETXWFO4LGT3 type=write size=2876262 2024-09-12T17:30:39.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.282+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~BZSSIVG9JPCI.0 size=1048576 2024-09-12T17:30:39.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.283+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~BZSSIVG9JPCI.1 size=1048576 2024-09-12T17:30:39.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.285+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~BZSSIVG9JPCI.2 size=562002 2024-09-12T17:30:39.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.288+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=BZSSIVG9JPCI tag=XB7QUA2WIRL2 type=write size=3707730 2024-09-12T17:30:39.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.290+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=0B9CA13I0JZJ type=del size=2028558 2024-09-12T17:30:39.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.291+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~1FWFVBSZDMHF.0 size=989260 2024-09-12T17:30:39.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.293+0000 7fece65ff780 1 < completed multipart upload key=2HTNXL56URAK upload=1FWFVBSZDMHF tag=ZJOHKSSRGOXC type=write size=2037836 2024-09-12T17:30:39.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.295+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~GXICPPRLPTJE.0 size=1048576 2024-09-12T17:30:39.298 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.296+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~GXICPPRLPTJE.1 size=1048576 2024-09-12T17:30:39.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.297+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~GXICPPRLPTJE.2 size=602911 2024-09-12T17:30:39.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.297+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=GXICPPRLPTJE tag=9XIDQXHL0XQN type=write size=3748639 2024-09-12T17:30:39.300 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.299+0000 7fece65ff780 1 < completed delete operation key=ZEFSNR1IIA10 tag=PY3KU8P7FSO1 type=del 2024-09-12T17:30:39.302 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.300+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=9JXGJPOAB7JW type=write size=772607 2024-09-12T17:30:39.303 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.301+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~VS037HJD3RVA.0 size=376096 2024-09-12T17:30:39.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.303+0000 7fece65ff780 1 < completed multipart upload key=I31CKY20NO9S upload=VS037HJD3RVA tag=VT3OZI41KAV3 type=write size=1424672 2024-09-12T17:30:39.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.304+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=YC0BJ7ZFTZUS type=del size=3192195 2024-09-12T17:30:39.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.306+0000 7fece65ff780 1 < completed write operation key=9KYNMM6W7RRM tag=2JEKI857VGXY type=write size=119355 2024-09-12T17:30:39.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.307+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=TNNYPPPQYRC5 type=del size=4142165 2024-09-12T17:30:39.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.308+0000 7fece65ff780 -1 < failed to complete operation key=5A7WPGW5P91B tag=V1VB603REAKO type=del size=2110764: (22) Invalid argument 2024-09-12T17:30:39.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.309+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=GMY14MO2HQ0J type=write size=350581 2024-09-12T17:30:39.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.310+0000 7fece65ff780 1 < canceled part key=_multipart_5A7WPGW5P91B.2~JB3ZKDPRCSMG.0 size=974131 2024-09-12T17:30:39.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.311+0000 7fece65ff780 1 < canceled multipart upload key=5A7WPGW5P91B upload=JB3ZKDPRCSMG tag=N7MTT0FZQC9T type=write size=2022707 2024-09-12T17:30:39.314 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.313+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=0UT85W7J0ZOI type=del size=1337279 2024-09-12T17:30:39.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.315+0000 7fece65ff780 1 < suggested update operation key=UCBB99EG8XK2 tag=Y3MWHQKYI1A3 type=del size=277269 2024-09-12T17:30:39.318 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.316+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=T5MKDAMJR502 type=del size=1081432 2024-09-12T17:30:39.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.318+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=L8JJSUPET96N type=del 2024-09-12T17:30:39.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.320+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~D5MGJG88LKII.0 size=1048576 2024-09-12T17:30:39.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.321+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~D5MGJG88LKII.1 size=1048576 2024-09-12T17:30:39.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.322+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~D5MGJG88LKII.2 size=144180 2024-09-12T17:30:39.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.322+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=D5MGJG88LKII tag=Z6TFULODJWO4 type=write size=3289908 2024-09-12T17:30:39.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.324+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~FTBP51G97OE1.0 size=1048576 2024-09-12T17:30:39.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.325+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~FTBP51G97OE1.1 size=284579 2024-09-12T17:30:39.328 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.327+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=FTBP51G97OE1 tag=889IVSNVQ2M9 type=write size=2381731 2024-09-12T17:30:39.332 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.330+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~N3I34G42HZCM.0 size=344470 2024-09-12T17:30:39.332 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.330+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=N3I34G42HZCM tag=S3M1M10O6A6S type=write size=1393046 2024-09-12T17:30:39.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.333+0000 7fece65ff780 1 < suggested update operation key=6GUDX5I1AKNH tag=FTPM59ZDJ4YT type=del size=4054884 2024-09-12T17:30:39.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.334+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=M3YPU3W8O6I1 type=del size=2487722 2024-09-12T17:30:39.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.334+0000 7fece65ff780 1 < canceled part key=_multipart_ZEFSNR1IIA10.2~KGPG400M0WVB.0 size=1048576 2024-09-12T17:30:39.337 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.335+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~KGPG400M0WVB.1 size=659892 2024-09-12T17:30:39.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.337+0000 7fece65ff780 1 < canceled multipart upload key=ZEFSNR1IIA10 upload=KGPG400M0WVB tag=233BLFBV77L9 type=write size=2757044 2024-09-12T17:30:39.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.338+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=H9UDT19QYQU0 type=del size=3966434 2024-09-12T17:30:39.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.340+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~2EHQ104P1VBG.0 size=1048576 2024-09-12T17:30:39.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.341+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~2EHQ104P1VBG.1 size=1015365 2024-09-12T17:30:39.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.343+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=2EHQ104P1VBG tag=RLQXQYXZH69G type=write size=3112517 2024-09-12T17:30:39.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.345+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~DBPHG0E52JM7.0 size=1048576 2024-09-12T17:30:39.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.346+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~DBPHG0E52JM7.1 size=907549 2024-09-12T17:30:39.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.346+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=DBPHG0E52JM7 tag=890GAP3ICLP8 type=write size=3004701 2024-09-12T17:30:39.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.347+0000 7fece65ff780 1 < completed part key=_multipart_6CCPZ4TVIU5N.2~8M4O9989O5I9.0 size=984840 2024-09-12T17:30:39.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.349+0000 7fece65ff780 1 < completed multipart upload key=6CCPZ4TVIU5N upload=8M4O9989O5I9 tag=4YBJSA9CT1CB type=write size=2033416 2024-09-12T17:30:39.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.352+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~ZW7NARRY9YXN.0 size=1048576 2024-09-12T17:30:39.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.353+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~ZW7NARRY9YXN.1 size=1048576 2024-09-12T17:30:39.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.354+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~ZW7NARRY9YXN.2 size=513544 2024-09-12T17:30:39.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.354+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=ZW7NARRY9YXN tag=OSBWSFQUPSA2 type=write size=3659272 2024-09-12T17:30:39.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.355+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=F87SHEMJDNYX type=del 2024-09-12T17:30:39.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.357+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~ME1OYP1K9D64.0 size=1048576 2024-09-12T17:30:39.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.358+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~ME1OYP1K9D64.1 size=401482 2024-09-12T17:30:39.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.358+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=ME1OYP1K9D64 tag=O5B9EY7SWK9S type=write size=2498634 2024-09-12T17:30:39.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.360+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~96JAA52SMSXB.0 size=1048576 2024-09-12T17:30:39.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.361+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~96JAA52SMSXB.1 size=779110 2024-09-12T17:30:39.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.363+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=96JAA52SMSXB tag=2ETXWFO4LGT3 type=write size=2876262 2024-09-12T17:30:39.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.364+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=BQ39JPR6202X type=write size=1000009 2024-09-12T17:30:39.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.365+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=0B9CA13I0JZJ type=del 2024-09-12T17:30:39.368 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.367+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=23UG9OZ3JFH2 type=del size=3471849 2024-09-12T17:30:39.369 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.368+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~GXICPPRLPTJE.0 size=1048576 2024-09-12T17:30:39.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.369+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~GXICPPRLPTJE.1 size=1048576 2024-09-12T17:30:39.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.370+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~GXICPPRLPTJE.2 size=602911 2024-09-12T17:30:39.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.372+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=GXICPPRLPTJE tag=9XIDQXHL0XQN type=write size=3748639 2024-09-12T17:30:39.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.375+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~GES7Z9Q0QACT.0 size=1048576 2024-09-12T17:30:39.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.376+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~GES7Z9Q0QACT.1 size=703991 2024-09-12T17:30:39.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.376+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=GES7Z9Q0QACT tag=23RTIC9B5F7N type=write size=2801143 2024-09-12T17:30:39.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.378+0000 7fece65ff780 1 < completed write operation key=2HTNXL56URAK tag=9JXGJPOAB7JW type=write size=772607 2024-09-12T17:30:39.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.380+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~A2M41O40FFOG.0 size=1048576 2024-09-12T17:30:39.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.381+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~A2M41O40FFOG.1 size=480051 2024-09-12T17:30:39.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.381+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=A2M41O40FFOG tag=CBL39ZGB3SFH type=write size=2577203 2024-09-12T17:30:39.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.383+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=YC0BJ7ZFTZUS type=del 2024-09-12T17:30:39.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.384+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=TRNSU05P4MBD type=del size=1978888 2024-09-12T17:30:39.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.386+0000 7fece65ff780 1 < suggested update operation key=Y1OT1OLGWB1Q tag=TNNYPPPQYRC5 type=del size=4142165 2024-09-12T17:30:39.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.387+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=4Q5Q3NMZD27F type=del size=370074 2024-09-12T17:30:39.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.388+0000 7fece65ff780 1 < canceled operation key=I7TGK5A3JHH5 tag=GMY14MO2HQ0J type=write size=350581 2024-09-12T17:30:39.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.391+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~XWFXIZ0G8YZG.0 size=605286 2024-09-12T17:30:39.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.391+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=XWFXIZ0G8YZG tag=TDT2ZPM23TJX type=write size=1653862 2024-09-12T17:30:39.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.393+0000 7fece65ff780 1 < suggested remove operation key=CEERZVBJQHP0 tag=0UT85W7J0ZOI type=del 2024-09-12T17:30:39.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.394+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=YCJ5KK5JMWTT type=del size=1510001 2024-09-12T17:30:39.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.395+0000 7fece65ff780 -1 < failed to complete operation key=Y1OT1OLGWB1Q tag=T5MKDAMJR502 type=del size=1081432: (22) Invalid argument 2024-09-12T17:30:39.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.397+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=ZNHZ6MCJCNTZ type=del size=3196604 2024-09-12T17:30:39.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.397+0000 7fece65ff780 1 < canceled part key=_multipart_FX8VJO1YXJ4H.2~D5MGJG88LKII.0 size=1048576 2024-09-12T17:30:39.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.398+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~D5MGJG88LKII.1 size=1048576 2024-09-12T17:30:39.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.398+0000 7fece65ff780 1 < canceled part key=_multipart_FX8VJO1YXJ4H.2~D5MGJG88LKII.2 size=144180 2024-09-12T17:30:39.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.400+0000 7fece65ff780 1 < canceled multipart upload key=FX8VJO1YXJ4H upload=D5MGJG88LKII tag=Z6TFULODJWO4 type=write size=3289908 2024-09-12T17:30:39.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.402+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~M43RSKMBZWZ0.0 size=769157 2024-09-12T17:30:39.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.402+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=M43RSKMBZWZ0 tag=3KLYF3YROIYH type=write size=1817733 2024-09-12T17:30:39.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.405+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~N3I34G42HZCM.0 size=344470 2024-09-12T17:30:39.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.407+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=N3I34G42HZCM tag=S3M1M10O6A6S type=write size=1393046 2024-09-12T17:30:39.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.409+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=E0PXC4QND3XS type=del size=1111896 2024-09-12T17:30:39.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.410+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=M3YPU3W8O6I1 type=del 2024-09-12T17:30:39.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.411+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=AQGWQGEEU0OA type=del size=2952499 2024-09-12T17:30:39.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.413+0000 7fece65ff780 1 < completed delete operation key=OIHDAJMPUK4I tag=H9UDT19QYQU0 type=del 2024-09-12T17:30:39.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.415+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~01X288K34203.0 size=780953 2024-09-12T17:30:39.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.415+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=01X288K34203 tag=SESZ6CNFSZBW type=write size=1829529 2024-09-12T17:30:39.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.417+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~DBPHG0E52JM7.0 size=1048576 2024-09-12T17:30:39.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.418+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~DBPHG0E52JM7.1 size=907549 2024-09-12T17:30:39.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.420+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=DBPHG0E52JM7 tag=890GAP3ICLP8 type=write size=3004701 2024-09-12T17:30:39.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.421+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=LR9KLR7QXZ3D type=write size=501039 2024-09-12T17:30:39.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.422+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~ZW7NARRY9YXN.0 size=1048576 2024-09-12T17:30:39.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.423+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~ZW7NARRY9YXN.1 size=1048576 2024-09-12T17:30:39.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.424+0000 7fece65ff780 1 < completed part key=_multipart_7AS5L998SDV7.2~ZW7NARRY9YXN.2 size=513544 2024-09-12T17:30:39.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.427+0000 7fece65ff780 1 < completed multipart upload key=7AS5L998SDV7 upload=ZW7NARRY9YXN tag=OSBWSFQUPSA2 type=write size=3659272 2024-09-12T17:30:39.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.429+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~OK6K78J9VQBR.0 size=1048576 2024-09-12T17:30:39.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.430+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~OK6K78J9VQBR.1 size=1048576 2024-09-12T17:30:39.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.431+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~OK6K78J9VQBR.2 size=279452 2024-09-12T17:30:39.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.431+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=OK6K78J9VQBR tag=1K2I19C9MNGW type=write size=3425180 2024-09-12T17:30:39.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.432+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~ME1OYP1K9D64.0 size=1048576 2024-09-12T17:30:39.435 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.433+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~ME1OYP1K9D64.1 size=401482 2024-09-12T17:30:39.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.435+0000 7fece65ff780 1 < completed multipart upload key=2HTNXL56URAK upload=ME1OYP1K9D64 tag=O5B9EY7SWK9S type=write size=2498634 2024-09-12T17:30:39.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.437+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=GA8S4EMKGJ58 type=write size=758249 2024-09-12T17:30:39.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.438+0000 7fece65ff780 1 < completed write operation key=I31CKY20NO9S tag=BQ39JPR6202X type=write size=1000009 2024-09-12T17:30:39.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.440+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~UQRHVGD5P1OP.0 size=76913 2024-09-12T17:30:39.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.440+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=UQRHVGD5P1OP tag=YSQX31BPHC73 type=write size=1125489 2024-09-12T17:30:39.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.442+0000 7fece65ff780 1 < suggested update operation key=OIHDAJMPUK4I tag=23UG9OZ3JFH2 type=del size=3471849 2024-09-12T17:30:39.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.445+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~FZ3RLPXLO7FI.0 size=185308 2024-09-12T17:30:39.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.445+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=FZ3RLPXLO7FI tag=3OAP7P942HDY type=write size=1233884 2024-09-12T17:30:39.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.446+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~GES7Z9Q0QACT.0 size=1048576 2024-09-12T17:30:39.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.447+0000 7fece65ff780 1 < completed part key=_multipart_I31CKY20NO9S.2~GES7Z9Q0QACT.1 size=703991 2024-09-12T17:30:39.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.449+0000 7fece65ff780 1 < completed multipart upload key=I31CKY20NO9S upload=GES7Z9Q0QACT tag=23RTIC9B5F7N type=write size=2801143 2024-09-12T17:30:39.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.450+0000 7fece65ff780 1 > prepared operation key=IMCE9Z7P4S6R tag=VVHFK2R04ZA8 type=del size=2551017 2024-09-12T17:30:39.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.452+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~A2M41O40FFOG.0 size=1048576 2024-09-12T17:30:39.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.453+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~A2M41O40FFOG.1 size=480051 2024-09-12T17:30:39.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.455+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=A2M41O40FFOG tag=CBL39ZGB3SFH type=write size=2577203 2024-09-12T17:30:39.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.457+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~YMQMIQ9SKO6O.0 size=490324 2024-09-12T17:30:39.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.457+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=YMQMIQ9SKO6O tag=98ZZ7QQEX8CF type=write size=1538900 2024-09-12T17:30:39.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.459+0000 7fece65ff780 -1 < failed to complete operation key=CEERZVBJQHP0 tag=TRNSU05P4MBD type=del size=1978888: (22) Invalid argument 2024-09-12T17:30:39.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.460+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=Y1XB6WKLZPCH type=del size=1694516 2024-09-12T17:30:39.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.461+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=4Q5Q3NMZD27F type=del 2024-09-12T17:30:39.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.464+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~3DLQ80L83XCS.0 size=1048576 2024-09-12T17:30:39.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.465+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~3DLQ80L83XCS.1 size=292824 2024-09-12T17:30:39.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.465+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=3DLQ80L83XCS tag=4GFR4L36OMK9 type=write size=2389976 2024-09-12T17:30:39.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.466+0000 7fece65ff780 1 < completed part key=_multipart_QQNW20B28RJC.2~XWFXIZ0G8YZG.0 size=605286 2024-09-12T17:30:39.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.468+0000 7fece65ff780 1 < completed multipart upload key=QQNW20B28RJC upload=XWFXIZ0G8YZG tag=TDT2ZPM23TJX type=write size=1653862 2024-09-12T17:30:39.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.469+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=RM2WRXYQCNE0 type=del size=1772250 2024-09-12T17:30:39.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.470+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=YCJ5KK5JMWTT type=del 2024-09-12T17:30:39.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.473+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~0098FYKCQWF6.0 size=1048576 2024-09-12T17:30:39.475 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.474+0000 7fece65ff780 1 > prepared part key=_multipart_UCBB99EG8XK2.2~0098FYKCQWF6.1 size=509959 2024-09-12T17:30:39.475 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.474+0000 7fece65ff780 1 > prepared multipart upload key=UCBB99EG8XK2 upload=0098FYKCQWF6 tag=EOGM2K1WMX3H type=write size=2607111 2024-09-12T17:30:39.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.475+0000 7fece65ff780 1 < completed delete operation key=6GUDX5I1AKNH tag=ZNHZ6MCJCNTZ type=del 2024-09-12T17:30:39.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.476+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=DD5UMM08C3KL type=del size=606360 2024-09-12T17:30:39.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.477+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~M43RSKMBZWZ0.0 size=769157 2024-09-12T17:30:39.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.479+0000 7fece65ff780 1 < completed multipart upload key=5A7WPGW5P91B upload=M43RSKMBZWZ0 tag=3KLYF3YROIYH type=write size=1817733 2024-09-12T17:30:39.483 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.482+0000 7fece65ff780 1 > prepared part key=_multipart_RKFRKIENSBTO.2~VQEMH1R8PEGY.0 size=845254 2024-09-12T17:30:39.483 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.482+0000 7fece65ff780 1 > prepared multipart upload key=RKFRKIENSBTO upload=VQEMH1R8PEGY tag=FUTHYWTCYSDJ type=write size=1893830 2024-09-12T17:30:39.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.483+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=E0PXC4QND3XS type=del 2024-09-12T17:30:39.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.484+0000 7fece65ff780 1 > prepared operation key=OPMR1WMB14CA tag=EI564R3U6ZXY type=del size=1231972 2024-09-12T17:30:39.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.485+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=AQGWQGEEU0OA type=del 2024-09-12T17:30:39.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.487+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=W2THZAXZ2YVY type=del size=906378 2024-09-12T17:30:39.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.488+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~01X288K34203.0 size=780953 2024-09-12T17:30:39.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.491+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=01X288K34203 tag=SESZ6CNFSZBW type=write size=1829529 2024-09-12T17:30:39.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.492+0000 7fece65ff780 1 > prepared operation key=Q00ZFG0BBDG5 tag=I9TL0AX3ZPFE type=write size=976848 2024-09-12T17:30:39.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.493+0000 7fece65ff780 1 < completed write operation key=W3MBKNIBLV7W tag=LR9KLR7QXZ3D type=write size=501039 2024-09-12T17:30:39.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.495+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~3ZP7E5G35H15.0 size=1048576 2024-09-12T17:30:39.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.496+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~3ZP7E5G35H15.1 size=1048576 2024-09-12T17:30:39.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.497+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~3ZP7E5G35H15.2 size=120435 2024-09-12T17:30:39.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.497+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=3ZP7E5G35H15 tag=HZI51RMJFWZ5 type=write size=3266163 2024-09-12T17:30:39.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.499+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~OK6K78J9VQBR.0 size=1048576 2024-09-12T17:30:39.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.500+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~OK6K78J9VQBR.1 size=1048576 2024-09-12T17:30:39.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.501+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~OK6K78J9VQBR.2 size=279452 2024-09-12T17:30:39.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.503+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=OK6K78J9VQBR tag=1K2I19C9MNGW type=write size=3425180 2024-09-12T17:30:39.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.504+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=MZLHEY056CSL type=del size=3664052 2024-09-12T17:30:39.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.506+0000 7fece65ff780 1 < completed write operation key=5A7WPGW5P91B tag=GA8S4EMKGJ58 type=write size=758249 2024-09-12T17:30:39.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.508+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~T925D5TWJNQB.0 size=1048576 2024-09-12T17:30:39.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.509+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~T925D5TWJNQB.1 size=1048576 2024-09-12T17:30:39.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.510+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~T925D5TWJNQB.2 size=808868 2024-09-12T17:30:39.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.510+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=T925D5TWJNQB tag=DWTH7F0X4Q99 type=write size=3954596 2024-09-12T17:30:39.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.512+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~UQRHVGD5P1OP.0 size=76913 2024-09-12T17:30:39.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.514+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=UQRHVGD5P1OP tag=YSQX31BPHC73 type=write size=1125489 2024-09-12T17:30:39.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.516+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~11T2I64KFZQW.0 size=1048576 2024-09-12T17:30:39.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.517+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~11T2I64KFZQW.1 size=897892 2024-09-12T17:30:39.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.517+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=11T2I64KFZQW tag=A3P1BBVCDZNU type=write size=2995044 2024-09-12T17:30:39.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.518+0000 7fece65ff780 1 < canceled part key=_multipart_9IGJG88NX1FS.2~FZ3RLPXLO7FI.0 size=185308 2024-09-12T17:30:39.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.520+0000 7fece65ff780 1 < canceled multipart upload key=9IGJG88NX1FS upload=FZ3RLPXLO7FI tag=3OAP7P942HDY type=write size=1233884 2024-09-12T17:30:39.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.521+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=2VQYKUK5BPNO type=del size=841284 2024-09-12T17:30:39.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.524+0000 7fece65ff780 1 < completed delete operation key=IMCE9Z7P4S6R tag=VVHFK2R04ZA8 type=del 2024-09-12T17:30:39.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.525+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=LAW060BBOETR type=del size=1171504 2024-09-12T17:30:39.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.526+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~YMQMIQ9SKO6O.0 size=490324 2024-09-12T17:30:39.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.529+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=YMQMIQ9SKO6O tag=98ZZ7QQEX8CF type=write size=1538900 2024-09-12T17:30:39.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.531+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~70DPE9C0059J.0 size=1048576 2024-09-12T17:30:39.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.532+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~70DPE9C0059J.1 size=455303 2024-09-12T17:30:39.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.532+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=70DPE9C0059J tag=E1B1H69GJYP8 type=write size=2552455 2024-09-12T17:30:39.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.533+0000 7fece65ff780 1 < completed delete operation key=CEERZVBJQHP0 tag=Y1XB6WKLZPCH type=del 2024-09-12T17:30:39.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.535+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=5KDGPT751KA7 type=del size=2558742 2024-09-12T17:30:39.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.536+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~3DLQ80L83XCS.0 size=1048576 2024-09-12T17:30:39.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.537+0000 7fece65ff780 1 < completed part key=_multipart_1G9VNO1V4IMW.2~3DLQ80L83XCS.1 size=292824 2024-09-12T17:30:39.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.539+0000 7fece65ff780 1 < completed multipart upload key=1G9VNO1V4IMW upload=3DLQ80L83XCS tag=4GFR4L36OMK9 type=write size=2389976 2024-09-12T17:30:39.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.541+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~7IU9NGDU4YV6.0 size=1048576 2024-09-12T17:30:39.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.542+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~7IU9NGDU4YV6.1 size=1048576 2024-09-12T17:30:39.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.543+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~7IU9NGDU4YV6.2 size=773840 2024-09-12T17:30:39.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.543+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=7IU9NGDU4YV6 tag=LS28OXF3TOEL type=write size=3919568 2024-09-12T17:30:39.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.545+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=RM2WRXYQCNE0 type=del 2024-09-12T17:30:39.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.547+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~WQ40J5HVK18V.0 size=1048576 2024-09-12T17:30:39.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.548+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~WQ40J5HVK18V.1 size=1048576 2024-09-12T17:30:39.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.549+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~WQ40J5HVK18V.2 size=239688 2024-09-12T17:30:39.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.549+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=WQ40J5HVK18V tag=BPU06YY05N7Y type=write size=3385416 2024-09-12T17:30:39.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.551+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~0098FYKCQWF6.0 size=1048576 2024-09-12T17:30:39.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.552+0000 7fece65ff780 1 < completed part key=_multipart_UCBB99EG8XK2.2~0098FYKCQWF6.1 size=509959 2024-09-12T17:30:39.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.554+0000 7fece65ff780 1 < completed multipart upload key=UCBB99EG8XK2 upload=0098FYKCQWF6 tag=EOGM2K1WMX3H type=write size=2607111 2024-09-12T17:30:39.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.557+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~UFWS5JCTHCQ0.0 size=1048576 2024-09-12T17:30:39.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.558+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~UFWS5JCTHCQ0.1 size=682680 2024-09-12T17:30:39.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.558+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=UFWS5JCTHCQ0 tag=3CDGL2BP09IL type=write size=2779832 2024-09-12T17:30:39.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.559+0000 7fece65ff780 1 < completed delete operation key=Y1OT1OLGWB1Q tag=DD5UMM08C3KL type=del 2024-09-12T17:30:39.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.560+0000 7fece65ff780 1 > prepared operation key=W3MBKNIBLV7W tag=INKWCBNBFB1W type=del size=4137777 2024-09-12T17:30:39.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.562+0000 7fece65ff780 1 < completed part key=_multipart_RKFRKIENSBTO.2~VQEMH1R8PEGY.0 size=845254 2024-09-12T17:30:39.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.564+0000 7fece65ff780 1 < completed multipart upload key=RKFRKIENSBTO upload=VQEMH1R8PEGY tag=FUTHYWTCYSDJ type=write size=1893830 2024-09-12T17:30:39.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.566+0000 7fece65ff780 1 > prepared part key=_multipart_YCNQL8CUUGW7.2~VWYCD58PA26J.0 size=611453 2024-09-12T17:30:39.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.566+0000 7fece65ff780 1 > prepared multipart upload key=YCNQL8CUUGW7 upload=VWYCD58PA26J tag=E2L8Z6D46FEU type=write size=1660029 2024-09-12T17:30:39.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.567+0000 7fece65ff780 1 < completed delete operation key=OPMR1WMB14CA tag=EI564R3U6ZXY type=del 2024-09-12T17:30:39.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.569+0000 7fece65ff780 1 > prepared operation key=5LAOX5H1AQWJ tag=RLNY86ELAPE5 type=write size=1020917 2024-09-12T17:30:39.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.570+0000 7fece65ff780 1 < completed delete operation key=TLEZIJ4881G7 tag=W2THZAXZ2YVY type=del 2024-09-12T17:30:39.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.572+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=2J04MGNIGSN6 type=del size=3833136 2024-09-12T17:30:39.575 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.573+0000 7fece65ff780 1 < completed write operation key=Q00ZFG0BBDG5 tag=I9TL0AX3ZPFE type=write size=976848 2024-09-12T17:30:39.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.575+0000 7fece65ff780 1 > prepared operation key=807GX4RQQLL4 tag=6WZOXABS10XT type=del size=190597 2024-09-12T17:30:39.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.577+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~3ZP7E5G35H15.0 size=1048576 2024-09-12T17:30:39.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.578+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~3ZP7E5G35H15.1 size=1048576 2024-09-12T17:30:39.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.579+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~3ZP7E5G35H15.2 size=120435 2024-09-12T17:30:39.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.582+0000 7fece65ff780 1 < completed multipart upload key=5A7WPGW5P91B upload=3ZP7E5G35H15 tag=HZI51RMJFWZ5 type=write size=3266163 2024-09-12T17:30:39.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.583+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=QDARKFMOQNXM type=del size=3939962 2024-09-12T17:30:39.586 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.584+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=MZLHEY056CSL type=del 2024-09-12T17:30:39.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.587+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~7Z8PHPMXFDOP.0 size=1048576 2024-09-12T17:30:39.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.588+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~7Z8PHPMXFDOP.1 size=1048576 2024-09-12T17:30:39.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.589+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~7Z8PHPMXFDOP.2 size=64090 2024-09-12T17:30:39.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.589+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=7Z8PHPMXFDOP tag=66PZBVH4X424 type=write size=3209818 2024-09-12T17:30:39.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.590+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~T925D5TWJNQB.0 size=1048576 2024-09-12T17:30:39.593 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.592+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~T925D5TWJNQB.1 size=1048576 2024-09-12T17:30:39.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.593+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~T925D5TWJNQB.2 size=808868 2024-09-12T17:30:39.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.595+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=T925D5TWJNQB tag=DWTH7F0X4Q99 type=write size=3954596 2024-09-12T17:30:39.599 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.598+0000 7fece65ff780 1 > prepared part key=_multipart_OIHDAJMPUK4I.2~YB9YT5R4DL1O.0 size=383668 2024-09-12T17:30:39.599 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.598+0000 7fece65ff780 1 > prepared multipart upload key=OIHDAJMPUK4I upload=YB9YT5R4DL1O tag=D6K47DVJETJ0 type=write size=1432244 2024-09-12T17:30:39.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.599+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~11T2I64KFZQW.0 size=1048576 2024-09-12T17:30:39.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.600+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~11T2I64KFZQW.1 size=897892 2024-09-12T17:30:39.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.603+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=11T2I64KFZQW tag=A3P1BBVCDZNU type=write size=2995044 2024-09-12T17:30:39.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.604+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=OUW043LK3A7J type=del size=52564 2024-09-12T17:30:39.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.607+0000 7fece65ff780 1 < suggested remove operation key=2HTNXL56URAK tag=2VQYKUK5BPNO type=del 2024-09-12T17:30:39.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.609+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=O917GEEDEMWE type=write size=921750 2024-09-12T17:30:39.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.610+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=LAW060BBOETR type=del 2024-09-12T17:30:39.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.613+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~8O82SVGGBSRX.0 size=803637 2024-09-12T17:30:39.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.613+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=8O82SVGGBSRX tag=LAGJIQV1K731 type=write size=1852213 2024-09-12T17:30:39.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.614+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~70DPE9C0059J.0 size=1048576 2024-09-12T17:30:39.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.615+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~70DPE9C0059J.1 size=455303 2024-09-12T17:30:39.619 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.618+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=70DPE9C0059J tag=E1B1H69GJYP8 type=write size=2552455 2024-09-12T17:30:39.621 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.620+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~YRQ9QOC12XL6.0 size=1048576 2024-09-12T17:30:39.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.621+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~YRQ9QOC12XL6.1 size=1048576 2024-09-12T17:30:39.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.622+0000 7fece65ff780 1 > prepared part key=_multipart_9IGJG88NX1FS.2~YRQ9QOC12XL6.2 size=9044 2024-09-12T17:30:39.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.622+0000 7fece65ff780 1 > prepared multipart upload key=9IGJG88NX1FS upload=YRQ9QOC12XL6 tag=9YE1EC0GE3CN type=write size=3154772 2024-09-12T17:30:39.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.623+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=5KDGPT751KA7 type=del 2024-09-12T17:30:39.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.625+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~TQ8ZE3GMKMCQ.0 size=663355 2024-09-12T17:30:39.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.625+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=TQ8ZE3GMKMCQ tag=O7LRVPJI17CX type=write size=1711931 2024-09-12T17:30:39.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.626+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~7IU9NGDU4YV6.0 size=1048576 2024-09-12T17:30:39.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.627+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~7IU9NGDU4YV6.1 size=1048576 2024-09-12T17:30:39.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.629+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~7IU9NGDU4YV6.2 size=773840 2024-09-12T17:30:39.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.631+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=7IU9NGDU4YV6 tag=LS28OXF3TOEL type=write size=3919568 2024-09-12T17:30:39.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.633+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~ZZXHXGMGJTKZ.0 size=1048576 2024-09-12T17:30:39.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.634+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~ZZXHXGMGJTKZ.1 size=1048576 2024-09-12T17:30:39.637 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.635+0000 7fece65ff780 1 > prepared part key=_multipart_5LAOX5H1AQWJ.2~ZZXHXGMGJTKZ.2 size=244019 2024-09-12T17:30:39.637 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.635+0000 7fece65ff780 1 > prepared multipart upload key=5LAOX5H1AQWJ upload=ZZXHXGMGJTKZ tag=1CUAS4T89MP5 type=write size=3389747 2024-09-12T17:30:39.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.636+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~WQ40J5HVK18V.0 size=1048576 2024-09-12T17:30:39.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.637+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~WQ40J5HVK18V.1 size=1048576 2024-09-12T17:30:39.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.638+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~WQ40J5HVK18V.2 size=239688 2024-09-12T17:30:39.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.640+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=WQ40J5HVK18V tag=BPU06YY05N7Y type=write size=3385416 2024-09-12T17:30:39.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.642+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~NUYPRKWJWV1V.0 size=553287 2024-09-12T17:30:39.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.642+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=NUYPRKWJWV1V tag=5F06PESBFO6F type=write size=1601863 2024-09-12T17:30:39.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.644+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~UFWS5JCTHCQ0.0 size=1048576 2024-09-12T17:30:39.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.646+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~UFWS5JCTHCQ0.1 size=682680 2024-09-12T17:30:39.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.649+0000 7fece65ff780 1 < completed multipart upload key=W3MBKNIBLV7W upload=UFWS5JCTHCQ0 tag=3CDGL2BP09IL type=write size=2779832 2024-09-12T17:30:39.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.650+0000 7fece65ff780 1 > prepared operation key=6GUDX5I1AKNH tag=UW1MT5O9D1U2 type=del size=3074102 2024-09-12T17:30:39.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.653+0000 7fece65ff780 1 < suggested update operation key=W3MBKNIBLV7W tag=INKWCBNBFB1W type=del size=4137777 2024-09-12T17:30:39.655 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.654+0000 7fece65ff780 1 > prepared operation key=I7TGK5A3JHH5 tag=39USM2R3OFMZ type=del size=2742566 2024-09-12T17:30:39.657 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.655+0000 7fece65ff780 1 < completed part key=_multipart_YCNQL8CUUGW7.2~VWYCD58PA26J.0 size=611453 2024-09-12T17:30:39.658 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.657+0000 7fece65ff780 1 < completed multipart upload key=YCNQL8CUUGW7 upload=VWYCD58PA26J tag=E2L8Z6D46FEU type=write size=1660029 2024-09-12T17:30:39.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.658+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=YHVXVAKHOG4L type=del size=3239904 2024-09-12T17:30:39.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.660+0000 7fece65ff780 1 < suggested remove operation key=5LAOX5H1AQWJ tag=RLNY86ELAPE5 type=write 2024-09-12T17:30:39.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.662+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~D0N98P2DEQ0O.0 size=1048576 2024-09-12T17:30:39.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.663+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~D0N98P2DEQ0O.1 size=1048576 2024-09-12T17:30:39.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.664+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~D0N98P2DEQ0O.2 size=247819 2024-09-12T17:30:39.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.664+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=D0N98P2DEQ0O tag=CTPVEOX7XZCR type=write size=3393547 2024-09-12T17:30:39.667 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.665+0000 7fece65ff780 1 < completed delete operation key=5A7WPGW5P91B tag=2J04MGNIGSN6 type=del 2024-09-12T17:30:39.668 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.667+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=LI5UYZGA24NS type=del size=989773 2024-09-12T17:30:39.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.668+0000 7fece65ff780 1 < completed delete operation key=807GX4RQQLL4 tag=6WZOXABS10XT type=del 2024-09-12T17:30:39.671 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.669+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=EEXTWZTPE9OH type=del size=1690876 2024-09-12T17:30:39.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.672+0000 7fece65ff780 1 < suggested remove operation key=TLEZIJ4881G7 tag=QDARKFMOQNXM type=del 2024-09-12T17:30:39.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.674+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~IAWEJF94BLQ7.0 size=1048576 2024-09-12T17:30:39.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.675+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~IAWEJF94BLQ7.1 size=1048576 2024-09-12T17:30:39.678 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.676+0000 7fece65ff780 1 > prepared part key=_multipart_FX8VJO1YXJ4H.2~IAWEJF94BLQ7.2 size=238350 2024-09-12T17:30:39.678 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.676+0000 7fece65ff780 1 > prepared multipart upload key=FX8VJO1YXJ4H upload=IAWEJF94BLQ7 tag=N3XX2Q3RDJN2 type=write size=3384078 2024-09-12T17:30:39.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.678+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~7Z8PHPMXFDOP.0 size=1048576 2024-09-12T17:30:39.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.678+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~7Z8PHPMXFDOP.1 size=1048576 2024-09-12T17:30:39.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.679+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~7Z8PHPMXFDOP.2 size=64090 2024-09-12T17:30:39.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.682+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=7Z8PHPMXFDOP tag=66PZBVH4X424 type=write size=3209818 2024-09-12T17:30:39.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.683+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=ADB97QKS513Y type=write size=613175 2024-09-12T17:30:39.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.684+0000 7fece65ff780 1 < completed part key=_multipart_OIHDAJMPUK4I.2~YB9YT5R4DL1O.0 size=383668 2024-09-12T17:30:39.688 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.687+0000 7fece65ff780 1 < completed multipart upload key=OIHDAJMPUK4I upload=YB9YT5R4DL1O tag=D6K47DVJETJ0 type=write size=1432244 2024-09-12T17:30:39.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.689+0000 7fece65ff780 1 > prepared part key=_multipart_ZEFSNR1IIA10.2~U4FZIZ7RR4D1.0 size=317166 2024-09-12T17:30:39.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.689+0000 7fece65ff780 1 > prepared multipart upload key=ZEFSNR1IIA10 upload=U4FZIZ7RR4D1 tag=SV8OBB2URJGT type=write size=1365742 2024-09-12T17:30:39.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.690+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=OUW043LK3A7J type=del 2024-09-12T17:30:39.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.692+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=ZJBA45E5A5XM type=write size=868238 2024-09-12T17:30:39.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.693+0000 7fece65ff780 1 < completed write operation key=I31CKY20NO9S tag=O917GEEDEMWE type=write size=921750 2024-09-12T17:30:39.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.694+0000 7fece65ff780 1 > prepared operation key=6CCPZ4TVIU5N tag=W2JKLNTKZ27A type=write size=747479 2024-09-12T17:30:39.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.696+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~8O82SVGGBSRX.0 size=803637 2024-09-12T17:30:39.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.698+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=8O82SVGGBSRX tag=LAGJIQV1K731 type=write size=1852213 2024-09-12T17:30:39.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.699+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=BZUNJ4QXI02T type=del size=3773679 2024-09-12T17:30:39.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.700+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~YRQ9QOC12XL6.0 size=1048576 2024-09-12T17:30:39.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.701+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~YRQ9QOC12XL6.1 size=1048576 2024-09-12T17:30:39.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.702+0000 7fece65ff780 1 < completed part key=_multipart_9IGJG88NX1FS.2~YRQ9QOC12XL6.2 size=9044 2024-09-12T17:30:39.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.704+0000 7fece65ff780 1 < completed multipart upload key=9IGJG88NX1FS upload=YRQ9QOC12XL6 tag=9YE1EC0GE3CN type=write size=3154772 2024-09-12T17:30:39.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.705+0000 7fece65ff780 1 > prepared operation key=7AS5L998SDV7 tag=VMWOOGT4R48A type=del size=3746224 2024-09-12T17:30:39.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.707+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~TQ8ZE3GMKMCQ.0 size=663355 2024-09-12T17:30:39.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.709+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=TQ8ZE3GMKMCQ tag=O7LRVPJI17CX type=write size=1711931 2024-09-12T17:30:39.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.711+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=6SAVD2Q095ST type=del size=3079776 2024-09-12T17:30:39.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.712+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~ZZXHXGMGJTKZ.0 size=1048576 2024-09-12T17:30:39.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.713+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~ZZXHXGMGJTKZ.1 size=1048576 2024-09-12T17:30:39.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.714+0000 7fece65ff780 1 < completed part key=_multipart_5LAOX5H1AQWJ.2~ZZXHXGMGJTKZ.2 size=244019 2024-09-12T17:30:39.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.716+0000 7fece65ff780 1 < completed multipart upload key=5LAOX5H1AQWJ upload=ZZXHXGMGJTKZ tag=1CUAS4T89MP5 type=write size=3389747 2024-09-12T17:30:39.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.717+0000 7fece65ff780 1 > prepared operation key=KKU8T0CVS40V tag=OXCXMNYDMS7S type=del size=3130336 2024-09-12T17:30:39.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.718+0000 7fece65ff780 1 < canceled part key=_multipart_FX8VJO1YXJ4H.2~NUYPRKWJWV1V.0 size=553287 2024-09-12T17:30:39.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.720+0000 7fece65ff780 1 < canceled multipart upload key=FX8VJO1YXJ4H upload=NUYPRKWJWV1V tag=5F06PESBFO6F type=write size=1601863 2024-09-12T17:30:39.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.721+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=1IBBJY9K99XS type=del size=722895 2024-09-12T17:30:39.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.723+0000 7fece65ff780 1 < canceled operation key=6GUDX5I1AKNH tag=UW1MT5O9D1U2 type=del size=3074102 2024-09-12T17:30:39.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.725+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~077G0LETNIRL.0 size=627882 2024-09-12T17:30:39.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.725+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=077G0LETNIRL tag=Q1A2QIEZA84Q type=write size=1676458 2024-09-12T17:30:39.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.726+0000 7fece65ff780 1 < completed delete operation key=I7TGK5A3JHH5 tag=39USM2R3OFMZ type=del 2024-09-12T17:30:39.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.727+0000 7fece65ff780 1 > prepared operation key=FX8VJO1YXJ4H tag=56P7AI02OQEX type=write size=454001 2024-09-12T17:30:39.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.729+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=YHVXVAKHOG4L type=del 2024-09-12T17:30:39.733 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.731+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~8CLGP7006EV2.0 size=1048576 2024-09-12T17:30:39.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.732+0000 7fece65ff780 1 > prepared part key=_multipart_Q00ZFG0BBDG5.2~8CLGP7006EV2.1 size=16580 2024-09-12T17:30:39.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.732+0000 7fece65ff780 1 > prepared multipart upload key=Q00ZFG0BBDG5 upload=8CLGP7006EV2 tag=508FAE33D7GA type=write size=2113732 2024-09-12T17:30:39.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.733+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~D0N98P2DEQ0O.0 size=1048576 2024-09-12T17:30:39.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.735+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~D0N98P2DEQ0O.1 size=1048576 2024-09-12T17:30:39.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.735+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~D0N98P2DEQ0O.2 size=247819 2024-09-12T17:30:39.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.737+0000 7fece65ff780 1 < completed multipart upload key=FX8VJO1YXJ4H upload=D0N98P2DEQ0O tag=CTPVEOX7XZCR type=write size=3393547 2024-09-12T17:30:39.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.740+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~1SW6DJMVS2CQ.0 size=1048576 2024-09-12T17:30:39.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.741+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~1SW6DJMVS2CQ.1 size=1048576 2024-09-12T17:30:39.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.742+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~1SW6DJMVS2CQ.2 size=656835 2024-09-12T17:30:39.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.742+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=1SW6DJMVS2CQ tag=RZMHIM2COQDA type=write size=3802563 2024-09-12T17:30:39.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.743+0000 7fece65ff780 1 < completed delete operation key=FX8VJO1YXJ4H tag=LI5UYZGA24NS type=del 2024-09-12T17:30:39.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.746+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~E721B4EP43P9.0 size=613621 2024-09-12T17:30:39.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.746+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=E721B4EP43P9 tag=L0VU7NFCZVMY type=write size=1662197 2024-09-12T17:30:39.748 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.747+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=EEXTWZTPE9OH type=del 2024-09-12T17:30:39.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.748+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=GPS6O0EA72U6 type=del size=700126 2024-09-12T17:30:39.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.749+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~IAWEJF94BLQ7.0 size=1048576 2024-09-12T17:30:39.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.749+0000 7fece65ff780 1 < canceled part key=_multipart_FX8VJO1YXJ4H.2~IAWEJF94BLQ7.1 size=1048576 2024-09-12T17:30:39.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.750+0000 7fece65ff780 1 < completed part key=_multipart_FX8VJO1YXJ4H.2~IAWEJF94BLQ7.2 size=238350 2024-09-12T17:30:39.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.752+0000 7fece65ff780 1 < canceled multipart upload key=FX8VJO1YXJ4H upload=IAWEJF94BLQ7 tag=N3XX2Q3RDJN2 type=write size=3384078 2024-09-12T17:30:39.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.753+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=URCHGHN5AI8O type=del size=3039932 2024-09-12T17:30:39.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.754+0000 7fece65ff780 1 < completed write operation key=TLEZIJ4881G7 tag=ADB97QKS513Y type=write size=613175 2024-09-12T17:30:39.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.756+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=DX509UQHVE1C type=del size=3477179 2024-09-12T17:30:39.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.757+0000 7fece65ff780 1 < completed part key=_multipart_ZEFSNR1IIA10.2~U4FZIZ7RR4D1.0 size=317166 2024-09-12T17:30:39.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.759+0000 7fece65ff780 1 < completed multipart upload key=ZEFSNR1IIA10 upload=U4FZIZ7RR4D1 tag=SV8OBB2URJGT type=write size=1365742 2024-09-12T17:30:39.762 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.761+0000 7fece65ff780 1 > prepared part key=_multipart_OPMR1WMB14CA.2~R9W7U58EVR2Z.0 size=415985 2024-09-12T17:30:39.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.761+0000 7fece65ff780 1 > prepared multipart upload key=OPMR1WMB14CA upload=R9W7U58EVR2Z tag=HXAWJP6WW6GJ type=write size=1464561 2024-09-12T17:30:39.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.764+0000 7fece65ff780 1 < suggested update operation key=TLEZIJ4881G7 tag=ZJBA45E5A5XM type=write size=868238 2024-09-12T17:30:39.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.766+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~0JKT19NA6FIN.0 size=178351 2024-09-12T17:30:39.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.766+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=0JKT19NA6FIN tag=ZHLFVNPO6LBV type=write size=1226927 2024-09-12T17:30:39.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.768+0000 7fece65ff780 1 < completed write operation key=6CCPZ4TVIU5N tag=W2JKLNTKZ27A type=write size=747479 2024-09-12T17:30:39.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.769+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=RAKF5QDZV08S type=del size=1584858 2024-09-12T17:30:39.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.771+0000 7fece65ff780 1 < suggested remove operation key=CBYI6C1ICE08 tag=BZUNJ4QXI02T type=del 2024-09-12T17:30:39.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.773+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~TWK1AJCEYCS5.0 size=1048576 2024-09-12T17:30:39.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.774+0000 7fece65ff780 1 > prepared part key=_multipart_CEERZVBJQHP0.2~TWK1AJCEYCS5.1 size=359784 2024-09-12T17:30:39.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.774+0000 7fece65ff780 1 > prepared multipart upload key=CEERZVBJQHP0 upload=TWK1AJCEYCS5 tag=EP0DXSA5ICU2 type=write size=2456936 2024-09-12T17:30:39.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.775+0000 7fece65ff780 1 < completed delete operation key=7AS5L998SDV7 tag=VMWOOGT4R48A type=del 2024-09-12T17:30:39.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.776+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=RQTVIOPD7A2L type=del size=1230458 2024-09-12T17:30:39.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.778+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=6SAVD2Q095ST type=del 2024-09-12T17:30:39.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.780+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~UP00HMERXT7D.0 size=1048576 2024-09-12T17:30:39.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.781+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~UP00HMERXT7D.1 size=1048576 2024-09-12T17:30:39.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.782+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~UP00HMERXT7D.2 size=7252 2024-09-12T17:30:39.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.782+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=UP00HMERXT7D tag=637W17BAXPN9 type=write size=3152980 2024-09-12T17:30:39.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.783+0000 7fece65ff780 1 < completed delete operation key=KKU8T0CVS40V tag=OXCXMNYDMS7S type=del 2024-09-12T17:30:39.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.785+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~W782CYPI69B2.0 size=755435 2024-09-12T17:30:39.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.785+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=W782CYPI69B2 tag=TGFMDQ9LHUWI type=write size=1804011 2024-09-12T17:30:39.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.787+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=1IBBJY9K99XS type=del 2024-09-12T17:30:39.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.788+0000 7fece65ff780 1 > prepared operation key=I31CKY20NO9S tag=VR95K3VX010B type=del size=2898576 2024-09-12T17:30:39.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.789+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~077G0LETNIRL.0 size=627882 2024-09-12T17:30:39.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.791+0000 7fece65ff780 1 < completed multipart upload key=807GX4RQQLL4 upload=077G0LETNIRL tag=Q1A2QIEZA84Q type=write size=1676458 2024-09-12T17:30:39.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.792+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=1GQNBSKK5HFC type=write size=29039 2024-09-12T17:30:39.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.795+0000 7fece65ff780 1 < suggested update operation key=FX8VJO1YXJ4H tag=56P7AI02OQEX type=write size=454001 2024-09-12T17:30:39.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.796+0000 7fece65ff780 1 > prepared operation key=Y30269Q7R340 tag=IZNPPRTRK92A type=del size=3466021 2024-09-12T17:30:39.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.797+0000 7fece65ff780 1 < completed part key=_multipart_Q00ZFG0BBDG5.2~8CLGP7006EV2.0 size=1048576 2024-09-12T17:30:39.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.797+0000 7fece65ff780 1 < canceled part key=_multipart_Q00ZFG0BBDG5.2~8CLGP7006EV2.1 size=16580 2024-09-12T17:30:39.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.799+0000 7fece65ff780 1 < canceled multipart upload key=Q00ZFG0BBDG5 upload=8CLGP7006EV2 tag=508FAE33D7GA type=write size=2113732 2024-09-12T17:30:39.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.802+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~JW1RN7GBARYK.0 size=1048576 2024-09-12T17:30:39.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.804+0000 7fece65ff780 1 > prepared part key=_multipart_UN6FLMRMAPUS.2~JW1RN7GBARYK.1 size=1005588 2024-09-12T17:30:39.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.804+0000 7fece65ff780 1 > prepared multipart upload key=UN6FLMRMAPUS upload=JW1RN7GBARYK tag=PDTD0GSUM3PQ type=write size=3102740 2024-09-12T17:30:39.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.805+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~1SW6DJMVS2CQ.0 size=1048576 2024-09-12T17:30:39.807 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.806+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~1SW6DJMVS2CQ.1 size=1048576 2024-09-12T17:30:39.808 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.807+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~1SW6DJMVS2CQ.2 size=656835 2024-09-12T17:30:39.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.810+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=1SW6DJMVS2CQ tag=RZMHIM2COQDA type=write size=3802563 2024-09-12T17:30:39.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.813+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~U7LGQ3CRN9X8.0 size=1048576 2024-09-12T17:30:39.816 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.814+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~U7LGQ3CRN9X8.1 size=1048576 2024-09-12T17:30:39.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.815+0000 7fece65ff780 1 > prepared part key=_multipart_KKU8T0CVS40V.2~U7LGQ3CRN9X8.2 size=924548 2024-09-12T17:30:39.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.815+0000 7fece65ff780 1 > prepared multipart upload key=KKU8T0CVS40V upload=U7LGQ3CRN9X8 tag=8E9CPEHH5MP4 type=write size=4070276 2024-09-12T17:30:39.818 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.816+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~E721B4EP43P9.0 size=613621 2024-09-12T17:30:39.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.818+0000 7fece65ff780 1 < completed multipart upload key=5A7WPGW5P91B upload=E721B4EP43P9 tag=L0VU7NFCZVMY type=write size=1662197 2024-09-12T17:30:39.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.820+0000 7fece65ff780 1 > prepared operation key=OIHDAJMPUK4I tag=YGDZZJE2EUWZ type=del size=3653516 2024-09-12T17:30:39.822 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.821+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=GPS6O0EA72U6 type=del 2024-09-12T17:30:39.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.823+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~9YI8WDM1IYM4.0 size=659229 2024-09-12T17:30:39.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.823+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=9YI8WDM1IYM4 tag=4GY09YT9YKN2 type=write size=1707805 2024-09-12T17:30:39.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.824+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=URCHGHN5AI8O type=del 2024-09-12T17:30:39.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.827+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~9ZLOB9ZEOE4E.0 size=1048576 2024-09-12T17:30:39.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.828+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~9ZLOB9ZEOE4E.1 size=451769 2024-09-12T17:30:39.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.828+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=9ZLOB9ZEOE4E tag=Z2F5H5WNR1F3 type=write size=2548921 2024-09-12T17:30:39.831 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.829+0000 7fece65ff780 1 < completed delete operation key=UN6FLMRMAPUS tag=DX509UQHVE1C type=del 2024-09-12T17:30:39.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.830+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=3OMGVX856PBW type=write size=555590 2024-09-12T17:30:39.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.831+0000 7fece65ff780 1 < completed part key=_multipart_OPMR1WMB14CA.2~R9W7U58EVR2Z.0 size=415985 2024-09-12T17:30:39.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.833+0000 7fece65ff780 1 < completed multipart upload key=OPMR1WMB14CA upload=R9W7U58EVR2Z tag=HXAWJP6WW6GJ type=write size=1464561 2024-09-12T17:30:39.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.835+0000 7fece65ff780 1 > prepared operation key=2HTNXL56URAK tag=Z3FE2RFGVDKM type=del size=2751438 2024-09-12T17:30:39.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.836+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~0JKT19NA6FIN.0 size=178351 2024-09-12T17:30:39.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.838+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=0JKT19NA6FIN tag=ZHLFVNPO6LBV type=write size=1226927 2024-09-12T17:30:39.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.840+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~WFIBTMMCE5AR.0 size=1048576 2024-09-12T17:30:39.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.841+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~WFIBTMMCE5AR.1 size=1048576 2024-09-12T17:30:39.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.842+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~WFIBTMMCE5AR.2 size=1032804 2024-09-12T17:30:39.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.842+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=WFIBTMMCE5AR tag=QUPM0JNSM13Z type=write size=4178532 2024-09-12T17:30:39.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.844+0000 7fece65ff780 1 < canceled operation key=5A7WPGW5P91B tag=RAKF5QDZV08S type=del size=1584858 2024-09-12T17:30:39.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.845+0000 7fece65ff780 1 > prepared operation key=YCNQL8CUUGW7 tag=OGDDLPV3LMM4 type=del size=2485364 2024-09-12T17:30:39.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.846+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~TWK1AJCEYCS5.0 size=1048576 2024-09-12T17:30:39.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.847+0000 7fece65ff780 1 < completed part key=_multipart_CEERZVBJQHP0.2~TWK1AJCEYCS5.1 size=359784 2024-09-12T17:30:39.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.849+0000 7fece65ff780 1 < completed multipart upload key=CEERZVBJQHP0 upload=TWK1AJCEYCS5 tag=EP0DXSA5ICU2 type=write size=2456936 2024-09-12T17:30:39.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.851+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~ZHILGF3NT1RW.0 size=1048576 2024-09-12T17:30:39.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.852+0000 7fece65ff780 1 > prepared part key=_multipart_I7TGK5A3JHH5.2~ZHILGF3NT1RW.1 size=598 2024-09-12T17:30:39.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.852+0000 7fece65ff780 1 > prepared multipart upload key=I7TGK5A3JHH5 upload=ZHILGF3NT1RW tag=UEAD2G4IMX0R type=write size=2097750 2024-09-12T17:30:39.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.854+0000 7fece65ff780 1 < completed delete operation key=1G9VNO1V4IMW tag=RQTVIOPD7A2L type=del 2024-09-12T17:30:39.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.855+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=CW2STYVTUX1O type=write size=720779 2024-09-12T17:30:39.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.857+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~UP00HMERXT7D.0 size=1048576 2024-09-12T17:30:39.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.858+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~UP00HMERXT7D.1 size=1048576 2024-09-12T17:30:39.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.859+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~UP00HMERXT7D.2 size=7252 2024-09-12T17:30:39.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.861+0000 7fece65ff780 1 < completed multipart upload key=2HTNXL56URAK upload=UP00HMERXT7D tag=637W17BAXPN9 type=write size=3152980 2024-09-12T17:30:39.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.862+0000 7fece65ff780 1 > prepared operation key=QQNW20B28RJC tag=T5MAL8J6FJ03 type=del size=3960437 2024-09-12T17:30:39.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.863+0000 7fece65ff780 1 < completed part key=_multipart_5A7WPGW5P91B.2~W782CYPI69B2.0 size=755435 2024-09-12T17:30:39.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.865+0000 7fece65ff780 1 < completed multipart upload key=5A7WPGW5P91B upload=W782CYPI69B2 tag=TGFMDQ9LHUWI type=write size=1804011 2024-09-12T17:30:39.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.866+0000 7fece65ff780 1 > prepared operation key=CEERZVBJQHP0 tag=OTGDJUB94LW1 type=write size=421517 2024-09-12T17:30:39.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.868+0000 7fece65ff780 1 < completed delete operation key=I31CKY20NO9S tag=VR95K3VX010B type=del 2024-09-12T17:30:39.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.869+0000 7fece65ff780 1 > prepared operation key=RKFRKIENSBTO tag=D19R8CSEO3H0 type=del size=3662345 2024-09-12T17:30:39.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.870+0000 7fece65ff780 1 < completed write operation key=2HTNXL56URAK tag=1GQNBSKK5HFC type=write size=29039 2024-09-12T17:30:39.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.872+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~WVJ35P1CX9SQ.0 size=1048576 2024-09-12T17:30:39.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.873+0000 7fece65ff780 1 > prepared part key=_multipart_W3MBKNIBLV7W.2~WVJ35P1CX9SQ.1 size=918207 2024-09-12T17:30:39.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.873+0000 7fece65ff780 1 > prepared multipart upload key=W3MBKNIBLV7W upload=WVJ35P1CX9SQ tag=4RDE3SASQG2C type=write size=3015359 2024-09-12T17:30:39.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.876+0000 7fece65ff780 1 < suggested remove operation key=Y30269Q7R340 tag=IZNPPRTRK92A type=del 2024-09-12T17:30:39.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.878+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~EFXOD4OVWRJL.0 size=1048576 2024-09-12T17:30:39.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.881+0000 7fece65ff780 1 > prepared part key=_multipart_807GX4RQQLL4.2~EFXOD4OVWRJL.1 size=843515 2024-09-12T17:30:39.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.881+0000 7fece65ff780 1 > prepared multipart upload key=807GX4RQQLL4 upload=EFXOD4OVWRJL tag=GKI4NZD7UNOQ type=write size=2940667 2024-09-12T17:30:39.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.882+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~JW1RN7GBARYK.0 size=1048576 2024-09-12T17:30:39.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.883+0000 7fece65ff780 1 < completed part key=_multipart_UN6FLMRMAPUS.2~JW1RN7GBARYK.1 size=1005588 2024-09-12T17:30:39.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.885+0000 7fece65ff780 1 < completed multipart upload key=UN6FLMRMAPUS upload=JW1RN7GBARYK tag=PDTD0GSUM3PQ type=write size=3102740 2024-09-12T17:30:39.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.886+0000 7fece65ff780 1 > prepared operation key=UCBB99EG8XK2 tag=WDI951GXL97Y type=del size=2949469 2024-09-12T17:30:39.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.888+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~U7LGQ3CRN9X8.0 size=1048576 2024-09-12T17:30:39.890 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.889+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~U7LGQ3CRN9X8.1 size=1048576 2024-09-12T17:30:39.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.890+0000 7fece65ff780 1 < completed part key=_multipart_KKU8T0CVS40V.2~U7LGQ3CRN9X8.2 size=924548 2024-09-12T17:30:39.894 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.892+0000 7fece65ff780 1 < completed multipart upload key=KKU8T0CVS40V upload=U7LGQ3CRN9X8 tag=8E9CPEHH5MP4 type=write size=4070276 2024-09-12T17:30:39.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.894+0000 7fece65ff780 1 > prepared part key=_multipart_Y1OT1OLGWB1Q.2~9EA5JRGNN7AY.0 size=529369 2024-09-12T17:30:39.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.894+0000 7fece65ff780 1 > prepared multipart upload key=Y1OT1OLGWB1Q upload=9EA5JRGNN7AY tag=WG3DD191D28S type=write size=1577945 2024-09-12T17:30:39.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.896+0000 7fece65ff780 1 < completed delete operation key=OIHDAJMPUK4I tag=YGDZZJE2EUWZ type=del 2024-09-12T17:30:39.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.898+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~UEH3DRN12GBK.0 size=1048576 2024-09-12T17:30:39.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.899+0000 7fece65ff780 1 > prepared part key=_multipart_CBYI6C1ICE08.2~UEH3DRN12GBK.1 size=938067 2024-09-12T17:30:39.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.899+0000 7fece65ff780 1 > prepared multipart upload key=CBYI6C1ICE08 upload=UEH3DRN12GBK tag=BR714DDPALFT type=write size=3035219 2024-09-12T17:30:39.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.901+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~9YI8WDM1IYM4.0 size=659229 2024-09-12T17:30:39.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.903+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=9YI8WDM1IYM4 tag=4GY09YT9YKN2 type=write size=1707805 2024-09-12T17:30:39.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.905+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~B9KXFECSHT3I.0 size=1048576 2024-09-12T17:30:39.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.906+0000 7fece65ff780 1 > prepared part key=_multipart_5A7WPGW5P91B.2~B9KXFECSHT3I.1 size=367096 2024-09-12T17:30:39.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.906+0000 7fece65ff780 1 > prepared multipart upload key=5A7WPGW5P91B upload=B9KXFECSHT3I tag=T0ANLIG1FGED type=write size=2464248 2024-09-12T17:30:39.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.907+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~9ZLOB9ZEOE4E.0 size=1048576 2024-09-12T17:30:39.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.908+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~9ZLOB9ZEOE4E.1 size=451769 2024-09-12T17:30:39.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.911+0000 7fece65ff780 1 < completed multipart upload key=2HTNXL56URAK upload=9ZLOB9ZEOE4E tag=Z2F5H5WNR1F3 type=write size=2548921 2024-09-12T17:30:39.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.912+0000 7fece65ff780 1 > prepared operation key=CBYI6C1ICE08 tag=6WOJCVOG7SNN type=write size=780863 2024-09-12T17:30:39.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.913+0000 7fece65ff780 1 < completed write operation key=2HTNXL56URAK tag=3OMGVX856PBW type=write size=555590 2024-09-12T17:30:39.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.916+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~Z3I57L7ZN50V.0 size=1048576 2024-09-12T17:30:39.918 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.917+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~Z3I57L7ZN50V.1 size=1048576 2024-09-12T17:30:39.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.918+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~Z3I57L7ZN50V.2 size=948219 2024-09-12T17:30:39.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.918+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=Z3I57L7ZN50V tag=N302KMHGWNVF type=write size=4093947 2024-09-12T17:30:39.921 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.919+0000 7fece65ff780 1 < completed delete operation key=2HTNXL56URAK tag=Z3FE2RFGVDKM type=del 2024-09-12T17:30:39.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.922+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~RSPSL4L7F8GQ.0 size=1048576 2024-09-12T17:30:39.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.923+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~RSPSL4L7F8GQ.1 size=1048576 2024-09-12T17:30:39.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.924+0000 7fece65ff780 1 > prepared part key=_multipart_1G9VNO1V4IMW.2~RSPSL4L7F8GQ.2 size=707683 2024-09-12T17:30:39.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.924+0000 7fece65ff780 1 > prepared multipart upload key=1G9VNO1V4IMW upload=RSPSL4L7F8GQ tag=G8GAX65I0RQM type=write size=3853411 2024-09-12T17:30:39.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.926+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~WFIBTMMCE5AR.0 size=1048576 2024-09-12T17:30:39.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.926+0000 7fece65ff780 1 < canceled part key=_multipart_2HTNXL56URAK.2~WFIBTMMCE5AR.1 size=1048576 2024-09-12T17:30:39.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.927+0000 7fece65ff780 1 < completed part key=_multipart_2HTNXL56URAK.2~WFIBTMMCE5AR.2 size=1032804 2024-09-12T17:30:39.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.929+0000 7fece65ff780 1 < canceled multipart upload key=2HTNXL56URAK upload=WFIBTMMCE5AR tag=QUPM0JNSM13Z type=write size=4178532 2024-09-12T17:30:39.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.931+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~4BJAMXRD2BBB.0 size=854010 2024-09-12T17:30:39.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.931+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=4BJAMXRD2BBB tag=OZKZTPJES4R6 type=write size=1902586 2024-09-12T17:30:39.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.933+0000 7fece65ff780 1 < completed delete operation key=YCNQL8CUUGW7 tag=OGDDLPV3LMM4 type=del 2024-09-12T17:30:39.936 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.934+0000 7fece65ff780 1 > prepared operation key=9IGJG88NX1FS tag=6DNXE7U9Z6G8 type=del size=1543995 2024-09-12T17:30:39.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.936+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~ZHILGF3NT1RW.0 size=1048576 2024-09-12T17:30:39.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.937+0000 7fece65ff780 1 < completed part key=_multipart_I7TGK5A3JHH5.2~ZHILGF3NT1RW.1 size=598 2024-09-12T17:30:39.941 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.939+0000 7fece65ff780 1 < completed multipart upload key=I7TGK5A3JHH5 upload=ZHILGF3NT1RW tag=UEAD2G4IMX0R type=write size=2097750 2024-09-12T17:30:39.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.940+0000 7fece65ff780 1 > prepared operation key=UN6FLMRMAPUS tag=6RERK792VOG6 type=del size=2765982 2024-09-12T17:30:39.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.941+0000 7fece65ff780 1 < completed write operation key=UN6FLMRMAPUS tag=CW2STYVTUX1O type=write size=720779 2024-09-12T17:30:39.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.944+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~96NVT5XCICW2.0 size=1048576 2024-09-12T17:30:39.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.945+0000 7fece65ff780 1 > prepared part key=_multipart_6CCPZ4TVIU5N.2~96NVT5XCICW2.1 size=397777 2024-09-12T17:30:39.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.945+0000 7fece65ff780 1 > prepared multipart upload key=6CCPZ4TVIU5N upload=96NVT5XCICW2 tag=OLQL2Y1W1WPH type=write size=2494929 2024-09-12T17:30:39.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.946+0000 7fece65ff780 1 < completed delete operation key=QQNW20B28RJC tag=T5MAL8J6FJ03 type=del 2024-09-12T17:30:39.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.948+0000 7fece65ff780 1 > prepared operation key=Y1OT1OLGWB1Q tag=ZSGOD7RMPEDV type=write size=34083 2024-09-12T17:30:39.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.949+0000 7fece65ff780 1 < completed write operation key=CEERZVBJQHP0 tag=OTGDJUB94LW1 type=write size=421517 2024-09-12T17:30:39.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.951+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~PQ6E40VGWBMB.0 size=1048576 2024-09-12T17:30:39.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.953+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~PQ6E40VGWBMB.1 size=1048576 2024-09-12T17:30:39.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.954+0000 7fece65ff780 1 > prepared part key=_multipart_QQNW20B28RJC.2~PQ6E40VGWBMB.2 size=1018245 2024-09-12T17:30:39.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.954+0000 7fece65ff780 1 > prepared multipart upload key=QQNW20B28RJC upload=PQ6E40VGWBMB tag=6XKT0JRD40Z4 type=write size=4163973 2024-09-12T17:30:39.957 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.955+0000 7fece65ff780 1 < completed delete operation key=RKFRKIENSBTO tag=D19R8CSEO3H0 type=del 2024-09-12T17:30:39.959 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.958+0000 7fece65ff780 1 > prepared part key=_multipart_7AS5L998SDV7.2~9MWO3IB7XPPF.0 size=226056 2024-09-12T17:30:39.959 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.958+0000 7fece65ff780 1 > prepared multipart upload key=7AS5L998SDV7 upload=9MWO3IB7XPPF tag=5CUL1CW4EAEM type=write size=1274632 2024-09-12T17:30:39.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.959+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~WVJ35P1CX9SQ.0 size=1048576 2024-09-12T17:30:39.961 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.960+0000 7fece65ff780 1 < completed part key=_multipart_W3MBKNIBLV7W.2~WVJ35P1CX9SQ.1 size=918207 2024-09-12T17:30:39.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.962+0000 7fece65ff780 1 < completed multipart upload key=W3MBKNIBLV7W upload=WVJ35P1CX9SQ tag=4RDE3SASQG2C type=write size=3015359 2024-09-12T17:30:39.966 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.964+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~1WCYVV10ZIVL.0 size=1048576 2024-09-12T17:30:39.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.965+0000 7fece65ff780 1 > prepared part key=_multipart_2HTNXL56URAK.2~1WCYVV10ZIVL.1 size=519835 2024-09-12T17:30:39.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.965+0000 7fece65ff780 1 > prepared multipart upload key=2HTNXL56URAK upload=1WCYVV10ZIVL tag=1QL8OH6W252F type=write size=2616987 2024-09-12T17:30:39.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.966+0000 7fece65ff780 1 < canceled part key=_multipart_807GX4RQQLL4.2~EFXOD4OVWRJL.0 size=1048576 2024-09-12T17:30:39.968 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.967+0000 7fece65ff780 1 < completed part key=_multipart_807GX4RQQLL4.2~EFXOD4OVWRJL.1 size=843515 2024-09-12T17:30:39.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.969+0000 7fece65ff780 1 < canceled multipart upload key=807GX4RQQLL4 upload=EFXOD4OVWRJL tag=GKI4NZD7UNOQ type=write size=2940667 2024-09-12T17:30:39.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.971+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~Q3MOZOZE9EDT.0 size=1048576 2024-09-12T17:30:39.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.972+0000 7fece65ff780 1 > prepared part key=_multipart_I31CKY20NO9S.2~Q3MOZOZE9EDT.1 size=632566 2024-09-12T17:30:39.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.972+0000 7fece65ff780 1 > prepared multipart upload key=I31CKY20NO9S upload=Q3MOZOZE9EDT tag=IIA1XE7K1IFG type=write size=2729718 2024-09-12T17:30:39.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.973+0000 7fece65ff780 1 < completed delete operation key=UCBB99EG8XK2 tag=WDI951GXL97Y type=del 2024-09-12T17:30:39.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.974+0000 7fece65ff780 1 > prepared operation key=5A7WPGW5P91B tag=86NHYDOVYA27 type=del size=4170296 2024-09-12T17:30:39.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.975+0000 7fece65ff780 1 < completed part key=_multipart_Y1OT1OLGWB1Q.2~9EA5JRGNN7AY.0 size=529369 2024-09-12T17:30:39.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.977+0000 7fece65ff780 1 < completed multipart upload key=Y1OT1OLGWB1Q upload=9EA5JRGNN7AY tag=WG3DD191D28S type=write size=1577945 2024-09-12T17:30:39.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.979+0000 7fece65ff780 1 > prepared operation key=1G9VNO1V4IMW tag=DY6PY6RBN9A0 type=del size=945921 2024-09-12T17:30:39.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.980+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~UEH3DRN12GBK.0 size=1048576 2024-09-12T17:30:39.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.981+0000 7fece65ff780 1 < completed part key=_multipart_CBYI6C1ICE08.2~UEH3DRN12GBK.1 size=938067 2024-09-12T17:30:39.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.983+0000 7fece65ff780 1 < completed multipart upload key=CBYI6C1ICE08 upload=UEH3DRN12GBK tag=BR714DDPALFT type=write size=3035219 2024-09-12T17:30:39.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:30:39.984+0000 7fece65ff780 1 > prepared operation key=TLEZIJ4881G7 tag=QWDSZ0SNNZU2 type=del size=569071 2024-09-12T17:30:39.986 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] cls_rgw_stats.simulate (9593 ms) 2024-09-12T17:30:39.986 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 1 test from cls_rgw_stats (9593 ms total) 2024-09-12T17:30:39.986 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:30:39.986 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:30:40.834 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 1 test from 1 test suite ran. (12331 ms total) 2024-09-12T17:30:40.834 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 1 test. 2024-09-12T17:30:40.837 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:30:40.837 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:30:40.927 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T17:30:40.928 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T17:30:40.928 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T17:30:40.977 INFO:tasks.workunit.client.0.smithi044.stdout:Running main() from gmock_main.cc 2024-09-12T17:30:40.977 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T17:30:40.977 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:30:42.839 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 31 tests from CmpOmap 2024-09-12T17:30:42.839 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T17:30:42.857 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (19 ms) 2024-09-12T17:30:42.858 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T17:30:42.861 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (4 ms) 2024-09-12T17:30:42.861 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T17:30:42.864 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-12T17:30:42.865 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T17:30:42.868 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2024-09-12T17:30:42.868 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T17:30:42.874 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2024-09-12T17:30:42.875 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T17:30:42.881 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_u64 (7 ms) 2024-09-12T17:30:42.882 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T17:30:42.885 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (4 ms) 2024-09-12T17:30:42.885 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T17:30:42.888 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-09-12T17:30:42.888 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T17:30:42.893 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (5 ms) 2024-09-12T17:30:42.893 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T17:30:42.897 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2024-09-12T17:30:42.897 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T17:30:42.898 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T17:30:42.898 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T17:30:42.898 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (0 ms) 2024-09-12T17:30:42.898 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T17:30:42.906 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (8 ms) 2024-09-12T17:30:42.906 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T17:30:42.912 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (6 ms) 2024-09-12T17:30:42.913 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T17:30:42.920 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (8 ms) 2024-09-12T17:30:42.920 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T17:30:42.926 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (6 ms) 2024-09-12T17:30:42.927 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T17:30:42.935 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_str (9 ms) 2024-09-12T17:30:42.935 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T17:30:42.943 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (7 ms) 2024-09-12T17:30:42.943 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T17:30:42.945 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (2 ms) 2024-09-12T17:30:42.946 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T17:30:42.948 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-12T17:30:42.948 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T17:30:42.949 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-12T17:30:42.949 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T17:30:42.950 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2024-09-12T17:30:42.950 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T17:30:42.956 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-09-12T17:30:42.956 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T17:30:42.962 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2024-09-12T17:30:42.962 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T17:30:42.970 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (8 ms) 2024-09-12T17:30:42.970 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T17:30:42.978 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (8 ms) 2024-09-12T17:30:42.979 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T17:30:42.981 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (3 ms) 2024-09-12T17:30:42.981 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T17:30:42.984 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (2 ms) 2024-09-12T17:30:42.984 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T17:30:42.984 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-12T17:30:42.985 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T17:30:42.985 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-09-12T17:30:42.985 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T17:30:42.992 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-09-12T17:30:42.993 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 31 tests from CmpOmap (154 ms total) 2024-09-12T17:30:42.993 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:30:42.993 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:30:43.849 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 31 tests from 1 test suite ran. (2872 ms total) 2024-09-12T17:30:43.849 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 31 tests. 2024-09-12T17:30:43.853 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:30:43.853 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:30:43.897 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T17:30:43.899 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T17:30:43.899 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T17:30:43.986 INFO:tasks.workunit.client.0.smithi044.stdout:Running main() from gmock_main.cc 2024-09-12T17:30:43.986 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:30:43.986 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:30:43.986 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T17:30:43.987 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T17:30:46.866 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2878 ms) 2024-09-12T17:30:46.866 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T17:30:49.895 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3030 ms) 2024-09-12T17:30:49.895 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T17:30:52.909 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.Reserve (3015 ms) 2024-09-12T17:30:52.909 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T17:30:55.940 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3030 ms) 2024-09-12T17:30:55.940 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T17:30:58.952 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.Commit (3013 ms) 2024-09-12T17:30:58.952 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T17:31:01.982 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.Stats (3028 ms) 2024-09-12T17:31:01.982 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T17:31:06.003 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4022 ms) 2024-09-12T17:31:06.003 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T17:31:09.028 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.Abort (3025 ms) 2024-09-12T17:31:09.028 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T17:31:12.047 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.ReserveError (3020 ms) 2024-09-12T17:31:12.047 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T17:31:15.062 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.CommitError (3014 ms) 2024-09-12T17:31:15.062 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T17:31:18.081 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.AbortError (3020 ms) 2024-09-12T17:31:18.081 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T17:31:21.096 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3015 ms) 2024-09-12T17:31:21.097 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T17:31:24.116 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3020 ms) 2024-09-12T17:31:24.116 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T17:31:27.122 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3006 ms) 2024-09-12T17:31:27.123 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T17:31:30.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3021 ms) 2024-09-12T17:31:30.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T17:31:33.163 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3019 ms) 2024-09-12T17:31:33.163 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T17:31:36.186 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3023 ms) 2024-09-12T17:31:36.186 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T17:31:39.212 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.Cleanup (3026 ms) 2024-09-12T17:31:39.212 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T17:31:50.251 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.MultiProducer (11040 ms) 2024-09-12T17:31:50.251 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T17:31:53.265 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3013 ms) 2024-09-12T17:31:53.265 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T17:32:07.325 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14060 ms) 2024-09-12T17:32:07.326 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T17:32:11.357 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4033 ms) 2024-09-12T17:32:11.358 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T17:32:17.392 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6034 ms) 2024-09-12T17:32:17.393 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T17:32:22.437 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5042 ms) 2024-09-12T17:32:22.437 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 24 tests from TestCls2PCQueue (98447 ms total) 2024-09-12T17:32:22.437 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:32:22.437 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:32:22.437 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 24 tests from 1 test suite ran. (98447 ms total) 2024-09-12T17:32:22.437 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 24 tests. 2024-09-12T17:32:22.438 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:32:22.438 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:32:22.484 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T17:32:22.486 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T17:32:22.486 DEBUG:teuthology.orchestra.run.smithi044:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T17:32:22.541 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:22.542 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:22.542 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:32:22.542 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:32:24.430 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 4 tests from ClsAccount 2024-09-12T17:32:24.430 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsAccount.add 2024-09-12T17:32:24.455 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsAccount.add (26 ms) 2024-09-12T17:32:24.456 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsAccount.get 2024-09-12T17:32:24.461 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsAccount.get (6 ms) 2024-09-12T17:32:24.461 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsAccount.rm 2024-09-12T17:32:24.644 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsAccount.rm (183 ms) 2024-09-12T17:32:24.645 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] ClsAccount.list 2024-09-12T17:32:24.665 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] ClsAccount.list (21 ms) 2024-09-12T17:32:24.665 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 4 tests from ClsAccount (236 ms total) 2024-09-12T17:32:24.665 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:32:24.665 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:32:25.445 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 4 tests from 1 test suite ran. (2902 ms total) 2024-09-12T17:32:25.445 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 4 tests. 2024-09-12T17:32:25.450 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:32:25.450 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:32:25.495 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T17:32:25.496 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T17:32:25.496 DEBUG:teuthology.orchestra.run.smithi044:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T17:32:25.591 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:25.591 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:25.591 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T17:32:25.591 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:32:27.461 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T17:32:27.462 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T17:32:27.481 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] rgw_gc_log.init_existing_queue (19 ms) 2024-09-12T17:32:27.481 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T17:32:27.484 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2024-09-12T17:32:27.484 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T17:32:27.488 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (4 ms) 2024-09-12T17:32:27.488 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T17:32:27.489 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2024-09-12T17:32:27.489 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T17:32:27.493 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-12T17:32:27.493 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T17:32:27.494 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-12T17:32:27.494 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 6 tests from rgw_gc_log (33 ms total) 2024-09-12T17:32:27.494 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:32:27.494 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:32:28.471 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 6 tests from 1 test suite ran. (2879 ms total) 2024-09-12T17:32:28.471 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 6 tests. 2024-09-12T17:32:28.474 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:32:28.474 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:32:28.525 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T17:32:28.526 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T17:32:28.526 DEBUG:teuthology.orchestra.run.smithi044:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T17:32:28.633 INFO:tasks.workunit.client.0.smithi044.stdout:Running main() from gmock_main.cc 2024-09-12T17:32:28.633 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:32:28.633 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:32:28.633 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T17:32:28.633 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T17:32:28.633 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2024-09-12T17:32:28.633 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2024-09-12T17:32:28.633 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns= i= 2024-09-12T17:32:28.633 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2024-09-12T17:32:28.633 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2024-09-12T17:32:28.634 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns= i= 2024-09-12T17:32:28.634 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2024-09-12T17:32:28.634 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2024-09-12T17:32:28.634 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns= i= 2024-09-12T17:32:28.634 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.634 INFO:tasks.workunit.client.0.smithi044.stdout: "obj1": { 2024-09-12T17:32:28.634 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.635 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.635 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.635 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.635 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.635 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.635 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.635 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.635 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.635 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.635 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.635 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.635 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2024-09-12T17:32:28.635 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.635 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.636 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.636 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.636 INFO:tasks.workunit.client.0.smithi044.stdout: "obj2": { 2024-09-12T17:32:28.636 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.636 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.636 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.636 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.636 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.636 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.636 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.636 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.636 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.636 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.636 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.637 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.637 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2024-09-12T17:32:28.637 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.637 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.637 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.637 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.637 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3": { 2024-09-12T17:32:28.637 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.637 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.637 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.637 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.637 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.637 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.638 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.638 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.638 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.638 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.638 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.638 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.638 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2024-09-12T17:32:28.638 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.638 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.638 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.638 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.638 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3-2": { 2024-09-12T17:32:28.638 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.638 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.639 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.639 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.639 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.639 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.639 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.639 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.639 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.639 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.639 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.639 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.639 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2024-09-12T17:32:28.639 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.639 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.640 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.640 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.640 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.640 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2024-09-12T17:32:28.640 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2024-09-12T17:32:28.640 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns=ns i= 2024-09-12T17:32:28.640 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2024-09-12T17:32:28.640 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2024-09-12T17:32:28.640 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns=ns i= 2024-09-12T17:32:28.641 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2024-09-12T17:32:28.641 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj 2024-09-12T17:32:28.641 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns=ns i= 2024-09-12T17:32:28.641 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.641 INFO:tasks.workunit.client.0.smithi044.stdout: "obj1": { 2024-09-12T17:32:28.641 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.641 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.641 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.641 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.642 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.642 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.642 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.642 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.642 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.642 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.642 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.642 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.642 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2024-09-12T17:32:28.642 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.642 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.642 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.643 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.643 INFO:tasks.workunit.client.0.smithi044.stdout: "obj2": { 2024-09-12T17:32:28.643 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.643 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.643 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.643 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.643 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.643 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.643 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.643 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.643 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.643 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.643 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.643 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.644 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2024-09-12T17:32:28.644 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.644 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.644 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.644 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.644 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3": { 2024-09-12T17:32:28.644 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.644 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.645 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.645 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.645 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.645 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.645 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.645 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.645 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.645 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.645 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.645 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.645 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2024-09-12T17:32:28.645 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.645 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.645 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.646 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.646 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3-2": { 2024-09-12T17:32:28.646 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.646 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.646 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.646 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.646 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.646 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.646 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.646 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.646 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.646 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.646 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.646 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.647 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2024-09-12T17:32:28.647 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.647 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.647 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.647 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.647 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.647 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2024-09-12T17:32:28.647 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2024-09-12T17:32:28.647 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns= i=v1 2024-09-12T17:32:28.647 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2024-09-12T17:32:28.647 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2024-09-12T17:32:28.647 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns= i=v1 2024-09-12T17:32:28.647 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2024-09-12T17:32:28.647 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2024-09-12T17:32:28.648 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns= i=v1 2024-09-12T17:32:28.648 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.648 INFO:tasks.workunit.client.0.smithi044.stdout: "obj1": { 2024-09-12T17:32:28.648 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.648 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.648 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.648 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.648 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.648 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.648 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.648 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.648 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.648 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.649 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.649 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.649 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2024-09-12T17:32:28.649 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2024-09-12T17:32:28.649 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.649 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.649 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.649 INFO:tasks.workunit.client.0.smithi044.stdout: "obj2": { 2024-09-12T17:32:28.649 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.649 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.649 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.649 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.649 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.650 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.650 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.650 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.650 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.650 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.650 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.650 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.650 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2024-09-12T17:32:28.650 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2024-09-12T17:32:28.650 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.650 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.650 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.650 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3": { 2024-09-12T17:32:28.650 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.651 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.651 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.651 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.651 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.651 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.651 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.651 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.651 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.651 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.651 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.651 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.651 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2024-09-12T17:32:28.651 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.651 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.652 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.652 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.652 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3-2": { 2024-09-12T17:32:28.652 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.652 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.652 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.652 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.652 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.653 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.653 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.653 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.653 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.653 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.653 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.653 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.653 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2024-09-12T17:32:28.653 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2024-09-12T17:32:28.653 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.653 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.653 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.653 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.653 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2024-09-12T17:32:28.654 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2024-09-12T17:32:28.654 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:32:28.654 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2024-09-12T17:32:28.654 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2024-09-12T17:32:28.654 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:32:28.654 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2024-09-12T17:32:28.654 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: _obj[v1] 2024-09-12T17:32:28.654 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:32:28.654 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.654 INFO:tasks.workunit.client.0.smithi044.stdout: "obj1": { 2024-09-12T17:32:28.654 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.654 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.655 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.655 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.655 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.655 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.655 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.655 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.655 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.655 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.655 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.655 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.656 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2024-09-12T17:32:28.656 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2024-09-12T17:32:28.656 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.656 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.656 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.656 INFO:tasks.workunit.client.0.smithi044.stdout: "obj2": { 2024-09-12T17:32:28.656 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.656 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.656 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.656 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.656 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.656 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.656 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.656 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.657 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.657 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.657 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.657 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.657 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2024-09-12T17:32:28.657 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2024-09-12T17:32:28.657 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.657 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.657 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.657 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3": { 2024-09-12T17:32:28.657 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.657 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.657 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.657 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.658 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.658 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.658 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.658 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.658 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.658 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.658 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.658 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.658 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2024-09-12T17:32:28.658 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.658 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.658 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.658 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.658 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3-2": { 2024-09-12T17:32:28.659 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.659 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.659 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.659 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.659 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.659 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.659 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.659 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.659 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.659 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.659 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.659 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.659 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_obj", 2024-09-12T17:32:28.659 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2024-09-12T17:32:28.660 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.660 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.660 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.660 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.660 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T17:32:28.660 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T17:32:28.660 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2024-09-12T17:32:28.660 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2024-09-12T17:32:28.661 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns= i= 2024-09-12T17:32:28.661 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2024-09-12T17:32:28.661 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2024-09-12T17:32:28.661 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns= i= 2024-09-12T17:32:28.661 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2024-09-12T17:32:28.661 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2024-09-12T17:32:28.661 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns= i= 2024-09-12T17:32:28.661 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.661 INFO:tasks.workunit.client.0.smithi044.stdout: "obj1": { 2024-09-12T17:32:28.661 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.661 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.661 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.661 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.662 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.662 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.662 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.662 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.662 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.662 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.662 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.662 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.662 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2024-09-12T17:32:28.663 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.663 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.663 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.663 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.663 INFO:tasks.workunit.client.0.smithi044.stdout: "obj2": { 2024-09-12T17:32:28.663 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.663 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.663 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.663 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.663 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.663 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.663 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.663 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.664 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.664 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.664 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.664 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.664 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2024-09-12T17:32:28.664 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.664 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.664 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.664 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.664 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3": { 2024-09-12T17:32:28.664 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.664 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.664 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.664 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.665 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.665 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.665 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.665 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.665 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.665 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.665 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.665 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.666 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2024-09-12T17:32:28.666 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.666 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.666 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.666 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.666 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3-2": { 2024-09-12T17:32:28.666 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.666 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.666 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.666 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.666 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.666 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.666 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.666 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.667 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.667 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.667 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.667 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.667 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2024-09-12T17:32:28.667 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.667 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.667 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.667 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.667 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.667 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2024-09-12T17:32:28.667 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2024-09-12T17:32:28.667 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns=ns i= 2024-09-12T17:32:28.667 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2024-09-12T17:32:28.668 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2024-09-12T17:32:28.668 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns=ns i= 2024-09-12T17:32:28.668 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2024-09-12T17:32:28.668 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj 2024-09-12T17:32:28.668 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns=ns i= 2024-09-12T17:32:28.668 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.668 INFO:tasks.workunit.client.0.smithi044.stdout: "obj1": { 2024-09-12T17:32:28.668 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.668 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.668 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.668 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.668 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.668 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.668 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.669 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.669 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.669 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.669 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.669 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.669 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2024-09-12T17:32:28.669 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.669 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.669 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.669 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.669 INFO:tasks.workunit.client.0.smithi044.stdout: "obj2": { 2024-09-12T17:32:28.669 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.670 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.670 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.670 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.670 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.670 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.670 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.670 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.670 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.670 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.671 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.671 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.671 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2024-09-12T17:32:28.671 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.671 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.671 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.671 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.671 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3": { 2024-09-12T17:32:28.671 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.671 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.671 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.671 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.671 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.671 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.671 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.672 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.672 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.672 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.672 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.672 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.672 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2024-09-12T17:32:28.672 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.672 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.672 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.672 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.672 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3-2": { 2024-09-12T17:32:28.673 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.673 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.673 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.673 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.673 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.673 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.673 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.673 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.673 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.674 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.674 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.674 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.674 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2024-09-12T17:32:28.674 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.674 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.674 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.674 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.674 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.674 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2024-09-12T17:32:28.674 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2024-09-12T17:32:28.674 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns= i=v1 2024-09-12T17:32:28.674 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2024-09-12T17:32:28.674 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2024-09-12T17:32:28.675 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns= i=v1 2024-09-12T17:32:28.675 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2024-09-12T17:32:28.675 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2024-09-12T17:32:28.675 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns= i=v1 2024-09-12T17:32:28.675 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.675 INFO:tasks.workunit.client.0.smithi044.stdout: "obj1": { 2024-09-12T17:32:28.675 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.675 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.676 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.676 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.677 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.677 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.677 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.677 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.677 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.677 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.677 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.677 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.677 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2024-09-12T17:32:28.677 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2024-09-12T17:32:28.677 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.677 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.677 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.677 INFO:tasks.workunit.client.0.smithi044.stdout: "obj2": { 2024-09-12T17:32:28.678 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.678 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.678 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.678 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.678 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.678 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.678 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.678 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.678 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.678 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.678 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.678 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.678 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2024-09-12T17:32:28.679 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2024-09-12T17:32:28.679 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.679 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.679 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.679 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3": { 2024-09-12T17:32:28.679 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.679 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.679 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.679 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.679 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.679 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.679 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.679 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.679 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.680 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.680 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.680 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.680 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2024-09-12T17:32:28.680 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.680 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.680 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.680 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.680 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3-2": { 2024-09-12T17:32:28.680 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.680 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.680 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.680 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.680 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.681 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.681 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.681 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.681 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.681 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.681 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.681 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.681 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2024-09-12T17:32:28.681 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2024-09-12T17:32:28.681 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.682 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.682 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.682 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.682 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2024-09-12T17:32:28.682 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2024-09-12T17:32:28.682 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:32:28.682 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2024-09-12T17:32:28.682 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2024-09-12T17:32:28.682 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:32:28.682 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2024-09-12T17:32:28.682 INFO:tasks.workunit.client.0.smithi044.stdout:parsed: obj[v1] 2024-09-12T17:32:28.682 INFO:tasks.workunit.client.0.smithi044.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:32:28.682 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.682 INFO:tasks.workunit.client.0.smithi044.stdout: "obj1": { 2024-09-12T17:32:28.683 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.683 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.683 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.683 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.683 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.683 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.683 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.683 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.684 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.684 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.684 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.684 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.684 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2024-09-12T17:32:28.684 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2024-09-12T17:32:28.684 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.684 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.684 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.684 INFO:tasks.workunit.client.0.smithi044.stdout: "obj2": { 2024-09-12T17:32:28.684 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.684 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.684 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.684 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.685 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.685 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.685 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.685 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.685 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.685 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.685 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.685 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.685 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2024-09-12T17:32:28.685 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2024-09-12T17:32:28.685 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.685 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.685 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.685 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3": { 2024-09-12T17:32:28.686 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.686 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.686 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.686 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.686 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.686 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.686 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.686 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.687 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.687 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.687 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.687 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.687 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2024-09-12T17:32:28.687 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.687 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.687 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.687 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.687 INFO:tasks.workunit.client.0.smithi044.stdout: "obj3-2": { 2024-09-12T17:32:28.687 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.687 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.687 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.687 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.688 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.688 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.688 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.688 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.688 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.688 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.688 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.688 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.688 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "obj", 2024-09-12T17:32:28.688 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "v1", 2024-09-12T17:32:28.688 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.688 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.688 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.688 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.689 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T17:32:28.689 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T17:32:28.689 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.689 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.689 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.689 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.689 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.689 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.689 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.689 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.690 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.690 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.690 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.690 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.690 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.690 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.690 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.690 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.690 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.690 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.690 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.691 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.691 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.691 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.691 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.691 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.691 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.691 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.691 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.691 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.691 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.691 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.691 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.691 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.691 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.692 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.692 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.692 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2024-09-12T17:32:28.692 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker_myobj", 2024-09-12T17:32:28.692 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.692 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.692 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.692 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.692 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.692 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.692 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.692 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.692 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.693 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.693 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.693 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.693 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.693 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.693 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.693 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.693 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.693 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.693 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.694 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.694 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.694 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.694 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.694 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.694 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.694 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.695 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.695 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.695 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.695 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.695 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.695 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.695 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.696 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.696 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.696 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.696 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.696 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.696 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.696 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.696 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.696 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.696 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.697 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.697 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.697 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.697 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.697 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.697 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.697 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.697 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.698 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.698 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.698 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.698 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.698 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.698 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.698 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.698 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.699 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker_myobj", 2024-09-12T17:32:28.699 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.699 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.699 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.699 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.699 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.699 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.699 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.699 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.699 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.700 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.700 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.700 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.700 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.700 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.700 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.700 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.700 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.700 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.701 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.701 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.701 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.701 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.701 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.701 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.701 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.702 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.702 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.702 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.702 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.702 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.702 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.702 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.702 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.702 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.703 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.703 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.703 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.703 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.703 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.703 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.703 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.703 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.703 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.703 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.704 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.704 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.704 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.704 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.704 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.704 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.704 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.705 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.705 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.705 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.705 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.705 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.705 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.705 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.705 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2024-09-12T17:32:28.706 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:32:28.706 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.706 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.706 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.706 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.706 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.706 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.707 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.707 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.707 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.707 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.707 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.708 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.708 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.708 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.708 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.708 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.708 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.709 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.709 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.709 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.709 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.709 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.709 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.709 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.709 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.710 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.710 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.710 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.710 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.710 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.710 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.710 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.711 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.711 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.711 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.711 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.711 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.711 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.711 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.711 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.711 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.712 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.712 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.712 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.712 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.712 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.712 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.712 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.712 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.712 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.712 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.713 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.713 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.713 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.713 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.713 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.713 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.713 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.713 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.713 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:32:28.714 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.714 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.714 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.714 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.714 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.714 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.714 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.714 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.714 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.715 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.715 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.715 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.715 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.715 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.715 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.715 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.715 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.715 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.715 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.716 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.716 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.716 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.716 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.716 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.716 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.717 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.717 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.717 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.717 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.717 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.717 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.717 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.718 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.718 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.718 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.718 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.718 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.718 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.718 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.718 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.719 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.719 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.719 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.719 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.719 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.719 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.719 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.719 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.720 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.720 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.720 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.720 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.720 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.721 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.721 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.721 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.721 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.721 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.721 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2024-09-12T17:32:28.722 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:32:28.722 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.722 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.722 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.722 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.722 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.722 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.723 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.723 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.723 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.723 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.723 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.723 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.723 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.723 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.723 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.724 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.724 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.724 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.724 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.724 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.724 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.724 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.724 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.724 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.725 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.725 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.725 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.725 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.725 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.725 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.725 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.725 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.725 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.726 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.726 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.726 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.726 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.726 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.726 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.726 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.726 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.726 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.727 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.727 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.727 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.727 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.727 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.727 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.727 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.727 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.727 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.728 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.728 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.728 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.728 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.728 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.728 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.728 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.728 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.728 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:32:28.728 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.728 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.728 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.729 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.729 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.729 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.729 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.729 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.729 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.729 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.730 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.730 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.730 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.730 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.730 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.730 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.730 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.730 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.730 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.730 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.731 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.731 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.731 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.731 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.731 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.731 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.731 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.731 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.731 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.731 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.731 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.732 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.732 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.732 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.732 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.732 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.732 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.732 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.733 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.733 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.733 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.733 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.733 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.734 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.734 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.734 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.734 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.734 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.734 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.734 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.734 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.734 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.734 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.735 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.735 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.735 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.735 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.735 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.735 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2024-09-12T17:32:28.735 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:32:28.735 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.735 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.735 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.736 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.736 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.736 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.736 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.736 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.736 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.736 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.736 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.736 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.736 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.737 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.737 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.737 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.737 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.737 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.737 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.737 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.737 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.737 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.737 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.737 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.737 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.738 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.738 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.738 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.738 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.738 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.738 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.738 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.738 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.738 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.739 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.739 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.739 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.739 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.739 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.739 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.739 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.739 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.739 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.739 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.739 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.740 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.740 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.740 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.740 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.740 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.740 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.740 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.740 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.740 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.740 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.740 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.741 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.741 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.741 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.741 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:32:28.741 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.741 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.741 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.741 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.741 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.741 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.741 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.742 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.742 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.742 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.742 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.742 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.742 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.742 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.742 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.742 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.742 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.742 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.743 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.743 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.743 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.743 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.743 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.743 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.743 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.743 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.743 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.743 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.744 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.744 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.744 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.744 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.744 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.744 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.744 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.744 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.744 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.744 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.744 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.744 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.745 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.745 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.745 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.745 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.745 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.745 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.745 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.745 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.745 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.746 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.746 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.746 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.746 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.746 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.746 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.746 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.746 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.746 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.746 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2024-09-12T17:32:28.746 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker___myobj", 2024-09-12T17:32:28.746 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj" 2024-09-12T17:32:28.747 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.747 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.747 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.747 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.747 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.747 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.747 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.747 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.747 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.747 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.747 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.747 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.747 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.747 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.748 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.748 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.748 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.748 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.748 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.748 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.748 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.748 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.748 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.748 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.749 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.749 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.749 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.749 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.749 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.749 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.749 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.749 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.749 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.749 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.749 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.749 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.749 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.749 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.750 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.750 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.750 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.750 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.750 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.750 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.750 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.750 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.750 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.750 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.750 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker___myobj", 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj" 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.753 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.753 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.753 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.753 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.753 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.753 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.753 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.753 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.753 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.753 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.753 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.753 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.753 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.754 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.754 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.754 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.754 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.754 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.754 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.754 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.754 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.754 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.754 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.754 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.755 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.755 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.755 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.755 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.755 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.755 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.755 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.755 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.755 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.755 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.756 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.756 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.756 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.756 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.756 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.756 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.756 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.756 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.756 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2024-09-12T17:32:28.756 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:32:28.757 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.757 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.757 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.757 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.757 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.757 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.757 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.757 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.757 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.757 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.757 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.758 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.758 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.758 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.758 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.758 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.758 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.758 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.758 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.758 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.758 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.758 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.758 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.759 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.759 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.759 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.759 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.759 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.759 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.759 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.759 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.759 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.760 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.760 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.760 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.760 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.760 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.760 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.760 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.760 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.760 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.760 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.761 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.761 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.761 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.761 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.761 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.761 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.761 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.761 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.761 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.761 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.761 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.761 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.761 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.761 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.762 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.762 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.762 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.762 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:32:28.762 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.762 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.762 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.762 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.762 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.763 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.763 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.763 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.763 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.763 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.763 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.763 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.763 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.763 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.763 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.763 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.764 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.764 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.764 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.764 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.764 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.764 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.764 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.764 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.764 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.764 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.764 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.765 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.765 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.765 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.765 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.765 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.765 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.765 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.765 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.765 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.766 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.766 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.766 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.766 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.766 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.766 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.766 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.766 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.767 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.767 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.767 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.767 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.767 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.767 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.767 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.767 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.767 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.767 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.767 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.767 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.767 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.768 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.768 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2024-09-12T17:32:28.768 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:32:28.768 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj" 2024-09-12T17:32:28.768 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.768 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.768 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.768 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.768 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.768 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.768 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.768 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.768 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.768 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.769 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.769 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.769 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.769 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.769 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.769 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.769 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.769 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.769 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.769 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.769 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.769 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.769 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.769 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.770 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.770 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.770 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.770 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.770 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.770 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.770 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.770 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.770 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.770 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.770 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.770 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.770 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.770 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.771 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.771 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.771 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.771 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.771 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.771 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.771 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.771 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.771 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.771 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.771 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.771 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.771 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.771 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.772 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.772 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.772 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.772 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.772 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.772 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.772 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:32:28.772 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj" 2024-09-12T17:32:28.772 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.772 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.772 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.772 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.772 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.773 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.773 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.773 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.773 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.773 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.773 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.773 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.773 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.773 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.773 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.773 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.773 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.773 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.774 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.774 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.774 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.774 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.774 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.774 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.774 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.774 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.774 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.774 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.774 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.774 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.774 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.774 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.775 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.775 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.775 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.775 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.775 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.775 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.775 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.775 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.775 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.776 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.776 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.776 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.776 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.776 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.776 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.776 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.776 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.776 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.776 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.776 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.777 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.777 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.777 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.777 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.777 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.777 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2024-09-12T17:32:28.777 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:32:28.777 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.777 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.777 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.777 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.777 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.778 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.778 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.778 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.778 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.778 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.778 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.778 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.778 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.778 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.778 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.778 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.779 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.779 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.779 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.779 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.779 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.779 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.779 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.779 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.779 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.779 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.779 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.779 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.779 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.779 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.780 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.780 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.780 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.780 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.780 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.780 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.780 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.780 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.780 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.780 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.780 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.780 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.780 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.781 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.781 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.781 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.781 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.781 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.781 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.781 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.781 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.781 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.781 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.781 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.781 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.781 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.782 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.782 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.782 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.782 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:32:28.782 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.782 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.782 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.782 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.782 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.782 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.782 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.782 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.782 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.782 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.783 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.783 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.783 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.783 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.783 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.783 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.783 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.783 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.783 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.783 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.783 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.783 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.783 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.783 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.784 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.784 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.784 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.784 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.784 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.784 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.784 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.784 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.784 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.784 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.784 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.784 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.784 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.785 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.785 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.785 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.785 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.785 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.785 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.785 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.785 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.785 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.785 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.785 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.785 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.785 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.786 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.786 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.786 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.786 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.786 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.786 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.786 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.786 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.786 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2024-09-12T17:32:28.786 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker___myobj_", 2024-09-12T17:32:28.786 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj_" 2024-09-12T17:32:28.786 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.786 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.787 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.787 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.787 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.787 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.787 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.787 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.787 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.787 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.787 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.787 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.787 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.787 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.787 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.788 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.788 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.788 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.788 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.788 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.788 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.788 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.788 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.788 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.788 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.788 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.788 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.789 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.789 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.789 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.789 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.789 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.790 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.790 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.790 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.790 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.791 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.791 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.791 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.791 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.791 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.791 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.791 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.791 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.791 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.791 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.791 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.791 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.792 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.792 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.792 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.792 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.792 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.792 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.792 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.792 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.792 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.792 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.792 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker___myobj_", 2024-09-12T17:32:28.792 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj_" 2024-09-12T17:32:28.793 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.793 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.793 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.793 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.793 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.793 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.793 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.793 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.793 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.793 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.793 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.793 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.794 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.794 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.794 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.794 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.794 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.794 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.794 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.794 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.794 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.794 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.794 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.794 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.795 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.795 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.795 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.795 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.795 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.795 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.795 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.795 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.795 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.795 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.795 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.795 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.795 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.795 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.796 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.796 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.796 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.796 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.796 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.796 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.796 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.796 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.796 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.796 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.796 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.797 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.797 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.797 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.797 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.797 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.797 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.797 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.797 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.797 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2024-09-12T17:32:28.797 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:32:28.797 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.798 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.798 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.798 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.798 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.798 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.798 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.798 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.798 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.798 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.798 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.798 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.798 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.799 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.799 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.799 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.799 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.799 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.799 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.799 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.799 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.799 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.799 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.799 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.799 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.799 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.800 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.800 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.800 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.800 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.800 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.800 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.800 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.800 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.800 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.800 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.800 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.801 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.801 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.801 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.801 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.801 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.801 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.801 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.801 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.801 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.801 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.801 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.801 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.802 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.802 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.802 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.802 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.802 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.802 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.802 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.802 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.802 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.802 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.802 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:32:28.802 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.802 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.803 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.803 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.803 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.803 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.803 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.803 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.803 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.803 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.803 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.803 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.803 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.803 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.803 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.804 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.804 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.804 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.804 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.804 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.804 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.804 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.804 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.804 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.804 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.804 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.804 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.804 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.805 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.805 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.805 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.805 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.805 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.805 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.805 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.805 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.805 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.805 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.805 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.805 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.805 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.806 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.806 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.806 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.806 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.806 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.806 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.806 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.806 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.806 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.806 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.807 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.807 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.807 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.807 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.807 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.807 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.807 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.807 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2024-09-12T17:32:28.807 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:32:28.807 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj_" 2024-09-12T17:32:28.807 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.807 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.807 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.808 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.808 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.808 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.808 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.808 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.808 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.808 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.808 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.808 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.809 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.809 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.809 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.809 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.809 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.809 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.809 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.809 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.809 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.809 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.809 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.809 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.809 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.809 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.810 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.810 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.810 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.810 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.810 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.810 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.810 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.810 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.810 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.810 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.810 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.810 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.810 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.810 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.811 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.811 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.811 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.811 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.811 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.811 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.811 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.811 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.811 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.811 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.811 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.811 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.811 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.811 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.812 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.812 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.812 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.812 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.812 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:32:28.812 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj_" 2024-09-12T17:32:28.812 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.812 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.812 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.812 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.812 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.812 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.812 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.813 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.813 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.813 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.813 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.813 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.813 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.813 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.813 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.813 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.813 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.813 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.813 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.813 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.813 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.814 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.814 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.814 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.814 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.814 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.814 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.814 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.814 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.814 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.814 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.814 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.814 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.814 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.815 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.815 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.815 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.815 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.815 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.815 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.815 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.815 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.815 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.815 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.815 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.815 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.815 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.816 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.816 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.816 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.816 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.816 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.816 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.816 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.816 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.816 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.816 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.816 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": "default-placement.data", 2024-09-12T17:32:28.816 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:32:28.816 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.817 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.817 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.817 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.817 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.817 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.817 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "test", 2024-09-12T17:32:28.817 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.817 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.817 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.817 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.817 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": "", 2024-09-12T17:32:28.817 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.817 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": "" 2024-09-12T17:32:28.818 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.818 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.818 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.818 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.818 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.818 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.818 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.818 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.818 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.818 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.818 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.818 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.818 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.818 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.819 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.819 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.819 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.819 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.819 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.819 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.819 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.819 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.819 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.819 INFO:tasks.workunit.client.0.smithi044.stdout: "obj": { 2024-09-12T17:32:28.819 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.819 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.819 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.819 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.820 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.820 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.820 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.820 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.820 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.820 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.820 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.820 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.820 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.820 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.820 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.820 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.820 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.820 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.821 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.821 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.821 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.821 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:32:28.821 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.821 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.821 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.821 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.821 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.821 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.821 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.821 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.821 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.822 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.822 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.822 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.822 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.822 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.822 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.822 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.822 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.822 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.822 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.822 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.822 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.822 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.822 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.823 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-12T17:32:28.823 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T17:32:28.823 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.823 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.823 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.823 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker_myobj", 2024-09-12T17:32:28.823 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.823 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.823 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.823 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.823 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.823 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.823 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.823 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.824 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.824 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.824 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.824 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.824 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.824 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.824 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.824 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.824 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.824 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.824 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.824 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.824 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.824 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.825 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.825 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker_myobj 2024-09-12T17:32:28.825 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.825 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2024-09-12T17:32:28.825 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.825 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker_myobj", 2024-09-12T17:32:28.825 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.825 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.825 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.825 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.825 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2024-09-12T17:32:28.825 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.825 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.825 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.826 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.826 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.826 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.826 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.826 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.826 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.826 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.826 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.826 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.826 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.826 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.826 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.826 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.826 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.826 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.827 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker_myobj 2024-09-12T17:32:28.827 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.827 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.827 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.827 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:32:28.827 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.827 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.827 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.827 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.828 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.828 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.828 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.828 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.828 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.828 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.828 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.828 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.828 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.828 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.828 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.829 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.829 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.829 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.829 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.829 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.829 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.829 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.829 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.829 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T17:32:28.829 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.830 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2024-09-12T17:32:28.830 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.830 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:32:28.830 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.830 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.830 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.830 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.830 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2024-09-12T17:32:28.830 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.830 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.830 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.831 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.831 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.831 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.831 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.831 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.831 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.831 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.831 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.831 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.831 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.831 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.832 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.832 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.832 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.832 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.832 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T17:32:28.832 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.832 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.832 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.832 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:32:28.832 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.832 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.832 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.833 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.833 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.833 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.833 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.833 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.833 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.833 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.833 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.833 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.834 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.834 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.834 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.834 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.834 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.834 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.834 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.834 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.834 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.834 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.834 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.834 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T17:32:28.834 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.835 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2024-09-12T17:32:28.835 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.835 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:32:28.835 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.835 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.835 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.835 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.835 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2024-09-12T17:32:28.835 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.835 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.835 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.835 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.835 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.836 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.836 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.836 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.836 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.836 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.836 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.836 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.836 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.836 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.836 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.836 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.837 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.837 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.837 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T17:32:28.837 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.837 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.837 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.837 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:32:28.837 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.837 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.837 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.838 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.838 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.838 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.838 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.838 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.838 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.838 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.838 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.838 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.838 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.838 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.839 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.839 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.839 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.839 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.839 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.839 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.839 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.839 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.839 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.839 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T17:32:28.840 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.840 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2024-09-12T17:32:28.840 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.840 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:32:28.840 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.840 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.840 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.840 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.840 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2024-09-12T17:32:28.840 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.840 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.840 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.840 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.841 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.841 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.841 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.841 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.841 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.841 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.841 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.841 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.841 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "myobj", 2024-09-12T17:32:28.841 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.841 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.841 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.841 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.842 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.842 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T17:32:28.842 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.842 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.843 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.843 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker___myobj", 2024-09-12T17:32:28.843 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj" 2024-09-12T17:32:28.843 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.843 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.843 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.843 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.843 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.843 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.843 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.843 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.843 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.844 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.844 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.844 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.844 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.844 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.844 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.844 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.844 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.844 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.844 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.844 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.844 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.845 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.845 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker___myobj 2024-09-12T17:32:28.845 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.845 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2024-09-12T17:32:28.845 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.845 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker___myobj", 2024-09-12T17:32:28.845 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj" 2024-09-12T17:32:28.845 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.845 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.845 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.845 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2024-09-12T17:32:28.845 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.845 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.846 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.846 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.846 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.846 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.846 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.846 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.846 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.846 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.846 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.846 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.848 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.848 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.848 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.848 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.848 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.848 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.848 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker___myobj 2024-09-12T17:32:28.848 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.848 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.848 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.849 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:32:28.849 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.849 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.849 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.849 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.849 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.849 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.849 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.849 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.849 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.849 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.849 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.849 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.849 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.850 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.850 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.850 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.850 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.850 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.850 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.850 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.850 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.850 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.850 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.850 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T17:32:28.850 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.850 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2024-09-12T17:32:28.850 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.851 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:32:28.851 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.851 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.851 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.851 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.851 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2024-09-12T17:32:28.851 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.851 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.851 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.851 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.851 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.851 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.851 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.852 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.852 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.852 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.852 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.852 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.852 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.852 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.852 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.852 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.852 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.852 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.852 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T17:32:28.852 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.852 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.853 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.853 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:32:28.853 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj" 2024-09-12T17:32:28.853 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.853 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.853 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.853 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.853 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.853 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.853 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.853 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.853 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.854 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.854 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.854 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.854 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.854 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.854 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.854 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.854 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.854 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.854 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.854 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.854 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.854 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.854 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T17:32:28.855 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.855 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2024-09-12T17:32:28.855 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.855 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:32:28.855 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj" 2024-09-12T17:32:28.855 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.855 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.855 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.855 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2024-09-12T17:32:28.855 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.855 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.855 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.855 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.856 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.856 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.856 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.856 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.856 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.856 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.856 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.856 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.856 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.856 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.856 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.856 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.856 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.856 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.857 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T17:32:28.857 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.857 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.857 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.857 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:32:28.857 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.857 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.857 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.857 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.857 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.857 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.857 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.857 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.858 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.858 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.858 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.858 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.858 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.858 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.858 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.858 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.858 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.858 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.858 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.858 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.858 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.858 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.859 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.859 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T17:32:28.859 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.859 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2024-09-12T17:32:28.859 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.859 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:32:28.859 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.859 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.859 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.859 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.859 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2024-09-12T17:32:28.859 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.859 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.859 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.860 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.860 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.860 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.860 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.860 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.860 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.860 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.860 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.860 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.860 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj", 2024-09-12T17:32:28.860 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.860 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.860 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.861 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.861 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.861 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T17:32:28.861 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.861 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.861 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.861 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker___myobj_", 2024-09-12T17:32:28.861 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj_" 2024-09-12T17:32:28.861 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.861 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.861 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.861 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.861 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.861 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.862 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.862 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.862 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.862 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.862 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.862 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.862 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.862 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.862 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.862 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.862 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.863 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.863 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.863 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.863 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.863 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.863 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T17:32:28.863 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.863 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2024-09-12T17:32:28.863 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.863 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker___myobj_", 2024-09-12T17:32:28.863 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj_" 2024-09-12T17:32:28.863 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.864 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.864 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.864 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2024-09-12T17:32:28.864 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.864 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.864 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.864 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.864 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.864 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.864 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.864 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.864 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.865 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.865 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.865 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.865 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.865 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.865 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.865 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.865 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.865 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.865 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T17:32:28.865 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.866 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.866 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.866 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:32:28.866 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.866 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.866 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.866 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.866 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.866 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.866 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.866 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.866 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.866 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.867 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.867 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.867 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.867 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.867 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.867 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.867 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.867 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.867 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.867 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.867 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.868 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.868 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.868 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T17:32:28.868 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.868 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2024-09-12T17:32:28.868 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.868 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:32:28.868 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.868 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.868 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.868 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.868 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2024-09-12T17:32:28.869 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.869 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.869 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.869 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.869 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.869 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.869 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.869 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.869 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.869 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.869 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.869 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.869 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.870 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "", 2024-09-12T17:32:28.870 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.870 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.870 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.870 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.870 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T17:32:28.870 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.870 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.870 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.870 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:32:28.870 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj_" 2024-09-12T17:32:28.871 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.871 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.871 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.871 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.871 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.871 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.871 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.871 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.871 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.871 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.871 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.872 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.872 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.872 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.872 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.872 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.872 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.872 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.872 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.872 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.872 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.872 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.872 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T17:32:28.873 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.873 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2024-09-12T17:32:28.873 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.873 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:32:28.873 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "marker__myobj_" 2024-09-12T17:32:28.873 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.873 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.873 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.873 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2024-09-12T17:32:28.873 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.873 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.873 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.874 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.874 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.874 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.874 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.874 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.874 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.874 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.874 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.874 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.875 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.875 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.875 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "" 2024-09-12T17:32:28.875 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.875 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.875 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.875 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T17:32:28.875 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.875 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj": { 2024-09-12T17:32:28.875 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.875 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:32:28.875 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.876 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.876 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.876 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.876 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj": { 2024-09-12T17:32:28.876 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.876 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.876 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.876 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.876 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.876 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.876 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.876 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.876 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.877 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.877 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.877 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.877 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.877 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.877 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.877 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.877 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.877 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.877 INFO:tasks.workunit.client.0.smithi044.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:32:28.877 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.877 INFO:tasks.workunit.client.0.smithi044.stdout: "raw_obj2": { 2024-09-12T17:32:28.877 INFO:tasks.workunit.client.0.smithi044.stdout: "pool": ".data-pool", 2024-09-12T17:32:28.878 INFO:tasks.workunit.client.0.smithi044.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:32:28.878 INFO:tasks.workunit.client.0.smithi044.stdout: "loc": "" 2024-09-12T17:32:28.878 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.878 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.878 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:28.878 INFO:tasks.workunit.client.0.smithi044.stdout: "new_obj2": { 2024-09-12T17:32:28.878 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket": { 2024-09-12T17:32:28.878 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "ebtest", 2024-09-12T17:32:28.878 INFO:tasks.workunit.client.0.smithi044.stdout: "marker": "marker", 2024-09-12T17:32:28.878 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_id": "bucket-id", 2024-09-12T17:32:28.878 INFO:tasks.workunit.client.0.smithi044.stdout: "tenant": "", 2024-09-12T17:32:28.878 INFO:tasks.workunit.client.0.smithi044.stdout: "explicit_placement": { 2024-09-12T17:32:28.878 INFO:tasks.workunit.client.0.smithi044.stdout: "data_pool": ".data-pool", 2024-09-12T17:32:28.879 INFO:tasks.workunit.client.0.smithi044.stdout: "data_extra_pool": "", 2024-09-12T17:32:28.879 INFO:tasks.workunit.client.0.smithi044.stdout: "index_pool": ".index-pool" 2024-09-12T17:32:28.879 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.879 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:28.879 INFO:tasks.workunit.client.0.smithi044.stdout: "key": { 2024-09-12T17:32:28.879 INFO:tasks.workunit.client.0.smithi044.stdout: "name": "_myobj_", 2024-09-12T17:32:28.879 INFO:tasks.workunit.client.0.smithi044.stdout: "instance": "inst", 2024-09-12T17:32:28.879 INFO:tasks.workunit.client.0.smithi044.stdout: "ns": "ns" 2024-09-12T17:32:28.879 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.879 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:28.879 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:28.879 INFO:tasks.workunit.client.0.smithi044.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:32:28.879 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T17:32:28.879 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T17:32:28.879 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:32:28.880 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:32:28.880 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T17:32:28.880 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 4 tests. 2024-09-12T17:32:28.880 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:32:28.880 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:32:28.925 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T17:32:28.926 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T17:32:28.926 DEBUG:teuthology.orchestra.run.smithi044:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T17:32:29.083 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:29.083 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:29.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.122+0000 7f9fcfc14800 20 rados->read ofs=0 len=0 2024-09-12T17:32:29.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.123+0000 7f9fcfc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:29.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.123+0000 7f9fcfc14800 20 realm 2024-09-12T17:32:29.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.123+0000 7f9fcfc14800 20 rados->read ofs=0 len=0 2024-09-12T17:32:29.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.124+0000 7f9fcfc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:29.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.124+0000 7f9fcfc14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:29.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.124+0000 7f9fcfc14800 20 rados->read ofs=0 len=0 2024-09-12T17:32:29.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.124+0000 7f9fcfc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:29.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.124+0000 7f9fcfc14800 20 rados->read ofs=0 len=0 2024-09-12T17:32:29.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.125+0000 7f9fcfc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:29.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.125+0000 7f9fcfc14800 20 rados->read ofs=0 len=0 2024-09-12T17:32:29.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.125+0000 7f9fcfc14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:29.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.125+0000 7f9fcfc14800 20 searching for the correct realm 2024-09-12T17:32:29.129 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.129+0000 7f9fcbbe1640 0 -- 172.21.15.44:0/2518644385 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f9fc0038040 msgr2=0x7f9fc002b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:29.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.132+0000 7f9fcb3e0640 0 -- 172.21.15.44:0/2518644385 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f9fc0048920 msgr2=0x7f9fc0008410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:29.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.340+0000 7f9fcfc14800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:32:29.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.340+0000 7f9fcfc14800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:32:29.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.340+0000 7f9fcfc14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:29.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.340+0000 7f9fcfc14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:29.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.340+0000 7f9fcfc14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:29.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.340+0000 7f9fcfc14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:29.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.340+0000 7f9fcfc14800 20 rados->read ofs=0 len=0 2024-09-12T17:32:29.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.340+0000 7f9fcfc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:29.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.340+0000 7f9fcfc14800 20 rados->read ofs=0 len=0 2024-09-12T17:32:29.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.341+0000 7f9fcfc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:29.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.341+0000 7f9fcfc14800 20 rados->read ofs=0 len=0 2024-09-12T17:32:29.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.341+0000 7f9fcfc14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:29.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.341+0000 7f9fcfc14800 20 zone default found 2024-09-12T17:32:29.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.341+0000 7f9fcfc14800 4 Realm: () 2024-09-12T17:32:29.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.341+0000 7f9fcfc14800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:32:29.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.341+0000 7f9fcfc14800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:32:29.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.341+0000 7f9fcfc14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:29.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.341+0000 7f9fcfc14800 20 zonegroup default 2024-09-12T17:32:29.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.341+0000 7f9fcfc14800 20 rados->read ofs=0 len=0 2024-09-12T17:32:29.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.342+0000 7f9fcfc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:29.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.342+0000 7f9fcfc14800 20 rados->read ofs=0 len=0 2024-09-12T17:32:29.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.342+0000 7f9fcfc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:29.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.342+0000 7f9fcfc14800 20 rados->read ofs=0 len=0 2024-09-12T17:32:29.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.342+0000 7f9fcfc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:29.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.342+0000 7f9fcfc14800 20 started sync module instance, tier type = 2024-09-12T17:32:29.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.342+0000 7f9fcfc14800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:32:29.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.353+0000 7f9fcfc14800 20 add_watcher() i=0 2024-09-12T17:32:29.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.353+0000 7f9fcfc14800 20 add_watcher() i=1 2024-09-12T17:32:29.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.353+0000 7f9fcfc14800 20 add_watcher() i=2 2024-09-12T17:32:29.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.353+0000 7f9fcfc14800 20 add_watcher() i=3 2024-09-12T17:32:29.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.353+0000 7f9fcfc14800 20 add_watcher() i=4 2024-09-12T17:32:29.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.353+0000 7f9fcfc14800 20 add_watcher() i=5 2024-09-12T17:32:29.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.353+0000 7f9fcfc14800 20 add_watcher() i=6 2024-09-12T17:32:29.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.354+0000 7f9fcfc14800 20 add_watcher() i=7 2024-09-12T17:32:29.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.354+0000 7f9fcfc14800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:29.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.356+0000 7f9e81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:29.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.356+0000 7f9fcfc14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:29.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.356+0000 7f9fcfc14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:29.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.356+0000 7f9fcfc14800 5 note: GC not initialized 2024-09-12T17:32:29.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.357+0000 7f9e80fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:29.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.357+0000 7f9fcfc14800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:29.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.357+0000 7f9fcfc14800 20 Filter name: none 2024-09-12T17:32:29.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.357+0000 7f9dfa7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:29.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.357+0000 7f9fcfc14800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T17:32:29.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.357+0000 7f9fcfc14800 20 rados->read ofs=0 len=0 2024-09-12T17:32:29.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.358+0000 7f9fcfc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:29.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.358+0000 7f9fcfc14800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T17:32:29.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.358+0000 7f9fcfc14800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:32:29.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.358+0000 7f9fcfc14800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T17:32:29.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.358+0000 7f9fcfc14800 20 rados->read ofs=0 len=0 2024-09-12T17:32:29.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.358+0000 7f9fcfc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:29.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.358+0000 7f9fcfc14800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T17:32:29.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.358+0000 7f9fcfc14800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:32:29.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.358+0000 7f9fcfc14800 10 cache get: name=default.rgw.meta+users.keys+pEEvt0grWLVJoJB2U9/hl2duGNc= : miss 2024-09-12T17:32:29.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.358+0000 7f9fcfc14800 20 rados->read ofs=0 len=0 2024-09-12T17:32:29.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.358+0000 7f9fcfc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:29.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.358+0000 7f9fcfc14800 10 cache put: name=default.rgw.meta+users.keys+pEEvt0grWLVJoJB2U9/hl2duGNc= info.flags=0x0 2024-09-12T17:32:29.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.358+0000 7f9fcfc14800 10 adding default.rgw.meta+users.keys+pEEvt0grWLVJoJB2U9/hl2duGNc= to cache LRU end 2024-09-12T17:32:29.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.358+0000 7f9fcfc14800 10 cache get: name=default.rgw.meta+users.keys+pEEvt0grWLVJoJB2U9/hl2duGNc= : hit (negative entry) 2024-09-12T17:32:29.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.358+0000 7f9fcfc14800 10 cache get: name=default.rgw.meta+users.keys+pEEvt0grWLVJoJB2U9/hl2duGNc= : hit (negative entry) 2024-09-12T17:32:29.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.360+0000 7f9fcfc14800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:32:29.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.360+0000 7f9fcfc14800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:32:29.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.360+0000 7f9fcfc14800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T17:32:29.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.360+0000 7f9eaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922115 cookie 94405132646496 notifier 5637 bl.length()=697 2024-09-12T17:32:29.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.360+0000 7f9eaeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:32:29.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.360+0000 7f9eaeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:32:29.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.362+0000 7f9fcfc14800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:32:29.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.362+0000 7f9fcfc14800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:32:29.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.362+0000 7f9fcfc14800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T17:32:29.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.362+0000 7f9eae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922112 cookie 94405132638128 notifier 5637 bl.length()=194 2024-09-12T17:32:29.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.362+0000 7f9eae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:32:29.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.362+0000 7f9eae7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:32:29.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.364+0000 7f9fcfc14800 10 cache put: name=default.rgw.meta+users.keys+pEEvt0grWLVJoJB2U9/hl2duGNc= info.flags=0x7 2024-09-12T17:32:29.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.364+0000 7f9fcfc14800 10 moving default.rgw.meta+users.keys+pEEvt0grWLVJoJB2U9/hl2duGNc= to cache LRU end 2024-09-12T17:32:29.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.364+0000 7f9fcfc14800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:pEEvt0grWLVJoJB2U9/hl2duGNc=, ofs0, ns] 2024-09-12T17:32:29.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.365+0000 7f9eae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922113 cookie 94405132640336 notifier 5637 bl.length()=203 2024-09-12T17:32:29.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.365+0000 7f9eae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+pEEvt0grWLVJoJB2U9/hl2duGNc= info.flags=0x7 2024-09-12T17:32:29.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.365+0000 7f9eae7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+pEEvt0grWLVJoJB2U9/hl2duGNc= to cache LRU end 2024-09-12T17:32:29.366 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:32:29.366 INFO:tasks.workunit.client.0.smithi044.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T17:32:29.366 INFO:tasks.workunit.client.0.smithi044.stdout: "display_name": "librgw test user", 2024-09-12T17:32:29.366 INFO:tasks.workunit.client.0.smithi044.stdout: "email": "librgw@example.com", 2024-09-12T17:32:29.366 INFO:tasks.workunit.client.0.smithi044.stdout: "suspended": 0, 2024-09-12T17:32:29.366 INFO:tasks.workunit.client.0.smithi044.stdout: "max_buckets": 1000, 2024-09-12T17:32:29.366 INFO:tasks.workunit.client.0.smithi044.stdout: "subusers": [], 2024-09-12T17:32:29.366 INFO:tasks.workunit.client.0.smithi044.stdout: "keys": [ 2024-09-12T17:32:29.366 INFO:tasks.workunit.client.0.smithi044.stdout: { 2024-09-12T17:32:29.366 INFO:tasks.workunit.client.0.smithi044.stdout: "user": "ceph-test-librgw-file", 2024-09-12T17:32:29.367 INFO:tasks.workunit.client.0.smithi044.stdout: "access_key": "pEEvt0grWLVJoJB2U9/hl2duGNc=", 2024-09-12T17:32:29.367 INFO:tasks.workunit.client.0.smithi044.stdout: "secret_key": "KGgsRAURfz5Fhk9tFmQQCbCrrFZtM/yrPX0bU9LVQuZiaRbqlVIo3Q==", 2024-09-12T17:32:29.367 INFO:tasks.workunit.client.0.smithi044.stdout: "active": true, 2024-09-12T17:32:29.367 INFO:tasks.workunit.client.0.smithi044.stdout: "create_date": "2024-09-12T17:32:29.359337Z" 2024-09-12T17:32:29.367 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:32:29.367 INFO:tasks.workunit.client.0.smithi044.stdout: ], 2024-09-12T17:32:29.367 INFO:tasks.workunit.client.0.smithi044.stdout: "swift_keys": [], 2024-09-12T17:32:29.367 INFO:tasks.workunit.client.0.smithi044.stdout: "caps": [], 2024-09-12T17:32:29.367 INFO:tasks.workunit.client.0.smithi044.stdout: "op_mask": "read, write, delete", 2024-09-12T17:32:29.367 INFO:tasks.workunit.client.0.smithi044.stdout: "default_placement": "", 2024-09-12T17:32:29.367 INFO:tasks.workunit.client.0.smithi044.stdout: "default_storage_class": "", 2024-09-12T17:32:29.367 INFO:tasks.workunit.client.0.smithi044.stdout: "placement_tags": [], 2024-09-12T17:32:29.367 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_quota": { 2024-09-12T17:32:29.367 INFO:tasks.workunit.client.0.smithi044.stdout: "enabled": false, 2024-09-12T17:32:29.368 INFO:tasks.workunit.client.0.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:32:29.368 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size": -1, 2024-09-12T17:32:29.368 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:32:29.368 INFO:tasks.workunit.client.0.smithi044.stdout: "max_objects": -1 2024-09-12T17:32:29.368 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:29.368 INFO:tasks.workunit.client.0.smithi044.stdout: "user_quota": { 2024-09-12T17:32:29.368 INFO:tasks.workunit.client.0.smithi044.stdout: "enabled": false, 2024-09-12T17:32:29.368 INFO:tasks.workunit.client.0.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:32:29.368 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size": -1, 2024-09-12T17:32:29.368 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:32:29.369 INFO:tasks.workunit.client.0.smithi044.stdout: "max_objects": -1 2024-09-12T17:32:29.369 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:32:29.369 INFO:tasks.workunit.client.0.smithi044.stdout: "temp_url_keys": [], 2024-09-12T17:32:29.369 INFO:tasks.workunit.client.0.smithi044.stdout: "type": "rgw", 2024-09-12T17:32:29.369 INFO:tasks.workunit.client.0.smithi044.stdout: "mfa_ids": [], 2024-09-12T17:32:29.369 INFO:tasks.workunit.client.0.smithi044.stdout: "account_id": "", 2024-09-12T17:32:29.369 INFO:tasks.workunit.client.0.smithi044.stdout: "path": "/", 2024-09-12T17:32:29.369 INFO:tasks.workunit.client.0.smithi044.stdout: "create_date": "2024-09-12T17:32:29.359325Z", 2024-09-12T17:32:29.369 INFO:tasks.workunit.client.0.smithi044.stdout: "tags": [], 2024-09-12T17:32:29.369 INFO:tasks.workunit.client.0.smithi044.stdout: "group_ids": [] 2024-09-12T17:32:29.369 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:32:29.369 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:32:29.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.366+0000 7f9e81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:29.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.368+0000 7f9fcfc14800 20 remove_watcher() i=0 2024-09-12T17:32:29.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.369+0000 7f9fcfc14800 2 removed watcher, disabling cache 2024-09-12T17:32:29.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.370+0000 7f9fcfc14800 20 remove_watcher() i=1 2024-09-12T17:32:29.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.371+0000 7f9fcfc14800 20 remove_watcher() i=2 2024-09-12T17:32:29.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.372+0000 7f9fcfc14800 20 remove_watcher() i=3 2024-09-12T17:32:29.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.373+0000 7f9fcfc14800 20 remove_watcher() i=4 2024-09-12T17:32:29.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.375+0000 7f9fcfc14800 20 remove_watcher() i=5 2024-09-12T17:32:29.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.376+0000 7f9fcfc14800 20 remove_watcher() i=6 2024-09-12T17:32:29.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:29.377+0000 7f9fcfc14800 20 remove_watcher() i=7 2024-09-12T17:32:29.388 INFO:tasks.workunit.client.0.smithi044.stdout:phase 1.1 2024-09-12T17:32:29.410 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:32:29.411 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:32:29.411 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:32:29.411 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:32:29.422 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:29.422 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:29.599 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (189 ms) 2024-09-12T17:32:29.599 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:32:29.600 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T17:32:29.600 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:32:29.600 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:32:29.600 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:32:29.608 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T17:32:29.613 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/f1 2024-09-12T17:32:29.615 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/f2 2024-09-12T17:32:29.618 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T17:32:29.621 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T17:32:29.623 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T17:32:29.626 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T17:32:29.629 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T17:32:29.632 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T17:32:29.635 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T17:32:29.637 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T17:32:29.640 INFO:tasks.workunit.client.0.smithi044.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T17:32:29.643 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETUP_HIER1 (43 ms) 2024-09-12T17:32:29.643 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:32:29.746 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETUP_DIRS1 (102 ms) 2024-09-12T17:32:29.746 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:32:29.746 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:32:29.746 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:32:29.763 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (18 ms) 2024-09-12T17:32:29.763 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:32:29.803 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (39 ms) 2024-09-12T17:32:29.803 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:32:29.803 INFO:tasks.workunit.client.0.smithi044.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T17:32:29.809 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2024-09-12T17:32:29.809 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:32:29.809 INFO:tasks.workunit.client.0.smithi044.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T17:32:29.815 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (6 ms) 2024-09-12T17:32:29.816 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:32:29.816 INFO:tasks.workunit.client.0.smithi044.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:32:29.816 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:32:29.816 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:32:29.816 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:32:29.816 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:32:29.816 INFO:tasks.workunit.client.0.smithi044.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:32:29.816 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:32:29.816 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:32:29.817 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:32:29.817 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:32:29.817 INFO:tasks.workunit.client.0.smithi044.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:32:29.817 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:32:29.817 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:32:29.817 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:32:29.817 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:32:29.817 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:32:29.817 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:32:29.817 INFO:tasks.workunit.client.0.smithi044.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:32:29.817 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:32:29.818 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:32:29.818 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:32:29.818 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:32:29.818 INFO:tasks.workunit.client.0.smithi044.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:32:29.818 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:32:29.819 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:32:29.819 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:32:29.820 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:32:29.820 INFO:tasks.workunit.client.0.smithi044.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:32:29.820 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:32:29.821 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:32:29.821 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:32:29.822 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:32:29.822 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READ_DIRS1 (7 ms) 2024-09-12T17:32:29.822 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:32:30.003 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READF_SETUP1 (180 ms) 2024-09-12T17:32:30.003 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:32:30.003 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:32:30.003 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:32:30.003 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:32:30.004 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:32:30.004 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:32:30.004 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:32:30.004 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:32:30.004 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:32:30.004 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:32:30.005 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:32:30.005 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:32:30.005 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:32:30.005 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:32:30.005 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:32:30.005 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:32:30.006 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:32:30.006 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:32:30.006 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:32:30.010 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:32:30.010 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:32:30.013 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:32:30.015 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:32:30.018 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:32:30.019 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:32:30.019 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:32:30.019 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:32:30.020 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:32:30.020 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:32:30.021 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:32:30.023 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:32:30.023 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:32:30.023 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:32:30.023 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:32:30.023 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:32:30.023 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.HIER1 (20 ms) 2024-09-12T17:32:30.023 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:32:30.023 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:32:30.023 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:32:30.023 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:32:30.024 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:32:30.024 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:32:30.024 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:32:30.024 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:32:30.024 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:32:30.024 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:32:30.024 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:32:30.024 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:32:30.024 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:32:30.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:30.022+0000 7f5d32c198c0 -1 shutting down 2024-09-12T17:32:30.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:32:30.023+0000 7f5c08ba5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65111, si_uid : 1000, si_addr0x3e80000fe57, si_status0 2024-09-12T17:32:59.683 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (29660 ms) 2024-09-12T17:32:59.683 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 24 tests from LibRGW (30272 ms total) 2024-09-12T17:32:59.683 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:32:59.684 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:32:59.684 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 24 tests from 1 test suite ran. (30272 ms total) 2024-09-12T17:32:59.684 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 24 tests. 2024-09-12T17:32:59.690 INFO:tasks.workunit.client.0.smithi044.stdout:phase 1.2 2024-09-12T17:32:59.715 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:32:59.715 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:32:59.715 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:32:59.715 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:32:59.723 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:59.723 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:00.140 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (425 ms) 2024-09-12T17:33:00.140 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:33:00.142 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T17:33:00.142 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:33:00.142 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:33:00.142 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:33:00.142 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T17:33:00.142 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:33:00.142 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T17:33:00.142 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:33:00.142 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:33:00.142 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:33:00.143 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:33:00.143 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:33:00.143 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:33:00.143 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:33:00.143 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:33:00.143 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:33:00.143 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:33:00.143 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:33:00.143 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:33:00.143 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:33:00.143 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T17:33:00.143 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:33:00.143 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:33:00.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:33:00.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:33:00.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:33:00.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:33:00.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:33:00.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:33:00.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:33:00.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T17:33:00.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:33:00.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:33:00.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:33:00.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:33:00.144 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:33:00.145 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:33:00.145 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:33:00.145 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:33:00.145 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:33:00.145 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:33:00.145 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:33:00.145 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:33:00.145 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:33:00.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:33:00.139+0000 7f23aecb58c0 -1 shutting down 2024-09-12T17:33:00.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:33:00.141+0000 7f22889f4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65730, si_uid : 1000, si_addr0x3e8000100c2, si_status0 2024-09-12T17:33:30.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (30396 ms) 2024-09-12T17:33:30.538 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 24 tests from LibRGW (30823 ms total) 2024-09-12T17:33:30.538 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:33:30.538 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:33:30.538 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 24 tests from 1 test suite ran. (30823 ms total) 2024-09-12T17:33:30.538 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 24 tests. 2024-09-12T17:33:30.543 INFO:tasks.workunit.client.0.smithi044.stdout:phase 1.3 2024-09-12T17:33:30.567 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:33:30.568 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:33:30.568 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:33:30.568 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:33:30.578 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:30.578 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:30.979 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (412 ms) 2024-09-12T17:33:30.980 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:33:30.980 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T17:33:30.980 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:33:30.980 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:33:30.981 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:33:30.986 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-09-12T17:33:30.986 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:33:31.046 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETUP_DIRS1 (59 ms) 2024-09-12T17:33:31.046 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:33:31.046 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:33:31.046 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:33:31.046 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:33:31.046 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:33:31.046 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:33:31.046 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:33:31.046 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:33:31.046 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:33:31.046 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:33:31.046 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:33:31.047 INFO:tasks.workunit.client.0.smithi044.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:33:31.047 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:33:31.047 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:33:31.047 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:33:31.047 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:33:31.047 INFO:tasks.workunit.client.0.smithi044.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:33:31.047 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:33:31.047 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:33:31.047 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:33:31.048 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:33:31.048 INFO:tasks.workunit.client.0.smithi044.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:33:31.048 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:33:31.048 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:33:31.048 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:33:31.048 INFO:tasks.workunit.client.0.smithi044.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:33:31.048 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:33:31.048 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:33:31.048 INFO:tasks.workunit.client.0.smithi044.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:33:31.048 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:33:31.049 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:33:31.049 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:33:31.049 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:33:31.049 INFO:tasks.workunit.client.0.smithi044.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:33:31.049 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:33:31.049 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:33:31.050 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:33:31.050 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:33:31.050 INFO:tasks.workunit.client.0.smithi044.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:33:31.051 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:33:31.052 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:33:31.052 INFO:tasks.workunit.client.0.smithi044.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:33:31.054 INFO:tasks.workunit.client.0.smithi044.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:33:31.054 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READ_DIRS1 (8 ms) 2024-09-12T17:33:31.054 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:33:31.054 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:33:31.054 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:33:31.055 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:33:31.055 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:33:31.055 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:33:31.055 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:33:31.055 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:33:31.055 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:33:31.055 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:33:31.055 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:33:31.055 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:33:31.055 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:33:31.055 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:33:31.055 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:33:31.055 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:33:31.056 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:33:31.056 INFO:tasks.workunit.client.0.smithi044.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:33:31.056 INFO:tasks.workunit.client.0.smithi044.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:33:31.056 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:33:31.056 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:33:31.061 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:33:31.061 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:33:31.064 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:33:31.065 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:33:31.069 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:33:31.069 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:33:31.070 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:33:31.070 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:33:31.071 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:33:31.071 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:33:31.072 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:33:31.074 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:33:31.074 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:33:31.074 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:33:31.074 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:33:31.074 INFO:tasks.workunit.client.0.smithi044.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:33:31.074 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2024-09-12T17:33:31.075 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:33:31.075 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:33:31.075 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:33:31.075 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:33:31.075 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:33:31.075 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:33:31.075 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:33:31.075 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:33:31.076 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:33:31.076 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:33:31.076 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:33:31.076 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:33:31.076 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:33:31.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:33:31.073+0000 7fa820a108c0 -1 shutting down 2024-09-12T17:33:31.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:33:31.074+0000 7fa6f640e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66349, si_uid : 1000, si_addr0x3e80001032d, si_status0 2024-09-12T17:34:01.174 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (30099 ms) 2024-09-12T17:34:01.175 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 24 tests from LibRGW (30606 ms total) 2024-09-12T17:34:01.175 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:34:01.175 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:34:01.175 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 24 tests from 1 test suite ran. (30606 ms total) 2024-09-12T17:34:01.175 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 24 tests. 2024-09-12T17:34:01.181 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2.1 2024-09-12T17:34:01.207 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:34:01.207 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:34:01.207 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:34:01.207 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:34:01.218 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:01.219 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:01.398 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (191 ms) 2024-09-12T17:34:01.398 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:34:01.399 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:34:01.399 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:34:01.408 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKET (9 ms) 2024-09-12T17:34:01.409 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:34:01.409 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:34:01.409 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:34:01.417 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave0 2024-09-12T17:34:01.425 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave1 2024-09-12T17:34:01.436 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave2 2024-09-12T17:34:01.444 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave3 2024-09-12T17:34:01.456 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave4 2024-09-12T17:34:01.464 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave5 2024-09-12T17:34:01.474 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave6 2024-09-12T17:34:01.482 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave7 2024-09-12T17:34:01.490 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave8 2024-09-12T17:34:01.498 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave9 2024-09-12T17:34:01.498 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (90 ms) 2024-09-12T17:34:01.498 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:34:01.767 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (269 ms) 2024-09-12T17:34:01.768 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:34:01.768 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:34:01.768 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:34:01.768 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:34:01.768 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:34:01.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:34:01.766+0000 7f8a2db2e8c0 -1 shutting down 2024-09-12T17:34:01.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:34:01.767+0000 7f890786d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66970, si_uid : 1000, si_addr0x3e80001059a, si_status0 2024-09-12T17:34:31.630 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (29862 ms) 2024-09-12T17:34:31.630 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 9 tests from LibRGW (30424 ms total) 2024-09-12T17:34:31.631 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:34:31.631 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:34:31.631 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 9 tests from 1 test suite ran. (30424 ms total) 2024-09-12T17:34:31.631 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 9 tests. 2024-09-12T17:34:31.636 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2.2 2024-09-12T17:34:31.663 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:34:31.663 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:34:31.663 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:34:31.663 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:34:31.672 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:31.673 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:32.070 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (408 ms) 2024-09-12T17:34:32.070 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:34:32.071 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:34:32.071 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:34:32.071 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:34:32.071 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:34:32.104 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_BUCKET (33 ms) 2024-09-12T17:34:32.104 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:34:32.112 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave0 2024-09-12T17:34:32.122 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave1 2024-09-12T17:34:32.130 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave2 2024-09-12T17:34:32.140 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave3 2024-09-12T17:34:32.148 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave4 2024-09-12T17:34:32.156 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave5 2024-09-12T17:34:32.164 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave6 2024-09-12T17:34:32.175 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave7 2024-09-12T17:34:32.182 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave8 2024-09-12T17:34:32.191 INFO:tasks.workunit.client.0.smithi044.stdout:created: sorrydave9 2024-09-12T17:34:32.191 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (87 ms) 2024-09-12T17:34:32.191 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:34:32.465 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (274 ms) 2024-09-12T17:34:32.465 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:34:32.466 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:34:32.466 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:34:32.466 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:34:32.466 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:34:32.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:34:32.464+0000 7f2ff5abc8c0 -1 shutting down 2024-09-12T17:34:32.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:34:32.465+0000 7f2ecf7fb640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67589, si_uid : 1000, si_addr0x3e800010805, si_status0 2024-09-12T17:35:02.450 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (29984 ms) 2024-09-12T17:35:02.450 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 9 tests from LibRGW (30787 ms total) 2024-09-12T17:35:02.450 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:35:02.450 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:35:02.451 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 9 tests from 1 test suite ran. (30787 ms total) 2024-09-12T17:35:02.451 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 9 tests. 2024-09-12T17:35:02.456 INFO:tasks.workunit.client.0.smithi044.stdout:phase 3.1 2024-09-12T17:35:02.785 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:35:02.786 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:35:02.786 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:35:02.786 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:35:02.795 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:02.795 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:02.973 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (187 ms) 2024-09-12T17:35:02.973 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:35:02.973 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:35:02.973 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:35:02.981 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-12T17:35:02.981 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:35:02.984 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-12T17:35:02.984 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:35:02.986 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T17:35:02.986 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:35:03.041 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LARGE1 (54 ms) 2024-09-12T17:35:03.041 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:35:03.073 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LARGE2 (33 ms) 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:35:03.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:35:03.071+0000 7f4a98b4b8c0 -1 shutting down 2024-09-12T17:35:03.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:35:03.073+0000 7f4972888640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68208, si_uid : 1000, si_addr0x3e800010a70, si_status0 2024-09-12T17:35:33.158 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (30084 ms) 2024-09-12T17:35:33.158 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 13 tests from LibRGW (30372 ms total) 2024-09-12T17:35:33.158 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:35:33.158 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:35:33.158 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 13 tests from 1 test suite ran. (30372 ms total) 2024-09-12T17:35:33.158 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 13 tests. 2024-09-12T17:35:33.165 INFO:tasks.workunit.client.0.smithi044.stdout:phase 3.2 2024-09-12T17:35:33.497 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:35:33.497 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:35:33.497 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:35:33.497 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:35:33.505 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:33.505 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:33.685 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (189 ms) 2024-09-12T17:35:33.685 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:35:33.687 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:35:33.687 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:35:33.687 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:35:33.687 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:35:33.692 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T17:35:33.692 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:35:33.696 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T17:35:33.696 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:35:33.779 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LARGE1 (83 ms) 2024-09-12T17:35:33.779 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:35:33.779 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T17:35:33.779 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:35:33.779 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:35:33.779 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:35:33.783 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-09-12T17:35:33.783 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:35:33.813 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_BUCKET (30 ms) 2024-09-12T17:35:33.813 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:35:33.813 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:35:33.813 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:35:33.813 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:35:33.813 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:35:33.814 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:35:33.812+0000 7f1a2b74e8c0 -1 shutting down 2024-09-12T17:35:33.814 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:35:33.814+0000 7f190548b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68827, si_uid : 1000, si_addr0x3e800010cdb, si_status0 2024-09-12T17:36:04.032 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (30218 ms) 2024-09-12T17:36:04.033 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 13 tests from LibRGW (30535 ms total) 2024-09-12T17:36:04.033 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:36:04.033 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:36:04.033 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 13 tests from 1 test suite ran. (30535 ms total) 2024-09-12T17:36:04.033 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 13 tests. 2024-09-12T17:36:04.039 INFO:tasks.workunit.client.0.smithi044.stdout:phase 4.1 2024-09-12T17:36:04.069 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:36:04.069 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:36:04.069 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:36:04.069 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:36:04.069 INFO:tasks.workunit.client.0.smithi044.stdout:read i1: 64001 2024-09-12T17:36:04.069 INFO:tasks.workunit.client.0.smithi044.stdout:read s1: blunderbuss 2024-09-12T17:36:04.069 INFO:tasks.workunit.client.0.smithi044.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:36:04.069 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:36:04.077 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:04.077 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:04.264 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (199 ms) 2024-09-12T17:36:04.264 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:36:04.265 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:36:04.265 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:36:04.281 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (16 ms) 2024-09-12T17:36:04.282 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:36:04.818 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_0 2024-09-12T17:36:04.818 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_1 2024-09-12T17:36:04.818 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_2 2024-09-12T17:36:04.818 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_3 2024-09-12T17:36:04.818 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_4 2024-09-12T17:36:04.818 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_5 2024-09-12T17:36:04.818 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_6 2024-09-12T17:36:04.818 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_7 2024-09-12T17:36:04.818 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_8 2024-09-12T17:36:04.818 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_9 2024-09-12T17:36:04.819 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_10 2024-09-12T17:36:04.819 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_11 2024-09-12T17:36:04.819 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_12 2024-09-12T17:36:04.819 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_13 2024-09-12T17:36:04.819 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_14 2024-09-12T17:36:04.819 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_15 2024-09-12T17:36:04.819 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_16 2024-09-12T17:36:04.819 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_17 2024-09-12T17:36:04.819 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_18 2024-09-12T17:36:04.819 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_19 2024-09-12T17:36:04.819 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_20 2024-09-12T17:36:04.819 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_21 2024-09-12T17:36:04.819 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_22 2024-09-12T17:36:04.820 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_23 2024-09-12T17:36:04.820 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_24 2024-09-12T17:36:04.820 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_25 2024-09-12T17:36:04.820 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_26 2024-09-12T17:36:04.820 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_27 2024-09-12T17:36:04.820 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_28 2024-09-12T17:36:04.820 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_29 2024-09-12T17:36:04.820 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_30 2024-09-12T17:36:04.820 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_31 2024-09-12T17:36:04.820 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_32 2024-09-12T17:36:04.820 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_33 2024-09-12T17:36:04.820 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_34 2024-09-12T17:36:04.820 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_35 2024-09-12T17:36:04.821 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_36 2024-09-12T17:36:04.821 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_37 2024-09-12T17:36:04.821 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_38 2024-09-12T17:36:04.821 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_39 2024-09-12T17:36:04.821 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_40 2024-09-12T17:36:04.821 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_41 2024-09-12T17:36:04.821 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_42 2024-09-12T17:36:04.821 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_43 2024-09-12T17:36:04.821 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_44 2024-09-12T17:36:04.821 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_45 2024-09-12T17:36:04.821 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_46 2024-09-12T17:36:04.821 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_47 2024-09-12T17:36:04.821 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_48 2024-09-12T17:36:04.821 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_49 2024-09-12T17:36:04.822 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_50 2024-09-12T17:36:04.822 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_51 2024-09-12T17:36:04.822 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_52 2024-09-12T17:36:04.822 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_53 2024-09-12T17:36:04.822 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_54 2024-09-12T17:36:04.822 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_55 2024-09-12T17:36:04.822 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_56 2024-09-12T17:36:04.822 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_57 2024-09-12T17:36:04.822 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_58 2024-09-12T17:36:04.822 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_59 2024-09-12T17:36:04.822 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_60 2024-09-12T17:36:04.822 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_61 2024-09-12T17:36:04.822 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_62 2024-09-12T17:36:04.822 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_63 2024-09-12T17:36:04.823 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_64 2024-09-12T17:36:04.823 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_65 2024-09-12T17:36:04.823 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_66 2024-09-12T17:36:04.823 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_67 2024-09-12T17:36:04.823 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_68 2024-09-12T17:36:04.823 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_69 2024-09-12T17:36:04.823 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_70 2024-09-12T17:36:04.823 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_71 2024-09-12T17:36:04.823 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_72 2024-09-12T17:36:04.823 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_73 2024-09-12T17:36:04.823 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_74 2024-09-12T17:36:04.823 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_75 2024-09-12T17:36:04.823 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_76 2024-09-12T17:36:04.824 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_77 2024-09-12T17:36:04.824 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_78 2024-09-12T17:36:04.824 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_79 2024-09-12T17:36:04.824 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_80 2024-09-12T17:36:04.824 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_81 2024-09-12T17:36:04.824 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_82 2024-09-12T17:36:04.824 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_83 2024-09-12T17:36:04.824 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_84 2024-09-12T17:36:04.824 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_85 2024-09-12T17:36:04.824 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_86 2024-09-12T17:36:04.824 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_87 2024-09-12T17:36:04.824 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_88 2024-09-12T17:36:04.824 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_89 2024-09-12T17:36:04.825 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_90 2024-09-12T17:36:04.825 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_91 2024-09-12T17:36:04.825 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_92 2024-09-12T17:36:04.825 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_93 2024-09-12T17:36:04.825 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_94 2024-09-12T17:36:04.825 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_95 2024-09-12T17:36:04.825 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_96 2024-09-12T17:36:04.825 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_97 2024-09-12T17:36:04.825 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_98 2024-09-12T17:36:04.825 INFO:tasks.workunit.client.0.smithi044.stdout:created: dmarker:f_99 2024-09-12T17:36:04.825 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (536 ms) 2024-09-12T17:36:04.825 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:36:04.827 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T17:36:04.827 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T17:36:04.827 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:36:04.827 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:36:04.827 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:36:04.827 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:36:04.827 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:36:04.827 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:36:04.827 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:36:04.827 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:36:04.827 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:36:04.828 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:36:04.828 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:36:04.828 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:36:04.828 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:36:04.828 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:36:04.828 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:36:04.828 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:36:04.828 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:36:04.828 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:36:04.828 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:36:04.828 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:36:04.828 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:36:04.829 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:36:04.829 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:36:04.829 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:36:04.829 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:36:04.829 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:36:04.829 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:36:04.829 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:36:04.829 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:36:04.829 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:36:04.829 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:36:04.829 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:36:04.829 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:36:04.829 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:36:04.830 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:36:04.830 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:36:04.830 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:36:04.830 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:36:04.830 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:36:04.830 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:36:04.830 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:36:04.830 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:36:04.830 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:36:04.830 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:36:04.830 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:36:04.831 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:36:04.831 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:36:04.831 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:36:04.831 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:36:04.831 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:36:04.831 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:36:04.831 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:36:04.831 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:36:04.832 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:36:04.832 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:36:04.832 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:36:04.832 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:36:04.832 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:36:04.832 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:36:04.832 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:36:04.832 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:36:04.832 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:36:04.832 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:36:04.832 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:36:04.832 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:36:04.832 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:36:04.833 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:36:04.833 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:36:04.833 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:36:04.833 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:36:04.833 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:36:04.833 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:36:04.833 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:36:04.833 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:36:04.833 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:36:04.833 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:36:04.833 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:36:04.833 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:36:04.833 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:36:04.833 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:36:04.834 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:36:04.834 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:36:04.834 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:36:04.834 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:36:04.834 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:36:04.834 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:36:04.834 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:36:04.834 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:36:04.834 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:36:04.834 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:36:04.834 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:36:04.834 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:36:04.834 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:36:04.834 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:36:04.835 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:36:04.835 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:36:04.835 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:36:04.835 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:36:04.835 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:36:04.835 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:36:04.835 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_READDIR (3 ms) 2024-09-12T17:36:04.835 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:36:04.835 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:36:04.835 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:36:04.835 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:36:04.835 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:36:04.835 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:36:04.835 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:36:04.836 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:36:04.836 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:36:04.836 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:36:04.836 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:36:04.836 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:36:04.836 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:36:04.836 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:36:04.836 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:36:04.836 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:36:04.836 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:36:04.836 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:36:04.836 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:36:04.836 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:36:04.837 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:36:04.837 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:36:04.837 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:36:04.837 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:36:04.837 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:36:04.837 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:36:04.837 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:36:04.837 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:36:04.837 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:36:04.837 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:36:04.837 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:36:04.837 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:36:04.837 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:36:04.837 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:36:04.838 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:36:04.838 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:36:04.838 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:36:04.838 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:36:04.838 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:36:04.838 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:36:04.838 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:36:04.838 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:36:04.838 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:36:04.838 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:36:04.838 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:36:04.838 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:36:04.838 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:36:04.838 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:36:04.839 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:36:04.839 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:36:04.839 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:36:04.839 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:36:04.839 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:36:04.839 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:36:04.839 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:36:04.839 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:36:04.839 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:36:04.839 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:36:04.840 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:36:04.840 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:36:04.840 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:36:04.840 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:36:04.840 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:36:04.840 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:36:04.840 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:36:04.840 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:36:04.841 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:36:04.841 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:36:04.841 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:36:04.841 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:36:04.841 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:36:04.841 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:36:04.841 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:36:04.841 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:36:04.841 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:36:04.841 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:36:04.841 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:36:04.841 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:36:04.841 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:36:04.841 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:36:04.842 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:36:04.842 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:36:04.842 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:36:04.842 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:36:04.842 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:36:04.842 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:36:04.842 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:36:04.842 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:36:04.842 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:36:04.842 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:36:04.842 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:36:04.842 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:36:04.842 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:36:04.842 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:36:04.843 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:36:04.843 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:36:04.843 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:36:04.843 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:36:04.843 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:36:04.843 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:36:04.843 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:36:04.843 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER2_READDIR (1 ms) 2024-09-12T17:36:04.843 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:36:04.843 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:36:04.843 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:36:04.843 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:36:04.843 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:36:04.843 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:36:04.844 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:36:04.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:36:04.820+0000 7f0f3e3338c0 -1 shutting down 2024-09-12T17:36:04.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:36:04.821+0000 7f0e16301640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69447, si_uid : 1000, si_addr0x3e800010f47, si_status0 2024-09-12T17:36:34.598 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (29777 ms) 2024-09-12T17:36:34.598 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 11 tests from LibRGW (30533 ms total) 2024-09-12T17:36:34.599 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:36:34.599 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:36:34.599 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 11 tests from 1 test suite ran. (30533 ms total) 2024-09-12T17:36:34.599 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 11 tests. 2024-09-12T17:36:34.605 INFO:tasks.workunit.client.0.smithi044.stdout:phase 4.2 2024-09-12T17:36:34.635 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:36:34.635 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:36:34.635 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:36:34.635 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:36:34.635 INFO:tasks.workunit.client.0.smithi044.stdout:read i1: 64001 2024-09-12T17:36:34.635 INFO:tasks.workunit.client.0.smithi044.stdout:read s1: blunderbuss 2024-09-12T17:36:34.635 INFO:tasks.workunit.client.0.smithi044.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:36:34.635 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:36:34.643 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:34.643 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:35.034 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (399 ms) 2024-09-12T17:36:35.034 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:36:35.035 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:36:35.035 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:36:35.044 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (9 ms) 2024-09-12T17:36:35.044 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:36:35.044 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:36:35.044 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:36:35.044 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:36:35.044 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:36:35.047 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:36:35.047 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:36:35.047 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:36:35.047 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:36:35.047 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:36:35.047 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:36:35.047 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:36:35.048 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:36:35.048 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:36:35.048 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:36:35.048 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:36:35.048 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:36:35.048 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:36:35.048 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:36:35.048 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:36:35.048 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:36:35.048 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:36:35.049 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:36:35.049 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:36:35.049 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:36:35.049 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:36:35.049 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:36:35.049 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:36:35.049 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:36:35.049 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:36:35.049 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:36:35.049 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:36:35.050 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:36:35.050 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:36:35.050 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:36:35.050 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:36:35.050 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:36:35.050 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:36:35.050 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:36:35.050 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:36:35.050 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:36:35.050 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:36:35.050 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:36:35.051 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:36:35.051 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:36:35.051 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:36:35.051 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:36:35.051 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:36:35.051 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:36:35.051 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:36:35.051 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:36:35.051 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:36:35.051 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:36:35.051 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:36:35.052 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:36:35.052 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:36:35.052 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:36:35.052 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:36:35.052 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:36:35.052 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:36:35.052 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:36:35.052 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:36:35.052 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:36:35.052 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:36:35.052 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:36:35.053 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:36:35.053 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:36:35.053 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:36:35.053 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:36:35.053 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:36:35.053 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:36:35.053 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:36:35.053 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:36:35.053 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:36:35.053 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:36:35.054 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:36:35.054 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:36:35.054 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:36:35.054 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:36:35.054 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:36:35.054 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:36:35.054 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:36:35.054 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:36:35.054 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:36:35.054 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:36:35.054 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:36:35.055 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:36:35.055 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:36:35.055 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:36:35.055 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:36:35.055 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:36:35.055 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:36:35.055 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:36:35.055 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:36:35.055 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:36:35.055 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:36:35.055 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:36:35.056 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:36:35.056 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:36:35.056 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:36:35.056 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:36:35.056 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:36:35.056 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:36:35.056 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:36:35.056 INFO:tasks.workunit.client.0.smithi044.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:36:35.056 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-12T17:36:35.056 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:36:35.057 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:36:35.057 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:36:35.057 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:36:35.057 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:36:35.057 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:36:35.057 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:36:35.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:36:35.046+0000 7f5636d258c0 -1 shutting down 2024-09-12T17:36:35.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:36:35.047+0000 7f550ecf7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70067, si_uid : 1000, si_addr0x3e8000111b3, si_status0 2024-09-12T17:37:05.292 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (30244 ms) 2024-09-12T17:37:05.292 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 11 tests from LibRGW (30656 ms total) 2024-09-12T17:37:05.293 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:37:05.293 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:37:05.293 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 11 tests from 1 test suite ran. (30656 ms total) 2024-09-12T17:37:05.293 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 11 tests. 2024-09-12T17:37:05.300 INFO:tasks.workunit.client.0.smithi044.stdout:phase 5.1 2024-09-12T17:37:05.332 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:37:05.332 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:37:05.333 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:37:05.333 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:37:05.343 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:05.343 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:05.735 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (403 ms) 2024-09-12T17:37:05.735 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:37:05.735 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:37:05.736 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:37:05.746 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-09-12T17:37:05.746 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:37:05.749 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-12T17:37:05.749 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:37:05.749 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:37:05.750 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:37:05.751 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T17:37:05.751 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:37:05.751 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:37:05.751 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:37:05.756 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.PUT_OBJECT (5 ms) 2024-09-12T17:37:05.756 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:37:05.761 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.GET_OBJECT (4 ms) 2024-09-12T17:37:05.761 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:37:05.761 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:37:05.761 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:37:05.761 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:37:05.761 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:37:05.761 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:37:05.761 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:37:05.761 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:37:05.762 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:37:05.762 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:37:05.762 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:37:05.762 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:37:05.762 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:37:05.762 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:37:05.762 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:37:05.762 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:37:05.762 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:37:05.762 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:37:05.762 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:37:05.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:37:05.759+0000 7f9d8f7348c0 -1 shutting down 2024-09-12T17:37:05.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:37:05.761+0000 7f9c6763c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70687, si_uid : 1000, si_addr0x3e80001141f, si_status0 2024-09-12T17:37:36.068 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (30307 ms) 2024-09-12T17:37:36.068 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 19 tests from LibRGW (30735 ms total) 2024-09-12T17:37:36.068 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:37:36.068 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:37:36.068 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 19 tests from 1 test suite ran. (30735 ms total) 2024-09-12T17:37:36.069 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 19 tests. 2024-09-12T17:37:36.073 INFO:tasks.workunit.client.0.smithi044.stdout:phase 5.2 2024-09-12T17:37:36.108 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:37:36.108 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:37:36.108 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:37:36.108 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:37:36.116 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:36.116 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:36.301 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (193 ms) 2024-09-12T17:37:36.301 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:37:36.302 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:37:36.302 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:37:36.302 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:37:36.302 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:37:36.307 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T17:37:36.307 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:37:36.307 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:37:36.308 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:37:36.308 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T17:37:36.308 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:37:36.308 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:37:36.308 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:37:36.308 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T17:37:36.308 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:37:36.308 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T17:37:36.308 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:37:36.308 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:37:36.308 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:37:36.308 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:37:36.309 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:37:36.309 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:37:36.309 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:37:36.309 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:37:36.309 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:37:36.309 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:37:36.309 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:37:36.312 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-12T17:37:36.312 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:37:36.340 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.DELETE_BUCKET (27 ms) 2024-09-12T17:37:36.340 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:37:36.340 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:37:36.340 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:37:36.340 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (1 ms) 2024-09-12T17:37:36.340 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:37:36.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:37:36.339+0000 7f9cdf5248c0 -1 shutting down 2024-09-12T17:37:36.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:37:36.340+0000 7f9bb74f7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71306, si_uid : 1000, si_addr0x3e80001168a, si_status0 2024-09-12T17:38:06.502 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (30161 ms) 2024-09-12T17:38:06.502 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 19 tests from LibRGW (30393 ms total) 2024-09-12T17:38:06.502 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:38:06.502 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:38:06.502 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 19 tests from 1 test suite ran. (30393 ms total) 2024-09-12T17:38:06.503 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 19 tests. 2024-09-12T17:38:06.507 INFO:tasks.workunit.client.0.smithi044.stdout:phase 6.1 2024-09-12T17:38:06.534 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:38:06.534 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment set-up. 2024-09-12T17:38:06.534 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 10 tests from LibRGW 2024-09-12T17:38:06.534 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:38:06.541 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:06.541 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:06.726 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.INIT (193 ms) 2024-09-12T17:38:06.726 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:38:06.727 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:38:06.727 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T17:38:06.747 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CREATE_BUCKETS (20 ms) 2024-09-12T17:38:06.747 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T17:38:06.753 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (6 ms) 2024-09-12T17:38:06.753 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T17:38:06.770 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.TOPDIR_RENAME (17 ms) 2024-09-12T17:38:06.770 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T17:38:06.792 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SUBDIR_RENAME (22 ms) 2024-09-12T17:38:06.793 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T17:38:06.814 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (22 ms) 2024-09-12T17:38:06.814 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:38:06.814 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:38:06.814 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:38:06.814 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:38:06.814 INFO:tasks.workunit.client.0.smithi044.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:38:06.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:06.812+0000 7f479d6878c0 -1 shutting down 2024-09-12T17:38:06.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:06.813+0000 7f46773c6640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71925, si_uid : 1000, si_addr0x3e8000118f5, si_status0 2024-09-12T17:38:37.117 INFO:tasks.workunit.client.0.smithi044.stdout:[ OK ] LibRGW.SHUTDOWN (30303 ms) 2024-09-12T17:38:37.118 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] 10 tests from LibRGW (30584 ms total) 2024-09-12T17:38:37.118 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:38:37.118 INFO:tasks.workunit.client.0.smithi044.stdout:[----------] Global test environment tear-down 2024-09-12T17:38:37.118 INFO:tasks.workunit.client.0.smithi044.stdout:[==========] 10 tests from 1 test suite ran. (30584 ms total) 2024-09-12T17:38:37.118 INFO:tasks.workunit.client.0.smithi044.stdout:[ PASSED ] 10 tests. 2024-09-12T17:38:37.125 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:38:37.125 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:38:37.171 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T17:38:37.172 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T17:38:37.172 DEBUG:teuthology.orchestra.run.smithi044:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T17:38:37.209 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -z ']' 2024-09-12T17:38:37.209 INFO:tasks.workunit.client.0.smithi044.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:38:37.209 INFO:tasks.workunit.client.0.smithi044.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:38:37.209 INFO:tasks.workunit.client.0.smithi044.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:38:37.209 INFO:tasks.workunit.client.0.smithi044.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:38:37.210 INFO:tasks.workunit.client.0.smithi044.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-12T17:38:37.247 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:37.248 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:37.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.288+0000 7f1659b35800 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.290+0000 7f1659b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.290+0000 7f1659b35800 20 realm 2024-09-12T17:38:37.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.290+0000 7f1659b35800 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.290+0000 7f1659b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.290+0000 7f1659b35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:37.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.290+0000 7f1659b35800 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.290+0000 7f1659b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.290+0000 7f1659b35800 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.291+0000 7f1659b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:37.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.291+0000 7f1659b35800 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.291+0000 7f1659b35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:37.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.291+0000 7f1659b35800 20 searching for the correct realm 2024-09-12T17:38:37.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.294+0000 7f165507c640 0 -- 172.21.15.44:0/478772889 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f1648046030 msgr2=0x7f164806bd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:37.298 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.298+0000 7f165587d640 0 -- 172.21.15.44:0/478772889 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f164c00a290 msgr2=0x7f164c066990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:37.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.505+0000 7f1659b35800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:38:37.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.505+0000 7f1659b35800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:38:37.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.505+0000 7f1659b35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:37.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.505+0000 7f1659b35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:37.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.505+0000 7f1659b35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:37.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.505+0000 7f1659b35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:37.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.505+0000 7f1659b35800 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.505+0000 7f1659b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.505+0000 7f1659b35800 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.506+0000 7f1659b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:37.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.506+0000 7f1659b35800 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.506+0000 7f1659b35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:37.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.506+0000 7f1659b35800 20 zone default found 2024-09-12T17:38:37.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.506+0000 7f1659b35800 4 Realm: () 2024-09-12T17:38:37.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.506+0000 7f1659b35800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:38:37.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.506+0000 7f1659b35800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:38:37.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.506+0000 7f1659b35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:37.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.506+0000 7f1659b35800 20 zonegroup default 2024-09-12T17:38:37.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.506+0000 7f1659b35800 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.507+0000 7f1659b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.507+0000 7f1659b35800 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.507+0000 7f1659b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.507+0000 7f1659b35800 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.507+0000 7f1659b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.507+0000 7f1659b35800 20 started sync module instance, tier type = 2024-09-12T17:38:37.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.507+0000 7f1659b35800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:38:37.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.519+0000 7f1659b35800 20 add_watcher() i=0 2024-09-12T17:38:37.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.519+0000 7f1659b35800 20 add_watcher() i=1 2024-09-12T17:38:37.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.519+0000 7f1659b35800 20 add_watcher() i=2 2024-09-12T17:38:37.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.519+0000 7f1659b35800 20 add_watcher() i=3 2024-09-12T17:38:37.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.519+0000 7f1659b35800 20 add_watcher() i=4 2024-09-12T17:38:37.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.519+0000 7f1659b35800 20 add_watcher() i=5 2024-09-12T17:38:37.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.519+0000 7f1659b35800 20 add_watcher() i=6 2024-09-12T17:38:37.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.520+0000 7f1659b35800 20 add_watcher() i=7 2024-09-12T17:38:37.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.520+0000 7f1659b35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:37.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.522+0000 7f15077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:37.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.522+0000 7f1659b35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:37.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.522+0000 7f1659b35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:37.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.522+0000 7f1659b35800 5 note: GC not initialized 2024-09-12T17:38:37.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.523+0000 7f15067fc640 20 reqs_thread_entry: start 2024-09-12T17:38:37.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.523+0000 7f1659b35800 20 init_complete bucket index max shards: 11 2024-09-12T17:38:37.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.523+0000 7f1659b35800 20 Filter name: none 2024-09-12T17:38:37.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.523+0000 7f1477fff640 20 reqs_thread_entry: start 2024-09-12T17:38:37.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.523+0000 7f1659b35800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T17:38:37.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.523+0000 7f1659b35800 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.523+0000 7f1659b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.523+0000 7f1659b35800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T17:38:37.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.523+0000 7f1659b35800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:38:37.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.523+0000 7f1659b35800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T17:38:37.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.523+0000 7f1659b35800 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.524+0000 7f1659b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.524+0000 7f1659b35800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T17:38:37.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.524+0000 7f1659b35800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:38:37.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.524+0000 7f1659b35800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T17:38:37.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.524+0000 7f1659b35800 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.524+0000 7f1659b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.524+0000 7f1659b35800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T17:38:37.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.524+0000 7f1659b35800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:38:37.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.524+0000 7f1659b35800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:38:37.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.524+0000 7f1659b35800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:38:37.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.525+0000 7f1659b35800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:38:37.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.525+0000 7f1659b35800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:38:37.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.525+0000 7f1659b35800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T17:38:37.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.526+0000 7f15397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922117 cookie 94401543183120 notifier 5543 bl.length()=677 2024-09-12T17:38:37.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.526+0000 7f15397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:38:37.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.526+0000 7f15397fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:38:37.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.527+0000 7f1659b35800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:38:37.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.527+0000 7f1659b35800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:38:37.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.527+0000 7f1659b35800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T17:38:37.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.528+0000 7f1538ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922126 cookie 94401543175392 notifier 5543 bl.length()=187 2024-09-12T17:38:37.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.528+0000 7f1538ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:38:37.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.528+0000 7f1538ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:38:37.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.529+0000 7f1659b35800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:38:37.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.529+0000 7f1659b35800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:38:37.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.529+0000 7f1659b35800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T17:38:37.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.530+0000 7f1538ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922127 cookie 94401543175392 notifier 5543 bl.length()=197 2024-09-12T17:38:37.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.530+0000 7f1538ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:38:37.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.530+0000 7f1538ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:38:37.531 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:38:37.531 INFO:tasks.workunit.client.0.smithi044.stdout: "user_id": "ceph-test-maven", 2024-09-12T17:38:37.531 INFO:tasks.workunit.client.0.smithi044.stdout: "display_name": "maven test user", 2024-09-12T17:38:37.531 INFO:tasks.workunit.client.0.smithi044.stdout: "email": "sigv4@example.com", 2024-09-12T17:38:37.531 INFO:tasks.workunit.client.0.smithi044.stdout: "suspended": 0, 2024-09-12T17:38:37.531 INFO:tasks.workunit.client.0.smithi044.stdout: "max_buckets": 1000, 2024-09-12T17:38:37.532 INFO:tasks.workunit.client.0.smithi044.stdout: "subusers": [], 2024-09-12T17:38:37.532 INFO:tasks.workunit.client.0.smithi044.stdout: "keys": [ 2024-09-12T17:38:37.532 INFO:tasks.workunit.client.0.smithi044.stdout: { 2024-09-12T17:38:37.532 INFO:tasks.workunit.client.0.smithi044.stdout: "user": "ceph-test-maven", 2024-09-12T17:38:37.532 INFO:tasks.workunit.client.0.smithi044.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T17:38:37.532 INFO:tasks.workunit.client.0.smithi044.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T17:38:37.532 INFO:tasks.workunit.client.0.smithi044.stdout: "active": true, 2024-09-12T17:38:37.532 INFO:tasks.workunit.client.0.smithi044.stdout: "create_date": "2024-09-12T17:38:37.524932Z" 2024-09-12T17:38:37.532 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:38:37.532 INFO:tasks.workunit.client.0.smithi044.stdout: ], 2024-09-12T17:38:37.532 INFO:tasks.workunit.client.0.smithi044.stdout: "swift_keys": [], 2024-09-12T17:38:37.532 INFO:tasks.workunit.client.0.smithi044.stdout: "caps": [], 2024-09-12T17:38:37.533 INFO:tasks.workunit.client.0.smithi044.stdout: "op_mask": "read, write, delete", 2024-09-12T17:38:37.533 INFO:tasks.workunit.client.0.smithi044.stdout: "default_placement": "", 2024-09-12T17:38:37.533 INFO:tasks.workunit.client.0.smithi044.stdout: "default_storage_class": "", 2024-09-12T17:38:37.533 INFO:tasks.workunit.client.0.smithi044.stdout: "placement_tags": [], 2024-09-12T17:38:37.533 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_quota": { 2024-09-12T17:38:37.533 INFO:tasks.workunit.client.0.smithi044.stdout: "enabled": false, 2024-09-12T17:38:37.533 INFO:tasks.workunit.client.0.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:38:37.533 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size": -1, 2024-09-12T17:38:37.533 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:38:37.533 INFO:tasks.workunit.client.0.smithi044.stdout: "max_objects": -1 2024-09-12T17:38:37.533 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:38:37.533 INFO:tasks.workunit.client.0.smithi044.stdout: "user_quota": { 2024-09-12T17:38:37.533 INFO:tasks.workunit.client.0.smithi044.stdout: "enabled": false, 2024-09-12T17:38:37.533 INFO:tasks.workunit.client.0.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:38:37.534 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size": -1, 2024-09-12T17:38:37.534 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:38:37.534 INFO:tasks.workunit.client.0.smithi044.stdout: "max_objects": -1 2024-09-12T17:38:37.534 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:38:37.534 INFO:tasks.workunit.client.0.smithi044.stdout: "temp_url_keys": [], 2024-09-12T17:38:37.534 INFO:tasks.workunit.client.0.smithi044.stdout: "type": "rgw", 2024-09-12T17:38:37.534 INFO:tasks.workunit.client.0.smithi044.stdout: "mfa_ids": [], 2024-09-12T17:38:37.534 INFO:tasks.workunit.client.0.smithi044.stdout: "account_id": "", 2024-09-12T17:38:37.534 INFO:tasks.workunit.client.0.smithi044.stdout: "path": "/", 2024-09-12T17:38:37.534 INFO:tasks.workunit.client.0.smithi044.stdout: "create_date": "2024-09-12T17:38:37.524920Z", 2024-09-12T17:38:37.534 INFO:tasks.workunit.client.0.smithi044.stdout: "tags": [], 2024-09-12T17:38:37.534 INFO:tasks.workunit.client.0.smithi044.stdout: "group_ids": [] 2024-09-12T17:38:37.534 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:38:37.535 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:38:37.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.531+0000 7f15077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:37.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.534+0000 7f1659b35800 20 remove_watcher() i=0 2024-09-12T17:38:37.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.534+0000 7f1659b35800 2 removed watcher, disabling cache 2024-09-12T17:38:37.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.535+0000 7f1659b35800 20 remove_watcher() i=1 2024-09-12T17:38:37.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.536+0000 7f1659b35800 20 remove_watcher() i=2 2024-09-12T17:38:37.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.537+0000 7f1659b35800 20 remove_watcher() i=3 2024-09-12T17:38:37.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.538+0000 7f1659b35800 20 remove_watcher() i=4 2024-09-12T17:38:37.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.539+0000 7f1659b35800 20 remove_watcher() i=5 2024-09-12T17:38:37.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.540+0000 7f1659b35800 20 remove_watcher() i=6 2024-09-12T17:38:37.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:38:37.541+0000 7f1659b35800 20 remove_watcher() i=7 2024-09-12T17:38:37.553 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -z ']' 2024-09-12T17:38:37.553 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-12T17:38:37.553 INFO:tasks.workunit.client.0.smithi044.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-12T17:38:37.554 INFO:tasks.workunit.client.0.smithi044.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi044.front.sepia.ceph.com:80 2024-09-12T17:38:37.554 INFO:tasks.workunit.client.0.smithi044.stderr:+ RGW_HTTP_ENDPOINT_URL=http://smithi044.front.sepia.ceph.com:80 2024-09-12T17:38:37.554 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-12T17:38:37.554 INFO:tasks.workunit.client.0.smithi044.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T17:38:37.554 INFO:tasks.workunit.client.0.smithi044.stderr:+ ./mvnw clean package 2024-09-12T17:38:37.571 INFO:tasks.workunit.client.0.smithi044.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:38:39.737 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Scanning for projects... 2024-09-12T17:38:39.856 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T17:38:39.942 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 63 kB/s) 2024-09-12T17:38:39.955 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T17:38:39.998 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 17/83 kB Progress (1): 18/83 kB Progress (1): 19/83 kB Progress (1): 21/83 kB Progress (1): 22/83 kB Progress (1): 23/83 kB Progress (1): 25/83 kB Progress (1): 26/83 kB Progress (1): 28/83 kB Progress (1): 29/83 kB Progress (1): 30/83 kB Progress (1): 32/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.9 MB/s) 2024-09-12T17:38:40.009 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T17:38:40.030 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 65/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.7 MB/s) 2024-09-12T17:38:40.060 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:40.060 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:38:40.060 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:38:40.060 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] from pom.xml 2024-09-12T17:38:40.060 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:38:40.063 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T17:38:40.078 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-12T17:38:40.085 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T17:38:40.101 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-12T17:38:40.105 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T17:38:40.122 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.7 MB/s) 2024-09-12T17:38:40.129 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T17:38:40.146 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.2 MB/s) 2024-09-12T17:38:40.160 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T17:38:40.176 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-09-12T17:38:40.184 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T17:38:40.199 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-12T17:38:40.201 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T17:38:40.215 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-12T17:38:40.218 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T17:38:40.234 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.0 MB/s) 2024-09-12T17:38:40.237 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T17:38:40.252 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-12T17:38:40.257 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T17:38:40.272 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 2.1 MB/s) 2024-09-12T17:38:40.278 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T17:38:40.293 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 613 kB/s) 2024-09-12T17:38:40.299 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T17:38:40.316 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/66 kB Progress (1): 32/66 kB Progress (1): 49/66 kB Progress (1): 65/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.9 MB/s) 2024-09-12T17:38:40.324 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T17:38:40.338 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 332 kB/s) 2024-09-12T17:38:40.340 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T17:38:40.355 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.5 MB/s) 2024-09-12T17:38:40.359 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T17:38:40.374 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/50 kB Progress (1): 32/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.3 MB/s) 2024-09-12T17:38:40.378 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T17:38:40.393 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.6 MB/s) 2024-09-12T17:38:40.401 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T17:38:40.415 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-12T17:38:40.420 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T17:38:40.436 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.8 MB/s) 2024-09-12T17:38:40.446 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T17:38:40.461 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 451 kB/s) 2024-09-12T17:38:40.463 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T17:38:40.479 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 619 kB/s) 2024-09-12T17:38:40.482 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T17:38:40.498 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.9 MB/s) 2024-09-12T17:38:40.501 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T17:38:40.516 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.4 MB/s) 2024-09-12T17:38:40.522 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T17:38:40.541 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.4 MB/s) 2024-09-12T17:38:40.556 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T17:38:40.571 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 406 kB/s) 2024-09-12T17:38:40.573 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T17:38:40.588 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.4 MB/s) 2024-09-12T17:38:40.592 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T17:38:40.608 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-12T17:38:40.615 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T17:38:40.630 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 267 kB/s) 2024-09-12T17:38:40.633 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T17:38:40.647 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 111 kB/s) 2024-09-12T17:38:40.649 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T17:38:40.664 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 149 kB/s) 2024-09-12T17:38:40.668 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T17:38:40.683 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-12T17:38:40.687 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T17:38:40.706 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 170 kB/s) 2024-09-12T17:38:40.710 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T17:38:40.725 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 731 kB/s) 2024-09-12T17:38:40.729 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T17:38:40.743 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 112 kB/s) 2024-09-12T17:38:40.747 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T17:38:40.766 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 225 kB/s) 2024-09-12T17:38:40.768 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T17:38:40.784 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 327 kB/s) 2024-09-12T17:38:40.787 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T17:38:40.802 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-12T17:38:40.804 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T17:38:40.820 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 240 kB/s) 2024-09-12T17:38:40.822 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T17:38:40.837 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 920 kB/s) 2024-09-12T17:38:40.840 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T17:38:40.854 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 245 kB/s) 2024-09-12T17:38:40.857 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T17:38:40.874 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 144 kB/s) 2024-09-12T17:38:40.879 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T17:38:40.894 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 194 kB/s) 2024-09-12T17:38:40.899 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T17:38:40.914 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-12T17:38:40.919 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T17:38:40.936 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 364 kB/s) 2024-09-12T17:38:40.939 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T17:38:40.954 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 233 kB/s) 2024-09-12T17:38:40.959 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T17:38:40.975 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 275 kB/s) 2024-09-12T17:38:40.978 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T17:38:40.994 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 150 kB/s) 2024-09-12T17:38:40.999 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T17:38:41.014 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 429 kB/s) 2024-09-12T17:38:41.019 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T17:38:41.033 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 433 kB/s) 2024-09-12T17:38:41.038 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T17:38:41.053 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 198 kB/s) 2024-09-12T17:38:41.058 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T17:38:41.073 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 232 kB/s) 2024-09-12T17:38:41.079 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T17:38:41.093 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 272 kB/s) 2024-09-12T17:38:41.095 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T17:38:41.110 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 118 kB/s) 2024-09-12T17:38:41.115 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T17:38:41.129 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 472 kB/s) 2024-09-12T17:38:41.132 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T17:38:41.147 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.1 MB/s) 2024-09-12T17:38:41.149 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T17:38:41.164 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.3 MB/s) 2024-09-12T17:38:41.167 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T17:38:41.181 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-12T17:38:41.184 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T17:38:41.199 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 331 kB/s) 2024-09-12T17:38:41.201 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T17:38:41.215 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 940 kB/s) 2024-09-12T17:38:41.219 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T17:38:41.233 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 998 kB/s) 2024-09-12T17:38:41.235 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T17:38:41.251 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.2 MB/s) 2024-09-12T17:38:41.257 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T17:38:41.272 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.0 MB/s) 2024-09-12T17:38:41.276 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T17:38:41.291 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.0 MB/s) 2024-09-12T17:38:41.293 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T17:38:41.308 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.3 MB/s) 2024-09-12T17:38:41.312 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T17:38:41.327 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.2 MB/s) 2024-09-12T17:38:41.331 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T17:38:41.346 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.3 MB/s) 2024-09-12T17:38:41.349 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T17:38:41.365 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.9 MB/s) 2024-09-12T17:38:41.370 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T17:38:41.385 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 256 kB/s) 2024-09-12T17:38:41.386 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T17:38:41.401 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 920 kB/s) 2024-09-12T17:38:41.404 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T17:38:41.418 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-12T17:38:41.420 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T17:38:41.434 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 227 kB/s) 2024-09-12T17:38:41.436 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T17:38:41.450 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-12T17:38:41.452 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T17:38:41.466 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 202 kB/s) 2024-09-12T17:38:41.468 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T17:38:41.481 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 117 kB/s) 2024-09-12T17:38:41.483 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T17:38:41.498 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 215 kB/s) 2024-09-12T17:38:41.499 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T17:38:41.514 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T17:38:41.515 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T17:38:41.530 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 229 kB/s) 2024-09-12T17:38:41.533 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T17:38:41.549 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 73 kB/s) 2024-09-12T17:38:41.550 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T17:38:41.565 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 64 kB/s) 2024-09-12T17:38:41.568 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T17:38:41.582 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 218 kB/s) 2024-09-12T17:38:41.585 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T17:38:41.599 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 217 kB/s) 2024-09-12T17:38:41.601 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T17:38:41.616 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-12T17:38:41.618 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T17:38:41.632 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 245 kB/s) 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T17:38:41.649 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 202 kB/s) 2024-09-12T17:38:41.665 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T17:38:41.744 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 42 MB/s) 2024-09-12T17:38:41.746 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T17:38:41.746 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T17:38:41.746 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T17:38:41.747 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T17:38:41.747 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T17:38:41.765 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 15/71 kB Progress (1): 31/71 kB Progress (1): 48/71 kB Progress (1): 64/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 3.5 MB/s) 2024-09-12T17:38:41.765 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T17:38:41.783 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 15/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 446 kB/s) 2024-09-12T17:38:41.783 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T17:38:41.795 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.4/98 kB Progress (2): 1.4/98 kB | 1.4/16 kB Progress (2): 2.8/98 kB | 1.4/16 kB Progress (3): 2.8/98 kB | 1.4/16 kB | 1.4/35 kB Progress (3): 4.1/98 kB | 1.4/16 kB | 1.4/35 kB Progress (3): 4.1/98 kB | 2.8/16 kB | 1.4/35 kB Progress (3): 5.5/98 kB | 2.8/16 kB | 1.4/35 kB Progress (3): 5.5/98 kB | 2.8/16 kB | 2.8/35 kB Progress (3): 6.9/98 kB | 2.8/16 kB | 2.8/35 kB Progress (4): 6.9/98 kB | 2.8/16 kB | 2.8/35 kB | 1.4/49 kB Progress (4): 8.3/98 kB | 2.8/16 kB | 2.8/35 kB | 1.4/49 kB Progress (4): 8.3/98 kB | 2.8/16 kB | 4.1/35 kB | 1.4/49 kB Progress (4): 9.7/98 kB | 2.8/16 kB | 4.1/35 kB | 1.4/49 kB Progress (4): 9.7/98 kB | 4.1/16 kB | 4.1/35 kB | 1.4/49 kB Progress (4): 11/98 kB | 4.1/16 kB | 4.1/35 kB | 1.4/49 kB Progress (4): 11/98 kB | 4.1/16 kB | 5.5/35 kB | 1.4/49 kB Progress (4): 11/98 kB | 4.1/16 kB | 5.5/35 kB | 2.8/49 kB Progress (4): 11/98 kB | 4.1/16 kB | 6.9/35 kB | 2.8/49 kB Progress (4): 12/98 kB | 4.1/16 kB | 6.9/35 kB | 2.8/49 kB Progress (4): 12/98 kB | 5.5/16 kB | 6.9/35 kB | 2.8/49 kB Progress (4): 12/98 kB | 5.5/16 kB | 8.3/35 kB | 2.8/49 kB Progress (4): 12/98 kB | 5.5/16 kB | 8.3/35 kB | 4.1/49 kB Progress (4): 12/98 kB | 5.5/16 kB | 9.7/35 kB | 4.1/49 kB Progress (4): 12/98 kB | 6.9/16 kB | 9.7/35 kB | 4.1/49 kB Progress (4): 12/98 kB | 6.9/16 kB | 11/35 kB | 4.1/49 kB Progress (4): 14/98 kB | 6.9/16 kB | 11/35 kB | 4.1/49 kB Progress (4): 14/98 kB | 6.9/16 kB | 12/35 kB | 4.1/49 kB Progress (4): 15/98 kB | 6.9/16 kB | 12/35 kB | 4.1/49 kB Progress (4): 15/98 kB | 8.3/16 kB | 12/35 kB | 4.1/49 kB Progress (4): 15/98 kB | 8.3/16 kB | 12/35 kB | 5.5/49 kB Progress (4): 15/98 kB | 9.7/16 kB | 12/35 kB | 5.5/49 kB Progress (4): 16/98 kB | 9.7/16 kB | 12/35 kB | 5.5/49 kB Progress (4): 16/98 kB | 9.7/16 kB | 14/35 kB | 5.5/49 kB Progress (4): 18/98 kB | 9.7/16 kB | 14/35 kB | 5.5/49 kB Progress (4): 18/98 kB | 11/16 kB | 14/35 kB | 5.5/49 kB Progress (4): 19/98 kB | 11/16 kB | 14/35 kB | 5.5/49 kB Progress (4): 19/98 kB | 11/16 kB | 14/35 kB | 6.9/49 kB Progress (4): 21/98 kB | 11/16 kB | 14/35 kB | 6.9/49 kB Progress (4): 21/98 kB | 12/16 kB | 14/35 kB | 6.9/49 kB Progress (4): 21/98 kB | 12/16 kB | 15/35 kB | 6.9/49 kB Progress (4): 21/98 kB | 14/16 kB | 15/35 kB | 6.9/49 kB Progress (4): 22/98 kB | 14/16 kB | 15/35 kB | 6.9/49 kB Progress (4): 22/98 kB | 14/16 kB | 15/35 kB | 8.3/49 kB Progress (4): 23/98 kB | 14/16 kB | 15/35 kB | 8.3/49 kB Progress (4): 23/98 kB | 14/16 kB | 15/35 kB | 9.7/49 kB Progress (4): 23/98 kB | 15/16 kB | 15/35 kB | 9.7/49 kB Progress (4): 23/98 kB | 15/16 kB | 16/35 kB | 9.7/49 kB Progress (4): 23/98 kB | 16 kB | 16/35 kB | 9.7/49 kB Progress (4): 23/98 kB | 16 kB | 16/35 kB | 11/49 kB Progress (4): 25/98 kB | 16 kB | 16/35 kB | 11/49 kB Progress (4): 25/98 kB | 16 kB | 18/35 kB | 11/49 kB Progress (4): 26/98 kB | 16 kB | 18/35 kB | 11/49 kB Progress (4): 26/98 kB | 16 kB | 19/35 kB | 11/49 kB Progress (4): 26/98 kB | 16 kB | 19/35 kB | 12/49 kB Progress (4): 26/98 kB | 16 kB | 21/35 kB | 12/49 kB Progress (4): 27/98 kB | 16 kB | 21/35 kB | 12/49 kB Progress (4): 27/98 kB | 16 kB | 22/35 kB | 12/49 kB Progress (4): 27/98 kB | 16 kB | 22/35 kB | 14/49 kB Progress (4): 27/98 kB | 16 kB | 23/35 kB | 14/49 kB Progress (4): 29/98 kB | 16 kB | 23/35 kB | 14/49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 329 kB/s) 2024-09-12T17:38:41.796 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (3): 29/98 kB | 25/35 kB | 14/49 kB Progress (3): 29/98 kB | 25/35 kB | 15/49 kB Progress (3): 29/98 kB | 26/35 kB | 15/49 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T17:38:41.805 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (3): 30/98 kB | 26/35 kB | 15/49 kB Progress (3): 30/98 kB | 27/35 kB | 15/49 kB Progress (3): 30/98 kB | 27/35 kB | 16/49 kB Progress (3): 30/98 kB | 29/35 kB | 16/49 kB Progress (3): 30/98 kB | 29/35 kB | 17/49 kB Progress (3): 30/98 kB | 30/35 kB | 17/49 kB Progress (3): 30/98 kB | 30/35 kB | 19/49 kB Progress (3): 30/98 kB | 30/35 kB | 20/49 kB Progress (3): 30/98 kB | 30/35 kB | 21/49 kB Progress (3): 30/98 kB | 30/35 kB | 23/49 kB Progress (3): 30/98 kB | 30/35 kB | 24/49 kB Progress (3): 30/98 kB | 30/35 kB | 25/49 kB Progress (3): 30/98 kB | 30/35 kB | 27/49 kB Progress (3): 30/98 kB | 30/35 kB | 28/49 kB Progress (3): 30/98 kB | 30/35 kB | 30/49 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 15/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 31/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 48/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 64/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 81/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 97/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 113/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 127/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 143/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 160/782 kB Progress (4): 30/98 kB | 30/35 kB | 30/49 kB | 176/782 kB Progress (4): 31/98 kB | 30/35 kB | 30/49 kB | 176/782 kB Progress (4): 33/98 kB | 30/35 kB | 30/49 kB | 176/782 kB Progress (4): 33/98 kB | 30/35 kB | 30/49 kB | 192/782 kB Progress (4): 34/98 kB | 30/35 kB | 30/49 kB | 192/782 kB Progress (4): 36/98 kB | 30/35 kB | 30/49 kB | 192/782 kB Progress (4): 36/98 kB | 30/35 kB | 31/49 kB | 192/782 kB Progress (4): 36/98 kB | 30/35 kB | 31/49 kB | 209/782 kB Progress (4): 37/98 kB | 30/35 kB | 31/49 kB | 209/782 kB Progress (4): 37/98 kB | 32/35 kB | 31/49 kB | 209/782 kB Progress (4): 37/98 kB | 32/35 kB | 32/49 kB | 209/782 kB Progress (4): 38/98 kB | 32/35 kB | 32/49 kB | 209/782 kB Progress (4): 38/98 kB | 32/35 kB | 34/49 kB | 209/782 kB Progress (4): 38/98 kB | 32/35 kB | 34/49 kB | 225/782 kB Progress (4): 38/98 kB | 33/35 kB | 34/49 kB | 225/782 kB Progress (4): 38/98 kB | 33/35 kB | 35/49 kB | 225/782 kB Progress (4): 40/98 kB | 33/35 kB | 35/49 kB | 225/782 kB Progress (4): 40/98 kB | 33/35 kB | 36/49 kB | 225/782 kB Progress (4): 40/98 kB | 34/35 kB | 36/49 kB | 225/782 kB Progress (4): 40/98 kB | 34/35 kB | 38/49 kB | 225/782 kB Progress (4): 41/98 kB | 34/35 kB | 38/49 kB | 225/782 kB Progress (4): 41/98 kB | 34/35 kB | 39/49 kB | 225/782 kB Progress (4): 41/98 kB | 34/35 kB | 39/49 kB | 242/782 kB Progress (4): 41/98 kB | 35 kB | 39/49 kB | 242/782 kB Progress (4): 41/98 kB | 35 kB | 41/49 kB | 242/782 kB Progress (4): 41/98 kB | 35 kB | 42/49 kB | 242/782 kB Progress (4): 41/98 kB | 35 kB | 43/49 kB | 242/782 kB Progress (4): 41/98 kB | 35 kB | 43/49 kB | 258/782 kB Progress (4): 42/98 kB | 35 kB | 43/49 kB | 258/782 kB Progress (4): 42/98 kB | 35 kB | 45/49 kB | 258/782 kB Progress (4): 44/98 kB | 35 kB | 45/49 kB | 258/782 kB Progress (4): 45/98 kB | 35 kB | 45/49 kB | 258/782 kB Progress (4): 45/98 kB | 35 kB | 46/49 kB | 258/782 kB Progress (4): 47/98 kB | 35 kB | 46/49 kB | 258/782 kB Progress (4): 47/98 kB | 35 kB | 48/49 kB | 258/782 kB Progress (4): 47/98 kB | 35 kB | 48/49 kB | 274/782 kB Progress (4): 47/98 kB | 35 kB | 49/49 kB | 274/782 kB Progress (4): 48/98 kB | 35 kB | 49/49 kB | 274/782 kB Progress (4): 48/98 kB | 35 kB | 49 kB | 274/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 617 kB/s) 2024-09-12T17:38:41.805 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (3): 49/98 kB | 49 kB | 274/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T17:38:41.805 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (3): 49/98 kB | 49 kB | 291/782 kB Progress (3): 51/98 kB | 49 kB | 291/782 kB Progress (3): 52/98 kB | 49 kB | 291/782 kB Progress (3): 53/98 kB | 49 kB | 291/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 864 kB/s) 2024-09-12T17:38:41.805 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 55/98 kB | 291/782 kB Progress (2): 55/98 kB | 307/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T17:38:41.809 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 56/98 kB | 307/782 kB Progress (2): 58/98 kB | 307/782 kB Progress (2): 58/98 kB | 324/782 kB Progress (2): 59/98 kB | 324/782 kB Progress (2): 60/98 kB | 324/782 kB Progress (2): 62/98 kB | 324/782 kB Progress (2): 62/98 kB | 340/782 kB Progress (2): 62/98 kB | 356/782 kB Progress (2): 62/98 kB | 373/782 kB Progress (2): 62/98 kB | 389/782 kB Progress (2): 62/98 kB | 405/782 kB Progress (2): 62/98 kB | 422/782 kB Progress (2): 62/98 kB | 438/782 kB Progress (2): 62/98 kB | 455/782 kB Progress (2): 62/98 kB | 471/782 kB Progress (2): 62/98 kB | 487/782 kB Progress (2): 62/98 kB | 504/782 kB Progress (3): 62/98 kB | 504/782 kB | 1.4/11 kB Progress (3): 62/98 kB | 504/782 kB | 2.8/11 kB Progress (3): 62/98 kB | 504/782 kB | 4.1/11 kB Progress (3): 62/98 kB | 520/782 kB | 4.1/11 kB Progress (3): 62/98 kB | 520/782 kB | 5.5/11 kB Progress (3): 62/98 kB | 520/782 kB | 6.9/11 kB Progress (3): 62/98 kB | 520/782 kB | 8.3/11 kB Progress (3): 62/98 kB | 537/782 kB | 8.3/11 kB Progress (3): 62/98 kB | 537/782 kB | 9.7/11 kB Progress (3): 62/98 kB | 537/782 kB | 11/11 kB Progress (3): 62/98 kB | 537/782 kB | 11 kB Progress (3): 62/98 kB | 553/782 kB | 11 kB Progress (3): 62/98 kB | 569/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 183 kB/s) 2024-09-12T17:38:41.809 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 62/98 kB | 586/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T17:38:41.813 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 62/98 kB | 602/782 kB Progress (2): 62/98 kB | 618/782 kB Progress (2): 62/98 kB | 635/782 kB Progress (2): 62/98 kB | 651/782 kB Progress (2): 62/98 kB | 668/782 kB Progress (2): 62/98 kB | 684/782 kB Progress (2): 62/98 kB | 700/782 kB Progress (2): 62/98 kB | 717/782 kB Progress (2): 62/98 kB | 733/782 kB Progress (2): 63/98 kB | 733/782 kB Progress (2): 63/98 kB | 749/782 kB Progress (2): 64/98 kB | 749/782 kB Progress (2): 64/98 kB | 766/782 kB Progress (2): 64/98 kB | 782/782 kB Progress (2): 64/98 kB | 782 kB Progress (2): 81/98 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 12 MB/s) 2024-09-12T17:38:41.813 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T17:38:41.814 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 97/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.4 MB/s) 2024-09-12T17:38:41.815 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T17:38:41.819 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.4/205 kB Progress (1): 2.8/205 kB Progress (1): 4.1/205 kB Progress (1): 5.5/205 kB Progress (1): 6.9/205 kB Progress (1): 8.3/205 kB Progress (1): 9.7/205 kB Progress (1): 11/205 kB Progress (1): 12/205 kB Progress (1): 14/205 kB Progress (1): 15/205 kB Progress (2): 15/205 kB | 16/30 kB Progress (2): 15/205 kB | 30 kB Progress (2): 31/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 414 kB/s) 2024-09-12T17:38:41.820 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T17:38:41.830 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 48/205 kB Progress (2): 48/205 kB | 1.4/81 kB Progress (2): 48/205 kB | 2.8/81 kB Progress (2): 48/205 kB | 4.1/81 kB Progress (2): 48/205 kB | 5.5/81 kB Progress (2): 48/205 kB | 6.9/81 kB Progress (2): 48/205 kB | 8.3/81 kB Progress (2): 48/205 kB | 9.7/81 kB Progress (2): 48/205 kB | 11/81 kB Progress (2): 48/205 kB | 12/81 kB Progress (2): 48/205 kB | 14/81 kB Progress (2): 48/205 kB | 15/81 kB Progress (2): 48/205 kB | 16/81 kB Progress (3): 48/205 kB | 16/81 kB | 16/798 kB Progress (3): 48/205 kB | 16/81 kB | 33/798 kB Progress (3): 48/205 kB | 16/81 kB | 49/798 kB Progress (3): 48/205 kB | 16/81 kB | 66/798 kB Progress (3): 48/205 kB | 16/81 kB | 82/798 kB Progress (3): 48/205 kB | 16/81 kB | 98/798 kB Progress (3): 48/205 kB | 16/81 kB | 115/798 kB Progress (3): 48/205 kB | 16/81 kB | 131/798 kB Progress (3): 48/205 kB | 16/81 kB | 147/798 kB Progress (4): 48/205 kB | 16/81 kB | 147/798 kB | 13 kB Progress (4): 48/205 kB | 16/81 kB | 164/798 kB | 13 kB Progress (4): 64/205 kB | 16/81 kB | 164/798 kB | 13 kB Progress (4): 64/205 kB | 16/81 kB | 180/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 161 kB/s) 2024-09-12T17:38:41.830 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T17:38:41.840 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (3): 64/205 kB | 16/81 kB | 197/798 kB Progress (3): 81/205 kB | 16/81 kB | 197/798 kB Progress (3): 81/205 kB | 16/81 kB | 213/798 kB Progress (3): 81/205 kB | 16/81 kB | 229/798 kB Progress (3): 81/205 kB | 16/81 kB | 246/798 kB Progress (3): 81/205 kB | 16/81 kB | 262/798 kB Progress (3): 81/205 kB | 16/81 kB | 275/798 kB Progress (3): 97/205 kB | 16/81 kB | 275/798 kB Progress (3): 97/205 kB | 16/81 kB | 291/798 kB Progress (3): 97/205 kB | 16/81 kB | 308/798 kB Progress (3): 97/205 kB | 16/81 kB | 324/798 kB Progress (3): 97/205 kB | 16/81 kB | 341/798 kB Progress (3): 97/205 kB | 16/81 kB | 357/798 kB Progress (3): 97/205 kB | 16/81 kB | 373/798 kB Progress (3): 97/205 kB | 16/81 kB | 390/798 kB Progress (3): 113/205 kB | 16/81 kB | 390/798 kB Progress (3): 113/205 kB | 16/81 kB | 406/798 kB Progress (3): 113/205 kB | 16/81 kB | 422/798 kB Progress (3): 129/205 kB | 16/81 kB | 422/798 kB Progress (3): 129/205 kB | 16/81 kB | 439/798 kB Progress (3): 129/205 kB | 16/81 kB | 455/798 kB Progress (4): 129/205 kB | 16/81 kB | 455/798 kB | 16/182 kB Progress (4): 129/205 kB | 16/81 kB | 472/798 kB | 16/182 kB Progress (4): 146/205 kB | 16/81 kB | 472/798 kB | 16/182 kB Progress (4): 146/205 kB | 33/81 kB | 472/798 kB | 16/182 kB Progress (4): 146/205 kB | 33/81 kB | 488/798 kB | 16/182 kB Progress (4): 146/205 kB | 33/81 kB | 488/798 kB | 33/182 kB Progress (4): 146/205 kB | 33/81 kB | 504/798 kB | 33/182 kB Progress (4): 162/205 kB | 33/81 kB | 504/798 kB | 33/182 kB Progress (4): 162/205 kB | 33/81 kB | 521/798 kB | 33/182 kB Progress (4): 162/205 kB | 33/81 kB | 537/798 kB | 33/182 kB Progress (4): 162/205 kB | 49/81 kB | 537/798 kB | 33/182 kB Progress (4): 162/205 kB | 49/81 kB | 554/798 kB | 33/182 kB Progress (4): 162/205 kB | 49/81 kB | 570/798 kB | 33/182 kB Progress (4): 162/205 kB | 49/81 kB | 570/798 kB | 49/182 kB Progress (4): 162/205 kB | 49/81 kB | 586/798 kB | 49/182 kB Progress (4): 162/205 kB | 49/81 kB | 603/798 kB | 49/182 kB Progress (4): 162/205 kB | 49/81 kB | 603/798 kB | 62/182 kB Progress (4): 162/205 kB | 64/81 kB | 603/798 kB | 62/182 kB Progress (4): 162/205 kB | 64/81 kB | 619/798 kB | 62/182 kB Progress (4): 162/205 kB | 64/81 kB | 635/798 kB | 62/182 kB Progress (4): 162/205 kB | 64/81 kB | 652/798 kB | 62/182 kB Progress (4): 162/205 kB | 64/81 kB | 668/798 kB | 62/182 kB Progress (4): 162/205 kB | 80/81 kB | 668/798 kB | 62/182 kB Progress (4): 162/205 kB | 81 kB | 668/798 kB | 62/182 kB Progress (4): 162/205 kB | 81 kB | 685/798 kB | 62/182 kB Progress (4): 162/205 kB | 81 kB | 701/798 kB | 62/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 874 kB/s) 2024-09-12T17:38:41.840 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T17:38:41.842 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (3): 162/205 kB | 717/798 kB | 62/182 kB Progress (3): 162/205 kB | 734/798 kB | 62/182 kB Progress (3): 179/205 kB | 734/798 kB | 62/182 kB Progress (3): 195/205 kB | 734/798 kB | 62/182 kB Progress (3): 195/205 kB | 750/798 kB | 62/182 kB Progress (3): 205 kB | 750/798 kB | 62/182 kB Progress (3): 205 kB | 766/798 kB | 62/182 kB Progress (3): 205 kB | 783/798 kB | 62/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.2 MB/s) 2024-09-12T17:38:41.842 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T17:38:41.843 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 798 kB | 62/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 8.3 MB/s) 2024-09-12T17:38:41.843 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T17:38:41.850 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 62/182 kB | 16/151 kB Progress (2): 62/182 kB | 33/151 kB Progress (2): 78/182 kB | 33/151 kB Progress (2): 78/182 kB | 49/151 kB Progress (2): 94/182 kB | 49/151 kB Progress (2): 94/182 kB | 66/151 kB Progress (2): 111/182 kB | 66/151 kB Progress (2): 111/182 kB | 79/151 kB Progress (2): 127/182 kB | 79/151 kB Progress (2): 127/182 kB | 95/151 kB Progress (2): 143/182 kB | 95/151 kB Progress (2): 143/182 kB | 111/151 kB Progress (2): 160/182 kB | 111/151 kB Progress (2): 176/182 kB | 111/151 kB Progress (2): 182 kB | 111/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.8 MB/s) 2024-09-12T17:38:41.850 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T17:38:41.855 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 111/151 kB | 16/27 kB Progress (2): 111/151 kB | 27 kB Progress (2): 128/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 253 kB/s) 2024-09-12T17:38:41.855 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T17:38:41.856 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 128/151 kB | 15/30 kB Progress (2): 128/151 kB | 30 kB Progress (2): 144/151 kB | 30 kB Progress (2): 151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 278 kB/s) 2024-09-12T17:38:41.856 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T17:38:41.856 INFO:tasks.workunit.client.0.smithi044.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.4 MB/s) 2024-09-12T17:38:41.857 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T17:38:41.865 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/385 kB Progress (1): 32/385 kB Progress (1): 49/385 kB Progress (1): 65/385 kB Progress (1): 81/385 kB Progress (1): 98/385 kB Progress (1): 114/385 kB Progress (1): 114/385 kB Progress (1): 131/385 kB Progress (1): 147/385 kB Progress (1): 164/385 kB Progress (1): 180/385 kB Progress (1): 196/385 kB Progress (1): 213/385 kB Progress (1): 229/385 kB Progress (1): 245/385 kB Progress (1): 262/385 kB Progress (2): 262/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 112 kB/s) 2024-09-12T17:38:41.865 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T17:38:41.870 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 278/385 kB Progress (1): 295/385 kB Progress (1): 311/385 kB Progress (1): 327/385 kB Progress (1): 344/385 kB Progress (2): 344/385 kB | 16/75 kB Progress (2): 360/385 kB | 16/75 kB Progress (2): 376/385 kB | 16/75 kB Progress (2): 385 kB | 16/75 kB Progress (2): 385 kB | 33/75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.2 MB/s) 2024-09-12T17:38:41.870 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T17:38:41.893 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 33/75 kB | 16/329 kB Progress (2): 49/75 kB | 16/329 kB Progress (2): 49/75 kB | 33/329 kB Progress (2): 49/75 kB | 49/329 kB Progress (3): 49/75 kB | 49/329 kB | 16/780 kB Progress (3): 49/75 kB | 66/329 kB | 16/780 kB Progress (3): 66/75 kB | 66/329 kB | 16/780 kB Progress (3): 66/75 kB | 66/329 kB | 33/780 kB Progress (3): 66/75 kB | 82/329 kB | 33/780 kB Progress (3): 75 kB | 82/329 kB | 33/780 kB Progress (3): 75 kB | 98/329 kB | 33/780 kB Progress (3): 75 kB | 98/329 kB | 49/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 540 kB/s) 2024-09-12T17:38:41.893 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T17:38:41.894 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 115/329 kB | 49/780 kB Progress (2): 115/329 kB | 66/780 kB Progress (2): 115/329 kB | 82/780 kB Progress (2): 131/329 kB | 82/780 kB Progress (3): 131/329 kB | 82/780 kB | 16/354 kB Progress (4): 131/329 kB | 82/780 kB | 16/354 kB | 16/501 kB Progress (4): 131/329 kB | 98/780 kB | 16/354 kB | 16/501 kB Progress (4): 147/329 kB | 98/780 kB | 16/354 kB | 16/501 kB Progress (4): 147/329 kB | 98/780 kB | 33/354 kB | 16/501 kB Progress (4): 147/329 kB | 98/780 kB | 33/354 kB | 32/501 kB Progress (4): 147/329 kB | 115/780 kB | 33/354 kB | 32/501 kB Progress (4): 164/329 kB | 115/780 kB | 33/354 kB | 32/501 kB Progress (4): 164/329 kB | 115/780 kB | 49/354 kB | 32/501 kB Progress (4): 164/329 kB | 131/780 kB | 49/354 kB | 32/501 kB Progress (4): 164/329 kB | 131/780 kB | 49/354 kB | 49/501 kB Progress (4): 164/329 kB | 131/780 kB | 64/354 kB | 49/501 kB Progress (4): 180/329 kB | 131/780 kB | 64/354 kB | 49/501 kB Progress (4): 180/329 kB | 131/780 kB | 64/354 kB | 65/501 kB Progress (4): 180/329 kB | 147/780 kB | 64/354 kB | 65/501 kB Progress (4): 180/329 kB | 147/780 kB | 80/354 kB | 65/501 kB Progress (4): 180/329 kB | 147/780 kB | 80/354 kB | 81/501 kB Progress (4): 197/329 kB | 147/780 kB | 80/354 kB | 81/501 kB Progress (4): 197/329 kB | 164/780 kB | 80/354 kB | 81/501 kB Progress (4): 197/329 kB | 164/780 kB | 96/354 kB | 81/501 kB Progress (4): 197/329 kB | 164/780 kB | 96/354 kB | 98/501 kB Progress (4): 197/329 kB | 164/780 kB | 113/354 kB | 98/501 kB Progress (4): 213/329 kB | 164/780 kB | 113/354 kB | 98/501 kB Progress (4): 213/329 kB | 180/780 kB | 113/354 kB | 98/501 kB Progress (4): 213/329 kB | 180/780 kB | 113/354 kB | 114/501 kB Progress (4): 213/329 kB | 180/780 kB | 129/354 kB | 114/501 kB Progress (4): 213/329 kB | 180/780 kB | 129/354 kB | 130/501 kB Progress (4): 229/329 kB | 180/780 kB | 129/354 kB | 130/501 kB Progress (4): 229/329 kB | 197/780 kB | 129/354 kB | 130/501 kB Progress (4): 229/329 kB | 197/780 kB | 146/354 kB | 130/501 kB Progress (4): 229/329 kB | 197/780 kB | 146/354 kB | 147/501 kB Progress (4): 246/329 kB | 197/780 kB | 146/354 kB | 147/501 kB Progress (4): 246/329 kB | 197/780 kB | 146/354 kB | 163/501 kB Progress (4): 246/329 kB | 197/780 kB | 162/354 kB | 163/501 kB Progress (4): 246/329 kB | 213/780 kB | 162/354 kB | 163/501 kB Progress (4): 256/329 kB | 213/780 kB | 162/354 kB | 163/501 kB Progress (4): 256/329 kB | 213/780 kB | 162/354 kB | 180/501 kB Progress (4): 256/329 kB | 213/780 kB | 178/354 kB | 180/501 kB Progress (4): 256/329 kB | 229/780 kB | 178/354 kB | 180/501 kB Progress (4): 256/329 kB | 229/780 kB | 178/354 kB | 196/501 kB Progress (4): 272/329 kB | 229/780 kB | 178/354 kB | 196/501 kB Progress (4): 272/329 kB | 229/780 kB | 195/354 kB | 196/501 kB Progress (4): 272/329 kB | 229/780 kB | 195/354 kB | 212/501 kB Progress (4): 272/329 kB | 246/780 kB | 195/354 kB | 212/501 kB Progress (4): 272/329 kB | 246/780 kB | 211/354 kB | 212/501 kB Progress (4): 289/329 kB | 246/780 kB | 211/354 kB | 212/501 kB Progress (4): 289/329 kB | 246/780 kB | 211/354 kB | 229/501 kB Progress (4): 289/329 kB | 246/780 kB | 227/354 kB | 229/501 kB Progress (4): 289/329 kB | 262/780 kB | 227/354 kB | 229/501 kB Progress (4): 289/329 kB | 262/780 kB | 227/354 kB | 245/501 kB Progress (4): 305/329 kB | 262/780 kB | 227/354 kB | 245/501 kB Progress (4): 305/329 kB | 262/780 kB | 244/354 kB | 245/501 kB Progress (4): 305/329 kB | 262/780 kB | 244/354 kB | 262/501 kB Progress (4): 305/329 kB | 279/780 kB | 244/354 kB | 262/501 kB Progress (4): 321/329 kB | 279/780 kB | 244/354 kB | 262/501 kB Progress (4): 321/329 kB | 279/780 kB | 260/354 kB | 262/501 kB Progress (4): 329 kB | 279/780 kB | 260/354 kB | 262/501 kB Progress (4): 329 kB | 295/780 kB | 260/354 kB | 262/501 kB Progress (4): 329 kB | 295/780 kB | 277/354 kB | 262/501 kB Progress (4): 329 kB | 295/780 kB | 293/354 kB | 262/501 kB Progress (4): 329 kB | 311/780 kB | 293/354 kB | 262/501 kB Progress (4): 329 kB | 311/780 kB | 309/354 kB | 262/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.3 MB/s) 2024-09-12T17:38:41.894 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (3): 328/780 kB | 309/354 kB | 262/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T17:38:41.895 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (3): 328/780 kB | 326/354 kB | 262/501 kB Progress (3): 344/780 kB | 326/354 kB | 262/501 kB Progress (3): 344/780 kB | 342/354 kB | 262/501 kB Progress (3): 360/780 kB | 342/354 kB | 262/501 kB Progress (3): 360/780 kB | 354 kB | 262/501 kB Progress (3): 377/780 kB | 354 kB | 262/501 kB Progress (3): 377/780 kB | 354 kB | 278/501 kB Progress (3): 393/780 kB | 354 kB | 278/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.4 MB/s) 2024-09-12T17:38:41.895 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T17:38:41.900 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 393/780 kB | 294/501 kB Progress (2): 410/780 kB | 294/501 kB Progress (2): 410/780 kB | 311/501 kB Progress (2): 426/780 kB | 311/501 kB Progress (2): 426/780 kB | 327/501 kB Progress (2): 442/780 kB | 327/501 kB Progress (2): 442/780 kB | 343/501 kB Progress (2): 459/780 kB | 343/501 kB Progress (2): 459/780 kB | 360/501 kB Progress (2): 475/780 kB | 360/501 kB Progress (2): 475/780 kB | 376/501 kB Progress (2): 492/780 kB | 376/501 kB Progress (2): 492/780 kB | 393/501 kB Progress (2): 508/780 kB | 393/501 kB Progress (2): 508/780 kB | 402/501 kB Progress (2): 524/780 kB | 402/501 kB Progress (2): 524/780 kB | 418/501 kB Progress (2): 541/780 kB | 418/501 kB Progress (2): 541/780 kB | 435/501 kB Progress (2): 557/780 kB | 435/501 kB Progress (2): 557/780 kB | 451/501 kB Progress (2): 573/780 kB | 451/501 kB Progress (2): 573/780 kB | 468/501 kB Progress (2): 585/780 kB | 468/501 kB Progress (2): 585/780 kB | 484/501 kB Progress (2): 601/780 kB | 484/501 kB Progress (2): 601/780 kB | 500/501 kB Progress (2): 601/780 kB | 501 kB Progress (2): 617/780 kB | 501 kB Progress (2): 634/780 kB | 501 kB Progress (2): 650/780 kB | 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.3 MB/s) 2024-09-12T17:38:41.900 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T17:38:41.902 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 667/780 kB Progress (1): 683/780 kB Progress (2): 683/780 kB | 16/41 kB Progress (2): 699/780 kB | 16/41 kB Progress (2): 699/780 kB | 33/41 kB Progress (2): 716/780 kB | 33/41 kB Progress (2): 716/780 kB | 41 kB Progress (2): 732/780 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 267 kB/s) 2024-09-12T17:38:41.903 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T17:38:41.903 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 749/780 kB Progress (1): 765/780 kB Progress (1): 780 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.0 MB/s) 2024-09-12T17:38:41.904 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T17:38:41.907 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 40 kB/s) 2024-09-12T17:38:41.908 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T17:38:41.917 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/586 kB Progress (1): 32/586 kB Progress (1): 49/586 kB Progress (1): 65/586 kB Progress (1): 81/586 kB Progress (1): 98/586 kB Progress (1): 114/586 kB Progress (1): 130/586 kB Progress (1): 147/586 kB Progress (1): 163/586 kB Progress (1): 180/586 kB Progress (1): 196/586 kB Progress (1): 212/586 kB Progress (1): 229/586 kB Progress (1): 245/586 kB Progress (1): 262/586 kB Progress (1): 278/586 kB Progress (1): 294/586 kB Progress (1): 311/586 kB Progress (1): 327/586 kB Progress (1): 343/586 kB Progress (2): 343/586 kB | 14 kB Progress (3): 343/586 kB | 14 kB | 16/211 kB Progress (3): 360/586 kB | 14 kB | 16/211 kB Progress (3): 376/586 kB | 14 kB | 16/211 kB Progress (3): 376/586 kB | 14 kB | 33/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 85 kB/s) 2024-09-12T17:38:41.917 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T17:38:41.920 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 393/586 kB | 33/211 kB Progress (2): 393/586 kB | 49/211 kB Progress (2): 402/586 kB | 49/211 kB Progress (2): 402/586 kB | 66/211 kB Progress (2): 418/586 kB | 66/211 kB Progress (2): 435/586 kB | 66/211 kB Progress (2): 435/586 kB | 82/211 kB Progress (2): 451/586 kB | 82/211 kB Progress (2): 451/586 kB | 98/211 kB Progress (2): 468/586 kB | 98/211 kB Progress (2): 484/586 kB | 98/211 kB Progress (2): 484/586 kB | 115/211 kB Progress (2): 500/586 kB | 115/211 kB Progress (3): 500/586 kB | 115/211 kB | 16/106 kB Progress (3): 500/586 kB | 131/211 kB | 16/106 kB Progress (3): 517/586 kB | 131/211 kB | 16/106 kB Progress (3): 517/586 kB | 131/211 kB | 32/106 kB Progress (3): 533/586 kB | 131/211 kB | 32/106 kB Progress (3): 533/586 kB | 147/211 kB | 32/106 kB Progress (3): 549/586 kB | 147/211 kB | 32/106 kB Progress (3): 549/586 kB | 147/211 kB | 49/106 kB Progress (3): 549/586 kB | 164/211 kB | 49/106 kB Progress (3): 566/586 kB | 164/211 kB | 49/106 kB Progress (3): 566/586 kB | 164/211 kB | 65/106 kB Progress (3): 582/586 kB | 164/211 kB | 65/106 kB Progress (3): 582/586 kB | 180/211 kB | 65/106 kB Progress (3): 586 kB | 180/211 kB | 65/106 kB Progress (3): 586 kB | 180/211 kB | 81/106 kB Progress (3): 586 kB | 197/211 kB | 81/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.4 MB/s) 2024-09-12T17:38:41.920 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T17:38:41.921 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 197/211 kB | 98/106 kB Progress (2): 211 kB | 98/106 kB Progress (2): 211 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-12T17:38:41.921 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T17:38:41.921 INFO:tasks.workunit.client.0.smithi044.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 614 kB/s) 2024-09-12T17:38:41.922 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:38:41.922 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 40 kB/s) 2024-09-12T17:38:41.922 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T17:38:41.936 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 82/245 kB Progress (2): 82/245 kB | 16/205 kB Progress (2): 82/245 kB | 33/205 kB Progress (2): 82/245 kB | 49/205 kB Progress (2): 98/245 kB | 49/205 kB Progress (2): 98/245 kB | 65/205 kB Progress (2): 115/245 kB | 65/205 kB Progress (2): 115/245 kB | 81/205 kB Progress (2): 115/245 kB | 98/205 kB Progress (2): 115/245 kB | 114/205 kB Progress (3): 115/245 kB | 114/205 kB | 16/16 kB Progress (3): 115/245 kB | 114/205 kB | 16 kB Progress (3): 131/245 kB | 114/205 kB | 16 kB Progress (3): 131/245 kB | 130/205 kB | 16 kB Progress (4): 131/245 kB | 130/205 kB | 16 kB | 15 kB Progress (5): 131/245 kB | 130/205 kB | 16 kB | 15 kB | 6.4 kB Progress (5): 131/245 kB | 147/205 kB | 16 kB | 15 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 88 kB/s) 2024-09-12T17:38:41.936 INFO:tasks.workunit.client.0.smithi044.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 82 kB/s) 2024-09-12T17:38:41.937 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (3): 131/245 kB | 163/205 kB | 6.4 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T17:38:41.937 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (3): 147/245 kB | 163/205 kB | 6.4 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T17:38:41.937 INFO:tasks.workunit.client.0.smithi044.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 34 kB/s) 2024-09-12T17:38:41.937 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T17:38:41.937 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 147/245 kB | 180/205 kB Progress (2): 147/245 kB | 196/205 kB Progress (2): 147/245 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.1 MB/s) 2024-09-12T17:38:41.937 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T17:38:41.945 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 164/245 kB Progress (1): 180/245 kB Progress (1): 197/245 kB Progress (1): 213/245 kB Progress (1): 229/245 kB Progress (1): 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-12T17:38:41.951 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/24 kB Progress (2): 16/24 kB | 16/23 kB Progress (3): 16/24 kB | 16/23 kB | 16/17 kB Progress (3): 16/24 kB | 23 kB | 16/17 kB Progress (3): 24 kB | 23 kB | 16/17 kB Progress (3): 24 kB | 23 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 86 kB/s) 2024-09-12T17:38:41.951 INFO:tasks.workunit.client.0.smithi044.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 112 kB/s) 2024-09-12T17:38:41.951 INFO:tasks.workunit.client.0.smithi044.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 119 kB/s) 2024-09-12T17:38:41.956 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 115/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 164/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 897 kB/s) 2024-09-12T17:38:41.973 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:41.973 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T17:38:41.979 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 416 kB/s) 2024-09-12T17:38:41.996 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T17:38:42.010 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 364 kB/s) 2024-09-12T17:38:42.012 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 3.1 MB/s) 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T17:38:42.044 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-12T17:38:42.049 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T17:38:42.066 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 81/153 kB Progress (1): 97/153 kB Progress (1): 114/153 kB Progress (1): 130/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.0 MB/s) 2024-09-12T17:38:42.066 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T17:38:42.084 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 115/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 164/215 kB Progress (1): 180/215 kB Progress (1): 197/215 kB Progress (1): 213/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 12 MB/s) 2024-09-12T17:38:42.124 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:42.124 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:38:42.129 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T17:38:42.143 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-12T17:38:42.145 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T17:38:42.161 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.6 MB/s) 2024-09-12T17:38:42.162 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T17:38:42.176 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-12T17:38:42.179 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T17:38:42.195 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.6 MB/s) 2024-09-12T17:38:42.199 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T17:38:42.213 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 431 kB/s) 2024-09-12T17:38:42.214 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T17:38:42.227 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 248 kB/s) 2024-09-12T17:38:42.230 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T17:38:42.244 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-12T17:38:42.246 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T17:38:42.260 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-12T17:38:42.262 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T17:38:42.277 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-12T17:38:42.279 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T17:38:42.293 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-12T17:38:42.294 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T17:38:42.309 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 557 kB/s) 2024-09-12T17:38:42.311 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T17:38:42.325 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-12T17:38:42.327 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T17:38:42.341 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-12T17:38:42.344 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T17:38:42.358 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-12T17:38:42.364 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T17:38:42.377 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 392 kB/s) 2024-09-12T17:38:42.380 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T17:38:42.394 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-12T17:38:42.400 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T17:38:42.414 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 364 kB/s) 2024-09-12T17:38:42.417 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T17:38:42.432 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 37/85 kB Progress (1): 53/85 kB Progress (1): 69/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.7 MB/s) 2024-09-12T17:38:42.432 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T17:38:42.433 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T17:38:42.433 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T17:38:42.433 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T17:38:42.433 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T17:38:42.448 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 178 kB/s) 2024-09-12T17:38:42.448 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 33/41 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T17:38:42.448 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 41 kB Progress (2): 41 kB | 16/55 kB Progress (3): 41 kB | 16/55 kB | 16/269 kB Progress (3): 41 kB | 16/55 kB | 33/269 kB Progress (3): 41 kB | 33/55 kB | 33/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.9 MB/s) 2024-09-12T17:38:42.448 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T17:38:42.449 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (3): 33/55 kB | 33/269 kB | 8.5 kB Progress (3): 33/55 kB | 49/269 kB | 8.5 kB Progress (3): 49/55 kB | 49/269 kB | 8.5 kB Progress (3): 49/55 kB | 66/269 kB | 8.5 kB Progress (3): 55 kB | 66/269 kB | 8.5 kB Progress (3): 55 kB | 82/269 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-09-12T17:38:42.449 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 55 kB | 98/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.4 MB/s) 2024-09-12T17:38:42.451 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 112/269 kB Progress (1): 129/269 kB Progress (1): 145/269 kB Progress (1): 162/269 kB Progress (1): 178/269 kB Progress (1): 194/269 kB Progress (1): 211/269 kB Progress (1): 227/269 kB Progress (1): 243/269 kB Progress (1): 260/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 14 MB/s) 2024-09-12T17:38:42.466 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (2): 49/327 kB | 16/587 kB Progress (2): 66/327 kB | 16/587 kB Progress (2): 66/327 kB | 32/587 kB Progress (2): 82/327 kB | 32/587 kB Progress (2): 82/327 kB | 49/587 kB Progress (2): 98/327 kB | 49/587 kB Progress (2): 98/327 kB | 65/587 kB Progress (2): 115/327 kB | 65/587 kB Progress (2): 115/327 kB | 81/587 kB Progress (2): 131/327 kB | 81/587 kB Progress (2): 131/327 kB | 98/587 kB Progress (2): 147/327 kB | 98/587 kB Progress (2): 147/327 kB | 114/587 kB Progress (2): 164/327 kB | 114/587 kB Progress (2): 164/327 kB | 130/587 kB Progress (2): 180/327 kB | 130/587 kB Progress (2): 180/327 kB | 147/587 kB Progress (2): 197/327 kB | 147/587 kB Progress (2): 197/327 kB | 163/587 kB Progress (2): 213/327 kB | 163/587 kB Progress (2): 213/327 kB | 180/587 kB Progress (2): 229/327 kB | 180/587 kB Progress (2): 229/327 kB | 196/587 kB Progress (2): 246/327 kB | 196/587 kB Progress (2): 246/327 kB | 212/587 kB Progress (2): 262/327 kB | 212/587 kB Progress (2): 262/327 kB | 229/587 kB Progress (2): 279/327 kB | 229/587 kB Progress (2): 279/327 kB | 245/587 kB Progress (2): 295/327 kB | 245/587 kB Progress (2): 295/327 kB | 262/587 kB Progress (2): 311/327 kB | 262/587 kB Progress (2): 311/327 kB | 278/587 kB Progress (2): 327 kB | 278/587 kB Progress (2): 327 kB | 294/587 kB Progress (2): 327 kB | 311/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.9 MB/s) 2024-09-12T17:38:42.476 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 327/587 kB Progress (1): 343/587 kB Progress (1): 360/587 kB Progress (1): 376/587 kB Progress (1): 393/587 kB Progress (1): 402/587 kB Progress (1): 418/587 kB Progress (1): 435/587 kB Progress (1): 451/587 kB Progress (1): 468/587 kB Progress (1): 484/587 kB Progress (1): 500/587 kB Progress (1): 517/587 kB Progress (1): 533/587 kB Progress (1): 549/587 kB Progress (1): 566/587 kB Progress (1): 582/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 14 MB/s) 2024-09-12T17:38:42.512 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:38:42.512 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:42.512 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:38:42.517 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T17:38:42.532 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-12T17:38:42.534 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T17:38:42.549 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-12T17:38:42.551 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T17:38:42.565 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-12T17:38:42.567 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T17:38:42.581 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-12T17:38:42.585 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T17:38:42.599 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-12T17:38:42.601 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T17:38:42.615 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 283 kB/s) 2024-09-12T17:38:42.618 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T17:38:42.633 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-12T17:38:42.637 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T17:38:42.652 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 311 kB/s) 2024-09-12T17:38:42.654 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T17:38:42.669 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-12T17:38:42.673 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T17:38:42.689 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 148 kB/s) 2024-09-12T17:38:42.691 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T17:38:42.706 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-12T17:38:42.709 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T17:38:42.724 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-12T17:38:42.727 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T17:38:42.742 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 438 kB/s) 2024-09-12T17:38:42.745 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T17:38:42.762 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 62 kB/s) 2024-09-12T17:38:42.764 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T17:38:42.781 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 466 kB/s) 2024-09-12T17:38:42.784 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T17:38:42.799 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-12T17:38:42.802 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T17:38:42.817 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 402 kB/s) 2024-09-12T17:38:42.820 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T17:38:42.835 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-12T17:38:42.839 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T17:38:42.853 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 55 kB/s) 2024-09-12T17:38:42.855 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T17:38:42.869 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-12T17:38:42.871 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T17:38:42.886 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.8 MB/s) 2024-09-12T17:38:42.889 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T17:38:42.903 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-12T17:38:42.905 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T17:38:42.919 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 94 kB/s) 2024-09-12T17:38:42.924 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T17:38:42.938 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 1.0 MB/s) 2024-09-12T17:38:42.938 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T17:38:42.938 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T17:38:42.938 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T17:38:42.938 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T17:38:42.938 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T17:38:42.954 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/122 kB Progress (2): 16/122 kB | 16/55 kB Progress (3): 16/122 kB | 16/55 kB | 16/27 kB Progress (3): 33/122 kB | 16/55 kB | 16/27 kB Progress (3): 33/122 kB | 16/55 kB | 27 kB Progress (3): 33/122 kB | 33/55 kB | 27 kB Progress (3): 49/122 kB | 33/55 kB | 27 kB Progress (3): 49/122 kB | 49/55 kB | 27 kB Progress (3): 49/122 kB | 55 kB | 27 kB Progress (3): 66/122 kB | 55 kB | 27 kB Progress (4): 66/122 kB | 55 kB | 27 kB | 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.9 MB/s) 2024-09-12T17:38:42.954 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (3): 82/122 kB | 55 kB | 4.2 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T17:38:42.954 INFO:tasks.workunit.client.0.smithi044.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.9 MB/s) 2024-09-12T17:38:42.954 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 98/122 kB | 4.2 kB Progress (3): 98/122 kB | 4.2 kB | 15/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 281 kB/s) 2024-09-12T17:38:42.954 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T17:38:42.954 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T17:38:42.955 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 115/122 kB | 15/334 kB Progress (2): 122 kB | 15/334 kB Progress (2): 122 kB | 31/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 8.2 MB/s) 2024-09-12T17:38:42.958 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 48/334 kB Progress (1): 64/334 kB Progress (1): 81/334 kB Progress (1): 94/334 kB Progress (1): 110/334 kB Progress (1): 127/334 kB Progress (1): 143/334 kB Progress (1): 159/334 kB Progress (1): 176/334 kB Progress (1): 192/334 kB Progress (1): 209/334 kB Progress (1): 225/334 kB Progress (1): 241/334 kB Progress (1): 258/334 kB Progress (1): 274/334 kB Progress (1): 291/334 kB Progress (1): 307/334 kB Progress (1): 323/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 17 MB/s) 2024-09-12T17:38:42.966 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 814 kB/s) 2024-09-12T17:38:42.967 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.7 kB Progress (2): 4.7 kB | 16/267 kB Progress (2): 4.7 kB | 33/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 166 kB/s) 2024-09-12T17:38:42.970 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 49/267 kB Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 256/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.4 MB/s) 2024-09-12T17:38:43.022 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T17:38:43.023 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T17:38:43.680 INFO:tasks.workunit.client.0.smithi044.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:38:43.680 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:43.681 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:38:43.689 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:38:43.689 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:43.690 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:38:43.690 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T17:38:43.690 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T17:38:43.845 INFO:tasks.workunit.client.0.smithi044.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:38:43.845 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:43.845 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:38:43.849 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T17:38:43.863 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 446 kB/s) 2024-09-12T17:38:43.867 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T17:38:43.882 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-12T17:38:43.885 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T17:38:43.901 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 204 kB/s) 2024-09-12T17:38:43.904 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T17:38:43.919 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-12T17:38:43.922 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T17:38:43.937 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-12T17:38:43.940 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T17:38:43.958 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 248 kB/s) 2024-09-12T17:38:43.962 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T17:38:43.979 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 104 kB/s) 2024-09-12T17:38:43.982 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T17:38:43.996 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-12T17:38:43.998 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T17:38:44.012 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.2 MB/s) 2024-09-12T17:38:44.014 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T17:38:44.029 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-12T17:38:44.031 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T17:38:44.045 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-12T17:38:44.048 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T17:38:44.062 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-12T17:38:44.063 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T17:38:44.077 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.7 MB/s) 2024-09-12T17:38:44.080 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T17:38:44.094 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-12T17:38:44.096 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T17:38:44.110 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-12T17:38:44.113 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T17:38:44.127 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-12T17:38:44.129 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T17:38:44.143 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.0 MB/s) 2024-09-12T17:38:44.146 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T17:38:44.160 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-12T17:38:44.163 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T17:38:44.176 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 167 kB/s) 2024-09-12T17:38:44.179 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T17:38:44.193 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-12T17:38:44.195 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T17:38:44.209 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-12T17:38:44.211 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T17:38:44.224 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 236 kB/s) 2024-09-12T17:38:44.225 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T17:38:44.240 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-12T17:38:44.242 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T17:38:44.255 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 520 kB/s) 2024-09-12T17:38:44.256 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T17:38:44.270 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 1.0 MB/s) 2024-09-12T17:38:44.273 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T17:38:44.286 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 228 kB/s) 2024-09-12T17:38:44.288 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T17:38:44.304 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 425 kB/s) 2024-09-12T17:38:44.305 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T17:38:44.318 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-12T17:38:44.320 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T17:38:44.335 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 148 kB/s) 2024-09-12T17:38:44.336 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T17:38:44.350 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-12T17:38:44.353 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T17:38:44.367 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-12T17:38:44.370 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T17:38:44.384 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-12T17:38:44.386 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T17:38:44.401 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 967 kB/s) 2024-09-12T17:38:44.403 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T17:38:44.417 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-12T17:38:44.419 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T17:38:44.434 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 319 kB/s) 2024-09-12T17:38:44.436 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T17:38:44.450 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-12T17:38:44.451 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T17:38:44.465 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.3 MB/s) 2024-09-12T17:38:44.468 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T17:38:44.482 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-12T17:38:44.484 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T17:38:44.498 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-12T17:38:44.501 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T17:38:44.515 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-12T17:38:44.516 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T17:38:44.529 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 370 kB/s) 2024-09-12T17:38:44.531 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T17:38:44.545 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-12T17:38:44.547 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T17:38:44.561 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-12T17:38:44.564 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T17:38:44.578 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-12T17:38:44.581 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T17:38:44.596 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 137 kB/s) 2024-09-12T17:38:44.598 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T17:38:44.612 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-12T17:38:44.616 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T17:38:44.629 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-12T17:38:44.631 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T17:38:44.645 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-12T17:38:44.646 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T17:38:44.660 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.3 MB/s) 2024-09-12T17:38:44.662 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T17:38:44.675 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-12T17:38:44.677 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T17:38:44.691 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 436 kB/s) 2024-09-12T17:38:44.693 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T17:38:44.706 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 564 kB/s) 2024-09-12T17:38:44.708 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T17:38:44.721 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 371 kB/s) 2024-09-12T17:38:44.724 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T17:38:44.738 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 522 kB/s) 2024-09-12T17:38:44.741 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T17:38:44.755 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.5 MB/s) 2024-09-12T17:38:44.757 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T17:38:44.772 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.2 MB/s) 2024-09-12T17:38:44.775 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T17:38:44.789 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-12T17:38:44.792 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T17:38:44.807 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-12T17:38:44.808 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T17:38:44.822 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 305 kB/s) 2024-09-12T17:38:44.823 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T17:38:44.839 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 213 kB/s) 2024-09-12T17:38:44.841 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T17:38:44.855 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.9 MB/s) 2024-09-12T17:38:44.858 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T17:38:44.872 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 169 kB/s) 2024-09-12T17:38:44.878 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T17:38:44.898 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/308 kB Progress (1): 32/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 81/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 130/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 212/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 15 MB/s) 2024-09-12T17:38:44.899 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T17:38:44.899 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T17:38:44.899 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T17:38:44.899 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T17:38:44.899 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T17:38:44.914 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 14 kB Progress (2): 14 kB | 16/26 kB Progress (2): 14 kB | 26 kB Progress (3): 14 kB | 26 kB | 16/171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 906 kB/s) 2024-09-12T17:38:44.914 INFO:tasks.workunit.client.0.smithi044.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.7 MB/s) 2024-09-12T17:38:44.914 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T17:38:44.914 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T17:38:44.916 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (2): 49/171 kB | 8.2 kB Progress (2): 66/171 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 511 kB/s) 2024-09-12T17:38:44.916 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 66/171 kB | 16/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T17:38:44.917 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 66/171 kB | 19/118 kB Progress (2): 82/171 kB | 19/118 kB Progress (2): 82/171 kB | 33/118 kB Progress (2): 82/171 kB | 44/118 kB Progress (2): 98/171 kB | 44/118 kB Progress (2): 98/171 kB | 55/118 kB Progress (2): 98/171 kB | 63/118 kB Progress (2): 98/171 kB | 64/118 kB Progress (2): 115/171 kB | 64/118 kB Progress (2): 115/171 kB | 80/118 kB Progress (2): 115/171 kB | 97/118 kB Progress (2): 131/171 kB | 97/118 kB Progress (2): 131/171 kB | 113/118 kB Progress (2): 131/171 kB | 118 kB Progress (2): 147/171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.2 MB/s) 2024-09-12T17:38:44.917 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 164/171 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T17:38:44.917 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.0 MB/s) 2024-09-12T17:38:44.918 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T17:38:44.934 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/146 kB Progress (1): 32/146 kB Progress (1): 49/146 kB Progress (1): 65/146 kB Progress (2): 65/146 kB | 16/136 kB Progress (2): 80/146 kB | 16/136 kB Progress (2): 80/146 kB | 33/136 kB Progress (2): 97/146 kB | 33/136 kB Progress (2): 97/146 kB | 49/136 kB Progress (2): 97/146 kB | 66/136 kB Progress (2): 113/146 kB | 66/136 kB Progress (2): 113/146 kB | 82/136 kB Progress (3): 113/146 kB | 82/136 kB | 16/61 kB Progress (3): 130/146 kB | 82/136 kB | 16/61 kB Progress (3): 130/146 kB | 98/136 kB | 16/61 kB Progress (3): 130/146 kB | 98/136 kB | 33/61 kB Progress (3): 130/146 kB | 114/136 kB | 33/61 kB Progress (3): 146 kB | 114/136 kB | 33/61 kB Progress (3): 146 kB | 130/136 kB | 33/61 kB Progress (3): 146 kB | 130/136 kB | 49/61 kB Progress (3): 146 kB | 136 kB | 49/61 kB Progress (3): 146 kB | 136 kB | 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.9 MB/s) 2024-09-12T17:38:44.934 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T17:38:44.934 INFO:tasks.workunit.client.0.smithi044.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.4 MB/s) 2024-09-12T17:38:44.935 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T17:38:44.935 INFO:tasks.workunit.client.0.smithi044.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 2.0 MB/s) 2024-09-12T17:38:44.935 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/58 kB Progress (2): 16/58 kB | 16/501 kB Progress (2): 33/58 kB | 16/501 kB Progress (2): 33/58 kB | 32/501 kB Progress (2): 49/58 kB | 32/501 kB Progress (2): 58 kB | 32/501 kB Progress (2): 58 kB | 49/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.8 MB/s) 2024-09-12T17:38:44.941 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 65/501 kB Progress (1): 81/501 kB Progress (1): 97/501 kB Progress (1): 114/501 kB Progress (1): 130/501 kB Progress (1): 147/501 kB Progress (1): 163/501 kB Progress (1): 179/501 kB Progress (1): 196/501 kB Progress (1): 212/501 kB Progress (1): 229/501 kB Progress (1): 245/501 kB Progress (1): 261/501 kB Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 310/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 392/501 kB Progress (1): 409/501 kB Progress (1): 425/501 kB Progress (1): 442/501 kB Progress (1): 458/501 kB Progress (1): 474/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 12 MB/s) 2024-09-12T17:38:44.945 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (2): 33/124 kB | 0/2.4 MB Progress (2): 49/124 kB | 0/2.4 MB Progress (2): 49/124 kB | 0/2.4 MB Progress (2): 66/124 kB | 0/2.4 MB Progress (2): 66/124 kB | 0/2.4 MB Progress (2): 82/124 kB | 0/2.4 MB Progress (2): 82/124 kB | 0.1/2.4 MB Progress (2): 98/124 kB | 0.1/2.4 MB Progress (2): 98/124 kB | 0.1/2.4 MB Progress (2): 115/124 kB | 0.1/2.4 MB Progress (2): 115/124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.7 MB/s) 2024-09-12T17:38:44.977 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 31 MB/s) 2024-09-12T17:38:45.055 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:45.056 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T17:38:45.059 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T17:38:45.074 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 299 kB/s) 2024-09-12T17:38:45.076 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T17:38:45.090 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-12T17:38:45.092 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T17:38:45.108 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-12T17:38:45.110 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T17:38:45.126 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.3 MB/s) 2024-09-12T17:38:45.129 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T17:38:45.145 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 345 kB/s) 2024-09-12T17:38:45.146 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T17:38:45.160 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-12T17:38:45.162 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T17:38:45.176 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-12T17:38:45.178 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T17:38:45.192 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-12T17:38:45.194 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T17:38:45.208 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-12T17:38:45.211 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T17:38:45.225 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-12T17:38:45.227 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T17:38:45.240 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 157 kB/s) 2024-09-12T17:38:45.242 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T17:38:45.256 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-12T17:38:45.258 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T17:38:45.272 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.8 MB/s) 2024-09-12T17:38:45.277 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T17:38:45.291 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.6 MB/s) 2024-09-12T17:38:45.291 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T17:38:45.291 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T17:38:45.292 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T17:38:45.292 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T17:38:45.292 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T17:38:45.307 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/79 kB Progress (2): 16/79 kB | 16/211 kB Progress (3): 16/79 kB | 16/211 kB | 16/58 kB Progress (4): 16/79 kB | 16/211 kB | 16/58 kB | 16/26 kB Progress (4): 33/79 kB | 16/211 kB | 16/58 kB | 16/26 kB Progress (4): 33/79 kB | 33/211 kB | 16/58 kB | 16/26 kB Progress (4): 49/79 kB | 33/211 kB | 16/58 kB | 16/26 kB Progress (4): 49/79 kB | 33/211 kB | 33/58 kB | 16/26 kB Progress (4): 49/79 kB | 33/211 kB | 33/58 kB | 26 kB Progress (4): 66/79 kB | 33/211 kB | 33/58 kB | 26 kB Progress (4): 66/79 kB | 33/211 kB | 49/58 kB | 26 kB Progress (4): 66/79 kB | 49/211 kB | 49/58 kB | 26 kB Progress (5): 66/79 kB | 49/211 kB | 49/58 kB | 26 kB | 0/1.0 MB Progress (5): 66/79 kB | 49/211 kB | 58 kB | 26 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.7 MB/s) 2024-09-12T17:38:45.307 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T17:38:45.307 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (4): 66/79 kB | 49/211 kB | 58 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.9 MB/s) 2024-09-12T17:38:45.307 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T17:38:45.310 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (3): 66/79 kB | 49/211 kB | 0/1.0 MB Progress (3): 79 kB | 49/211 kB | 0/1.0 MB Progress (3): 79 kB | 63/211 kB | 0/1.0 MB Progress (3): 79 kB | 63/211 kB | 0.1/1.0 MB Progress (3): 79 kB | 79/211 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 5.0 MB/s) 2024-09-12T17:38:45.310 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 79/211 kB | 0.1/1.0 MB Progress (2): 95/211 kB | 0.1/1.0 MB Progress (2): 95/211 kB | 0.1/1.0 MB Progress (2): 112/211 kB | 0.1/1.0 MB Progress (2): 112/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 145/211 kB | 0.1/1.0 MB Progress (2): 145/211 kB | 0.1/1.0 MB Progress (2): 161/211 kB | 0.1/1.0 MB Progress (2): 161/211 kB | 0.2/1.0 MB Progress (2): 177/211 kB | 0.2/1.0 MB Progress (2): 177/211 kB | 0.2/1.0 MB Progress (2): 194/211 kB | 0.2/1.0 MB Progress (2): 194/211 kB | 0.2/1.0 MB Progress (2): 210/211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-12T17:38:45.321 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (2): 1.0/1.0 MB | 16/116 kB Progress (2): 1.0/1.0 MB | 16/116 kB Progress (3): 1.0/1.0 MB | 16/116 kB | 16/267 kB Progress (3): 1.0 MB | 16/116 kB | 16/267 kB Progress (3): 1.0 MB | 33/116 kB | 16/267 kB Progress (3): 1.0 MB | 33/116 kB | 33/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 34 MB/s) 2024-09-12T17:38:45.323 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 49/116 kB | 33/267 kB Progress (2): 49/116 kB | 47/267 kB Progress (2): 66/116 kB | 47/267 kB Progress (2): 66/116 kB | 63/267 kB Progress (2): 82/116 kB | 63/267 kB Progress (2): 82/116 kB | 79/267 kB Progress (2): 98/116 kB | 79/267 kB Progress (2): 98/116 kB | 96/267 kB Progress (2): 115/116 kB | 96/267 kB Progress (2): 115/116 kB | 112/267 kB Progress (2): 116 kB | 112/267 kB Progress (2): 116 kB | 128/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.7 MB/s) 2024-09-12T17:38:45.325 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 145/267 kB Progress (1): 161/267 kB Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 210/267 kB Progress (1): 227/267 kB Progress (1): 243/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 8.1 MB/s) 2024-09-12T17:38:45.473 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T17:38:45.503 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:38:45.503 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:38:45.503 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:38:45.504 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Total time: 5.802 s 2024-09-12T17:38:45.504 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Finished at: 2024-09-12T17:38:45Z 2024-09-12T17:38:45.504 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:38:45.547 INFO:tasks.workunit.client.0.smithi044.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T17:38:45.556 INFO:tasks.workunit.client.0.smithi044.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:38:46.623 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Scanning for projects... 2024-09-12T17:38:46.721 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:46.721 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:38:46.721 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:38:46.721 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] from pom.xml 2024-09-12T17:38:46.721 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:38:46.994 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:46.995 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:38:47.084 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:38:47.084 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:47.084 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:38:47.183 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:38:47.184 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:47.184 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:38:47.185 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:38:47.186 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:47.186 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:38:47.193 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:38:47.193 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:47.193 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:38:47.406 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T17:38:47.603 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T17:38:47.792 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 24 kB/s) 2024-09-12T17:38:47.801 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T17:38:47.819 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 145 kB/s) 2024-09-12T17:38:47.824 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T17:38:47.843 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-12T17:38:47.848 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T17:38:47.862 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 189 kB/s) 2024-09-12T17:38:47.865 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T17:38:47.881 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-09-12T17:38:47.884 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T17:38:47.900 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-12T17:38:47.902 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T17:38:47.918 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 167 kB/s) 2024-09-12T17:38:47.924 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T17:38:47.944 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.3 MB/s) 2024-09-12T17:38:47.947 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T17:38:47.947 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T17:38:47.947 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T17:38:47.947 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T17:38:47.947 INFO:tasks.workunit.client.0.smithi044.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T17:38:47.987 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 16/169 kB Progress (1): 33/169 kB Progress (1): 49/169 kB Progress (1): 66/169 kB Progress (1): 82/169 kB Progress (1): 98/169 kB Progress (1): 115/169 kB Progress (1): 131/169 kB Progress (1): 147/169 kB Progress (1): 164/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 4.1 MB/s) 2024-09-12T17:38:47.998 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (2): 2.8/7.7 kB | 1.4/18 kB Progress (2): 4.1/7.7 kB | 1.4/18 kB Progress (2): 4.1/7.7 kB | 2.8/18 kB Progress (2): 5.5/7.7 kB | 2.8/18 kB Progress (2): 5.5/7.7 kB | 4.1/18 kB Progress (2): 6.9/7.7 kB | 4.1/18 kB Progress (2): 6.9/7.7 kB | 5.5/18 kB Progress (2): 7.7 kB | 5.5/18 kB Progress (3): 7.7 kB | 5.5/18 kB | 16/189 kB Progress (3): 7.7 kB | 6.9/18 kB | 16/189 kB Progress (3): 7.7 kB | 8.3/18 kB | 16/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 147 kB/s) 2024-09-12T17:38:48.002 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 9.7/18 kB | 16/189 kB Progress (2): 11/18 kB | 16/189 kB Progress (2): 12/18 kB | 16/189 kB Progress (2): 14/18 kB | 16/189 kB Progress (2): 15/18 kB | 16/189 kB Progress (3): 15/18 kB | 16/189 kB | 16/103 kB Progress (3): 16/18 kB | 16/189 kB | 16/103 kB Progress (3): 17/18 kB | 16/189 kB | 16/103 kB Progress (3): 18 kB | 16/189 kB | 16/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 308 kB/s) 2024-09-12T17:38:48.026 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (2): 33/189 kB | 16/103 kB Progress (2): 49/189 kB | 16/103 kB Progress (2): 49/189 kB | 33/103 kB Progress (2): 49/189 kB | 49/103 kB Progress (2): 66/189 kB | 49/103 kB Progress (2): 82/189 kB | 49/103 kB Progress (2): 98/189 kB | 49/103 kB Progress (2): 98/189 kB | 66/103 kB Progress (2): 115/189 kB | 66/103 kB Progress (2): 115/189 kB | 82/103 kB Progress (2): 131/189 kB | 82/103 kB Progress (2): 147/189 kB | 82/103 kB Progress (2): 147/189 kB | 98/103 kB Progress (2): 147/189 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-12T17:38:48.032 INFO:tasks.workunit.client.0.smithi044.stdout:Progress (1): 164/189 kB Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.2 MB/s) 2024-09-12T17:38:48.046 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:48.046 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:38:48.046 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] T E S T S 2024-09-12T17:38:48.046 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:38:48.513 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T17:38:48.622 INFO:tasks.workunit.client.0.smithi044.stdout:PutObjects.java: starting test run: 2024-09-12T17:38:48.623 INFO:tasks.workunit.client.0.smithi044.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:38:48.623 INFO:tasks.workunit.client.0.smithi044.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:38:48.623 INFO:tasks.workunit.client.0.smithi044.stdout: EndpointUrl=http://smithi044.front.sepia.ceph.com:80 2024-09-12T17:38:48.623 INFO:tasks.workunit.client.0.smithi044.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T17:38:48.720 INFO:tasks.workunit.client.0.smithi044.stdout:DEBUG: Environment Variables Read 2024-09-12T17:38:49.021 INFO:tasks.workunit.client.0.smithi044.stdout:DEBUG: S3 Client Initialized 2024-09-12T17:38:49.022 INFO:tasks.workunit.client.0.smithi044.stdout:DEBUG: Generating File 2024-09-12T17:38:49.022 INFO:tasks.workunit.client.0.smithi044.stdout:DEBUG: File Generated 2024-09-12T17:38:49.022 INFO:tasks.workunit.client.0.smithi044.stdout:DEBUG: Generating File 2024-09-12T17:38:49.022 INFO:tasks.workunit.client.0.smithi044.stdout:DEBUG: File Generated 2024-09-12T17:38:49.022 INFO:tasks.workunit.client.0.smithi044.stdout:DEBUG: Generating File 2024-09-12T17:38:49.124 INFO:tasks.workunit.client.0.smithi044.stdout:DEBUG: File Generated 2024-09-12T17:38:49.124 INFO:tasks.workunit.client.0.smithi044.stdout:DEBUG: Generating File 2024-09-12T17:38:49.124 INFO:tasks.workunit.client.0.smithi044.stdout:DEBUG: File Generated 2024-09-12T17:38:49.124 INFO:tasks.workunit.client.0.smithi044.stdout:DEBUG: Generating File 2024-09-12T17:38:49.124 INFO:tasks.workunit.client.0.smithi044.stdout:DEBUG: File Generated 2024-09-12T17:38:49.125 INFO:tasks.workunit.client.0.smithi044.stdout:DEBUG: Generating File 2024-09-12T17:38:49.125 INFO:tasks.workunit.client.0.smithi044.stdout:DEBUG: File Generated 2024-09-12T17:38:49.125 INFO:tasks.workunit.client.0.smithi044.stdout:DEBUG: Generated Big Files 2024-09-12T17:38:49.290 INFO:tasks.workunit.client.0.smithi044.stdout:HeadBucketResponse() 2024-09-12T17:38:49.290 INFO:tasks.workunit.client.0.smithi044.stdout:sheik is ready 2024-09-12T17:38:49.290 INFO:tasks.workunit.client.0.smithi044.stdout:DEBUG: Test Bucket Created 2024-09-12T17:38:49.321 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T17:38:49.422 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T17:38:49.522 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T17:38:49.563 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T17:38:49.622 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T17:38:49.707 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T17:38:49.722 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T17:38:49.811 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T17:38:49.822 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T17:38:49.922 INFO:tasks.workunit.client.0.smithi044.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T17:38:51.525 INFO:tasks.workunit.client.0.smithi044.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T17:38:51.826 INFO:tasks.workunit.client.0.smithi044.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T17:38:53.918 INFO:tasks.workunit.client.0.smithi044.stdout:arg: file-0b 2024-09-12T17:38:53.919 INFO:tasks.workunit.client.0.smithi044.stdout:arg: file-8b 2024-09-12T17:38:53.920 INFO:tasks.workunit.client.0.smithi044.stdout:arg: file-200b 2024-09-12T17:38:53.922 INFO:tasks.workunit.client.0.smithi044.stdout:arg: file-21983b 2024-09-12T17:38:53.923 INFO:tasks.workunit.client.0.smithi044.stdout:arg: file-5519b 2024-09-12T17:38:53.924 INFO:tasks.workunit.client.0.smithi044.stdout:arg: file-204329b 2024-09-12T17:38:53.925 INFO:tasks.workunit.client.0.smithi044.stdout:arg: file-256k 2024-09-12T17:38:53.927 INFO:tasks.workunit.client.0.smithi044.stdout:arg: file-1m 2024-09-12T17:38:53.929 INFO:tasks.workunit.client.0.smithi044.stdout:arg: file-1038757b 2024-09-12T17:38:53.963 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T17:38:53.964 INFO:tasks.workunit.client.0.smithi044.stdout:PutObjectResponse 2024-09-12T17:38:54.020 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T17:38:54.021 INFO:tasks.workunit.client.0.smithi044.stdout:PutObjectResponse 2024-09-12T17:38:54.029 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T17:38:54.077 INFO:tasks.workunit.client.0.smithi044.stdout:PutObjectResponse 2024-09-12T17:38:54.129 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T17:38:54.129 INFO:tasks.workunit.client.0.smithi044.stdout:PutObjectResponse 2024-09-12T17:38:54.194 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T17:38:54.194 INFO:tasks.workunit.client.0.smithi044.stdout:PutObjectResponse 2024-09-12T17:38:54.219 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T17:38:54.220 INFO:tasks.workunit.client.0.smithi044.stdout:PutObjectResponse 2024-09-12T17:38:54.229 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T17:38:54.244 INFO:tasks.workunit.client.0.smithi044.stdout:PutObjectResponse 2024-09-12T17:38:54.304 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T17:38:54.305 INFO:tasks.workunit.client.0.smithi044.stdout:PutObjectResponse 2024-09-12T17:38:54.329 INFO:tasks.workunit.client.0.smithi044.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T17:38:54.345 INFO:tasks.workunit.client.0.smithi044.stdout:PutObjectResponse 2024-09-12T17:38:54.429 INFO:tasks.workunit.client.0.smithi044.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T17:38:54.730 INFO:tasks.workunit.client.0.smithi044.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T17:38:55.030 INFO:tasks.workunit.client.0.smithi044.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T17:38:57.493 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.967 s -- in io.ceph.jcksum.PutObjects 2024-09-12T17:38:57.507 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:57.507 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Results: 2024-09-12T17:38:57.507 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:57.507 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T17:38:57.507 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] 2024-09-12T17:38:57.509 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:38:57.509 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:38:57.509 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:38:57.510 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Total time: 10.909 s 2024-09-12T17:38:57.510 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] Finished at: 2024-09-12T17:38:57Z 2024-09-12T17:38:57.510 INFO:tasks.workunit.client.0.smithi044.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:38:57.522 INFO:tasks.workunit.client.0.smithi044.stderr:+ exit 2024-09-12T17:38:57.523 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:38:57.523 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:38:57.603 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T17:38:57.603 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:38:57.982 DEBUG:teuthology.parallel:result is None 2024-09-12T17:38:57.982 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:38:58.021 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:38:58.022 DEBUG:teuthology.orchestra.run.smithi044:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:38:58.092 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:38:58.092 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:38:58.106 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:38:58.106 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:38:58.106 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:38:58.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:38:58.162 INFO:teuthology.orchestra.run.smithi044.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:38:58.162 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:38:58.233 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:38:58.234 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:38:58.305 INFO:tasks.workunit:timeout=3h 2024-09-12T17:38:58.305 INFO:tasks.workunit:cleanup=True 2024-09-12T17:38:58.306 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:38:58.376 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:39:58.653 INFO:tasks.workunit.client.0.smithi044.stderr:Updating files: 90% (11456/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:39:59.460 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:39:59.461 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:39:59.461 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:39:59.461 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:39:59.461 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:39:59.461 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:39:59.461 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:39:59.461 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:39:59.461 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:39:59.462 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2024-09-12T17:39:59.462 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:39:59.462 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2024-09-12T17:39:59.462 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:39:59.462 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2024-09-12T17:39:59.462 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:39:59.462 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:39:59.462 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:39:59.463 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:39:59.467 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:39:59.538 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:39:59.540 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:39:59.540 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:39:59.591 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:39:59.641 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:39:59.681 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:39:59.683 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:39:59.683 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:39:59.723 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:39:59.726 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:39:59.726 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:39:59.797 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T17:39:59.798 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T17:39:59.798 DEBUG:teuthology.orchestra.run.smithi044:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T17:39:59.874 INFO:tasks.workunit.client.0.smithi044.stdout:INFO: fully qualified domain name: smithi044.front.sepia.ceph.com 2024-09-12T17:39:59.875 INFO:tasks.workunit.client.0.smithi044.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T17:39:59.875 INFO:tasks.workunit.client.0.smithi044.stdout:== TESTING VERSIONED BUCKET == 2024-09-12T17:40:02.485 INFO:tasks.workunit.client.0.smithi044.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:40:02.669 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting pip 2024-09-12T17:40:02.675 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:40:02.721 INFO:tasks.workunit.client.0.smithi044.stdout:Installing collected packages: pip 2024-09-12T17:40:02.722 INFO:tasks.workunit.client.0.smithi044.stdout: Attempting uninstall: pip 2024-09-12T17:40:02.722 INFO:tasks.workunit.client.0.smithi044.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:40:02.887 INFO:tasks.workunit.client.0.smithi044.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:40:02.893 INFO:tasks.workunit.client.0.smithi044.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:40:03.674 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully installed pip-24.2 2024-09-12T17:40:04.529 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting boto3 2024-09-12T17:40:04.530 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:40:05.078 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:40:05.079 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:40:05.133 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:40:05.134 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:40:05.189 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:40:05.190 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:40:05.240 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:40:05.241 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:40:05.318 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:40:05.319 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:40:05.512 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:40:05.513 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:40:05.517 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:40:05.519 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:40:05.528 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:40:05.529 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:40:05.530 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:40:05.532 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:40:05.533 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:40:05.609 INFO:tasks.workunit.client.0.smithi044.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:40:06.684 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:40:06.922 INFO:tasks.workunit.client.0.smithi044.stdout:INFO: creating user 2024-09-12T17:40:07.237 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-12T17:40:07.238 INFO:tasks.workunit.client.0.smithi044.stdout: "user_id": "testid", 2024-09-12T17:40:07.238 INFO:tasks.workunit.client.0.smithi044.stdout: "display_name": "M. Tester", 2024-09-12T17:40:07.238 INFO:tasks.workunit.client.0.smithi044.stdout: "email": "tester@ceph.com", 2024-09-12T17:40:07.238 INFO:tasks.workunit.client.0.smithi044.stdout: "suspended": 0, 2024-09-12T17:40:07.238 INFO:tasks.workunit.client.0.smithi044.stdout: "max_buckets": 1000, 2024-09-12T17:40:07.238 INFO:tasks.workunit.client.0.smithi044.stdout: "subusers": [], 2024-09-12T17:40:07.238 INFO:tasks.workunit.client.0.smithi044.stdout: "keys": [ 2024-09-12T17:40:07.238 INFO:tasks.workunit.client.0.smithi044.stdout: { 2024-09-12T17:40:07.238 INFO:tasks.workunit.client.0.smithi044.stdout: "user": "testid", 2024-09-12T17:40:07.238 INFO:tasks.workunit.client.0.smithi044.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T17:40:07.239 INFO:tasks.workunit.client.0.smithi044.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T17:40:07.239 INFO:tasks.workunit.client.0.smithi044.stdout: "active": true, 2024-09-12T17:40:07.239 INFO:tasks.workunit.client.0.smithi044.stdout: "create_date": "2024-09-12T17:40:07.231318Z" 2024-09-12T17:40:07.239 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-12T17:40:07.239 INFO:tasks.workunit.client.0.smithi044.stdout: ], 2024-09-12T17:40:07.239 INFO:tasks.workunit.client.0.smithi044.stdout: "swift_keys": [], 2024-09-12T17:40:07.239 INFO:tasks.workunit.client.0.smithi044.stdout: "caps": [], 2024-09-12T17:40:07.239 INFO:tasks.workunit.client.0.smithi044.stdout: "op_mask": "read, write, delete", 2024-09-12T17:40:07.239 INFO:tasks.workunit.client.0.smithi044.stdout: "default_placement": "", 2024-09-12T17:40:07.239 INFO:tasks.workunit.client.0.smithi044.stdout: "default_storage_class": "", 2024-09-12T17:40:07.239 INFO:tasks.workunit.client.0.smithi044.stdout: "placement_tags": [], 2024-09-12T17:40:07.240 INFO:tasks.workunit.client.0.smithi044.stdout: "bucket_quota": { 2024-09-12T17:40:07.240 INFO:tasks.workunit.client.0.smithi044.stdout: "enabled": false, 2024-09-12T17:40:07.240 INFO:tasks.workunit.client.0.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:40:07.240 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size": -1, 2024-09-12T17:40:07.240 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:40:07.240 INFO:tasks.workunit.client.0.smithi044.stdout: "max_objects": -1 2024-09-12T17:40:07.240 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:40:07.240 INFO:tasks.workunit.client.0.smithi044.stdout: "user_quota": { 2024-09-12T17:40:07.240 INFO:tasks.workunit.client.0.smithi044.stdout: "enabled": false, 2024-09-12T17:40:07.240 INFO:tasks.workunit.client.0.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:40:07.240 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size": -1, 2024-09-12T17:40:07.241 INFO:tasks.workunit.client.0.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:40:07.241 INFO:tasks.workunit.client.0.smithi044.stdout: "max_objects": -1 2024-09-12T17:40:07.241 INFO:tasks.workunit.client.0.smithi044.stdout: }, 2024-09-12T17:40:07.241 INFO:tasks.workunit.client.0.smithi044.stdout: "temp_url_keys": [], 2024-09-12T17:40:07.241 INFO:tasks.workunit.client.0.smithi044.stdout: "type": "rgw", 2024-09-12T17:40:07.241 INFO:tasks.workunit.client.0.smithi044.stdout: "mfa_ids": [], 2024-09-12T17:40:07.241 INFO:tasks.workunit.client.0.smithi044.stdout: "account_id": "", 2024-09-12T17:40:07.241 INFO:tasks.workunit.client.0.smithi044.stdout: "path": "/", 2024-09-12T17:40:07.241 INFO:tasks.workunit.client.0.smithi044.stdout: "create_date": "2024-09-12T17:40:07.231302Z", 2024-09-12T17:40:07.241 INFO:tasks.workunit.client.0.smithi044.stdout: "tags": [], 2024-09-12T17:40:07.241 INFO:tasks.workunit.client.0.smithi044.stdout: "group_ids": [] 2024-09-12T17:40:07.242 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-12T17:40:07.242 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-12T17:40:07.503 INFO:tasks.workunit.client.0.smithi044.stderr:5+0 records in 2024-09-12T17:40:07.504 INFO:tasks.workunit.client.0.smithi044.stderr:5+0 records out 2024-09-12T17:40:07.504 INFO:tasks.workunit.client.0.smithi044.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.014227 s, 369 MB/s 2024-09-12T17:40:08.637 INFO:tasks.workunit.client.0.smithi044.stdout:bucket nams is reupload-bkt-123333 2024-09-12T17:40:08.637 INFO:tasks.workunit.client.0.smithi044.stdout:endpoint is http://smithi044.front.sepia.ceph.com:80 2024-09-12T17:40:08.637 INFO:tasks.workunit.client.0.smithi044.stdout:start UploadId=2~EJ61dy9VcNZx1p4dgo3EfMGQeWXxp02 2024-09-12T17:40:08.637 INFO:tasks.workunit.client.0.smithi044.stdout:phase 1 uploaded part {'ETag': '"123846335667913c770741bf01b7b09e"', 'PartNumber': 1} 2024-09-12T17:40:08.637 INFO:tasks.workunit.client.0.smithi044.stdout:phase 1 uploaded part {'ETag': '"123846335667913c770741bf01b7b09e"', 'PartNumber': 2} 2024-09-12T17:40:08.637 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"123846335667913c770741bf01b7b09e"', 'PartNumber': 1} 2024-09-12T17:40:08.637 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"123846335667913c770741bf01b7b09e"', 'PartNumber': 1} 2024-09-12T17:40:08.638 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"123846335667913c770741bf01b7b09e"', 'PartNumber': 1} 2024-09-12T17:40:08.638 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"123846335667913c770741bf01b7b09e"', 'PartNumber': 1} 2024-09-12T17:40:08.638 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"123846335667913c770741bf01b7b09e"', 'PartNumber': 1} 2024-09-12T17:40:08.638 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"123846335667913c770741bf01b7b09e"', 'PartNumber': 1} 2024-09-12T17:40:08.638 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"123846335667913c770741bf01b7b09e"', 'PartNumber': 1} 2024-09-12T17:40:08.638 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"123846335667913c770741bf01b7b09e"', 'PartNumber': 1} 2024-09-12T17:40:08.638 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"123846335667913c770741bf01b7b09e"', 'PartNumber': 1} 2024-09-12T17:40:08.638 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"123846335667913c770741bf01b7b09e"', 'PartNumber': 1} 2024-09-12T17:40:08.638 INFO:tasks.workunit.client.0.smithi044.stdout:phase 2 uploaded part {'ETag': '"123846335667913c770741bf01b7b09e"', 'PartNumber': 1} 2024-09-12T17:40:08.638 INFO:tasks.workunit.client.0.smithi044.stdout:aborting multipart upload, parts=[{'ETag': '"123846335667913c770741bf01b7b09e"', 'PartNumber': 1}, {'ETag': '"123846335667913c770741bf01b7b09e"', 'PartNumber': 2}] 2024-09-12T17:40:10.491 INFO:tasks.workunit.client.0.smithi044.stdout:radosgw-admin bucket radoslist: 2024-09-12T17:40:10.554 INFO:tasks.workunit.client.0.smithi044.stdout:rados ls: 2024-09-12T17:40:10.559 INFO:tasks.workunit.client.0.smithi044.stdout:== PASSED == 2024-09-12T17:40:10.559 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:40:10.559 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:40:10.649 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T17:40:10.649 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:40:10.994 DEBUG:teuthology.parallel:result is None 2024-09-12T17:40:10.995 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:40:11.034 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:40:11.034 DEBUG:teuthology.orchestra.run.smithi044:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:40:11.104 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:40:11.104 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T17:40:11.120 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T17:40:11.120 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T17:40:11.120 INFO:tasks.ragweed:Using branch 'wip-rgw-meta-handlers' for ragweed 2024-09-12T17:40:11.121 DEBUG:teuthology.orchestra.run.smithi044:> git clone -b wip-rgw-meta-handlers https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:40:11.174 INFO:teuthology.orchestra.run.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:40:11.202 INFO:teuthology.orchestra.run.smithi044.stderr:fatal: Remote branch wip-rgw-meta-handlers not found in upstream origin 2024-09-12T17:40:11.203 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-12T17:40:11.204 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-12T17:40:11.204 DEBUG:teuthology.orchestra.run.smithi044:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:40:11.274 INFO:teuthology.orchestra.run.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:40:11.453 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T17:40:11.454 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T17:40:11.454 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key LSJLYRKSDSWLHEXMIHRD --secret eSTNAh0poFK8mJkrlZyT+IqSrSo6TjjNRvh4LqnVBFuJmbYo2q4JKg== --email ragweed.client.0+test@test.test --system false 2024-09-12T17:40:11.563 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:11.563 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:11.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.598+0000 7f997fb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.599+0000 7f997fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.599+0000 7f997fb2e800 20 realm 2024-09-12T17:40:11.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.599+0000 7f997fb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.600+0000 7f997fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.600+0000 7f997fb2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:11.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.600+0000 7f997fb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.600+0000 7f997fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.600+0000 7f997fb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.601+0000 7f997fb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:11.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.601+0000 7f997fb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.601+0000 7f997fb2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:11.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.601+0000 7f997fb2e800 20 searching for the correct realm 2024-09-12T17:40:11.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.604+0000 7f997af6a640 0 -- 172.21.15.44:0/2987400234 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f996c053060 msgr2=0x7f996c0738f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:11.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.608+0000 7f997b76b640 0 -- 172.21.15.44:0/2987400234 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f99700b50d0 msgr2=0x7f99700be0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:11.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.814+0000 7f997fb2e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:40:11.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.814+0000 7f997fb2e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:40:11.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.814+0000 7f997fb2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:11.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.814+0000 7f997fb2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:11.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.814+0000 7f997fb2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:11.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.814+0000 7f997fb2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:11.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.814+0000 7f997fb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.815+0000 7f997fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.815+0000 7f997fb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.815+0000 7f997fb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:11.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.815+0000 7f997fb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.816+0000 7f997fb2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:11.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.816+0000 7f997fb2e800 20 zone default found 2024-09-12T17:40:11.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.816+0000 7f997fb2e800 4 Realm: () 2024-09-12T17:40:11.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.816+0000 7f997fb2e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:40:11.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.816+0000 7f997fb2e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:40:11.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.816+0000 7f997fb2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:11.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.816+0000 7f997fb2e800 20 zonegroup default 2024-09-12T17:40:11.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.816+0000 7f997fb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.816+0000 7f997fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.816+0000 7f997fb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.816+0000 7f997fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.816+0000 7f997fb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.817+0000 7f997fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.817+0000 7f997fb2e800 20 started sync module instance, tier type = 2024-09-12T17:40:11.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.817+0000 7f997fb2e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:40:11.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.833+0000 7f997fb2e800 20 add_watcher() i=0 2024-09-12T17:40:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.833+0000 7f997fb2e800 20 add_watcher() i=1 2024-09-12T17:40:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.833+0000 7f997fb2e800 20 add_watcher() i=2 2024-09-12T17:40:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.833+0000 7f997fb2e800 20 add_watcher() i=3 2024-09-12T17:40:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.833+0000 7f997fb2e800 20 add_watcher() i=4 2024-09-12T17:40:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.833+0000 7f997fb2e800 20 add_watcher() i=5 2024-09-12T17:40:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.833+0000 7f997fb2e800 20 add_watcher() i=6 2024-09-12T17:40:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.834+0000 7f997fb2e800 20 add_watcher() i=7 2024-09-12T17:40:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.834+0000 7f997fb2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:11.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.836+0000 7f9831fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:11.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.836+0000 7f997fb2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:11.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.836+0000 7f997fb2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:11.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.836+0000 7f997fb2e800 5 note: GC not initialized 2024-09-12T17:40:11.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.836+0000 7f9830fe1640 20 reqs_thread_entry: start 2024-09-12T17:40:11.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.836+0000 7f997fb2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:11.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.836+0000 7f997fb2e800 20 Filter name: none 2024-09-12T17:40:11.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.836+0000 7f97aa7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:11.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.837+0000 7f997fb2e800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:40:11.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.837+0000 7f997fb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.837+0000 7f997fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.837+0000 7f997fb2e800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T17:40:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.837+0000 7f997fb2e800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:40:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.837+0000 7f997fb2e800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T17:40:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.837+0000 7f997fb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.837+0000 7f997fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.837+0000 7f997fb2e800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T17:40:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.837+0000 7f997fb2e800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:40:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.837+0000 7f997fb2e800 10 cache get: name=default.rgw.meta+users.keys+LSJLYRKSDSWLHEXMIHRD : miss 2024-09-12T17:40:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.837+0000 7f997fb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.838+0000 7f997fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.838+0000 7f997fb2e800 10 cache put: name=default.rgw.meta+users.keys+LSJLYRKSDSWLHEXMIHRD info.flags=0x0 2024-09-12T17:40:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.838+0000 7f997fb2e800 10 adding default.rgw.meta+users.keys+LSJLYRKSDSWLHEXMIHRD to cache LRU end 2024-09-12T17:40:11.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.838+0000 7f997fb2e800 10 cache get: name=default.rgw.meta+users.keys+LSJLYRKSDSWLHEXMIHRD : hit (negative entry) 2024-09-12T17:40:11.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.838+0000 7f997fb2e800 10 cache get: name=default.rgw.meta+users.keys+LSJLYRKSDSWLHEXMIHRD : hit (negative entry) 2024-09-12T17:40:11.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.839+0000 7f997fb2e800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:40:11.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.839+0000 7f997fb2e800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:40:11.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.839+0000 7f997fb2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:40:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.840+0000 7f985effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824023 cookie 94682664271296 notifier 5651 bl.length()=675 2024-09-12T17:40:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.840+0000 7f985effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:40:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.840+0000 7f985effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:40:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.841+0000 7f997fb2e800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:40:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.841+0000 7f997fb2e800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:40:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.841+0000 7f997fb2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:40:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.842+0000 7f985effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824016 cookie 94682664280096 notifier 5651 bl.length()=202 2024-09-12T17:40:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.842+0000 7f985effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:40:11.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.842+0000 7f985effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:40:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.844+0000 7f997fb2e800 10 cache put: name=default.rgw.meta+users.keys+LSJLYRKSDSWLHEXMIHRD info.flags=0x7 2024-09-12T17:40:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.844+0000 7f997fb2e800 10 moving default.rgw.meta+users.keys+LSJLYRKSDSWLHEXMIHRD to cache LRU end 2024-09-12T17:40:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.844+0000 7f997fb2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:LSJLYRKSDSWLHEXMIHRD, ofs0, ns] 2024-09-12T17:40:11.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.844+0000 7f985effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824018 cookie 94682664285632 notifier 5651 bl.length()=190 2024-09-12T17:40:11.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.844+0000 7f985effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LSJLYRKSDSWLHEXMIHRD info.flags=0x7 2024-09-12T17:40:11.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.844+0000 7f985effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LSJLYRKSDSWLHEXMIHRD to cache LRU end 2024-09-12T17:40:11.846 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T17:40:11.846 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "ragweed.client.0", 2024-09-12T17:40:11.846 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T17:40:11.846 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T17:40:11.846 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2024-09-12T17:40:11.846 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2024-09-12T17:40:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2024-09-12T17:40:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2024-09-12T17:40:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-12T17:40:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "ragweed.client.0", 2024-09-12T17:40:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "LSJLYRKSDSWLHEXMIHRD", 2024-09-12T17:40:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "eSTNAh0poFK8mJkrlZyT+IqSrSo6TjjNRvh4LqnVBFuJmbYo2q4JKg==", 2024-09-12T17:40:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "active": true, 2024-09-12T17:40:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:40:11.839879Z" 2024-09-12T17:40:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T17:40:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-12T17:40:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2024-09-12T17:40:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [], 2024-09-12T17:40:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2024-09-12T17:40:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2024-09-12T17:40:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2024-09-12T17:40:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2024-09-12T17:40:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2024-09-12T17:40:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:40:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:40:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:40:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:40:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:40:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:40:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2024-09-12T17:40:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:40:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:40:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:40:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:40:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:40:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:40:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2024-09-12T17:40:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "rgw", 2024-09-12T17:40:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [], 2024-09-12T17:40:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "account_id": "", 2024-09-12T17:40:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-12T17:40:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:40:11.839867Z", 2024-09-12T17:40:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-09-12T17:40:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "group_ids": [] 2024-09-12T17:40:11.849 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T17:40:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:40:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.845+0000 7f9831fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.848+0000 7f997fb2e800 20 remove_watcher() i=0 2024-09-12T17:40:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.848+0000 7f997fb2e800 2 removed watcher, disabling cache 2024-09-12T17:40:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.849+0000 7f997fb2e800 20 remove_watcher() i=1 2024-09-12T17:40:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.850+0000 7f997fb2e800 20 remove_watcher() i=2 2024-09-12T17:40:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.851+0000 7f997fb2e800 20 remove_watcher() i=3 2024-09-12T17:40:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.852+0000 7f997fb2e800 20 remove_watcher() i=4 2024-09-12T17:40:11.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.853+0000 7f997fb2e800 20 remove_watcher() i=5 2024-09-12T17:40:11.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.854+0000 7f997fb2e800 20 remove_watcher() i=6 2024-09-12T17:40:11.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.855+0000 7f997fb2e800 20 remove_watcher() i=7 2024-09-12T17:40:11.868 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T17:40:11.869 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key TMRDFZRADWOGGIAICGAW --secret 0SsglmKlR62mZrO615T5W107WUCtSusZ3xk5n+b+sNDM3NjafHzxPw== --email sysuser.client.0+test@test.test --system true 2024-09-12T17:40:11.937 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:11.937 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:11.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.972+0000 7fad80d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.974+0000 7fad80d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.974+0000 7fad80d25800 20 realm 2024-09-12T17:40:11.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.974+0000 7fad80d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.974+0000 7fad80d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.974+0000 7fad80d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:11.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.974+0000 7fad80d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.974+0000 7fad80d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.974+0000 7fad80d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.975+0000 7fad80d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:11.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.975+0000 7fad80d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.975+0000 7fad80d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:11.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.975+0000 7fad80d25800 20 searching for the correct realm 2024-09-12T17:40:11.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.979+0000 7fad7d134640 0 -- 172.21.15.44:0/1203481374 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x55c01288ab20 msgr2=0x55c01288cfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:11.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.983+0000 7fad7c132640 0 -- 172.21.15.44:0/1203481374 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fad6c039060 msgr2=0x7fad6c066da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:11.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.987+0000 7fad80d25800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:40:11.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.987+0000 7fad80d25800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:40:11.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.987+0000 7fad80d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:11.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.987+0000 7fad80d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:11.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.987+0000 7fad80d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:11.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.987+0000 7fad80d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:11.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.987+0000 7fad80d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.987+0000 7fad80d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.987+0000 7fad80d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.987+0000 7fad80d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:11.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.987+0000 7fad80d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.988+0000 7fad80d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:11.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.988+0000 7fad80d25800 20 zone default found 2024-09-12T17:40:11.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.988+0000 7fad80d25800 4 Realm: () 2024-09-12T17:40:11.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.988+0000 7fad80d25800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:40:11.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.988+0000 7fad80d25800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:40:11.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.988+0000 7fad80d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:11.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.988+0000 7fad80d25800 20 zonegroup default 2024-09-12T17:40:11.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.988+0000 7fad80d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.988+0000 7fad80d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.988+0000 7fad80d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.988+0000 7fad80d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.988+0000 7fad80d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:11.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.989+0000 7fad80d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:11.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.989+0000 7fad80d25800 20 started sync module instance, tier type = 2024-09-12T17:40:11.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.989+0000 7fad80d25800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:40:12.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.999+0000 7fad80d25800 20 add_watcher() i=0 2024-09-12T17:40:12.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.999+0000 7fad80d25800 20 add_watcher() i=1 2024-09-12T17:40:12.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.999+0000 7fad80d25800 20 add_watcher() i=2 2024-09-12T17:40:12.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.999+0000 7fad80d25800 20 add_watcher() i=3 2024-09-12T17:40:12.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.999+0000 7fad80d25800 20 add_watcher() i=4 2024-09-12T17:40:12.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.999+0000 7fad80d25800 20 add_watcher() i=5 2024-09-12T17:40:12.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:11.999+0000 7fad80d25800 20 add_watcher() i=6 2024-09-12T17:40:12.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.000+0000 7fad80d25800 20 add_watcher() i=7 2024-09-12T17:40:12.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.000+0000 7fad80d25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:12.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.001+0000 7fac337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:12.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.001+0000 7fad80d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:12.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.001+0000 7fad80d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:12.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.002+0000 7fad80d25800 5 note: GC not initialized 2024-09-12T17:40:12.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.002+0000 7fac327e4640 20 reqs_thread_entry: start 2024-09-12T17:40:12.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.002+0000 7fad80d25800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:12.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.002+0000 7fad80d25800 20 Filter name: none 2024-09-12T17:40:12.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.002+0000 7fac2bfff640 20 reqs_thread_entry: start 2024-09-12T17:40:12.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.002+0000 7fad80d25800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:40:12.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.002+0000 7fad80d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.003+0000 7fad80d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:12.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.003+0000 7fad80d25800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T17:40:12.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.003+0000 7fad80d25800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:40:12.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.003+0000 7fad80d25800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T17:40:12.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.003+0000 7fad80d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.003+0000 7fad80d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:12.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.003+0000 7fad80d25800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T17:40:12.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.003+0000 7fad80d25800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:40:12.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.003+0000 7fad80d25800 10 cache get: name=default.rgw.meta+users.keys+TMRDFZRADWOGGIAICGAW : miss 2024-09-12T17:40:12.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.003+0000 7fad80d25800 20 rados->read ofs=0 len=0 2024-09-12T17:40:12.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.003+0000 7fad80d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:12.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.003+0000 7fad80d25800 10 cache put: name=default.rgw.meta+users.keys+TMRDFZRADWOGGIAICGAW info.flags=0x0 2024-09-12T17:40:12.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.003+0000 7fad80d25800 10 adding default.rgw.meta+users.keys+TMRDFZRADWOGGIAICGAW to cache LRU end 2024-09-12T17:40:12.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.003+0000 7fad80d25800 10 cache get: name=default.rgw.meta+users.keys+TMRDFZRADWOGGIAICGAW : hit (negative entry) 2024-09-12T17:40:12.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.003+0000 7fad80d25800 10 cache get: name=default.rgw.meta+users.keys+TMRDFZRADWOGGIAICGAW : hit (negative entry) 2024-09-12T17:40:12.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.004+0000 7fad80d25800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:40:12.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.004+0000 7fad80d25800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:40:12.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.004+0000 7fad80d25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:40:12.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.005+0000 7fac53fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824017 cookie 94283433082624 notifier 6027 bl.length()=675 2024-09-12T17:40:12.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.005+0000 7fac53fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:40:12.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.005+0000 7fac53fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:40:12.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.006+0000 7fad80d25800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:40:12.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.006+0000 7fad80d25800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:40:12.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.006+0000 7fad80d25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:40:12.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.007+0000 7fac53fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824024 cookie 94283433089728 notifier 6027 bl.length()=202 2024-09-12T17:40:12.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.007+0000 7fac53fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:40:12.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.007+0000 7fac53fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:40:12.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.008+0000 7fad80d25800 10 cache put: name=default.rgw.meta+users.keys+TMRDFZRADWOGGIAICGAW info.flags=0x7 2024-09-12T17:40:12.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.008+0000 7fad80d25800 10 moving default.rgw.meta+users.keys+TMRDFZRADWOGGIAICGAW to cache LRU end 2024-09-12T17:40:12.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.008+0000 7fad80d25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:TMRDFZRADWOGGIAICGAW, ofs0, ns] 2024-09-12T17:40:12.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.009+0000 7fac537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824045 cookie 94283433033072 notifier 6027 bl.length()=190 2024-09-12T17:40:12.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.009+0000 7fac537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TMRDFZRADWOGGIAICGAW info.flags=0x7 2024-09-12T17:40:12.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.009+0000 7fac537fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TMRDFZRADWOGGIAICGAW to cache LRU end 2024-09-12T17:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T17:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "sysuser.client.0", 2024-09-12T17:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T17:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T17:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2024-09-12T17:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2024-09-12T17:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2024-09-12T17:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2024-09-12T17:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-12T17:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "sysuser.client.0", 2024-09-12T17:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "TMRDFZRADWOGGIAICGAW", 2024-09-12T17:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "0SsglmKlR62mZrO615T5W107WUCtSusZ3xk5n+b+sNDM3NjafHzxPw==", 2024-09-12T17:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "active": true, 2024-09-12T17:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:40:12.005150Z" 2024-09-12T17:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T17:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-12T17:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2024-09-12T17:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [], 2024-09-12T17:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2024-09-12T17:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "system": true, 2024-09-12T17:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2024-09-12T17:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2024-09-12T17:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2024-09-12T17:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2024-09-12T17:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2024-09-12T17:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2024-09-12T17:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "rgw", 2024-09-12T17:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [], 2024-09-12T17:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "account_id": "", 2024-09-12T17:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-12T17:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:40:12.005134Z", 2024-09-12T17:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-09-12T17:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "group_ids": [] 2024-09-12T17:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T17:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:40:12.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.010+0000 7fac337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:12.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.012+0000 7fad80d25800 20 remove_watcher() i=0 2024-09-12T17:40:12.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.012+0000 7fad80d25800 2 removed watcher, disabling cache 2024-09-12T17:40:12.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.014+0000 7fad80d25800 20 remove_watcher() i=1 2024-09-12T17:40:12.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.015+0000 7fad80d25800 20 remove_watcher() i=2 2024-09-12T17:40:12.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.016+0000 7fad80d25800 20 remove_watcher() i=3 2024-09-12T17:40:12.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.017+0000 7fad80d25800 20 remove_watcher() i=4 2024-09-12T17:40:12.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.018+0000 7fad80d25800 20 remove_watcher() i=5 2024-09-12T17:40:12.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.019+0000 7fad80d25800 20 remove_watcher() i=6 2024-09-12T17:40:12.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:12.020+0000 7fad80d25800 20 remove_watcher() i=7 2024-09-12T17:40:12.033 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T17:40:12.033 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:40:12.033 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T17:40:12.063 INFO:tasks.ragweed:Configuring boto... 2024-09-12T17:40:12.064 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:40:12.064 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T17:40:12.134 DEBUG:teuthology.orchestra.run.smithi044:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T17:40:12.330 INFO:teuthology.orchestra.run.smithi044.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T17:40:12.498 INFO:teuthology.orchestra.run.smithi044.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T17:40:13.111 INFO:teuthology.orchestra.run.smithi044.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:40:19.369 INFO:teuthology.orchestra.run.smithi044.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T17:40:22.868 INFO:teuthology.orchestra.run.smithi044.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=b0b2c7950b90169f16b792831c3c94ee6ca71279fa670c6f165f1d3c10b2bdd0,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-12T17:40:22.868 INFO:teuthology.orchestra.run.smithi044.stdout:py run-test-pre: PYTHONHASHSEED='2333630851' 2024-09-12T17:40:22.868 INFO:teuthology.orchestra.run.smithi044.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T17:40:23.072 INFO:teuthology.orchestra.run.smithi044.stdout:============================= test session starts ============================== 2024-09-12T17:40:23.072 INFO:teuthology.orchestra.run.smithi044.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T17:40:23.072 INFO:teuthology.orchestra.run.smithi044.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:40:23.073 INFO:teuthology.orchestra.run.smithi044.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:40:23.073 INFO:teuthology.orchestra.run.smithi044.stdout:configfile: pytest.ini 2024-09-12T17:40:23.173 INFO:teuthology.orchestra.run.smithi044.stdout:collecting ... collected 9 items 2024-09-12T17:40:23.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:40:23.662 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T17:40:24.239 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T17:40:24.685 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T17:40:25.207 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T17:40:25.809 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T17:40:31.806 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T17:40:33.097 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T17:40:34.280 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T17:40:36.571 INFO:teuthology.orchestra.run.smithi044.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T17:40:36.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:40:36.571 INFO:teuthology.orchestra.run.smithi044.stdout:=============================== warnings summary =============================== 2024-09-12T17:40:36.571 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T17:40:36.571 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T17:40:36.571 INFO:teuthology.orchestra.run.smithi044.stdout: import imp 2024-09-12T17:40:36.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:40:36.571 INFO:teuthology.orchestra.run.smithi044.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T17:40:36.571 INFO:teuthology.orchestra.run.smithi044.stdout:======================== 9 passed, 1 warning in 13.50s ========================= 2024-09-12T17:40:36.601 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________________ summary ____________________________________ 2024-09-12T17:40:36.601 INFO:teuthology.orchestra.run.smithi044.stdout: py: commands succeeded 2024-09-12T17:40:36.602 INFO:teuthology.orchestra.run.smithi044.stdout: congratulations :) 2024-09-12T17:40:36.620 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T17:40:36.621 DEBUG:teuthology.orchestra.run.smithi044:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T17:40:36.651 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T17:40:36.751 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:36.751 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:36.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.787+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.789+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:36.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.789+0000 7f475010c800 20 realm 2024-09-12T17:40:36.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.789+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.789+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:36.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.789+0000 7f475010c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:36.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.789+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.789+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:36.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.789+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.790+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:36.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.790+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.790+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:36.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.790+0000 7f475010c800 20 searching for the correct realm 2024-09-12T17:40:36.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.792+0000 7f474e3f7640 0 -- 172.21.15.44:0/144581310 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f473c0030f0 msgr2=0x7f4738088680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:36.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.794+0000 7f47453f5640 0 -- 172.21.15.44:0/144581310 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f474007a070 msgr2=0x7f4740089440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:36.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.801+0000 7f475010c800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:40:36.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.801+0000 7f475010c800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:40:36.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.801+0000 7f475010c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:36.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.801+0000 7f475010c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:36.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.801+0000 7f475010c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:36.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.801+0000 7f475010c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:36.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.802+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.802+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:36.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.802+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.802+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:36.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.802+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.802+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:36.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.802+0000 7f475010c800 20 zone default found 2024-09-12T17:40:36.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.802+0000 7f475010c800 4 Realm: () 2024-09-12T17:40:36.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.802+0000 7f475010c800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:40:36.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.802+0000 7f475010c800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:40:36.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.802+0000 7f475010c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:36.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.802+0000 7f475010c800 20 zonegroup default 2024-09-12T17:40:36.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.802+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.803+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:36.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.803+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.803+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:36.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.803+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.803+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:36.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.803+0000 7f475010c800 20 started sync module instance, tier type = 2024-09-12T17:40:36.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.803+0000 7f475010c800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:40:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.813+0000 7f475010c800 20 add_watcher() i=0 2024-09-12T17:40:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.813+0000 7f475010c800 20 add_watcher() i=1 2024-09-12T17:40:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.813+0000 7f475010c800 20 add_watcher() i=2 2024-09-12T17:40:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.813+0000 7f475010c800 20 add_watcher() i=3 2024-09-12T17:40:36.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.813+0000 7f475010c800 20 add_watcher() i=4 2024-09-12T17:40:36.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.813+0000 7f475010c800 20 add_watcher() i=5 2024-09-12T17:40:36.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.813+0000 7f475010c800 20 add_watcher() i=6 2024-09-12T17:40:36.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.814+0000 7f475010c800 20 add_watcher() i=7 2024-09-12T17:40:36.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.814+0000 7f475010c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:36.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.816+0000 7f45ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:36.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.816+0000 7f475010c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:36.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.816+0000 7f475010c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.853+0000 7f45fe7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.853+0000 7f475010c800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.853+0000 7f475010c800 20 Filter name: none 2024-09-12T17:40:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.853+0000 7f4573fff640 20 reqs_thread_entry: start 2024-09-12T17:40:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.853+0000 7f475010c800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:40:36.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.853+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.854+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:40:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.854+0000 7f475010c800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T17:40:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.854+0000 7f475010c800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:40:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.854+0000 7f475010c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.854+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5 : miss 2024-09-12T17:40:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.854+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.855+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T17:40:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.855+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5 info.flags=0x17 2024-09-12T17:40:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.855+0000 7f475010c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5 to cache LRU end 2024-09-12T17:40:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.855+0000 7f475010c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.855+0000 7f475010c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:40:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.855+0000 7f475010c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5 2024-09-12T17:40:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.856+0000 7f475010c800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:40:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.857+0000 7f475010c800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T17:40:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.857+0000 7f475010c800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T17:40:36.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.857+0000 7f475010c800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T17:40:36.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.858+0000 7f475010c800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T17:40:36.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.858+0000 7f475010c800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T17:40:36.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.858+0000 7f475010c800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T17:40:36.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.859+0000 7f475010c800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T17:40:36.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.859+0000 7f475010c800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T17:40:36.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.860+0000 7f475010c800 20 get_obj_state: octx=0x7f474001dfb0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55635c98da98 s->prefetch_data=0 2024-09-12T17:40:36.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.861+0000 7f475010c800 10 manifest: total_size = 5048 2024-09-12T17:40:36.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.861+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6186622460565601544 2024-09-12T17:40:36.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.861+0000 7f475010c800 20 get_obj_state: octx=0x7f474001dfb0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55635c98da98 s->prefetch_data=0 2024-09-12T17:40:36.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.861+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c98da98 2024-09-12T17:40:36.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.861+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5.1 2024-09-12T17:40:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.863+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.863+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5048 stripe_ofs=5048 part_ofs=0 rule->part_size=0 2024-09-12T17:40:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.863+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6186622460565601544 2024-09-12T17:40:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.863+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.863+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_.xq-3jQ8eAOzBTy16iuVDs7zDMVfs0UI_0 2024-09-12T17:40:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.863+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:40:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.863+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.863+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6186622460565601544 2024-09-12T17:40:36.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.864+0000 7f46317fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:40:36.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.865+0000 7f475010c800 20 get_obj_state: octx=0x7f474001dfb0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55635c912a78 s->prefetch_data=0 2024-09-12T17:40:36.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.865+0000 7f475010c800 10 manifest: total_size = 7480 2024-09-12T17:40:36.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.865+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10051121817283563394 2024-09-12T17:40:36.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.865+0000 7f475010c800 20 get_obj_state: octx=0x7f474001dfb0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55635c912a78 s->prefetch_data=0 2024-09-12T17:40:36.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.865+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c912a78 2024-09-12T17:40:36.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.865+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5.2 2024-09-12T17:40:36.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.867+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:36.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.867+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=7480 stripe_ofs=7480 part_ofs=0 rule->part_size=0 2024-09-12T17:40:36.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.867+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10051121817283563394 2024-09-12T17:40:36.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.867+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:36.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.867+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_.JrjTglM5Sdprzp2FZJxWTNr1l_3C_QL_0 2024-09-12T17:40:36.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.867+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:40:36.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.867+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:36.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.867+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10051121817283563394 2024-09-12T17:40:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.869+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T17:40:36.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.869+0000 7f475010c800 20 get_obj_state: octx=0x7f474001dfb0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55635c912a78 s->prefetch_data=0 2024-09-12T17:40:36.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.870+0000 7f475010c800 10 manifest: total_size = 5006 2024-09-12T17:40:36.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.870+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7985967715707443855 2024-09-12T17:40:36.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.870+0000 7f475010c800 20 get_obj_state: octx=0x7f474001dfb0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55635c912a78 s->prefetch_data=0 2024-09-12T17:40:36.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.870+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c912a78 2024-09-12T17:40:36.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.870+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5.2 2024-09-12T17:40:36.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.872+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:36.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.872+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5006 stripe_ofs=5006 part_ofs=0 rule->part_size=0 2024-09-12T17:40:36.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.872+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7985967715707443855 2024-09-12T17:40:36.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.872+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:36.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.872+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_.mphNAp_T8SyFiXgNj4UE5cvEUwGGyrM_0 2024-09-12T17:40:36.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.872+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:40:36.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.872+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:36.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.872+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7985967715707443855 2024-09-12T17:40:36.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.874+0000 7f46317fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T17:40:36.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.874+0000 7f475010c800 20 get_obj_state: octx=0x7f474001dfb0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55635c912a78 s->prefetch_data=0 2024-09-12T17:40:36.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.874+0000 7f475010c800 10 manifest: total_size = 7653 2024-09-12T17:40:36.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.874+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14105356822649045311 2024-09-12T17:40:36.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.874+0000 7f475010c800 20 get_obj_state: octx=0x7f474001dfb0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55635c912a78 s->prefetch_data=0 2024-09-12T17:40:36.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.874+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c912a78 2024-09-12T17:40:36.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.874+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5.3 2024-09-12T17:40:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.876+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.876+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=7653 stripe_ofs=7653 part_ofs=0 rule->part_size=0 2024-09-12T17:40:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.876+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14105356822649045311 2024-09-12T17:40:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.876+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.876+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_.XYLDszxdZUS4125XAViFazkBBjE6EBT_0 2024-09-12T17:40:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.876+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:40:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.876+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.876+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14105356822649045311 2024-09-12T17:40:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.877+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T17:40:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.877+0000 7f475010c800 20 get_obj_state: octx=0x7f473808e170 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55635c912a78 s->prefetch_data=0 2024-09-12T17:40:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.878+0000 7f475010c800 10 manifest: total_size = 7639 2024-09-12T17:40:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.878+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15924639319525217491 2024-09-12T17:40:36.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.878+0000 7f475010c800 20 get_obj_state: octx=0x7f473808e170 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55635c912a78 s->prefetch_data=0 2024-09-12T17:40:36.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.878+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c912a78 2024-09-12T17:40:36.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.878+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5.4 2024-09-12T17:40:36.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.880+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.880+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=7639 stripe_ofs=7639 part_ofs=0 rule->part_size=0 2024-09-12T17:40:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.880+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15924639319525217491 2024-09-12T17:40:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.880+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.880+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_._DP89vAzz6UafXQ6BO13aCMjU517bkA_0 2024-09-12T17:40:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.880+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:40:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.880+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.880+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15924639319525217491 2024-09-12T17:40:36.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.881+0000 7f46317fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T17:40:36.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.881+0000 7f475010c800 20 get_obj_state: octx=0x7f473808e170 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55635c912a78 s->prefetch_data=0 2024-09-12T17:40:36.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.882+0000 7f475010c800 10 manifest: total_size = 7537 2024-09-12T17:40:36.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.882+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5947264467407574525 2024-09-12T17:40:36.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.882+0000 7f475010c800 20 get_obj_state: octx=0x7f473808e170 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55635c912a78 s->prefetch_data=0 2024-09-12T17:40:36.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.882+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c912a78 2024-09-12T17:40:36.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.882+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5.4 2024-09-12T17:40:36.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.884+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:36.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.884+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=7537 stripe_ofs=7537 part_ofs=0 rule->part_size=0 2024-09-12T17:40:36.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.884+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5947264467407574525 2024-09-12T17:40:36.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.884+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:36.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.884+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_.5SDVH50VIEsomIAcxgmv_tE-_KjyVGl_0 2024-09-12T17:40:36.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.884+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:40:36.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.884+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:36.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.884+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5947264467407574525 2024-09-12T17:40:36.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.885+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T17:40:36.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.885+0000 7f475010c800 20 get_obj_state: octx=0x7f4748061f80 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55635c912a78 s->prefetch_data=0 2024-09-12T17:40:36.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.886+0000 7f475010c800 10 manifest: total_size = 4870 2024-09-12T17:40:36.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.886+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12794308448852367148 2024-09-12T17:40:36.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.886+0000 7f475010c800 20 get_obj_state: octx=0x7f4748061f80 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55635c912a78 s->prefetch_data=0 2024-09-12T17:40:36.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.886+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c912a78 2024-09-12T17:40:36.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.886+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5.5 2024-09-12T17:40:36.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.888+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:36.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.888+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=4870 stripe_ofs=4870 part_ofs=0 rule->part_size=0 2024-09-12T17:40:36.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.888+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12794308448852367148 2024-09-12T17:40:36.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.888+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:36.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.888+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_.vnmohf16Y4Y2g1QDvYDCsM-mihY1qZW_0 2024-09-12T17:40:36.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.888+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:40:36.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.888+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:36.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.888+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12794308448852367148 2024-09-12T17:40:36.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.889+0000 7f46317fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T17:40:36.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.889+0000 7f475010c800 20 get_obj_state: octx=0x7f474001dfb0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55635c912a78 s->prefetch_data=0 2024-09-12T17:40:36.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.889+0000 7f475010c800 10 manifest: total_size = 7803 2024-09-12T17:40:36.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.889+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17988251956013575058 2024-09-12T17:40:36.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.889+0000 7f475010c800 20 get_obj_state: octx=0x7f474001dfb0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55635c912a78 s->prefetch_data=0 2024-09-12T17:40:36.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.889+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c912a78 2024-09-12T17:40:36.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.889+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5.7 2024-09-12T17:40:36.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.891+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:36.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.891+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=7803 stripe_ofs=7803 part_ofs=0 rule->part_size=0 2024-09-12T17:40:36.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.891+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17988251956013575058 2024-09-12T17:40:36.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.891+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:36.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.891+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_.o-7XhA11ORNqC9lztzU1lQZcMONJ3m7_0 2024-09-12T17:40:36.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.891+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:40:36.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.891+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:36.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.891+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17988251956013575058 2024-09-12T17:40:36.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.892+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T17:40:36.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.893+0000 7f475010c800 20 get_obj_state: octx=0x7f4748065b80 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55635c912a78 s->prefetch_data=0 2024-09-12T17:40:36.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.893+0000 7f475010c800 10 manifest: total_size = 8744 2024-09-12T17:40:36.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.893+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5884166847466213428 2024-09-12T17:40:36.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.893+0000 7f475010c800 20 get_obj_state: octx=0x7f4748065b80 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55635c912a78 s->prefetch_data=0 2024-09-12T17:40:36.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.893+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c912a78 2024-09-12T17:40:36.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.893+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5.8 2024-09-12T17:40:36.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.895+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:36.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.895+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=8744 stripe_ofs=8744 part_ofs=0 rule->part_size=0 2024-09-12T17:40:36.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.895+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5884166847466213428 2024-09-12T17:40:36.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.895+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:36.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.895+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_.ZJWTYsZQFfmBIqKqZ4RoAXKb0DUqHkt_0 2024-09-12T17:40:36.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.895+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:40:36.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.895+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:36.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.895+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5884166847466213428 2024-09-12T17:40:36.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.896+0000 7f46317fa640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T17:40:36.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.897+0000 7f475010c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:40:36.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.897+0000 7f475010c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:40:36.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.897+0000 7f475010c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:40:36.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.897+0000 7f475010c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:40:36.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.897+0000 7f475010c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:40:36.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.897+0000 7f475010c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:40:36.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.897+0000 7f475010c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5])"; uploads.size()=0; is_truncated=0 2024-09-12T17:40:36.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.899+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T17:40:36.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.899+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.900+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T17:40:36.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.900+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T17:40:36.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.900+0000 7f475010c800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T17:40:36.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.901+0000 7f475010c800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T17:40:36.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.901+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T17:40:36.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.901+0000 7f46317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627804 cookie 93885242826032 notifier 6054 bl.length()=162 2024-09-12T17:40:36.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.903+0000 7f475010c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5 from cache 2024-09-12T17:40:36.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.903+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5, ofs0, ns] 2024-09-12T17:40:36.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.903+0000 7f4630ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627801 cookie 93885242874464 notifier 6054 bl.length()=219 2024-09-12T17:40:36.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.906+0000 7f475010c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5 : miss 2024-09-12T17:40:36.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.906+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.906+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:36.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.906+0000 7f475010c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5 info.flags=0x0 2024-09-12T17:40:36.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.906+0000 7f475010c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5 to cache LRU end 2024-09-12T17:40:36.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.908+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12 : miss 2024-09-12T17:40:36.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.908+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.909+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T17:40:36.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.909+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12 info.flags=0x17 2024-09-12T17:40:36.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.909+0000 7f475010c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12 to cache LRU end 2024-09-12T17:40:36.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.909+0000 7f475010c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:36.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.909+0000 7f475010c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:40:36.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.909+0000 7f475010c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12 2024-09-12T17:40:36.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.913+0000 7f475010c800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:40:36.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.913+0000 7f475010c800 20 get_obj_state: octx=0x7f47380a0090 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55635c90dee8 s->prefetch_data=0 2024-09-12T17:40:36.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.914+0000 7f475010c800 10 manifest: total_size = 1667 2024-09-12T17:40:36.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.914+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8387913938842271588 2024-09-12T17:40:36.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.914+0000 7f475010c800 20 get_obj_state: octx=0x7f47380a0090 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55635c90dee8 s->prefetch_data=0 2024-09-12T17:40:36.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.914+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c90dee8 2024-09-12T17:40:36.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.914+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12.10 2024-09-12T17:40:36.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:40:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T17:40:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T17:40:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:40:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T17:40:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T17:40:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:40:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-12T17:40:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T17:40:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T17:40:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-12T17:40:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T17:40:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8387913938842271588 2024-09-12T17:40:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12__multipart_foo.2~2ftiJkwWe0bZfPBCAmWZMrTCUAL0pkz.1 2024-09-12T17:40:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T17:40:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12__multipart_foo.2~2ftiJkwWe0bZfPBCAmWZMrTCUAL0pkz.2 2024-09-12T17:40:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T17:40:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12__multipart_foo.2~2ftiJkwWe0bZfPBCAmWZMrTCUAL0pkz.3 2024-09-12T17:40:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T17:40:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12__multipart_foo.2~2ftiJkwWe0bZfPBCAmWZMrTCUAL0pkz.4 2024-09-12T17:40:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T17:40:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.916+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8387913938842271588 2024-09-12T17:40:36.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.917+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:40:36.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.917+0000 7f475010c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:40:36.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.917+0000 7f475010c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:40:36.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.918+0000 7f475010c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:40:36.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.918+0000 7f475010c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:40:36.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.918+0000 7f475010c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:40:36.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.918+0000 7f475010c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:40:36.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.918+0000 7f475010c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12])"; uploads.size()=0; is_truncated=0 2024-09-12T17:40:36.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.920+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T17:40:36.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.920+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.920+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T17:40:36.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.920+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T17:40:36.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.920+0000 7f475010c800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T17:40:36.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.922+0000 7f475010c800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T17:40:36.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.922+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T17:40:36.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.922+0000 7f4630ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627827 cookie 93885242869696 notifier 6054 bl.length()=191 2024-09-12T17:40:36.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.923+0000 7f475010c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12 from cache 2024-09-12T17:40:36.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.923+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12, ofs0, ns] 2024-09-12T17:40:36.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.924+0000 7f46317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627805 cookie 93885242826032 notifier 6054 bl.length()=249 2024-09-12T17:40:36.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.926+0000 7f475010c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12 : miss 2024-09-12T17:40:36.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.926+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.927+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:36.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.927+0000 7f475010c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12 info.flags=0x0 2024-09-12T17:40:36.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.927+0000 7f475010c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12 to cache LRU end 2024-09-12T17:40:36.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.929+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13 : miss 2024-09-12T17:40:36.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.929+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.929+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T17:40:36.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.929+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13 info.flags=0x17 2024-09-12T17:40:36.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.929+0000 7f475010c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13 to cache LRU end 2024-09-12T17:40:36.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.929+0000 7f475010c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:36.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.929+0000 7f475010c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:40:36.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.929+0000 7f475010c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13 2024-09-12T17:40:36.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.933+0000 7f475010c800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:40:36.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.933+0000 7f475010c800 20 get_obj_state: octx=0x55635c917cb0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55635c9182f8 s->prefetch_data=0 2024-09-12T17:40:36.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.933+0000 7f475010c800 10 manifest: total_size = 18874368 2024-09-12T17:40:36.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.933+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1353612114100302435 2024-09-12T17:40:36.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.933+0000 7f475010c800 20 get_obj_state: octx=0x55635c917cb0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55635c9182f8 s->prefetch_data=0 2024-09-12T17:40:36.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.933+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c9182f8 2024-09-12T17:40:36.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.933+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13.10 2024-09-12T17:40:36.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:36.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:40:36.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:36.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:36.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:36.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:40:36.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:36.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:40:36.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:40:36.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T17:40:36.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:40:36.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T17:40:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1353612114100302435 2024-09-12T17:40:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13__multipart_foo.2~d1dEjAZ3nPNEaAp64t2Qslnc9uHGIXj.1 2024-09-12T17:40:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T17:40:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13__multipart_foo.2~d1dEjAZ3nPNEaAp64t2Qslnc9uHGIXj.2 2024-09-12T17:40:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T17:40:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13__multipart_foo.2~d1dEjAZ3nPNEaAp64t2Qslnc9uHGIXj.3 2024-09-12T17:40:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T17:40:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13__multipart_foo.2~d1dEjAZ3nPNEaAp64t2Qslnc9uHGIXj.4 2024-09-12T17:40:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T17:40:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.936+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1353612114100302435 2024-09-12T17:40:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.937+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:40:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.937+0000 7f475010c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:40:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.937+0000 7f475010c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:40:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.938+0000 7f475010c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:40:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.938+0000 7f475010c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:40:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.938+0000 7f475010c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:40:36.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.938+0000 7f475010c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:40:36.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.938+0000 7f475010c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13])"; uploads.size()=0; is_truncated=0 2024-09-12T17:40:36.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.940+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T17:40:36.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.940+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.941+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T17:40:36.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.941+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T17:40:36.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.941+0000 7f475010c800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T17:40:36.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.942+0000 7f475010c800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T17:40:36.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.942+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T17:40:36.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.942+0000 7f4630ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627802 cookie 93885242874464 notifier 6054 bl.length()=198 2024-09-12T17:40:36.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.944+0000 7f475010c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13 from cache 2024-09-12T17:40:36.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.944+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13, ofs0, ns] 2024-09-12T17:40:36.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.944+0000 7f46317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627803 cookie 93885242884896 notifier 6054 bl.length()=256 2024-09-12T17:40:36.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.947+0000 7f475010c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13 : miss 2024-09-12T17:40:36.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.947+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.947+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:36.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.947+0000 7f475010c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13 info.flags=0x0 2024-09-12T17:40:36.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.947+0000 7f475010c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13 to cache LRU end 2024-09-12T17:40:36.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.949+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11 : miss 2024-09-12T17:40:36.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.949+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.949+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T17:40:36.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.949+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11 info.flags=0x17 2024-09-12T17:40:36.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.949+0000 7f475010c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11 to cache LRU end 2024-09-12T17:40:36.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.949+0000 7f475010c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:36.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.949+0000 7f475010c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:40:36.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.949+0000 7f475010c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11 2024-09-12T17:40:36.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.954+0000 7f475010c800 10 cls_bucket_list_unordered: got foo[MKAeg3o1KqAR20T.a55crO0U2NWjXyC] 2024-09-12T17:40:36.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.954+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11.10 2024-09-12T17:40:36.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.954+0000 7f475010c800 20 get_obj_state: octx=0x7f4740055a40 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55635c92fa78 s->prefetch_data=0 2024-09-12T17:40:36.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.954+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to d2bpnkj7xj0rzutzcpwn6l318baq9dgk 2024-09-12T17:40:36.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.954+0000 7f475010c800 20 get_obj_state_impl: setting s->olh_tag to gvknmijv8mluy9fozzdev22qqf88tyck 2024-09-12T17:40:36.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.954+0000 7f475010c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gvknmijv8mluy9fozzdev22qqf88tyck 2024-09-12T17:40:36.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.955+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11.10 2024-09-12T17:40:36.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.957+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11.10 2024-09-12T17:40:36.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.957+0000 7f475010c800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T17:40:36.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.957+0000 7f475010c800 20 olh_log_entry: epoch=3 op=3 key=foo[MKAeg3o1KqAR20T.a55crO0U2NWjXyC] 2024-09-12T17:40:36.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.957+0000 7f475010c800 20 get_obj_state: octx=0x7f4740055a40 obj=test-client.0-r-test-multipart-index-versioning.1:_:MKAeg3o1KqAR20T.a55crO0U2NWjXyC_foo state=0x55635c92df08 s->prefetch_data=0 2024-09-12T17:40:36.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.957+0000 7f475010c800 10 manifest: total_size = 1667 2024-09-12T17:40:36.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.957+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11846168974823483583 2024-09-12T17:40:36.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.957+0000 7f475010c800 20 get_obj_state: octx=0x7f4740055a40 obj=test-client.0-r-test-multipart-index-versioning.1:_:MKAeg3o1KqAR20T.a55crO0U2NWjXyC_foo state=0x55635c92df08 s->prefetch_data=0 2024-09-12T17:40:36.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.957+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c92df08 2024-09-12T17:40:36.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.957+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11.10 2024-09-12T17:40:36.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:40:36.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T17:40:36.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T17:40:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:40:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T17:40:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T17:40:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:40:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-12T17:40:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T17:40:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T17:40:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-12T17:40:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T17:40:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11846168974823483583 2024-09-12T17:40:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11__multipart_foo.2~b_70D13zZgqrdHe2Je2F8JmHCzCb_jM.1 2024-09-12T17:40:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T17:40:36.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11__multipart_foo.2~b_70D13zZgqrdHe2Je2F8JmHCzCb_jM.2 2024-09-12T17:40:36.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T17:40:36.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11__multipart_foo.2~b_70D13zZgqrdHe2Je2F8JmHCzCb_jM.3 2024-09-12T17:40:36.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T17:40:36.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11__multipart_foo.2~b_70D13zZgqrdHe2Je2F8JmHCzCb_jM.4 2024-09-12T17:40:36.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T17:40:36.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:36.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.960+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11846168974823483583 2024-09-12T17:40:36.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.961+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo[MKAeg3o1KqAR20T.a55crO0U2NWjXyC] 2024-09-12T17:40:36.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.962+0000 7f475010c800 20 get_obj_state: octx=0x7f4740055a40 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55635c92fa78 s->prefetch_data=0 2024-09-12T17:40:36.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.963+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11.10 2024-09-12T17:40:36.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.964+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11.10 2024-09-12T17:40:36.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.964+0000 7f475010c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:40:36.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.964+0000 7f475010c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:40:36.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.965+0000 7f475010c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:40:36.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.965+0000 7f475010c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:40:36.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.965+0000 7f475010c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:40:36.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.965+0000 7f475010c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:40:36.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.965+0000 7f475010c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11])"; uploads.size()=0; is_truncated=0 2024-09-12T17:40:36.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.967+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T17:40:36.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.967+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.968+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T17:40:36.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.968+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T17:40:36.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.968+0000 7f475010c800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T17:40:36.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.969+0000 7f475010c800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T17:40:36.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.969+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T17:40:36.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.969+0000 7f4630ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627803 cookie 93885242874464 notifier 6054 bl.length()=193 2024-09-12T17:40:36.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.971+0000 7f475010c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11 from cache 2024-09-12T17:40:36.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.971+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11, ofs0, ns] 2024-09-12T17:40:36.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.971+0000 7f46317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627837 cookie 93885242879504 notifier 6054 bl.length()=251 2024-09-12T17:40:36.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.974+0000 7f475010c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11 : miss 2024-09-12T17:40:36.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.974+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.974+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:36.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.974+0000 7f475010c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11 info.flags=0x0 2024-09-12T17:40:36.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.974+0000 7f475010c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11 to cache LRU end 2024-09-12T17:40:36.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.976+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10 : miss 2024-09-12T17:40:36.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.976+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.977+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=449 2024-09-12T17:40:36.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.977+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10 info.flags=0x17 2024-09-12T17:40:36.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.977+0000 7f475010c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10 to cache LRU end 2024-09-12T17:40:36.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.977+0000 7f475010c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:36.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.977+0000 7f475010c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:40:36.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.977+0000 7f475010c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10 2024-09-12T17:40:36.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.980+0000 7f475010c800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:40:36.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.980+0000 7f475010c800 20 get_obj_state: octx=0x7f47480658d0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55635c919658 s->prefetch_data=0 2024-09-12T17:40:36.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.981+0000 7f475010c800 10 manifest: total_size = 18874368 2024-09-12T17:40:36.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.981+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11031857741125420125 2024-09-12T17:40:36.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.981+0000 7f475010c800 20 get_obj_state: octx=0x7f47480658d0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55635c919658 s->prefetch_data=0 2024-09-12T17:40:36.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.981+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c919658 2024-09-12T17:40:36.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.981+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10.10 2024-09-12T17:40:36.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:36.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:40:36.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:36.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:36.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:36.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:40:36.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:36.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:40:36.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:40:36.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T17:40:36.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:40:36.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T17:40:36.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11031857741125420125 2024-09-12T17:40:36.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:36.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10__multipart_foo.2~cbGGG6AMZWvqUG-Wz3CdDbg6UFwOK8-.1 2024-09-12T17:40:36.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T17:40:36.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10__multipart_foo.2~cbGGG6AMZWvqUG-Wz3CdDbg6UFwOK8-.2 2024-09-12T17:40:36.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T17:40:36.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10__multipart_foo.2~cbGGG6AMZWvqUG-Wz3CdDbg6UFwOK8-.3 2024-09-12T17:40:36.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T17:40:36.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10__multipart_foo.2~cbGGG6AMZWvqUG-Wz3CdDbg6UFwOK8-.4 2024-09-12T17:40:36.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T17:40:36.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:36.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.983+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11031857741125420125 2024-09-12T17:40:36.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.984+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:40:36.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.985+0000 7f475010c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:40:36.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.985+0000 7f475010c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:40:36.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.985+0000 7f475010c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:40:36.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.985+0000 7f475010c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:40:36.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.985+0000 7f475010c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:40:36.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.985+0000 7f475010c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:40:36.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.986+0000 7f475010c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10])"; uploads.size()=0; is_truncated=0 2024-09-12T17:40:36.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.987+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T17:40:36.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.987+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.988+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=227 2024-09-12T17:40:36.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.988+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T17:40:36.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.988+0000 7f475010c800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T17:40:36.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.989+0000 7f475010c800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T17:40:36.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.989+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T17:40:36.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.989+0000 7f4630ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627806 cookie 93885242875584 notifier 6054 bl.length()=183 2024-09-12T17:40:36.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.991+0000 7f475010c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10 from cache 2024-09-12T17:40:36.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.991+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10, ofs0, ns] 2024-09-12T17:40:36.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.991+0000 7f46317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627828 cookie 93885242869696 notifier 6054 bl.length()=241 2024-09-12T17:40:36.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.993+0000 7f475010c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10 : miss 2024-09-12T17:40:36.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.993+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.994+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:36.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.994+0000 7f475010c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10 info.flags=0x0 2024-09-12T17:40:36.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.994+0000 7f475010c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10 to cache LRU end 2024-09-12T17:40:36.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.996+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16 : miss 2024-09-12T17:40:36.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.996+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:36.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.997+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:40:36.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.997+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16 info.flags=0x17 2024-09-12T17:40:36.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.997+0000 7f475010c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16 to cache LRU end 2024-09-12T17:40:36.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.997+0000 7f475010c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:36.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.997+0000 7f475010c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:40:36.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.997+0000 7f475010c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16 2024-09-12T17:40:36.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.997+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:40:36.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.998+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:40:36.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.998+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:40:37.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.999+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:40:37.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.999+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:40:37.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:36.999+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:40:37.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.000+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:40:37.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.000+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:40:37.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.000+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:40:37.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.000+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:40:37.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.000+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:40:37.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.001+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:40:37.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.001+0000 7f475010c800 20 get_obj_state: octx=0x55635c912a40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.001+0000 7f475010c800 10 manifest: total_size = 324647 2024-09-12T17:40:37.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.001+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to _sIngmwhhEJFO_LEmrJ-X3Vj2laSSNbJ 2024-09-12T17:40:37.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.001+0000 7f475010c800 20 get_obj_state: octx=0x55635c912a40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.001+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.001+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16.0 2024-09-12T17:40:37.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.004+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.004+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.004+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: _sIngmwhhEJFO_LEmrJ-X3Vj2laSSNbJ 2024-09-12T17:40:37.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.004+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.004+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.PAoIELUVkCV3N8_HA4qCft9MERzXGqH_0 2024-09-12T17:40:37.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.004+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:40:37.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.004+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.004+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _sIngmwhhEJFO_LEmrJ-X3Vj2laSSNbJ 2024-09-12T17:40:37.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.005+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:40:37.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.005+0000 7f475010c800 20 get_obj_state: octx=0x55635c912a40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.006+0000 7f475010c800 10 manifest: total_size = 5242880 2024-09-12T17:40:37.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.006+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to _ElmnEhibCY_7WzESMxDsB7fL7hcF91P 2024-09-12T17:40:37.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.006+0000 7f475010c800 20 get_obj_state: octx=0x55635c912a40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.006+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.006+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16.2 2024-09-12T17:40:37.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.008+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.008+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.008+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: _ElmnEhibCY_7WzESMxDsB7fL7hcF91P 2024-09-12T17:40:37.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.008+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.008+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.O8vX1gFnKOFam4dZ1ZITLlHYI-d3Yjt_0 2024-09-12T17:40:37.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.008+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:40:37.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.008+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.008+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _ElmnEhibCY_7WzESMxDsB7fL7hcF91P 2024-09-12T17:40:37.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.009+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:40:37.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.009+0000 7f475010c800 20 get_obj_state: octx=0x55635c912a40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.009+0000 7f475010c800 10 manifest: total_size = 5242880 2024-09-12T17:40:37.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.009+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16975845030498995499 2024-09-12T17:40:37.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.009+0000 7f475010c800 20 get_obj_state: octx=0x55635c912a40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.009+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.009+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16.3 2024-09-12T17:40:37.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.012+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.012+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.012+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16975845030498995499 2024-09-12T17:40:37.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.012+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.012+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.8gpeL8vs5sCpGXIKFTo4q5foDwE4EbW_0 2024-09-12T17:40:37.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.012+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:40:37.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.012+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.012+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16975845030498995499 2024-09-12T17:40:37.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.013+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:40:37.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.013+0000 7f475010c800 20 get_obj_state: octx=0x7f474806f020 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.013+0000 7f475010c800 10 manifest: total_size = 5242880 2024-09-12T17:40:37.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.013+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to _Q28L4CSL7YCQkDoonVHT3WW76LEqRcZ 2024-09-12T17:40:37.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.013+0000 7f475010c800 20 get_obj_state: octx=0x7f474806f020 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.013+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.013+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16.5 2024-09-12T17:40:37.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.015+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.015+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.015+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: _Q28L4CSL7YCQkDoonVHT3WW76LEqRcZ 2024-09-12T17:40:37.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.015+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.015+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.ZmBOI1NePc1v2d1JGfkF5iivzEQZG8k_0 2024-09-12T17:40:37.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.015+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:40:37.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.015+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.015+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _Q28L4CSL7YCQkDoonVHT3WW76LEqRcZ 2024-09-12T17:40:37.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.017+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:40:37.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.017+0000 7f475010c800 20 get_obj_state: octx=0x55635c912a40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.017+0000 7f475010c800 10 manifest: total_size = 5242880 2024-09-12T17:40:37.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.017+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to _ZVXHi9l2X9jLyaqf-KshmRqRxO18PO- 2024-09-12T17:40:37.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.017+0000 7f475010c800 20 get_obj_state: octx=0x55635c912a40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.017+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.017+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16.5 2024-09-12T17:40:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.019+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.019+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.019+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: _ZVXHi9l2X9jLyaqf-KshmRqRxO18PO- 2024-09-12T17:40:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.019+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.019+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.y0piGTJli67xM1wOhoShyUL-yIlLSvz_0 2024-09-12T17:40:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.019+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:40:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.019+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.019+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _ZVXHi9l2X9jLyaqf-KshmRqRxO18PO- 2024-09-12T17:40:37.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.020+0000 7f475010c800 20 get_obj_state: octx=0x55635c90e220 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.020+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:40:37.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.021+0000 7f475010c800 10 manifest: total_size = 324647 2024-09-12T17:40:37.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.021+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8930169335335412854 2024-09-12T17:40:37.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.021+0000 7f475010c800 20 get_obj_state: octx=0x55635c90e220 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.021+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.021+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16.5 2024-09-12T17:40:37.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.023+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.023+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.023+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8930169335335412854 2024-09-12T17:40:37.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.023+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.023+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.wy3s7L4_NBufXcO9SyPT3yEm3JKQ7R1_0 2024-09-12T17:40:37.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.023+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T17:40:37.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.023+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.023+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8930169335335412854 2024-09-12T17:40:37.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.025+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:40:37.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.025+0000 7f475010c800 20 get_obj_state: octx=0x7f4740055880 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.025+0000 7f475010c800 10 manifest: total_size = 5242880 2024-09-12T17:40:37.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.025+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to _Nhya3JHF49_SJzke0FWKTVh3RQQaWjl 2024-09-12T17:40:37.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.025+0000 7f475010c800 20 get_obj_state: octx=0x7f4740055880 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.025+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.025+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16.7 2024-09-12T17:40:37.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.028+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.028+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.028+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: _Nhya3JHF49_SJzke0FWKTVh3RQQaWjl 2024-09-12T17:40:37.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.028+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.028+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.mcFO5S-2AHIeVYCdrx1d9OIwQi_lxYA_0 2024-09-12T17:40:37.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.028+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:40:37.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.028+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.028+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _Nhya3JHF49_SJzke0FWKTVh3RQQaWjl 2024-09-12T17:40:37.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.029+0000 7f475010c800 20 get_obj_state: octx=0x7f4738089240 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.029+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:40:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.029+0000 7f475010c800 10 manifest: total_size = 5242880 2024-09-12T17:40:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.029+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3776430032419950555 2024-09-12T17:40:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.029+0000 7f475010c800 20 get_obj_state: octx=0x7f4738089240 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.029+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.029+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16.7 2024-09-12T17:40:37.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.032+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.032+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.032+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3776430032419950555 2024-09-12T17:40:37.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.032+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.032+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.pJ9fvemURAFQva4hPdq2RQXLESba0Ek_0 2024-09-12T17:40:37.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.032+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T17:40:37.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.032+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.032+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3776430032419950555 2024-09-12T17:40:37.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.033+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:40:37.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.033+0000 7f475010c800 20 get_obj_state: octx=0x7f473806be80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.033+0000 7f475010c800 10 manifest: total_size = 324647 2024-09-12T17:40:37.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.033+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2761698620202402553 2024-09-12T17:40:37.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.033+0000 7f475010c800 20 get_obj_state: octx=0x7f473806be80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.033+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.033+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16.7 2024-09-12T17:40:37.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.035+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.035+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.035+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2761698620202402553 2024-09-12T17:40:37.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.035+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.035+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.wy3s7L4_NBufXcO9SyPT3yEm3JKQ7R1_0 2024-09-12T17:40:37.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.035+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T17:40:37.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.035+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.036+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2761698620202402553 2024-09-12T17:40:37.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.037+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:40:37.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.037+0000 7f475010c800 20 get_obj_state: octx=0x55635c918fc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.037+0000 7f475010c800 10 manifest: total_size = 5242880 2024-09-12T17:40:37.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.037+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2740387141388103082 2024-09-12T17:40:37.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.037+0000 7f475010c800 20 get_obj_state: octx=0x55635c918fc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.037+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.037+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16.8 2024-09-12T17:40:37.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.039+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.039+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.039+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2740387141388103082 2024-09-12T17:40:37.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.039+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.039+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.pJ9fvemURAFQva4hPdq2RQXLESba0Ek_0 2024-09-12T17:40:37.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.039+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T17:40:37.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.039+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.039+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2740387141388103082 2024-09-12T17:40:37.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.041+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:40:37.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.041+0000 7f475010c800 20 get_obj_state: octx=0x7f4738089240 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.041+0000 7f475010c800 10 manifest: total_size = 324647 2024-09-12T17:40:37.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.041+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to _WDpieQU95iIZ8-3lNzufZ74DpkCwhlp 2024-09-12T17:40:37.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.041+0000 7f475010c800 20 get_obj_state: octx=0x7f4738089240 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.041+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.041+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16.8 2024-09-12T17:40:37.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.043+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.043+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.043+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: _WDpieQU95iIZ8-3lNzufZ74DpkCwhlp 2024-09-12T17:40:37.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.043+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.043+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.ng1Ob48byQ4MsIAcmDB7VyDnpvpVvPC_0 2024-09-12T17:40:37.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.043+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:40:37.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.043+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.043+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _WDpieQU95iIZ8-3lNzufZ74DpkCwhlp 2024-09-12T17:40:37.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.044+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:40:37.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.044+0000 7f475010c800 20 get_obj_state: octx=0x55635c918fc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.045+0000 7f475010c800 10 manifest: total_size = 5242880 2024-09-12T17:40:37.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.045+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15567176399301549800 2024-09-12T17:40:37.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.045+0000 7f475010c800 20 get_obj_state: octx=0x55635c918fc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.045+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.045+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16.9 2024-09-12T17:40:37.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.047+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.047+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.047+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15567176399301549800 2024-09-12T17:40:37.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.047+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.047+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.8gpeL8vs5sCpGXIKFTo4q5foDwE4EbW_0 2024-09-12T17:40:37.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.047+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:40:37.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.047+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.047+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15567176399301549800 2024-09-12T17:40:37.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.048+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:40:37.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.049+0000 7f475010c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:40:37.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.049+0000 7f475010c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:40:37.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.049+0000 7f475010c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:40:37.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.049+0000 7f475010c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:40:37.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.049+0000 7f475010c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:40:37.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.049+0000 7f475010c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:40:37.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.049+0000 7f475010c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16])"; uploads.size()=0; is_truncated=0 2024-09-12T17:40:37.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.051+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T17:40:37.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.051+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.052+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T17:40:37.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.052+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T17:40:37.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.052+0000 7f475010c800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T17:40:37.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.053+0000 7f475010c800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T17:40:37.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.053+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T17:40:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.053+0000 7f4630ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627804 cookie 93885242874464 notifier 6054 bl.length()=189 2024-09-12T17:40:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.055+0000 7f475010c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16 from cache 2024-09-12T17:40:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.055+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16, ofs0, ns] 2024-09-12T17:40:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.055+0000 7f46317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627838 cookie 93885242879504 notifier 6054 bl.length()=247 2024-09-12T17:40:37.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.057+0000 7f475010c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16 : miss 2024-09-12T17:40:37.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.057+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.058+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:37.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.058+0000 7f475010c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16 info.flags=0x0 2024-09-12T17:40:37.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.058+0000 7f475010c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16 to cache LRU end 2024-09-12T17:40:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.060+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17 : miss 2024-09-12T17:40:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.060+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.060+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:40:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.060+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17 info.flags=0x17 2024-09-12T17:40:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.060+0000 7f475010c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17 to cache LRU end 2024-09-12T17:40:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.060+0000 7f475010c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.060+0000 7f475010c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:40:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.060+0000 7f475010c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17 2024-09-12T17:40:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.061+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:40:37.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.061+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:40:37.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.062+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:40:37.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.063+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:40:37.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.063+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:40:37.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.063+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:40:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.063+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:40:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.063+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:40:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.063+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:40:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.064+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:40:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.064+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:40:37.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.064+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:40:37.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.065+0000 7f475010c800 20 get_obj_state: octx=0x55635c915c70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.065+0000 7f475010c800 10 manifest: total_size = 11534336 2024-09-12T17:40:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.065+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to _QC5_W-CSLd1KvVqMwHZEqTzOudNw6Iw 2024-09-12T17:40:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.065+0000 7f475010c800 20 get_obj_state: octx=0x55635c915c70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.065+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.065+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17.0 2024-09-12T17:40:37.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.067+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.067+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.067+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.067+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.067+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: _QC5_W-CSLd1KvVqMwHZEqTzOudNw6Iw 2024-09-12T17:40:37.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.067+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.067+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.vcZqT-_ukM84fMRPL_w3-NkeZaf9r22_0 2024-09-12T17:40:37.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.067+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:40:37.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.067+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.vcZqT-_ukM84fMRPL_w3-NkeZaf9r22_1 2024-09-12T17:40:37.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.067+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T17:40:37.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.067+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.067+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _QC5_W-CSLd1KvVqMwHZEqTzOudNw6Iw 2024-09-12T17:40:37.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.068+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:40:37.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.068+0000 7f475010c800 20 get_obj_state: octx=0x55635c915c70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.069+0000 7f475010c800 10 manifest: total_size = 11534336 2024-09-12T17:40:37.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.069+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to _po98u7HrsoARN11RlmLdn91C40d7EB8 2024-09-12T17:40:37.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.069+0000 7f475010c800 20 get_obj_state: octx=0x55635c915c70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.069+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.069+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17.2 2024-09-12T17:40:37.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.071+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.071+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.071+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.071+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.071+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: _po98u7HrsoARN11RlmLdn91C40d7EB8 2024-09-12T17:40:37.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.071+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.071+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.4SKXpN0PYw7Iw2JE-ICweP72ZBPMjsV_0 2024-09-12T17:40:37.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.071+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:40:37.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.071+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.4SKXpN0PYw7Iw2JE-ICweP72ZBPMjsV_1 2024-09-12T17:40:37.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.071+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:40:37.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.071+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.071+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _po98u7HrsoARN11RlmLdn91C40d7EB8 2024-09-12T17:40:37.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.072+0000 7f475010c800 20 get_obj_state: octx=0x55635c915c70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.072+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:40:37.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.072+0000 7f475010c800 10 manifest: total_size = 11534336 2024-09-12T17:40:37.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.072+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11050587786955050156 2024-09-12T17:40:37.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.072+0000 7f475010c800 20 get_obj_state: octx=0x55635c915c70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.072+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.072+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17.3 2024-09-12T17:40:37.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:37.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:40:37.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:37.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:37.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:37.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:40:37.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:40:37.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:40:37.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:40:37.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11050587786955050156 2024-09-12T17:40:37.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-FROZEN.2~RMRL9v_ZGzvLL32l7BQtIiRkVd-59Kk.1 2024-09-12T17:40:37.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T17:40:37.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-FROZEN.2~RMRL9v_ZGzvLL32l7BQtIiRkVd-59Kk.2 2024-09-12T17:40:37.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-12T17:40:37.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-FROZEN.2~RMRL9v_ZGzvLL32l7BQtIiRkVd-59Kk.3 2024-09-12T17:40:37.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-12T17:40:37.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.074+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11050587786955050156 2024-09-12T17:40:37.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.075+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:40:37.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.076+0000 7f475010c800 20 get_obj_state: octx=0x7f4738088e90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.077+0000 7f475010c800 10 manifest: total_size = 11534336 2024-09-12T17:40:37.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.077+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to _e-VKmUqIQEL1CqtVdQ6__2_t0CSv0XW 2024-09-12T17:40:37.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.077+0000 7f475010c800 20 get_obj_state: octx=0x7f4738088e90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.077+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.077+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17.5 2024-09-12T17:40:37.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.079+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.079+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.079+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.079+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.079+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: _e-VKmUqIQEL1CqtVdQ6__2_t0CSv0XW 2024-09-12T17:40:37.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.079+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.079+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.4sW-IHpgMqy1laQvHuremRuKLkP_-Qb_0 2024-09-12T17:40:37.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.079+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:40:37.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.079+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.4sW-IHpgMqy1laQvHuremRuKLkP_-Qb_1 2024-09-12T17:40:37.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.079+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T17:40:37.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.079+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.079+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _e-VKmUqIQEL1CqtVdQ6__2_t0CSv0XW 2024-09-12T17:40:37.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.080+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:40:37.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.080+0000 7f475010c800 20 get_obj_state: octx=0x7f4748061f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.080+0000 7f475010c800 10 manifest: total_size = 11534336 2024-09-12T17:40:37.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.080+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to _TXzTEVJVXDd4oVuqZNVD9sq-UJjQvjv 2024-09-12T17:40:37.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.080+0000 7f475010c800 20 get_obj_state: octx=0x7f4748061f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.080+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.080+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17.5 2024-09-12T17:40:37.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.083+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.083+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.083+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.083+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.083+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: _TXzTEVJVXDd4oVuqZNVD9sq-UJjQvjv 2024-09-12T17:40:37.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.083+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.083+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.Zo45XUJJ78hthOTePv8jHQVRuw6B-2D_0 2024-09-12T17:40:37.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.083+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:40:37.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.083+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.Zo45XUJJ78hthOTePv8jHQVRuw6B-2D_1 2024-09-12T17:40:37.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.083+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T17:40:37.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.083+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.083+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _TXzTEVJVXDd4oVuqZNVD9sq-UJjQvjv 2024-09-12T17:40:37.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.084+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:40:37.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.086+0000 7f475010c800 20 get_obj_state: octx=0x7f4748061f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.087+0000 7f475010c800 10 manifest: total_size = 11534336 2024-09-12T17:40:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.087+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12400660657098538879 2024-09-12T17:40:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.087+0000 7f475010c800 20 get_obj_state: octx=0x7f4748061f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.087+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.087+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17.5 2024-09-12T17:40:37.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:37.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:40:37.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:37.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:37.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:37.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:40:37.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:40:37.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:40:37.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:40:37.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12400660657098538879 2024-09-12T17:40:37.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-STANDARD.2~iXSIErO2B2bnt30qSQCjizSuiZJeov6.1 2024-09-12T17:40:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T17:40:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-STANDARD.2~iXSIErO2B2bnt30qSQCjizSuiZJeov6.2 2024-09-12T17:40:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T17:40:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-STANDARD.2~iXSIErO2B2bnt30qSQCjizSuiZJeov6.3 2024-09-12T17:40:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T17:40:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.089+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12400660657098538879 2024-09-12T17:40:37.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.090+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:40:37.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.090+0000 7f475010c800 20 get_obj_state: octx=0x55635c86df00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.091+0000 7f475010c800 10 manifest: total_size = 11534336 2024-09-12T17:40:37.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.091+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to _8wvtmuAVcE6PSSmWu2G5nh5_YuGGHDZ 2024-09-12T17:40:37.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.091+0000 7f475010c800 20 get_obj_state: octx=0x55635c86df00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.091+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.091+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17.7 2024-09-12T17:40:37.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.093+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.093+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.093+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.093+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.093+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: _8wvtmuAVcE6PSSmWu2G5nh5_YuGGHDZ 2024-09-12T17:40:37.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.093+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.093+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.qklC0ajsVzjwgrwOM9zbLXTvd0p0A9i_0 2024-09-12T17:40:37.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.093+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:40:37.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.093+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.qklC0ajsVzjwgrwOM9zbLXTvd0p0A9i_1 2024-09-12T17:40:37.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.093+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:40:37.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.093+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.093+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _8wvtmuAVcE6PSSmWu2G5nh5_YuGGHDZ 2024-09-12T17:40:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.094+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:40:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.094+0000 7f475010c800 20 get_obj_state: octx=0x55635c86df00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.094+0000 7f475010c800 10 manifest: total_size = 11534336 2024-09-12T17:40:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.094+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8185051609922464666 2024-09-12T17:40:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.094+0000 7f475010c800 20 get_obj_state: octx=0x55635c86df00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.094+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.094+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17.7 2024-09-12T17:40:37.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:37.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:40:37.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:37.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:37.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:37.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:40:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:40:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:40:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:40:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8185051609922464666 2024-09-12T17:40:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-LUKEWARM.2~ssz7_zxUOUxqBgdsXGLL_9cUfBs2Tgo.1 2024-09-12T17:40:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T17:40:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-LUKEWARM.2~ssz7_zxUOUxqBgdsXGLL_9cUfBs2Tgo.2 2024-09-12T17:40:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-12T17:40:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-LUKEWARM.2~ssz7_zxUOUxqBgdsXGLL_9cUfBs2Tgo.3 2024-09-12T17:40:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-12T17:40:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.096+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8185051609922464666 2024-09-12T17:40:37.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.097+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:40:37.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.098+0000 7f475010c800 20 get_obj_state: octx=0x55635c9102b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.098+0000 7f475010c800 10 manifest: total_size = 11534336 2024-09-12T17:40:37.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.098+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.273015162164835411 2024-09-12T17:40:37.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.098+0000 7f475010c800 20 get_obj_state: octx=0x55635c9102b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.098+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.098+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17.7 2024-09-12T17:40:37.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:37.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:40:37.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:37.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:37.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:37.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:40:37.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:40:37.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:40:37.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:40:37.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.273015162164835411 2024-09-12T17:40:37.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-STANDARD.2~iXSIErO2B2bnt30qSQCjizSuiZJeov6.1 2024-09-12T17:40:37.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 363 2024-09-12T17:40:37.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-STANDARD.2~iXSIErO2B2bnt30qSQCjizSuiZJeov6.2 2024-09-12T17:40:37.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-12T17:40:37.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-STANDARD.2~iXSIErO2B2bnt30qSQCjizSuiZJeov6.3 2024-09-12T17:40:37.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-12T17:40:37.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.101+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.273015162164835411 2024-09-12T17:40:37.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.102+0000 7f475010c800 20 get_obj_state: octx=0x55635c90f610 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.102+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:40:37.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.102+0000 7f475010c800 10 manifest: total_size = 11534336 2024-09-12T17:40:37.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.102+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7780619493950604204 2024-09-12T17:40:37.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.102+0000 7f475010c800 20 get_obj_state: octx=0x55635c90f610 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.102+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.102+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17.8 2024-09-12T17:40:37.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:37.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:40:37.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:37.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:37.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:37.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:40:37.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:40:37.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:40:37.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:40:37.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7780619493950604204 2024-09-12T17:40:37.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-LUKEWARM.2~ssz7_zxUOUxqBgdsXGLL_9cUfBs2Tgo.1 2024-09-12T17:40:37.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T17:40:37.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-LUKEWARM.2~ssz7_zxUOUxqBgdsXGLL_9cUfBs2Tgo.2 2024-09-12T17:40:37.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-12T17:40:37.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-LUKEWARM.2~ssz7_zxUOUxqBgdsXGLL_9cUfBs2Tgo.3 2024-09-12T17:40:37.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-12T17:40:37.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.104+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7780619493950604204 2024-09-12T17:40:37.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.106+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:40:37.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.106+0000 7f475010c800 20 get_obj_state: octx=0x55635c90e3c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.106+0000 7f475010c800 10 manifest: total_size = 11534336 2024-09-12T17:40:37.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.106+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to _l4g4pkOF2GzDUQ8W7O0YzYpS6ES4YvQ 2024-09-12T17:40:37.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.106+0000 7f475010c800 20 get_obj_state: octx=0x55635c90e3c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.106+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.106+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17.8 2024-09-12T17:40:37.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.108+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.108+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.108+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.108+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.108+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: _l4g4pkOF2GzDUQ8W7O0YzYpS6ES4YvQ 2024-09-12T17:40:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.108+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.108+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.sHK5p-Sfo-_QNkL_hDKobyqYpMGJ3sr_0 2024-09-12T17:40:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.108+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:40:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.108+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.sHK5p-Sfo-_QNkL_hDKobyqYpMGJ3sr_1 2024-09-12T17:40:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.108+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T17:40:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.108+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.108+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _l4g4pkOF2GzDUQ8W7O0YzYpS6ES4YvQ 2024-09-12T17:40:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.109+0000 7f475010c800 20 get_obj_state: octx=0x7f4748066530 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.110+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:40:37.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.110+0000 7f475010c800 10 manifest: total_size = 11534336 2024-09-12T17:40:37.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.110+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6509013376206427276 2024-09-12T17:40:37.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.110+0000 7f475010c800 20 get_obj_state: octx=0x7f4748066530 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.110+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.110+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17.9 2024-09-12T17:40:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:40:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:40:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:40:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:40:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:40:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6509013376206427276 2024-09-12T17:40:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-FROZEN.2~RMRL9v_ZGzvLL32l7BQtIiRkVd-59Kk.1 2024-09-12T17:40:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T17:40:37.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-FROZEN.2~RMRL9v_ZGzvLL32l7BQtIiRkVd-59Kk.2 2024-09-12T17:40:37.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T17:40:37.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-FROZEN.2~RMRL9v_ZGzvLL32l7BQtIiRkVd-59Kk.3 2024-09-12T17:40:37.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T17:40:37.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.112+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6509013376206427276 2024-09-12T17:40:37.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.113+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:40:37.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.113+0000 7f475010c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:40:37.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.113+0000 7f475010c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:40:37.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.114+0000 7f475010c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:40:37.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.114+0000 7f475010c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:40:37.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.114+0000 7f475010c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:40:37.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.114+0000 7f475010c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:40:37.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.114+0000 7f475010c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17])"; uploads.size()=0; is_truncated=0 2024-09-12T17:40:37.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.116+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T17:40:37.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.116+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.116+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T17:40:37.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.116+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T17:40:37.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.116+0000 7f475010c800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T17:40:37.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.117+0000 7f475010c800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T17:40:37.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.117+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T17:40:37.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.118+0000 7f46317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627839 cookie 93885242879504 notifier 6054 bl.length()=199 2024-09-12T17:40:37.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.119+0000 7f475010c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17 from cache 2024-09-12T17:40:37.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.119+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17, ofs0, ns] 2024-09-12T17:40:37.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.119+0000 7f4630ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627804 cookie 93885242887536 notifier 6054 bl.length()=257 2024-09-12T17:40:37.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.122+0000 7f475010c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17 : miss 2024-09-12T17:40:37.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.122+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.122+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:37.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.122+0000 7f475010c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17 info.flags=0x0 2024-09-12T17:40:37.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.122+0000 7f475010c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17 to cache LRU end 2024-09-12T17:40:37.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.124+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15 : miss 2024-09-12T17:40:37.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.124+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.125+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:40:37.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.125+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15 info.flags=0x17 2024-09-12T17:40:37.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.125+0000 7f475010c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15 to cache LRU end 2024-09-12T17:40:37.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.125+0000 7f475010c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:37.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.125+0000 7f475010c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:40:37.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.125+0000 7f475010c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15 2024-09-12T17:40:37.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.126+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:40:37.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.127+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:40:37.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.128+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:40:37.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.129+0000 7f475010c800 20 get_obj_state: octx=0x55635c915c70 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55635c92a608 s->prefetch_data=0 2024-09-12T17:40:37.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.130+0000 7f475010c800 10 manifest: total_size = 11534336 2024-09-12T17:40:37.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.130+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2740950164466902422 2024-09-12T17:40:37.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.130+0000 7f475010c800 20 get_obj_state: octx=0x55635c915c70 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55635c92a608 s->prefetch_data=0 2024-09-12T17:40:37.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.130+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c92a608 2024-09-12T17:40:37.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.130+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15.3 2024-09-12T17:40:37.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:37.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:40:37.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:37.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:37.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:37.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:40:37.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:40:37.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:40:37.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:40:37.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2740950164466902422 2024-09-12T17:40:37.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-FROZEN.2~sKqHMa903xXWiLZcw2L7IcbpKpArytK.1 2024-09-12T17:40:37.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T17:40:37.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-FROZEN.2~sKqHMa903xXWiLZcw2L7IcbpKpArytK.2 2024-09-12T17:40:37.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T17:40:37.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-FROZEN.2~sKqHMa903xXWiLZcw2L7IcbpKpArytK.3 2024-09-12T17:40:37.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T17:40:37.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.132+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2740950164466902422 2024-09-12T17:40:37.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.133+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:40:37.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.133+0000 7f475010c800 20 get_obj_state: octx=0x7f4740055880 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55635c92a608 s->prefetch_data=0 2024-09-12T17:40:37.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.134+0000 7f475010c800 10 manifest: total_size = 16377 2024-09-12T17:40:37.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.134+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56654444266832317 2024-09-12T17:40:37.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.134+0000 7f475010c800 20 get_obj_state: octx=0x7f4740055880 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55635c92a608 s->prefetch_data=0 2024-09-12T17:40:37.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.134+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c92a608 2024-09-12T17:40:37.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.134+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15.5 2024-09-12T17:40:37.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-09-12T17:40:37.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7670 2024-09-12T17:40:37.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7672 2024-09-12T17:40:37.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-12T17:40:37.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6299126 part_ofs=7670 rule->part_size=7672 2024-09-12T17:40:37.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=1035 2024-09-12T17:40:37.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-12T17:40:37.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6306798 part_ofs=15342 rule->part_size=1035 2024-09-12T17:40:37.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=16377 rule->part_size=1035 2024-09-12T17:40:37.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56654444266832317 2024-09-12T17:40:37.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-STANDARD.2~s7az6GdIpdGaYGw1bGJjaGivdTrxNF3.1 2024-09-12T17:40:37.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 362 2024-09-12T17:40:37.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-STANDARD.2~s7az6GdIpdGaYGw1bGJjaGivdTrxNF3.2 2024-09-12T17:40:37.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 626 2024-09-12T17:40:37.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-STANDARD.2~s7az6GdIpdGaYGw1bGJjaGivdTrxNF3.3 2024-09-12T17:40:37.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 890 2024-09-12T17:40:37.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.136+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56654444266832317 2024-09-12T17:40:37.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.137+0000 7f475010c800 20 get_obj_state: octx=0x55635c875f60 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55635c92a608 s->prefetch_data=0 2024-09-12T17:40:37.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.138+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:40:37.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.138+0000 7f475010c800 10 manifest: total_size = 11534336 2024-09-12T17:40:37.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.138+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18263488518417133553 2024-09-12T17:40:37.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.138+0000 7f475010c800 20 get_obj_state: octx=0x55635c875f60 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55635c92a608 s->prefetch_data=0 2024-09-12T17:40:37.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.138+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c92a608 2024-09-12T17:40:37.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.138+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15.7 2024-09-12T17:40:37.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:37.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:40:37.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:37.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:40:37.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:40:37.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:40:37.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:40:37.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:40:37.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:40:37.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18263488518417133553 2024-09-12T17:40:37.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-LUKEWARM.2~-6Gu2OqSRD9WQ9P2FG_Y5JqhVrWzr8F.1 2024-09-12T17:40:37.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T17:40:37.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-LUKEWARM.2~-6Gu2OqSRD9WQ9P2FG_Y5JqhVrWzr8F.2 2024-09-12T17:40:37.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-12T17:40:37.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-LUKEWARM.2~-6Gu2OqSRD9WQ9P2FG_Y5JqhVrWzr8F.3 2024-09-12T17:40:37.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-12T17:40:37.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.140+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18263488518417133553 2024-09-12T17:40:37.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.141+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:40:37.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.141+0000 7f475010c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:40:37.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.141+0000 7f475010c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:40:37.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.142+0000 7f475010c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:40:37.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.142+0000 7f475010c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:40:37.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.142+0000 7f475010c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:40:37.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.142+0000 7f475010c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:40:37.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.142+0000 7f475010c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15])"; uploads.size()=0; is_truncated=0 2024-09-12T17:40:37.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.144+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T17:40:37.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.144+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.144+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T17:40:37.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.144+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T17:40:37.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.144+0000 7f475010c800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T17:40:37.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.145+0000 7f475010c800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T17:40:37.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.145+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T17:40:37.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.145+0000 7f46317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627805 cookie 93885242884896 notifier 6054 bl.length()=194 2024-09-12T17:40:37.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.147+0000 7f475010c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15 from cache 2024-09-12T17:40:37.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.147+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15, ofs0, ns] 2024-09-12T17:40:37.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.148+0000 7f4630ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627806 cookie 93885242887536 notifier 6054 bl.length()=252 2024-09-12T17:40:37.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.152+0000 7f475010c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15 : miss 2024-09-12T17:40:37.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.152+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.152+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:37.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.152+0000 7f475010c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15 info.flags=0x0 2024-09-12T17:40:37.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.152+0000 7f475010c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15 to cache LRU end 2024-09-12T17:40:37.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.154+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14 : miss 2024-09-12T17:40:37.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.154+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.155+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T17:40:37.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.155+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14 info.flags=0x17 2024-09-12T17:40:37.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.155+0000 7f475010c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14 to cache LRU end 2024-09-12T17:40:37.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.155+0000 7f475010c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:37.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.155+0000 7f475010c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:40:37.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.155+0000 7f475010c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14 2024-09-12T17:40:37.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.157+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:40:37.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.157+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:40:37.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.158+0000 7f475010c800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:40:37.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.159+0000 7f475010c800 20 get_obj_state: octx=0x55635c915c70 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.159+0000 7f475010c800 10 manifest: total_size = 10485760 2024-09-12T17:40:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.159+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17883539685741343909 2024-09-12T17:40:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.159+0000 7f475010c800 20 get_obj_state: octx=0x55635c915c70 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.159+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.159+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14.3 2024-09-12T17:40:37.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.161+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.161+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.161+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.161+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.162+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17883539685741343909 2024-09-12T17:40:37.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.162+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.162+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14__shadow_.OGjzaPL7RJU0k77d7ZJ-G-jtSMg9AFE_0 2024-09-12T17:40:37.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.162+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:40:37.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.162+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14__shadow_.OGjzaPL7RJU0k77d7ZJ-G-jtSMg9AFE_1 2024-09-12T17:40:37.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.162+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T17:40:37.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.162+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.162+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17883539685741343909 2024-09-12T17:40:37.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.163+0000 7f475010c800 20 get_obj_state: octx=0x55635c875f60 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.163+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:40:37.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.163+0000 7f475010c800 10 manifest: total_size = 649292 2024-09-12T17:40:37.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.163+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9479332390376112689 2024-09-12T17:40:37.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.163+0000 7f475010c800 20 get_obj_state: octx=0x55635c875f60 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.163+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.163+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14.5 2024-09-12T17:40:37.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.166+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.166+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=649292 stripe_ofs=649292 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.166+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9479332390376112689 2024-09-12T17:40:37.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.166+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.166+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14__shadow_.3aic9uIhURhWf82qWkB5cimoepxm-Ga_0 2024-09-12T17:40:37.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.166+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T17:40:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.166+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.166+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9479332390376112689 2024-09-12T17:40:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.167+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:40:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.167+0000 7f475010c800 20 get_obj_state: octx=0x7f47480017c0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.167+0000 7f475010c800 10 manifest: total_size = 10485760 2024-09-12T17:40:37.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.167+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14035723289373576276 2024-09-12T17:40:37.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.167+0000 7f475010c800 20 get_obj_state: octx=0x7f47480017c0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55635c929948 s->prefetch_data=0 2024-09-12T17:40:37.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.167+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c929948 2024-09-12T17:40:37.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.167+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14.7 2024-09-12T17:40:37.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.170+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.170+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.170+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.170+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.170+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14035723289373576276 2024-09-12T17:40:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.170+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.170+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14__shadow_.M2JjtGFhFK-uDa8yDBd9lfajzCNbIOC_0 2024-09-12T17:40:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.170+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T17:40:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.170+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14__shadow_.M2JjtGFhFK-uDa8yDBd9lfajzCNbIOC_1 2024-09-12T17:40:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.170+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T17:40:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.170+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.170+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14035723289373576276 2024-09-12T17:40:37.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.171+0000 7f46317fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:40:37.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.171+0000 7f475010c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:40:37.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.171+0000 7f475010c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:40:37.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.172+0000 7f475010c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:40:37.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.172+0000 7f475010c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:40:37.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.172+0000 7f475010c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:40:37.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.172+0000 7f475010c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:40:37.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.172+0000 7f475010c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14])"; uploads.size()=0; is_truncated=0 2024-09-12T17:40:37.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.173+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T17:40:37.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.173+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.174+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T17:40:37.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.174+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T17:40:37.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.174+0000 7f475010c800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T17:40:37.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.175+0000 7f475010c800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T17:40:37.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.175+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T17:40:37.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.175+0000 7f46317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627805 cookie 93885242874464 notifier 6054 bl.length()=184 2024-09-12T17:40:37.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.177+0000 7f475010c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14 from cache 2024-09-12T17:40:37.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.177+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14, ofs0, ns] 2024-09-12T17:40:37.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.177+0000 7f4630ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627807 cookie 93885242884896 notifier 6054 bl.length()=242 2024-09-12T17:40:37.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.182+0000 7f475010c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14 : miss 2024-09-12T17:40:37.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.182+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.182+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:37.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.182+0000 7f475010c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14 info.flags=0x0 2024-09-12T17:40:37.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.182+0000 7f475010c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14 to cache LRU end 2024-09-12T17:40:37.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.184+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7 : miss 2024-09-12T17:40:37.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.184+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.184+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:40:37.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.184+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7 info.flags=0x17 2024-09-12T17:40:37.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.184+0000 7f475010c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7 to cache LRU end 2024-09-12T17:40:37.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.184+0000 7f475010c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:37.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.184+0000 7f475010c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:40:37.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.184+0000 7f475010c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7 2024-09-12T17:40:37.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.185+0000 7f475010c800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:40:37.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.186+0000 7f475010c800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:40:37.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.187+0000 7f475010c800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:40:37.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.188+0000 7f475010c800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:40:37.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.188+0000 7f475010c800 20 get_obj_state: octx=0x55635c98f530 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55635c92a568 s->prefetch_data=0 2024-09-12T17:40:37.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.189+0000 7f475010c800 10 manifest: total_size = 0 2024-09-12T17:40:37.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.189+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9461307609465320518 2024-09-12T17:40:37.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.189+0000 7f475010c800 20 get_obj_state: octx=0x55635c98f530 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55635c92a568 s->prefetch_data=0 2024-09-12T17:40:37.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.189+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c92a568 2024-09-12T17:40:37.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.189+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7.2 2024-09-12T17:40:37.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.191+0000 7f475010c800 20 get_obj_state: octx=0x55635c98f530 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55635c92a568 s->prefetch_data=0 2024-09-12T17:40:37.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.192+0000 7f475010c800 10 manifest: total_size = 0 2024-09-12T17:40:37.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.192+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5794833276766451092 2024-09-12T17:40:37.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.192+0000 7f475010c800 20 get_obj_state: octx=0x55635c98f530 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55635c92a568 s->prefetch_data=0 2024-09-12T17:40:37.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.192+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c92a568 2024-09-12T17:40:37.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.192+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7.3 2024-09-12T17:40:37.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.192+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:40:37.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.194+0000 7f475010c800 20 get_obj_state: octx=0x55635c98f530 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55635c92a568 s->prefetch_data=0 2024-09-12T17:40:37.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.194+0000 7f475010c800 10 manifest: total_size = 0 2024-09-12T17:40:37.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.194+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14628057979818665158 2024-09-12T17:40:37.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.194+0000 7f475010c800 20 get_obj_state: octx=0x55635c98f530 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55635c92a568 s->prefetch_data=0 2024-09-12T17:40:37.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.194+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c92a568 2024-09-12T17:40:37.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.194+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7.6 2024-09-12T17:40:37.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.195+0000 7f46317fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:40:37.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.196+0000 7f475010c800 20 get_obj_state: octx=0x7f47480017c0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55635c92a568 s->prefetch_data=0 2024-09-12T17:40:37.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.197+0000 7f475010c800 10 manifest: total_size = 0 2024-09-12T17:40:37.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.197+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11334541478902963137 2024-09-12T17:40:37.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.197+0000 7f475010c800 20 get_obj_state: octx=0x7f47480017c0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55635c92a568 s->prefetch_data=0 2024-09-12T17:40:37.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.197+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c92a568 2024-09-12T17:40:37.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.197+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7.8 2024-09-12T17:40:37.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.198+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:40:37.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.199+0000 7f475010c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:40:37.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.199+0000 7f475010c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:40:37.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.200+0000 7f46317fa640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:40:37.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.200+0000 7f475010c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:40:37.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.200+0000 7f475010c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:40:37.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.200+0000 7f475010c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:40:37.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.200+0000 7f475010c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:40:37.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.200+0000 7f475010c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7])"; uploads.size()=0; is_truncated=0 2024-09-12T17:40:37.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.202+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T17:40:37.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.202+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.202+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:40:37.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.202+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T17:40:37.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.202+0000 7f475010c800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T17:40:37.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.203+0000 7f475010c800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T17:40:37.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.203+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T17:40:37.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.204+0000 7f4630ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627829 cookie 93885242869696 notifier 6054 bl.length()=181 2024-09-12T17:40:37.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.205+0000 7f475010c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7 from cache 2024-09-12T17:40:37.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.205+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7, ofs0, ns] 2024-09-12T17:40:37.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.206+0000 7f46317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627808 cookie 93885242884896 notifier 6054 bl.length()=238 2024-09-12T17:40:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.213+0000 7f475010c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7 : miss 2024-09-12T17:40:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.213+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.213+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:37.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.213+0000 7f475010c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7 info.flags=0x0 2024-09-12T17:40:37.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.213+0000 7f475010c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7 to cache LRU end 2024-09-12T17:40:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.215+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8 : miss 2024-09-12T17:40:37.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.215+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.216+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:40:37.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.216+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8 info.flags=0x17 2024-09-12T17:40:37.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.216+0000 7f475010c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8 to cache LRU end 2024-09-12T17:40:37.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.216+0000 7f475010c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:37.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.216+0000 7f475010c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:40:37.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.216+0000 7f475010c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8 2024-09-12T17:40:37.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.217+0000 7f475010c800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:40:37.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.217+0000 7f475010c800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:40:37.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.218+0000 7f475010c800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:40:37.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.219+0000 7f475010c800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:40:37.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.220+0000 7f475010c800 20 get_obj_state: octx=0x55635c90ffc0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55635c93cea8 s->prefetch_data=0 2024-09-12T17:40:37.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.220+0000 7f475010c800 10 manifest: total_size = 24595 2024-09-12T17:40:37.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.220+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15238521963579092362 2024-09-12T17:40:37.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.220+0000 7f475010c800 20 get_obj_state: octx=0x55635c90ffc0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55635c93cea8 s->prefetch_data=0 2024-09-12T17:40:37.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.220+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c93cea8 2024-09-12T17:40:37.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.220+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8.2 2024-09-12T17:40:37.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.222+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.222+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.223+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15238521963579092362 2024-09-12T17:40:37.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.223+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.223+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8__shadow_.lmx345cWpG8j8K15TY738t8BLrw6WVL_0 2024-09-12T17:40:37.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.223+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:40:37.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.223+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.223+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15238521963579092362 2024-09-12T17:40:37.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.224+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:40:37.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.224+0000 7f475010c800 20 get_obj_state: octx=0x55635c90ffc0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55635c93cea8 s->prefetch_data=0 2024-09-12T17:40:37.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.224+0000 7f475010c800 10 manifest: total_size = 524288 2024-09-12T17:40:37.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.224+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17181285536792801919 2024-09-12T17:40:37.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.224+0000 7f475010c800 20 get_obj_state: octx=0x55635c90ffc0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55635c93cea8 s->prefetch_data=0 2024-09-12T17:40:37.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.224+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c93cea8 2024-09-12T17:40:37.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.224+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8.3 2024-09-12T17:40:37.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.226+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.226+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.226+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17181285536792801919 2024-09-12T17:40:37.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.226+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.226+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8__shadow_.ca4lfa573vHRUXI_CQbxdsDRo22VDI1_0 2024-09-12T17:40:37.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.226+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:40:37.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.226+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.226+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17181285536792801919 2024-09-12T17:40:37.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.228+0000 7f46317fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:40:37.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.228+0000 7f475010c800 20 get_obj_state: octx=0x7f47480017c0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55635c93cea8 s->prefetch_data=0 2024-09-12T17:40:37.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.228+0000 7f475010c800 10 manifest: total_size = 24595 2024-09-12T17:40:37.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.228+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.696212667528781378 2024-09-12T17:40:37.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.228+0000 7f475010c800 20 get_obj_state: octx=0x7f47480017c0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55635c93cea8 s->prefetch_data=0 2024-09-12T17:40:37.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.228+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c93cea8 2024-09-12T17:40:37.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.228+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8.6 2024-09-12T17:40:37.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.230+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.230+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.230+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.696212667528781378 2024-09-12T17:40:37.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.230+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.230+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8__shadow_.nj7OBHHSRHEJAmZmTA0Ez66XBvNkUSy_0 2024-09-12T17:40:37.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.230+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-12T17:40:37.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.230+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.230+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.696212667528781378 2024-09-12T17:40:37.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.231+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:40:37.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.231+0000 7f475010c800 20 get_obj_state: octx=0x7f47480017c0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55635c93cea8 s->prefetch_data=0 2024-09-12T17:40:37.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.232+0000 7f475010c800 10 manifest: total_size = 24595 2024-09-12T17:40:37.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.232+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6625355375052573093 2024-09-12T17:40:37.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.232+0000 7f475010c800 20 get_obj_state: octx=0x7f47480017c0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55635c93cea8 s->prefetch_data=0 2024-09-12T17:40:37.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.232+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c93cea8 2024-09-12T17:40:37.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.232+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8.8 2024-09-12T17:40:37.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.234+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.234+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.234+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6625355375052573093 2024-09-12T17:40:37.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.234+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.234+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8__shadow_.W6SbKxADuvXvCTRgJm9GJ1jiT7x79a8_0 2024-09-12T17:40:37.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.234+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:40:37.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.234+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.234+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6625355375052573093 2024-09-12T17:40:37.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.235+0000 7f46317fa640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:40:37.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.235+0000 7f475010c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:40:37.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.235+0000 7f475010c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:40:37.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.236+0000 7f475010c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:40:37.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.236+0000 7f475010c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:40:37.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.236+0000 7f475010c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:40:37.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.236+0000 7f475010c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:40:37.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.236+0000 7f475010c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8])"; uploads.size()=0; is_truncated=0 2024-09-12T17:40:37.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.237+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T17:40:37.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.238+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.238+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:40:37.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.238+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T17:40:37.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.238+0000 7f475010c800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T17:40:37.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.239+0000 7f475010c800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T17:40:37.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.239+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T17:40:37.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.239+0000 7f4630ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627830 cookie 93885242869696 notifier 6054 bl.length()=181 2024-09-12T17:40:37.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.241+0000 7f475010c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8 from cache 2024-09-12T17:40:37.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.241+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8, ofs0, ns] 2024-09-12T17:40:37.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.241+0000 7f46317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627809 cookie 93885242884896 notifier 6054 bl.length()=238 2024-09-12T17:40:37.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.244+0000 7f475010c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8 : miss 2024-09-12T17:40:37.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.244+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.244+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:37.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.244+0000 7f475010c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8 info.flags=0x0 2024-09-12T17:40:37.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.244+0000 7f475010c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8 to cache LRU end 2024-09-12T17:40:37.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.246+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9 : miss 2024-09-12T17:40:37.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.246+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.247+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:40:37.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.247+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9 info.flags=0x17 2024-09-12T17:40:37.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.247+0000 7f475010c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9 to cache LRU end 2024-09-12T17:40:37.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.247+0000 7f475010c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:37.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.247+0000 7f475010c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:40:37.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.247+0000 7f475010c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9 2024-09-12T17:40:37.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.248+0000 7f475010c800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:40:37.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.249+0000 7f475010c800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:40:37.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.250+0000 7f475010c800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:40:37.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.251+0000 7f475010c800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:40:37.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.251+0000 7f475010c800 20 get_obj_state: octx=0x7f4738087020 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55635c91fbf8 s->prefetch_data=0 2024-09-12T17:40:37.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.252+0000 7f475010c800 10 manifest: total_size = 4134 2024-09-12T17:40:37.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.252+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15580978071178754962 2024-09-12T17:40:37.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.252+0000 7f475010c800 20 get_obj_state: octx=0x7f4738087020 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55635c91fbf8 s->prefetch_data=0 2024-09-12T17:40:37.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.252+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c91fbf8 2024-09-12T17:40:37.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.252+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9.2 2024-09-12T17:40:37.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.254+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.254+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.254+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15580978071178754962 2024-09-12T17:40:37.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.254+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.254+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9__shadow_._SvutE6LsaCyci3R52ch-6Tth27LY94_0 2024-09-12T17:40:37.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.254+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:40:37.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.254+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.254+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15580978071178754962 2024-09-12T17:40:37.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.255+0000 7f46317fa640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:40:37.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.255+0000 7f475010c800 20 get_obj_state: octx=0x7f4738087020 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55635c91fbf8 s->prefetch_data=0 2024-09-12T17:40:37.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.256+0000 7f475010c800 10 manifest: total_size = 1035 2024-09-12T17:40:37.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.256+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2324725440601752248 2024-09-12T17:40:37.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.256+0000 7f475010c800 20 get_obj_state: octx=0x7f4738087020 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55635c91fbf8 s->prefetch_data=0 2024-09-12T17:40:37.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.256+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c91fbf8 2024-09-12T17:40:37.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.256+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9.3 2024-09-12T17:40:37.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.258+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.258+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.258+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2324725440601752248 2024-09-12T17:40:37.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.258+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.258+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9__shadow_.JIuc0aQxsz9ededklDzH-LSd9-BOfO8_0 2024-09-12T17:40:37.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.258+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:40:37.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.258+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.258+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2324725440601752248 2024-09-12T17:40:37.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.259+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:40:37.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.259+0000 7f475010c800 20 get_obj_state: octx=0x7f47480017c0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55635c91fbf8 s->prefetch_data=0 2024-09-12T17:40:37.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.259+0000 7f475010c800 10 manifest: total_size = 1035 2024-09-12T17:40:37.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.259+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14729610525299173085 2024-09-12T17:40:37.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.259+0000 7f475010c800 20 get_obj_state: octx=0x7f47480017c0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55635c91fbf8 s->prefetch_data=0 2024-09-12T17:40:37.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.259+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c91fbf8 2024-09-12T17:40:37.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.259+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9.6 2024-09-12T17:40:37.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.261+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.261+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.261+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14729610525299173085 2024-09-12T17:40:37.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.261+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.261+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9__shadow_.6u5BHXdudgTeWpEmAg6hBXiKEdbdmAj_0 2024-09-12T17:40:37.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.261+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:40:37.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.261+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.261+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14729610525299173085 2024-09-12T17:40:37.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.263+0000 7f46317fa640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:40:37.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.263+0000 7f475010c800 20 get_obj_state: octx=0x7f4738087020 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55635c91fbf8 s->prefetch_data=0 2024-09-12T17:40:37.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.263+0000 7f475010c800 10 manifest: total_size = 1035 2024-09-12T17:40:37.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.263+0000 7f475010c800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8032868066886114352 2024-09-12T17:40:37.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.263+0000 7f475010c800 20 get_obj_state: octx=0x7f4738087020 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55635c91fbf8 s->prefetch_data=0 2024-09-12T17:40:37.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.263+0000 7f475010c800 20 prepare_atomic_modification: state is not atomic. state=0x55635c91fbf8 2024-09-12T17:40:37.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.263+0000 7f475010c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9.8 2024-09-12T17:40:37.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.265+0000 7f475010c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:40:37.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.265+0000 7f475010c800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-12T17:40:37.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.265+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8032868066886114352 2024-09-12T17:40:37.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.265+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:40:37.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.265+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9__shadow_.ZfUsnTwvpP1hs2Kvm0JgNGHJqtlIahS_0 2024-09-12T17:40:37.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.265+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:40:37.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.265+0000 7f475010c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:40:37.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.265+0000 7f475010c800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8032868066886114352 2024-09-12T17:40:37.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.266+0000 7f4630ff9640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:40:37.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.266+0000 7f475010c800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:40:37.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.266+0000 7f475010c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:40:37.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.267+0000 7f475010c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:40:37.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.267+0000 7f475010c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:40:37.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.267+0000 7f475010c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:40:37.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.267+0000 7f475010c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:40:37.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.267+0000 7f475010c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9])"; uploads.size()=0; is_truncated=0 2024-09-12T17:40:37.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.269+0000 7f475010c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T17:40:37.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.269+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.269+0000 7f475010c800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:40:37.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.269+0000 7f475010c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T17:40:37.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.269+0000 7f475010c800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T17:40:37.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.270+0000 7f475010c800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T17:40:37.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.270+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T17:40:37.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.271+0000 7f46317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627831 cookie 93885242869696 notifier 6054 bl.length()=181 2024-09-12T17:40:37.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.272+0000 7f475010c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9 from cache 2024-09-12T17:40:37.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.272+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9, ofs0, ns] 2024-09-12T17:40:37.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.272+0000 7f4630ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627810 cookie 93885242884896 notifier 6054 bl.length()=238 2024-09-12T17:40:37.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.275+0000 7f475010c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9 : miss 2024-09-12T17:40:37.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.275+0000 7f475010c800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.275+0000 7f475010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:37.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.275+0000 7f475010c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9 info.flags=0x0 2024-09-12T17:40:37.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.275+0000 7f475010c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9 to cache LRU end 2024-09-12T17:40:37.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.277+0000 7f475010c800 10 removing key index: LSJLYRKSDSWLHEXMIHRD 2024-09-12T17:40:37.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.278+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:LSJLYRKSDSWLHEXMIHRD, ofs0, ns] 2024-09-12T17:40:37.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.278+0000 7f4630ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627811 cookie 93885242884896 notifier 6054 bl.length()=170 2024-09-12T17:40:37.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.279+0000 7f475010c800 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T17:40:37.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.280+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:40:37.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.280+0000 7f46317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627806 cookie 93885242874464 notifier 6054 bl.length()=182 2024-09-12T17:40:37.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.281+0000 7f475010c800 10 removing user buckets index 2024-09-12T17:40:37.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.281+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T17:40:37.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.282+0000 7f46317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627812 cookie 93885242884896 notifier 6054 bl.length()=173 2024-09-12T17:40:37.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.282+0000 7f475010c800 10 removing user index: ragweed.client.0 2024-09-12T17:40:37.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.283+0000 7f475010c800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T17:40:37.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.283+0000 7f475010c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:40:37.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.283+0000 7f4630ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627807 cookie 93885242875584 notifier 6054 bl.length()=165 2024-09-12T17:40:37.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.285+0000 7f45ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:37.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.287+0000 7f475010c800 20 remove_watcher() i=0 2024-09-12T17:40:37.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.287+0000 7f475010c800 2 removed watcher, disabling cache 2024-09-12T17:40:37.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.288+0000 7f475010c800 20 remove_watcher() i=1 2024-09-12T17:40:37.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.289+0000 7f475010c800 20 remove_watcher() i=2 2024-09-12T17:40:37.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.290+0000 7f475010c800 20 remove_watcher() i=3 2024-09-12T17:40:37.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.291+0000 7f475010c800 20 remove_watcher() i=4 2024-09-12T17:40:37.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.292+0000 7f475010c800 20 remove_watcher() i=5 2024-09-12T17:40:37.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.293+0000 7f475010c800 20 remove_watcher() i=6 2024-09-12T17:40:37.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.294+0000 7f475010c800 20 remove_watcher() i=7 2024-09-12T17:40:37.306 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T17:40:37.364 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:37.364 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:37.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.400+0000 7fb8d9220800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.401+0000 7fb8d9220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:37.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.401+0000 7fb8d9220800 20 realm 2024-09-12T17:40:37.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.401+0000 7fb8d9220800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.401+0000 7fb8d9220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:37.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.401+0000 7fb8d9220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:37.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.401+0000 7fb8d9220800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.401+0000 7fb8d9220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:37.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.401+0000 7fb8d9220800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.402+0000 7fb8d9220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:37.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.402+0000 7fb8d9220800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.402+0000 7fb8d9220800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:37.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.402+0000 7fb8d9220800 20 searching for the correct realm 2024-09-12T17:40:37.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.405+0000 7fb8d6509640 0 -- 172.21.15.44:0/1378244365 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fb8c8080050 msgr2=0x7fb8c8081940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:37.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.409+0000 7fb8d6d0a640 0 -- 172.21.15.44:0/1378244365 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fb8cc060a90 msgr2=0x7fb8cc0907f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.615+0000 7fb8d9220800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:40:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.615+0000 7fb8d9220800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:40:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.615+0000 7fb8d9220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.615+0000 7fb8d9220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.615+0000 7fb8d9220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.615+0000 7fb8d9220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.615+0000 7fb8d9220800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.615+0000 7fb8d9220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.615+0000 7fb8d9220800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.616+0000 7fb8d9220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.616+0000 7fb8d9220800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.616+0000 7fb8d9220800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.616+0000 7fb8d9220800 20 zone default found 2024-09-12T17:40:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.616+0000 7fb8d9220800 4 Realm: () 2024-09-12T17:40:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.616+0000 7fb8d9220800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:40:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.616+0000 7fb8d9220800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:40:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.616+0000 7fb8d9220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.616+0000 7fb8d9220800 20 zonegroup default 2024-09-12T17:40:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.616+0000 7fb8d9220800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.616+0000 7fb8d9220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.616+0000 7fb8d9220800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.617+0000 7fb8d9220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.617+0000 7fb8d9220800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.617+0000 7fb8d9220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.617+0000 7fb8d9220800 20 started sync module instance, tier type = 2024-09-12T17:40:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.617+0000 7fb8d9220800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:40:37.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.626+0000 7fb8d9220800 20 add_watcher() i=0 2024-09-12T17:40:37.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.626+0000 7fb8d9220800 20 add_watcher() i=1 2024-09-12T17:40:37.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.626+0000 7fb8d9220800 20 add_watcher() i=2 2024-09-12T17:40:37.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.626+0000 7fb8d9220800 20 add_watcher() i=3 2024-09-12T17:40:37.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.626+0000 7fb8d9220800 20 add_watcher() i=4 2024-09-12T17:40:37.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.626+0000 7fb8d9220800 20 add_watcher() i=5 2024-09-12T17:40:37.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.626+0000 7fb8d9220800 20 add_watcher() i=6 2024-09-12T17:40:37.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.627+0000 7fb8d9220800 20 add_watcher() i=7 2024-09-12T17:40:37.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.627+0000 7fb8d9220800 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:37.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.629+0000 7fb78dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:37.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.629+0000 7fb8d9220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:37.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.629+0000 7fb8d9220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:37.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.664+0000 7fb78cfe1640 20 reqs_thread_entry: start 2024-09-12T17:40:37.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.664+0000 7fb8d9220800 20 init_complete bucket index max shards: 11 2024-09-12T17:40:37.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.664+0000 7fb8d9220800 20 Filter name: none 2024-09-12T17:40:37.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.664+0000 7fb785ffb640 20 reqs_thread_entry: start 2024-09-12T17:40:37.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.664+0000 7fb8d9220800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:40:37.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.664+0000 7fb8d9220800 20 rados->read ofs=0 len=0 2024-09-12T17:40:37.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.665+0000 7fb8d9220800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:40:37.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.665+0000 7fb8d9220800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T17:40:37.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.665+0000 7fb8d9220800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:40:37.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.665+0000 7fb8d9220800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:37.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.666+0000 7fb8d9220800 10 removing key index: TMRDFZRADWOGGIAICGAW 2024-09-12T17:40:37.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.667+0000 7fb8d9220800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:TMRDFZRADWOGGIAICGAW, ofs0, ns] 2024-09-12T17:40:37.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.667+0000 7fb7b9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627832 cookie 94739792176496 notifier 5711 bl.length()=170 2024-09-12T17:40:37.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.667+0000 7fb8d9220800 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T17:40:37.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.668+0000 7fb8d9220800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:40:37.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.669+0000 7fb7b9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627808 cookie 94739792180928 notifier 5711 bl.length()=182 2024-09-12T17:40:37.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.669+0000 7fb8d9220800 10 removing user buckets index 2024-09-12T17:40:37.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.670+0000 7fb8d9220800 10 removing user index: sysuser.client.0 2024-09-12T17:40:37.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.671+0000 7fb8d9220800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T17:40:37.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.671+0000 7fb8d9220800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:40:37.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.672+0000 7fb7b9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627807 cookie 94739792184496 notifier 5711 bl.length()=165 2024-09-12T17:40:37.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.673+0000 7fb78dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:37.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.675+0000 7fb8d9220800 20 remove_watcher() i=0 2024-09-12T17:40:37.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.675+0000 7fb8d9220800 2 removed watcher, disabling cache 2024-09-12T17:40:37.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.676+0000 7fb8d9220800 20 remove_watcher() i=1 2024-09-12T17:40:37.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.677+0000 7fb8d9220800 20 remove_watcher() i=2 2024-09-12T17:40:37.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.678+0000 7fb8d9220800 20 remove_watcher() i=3 2024-09-12T17:40:37.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.679+0000 7fb8d9220800 20 remove_watcher() i=4 2024-09-12T17:40:37.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.680+0000 7fb8d9220800 20 remove_watcher() i=5 2024-09-12T17:40:37.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.681+0000 7fb8d9220800 20 remove_watcher() i=6 2024-09-12T17:40:37.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:40:37.682+0000 7fb8d9220800 20 remove_watcher() i=7 2024-09-12T17:40:37.694 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T17:40:37.694 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:40:37.770 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:40:37.781 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:40:37.781 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:40:37.781 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:40:37.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:40:37.811 INFO:teuthology.orchestra.run.smithi044.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:40:37.812 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:40:37.881 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:40:37.881 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:40:37.951 INFO:tasks.workunit:timeout=3h 2024-09-12T17:40:37.951 INFO:tasks.workunit:cleanup=True 2024-09-12T17:40:37.951 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:40:38.022 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:41:38.664 INFO:tasks.workunit.client.0.smithi044.stderr:Updating files: 91% (11570/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:41:39.479 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:41:39.480 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:39.480 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:41:39.480 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:41:39.480 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:41:39.480 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:39.480 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:41:39.480 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:41:39.480 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:39.480 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2024-09-12T17:41:39.480 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:39.480 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2024-09-12T17:41:39.481 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:39.481 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2024-09-12T17:41:39.481 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:39.481 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:41:39.481 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:39.481 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:41:39.485 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:41:39.554 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:41:39.556 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:41:39.556 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:41:39.608 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:41:39.658 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:41:39.698 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:41:39.700 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:41:39.700 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:41:39.740 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:41:39.743 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:41:39.743 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:41:39.815 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T17:41:39.816 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T17:41:39.816 DEBUG:teuthology.orchestra.run.smithi044:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:41:39.890 INFO:tasks.workunit.client.0.smithi044.stderr:+ ulimit -c 0 2024-09-12T17:41:39.891 INFO:tasks.workunit.client.0.smithi044.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:41:39.891 INFO:tasks.workunit.client.0.smithi044.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:41:39.891 INFO:tasks.workunit.client.0.smithi044.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:41:42.495 INFO:tasks.workunit.client.0.smithi044.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:41:42.496 INFO:tasks.workunit.client.0.smithi044.stderr:++ deactivate nondestructive 2024-09-12T17:41:42.496 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2024-09-12T17:41:42.496 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2024-09-12T17:41:42.496 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:41:42.496 INFO:tasks.workunit.client.0.smithi044.stderr:++ hash -r 2024-09-12T17:41:42.496 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2024-09-12T17:41:42.496 INFO:tasks.workunit.client.0.smithi044.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:41:42.496 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:41:42.496 INFO:tasks.workunit.client.0.smithi044.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:41:42.496 INFO:tasks.workunit.client.0.smithi044.stderr:++ export VIRTUAL_ENV 2024-09-12T17:41:42.496 INFO:tasks.workunit.client.0.smithi044.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:41:42.499 INFO:tasks.workunit.client.0.smithi044.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:41:42.499 INFO:tasks.workunit.client.0.smithi044.stderr:++ export PATH 2024-09-12T17:41:42.500 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2024-09-12T17:41:42.500 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -z '' ']' 2024-09-12T17:41:42.500 INFO:tasks.workunit.client.0.smithi044.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:41:42.500 INFO:tasks.workunit.client.0.smithi044.stderr:++ PS1='(rgw) ' 2024-09-12T17:41:42.500 INFO:tasks.workunit.client.0.smithi044.stderr:++ export PS1 2024-09-12T17:41:42.500 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:41:42.500 INFO:tasks.workunit.client.0.smithi044.stderr:++ hash -r 2024-09-12T17:41:42.500 INFO:tasks.workunit.client.0.smithi044.stderr:+ pip install pip --upgrade 2024-09-12T17:41:42.735 INFO:tasks.workunit.client.0.smithi044.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:41:42.929 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting pip 2024-09-12T17:41:42.935 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:41:42.982 INFO:tasks.workunit.client.0.smithi044.stdout:Installing collected packages: pip 2024-09-12T17:41:42.982 INFO:tasks.workunit.client.0.smithi044.stdout: Attempting uninstall: pip 2024-09-12T17:41:42.982 INFO:tasks.workunit.client.0.smithi044.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:41:43.152 INFO:tasks.workunit.client.0.smithi044.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:41:43.157 INFO:tasks.workunit.client.0.smithi044.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:41:43.933 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully installed pip-24.2 2024-09-12T17:41:43.982 INFO:tasks.workunit.client.0.smithi044.stderr:+ pip install boto3 2024-09-12T17:41:44.786 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting boto3 2024-09-12T17:41:44.787 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:41:45.341 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:41:45.342 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:41:45.385 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:41:45.458 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:41:45.458 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:41:45.458 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:41:45.484 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:41:45.487 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:41:45.561 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:41:45.563 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:41:45.713 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:41:45.714 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:41:45.718 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:41:45.720 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:41:45.729 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:41:45.730 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:41:45.732 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:41:45.733 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:41:45.734 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:41:45.811 INFO:tasks.workunit.client.0.smithi044.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:41:46.877 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:41:46.995 INFO:tasks.workunit.client.0.smithi044.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T17:41:47.123 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T17:41:47.158 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:47.159 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:47.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.198+0000 7f3f80f17800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.200+0000 7f3f80f17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.200+0000 7f3f80f17800 20 realm 2024-09-12T17:41:47.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.200+0000 7f3f80f17800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.200+0000 7f3f80f17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.200+0000 7f3f80f17800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:47.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.200+0000 7f3f80f17800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.200+0000 7f3f80f17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.200+0000 7f3f80f17800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.201+0000 7f3f80f17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:47.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.201+0000 7f3f80f17800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.201+0000 7f3f80f17800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:47.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.202+0000 7f3f80f17800 20 searching for the correct realm 2024-09-12T17:41:47.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.206+0000 7f3f7f202640 0 -- 172.21.15.44:0/859293297 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x55cc5fc46210 msgr2=0x55cc5fc486a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:47.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.209+0000 7f3f7e200640 0 -- 172.21.15.44:0/859293297 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f3f70029040 msgr2=0x7f3f70041700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:47.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.214+0000 7f3f80f17800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:47.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.214+0000 7f3f80f17800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:47.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.214+0000 7f3f80f17800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:47.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.214+0000 7f3f80f17800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:47.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.214+0000 7f3f80f17800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:47.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.214+0000 7f3f80f17800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:47.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.214+0000 7f3f80f17800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.215+0000 7f3f80f17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.215+0000 7f3f80f17800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.215+0000 7f3f80f17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:47.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.215+0000 7f3f80f17800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.215+0000 7f3f80f17800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:47.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.215+0000 7f3f80f17800 20 zone default found 2024-09-12T17:41:47.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.215+0000 7f3f80f17800 4 Realm: () 2024-09-12T17:41:47.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.215+0000 7f3f80f17800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:47.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.215+0000 7f3f80f17800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:47.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.215+0000 7f3f80f17800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:47.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.215+0000 7f3f80f17800 20 zonegroup default 2024-09-12T17:41:47.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.215+0000 7f3f80f17800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.216+0000 7f3f80f17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.216+0000 7f3f80f17800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.216+0000 7f3f80f17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.216+0000 7f3f80f17800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.216+0000 7f3f80f17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.216+0000 7f3f80f17800 20 started sync module instance, tier type = 2024-09-12T17:41:47.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.216+0000 7f3f80f17800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:47.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.226+0000 7f3f80f17800 20 add_watcher() i=0 2024-09-12T17:41:47.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.226+0000 7f3f80f17800 20 add_watcher() i=1 2024-09-12T17:41:47.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.226+0000 7f3f80f17800 20 add_watcher() i=2 2024-09-12T17:41:47.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.226+0000 7f3f80f17800 20 add_watcher() i=3 2024-09-12T17:41:47.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.226+0000 7f3f80f17800 20 add_watcher() i=4 2024-09-12T17:41:47.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.226+0000 7f3f80f17800 20 add_watcher() i=5 2024-09-12T17:41:47.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.226+0000 7f3f80f17800 20 add_watcher() i=6 2024-09-12T17:41:47.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.227+0000 7f3f80f17800 20 add_watcher() i=7 2024-09-12T17:41:47.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.227+0000 7f3f80f17800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:47.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.229+0000 7f3e357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:47.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.229+0000 7f3f80f17800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:47.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.229+0000 7f3f80f17800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:47.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.229+0000 7f3f80f17800 5 note: GC not initialized 2024-09-12T17:41:47.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.229+0000 7f3daffff640 20 reqs_thread_entry: start 2024-09-12T17:41:47.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.229+0000 7f3f80f17800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:47.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.229+0000 7f3f80f17800 20 Filter name: none 2024-09-12T17:41:47.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.229+0000 7f3dadffb640 20 reqs_thread_entry: start 2024-09-12T17:41:47.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.230+0000 7f3f80f17800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T17:41:47.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.230+0000 7f3f80f17800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.230+0000 7f3f80f17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.230+0000 7f3f80f17800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T17:41:47.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.230+0000 7f3f80f17800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T17:41:47.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.230+0000 7f3f80f17800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T17:41:47.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.230+0000 7f3f80f17800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.230+0000 7f3f80f17800 20 rados_obj.operate() r=0 bl.length=22 2024-09-12T17:41:47.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.230+0000 7f3f80f17800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-12T17:41:47.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.230+0000 7f3f80f17800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:41:47.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.230+0000 7f3f80f17800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-12T17:41:47.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.230+0000 7f3f80f17800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.231+0000 7f3f80f17800 20 rados_obj.operate() r=0 bl.length=420 2024-09-12T17:41:47.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.231+0000 7f3f80f17800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-12T17:41:47.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.231+0000 7f3f80f17800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-12T17:41:47.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.231+0000 7f3f80f17800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:47.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.231+0000 7f3f80f17800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-12T17:41:47.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.231+0000 7f3f80f17800 20 get_user_info_from_index found 0 xattrs 2024-09-12T17:41:47.233 INFO:tasks.workunit.client.0.smithi044.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-12T17:41:47.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.232+0000 7f3e357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:47.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.234+0000 7f3f80f17800 20 remove_watcher() i=0 2024-09-12T17:41:47.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.234+0000 7f3f80f17800 2 removed watcher, disabling cache 2024-09-12T17:41:47.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.235+0000 7f3f80f17800 20 remove_watcher() i=1 2024-09-12T17:41:47.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.237+0000 7f3f80f17800 20 remove_watcher() i=2 2024-09-12T17:41:47.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.238+0000 7f3f80f17800 20 remove_watcher() i=3 2024-09-12T17:41:47.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.239+0000 7f3f80f17800 20 remove_watcher() i=4 2024-09-12T17:41:47.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.240+0000 7f3f80f17800 20 remove_watcher() i=5 2024-09-12T17:41:47.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.241+0000 7f3f80f17800 20 remove_watcher() i=6 2024-09-12T17:41:47.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.242+0000 7f3f80f17800 20 remove_watcher() i=7 2024-09-12T17:41:47.480 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard add 2024-09-12T17:41:47.480 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:47.481 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:41:47.511 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:47.511 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:47.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.551+0000 7f82f1322800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.553+0000 7f82f1322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.553+0000 7f82f1322800 20 realm 2024-09-12T17:41:47.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.553+0000 7f82f1322800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.553+0000 7f82f1322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.553+0000 7f82f1322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:47.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.553+0000 7f82f1322800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.553+0000 7f82f1322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.553+0000 7f82f1322800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.554+0000 7f82f1322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:47.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.554+0000 7f82f1322800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.554+0000 7f82f1322800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:47.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.554+0000 7f82f1322800 20 searching for the correct realm 2024-09-12T17:41:47.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.558+0000 7f82ec867640 0 -- 172.21.15.44:0/949108630 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55c196dcf650 msgr2=0x55c196dd1a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:47.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.562+0000 7f82ed068640 0 -- 172.21.15.44:0/949108630 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f82e406b050 msgr2=0x7f82e4094840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:47.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.768+0000 7f82f1322800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:47.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.768+0000 7f82f1322800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:47.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.768+0000 7f82f1322800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:47.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.768+0000 7f82f1322800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:47.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.768+0000 7f82f1322800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:47.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.768+0000 7f82f1322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:47.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.768+0000 7f82f1322800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.769+0000 7f82f1322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.769+0000 7f82f1322800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.769+0000 7f82f1322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:47.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.769+0000 7f82f1322800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.769+0000 7f82f1322800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:47.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.769+0000 7f82f1322800 20 zone default found 2024-09-12T17:41:47.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.769+0000 7f82f1322800 4 Realm: () 2024-09-12T17:41:47.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.769+0000 7f82f1322800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:47.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.769+0000 7f82f1322800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:47.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.769+0000 7f82f1322800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:47.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.769+0000 7f82f1322800 20 zonegroup default 2024-09-12T17:41:47.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.769+0000 7f82f1322800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.770+0000 7f82f1322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.770+0000 7f82f1322800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.770+0000 7f82f1322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.770+0000 7f82f1322800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.771+0000 7f82f1322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.771+0000 7f82f1322800 20 started sync module instance, tier type = 2024-09-12T17:41:47.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.771+0000 7f82f1322800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:47.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.781+0000 7f82f1322800 20 add_watcher() i=0 2024-09-12T17:41:47.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.781+0000 7f82f1322800 20 add_watcher() i=1 2024-09-12T17:41:47.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.781+0000 7f82f1322800 20 add_watcher() i=2 2024-09-12T17:41:47.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.781+0000 7f82f1322800 20 add_watcher() i=3 2024-09-12T17:41:47.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.781+0000 7f82f1322800 20 add_watcher() i=4 2024-09-12T17:41:47.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.781+0000 7f82f1322800 20 add_watcher() i=5 2024-09-12T17:41:47.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.781+0000 7f82f1322800 20 add_watcher() i=6 2024-09-12T17:41:47.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.782+0000 7f82f1322800 20 add_watcher() i=7 2024-09-12T17:41:47.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.782+0000 7f82f1322800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:47.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.784+0000 7f81a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:47.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.784+0000 7f82f1322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:47.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.784+0000 7f82f1322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:47.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.784+0000 7f82f1322800 5 note: GC not initialized 2024-09-12T17:41:47.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.784+0000 7f81a27e4640 20 reqs_thread_entry: start 2024-09-12T17:41:47.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.784+0000 7f82f1322800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:47.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.785+0000 7f82f1322800 20 Filter name: none 2024-09-12T17:41:47.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.785+0000 7f8113fff640 20 reqs_thread_entry: start 2024-09-12T17:41:47.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.785+0000 7f82f1322800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.785+0000 7f82f1322800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:47.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.785+0000 7f82f1322800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.786+0000 7f82f1322800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:47.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.786+0000 7f82f1322800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:47.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.786+0000 7f82f1322800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.787+0000 7f82f1322800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:47.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.787+0000 7f82f1322800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.787+0000 7f82f1322800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:47.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.787+0000 7f82f1322800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:47.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.789+0000 7f81a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:47.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.791+0000 7f82f1322800 20 remove_watcher() i=0 2024-09-12T17:41:47.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.791+0000 7f82f1322800 2 removed watcher, disabling cache 2024-09-12T17:41:47.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.793+0000 7f82f1322800 20 remove_watcher() i=1 2024-09-12T17:41:47.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.794+0000 7f82f1322800 20 remove_watcher() i=2 2024-09-12T17:41:47.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.795+0000 7f82f1322800 20 remove_watcher() i=3 2024-09-12T17:41:47.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.796+0000 7f82f1322800 20 remove_watcher() i=4 2024-09-12T17:41:47.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.797+0000 7f82f1322800 20 remove_watcher() i=5 2024-09-12T17:41:47.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.798+0000 7f82f1322800 20 remove_watcher() i=6 2024-09-12T17:41:47.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.800+0000 7f82f1322800 20 remove_watcher() i=7 2024-09-12T17:41:47.865 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:47.865 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:41:47.865 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: a-bucket id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T17:41:47.865 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:47.865 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-12T17:41:47.865 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:47.866 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:47.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.884+0000 7f5dfbb44800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.885+0000 7f5dfbb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.885+0000 7f5dfbb44800 20 realm 2024-09-12T17:41:47.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.885+0000 7f5dfbb44800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.885+0000 7f5dfbb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.885+0000 7f5dfbb44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:47.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.885+0000 7f5dfbb44800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.885+0000 7f5dfbb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:47.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.885+0000 7f5dfbb44800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.886+0000 7f5dfbb44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:47.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.886+0000 7f5dfbb44800 20 rados->read ofs=0 len=0 2024-09-12T17:41:47.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.886+0000 7f5dfbb44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:47.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.886+0000 7f5dfbb44800 20 searching for the correct realm 2024-09-12T17:41:47.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:47.891+0000 7f5df80f5640 0 -- 172.21.15.44:0/1551267101 >> [v2:172.21.15.181:6810/2228110208,v1:172.21.15.181:6811/2228110208] conn(0x7f5dec076040 msgr2=0x7f5dec081930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:48.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.098+0000 7f5df78f4640 0 -- 172.21.15.44:0/1551267101 >> [v2:172.21.15.181:6826/1273321942,v1:172.21.15.181:6827/1273321942] conn(0x56473fd05190 msgr2=0x56473fd075c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:48.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.101+0000 7f5dfbb44800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:48.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.101+0000 7f5dfbb44800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:48.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.101+0000 7f5dfbb44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:48.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.101+0000 7f5dfbb44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:48.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.101+0000 7f5dfbb44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:48.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.101+0000 7f5dfbb44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:48.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.101+0000 7f5dfbb44800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.101+0000 7f5dfbb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.101+0000 7f5dfbb44800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.102+0000 7f5dfbb44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:48.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.102+0000 7f5dfbb44800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.102+0000 7f5dfbb44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:48.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.102+0000 7f5dfbb44800 20 zone default found 2024-09-12T17:41:48.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.102+0000 7f5dfbb44800 4 Realm: () 2024-09-12T17:41:48.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.102+0000 7f5dfbb44800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:48.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.102+0000 7f5dfbb44800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:48.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.102+0000 7f5dfbb44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:48.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.102+0000 7f5dfbb44800 20 zonegroup default 2024-09-12T17:41:48.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.102+0000 7f5dfbb44800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.102+0000 7f5dfbb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.102+0000 7f5dfbb44800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.103+0000 7f5dfbb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.103+0000 7f5dfbb44800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.103+0000 7f5dfbb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.103+0000 7f5dfbb44800 20 started sync module instance, tier type = 2024-09-12T17:41:48.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.103+0000 7f5dfbb44800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:48.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.113+0000 7f5dfbb44800 20 add_watcher() i=0 2024-09-12T17:41:48.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.113+0000 7f5dfbb44800 20 add_watcher() i=1 2024-09-12T17:41:48.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.113+0000 7f5dfbb44800 20 add_watcher() i=2 2024-09-12T17:41:48.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.113+0000 7f5dfbb44800 20 add_watcher() i=3 2024-09-12T17:41:48.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.113+0000 7f5dfbb44800 20 add_watcher() i=4 2024-09-12T17:41:48.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.113+0000 7f5dfbb44800 20 add_watcher() i=5 2024-09-12T17:41:48.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.113+0000 7f5dfbb44800 20 add_watcher() i=6 2024-09-12T17:41:48.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.114+0000 7f5dfbb44800 20 add_watcher() i=7 2024-09-12T17:41:48.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.114+0000 7f5dfbb44800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:48.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.116+0000 7f5cadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:48.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.116+0000 7f5dfbb44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:48.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.116+0000 7f5dfbb44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:48.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.116+0000 7f5dfbb44800 5 note: GC not initialized 2024-09-12T17:41:48.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.116+0000 7f5cacfe1640 20 reqs_thread_entry: start 2024-09-12T17:41:48.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.117+0000 7f5dfbb44800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:48.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.117+0000 7f5dfbb44800 20 Filter name: none 2024-09-12T17:41:48.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.117+0000 7f5c267fc640 20 reqs_thread_entry: start 2024-09-12T17:41:48.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.117+0000 7f5dfbb44800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:41:48.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.117+0000 7f5dfbb44800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.117+0000 7f5dfbb44800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:48.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.117+0000 7f5dfbb44800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:41:48.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.117+0000 7f5dfbb44800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:41:48.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.117+0000 7f5dfbb44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:41:48.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.117+0000 7f5dfbb44800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.118+0000 7f5dfbb44800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:48.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.118+0000 7f5dfbb44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:41:48.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.118+0000 7f5dfbb44800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:41:48.121 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.118+0000 7f5dfbb44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:48.121 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.118+0000 7f5dfbb44800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:48.121 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.118+0000 7f5dfbb44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:41:48.121 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.120+0000 7f5cadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:48.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.123+0000 7f5dfbb44800 20 remove_watcher() i=0 2024-09-12T17:41:48.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.123+0000 7f5dfbb44800 2 removed watcher, disabling cache 2024-09-12T17:41:48.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.124+0000 7f5dfbb44800 20 remove_watcher() i=1 2024-09-12T17:41:48.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.125+0000 7f5dfbb44800 20 remove_watcher() i=2 2024-09-12T17:41:48.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.126+0000 7f5dfbb44800 20 remove_watcher() i=3 2024-09-12T17:41:48.129 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.127+0000 7f5dfbb44800 20 remove_watcher() i=4 2024-09-12T17:41:48.129 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.128+0000 7f5dfbb44800 20 remove_watcher() i=5 2024-09-12T17:41:48.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.129+0000 7f5dfbb44800 20 remove_watcher() i=6 2024-09-12T17:41:48.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.130+0000 7f5dfbb44800 20 remove_watcher() i=7 2024-09-12T17:41:48.144 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshard list 2024-09-12T17:41:48.171 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:48.172 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:48.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.210+0000 7f3af3210800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.211+0000 7f3af3210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.211+0000 7f3af3210800 20 realm 2024-09-12T17:41:48.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.211+0000 7f3af3210800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.212+0000 7f3af3210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.212+0000 7f3af3210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:48.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.212+0000 7f3af3210800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.212+0000 7f3af3210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.212+0000 7f3af3210800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.213+0000 7f3af3210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:48.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.213+0000 7f3af3210800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.213+0000 7f3af3210800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:48.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.213+0000 7f3af3210800 20 searching for the correct realm 2024-09-12T17:41:48.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.217+0000 7f3ae7fff640 0 -- 172.21.15.44:0/4097392924 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f3ae007d070 msgr2=0x7f3ae008f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:48.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.221+0000 7f3aef1bd640 0 -- 172.21.15.44:0/4097392924 >> [v2:172.21.15.181:6810/2228110208,v1:172.21.15.181:6811/2228110208] conn(0x7f3ad8068c20 msgr2=0x7f3ad809f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:48.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.225+0000 7f3af3210800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:48.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.225+0000 7f3af3210800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:48.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.225+0000 7f3af3210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:48.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.225+0000 7f3af3210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:48.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.225+0000 7f3af3210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:48.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.225+0000 7f3af3210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:48.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.225+0000 7f3af3210800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.225+0000 7f3af3210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.225+0000 7f3af3210800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.226+0000 7f3af3210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:48.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.226+0000 7f3af3210800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.226+0000 7f3af3210800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:48.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.226+0000 7f3af3210800 20 zone default found 2024-09-12T17:41:48.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.226+0000 7f3af3210800 4 Realm: () 2024-09-12T17:41:48.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.226+0000 7f3af3210800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:48.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.226+0000 7f3af3210800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:48.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.226+0000 7f3af3210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:48.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.226+0000 7f3af3210800 20 zonegroup default 2024-09-12T17:41:48.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.226+0000 7f3af3210800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.226+0000 7f3af3210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.227+0000 7f3af3210800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.227+0000 7f3af3210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.227+0000 7f3af3210800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.227+0000 7f3af3210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.227+0000 7f3af3210800 20 started sync module instance, tier type = 2024-09-12T17:41:48.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.227+0000 7f3af3210800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:48.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.237+0000 7f3af3210800 20 add_watcher() i=0 2024-09-12T17:41:48.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.237+0000 7f3af3210800 20 add_watcher() i=1 2024-09-12T17:41:48.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.237+0000 7f3af3210800 20 add_watcher() i=2 2024-09-12T17:41:48.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.237+0000 7f3af3210800 20 add_watcher() i=3 2024-09-12T17:41:48.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.237+0000 7f3af3210800 20 add_watcher() i=4 2024-09-12T17:41:48.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.237+0000 7f3af3210800 20 add_watcher() i=5 2024-09-12T17:41:48.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.237+0000 7f3af3210800 20 add_watcher() i=6 2024-09-12T17:41:48.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.238+0000 7f3af3210800 20 add_watcher() i=7 2024-09-12T17:41:48.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.238+0000 7f3af3210800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:48.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.239+0000 7f39a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:48.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.240+0000 7f3af3210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:48.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.240+0000 7f3af3210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:48.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.240+0000 7f3af3210800 5 note: GC not initialized 2024-09-12T17:41:48.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.240+0000 7f391ffff640 20 reqs_thread_entry: start 2024-09-12T17:41:48.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.240+0000 7f3af3210800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:48.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.240+0000 7f3af3210800 20 Filter name: none 2024-09-12T17:41:48.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.240+0000 7f391dffb640 20 reqs_thread_entry: start 2024-09-12T17:41:48.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.247+0000 7f39a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:48.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.250+0000 7f3af3210800 20 remove_watcher() i=0 2024-09-12T17:41:48.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.250+0000 7f3af3210800 2 removed watcher, disabling cache 2024-09-12T17:41:48.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.251+0000 7f3af3210800 20 remove_watcher() i=1 2024-09-12T17:41:48.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.252+0000 7f3af3210800 20 remove_watcher() i=2 2024-09-12T17:41:48.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.253+0000 7f3af3210800 20 remove_watcher() i=3 2024-09-12T17:41:48.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.254+0000 7f3af3210800 20 remove_watcher() i=4 2024-09-12T17:41:48.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.255+0000 7f3af3210800 20 remove_watcher() i=5 2024-09-12T17:41:48.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.256+0000 7f3af3210800 20 remove_watcher() i=6 2024-09-12T17:41:48.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.257+0000 7f3af3210800 20 remove_watcher() i=7 2024-09-12T17:41:48.269 INFO:tasks.workunit.client.0.smithi044.stderr:bucket name a-bucket 2024-09-12T17:41:48.270 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard process 2024-09-12T17:41:48.270 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:48.271 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshard process 2024-09-12T17:41:48.298 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:48.298 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:48.337 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.336+0000 7f81bab39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.337+0000 7f81bab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.337+0000 7f81bab39800 20 realm 2024-09-12T17:41:48.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.337+0000 7f81bab39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.337+0000 7f81bab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.337+0000 7f81bab39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:48.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.337+0000 7f81bab39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.337+0000 7f81bab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.337+0000 7f81bab39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.338+0000 7f81bab39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:48.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.338+0000 7f81bab39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.338+0000 7f81bab39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:48.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.339+0000 7f81bab39800 20 searching for the correct realm 2024-09-12T17:41:48.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.342+0000 7f81b6fc8640 0 -- 172.21.15.44:0/2164901331 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f81ac027040 msgr2=0x7f81ac0289c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:48.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.346+0000 7f81b67c7640 0 -- 172.21.15.44:0/2164901331 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f81ac026410 msgr2=0x7f81ac026890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:48.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.553+0000 7f81bab39800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:48.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.553+0000 7f81bab39800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:48.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.553+0000 7f81bab39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:48.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.553+0000 7f81bab39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:48.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.553+0000 7f81bab39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:48.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.553+0000 7f81bab39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:48.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.553+0000 7f81bab39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.554+0000 7f81bab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.554+0000 7f81bab39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.554+0000 7f81bab39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:48.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.554+0000 7f81bab39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.554+0000 7f81bab39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:48.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.554+0000 7f81bab39800 20 zone default found 2024-09-12T17:41:48.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.554+0000 7f81bab39800 4 Realm: () 2024-09-12T17:41:48.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.554+0000 7f81bab39800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:48.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.554+0000 7f81bab39800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:48.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.554+0000 7f81bab39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:48.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.554+0000 7f81bab39800 20 zonegroup default 2024-09-12T17:41:48.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.554+0000 7f81bab39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.555+0000 7f81bab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.555+0000 7f81bab39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.555+0000 7f81bab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.555+0000 7f81bab39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.555+0000 7f81bab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:48.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.555+0000 7f81bab39800 20 started sync module instance, tier type = 2024-09-12T17:41:48.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.555+0000 7f81bab39800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:48.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.566+0000 7f81bab39800 20 add_watcher() i=0 2024-09-12T17:41:48.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.566+0000 7f81bab39800 20 add_watcher() i=1 2024-09-12T17:41:48.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.566+0000 7f81bab39800 20 add_watcher() i=2 2024-09-12T17:41:48.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.566+0000 7f81bab39800 20 add_watcher() i=3 2024-09-12T17:41:48.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.566+0000 7f81bab39800 20 add_watcher() i=4 2024-09-12T17:41:48.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.566+0000 7f81bab39800 20 add_watcher() i=5 2024-09-12T17:41:48.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.566+0000 7f81bab39800 20 add_watcher() i=6 2024-09-12T17:41:48.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.567+0000 7f81bab39800 20 add_watcher() i=7 2024-09-12T17:41:48.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.567+0000 7f81bab39800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:48.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.569+0000 7f806cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:48.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.569+0000 7f81bab39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:48.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.569+0000 7f81bab39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:48.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.569+0000 7f81bab39800 5 note: GC not initialized 2024-09-12T17:41:48.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.569+0000 7f7fe77fe640 20 reqs_thread_entry: start 2024-09-12T17:41:48.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.569+0000 7f81bab39800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:48.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.569+0000 7f81bab39800 20 Filter name: none 2024-09-12T17:41:48.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.570+0000 7f7fe57fa640 20 reqs_thread_entry: start 2024-09-12T17:41:48.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.570+0000 7f81bab39800 20 processing logshard = reshard.0000000000 2024-09-12T17:41:48.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.572+0000 7f81bab39800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:41:48.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.572+0000 7f81bab39800 20 processing logshard = reshard.0000000001 2024-09-12T17:41:48.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.575+0000 7f81bab39800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:41:48.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.575+0000 7f81bab39800 20 processing logshard = reshard.0000000002 2024-09-12T17:41:48.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.577+0000 7f81bab39800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:41:48.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.577+0000 7f81bab39800 20 processing logshard = reshard.0000000003 2024-09-12T17:41:48.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.580+0000 7f81bab39800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:41:48.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.580+0000 7f81bab39800 20 processing logshard = reshard.0000000004 2024-09-12T17:41:48.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.583+0000 7f81bab39800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:41:48.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.583+0000 7f81bab39800 20 processing logshard = reshard.0000000005 2024-09-12T17:41:48.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.585+0000 7f81bab39800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:41:48.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.585+0000 7f81bab39800 20 processing logshard = reshard.0000000006 2024-09-12T17:41:48.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.587+0000 7f81bab39800 20 process_entry resharding a-bucket 2024-09-12T17:41:48.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.587+0000 7f81bab39800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:41:48.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.587+0000 7f81bab39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.587+0000 7f81bab39800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:48.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.587+0000 7f81bab39800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:41:48.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.587+0000 7f81bab39800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:41:48.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.587+0000 7f81bab39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:41:48.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.587+0000 7f81bab39800 20 rados->read ofs=0 len=0 2024-09-12T17:41:48.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.588+0000 7f81bab39800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:48.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.588+0000 7f81bab39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:41:48.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.588+0000 7f81bab39800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:41:48.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.588+0000 7f81bab39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:48.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.588+0000 7f81bab39800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:48.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.588+0000 7f81bab39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:41:48.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.594+0000 7f81bab39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:41:48.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.594+0000 7f81bab39800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:41:48.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.594+0000 7f81bab39800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:48.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.594+0000 7f81bab39800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:41:48.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.594+0000 7f80997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562403 cookie 94657364195648 notifier 6171 bl.length()=911 2024-09-12T17:41:48.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.594+0000 7f80997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:41:48.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.594+0000 7f80997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:41:48.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.594+0000 7f80997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:48.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.595+0000 7f81bab39800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:41:48.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.595+0000 7f81bab39800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:41:48.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.595+0000 7f81bab39800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:41:48.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.595+0000 7f81bab39800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:41:48.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.0 2024-09-12T17:41:48.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.0 2024-09-12T17:41:48.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.1 2024-09-12T17:41:48.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.1 2024-09-12T17:41:48.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.2 2024-09-12T17:41:48.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.2 2024-09-12T17:41:48.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.3 2024-09-12T17:41:48.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.3 2024-09-12T17:41:48.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.4 2024-09-12T17:41:48.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.4 2024-09-12T17:41:48.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.5 2024-09-12T17:41:48.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.5 2024-09-12T17:41:48.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.6 2024-09-12T17:41:48.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.6 2024-09-12T17:41:48.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.7 2024-09-12T17:41:48.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.7 2024-09-12T17:41:48.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.8 2024-09-12T17:41:48.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.8 2024-09-12T17:41:48.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.9 2024-09-12T17:41:48.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.9 2024-09-12T17:41:48.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.10 2024-09-12T17:41:48.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.10 2024-09-12T17:41:48.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.11 2024-09-12T17:41:48.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.11 2024-09-12T17:41:48.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.599+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.0 2024-09-12T17:41:48.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.600+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1 2024-09-12T17:41:48.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.600+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2 2024-09-12T17:41:48.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.601+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3 2024-09-12T17:41:48.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.601+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.4 2024-09-12T17:41:48.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.601+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.5 2024-09-12T17:41:48.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.602+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.6 2024-09-12T17:41:48.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.603+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.7 2024-09-12T17:41:48.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.603+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.8 2024-09-12T17:41:48.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.603+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.9 2024-09-12T17:41:48.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.604+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.10 2024-09-12T17:41:48.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.605+0000 7f81bab39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:48.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.605+0000 7f81bab39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:41:48.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.606+0000 7f81bab39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:41:48.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.606+0000 7f81bab39800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:41:48.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.606+0000 7f81bab39800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:48.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.606+0000 7f81bab39800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:41:48.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.607+0000 7f8099ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562404 cookie 94657364195648 notifier 6171 bl.length()=911 2024-09-12T17:41:48.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.607+0000 7f8099ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:41:48.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.607+0000 7f8099ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:41:48.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.607+0000 7f8099ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:48.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.607+0000 7f81bab39800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:41:48.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.607+0000 7f81bab39800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:41:48.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.607+0000 7f81bab39800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:41:48.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.607+0000 7f81bab39800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:41:48.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.610+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.0 2024-09-12T17:41:48.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.610+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1 2024-09-12T17:41:48.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.610+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2 2024-09-12T17:41:48.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.611+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3 2024-09-12T17:41:48.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.611+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.4 2024-09-12T17:41:48.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.611+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.5 2024-09-12T17:41:48.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.612+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.6 2024-09-12T17:41:48.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.612+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.7 2024-09-12T17:41:48.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.612+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.8 2024-09-12T17:41:48.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.613+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.9 2024-09-12T17:41:48.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.613+0000 7f81bab39800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.10 2024-09-12T17:41:48.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.613+0000 7f81bab39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:48.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.613+0000 7f81bab39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:41:48.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.615+0000 7f81bab39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:41:48.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.615+0000 7f81bab39800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:41:48.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.615+0000 7f81bab39800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:48.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.615+0000 7f81bab39800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:41:48.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.615+0000 7f80997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562405 cookie 94657364195648 notifier 6171 bl.length()=879 2024-09-12T17:41:48.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.615+0000 7f80997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:41:48.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.615+0000 7f80997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:41:48.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.615+0000 7f80997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:48.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.616+0000 7f81bab39800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:41:48.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.616+0000 7f81bab39800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:41:48.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.616+0000 7f81bab39800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:41:48.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.616+0000 7f81bab39800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:41:48.619 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.618+0000 7f81bab39800 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-12T17:41:48.620 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.619+0000 7f81bab39800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:41:48.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.621+0000 7f81bab39800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:41:48.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.621+0000 7f81bab39800 20 processing logshard = reshard.0000000007 2024-09-12T17:41:48.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.623+0000 7f81bab39800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:41:48.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.623+0000 7f81bab39800 20 processing logshard = reshard.0000000008 2024-09-12T17:41:48.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.626+0000 7f81bab39800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:41:48.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.626+0000 7f81bab39800 20 processing logshard = reshard.0000000009 2024-09-12T17:41:48.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.628+0000 7f81bab39800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:41:48.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.628+0000 7f81bab39800 20 processing logshard = reshard.0000000010 2024-09-12T17:41:48.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.631+0000 7f81bab39800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:41:48.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.631+0000 7f81bab39800 20 processing logshard = reshard.0000000011 2024-09-12T17:41:48.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.633+0000 7f81bab39800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:41:48.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.633+0000 7f81bab39800 20 processing logshard = reshard.0000000012 2024-09-12T17:41:48.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.636+0000 7f81bab39800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:41:48.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.636+0000 7f81bab39800 20 processing logshard = reshard.0000000013 2024-09-12T17:41:48.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.639+0000 7f81bab39800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:41:48.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.639+0000 7f81bab39800 20 processing logshard = reshard.0000000014 2024-09-12T17:41:48.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.642+0000 7f81bab39800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:41:48.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.642+0000 7f81bab39800 20 processing logshard = reshard.0000000015 2024-09-12T17:41:48.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.645+0000 7f81bab39800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:41:48.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.646+0000 7f806cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:48.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.648+0000 7f81bab39800 20 remove_watcher() i=0 2024-09-12T17:41:48.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.648+0000 7f81bab39800 2 removed watcher, disabling cache 2024-09-12T17:41:48.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.649+0000 7f81bab39800 20 remove_watcher() i=1 2024-09-12T17:41:48.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.650+0000 7f81bab39800 20 remove_watcher() i=2 2024-09-12T17:41:48.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.651+0000 7f81bab39800 20 remove_watcher() i=3 2024-09-12T17:41:48.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.652+0000 7f81bab39800 20 remove_watcher() i=4 2024-09-12T17:41:48.655 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.653+0000 7f81bab39800 20 remove_watcher() i=5 2024-09-12T17:41:48.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.654+0000 7f81bab39800 20 remove_watcher() i=6 2024-09-12T17:41:48.657 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:48.655+0000 7f81bab39800 20 remove_watcher() i=7 2024-09-12T17:41:53.675 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:41:53.708 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:53.708 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:53.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.752+0000 7f242c930800 20 rados->read ofs=0 len=0 2024-09-12T17:41:53.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.754+0000 7f242c930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:53.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.754+0000 7f242c930800 20 realm 2024-09-12T17:41:53.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.754+0000 7f242c930800 20 rados->read ofs=0 len=0 2024-09-12T17:41:53.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.754+0000 7f242c930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:53.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.754+0000 7f242c930800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:53.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.754+0000 7f242c930800 20 rados->read ofs=0 len=0 2024-09-12T17:41:53.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.755+0000 7f242c930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:53.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.755+0000 7f242c930800 20 rados->read ofs=0 len=0 2024-09-12T17:41:53.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.756+0000 7f242c930800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:53.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.756+0000 7f242c930800 20 rados->read ofs=0 len=0 2024-09-12T17:41:53.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.756+0000 7f242c930800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:53.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.756+0000 7f242c930800 20 searching for the correct realm 2024-09-12T17:41:53.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.759+0000 7f241feaf640 0 -- 172.21.15.44:0/4293415326 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f241806bc20 msgr2=0x7f2418067660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:53.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.763+0000 7f24286b0640 0 -- 172.21.15.44:0/4293415326 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f24100441b0 msgr2=0x7f24100249f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:53.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.972+0000 7f242c930800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:53.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.972+0000 7f242c930800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:53.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.972+0000 7f242c930800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:53.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.972+0000 7f242c930800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:53.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.972+0000 7f242c930800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:53.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.972+0000 7f242c930800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:53.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.972+0000 7f242c930800 20 rados->read ofs=0 len=0 2024-09-12T17:41:53.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.972+0000 7f242c930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:53.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.972+0000 7f242c930800 20 rados->read ofs=0 len=0 2024-09-12T17:41:53.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.973+0000 7f242c930800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:53.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.973+0000 7f242c930800 20 rados->read ofs=0 len=0 2024-09-12T17:41:53.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.973+0000 7f242c930800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:53.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.973+0000 7f242c930800 20 zone default found 2024-09-12T17:41:53.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.973+0000 7f242c930800 4 Realm: () 2024-09-12T17:41:53.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.973+0000 7f242c930800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:53.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.973+0000 7f242c930800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:53.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.973+0000 7f242c930800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:53.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.973+0000 7f242c930800 20 zonegroup default 2024-09-12T17:41:53.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.973+0000 7f242c930800 20 rados->read ofs=0 len=0 2024-09-12T17:41:53.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.973+0000 7f242c930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:53.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.973+0000 7f242c930800 20 rados->read ofs=0 len=0 2024-09-12T17:41:53.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.974+0000 7f242c930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:53.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.974+0000 7f242c930800 20 rados->read ofs=0 len=0 2024-09-12T17:41:53.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.974+0000 7f242c930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:53.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.974+0000 7f242c930800 20 started sync module instance, tier type = 2024-09-12T17:41:53.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.974+0000 7f242c930800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:53.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.986+0000 7f242c930800 20 add_watcher() i=0 2024-09-12T17:41:53.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.986+0000 7f242c930800 20 add_watcher() i=1 2024-09-12T17:41:53.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.986+0000 7f242c930800 20 add_watcher() i=2 2024-09-12T17:41:53.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.986+0000 7f242c930800 20 add_watcher() i=3 2024-09-12T17:41:53.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.986+0000 7f242c930800 20 add_watcher() i=4 2024-09-12T17:41:53.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.986+0000 7f242c930800 20 add_watcher() i=5 2024-09-12T17:41:53.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.986+0000 7f242c930800 20 add_watcher() i=6 2024-09-12T17:41:53.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.987+0000 7f242c930800 20 add_watcher() i=7 2024-09-12T17:41:53.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.987+0000 7f242c930800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:53.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.989+0000 7f22defdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:53.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.989+0000 7f242c930800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:53.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.989+0000 7f242c930800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:53.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.989+0000 7f242c930800 5 note: GC not initialized 2024-09-12T17:41:53.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.990+0000 7f22ddfdb640 20 reqs_thread_entry: start 2024-09-12T17:41:53.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.990+0000 7f242c930800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:53.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.990+0000 7f242c930800 20 Filter name: none 2024-09-12T17:41:53.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.990+0000 7f224f7fe640 20 reqs_thread_entry: start 2024-09-12T17:41:53.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.990+0000 7f242c930800 20 rados->read ofs=0 len=0 2024-09-12T17:41:53.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.991+0000 7f242c930800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:53.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.991+0000 7f242c930800 20 rados->read ofs=0 len=0 2024-09-12T17:41:53.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.992+0000 7f242c930800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:53.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.992+0000 7f242c930800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:53.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.992+0000 7f242c930800 20 rados->read ofs=0 len=0 2024-09-12T17:41:53.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.992+0000 7f242c930800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:53.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.992+0000 7f242c930800 20 rados->read ofs=0 len=0 2024-09-12T17:41:53.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.993+0000 7f242c930800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:53.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.993+0000 7f242c930800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:53.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.995+0000 7f22defdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:53.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.998+0000 7f242c930800 20 remove_watcher() i=0 2024-09-12T17:41:53.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.998+0000 7f242c930800 2 removed watcher, disabling cache 2024-09-12T17:41:54.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:53.999+0000 7f242c930800 20 remove_watcher() i=1 2024-09-12T17:41:54.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.000+0000 7f242c930800 20 remove_watcher() i=2 2024-09-12T17:41:54.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.002+0000 7f242c930800 20 remove_watcher() i=3 2024-09-12T17:41:54.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.003+0000 7f242c930800 20 remove_watcher() i=4 2024-09-12T17:41:54.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.004+0000 7f242c930800 20 remove_watcher() i=5 2024-09-12T17:41:54.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.005+0000 7f242c930800 20 remove_watcher() i=6 2024-09-12T17:41:54.008 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.007+0000 7f242c930800 20 remove_watcher() i=7 2024-09-12T17:41:54.021 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:54.021 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:41:54.021 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: a-bucket id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T17:41:54.021 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:54.021 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard add non empty bucket 2024-09-12T17:41:54.021 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:54.111 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:41:54.140 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:54.140 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:54.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.178+0000 7fa5f992e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.181+0000 7fa5f992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.181+0000 7fa5f992e800 20 realm 2024-09-12T17:41:54.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.181+0000 7fa5f992e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.181+0000 7fa5f992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.181+0000 7fa5f992e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:54.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.181+0000 7fa5f992e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.182+0000 7fa5f992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.182+0000 7fa5f992e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.182+0000 7fa5f992e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:54.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.182+0000 7fa5f992e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.183+0000 7fa5f992e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:54.185 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.183+0000 7fa5f992e800 20 searching for the correct realm 2024-09-12T17:41:54.186 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.185+0000 7fa5f556b640 0 -- 172.21.15.44:0/85536002 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7fa5f0017070 msgr2=0x7fa5f0017960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:54.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.391+0000 7fa5f5d6c640 0 -- 172.21.15.44:0/85536002 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7fa5ec04d960 msgr2=0x7fa5ec0da900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:54.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.397+0000 7fa5f992e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:54.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.397+0000 7fa5f992e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:54.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.397+0000 7fa5f992e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:54.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.397+0000 7fa5f992e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:54.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.397+0000 7fa5f992e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:54.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.397+0000 7fa5f992e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:54.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.397+0000 7fa5f992e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.397+0000 7fa5f992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.397+0000 7fa5f992e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.397+0000 7fa5f992e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:54.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.397+0000 7fa5f992e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.398+0000 7fa5f992e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.398+0000 7fa5f992e800 20 zone default found 2024-09-12T17:41:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.398+0000 7fa5f992e800 4 Realm: () 2024-09-12T17:41:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.398+0000 7fa5f992e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.398+0000 7fa5f992e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.398+0000 7fa5f992e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.398+0000 7fa5f992e800 20 zonegroup default 2024-09-12T17:41:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.398+0000 7fa5f992e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.398+0000 7fa5f992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.398+0000 7fa5f992e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.399+0000 7fa5f992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.399+0000 7fa5f992e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.399+0000 7fa5f992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.399+0000 7fa5f992e800 20 started sync module instance, tier type = 2024-09-12T17:41:54.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.399+0000 7fa5f992e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:54.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.409+0000 7fa5f992e800 20 add_watcher() i=0 2024-09-12T17:41:54.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.409+0000 7fa5f992e800 20 add_watcher() i=1 2024-09-12T17:41:54.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.409+0000 7fa5f992e800 20 add_watcher() i=2 2024-09-12T17:41:54.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.409+0000 7fa5f992e800 20 add_watcher() i=3 2024-09-12T17:41:54.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.409+0000 7fa5f992e800 20 add_watcher() i=4 2024-09-12T17:41:54.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.409+0000 7fa5f992e800 20 add_watcher() i=5 2024-09-12T17:41:54.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.409+0000 7fa5f992e800 20 add_watcher() i=6 2024-09-12T17:41:54.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.410+0000 7fa5f992e800 20 add_watcher() i=7 2024-09-12T17:41:54.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.410+0000 7fa5f992e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:54.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.412+0000 7fa4a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:54.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.412+0000 7fa5f992e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:54.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.412+0000 7fa5f992e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:54.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.412+0000 7fa5f992e800 5 note: GC not initialized 2024-09-12T17:41:54.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.413+0000 7fa4a67fc640 20 reqs_thread_entry: start 2024-09-12T17:41:54.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.413+0000 7fa5f992e800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:54.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.413+0000 7fa5f992e800 20 Filter name: none 2024-09-12T17:41:54.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.413+0000 7fa4a3fe7640 20 reqs_thread_entry: start 2024-09-12T17:41:54.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.413+0000 7fa5f992e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.414+0000 7fa5f992e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:54.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.414+0000 7fa5f992e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.414+0000 7fa5f992e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:54.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.414+0000 7fa5f992e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:54.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.414+0000 7fa5f992e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.414+0000 7fa5f992e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:54.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.414+0000 7fa5f992e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.415+0000 7fa5f992e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:54.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.415+0000 7fa5f992e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:54.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.417+0000 7fa4a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:54.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.420+0000 7fa5f992e800 20 remove_watcher() i=0 2024-09-12T17:41:54.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.420+0000 7fa5f992e800 2 removed watcher, disabling cache 2024-09-12T17:41:54.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.421+0000 7fa5f992e800 20 remove_watcher() i=1 2024-09-12T17:41:54.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.422+0000 7fa5f992e800 20 remove_watcher() i=2 2024-09-12T17:41:54.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.423+0000 7fa5f992e800 20 remove_watcher() i=3 2024-09-12T17:41:54.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.424+0000 7fa5f992e800 20 remove_watcher() i=4 2024-09-12T17:41:54.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.425+0000 7fa5f992e800 20 remove_watcher() i=5 2024-09-12T17:41:54.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.426+0000 7fa5f992e800 20 remove_watcher() i=6 2024-09-12T17:41:54.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.427+0000 7fa5f992e800 20 remove_watcher() i=7 2024-09-12T17:41:54.441 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:54.441 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:41:54.441 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: a-bucket id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-12T17:41:54.441 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:54.442 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-12T17:41:54.474 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:54.474 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:54.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.512+0000 7f8847f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.513+0000 7f8847f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.513+0000 7f8847f24800 20 realm 2024-09-12T17:41:54.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.513+0000 7f8847f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.513+0000 7f8847f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.513+0000 7f8847f24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:54.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.513+0000 7f8847f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.514+0000 7f8847f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.514+0000 7f8847f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.515+0000 7f8847f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:54.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.515+0000 7f8847f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.515+0000 7f8847f24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:54.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.515+0000 7f8847f24800 20 searching for the correct realm 2024-09-12T17:41:54.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.518+0000 7f8843301640 0 -- 172.21.15.44:0/619990471 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x557d17579330 msgr2=0x557d1757b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:54.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.522+0000 7f8843b02640 0 -- 172.21.15.44:0/619990471 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f882c08b1a0 msgr2=0x7f882c0470b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:54.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.527+0000 7f8847f24800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:54.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.527+0000 7f8847f24800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:54.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.527+0000 7f8847f24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:54.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.527+0000 7f8847f24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:54.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.527+0000 7f8847f24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:54.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.527+0000 7f8847f24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:54.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.527+0000 7f8847f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.527+0000 7f8847f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.527+0000 7f8847f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.527+0000 7f8847f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:54.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.527+0000 7f8847f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.528+0000 7f8847f24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:54.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.528+0000 7f8847f24800 20 zone default found 2024-09-12T17:41:54.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.528+0000 7f8847f24800 4 Realm: () 2024-09-12T17:41:54.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.528+0000 7f8847f24800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:54.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.528+0000 7f8847f24800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:54.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.528+0000 7f8847f24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:54.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.528+0000 7f8847f24800 20 zonegroup default 2024-09-12T17:41:54.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.528+0000 7f8847f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.528+0000 7f8847f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.528+0000 7f8847f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.528+0000 7f8847f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.528+0000 7f8847f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.529+0000 7f8847f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.529+0000 7f8847f24800 20 started sync module instance, tier type = 2024-09-12T17:41:54.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.529+0000 7f8847f24800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:54.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.539+0000 7f8847f24800 20 add_watcher() i=0 2024-09-12T17:41:54.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.539+0000 7f8847f24800 20 add_watcher() i=1 2024-09-12T17:41:54.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.539+0000 7f8847f24800 20 add_watcher() i=2 2024-09-12T17:41:54.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.539+0000 7f8847f24800 20 add_watcher() i=3 2024-09-12T17:41:54.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.539+0000 7f8847f24800 20 add_watcher() i=4 2024-09-12T17:41:54.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.539+0000 7f8847f24800 20 add_watcher() i=5 2024-09-12T17:41:54.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.539+0000 7f8847f24800 20 add_watcher() i=6 2024-09-12T17:41:54.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.540+0000 7f8847f24800 20 add_watcher() i=7 2024-09-12T17:41:54.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.540+0000 7f8847f24800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:54.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.542+0000 7f86f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:54.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.542+0000 7f8847f24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:54.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.542+0000 7f8847f24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:54.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.542+0000 7f8847f24800 5 note: GC not initialized 2024-09-12T17:41:54.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.542+0000 7f86f8fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:54.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.542+0000 7f8847f24800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:54.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.542+0000 7f8847f24800 20 Filter name: none 2024-09-12T17:41:54.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.543+0000 7f86727fc640 20 reqs_thread_entry: start 2024-09-12T17:41:54.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.543+0000 7f8847f24800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:41:54.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.543+0000 7f8847f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.543+0000 7f8847f24800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:54.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.543+0000 7f8847f24800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:41:54.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.543+0000 7f8847f24800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:41:54.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.543+0000 7f8847f24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:41:54.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.543+0000 7f8847f24800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.544+0000 7f8847f24800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:54.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.544+0000 7f8847f24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:41:54.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.544+0000 7f8847f24800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:41:54.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.544+0000 7f8847f24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:54.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.544+0000 7f8847f24800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:54.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.544+0000 7f8847f24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:41:54.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.546+0000 7f86f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:54.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.548+0000 7f8847f24800 20 remove_watcher() i=0 2024-09-12T17:41:54.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.548+0000 7f8847f24800 2 removed watcher, disabling cache 2024-09-12T17:41:54.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.549+0000 7f8847f24800 20 remove_watcher() i=1 2024-09-12T17:41:54.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.550+0000 7f8847f24800 20 remove_watcher() i=2 2024-09-12T17:41:54.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.551+0000 7f8847f24800 20 remove_watcher() i=3 2024-09-12T17:41:54.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.553+0000 7f8847f24800 20 remove_watcher() i=4 2024-09-12T17:41:54.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.554+0000 7f8847f24800 20 remove_watcher() i=5 2024-09-12T17:41:54.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.555+0000 7f8847f24800 20 remove_watcher() i=6 2024-09-12T17:41:54.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.556+0000 7f8847f24800 20 remove_watcher() i=7 2024-09-12T17:41:54.570 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshard list 2024-09-12T17:41:54.597 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:54.597 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:54.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.634+0000 7fd66aa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.636+0000 7fd66aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.636+0000 7fd66aa0e800 20 realm 2024-09-12T17:41:54.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.636+0000 7fd66aa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.636+0000 7fd66aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.636+0000 7fd66aa0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:54.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.636+0000 7fd66aa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.636+0000 7fd66aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.636+0000 7fd66aa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.637+0000 7fd66aa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:54.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.637+0000 7fd66aa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.637+0000 7fd66aa0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:54.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.637+0000 7fd66aa0e800 20 searching for the correct realm 2024-09-12T17:41:54.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.641+0000 7fd6659bb640 0 -- 172.21.15.44:0/1388225950 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x5586fc5d9320 msgr2=0x5586fc5db710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:54.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.644+0000 7fd6661bc640 0 -- 172.21.15.44:0/1388225950 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fd65c02d3e0 msgr2=0x7fd65c02d840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:54.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.851+0000 7fd66aa0e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:54.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.851+0000 7fd66aa0e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:54.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.851+0000 7fd66aa0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:54.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.851+0000 7fd66aa0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:54.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.851+0000 7fd66aa0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:54.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.851+0000 7fd66aa0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:54.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.851+0000 7fd66aa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.852+0000 7fd66aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.852+0000 7fd66aa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.852+0000 7fd66aa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:54.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.852+0000 7fd66aa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.853+0000 7fd66aa0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:54.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.853+0000 7fd66aa0e800 20 zone default found 2024-09-12T17:41:54.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.853+0000 7fd66aa0e800 4 Realm: () 2024-09-12T17:41:54.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.853+0000 7fd66aa0e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:54.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.853+0000 7fd66aa0e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:54.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.853+0000 7fd66aa0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:54.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.853+0000 7fd66aa0e800 20 zonegroup default 2024-09-12T17:41:54.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.853+0000 7fd66aa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.853+0000 7fd66aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.853+0000 7fd66aa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.853+0000 7fd66aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.853+0000 7fd66aa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.853+0000 7fd66aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.853+0000 7fd66aa0e800 20 started sync module instance, tier type = 2024-09-12T17:41:54.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.853+0000 7fd66aa0e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:54.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.863+0000 7fd66aa0e800 20 add_watcher() i=0 2024-09-12T17:41:54.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.863+0000 7fd66aa0e800 20 add_watcher() i=1 2024-09-12T17:41:54.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.863+0000 7fd66aa0e800 20 add_watcher() i=2 2024-09-12T17:41:54.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.863+0000 7fd66aa0e800 20 add_watcher() i=3 2024-09-12T17:41:54.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.863+0000 7fd66aa0e800 20 add_watcher() i=4 2024-09-12T17:41:54.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.863+0000 7fd66aa0e800 20 add_watcher() i=5 2024-09-12T17:41:54.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.863+0000 7fd66aa0e800 20 add_watcher() i=6 2024-09-12T17:41:54.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.864+0000 7fd66aa0e800 20 add_watcher() i=7 2024-09-12T17:41:54.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.864+0000 7fd66aa0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:54.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.866+0000 7fd51cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:54.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.867+0000 7fd66aa0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:54.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.867+0000 7fd66aa0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:54.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.867+0000 7fd66aa0e800 5 note: GC not initialized 2024-09-12T17:41:54.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.867+0000 7fd4977fe640 20 reqs_thread_entry: start 2024-09-12T17:41:54.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.867+0000 7fd66aa0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:54.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.867+0000 7fd66aa0e800 20 Filter name: none 2024-09-12T17:41:54.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.867+0000 7fd4957fa640 20 reqs_thread_entry: start 2024-09-12T17:41:54.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.875+0000 7fd51cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:54.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.877+0000 7fd66aa0e800 20 remove_watcher() i=0 2024-09-12T17:41:54.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.878+0000 7fd66aa0e800 2 removed watcher, disabling cache 2024-09-12T17:41:54.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.879+0000 7fd66aa0e800 20 remove_watcher() i=1 2024-09-12T17:41:54.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.880+0000 7fd66aa0e800 20 remove_watcher() i=2 2024-09-12T17:41:54.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.881+0000 7fd66aa0e800 20 remove_watcher() i=3 2024-09-12T17:41:54.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.882+0000 7fd66aa0e800 20 remove_watcher() i=4 2024-09-12T17:41:54.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.883+0000 7fd66aa0e800 20 remove_watcher() i=5 2024-09-12T17:41:54.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.884+0000 7fd66aa0e800 20 remove_watcher() i=6 2024-09-12T17:41:54.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.885+0000 7fd66aa0e800 20 remove_watcher() i=7 2024-09-12T17:41:54.898 INFO:tasks.workunit.client.0.smithi044.stderr:bucket name a-bucket 2024-09-12T17:41:54.899 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard process non empty bucket 2024-09-12T17:41:54.899 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:54.900 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshard process 2024-09-12T17:41:54.927 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:54.928 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:54.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.966+0000 7f3077f28800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.967+0000 7f3077f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.967+0000 7f3077f28800 20 realm 2024-09-12T17:41:54.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.967+0000 7f3077f28800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.967+0000 7f3077f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.967+0000 7f3077f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:54.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.967+0000 7f3077f28800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.968+0000 7f3077f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.968+0000 7f3077f28800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.969+0000 7f3077f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:54.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.969+0000 7f3077f28800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.969+0000 7f3077f28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:54.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.969+0000 7f3077f28800 20 searching for the correct realm 2024-09-12T17:41:54.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.973+0000 7f307344a640 0 -- 172.21.15.44:0/4205845976 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55f4cc74dc40 msgr2=0x55f4cc750030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:54.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.976+0000 7f3073c4b640 0 -- 172.21.15.44:0/4205845976 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f30680860e0 msgr2=0x7f306802e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:54.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.981+0000 7f3077f28800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:54.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.981+0000 7f3077f28800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:54.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.981+0000 7f3077f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:54.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.981+0000 7f3077f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:54.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.981+0000 7f3077f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:54.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.981+0000 7f3077f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:54.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.981+0000 7f3077f28800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.981+0000 7f3077f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.981+0000 7f3077f28800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.981+0000 7f3077f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:54.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.981+0000 7f3077f28800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.982+0000 7f3077f28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:54.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.982+0000 7f3077f28800 20 zone default found 2024-09-12T17:41:54.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.982+0000 7f3077f28800 4 Realm: () 2024-09-12T17:41:54.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.982+0000 7f3077f28800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:54.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.982+0000 7f3077f28800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:54.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.982+0000 7f3077f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:54.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.982+0000 7f3077f28800 20 zonegroup default 2024-09-12T17:41:54.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.982+0000 7f3077f28800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.982+0000 7f3077f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.982+0000 7f3077f28800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.982+0000 7f3077f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.982+0000 7f3077f28800 20 rados->read ofs=0 len=0 2024-09-12T17:41:54.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.982+0000 7f3077f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:54.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.982+0000 7f3077f28800 20 started sync module instance, tier type = 2024-09-12T17:41:54.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.982+0000 7f3077f28800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:54.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.992+0000 7f3077f28800 20 add_watcher() i=0 2024-09-12T17:41:54.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.992+0000 7f3077f28800 20 add_watcher() i=1 2024-09-12T17:41:54.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.992+0000 7f3077f28800 20 add_watcher() i=2 2024-09-12T17:41:54.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.992+0000 7f3077f28800 20 add_watcher() i=3 2024-09-12T17:41:54.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.992+0000 7f3077f28800 20 add_watcher() i=4 2024-09-12T17:41:54.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.992+0000 7f3077f28800 20 add_watcher() i=5 2024-09-12T17:41:54.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.992+0000 7f3077f28800 20 add_watcher() i=6 2024-09-12T17:41:54.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.993+0000 7f3077f28800 20 add_watcher() i=7 2024-09-12T17:41:54.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.993+0000 7f3077f28800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:54.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.994+0000 7f2f29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:54.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.995+0000 7f3077f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:54.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.995+0000 7f3077f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:54.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.995+0000 7f3077f28800 5 note: GC not initialized 2024-09-12T17:41:54.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.995+0000 7f2f28fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:54.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.995+0000 7f3077f28800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:54.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.995+0000 7f3077f28800 20 Filter name: none 2024-09-12T17:41:54.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.995+0000 7f2ea27fc640 20 reqs_thread_entry: start 2024-09-12T17:41:54.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.995+0000 7f3077f28800 20 processing logshard = reshard.0000000000 2024-09-12T17:41:54.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.998+0000 7f3077f28800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:41:54.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:54.998+0000 7f3077f28800 20 processing logshard = reshard.0000000001 2024-09-12T17:41:55.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.001+0000 7f3077f28800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:41:55.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.001+0000 7f3077f28800 20 processing logshard = reshard.0000000002 2024-09-12T17:41:55.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.003+0000 7f3077f28800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:41:55.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.003+0000 7f3077f28800 20 processing logshard = reshard.0000000003 2024-09-12T17:41:55.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.005+0000 7f3077f28800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:41:55.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.005+0000 7f3077f28800 20 processing logshard = reshard.0000000004 2024-09-12T17:41:55.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.008+0000 7f3077f28800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:41:55.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.008+0000 7f3077f28800 20 processing logshard = reshard.0000000005 2024-09-12T17:41:55.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.010+0000 7f3077f28800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:41:55.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.010+0000 7f3077f28800 20 processing logshard = reshard.0000000006 2024-09-12T17:41:55.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.011+0000 7f3077f28800 20 process_entry resharding a-bucket 2024-09-12T17:41:55.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.011+0000 7f3077f28800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:41:55.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.011+0000 7f3077f28800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.012+0000 7f3077f28800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:55.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.012+0000 7f3077f28800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:41:55.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.012+0000 7f3077f28800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:41:55.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.012+0000 7f3077f28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:41:55.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.012+0000 7f3077f28800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.012+0000 7f3077f28800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:55.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.012+0000 7f3077f28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:41:55.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.012+0000 7f3077f28800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:41:55.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.012+0000 7f3077f28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:55.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.012+0000 7f3077f28800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:55.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.012+0000 7f3077f28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:41:55.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.023+0000 7f3077f28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:41:55.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.023+0000 7f3077f28800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:41:55.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.023+0000 7f3077f28800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:55.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.023+0000 7f3077f28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:41:55.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.023+0000 7f2f527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562406 cookie 94509890600128 notifier 5876 bl.length()=911 2024-09-12T17:41:55.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.023+0000 7f2f527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:41:55.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.023+0000 7f2f527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:41:55.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.023+0000 7f2f527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:55.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.023+0000 7f3077f28800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:41:55.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.023+0000 7f3077f28800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:41:55.026 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.023+0000 7f3077f28800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:41:55.026 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.023+0000 7f3077f28800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:41:55.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:41:55.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:41:55.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:41:55.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:41:55.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:41:55.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:41:55.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:41:55.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:41:55.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:41:55.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:41:55.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:41:55.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:41:55.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:41:55.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:41:55.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:41:55.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:41:55.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:41:55.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:41:55.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:41:55.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:41:55.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:41:55.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:41:55.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:41:55.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:41:55.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:41:55.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:41:55.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.0 2024-09-12T17:41:55.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.0 2024-09-12T17:41:55.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.1 2024-09-12T17:41:55.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.029+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.1 2024-09-12T17:41:55.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.030+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.2 2024-09-12T17:41:55.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.030+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.2 2024-09-12T17:41:55.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.030+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.3 2024-09-12T17:41:55.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.030+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.3 2024-09-12T17:41:55.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.031+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.4 2024-09-12T17:41:55.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.031+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.4 2024-09-12T17:41:55.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.031+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.5 2024-09-12T17:41:55.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.031+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.5 2024-09-12T17:41:55.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.032+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.6 2024-09-12T17:41:55.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.032+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.6 2024-09-12T17:41:55.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.033+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.7 2024-09-12T17:41:55.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.033+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.7 2024-09-12T17:41:55.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.033+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.8 2024-09-12T17:41:55.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.033+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.8 2024-09-12T17:41:55.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.034+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.9 2024-09-12T17:41:55.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.034+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.9 2024-09-12T17:41:55.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.034+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.10 2024-09-12T17:41:55.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.034+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.10 2024-09-12T17:41:55.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.035+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.11 2024-09-12T17:41:55.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.035+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.11 2024-09-12T17:41:55.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.037+0000 7f3077f28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:55.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.037+0000 7f3077f28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:41:55.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.039+0000 7f3077f28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:41:55.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.039+0000 7f3077f28800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:41:55.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.039+0000 7f3077f28800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:55.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.039+0000 7f3077f28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:41:55.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.039+0000 7f2f527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562407 cookie 94509890600128 notifier 5876 bl.length()=911 2024-09-12T17:41:55.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.039+0000 7f2f527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:41:55.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.039+0000 7f2f527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:41:55.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.039+0000 7f2f527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:55.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.039+0000 7f3077f28800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:41:55.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.039+0000 7f3077f28800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:41:55.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.039+0000 7f3077f28800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:41:55.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.039+0000 7f3077f28800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:41:55.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.042+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.0 2024-09-12T17:41:55.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.042+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.0 2024-09-12T17:41:55.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.042+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.1 2024-09-12T17:41:55.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.042+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.1 2024-09-12T17:41:55.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.042+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.2 2024-09-12T17:41:55.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.042+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.2 2024-09-12T17:41:55.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.043+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.3 2024-09-12T17:41:55.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.043+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.3 2024-09-12T17:41:55.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.043+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.4 2024-09-12T17:41:55.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.043+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.4 2024-09-12T17:41:55.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.043+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.5 2024-09-12T17:41:55.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.043+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.5 2024-09-12T17:41:55.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.044+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.6 2024-09-12T17:41:55.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.044+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.6 2024-09-12T17:41:55.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.044+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.7 2024-09-12T17:41:55.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.044+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.7 2024-09-12T17:41:55.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.044+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.8 2024-09-12T17:41:55.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.044+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.8 2024-09-12T17:41:55.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.045+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.9 2024-09-12T17:41:55.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.045+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.9 2024-09-12T17:41:55.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.045+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.10 2024-09-12T17:41:55.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.045+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.10 2024-09-12T17:41:55.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.045+0000 7f3077f28800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.11 2024-09-12T17:41:55.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.045+0000 7f3077f28800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.1.11 2024-09-12T17:41:55.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.046+0000 7f3077f28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:55.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.046+0000 7f3077f28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:41:55.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.047+0000 7f3077f28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:41:55.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.047+0000 7f3077f28800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:41:55.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.047+0000 7f3077f28800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:55.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.047+0000 7f3077f28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:41:55.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.047+0000 7f2f527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562408 cookie 94509890600128 notifier 5876 bl.length()=879 2024-09-12T17:41:55.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.047+0000 7f2f527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:41:55.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.047+0000 7f2f527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:41:55.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.047+0000 7f2f527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:55.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.048+0000 7f3077f28800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:41:55.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.048+0000 7f3077f28800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:41:55.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.048+0000 7f3077f28800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:41:55.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.048+0000 7f3077f28800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:41:55.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.050+0000 7f3077f28800 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-12T17:41:55.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.051+0000 7f3077f28800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:41:55.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.053+0000 7f3077f28800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:41:55.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.053+0000 7f3077f28800 20 processing logshard = reshard.0000000007 2024-09-12T17:41:55.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.055+0000 7f3077f28800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:41:55.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.055+0000 7f3077f28800 20 processing logshard = reshard.0000000008 2024-09-12T17:41:55.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.057+0000 7f3077f28800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:41:55.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.057+0000 7f3077f28800 20 processing logshard = reshard.0000000009 2024-09-12T17:41:55.060 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.059+0000 7f3077f28800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:41:55.060 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.059+0000 7f3077f28800 20 processing logshard = reshard.0000000010 2024-09-12T17:41:55.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.061+0000 7f3077f28800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:41:55.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.061+0000 7f3077f28800 20 processing logshard = reshard.0000000011 2024-09-12T17:41:55.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.064+0000 7f3077f28800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:41:55.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.064+0000 7f3077f28800 20 processing logshard = reshard.0000000012 2024-09-12T17:41:55.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.066+0000 7f3077f28800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:41:55.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.066+0000 7f3077f28800 20 processing logshard = reshard.0000000013 2024-09-12T17:41:55.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.069+0000 7f3077f28800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:41:55.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.069+0000 7f3077f28800 20 processing logshard = reshard.0000000014 2024-09-12T17:41:55.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.071+0000 7f3077f28800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:41:55.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.072+0000 7f3077f28800 20 processing logshard = reshard.0000000015 2024-09-12T17:41:55.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.074+0000 7f3077f28800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:41:55.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.075+0000 7f2f29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:55.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.077+0000 7f3077f28800 20 remove_watcher() i=0 2024-09-12T17:41:55.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.077+0000 7f3077f28800 2 removed watcher, disabling cache 2024-09-12T17:41:55.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.078+0000 7f3077f28800 20 remove_watcher() i=1 2024-09-12T17:41:55.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.079+0000 7f3077f28800 20 remove_watcher() i=2 2024-09-12T17:41:55.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.080+0000 7f3077f28800 20 remove_watcher() i=3 2024-09-12T17:41:55.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.081+0000 7f3077f28800 20 remove_watcher() i=4 2024-09-12T17:41:55.083 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.082+0000 7f3077f28800 20 remove_watcher() i=5 2024-09-12T17:41:55.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.083+0000 7f3077f28800 20 remove_watcher() i=6 2024-09-12T17:41:55.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.084+0000 7f3077f28800 20 remove_watcher() i=7 2024-09-12T17:41:55.098 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:41:55.127 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:55.128 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:55.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.165+0000 7f2bb4935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.167+0000 7f2bb4935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.167+0000 7f2bb4935800 20 realm 2024-09-12T17:41:55.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.167+0000 7f2bb4935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.167+0000 7f2bb4935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.167+0000 7f2bb4935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:55.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.167+0000 7f2bb4935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.167+0000 7f2bb4935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.167+0000 7f2bb4935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.168+0000 7f2bb4935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:55.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.168+0000 7f2bb4935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.169+0000 7f2bb4935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:55.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.169+0000 7f2bb4935800 20 searching for the correct realm 2024-09-12T17:41:55.174 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.172+0000 7f2bafe20640 0 -- 172.21.15.44:0/2827519040 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x55639d419cf0 msgr2=0x55639d41c170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:55.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.176+0000 7f2bafe20640 0 -- 172.21.15.44:0/2827519040 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f2ba00bc040 msgr2=0x7f2ba00c69f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:55.181 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.179+0000 7f2bb4935800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:55.181 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.179+0000 7f2bb4935800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:55.181 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.179+0000 7f2bb4935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:55.181 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.179+0000 7f2bb4935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:55.181 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.179+0000 7f2bb4935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:55.182 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.179+0000 7f2bb4935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:55.182 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.179+0000 7f2bb4935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.182 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.180+0000 7f2bb4935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.182 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.180+0000 7f2bb4935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.182 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.180+0000 7f2bb4935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:55.182 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.180+0000 7f2bb4935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.180+0000 7f2bb4935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:55.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.180+0000 7f2bb4935800 20 zone default found 2024-09-12T17:41:55.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.180+0000 7f2bb4935800 4 Realm: () 2024-09-12T17:41:55.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.180+0000 7f2bb4935800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:55.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.180+0000 7f2bb4935800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:55.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.180+0000 7f2bb4935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:55.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.180+0000 7f2bb4935800 20 zonegroup default 2024-09-12T17:41:55.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.180+0000 7f2bb4935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.180+0000 7f2bb4935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.180+0000 7f2bb4935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.181+0000 7f2bb4935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.181+0000 7f2bb4935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.181+0000 7f2bb4935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.181+0000 7f2bb4935800 20 started sync module instance, tier type = 2024-09-12T17:41:55.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.181+0000 7f2bb4935800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:55.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.190+0000 7f2bb4935800 20 add_watcher() i=0 2024-09-12T17:41:55.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.190+0000 7f2bb4935800 20 add_watcher() i=1 2024-09-12T17:41:55.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.190+0000 7f2bb4935800 20 add_watcher() i=2 2024-09-12T17:41:55.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.190+0000 7f2bb4935800 20 add_watcher() i=3 2024-09-12T17:41:55.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.190+0000 7f2bb4935800 20 add_watcher() i=4 2024-09-12T17:41:55.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.190+0000 7f2bb4935800 20 add_watcher() i=5 2024-09-12T17:41:55.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.190+0000 7f2bb4935800 20 add_watcher() i=6 2024-09-12T17:41:55.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.193+0000 7f2bb4935800 20 add_watcher() i=7 2024-09-12T17:41:55.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.193+0000 7f2bb4935800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:55.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.194+0000 7f2a66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:55.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.194+0000 7f2bb4935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:55.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.194+0000 7f2bb4935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:55.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.194+0000 7f2bb4935800 5 note: GC not initialized 2024-09-12T17:41:55.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.195+0000 7f2a65fdb640 20 reqs_thread_entry: start 2024-09-12T17:41:55.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.195+0000 7f2bb4935800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:55.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.195+0000 7f2bb4935800 20 Filter name: none 2024-09-12T17:41:55.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.195+0000 7f29d77fe640 20 reqs_thread_entry: start 2024-09-12T17:41:55.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.195+0000 7f2bb4935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.196+0000 7f2bb4935800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:55.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.196+0000 7f2bb4935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.196+0000 7f2bb4935800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:55.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.196+0000 7f2bb4935800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:55.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.196+0000 7f2bb4935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.197+0000 7f2bb4935800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:55.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.197+0000 7f2bb4935800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.197+0000 7f2bb4935800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:55.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.197+0000 7f2bb4935800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:55.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.199+0000 7f2a66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:55.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.201+0000 7f2bb4935800 20 remove_watcher() i=0 2024-09-12T17:41:55.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.201+0000 7f2bb4935800 2 removed watcher, disabling cache 2024-09-12T17:41:55.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.202+0000 7f2bb4935800 20 remove_watcher() i=1 2024-09-12T17:41:55.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.203+0000 7f2bb4935800 20 remove_watcher() i=2 2024-09-12T17:41:55.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.204+0000 7f2bb4935800 20 remove_watcher() i=3 2024-09-12T17:41:55.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.205+0000 7f2bb4935800 20 remove_watcher() i=4 2024-09-12T17:41:55.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.206+0000 7f2bb4935800 20 remove_watcher() i=5 2024-09-12T17:41:55.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.207+0000 7f2bb4935800 20 remove_watcher() i=6 2024-09-12T17:41:55.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.208+0000 7f2bb4935800 20 remove_watcher() i=7 2024-09-12T17:41:55.222 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:55.222 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:41:55.222 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: a-bucket id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T17:41:55.222 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:55.222 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T17:41:55.222 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:55.425 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:41:55.454 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:55.454 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:55.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.492+0000 7f89c932f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.493+0000 7f89c932f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.493+0000 7f89c932f800 20 realm 2024-09-12T17:41:55.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.493+0000 7f89c932f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.493+0000 7f89c932f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.493+0000 7f89c932f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:55.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.494+0000 7f89c932f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.494+0000 7f89c932f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.494+0000 7f89c932f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.494+0000 7f89c932f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:55.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.495+0000 7f89c932f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.495+0000 7f89c932f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:55.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.495+0000 7f89c932f800 20 searching for the correct realm 2024-09-12T17:41:55.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.498+0000 7f89c581b640 0 -- 172.21.15.44:0/3872417787 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x56329fb8b5a0 msgr2=0x56329fb8da10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:55.503 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.502+0000 7f89c501a640 0 -- 172.21.15.44:0/3872417787 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f89bc064940 msgr2=0x7f89bc0873d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:55.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:55.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:55.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:55.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:55.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:55.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:55.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:55.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:55.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 20 zone default found 2024-09-12T17:41:55.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 4 Realm: () 2024-09-12T17:41:55.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:55.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:55.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:55.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 20 zonegroup default 2024-09-12T17:41:55.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.506+0000 7f89c932f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.507+0000 7f89c932f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.507+0000 7f89c932f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.507+0000 7f89c932f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.507+0000 7f89c932f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.507+0000 7f89c932f800 20 started sync module instance, tier type = 2024-09-12T17:41:55.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.507+0000 7f89c932f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:55.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.516+0000 7f89c932f800 20 add_watcher() i=0 2024-09-12T17:41:55.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.516+0000 7f89c932f800 20 add_watcher() i=1 2024-09-12T17:41:55.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.516+0000 7f89c932f800 20 add_watcher() i=2 2024-09-12T17:41:55.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.516+0000 7f89c932f800 20 add_watcher() i=3 2024-09-12T17:41:55.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.516+0000 7f89c932f800 20 add_watcher() i=4 2024-09-12T17:41:55.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.516+0000 7f89c932f800 20 add_watcher() i=5 2024-09-12T17:41:55.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.516+0000 7f89c932f800 20 add_watcher() i=6 2024-09-12T17:41:55.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.517+0000 7f89c932f800 20 add_watcher() i=7 2024-09-12T17:41:55.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.517+0000 7f89c932f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:55.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.519+0000 7f887bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:55.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.519+0000 7f89c932f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:55.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.519+0000 7f89c932f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:55.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.519+0000 7f89c932f800 5 note: GC not initialized 2024-09-12T17:41:55.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.519+0000 7f887afe5640 20 reqs_thread_entry: start 2024-09-12T17:41:55.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.519+0000 7f89c932f800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:55.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.520+0000 7f89c932f800 20 Filter name: none 2024-09-12T17:41:55.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.520+0000 7f8878fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:55.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.520+0000 7f89c932f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.520+0000 7f89c932f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:41:55.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.520+0000 7f89c932f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.521+0000 7f89c932f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:41:55.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.521+0000 7f89c932f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:55.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.521+0000 7f89c932f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.522+0000 7f89c932f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:41:55.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.522+0000 7f89c932f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.522+0000 7f89c932f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:41:55.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.522+0000 7f89c932f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:55.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.524+0000 7f887bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:55.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.526+0000 7f89c932f800 20 remove_watcher() i=0 2024-09-12T17:41:55.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.526+0000 7f89c932f800 2 removed watcher, disabling cache 2024-09-12T17:41:55.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.527+0000 7f89c932f800 20 remove_watcher() i=1 2024-09-12T17:41:55.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.528+0000 7f89c932f800 20 remove_watcher() i=2 2024-09-12T17:41:55.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.529+0000 7f89c932f800 20 remove_watcher() i=3 2024-09-12T17:41:55.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.530+0000 7f89c932f800 20 remove_watcher() i=4 2024-09-12T17:41:55.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.531+0000 7f89c932f800 20 remove_watcher() i=5 2024-09-12T17:41:55.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.532+0000 7f89c932f800 20 remove_watcher() i=6 2024-09-12T17:41:55.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.533+0000 7f89c932f800 20 remove_watcher() i=7 2024-09-12T17:41:55.547 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:55.547 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:41:55.547 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-init-index id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:41:55.548 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:55.549 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T17:41:55.583 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:55.583 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:55.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.621+0000 7f9a72f32800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.624 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.622+0000 7f9a72f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.624 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.622+0000 7f9a72f32800 20 realm 2024-09-12T17:41:55.624 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.622+0000 7f9a72f32800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.624 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.623+0000 7f9a72f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.624 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.623+0000 7f9a72f32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:55.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.623+0000 7f9a72f32800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.623+0000 7f9a72f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.623+0000 7f9a72f32800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.623+0000 7f9a72f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:55.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.623+0000 7f9a72f32800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.624+0000 7f9a72f32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:55.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.624+0000 7f9a72f32800 20 searching for the correct realm 2024-09-12T17:41:55.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.627+0000 7f9a6f3bd640 0 -- 172.21.15.44:0/398844127 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f9a64028030 msgr2=0x7f9a6406d460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:55.631 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.630+0000 7f9a6ebbc640 0 -- 172.21.15.44:0/398844127 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f9a6407dbd0 msgr2=0x7f9a6400d9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:55.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.835+0000 7f9a72f32800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:55.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.835+0000 7f9a72f32800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:55.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.835+0000 7f9a72f32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:55.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.835+0000 7f9a72f32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:55.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.835+0000 7f9a72f32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:55.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.835+0000 7f9a72f32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:55.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.835+0000 7f9a72f32800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.836+0000 7f9a72f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.836+0000 7f9a72f32800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.836+0000 7f9a72f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:55.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.836+0000 7f9a72f32800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.836+0000 7f9a72f32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:55.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.836+0000 7f9a72f32800 20 zone default found 2024-09-12T17:41:55.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.836+0000 7f9a72f32800 4 Realm: () 2024-09-12T17:41:55.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.836+0000 7f9a72f32800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:55.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.836+0000 7f9a72f32800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:55.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.836+0000 7f9a72f32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:55.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.836+0000 7f9a72f32800 20 zonegroup default 2024-09-12T17:41:55.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.836+0000 7f9a72f32800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.837+0000 7f9a72f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.837+0000 7f9a72f32800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.837+0000 7f9a72f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.837+0000 7f9a72f32800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.837+0000 7f9a72f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.837+0000 7f9a72f32800 20 started sync module instance, tier type = 2024-09-12T17:41:55.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.837+0000 7f9a72f32800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:55.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.847+0000 7f9a72f32800 20 add_watcher() i=0 2024-09-12T17:41:55.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.847+0000 7f9a72f32800 20 add_watcher() i=1 2024-09-12T17:41:55.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.847+0000 7f9a72f32800 20 add_watcher() i=2 2024-09-12T17:41:55.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.847+0000 7f9a72f32800 20 add_watcher() i=3 2024-09-12T17:41:55.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.847+0000 7f9a72f32800 20 add_watcher() i=4 2024-09-12T17:41:55.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.847+0000 7f9a72f32800 20 add_watcher() i=5 2024-09-12T17:41:55.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.847+0000 7f9a72f32800 20 add_watcher() i=6 2024-09-12T17:41:55.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.848+0000 7f9a72f32800 20 add_watcher() i=7 2024-09-12T17:41:55.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.848+0000 7f9a72f32800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:55.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.850+0000 7f99257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:55.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.850+0000 7f9a72f32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:55.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.850+0000 7f9a72f32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:55.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.850+0000 7f9a72f32800 5 note: GC not initialized 2024-09-12T17:41:55.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.850+0000 7f989ffff640 20 reqs_thread_entry: start 2024-09-12T17:41:55.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.850+0000 7f9a72f32800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:55.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.850+0000 7f9a72f32800 20 Filter name: none 2024-09-12T17:41:55.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.851+0000 7f989dffb640 20 reqs_thread_entry: start 2024-09-12T17:41:55.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.851+0000 7f9a72f32800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:41:55.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.851+0000 7f9a72f32800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.851+0000 7f9a72f32800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:41:55.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.851+0000 7f9a72f32800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:41:55.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.851+0000 7f9a72f32800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:41:55.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.851+0000 7f9a72f32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 : miss 2024-09-12T17:41:55.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.851+0000 7f9a72f32800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.851+0000 7f9a72f32800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:41:55.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.851+0000 7f9a72f32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 info.flags=0x17 2024-09-12T17:41:55.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.851+0000 7f9a72f32800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 to cache LRU end 2024-09-12T17:41:55.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.851+0000 7f9a72f32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:55.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.851+0000 7f9a72f32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:55.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.851+0000 7f9a72f32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 2024-09-12T17:41:55.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.853+0000 7f9a72f32800 -1 Injecting error=-5 at location=init_index 2024-09-12T17:41:55.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.853+0000 7f9a72f32800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T17:41:55.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.854+0000 7f99257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:55.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.856+0000 7f9a72f32800 20 remove_watcher() i=0 2024-09-12T17:41:55.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.856+0000 7f9a72f32800 2 removed watcher, disabling cache 2024-09-12T17:41:55.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.857+0000 7f9a72f32800 20 remove_watcher() i=1 2024-09-12T17:41:55.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.858+0000 7f9a72f32800 20 remove_watcher() i=2 2024-09-12T17:41:55.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.859+0000 7f9a72f32800 20 remove_watcher() i=3 2024-09-12T17:41:55.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.860+0000 7f9a72f32800 20 remove_watcher() i=4 2024-09-12T17:41:55.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.861+0000 7f9a72f32800 20 remove_watcher() i=5 2024-09-12T17:41:55.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.862+0000 7f9a72f32800 20 remove_watcher() i=6 2024-09-12T17:41:55.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.863+0000 7f9a72f32800 20 remove_watcher() i=7 2024-09-12T17:41:55.878 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:41:55.907 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:55.907 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:55.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.944+0000 7f6721d1f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.946+0000 7f6721d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.946+0000 7f6721d1f800 20 realm 2024-09-12T17:41:55.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.946+0000 7f6721d1f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.946+0000 7f6721d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.946+0000 7f6721d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:55.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.946+0000 7f6721d1f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.946+0000 7f6721d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:55.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.946+0000 7f6721d1f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.947+0000 7f6721d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:55.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.947+0000 7f6721d1f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:55.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.948+0000 7f6721d1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:55.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.948+0000 7f6721d1f800 20 searching for the correct realm 2024-09-12T17:41:55.952 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:55.951+0000 7f671d2a8640 0 -- 172.21.15.44:0/1291818087 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f6710031070 msgr2=0x7f671004b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:56.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.156+0000 7f671daa9640 0 -- 172.21.15.44:0/1291818087 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f6714049040 msgr2=0x7f67140429e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:56.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.362+0000 7f6721d1f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:56.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.362+0000 7f6721d1f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:56.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.362+0000 7f6721d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:56.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.362+0000 7f6721d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:56.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.362+0000 7f6721d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:56.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.362+0000 7f6721d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:56.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.362+0000 7f6721d1f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.362+0000 7f6721d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:56.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.362+0000 7f6721d1f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.363+0000 7f6721d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:56.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.363+0000 7f6721d1f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.363+0000 7f6721d1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:56.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.363+0000 7f6721d1f800 20 zone default found 2024-09-12T17:41:56.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.363+0000 7f6721d1f800 4 Realm: () 2024-09-12T17:41:56.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.363+0000 7f6721d1f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:56.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.363+0000 7f6721d1f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:56.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.363+0000 7f6721d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:56.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.363+0000 7f6721d1f800 20 zonegroup default 2024-09-12T17:41:56.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.363+0000 7f6721d1f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.363+0000 7f6721d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:56.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.363+0000 7f6721d1f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.364+0000 7f6721d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:56.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.364+0000 7f6721d1f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.364+0000 7f6721d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:56.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.364+0000 7f6721d1f800 20 started sync module instance, tier type = 2024-09-12T17:41:56.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.364+0000 7f6721d1f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:56.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.374+0000 7f6721d1f800 20 add_watcher() i=0 2024-09-12T17:41:56.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.374+0000 7f6721d1f800 20 add_watcher() i=1 2024-09-12T17:41:56.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.374+0000 7f6721d1f800 20 add_watcher() i=2 2024-09-12T17:41:56.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.374+0000 7f6721d1f800 20 add_watcher() i=3 2024-09-12T17:41:56.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.374+0000 7f6721d1f800 20 add_watcher() i=4 2024-09-12T17:41:56.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.374+0000 7f6721d1f800 20 add_watcher() i=5 2024-09-12T17:41:56.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.374+0000 7f6721d1f800 20 add_watcher() i=6 2024-09-12T17:41:56.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.375+0000 7f6721d1f800 20 add_watcher() i=7 2024-09-12T17:41:56.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.375+0000 7f6721d1f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:56.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.377+0000 7f65cffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:56.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.377+0000 7f6721d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:56.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.377+0000 7f6721d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:56.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.377+0000 7f6721d1f800 5 note: GC not initialized 2024-09-12T17:41:56.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.378+0000 7f65ceffd640 20 reqs_thread_entry: start 2024-09-12T17:41:56.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.378+0000 7f6721d1f800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:56.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.378+0000 7f6721d1f800 20 Filter name: none 2024-09-12T17:41:56.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.378+0000 7f65ccff9640 20 reqs_thread_entry: start 2024-09-12T17:41:56.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.378+0000 7f6721d1f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.378+0000 7f6721d1f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:41:56.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.378+0000 7f6721d1f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.379+0000 7f6721d1f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:41:56.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.379+0000 7f6721d1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:56.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.379+0000 7f6721d1f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.379+0000 7f6721d1f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:41:56.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.379+0000 7f6721d1f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.380+0000 7f6721d1f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:41:56.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.380+0000 7f6721d1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:56.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.382+0000 7f65cffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:56.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.384+0000 7f6721d1f800 20 remove_watcher() i=0 2024-09-12T17:41:56.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.384+0000 7f6721d1f800 2 removed watcher, disabling cache 2024-09-12T17:41:56.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.385+0000 7f6721d1f800 20 remove_watcher() i=1 2024-09-12T17:41:56.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.386+0000 7f6721d1f800 20 remove_watcher() i=2 2024-09-12T17:41:56.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.387+0000 7f6721d1f800 20 remove_watcher() i=3 2024-09-12T17:41:56.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.388+0000 7f6721d1f800 20 remove_watcher() i=4 2024-09-12T17:41:56.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.389+0000 7f6721d1f800 20 remove_watcher() i=5 2024-09-12T17:41:56.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.390+0000 7f6721d1f800 20 remove_watcher() i=6 2024-09-12T17:41:56.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.392+0000 7f6721d1f800 20 remove_watcher() i=7 2024-09-12T17:41:56.405 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:56.406 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:41:56.406 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-init-index id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:41:56.406 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:56.459 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:41:56.493 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:56.493 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:56.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.532+0000 7fe2c7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.533+0000 7fe2c7a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:56.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.533+0000 7fe2c7a87800 20 realm 2024-09-12T17:41:56.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.533+0000 7fe2c7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.534+0000 7fe2c7a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:56.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.534+0000 7fe2c7a87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:56.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.534+0000 7fe2c7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.534+0000 7fe2c7a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:56.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.534+0000 7fe2c7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.535+0000 7fe2c7a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:56.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.535+0000 7fe2c7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.535+0000 7fe2c7a87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:56.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.535+0000 7fe2c7a87800 20 searching for the correct realm 2024-09-12T17:41:56.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.538+0000 7fe2c4d70640 0 -- 172.21.15.44:0/405431793 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fe2b808e040 msgr2=0x7fe2b80a4420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:56.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.542+0000 7fe2c5571640 0 -- 172.21.15.44:0/405431793 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fe2bc076f50 msgr2=0x7fe2bc003950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:56.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.749+0000 7fe2c7a87800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:56.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.749+0000 7fe2c7a87800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:56.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.749+0000 7fe2c7a87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:56.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.749+0000 7fe2c7a87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:56.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.749+0000 7fe2c7a87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:56.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.749+0000 7fe2c7a87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:56.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.749+0000 7fe2c7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.749+0000 7fe2c7a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:56.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.749+0000 7fe2c7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.749+0000 7fe2c7a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:56.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.749+0000 7fe2c7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.750+0000 7fe2c7a87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.750+0000 7fe2c7a87800 20 zone default found 2024-09-12T17:41:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.750+0000 7fe2c7a87800 4 Realm: () 2024-09-12T17:41:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.750+0000 7fe2c7a87800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.750+0000 7fe2c7a87800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.750+0000 7fe2c7a87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.750+0000 7fe2c7a87800 20 zonegroup default 2024-09-12T17:41:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.750+0000 7fe2c7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.750+0000 7fe2c7a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.750+0000 7fe2c7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.750+0000 7fe2c7a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.750+0000 7fe2c7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.751+0000 7fe2c7a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:56.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.751+0000 7fe2c7a87800 20 started sync module instance, tier type = 2024-09-12T17:41:56.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.751+0000 7fe2c7a87800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:56.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.761+0000 7fe2c7a87800 20 add_watcher() i=0 2024-09-12T17:41:56.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.761+0000 7fe2c7a87800 20 add_watcher() i=1 2024-09-12T17:41:56.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.761+0000 7fe2c7a87800 20 add_watcher() i=2 2024-09-12T17:41:56.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.761+0000 7fe2c7a87800 20 add_watcher() i=3 2024-09-12T17:41:56.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.761+0000 7fe2c7a87800 20 add_watcher() i=4 2024-09-12T17:41:56.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.761+0000 7fe2c7a87800 20 add_watcher() i=5 2024-09-12T17:41:56.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.761+0000 7fe2c7a87800 20 add_watcher() i=6 2024-09-12T17:41:56.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.763+0000 7fe2c7a87800 20 add_watcher() i=7 2024-09-12T17:41:56.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.763+0000 7fe2c7a87800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:56.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.765+0000 7fe17bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:56.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.765+0000 7fe2c7a87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:56.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.765+0000 7fe2c7a87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:56.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.765+0000 7fe2c7a87800 5 note: GC not initialized 2024-09-12T17:41:56.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.765+0000 7fe17afe5640 20 reqs_thread_entry: start 2024-09-12T17:41:56.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.766+0000 7fe2c7a87800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:56.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.766+0000 7fe2c7a87800 20 Filter name: none 2024-09-12T17:41:56.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.766+0000 7fe178fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:56.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.766+0000 7fe2c7a87800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:41:56.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.766+0000 7fe2c7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.766+0000 7fe2c7a87800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:41:56.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.766+0000 7fe2c7a87800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:41:56.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.766+0000 7fe2c7a87800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:41:56.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.766+0000 7fe2c7a87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 : miss 2024-09-12T17:41:56.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.766+0000 7fe2c7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.767+0000 7fe2c7a87800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:41:56.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.767+0000 7fe2c7a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 info.flags=0x17 2024-09-12T17:41:56.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.767+0000 7fe2c7a87800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 to cache LRU end 2024-09-12T17:41:56.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.767+0000 7fe2c7a87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:56.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.767+0000 7fe2c7a87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:56.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.767+0000 7fe2c7a87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 2024-09-12T17:41:56.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.772+0000 7fe2c7a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 info.flags=0x17 2024-09-12T17:41:56.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.772+0000 7fe2c7a87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 to cache LRU end 2024-09-12T17:41:56.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.772+0000 7fe2c7a87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:56.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.772+0000 7fe2c7a87800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20, ofs0, ns] 2024-09-12T17:41:56.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.772+0000 7fe1a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562401 cookie 93925463950544 notifier 5963 bl.length()=995 2024-09-12T17:41:56.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.772+0000 7fe1a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 info.flags=0x17 2024-09-12T17:41:56.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.772+0000 7fe1a8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 to cache LRU end 2024-09-12T17:41:56.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.772+0000 7fe1a8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:56.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.773+0000 7fe2c7a87800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20]): orig_sources= new_sources= 2024-09-12T17:41:56.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.773+0000 7fe2c7a87800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20]): potential sources added=[] removed=[] 2024-09-12T17:41:56.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.773+0000 7fe2c7a87800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20]): orig_dests= new_dests= 2024-09-12T17:41:56.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.773+0000 7fe2c7a87800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20]): potential dests added=[] removed=[] 2024-09-12T17:41:56.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.0 2024-09-12T17:41:56.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.0 2024-09-12T17:41:56.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.1 2024-09-12T17:41:56.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.1 2024-09-12T17:41:56.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.2 2024-09-12T17:41:56.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.2 2024-09-12T17:41:56.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.3 2024-09-12T17:41:56.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.3 2024-09-12T17:41:56.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.4 2024-09-12T17:41:56.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.4 2024-09-12T17:41:56.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.5 2024-09-12T17:41:56.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.5 2024-09-12T17:41:56.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.6 2024-09-12T17:41:56.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.6 2024-09-12T17:41:56.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.7 2024-09-12T17:41:56.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.7 2024-09-12T17:41:56.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.8 2024-09-12T17:41:56.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.8 2024-09-12T17:41:56.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.9 2024-09-12T17:41:56.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.9 2024-09-12T17:41:56.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.10 2024-09-12T17:41:56.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.10 2024-09-12T17:41:56.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.11 2024-09-12T17:41:56.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1.11 2024-09-12T17:41:56.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.0 2024-09-12T17:41:56.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.778+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1 2024-09-12T17:41:56.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.779+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.2 2024-09-12T17:41:56.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.779+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.3 2024-09-12T17:41:56.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.780+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.4 2024-09-12T17:41:56.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.780+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.5 2024-09-12T17:41:56.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.781+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.6 2024-09-12T17:41:56.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.781+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.7 2024-09-12T17:41:56.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.782+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.8 2024-09-12T17:41:56.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.782+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.9 2024-09-12T17:41:56.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.782+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.10 2024-09-12T17:41:56.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.785+0000 7fe2c7a87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:56.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.785+0000 7fe2c7a87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 2024-09-12T17:41:56.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.787+0000 7fe2c7a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 info.flags=0x17 2024-09-12T17:41:56.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.787+0000 7fe2c7a87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 to cache LRU end 2024-09-12T17:41:56.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.787+0000 7fe2c7a87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:56.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.787+0000 7fe2c7a87800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20, ofs0, ns] 2024-09-12T17:41:56.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.787+0000 7fe1a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562402 cookie 93925463950544 notifier 5963 bl.length()=995 2024-09-12T17:41:56.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.787+0000 7fe1a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 info.flags=0x17 2024-09-12T17:41:56.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.787+0000 7fe1a8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 to cache LRU end 2024-09-12T17:41:56.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.787+0000 7fe1a8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:56.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.787+0000 7fe2c7a87800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20]): orig_sources= new_sources= 2024-09-12T17:41:56.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.787+0000 7fe2c7a87800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20]): potential sources added=[] removed=[] 2024-09-12T17:41:56.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.787+0000 7fe2c7a87800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20]): orig_dests= new_dests= 2024-09-12T17:41:56.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.787+0000 7fe2c7a87800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20]): potential dests added=[] removed=[] 2024-09-12T17:41:56.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.790+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.0 2024-09-12T17:41:56.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.790+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.1 2024-09-12T17:41:56.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.791+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.2 2024-09-12T17:41:56.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.791+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.3 2024-09-12T17:41:56.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.791+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.4 2024-09-12T17:41:56.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.792+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.5 2024-09-12T17:41:56.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.792+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.6 2024-09-12T17:41:56.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.792+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.7 2024-09-12T17:41:56.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.793+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.8 2024-09-12T17:41:56.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.793+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.9 2024-09-12T17:41:56.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.793+0000 7fe2c7a87800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20.10 2024-09-12T17:41:56.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.794+0000 7fe2c7a87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:56.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.794+0000 7fe2c7a87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 2024-09-12T17:41:56.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.795+0000 7fe2c7a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 info.flags=0x17 2024-09-12T17:41:56.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.795+0000 7fe2c7a87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 to cache LRU end 2024-09-12T17:41:56.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.795+0000 7fe2c7a87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:56.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.795+0000 7fe2c7a87800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20, ofs0, ns] 2024-09-12T17:41:56.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.796+0000 7fe197fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562403 cookie 93925463950544 notifier 5963 bl.length()=963 2024-09-12T17:41:56.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.796+0000 7fe197fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 info.flags=0x17 2024-09-12T17:41:56.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.796+0000 7fe197fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 to cache LRU end 2024-09-12T17:41:56.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.796+0000 7fe197fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:56.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.796+0000 7fe2c7a87800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20]): orig_sources= new_sources= 2024-09-12T17:41:56.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.796+0000 7fe2c7a87800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20]): potential sources added=[] removed=[] 2024-09-12T17:41:56.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.796+0000 7fe2c7a87800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20]): orig_dests= new_dests= 2024-09-12T17:41:56.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.796+0000 7fe2c7a87800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20]): potential dests added=[] removed=[] 2024-09-12T17:41:56.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.799+0000 7fe2c7a87800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T17:41:56.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.801+0000 7fe17bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:56.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.803+0000 7fe2c7a87800 20 remove_watcher() i=0 2024-09-12T17:41:56.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.803+0000 7fe2c7a87800 2 removed watcher, disabling cache 2024-09-12T17:41:56.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.804+0000 7fe2c7a87800 20 remove_watcher() i=1 2024-09-12T17:41:56.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.805+0000 7fe2c7a87800 20 remove_watcher() i=2 2024-09-12T17:41:56.808 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.806+0000 7fe2c7a87800 20 remove_watcher() i=3 2024-09-12T17:41:56.809 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.808+0000 7fe2c7a87800 20 remove_watcher() i=4 2024-09-12T17:41:56.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.809+0000 7fe2c7a87800 20 remove_watcher() i=5 2024-09-12T17:41:56.811 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.810+0000 7fe2c7a87800 20 remove_watcher() i=6 2024-09-12T17:41:56.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.811+0000 7fe2c7a87800 20 remove_watcher() i=7 2024-09-12T17:41:56.825 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:41:56.855 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:56.855 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:56.894 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.892+0000 7fc98b333800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.894+0000 7fc98b333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:56.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.894+0000 7fc98b333800 20 realm 2024-09-12T17:41:56.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.894+0000 7fc98b333800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.894+0000 7fc98b333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:56.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.894+0000 7fc98b333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:56.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.894+0000 7fc98b333800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.895+0000 7fc98b333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:56.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.895+0000 7fc98b333800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.895+0000 7fc98b333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:56.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.895+0000 7fc98b333800 20 rados->read ofs=0 len=0 2024-09-12T17:41:56.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.896+0000 7fc98b333800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:56.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.896+0000 7fc98b333800 20 searching for the correct realm 2024-09-12T17:41:56.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.898+0000 7fc987877640 0 -- 172.21.15.44:0/3838334934 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7fc97c027040 msgr2=0x7fc97c031900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:56.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:56.902+0000 7fc987076640 0 -- 172.21.15.44:0/3838334934 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fc97c03d900 msgr2=0x7fc97c026420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:57.110 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:57.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:57.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:57.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:57.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:57.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:57.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:57.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:57.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:57.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 20 zone default found 2024-09-12T17:41:57.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 4 Realm: () 2024-09-12T17:41:57.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:57.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:57.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:57.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 20 zonegroup default 2024-09-12T17:41:57.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.109+0000 7fc98b333800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.110+0000 7fc98b333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:57.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.110+0000 7fc98b333800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.110+0000 7fc98b333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:57.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.110+0000 7fc98b333800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.110+0000 7fc98b333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:57.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.110+0000 7fc98b333800 20 started sync module instance, tier type = 2024-09-12T17:41:57.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.110+0000 7fc98b333800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:57.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.121+0000 7fc98b333800 20 add_watcher() i=0 2024-09-12T17:41:57.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.121+0000 7fc98b333800 20 add_watcher() i=1 2024-09-12T17:41:57.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.121+0000 7fc98b333800 20 add_watcher() i=2 2024-09-12T17:41:57.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.121+0000 7fc98b333800 20 add_watcher() i=3 2024-09-12T17:41:57.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.121+0000 7fc98b333800 20 add_watcher() i=4 2024-09-12T17:41:57.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.121+0000 7fc98b333800 20 add_watcher() i=5 2024-09-12T17:41:57.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.122+0000 7fc98b333800 20 add_watcher() i=6 2024-09-12T17:41:57.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.122+0000 7fc98b333800 20 add_watcher() i=7 2024-09-12T17:41:57.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.122+0000 7fc98b333800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:57.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.124+0000 7fc83dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:57.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.124+0000 7fc98b333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:57.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.124+0000 7fc98b333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:57.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.124+0000 7fc98b333800 5 note: GC not initialized 2024-09-12T17:41:57.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.124+0000 7fc83cfe1640 20 reqs_thread_entry: start 2024-09-12T17:41:57.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.124+0000 7fc98b333800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:57.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.125+0000 7fc98b333800 20 Filter name: none 2024-09-12T17:41:57.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.125+0000 7fc7b67fc640 20 reqs_thread_entry: start 2024-09-12T17:41:57.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.125+0000 7fc98b333800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.125+0000 7fc98b333800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:41:57.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.125+0000 7fc98b333800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.126+0000 7fc98b333800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:41:57.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.126+0000 7fc98b333800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:57.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.126+0000 7fc98b333800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.126+0000 7fc98b333800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:41:57.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.126+0000 7fc98b333800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.127+0000 7fc98b333800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:41:57.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.127+0000 7fc98b333800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:57.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.128+0000 7fc83dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:57.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.130+0000 7fc98b333800 20 remove_watcher() i=0 2024-09-12T17:41:57.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.130+0000 7fc98b333800 2 removed watcher, disabling cache 2024-09-12T17:41:57.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.132+0000 7fc98b333800 20 remove_watcher() i=1 2024-09-12T17:41:57.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.133+0000 7fc98b333800 20 remove_watcher() i=2 2024-09-12T17:41:57.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.134+0000 7fc98b333800 20 remove_watcher() i=3 2024-09-12T17:41:57.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.135+0000 7fc98b333800 20 remove_watcher() i=4 2024-09-12T17:41:57.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.136+0000 7fc98b333800 20 remove_watcher() i=5 2024-09-12T17:41:57.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.137+0000 7fc98b333800 20 remove_watcher() i=6 2024-09-12T17:41:57.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.138+0000 7fc98b333800 20 remove_watcher() i=7 2024-09-12T17:41:57.150 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:57.151 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:41:57.151 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-init-index id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:41:57.151 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:57.228 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T17:41:57.229 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:57.421 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:41:57.450 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:57.451 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:57.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.488+0000 7faa0a942800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.490+0000 7faa0a942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:57.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.490+0000 7faa0a942800 20 realm 2024-09-12T17:41:57.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.490+0000 7faa0a942800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.490+0000 7faa0a942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:57.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.490+0000 7faa0a942800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:57.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.490+0000 7faa0a942800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.490+0000 7faa0a942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:57.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.490+0000 7faa0a942800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.491+0000 7faa0a942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:57.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.491+0000 7faa0a942800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.491+0000 7faa0a942800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:57.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.491+0000 7faa0a942800 20 searching for the correct realm 2024-09-12T17:41:57.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.494+0000 7faa05e85640 0 -- 172.21.15.44:0/1084888641 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fa9f80b4cc0 msgr2=0x7fa9f80aac40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:57.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.498+0000 7faa06686640 0 -- 172.21.15.44:0/1084888641 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fa9fc03b9a0 msgr2=0x7fa9fc082970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:57.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.704+0000 7faa0a942800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:57.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.704+0000 7faa0a942800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:57.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.704+0000 7faa0a942800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:57.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.704+0000 7faa0a942800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:57.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.704+0000 7faa0a942800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:57.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.704+0000 7faa0a942800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:57.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.704+0000 7faa0a942800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.704+0000 7faa0a942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:57.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.704+0000 7faa0a942800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.705+0000 7faa0a942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:57.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.705+0000 7faa0a942800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.705+0000 7faa0a942800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:57.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.705+0000 7faa0a942800 20 zone default found 2024-09-12T17:41:57.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.705+0000 7faa0a942800 4 Realm: () 2024-09-12T17:41:57.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.705+0000 7faa0a942800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:57.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.705+0000 7faa0a942800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:57.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.705+0000 7faa0a942800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:57.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.705+0000 7faa0a942800 20 zonegroup default 2024-09-12T17:41:57.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.705+0000 7faa0a942800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.705+0000 7faa0a942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:57.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.705+0000 7faa0a942800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.706+0000 7faa0a942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:57.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.706+0000 7faa0a942800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.706+0000 7faa0a942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:57.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.706+0000 7faa0a942800 20 started sync module instance, tier type = 2024-09-12T17:41:57.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.706+0000 7faa0a942800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:57.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.716+0000 7faa0a942800 20 add_watcher() i=0 2024-09-12T17:41:57.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.716+0000 7faa0a942800 20 add_watcher() i=1 2024-09-12T17:41:57.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.716+0000 7faa0a942800 20 add_watcher() i=2 2024-09-12T17:41:57.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.716+0000 7faa0a942800 20 add_watcher() i=3 2024-09-12T17:41:57.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.716+0000 7faa0a942800 20 add_watcher() i=4 2024-09-12T17:41:57.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.716+0000 7faa0a942800 20 add_watcher() i=5 2024-09-12T17:41:57.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.716+0000 7faa0a942800 20 add_watcher() i=6 2024-09-12T17:41:57.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.717+0000 7faa0a942800 20 add_watcher() i=7 2024-09-12T17:41:57.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.717+0000 7faa0a942800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:57.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.718+0000 7fa8bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:57.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.719+0000 7faa0a942800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:57.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.719+0000 7faa0a942800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:57.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.719+0000 7faa0a942800 5 note: GC not initialized 2024-09-12T17:41:57.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.719+0000 7fa8377fe640 20 reqs_thread_entry: start 2024-09-12T17:41:57.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.719+0000 7faa0a942800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:57.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.719+0000 7faa0a942800 20 Filter name: none 2024-09-12T17:41:57.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.719+0000 7fa8357fa640 20 reqs_thread_entry: start 2024-09-12T17:41:57.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.719+0000 7faa0a942800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.720+0000 7faa0a942800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:41:57.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.720+0000 7faa0a942800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.721+0000 7faa0a942800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:41:57.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.721+0000 7faa0a942800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:57.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.721+0000 7faa0a942800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.721+0000 7faa0a942800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:41:57.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.721+0000 7faa0a942800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.722+0000 7faa0a942800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:41:57.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.722+0000 7faa0a942800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:57.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.724+0000 7fa8bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:57.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.726+0000 7faa0a942800 20 remove_watcher() i=0 2024-09-12T17:41:57.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.726+0000 7faa0a942800 2 removed watcher, disabling cache 2024-09-12T17:41:57.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.727+0000 7faa0a942800 20 remove_watcher() i=1 2024-09-12T17:41:57.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.728+0000 7faa0a942800 20 remove_watcher() i=2 2024-09-12T17:41:57.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.729+0000 7faa0a942800 20 remove_watcher() i=3 2024-09-12T17:41:57.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.730+0000 7faa0a942800 20 remove_watcher() i=4 2024-09-12T17:41:57.733 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.731+0000 7faa0a942800 20 remove_watcher() i=5 2024-09-12T17:41:57.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.732+0000 7faa0a942800 20 remove_watcher() i=6 2024-09-12T17:41:57.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.733+0000 7faa0a942800 20 remove_watcher() i=7 2024-09-12T17:41:57.746 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:57.746 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:41:57.746 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-init-index id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:41:57.746 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:57.747 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T17:41:57.784 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:57.784 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:57.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.822+0000 7f73da2b7800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.824+0000 7f73da2b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:57.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.824+0000 7f73da2b7800 20 realm 2024-09-12T17:41:57.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.824+0000 7f73da2b7800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.824+0000 7f73da2b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:57.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.824+0000 7f73da2b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:57.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.824+0000 7f73da2b7800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.824+0000 7f73da2b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:57.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.824+0000 7f73da2b7800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.825+0000 7f73da2b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:57.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.825+0000 7f73da2b7800 20 rados->read ofs=0 len=0 2024-09-12T17:41:57.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.826+0000 7f73da2b7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:57.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.826+0000 7f73da2b7800 20 searching for the correct realm 2024-09-12T17:41:57.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.828+0000 7f73d75a0640 0 -- 172.21.15.44:0/2133237348 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f73c8081910 msgr2=0x7f73c8081170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:57.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:57.832+0000 7f73d7da1640 0 -- 172.21.15.44:0/2133237348 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f73cc078950 msgr2=0x7f73cc0983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:58.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.038+0000 7f73da2b7800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:58.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.038+0000 7f73da2b7800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:58.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.038+0000 7f73da2b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:58.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.038+0000 7f73da2b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:58.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.038+0000 7f73da2b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:58.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.038+0000 7f73da2b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:58.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.038+0000 7f73da2b7800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.038+0000 7f73da2b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.038+0000 7f73da2b7800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.039+0000 7f73da2b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:58.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.039+0000 7f73da2b7800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.039+0000 7f73da2b7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:58.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.039+0000 7f73da2b7800 20 zone default found 2024-09-12T17:41:58.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.039+0000 7f73da2b7800 4 Realm: () 2024-09-12T17:41:58.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.039+0000 7f73da2b7800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:58.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.039+0000 7f73da2b7800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:58.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.039+0000 7f73da2b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:58.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.039+0000 7f73da2b7800 20 zonegroup default 2024-09-12T17:41:58.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.039+0000 7f73da2b7800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.039+0000 7f73da2b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.039+0000 7f73da2b7800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.040+0000 7f73da2b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.040+0000 7f73da2b7800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.040+0000 7f73da2b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.040+0000 7f73da2b7800 20 started sync module instance, tier type = 2024-09-12T17:41:58.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.040+0000 7f73da2b7800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:58.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.049+0000 7f73da2b7800 20 add_watcher() i=0 2024-09-12T17:41:58.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.049+0000 7f73da2b7800 20 add_watcher() i=1 2024-09-12T17:41:58.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.049+0000 7f73da2b7800 20 add_watcher() i=2 2024-09-12T17:41:58.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.049+0000 7f73da2b7800 20 add_watcher() i=3 2024-09-12T17:41:58.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.049+0000 7f73da2b7800 20 add_watcher() i=4 2024-09-12T17:41:58.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.049+0000 7f73da2b7800 20 add_watcher() i=5 2024-09-12T17:41:58.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.049+0000 7f73da2b7800 20 add_watcher() i=6 2024-09-12T17:41:58.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.050+0000 7f73da2b7800 20 add_watcher() i=7 2024-09-12T17:41:58.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.050+0000 7f73da2b7800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:58.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.052+0000 7f728e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:58.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.052+0000 7f73da2b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:58.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.052+0000 7f73da2b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:58.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.053+0000 7f73da2b7800 5 note: GC not initialized 2024-09-12T17:41:58.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.053+0000 7f728d7e2640 20 reqs_thread_entry: start 2024-09-12T17:41:58.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.053+0000 7f73da2b7800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:58.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.053+0000 7f73da2b7800 20 Filter name: none 2024-09-12T17:41:58.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.053+0000 7f72867fc640 20 reqs_thread_entry: start 2024-09-12T17:41:58.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.053+0000 7f73da2b7800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:41:58.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.053+0000 7f73da2b7800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.054+0000 7f73da2b7800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:41:58.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.054+0000 7f73da2b7800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:41:58.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.054+0000 7f73da2b7800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:41:58.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.054+0000 7f73da2b7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21 : miss 2024-09-12T17:41:58.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.054+0000 7f73da2b7800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.054+0000 7f73da2b7800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:41:58.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.054+0000 7f73da2b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21 info.flags=0x17 2024-09-12T17:41:58.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.054+0000 7f73da2b7800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21 to cache LRU end 2024-09-12T17:41:58.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.054+0000 7f73da2b7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:58.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.054+0000 7f73da2b7800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:58.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.054+0000 7f73da2b7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21 2024-09-12T17:41:58.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.055+0000 7f73da2b7800 -1 Injecting error=-95 at location=init_index 2024-09-12T17:41:58.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.055+0000 7f73da2b7800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:41:58.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.059+0000 7f73da2b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21 info.flags=0x17 2024-09-12T17:41:58.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.059+0000 7f73da2b7800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21 to cache LRU end 2024-09-12T17:41:58.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.059+0000 7f73da2b7800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:58.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.059+0000 7f73da2b7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21, ofs0, ns] 2024-09-12T17:41:58.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.059+0000 7f72b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562406 cookie 94241292111760 notifier 6411 bl.length()=995 2024-09-12T17:41:58.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.059+0000 7f72b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21 info.flags=0x17 2024-09-12T17:41:58.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.059+0000 7f72b67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21 to cache LRU end 2024-09-12T17:41:58.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.059+0000 7f72b67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:58.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.060+0000 7f73da2b7800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21]): orig_sources= new_sources= 2024-09-12T17:41:58.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.060+0000 7f73da2b7800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21]): potential sources added=[] removed=[] 2024-09-12T17:41:58.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.060+0000 7f73da2b7800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21]): orig_dests= new_dests= 2024-09-12T17:41:58.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.060+0000 7f73da2b7800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21]): potential dests added=[] removed=[] 2024-09-12T17:41:58.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.0 2024-09-12T17:41:58.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.0 2024-09-12T17:41:58.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.1 2024-09-12T17:41:58.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.1 2024-09-12T17:41:58.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.2 2024-09-12T17:41:58.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.2 2024-09-12T17:41:58.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.3 2024-09-12T17:41:58.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.3 2024-09-12T17:41:58.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.4 2024-09-12T17:41:58.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.4 2024-09-12T17:41:58.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.5 2024-09-12T17:41:58.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.5 2024-09-12T17:41:58.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.6 2024-09-12T17:41:58.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.6 2024-09-12T17:41:58.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.7 2024-09-12T17:41:58.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.7 2024-09-12T17:41:58.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.8 2024-09-12T17:41:58.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.8 2024-09-12T17:41:58.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.9 2024-09-12T17:41:58.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.9 2024-09-12T17:41:58.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.10 2024-09-12T17:41:58.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.10 2024-09-12T17:41:58.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.11 2024-09-12T17:41:58.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1.11 2024-09-12T17:41:58.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.0 2024-09-12T17:41:58.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.062+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.1 2024-09-12T17:41:58.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.063+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.2 2024-09-12T17:41:58.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.063+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.3 2024-09-12T17:41:58.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.064+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.4 2024-09-12T17:41:58.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.064+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.5 2024-09-12T17:41:58.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.065+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.6 2024-09-12T17:41:58.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.065+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.7 2024-09-12T17:41:58.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.066+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.8 2024-09-12T17:41:58.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.067+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.9 2024-09-12T17:41:58.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.067+0000 7f73da2b7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21.10 2024-09-12T17:41:58.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.070+0000 7f73da2b7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:58.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.070+0000 7f73da2b7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21 2024-09-12T17:41:58.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.071+0000 7f73da2b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21 info.flags=0x17 2024-09-12T17:41:58.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.071+0000 7f73da2b7800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21 to cache LRU end 2024-09-12T17:41:58.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.071+0000 7f73da2b7800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:58.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.071+0000 7f73da2b7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21, ofs0, ns] 2024-09-12T17:41:58.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.072+0000 7f72b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562407 cookie 94241292111760 notifier 6411 bl.length()=963 2024-09-12T17:41:58.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.072+0000 7f72b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21 info.flags=0x17 2024-09-12T17:41:58.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.072+0000 7f72b6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21 to cache LRU end 2024-09-12T17:41:58.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.072+0000 7f72b6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:58.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.072+0000 7f73da2b7800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21]): orig_sources= new_sources= 2024-09-12T17:41:58.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.072+0000 7f73da2b7800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21]): potential sources added=[] removed=[] 2024-09-12T17:41:58.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.072+0000 7f73da2b7800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21]): orig_dests= new_dests= 2024-09-12T17:41:58.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.072+0000 7f73da2b7800 20 handle_bi_update(): bucket=:error-at-init-index[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21]): potential dests added=[] removed=[] 2024-09-12T17:41:58.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.074+0000 7f73da2b7800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T17:41:58.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.076+0000 7f728e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:58.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.078+0000 7f73da2b7800 20 remove_watcher() i=0 2024-09-12T17:41:58.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.078+0000 7f73da2b7800 2 removed watcher, disabling cache 2024-09-12T17:41:58.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.080+0000 7f73da2b7800 20 remove_watcher() i=1 2024-09-12T17:41:58.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.081+0000 7f73da2b7800 20 remove_watcher() i=2 2024-09-12T17:41:58.083 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.082+0000 7f73da2b7800 20 remove_watcher() i=3 2024-09-12T17:41:58.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.083+0000 7f73da2b7800 20 remove_watcher() i=4 2024-09-12T17:41:58.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.084+0000 7f73da2b7800 20 remove_watcher() i=5 2024-09-12T17:41:58.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.085+0000 7f73da2b7800 20 remove_watcher() i=6 2024-09-12T17:41:58.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.085+0000 7f73da2b7800 20 remove_watcher() i=7 2024-09-12T17:41:58.100 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:41:58.129 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:58.130 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:58.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.167+0000 7f5561415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.171 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.170+0000 7f5561415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.170+0000 7f5561415800 20 realm 2024-09-12T17:41:58.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.170+0000 7f5561415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.170+0000 7f5561415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.170+0000 7f5561415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:58.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.170+0000 7f5561415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.170+0000 7f5561415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.170+0000 7f5561415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.171+0000 7f5561415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:58.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.171+0000 7f5561415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.172+0000 7f5561415800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:58.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.172+0000 7f5561415800 20 searching for the correct realm 2024-09-12T17:41:58.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.175+0000 7f5557fff640 0 -- 172.21.15.44:0/4094942047 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f555008b030 msgr2=0x7f5550070940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:58.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.178+0000 7f555cb92640 0 -- 172.21.15.44:0/4094942047 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f5548070640 msgr2=0x7f55480619d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:58.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.384+0000 7f5561415800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:58.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.384+0000 7f5561415800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:58.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.384+0000 7f5561415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:58.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.384+0000 7f5561415800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:58.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.384+0000 7f5561415800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:58.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.384+0000 7f5561415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:58.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.384+0000 7f5561415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.384+0000 7f5561415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.384+0000 7f5561415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.384+0000 7f5561415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:58.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.384+0000 7f5561415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.385+0000 7f5561415800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:58.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.385+0000 7f5561415800 20 zone default found 2024-09-12T17:41:58.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.385+0000 7f5561415800 4 Realm: () 2024-09-12T17:41:58.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.385+0000 7f5561415800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:58.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.385+0000 7f5561415800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:58.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.385+0000 7f5561415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:58.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.385+0000 7f5561415800 20 zonegroup default 2024-09-12T17:41:58.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.385+0000 7f5561415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.385+0000 7f5561415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.385+0000 7f5561415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.385+0000 7f5561415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.385+0000 7f5561415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.385+0000 7f5561415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.385+0000 7f5561415800 20 started sync module instance, tier type = 2024-09-12T17:41:58.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.385+0000 7f5561415800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:58.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.395+0000 7f5561415800 20 add_watcher() i=0 2024-09-12T17:41:58.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.395+0000 7f5561415800 20 add_watcher() i=1 2024-09-12T17:41:58.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.395+0000 7f5561415800 20 add_watcher() i=2 2024-09-12T17:41:58.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.395+0000 7f5561415800 20 add_watcher() i=3 2024-09-12T17:41:58.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.395+0000 7f5561415800 20 add_watcher() i=4 2024-09-12T17:41:58.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.395+0000 7f5561415800 20 add_watcher() i=5 2024-09-12T17:41:58.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.395+0000 7f5561415800 20 add_watcher() i=6 2024-09-12T17:41:58.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.396+0000 7f5561415800 20 add_watcher() i=7 2024-09-12T17:41:58.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.396+0000 7f5561415800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:58.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.397+0000 7f54137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:58.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.398+0000 7f5561415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:58.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.398+0000 7f5561415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:58.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.398+0000 7f5561415800 5 note: GC not initialized 2024-09-12T17:41:58.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.398+0000 7f54127e4640 20 reqs_thread_entry: start 2024-09-12T17:41:58.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.398+0000 7f5561415800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:58.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.398+0000 7f5561415800 20 Filter name: none 2024-09-12T17:41:58.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.398+0000 7f540b7fe640 20 reqs_thread_entry: start 2024-09-12T17:41:58.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.398+0000 7f5561415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.399+0000 7f5561415800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:41:58.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.399+0000 7f5561415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.399+0000 7f5561415800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:41:58.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.399+0000 7f5561415800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:58.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.400+0000 7f5561415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.400+0000 7f5561415800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:41:58.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.400+0000 7f5561415800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.400+0000 7f5561415800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:41:58.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.400+0000 7f5561415800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:58.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.402+0000 7f54137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:58.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.404+0000 7f5561415800 20 remove_watcher() i=0 2024-09-12T17:41:58.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.404+0000 7f5561415800 2 removed watcher, disabling cache 2024-09-12T17:41:58.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.405+0000 7f5561415800 20 remove_watcher() i=1 2024-09-12T17:41:58.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.406+0000 7f5561415800 20 remove_watcher() i=2 2024-09-12T17:41:58.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.408+0000 7f5561415800 20 remove_watcher() i=3 2024-09-12T17:41:58.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.409+0000 7f5561415800 20 remove_watcher() i=4 2024-09-12T17:41:58.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.410+0000 7f5561415800 20 remove_watcher() i=5 2024-09-12T17:41:58.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.411+0000 7f5561415800 20 remove_watcher() i=6 2024-09-12T17:41:58.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.412+0000 7f5561415800 20 remove_watcher() i=7 2024-09-12T17:41:58.426 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:58.426 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:41:58.426 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-init-index id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:41:58.426 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:58.501 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T17:41:58.501 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:58.702 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:41:58.731 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:58.731 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:58.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.769+0000 7fb10b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.770+0000 7fb10b13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.770+0000 7fb10b13d800 20 realm 2024-09-12T17:41:58.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.770+0000 7fb10b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.770+0000 7fb10b13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.771+0000 7fb10b13d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:58.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.771+0000 7fb10b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.771+0000 7fb10b13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:58.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.771+0000 7fb10b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.772+0000 7fb10b13d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:58.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.772+0000 7fb10b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:58.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.772+0000 7fb10b13d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:58.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.772+0000 7fb10b13d800 20 searching for the correct realm 2024-09-12T17:41:58.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.774+0000 7fb106629640 0 -- 172.21.15.44:0/236162817 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fb0f8045030 msgr2=0x7fb0f8018940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:58.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:58.980+0000 7fb106e2a640 0 -- 172.21.15.44:0/236162817 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fb0fc06fbd0 msgr2=0x7fb0fc01f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:59.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.187+0000 7fb10b13d800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:59.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.187+0000 7fb10b13d800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:59.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.187+0000 7fb10b13d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:59.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.187+0000 7fb10b13d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:59.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.187+0000 7fb10b13d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:59.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.187+0000 7fb10b13d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:59.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.187+0000 7fb10b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.187+0000 7fb10b13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.187+0000 7fb10b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.188+0000 7fb10b13d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:59.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.188+0000 7fb10b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.188+0000 7fb10b13d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:59.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.188+0000 7fb10b13d800 20 zone default found 2024-09-12T17:41:59.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.188+0000 7fb10b13d800 4 Realm: () 2024-09-12T17:41:59.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.188+0000 7fb10b13d800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:59.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.188+0000 7fb10b13d800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:59.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.188+0000 7fb10b13d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:59.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.188+0000 7fb10b13d800 20 zonegroup default 2024-09-12T17:41:59.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.188+0000 7fb10b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.188+0000 7fb10b13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.188+0000 7fb10b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.189+0000 7fb10b13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.189+0000 7fb10b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.189+0000 7fb10b13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.189+0000 7fb10b13d800 20 started sync module instance, tier type = 2024-09-12T17:41:59.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.189+0000 7fb10b13d800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:59.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.199+0000 7fb10b13d800 20 add_watcher() i=0 2024-09-12T17:41:59.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.199+0000 7fb10b13d800 20 add_watcher() i=1 2024-09-12T17:41:59.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.199+0000 7fb10b13d800 20 add_watcher() i=2 2024-09-12T17:41:59.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.199+0000 7fb10b13d800 20 add_watcher() i=3 2024-09-12T17:41:59.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.199+0000 7fb10b13d800 20 add_watcher() i=4 2024-09-12T17:41:59.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.199+0000 7fb10b13d800 20 add_watcher() i=5 2024-09-12T17:41:59.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.199+0000 7fb10b13d800 20 add_watcher() i=6 2024-09-12T17:41:59.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.200+0000 7fb10b13d800 20 add_watcher() i=7 2024-09-12T17:41:59.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.200+0000 7fb10b13d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:59.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.201+0000 7fafbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:59.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.202+0000 7fb10b13d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:59.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.202+0000 7fb10b13d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:59.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.202+0000 7fb10b13d800 5 note: GC not initialized 2024-09-12T17:41:59.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.202+0000 7faf37fff640 20 reqs_thread_entry: start 2024-09-12T17:41:59.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.202+0000 7fb10b13d800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:59.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.202+0000 7fb10b13d800 20 Filter name: none 2024-09-12T17:41:59.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.202+0000 7faf35ffb640 20 reqs_thread_entry: start 2024-09-12T17:41:59.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.202+0000 7fb10b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.203+0000 7fb10b13d800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:41:59.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.203+0000 7fb10b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.204+0000 7fb10b13d800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:41:59.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.204+0000 7fb10b13d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:59.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.204+0000 7fb10b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.204+0000 7fb10b13d800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:41:59.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.204+0000 7fb10b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.204+0000 7fb10b13d800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:41:59.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.204+0000 7fb10b13d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:59.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.206+0000 7fafbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:59.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.208+0000 7fb10b13d800 20 remove_watcher() i=0 2024-09-12T17:41:59.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.208+0000 7fb10b13d800 2 removed watcher, disabling cache 2024-09-12T17:41:59.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.209+0000 7fb10b13d800 20 remove_watcher() i=1 2024-09-12T17:41:59.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.211+0000 7fb10b13d800 20 remove_watcher() i=2 2024-09-12T17:41:59.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.212+0000 7fb10b13d800 20 remove_watcher() i=3 2024-09-12T17:41:59.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.213+0000 7fb10b13d800 20 remove_watcher() i=4 2024-09-12T17:41:59.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.214+0000 7fb10b13d800 20 remove_watcher() i=5 2024-09-12T17:41:59.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.215+0000 7fb10b13d800 20 remove_watcher() i=6 2024-09-12T17:41:59.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.216+0000 7fb10b13d800 20 remove_watcher() i=7 2024-09-12T17:41:59.232 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.232 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:41:59.232 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-init-indext id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:41:59.232 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.233 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T17:41:59.268 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:59.268 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:59.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.308+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.309+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.309+0000 7fef45346800 20 realm 2024-09-12T17:41:59.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.309+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.309+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.309+0000 7fef45346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:59.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.309+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.310+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.310+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.310+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:59.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.310+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.311+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:59.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.311+0000 7fef45346800 20 searching for the correct realm 2024-09-12T17:41:59.315 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.314+0000 7fef42636640 0 -- 172.21.15.44:0/2249472983 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fef3400e040 msgr2=0x7fef34066030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:59.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.317+0000 7fef42e37640 0 -- 172.21.15.44:0/2249472983 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fef38082040 msgr2=0x7fef380a90b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:59.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:59.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:59.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:59.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:59.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:59.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:59.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.523+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.523+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.523+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.524+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:59.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.524+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.524+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:59.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.524+0000 7fef45346800 20 zone default found 2024-09-12T17:41:59.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.524+0000 7fef45346800 4 Realm: () 2024-09-12T17:41:59.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.524+0000 7fef45346800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:59.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.524+0000 7fef45346800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:59.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.524+0000 7fef45346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:59.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.524+0000 7fef45346800 20 zonegroup default 2024-09-12T17:41:59.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.524+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.525+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.525+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.525+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.525+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.525+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.525+0000 7fef45346800 20 started sync module instance, tier type = 2024-09-12T17:41:59.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.525+0000 7fef45346800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:59.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=0 2024-09-12T17:41:59.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=1 2024-09-12T17:41:59.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=2 2024-09-12T17:41:59.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=3 2024-09-12T17:41:59.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=4 2024-09-12T17:41:59.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=5 2024-09-12T17:41:59.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=6 2024-09-12T17:41:59.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.535+0000 7fef45346800 20 add_watcher() i=7 2024-09-12T17:41:59.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.535+0000 7fef45346800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:59.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.537+0000 7fedf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:59.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.537+0000 7fef45346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:59.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.537+0000 7fef45346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:59.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.537+0000 7fef45346800 5 note: GC not initialized 2024-09-12T17:41:59.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.537+0000 7fed73fff640 20 reqs_thread_entry: start 2024-09-12T17:41:59.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.537+0000 7fef45346800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:59.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.537+0000 7fef45346800 20 Filter name: none 2024-09-12T17:41:59.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.538+0000 7fed71ffb640 20 reqs_thread_entry: start 2024-09-12T17:41:59.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.538+0000 7fef45346800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:41:59.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.538+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.538+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:41:59.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.538+0000 7fef45346800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:41:59.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.538+0000 7fef45346800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:41:59.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.538+0000 7fef45346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 : miss 2024-09-12T17:41:59.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.538+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.538+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:41:59.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.538+0000 7fef45346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 info.flags=0x17 2024-09-12T17:41:59.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.538+0000 7fef45346800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 to cache LRU end 2024-09-12T17:41:59.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.538+0000 7fef45346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:59.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.538+0000 7fef45346800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:59.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.538+0000 7fef45346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 2024-09-12T17:41:59.560 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fef45346800 time 2024-09-12T17:41:59.541724+0000 2024-09-12T17:41:59.560 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:41:59.560 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:41:59.560 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fef4898c71a] 2024-09-12T17:41:59.560 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fef4898c8d8] 2024-09-12T17:41:59.560 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641161cb841] 2024-09-12T17:41:59.560 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd73b64) [0x5641166d8b64] 2024-09-12T17:41:59.561 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5641161db50d] 2024-09-12T17:41:59.561 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:41:59.561 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fef47629590] 2024-09-12T17:41:59.561 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:41:59.561 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:41:59.561 INFO:tasks.workunit.client.0.smithi044.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:41:59.561 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7fef45346800 thread_name:radosgw-admin 2024-09-12T17:41:59.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.541+0000 7fef45346800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fef45346800 time 2024-09-12T17:41:59.541724+0000 2024-09-12T17:41:59.561 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:41:59.561 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.561 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:41:59.561 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fef4898c71a] 2024-09-12T17:41:59.562 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fef4898c8d8] 2024-09-12T17:41:59.562 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641161cb841] 2024-09-12T17:41:59.562 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd73b64) [0x5641166d8b64] 2024-09-12T17:41:59.562 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5641161db50d] 2024-09-12T17:41:59.562 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:41:59.562 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fef47629590] 2024-09-12T17:41:59.562 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:41:59.562 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:41:59.562 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.562 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:41:59.562 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fef4763e6f0] 2024-09-12T17:41:59.563 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fef4768b99c] 2024-09-12T17:41:59.563 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:41:59.563 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:41:59.563 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fef4898c774] 2024-09-12T17:41:59.563 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fef4898c8d8] 2024-09-12T17:41:59.563 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641161cb841] 2024-09-12T17:41:59.563 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd73b64) [0x5641166d8b64] 2024-09-12T17:41:59.563 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5641161db50d] 2024-09-12T17:41:59.563 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:41:59.563 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fef47629590] 2024-09-12T17:41:59.563 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:41:59.563 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:41:59.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.541+0000 7fef45346800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:41:59.564 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7fef45346800 thread_name:radosgw-admin 2024-09-12T17:41:59.564 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.564 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:41:59.564 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fef4763e6f0] 2024-09-12T17:41:59.564 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fef4768b99c] 2024-09-12T17:41:59.564 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:41:59.564 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:41:59.564 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fef4898c774] 2024-09-12T17:41:59.564 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fef4898c8d8] 2024-09-12T17:41:59.564 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641161cb841] 2024-09-12T17:41:59.564 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd73b64) [0x5641166d8b64] 2024-09-12T17:41:59.564 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5641161db50d] 2024-09-12T17:41:59.565 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:41:59.565 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fef47629590] 2024-09-12T17:41:59.565 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:41:59.565 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:41:59.565 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:41:59.565 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.565 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:41:59.565 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:41:59.289+0000 7fef42636640 1 monclient: found mon.noname-a 2024-09-12T17:41:59.565 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:41:59.289+0000 7fef42636640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:41:59.566 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:41:59.289+0000 7fef42e37640 10 monclient: get_auth_request con 0x564118840940 auth_method 0 2024-09-12T17:41:59.566 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.566 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:41:59.566 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: dump: 2024-09-12T17:41:59.566 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.566 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.566 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.566 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.566 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.566 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.567 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.567 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.567 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.567 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.567 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: _finish_auth 0 2024-09-12T17:41:59.567 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: _check_auth_tickets 2024-09-12T17:41:59.567 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:59.567 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.567 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:41:59.567 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: dump: 2024-09-12T17:41:59.568 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.568 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.568 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.568 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.568 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.568 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.568 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.568 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.568 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.569 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.569 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:41:59.289+0000 7fef45346800 5 monclient: authenticate success, global_id 6456 2024-09-12T17:41:59.569 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:41:59.289+0000 7fef45346800 10 monclient: get_monmap_and_config success 2024-09-12T17:41:59.569 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:41:59.289+0000 7fef45346800 4 set_mon_vals no callback set 2024-09-12T17:41:59.569 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:41:59.290+0000 7fef45346800 10 monclient: shutdown 2024-09-12T17:41:59.569 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:41:59.290+0000 7fef45346800 5 asok(0x5641186d9730) unregister_commands rotate-key 2024-09-12T17:41:59.569 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:41:59.290+0000 7fef45346800 10 monclient: build_initial_monmap 2024-09-12T17:41:59.569 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:41:59.290+0000 7fef45346800 1 build_initial for_mkfs: 0 2024-09-12T17:41:59.569 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:41:59.290+0000 7fef45346800 10 monclient: monmap: 2024-09-12T17:41:59.569 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:41:59.569 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:41:59.569 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:41:59.569 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:41:59.570 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:41:59.570 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.570 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:41:59.570 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:41:59.570 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:41:59.570 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.570 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding auth protocol: cephx 2024-09-12T17:41:59.570 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding auth protocol: cephx 2024-09-12T17:41:59.570 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding auth protocol: cephx 2024-09-12T17:41:59.570 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: secure 2024-09-12T17:41:59.570 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: crc 2024-09-12T17:41:59.570 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: secure 2024-09-12T17:41:59.570 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: crc 2024-09-12T17:41:59.570 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: secure 2024-09-12T17:41:59.571 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: crc 2024-09-12T17:41:59.571 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: crc 2024-09-12T17:41:59.571 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: secure 2024-09-12T17:41:59.571 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: crc 2024-09-12T17:41:59.571 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: secure 2024-09-12T17:41:59.571 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: crc 2024-09-12T17:41:59.571 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: secure 2024-09-12T17:41:59.571 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:41:59.290+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.571 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:41:59.290+0000 7fef45346800 1 librados: starting msgr at 2024-09-12T17:41:59.571 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:41:59.290+0000 7fef45346800 1 librados: starting objecter 2024-09-12T17:41:59.571 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:41:59.291+0000 7fef45346800 5 asok(0x5641186d9730) register_command objecter_requests hook 0x5641188ff7e0 2024-09-12T17:41:59.571 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:41:59.291+0000 7fef45346800 1 librados: setting wanted keys 2024-09-12T17:41:59.571 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:41:59.291+0000 7fef45346800 1 librados: calling monclient init 2024-09-12T17:41:59.572 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient: init 2024-09-12T17:41:59.572 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding auth protocol: cephx 2024-09-12T17:41:59.572 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding auth protocol: cephx 2024-09-12T17:41:59.572 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding auth protocol: cephx 2024-09-12T17:41:59.572 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: secure 2024-09-12T17:41:59.572 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: crc 2024-09-12T17:41:59.572 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: secure 2024-09-12T17:41:59.572 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: crc 2024-09-12T17:41:59.572 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: secure 2024-09-12T17:41:59.572 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: crc 2024-09-12T17:41:59.572 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: crc 2024-09-12T17:41:59.572 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: secure 2024-09-12T17:41:59.572 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: crc 2024-09-12T17:41:59.573 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: secure 2024-09-12T17:41:59.573 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: crc 2024-09-12T17:41:59.573 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: secure 2024-09-12T17:41:59.573 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:41:59.291+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.573 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:41:59.291+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.573 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:41:59.291+0000 7fef45346800 5 asok(0x5641186d9730) register_command rotate-key hook 0x5641188fe1e8 2024-09-12T17:41:59.573 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient: _reopen_session rank -1 2024-09-12T17:41:59.573 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:41:59.573 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient(hunting): picked mon.noname-b con 0x564118840940 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:41:59.573 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient(hunting): picked mon.noname-a con 0x564118846f50 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:41:59.574 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient(hunting): picked mon.noname-c con 0x5641188478c0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:41:59.574 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.574 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.574 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.574 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient(hunting): _renew_subs 2024-09-12T17:41:59.574 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient(hunting): authenticate will time out at 1891.928650s 2024-09-12T17:41:59.574 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:41:59.291+0000 7fef42636640 10 monclient(hunting): get_auth_request con 0x564118846f50 auth_method 0 2024-09-12T17:41:59.574 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:41:59.291+0000 7fef42636640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.574 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:41:59.291+0000 7fef42636640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.574 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:41:59.291+0000 7fef42636640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.574 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:41:59.291+0000 7fef43638640 10 monclient(hunting): get_auth_request con 0x5641188478c0 auth_method 0 2024-09-12T17:41:59.575 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:41:59.291+0000 7fef43638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.575 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:41:59.291+0000 7fef43638640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.575 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:41:59.291+0000 7fef43638640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.575 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:41:59.291+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.575 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:41:59.291+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.575 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:41:59.291+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.575 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:41:59.291+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.575 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:41:59.291+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.575 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:41:59.291+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.575 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:41:59.291+0000 7fef42636640 10 monclient(hunting): handle_auth_done global_id 6459 payload 824 2024-09-12T17:41:59.575 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:41:59.292+0000 7fef42636640 10 monclient: _finish_hunting 0 2024-09-12T17:41:59.575 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:41:59.292+0000 7fef42636640 1 monclient: found mon.noname-a 2024-09-12T17:41:59.575 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:41:59.292+0000 7fef42636640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:41:59.576 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.576 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:41:59.576 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: dump: 2024-09-12T17:41:59.576 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.576 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.576 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.576 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.576 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.576 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.576 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.576 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.576 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.577 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.577 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: _finish_auth 0 2024-09-12T17:41:59.577 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: _check_auth_tickets 2024-09-12T17:41:59.577 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:59.577 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.577 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:41:59.577 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: dump: 2024-09-12T17:41:59.577 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.577 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.577 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.577 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.577 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.577 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.578 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.578 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.578 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.578 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.578 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:41:59.292+0000 7fef45346800 5 monclient: authenticate success, global_id 6459 2024-09-12T17:41:59.578 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:41:59.292+0000 7fef45346800 10 monclient: _renew_subs 2024-09-12T17:41:59.578 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:41:59.292+0000 7fef45346800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:41:59.578 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:41:59.292+0000 7fee30e09640 4 set_mon_vals no callback set 2024-09-12T17:41:59.578 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:41:59.292+0000 7fef45346800 10 monclient: _renew_subs 2024-09-12T17:41:59.578 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:41:59.292+0000 7fef45346800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:41:59.578 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:41:59.292+0000 7fef45346800 1 librados: init done 2024-09-12T17:41:59.578 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:41:59.294+0000 7fee2f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:41:59.578 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:41:59.294+0000 7fee2f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:41:59.579 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:41:59.294+0000 7fee2f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:41:59.579 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:41:59.294+0000 7fef42e37640 10 monclient: get_auth_request con 0x7fee28076470 auth_method 0 2024-09-12T17:41:59.579 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:41:59.294+0000 7fef43638640 10 monclient: get_auth_request con 0x5641189262e0 auth_method 0 2024-09-12T17:41:59.579 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:41:59.295+0000 7fef42e37640 10 monclient: get_auth_request con 0x564118949350 auth_method 0 2024-09-12T17:41:59.579 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:41:59.297+0000 7fef42636640 10 monclient: get_auth_request con 0x56411894e3e0 auth_method 0 2024-09-12T17:41:59.579 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:41:59.298+0000 7fef45346800 10 monclient: build_initial_monmap 2024-09-12T17:41:59.579 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:41:59.298+0000 7fef45346800 1 build_initial for_mkfs: 0 2024-09-12T17:41:59.579 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:41:59.298+0000 7fef45346800 10 monclient: monmap: 2024-09-12T17:41:59.579 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:41:59.579 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:41:59.579 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:41:59.579 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:41:59.579 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:41:59.580 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.580 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:41:59.580 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:41:59.580 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:41:59.580 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.580 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding auth protocol: cephx 2024-09-12T17:41:59.580 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding auth protocol: cephx 2024-09-12T17:41:59.580 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding auth protocol: cephx 2024-09-12T17:41:59.580 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: secure 2024-09-12T17:41:59.580 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: crc 2024-09-12T17:41:59.580 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: secure 2024-09-12T17:41:59.580 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: crc 2024-09-12T17:41:59.580 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: secure 2024-09-12T17:41:59.581 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: crc 2024-09-12T17:41:59.581 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: crc 2024-09-12T17:41:59.581 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: secure 2024-09-12T17:41:59.581 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: crc 2024-09-12T17:41:59.581 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: secure 2024-09-12T17:41:59.581 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: crc 2024-09-12T17:41:59.581 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: secure 2024-09-12T17:41:59.581 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:41:59.298+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.581 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:41:59.298+0000 7fef45346800 5 asok(0x5641186d9730) register_command objecter_requests cmddesc objecter_requests hook 0x564118955c60 EEXIST 2024-09-12T17:41:59.581 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:41:59.298+0000 7fef45346800 10 monclient: init 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding auth protocol: cephx 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding auth protocol: cephx 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding auth protocol: cephx 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: secure 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: crc 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: secure 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: crc 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: secure 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: crc 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: crc 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: secure 2024-09-12T17:41:59.582 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: crc 2024-09-12T17:41:59.583 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: secure 2024-09-12T17:41:59.583 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: crc 2024-09-12T17:41:59.583 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: secure 2024-09-12T17:41:59.583 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:41:59.298+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.583 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:41:59.299+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.583 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:41:59.299+0000 7fef45346800 5 asok(0x5641186d9730) register_command rotate-key cmddesc rotate-key hook 0x5641189513b0 EEXIST 2024-09-12T17:41:59.583 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient: _reopen_session rank -1 2024-09-12T17:41:59.583 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:41:59.583 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient(hunting): picked mon.noname-c con 0x564118979950 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:41:59.583 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient(hunting): picked mon.noname-a con 0x56411897bc20 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:41:59.584 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient(hunting): picked mon.noname-b con 0x564118978120 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:41:59.584 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.584 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.584 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.584 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient(hunting): _renew_subs 2024-09-12T17:41:59.584 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient(hunting): authenticate will time out at 1891.936334s 2024-09-12T17:41:59.585 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient(hunting): get_auth_request con 0x564118979950 auth_method 0 2024-09-12T17:41:59.585 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.585 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.585 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.585 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:41:59.299+0000 7fef42636640 10 monclient(hunting): get_auth_request con 0x56411897bc20 auth_method 0 2024-09-12T17:41:59.585 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:41:59.299+0000 7fef42636640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.585 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:41:59.299+0000 7fef42636640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.585 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:41:59.299+0000 7fef42636640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.585 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:41:59.299+0000 7fef43638640 10 monclient(hunting): get_auth_request con 0x564118978120 auth_method 0 2024-09-12T17:41:59.585 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:41:59.299+0000 7fef43638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.585 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:41:59.299+0000 7fef43638640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:41:59.299+0000 7fef43638640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:41:59.299+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:41:59.299+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:41:59.299+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:41:59.299+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:41:59.299+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:41:59.299+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient(hunting): handle_auth_done global_id 6059 payload 824 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient: _finish_hunting 0 2024-09-12T17:41:59.586 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:41:59.299+0000 7fef42e37640 1 monclient: found mon.noname-c 2024-09-12T17:41:59.587 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:41:59.587 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.587 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:41:59.587 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: dump: 2024-09-12T17:41:59.587 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.587 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.587 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.587 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.587 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.587 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.587 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.587 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.587 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.587 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.588 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: _finish_auth 0 2024-09-12T17:41:59.588 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: _check_auth_tickets 2024-09-12T17:41:59.588 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:59.588 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.588 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:41:59.588 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: dump: 2024-09-12T17:41:59.588 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.588 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.588 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.589 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.589 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.589 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.589 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.589 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.589 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.589 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.589 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:41:59.300+0000 7fef45346800 5 monclient: authenticate success, global_id 6059 2024-09-12T17:41:59.589 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:41:59.300+0000 7fef45346800 10 monclient: _renew_subs 2024-09-12T17:41:59.589 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:41:59.300+0000 7fef45346800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:41:59.589 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:41:59.300+0000 7fef43e39640 4 set_mon_vals no callback set 2024-09-12T17:41:59.589 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:41:59.300+0000 7fef45346800 10 monclient: _renew_subs 2024-09-12T17:41:59.590 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:41:59.300+0000 7fef45346800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:41:59.590 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:41:59.302+0000 7fee2ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:41:59.590 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:41:59.302+0000 7fee2ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:41:59.590 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:41:59.302+0000 7fee2ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:41:59.590 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:41:59.302+0000 7fef42636640 10 monclient: get_auth_request con 0x7fee1c076380 auth_method 0 2024-09-12T17:41:59.590 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:41:59.302+0000 7fef45346800 10 monclient: get_monmap_and_config 2024-09-12T17:41:59.590 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:41:59.302+0000 7fef45346800 10 monclient: build_initial_monmap 2024-09-12T17:41:59.591 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:41:59.302+0000 7fef45346800 1 build_initial for_mkfs: 0 2024-09-12T17:41:59.591 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:41:59.302+0000 7fef45346800 10 monclient: monmap: 2024-09-12T17:41:59.591 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:41:59.591 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:41:59.591 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:41:59.591 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:41:59.591 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:41:59.591 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.592 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:41:59.592 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:41:59.592 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:41:59.592 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.592 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding auth protocol: cephx 2024-09-12T17:41:59.592 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding auth protocol: cephx 2024-09-12T17:41:59.592 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding auth protocol: cephx 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: secure 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: crc 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: secure 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: crc 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: secure 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: crc 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: crc 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: secure 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: crc 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: secure 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: crc 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: secure 2024-09-12T17:41:59.593 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:41:59.302+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.594 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:41:59.302+0000 7fef45346800 10 monclient: init 2024-09-12T17:41:59.594 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding auth protocol: cephx 2024-09-12T17:41:59.594 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding auth protocol: cephx 2024-09-12T17:41:59.594 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding auth protocol: cephx 2024-09-12T17:41:59.594 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: secure 2024-09-12T17:41:59.594 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: crc 2024-09-12T17:41:59.594 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: secure 2024-09-12T17:41:59.594 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: crc 2024-09-12T17:41:59.594 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: secure 2024-09-12T17:41:59.594 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: crc 2024-09-12T17:41:59.594 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: crc 2024-09-12T17:41:59.594 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: secure 2024-09-12T17:41:59.594 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: crc 2024-09-12T17:41:59.595 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: secure 2024-09-12T17:41:59.595 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: crc 2024-09-12T17:41:59.595 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: secure 2024-09-12T17:41:59.595 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:41:59.303+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.595 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:41:59.303+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.595 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:41:59.303+0000 7fef45346800 5 asok(0x5641186d9730) register_command rotate-key cmddesc rotate-key hook 0x7fff396468a8 EEXIST 2024-09-12T17:41:59.595 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient: _reopen_session rank -1 2024-09-12T17:41:59.595 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:41:59.595 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient(hunting): picked mon.noname-a con 0x5641189cdc60 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:41:59.595 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient(hunting): picked mon.noname-c con 0x56411899ebb0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:41:59.595 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient(hunting): picked mon.noname-b con 0x5641189c9500 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:41:59.595 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.595 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.596 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.596 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient(hunting): _renew_subs 2024-09-12T17:41:59.596 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient(hunting): authenticate will time out at 1891.940320s 2024-09-12T17:41:59.596 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient(hunting): get_auth_request con 0x5641189cdc60 auth_method 0 2024-09-12T17:41:59.596 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.596 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.596 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.596 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:41:59.303+0000 7fef42636640 10 monclient(hunting): get_auth_request con 0x56411899ebb0 auth_method 0 2024-09-12T17:41:59.596 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:41:59.303+0000 7fef42636640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.596 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:41:59.303+0000 7fef42636640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.596 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:41:59.303+0000 7fef42636640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:41:59.303+0000 7fef43638640 10 monclient(hunting): get_auth_request con 0x5641189c9500 auth_method 0 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:41:59.303+0000 7fef43638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:41:59.303+0000 7fef43638640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:41:59.303+0000 7fef43638640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:41:59.303+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:41:59.303+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:41:59.303+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:41:59.303+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:41:59.303+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.597 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:41:59.303+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient(hunting): handle_auth_done global_id 6465 payload 274 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient: _finish_hunting 0 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:41:59.303+0000 7fef42e37640 1 monclient: found mon.noname-a 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:41:59.303+0000 7fee267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:41:59.303+0000 7fee267fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:41:59.303+0000 7fee267fc640 10 monclient: dump: 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.598 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:41:59.303+0000 7fee267fc640 10 monclient: _finish_auth 0 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:41:59.303+0000 7fee267fc640 10 monclient: _check_auth_tickets 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:41:59.303+0000 7fef45346800 5 monclient: authenticate success, global_id 6465 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:41:59.303+0000 7fee267fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient: get_monmap_and_config success 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:41:59.303+0000 7fef45346800 4 set_mon_vals no callback set 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:41:59.303+0000 7fee267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:41:59.304+0000 7fee267fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:41:59.599 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:41:59.304+0000 7fee267fc640 10 monclient: dump: 2024-09-12T17:41:59.600 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.600 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.600 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.600 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.600 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.600 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.600 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.600 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.600 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.600 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.601 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:41:59.304+0000 7fef45346800 10 monclient: shutdown 2024-09-12T17:41:59.601 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:41:59.304+0000 7fef45346800 10 monclient: build_initial_monmap 2024-09-12T17:41:59.601 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:41:59.304+0000 7fef45346800 1 build_initial for_mkfs: 0 2024-09-12T17:41:59.601 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:41:59.304+0000 7fef45346800 10 monclient: monmap: 2024-09-12T17:41:59.601 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:41:59.601 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:41:59.601 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:41:59.601 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:41:59.602 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:41:59.602 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.602 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:41:59.602 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:41:59.602 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:41:59.602 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.602 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding auth protocol: cephx 2024-09-12T17:41:59.602 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding auth protocol: cephx 2024-09-12T17:41:59.602 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding auth protocol: cephx 2024-09-12T17:41:59.603 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: secure 2024-09-12T17:41:59.603 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: crc 2024-09-12T17:41:59.603 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: secure 2024-09-12T17:41:59.603 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: crc 2024-09-12T17:41:59.603 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: secure 2024-09-12T17:41:59.603 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: crc 2024-09-12T17:41:59.603 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: crc 2024-09-12T17:41:59.603 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: secure 2024-09-12T17:41:59.604 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: crc 2024-09-12T17:41:59.604 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: secure 2024-09-12T17:41:59.604 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: crc 2024-09-12T17:41:59.604 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: secure 2024-09-12T17:41:59.604 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:41:59.304+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.604 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:41:59.304+0000 7fef45346800 1 librados: starting msgr at 2024-09-12T17:41:59.604 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:41:59.304+0000 7fef45346800 1 librados: starting objecter 2024-09-12T17:41:59.604 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:41:59.305+0000 7fef45346800 5 asok(0x5641186d9730) register_command objecter_requests cmddesc objecter_requests hook 0x56411897fad0 EEXIST 2024-09-12T17:41:59.605 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:41:59.305+0000 7fef45346800 1 librados: setting wanted keys 2024-09-12T17:41:59.605 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:41:59.305+0000 7fef45346800 1 librados: calling monclient init 2024-09-12T17:41:59.605 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient: init 2024-09-12T17:41:59.605 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding auth protocol: cephx 2024-09-12T17:41:59.605 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding auth protocol: cephx 2024-09-12T17:41:59.605 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding auth protocol: cephx 2024-09-12T17:41:59.605 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: secure 2024-09-12T17:41:59.606 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: crc 2024-09-12T17:41:59.606 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: secure 2024-09-12T17:41:59.606 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: crc 2024-09-12T17:41:59.606 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: secure 2024-09-12T17:41:59.606 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: crc 2024-09-12T17:41:59.606 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: crc 2024-09-12T17:41:59.606 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: secure 2024-09-12T17:41:59.606 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: crc 2024-09-12T17:41:59.607 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: secure 2024-09-12T17:41:59.607 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: crc 2024-09-12T17:41:59.607 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: secure 2024-09-12T17:41:59.607 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:41:59.305+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.607 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:41:59.305+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.607 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:41:59.305+0000 7fef45346800 5 asok(0x5641186d9730) register_command rotate-key cmddesc rotate-key hook 0x564118991848 EEXIST 2024-09-12T17:41:59.607 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient: _reopen_session rank -1 2024-09-12T17:41:59.607 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient(hunting): picked mon.noname-b con 0x56411899ebb0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient(hunting): picked mon.noname-a con 0x5641189c9500 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient(hunting): picked mon.noname-c con 0x5641189cdc60 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient(hunting): _renew_subs 2024-09-12T17:41:59.608 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient(hunting): authenticate will time out at 1891.942742s 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:41:59.305+0000 7fef43638640 10 monclient(hunting): get_auth_request con 0x5641189cdc60 auth_method 0 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:41:59.305+0000 7fef43638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:41:59.305+0000 7fef43638640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:41:59.305+0000 7fef43638640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:41:59.305+0000 7fef42636640 10 monclient(hunting): get_auth_request con 0x5641189c9500 auth_method 0 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:41:59.305+0000 7fef42636640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:41:59.305+0000 7fef42636640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.609 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:41:59.305+0000 7fef42636640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.610 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:41:59.305+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.610 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:41:59.305+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.610 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:41:59.305+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.610 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:41:59.305+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.610 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:41:59.305+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.610 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:41:59.305+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.610 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:41:59.305+0000 7fef42e37640 10 monclient(hunting): get_auth_request con 0x56411899ebb0 auth_method 0 2024-09-12T17:41:59.610 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:41:59.305+0000 7fef42e37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.611 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:41:59.305+0000 7fef42e37640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.611 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:41:59.305+0000 7fef42e37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.611 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:41:59.306+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.611 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:41:59.306+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.611 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:41:59.306+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.611 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:41:59.306+0000 7fef43638640 10 monclient(hunting): handle_auth_done global_id 6065 payload 824 2024-09-12T17:41:59.611 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:41:59.306+0000 7fef43638640 10 monclient: _finish_hunting 0 2024-09-12T17:41:59.611 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:41:59.306+0000 7fef43638640 1 monclient: found mon.noname-c 2024-09-12T17:41:59.612 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:41:59.306+0000 7fef43638640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:41:59.612 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.612 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:41:59.612 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: dump: 2024-09-12T17:41:59.612 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.612 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.612 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.612 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.613 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.613 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.613 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.613 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.613 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.613 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.613 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: _finish_auth 0 2024-09-12T17:41:59.613 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:41:59.614 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:59.614 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.614 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:41:59.614 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: dump: 2024-09-12T17:41:59.614 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.614 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.614 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.615 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.615 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.615 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.615 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.615 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.616 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.616 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.616 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:41:59.306+0000 7fef45346800 5 monclient: authenticate success, global_id 6065 2024-09-12T17:41:59.616 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:41:59.306+0000 7fee267fc640 4 set_mon_vals no callback set 2024-09-12T17:41:59.616 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:41:59.306+0000 7fef45346800 10 monclient: _renew_subs 2024-09-12T17:41:59.616 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:41:59.306+0000 7fef45346800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:41:59.616 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:41:59.306+0000 7fef45346800 10 monclient: _renew_subs 2024-09-12T17:41:59.616 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:41:59.306+0000 7fef45346800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:41:59.306+0000 7fef45346800 1 librados: init done 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:41:59.306+0000 7fef45346800 5 asok(0x5641186d9730) register_command cr dump hook 0x5641189bf2c8 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:41:59.308+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:41:59.308+0000 7fee24ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:41:59.308+0000 7fee24ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:41:59.308+0000 7fee24ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:41:59.309+0000 7fef42e37640 10 monclient: get_auth_request con 0x7fee0c0764a0 auth_method 0 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:41:59.309+0000 7fef42636640 10 monclient: get_auth_request con 0x5641189e7fc0 auth_method 0 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:41:59.309+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:41:59.309+0000 7fef45346800 20 realm 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:41:59.309+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:41:59.309+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.617 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:41:59.309+0000 7fef45346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:59.618 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:41:59.309+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.618 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:41:59.310+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.618 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:41:59.310+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.618 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:41:59.310+0000 7fef42e37640 10 monclient: get_auth_request con 0x5641189ec210 auth_method 0 2024-09-12T17:41:59.618 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:41:59.310+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:59.618 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:41:59.310+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.618 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:41:59.311+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:59.618 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:41:59.311+0000 7fef45346800 20 searching for the correct realm 2024-09-12T17:41:59.618 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:41:59.311+0000 7fef42636640 10 monclient: get_auth_request con 0x5641189f14a0 auth_method 0 2024-09-12T17:41:59.618 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:41:59.312+0000 7fef43638640 10 monclient: get_auth_request con 0x7fef38073030 auth_method 0 2024-09-12T17:41:59.618 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:41:59.312+0000 7fef42e37640 10 monclient: get_auth_request con 0x7fef3c066820 auth_method 0 2024-09-12T17:41:59.618 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:41:59.313+0000 7fef42636640 10 monclient: get_auth_request con 0x7fef3400e040 auth_method 0 2024-09-12T17:41:59.618 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:41:59.314+0000 7fef42636640 0 -- 172.21.15.44:0/2249472983 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fef3400e040 msgr2=0x7fef34066030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:59.619 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:41:59.314+0000 7fee24ff9640 1 client.6065.objecter ms_handle_reset 0x7fef3400e040 session 0x7fef3401adc0 osd.4 2024-09-12T17:41:59.619 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:41:59.314+0000 7fee24ff9640 10 monclient: _renew_subs 2024-09-12T17:41:59.619 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:41:59.314+0000 7fee24ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:41:59.619 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:41:59.314+0000 7fef42636640 10 monclient: get_auth_request con 0x7fee0c0862c0 auth_method 0 2024-09-12T17:41:59.619 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:41:59.315+0000 7fef43638640 10 monclient: get_auth_request con 0x7fef380d0040 auth_method 0 2024-09-12T17:41:59.619 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:41:59.317+0000 7fef42e37640 10 monclient: get_auth_request con 0x7fef38082040 auth_method 0 2024-09-12T17:41:59.619 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:41:59.317+0000 7fef42e37640 0 -- 172.21.15.44:0/2249472983 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fef38082040 msgr2=0x7fef380a90b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:59.619 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:41:59.518+0000 7fef42e37640 10 monclient: get_auth_request con 0x7fef38082040 auth_method 0 2024-09-12T17:41:59.619 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:59.619 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:59.619 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:59.619 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:59.619 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:59.620 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:59.620 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:41:59.523+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.620 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:41:59.523+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.620 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:41:59.523+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.620 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:41:59.524+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:59.620 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:41:59.524+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.620 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:41:59.524+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:59.620 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:41:59.524+0000 7fef45346800 20 zone default found 2024-09-12T17:41:59.620 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:41:59.524+0000 7fef45346800 4 Realm: () 2024-09-12T17:41:59.620 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:41:59.524+0000 7fef45346800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:59.620 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:41:59.524+0000 7fef45346800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:59.620 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:41:59.524+0000 7fef45346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:59.620 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:41:59.524+0000 7fef45346800 20 zonegroup default 2024-09-12T17:41:59.621 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:41:59.524+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.621 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:41:59.525+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.621 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:41:59.525+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.621 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:41:59.525+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.621 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:41:59.525+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.621 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:41:59.525+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.621 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:41:59.525+0000 7fef45346800 20 started sync module instance, tier type = 2024-09-12T17:41:59.621 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:41:59.525+0000 7fef45346800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:59.621 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=0 2024-09-12T17:41:59.621 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=1 2024-09-12T17:41:59.621 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=2 2024-09-12T17:41:59.621 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=3 2024-09-12T17:41:59.622 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=4 2024-09-12T17:41:59.622 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=5 2024-09-12T17:41:59.622 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=6 2024-09-12T17:41:59.622 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:41:59.535+0000 7fef45346800 20 add_watcher() i=7 2024-09-12T17:41:59.622 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:41:59.535+0000 7fef45346800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:59.622 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding auth protocol: cephx 2024-09-12T17:41:59.622 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding auth protocol: cephx 2024-09-12T17:41:59.622 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding auth protocol: cephx 2024-09-12T17:41:59.622 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: secure 2024-09-12T17:41:59.623 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: crc 2024-09-12T17:41:59.623 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: secure 2024-09-12T17:41:59.623 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: crc 2024-09-12T17:41:59.623 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: secure 2024-09-12T17:41:59.623 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: crc 2024-09-12T17:41:59.623 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: crc 2024-09-12T17:41:59.623 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: secure 2024-09-12T17:41:59.623 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: crc 2024-09-12T17:41:59.623 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: secure 2024-09-12T17:41:59.623 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: crc 2024-09-12T17:41:59.623 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: secure 2024-09-12T17:41:59.623 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:41:59.537+0000 7fedf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:41:59.537+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:41:59.537+0000 7fef45346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:41:59.537+0000 7fef45346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:41:59.537+0000 7fef45346800 5 asok(0x5641186d9730) register_command cache list hook 0x56411899cd30 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:41:59.537+0000 7fef45346800 5 asok(0x5641186d9730) register_command cache inspect hook 0x56411899cd30 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:41:59.537+0000 7fef45346800 5 asok(0x5641186d9730) register_command cache erase hook 0x56411899cd30 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:41:59.537+0000 7fef45346800 5 asok(0x5641186d9730) register_command cache zap hook 0x56411899cd30 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:41:59.537+0000 7fef45346800 5 note: GC not initialized 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:41:59.537+0000 7fed73fff640 20 reqs_thread_entry: start 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:41:59.537+0000 7fef45346800 5 asok(0x5641186d9730) register_command sync trace show hook 0x7fef3c00a620 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:41:59.537+0000 7fef45346800 5 asok(0x5641186d9730) register_command sync trace history hook 0x7fef3c00a620 2024-09-12T17:41:59.624 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:41:59.537+0000 7fef45346800 5 asok(0x5641186d9730) register_command sync trace active hook 0x7fef3c00a620 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:41:59.537+0000 7fef45346800 5 asok(0x5641186d9730) register_command sync trace active_short hook 0x7fef3c00a620 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:41:59.537+0000 7fef45346800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:41:59.537+0000 7fef45346800 20 Filter name: none 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:41:59.538+0000 7fed71ffb640 20 reqs_thread_entry: start 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:41:59.538+0000 7fef45346800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:41:59.538+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:41:59.538+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:41:59.538+0000 7fef45346800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:41:59.538+0000 7fef45346800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:41:59.538+0000 7fef45346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 : miss 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:41:59.538+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:41:59.538+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:41:59.625 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:41:59.538+0000 7fef45346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 info.flags=0x17 2024-09-12T17:41:59.626 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:41:59.538+0000 7fef45346800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 to cache LRU end 2024-09-12T17:41:59.626 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:41:59.538+0000 7fef45346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:59.626 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:41:59.538+0000 7fef45346800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:59.626 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:41:59.538+0000 7fef45346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 2024-09-12T17:41:59.626 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:41:59.541+0000 7fef45346800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fef45346800 time 2024-09-12T17:41:59.541724+0000 2024-09-12T17:41:59.626 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:41:59.626 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.626 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:41:59.626 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fef4898c71a] 2024-09-12T17:41:59.626 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fef4898c8d8] 2024-09-12T17:41:59.626 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641161cb841] 2024-09-12T17:41:59.626 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd73b64) [0x5641166d8b64] 2024-09-12T17:41:59.627 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5641161db50d] 2024-09-12T17:41:59.627 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:41:59.627 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fef47629590] 2024-09-12T17:41:59.627 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:41:59.627 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:41:59.627 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.627 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:41:59.541+0000 7fef45346800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:41:59.627 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7fef45346800 thread_name:radosgw-admin 2024-09-12T17:41:59.627 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.627 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:41:59.627 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fef4763e6f0] 2024-09-12T17:41:59.627 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fef4768b99c] 2024-09-12T17:41:59.627 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:41:59.628 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:41:59.628 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fef4898c774] 2024-09-12T17:41:59.628 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fef4898c8d8] 2024-09-12T17:41:59.628 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641161cb841] 2024-09-12T17:41:59.628 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd73b64) [0x5641166d8b64] 2024-09-12T17:41:59.628 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5641161db50d] 2024-09-12T17:41:59.628 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:41:59.628 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fef47629590] 2024-09-12T17:41:59.628 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:41:59.628 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:41:59.628 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:41:59.629 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.629 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:41:59.629 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:41:59.629 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:41:59.629 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:41:59.629 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:41:59.629 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:41:59.629 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:41:59.629 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:41:59.629 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:41:59.629 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:41:59.629 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:41:59.629 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:41:59.630 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:41:59.630 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:41:59.630 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:41:59.630 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:41:59.630 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:41:59.630 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:41:59.630 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:41:59.630 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:41:59.630 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:41:59.630 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:41:59.630 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:41:59.630 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:41:59.630 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:41:59.631 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:41:59.631 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:41:59.631 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:41:59.631 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:41:59.631 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:41:59.631 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:41:59.631 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:41:59.631 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:41:59.631 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:41:59.631 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:41:59.631 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:41:59.631 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:41:59.632 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:41:59.632 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:41:59.632 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:41:59.632 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:41:59.632 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:41:59.632 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:41:59.632 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:41:59.632 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:41:59.632 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:41:59.632 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:41:59.632 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:41:59.632 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:41:59.632 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:41:59.633 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:41:59.633 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:41:59.633 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:41:59.633 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:41:59.633 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:41:59.633 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:41:59.633 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:41:59.633 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:41:59.633 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:41:59.633 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:41:59.633 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:41:59.633 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:41:59.634 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:41:59.634 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:41:59.634 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:41:59.634 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:41:59.634 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:41:59.634 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:41:59.634 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:41:59.634 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:41:59.634 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:41:59.634 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:41:59.634 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:41:59.634 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:41:59.634 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:41:59.635 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:41:59.635 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:41:59.635 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:41:59.635 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:41:59.635 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:41:59.635 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:41:59.635 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:41:59.635 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:41:59.635 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:41:59.635 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:41:59.635 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:41:59.635 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:41:59.635 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:41:59.636 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:41:59.636 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:41:59.636 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:41:59.636 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:41:59.636 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:41:59.636 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:41:59.636 INFO:tasks.workunit.client.0.smithi044.stderr: 7fed71ffb640 / http_manager 2024-09-12T17:41:59.636 INFO:tasks.workunit.client.0.smithi044.stderr: 7fed73fff640 / http_manager 2024-09-12T17:41:59.636 INFO:tasks.workunit.client.0.smithi044.stderr: 7fedf97e2640 / rgw_dt_lg_renew 2024-09-12T17:41:59.636 INFO:tasks.workunit.client.0.smithi044.stderr: 7fee24ff9640 / ms_dispatch 2024-09-12T17:41:59.636 INFO:tasks.workunit.client.0.smithi044.stderr: 7fee267fc640 / io_context_pool 2024-09-12T17:41:59.636 INFO:tasks.workunit.client.0.smithi044.stderr: 7fee2ce01640 / ms_dispatch 2024-09-12T17:41:59.637 INFO:tasks.workunit.client.0.smithi044.stderr: 7fee2f606640 / ms_dispatch 2024-09-12T17:41:59.637 INFO:tasks.workunit.client.0.smithi044.stderr: 7fee30e09640 / io_context_pool 2024-09-12T17:41:59.637 INFO:tasks.workunit.client.0.smithi044.stderr: 7fef42636640 / msgr-worker-2 2024-09-12T17:41:59.637 INFO:tasks.workunit.client.0.smithi044.stderr: 7fef42e37640 / msgr-worker-1 2024-09-12T17:41:59.637 INFO:tasks.workunit.client.0.smithi044.stderr: 7fef43638640 / msgr-worker-0 2024-09-12T17:41:59.637 INFO:tasks.workunit.client.0.smithi044.stderr: 7fef43e39640 / io_context_pool 2024-09-12T17:41:59.637 INFO:tasks.workunit.client.0.smithi044.stderr: 7fef45346800 / radosgw-admin 2024-09-12T17:41:59.637 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:41:59.637 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:41:59.637 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/log/ceph/ceph-client.admin.91450.log 2024-09-12T17:41:59.637 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:41:59.637 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:41:59.637 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:41:59.289+0000 7fef42636640 1 monclient: found mon.noname-a 2024-09-12T17:41:59.638 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:41:59.289+0000 7fef42636640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:41:59.638 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:41:59.289+0000 7fef42e37640 10 monclient: get_auth_request con 0x564118840940 auth_method 0 2024-09-12T17:41:59.638 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.638 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:41:59.638 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: dump: 2024-09-12T17:41:59.638 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.638 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.638 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.638 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.638 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.639 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.639 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.639 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.639 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.639 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.639 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: _finish_auth 0 2024-09-12T17:41:59.639 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: _check_auth_tickets 2024-09-12T17:41:59.639 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:59.639 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.639 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:41:59.639 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:41:59.289+0000 7fee30e09640 10 monclient: dump: 2024-09-12T17:41:59.640 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.640 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.640 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.640 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.640 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.640 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.640 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.640 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.641 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.641 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.641 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:41:59.289+0000 7fef45346800 5 monclient: authenticate success, global_id 6456 2024-09-12T17:41:59.641 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:41:59.289+0000 7fef45346800 10 monclient: get_monmap_and_config success 2024-09-12T17:41:59.641 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:41:59.289+0000 7fef45346800 4 set_mon_vals no callback set 2024-09-12T17:41:59.641 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:41:59.290+0000 7fef45346800 10 monclient: shutdown 2024-09-12T17:41:59.641 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:41:59.290+0000 7fef45346800 5 asok(0x5641186d9730) unregister_commands rotate-key 2024-09-12T17:41:59.641 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:41:59.290+0000 7fef45346800 10 monclient: build_initial_monmap 2024-09-12T17:41:59.641 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:41:59.290+0000 7fef45346800 1 build_initial for_mkfs: 0 2024-09-12T17:41:59.641 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:41:59.290+0000 7fef45346800 10 monclient: monmap: 2024-09-12T17:41:59.641 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:41:59.641 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:41:59.641 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:41:59.641 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:41:59.642 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:41:59.642 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.642 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:41:59.642 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:41:59.642 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:41:59.642 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.642 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding auth protocol: cephx 2024-09-12T17:41:59.642 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding auth protocol: cephx 2024-09-12T17:41:59.642 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding auth protocol: cephx 2024-09-12T17:41:59.642 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: secure 2024-09-12T17:41:59.642 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: crc 2024-09-12T17:41:59.642 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: secure 2024-09-12T17:41:59.642 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: crc 2024-09-12T17:41:59.643 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: secure 2024-09-12T17:41:59.643 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: crc 2024-09-12T17:41:59.643 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: crc 2024-09-12T17:41:59.643 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: secure 2024-09-12T17:41:59.643 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: crc 2024-09-12T17:41:59.643 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: secure 2024-09-12T17:41:59.643 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: crc 2024-09-12T17:41:59.643 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:41:59.290+0000 7fef45346800 5 AuthRegistry(0x564118903800) adding con mode: secure 2024-09-12T17:41:59.643 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:41:59.290+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.643 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:41:59.290+0000 7fef45346800 1 librados: starting msgr at 2024-09-12T17:41:59.643 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:41:59.290+0000 7fef45346800 1 librados: starting objecter 2024-09-12T17:41:59.643 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:41:59.291+0000 7fef45346800 5 asok(0x5641186d9730) register_command objecter_requests hook 0x5641188ff7e0 2024-09-12T17:41:59.644 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:41:59.291+0000 7fef45346800 1 librados: setting wanted keys 2024-09-12T17:41:59.644 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:41:59.291+0000 7fef45346800 1 librados: calling monclient init 2024-09-12T17:41:59.644 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient: init 2024-09-12T17:41:59.644 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding auth protocol: cephx 2024-09-12T17:41:59.644 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding auth protocol: cephx 2024-09-12T17:41:59.644 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding auth protocol: cephx 2024-09-12T17:41:59.644 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: secure 2024-09-12T17:41:59.644 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: crc 2024-09-12T17:41:59.644 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: secure 2024-09-12T17:41:59.644 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: crc 2024-09-12T17:41:59.644 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: secure 2024-09-12T17:41:59.644 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: crc 2024-09-12T17:41:59.644 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: crc 2024-09-12T17:41:59.645 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: secure 2024-09-12T17:41:59.645 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: crc 2024-09-12T17:41:59.645 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: secure 2024-09-12T17:41:59.645 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: crc 2024-09-12T17:41:59.645 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:41:59.291+0000 7fef45346800 5 AuthRegistry(0x5641188fe0a0) adding con mode: secure 2024-09-12T17:41:59.645 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:41:59.291+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.645 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:41:59.291+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.645 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:41:59.291+0000 7fef45346800 5 asok(0x5641186d9730) register_command rotate-key hook 0x5641188fe1e8 2024-09-12T17:41:59.645 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient: _reopen_session rank -1 2024-09-12T17:41:59.645 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:41:59.645 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient(hunting): picked mon.noname-b con 0x564118840940 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:41:59.645 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient(hunting): picked mon.noname-a con 0x564118846f50 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:41:59.645 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient(hunting): picked mon.noname-c con 0x5641188478c0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:41:59.646 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.646 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.646 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.646 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient(hunting): _renew_subs 2024-09-12T17:41:59.646 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:41:59.291+0000 7fef45346800 10 monclient(hunting): authenticate will time out at 1891.928650s 2024-09-12T17:41:59.646 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:41:59.291+0000 7fef42636640 10 monclient(hunting): get_auth_request con 0x564118846f50 auth_method 0 2024-09-12T17:41:59.646 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:41:59.291+0000 7fef42636640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.646 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:41:59.291+0000 7fef42636640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.646 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:41:59.291+0000 7fef42636640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.646 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:41:59.291+0000 7fef43638640 10 monclient(hunting): get_auth_request con 0x5641188478c0 auth_method 0 2024-09-12T17:41:59.646 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:41:59.291+0000 7fef43638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.646 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:41:59.291+0000 7fef43638640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.646 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:41:59.291+0000 7fef43638640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.647 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:41:59.291+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.647 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:41:59.291+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.647 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:41:59.291+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.647 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:41:59.291+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.647 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:41:59.291+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.647 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:41:59.291+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.647 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:41:59.291+0000 7fef42636640 10 monclient(hunting): handle_auth_done global_id 6459 payload 824 2024-09-12T17:41:59.647 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:41:59.292+0000 7fef42636640 10 monclient: _finish_hunting 0 2024-09-12T17:41:59.647 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:41:59.292+0000 7fef42636640 1 monclient: found mon.noname-a 2024-09-12T17:41:59.647 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:41:59.292+0000 7fef42636640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:41:59.647 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.647 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:41:59.647 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: dump: 2024-09-12T17:41:59.648 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.648 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.648 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.648 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.648 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.648 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.648 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.648 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.648 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.648 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.648 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: _finish_auth 0 2024-09-12T17:41:59.648 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: _check_auth_tickets 2024-09-12T17:41:59.648 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:59.649 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.649 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:41:59.649 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:41:59.292+0000 7fee2f606640 10 monclient: dump: 2024-09-12T17:41:59.649 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.649 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.649 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.649 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.649 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.649 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.649 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.649 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.649 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.649 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.650 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:41:59.292+0000 7fef45346800 5 monclient: authenticate success, global_id 6459 2024-09-12T17:41:59.650 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:41:59.292+0000 7fef45346800 10 monclient: _renew_subs 2024-09-12T17:41:59.650 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:41:59.292+0000 7fef45346800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:41:59.650 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:41:59.292+0000 7fee30e09640 4 set_mon_vals no callback set 2024-09-12T17:41:59.650 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:41:59.292+0000 7fef45346800 10 monclient: _renew_subs 2024-09-12T17:41:59.650 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:41:59.292+0000 7fef45346800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:41:59.650 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:41:59.292+0000 7fef45346800 1 librados: init done 2024-09-12T17:41:59.650 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:41:59.294+0000 7fee2f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:41:59.650 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:41:59.294+0000 7fee2f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:41:59.650 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:41:59.294+0000 7fee2f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:41:59.650 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:41:59.294+0000 7fef42e37640 10 monclient: get_auth_request con 0x7fee28076470 auth_method 0 2024-09-12T17:41:59.650 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:41:59.294+0000 7fef43638640 10 monclient: get_auth_request con 0x5641189262e0 auth_method 0 2024-09-12T17:41:59.650 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:41:59.295+0000 7fef42e37640 10 monclient: get_auth_request con 0x564118949350 auth_method 0 2024-09-12T17:41:59.651 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:41:59.297+0000 7fef42636640 10 monclient: get_auth_request con 0x56411894e3e0 auth_method 0 2024-09-12T17:41:59.651 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:41:59.298+0000 7fef45346800 10 monclient: build_initial_monmap 2024-09-12T17:41:59.651 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:41:59.298+0000 7fef45346800 1 build_initial for_mkfs: 0 2024-09-12T17:41:59.651 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:41:59.298+0000 7fef45346800 10 monclient: monmap: 2024-09-12T17:41:59.651 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:41:59.651 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:41:59.651 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:41:59.651 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:41:59.651 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:41:59.651 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.651 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:41:59.651 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:41:59.651 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:41:59.652 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.652 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding auth protocol: cephx 2024-09-12T17:41:59.652 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding auth protocol: cephx 2024-09-12T17:41:59.652 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding auth protocol: cephx 2024-09-12T17:41:59.652 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: secure 2024-09-12T17:41:59.652 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: crc 2024-09-12T17:41:59.652 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: secure 2024-09-12T17:41:59.652 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: crc 2024-09-12T17:41:59.652 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: secure 2024-09-12T17:41:59.652 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: crc 2024-09-12T17:41:59.652 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: crc 2024-09-12T17:41:59.652 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: secure 2024-09-12T17:41:59.652 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: crc 2024-09-12T17:41:59.653 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: secure 2024-09-12T17:41:59.653 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: crc 2024-09-12T17:41:59.653 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118952210) adding con mode: secure 2024-09-12T17:41:59.653 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:41:59.298+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.653 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:41:59.298+0000 7fef45346800 5 asok(0x5641186d9730) register_command objecter_requests cmddesc objecter_requests hook 0x564118955c60 EEXIST 2024-09-12T17:41:59.653 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:41:59.298+0000 7fef45346800 10 monclient: init 2024-09-12T17:41:59.653 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding auth protocol: cephx 2024-09-12T17:41:59.653 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding auth protocol: cephx 2024-09-12T17:41:59.653 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding auth protocol: cephx 2024-09-12T17:41:59.653 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: secure 2024-09-12T17:41:59.653 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: crc 2024-09-12T17:41:59.653 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: secure 2024-09-12T17:41:59.654 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: crc 2024-09-12T17:41:59.654 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: secure 2024-09-12T17:41:59.654 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: crc 2024-09-12T17:41:59.654 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: crc 2024-09-12T17:41:59.654 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: secure 2024-09-12T17:41:59.654 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: crc 2024-09-12T17:41:59.654 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: secure 2024-09-12T17:41:59.654 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: crc 2024-09-12T17:41:59.654 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:41:59.298+0000 7fef45346800 5 AuthRegistry(0x564118951268) adding con mode: secure 2024-09-12T17:41:59.654 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:41:59.298+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.654 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:41:59.299+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.654 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:41:59.299+0000 7fef45346800 5 asok(0x5641186d9730) register_command rotate-key cmddesc rotate-key hook 0x5641189513b0 EEXIST 2024-09-12T17:41:59.654 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient: _reopen_session rank -1 2024-09-12T17:41:59.655 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:41:59.655 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient(hunting): picked mon.noname-c con 0x564118979950 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:41:59.655 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient(hunting): picked mon.noname-a con 0x56411897bc20 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:41:59.655 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient(hunting): picked mon.noname-b con 0x564118978120 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:41:59.655 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.655 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.655 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.655 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient(hunting): _renew_subs 2024-09-12T17:41:59.655 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:41:59.299+0000 7fef45346800 10 monclient(hunting): authenticate will time out at 1891.936334s 2024-09-12T17:41:59.655 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient(hunting): get_auth_request con 0x564118979950 auth_method 0 2024-09-12T17:41:59.655 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.655 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.656 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.656 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:41:59.299+0000 7fef42636640 10 monclient(hunting): get_auth_request con 0x56411897bc20 auth_method 0 2024-09-12T17:41:59.656 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:41:59.299+0000 7fef42636640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.656 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:41:59.299+0000 7fef42636640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.656 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:41:59.299+0000 7fef42636640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.656 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:41:59.299+0000 7fef43638640 10 monclient(hunting): get_auth_request con 0x564118978120 auth_method 0 2024-09-12T17:41:59.656 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:41:59.299+0000 7fef43638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.656 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:41:59.299+0000 7fef43638640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.656 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:41:59.299+0000 7fef43638640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.656 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.656 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.656 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.656 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:41:59.299+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.657 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:41:59.299+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.657 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:41:59.299+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.657 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:41:59.299+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.657 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:41:59.299+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.657 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:41:59.299+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.657 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient(hunting): handle_auth_done global_id 6059 payload 824 2024-09-12T17:41:59.657 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient: _finish_hunting 0 2024-09-12T17:41:59.657 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:41:59.299+0000 7fef42e37640 1 monclient: found mon.noname-c 2024-09-12T17:41:59.657 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:41:59.299+0000 7fef42e37640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:41:59.657 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.657 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:41:59.657 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: dump: 2024-09-12T17:41:59.658 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.658 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.658 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.658 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.658 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.658 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.658 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.658 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.658 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.658 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.658 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: _finish_auth 0 2024-09-12T17:41:59.658 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: _check_auth_tickets 2024-09-12T17:41:59.658 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:59.659 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.659 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:41:59.659 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:41:59.300+0000 7fee2ce01640 10 monclient: dump: 2024-09-12T17:41:59.659 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.659 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.659 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.659 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.659 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.659 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.659 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.659 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.659 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.659 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.660 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:41:59.300+0000 7fef45346800 5 monclient: authenticate success, global_id 6059 2024-09-12T17:41:59.660 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:41:59.300+0000 7fef45346800 10 monclient: _renew_subs 2024-09-12T17:41:59.660 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:41:59.300+0000 7fef45346800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:41:59.660 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:41:59.300+0000 7fef43e39640 4 set_mon_vals no callback set 2024-09-12T17:41:59.660 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:41:59.300+0000 7fef45346800 10 monclient: _renew_subs 2024-09-12T17:41:59.660 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:41:59.300+0000 7fef45346800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:41:59.660 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:41:59.302+0000 7fee2ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:41:59.660 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:41:59.302+0000 7fee2ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:41:59.660 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:41:59.302+0000 7fee2ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:41:59.660 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:41:59.302+0000 7fef42636640 10 monclient: get_auth_request con 0x7fee1c076380 auth_method 0 2024-09-12T17:41:59.660 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:41:59.302+0000 7fef45346800 10 monclient: get_monmap_and_config 2024-09-12T17:41:59.660 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:41:59.302+0000 7fef45346800 10 monclient: build_initial_monmap 2024-09-12T17:41:59.661 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:41:59.302+0000 7fef45346800 1 build_initial for_mkfs: 0 2024-09-12T17:41:59.661 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:41:59.302+0000 7fef45346800 10 monclient: monmap: 2024-09-12T17:41:59.661 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:41:59.661 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:41:59.661 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:41:59.661 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:41:59.661 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:41:59.661 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.661 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:41:59.661 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:41:59.661 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:41:59.661 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.661 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding auth protocol: cephx 2024-09-12T17:41:59.662 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding auth protocol: cephx 2024-09-12T17:41:59.662 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding auth protocol: cephx 2024-09-12T17:41:59.662 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: secure 2024-09-12T17:41:59.662 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: crc 2024-09-12T17:41:59.662 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: secure 2024-09-12T17:41:59.662 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: crc 2024-09-12T17:41:59.662 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: secure 2024-09-12T17:41:59.662 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: crc 2024-09-12T17:41:59.662 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: crc 2024-09-12T17:41:59.662 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: secure 2024-09-12T17:41:59.662 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: crc 2024-09-12T17:41:59.662 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: secure 2024-09-12T17:41:59.662 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: crc 2024-09-12T17:41:59.663 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x564118999610) adding con mode: secure 2024-09-12T17:41:59.663 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:41:59.302+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.663 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:41:59.302+0000 7fef45346800 10 monclient: init 2024-09-12T17:41:59.663 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding auth protocol: cephx 2024-09-12T17:41:59.663 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding auth protocol: cephx 2024-09-12T17:41:59.663 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding auth protocol: cephx 2024-09-12T17:41:59.663 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: secure 2024-09-12T17:41:59.663 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: crc 2024-09-12T17:41:59.663 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: secure 2024-09-12T17:41:59.663 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: crc 2024-09-12T17:41:59.663 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: secure 2024-09-12T17:41:59.663 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: crc 2024-09-12T17:41:59.664 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: crc 2024-09-12T17:41:59.664 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: secure 2024-09-12T17:41:59.664 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: crc 2024-09-12T17:41:59.664 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: secure 2024-09-12T17:41:59.664 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: crc 2024-09-12T17:41:59.664 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:41:59.302+0000 7fef45346800 5 AuthRegistry(0x7fff39646760) adding con mode: secure 2024-09-12T17:41:59.664 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:41:59.303+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.664 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:41:59.303+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.664 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:41:59.303+0000 7fef45346800 5 asok(0x5641186d9730) register_command rotate-key cmddesc rotate-key hook 0x7fff396468a8 EEXIST 2024-09-12T17:41:59.664 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient: _reopen_session rank -1 2024-09-12T17:41:59.664 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:41:59.665 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient(hunting): picked mon.noname-a con 0x5641189cdc60 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:41:59.665 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient(hunting): picked mon.noname-c con 0x56411899ebb0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:41:59.665 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient(hunting): picked mon.noname-b con 0x5641189c9500 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:41:59.665 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.665 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.665 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.665 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient(hunting): _renew_subs 2024-09-12T17:41:59.665 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient(hunting): authenticate will time out at 1891.940320s 2024-09-12T17:41:59.665 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient(hunting): get_auth_request con 0x5641189cdc60 auth_method 0 2024-09-12T17:41:59.665 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.665 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.665 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.666 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:41:59.303+0000 7fef42636640 10 monclient(hunting): get_auth_request con 0x56411899ebb0 auth_method 0 2024-09-12T17:41:59.666 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:41:59.303+0000 7fef42636640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.666 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:41:59.303+0000 7fef42636640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.666 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:41:59.303+0000 7fef42636640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.666 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:41:59.303+0000 7fef43638640 10 monclient(hunting): get_auth_request con 0x5641189c9500 auth_method 0 2024-09-12T17:41:59.666 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:41:59.303+0000 7fef43638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.666 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:41:59.303+0000 7fef43638640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.666 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:41:59.303+0000 7fef43638640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.666 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.666 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.666 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.666 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:41:59.303+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.666 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:41:59.303+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.667 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:41:59.303+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.667 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:41:59.303+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.667 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:41:59.303+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.667 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:41:59.303+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.667 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient(hunting): handle_auth_done global_id 6465 payload 274 2024-09-12T17:41:59.667 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient: _finish_hunting 0 2024-09-12T17:41:59.667 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:41:59.303+0000 7fef42e37640 1 monclient: found mon.noname-a 2024-09-12T17:41:59.667 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:41:59.303+0000 7fef42e37640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:41:59.667 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:41:59.303+0000 7fee267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.667 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:41:59.303+0000 7fee267fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:41:59.667 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:41:59.303+0000 7fee267fc640 10 monclient: dump: 2024-09-12T17:41:59.667 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.667 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.667 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.668 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.668 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.668 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.668 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.668 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.668 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.668 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.668 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:41:59.303+0000 7fee267fc640 10 monclient: _finish_auth 0 2024-09-12T17:41:59.668 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:41:59.303+0000 7fee267fc640 10 monclient: _check_auth_tickets 2024-09-12T17:41:59.668 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:41:59.303+0000 7fef45346800 5 monclient: authenticate success, global_id 6465 2024-09-12T17:41:59.668 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:41:59.303+0000 7fee267fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:59.668 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:41:59.303+0000 7fef45346800 10 monclient: get_monmap_and_config success 2024-09-12T17:41:59.668 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:41:59.303+0000 7fef45346800 4 set_mon_vals no callback set 2024-09-12T17:41:59.669 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:41:59.303+0000 7fee267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.669 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:41:59.304+0000 7fee267fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:41:59.669 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:41:59.304+0000 7fee267fc640 10 monclient: dump: 2024-09-12T17:41:59.669 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.669 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.669 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.669 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.669 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.669 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.669 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.669 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.669 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.669 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.670 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:41:59.304+0000 7fef45346800 10 monclient: shutdown 2024-09-12T17:41:59.670 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:41:59.304+0000 7fef45346800 10 monclient: build_initial_monmap 2024-09-12T17:41:59.670 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:41:59.304+0000 7fef45346800 1 build_initial for_mkfs: 0 2024-09-12T17:41:59.670 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:41:59.304+0000 7fef45346800 10 monclient: monmap: 2024-09-12T17:41:59.670 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:41:59.670 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:41:59.670 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:41:59.670 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:41:59.670 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:41:59.670 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.670 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:41:59.670 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:41:59.670 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:41:59.671 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.671 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding auth protocol: cephx 2024-09-12T17:41:59.671 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding auth protocol: cephx 2024-09-12T17:41:59.671 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding auth protocol: cephx 2024-09-12T17:41:59.671 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: secure 2024-09-12T17:41:59.671 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: crc 2024-09-12T17:41:59.671 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: secure 2024-09-12T17:41:59.671 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: crc 2024-09-12T17:41:59.671 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: secure 2024-09-12T17:41:59.671 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: crc 2024-09-12T17:41:59.671 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: crc 2024-09-12T17:41:59.671 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: secure 2024-09-12T17:41:59.671 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: crc 2024-09-12T17:41:59.671 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: secure 2024-09-12T17:41:59.672 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: crc 2024-09-12T17:41:59.672 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:41:59.304+0000 7fef45346800 5 AuthRegistry(0x5641189c9c20) adding con mode: secure 2024-09-12T17:41:59.672 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:41:59.304+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.672 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:41:59.304+0000 7fef45346800 1 librados: starting msgr at 2024-09-12T17:41:59.672 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:41:59.304+0000 7fef45346800 1 librados: starting objecter 2024-09-12T17:41:59.672 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:41:59.305+0000 7fef45346800 5 asok(0x5641186d9730) register_command objecter_requests cmddesc objecter_requests hook 0x56411897fad0 EEXIST 2024-09-12T17:41:59.672 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:41:59.305+0000 7fef45346800 1 librados: setting wanted keys 2024-09-12T17:41:59.672 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:41:59.305+0000 7fef45346800 1 librados: calling monclient init 2024-09-12T17:41:59.672 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient: init 2024-09-12T17:41:59.672 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding auth protocol: cephx 2024-09-12T17:41:59.672 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding auth protocol: cephx 2024-09-12T17:41:59.672 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding auth protocol: cephx 2024-09-12T17:41:59.672 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: secure 2024-09-12T17:41:59.673 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: crc 2024-09-12T17:41:59.673 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: secure 2024-09-12T17:41:59.673 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: crc 2024-09-12T17:41:59.673 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: secure 2024-09-12T17:41:59.673 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: crc 2024-09-12T17:41:59.673 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: crc 2024-09-12T17:41:59.673 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: secure 2024-09-12T17:41:59.673 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: crc 2024-09-12T17:41:59.673 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: secure 2024-09-12T17:41:59.673 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: crc 2024-09-12T17:41:59.673 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:41:59.305+0000 7fef45346800 5 AuthRegistry(0x564118991700) adding con mode: secure 2024-09-12T17:41:59.673 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:41:59.305+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.673 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:41:59.305+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.674 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:41:59.305+0000 7fef45346800 5 asok(0x5641186d9730) register_command rotate-key cmddesc rotate-key hook 0x564118991848 EEXIST 2024-09-12T17:41:59.674 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient: _reopen_session rank -1 2024-09-12T17:41:59.674 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:41:59.674 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient(hunting): picked mon.noname-b con 0x56411899ebb0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:41:59.674 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient(hunting): picked mon.noname-a con 0x5641189c9500 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:41:59.674 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient(hunting): picked mon.noname-c con 0x5641189cdc60 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:41:59.674 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.674 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.674 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient(hunting): start opening mon connection 2024-09-12T17:41:59.674 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient(hunting): _renew_subs 2024-09-12T17:41:59.674 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:41:59.305+0000 7fef45346800 10 monclient(hunting): authenticate will time out at 1891.942742s 2024-09-12T17:41:59.674 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:41:59.305+0000 7fef43638640 10 monclient(hunting): get_auth_request con 0x5641189cdc60 auth_method 0 2024-09-12T17:41:59.674 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:41:59.305+0000 7fef43638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.675 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:41:59.305+0000 7fef43638640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.675 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:41:59.305+0000 7fef43638640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.675 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:41:59.305+0000 7fef42636640 10 monclient(hunting): get_auth_request con 0x5641189c9500 auth_method 0 2024-09-12T17:41:59.675 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:41:59.305+0000 7fef42636640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.675 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:41:59.305+0000 7fef42636640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.675 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:41:59.305+0000 7fef42636640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.675 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:41:59.305+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.675 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:41:59.305+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.675 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:41:59.305+0000 7fef43638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.675 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:41:59.305+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.675 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:41:59.305+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.675 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:41:59.305+0000 7fef42636640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.675 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:41:59.305+0000 7fef42e37640 10 monclient(hunting): get_auth_request con 0x56411899ebb0 auth_method 0 2024-09-12T17:41:59.676 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:41:59.305+0000 7fef42e37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:41:59.676 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:41:59.305+0000 7fef42e37640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:41:59.676 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:41:59.305+0000 7fef42e37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:41:59.676 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:41:59.306+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:41:59.676 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:41:59.306+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:41:59.676 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:41:59.306+0000 7fef42e37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:41:59.676 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:41:59.306+0000 7fef43638640 10 monclient(hunting): handle_auth_done global_id 6065 payload 824 2024-09-12T17:41:59.676 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:41:59.306+0000 7fef43638640 10 monclient: _finish_hunting 0 2024-09-12T17:41:59.676 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:41:59.306+0000 7fef43638640 1 monclient: found mon.noname-c 2024-09-12T17:41:59.676 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:41:59.306+0000 7fef43638640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:41:59.676 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.676 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:41:59.676 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: dump: 2024-09-12T17:41:59.677 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.677 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.677 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.677 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.677 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.677 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.677 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.677 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.677 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.677 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.677 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: _finish_auth 0 2024-09-12T17:41:59.677 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:41:59.677 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:41:59.678 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:41:59.678 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:41:59.678 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:41:59.306+0000 7fee24ff9640 10 monclient: dump: 2024-09-12T17:41:59.678 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:41:59.678 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:41:59.678 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.678 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:41:59.678 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:41:59.678 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:41:59.678 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:41:59.678 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:41:59.678 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:41:59.678 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.679 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:41:59.306+0000 7fef45346800 5 monclient: authenticate success, global_id 6065 2024-09-12T17:41:59.679 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:41:59.306+0000 7fee267fc640 4 set_mon_vals no callback set 2024-09-12T17:41:59.679 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:41:59.306+0000 7fef45346800 10 monclient: _renew_subs 2024-09-12T17:41:59.679 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:41:59.306+0000 7fef45346800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:41:59.679 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:41:59.306+0000 7fef45346800 10 monclient: _renew_subs 2024-09-12T17:41:59.679 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:41:59.306+0000 7fef45346800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:41:59.679 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:41:59.306+0000 7fef45346800 1 librados: init done 2024-09-12T17:41:59.679 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:41:59.306+0000 7fef45346800 5 asok(0x5641186d9730) register_command cr dump hook 0x5641189bf2c8 2024-09-12T17:41:59.679 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:41:59.308+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.679 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:41:59.308+0000 7fee24ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:41:59.679 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:41:59.308+0000 7fee24ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:41:59.679 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:41:59.308+0000 7fee24ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:41:59.680 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:41:59.309+0000 7fef42e37640 10 monclient: get_auth_request con 0x7fee0c0764a0 auth_method 0 2024-09-12T17:41:59.680 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:41:59.309+0000 7fef42636640 10 monclient: get_auth_request con 0x5641189e7fc0 auth_method 0 2024-09-12T17:41:59.680 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:41:59.309+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.680 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:41:59.309+0000 7fef45346800 20 realm 2024-09-12T17:41:59.680 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:41:59.309+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.680 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:41:59.309+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.680 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:41:59.309+0000 7fef45346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:59.680 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:41:59.309+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.680 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:41:59.310+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.680 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:41:59.310+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.680 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:41:59.310+0000 7fef42e37640 10 monclient: get_auth_request con 0x5641189ec210 auth_method 0 2024-09-12T17:41:59.680 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:41:59.310+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:59.680 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:41:59.310+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.681 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:41:59.311+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:59.681 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:41:59.311+0000 7fef45346800 20 searching for the correct realm 2024-09-12T17:41:59.681 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:41:59.311+0000 7fef42636640 10 monclient: get_auth_request con 0x5641189f14a0 auth_method 0 2024-09-12T17:41:59.681 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:41:59.312+0000 7fef43638640 10 monclient: get_auth_request con 0x7fef38073030 auth_method 0 2024-09-12T17:41:59.681 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:41:59.312+0000 7fef42e37640 10 monclient: get_auth_request con 0x7fef3c066820 auth_method 0 2024-09-12T17:41:59.681 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:41:59.313+0000 7fef42636640 10 monclient: get_auth_request con 0x7fef3400e040 auth_method 0 2024-09-12T17:41:59.681 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:41:59.314+0000 7fef42636640 0 -- 172.21.15.44:0/2249472983 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fef3400e040 msgr2=0x7fef34066030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:59.681 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:41:59.314+0000 7fee24ff9640 1 client.6065.objecter ms_handle_reset 0x7fef3400e040 session 0x7fef3401adc0 osd.4 2024-09-12T17:41:59.681 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:41:59.314+0000 7fee24ff9640 10 monclient: _renew_subs 2024-09-12T17:41:59.681 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:41:59.314+0000 7fee24ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:41:59.681 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:41:59.314+0000 7fef42636640 10 monclient: get_auth_request con 0x7fee0c0862c0 auth_method 0 2024-09-12T17:41:59.681 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:41:59.315+0000 7fef43638640 10 monclient: get_auth_request con 0x7fef380d0040 auth_method 0 2024-09-12T17:41:59.682 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:41:59.317+0000 7fef42e37640 10 monclient: get_auth_request con 0x7fef38082040 auth_method 0 2024-09-12T17:41:59.682 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:41:59.317+0000 7fef42e37640 0 -- 172.21.15.44:0/2249472983 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fef38082040 msgr2=0x7fef380a90b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:59.682 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:41:59.518+0000 7fef42e37640 10 monclient: get_auth_request con 0x7fef38082040 auth_method 0 2024-09-12T17:41:59.682 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:59.682 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:59.682 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:59.682 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:59.682 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:59.682 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:41:59.523+0000 7fef45346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:59.682 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:41:59.523+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.682 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:41:59.523+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.682 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:41:59.523+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.682 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:41:59.524+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:59.683 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:41:59.524+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.683 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:41:59.524+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:59.683 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:41:59.524+0000 7fef45346800 20 zone default found 2024-09-12T17:41:59.683 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:41:59.524+0000 7fef45346800 4 Realm: () 2024-09-12T17:41:59.683 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:41:59.524+0000 7fef45346800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:59.683 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:41:59.524+0000 7fef45346800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:59.683 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:41:59.524+0000 7fef45346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:59.683 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:41:59.524+0000 7fef45346800 20 zonegroup default 2024-09-12T17:41:59.683 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:41:59.524+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.683 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:41:59.525+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.683 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:41:59.525+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.683 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:41:59.525+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.683 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:41:59.525+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.684 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:41:59.525+0000 7fef45346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.684 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:41:59.525+0000 7fef45346800 20 started sync module instance, tier type = 2024-09-12T17:41:59.684 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:41:59.525+0000 7fef45346800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:59.684 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=0 2024-09-12T17:41:59.684 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=1 2024-09-12T17:41:59.684 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=2 2024-09-12T17:41:59.684 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=3 2024-09-12T17:41:59.684 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=4 2024-09-12T17:41:59.684 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=5 2024-09-12T17:41:59.684 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:41:59.534+0000 7fef45346800 20 add_watcher() i=6 2024-09-12T17:41:59.684 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:41:59.535+0000 7fef45346800 20 add_watcher() i=7 2024-09-12T17:41:59.684 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:41:59.535+0000 7fef45346800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:59.684 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding auth protocol: cephx 2024-09-12T17:41:59.685 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding auth protocol: cephx 2024-09-12T17:41:59.685 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding auth protocol: cephx 2024-09-12T17:41:59.685 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: secure 2024-09-12T17:41:59.685 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: crc 2024-09-12T17:41:59.685 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: secure 2024-09-12T17:41:59.685 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: crc 2024-09-12T17:41:59.685 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: secure 2024-09-12T17:41:59.685 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: crc 2024-09-12T17:41:59.685 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: crc 2024-09-12T17:41:59.685 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: secure 2024-09-12T17:41:59.685 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: crc 2024-09-12T17:41:59.685 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: secure 2024-09-12T17:41:59.685 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: crc 2024-09-12T17:41:59.686 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:41:59.537+0000 7fef45346800 5 AuthRegistry(0x7fff39646c30) adding con mode: secure 2024-09-12T17:41:59.686 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:41:59.537+0000 7fedf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:59.686 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:41:59.537+0000 7fef45346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:41:59.686 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:41:59.537+0000 7fef45346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:59.686 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:41:59.537+0000 7fef45346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:59.686 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:41:59.537+0000 7fef45346800 5 asok(0x5641186d9730) register_command cache list hook 0x56411899cd30 2024-09-12T17:41:59.686 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:41:59.537+0000 7fef45346800 5 asok(0x5641186d9730) register_command cache inspect hook 0x56411899cd30 2024-09-12T17:41:59.686 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:41:59.537+0000 7fef45346800 5 asok(0x5641186d9730) register_command cache erase hook 0x56411899cd30 2024-09-12T17:41:59.686 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:41:59.537+0000 7fef45346800 5 asok(0x5641186d9730) register_command cache zap hook 0x56411899cd30 2024-09-12T17:41:59.686 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:41:59.537+0000 7fef45346800 5 note: GC not initialized 2024-09-12T17:41:59.686 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:41:59.537+0000 7fed73fff640 20 reqs_thread_entry: start 2024-09-12T17:41:59.686 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:41:59.537+0000 7fef45346800 5 asok(0x5641186d9730) register_command sync trace show hook 0x7fef3c00a620 2024-09-12T17:41:59.687 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:41:59.537+0000 7fef45346800 5 asok(0x5641186d9730) register_command sync trace history hook 0x7fef3c00a620 2024-09-12T17:41:59.687 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:41:59.537+0000 7fef45346800 5 asok(0x5641186d9730) register_command sync trace active hook 0x7fef3c00a620 2024-09-12T17:41:59.687 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:41:59.537+0000 7fef45346800 5 asok(0x5641186d9730) register_command sync trace active_short hook 0x7fef3c00a620 2024-09-12T17:41:59.687 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:41:59.537+0000 7fef45346800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:59.687 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:41:59.537+0000 7fef45346800 20 Filter name: none 2024-09-12T17:41:59.687 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:41:59.538+0000 7fed71ffb640 20 reqs_thread_entry: start 2024-09-12T17:41:59.687 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:41:59.538+0000 7fef45346800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:41:59.687 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:41:59.538+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.687 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:41:59.538+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:41:59.687 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:41:59.538+0000 7fef45346800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:41:59.687 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:41:59.538+0000 7fef45346800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:41:59.687 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:41:59.538+0000 7fef45346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 : miss 2024-09-12T17:41:59.687 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:41:59.538+0000 7fef45346800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.688 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:41:59.538+0000 7fef45346800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:41:59.688 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:41:59.538+0000 7fef45346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 info.flags=0x17 2024-09-12T17:41:59.688 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:41:59.538+0000 7fef45346800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 to cache LRU end 2024-09-12T17:41:59.688 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:41:59.538+0000 7fef45346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:59.688 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:41:59.538+0000 7fef45346800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:41:59.688 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:41:59.538+0000 7fef45346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 2024-09-12T17:41:59.688 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:41:59.541+0000 7fef45346800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fef45346800 time 2024-09-12T17:41:59.541724+0000 2024-09-12T17:41:59.688 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:41:59.688 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.688 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:41:59.688 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fef4898c71a] 2024-09-12T17:41:59.688 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fef4898c8d8] 2024-09-12T17:41:59.688 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641161cb841] 2024-09-12T17:41:59.689 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd73b64) [0x5641166d8b64] 2024-09-12T17:41:59.689 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5641161db50d] 2024-09-12T17:41:59.689 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:41:59.689 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fef47629590] 2024-09-12T17:41:59.689 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:41:59.689 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:41:59.689 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.689 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:41:59.541+0000 7fef45346800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:41:59.689 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7fef45346800 thread_name:radosgw-admin 2024-09-12T17:41:59.689 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.689 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:41:59.689 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fef4763e6f0] 2024-09-12T17:41:59.689 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fef4768b99c] 2024-09-12T17:41:59.690 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:41:59.690 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:41:59.690 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fef4898c774] 2024-09-12T17:41:59.690 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fef4898c8d8] 2024-09-12T17:41:59.690 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641161cb841] 2024-09-12T17:41:59.690 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd73b64) [0x5641166d8b64] 2024-09-12T17:41:59.690 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5641161db50d] 2024-09-12T17:41:59.690 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:41:59.690 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fef47629590] 2024-09-12T17:41:59.690 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:41:59.690 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:41:59.690 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:41:59.690 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.691 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:41:59.691 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:41:59.691 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:41:59.691 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:41:59.691 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:41:59.691 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:41:59.691 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:41:59.691 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:41:59.691 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:41:59.691 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:41:59.691 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:41:59.691 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:41:59.691 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:41:59.692 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:41:59.692 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:41:59.692 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:41:59.692 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:41:59.692 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:41:59.692 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:41:59.692 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:41:59.692 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:41:59.692 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:41:59.692 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:41:59.692 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:41:59.692 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:41:59.693 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:41:59.693 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:41:59.693 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:41:59.693 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:41:59.693 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:41:59.693 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:41:59.693 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:41:59.693 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:41:59.693 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:41:59.693 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:41:59.693 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:41:59.693 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:41:59.693 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:41:59.694 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:41:59.694 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:41:59.694 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:41:59.694 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:41:59.694 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:41:59.694 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:41:59.694 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:41:59.694 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:41:59.694 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:41:59.694 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:41:59.694 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:41:59.694 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:41:59.694 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:41:59.695 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:41:59.695 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:41:59.695 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:41:59.695 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:41:59.695 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:41:59.695 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:41:59.695 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:41:59.695 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:41:59.695 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:41:59.695 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:41:59.695 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:41:59.695 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:41:59.695 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:41:59.695 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:41:59.696 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:41:59.696 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:41:59.696 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:41:59.696 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:41:59.696 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:41:59.696 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:41:59.696 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:41:59.696 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:41:59.696 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:41:59.696 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:41:59.696 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:41:59.696 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:41:59.696 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:41:59.697 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:41:59.697 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:41:59.697 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:41:59.697 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:41:59.697 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:41:59.697 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:41:59.697 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:41:59.697 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:41:59.697 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:41:59.697 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:41:59.697 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:41:59.697 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:41:59.697 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:41:59.698 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:41:59.698 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:41:59.698 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:41:59.698 INFO:tasks.workunit.client.0.smithi044.stderr: 7fed71ffb640 / http_manager 2024-09-12T17:41:59.698 INFO:tasks.workunit.client.0.smithi044.stderr: 7fed73fff640 / http_manager 2024-09-12T17:41:59.698 INFO:tasks.workunit.client.0.smithi044.stderr: 7fedf97e2640 / rgw_dt_lg_renew 2024-09-12T17:41:59.698 INFO:tasks.workunit.client.0.smithi044.stderr: 7fee24ff9640 / ms_dispatch 2024-09-12T17:41:59.698 INFO:tasks.workunit.client.0.smithi044.stderr: 7fee267fc640 / io_context_pool 2024-09-12T17:41:59.698 INFO:tasks.workunit.client.0.smithi044.stderr: 7fee2ce01640 / ms_dispatch 2024-09-12T17:41:59.698 INFO:tasks.workunit.client.0.smithi044.stderr: 7fee2f606640 / ms_dispatch 2024-09-12T17:41:59.698 INFO:tasks.workunit.client.0.smithi044.stderr: 7fee30e09640 / io_context_pool 2024-09-12T17:41:59.698 INFO:tasks.workunit.client.0.smithi044.stderr: 7fef42636640 / msgr-worker-2 2024-09-12T17:41:59.698 INFO:tasks.workunit.client.0.smithi044.stderr: 7fef42e37640 / msgr-worker-1 2024-09-12T17:41:59.698 INFO:tasks.workunit.client.0.smithi044.stderr: 7fef43638640 / msgr-worker-0 2024-09-12T17:41:59.699 INFO:tasks.workunit.client.0.smithi044.stderr: 7fef43e39640 / io_context_pool 2024-09-12T17:41:59.699 INFO:tasks.workunit.client.0.smithi044.stderr: 7fef45346800 / radosgw-admin 2024-09-12T17:41:59.699 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:41:59.699 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:41:59.699 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:41:59.543432Z_abdb0ae5-780e-440d-813f-ccf0ed2a7846/log 2024-09-12T17:41:59.699 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:41:59.699 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:41:59.704 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:59.704 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:59.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.621+0000 7f415042f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.623+0000 7f415042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.623+0000 7f415042f800 20 realm 2024-09-12T17:41:59.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.623+0000 7f415042f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.623+0000 7f415042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.623+0000 7f415042f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.623+0000 7f415042f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.623+0000 7f415042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.623+0000 7f415042f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.624+0000 7f415042f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.624+0000 7f415042f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.624+0000 7f415042f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.624+0000 7f415042f800 20 searching for the correct realm 2024-09-12T17:41:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.628+0000 7f414d718640 0 -- 172.21.15.44:0/1721951298 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f4140081040 msgr2=0x7f414008e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.632+0000 7f414d718640 0 -- 172.21.15.44:0/1721951298 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f4018086210 msgr2=0x7f4018088640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.635+0000 7f415042f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:41:59.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.635+0000 7f415042f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:41:59.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.635+0000 7f415042f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:59.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.635+0000 7f415042f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:59.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.635+0000 7f415042f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:59.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.635+0000 7f415042f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:59.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.635+0000 7f415042f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.635+0000 7f415042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.635+0000 7f415042f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.636+0000 7f415042f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:59.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.636+0000 7f415042f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.636+0000 7f415042f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:59.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.636+0000 7f415042f800 20 zone default found 2024-09-12T17:41:59.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.636+0000 7f415042f800 4 Realm: () 2024-09-12T17:41:59.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.636+0000 7f415042f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:41:59.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.636+0000 7f415042f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:41:59.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.636+0000 7f415042f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:59.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.636+0000 7f415042f800 20 zonegroup default 2024-09-12T17:41:59.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.636+0000 7f415042f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.636+0000 7f415042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.636+0000 7f415042f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.636+0000 7f415042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.636+0000 7f415042f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.637+0000 7f415042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.637+0000 7f415042f800 20 started sync module instance, tier type = 2024-09-12T17:41:59.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.637+0000 7f415042f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:41:59.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.646+0000 7f415042f800 20 add_watcher() i=0 2024-09-12T17:41:59.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.646+0000 7f415042f800 20 add_watcher() i=1 2024-09-12T17:41:59.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.646+0000 7f415042f800 20 add_watcher() i=2 2024-09-12T17:41:59.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.646+0000 7f415042f800 20 add_watcher() i=3 2024-09-12T17:41:59.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.646+0000 7f415042f800 20 add_watcher() i=4 2024-09-12T17:41:59.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.646+0000 7f415042f800 20 add_watcher() i=5 2024-09-12T17:41:59.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.646+0000 7f415042f800 20 add_watcher() i=6 2024-09-12T17:41:59.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.647+0000 7f415042f800 20 add_watcher() i=7 2024-09-12T17:41:59.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.647+0000 7f415042f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:59.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.648+0000 7f4003fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:59.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.649+0000 7f415042f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:59.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.649+0000 7f415042f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:59.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.649+0000 7f415042f800 5 note: GC not initialized 2024-09-12T17:41:59.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.649+0000 7f4002fe5640 20 reqs_thread_entry: start 2024-09-12T17:41:59.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.649+0000 7f415042f800 20 init_complete bucket index max shards: 11 2024-09-12T17:41:59.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.649+0000 7f415042f800 20 Filter name: none 2024-09-12T17:41:59.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.649+0000 7f4000fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:59.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.649+0000 7f415042f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.650+0000 7f415042f800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:41:59.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.650+0000 7f415042f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.650+0000 7f415042f800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:41:59.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.650+0000 7f415042f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:59.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.650+0000 7f415042f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.650+0000 7f415042f800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:41:59.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.650+0000 7f415042f800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.651+0000 7f415042f800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:41:59.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.651+0000 7f415042f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:59.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.652+0000 7f4003fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:59.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.654+0000 7f415042f800 20 remove_watcher() i=0 2024-09-12T17:41:59.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.654+0000 7f415042f800 2 removed watcher, disabling cache 2024-09-12T17:41:59.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.655+0000 7f415042f800 20 remove_watcher() i=1 2024-09-12T17:41:59.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.656+0000 7f415042f800 20 remove_watcher() i=2 2024-09-12T17:41:59.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.657+0000 7f415042f800 20 remove_watcher() i=3 2024-09-12T17:41:59.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.659+0000 7f415042f800 20 remove_watcher() i=4 2024-09-12T17:41:59.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.660+0000 7f415042f800 20 remove_watcher() i=5 2024-09-12T17:41:59.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.661+0000 7f415042f800 20 remove_watcher() i=6 2024-09-12T17:41:59.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.662+0000 7f415042f800 20 remove_watcher() i=7 2024-09-12T17:41:59.710 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.710 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:41:59.710 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-init-indext id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:41:59.710 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:41:59.727 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:41:59.761 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:59.762 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:59.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.799+0000 7f078b926800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.801+0000 7f078b926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.801+0000 7f078b926800 20 realm 2024-09-12T17:41:59.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.801+0000 7f078b926800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.801+0000 7f078b926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.801+0000 7f078b926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:59.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.801+0000 7f078b926800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.801+0000 7f078b926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:59.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.801+0000 7f078b926800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.802+0000 7f078b926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:59.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.802+0000 7f078b926800 20 rados->read ofs=0 len=0 2024-09-12T17:41:59.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.802+0000 7f078b926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:59.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.802+0000 7f078b926800 20 searching for the correct realm 2024-09-12T17:41:59.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.805+0000 7f077ffff640 0 -- 172.21.15.44:0/3973838945 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f077807e800 msgr2=0x7f077802e970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:59.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:41:59.809+0000 7f07875b5640 0 -- 172.21.15.44:0/3973838945 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f0770067040 msgr2=0x7f077007a620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:00.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.015+0000 7f078b926800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:00.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.015+0000 7f078b926800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:00.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.015+0000 7f078b926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:00.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.015+0000 7f078b926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:00.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.015+0000 7f078b926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:00.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.015+0000 7f078b926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:00.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.015+0000 7f078b926800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.015+0000 7f078b926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:00.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.015+0000 7f078b926800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.016+0000 7f078b926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:00.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.016+0000 7f078b926800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.016+0000 7f078b926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:00.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.016+0000 7f078b926800 20 zone default found 2024-09-12T17:42:00.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.016+0000 7f078b926800 4 Realm: () 2024-09-12T17:42:00.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.016+0000 7f078b926800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:00.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.016+0000 7f078b926800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:00.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.016+0000 7f078b926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:00.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.016+0000 7f078b926800 20 zonegroup default 2024-09-12T17:42:00.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.016+0000 7f078b926800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.017+0000 7f078b926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:00.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.017+0000 7f078b926800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.017+0000 7f078b926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:00.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.017+0000 7f078b926800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.017+0000 7f078b926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:00.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.017+0000 7f078b926800 20 started sync module instance, tier type = 2024-09-12T17:42:00.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.017+0000 7f078b926800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:00.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.027+0000 7f078b926800 20 add_watcher() i=0 2024-09-12T17:42:00.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.027+0000 7f078b926800 20 add_watcher() i=1 2024-09-12T17:42:00.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.027+0000 7f078b926800 20 add_watcher() i=2 2024-09-12T17:42:00.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.027+0000 7f078b926800 20 add_watcher() i=3 2024-09-12T17:42:00.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.027+0000 7f078b926800 20 add_watcher() i=4 2024-09-12T17:42:00.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.027+0000 7f078b926800 20 add_watcher() i=5 2024-09-12T17:42:00.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.027+0000 7f078b926800 20 add_watcher() i=6 2024-09-12T17:42:00.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.028+0000 7f078b926800 20 add_watcher() i=7 2024-09-12T17:42:00.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.028+0000 7f078b926800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:00.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.030+0000 7f063dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:00.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.030+0000 7f078b926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:00.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.030+0000 7f078b926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:00.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.030+0000 7f078b926800 5 note: GC not initialized 2024-09-12T17:42:00.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.030+0000 7f063cfe1640 20 reqs_thread_entry: start 2024-09-12T17:42:00.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.031+0000 7f078b926800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:00.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.031+0000 7f078b926800 20 Filter name: none 2024-09-12T17:42:00.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.031+0000 7f05b67fc640 20 reqs_thread_entry: start 2024-09-12T17:42:00.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.031+0000 7f078b926800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:42:00.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.031+0000 7f078b926800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.031+0000 7f078b926800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:42:00.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.031+0000 7f078b926800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:42:00.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.031+0000 7f078b926800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:42:00.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.031+0000 7f078b926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 : miss 2024-09-12T17:42:00.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.031+0000 7f078b926800 20 rados->read ofs=0 len=0 2024-09-12T17:42:00.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.032+0000 7f078b926800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:42:00.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.032+0000 7f078b926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 info.flags=0x17 2024-09-12T17:42:00.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.032+0000 7f078b926800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 to cache LRU end 2024-09-12T17:42:00.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.032+0000 7f078b926800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:00.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.032+0000 7f078b926800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:00.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.032+0000 7f078b926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 2024-09-12T17:42:00.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.033+0000 7f078b926800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 to be held by another RGW process; skipping for now 2024-09-12T17:42:00.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.034+0000 7f063dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:00.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.036+0000 7f078b926800 20 remove_watcher() i=0 2024-09-12T17:42:00.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.036+0000 7f078b926800 2 removed watcher, disabling cache 2024-09-12T17:42:00.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.037+0000 7f078b926800 20 remove_watcher() i=1 2024-09-12T17:42:00.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.038+0000 7f078b926800 20 remove_watcher() i=2 2024-09-12T17:42:00.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.039+0000 7f078b926800 20 remove_watcher() i=3 2024-09-12T17:42:00.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.040+0000 7f078b926800 20 remove_watcher() i=4 2024-09-12T17:42:00.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.041+0000 7f078b926800 20 remove_watcher() i=5 2024-09-12T17:42:00.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.042+0000 7f078b926800 20 remove_watcher() i=6 2024-09-12T17:42:00.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:00.043+0000 7f078b926800 20 remove_watcher() i=7 2024-09-12T17:42:00.057 INFO:tasks.workunit.client.0.smithi044.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:42:30.062 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:42:30.099 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:30.099 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:30.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.142+0000 7fb64b735800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.144+0000 7fb64b735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.144+0000 7fb64b735800 20 realm 2024-09-12T17:42:30.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.144+0000 7fb64b735800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.144+0000 7fb64b735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.144+0000 7fb64b735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:30.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.144+0000 7fb64b735800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.145+0000 7fb64b735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.145+0000 7fb64b735800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.146+0000 7fb64b735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:30.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.146+0000 7fb64b735800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.146+0000 7fb64b735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:30.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.146+0000 7fb64b735800 20 searching for the correct realm 2024-09-12T17:42:30.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.150+0000 7fb646ce3640 0 -- 172.21.15.44:0/2970095502 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x561652e95240 msgr2=0x561652e97700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:30.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.154+0000 7fb6474e4640 0 -- 172.21.15.44:0/2970095502 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fb63c0a0370 msgr2=0x7fb63c0a07d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:30.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.159+0000 7fb64b735800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:30.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.159+0000 7fb64b735800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:30.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.159+0000 7fb64b735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:30.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.159+0000 7fb64b735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:30.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.159+0000 7fb64b735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:30.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.159+0000 7fb64b735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:30.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.159+0000 7fb64b735800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.159+0000 7fb64b735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.159+0000 7fb64b735800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.159+0000 7fb64b735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:30.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.159+0000 7fb64b735800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.160+0000 7fb64b735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:30.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.160+0000 7fb64b735800 20 zone default found 2024-09-12T17:42:30.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.160+0000 7fb64b735800 4 Realm: () 2024-09-12T17:42:30.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.160+0000 7fb64b735800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:30.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.160+0000 7fb64b735800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:30.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.160+0000 7fb64b735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:30.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.160+0000 7fb64b735800 20 zonegroup default 2024-09-12T17:42:30.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.160+0000 7fb64b735800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.160+0000 7fb64b735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.160+0000 7fb64b735800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.160+0000 7fb64b735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.160+0000 7fb64b735800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.161+0000 7fb64b735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.161+0000 7fb64b735800 20 started sync module instance, tier type = 2024-09-12T17:42:30.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.161+0000 7fb64b735800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:30.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.172+0000 7fb64b735800 20 add_watcher() i=0 2024-09-12T17:42:30.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.172+0000 7fb64b735800 20 add_watcher() i=1 2024-09-12T17:42:30.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.172+0000 7fb64b735800 20 add_watcher() i=2 2024-09-12T17:42:30.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.172+0000 7fb64b735800 20 add_watcher() i=3 2024-09-12T17:42:30.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.172+0000 7fb64b735800 20 add_watcher() i=4 2024-09-12T17:42:30.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.172+0000 7fb64b735800 20 add_watcher() i=5 2024-09-12T17:42:30.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.172+0000 7fb64b735800 20 add_watcher() i=6 2024-09-12T17:42:30.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.173+0000 7fb64b735800 20 add_watcher() i=7 2024-09-12T17:42:30.174 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.173+0000 7fb64b735800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:30.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.175+0000 7fb4fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:30.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.175+0000 7fb64b735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:30.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.175+0000 7fb64b735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:30.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.175+0000 7fb64b735800 5 note: GC not initialized 2024-09-12T17:42:30.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.175+0000 7fb4fcfe1640 20 reqs_thread_entry: start 2024-09-12T17:42:30.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.175+0000 7fb64b735800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:30.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.175+0000 7fb64b735800 20 Filter name: none 2024-09-12T17:42:30.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.176+0000 7fb4767fc640 20 reqs_thread_entry: start 2024-09-12T17:42:30.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.176+0000 7fb64b735800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:42:30.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.176+0000 7fb64b735800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.176+0000 7fb64b735800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:42:30.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.176+0000 7fb64b735800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:42:30.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.176+0000 7fb64b735800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:42:30.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.176+0000 7fb64b735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 : miss 2024-09-12T17:42:30.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.176+0000 7fb64b735800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.176+0000 7fb64b735800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:42:30.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.176+0000 7fb64b735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 info.flags=0x17 2024-09-12T17:42:30.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.176+0000 7fb64b735800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 to cache LRU end 2024-09-12T17:42:30.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.176+0000 7fb64b735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:30.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.176+0000 7fb64b735800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:30.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.176+0000 7fb64b735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 2024-09-12T17:42:30.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.182+0000 7fb64b735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 info.flags=0x17 2024-09-12T17:42:30.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.182+0000 7fb64b735800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 to cache LRU end 2024-09-12T17:42:30.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.182+0000 7fb64b735800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:30.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.182+0000 7fb64b735800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22, ofs0, ns] 2024-09-12T17:42:30.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.183+0000 7fb52affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562410 cookie 94653880304064 notifier 6116 bl.length()=997 2024-09-12T17:42:30.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.183+0000 7fb52affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 info.flags=0x17 2024-09-12T17:42:30.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.183+0000 7fb52affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 to cache LRU end 2024-09-12T17:42:30.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.183+0000 7fb52affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:30.185 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.183+0000 7fb64b735800 20 handle_bi_update(): bucket=:abort-at-init-indext[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22]): orig_sources= new_sources= 2024-09-12T17:42:30.185 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.183+0000 7fb64b735800 20 handle_bi_update(): bucket=:abort-at-init-indext[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22]): potential sources added=[] removed=[] 2024-09-12T17:42:30.185 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.183+0000 7fb64b735800 20 handle_bi_update(): bucket=:abort-at-init-indext[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22]): orig_dests= new_dests= 2024-09-12T17:42:30.185 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.183+0000 7fb64b735800 20 handle_bi_update(): bucket=:abort-at-init-indext[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22]): potential dests added=[] removed=[] 2024-09-12T17:42:30.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.0 2024-09-12T17:42:30.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.0 2024-09-12T17:42:30.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.1 2024-09-12T17:42:30.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.1 2024-09-12T17:42:30.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.2 2024-09-12T17:42:30.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.2 2024-09-12T17:42:30.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.3 2024-09-12T17:42:30.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.3 2024-09-12T17:42:30.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.4 2024-09-12T17:42:30.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.4 2024-09-12T17:42:30.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.5 2024-09-12T17:42:30.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.5 2024-09-12T17:42:30.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.6 2024-09-12T17:42:30.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.6 2024-09-12T17:42:30.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.7 2024-09-12T17:42:30.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.7 2024-09-12T17:42:30.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.8 2024-09-12T17:42:30.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.8 2024-09-12T17:42:30.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.9 2024-09-12T17:42:30.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.9 2024-09-12T17:42:30.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.10 2024-09-12T17:42:30.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.10 2024-09-12T17:42:30.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.11 2024-09-12T17:42:30.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1.11 2024-09-12T17:42:30.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.188+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.0 2024-09-12T17:42:30.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.189+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1 2024-09-12T17:42:30.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.189+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.2 2024-09-12T17:42:30.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.190+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.3 2024-09-12T17:42:30.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.190+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.4 2024-09-12T17:42:30.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.190+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.5 2024-09-12T17:42:30.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.191+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.6 2024-09-12T17:42:30.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.192+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.7 2024-09-12T17:42:30.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.192+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.8 2024-09-12T17:42:30.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.193+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.9 2024-09-12T17:42:30.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.193+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.10 2024-09-12T17:42:30.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.197+0000 7fb64b735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:30.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.197+0000 7fb64b735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 2024-09-12T17:42:30.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.198+0000 7fb64b735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 info.flags=0x17 2024-09-12T17:42:30.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.198+0000 7fb64b735800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 to cache LRU end 2024-09-12T17:42:30.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.198+0000 7fb64b735800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:30.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.198+0000 7fb64b735800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22, ofs0, ns] 2024-09-12T17:42:30.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.198+0000 7fb52a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562411 cookie 94653880304064 notifier 6116 bl.length()=997 2024-09-12T17:42:30.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.198+0000 7fb52a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 info.flags=0x17 2024-09-12T17:42:30.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.198+0000 7fb52a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 to cache LRU end 2024-09-12T17:42:30.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.198+0000 7fb52a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:30.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.199+0000 7fb64b735800 20 handle_bi_update(): bucket=:abort-at-init-indext[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22]): orig_sources= new_sources= 2024-09-12T17:42:30.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.199+0000 7fb64b735800 20 handle_bi_update(): bucket=:abort-at-init-indext[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22]): potential sources added=[] removed=[] 2024-09-12T17:42:30.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.199+0000 7fb64b735800 20 handle_bi_update(): bucket=:abort-at-init-indext[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22]): orig_dests= new_dests= 2024-09-12T17:42:30.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.199+0000 7fb64b735800 20 handle_bi_update(): bucket=:abort-at-init-indext[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22]): potential dests added=[] removed=[] 2024-09-12T17:42:30.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.201+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.0 2024-09-12T17:42:30.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.201+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.1 2024-09-12T17:42:30.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.202+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.2 2024-09-12T17:42:30.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.202+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.3 2024-09-12T17:42:30.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.202+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.4 2024-09-12T17:42:30.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.203+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.5 2024-09-12T17:42:30.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.203+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.6 2024-09-12T17:42:30.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.203+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.7 2024-09-12T17:42:30.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.204+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.8 2024-09-12T17:42:30.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.204+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.9 2024-09-12T17:42:30.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.205+0000 7fb64b735800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22.10 2024-09-12T17:42:30.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.205+0000 7fb64b735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:30.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.205+0000 7fb64b735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 2024-09-12T17:42:30.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.207+0000 7fb64b735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 info.flags=0x17 2024-09-12T17:42:30.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.207+0000 7fb64b735800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 to cache LRU end 2024-09-12T17:42:30.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.207+0000 7fb64b735800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:30.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.207+0000 7fb64b735800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22, ofs0, ns] 2024-09-12T17:42:30.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.207+0000 7fb52affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562412 cookie 94653880304064 notifier 6116 bl.length()=965 2024-09-12T17:42:30.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.207+0000 7fb52affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 info.flags=0x17 2024-09-12T17:42:30.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.207+0000 7fb52affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 to cache LRU end 2024-09-12T17:42:30.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.207+0000 7fb52affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:30.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.207+0000 7fb64b735800 20 handle_bi_update(): bucket=:abort-at-init-indext[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22]): orig_sources= new_sources= 2024-09-12T17:42:30.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.207+0000 7fb64b735800 20 handle_bi_update(): bucket=:abort-at-init-indext[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22]): potential sources added=[] removed=[] 2024-09-12T17:42:30.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.207+0000 7fb64b735800 20 handle_bi_update(): bucket=:abort-at-init-indext[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22]): orig_dests= new_dests= 2024-09-12T17:42:30.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.207+0000 7fb64b735800 20 handle_bi_update(): bucket=:abort-at-init-indext[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22]): potential dests added=[] removed=[] 2024-09-12T17:42:30.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.210+0000 7fb64b735800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-12T17:42:30.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.212+0000 7fb4fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:30.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.214+0000 7fb64b735800 20 remove_watcher() i=0 2024-09-12T17:42:30.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.214+0000 7fb64b735800 2 removed watcher, disabling cache 2024-09-12T17:42:30.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.216+0000 7fb64b735800 20 remove_watcher() i=1 2024-09-12T17:42:30.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.217+0000 7fb64b735800 20 remove_watcher() i=2 2024-09-12T17:42:30.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.218+0000 7fb64b735800 20 remove_watcher() i=3 2024-09-12T17:42:30.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.219+0000 7fb64b735800 20 remove_watcher() i=4 2024-09-12T17:42:30.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.220+0000 7fb64b735800 20 remove_watcher() i=5 2024-09-12T17:42:30.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.221+0000 7fb64b735800 20 remove_watcher() i=6 2024-09-12T17:42:30.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.222+0000 7fb64b735800 20 remove_watcher() i=7 2024-09-12T17:42:30.235 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:42:30.264 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:30.264 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:30.303 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.303+0000 7f5af1220800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.305+0000 7f5af1220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.305+0000 7f5af1220800 20 realm 2024-09-12T17:42:30.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.305+0000 7f5af1220800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.305+0000 7f5af1220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.305+0000 7f5af1220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:30.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.305+0000 7f5af1220800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.305+0000 7f5af1220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.305+0000 7f5af1220800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.306+0000 7f5af1220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:30.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.306+0000 7f5af1220800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.306+0000 7f5af1220800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:30.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.306+0000 7f5af1220800 20 searching for the correct realm 2024-09-12T17:42:30.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.309+0000 7f5aef50b640 0 -- 172.21.15.44:0/1998071913 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f5ae4019920 msgr2=0x7f5ae402d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:30.314 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.313+0000 7f5aeed0a640 0 -- 172.21.15.44:0/1998071913 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f5ae403d410 msgr2=0x7f5ae403d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:30.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.520+0000 7f5af1220800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:30.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.520+0000 7f5af1220800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:30.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.520+0000 7f5af1220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:30.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.520+0000 7f5af1220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:30.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.520+0000 7f5af1220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:30.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.520+0000 7f5af1220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:30.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.520+0000 7f5af1220800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.520+0000 7f5af1220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.520+0000 7f5af1220800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.521+0000 7f5af1220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:30.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.521+0000 7f5af1220800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.521+0000 7f5af1220800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:30.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.521+0000 7f5af1220800 20 zone default found 2024-09-12T17:42:30.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.521+0000 7f5af1220800 4 Realm: () 2024-09-12T17:42:30.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.521+0000 7f5af1220800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:30.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.521+0000 7f5af1220800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:30.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.521+0000 7f5af1220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:30.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.521+0000 7f5af1220800 20 zonegroup default 2024-09-12T17:42:30.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.521+0000 7f5af1220800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.521+0000 7f5af1220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.521+0000 7f5af1220800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.522+0000 7f5af1220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.522+0000 7f5af1220800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.522+0000 7f5af1220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.522+0000 7f5af1220800 20 started sync module instance, tier type = 2024-09-12T17:42:30.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.522+0000 7f5af1220800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:30.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.532+0000 7f5af1220800 20 add_watcher() i=0 2024-09-12T17:42:30.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.532+0000 7f5af1220800 20 add_watcher() i=1 2024-09-12T17:42:30.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.532+0000 7f5af1220800 20 add_watcher() i=2 2024-09-12T17:42:30.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.532+0000 7f5af1220800 20 add_watcher() i=3 2024-09-12T17:42:30.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.532+0000 7f5af1220800 20 add_watcher() i=4 2024-09-12T17:42:30.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.532+0000 7f5af1220800 20 add_watcher() i=5 2024-09-12T17:42:30.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.532+0000 7f5af1220800 20 add_watcher() i=6 2024-09-12T17:42:30.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.533+0000 7f5af1220800 20 add_watcher() i=7 2024-09-12T17:42:30.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.533+0000 7f5af1220800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:30.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.535+0000 7f59a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:30.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.535+0000 7f5af1220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:30.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.535+0000 7f5af1220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:30.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.535+0000 7f5af1220800 5 note: GC not initialized 2024-09-12T17:42:30.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.535+0000 7f591ffff640 20 reqs_thread_entry: start 2024-09-12T17:42:30.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.535+0000 7f5af1220800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:30.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.536+0000 7f5af1220800 20 Filter name: none 2024-09-12T17:42:30.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.536+0000 7f591dffb640 20 reqs_thread_entry: start 2024-09-12T17:42:30.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.536+0000 7f5af1220800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.536+0000 7f5af1220800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:42:30.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.536+0000 7f5af1220800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.537+0000 7f5af1220800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:42:30.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.537+0000 7f5af1220800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:30.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.537+0000 7f5af1220800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.537+0000 7f5af1220800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:42:30.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.537+0000 7f5af1220800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.538+0000 7f5af1220800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:42:30.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.538+0000 7f5af1220800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:30.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.539+0000 7f59a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:30.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.542+0000 7f5af1220800 20 remove_watcher() i=0 2024-09-12T17:42:30.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.542+0000 7f5af1220800 2 removed watcher, disabling cache 2024-09-12T17:42:30.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.543+0000 7f5af1220800 20 remove_watcher() i=1 2024-09-12T17:42:30.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.544+0000 7f5af1220800 20 remove_watcher() i=2 2024-09-12T17:42:30.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.545+0000 7f5af1220800 20 remove_watcher() i=3 2024-09-12T17:42:30.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.546+0000 7f5af1220800 20 remove_watcher() i=4 2024-09-12T17:42:30.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.547+0000 7f5af1220800 20 remove_watcher() i=5 2024-09-12T17:42:30.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.548+0000 7f5af1220800 20 remove_watcher() i=6 2024-09-12T17:42:30.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.549+0000 7f5af1220800 20 remove_watcher() i=7 2024-09-12T17:42:30.561 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:30.561 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:42:30.561 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-init-indext id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:42:30.562 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:30.640 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T17:42:30.640 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:30.840 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:42:30.869 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:30.869 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:30.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.907+0000 7f29d441d800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.908+0000 7f29d441d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.908+0000 7f29d441d800 20 realm 2024-09-12T17:42:30.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.908+0000 7f29d441d800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.908+0000 7f29d441d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.908+0000 7f29d441d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:30.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.908+0000 7f29d441d800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.909+0000 7f29d441d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:30.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.909+0000 7f29d441d800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.909+0000 7f29d441d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:30.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.909+0000 7f29d441d800 20 rados->read ofs=0 len=0 2024-09-12T17:42:30.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.910+0000 7f29d441d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:30.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.910+0000 7f29d441d800 20 searching for the correct realm 2024-09-12T17:42:30.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.913+0000 7f29c73ea640 0 -- 172.21.15.44:0/2404621307 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x557300e83730 msgr2=0x557300e85b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:30.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:30.916+0000 7f29cfbeb640 0 -- 172.21.15.44:0/2404621307 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f29b8040900 msgr2=0x7f29b8008410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:31.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.124+0000 7f29d441d800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:31.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.124+0000 7f29d441d800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:31.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.124+0000 7f29d441d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:31.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.124+0000 7f29d441d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:31.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.124+0000 7f29d441d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:31.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.124+0000 7f29d441d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:31.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.124+0000 7f29d441d800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.124+0000 7f29d441d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.124+0000 7f29d441d800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.124+0000 7f29d441d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:31.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.124+0000 7f29d441d800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.125+0000 7f29d441d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:31.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.125+0000 7f29d441d800 20 zone default found 2024-09-12T17:42:31.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.125+0000 7f29d441d800 4 Realm: () 2024-09-12T17:42:31.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.125+0000 7f29d441d800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:31.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.125+0000 7f29d441d800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:31.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.125+0000 7f29d441d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:31.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.125+0000 7f29d441d800 20 zonegroup default 2024-09-12T17:42:31.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.125+0000 7f29d441d800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.125+0000 7f29d441d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.125+0000 7f29d441d800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.125+0000 7f29d441d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.125+0000 7f29d441d800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.126+0000 7f29d441d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.126+0000 7f29d441d800 20 started sync module instance, tier type = 2024-09-12T17:42:31.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.126+0000 7f29d441d800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:31.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.134+0000 7f29d441d800 20 add_watcher() i=0 2024-09-12T17:42:31.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.134+0000 7f29d441d800 20 add_watcher() i=1 2024-09-12T17:42:31.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.134+0000 7f29d441d800 20 add_watcher() i=2 2024-09-12T17:42:31.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.134+0000 7f29d441d800 20 add_watcher() i=3 2024-09-12T17:42:31.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.134+0000 7f29d441d800 20 add_watcher() i=4 2024-09-12T17:42:31.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.134+0000 7f29d441d800 20 add_watcher() i=5 2024-09-12T17:42:31.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.134+0000 7f29d441d800 20 add_watcher() i=6 2024-09-12T17:42:31.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.136+0000 7f29d441d800 20 add_watcher() i=7 2024-09-12T17:42:31.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.136+0000 7f29d441d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:31.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.137+0000 7f2885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:31.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.137+0000 7f29d441d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:31.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.137+0000 7f29d441d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:31.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.137+0000 7f29d441d800 5 note: GC not initialized 2024-09-12T17:42:31.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.138+0000 7f2884fe1640 20 reqs_thread_entry: start 2024-09-12T17:42:31.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.138+0000 7f29d441d800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:31.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.138+0000 7f29d441d800 20 Filter name: none 2024-09-12T17:42:31.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.138+0000 7f27fe7fc640 20 reqs_thread_entry: start 2024-09-12T17:42:31.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.138+0000 7f29d441d800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.139+0000 7f29d441d800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:31.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.139+0000 7f29d441d800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.139+0000 7f29d441d800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:31.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.139+0000 7f29d441d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:31.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.139+0000 7f29d441d800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.139+0000 7f29d441d800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:31.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.139+0000 7f29d441d800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.140+0000 7f29d441d800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:31.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.140+0000 7f29d441d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:31.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.141+0000 7f2885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:31.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.144+0000 7f29d441d800 20 remove_watcher() i=0 2024-09-12T17:42:31.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.144+0000 7f29d441d800 2 removed watcher, disabling cache 2024-09-12T17:42:31.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.145+0000 7f29d441d800 20 remove_watcher() i=1 2024-09-12T17:42:31.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.146+0000 7f29d441d800 20 remove_watcher() i=2 2024-09-12T17:42:31.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.146+0000 7f29d441d800 20 remove_watcher() i=3 2024-09-12T17:42:31.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.148+0000 7f29d441d800 20 remove_watcher() i=4 2024-09-12T17:42:31.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.149+0000 7f29d441d800 20 remove_watcher() i=5 2024-09-12T17:42:31.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.150+0000 7f29d441d800 20 remove_watcher() i=6 2024-09-12T17:42:31.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.151+0000 7f29d441d800 20 remove_watcher() i=7 2024-09-12T17:42:31.162 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:31.162 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:42:31.162 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-set-target-layout id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:42:31.163 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:31.164 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T17:42:31.199 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:31.199 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:31.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.237+0000 7f1864d46800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.238+0000 7f1864d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.238+0000 7f1864d46800 20 realm 2024-09-12T17:42:31.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.238+0000 7f1864d46800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.238+0000 7f1864d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.238+0000 7f1864d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:31.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.238+0000 7f1864d46800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.238+0000 7f1864d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.238+0000 7f1864d46800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.239+0000 7f1864d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:31.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.239+0000 7f1864d46800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.240+0000 7f1864d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:31.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.240+0000 7f1864d46800 20 searching for the correct realm 2024-09-12T17:42:31.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.242+0000 7f1862036640 0 -- 172.21.15.44:0/1588565847 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f185408f040 msgr2=0x7f1854080920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:31.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.246+0000 7f1862837640 0 -- 172.21.15.44:0/1588565847 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f1858090030 msgr2=0x7f185807a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:31.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.452+0000 7f1864d46800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:31.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.452+0000 7f1864d46800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:31.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.452+0000 7f1864d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:31.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.452+0000 7f1864d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:31.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.452+0000 7f1864d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:31.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.452+0000 7f1864d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:31.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.452+0000 7f1864d46800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.452+0000 7f1864d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.452+0000 7f1864d46800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.453+0000 7f1864d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:31.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.453+0000 7f1864d46800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.454+0000 7f1864d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:31.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.454+0000 7f1864d46800 20 zone default found 2024-09-12T17:42:31.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.454+0000 7f1864d46800 4 Realm: () 2024-09-12T17:42:31.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.454+0000 7f1864d46800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:31.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.454+0000 7f1864d46800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:31.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.454+0000 7f1864d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:31.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.454+0000 7f1864d46800 20 zonegroup default 2024-09-12T17:42:31.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.454+0000 7f1864d46800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.454+0000 7f1864d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.454+0000 7f1864d46800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.454+0000 7f1864d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.454+0000 7f1864d46800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.454+0000 7f1864d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.455+0000 7f1864d46800 20 started sync module instance, tier type = 2024-09-12T17:42:31.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.455+0000 7f1864d46800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:31.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.464+0000 7f1864d46800 20 add_watcher() i=0 2024-09-12T17:42:31.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.464+0000 7f1864d46800 20 add_watcher() i=1 2024-09-12T17:42:31.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.464+0000 7f1864d46800 20 add_watcher() i=2 2024-09-12T17:42:31.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.464+0000 7f1864d46800 20 add_watcher() i=3 2024-09-12T17:42:31.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.464+0000 7f1864d46800 20 add_watcher() i=4 2024-09-12T17:42:31.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.464+0000 7f1864d46800 20 add_watcher() i=5 2024-09-12T17:42:31.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.464+0000 7f1864d46800 20 add_watcher() i=6 2024-09-12T17:42:31.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.465+0000 7f1864d46800 20 add_watcher() i=7 2024-09-12T17:42:31.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.465+0000 7f1864d46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:31.467 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.466+0000 7f17197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:31.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.467+0000 7f1864d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:31.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.467+0000 7f1864d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:31.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.467+0000 7f1864d46800 5 note: GC not initialized 2024-09-12T17:42:31.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.467+0000 7f1693fff640 20 reqs_thread_entry: start 2024-09-12T17:42:31.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.467+0000 7f1864d46800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:31.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.467+0000 7f1864d46800 20 Filter name: none 2024-09-12T17:42:31.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.467+0000 7f1691ffb640 20 reqs_thread_entry: start 2024-09-12T17:42:31.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.467+0000 7f1864d46800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:42:31.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.467+0000 7f1864d46800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.468+0000 7f1864d46800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:31.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.468+0000 7f1864d46800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:42:31.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.468+0000 7f1864d46800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:42:31.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.468+0000 7f1864d46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 : miss 2024-09-12T17:42:31.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.468+0000 7f1864d46800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.468+0000 7f1864d46800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:31.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.468+0000 7f1864d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 info.flags=0x17 2024-09-12T17:42:31.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.468+0000 7f1864d46800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 to cache LRU end 2024-09-12T17:42:31.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.468+0000 7f1864d46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:31.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.468+0000 7f1864d46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:31.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.468+0000 7f1864d46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 2024-09-12T17:42:31.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.472+0000 7f1864d46800 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T17:42:31.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.472+0000 7f1864d46800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T17:42:31.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.477+0000 7f17197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:31.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.479+0000 7f1864d46800 20 remove_watcher() i=0 2024-09-12T17:42:31.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.479+0000 7f1864d46800 2 removed watcher, disabling cache 2024-09-12T17:42:31.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.480+0000 7f1864d46800 20 remove_watcher() i=1 2024-09-12T17:42:31.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.481+0000 7f1864d46800 20 remove_watcher() i=2 2024-09-12T17:42:31.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.482+0000 7f1864d46800 20 remove_watcher() i=3 2024-09-12T17:42:31.483 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.483+0000 7f1864d46800 20 remove_watcher() i=4 2024-09-12T17:42:31.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.484+0000 7f1864d46800 20 remove_watcher() i=5 2024-09-12T17:42:31.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.485+0000 7f1864d46800 20 remove_watcher() i=6 2024-09-12T17:42:31.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.486+0000 7f1864d46800 20 remove_watcher() i=7 2024-09-12T17:42:31.499 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:42:31.528 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:31.529 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:31.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.567+0000 7f558ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.569+0000 7f558ed24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.569+0000 7f558ed24800 20 realm 2024-09-12T17:42:31.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.569+0000 7f558ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.569+0000 7f558ed24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.569+0000 7f558ed24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:31.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.569+0000 7f558ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.570+0000 7f558ed24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.570+0000 7f558ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.570+0000 7f558ed24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:31.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.570+0000 7f558ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.571+0000 7f558ed24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:31.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.571+0000 7f558ed24800 20 searching for the correct realm 2024-09-12T17:42:31.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.573+0000 7f558a155640 0 -- 172.21.15.44:0/2525701775 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f557c030070 msgr2=0x7f557c082980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:31.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.577+0000 7f558a956640 0 -- 172.21.15.44:0/2525701775 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f558006ab90 msgr2=0x7f55800629e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:31.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.784+0000 7f558ed24800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:31.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.784+0000 7f558ed24800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:31.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.784+0000 7f558ed24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:31.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.784+0000 7f558ed24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:31.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.784+0000 7f558ed24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:31.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.784+0000 7f558ed24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:31.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.784+0000 7f558ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.784+0000 7f558ed24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.784+0000 7f558ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.785+0000 7f558ed24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:31.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.785+0000 7f558ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.785+0000 7f558ed24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:31.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.785+0000 7f558ed24800 20 zone default found 2024-09-12T17:42:31.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.785+0000 7f558ed24800 4 Realm: () 2024-09-12T17:42:31.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.785+0000 7f558ed24800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:31.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.785+0000 7f558ed24800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:31.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.785+0000 7f558ed24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:31.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.785+0000 7f558ed24800 20 zonegroup default 2024-09-12T17:42:31.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.785+0000 7f558ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.785+0000 7f558ed24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.785+0000 7f558ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.786+0000 7f558ed24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.786+0000 7f558ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.786+0000 7f558ed24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.786+0000 7f558ed24800 20 started sync module instance, tier type = 2024-09-12T17:42:31.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.786+0000 7f558ed24800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:31.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.795+0000 7f558ed24800 20 add_watcher() i=0 2024-09-12T17:42:31.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.795+0000 7f558ed24800 20 add_watcher() i=1 2024-09-12T17:42:31.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.795+0000 7f558ed24800 20 add_watcher() i=2 2024-09-12T17:42:31.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.795+0000 7f558ed24800 20 add_watcher() i=3 2024-09-12T17:42:31.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.795+0000 7f558ed24800 20 add_watcher() i=4 2024-09-12T17:42:31.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.795+0000 7f558ed24800 20 add_watcher() i=5 2024-09-12T17:42:31.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.795+0000 7f558ed24800 20 add_watcher() i=6 2024-09-12T17:42:31.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.796+0000 7f558ed24800 20 add_watcher() i=7 2024-09-12T17:42:31.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.796+0000 7f558ed24800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:31.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.798+0000 7f54417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:31.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.798+0000 7f558ed24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:31.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.798+0000 7f558ed24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:31.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.798+0000 7f558ed24800 5 note: GC not initialized 2024-09-12T17:42:31.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.798+0000 7f53bbfff640 20 reqs_thread_entry: start 2024-09-12T17:42:31.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.798+0000 7f558ed24800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:31.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.799+0000 7f558ed24800 20 Filter name: none 2024-09-12T17:42:31.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.799+0000 7f53b9ffb640 20 reqs_thread_entry: start 2024-09-12T17:42:31.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.799+0000 7f558ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.799+0000 7f558ed24800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:31.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.799+0000 7f558ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.799+0000 7f558ed24800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:31.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.799+0000 7f558ed24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:31.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.799+0000 7f558ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.800+0000 7f558ed24800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:31.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.800+0000 7f558ed24800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.800+0000 7f558ed24800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:31.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.800+0000 7f558ed24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:31.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.802+0000 7f54417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:31.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.804+0000 7f558ed24800 20 remove_watcher() i=0 2024-09-12T17:42:31.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.804+0000 7f558ed24800 2 removed watcher, disabling cache 2024-09-12T17:42:31.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.805+0000 7f558ed24800 20 remove_watcher() i=1 2024-09-12T17:42:31.807 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.807+0000 7f558ed24800 20 remove_watcher() i=2 2024-09-12T17:42:31.808 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.807+0000 7f558ed24800 20 remove_watcher() i=3 2024-09-12T17:42:31.809 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.808+0000 7f558ed24800 20 remove_watcher() i=4 2024-09-12T17:42:31.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.809+0000 7f558ed24800 20 remove_watcher() i=5 2024-09-12T17:42:31.811 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.810+0000 7f558ed24800 20 remove_watcher() i=6 2024-09-12T17:42:31.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.811+0000 7f558ed24800 20 remove_watcher() i=7 2024-09-12T17:42:31.823 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:31.823 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:42:31.824 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-set-target-layout id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:42:31.824 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:31.875 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:42:31.908 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:31.908 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:31.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.947+0000 7f9ea1214800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.949+0000 7f9ea1214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.949+0000 7f9ea1214800 20 realm 2024-09-12T17:42:31.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.949+0000 7f9ea1214800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.949+0000 7f9ea1214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.949+0000 7f9ea1214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:31.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.949+0000 7f9ea1214800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.949+0000 7f9ea1214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:31.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.949+0000 7f9ea1214800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.950+0000 7f9ea1214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:31.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.950+0000 7f9ea1214800 20 rados->read ofs=0 len=0 2024-09-12T17:42:31.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.950+0000 7f9ea1214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:31.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.950+0000 7f9ea1214800 20 searching for the correct realm 2024-09-12T17:42:31.952 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:31.952+0000 7f9e9c8cb640 0 -- 172.21.15.44:0/3831069645 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7f9e9401a040 msgr2=0x7f9e9406bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:32.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.158+0000 7f9e9d0cc640 0 -- 172.21.15.44:0/3831069645 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f9e90072070 msgr2=0x7f9e900a4070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:32.164 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.163+0000 7f9ea1214800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:32.164 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.163+0000 7f9ea1214800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:32.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.163+0000 7f9ea1214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:32.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.163+0000 7f9ea1214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:32.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.163+0000 7f9ea1214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:32.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.163+0000 7f9ea1214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:32.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.163+0000 7f9ea1214800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.164+0000 7f9ea1214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.164+0000 7f9ea1214800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.164+0000 7f9ea1214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:32.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.164+0000 7f9ea1214800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.164+0000 7f9ea1214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:32.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.164+0000 7f9ea1214800 20 zone default found 2024-09-12T17:42:32.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.164+0000 7f9ea1214800 4 Realm: () 2024-09-12T17:42:32.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.164+0000 7f9ea1214800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:32.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.164+0000 7f9ea1214800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:32.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.164+0000 7f9ea1214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:32.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.164+0000 7f9ea1214800 20 zonegroup default 2024-09-12T17:42:32.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.164+0000 7f9ea1214800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.164+0000 7f9ea1214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.165+0000 7f9ea1214800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.165+0000 7f9ea1214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.165+0000 7f9ea1214800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.165+0000 7f9ea1214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.165+0000 7f9ea1214800 20 started sync module instance, tier type = 2024-09-12T17:42:32.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.165+0000 7f9ea1214800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:32.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.174+0000 7f9ea1214800 20 add_watcher() i=0 2024-09-12T17:42:32.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.174+0000 7f9ea1214800 20 add_watcher() i=1 2024-09-12T17:42:32.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.174+0000 7f9ea1214800 20 add_watcher() i=2 2024-09-12T17:42:32.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.174+0000 7f9ea1214800 20 add_watcher() i=3 2024-09-12T17:42:32.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.174+0000 7f9ea1214800 20 add_watcher() i=4 2024-09-12T17:42:32.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.174+0000 7f9ea1214800 20 add_watcher() i=5 2024-09-12T17:42:32.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.174+0000 7f9ea1214800 20 add_watcher() i=6 2024-09-12T17:42:32.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.175+0000 7f9ea1214800 20 add_watcher() i=7 2024-09-12T17:42:32.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.175+0000 7f9ea1214800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:32.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.177+0000 7f9d52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:32.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.177+0000 7f9ea1214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:32.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.177+0000 7f9ea1214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:32.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.177+0000 7f9ea1214800 5 note: GC not initialized 2024-09-12T17:42:32.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.177+0000 7f9d51fe3640 20 reqs_thread_entry: start 2024-09-12T17:42:32.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.178+0000 7f9ea1214800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:32.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.178+0000 7f9ea1214800 20 Filter name: none 2024-09-12T17:42:32.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.178+0000 7f9cc37fe640 20 reqs_thread_entry: start 2024-09-12T17:42:32.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.178+0000 7f9ea1214800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:42:32.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.178+0000 7f9ea1214800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.178+0000 7f9ea1214800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:32.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.178+0000 7f9ea1214800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:42:32.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.178+0000 7f9ea1214800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:42:32.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.178+0000 7f9ea1214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 : miss 2024-09-12T17:42:32.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.178+0000 7f9ea1214800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.179+0000 7f9ea1214800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:32.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.179+0000 7f9ea1214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 info.flags=0x17 2024-09-12T17:42:32.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.179+0000 7f9ea1214800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 to cache LRU end 2024-09-12T17:42:32.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.179+0000 7f9ea1214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:32.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.179+0000 7f9ea1214800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:32.181 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.179+0000 7f9ea1214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 2024-09-12T17:42:32.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.188+0000 7f9ea1214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 info.flags=0x17 2024-09-12T17:42:32.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.188+0000 7f9ea1214800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 to cache LRU end 2024-09-12T17:42:32.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.188+0000 7f9ea1214800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:32.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.188+0000 7f9ea1214800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23, ofs0, ns] 2024-09-12T17:42:32.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.188+0000 7f9d73fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562410 cookie 94744865164272 notifier 6197 bl.length()=1009 2024-09-12T17:42:32.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.188+0000 7f9d73fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 info.flags=0x17 2024-09-12T17:42:32.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.188+0000 7f9d73fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 to cache LRU end 2024-09-12T17:42:32.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.188+0000 7f9d73fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:32.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.188+0000 7f9ea1214800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23]): orig_sources= new_sources= 2024-09-12T17:42:32.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.188+0000 7f9ea1214800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23]): potential sources added=[] removed=[] 2024-09-12T17:42:32.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.188+0000 7f9ea1214800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23]): orig_dests= new_dests= 2024-09-12T17:42:32.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.188+0000 7f9ea1214800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23]): potential dests added=[] removed=[] 2024-09-12T17:42:32.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.0 2024-09-12T17:42:32.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.0 2024-09-12T17:42:32.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.1 2024-09-12T17:42:32.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.1 2024-09-12T17:42:32.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.2 2024-09-12T17:42:32.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.2 2024-09-12T17:42:32.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.3 2024-09-12T17:42:32.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.3 2024-09-12T17:42:32.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.4 2024-09-12T17:42:32.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.4 2024-09-12T17:42:32.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.5 2024-09-12T17:42:32.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.5 2024-09-12T17:42:32.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.6 2024-09-12T17:42:32.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.6 2024-09-12T17:42:32.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.7 2024-09-12T17:42:32.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.7 2024-09-12T17:42:32.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.8 2024-09-12T17:42:32.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.8 2024-09-12T17:42:32.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.9 2024-09-12T17:42:32.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.9 2024-09-12T17:42:32.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.10 2024-09-12T17:42:32.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.10 2024-09-12T17:42:32.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.11 2024-09-12T17:42:32.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1.11 2024-09-12T17:42:32.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.0 2024-09-12T17:42:32.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1 2024-09-12T17:42:32.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.193+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.2 2024-09-12T17:42:32.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.194+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.3 2024-09-12T17:42:32.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.195+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.4 2024-09-12T17:42:32.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.196+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.5 2024-09-12T17:42:32.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.196+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.6 2024-09-12T17:42:32.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.197+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.7 2024-09-12T17:42:32.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.197+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.8 2024-09-12T17:42:32.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.198+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.9 2024-09-12T17:42:32.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.199+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.10 2024-09-12T17:42:32.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.201+0000 7f9ea1214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:32.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.201+0000 7f9ea1214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 2024-09-12T17:42:32.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.203+0000 7f9ea1214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 info.flags=0x17 2024-09-12T17:42:32.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.203+0000 7f9ea1214800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 to cache LRU end 2024-09-12T17:42:32.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.203+0000 7f9ea1214800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:32.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.203+0000 7f9ea1214800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23, ofs0, ns] 2024-09-12T17:42:32.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.203+0000 7f9d737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562411 cookie 94744865164272 notifier 6197 bl.length()=1009 2024-09-12T17:42:32.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.203+0000 7f9d737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 info.flags=0x17 2024-09-12T17:42:32.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.203+0000 7f9d737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 to cache LRU end 2024-09-12T17:42:32.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.203+0000 7f9d737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:32.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.204+0000 7f9ea1214800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23]): orig_sources= new_sources= 2024-09-12T17:42:32.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.204+0000 7f9ea1214800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23]): potential sources added=[] removed=[] 2024-09-12T17:42:32.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.204+0000 7f9ea1214800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23]): orig_dests= new_dests= 2024-09-12T17:42:32.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.204+0000 7f9ea1214800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23]): potential dests added=[] removed=[] 2024-09-12T17:42:32.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.206+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.0 2024-09-12T17:42:32.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.206+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.1 2024-09-12T17:42:32.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.206+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.2 2024-09-12T17:42:32.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.206+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.3 2024-09-12T17:42:32.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.207+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.4 2024-09-12T17:42:32.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.207+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.5 2024-09-12T17:42:32.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.207+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.6 2024-09-12T17:42:32.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.208+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.7 2024-09-12T17:42:32.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.208+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.8 2024-09-12T17:42:32.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.208+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.9 2024-09-12T17:42:32.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.209+0000 7f9ea1214800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23.10 2024-09-12T17:42:32.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.209+0000 7f9ea1214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:32.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.209+0000 7f9ea1214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 2024-09-12T17:42:32.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.210+0000 7f9ea1214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 info.flags=0x17 2024-09-12T17:42:32.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.210+0000 7f9ea1214800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 to cache LRU end 2024-09-12T17:42:32.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.210+0000 7f9ea1214800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:32.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.210+0000 7f9ea1214800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23, ofs0, ns] 2024-09-12T17:42:32.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.210+0000 7f9d73fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562412 cookie 94744865164272 notifier 6197 bl.length()=977 2024-09-12T17:42:32.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.210+0000 7f9d73fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 info.flags=0x17 2024-09-12T17:42:32.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.210+0000 7f9d73fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 to cache LRU end 2024-09-12T17:42:32.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.210+0000 7f9d73fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:32.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.211+0000 7f9ea1214800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23]): orig_sources= new_sources= 2024-09-12T17:42:32.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.211+0000 7f9ea1214800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23]): potential sources added=[] removed=[] 2024-09-12T17:42:32.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.211+0000 7f9ea1214800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23]): orig_dests= new_dests= 2024-09-12T17:42:32.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.211+0000 7f9ea1214800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23]): potential dests added=[] removed=[] 2024-09-12T17:42:32.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.213+0000 7f9ea1214800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:42:32.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.216+0000 7f9d52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:32.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.218+0000 7f9ea1214800 20 remove_watcher() i=0 2024-09-12T17:42:32.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.218+0000 7f9ea1214800 2 removed watcher, disabling cache 2024-09-12T17:42:32.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.219+0000 7f9ea1214800 20 remove_watcher() i=1 2024-09-12T17:42:32.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.220+0000 7f9ea1214800 20 remove_watcher() i=2 2024-09-12T17:42:32.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.221+0000 7f9ea1214800 20 remove_watcher() i=3 2024-09-12T17:42:32.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.222+0000 7f9ea1214800 20 remove_watcher() i=4 2024-09-12T17:42:32.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.223+0000 7f9ea1214800 20 remove_watcher() i=5 2024-09-12T17:42:32.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.224+0000 7f9ea1214800 20 remove_watcher() i=6 2024-09-12T17:42:32.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.225+0000 7f9ea1214800 20 remove_watcher() i=7 2024-09-12T17:42:32.238 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:42:32.268 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:32.268 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:32.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.306+0000 7f155dc10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.308+0000 7f155dc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.308+0000 7f155dc10800 20 realm 2024-09-12T17:42:32.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.308+0000 7f155dc10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.308+0000 7f155dc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.308+0000 7f155dc10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:32.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.308+0000 7f155dc10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.308+0000 7f155dc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.308+0000 7f155dc10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.309+0000 7f155dc10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:32.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.309+0000 7f155dc10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.309+0000 7f155dc10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:32.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.309+0000 7f155dc10800 20 searching for the correct realm 2024-09-12T17:42:32.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.312+0000 7f1559bbd640 0 -- 172.21.15.44:0/2880467604 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f1550058290 msgr2=0x7f15500a95f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:32.316 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.316+0000 7f15593bc640 0 -- 172.21.15.44:0/2880467604 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f15500acb60 msgr2=0x7f15500d9040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:32.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.320+0000 7f155dc10800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:32.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.320+0000 7f155dc10800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:32.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.320+0000 7f155dc10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:32.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.320+0000 7f155dc10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:32.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.320+0000 7f155dc10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:32.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.320+0000 7f155dc10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:32.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.320+0000 7f155dc10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.320+0000 7f155dc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.320+0000 7f155dc10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.321+0000 7f155dc10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:32.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.321+0000 7f155dc10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.321+0000 7f155dc10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:32.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.321+0000 7f155dc10800 20 zone default found 2024-09-12T17:42:32.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.321+0000 7f155dc10800 4 Realm: () 2024-09-12T17:42:32.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.321+0000 7f155dc10800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:32.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.321+0000 7f155dc10800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:32.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.321+0000 7f155dc10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:32.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.321+0000 7f155dc10800 20 zonegroup default 2024-09-12T17:42:32.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.321+0000 7f155dc10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.321+0000 7f155dc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.321+0000 7f155dc10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.321+0000 7f155dc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.321+0000 7f155dc10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.322+0000 7f155dc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.322+0000 7f155dc10800 20 started sync module instance, tier type = 2024-09-12T17:42:32.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.322+0000 7f155dc10800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:32.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.330+0000 7f155dc10800 20 add_watcher() i=0 2024-09-12T17:42:32.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.330+0000 7f155dc10800 20 add_watcher() i=1 2024-09-12T17:42:32.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.330+0000 7f155dc10800 20 add_watcher() i=2 2024-09-12T17:42:32.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.330+0000 7f155dc10800 20 add_watcher() i=3 2024-09-12T17:42:32.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.330+0000 7f155dc10800 20 add_watcher() i=4 2024-09-12T17:42:32.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.330+0000 7f155dc10800 20 add_watcher() i=5 2024-09-12T17:42:32.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.330+0000 7f155dc10800 20 add_watcher() i=6 2024-09-12T17:42:32.332 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.331+0000 7f155dc10800 20 add_watcher() i=7 2024-09-12T17:42:32.332 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.331+0000 7f155dc10800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:32.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.333+0000 7f140f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:32.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.333+0000 7f155dc10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:32.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.333+0000 7f155dc10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:32.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.333+0000 7f155dc10800 5 note: GC not initialized 2024-09-12T17:42:32.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.333+0000 7f140e7e4640 20 reqs_thread_entry: start 2024-09-12T17:42:32.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.333+0000 7f155dc10800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:32.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.333+0000 7f155dc10800 20 Filter name: none 2024-09-12T17:42:32.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.334+0000 7f137ffff640 20 reqs_thread_entry: start 2024-09-12T17:42:32.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.334+0000 7f155dc10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.334+0000 7f155dc10800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:32.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.334+0000 7f155dc10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.334+0000 7f155dc10800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:32.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.334+0000 7f155dc10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:32.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.334+0000 7f155dc10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.335+0000 7f155dc10800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:32.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.335+0000 7f155dc10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.335+0000 7f155dc10800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:32.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.335+0000 7f155dc10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:32.337 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.337+0000 7f140f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:32.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.339+0000 7f155dc10800 20 remove_watcher() i=0 2024-09-12T17:42:32.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.339+0000 7f155dc10800 2 removed watcher, disabling cache 2024-09-12T17:42:32.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.340+0000 7f155dc10800 20 remove_watcher() i=1 2024-09-12T17:42:32.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.341+0000 7f155dc10800 20 remove_watcher() i=2 2024-09-12T17:42:32.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.342+0000 7f155dc10800 20 remove_watcher() i=3 2024-09-12T17:42:32.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.343+0000 7f155dc10800 20 remove_watcher() i=4 2024-09-12T17:42:32.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.344+0000 7f155dc10800 20 remove_watcher() i=5 2024-09-12T17:42:32.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.345+0000 7f155dc10800 20 remove_watcher() i=6 2024-09-12T17:42:32.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.346+0000 7f155dc10800 20 remove_watcher() i=7 2024-09-12T17:42:32.357 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:32.357 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:42:32.357 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-set-target-layout id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:42:32.358 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:32.435 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T17:42:32.435 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:32.626 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:42:32.655 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:32.656 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:32.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.693+0000 7ff3de40e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.695+0000 7ff3de40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.695+0000 7ff3de40e800 20 realm 2024-09-12T17:42:32.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.695+0000 7ff3de40e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.695+0000 7ff3de40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.695+0000 7ff3de40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:32.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.695+0000 7ff3de40e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.696+0000 7ff3de40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.696+0000 7ff3de40e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.696+0000 7ff3de40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:32.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.696+0000 7ff3de40e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.697+0000 7ff3de40e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:32.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.697+0000 7ff3de40e800 20 searching for the correct realm 2024-09-12T17:42:32.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.700+0000 7ff3da36c640 0 -- 172.21.15.44:0/2722412901 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x55ab77151bf0 msgr2=0x55ab77154080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:32.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.704+0000 7ff3d936a640 0 -- 172.21.15.44:0/2722412901 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7ff3cc0b2d40 msgr2=0x7ff3cc0b1aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:32.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.707+0000 7ff3de40e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:32.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.707+0000 7ff3de40e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:32.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.707+0000 7ff3de40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:32.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.707+0000 7ff3de40e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:32.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.707+0000 7ff3de40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:32.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.707+0000 7ff3de40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:32.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.707+0000 7ff3de40e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.707+0000 7ff3de40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.707+0000 7ff3de40e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.708+0000 7ff3de40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:32.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.708+0000 7ff3de40e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.708+0000 7ff3de40e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:32.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.708+0000 7ff3de40e800 20 zone default found 2024-09-12T17:42:32.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.708+0000 7ff3de40e800 4 Realm: () 2024-09-12T17:42:32.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.708+0000 7ff3de40e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:32.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.708+0000 7ff3de40e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:32.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.708+0000 7ff3de40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:32.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.708+0000 7ff3de40e800 20 zonegroup default 2024-09-12T17:42:32.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.708+0000 7ff3de40e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.708+0000 7ff3de40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.708+0000 7ff3de40e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.709+0000 7ff3de40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.709+0000 7ff3de40e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.709+0000 7ff3de40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.709+0000 7ff3de40e800 20 started sync module instance, tier type = 2024-09-12T17:42:32.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.709+0000 7ff3de40e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:32.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.718+0000 7ff3de40e800 20 add_watcher() i=0 2024-09-12T17:42:32.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.718+0000 7ff3de40e800 20 add_watcher() i=1 2024-09-12T17:42:32.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.718+0000 7ff3de40e800 20 add_watcher() i=2 2024-09-12T17:42:32.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.718+0000 7ff3de40e800 20 add_watcher() i=3 2024-09-12T17:42:32.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.718+0000 7ff3de40e800 20 add_watcher() i=4 2024-09-12T17:42:32.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.718+0000 7ff3de40e800 20 add_watcher() i=5 2024-09-12T17:42:32.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.718+0000 7ff3de40e800 20 add_watcher() i=6 2024-09-12T17:42:32.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.719+0000 7ff3de40e800 20 add_watcher() i=7 2024-09-12T17:42:32.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.719+0000 7ff3de40e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:32.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.720+0000 7ff28b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:32.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.721+0000 7ff3de40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:32.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.721+0000 7ff3de40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:32.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.721+0000 7ff3de40e800 5 note: GC not initialized 2024-09-12T17:42:32.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.721+0000 7ff28a7fc640 20 reqs_thread_entry: start 2024-09-12T17:42:32.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.721+0000 7ff3de40e800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:32.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.721+0000 7ff3de40e800 20 Filter name: none 2024-09-12T17:42:32.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.721+0000 7ff1fbfff640 20 reqs_thread_entry: start 2024-09-12T17:42:32.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.721+0000 7ff3de40e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.722+0000 7ff3de40e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:32.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.722+0000 7ff3de40e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.722+0000 7ff3de40e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:32.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.722+0000 7ff3de40e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:32.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.722+0000 7ff3de40e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.723+0000 7ff3de40e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:32.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.723+0000 7ff3de40e800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.723+0000 7ff3de40e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:32.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.723+0000 7ff3de40e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:32.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.725+0000 7ff28b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:32.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.727+0000 7ff3de40e800 20 remove_watcher() i=0 2024-09-12T17:42:32.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.727+0000 7ff3de40e800 2 removed watcher, disabling cache 2024-09-12T17:42:32.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.728+0000 7ff3de40e800 20 remove_watcher() i=1 2024-09-12T17:42:32.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.729+0000 7ff3de40e800 20 remove_watcher() i=2 2024-09-12T17:42:32.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.730+0000 7ff3de40e800 20 remove_watcher() i=3 2024-09-12T17:42:32.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.731+0000 7ff3de40e800 20 remove_watcher() i=4 2024-09-12T17:42:32.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.732+0000 7ff3de40e800 20 remove_watcher() i=5 2024-09-12T17:42:32.733 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.732+0000 7ff3de40e800 20 remove_watcher() i=6 2024-09-12T17:42:32.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.733+0000 7ff3de40e800 20 remove_watcher() i=7 2024-09-12T17:42:32.745 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:32.745 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:42:32.745 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-set-target-layout id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:42:32.745 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:32.746 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T17:42:32.783 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:32.783 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:32.823 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.822+0000 7f0c57146800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.824+0000 7f0c57146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.824+0000 7f0c57146800 20 realm 2024-09-12T17:42:32.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.824+0000 7f0c57146800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.824+0000 7f0c57146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.824+0000 7f0c57146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:32.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.824+0000 7f0c57146800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.824+0000 7f0c57146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:32.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.824+0000 7f0c57146800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.825+0000 7f0c57146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:32.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.825+0000 7f0c57146800 20 rados->read ofs=0 len=0 2024-09-12T17:42:32.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.825+0000 7f0c57146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:32.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.825+0000 7f0c57146800 20 searching for the correct realm 2024-09-12T17:42:32.829 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:32.829+0000 7f0c55431640 0 -- 172.21.15.44:0/162826208 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f0c48015070 msgr2=0x7f0c48017760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:33.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.034+0000 7f0c54c30640 0 -- 172.21.15.44:0/162826208 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f0c48097040 msgr2=0x7f0c48069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:33.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.241+0000 7f0c57146800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:33.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.241+0000 7f0c57146800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:33.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.241+0000 7f0c57146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:33.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.241+0000 7f0c57146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:33.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.241+0000 7f0c57146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:33.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.241+0000 7f0c57146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:33.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.241+0000 7f0c57146800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.241+0000 7f0c57146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.241+0000 7f0c57146800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.241+0000 7f0c57146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:33.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.241+0000 7f0c57146800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.242+0000 7f0c57146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:33.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.242+0000 7f0c57146800 20 zone default found 2024-09-12T17:42:33.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.242+0000 7f0c57146800 4 Realm: () 2024-09-12T17:42:33.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.242+0000 7f0c57146800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:33.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.242+0000 7f0c57146800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:33.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.242+0000 7f0c57146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:33.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.242+0000 7f0c57146800 20 zonegroup default 2024-09-12T17:42:33.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.242+0000 7f0c57146800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.242+0000 7f0c57146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.242+0000 7f0c57146800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.243+0000 7f0c57146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.243+0000 7f0c57146800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.243+0000 7f0c57146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.243+0000 7f0c57146800 20 started sync module instance, tier type = 2024-09-12T17:42:33.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.243+0000 7f0c57146800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:33.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.252+0000 7f0c57146800 20 add_watcher() i=0 2024-09-12T17:42:33.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.252+0000 7f0c57146800 20 add_watcher() i=1 2024-09-12T17:42:33.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.252+0000 7f0c57146800 20 add_watcher() i=2 2024-09-12T17:42:33.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.252+0000 7f0c57146800 20 add_watcher() i=3 2024-09-12T17:42:33.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.252+0000 7f0c57146800 20 add_watcher() i=4 2024-09-12T17:42:33.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.252+0000 7f0c57146800 20 add_watcher() i=5 2024-09-12T17:42:33.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.252+0000 7f0c57146800 20 add_watcher() i=6 2024-09-12T17:42:33.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.253+0000 7f0c57146800 20 add_watcher() i=7 2024-09-12T17:42:33.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.253+0000 7f0c57146800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:33.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.255+0000 7f0b0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:33.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.255+0000 7f0c57146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:33.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.255+0000 7f0c57146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:33.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.255+0000 7f0c57146800 5 note: GC not initialized 2024-09-12T17:42:33.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.256+0000 7f0b09fe3640 20 reqs_thread_entry: start 2024-09-12T17:42:33.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.256+0000 7f0c57146800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:33.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.256+0000 7f0c57146800 20 Filter name: none 2024-09-12T17:42:33.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.256+0000 7f0a7b7fe640 20 reqs_thread_entry: start 2024-09-12T17:42:33.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.256+0000 7f0c57146800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:42:33.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.256+0000 7f0c57146800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.256+0000 7f0c57146800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:33.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.256+0000 7f0c57146800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:42:33.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.256+0000 7f0c57146800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:42:33.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.256+0000 7f0c57146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 : miss 2024-09-12T17:42:33.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.256+0000 7f0c57146800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.257+0000 7f0c57146800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:33.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.257+0000 7f0c57146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 info.flags=0x17 2024-09-12T17:42:33.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.257+0000 7f0c57146800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 to cache LRU end 2024-09-12T17:42:33.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.257+0000 7f0c57146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:33.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.257+0000 7f0c57146800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:33.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.257+0000 7f0c57146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 2024-09-12T17:42:33.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.261+0000 7f0c57146800 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T17:42:33.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.263+0000 7f0c57146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 info.flags=0x17 2024-09-12T17:42:33.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.263+0000 7f0c57146800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 to cache LRU end 2024-09-12T17:42:33.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.263+0000 7f0c57146800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:33.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.263+0000 7f0c57146800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24, ofs0, ns] 2024-09-12T17:42:33.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.263+0000 7f0b2bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562415 cookie 94831927036256 notifier 6669 bl.length()=1009 2024-09-12T17:42:33.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.263+0000 7f0b2bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 info.flags=0x17 2024-09-12T17:42:33.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.263+0000 7f0b2bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 to cache LRU end 2024-09-12T17:42:33.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.263+0000 7f0b2bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:33.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.263+0000 7f0c57146800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24]): orig_sources= new_sources= 2024-09-12T17:42:33.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.263+0000 7f0c57146800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24]): potential sources added=[] removed=[] 2024-09-12T17:42:33.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.263+0000 7f0c57146800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24]): orig_dests= new_dests= 2024-09-12T17:42:33.265 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.263+0000 7f0c57146800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24]): potential dests added=[] removed=[] 2024-09-12T17:42:33.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.0 2024-09-12T17:42:33.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.0 2024-09-12T17:42:33.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.1 2024-09-12T17:42:33.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.1 2024-09-12T17:42:33.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.2 2024-09-12T17:42:33.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.2 2024-09-12T17:42:33.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.3 2024-09-12T17:42:33.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.3 2024-09-12T17:42:33.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.4 2024-09-12T17:42:33.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.4 2024-09-12T17:42:33.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.5 2024-09-12T17:42:33.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.5 2024-09-12T17:42:33.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.6 2024-09-12T17:42:33.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.6 2024-09-12T17:42:33.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.7 2024-09-12T17:42:33.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.7 2024-09-12T17:42:33.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.8 2024-09-12T17:42:33.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.8 2024-09-12T17:42:33.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.9 2024-09-12T17:42:33.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.9 2024-09-12T17:42:33.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.10 2024-09-12T17:42:33.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.10 2024-09-12T17:42:33.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.11 2024-09-12T17:42:33.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1.11 2024-09-12T17:42:33.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.0 2024-09-12T17:42:33.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.268+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1 2024-09-12T17:42:33.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.269+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.2 2024-09-12T17:42:33.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.269+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.3 2024-09-12T17:42:33.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.270+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.4 2024-09-12T17:42:33.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.271+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.5 2024-09-12T17:42:33.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.271+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.6 2024-09-12T17:42:33.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.272+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.7 2024-09-12T17:42:33.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.272+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.8 2024-09-12T17:42:33.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.273+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.9 2024-09-12T17:42:33.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.273+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.10 2024-09-12T17:42:33.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.277+0000 7f0c57146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:33.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.277+0000 7f0c57146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 2024-09-12T17:42:33.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.278+0000 7f0c57146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 info.flags=0x17 2024-09-12T17:42:33.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.278+0000 7f0c57146800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 to cache LRU end 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.278+0000 7f0c57146800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.278+0000 7f0c57146800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24, ofs0, ns] 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.278+0000 7f0b2b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562416 cookie 94831927036256 notifier 6669 bl.length()=1009 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.278+0000 7f0b2b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 info.flags=0x17 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.278+0000 7f0b2b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 to cache LRU end 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.278+0000 7f0b2b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.279+0000 7f0c57146800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24]): orig_sources= new_sources= 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.279+0000 7f0c57146800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24]): potential sources added=[] removed=[] 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.279+0000 7f0c57146800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24]): orig_dests= new_dests= 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.279+0000 7f0c57146800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24]): potential dests added=[] removed=[] 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.281+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.0 2024-09-12T17:42:33.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.281+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.1 2024-09-12T17:42:33.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.282+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.2 2024-09-12T17:42:33.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.282+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.3 2024-09-12T17:42:33.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.282+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.4 2024-09-12T17:42:33.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.283+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.5 2024-09-12T17:42:33.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.283+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.6 2024-09-12T17:42:33.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.283+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.7 2024-09-12T17:42:33.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.284+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.8 2024-09-12T17:42:33.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.284+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.9 2024-09-12T17:42:33.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.284+0000 7f0c57146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24.10 2024-09-12T17:42:33.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.285+0000 7f0c57146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:42:33.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.285+0000 7f0c57146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 2024-09-12T17:42:33.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.286+0000 7f0c57146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 info.flags=0x17 2024-09-12T17:42:33.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.286+0000 7f0c57146800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 to cache LRU end 2024-09-12T17:42:33.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.286+0000 7f0c57146800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:33.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.286+0000 7f0c57146800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24, ofs0, ns] 2024-09-12T17:42:33.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.287+0000 7f0b2b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562417 cookie 94831927036256 notifier 6669 bl.length()=977 2024-09-12T17:42:33.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.287+0000 7f0b2b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 info.flags=0x17 2024-09-12T17:42:33.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.287+0000 7f0b2b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 to cache LRU end 2024-09-12T17:42:33.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.287+0000 7f0b2b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:33.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.287+0000 7f0c57146800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24]): orig_sources= new_sources= 2024-09-12T17:42:33.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.287+0000 7f0c57146800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24]): potential sources added=[] removed=[] 2024-09-12T17:42:33.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.287+0000 7f0c57146800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24]): orig_dests= new_dests= 2024-09-12T17:42:33.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.287+0000 7f0c57146800 20 handle_bi_update(): bucket=:error-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24]): potential dests added=[] removed=[] 2024-09-12T17:42:33.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.290+0000 7f0c57146800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:42:33.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.292+0000 7f0b0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:33.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.294+0000 7f0c57146800 20 remove_watcher() i=0 2024-09-12T17:42:33.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.294+0000 7f0c57146800 2 removed watcher, disabling cache 2024-09-12T17:42:33.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.295+0000 7f0c57146800 20 remove_watcher() i=1 2024-09-12T17:42:33.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.296+0000 7f0c57146800 20 remove_watcher() i=2 2024-09-12T17:42:33.298 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.297+0000 7f0c57146800 20 remove_watcher() i=3 2024-09-12T17:42:33.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.298+0000 7f0c57146800 20 remove_watcher() i=4 2024-09-12T17:42:33.300 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.299+0000 7f0c57146800 20 remove_watcher() i=5 2024-09-12T17:42:33.301 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.300+0000 7f0c57146800 20 remove_watcher() i=6 2024-09-12T17:42:33.302 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.301+0000 7f0c57146800 20 remove_watcher() i=7 2024-09-12T17:42:33.315 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:42:33.344 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:33.345 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:33.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.383+0000 7f00ef519800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.384+0000 7f00ef519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.384+0000 7f00ef519800 20 realm 2024-09-12T17:42:33.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.384+0000 7f00ef519800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.385+0000 7f00ef519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.385+0000 7f00ef519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:33.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.385+0000 7f00ef519800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.385+0000 7f00ef519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.385+0000 7f00ef519800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.386+0000 7f00ef519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:33.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.386+0000 7f00ef519800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.386+0000 7f00ef519800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:33.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.386+0000 7f00ef519800 20 searching for the correct realm 2024-09-12T17:42:33.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.390+0000 7f00ed804640 0 -- 172.21.15.44:0/458148260 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x560977451550 msgr2=0x560977453970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:33.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.393+0000 7f00ec802640 0 -- 172.21.15.44:0/458148260 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f00e006d060 msgr2=0x7f00e00a3330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:33.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.397+0000 7f00ef519800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:33.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.397+0000 7f00ef519800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:33.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.397+0000 7f00ef519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:33.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.397+0000 7f00ef519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:33.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.397+0000 7f00ef519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:33.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.397+0000 7f00ef519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:33.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.397+0000 7f00ef519800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.397+0000 7f00ef519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.397+0000 7f00ef519800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.398+0000 7f00ef519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:33.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.398+0000 7f00ef519800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.398+0000 7f00ef519800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:33.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.398+0000 7f00ef519800 20 zone default found 2024-09-12T17:42:33.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.398+0000 7f00ef519800 4 Realm: () 2024-09-12T17:42:33.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.398+0000 7f00ef519800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:33.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.398+0000 7f00ef519800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:33.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.398+0000 7f00ef519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:33.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.398+0000 7f00ef519800 20 zonegroup default 2024-09-12T17:42:33.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.398+0000 7f00ef519800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.398+0000 7f00ef519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.398+0000 7f00ef519800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.399+0000 7f00ef519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.399+0000 7f00ef519800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.399+0000 7f00ef519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.399+0000 7f00ef519800 20 started sync module instance, tier type = 2024-09-12T17:42:33.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.399+0000 7f00ef519800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:33.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.408+0000 7f00ef519800 20 add_watcher() i=0 2024-09-12T17:42:33.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.408+0000 7f00ef519800 20 add_watcher() i=1 2024-09-12T17:42:33.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.408+0000 7f00ef519800 20 add_watcher() i=2 2024-09-12T17:42:33.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.408+0000 7f00ef519800 20 add_watcher() i=3 2024-09-12T17:42:33.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.408+0000 7f00ef519800 20 add_watcher() i=4 2024-09-12T17:42:33.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.408+0000 7f00ef519800 20 add_watcher() i=5 2024-09-12T17:42:33.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.408+0000 7f00ef519800 20 add_watcher() i=6 2024-09-12T17:42:33.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.409+0000 7f00ef519800 20 add_watcher() i=7 2024-09-12T17:42:33.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.409+0000 7f00ef519800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:33.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.410+0000 7effa3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:33.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.411+0000 7f00ef519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:33.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.411+0000 7f00ef519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:33.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.411+0000 7f00ef519800 5 note: GC not initialized 2024-09-12T17:42:33.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.411+0000 7effa2fe5640 20 reqs_thread_entry: start 2024-09-12T17:42:33.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.411+0000 7f00ef519800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:33.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.411+0000 7f00ef519800 20 Filter name: none 2024-09-12T17:42:33.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.411+0000 7effa0fe1640 20 reqs_thread_entry: start 2024-09-12T17:42:33.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.411+0000 7f00ef519800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.411+0000 7f00ef519800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:33.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.411+0000 7f00ef519800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.412+0000 7f00ef519800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:33.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.412+0000 7f00ef519800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:33.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.412+0000 7f00ef519800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.412+0000 7f00ef519800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:33.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.412+0000 7f00ef519800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.413+0000 7f00ef519800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:33.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.413+0000 7f00ef519800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:33.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.414+0000 7effa3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:33.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.416+0000 7f00ef519800 20 remove_watcher() i=0 2024-09-12T17:42:33.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.416+0000 7f00ef519800 2 removed watcher, disabling cache 2024-09-12T17:42:33.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.417+0000 7f00ef519800 20 remove_watcher() i=1 2024-09-12T17:42:33.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.418+0000 7f00ef519800 20 remove_watcher() i=2 2024-09-12T17:42:33.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.419+0000 7f00ef519800 20 remove_watcher() i=3 2024-09-12T17:42:33.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.420+0000 7f00ef519800 20 remove_watcher() i=4 2024-09-12T17:42:33.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.421+0000 7f00ef519800 20 remove_watcher() i=5 2024-09-12T17:42:33.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.422+0000 7f00ef519800 20 remove_watcher() i=6 2024-09-12T17:42:33.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.423+0000 7f00ef519800 20 remove_watcher() i=7 2024-09-12T17:42:33.435 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:33.435 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:42:33.435 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-set-target-layout id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:42:33.435 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:33.512 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T17:42:33.512 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:33.710 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:42:33.739 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:33.740 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:33.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.778+0000 7f9f33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.780+0000 7f9f33e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.780+0000 7f9f33e10800 20 realm 2024-09-12T17:42:33.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.780+0000 7f9f33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.780+0000 7f9f33e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.780+0000 7f9f33e10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:33.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.780+0000 7f9f33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.780+0000 7f9f33e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.780+0000 7f9f33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.781+0000 7f9f33e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:33.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.781+0000 7f9f33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.781+0000 7f9f33e10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:33.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.781+0000 7f9f33e10800 20 searching for the correct realm 2024-09-12T17:42:33.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.784+0000 7f9f2edbb640 0 -- 172.21.15.44:0/200171816 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f9f20094060 msgr2=0x7f9f200030b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:33.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.788+0000 7f9f2f5bc640 0 -- 172.21.15.44:0/200171816 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f9f24017990 msgr2=0x7f9f24072950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:33.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.993+0000 7f9f33e10800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:33.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.993+0000 7f9f33e10800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:33.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.993+0000 7f9f33e10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:33.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.993+0000 7f9f33e10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:33.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.993+0000 7f9f33e10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:33.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.993+0000 7f9f33e10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:33.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.993+0000 7f9f33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.994+0000 7f9f33e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.994+0000 7f9f33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.994+0000 7f9f33e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:33.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.994+0000 7f9f33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.994+0000 7f9f33e10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:33.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.994+0000 7f9f33e10800 20 zone default found 2024-09-12T17:42:33.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.994+0000 7f9f33e10800 4 Realm: () 2024-09-12T17:42:33.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.994+0000 7f9f33e10800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:33.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.994+0000 7f9f33e10800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:33.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.994+0000 7f9f33e10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:33.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.994+0000 7f9f33e10800 20 zonegroup default 2024-09-12T17:42:33.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.994+0000 7f9f33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.995+0000 7f9f33e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.995+0000 7f9f33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.995+0000 7f9f33e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.995+0000 7f9f33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:33.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.995+0000 7f9f33e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:33.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.995+0000 7f9f33e10800 20 started sync module instance, tier type = 2024-09-12T17:42:33.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:33.995+0000 7f9f33e10800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:34.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.005+0000 7f9f33e10800 20 add_watcher() i=0 2024-09-12T17:42:34.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.005+0000 7f9f33e10800 20 add_watcher() i=1 2024-09-12T17:42:34.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.005+0000 7f9f33e10800 20 add_watcher() i=2 2024-09-12T17:42:34.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.005+0000 7f9f33e10800 20 add_watcher() i=3 2024-09-12T17:42:34.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.005+0000 7f9f33e10800 20 add_watcher() i=4 2024-09-12T17:42:34.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.005+0000 7f9f33e10800 20 add_watcher() i=5 2024-09-12T17:42:34.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.005+0000 7f9f33e10800 20 add_watcher() i=6 2024-09-12T17:42:34.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.006+0000 7f9f33e10800 20 add_watcher() i=7 2024-09-12T17:42:34.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.006+0000 7f9f33e10800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:34.008 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.007+0000 7f9de5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:34.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.008+0000 7f9f33e10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:34.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.008+0000 7f9f33e10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:34.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.008+0000 7f9f33e10800 5 note: GC not initialized 2024-09-12T17:42:34.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.008+0000 7f9de4fe1640 20 reqs_thread_entry: start 2024-09-12T17:42:34.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.008+0000 7f9f33e10800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:34.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.008+0000 7f9f33e10800 20 Filter name: none 2024-09-12T17:42:34.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.008+0000 7f9d5e7fc640 20 reqs_thread_entry: start 2024-09-12T17:42:34.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.008+0000 7f9f33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.009+0000 7f9f33e10800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:34.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.009+0000 7f9f33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.010+0000 7f9f33e10800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:34.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.010+0000 7f9f33e10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:34.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.010+0000 7f9f33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.010+0000 7f9f33e10800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:34.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.010+0000 7f9f33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.010+0000 7f9f33e10800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:34.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.011+0000 7f9f33e10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:34.013 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.012+0000 7f9de5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:34.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.015+0000 7f9f33e10800 20 remove_watcher() i=0 2024-09-12T17:42:34.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.015+0000 7f9f33e10800 2 removed watcher, disabling cache 2024-09-12T17:42:34.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.016+0000 7f9f33e10800 20 remove_watcher() i=1 2024-09-12T17:42:34.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.017+0000 7f9f33e10800 20 remove_watcher() i=2 2024-09-12T17:42:34.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.018+0000 7f9f33e10800 20 remove_watcher() i=3 2024-09-12T17:42:34.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.019+0000 7f9f33e10800 20 remove_watcher() i=4 2024-09-12T17:42:34.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.020+0000 7f9f33e10800 20 remove_watcher() i=5 2024-09-12T17:42:34.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.021+0000 7f9f33e10800 20 remove_watcher() i=6 2024-09-12T17:42:34.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.022+0000 7f9f33e10800 20 remove_watcher() i=7 2024-09-12T17:42:34.033 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.033 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:42:34.033 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-set-target-layout id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:42:34.033 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.035 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T17:42:34.070 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:34.070 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:34.110 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.109+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.111+0000 7f938a80f800 20 realm 2024-09-12T17:42:34.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.111+0000 7f938a80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:34.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.112+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:34.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.112+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.112+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:34.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.112+0000 7f938a80f800 20 searching for the correct realm 2024-09-12T17:42:34.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.116+0000 7f9387aff640 0 -- 172.21.15.44:0/88874874 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x559cbc03aef0 msgr2=0x559cbc03d390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:34.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.119+0000 7f9388300640 0 -- 172.21.15.44:0/88874874 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f937c09a3a0 msgr2=0x7f937c09a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:34.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:34.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:34.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:34.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:34.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:34.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:34.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.123+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.123+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.123+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:34.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:34.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.124+0000 7f938a80f800 20 zone default found 2024-09-12T17:42:34.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.124+0000 7f938a80f800 4 Realm: () 2024-09-12T17:42:34.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.124+0000 7f938a80f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:34.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.124+0000 7f938a80f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:34.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.124+0000 7f938a80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:34.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.124+0000 7f938a80f800 20 zonegroup default 2024-09-12T17:42:34.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.125+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.125+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.125+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.125+0000 7f938a80f800 20 started sync module instance, tier type = 2024-09-12T17:42:34.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.125+0000 7f938a80f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:34.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=0 2024-09-12T17:42:34.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=1 2024-09-12T17:42:34.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=2 2024-09-12T17:42:34.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=3 2024-09-12T17:42:34.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=4 2024-09-12T17:42:34.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=5 2024-09-12T17:42:34.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=6 2024-09-12T17:42:34.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.135+0000 7f938a80f800 20 add_watcher() i=7 2024-09-12T17:42:34.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.135+0000 7f938a80f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:34.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.136+0000 7f923efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:34.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.136+0000 7f938a80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:34.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.136+0000 7f938a80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:34.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.137+0000 7f938a80f800 5 note: GC not initialized 2024-09-12T17:42:34.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.137+0000 7f923dfdb640 20 reqs_thread_entry: start 2024-09-12T17:42:34.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.137+0000 7f938a80f800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:34.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.137+0000 7f938a80f800 20 Filter name: none 2024-09-12T17:42:34.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.137+0000 7f91af7fe640 20 reqs_thread_entry: start 2024-09-12T17:42:34.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.137+0000 7f938a80f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:42:34.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.137+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.138+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:34.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.138+0000 7f938a80f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:42:34.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.138+0000 7f938a80f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:42:34.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.138+0000 7f938a80f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 : miss 2024-09-12T17:42:34.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.138+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.138+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:34.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.138+0000 7f938a80f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 info.flags=0x17 2024-09-12T17:42:34.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.138+0000 7f938a80f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 to cache LRU end 2024-09-12T17:42:34.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.138+0000 7f938a80f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:34.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.138+0000 7f938a80f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:34.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.138+0000 7f938a80f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 2024-09-12T17:42:34.142 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f938a80f800 time 2024-09-12T17:42:34.142538+0000 2024-09-12T17:42:34.142 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:42:34.143 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:34.143 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f938dd8c71a] 2024-09-12T17:42:34.143 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f938dd8c8d8] 2024-09-12T17:42:34.143 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559cbae1d841] 2024-09-12T17:42:34.143 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd73ca8) [0x559cbb32aca8] 2024-09-12T17:42:34.143 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559cbae2d50d] 2024-09-12T17:42:34.144 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:42:34.144 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f938ca29590] 2024-09-12T17:42:34.144 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:42:34.144 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:42:34.144 INFO:tasks.workunit.client.0.smithi044.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:42:34.144 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f938a80f800 thread_name:radosgw-admin 2024-09-12T17:42:34.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.142+0000 7f938a80f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f938a80f800 time 2024-09-12T17:42:34.142538+0000 2024-09-12T17:42:34.144 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:42:34.144 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.144 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:34.144 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f938dd8c71a] 2024-09-12T17:42:34.144 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f938dd8c8d8] 2024-09-12T17:42:34.145 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559cbae1d841] 2024-09-12T17:42:34.145 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd73ca8) [0x559cbb32aca8] 2024-09-12T17:42:34.145 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559cbae2d50d] 2024-09-12T17:42:34.145 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:42:34.145 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f938ca29590] 2024-09-12T17:42:34.145 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:42:34.145 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:42:34.145 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.163 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:34.164 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f938ca3e6f0] 2024-09-12T17:42:34.164 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f938ca8b99c] 2024-09-12T17:42:34.164 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:42:34.164 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:42:34.164 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f938dd8c774] 2024-09-12T17:42:34.165 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f938dd8c8d8] 2024-09-12T17:42:34.165 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559cbae1d841] 2024-09-12T17:42:34.165 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd73ca8) [0x559cbb32aca8] 2024-09-12T17:42:34.165 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559cbae2d50d] 2024-09-12T17:42:34.165 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:42:34.165 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f938ca29590] 2024-09-12T17:42:34.165 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:42:34.166 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:42:34.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.143+0000 7f938a80f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:42:34.166 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f938a80f800 thread_name:radosgw-admin 2024-09-12T17:42:34.166 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.166 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:34.166 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f938ca3e6f0] 2024-09-12T17:42:34.166 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f938ca8b99c] 2024-09-12T17:42:34.166 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:42:34.167 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:42:34.167 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f938dd8c774] 2024-09-12T17:42:34.167 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f938dd8c8d8] 2024-09-12T17:42:34.167 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559cbae1d841] 2024-09-12T17:42:34.167 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd73ca8) [0x559cbb32aca8] 2024-09-12T17:42:34.167 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559cbae2d50d] 2024-09-12T17:42:34.167 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:42:34.168 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f938ca29590] 2024-09-12T17:42:34.168 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:42:34.168 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:42:34.168 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:42:34.168 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.168 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:42:34.168 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:42:34.091+0000 7f9388b01640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:42:34.169 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.169 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:42:34.169 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: dump: 2024-09-12T17:42:34.169 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.169 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.169 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.169 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.169 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.170 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.170 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.170 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.170 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.170 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.170 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: _finish_auth 0 2024-09-12T17:42:34.170 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: _check_auth_tickets 2024-09-12T17:42:34.170 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:42:34.091+0000 7f938a80f800 5 monclient: authenticate success, global_id 6711 2024-09-12T17:42:34.171 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:34.171 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.171 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:42:34.171 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: dump: 2024-09-12T17:42:34.171 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.171 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.171 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.172 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.172 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.172 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.172 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.172 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.172 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.172 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.172 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:42:34.091+0000 7f938a80f800 10 monclient: get_monmap_and_config success 2024-09-12T17:42:34.173 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:42:34.091+0000 7f938a80f800 4 set_mon_vals no callback set 2024-09-12T17:42:34.173 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:42:34.092+0000 7f938a80f800 10 monclient: shutdown 2024-09-12T17:42:34.173 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 asok(0x559cbbd25730) unregister_commands rotate-key 2024-09-12T17:42:34.173 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:42:34.092+0000 7f938a80f800 10 monclient: build_initial_monmap 2024-09-12T17:42:34.173 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:42:34.092+0000 7f938a80f800 1 build_initial for_mkfs: 0 2024-09-12T17:42:34.173 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:42:34.092+0000 7f938a80f800 10 monclient: monmap: 2024-09-12T17:42:34.173 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:42:34.173 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:34.173 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:42:34.173 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:42:34.173 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:34.174 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.174 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:42:34.174 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:42:34.174 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:42:34.174 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.174 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding auth protocol: cephx 2024-09-12T17:42:34.174 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding auth protocol: cephx 2024-09-12T17:42:34.174 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding auth protocol: cephx 2024-09-12T17:42:34.174 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: secure 2024-09-12T17:42:34.174 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: crc 2024-09-12T17:42:34.174 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: secure 2024-09-12T17:42:34.174 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: crc 2024-09-12T17:42:34.174 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: secure 2024-09-12T17:42:34.174 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: crc 2024-09-12T17:42:34.175 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: crc 2024-09-12T17:42:34.175 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: secure 2024-09-12T17:42:34.175 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: crc 2024-09-12T17:42:34.175 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: secure 2024-09-12T17:42:34.175 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: crc 2024-09-12T17:42:34.175 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: secure 2024-09-12T17:42:34.175 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:42:34.092+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.176 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:42:34.092+0000 7f938a80f800 1 librados: starting msgr at 2024-09-12T17:42:34.176 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:42:34.092+0000 7f938a80f800 1 librados: starting objecter 2024-09-12T17:42:34.176 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command objecter_requests hook 0x559cbbf79c40 2024-09-12T17:42:34.176 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:42:34.092+0000 7f938a80f800 1 librados: setting wanted keys 2024-09-12T17:42:34.176 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:42:34.092+0000 7f938a80f800 1 librados: calling monclient init 2024-09-12T17:42:34.176 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:42:34.092+0000 7f938a80f800 10 monclient: init 2024-09-12T17:42:34.177 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding auth protocol: cephx 2024-09-12T17:42:34.177 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding auth protocol: cephx 2024-09-12T17:42:34.177 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding auth protocol: cephx 2024-09-12T17:42:34.177 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: secure 2024-09-12T17:42:34.177 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: crc 2024-09-12T17:42:34.177 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: secure 2024-09-12T17:42:34.177 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: crc 2024-09-12T17:42:34.178 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: secure 2024-09-12T17:42:34.178 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: crc 2024-09-12T17:42:34.178 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: crc 2024-09-12T17:42:34.178 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: secure 2024-09-12T17:42:34.178 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: crc 2024-09-12T17:42:34.178 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: secure 2024-09-12T17:42:34.178 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: crc 2024-09-12T17:42:34.179 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: secure 2024-09-12T17:42:34.179 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:42:34.093+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.179 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:42:34.093+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.179 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:42:34.093+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command rotate-key hook 0x559cbbf47df8 2024-09-12T17:42:34.179 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:34.179 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:42:34.179 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-c con 0x559cbbdd1110 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:42:34.179 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-a con 0x559cbbdd1a90 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:42:34.179 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-b con 0x559cbbe8a890 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:42:34.179 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.179 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.179 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.180 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:34.180 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient(hunting): authenticate will time out at 1926.729399s 2024-09-12T17:42:34.180 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient(hunting): get_auth_request con 0x559cbbdd1110 auth_method 0 2024-09-12T17:42:34.180 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.180 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.180 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.180 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:42:34.093+0000 7f9387aff640 10 monclient(hunting): get_auth_request con 0x559cbbdd1a90 auth_method 0 2024-09-12T17:42:34.180 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:42:34.093+0000 7f9387aff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.180 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:42:34.093+0000 7f9387aff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.180 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:42:34.093+0000 7f9387aff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.180 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.180 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.181 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.181 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:42:34.093+0000 7f9388b01640 10 monclient(hunting): get_auth_request con 0x559cbbe8a890 auth_method 0 2024-09-12T17:42:34.181 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:42:34.093+0000 7f9388b01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.181 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:42:34.093+0000 7f9388b01640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.181 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:42:34.093+0000 7f9388b01640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.181 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:42:34.093+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.181 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:42:34.093+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.181 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:42:34.093+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.181 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient(hunting): handle_auth_done global_id 6287 payload 824 2024-09-12T17:42:34.181 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient: _finish_hunting 0 2024-09-12T17:42:34.181 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:42:34.093+0000 7f9388300640 1 monclient: found mon.noname-c 2024-09-12T17:42:34.182 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:42:34.182 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:42:34.093+0000 7f9274e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.182 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:42:34.093+0000 7f9274e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:42:34.182 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:42:34.093+0000 7f9274e09640 10 monclient: dump: 2024-09-12T17:42:34.182 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.182 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.182 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.182 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.182 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.182 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.182 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.182 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.182 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.182 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.183 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:42:34.093+0000 7f9274e09640 10 monclient: _finish_auth 0 2024-09-12T17:42:34.183 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:42:34.093+0000 7f9274e09640 10 monclient: _check_auth_tickets 2024-09-12T17:42:34.183 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:42:34.093+0000 7f9274e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:34.183 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:42:34.094+0000 7f9274e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.183 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:42:34.094+0000 7f9274e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:42:34.183 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:42:34.094+0000 7f9274e09640 10 monclient: dump: 2024-09-12T17:42:34.183 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.183 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.183 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.183 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.183 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.183 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.183 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.184 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.184 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.184 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.184 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:42:34.094+0000 7f938a80f800 5 monclient: authenticate success, global_id 6287 2024-09-12T17:42:34.184 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:42:34.094+0000 7f938a80f800 10 monclient: _renew_subs 2024-09-12T17:42:34.184 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:42:34.094+0000 7f927660c640 4 set_mon_vals no callback set 2024-09-12T17:42:34.184 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:42:34.094+0000 7f938a80f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:42:34.184 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:42:34.094+0000 7f938a80f800 10 monclient: _renew_subs 2024-09-12T17:42:34.184 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:42:34.094+0000 7f938a80f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:42:34.184 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:42:34.094+0000 7f938a80f800 1 librados: init done 2024-09-12T17:42:34.184 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:42:34.095+0000 7f9274e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:34.184 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:42:34.095+0000 7f9274e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:42:34.184 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:42:34.095+0000 7f9274e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:42:34.185 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:42:34.096+0000 7f9387aff640 10 monclient: get_auth_request con 0x7f9270076470 auth_method 0 2024-09-12T17:42:34.185 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:42:34.096+0000 7f9388b01640 10 monclient: get_auth_request con 0x559cbbf8ffb0 auth_method 0 2024-09-12T17:42:34.185 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:42:34.097+0000 7f9388300640 10 monclient: get_auth_request con 0x559cbbf93190 auth_method 0 2024-09-12T17:42:34.185 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:42:34.098+0000 7f9387aff640 10 monclient: get_auth_request con 0x559cbbf98220 auth_method 0 2024-09-12T17:42:34.185 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:42:34.099+0000 7f938a80f800 10 monclient: build_initial_monmap 2024-09-12T17:42:34.185 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:42:34.099+0000 7f938a80f800 1 build_initial for_mkfs: 0 2024-09-12T17:42:34.185 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:42:34.099+0000 7f938a80f800 10 monclient: monmap: 2024-09-12T17:42:34.185 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:42:34.185 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:34.186 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:42:34.186 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:42:34.186 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:34.186 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.186 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:42:34.186 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:42:34.186 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:42:34.186 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.186 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding auth protocol: cephx 2024-09-12T17:42:34.187 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding auth protocol: cephx 2024-09-12T17:42:34.187 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding auth protocol: cephx 2024-09-12T17:42:34.187 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: secure 2024-09-12T17:42:34.187 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: crc 2024-09-12T17:42:34.187 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: secure 2024-09-12T17:42:34.187 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: crc 2024-09-12T17:42:34.187 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: secure 2024-09-12T17:42:34.187 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: crc 2024-09-12T17:42:34.187 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: crc 2024-09-12T17:42:34.187 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: secure 2024-09-12T17:42:34.188 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: crc 2024-09-12T17:42:34.188 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: secure 2024-09-12T17:42:34.188 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: crc 2024-09-12T17:42:34.188 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: secure 2024-09-12T17:42:34.188 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:42:34.099+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.188 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command objecter_requests cmddesc objecter_requests hook 0x559cbbf9f980 EEXIST 2024-09-12T17:42:34.188 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient: init 2024-09-12T17:42:34.188 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding auth protocol: cephx 2024-09-12T17:42:34.188 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding auth protocol: cephx 2024-09-12T17:42:34.189 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding auth protocol: cephx 2024-09-12T17:42:34.189 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: secure 2024-09-12T17:42:34.189 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: crc 2024-09-12T17:42:34.189 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: secure 2024-09-12T17:42:34.189 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: crc 2024-09-12T17:42:34.189 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: secure 2024-09-12T17:42:34.189 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: crc 2024-09-12T17:42:34.189 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: crc 2024-09-12T17:42:34.189 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: secure 2024-09-12T17:42:34.189 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: crc 2024-09-12T17:42:34.189 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: secure 2024-09-12T17:42:34.189 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: crc 2024-09-12T17:42:34.190 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: secure 2024-09-12T17:42:34.190 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:42:34.100+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.190 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:42:34.100+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.190 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command rotate-key cmddesc rotate-key hook 0x559cbbf9b120 EEXIST 2024-09-12T17:42:34.190 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:34.190 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:42:34.190 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-c con 0x559cbbfc3670 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:42:34.190 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-a con 0x559cbbfc5940 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:42:34.190 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-b con 0x559cbbfc1e40 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:42:34.190 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.190 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.190 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.190 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:34.191 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient(hunting): authenticate will time out at 1926.736756s 2024-09-12T17:42:34.191 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:42:34.100+0000 7f9388300640 10 monclient(hunting): get_auth_request con 0x559cbbfc3670 auth_method 0 2024-09-12T17:42:34.191 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:42:34.100+0000 7f9388300640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.191 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:42:34.100+0000 7f9388300640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.191 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:42:34.100+0000 7f9388300640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.191 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:42:34.100+0000 7f9387aff640 10 monclient(hunting): get_auth_request con 0x559cbbfc5940 auth_method 0 2024-09-12T17:42:34.191 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:42:34.100+0000 7f9387aff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.191 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:42:34.100+0000 7f9387aff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.191 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:42:34.100+0000 7f9387aff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.191 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:42:34.100+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.191 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:42:34.100+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.191 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:42:34.100+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.191 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:42:34.100+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.192 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:42:34.100+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.192 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:42:34.100+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.192 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:42:34.100+0000 7f9388b01640 10 monclient(hunting): get_auth_request con 0x559cbbfc1e40 auth_method 0 2024-09-12T17:42:34.192 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:42:34.100+0000 7f9388b01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.192 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:42:34.100+0000 7f9388b01640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.192 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:42:34.100+0000 7f9388b01640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.192 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:42:34.101+0000 7f9388300640 10 monclient(hunting): handle_auth_done global_id 6290 payload 824 2024-09-12T17:42:34.192 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:42:34.101+0000 7f9388300640 10 monclient: _finish_hunting 0 2024-09-12T17:42:34.192 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:42:34.101+0000 7f9388300640 1 monclient: found mon.noname-c 2024-09-12T17:42:34.192 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:42:34.101+0000 7f9388300640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:42:34.192 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.192 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:42:34.193 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: dump: 2024-09-12T17:42:34.193 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.193 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.193 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.193 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.193 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.193 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.193 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.193 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.193 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.193 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.193 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: _finish_auth 0 2024-09-12T17:42:34.193 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: _check_auth_tickets 2024-09-12T17:42:34.194 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:34.194 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.194 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:42:34.194 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: dump: 2024-09-12T17:42:34.194 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.194 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.194 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.194 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.194 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.194 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.194 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.195 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.195 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.195 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.195 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:42:34.101+0000 7f938a80f800 5 monclient: authenticate success, global_id 6290 2024-09-12T17:42:34.195 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:42:34.101+0000 7f938a80f800 10 monclient: _renew_subs 2024-09-12T17:42:34.195 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:42:34.101+0000 7f9389302640 4 set_mon_vals no callback set 2024-09-12T17:42:34.196 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:42:34.101+0000 7f938a80f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:42:34.196 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:42:34.101+0000 7f938a80f800 10 monclient: _renew_subs 2024-09-12T17:42:34.196 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:42:34.101+0000 7f938a80f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:42:34.196 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:42:34.103+0000 7f926dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:34.196 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:42:34.103+0000 7f926dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:42:34.196 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:42:34.103+0000 7f926dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:42:34.196 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:42:34.103+0000 7f938a80f800 10 monclient: get_monmap_and_config 2024-09-12T17:42:34.196 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:42:34.103+0000 7f938a80f800 10 monclient: build_initial_monmap 2024-09-12T17:42:34.196 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:42:34.103+0000 7f938a80f800 1 build_initial for_mkfs: 0 2024-09-12T17:42:34.196 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:42:34.103+0000 7f938a80f800 10 monclient: monmap: 2024-09-12T17:42:34.197 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:42:34.197 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:34.197 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:42:34.197 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:42:34.197 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:34.197 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.197 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:42:34.197 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:42:34.197 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:42:34.197 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.198 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding auth protocol: cephx 2024-09-12T17:42:34.198 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding auth protocol: cephx 2024-09-12T17:42:34.198 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding auth protocol: cephx 2024-09-12T17:42:34.198 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: secure 2024-09-12T17:42:34.198 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: crc 2024-09-12T17:42:34.198 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: secure 2024-09-12T17:42:34.198 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: crc 2024-09-12T17:42:34.198 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: secure 2024-09-12T17:42:34.198 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: crc 2024-09-12T17:42:34.198 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: crc 2024-09-12T17:42:34.198 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: secure 2024-09-12T17:42:34.198 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: crc 2024-09-12T17:42:34.198 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: secure 2024-09-12T17:42:34.199 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: crc 2024-09-12T17:42:34.199 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:42:34.103+0000 7f9387aff640 10 monclient: get_auth_request con 0x7f9260076380 auth_method 0 2024-09-12T17:42:34.199 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: secure 2024-09-12T17:42:34.199 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:42:34.103+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.199 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient: init 2024-09-12T17:42:34.200 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding auth protocol: cephx 2024-09-12T17:42:34.200 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding auth protocol: cephx 2024-09-12T17:42:34.200 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding auth protocol: cephx 2024-09-12T17:42:34.200 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: secure 2024-09-12T17:42:34.200 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: crc 2024-09-12T17:42:34.200 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: secure 2024-09-12T17:42:34.201 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: crc 2024-09-12T17:42:34.201 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: secure 2024-09-12T17:42:34.201 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: crc 2024-09-12T17:42:34.201 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: crc 2024-09-12T17:42:34.201 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: secure 2024-09-12T17:42:34.201 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: crc 2024-09-12T17:42:34.201 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: secure 2024-09-12T17:42:34.201 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: crc 2024-09-12T17:42:34.201 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: secure 2024-09-12T17:42:34.201 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:42:34.104+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.201 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:42:34.104+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.202 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command rotate-key cmddesc rotate-key hook 0x7ffc580a4618 EEXIST 2024-09-12T17:42:34.202 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:34.202 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:42:34.202 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-b con 0x559cbc017b30 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:42:34.202 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-c con 0x559cbbfe7940 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:42:34.202 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-a con 0x559cbc012ef0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:42:34.202 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.202 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.202 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.202 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:34.203 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient(hunting): authenticate will time out at 1926.740646s 2024-09-12T17:42:34.203 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient(hunting): get_auth_request con 0x559cbc012ef0 auth_method 0 2024-09-12T17:42:34.203 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.203 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.203 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.204 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:42:34.104+0000 7f9387aff640 10 monclient(hunting): get_auth_request con 0x559cbbfe7940 auth_method 0 2024-09-12T17:42:34.204 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:42:34.104+0000 7f9387aff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.204 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:42:34.104+0000 7f9387aff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.204 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:42:34.104+0000 7f9387aff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.204 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:42:34.104+0000 7f9388300640 10 monclient(hunting): get_auth_request con 0x559cbc017b30 auth_method 0 2024-09-12T17:42:34.204 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:42:34.104+0000 7f9388300640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.205 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:42:34.104+0000 7f9388300640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.205 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:42:34.104+0000 7f9388300640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.205 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.205 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.205 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.206 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:42:34.104+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.206 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:42:34.104+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.206 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:42:34.104+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.206 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:42:34.104+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.206 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:42:34.104+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.206 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:42:34.104+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.207 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient(hunting): handle_auth_done global_id 6720 payload 274 2024-09-12T17:42:34.207 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient: _finish_hunting 0 2024-09-12T17:42:34.207 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:42:34.104+0000 7f9388b01640 1 monclient: found mon.noname-a 2024-09-12T17:42:34.207 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:42:34.207 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.207 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:42:34.208 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: dump: 2024-09-12T17:42:34.208 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.208 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.208 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.208 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.208 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.208 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.209 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.209 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.209 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.209 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.209 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: _finish_auth 0 2024-09-12T17:42:34.209 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:42:34.209 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:34.209 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.210 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:42:34.210 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: dump: 2024-09-12T17:42:34.210 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.210 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.210 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.210 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.210 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.210 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.211 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.211 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.211 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.211 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.211 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:42:34.105+0000 7f938a80f800 5 monclient: authenticate success, global_id 6720 2024-09-12T17:42:34.211 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:42:34.105+0000 7f938a80f800 10 monclient: get_monmap_and_config success 2024-09-12T17:42:34.211 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:42:34.105+0000 7f938a80f800 4 set_mon_vals no callback set 2024-09-12T17:42:34.212 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:42:34.105+0000 7f938a80f800 10 monclient: shutdown 2024-09-12T17:42:34.212 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:42:34.105+0000 7f938a80f800 10 monclient: build_initial_monmap 2024-09-12T17:42:34.212 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:42:34.105+0000 7f938a80f800 1 build_initial for_mkfs: 0 2024-09-12T17:42:34.212 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:42:34.105+0000 7f938a80f800 10 monclient: monmap: 2024-09-12T17:42:34.212 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:42:34.212 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:34.212 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:42:34.212 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:42:34.213 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:34.213 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.213 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:42:34.213 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:42:34.213 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:42:34.213 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.213 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding auth protocol: cephx 2024-09-12T17:42:34.213 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding auth protocol: cephx 2024-09-12T17:42:34.214 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding auth protocol: cephx 2024-09-12T17:42:34.214 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: secure 2024-09-12T17:42:34.214 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: crc 2024-09-12T17:42:34.214 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: secure 2024-09-12T17:42:34.214 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: crc 2024-09-12T17:42:34.214 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: secure 2024-09-12T17:42:34.214 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: crc 2024-09-12T17:42:34.215 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: crc 2024-09-12T17:42:34.215 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: secure 2024-09-12T17:42:34.215 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: crc 2024-09-12T17:42:34.215 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: secure 2024-09-12T17:42:34.215 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: crc 2024-09-12T17:42:34.215 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: secure 2024-09-12T17:42:34.215 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:42:34.106+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.215 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:42:34.106+0000 7f938a80f800 1 librados: starting msgr at 2024-09-12T17:42:34.216 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:42:34.106+0000 7f938a80f800 1 librados: starting objecter 2024-09-12T17:42:34.216 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command objecter_requests cmddesc objecter_requests hook 0x559cbc00e1a0 EEXIST 2024-09-12T17:42:34.216 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:42:34.106+0000 7f938a80f800 1 librados: setting wanted keys 2024-09-12T17:42:34.216 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:42:34.106+0000 7f938a80f800 1 librados: calling monclient init 2024-09-12T17:42:34.216 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient: init 2024-09-12T17:42:34.216 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding auth protocol: cephx 2024-09-12T17:42:34.216 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding auth protocol: cephx 2024-09-12T17:42:34.217 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding auth protocol: cephx 2024-09-12T17:42:34.217 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: secure 2024-09-12T17:42:34.217 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: crc 2024-09-12T17:42:34.217 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: secure 2024-09-12T17:42:34.217 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: crc 2024-09-12T17:42:34.217 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: secure 2024-09-12T17:42:34.217 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: crc 2024-09-12T17:42:34.217 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: crc 2024-09-12T17:42:34.217 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: secure 2024-09-12T17:42:34.218 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: crc 2024-09-12T17:42:34.218 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: secure 2024-09-12T17:42:34.218 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: crc 2024-09-12T17:42:34.218 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: secure 2024-09-12T17:42:34.218 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:42:34.106+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.218 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:42:34.106+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.218 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command rotate-key cmddesc rotate-key hook 0x559cbbfdb568 EEXIST 2024-09-12T17:42:34.218 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:34.218 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:42:34.218 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-a con 0x559cbbfe7940 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:42:34.218 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-c con 0x559cbc012ef0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:42:34.218 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-b con 0x559cbc017b30 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:42:34.219 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.219 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.219 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.219 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:34.219 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient(hunting): authenticate will time out at 1926.742973s 2024-09-12T17:42:34.219 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient(hunting): get_auth_request con 0x559cbbfe7940 auth_method 0 2024-09-12T17:42:34.219 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.219 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.219 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.219 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:42:34.107+0000 7f9387aff640 10 monclient(hunting): get_auth_request con 0x559cbc012ef0 auth_method 0 2024-09-12T17:42:34.219 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:42:34.107+0000 7f9387aff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.220 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:42:34.107+0000 7f9387aff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.220 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:42:34.107+0000 7f9387aff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.220 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.220 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.220 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.220 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:42:34.107+0000 7f9388b01640 10 monclient(hunting): get_auth_request con 0x559cbc017b30 auth_method 0 2024-09-12T17:42:34.220 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:42:34.107+0000 7f9388b01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.220 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:42:34.107+0000 7f9388b01640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.220 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:42:34.107+0000 7f9388b01640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.220 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:42:34.107+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.221 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:42:34.107+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.221 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:42:34.107+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.221 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:42:34.107+0000 7f9388b01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.221 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:42:34.107+0000 7f9388b01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.221 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:42:34.107+0000 7f9388b01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.221 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient(hunting): handle_auth_done global_id 6723 payload 824 2024-09-12T17:42:34.221 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient: _finish_hunting 0 2024-09-12T17:42:34.221 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:42:34.107+0000 7f9388300640 1 monclient: found mon.noname-a 2024-09-12T17:42:34.221 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:42:34.221 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.222 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:42:34.222 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: dump: 2024-09-12T17:42:34.222 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.222 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.222 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.222 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.222 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.222 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.222 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.222 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.222 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.222 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.223 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: _finish_auth 0 2024-09-12T17:42:34.223 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: _check_auth_tickets 2024-09-12T17:42:34.223 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:34.223 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.223 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:42:34.223 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: dump: 2024-09-12T17:42:34.223 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.223 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.223 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.223 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.223 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.223 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.223 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.224 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.224 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.224 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.224 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:42:34.107+0000 7f938a80f800 5 monclient: authenticate success, global_id 6723 2024-09-12T17:42:34.224 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:42:34.107+0000 7f925f7fe640 4 set_mon_vals no callback set 2024-09-12T17:42:34.224 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:42:34.107+0000 7f938a80f800 10 monclient: _renew_subs 2024-09-12T17:42:34.224 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:42:34.107+0000 7f938a80f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:42:34.224 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:42:34.107+0000 7f938a80f800 10 monclient: _renew_subs 2024-09-12T17:42:34.224 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:42:34.107+0000 7f938a80f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:42:34.224 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:42:34.107+0000 7f938a80f800 1 librados: init done 2024-09-12T17:42:34.224 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:42:34.107+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command cr dump hook 0x559cbc009dd8 2024-09-12T17:42:34.224 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:42:34.109+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.225 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:42:34.109+0000 7f925dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:34.225 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:42:34.109+0000 7f925dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:42:34.225 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:42:34.109+0000 7f925dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:42:34.225 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:42:34.110+0000 7f9387aff640 10 monclient: get_auth_request con 0x7f9250076470 auth_method 0 2024-09-12T17:42:34.225 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:42:34.110+0000 7f9388b01640 10 monclient: get_auth_request con 0x559cbc031a40 auth_method 0 2024-09-12T17:42:34.225 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.225 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:42:34.111+0000 7f938a80f800 20 realm 2024-09-12T17:42:34.225 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.225 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.225 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:42:34.111+0000 7f938a80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:34.225 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.226 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.226 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.226 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:42:34.111+0000 7f9388300640 10 monclient: get_auth_request con 0x559cbc035dd0 auth_method 0 2024-09-12T17:42:34.226 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:42:34.112+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:34.226 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:42:34.112+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.226 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:42:34.112+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:34.226 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:42:34.112+0000 7f938a80f800 20 searching for the correct realm 2024-09-12T17:42:34.226 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:42:34.112+0000 7f9387aff640 10 monclient: get_auth_request con 0x559cbc03aef0 auth_method 0 2024-09-12T17:42:34.226 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:42:34.113+0000 7f9388b01640 10 monclient: get_auth_request con 0x7f937c064c60 auth_method 0 2024-09-12T17:42:34.226 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:42:34.114+0000 7f9388300640 10 monclient: get_auth_request con 0x7f938003b040 auth_method 0 2024-09-12T17:42:34.227 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:42:34.114+0000 7f9387aff640 10 monclient: get_auth_request con 0x7f937800e310 auth_method 0 2024-09-12T17:42:34.227 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:42:34.116+0000 7f9387aff640 0 -- 172.21.15.44:0/88874874 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x559cbc03aef0 msgr2=0x559cbc03d390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:34.227 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:42:34.116+0000 7f925dffb640 1 client.6723.objecter ms_handle_reset 0x559cbc03aef0 session 0x559cbc03a870 osd.3 2024-09-12T17:42:34.227 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:42:34.116+0000 7f925dffb640 10 monclient: _renew_subs 2024-09-12T17:42:34.227 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:42:34.116+0000 7f925dffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:42:34.227 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:42:34.116+0000 7f9387aff640 10 monclient: get_auth_request con 0x7f9250086290 auth_method 0 2024-09-12T17:42:34.227 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:42:34.116+0000 7f9388b01640 10 monclient: get_auth_request con 0x7f937c08bb80 auth_method 0 2024-09-12T17:42:34.227 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:42:34.119+0000 7f9388300640 10 monclient: get_auth_request con 0x7f937c09a3a0 auth_method 0 2024-09-12T17:42:34.227 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:42:34.119+0000 7f9388300640 0 -- 172.21.15.44:0/88874874 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f937c09a3a0 msgr2=0x7f937c09a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:34.227 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:42:34.119+0000 7f925dffb640 1 client.6723.objecter ms_handle_reset 0x7f937c09a3a0 session 0x7f937c09bdd0 osd.0 2024-09-12T17:42:34.227 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:42:34.119+0000 7f9388300640 10 monclient: get_auth_request con 0x559cbc03aef0 auth_method 0 2024-09-12T17:42:34.227 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:34.228 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:34.228 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:34.228 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:34.228 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:34.228 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:34.228 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.228 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.228 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.228 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:34.228 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.228 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:34.228 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:42:34.124+0000 7f938a80f800 20 zone default found 2024-09-12T17:42:34.228 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:42:34.124+0000 7f938a80f800 4 Realm: () 2024-09-12T17:42:34.229 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:42:34.124+0000 7f938a80f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:34.229 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:42:34.124+0000 7f938a80f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:34.229 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:42:34.124+0000 7f938a80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:34.229 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:42:34.124+0000 7f938a80f800 20 zonegroup default 2024-09-12T17:42:34.229 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.229 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.229 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.229 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:42:34.125+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.229 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:42:34.125+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.229 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:42:34.125+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.229 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:42:34.125+0000 7f938a80f800 20 started sync module instance, tier type = 2024-09-12T17:42:34.229 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:42:34.125+0000 7f938a80f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:34.229 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=0 2024-09-12T17:42:34.230 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=1 2024-09-12T17:42:34.230 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=2 2024-09-12T17:42:34.230 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=3 2024-09-12T17:42:34.230 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=4 2024-09-12T17:42:34.230 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=5 2024-09-12T17:42:34.230 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=6 2024-09-12T17:42:34.230 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:42:34.135+0000 7f938a80f800 20 add_watcher() i=7 2024-09-12T17:42:34.230 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:42:34.135+0000 7f938a80f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:34.230 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding auth protocol: cephx 2024-09-12T17:42:34.230 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding auth protocol: cephx 2024-09-12T17:42:34.230 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding auth protocol: cephx 2024-09-12T17:42:34.230 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: secure 2024-09-12T17:42:34.231 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: crc 2024-09-12T17:42:34.231 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: secure 2024-09-12T17:42:34.231 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: crc 2024-09-12T17:42:34.231 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: secure 2024-09-12T17:42:34.231 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: crc 2024-09-12T17:42:34.231 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: crc 2024-09-12T17:42:34.231 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: secure 2024-09-12T17:42:34.231 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: crc 2024-09-12T17:42:34.231 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: secure 2024-09-12T17:42:34.231 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: crc 2024-09-12T17:42:34.231 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: secure 2024-09-12T17:42:34.231 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:42:34.136+0000 7f923efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:34.231 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:42:34.136+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.232 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:42:34.136+0000 7f938a80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:34.232 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:42:34.136+0000 7f938a80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:34.232 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command cache list hook 0x559cbc00e230 2024-09-12T17:42:34.232 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command cache inspect hook 0x559cbc00e230 2024-09-12T17:42:34.232 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command cache erase hook 0x559cbc00e230 2024-09-12T17:42:34.232 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command cache zap hook 0x559cbc00e230 2024-09-12T17:42:34.232 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 note: GC not initialized 2024-09-12T17:42:34.232 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:42:34.137+0000 7f923dfdb640 20 reqs_thread_entry: start 2024-09-12T17:42:34.232 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command sync trace show hook 0x7f9380004670 2024-09-12T17:42:34.232 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command sync trace history hook 0x7f9380004670 2024-09-12T17:42:34.232 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command sync trace active hook 0x7f9380004670 2024-09-12T17:42:34.232 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command sync trace active_short hook 0x7f9380004670 2024-09-12T17:42:34.233 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:42:34.137+0000 7f938a80f800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:34.233 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:42:34.137+0000 7f938a80f800 20 Filter name: none 2024-09-12T17:42:34.233 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:42:34.137+0000 7f91af7fe640 20 reqs_thread_entry: start 2024-09-12T17:42:34.233 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:42:34.137+0000 7f938a80f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:42:34.233 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:42:34.137+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.233 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:42:34.138+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:34.233 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:42:34.138+0000 7f938a80f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:42:34.233 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:42:34.138+0000 7f938a80f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:42:34.233 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:42:34.138+0000 7f938a80f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 : miss 2024-09-12T17:42:34.233 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:42:34.138+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.233 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:42:34.138+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:34.233 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:42:34.138+0000 7f938a80f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 info.flags=0x17 2024-09-12T17:42:34.234 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:42:34.138+0000 7f938a80f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 to cache LRU end 2024-09-12T17:42:34.234 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:42:34.138+0000 7f938a80f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:34.234 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:42:34.138+0000 7f938a80f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:34.234 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:42:34.138+0000 7f938a80f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 2024-09-12T17:42:34.234 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:42:34.142+0000 7f938a80f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f938a80f800 time 2024-09-12T17:42:34.142538+0000 2024-09-12T17:42:34.234 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:42:34.234 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.234 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:34.234 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f938dd8c71a] 2024-09-12T17:42:34.234 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f938dd8c8d8] 2024-09-12T17:42:34.234 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559cbae1d841] 2024-09-12T17:42:34.234 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd73ca8) [0x559cbb32aca8] 2024-09-12T17:42:34.235 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559cbae2d50d] 2024-09-12T17:42:34.235 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:42:34.235 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f938ca29590] 2024-09-12T17:42:34.235 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:42:34.235 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:42:34.235 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.235 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:42:34.143+0000 7f938a80f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:42:34.235 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f938a80f800 thread_name:radosgw-admin 2024-09-12T17:42:34.235 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.235 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:34.235 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f938ca3e6f0] 2024-09-12T17:42:34.236 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f938ca8b99c] 2024-09-12T17:42:34.236 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:42:34.236 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:42:34.236 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f938dd8c774] 2024-09-12T17:42:34.236 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f938dd8c8d8] 2024-09-12T17:42:34.236 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559cbae1d841] 2024-09-12T17:42:34.236 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd73ca8) [0x559cbb32aca8] 2024-09-12T17:42:34.237 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559cbae2d50d] 2024-09-12T17:42:34.237 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:42:34.237 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f938ca29590] 2024-09-12T17:42:34.237 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:42:34.237 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:42:34.237 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:42:34.237 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.237 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:42:34.237 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:42:34.237 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:42:34.237 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:42:34.237 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:42:34.238 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:42:34.238 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:42:34.238 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:42:34.238 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:42:34.238 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:42:34.238 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:42:34.238 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:42:34.238 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:42:34.238 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:42:34.238 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:42:34.238 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:42:34.238 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:42:34.238 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:42:34.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:42:34.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:42:34.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:42:34.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:42:34.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:42:34.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:42:34.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:42:34.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:42:34.239 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:42:34.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:42:34.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:42:34.239 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:42:34.239 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:42:34.240 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:42:34.240 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:42:34.240 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:42:34.240 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:42:34.240 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:42:34.240 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:42:34.240 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:42:34.240 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:42:34.240 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:42:34.240 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:42:34.240 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:42:34.240 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:42:34.240 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:42:34.241 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:42:34.241 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:42:34.241 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:42:34.241 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:42:34.241 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:42:34.241 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:42:34.241 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:42:34.241 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:42:34.241 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:42:34.241 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:42:34.241 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:42:34.241 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:42:34.241 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:42:34.242 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:42:34.242 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:42:34.242 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:42:34.242 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:42:34.242 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:42:34.242 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:42:34.242 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:42:34.242 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:42:34.242 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:42:34.242 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:42:34.242 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:42:34.242 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:42:34.242 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:42:34.243 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:42:34.243 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:42:34.243 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:42:34.243 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:42:34.243 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:42:34.243 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:42:34.243 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:42:34.243 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:42:34.243 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:42:34.243 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:42:34.243 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:42:34.243 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:42:34.244 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:42:34.244 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:42:34.244 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:42:34.244 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:42:34.244 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:42:34.244 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:42:34.244 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:42:34.244 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:42:34.244 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:42:34.244 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:42:34.245 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:42:34.245 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:42:34.245 INFO:tasks.workunit.client.0.smithi044.stderr: 7f91af7fe640 / http_manager 2024-09-12T17:42:34.245 INFO:tasks.workunit.client.0.smithi044.stderr: 7f923dfdb640 / http_manager 2024-09-12T17:42:34.245 INFO:tasks.workunit.client.0.smithi044.stderr: 7f923efdd640 / rgw_dt_lg_renew 2024-09-12T17:42:34.245 INFO:tasks.workunit.client.0.smithi044.stderr: 7f925dffb640 / ms_dispatch 2024-09-12T17:42:34.245 INFO:tasks.workunit.client.0.smithi044.stderr: 7f925f7fe640 / io_context_pool 2024-09-12T17:42:34.245 INFO:tasks.workunit.client.0.smithi044.stderr: 7f926dffb640 / ms_dispatch 2024-09-12T17:42:34.245 INFO:tasks.workunit.client.0.smithi044.stderr: 7f9274e09640 / ms_dispatch 2024-09-12T17:42:34.245 INFO:tasks.workunit.client.0.smithi044.stderr: 7f927660c640 / io_context_pool 2024-09-12T17:42:34.245 INFO:tasks.workunit.client.0.smithi044.stderr: 7f9387aff640 / msgr-worker-2 2024-09-12T17:42:34.245 INFO:tasks.workunit.client.0.smithi044.stderr: 7f9388300640 / msgr-worker-1 2024-09-12T17:42:34.245 INFO:tasks.workunit.client.0.smithi044.stderr: 7f9388b01640 / msgr-worker-0 2024-09-12T17:42:34.246 INFO:tasks.workunit.client.0.smithi044.stderr: 7f9389302640 / io_context_pool 2024-09-12T17:42:34.246 INFO:tasks.workunit.client.0.smithi044.stderr: 7f938a80f800 / radosgw-admin 2024-09-12T17:42:34.246 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:42:34.246 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:42:34.246 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/log/ceph/ceph-client.admin.99697.log 2024-09-12T17:42:34.246 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:42:34.246 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:42:34.246 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:42:34.091+0000 7f9388b01640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:42:34.246 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.246 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:42:34.246 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: dump: 2024-09-12T17:42:34.246 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.246 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.247 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.247 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.247 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.247 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.247 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.247 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.247 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.247 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.247 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: _finish_auth 0 2024-09-12T17:42:34.247 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: _check_auth_tickets 2024-09-12T17:42:34.247 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:42:34.091+0000 7f938a80f800 5 monclient: authenticate success, global_id 6711 2024-09-12T17:42:34.247 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:34.248 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.248 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:42:34.248 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:42:34.091+0000 7f927660c640 10 monclient: dump: 2024-09-12T17:42:34.248 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.248 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.248 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.248 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.248 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.248 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.248 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.248 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.248 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.249 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.249 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:42:34.091+0000 7f938a80f800 10 monclient: get_monmap_and_config success 2024-09-12T17:42:34.249 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:42:34.091+0000 7f938a80f800 4 set_mon_vals no callback set 2024-09-12T17:42:34.249 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:42:34.092+0000 7f938a80f800 10 monclient: shutdown 2024-09-12T17:42:34.249 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 asok(0x559cbbd25730) unregister_commands rotate-key 2024-09-12T17:42:34.249 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:42:34.092+0000 7f938a80f800 10 monclient: build_initial_monmap 2024-09-12T17:42:34.249 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:42:34.092+0000 7f938a80f800 1 build_initial for_mkfs: 0 2024-09-12T17:42:34.249 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:42:34.092+0000 7f938a80f800 10 monclient: monmap: 2024-09-12T17:42:34.249 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:42:34.249 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:34.249 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:42:34.249 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:42:34.249 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:34.250 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.250 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:42:34.250 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:42:34.250 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:42:34.250 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.250 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding auth protocol: cephx 2024-09-12T17:42:34.250 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding auth protocol: cephx 2024-09-12T17:42:34.250 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding auth protocol: cephx 2024-09-12T17:42:34.250 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: secure 2024-09-12T17:42:34.250 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: crc 2024-09-12T17:42:34.250 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: secure 2024-09-12T17:42:34.250 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: crc 2024-09-12T17:42:34.251 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: secure 2024-09-12T17:42:34.251 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: crc 2024-09-12T17:42:34.251 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: crc 2024-09-12T17:42:34.251 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: secure 2024-09-12T17:42:34.251 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: crc 2024-09-12T17:42:34.251 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: secure 2024-09-12T17:42:34.251 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: crc 2024-09-12T17:42:34.251 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf4d4b0) adding con mode: secure 2024-09-12T17:42:34.251 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:42:34.092+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.251 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:42:34.092+0000 7f938a80f800 1 librados: starting msgr at 2024-09-12T17:42:34.251 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:42:34.092+0000 7f938a80f800 1 librados: starting objecter 2024-09-12T17:42:34.251 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command objecter_requests hook 0x559cbbf79c40 2024-09-12T17:42:34.251 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:42:34.092+0000 7f938a80f800 1 librados: setting wanted keys 2024-09-12T17:42:34.252 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:42:34.092+0000 7f938a80f800 1 librados: calling monclient init 2024-09-12T17:42:34.252 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:42:34.092+0000 7f938a80f800 10 monclient: init 2024-09-12T17:42:34.252 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding auth protocol: cephx 2024-09-12T17:42:34.252 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding auth protocol: cephx 2024-09-12T17:42:34.252 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding auth protocol: cephx 2024-09-12T17:42:34.252 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: secure 2024-09-12T17:42:34.253 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: crc 2024-09-12T17:42:34.253 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: secure 2024-09-12T17:42:34.253 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: crc 2024-09-12T17:42:34.253 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: secure 2024-09-12T17:42:34.253 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: crc 2024-09-12T17:42:34.254 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: crc 2024-09-12T17:42:34.254 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: secure 2024-09-12T17:42:34.254 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: crc 2024-09-12T17:42:34.254 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: secure 2024-09-12T17:42:34.254 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: crc 2024-09-12T17:42:34.254 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:42:34.092+0000 7f938a80f800 5 AuthRegistry(0x559cbbf47cb0) adding con mode: secure 2024-09-12T17:42:34.255 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:42:34.093+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.255 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:42:34.093+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.255 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:42:34.093+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command rotate-key hook 0x559cbbf47df8 2024-09-12T17:42:34.255 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:34.255 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:42:34.255 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-c con 0x559cbbdd1110 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:42:34.255 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-a con 0x559cbbdd1a90 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:42:34.255 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-b con 0x559cbbe8a890 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:42:34.255 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.255 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.256 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.256 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:34.256 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:42:34.093+0000 7f938a80f800 10 monclient(hunting): authenticate will time out at 1926.729399s 2024-09-12T17:42:34.256 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient(hunting): get_auth_request con 0x559cbbdd1110 auth_method 0 2024-09-12T17:42:34.256 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.256 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.256 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.256 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:42:34.093+0000 7f9387aff640 10 monclient(hunting): get_auth_request con 0x559cbbdd1a90 auth_method 0 2024-09-12T17:42:34.256 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:42:34.093+0000 7f9387aff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.256 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:42:34.093+0000 7f9387aff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.256 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:42:34.093+0000 7f9387aff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.257 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.257 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.257 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.257 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:42:34.093+0000 7f9388b01640 10 monclient(hunting): get_auth_request con 0x559cbbe8a890 auth_method 0 2024-09-12T17:42:34.257 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:42:34.093+0000 7f9388b01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.257 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:42:34.093+0000 7f9388b01640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.257 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:42:34.093+0000 7f9388b01640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.257 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:42:34.093+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.257 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:42:34.093+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.257 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:42:34.093+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.258 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient(hunting): handle_auth_done global_id 6287 payload 824 2024-09-12T17:42:34.258 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient: _finish_hunting 0 2024-09-12T17:42:34.258 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:42:34.093+0000 7f9388300640 1 monclient: found mon.noname-c 2024-09-12T17:42:34.258 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:42:34.093+0000 7f9388300640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:42:34.258 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:42:34.093+0000 7f9274e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.258 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:42:34.093+0000 7f9274e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:42:34.258 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:42:34.093+0000 7f9274e09640 10 monclient: dump: 2024-09-12T17:42:34.258 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.258 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.258 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.258 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.258 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.259 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.259 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.259 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.259 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.259 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.260 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:42:34.093+0000 7f9274e09640 10 monclient: _finish_auth 0 2024-09-12T17:42:34.260 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:42:34.093+0000 7f9274e09640 10 monclient: _check_auth_tickets 2024-09-12T17:42:34.260 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:42:34.093+0000 7f9274e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:34.260 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:42:34.094+0000 7f9274e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.260 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:42:34.094+0000 7f9274e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:42:34.260 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:42:34.094+0000 7f9274e09640 10 monclient: dump: 2024-09-12T17:42:34.260 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.260 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.260 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.261 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.261 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.261 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.261 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.261 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.262 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.262 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.262 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:42:34.094+0000 7f938a80f800 5 monclient: authenticate success, global_id 6287 2024-09-12T17:42:34.262 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:42:34.094+0000 7f938a80f800 10 monclient: _renew_subs 2024-09-12T17:42:34.262 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:42:34.094+0000 7f927660c640 4 set_mon_vals no callback set 2024-09-12T17:42:34.262 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:42:34.094+0000 7f938a80f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:42:34.262 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:42:34.094+0000 7f938a80f800 10 monclient: _renew_subs 2024-09-12T17:42:34.262 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:42:34.094+0000 7f938a80f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:42:34.262 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:42:34.094+0000 7f938a80f800 1 librados: init done 2024-09-12T17:42:34.263 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:42:34.095+0000 7f9274e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:34.263 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:42:34.095+0000 7f9274e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:42:34.263 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:42:34.095+0000 7f9274e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:42:34.263 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:42:34.096+0000 7f9387aff640 10 monclient: get_auth_request con 0x7f9270076470 auth_method 0 2024-09-12T17:42:34.263 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:42:34.096+0000 7f9388b01640 10 monclient: get_auth_request con 0x559cbbf8ffb0 auth_method 0 2024-09-12T17:42:34.263 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:42:34.097+0000 7f9388300640 10 monclient: get_auth_request con 0x559cbbf93190 auth_method 0 2024-09-12T17:42:34.263 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:42:34.098+0000 7f9387aff640 10 monclient: get_auth_request con 0x559cbbf98220 auth_method 0 2024-09-12T17:42:34.263 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:42:34.099+0000 7f938a80f800 10 monclient: build_initial_monmap 2024-09-12T17:42:34.263 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:42:34.099+0000 7f938a80f800 1 build_initial for_mkfs: 0 2024-09-12T17:42:34.263 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:42:34.099+0000 7f938a80f800 10 monclient: monmap: 2024-09-12T17:42:34.263 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:42:34.263 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:34.263 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:42:34.264 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:42:34.264 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:34.264 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.264 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:42:34.264 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:42:34.264 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:42:34.264 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.264 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding auth protocol: cephx 2024-09-12T17:42:34.264 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding auth protocol: cephx 2024-09-12T17:42:34.264 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding auth protocol: cephx 2024-09-12T17:42:34.265 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: secure 2024-09-12T17:42:34.265 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: crc 2024-09-12T17:42:34.265 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: secure 2024-09-12T17:42:34.265 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: crc 2024-09-12T17:42:34.265 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: secure 2024-09-12T17:42:34.265 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: crc 2024-09-12T17:42:34.265 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: crc 2024-09-12T17:42:34.265 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: secure 2024-09-12T17:42:34.265 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: crc 2024-09-12T17:42:34.265 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: secure 2024-09-12T17:42:34.266 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: crc 2024-09-12T17:42:34.266 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:42:34.099+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9bf90) adding con mode: secure 2024-09-12T17:42:34.266 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:42:34.099+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.266 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command objecter_requests cmddesc objecter_requests hook 0x559cbbf9f980 EEXIST 2024-09-12T17:42:34.266 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient: init 2024-09-12T17:42:34.266 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding auth protocol: cephx 2024-09-12T17:42:34.266 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding auth protocol: cephx 2024-09-12T17:42:34.266 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding auth protocol: cephx 2024-09-12T17:42:34.266 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: secure 2024-09-12T17:42:34.266 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: crc 2024-09-12T17:42:34.266 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: secure 2024-09-12T17:42:34.266 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: crc 2024-09-12T17:42:34.267 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: secure 2024-09-12T17:42:34.267 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: crc 2024-09-12T17:42:34.267 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: crc 2024-09-12T17:42:34.267 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: secure 2024-09-12T17:42:34.267 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: crc 2024-09-12T17:42:34.267 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: secure 2024-09-12T17:42:34.267 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: crc 2024-09-12T17:42:34.267 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 AuthRegistry(0x559cbbf9afd8) adding con mode: secure 2024-09-12T17:42:34.267 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:42:34.100+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.267 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:42:34.100+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.268 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:42:34.100+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command rotate-key cmddesc rotate-key hook 0x559cbbf9b120 EEXIST 2024-09-12T17:42:34.268 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:34.268 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:42:34.268 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-c con 0x559cbbfc3670 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:42:34.268 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-a con 0x559cbbfc5940 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:42:34.268 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-b con 0x559cbbfc1e40 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:42:34.269 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.269 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.269 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.269 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:34.269 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:42:34.100+0000 7f938a80f800 10 monclient(hunting): authenticate will time out at 1926.736756s 2024-09-12T17:42:34.269 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:42:34.100+0000 7f9388300640 10 monclient(hunting): get_auth_request con 0x559cbbfc3670 auth_method 0 2024-09-12T17:42:34.269 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:42:34.100+0000 7f9388300640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.269 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:42:34.100+0000 7f9388300640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.269 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:42:34.100+0000 7f9388300640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.269 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:42:34.100+0000 7f9387aff640 10 monclient(hunting): get_auth_request con 0x559cbbfc5940 auth_method 0 2024-09-12T17:42:34.269 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:42:34.100+0000 7f9387aff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.269 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:42:34.100+0000 7f9387aff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.269 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:42:34.100+0000 7f9387aff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.270 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:42:34.100+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.270 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:42:34.100+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.270 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:42:34.100+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.270 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:42:34.100+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.270 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:42:34.100+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.270 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:42:34.100+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.270 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:42:34.100+0000 7f9388b01640 10 monclient(hunting): get_auth_request con 0x559cbbfc1e40 auth_method 0 2024-09-12T17:42:34.270 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:42:34.100+0000 7f9388b01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.270 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:42:34.100+0000 7f9388b01640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.270 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:42:34.100+0000 7f9388b01640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.270 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:42:34.101+0000 7f9388300640 10 monclient(hunting): handle_auth_done global_id 6290 payload 824 2024-09-12T17:42:34.270 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:42:34.101+0000 7f9388300640 10 monclient: _finish_hunting 0 2024-09-12T17:42:34.270 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:42:34.101+0000 7f9388300640 1 monclient: found mon.noname-c 2024-09-12T17:42:34.271 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:42:34.101+0000 7f9388300640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:42:34.271 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.271 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:42:34.271 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: dump: 2024-09-12T17:42:34.271 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.271 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.271 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.271 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.271 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.271 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.271 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.272 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.272 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.272 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.272 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: _finish_auth 0 2024-09-12T17:42:34.272 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: _check_auth_tickets 2024-09-12T17:42:34.272 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:34.272 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.272 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:42:34.272 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:42:34.101+0000 7f926dffb640 10 monclient: dump: 2024-09-12T17:42:34.272 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.272 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.273 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.273 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.273 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.273 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.273 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.273 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.273 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.273 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.273 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:42:34.101+0000 7f938a80f800 5 monclient: authenticate success, global_id 6290 2024-09-12T17:42:34.273 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:42:34.101+0000 7f938a80f800 10 monclient: _renew_subs 2024-09-12T17:42:34.273 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:42:34.101+0000 7f9389302640 4 set_mon_vals no callback set 2024-09-12T17:42:34.274 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:42:34.101+0000 7f938a80f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:42:34.274 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:42:34.101+0000 7f938a80f800 10 monclient: _renew_subs 2024-09-12T17:42:34.274 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:42:34.101+0000 7f938a80f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:42:34.274 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:42:34.103+0000 7f926dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:34.274 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:42:34.103+0000 7f926dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:42:34.274 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:42:34.103+0000 7f926dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:42:34.274 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:42:34.103+0000 7f938a80f800 10 monclient: get_monmap_and_config 2024-09-12T17:42:34.275 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:42:34.103+0000 7f938a80f800 10 monclient: build_initial_monmap 2024-09-12T17:42:34.275 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:42:34.103+0000 7f938a80f800 1 build_initial for_mkfs: 0 2024-09-12T17:42:34.275 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:42:34.103+0000 7f938a80f800 10 monclient: monmap: 2024-09-12T17:42:34.275 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:42:34.275 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:34.275 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:42:34.275 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:42:34.276 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:34.276 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.276 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:42:34.276 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:42:34.276 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:42:34.276 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.276 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding auth protocol: cephx 2024-09-12T17:42:34.276 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding auth protocol: cephx 2024-09-12T17:42:34.276 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding auth protocol: cephx 2024-09-12T17:42:34.276 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: secure 2024-09-12T17:42:34.276 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: crc 2024-09-12T17:42:34.277 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: secure 2024-09-12T17:42:34.277 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: crc 2024-09-12T17:42:34.277 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: secure 2024-09-12T17:42:34.277 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: crc 2024-09-12T17:42:34.277 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: crc 2024-09-12T17:42:34.277 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: secure 2024-09-12T17:42:34.277 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: crc 2024-09-12T17:42:34.277 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: secure 2024-09-12T17:42:34.277 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: crc 2024-09-12T17:42:34.277 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:42:34.103+0000 7f9387aff640 10 monclient: get_auth_request con 0x7f9260076380 auth_method 0 2024-09-12T17:42:34.277 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:42:34.103+0000 7f938a80f800 5 AuthRegistry(0x559cbbfe3490) adding con mode: secure 2024-09-12T17:42:34.277 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:42:34.103+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.278 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient: init 2024-09-12T17:42:34.278 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding auth protocol: cephx 2024-09-12T17:42:34.278 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding auth protocol: cephx 2024-09-12T17:42:34.278 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding auth protocol: cephx 2024-09-12T17:42:34.278 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: secure 2024-09-12T17:42:34.278 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: crc 2024-09-12T17:42:34.278 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: secure 2024-09-12T17:42:34.278 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: crc 2024-09-12T17:42:34.278 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: secure 2024-09-12T17:42:34.278 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: crc 2024-09-12T17:42:34.278 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: crc 2024-09-12T17:42:34.278 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: secure 2024-09-12T17:42:34.279 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: crc 2024-09-12T17:42:34.279 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: secure 2024-09-12T17:42:34.279 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: crc 2024-09-12T17:42:34.279 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a44d0) adding con mode: secure 2024-09-12T17:42:34.279 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:42:34.104+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.279 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:42:34.104+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.279 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:42:34.104+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command rotate-key cmddesc rotate-key hook 0x7ffc580a4618 EEXIST 2024-09-12T17:42:34.279 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:34.279 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:42:34.279 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-b con 0x559cbc017b30 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:42:34.279 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-c con 0x559cbbfe7940 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:42:34.279 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-a con 0x559cbc012ef0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:42:34.279 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.280 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.280 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.280 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:34.280 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:42:34.104+0000 7f938a80f800 10 monclient(hunting): authenticate will time out at 1926.740646s 2024-09-12T17:42:34.280 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient(hunting): get_auth_request con 0x559cbc012ef0 auth_method 0 2024-09-12T17:42:34.280 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.280 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.280 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.280 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:42:34.104+0000 7f9387aff640 10 monclient(hunting): get_auth_request con 0x559cbbfe7940 auth_method 0 2024-09-12T17:42:34.280 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:42:34.104+0000 7f9387aff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.280 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:42:34.104+0000 7f9387aff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.280 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:42:34.104+0000 7f9387aff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.280 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:42:34.104+0000 7f9388300640 10 monclient(hunting): get_auth_request con 0x559cbc017b30 auth_method 0 2024-09-12T17:42:34.281 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:42:34.104+0000 7f9388300640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.281 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:42:34.104+0000 7f9388300640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.281 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:42:34.104+0000 7f9388300640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.281 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.281 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.281 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.281 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:42:34.104+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.281 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:42:34.104+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.282 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:42:34.104+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.282 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:42:34.104+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.282 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:42:34.104+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.282 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:42:34.104+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.282 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient(hunting): handle_auth_done global_id 6720 payload 274 2024-09-12T17:42:34.282 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient: _finish_hunting 0 2024-09-12T17:42:34.282 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:42:34.104+0000 7f9388b01640 1 monclient: found mon.noname-a 2024-09-12T17:42:34.282 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:42:34.104+0000 7f9388b01640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:42:34.282 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.282 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:42:34.282 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: dump: 2024-09-12T17:42:34.282 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.283 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.283 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.283 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.283 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.283 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.283 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.283 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.283 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.283 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.283 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: _finish_auth 0 2024-09-12T17:42:34.283 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:42:34.283 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:34.284 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.284 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:42:34.284 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:42:34.105+0000 7f925f7fe640 10 monclient: dump: 2024-09-12T17:42:34.284 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.284 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.284 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.284 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.284 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.284 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.284 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.284 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.284 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.285 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.285 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:42:34.105+0000 7f938a80f800 5 monclient: authenticate success, global_id 6720 2024-09-12T17:42:34.285 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:42:34.105+0000 7f938a80f800 10 monclient: get_monmap_and_config success 2024-09-12T17:42:34.285 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:42:34.105+0000 7f938a80f800 4 set_mon_vals no callback set 2024-09-12T17:42:34.285 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:42:34.105+0000 7f938a80f800 10 monclient: shutdown 2024-09-12T17:42:34.285 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:42:34.105+0000 7f938a80f800 10 monclient: build_initial_monmap 2024-09-12T17:42:34.285 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:42:34.105+0000 7f938a80f800 1 build_initial for_mkfs: 0 2024-09-12T17:42:34.285 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:42:34.105+0000 7f938a80f800 10 monclient: monmap: 2024-09-12T17:42:34.285 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:42:34.285 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:42:34.285 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:42:34.286 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:42:34.286 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:42:34.286 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.286 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:42:34.286 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:42:34.286 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:42:34.286 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.286 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding auth protocol: cephx 2024-09-12T17:42:34.287 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding auth protocol: cephx 2024-09-12T17:42:34.287 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding auth protocol: cephx 2024-09-12T17:42:34.287 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: secure 2024-09-12T17:42:34.287 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: crc 2024-09-12T17:42:34.287 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: secure 2024-09-12T17:42:34.287 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: crc 2024-09-12T17:42:34.287 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: secure 2024-09-12T17:42:34.287 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: crc 2024-09-12T17:42:34.287 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: crc 2024-09-12T17:42:34.288 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: secure 2024-09-12T17:42:34.288 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: crc 2024-09-12T17:42:34.288 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: secure 2024-09-12T17:42:34.288 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: crc 2024-09-12T17:42:34.288 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbc0133a0) adding con mode: secure 2024-09-12T17:42:34.288 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:42:34.106+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.288 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:42:34.106+0000 7f938a80f800 1 librados: starting msgr at 2024-09-12T17:42:34.288 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:42:34.106+0000 7f938a80f800 1 librados: starting objecter 2024-09-12T17:42:34.289 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command objecter_requests cmddesc objecter_requests hook 0x559cbc00e1a0 EEXIST 2024-09-12T17:42:34.289 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:42:34.106+0000 7f938a80f800 1 librados: setting wanted keys 2024-09-12T17:42:34.289 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:42:34.106+0000 7f938a80f800 1 librados: calling monclient init 2024-09-12T17:42:34.289 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient: init 2024-09-12T17:42:34.289 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding auth protocol: cephx 2024-09-12T17:42:34.289 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding auth protocol: cephx 2024-09-12T17:42:34.289 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding auth protocol: cephx 2024-09-12T17:42:34.289 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: secure 2024-09-12T17:42:34.290 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: crc 2024-09-12T17:42:34.290 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: secure 2024-09-12T17:42:34.290 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: crc 2024-09-12T17:42:34.290 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: secure 2024-09-12T17:42:34.290 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: crc 2024-09-12T17:42:34.290 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: crc 2024-09-12T17:42:34.290 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: secure 2024-09-12T17:42:34.290 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: crc 2024-09-12T17:42:34.290 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: secure 2024-09-12T17:42:34.290 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: crc 2024-09-12T17:42:34.290 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 AuthRegistry(0x559cbbfdb420) adding con mode: secure 2024-09-12T17:42:34.290 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:42:34.106+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.291 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:42:34.106+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.291 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:42:34.106+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command rotate-key cmddesc rotate-key hook 0x559cbbfdb568 EEXIST 2024-09-12T17:42:34.291 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient: _reopen_session rank -1 2024-09-12T17:42:34.291 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:42:34.291 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-a con 0x559cbbfe7940 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:42:34.291 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-c con 0x559cbc012ef0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:42:34.291 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient(hunting): picked mon.noname-b con 0x559cbc017b30 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:42:34.291 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.291 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.291 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:42:34.291 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient(hunting): _renew_subs 2024-09-12T17:42:34.291 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:42:34.106+0000 7f938a80f800 10 monclient(hunting): authenticate will time out at 1926.742973s 2024-09-12T17:42:34.291 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient(hunting): get_auth_request con 0x559cbbfe7940 auth_method 0 2024-09-12T17:42:34.291 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.292 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.292 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.292 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:42:34.107+0000 7f9387aff640 10 monclient(hunting): get_auth_request con 0x559cbc012ef0 auth_method 0 2024-09-12T17:42:34.292 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:42:34.107+0000 7f9387aff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.292 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:42:34.107+0000 7f9387aff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.292 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:42:34.107+0000 7f9387aff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.292 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.292 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.292 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.292 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:42:34.107+0000 7f9388b01640 10 monclient(hunting): get_auth_request con 0x559cbc017b30 auth_method 0 2024-09-12T17:42:34.292 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:42:34.107+0000 7f9388b01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:42:34.292 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:42:34.107+0000 7f9388b01640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:42:34.293 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:42:34.107+0000 7f9388b01640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:42:34.293 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:42:34.107+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.293 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:42:34.107+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.293 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:42:34.107+0000 7f9387aff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.293 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:42:34.107+0000 7f9388b01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:42:34.293 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:42:34.107+0000 7f9388b01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:42:34.293 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:42:34.107+0000 7f9388b01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:42:34.293 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient(hunting): handle_auth_done global_id 6723 payload 824 2024-09-12T17:42:34.293 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient: _finish_hunting 0 2024-09-12T17:42:34.293 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:42:34.107+0000 7f9388300640 1 monclient: found mon.noname-a 2024-09-12T17:42:34.293 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:42:34.107+0000 7f9388300640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:42:34.293 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.293 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:42:34.294 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: dump: 2024-09-12T17:42:34.294 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.294 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.294 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.294 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.294 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.294 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.294 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.294 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.294 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.294 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.294 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: _finish_auth 0 2024-09-12T17:42:34.294 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: _check_auth_tickets 2024-09-12T17:42:34.295 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:42:34.295 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:42:34.295 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:42:34.295 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:42:34.107+0000 7f925dffb640 10 monclient: dump: 2024-09-12T17:42:34.295 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:42:34.295 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:42:34.295 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.295 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:42:34.295 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:42:34.295 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:42:34.295 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:42:34.295 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:42:34.295 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:42:34.295 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.295 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:42:34.107+0000 7f938a80f800 5 monclient: authenticate success, global_id 6723 2024-09-12T17:42:34.296 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:42:34.107+0000 7f925f7fe640 4 set_mon_vals no callback set 2024-09-12T17:42:34.296 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:42:34.107+0000 7f938a80f800 10 monclient: _renew_subs 2024-09-12T17:42:34.296 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:42:34.107+0000 7f938a80f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:42:34.296 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:42:34.107+0000 7f938a80f800 10 monclient: _renew_subs 2024-09-12T17:42:34.296 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:42:34.107+0000 7f938a80f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:42:34.296 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:42:34.107+0000 7f938a80f800 1 librados: init done 2024-09-12T17:42:34.296 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:42:34.107+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command cr dump hook 0x559cbc009dd8 2024-09-12T17:42:34.296 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:42:34.109+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.296 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:42:34.109+0000 7f925dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:42:34.296 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:42:34.109+0000 7f925dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:42:34.296 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:42:34.109+0000 7f925dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:42:34.296 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:42:34.110+0000 7f9387aff640 10 monclient: get_auth_request con 0x7f9250076470 auth_method 0 2024-09-12T17:42:34.296 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:42:34.110+0000 7f9388b01640 10 monclient: get_auth_request con 0x559cbc031a40 auth_method 0 2024-09-12T17:42:34.297 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.297 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:42:34.111+0000 7f938a80f800 20 realm 2024-09-12T17:42:34.297 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.297 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.297 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:42:34.111+0000 7f938a80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:34.297 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.297 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.297 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:42:34.111+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.298 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:42:34.111+0000 7f9388300640 10 monclient: get_auth_request con 0x559cbc035dd0 auth_method 0 2024-09-12T17:42:34.298 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:42:34.112+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:34.298 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:42:34.112+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.298 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:42:34.112+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:34.298 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:42:34.112+0000 7f938a80f800 20 searching for the correct realm 2024-09-12T17:42:34.298 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:42:34.112+0000 7f9387aff640 10 monclient: get_auth_request con 0x559cbc03aef0 auth_method 0 2024-09-12T17:42:34.298 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:42:34.113+0000 7f9388b01640 10 monclient: get_auth_request con 0x7f937c064c60 auth_method 0 2024-09-12T17:42:34.298 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:42:34.114+0000 7f9388300640 10 monclient: get_auth_request con 0x7f938003b040 auth_method 0 2024-09-12T17:42:34.298 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:42:34.114+0000 7f9387aff640 10 monclient: get_auth_request con 0x7f937800e310 auth_method 0 2024-09-12T17:42:34.298 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:42:34.116+0000 7f9387aff640 0 -- 172.21.15.44:0/88874874 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x559cbc03aef0 msgr2=0x559cbc03d390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:34.298 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:42:34.116+0000 7f925dffb640 1 client.6723.objecter ms_handle_reset 0x559cbc03aef0 session 0x559cbc03a870 osd.3 2024-09-12T17:42:34.298 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:42:34.116+0000 7f925dffb640 10 monclient: _renew_subs 2024-09-12T17:42:34.298 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:42:34.116+0000 7f925dffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:42:34.299 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:42:34.116+0000 7f9387aff640 10 monclient: get_auth_request con 0x7f9250086290 auth_method 0 2024-09-12T17:42:34.299 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:42:34.116+0000 7f9388b01640 10 monclient: get_auth_request con 0x7f937c08bb80 auth_method 0 2024-09-12T17:42:34.299 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:42:34.119+0000 7f9388300640 10 monclient: get_auth_request con 0x7f937c09a3a0 auth_method 0 2024-09-12T17:42:34.299 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:42:34.119+0000 7f9388300640 0 -- 172.21.15.44:0/88874874 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f937c09a3a0 msgr2=0x7f937c09a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:34.299 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:42:34.119+0000 7f925dffb640 1 client.6723.objecter ms_handle_reset 0x7f937c09a3a0 session 0x7f937c09bdd0 osd.0 2024-09-12T17:42:34.299 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:42:34.119+0000 7f9388300640 10 monclient: get_auth_request con 0x559cbc03aef0 auth_method 0 2024-09-12T17:42:34.299 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:34.299 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:34.299 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:34.299 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:34.299 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:34.299 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:34.299 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.300 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.300 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:42:34.123+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.300 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:34.300 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.300 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:34.300 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:42:34.124+0000 7f938a80f800 20 zone default found 2024-09-12T17:42:34.300 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:42:34.124+0000 7f938a80f800 4 Realm: () 2024-09-12T17:42:34.300 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:42:34.124+0000 7f938a80f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:34.300 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:42:34.124+0000 7f938a80f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:34.300 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:42:34.124+0000 7f938a80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:34.300 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:42:34.124+0000 7f938a80f800 20 zonegroup default 2024-09-12T17:42:34.300 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.300 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.300 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:42:34.124+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.301 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:42:34.125+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.301 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:42:34.125+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.301 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:42:34.125+0000 7f938a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.301 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:42:34.125+0000 7f938a80f800 20 started sync module instance, tier type = 2024-09-12T17:42:34.301 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:42:34.125+0000 7f938a80f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:34.301 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=0 2024-09-12T17:42:34.302 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=1 2024-09-12T17:42:34.302 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=2 2024-09-12T17:42:34.302 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=3 2024-09-12T17:42:34.302 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=4 2024-09-12T17:42:34.302 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=5 2024-09-12T17:42:34.303 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:42:34.134+0000 7f938a80f800 20 add_watcher() i=6 2024-09-12T17:42:34.303 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:42:34.135+0000 7f938a80f800 20 add_watcher() i=7 2024-09-12T17:42:34.303 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:42:34.135+0000 7f938a80f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:34.303 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding auth protocol: cephx 2024-09-12T17:42:34.303 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding auth protocol: cephx 2024-09-12T17:42:34.303 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding auth protocol: cephx 2024-09-12T17:42:34.303 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: secure 2024-09-12T17:42:34.303 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: crc 2024-09-12T17:42:34.304 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: secure 2024-09-12T17:42:34.304 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: crc 2024-09-12T17:42:34.304 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: secure 2024-09-12T17:42:34.304 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: crc 2024-09-12T17:42:34.304 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: crc 2024-09-12T17:42:34.304 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: secure 2024-09-12T17:42:34.304 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: crc 2024-09-12T17:42:34.305 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: secure 2024-09-12T17:42:34.305 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: crc 2024-09-12T17:42:34.305 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:42:34.136+0000 7f938a80f800 5 AuthRegistry(0x7ffc580a49a0) adding con mode: secure 2024-09-12T17:42:34.305 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:42:34.136+0000 7f923efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:34.305 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:42:34.136+0000 7f938a80f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:42:34.305 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:42:34.136+0000 7f938a80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:34.305 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:42:34.136+0000 7f938a80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:34.305 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command cache list hook 0x559cbc00e230 2024-09-12T17:42:34.305 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command cache inspect hook 0x559cbc00e230 2024-09-12T17:42:34.305 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command cache erase hook 0x559cbc00e230 2024-09-12T17:42:34.305 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command cache zap hook 0x559cbc00e230 2024-09-12T17:42:34.306 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 note: GC not initialized 2024-09-12T17:42:34.306 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:42:34.137+0000 7f923dfdb640 20 reqs_thread_entry: start 2024-09-12T17:42:34.306 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command sync trace show hook 0x7f9380004670 2024-09-12T17:42:34.306 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command sync trace history hook 0x7f9380004670 2024-09-12T17:42:34.306 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command sync trace active hook 0x7f9380004670 2024-09-12T17:42:34.306 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:42:34.137+0000 7f938a80f800 5 asok(0x559cbbd25730) register_command sync trace active_short hook 0x7f9380004670 2024-09-12T17:42:34.307 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:42:34.137+0000 7f938a80f800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:34.307 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:42:34.137+0000 7f938a80f800 20 Filter name: none 2024-09-12T17:42:34.307 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:42:34.137+0000 7f91af7fe640 20 reqs_thread_entry: start 2024-09-12T17:42:34.307 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:42:34.137+0000 7f938a80f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:42:34.307 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:42:34.137+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.307 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:42:34.138+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:34.307 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:42:34.138+0000 7f938a80f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:42:34.307 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:42:34.138+0000 7f938a80f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:42:34.308 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:42:34.138+0000 7f938a80f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 : miss 2024-09-12T17:42:34.308 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:42:34.138+0000 7f938a80f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.308 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:42:34.138+0000 7f938a80f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:34.308 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:42:34.138+0000 7f938a80f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 info.flags=0x17 2024-09-12T17:42:34.308 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:42:34.138+0000 7f938a80f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 to cache LRU end 2024-09-12T17:42:34.308 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:42:34.138+0000 7f938a80f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:34.308 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:42:34.138+0000 7f938a80f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:34.308 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:42:34.138+0000 7f938a80f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 2024-09-12T17:42:34.308 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:42:34.142+0000 7f938a80f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f938a80f800 time 2024-09-12T17:42:34.142538+0000 2024-09-12T17:42:34.309 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:42:34.309 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.309 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:34.309 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f938dd8c71a] 2024-09-12T17:42:34.309 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f938dd8c8d8] 2024-09-12T17:42:34.309 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559cbae1d841] 2024-09-12T17:42:34.309 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd73ca8) [0x559cbb32aca8] 2024-09-12T17:42:34.309 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559cbae2d50d] 2024-09-12T17:42:34.309 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:42:34.309 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f938ca29590] 2024-09-12T17:42:34.309 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:42:34.310 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:42:34.310 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.310 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:42:34.143+0000 7f938a80f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:42:34.310 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f938a80f800 thread_name:radosgw-admin 2024-09-12T17:42:34.310 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.310 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:42:34.310 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f938ca3e6f0] 2024-09-12T17:42:34.310 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f938ca8b99c] 2024-09-12T17:42:34.310 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:42:34.310 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:42:34.310 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f938dd8c774] 2024-09-12T17:42:34.310 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f938dd8c8d8] 2024-09-12T17:42:34.310 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559cbae1d841] 2024-09-12T17:42:34.310 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd73ca8) [0x559cbb32aca8] 2024-09-12T17:42:34.311 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559cbae2d50d] 2024-09-12T17:42:34.311 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:42:34.311 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f938ca29590] 2024-09-12T17:42:34.311 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:42:34.311 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:42:34.311 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:42:34.311 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.311 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:42:34.311 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:42:34.311 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:42:34.311 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:42:34.311 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:42:34.312 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:42:34.312 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:42:34.312 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:42:34.312 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:42:34.312 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:42:34.312 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:42:34.312 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:42:34.312 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:42:34.312 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:42:34.312 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:42:34.312 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:42:34.312 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:42:34.312 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:42:34.313 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:42:34.313 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:42:34.313 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:42:34.313 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:42:34.313 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:42:34.313 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:42:34.313 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:42:34.313 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:42:34.314 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:42:34.314 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:42:34.314 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:42:34.314 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:42:34.314 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:42:34.314 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:42:34.314 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:42:34.314 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:42:34.314 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:42:34.315 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:42:34.315 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:42:34.315 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:42:34.315 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:42:34.315 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:42:34.315 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:42:34.315 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:42:34.315 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:42:34.315 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:42:34.315 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:42:34.315 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:42:34.315 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:42:34.315 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:42:34.316 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:42:34.316 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:42:34.316 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:42:34.316 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:42:34.316 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:42:34.316 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:42:34.316 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:42:34.316 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:42:34.316 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:42:34.317 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:42:34.317 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:42:34.317 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:42:34.317 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:42:34.317 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:42:34.317 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:42:34.317 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:42:34.317 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:42:34.317 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:42:34.317 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:42:34.317 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:42:34.317 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:42:34.317 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:42:34.318 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:42:34.318 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:42:34.318 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:42:34.318 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:42:34.318 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:42:34.318 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:42:34.318 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:42:34.318 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:42:34.318 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:42:34.318 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:42:34.318 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:42:34.318 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:42:34.318 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:42:34.319 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:42:34.319 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:42:34.319 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:42:34.319 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:42:34.319 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:42:34.319 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:42:34.319 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:42:34.319 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:42:34.319 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:42:34.319 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:42:34.319 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:42:34.319 INFO:tasks.workunit.client.0.smithi044.stderr: 7f91af7fe640 / http_manager 2024-09-12T17:42:34.319 INFO:tasks.workunit.client.0.smithi044.stderr: 7f923dfdb640 / http_manager 2024-09-12T17:42:34.319 INFO:tasks.workunit.client.0.smithi044.stderr: 7f923efdd640 / rgw_dt_lg_renew 2024-09-12T17:42:34.320 INFO:tasks.workunit.client.0.smithi044.stderr: 7f925dffb640 / ms_dispatch 2024-09-12T17:42:34.320 INFO:tasks.workunit.client.0.smithi044.stderr: 7f925f7fe640 / io_context_pool 2024-09-12T17:42:34.320 INFO:tasks.workunit.client.0.smithi044.stderr: 7f926dffb640 / ms_dispatch 2024-09-12T17:42:34.320 INFO:tasks.workunit.client.0.smithi044.stderr: 7f9274e09640 / ms_dispatch 2024-09-12T17:42:34.320 INFO:tasks.workunit.client.0.smithi044.stderr: 7f927660c640 / io_context_pool 2024-09-12T17:42:34.320 INFO:tasks.workunit.client.0.smithi044.stderr: 7f9387aff640 / msgr-worker-2 2024-09-12T17:42:34.320 INFO:tasks.workunit.client.0.smithi044.stderr: 7f9388300640 / msgr-worker-1 2024-09-12T17:42:34.320 INFO:tasks.workunit.client.0.smithi044.stderr: 7f9388b01640 / msgr-worker-0 2024-09-12T17:42:34.320 INFO:tasks.workunit.client.0.smithi044.stderr: 7f9389302640 / io_context_pool 2024-09-12T17:42:34.321 INFO:tasks.workunit.client.0.smithi044.stderr: 7f938a80f800 / radosgw-admin 2024-09-12T17:42:34.321 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:42:34.321 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:42:34.321 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:42:34.144187Z_1950fccd-d886-4c8a-8495-a828346fd09d/log 2024-09-12T17:42:34.321 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:42:34.321 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:42:34.323 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:34.324 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:34.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.222+0000 7f8838923800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.224+0000 7f8838923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.224+0000 7f8838923800 20 realm 2024-09-12T17:42:34.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.224+0000 7f8838923800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.224+0000 7f8838923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.224+0000 7f8838923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:34.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.224+0000 7f8838923800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.224+0000 7f8838923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.224+0000 7f8838923800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.225+0000 7f8838923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:34.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.225+0000 7f8838923800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.225+0000 7f8838923800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:34.325 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.226+0000 7f8838923800 20 searching for the correct realm 2024-09-12T17:42:34.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.228+0000 7f8833e12640 0 -- 172.21.15.44:0/3740474194 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f88240383f0 msgr2=0x7f8824038810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:34.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.232+0000 7f8834613640 0 -- 172.21.15.44:0/3740474194 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f881c02ac10 msgr2=0x7f881c0185c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:34.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.438+0000 7f8838923800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:34.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.438+0000 7f8838923800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:34.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.438+0000 7f8838923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:34.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.438+0000 7f8838923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:34.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.438+0000 7f8838923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:34.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.438+0000 7f8838923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:34.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.438+0000 7f8838923800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.439+0000 7f8838923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.439+0000 7f8838923800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.439+0000 7f8838923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:34.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.439+0000 7f8838923800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.439+0000 7f8838923800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:34.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.439+0000 7f8838923800 20 zone default found 2024-09-12T17:42:34.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.439+0000 7f8838923800 4 Realm: () 2024-09-12T17:42:34.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.439+0000 7f8838923800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:34.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.439+0000 7f8838923800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:34.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.439+0000 7f8838923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:34.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.439+0000 7f8838923800 20 zonegroup default 2024-09-12T17:42:34.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.439+0000 7f8838923800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.440+0000 7f8838923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.440+0000 7f8838923800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.440+0000 7f8838923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.440+0000 7f8838923800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.440+0000 7f8838923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.440+0000 7f8838923800 20 started sync module instance, tier type = 2024-09-12T17:42:34.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.440+0000 7f8838923800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:34.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.449+0000 7f8838923800 20 add_watcher() i=0 2024-09-12T17:42:34.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.449+0000 7f8838923800 20 add_watcher() i=1 2024-09-12T17:42:34.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.449+0000 7f8838923800 20 add_watcher() i=2 2024-09-12T17:42:34.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.449+0000 7f8838923800 20 add_watcher() i=3 2024-09-12T17:42:34.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.449+0000 7f8838923800 20 add_watcher() i=4 2024-09-12T17:42:34.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.449+0000 7f8838923800 20 add_watcher() i=5 2024-09-12T17:42:34.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.449+0000 7f8838923800 20 add_watcher() i=6 2024-09-12T17:42:34.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.450+0000 7f8838923800 20 add_watcher() i=7 2024-09-12T17:42:34.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.450+0000 7f8838923800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:34.452 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.452+0000 7f86eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:34.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.452+0000 7f8838923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:34.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.452+0000 7f8838923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:34.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.452+0000 7f8838923800 5 note: GC not initialized 2024-09-12T17:42:34.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.452+0000 7f86e9fdb640 20 reqs_thread_entry: start 2024-09-12T17:42:34.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.452+0000 7f8838923800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:34.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.452+0000 7f8838923800 20 Filter name: none 2024-09-12T17:42:34.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.452+0000 7f865b7fe640 20 reqs_thread_entry: start 2024-09-12T17:42:34.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.452+0000 7f8838923800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.453+0000 7f8838923800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:34.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.453+0000 7f8838923800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.453+0000 7f8838923800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:34.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.453+0000 7f8838923800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:34.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.453+0000 7f8838923800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.454+0000 7f8838923800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:34.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.454+0000 7f8838923800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.454+0000 7f8838923800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:34.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.454+0000 7f8838923800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:42:34.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.456+0000 7f86eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:34.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.458+0000 7f8838923800 20 remove_watcher() i=0 2024-09-12T17:42:34.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.458+0000 7f8838923800 2 removed watcher, disabling cache 2024-09-12T17:42:34.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.459+0000 7f8838923800 20 remove_watcher() i=1 2024-09-12T17:42:34.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.460+0000 7f8838923800 20 remove_watcher() i=2 2024-09-12T17:42:34.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.461+0000 7f8838923800 20 remove_watcher() i=3 2024-09-12T17:42:34.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.462+0000 7f8838923800 20 remove_watcher() i=4 2024-09-12T17:42:34.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.463+0000 7f8838923800 20 remove_watcher() i=5 2024-09-12T17:42:34.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.464+0000 7f8838923800 20 remove_watcher() i=6 2024-09-12T17:42:34.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.465+0000 7f8838923800 20 remove_watcher() i=7 2024-09-12T17:42:34.476 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.476 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:42:34.476 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-set-target-layout id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:42:34.476 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:42:34.528 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:42:34.560 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:34.561 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:34.600 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.599+0000 7fb67971f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.600+0000 7fb67971f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.600+0000 7fb67971f800 20 realm 2024-09-12T17:42:34.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.600+0000 7fb67971f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.601+0000 7fb67971f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.601+0000 7fb67971f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:34.601 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.601+0000 7fb67971f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.601+0000 7fb67971f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.602 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.601+0000 7fb67971f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.602+0000 7fb67971f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:34.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.602+0000 7fb67971f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.602+0000 7fb67971f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:34.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.602+0000 7fb67971f800 20 searching for the correct realm 2024-09-12T17:42:34.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.605+0000 7fb674ca8640 0 -- 172.21.15.44:0/924122306 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fb66806b020 msgr2=0x7fb6680aaa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:34.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.609+0000 7fb6754a9640 0 -- 172.21.15.44:0/924122306 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fb660020970 msgr2=0x7fb660008c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:34.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.816+0000 7fb67971f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:42:34.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.816+0000 7fb67971f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:42:34.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.816+0000 7fb67971f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:34.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.816+0000 7fb67971f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:34.818 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.816+0000 7fb67971f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:34.818 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.816+0000 7fb67971f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:34.818 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.816+0000 7fb67971f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.818 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.816+0000 7fb67971f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.818 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.816+0000 7fb67971f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.818 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.816+0000 7fb67971f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:34.818 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.816+0000 7fb67971f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.817+0000 7fb67971f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:34.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.817+0000 7fb67971f800 20 zone default found 2024-09-12T17:42:34.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.817+0000 7fb67971f800 4 Realm: () 2024-09-12T17:42:34.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.817+0000 7fb67971f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:42:34.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.817+0000 7fb67971f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:42:34.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.817+0000 7fb67971f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:34.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.817+0000 7fb67971f800 20 zonegroup default 2024-09-12T17:42:34.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.817+0000 7fb67971f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.817+0000 7fb67971f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.817+0000 7fb67971f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.818+0000 7fb67971f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.818+0000 7fb67971f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.818+0000 7fb67971f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:34.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.818+0000 7fb67971f800 20 started sync module instance, tier type = 2024-09-12T17:42:34.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.818+0000 7fb67971f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:42:34.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.827+0000 7fb67971f800 20 add_watcher() i=0 2024-09-12T17:42:34.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.827+0000 7fb67971f800 20 add_watcher() i=1 2024-09-12T17:42:34.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.827+0000 7fb67971f800 20 add_watcher() i=2 2024-09-12T17:42:34.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.827+0000 7fb67971f800 20 add_watcher() i=3 2024-09-12T17:42:34.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.827+0000 7fb67971f800 20 add_watcher() i=4 2024-09-12T17:42:34.829 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.827+0000 7fb67971f800 20 add_watcher() i=5 2024-09-12T17:42:34.829 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.827+0000 7fb67971f800 20 add_watcher() i=6 2024-09-12T17:42:34.829 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.828+0000 7fb67971f800 20 add_watcher() i=7 2024-09-12T17:42:34.829 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.828+0000 7fb67971f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:34.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.830+0000 7fb52b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:34.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.830+0000 7fb67971f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:34.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.830+0000 7fb67971f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:34.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.830+0000 7fb67971f800 5 note: GC not initialized 2024-09-12T17:42:34.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.831+0000 7fb52a7e4640 20 reqs_thread_entry: start 2024-09-12T17:42:34.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.831+0000 7fb67971f800 20 init_complete bucket index max shards: 11 2024-09-12T17:42:34.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.831+0000 7fb67971f800 20 Filter name: none 2024-09-12T17:42:34.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.831+0000 7fb49bfff640 20 reqs_thread_entry: start 2024-09-12T17:42:34.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.831+0000 7fb67971f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:42:34.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.831+0000 7fb67971f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.832+0000 7fb67971f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:42:34.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.832+0000 7fb67971f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:42:34.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.832+0000 7fb67971f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:42:34.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.832+0000 7fb67971f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 : miss 2024-09-12T17:42:34.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.832+0000 7fb67971f800 20 rados->read ofs=0 len=0 2024-09-12T17:42:34.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.832+0000 7fb67971f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:42:34.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.832+0000 7fb67971f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 info.flags=0x17 2024-09-12T17:42:34.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.832+0000 7fb67971f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 to cache LRU end 2024-09-12T17:42:34.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.832+0000 7fb67971f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:42:34.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.832+0000 7fb67971f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:42:34.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.832+0000 7fb67971f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 2024-09-12T17:42:34.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.833+0000 7fb67971f800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 to be held by another RGW process; skipping for now 2024-09-12T17:42:34.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.834+0000 7fb52b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:34.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.836+0000 7fb67971f800 20 remove_watcher() i=0 2024-09-12T17:42:34.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.836+0000 7fb67971f800 2 removed watcher, disabling cache 2024-09-12T17:42:34.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.837+0000 7fb67971f800 20 remove_watcher() i=1 2024-09-12T17:42:34.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.838+0000 7fb67971f800 20 remove_watcher() i=2 2024-09-12T17:42:34.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.839+0000 7fb67971f800 20 remove_watcher() i=3 2024-09-12T17:42:34.841 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.840+0000 7fb67971f800 20 remove_watcher() i=4 2024-09-12T17:42:34.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.841+0000 7fb67971f800 20 remove_watcher() i=5 2024-09-12T17:42:34.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.842+0000 7fb67971f800 20 remove_watcher() i=6 2024-09-12T17:42:34.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:42:34.844+0000 7fb67971f800 20 remove_watcher() i=7 2024-09-12T17:42:34.855 INFO:tasks.workunit.client.0.smithi044.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:43:04.888 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:43:04.925 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:04.925 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:04.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:04.968+0000 7f6c00b21800 20 rados->read ofs=0 len=0 2024-09-12T17:43:04.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:04.970+0000 7f6c00b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:04.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:04.970+0000 7f6c00b21800 20 realm 2024-09-12T17:43:04.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:04.970+0000 7f6c00b21800 20 rados->read ofs=0 len=0 2024-09-12T17:43:04.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:04.970+0000 7f6c00b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:04.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:04.970+0000 7f6c00b21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:04.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:04.970+0000 7f6c00b21800 20 rados->read ofs=0 len=0 2024-09-12T17:43:04.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:04.970+0000 7f6c00b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:04.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:04.970+0000 7f6c00b21800 20 rados->read ofs=0 len=0 2024-09-12T17:43:04.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:04.971+0000 7f6c00b21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:04.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:04.971+0000 7f6c00b21800 20 rados->read ofs=0 len=0 2024-09-12T17:43:04.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:04.971+0000 7f6c00b21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:04.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:04.971+0000 7f6c00b21800 20 searching for the correct realm 2024-09-12T17:43:04.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:04.974+0000 7f6bfc756640 0 -- 172.21.15.44:0/2191055894 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7f6bf4026030 msgr2=0x7f6bf4061b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:05.181 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.179+0000 7f6bfc756640 0 -- 172.21.15.44:0/2191055894 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7f6ac40862c0 msgr2=0x7f6ac40886f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:05.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.389+0000 7f6c00b21800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:05.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.389+0000 7f6c00b21800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:05.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.389+0000 7f6c00b21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:05.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.389+0000 7f6c00b21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:05.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.389+0000 7f6c00b21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:05.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.389+0000 7f6c00b21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:05.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.389+0000 7f6c00b21800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.390+0000 7f6c00b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:05.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.390+0000 7f6c00b21800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.390+0000 7f6c00b21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:05.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.390+0000 7f6c00b21800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.391+0000 7f6c00b21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:05.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.391+0000 7f6c00b21800 20 zone default found 2024-09-12T17:43:05.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.391+0000 7f6c00b21800 4 Realm: () 2024-09-12T17:43:05.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.391+0000 7f6c00b21800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:05.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.391+0000 7f6c00b21800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:05.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.391+0000 7f6c00b21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:05.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.391+0000 7f6c00b21800 20 zonegroup default 2024-09-12T17:43:05.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.391+0000 7f6c00b21800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.391+0000 7f6c00b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:05.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.391+0000 7f6c00b21800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.391+0000 7f6c00b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:05.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.392+0000 7f6c00b21800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.392+0000 7f6c00b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:05.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.392+0000 7f6c00b21800 20 started sync module instance, tier type = 2024-09-12T17:43:05.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.392+0000 7f6c00b21800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:05.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.403+0000 7f6c00b21800 20 add_watcher() i=0 2024-09-12T17:43:05.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.403+0000 7f6c00b21800 20 add_watcher() i=1 2024-09-12T17:43:05.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.403+0000 7f6c00b21800 20 add_watcher() i=2 2024-09-12T17:43:05.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.403+0000 7f6c00b21800 20 add_watcher() i=3 2024-09-12T17:43:05.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.403+0000 7f6c00b21800 20 add_watcher() i=4 2024-09-12T17:43:05.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.403+0000 7f6c00b21800 20 add_watcher() i=5 2024-09-12T17:43:05.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.403+0000 7f6c00b21800 20 add_watcher() i=6 2024-09-12T17:43:05.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.405+0000 7f6c00b21800 20 add_watcher() i=7 2024-09-12T17:43:05.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.405+0000 7f6c00b21800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:05.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.407+0000 7f6ab2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:05.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.407+0000 7f6c00b21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:05.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.407+0000 7f6c00b21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:05.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.407+0000 7f6c00b21800 5 note: GC not initialized 2024-09-12T17:43:05.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.407+0000 7f6ab1fdb640 20 reqs_thread_entry: start 2024-09-12T17:43:05.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.407+0000 7f6c00b21800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:05.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.408+0000 7f6c00b21800 20 Filter name: none 2024-09-12T17:43:05.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.408+0000 7f6a237fe640 20 reqs_thread_entry: start 2024-09-12T17:43:05.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.408+0000 7f6c00b21800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:43:05.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.408+0000 7f6c00b21800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.408+0000 7f6c00b21800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:43:05.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.408+0000 7f6c00b21800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:43:05.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.408+0000 7f6c00b21800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:43:05.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.408+0000 7f6c00b21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 : miss 2024-09-12T17:43:05.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.408+0000 7f6c00b21800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.409+0000 7f6c00b21800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:43:05.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.409+0000 7f6c00b21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 info.flags=0x17 2024-09-12T17:43:05.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.409+0000 7f6c00b21800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 to cache LRU end 2024-09-12T17:43:05.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.409+0000 7f6c00b21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:05.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.409+0000 7f6c00b21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:05.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.409+0000 7f6c00b21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 2024-09-12T17:43:05.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.414+0000 7f6c00b21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 info.flags=0x17 2024-09-12T17:43:05.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.414+0000 7f6c00b21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 to cache LRU end 2024-09-12T17:43:05.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.414+0000 7f6c00b21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:05.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.414+0000 7f6c00b21800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25, ofs0, ns] 2024-09-12T17:43:05.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.414+0000 7f6ad2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562406 cookie 93952928055120 notifier 6777 bl.length()=1009 2024-09-12T17:43:05.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.414+0000 7f6ad2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 info.flags=0x17 2024-09-12T17:43:05.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.414+0000 7f6ad2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 to cache LRU end 2024-09-12T17:43:05.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.414+0000 7f6ad2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:05.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.415+0000 7f6c00b21800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25]): orig_sources= new_sources= 2024-09-12T17:43:05.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.415+0000 7f6c00b21800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25]): potential sources added=[] removed=[] 2024-09-12T17:43:05.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.415+0000 7f6c00b21800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25]): orig_dests= new_dests= 2024-09-12T17:43:05.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.415+0000 7f6c00b21800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25]): potential dests added=[] removed=[] 2024-09-12T17:43:05.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.0 2024-09-12T17:43:05.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.0 2024-09-12T17:43:05.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.1 2024-09-12T17:43:05.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.1 2024-09-12T17:43:05.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.2 2024-09-12T17:43:05.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.2 2024-09-12T17:43:05.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.3 2024-09-12T17:43:05.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.3 2024-09-12T17:43:05.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.4 2024-09-12T17:43:05.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.4 2024-09-12T17:43:05.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.5 2024-09-12T17:43:05.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.5 2024-09-12T17:43:05.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.6 2024-09-12T17:43:05.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.6 2024-09-12T17:43:05.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.7 2024-09-12T17:43:05.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.7 2024-09-12T17:43:05.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.8 2024-09-12T17:43:05.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.8 2024-09-12T17:43:05.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.9 2024-09-12T17:43:05.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.9 2024-09-12T17:43:05.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.10 2024-09-12T17:43:05.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.10 2024-09-12T17:43:05.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.11 2024-09-12T17:43:05.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1.11 2024-09-12T17:43:05.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.420+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.0 2024-09-12T17:43:05.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.421+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1 2024-09-12T17:43:05.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.421+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.2 2024-09-12T17:43:05.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.422+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.3 2024-09-12T17:43:05.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.423+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.4 2024-09-12T17:43:05.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.423+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.5 2024-09-12T17:43:05.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.424+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.6 2024-09-12T17:43:05.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.424+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.7 2024-09-12T17:43:05.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.425+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.8 2024-09-12T17:43:05.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.425+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.9 2024-09-12T17:43:05.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.426+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.10 2024-09-12T17:43:05.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.429+0000 7f6c00b21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:05.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.429+0000 7f6c00b21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 2024-09-12T17:43:05.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.431+0000 7f6c00b21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 info.flags=0x17 2024-09-12T17:43:05.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.431+0000 7f6c00b21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 to cache LRU end 2024-09-12T17:43:05.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.431+0000 7f6c00b21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:05.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.431+0000 7f6c00b21800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25, ofs0, ns] 2024-09-12T17:43:05.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.431+0000 7f6ad2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562407 cookie 93952928055120 notifier 6777 bl.length()=1009 2024-09-12T17:43:05.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.431+0000 7f6ad2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 info.flags=0x17 2024-09-12T17:43:05.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.431+0000 7f6ad2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 to cache LRU end 2024-09-12T17:43:05.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.431+0000 7f6ad2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:05.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.431+0000 7f6c00b21800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25]): orig_sources= new_sources= 2024-09-12T17:43:05.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.431+0000 7f6c00b21800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25]): potential sources added=[] removed=[] 2024-09-12T17:43:05.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.431+0000 7f6c00b21800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25]): orig_dests= new_dests= 2024-09-12T17:43:05.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.431+0000 7f6c00b21800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25]): potential dests added=[] removed=[] 2024-09-12T17:43:05.435 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.434+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.0 2024-09-12T17:43:05.436 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.434+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.1 2024-09-12T17:43:05.436 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.435+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.2 2024-09-12T17:43:05.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.435+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.3 2024-09-12T17:43:05.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.435+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.4 2024-09-12T17:43:05.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.436+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.5 2024-09-12T17:43:05.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.436+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.6 2024-09-12T17:43:05.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.437+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.7 2024-09-12T17:43:05.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.437+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.8 2024-09-12T17:43:05.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.437+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.9 2024-09-12T17:43:05.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.438+0000 7f6c00b21800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25.10 2024-09-12T17:43:05.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.438+0000 7f6c00b21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:05.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.438+0000 7f6c00b21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 2024-09-12T17:43:05.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.439+0000 7f6c00b21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 info.flags=0x17 2024-09-12T17:43:05.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.439+0000 7f6c00b21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 to cache LRU end 2024-09-12T17:43:05.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.439+0000 7f6c00b21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:05.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.439+0000 7f6c00b21800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25, ofs0, ns] 2024-09-12T17:43:05.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.440+0000 7f6ad2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562408 cookie 93952928055120 notifier 6777 bl.length()=977 2024-09-12T17:43:05.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.440+0000 7f6ad2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 info.flags=0x17 2024-09-12T17:43:05.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.440+0000 7f6ad2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 to cache LRU end 2024-09-12T17:43:05.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.440+0000 7f6ad2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:05.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.440+0000 7f6c00b21800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25]): orig_sources= new_sources= 2024-09-12T17:43:05.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.440+0000 7f6c00b21800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25]): potential sources added=[] removed=[] 2024-09-12T17:43:05.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.440+0000 7f6c00b21800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25]): orig_dests= new_dests= 2024-09-12T17:43:05.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.440+0000 7f6c00b21800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25]): potential dests added=[] removed=[] 2024-09-12T17:43:05.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.443+0000 7f6c00b21800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:43:05.446 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.445+0000 7f6ab2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:05.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.447+0000 7f6c00b21800 20 remove_watcher() i=0 2024-09-12T17:43:05.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.447+0000 7f6c00b21800 2 removed watcher, disabling cache 2024-09-12T17:43:05.450 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.449+0000 7f6c00b21800 20 remove_watcher() i=1 2024-09-12T17:43:05.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.450+0000 7f6c00b21800 20 remove_watcher() i=2 2024-09-12T17:43:05.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.452+0000 7f6c00b21800 20 remove_watcher() i=3 2024-09-12T17:43:05.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.453+0000 7f6c00b21800 20 remove_watcher() i=4 2024-09-12T17:43:05.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.454+0000 7f6c00b21800 20 remove_watcher() i=5 2024-09-12T17:43:05.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.455+0000 7f6c00b21800 20 remove_watcher() i=6 2024-09-12T17:43:05.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.456+0000 7f6c00b21800 20 remove_watcher() i=7 2024-09-12T17:43:05.472 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:43:05.503 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:05.503 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:05.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.542+0000 7ff120940800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.543+0000 7ff120940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:05.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.543+0000 7ff120940800 20 realm 2024-09-12T17:43:05.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.543+0000 7ff120940800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.544+0000 7ff120940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:05.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.544+0000 7ff120940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:05.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.544+0000 7ff120940800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.544+0000 7ff120940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:05.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.544+0000 7ff120940800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.545+0000 7ff120940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:05.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.545+0000 7ff120940800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.545+0000 7ff120940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:05.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.545+0000 7ff120940800 20 searching for the correct realm 2024-09-12T17:43:05.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.548+0000 7ff11cec1640 0 -- 172.21.15.44:0/1536302583 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7ff110074070 msgr2=0x7ff1100a4d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:05.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.552+0000 7ff11c6c0640 0 -- 172.21.15.44:0/1536302583 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7ff1100578e0 msgr2=0x7ff110057030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:05.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.760+0000 7ff120940800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:05.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.760+0000 7ff120940800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:05.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.760+0000 7ff120940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:05.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.760+0000 7ff120940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:05.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.760+0000 7ff120940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:05.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.760+0000 7ff120940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:05.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.760+0000 7ff120940800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.760+0000 7ff120940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:05.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.760+0000 7ff120940800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.760+0000 7ff120940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:05.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.760+0000 7ff120940800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.761+0000 7ff120940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:05.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.761+0000 7ff120940800 20 zone default found 2024-09-12T17:43:05.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.761+0000 7ff120940800 4 Realm: () 2024-09-12T17:43:05.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.761+0000 7ff120940800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:05.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.761+0000 7ff120940800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:05.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.761+0000 7ff120940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:05.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.761+0000 7ff120940800 20 zonegroup default 2024-09-12T17:43:05.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.761+0000 7ff120940800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.761+0000 7ff120940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:05.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.761+0000 7ff120940800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.761+0000 7ff120940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:05.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.761+0000 7ff120940800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.761+0000 7ff120940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:05.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.762+0000 7ff120940800 20 started sync module instance, tier type = 2024-09-12T17:43:05.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.762+0000 7ff120940800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:05.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.771+0000 7ff120940800 20 add_watcher() i=0 2024-09-12T17:43:05.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.771+0000 7ff120940800 20 add_watcher() i=1 2024-09-12T17:43:05.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.771+0000 7ff120940800 20 add_watcher() i=2 2024-09-12T17:43:05.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.771+0000 7ff120940800 20 add_watcher() i=3 2024-09-12T17:43:05.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.771+0000 7ff120940800 20 add_watcher() i=4 2024-09-12T17:43:05.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.771+0000 7ff120940800 20 add_watcher() i=5 2024-09-12T17:43:05.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.771+0000 7ff120940800 20 add_watcher() i=6 2024-09-12T17:43:05.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.773+0000 7ff120940800 20 add_watcher() i=7 2024-09-12T17:43:05.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.773+0000 7ff120940800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.774+0000 7fefd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.775+0000 7ff120940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.775+0000 7ff120940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.775+0000 7ff120940800 5 note: GC not initialized 2024-09-12T17:43:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.775+0000 7fefd1fdb640 20 reqs_thread_entry: start 2024-09-12T17:43:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.775+0000 7ff120940800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.775+0000 7ff120940800 20 Filter name: none 2024-09-12T17:43:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.775+0000 7fef437fe640 20 reqs_thread_entry: start 2024-09-12T17:43:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.775+0000 7ff120940800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.776+0000 7ff120940800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:43:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.776+0000 7ff120940800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.776+0000 7ff120940800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:43:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.776+0000 7ff120940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.776+0000 7ff120940800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.777+0000 7ff120940800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:43:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.777+0000 7ff120940800 20 rados->read ofs=0 len=0 2024-09-12T17:43:05.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.778+0000 7ff120940800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:43:05.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.778+0000 7ff120940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:05.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.779+0000 7fefd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:05.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.782+0000 7ff120940800 20 remove_watcher() i=0 2024-09-12T17:43:05.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.782+0000 7ff120940800 2 removed watcher, disabling cache 2024-09-12T17:43:05.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.783+0000 7ff120940800 20 remove_watcher() i=1 2024-09-12T17:43:05.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.784+0000 7ff120940800 20 remove_watcher() i=2 2024-09-12T17:43:05.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.785+0000 7ff120940800 20 remove_watcher() i=3 2024-09-12T17:43:05.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.786+0000 7ff120940800 20 remove_watcher() i=4 2024-09-12T17:43:05.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.787+0000 7ff120940800 20 remove_watcher() i=5 2024-09-12T17:43:05.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.788+0000 7ff120940800 20 remove_watcher() i=6 2024-09-12T17:43:05.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:05.789+0000 7ff120940800 20 remove_watcher() i=7 2024-09-12T17:43:05.802 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:05.803 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:43:05.803 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-set-target-layout id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:43:05.803 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:05.881 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T17:43:05.881 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:06.086 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:43:06.115 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:06.116 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:06.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.155+0000 7fbdf1c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.157+0000 7fbdf1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.157+0000 7fbdf1c0e800 20 realm 2024-09-12T17:43:06.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.157+0000 7fbdf1c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.157+0000 7fbdf1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.157+0000 7fbdf1c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:06.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.157+0000 7fbdf1c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.157+0000 7fbdf1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.157+0000 7fbdf1c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.158+0000 7fbdf1c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:06.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.158+0000 7fbdf1c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.158+0000 7fbdf1c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:06.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.158+0000 7fbdf1c0e800 20 searching for the correct realm 2024-09-12T17:43:06.164 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.161+0000 7fbdecaca640 0 -- 172.21.15.44:0/3494349697 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fbde0018070 msgr2=0x7fbde0049210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:06.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.165+0000 7fbded2cb640 0 -- 172.21.15.44:0/3494349697 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fbde402f030 msgr2=0x7fbde40a00e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:06.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.370+0000 7fbdf1c0e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:06.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.370+0000 7fbdf1c0e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:06.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.370+0000 7fbdf1c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:06.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.370+0000 7fbdf1c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:06.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.370+0000 7fbdf1c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:06.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.370+0000 7fbdf1c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:06.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.370+0000 7fbdf1c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.370+0000 7fbdf1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.370+0000 7fbdf1c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.371+0000 7fbdf1c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:06.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.371+0000 7fbdf1c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.371+0000 7fbdf1c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:06.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.371+0000 7fbdf1c0e800 20 zone default found 2024-09-12T17:43:06.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.371+0000 7fbdf1c0e800 4 Realm: () 2024-09-12T17:43:06.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.371+0000 7fbdf1c0e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:06.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.371+0000 7fbdf1c0e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:06.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.371+0000 7fbdf1c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:06.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.371+0000 7fbdf1c0e800 20 zonegroup default 2024-09-12T17:43:06.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.371+0000 7fbdf1c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.371+0000 7fbdf1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.371+0000 7fbdf1c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.372+0000 7fbdf1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.372+0000 7fbdf1c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.372+0000 7fbdf1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.372+0000 7fbdf1c0e800 20 started sync module instance, tier type = 2024-09-12T17:43:06.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.372+0000 7fbdf1c0e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:06.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.381+0000 7fbdf1c0e800 20 add_watcher() i=0 2024-09-12T17:43:06.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.381+0000 7fbdf1c0e800 20 add_watcher() i=1 2024-09-12T17:43:06.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.381+0000 7fbdf1c0e800 20 add_watcher() i=2 2024-09-12T17:43:06.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.381+0000 7fbdf1c0e800 20 add_watcher() i=3 2024-09-12T17:43:06.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.381+0000 7fbdf1c0e800 20 add_watcher() i=4 2024-09-12T17:43:06.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.381+0000 7fbdf1c0e800 20 add_watcher() i=5 2024-09-12T17:43:06.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.381+0000 7fbdf1c0e800 20 add_watcher() i=6 2024-09-12T17:43:06.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.382+0000 7fbdf1c0e800 20 add_watcher() i=7 2024-09-12T17:43:06.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.382+0000 7fbdf1c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:06.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.383+0000 7fbca37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:06.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.384+0000 7fbdf1c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:06.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.384+0000 7fbdf1c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:06.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.384+0000 7fbdf1c0e800 5 note: GC not initialized 2024-09-12T17:43:06.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.384+0000 7fbca27e4640 20 reqs_thread_entry: start 2024-09-12T17:43:06.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.384+0000 7fbdf1c0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:06.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.384+0000 7fbdf1c0e800 20 Filter name: none 2024-09-12T17:43:06.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.384+0000 7fbc13fff640 20 reqs_thread_entry: start 2024-09-12T17:43:06.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.384+0000 7fbdf1c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.385+0000 7fbdf1c0e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:06.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.385+0000 7fbdf1c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.385+0000 7fbdf1c0e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:06.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.385+0000 7fbdf1c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:06.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.386+0000 7fbdf1c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.386+0000 7fbdf1c0e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:06.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.386+0000 7fbdf1c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.387+0000 7fbdf1c0e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:06.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.387+0000 7fbdf1c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:06.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.388+0000 7fbca37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:06.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.390+0000 7fbdf1c0e800 20 remove_watcher() i=0 2024-09-12T17:43:06.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.390+0000 7fbdf1c0e800 2 removed watcher, disabling cache 2024-09-12T17:43:06.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.391+0000 7fbdf1c0e800 20 remove_watcher() i=1 2024-09-12T17:43:06.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.392+0000 7fbdf1c0e800 20 remove_watcher() i=2 2024-09-12T17:43:06.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.393+0000 7fbdf1c0e800 20 remove_watcher() i=3 2024-09-12T17:43:06.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.395+0000 7fbdf1c0e800 20 remove_watcher() i=4 2024-09-12T17:43:06.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.395+0000 7fbdf1c0e800 20 remove_watcher() i=5 2024-09-12T17:43:06.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.397+0000 7fbdf1c0e800 20 remove_watcher() i=6 2024-09-12T17:43:06.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.398+0000 7fbdf1c0e800 20 remove_watcher() i=7 2024-09-12T17:43:06.410 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:06.410 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:43:06.410 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-trim-reshard-log-entries id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:06.410 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:06.412 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T17:43:06.447 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:06.447 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:06.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.484+0000 7f46e2d2f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.486+0000 7f46e2d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.486+0000 7f46e2d2f800 20 realm 2024-09-12T17:43:06.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.486+0000 7f46e2d2f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.486+0000 7f46e2d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.486+0000 7f46e2d2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:06.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.486+0000 7f46e2d2f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.486+0000 7f46e2d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.486+0000 7f46e2d2f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.487+0000 7f46e2d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:06.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.487+0000 7f46e2d2f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.487+0000 7f46e2d2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:06.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.487+0000 7f46e2d2f800 20 searching for the correct realm 2024-09-12T17:43:06.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.490+0000 7f46df277640 0 -- 172.21.15.44:0/3587851662 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f46d4070ba0 msgr2=0x7f46d405b470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:06.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.494+0000 7f46dea76640 0 -- 172.21.15.44:0/3587851662 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f46d4007d80 msgr2=0x7f46d40aa190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:06.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.700+0000 7f46e2d2f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:06.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.700+0000 7f46e2d2f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:06.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.700+0000 7f46e2d2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:06.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.700+0000 7f46e2d2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:06.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.700+0000 7f46e2d2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:06.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.700+0000 7f46e2d2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:06.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.700+0000 7f46e2d2f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.700+0000 7f46e2d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.700+0000 7f46e2d2f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.701+0000 7f46e2d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:06.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.701+0000 7f46e2d2f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.701+0000 7f46e2d2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:06.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.701+0000 7f46e2d2f800 20 zone default found 2024-09-12T17:43:06.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.701+0000 7f46e2d2f800 4 Realm: () 2024-09-12T17:43:06.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.701+0000 7f46e2d2f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:06.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.701+0000 7f46e2d2f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:06.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.701+0000 7f46e2d2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:06.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.701+0000 7f46e2d2f800 20 zonegroup default 2024-09-12T17:43:06.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.701+0000 7f46e2d2f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.702+0000 7f46e2d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.702+0000 7f46e2d2f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.702+0000 7f46e2d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.702+0000 7f46e2d2f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.703+0000 7f46e2d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.703+0000 7f46e2d2f800 20 started sync module instance, tier type = 2024-09-12T17:43:06.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.703+0000 7f46e2d2f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:06.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.712+0000 7f46e2d2f800 20 add_watcher() i=0 2024-09-12T17:43:06.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.712+0000 7f46e2d2f800 20 add_watcher() i=1 2024-09-12T17:43:06.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.712+0000 7f46e2d2f800 20 add_watcher() i=2 2024-09-12T17:43:06.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.712+0000 7f46e2d2f800 20 add_watcher() i=3 2024-09-12T17:43:06.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.712+0000 7f46e2d2f800 20 add_watcher() i=4 2024-09-12T17:43:06.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.712+0000 7f46e2d2f800 20 add_watcher() i=5 2024-09-12T17:43:06.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.712+0000 7f46e2d2f800 20 add_watcher() i=6 2024-09-12T17:43:06.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.713+0000 7f46e2d2f800 20 add_watcher() i=7 2024-09-12T17:43:06.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.713+0000 7f46e2d2f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:06.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.715+0000 7f45957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:06.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.715+0000 7f46e2d2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:06.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.715+0000 7f46e2d2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:06.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.715+0000 7f46e2d2f800 5 note: GC not initialized 2024-09-12T17:43:06.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.715+0000 7f450ffff640 20 reqs_thread_entry: start 2024-09-12T17:43:06.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.715+0000 7f46e2d2f800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:06.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.716+0000 7f46e2d2f800 20 Filter name: none 2024-09-12T17:43:06.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.716+0000 7f450dffb640 20 reqs_thread_entry: start 2024-09-12T17:43:06.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.716+0000 7f46e2d2f800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:43:06.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.716+0000 7f46e2d2f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.716+0000 7f46e2d2f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:06.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.716+0000 7f46e2d2f800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:43:06.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.716+0000 7f46e2d2f800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:43:06.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.716+0000 7f46e2d2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 : miss 2024-09-12T17:43:06.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.716+0000 7f46e2d2f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.716+0000 7f46e2d2f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:06.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.716+0000 7f46e2d2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 info.flags=0x17 2024-09-12T17:43:06.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.716+0000 7f46e2d2f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 to cache LRU end 2024-09-12T17:43:06.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.716+0000 7f46e2d2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:06.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.716+0000 7f46e2d2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:06.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.716+0000 7f46e2d2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 2024-09-12T17:43:06.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.722+0000 7f46e2d2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 info.flags=0x17 2024-09-12T17:43:06.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.722+0000 7f46e2d2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 to cache LRU end 2024-09-12T17:43:06.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.722+0000 7f46e2d2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:06.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.722+0000 7f46e2d2f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26, ofs0, ns] 2024-09-12T17:43:06.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.723+0000 7f45c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562411 cookie 94211952968160 notifier 6395 bl.length()=1023 2024-09-12T17:43:06.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.723+0000 7f45c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 info.flags=0x17 2024-09-12T17:43:06.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.723+0000 7f45c27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 to cache LRU end 2024-09-12T17:43:06.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.723+0000 7f45c27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:06.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.723+0000 7f46e2d2f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26]): orig_sources= new_sources= 2024-09-12T17:43:06.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.723+0000 7f46e2d2f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26]): potential sources added=[] removed=[] 2024-09-12T17:43:06.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.723+0000 7f46e2d2f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26]): orig_dests= new_dests= 2024-09-12T17:43:06.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.723+0000 7f46e2d2f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26]): potential dests added=[] removed=[] 2024-09-12T17:43:06.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.723+0000 7f46e2d2f800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T17:43:06.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.723+0000 7f46e2d2f800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T17:43:06.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.725+0000 7f45957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:06.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.727+0000 7f46e2d2f800 20 remove_watcher() i=0 2024-09-12T17:43:06.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.727+0000 7f46e2d2f800 2 removed watcher, disabling cache 2024-09-12T17:43:06.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.728+0000 7f46e2d2f800 20 remove_watcher() i=1 2024-09-12T17:43:06.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.729+0000 7f46e2d2f800 20 remove_watcher() i=2 2024-09-12T17:43:06.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.730+0000 7f46e2d2f800 20 remove_watcher() i=3 2024-09-12T17:43:06.733 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.731+0000 7f46e2d2f800 20 remove_watcher() i=4 2024-09-12T17:43:06.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.732+0000 7f46e2d2f800 20 remove_watcher() i=5 2024-09-12T17:43:06.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.733+0000 7f46e2d2f800 20 remove_watcher() i=6 2024-09-12T17:43:06.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.734+0000 7f46e2d2f800 20 remove_watcher() i=7 2024-09-12T17:43:06.749 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:43:06.779 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:06.779 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:06.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.816+0000 7f1b0c420800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.819 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.817+0000 7f1b0c420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.819 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.817+0000 7f1b0c420800 20 realm 2024-09-12T17:43:06.819 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.817+0000 7f1b0c420800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.818+0000 7f1b0c420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.818+0000 7f1b0c420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:06.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.818+0000 7f1b0c420800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.818+0000 7f1b0c420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.818+0000 7f1b0c420800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.818+0000 7f1b0c420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:06.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.818+0000 7f1b0c420800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.819+0000 7f1b0c420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:06.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.819+0000 7f1b0c420800 20 searching for the correct realm 2024-09-12T17:43:06.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.823+0000 7f1b09710640 0 -- 172.21.15.44:0/2029119059 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f1afc0b1bc0 msgr2=0x7f1afc0aaf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:06.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.826+0000 7f1b0a712640 0 -- 172.21.15.44:0/2029119059 >> [v2:172.21.15.181:6810/2228110208,v1:172.21.15.181:6811/2228110208] conn(0x7f1b0001f060 msgr2=0x7f1b000747c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:06.831 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:06.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:06.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:06.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:06.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:06.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:06.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:06.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:06.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 20 zone default found 2024-09-12T17:43:06.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 4 Realm: () 2024-09-12T17:43:06.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:06.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:06.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:06.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 20 zonegroup default 2024-09-12T17:43:06.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.830+0000 7f1b0c420800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.831+0000 7f1b0c420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.831+0000 7f1b0c420800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.831+0000 7f1b0c420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.831+0000 7f1b0c420800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.831+0000 7f1b0c420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.831+0000 7f1b0c420800 20 started sync module instance, tier type = 2024-09-12T17:43:06.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.831+0000 7f1b0c420800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:06.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.840+0000 7f1b0c420800 20 add_watcher() i=0 2024-09-12T17:43:06.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.840+0000 7f1b0c420800 20 add_watcher() i=1 2024-09-12T17:43:06.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.840+0000 7f1b0c420800 20 add_watcher() i=2 2024-09-12T17:43:06.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.840+0000 7f1b0c420800 20 add_watcher() i=3 2024-09-12T17:43:06.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.840+0000 7f1b0c420800 20 add_watcher() i=4 2024-09-12T17:43:06.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.840+0000 7f1b0c420800 20 add_watcher() i=5 2024-09-12T17:43:06.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.840+0000 7f1b0c420800 20 add_watcher() i=6 2024-09-12T17:43:06.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.841+0000 7f1b0c420800 20 add_watcher() i=7 2024-09-12T17:43:06.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.841+0000 7f1b0c420800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:06.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.843+0000 7f19bffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:06.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.843+0000 7f1b0c420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:06.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.843+0000 7f1b0c420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:06.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.843+0000 7f1b0c420800 5 note: GC not initialized 2024-09-12T17:43:06.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.844+0000 7f19befe5640 20 reqs_thread_entry: start 2024-09-12T17:43:06.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.844+0000 7f1b0c420800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:06.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.844+0000 7f1b0c420800 20 Filter name: none 2024-09-12T17:43:06.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.844+0000 7f19bcfe1640 20 reqs_thread_entry: start 2024-09-12T17:43:06.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.844+0000 7f1b0c420800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.844+0000 7f1b0c420800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:06.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.844+0000 7f1b0c420800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.845+0000 7f1b0c420800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:43:06.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.845+0000 7f1b0c420800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:06.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.845+0000 7f1b0c420800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.845+0000 7f1b0c420800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:06.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.845+0000 7f1b0c420800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.846+0000 7f1b0c420800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:43:06.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.846+0000 7f1b0c420800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:06.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.847+0000 7f19bffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:06.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.849+0000 7f1b0c420800 20 remove_watcher() i=0 2024-09-12T17:43:06.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.849+0000 7f1b0c420800 2 removed watcher, disabling cache 2024-09-12T17:43:06.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.850+0000 7f1b0c420800 20 remove_watcher() i=1 2024-09-12T17:43:06.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.851+0000 7f1b0c420800 20 remove_watcher() i=2 2024-09-12T17:43:06.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.853+0000 7f1b0c420800 20 remove_watcher() i=3 2024-09-12T17:43:06.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.854+0000 7f1b0c420800 20 remove_watcher() i=4 2024-09-12T17:43:06.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.855+0000 7f1b0c420800 20 remove_watcher() i=5 2024-09-12T17:43:06.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.856+0000 7f1b0c420800 20 remove_watcher() i=6 2024-09-12T17:43:06.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.857+0000 7f1b0c420800 20 remove_watcher() i=7 2024-09-12T17:43:06.869 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:06.869 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:43:06.869 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-trim-reshard-log-entries id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:06.869 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:06.921 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:43:06.954 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:06.954 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:06.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.991+0000 7fe0a5614800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.992+0000 7fe0a5614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.992+0000 7fe0a5614800 20 realm 2024-09-12T17:43:06.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.992+0000 7fe0a5614800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.993+0000 7fe0a5614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.993+0000 7fe0a5614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:06.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.993+0000 7fe0a5614800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.993+0000 7fe0a5614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:06.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.993+0000 7fe0a5614800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.994+0000 7fe0a5614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:06.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.994+0000 7fe0a5614800 20 rados->read ofs=0 len=0 2024-09-12T17:43:06.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.994+0000 7fe0a5614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:06.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.994+0000 7fe0a5614800 20 searching for the correct realm 2024-09-12T17:43:06.998 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:06.997+0000 7fe0a04ca640 0 -- 172.21.15.44:0/3372511789 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fe090088bf0 msgr2=0x7fe09007d130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:07.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.000+0000 7fe0a0ccb640 0 -- 172.21.15.44:0/3372511789 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fe0940c6b90 msgr2=0x7fe0940a3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:07.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.206+0000 7fe0a5614800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:07.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.206+0000 7fe0a5614800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:07.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.206+0000 7fe0a5614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:07.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.206+0000 7fe0a5614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:07.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.206+0000 7fe0a5614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:07.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.206+0000 7fe0a5614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:07.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.206+0000 7fe0a5614800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.207+0000 7fe0a5614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.207+0000 7fe0a5614800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.207+0000 7fe0a5614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:07.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.207+0000 7fe0a5614800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.207+0000 7fe0a5614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:07.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.207+0000 7fe0a5614800 20 zone default found 2024-09-12T17:43:07.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.207+0000 7fe0a5614800 4 Realm: () 2024-09-12T17:43:07.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.207+0000 7fe0a5614800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:07.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.207+0000 7fe0a5614800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:07.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.207+0000 7fe0a5614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:07.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.207+0000 7fe0a5614800 20 zonegroup default 2024-09-12T17:43:07.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.207+0000 7fe0a5614800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.208+0000 7fe0a5614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.208+0000 7fe0a5614800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.208+0000 7fe0a5614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.208+0000 7fe0a5614800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.208+0000 7fe0a5614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.208+0000 7fe0a5614800 20 started sync module instance, tier type = 2024-09-12T17:43:07.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.208+0000 7fe0a5614800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:07.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.219+0000 7fe0a5614800 20 add_watcher() i=0 2024-09-12T17:43:07.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.219+0000 7fe0a5614800 20 add_watcher() i=1 2024-09-12T17:43:07.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.219+0000 7fe0a5614800 20 add_watcher() i=2 2024-09-12T17:43:07.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.219+0000 7fe0a5614800 20 add_watcher() i=3 2024-09-12T17:43:07.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.219+0000 7fe0a5614800 20 add_watcher() i=4 2024-09-12T17:43:07.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.219+0000 7fe0a5614800 20 add_watcher() i=5 2024-09-12T17:43:07.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.219+0000 7fe0a5614800 20 add_watcher() i=6 2024-09-12T17:43:07.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.220+0000 7fe0a5614800 20 add_watcher() i=7 2024-09-12T17:43:07.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.220+0000 7fe0a5614800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:07.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.221+0000 7fdf56fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:07.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.222+0000 7fe0a5614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:07.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.222+0000 7fe0a5614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:07.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.222+0000 7fe0a5614800 5 note: GC not initialized 2024-09-12T17:43:07.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.222+0000 7fdf55fe3640 20 reqs_thread_entry: start 2024-09-12T17:43:07.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.222+0000 7fe0a5614800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:07.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.222+0000 7fe0a5614800 20 Filter name: none 2024-09-12T17:43:07.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.222+0000 7fdec77fe640 20 reqs_thread_entry: start 2024-09-12T17:43:07.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.222+0000 7fe0a5614800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:43:07.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.222+0000 7fe0a5614800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.223+0000 7fe0a5614800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:07.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.223+0000 7fe0a5614800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:43:07.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.223+0000 7fe0a5614800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:43:07.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.223+0000 7fe0a5614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 : miss 2024-09-12T17:43:07.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.223+0000 7fe0a5614800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.223+0000 7fe0a5614800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:43:07.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.223+0000 7fe0a5614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 info.flags=0x17 2024-09-12T17:43:07.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.223+0000 7fe0a5614800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 to cache LRU end 2024-09-12T17:43:07.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.223+0000 7fe0a5614800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:07.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.223+0000 7fe0a5614800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:07.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.223+0000 7fe0a5614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 2024-09-12T17:43:07.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.224+0000 7fe0a5614800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:43:07.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.231+0000 7fe0a5614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 info.flags=0x17 2024-09-12T17:43:07.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.231+0000 7fe0a5614800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 to cache LRU end 2024-09-12T17:43:07.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.231+0000 7fe0a5614800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:07.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.231+0000 7fe0a5614800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26, ofs0, ns] 2024-09-12T17:43:07.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.231+0000 7fdf777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562412 cookie 93932154875632 notifier 6428 bl.length()=1023 2024-09-12T17:43:07.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.231+0000 7fdf777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 info.flags=0x17 2024-09-12T17:43:07.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.231+0000 7fdf777fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 to cache LRU end 2024-09-12T17:43:07.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.231+0000 7fdf777fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:07.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.232+0000 7fe0a5614800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26]): orig_sources= new_sources= 2024-09-12T17:43:07.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.232+0000 7fe0a5614800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26]): potential sources added=[] removed=[] 2024-09-12T17:43:07.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.232+0000 7fe0a5614800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26]): orig_dests= new_dests= 2024-09-12T17:43:07.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.232+0000 7fe0a5614800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26]): potential dests added=[] removed=[] 2024-09-12T17:43:07.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.0 2024-09-12T17:43:07.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.0 2024-09-12T17:43:07.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.1 2024-09-12T17:43:07.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.1 2024-09-12T17:43:07.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.2 2024-09-12T17:43:07.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.2 2024-09-12T17:43:07.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.3 2024-09-12T17:43:07.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.3 2024-09-12T17:43:07.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.4 2024-09-12T17:43:07.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.4 2024-09-12T17:43:07.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.5 2024-09-12T17:43:07.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.5 2024-09-12T17:43:07.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.6 2024-09-12T17:43:07.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.6 2024-09-12T17:43:07.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.7 2024-09-12T17:43:07.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.7 2024-09-12T17:43:07.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.8 2024-09-12T17:43:07.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.8 2024-09-12T17:43:07.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.9 2024-09-12T17:43:07.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.9 2024-09-12T17:43:07.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.10 2024-09-12T17:43:07.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.10 2024-09-12T17:43:07.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.11 2024-09-12T17:43:07.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2.11 2024-09-12T17:43:07.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.236+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.0 2024-09-12T17:43:07.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.237+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.1 2024-09-12T17:43:07.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.237+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2 2024-09-12T17:43:07.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.237+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.3 2024-09-12T17:43:07.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.238+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.4 2024-09-12T17:43:07.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.238+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.5 2024-09-12T17:43:07.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.239+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.6 2024-09-12T17:43:07.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.239+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.7 2024-09-12T17:43:07.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.240+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.8 2024-09-12T17:43:07.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.240+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.9 2024-09-12T17:43:07.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.241+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.10 2024-09-12T17:43:07.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.244+0000 7fe0a5614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:07.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.244+0000 7fe0a5614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 2024-09-12T17:43:07.246 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.245+0000 7fe0a5614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 info.flags=0x17 2024-09-12T17:43:07.246 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.245+0000 7fe0a5614800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 to cache LRU end 2024-09-12T17:43:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.245+0000 7fe0a5614800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.245+0000 7fe0a5614800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26, ofs0, ns] 2024-09-12T17:43:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.245+0000 7fdf777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562413 cookie 93932154875632 notifier 6428 bl.length()=1023 2024-09-12T17:43:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.245+0000 7fdf777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 info.flags=0x17 2024-09-12T17:43:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.245+0000 7fdf777fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 to cache LRU end 2024-09-12T17:43:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.245+0000 7fdf777fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.245+0000 7fe0a5614800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26]): orig_sources= new_sources= 2024-09-12T17:43:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.245+0000 7fe0a5614800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26]): potential sources added=[] removed=[] 2024-09-12T17:43:07.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.245+0000 7fe0a5614800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26]): orig_dests= new_dests= 2024-09-12T17:43:07.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.245+0000 7fe0a5614800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26]): potential dests added=[] removed=[] 2024-09-12T17:43:07.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.248+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.0 2024-09-12T17:43:07.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.248+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.1 2024-09-12T17:43:07.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.249+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.2 2024-09-12T17:43:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.249+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.3 2024-09-12T17:43:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.249+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.4 2024-09-12T17:43:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.250+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.5 2024-09-12T17:43:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.250+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.6 2024-09-12T17:43:07.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.250+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.7 2024-09-12T17:43:07.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.251+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.8 2024-09-12T17:43:07.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.251+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.9 2024-09-12T17:43:07.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.252+0000 7fe0a5614800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26.10 2024-09-12T17:43:07.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.252+0000 7fe0a5614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:07.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.252+0000 7fe0a5614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 2024-09-12T17:43:07.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.253+0000 7fe0a5614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 info.flags=0x17 2024-09-12T17:43:07.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.253+0000 7fe0a5614800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 to cache LRU end 2024-09-12T17:43:07.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.253+0000 7fe0a5614800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:07.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.253+0000 7fe0a5614800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26, ofs0, ns] 2024-09-12T17:43:07.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.253+0000 7fdf777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562414 cookie 93932154875632 notifier 6428 bl.length()=991 2024-09-12T17:43:07.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.253+0000 7fdf777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 info.flags=0x17 2024-09-12T17:43:07.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.253+0000 7fdf777fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 to cache LRU end 2024-09-12T17:43:07.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.253+0000 7fdf777fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:07.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.254+0000 7fe0a5614800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26]): orig_sources= new_sources= 2024-09-12T17:43:07.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.254+0000 7fe0a5614800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26]): potential sources added=[] removed=[] 2024-09-12T17:43:07.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.254+0000 7fe0a5614800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26]): orig_dests= new_dests= 2024-09-12T17:43:07.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.254+0000 7fe0a5614800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26]): potential dests added=[] removed=[] 2024-09-12T17:43:07.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.256+0000 7fe0a5614800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:43:07.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.258+0000 7fdf56fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:07.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.260+0000 7fe0a5614800 20 remove_watcher() i=0 2024-09-12T17:43:07.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.260+0000 7fe0a5614800 2 removed watcher, disabling cache 2024-09-12T17:43:07.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.261+0000 7fe0a5614800 20 remove_watcher() i=1 2024-09-12T17:43:07.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.262+0000 7fe0a5614800 20 remove_watcher() i=2 2024-09-12T17:43:07.265 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.263+0000 7fe0a5614800 20 remove_watcher() i=3 2024-09-12T17:43:07.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.265+0000 7fe0a5614800 20 remove_watcher() i=4 2024-09-12T17:43:07.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.266+0000 7fe0a5614800 20 remove_watcher() i=5 2024-09-12T17:43:07.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.267+0000 7fe0a5614800 20 remove_watcher() i=6 2024-09-12T17:43:07.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.268+0000 7fe0a5614800 20 remove_watcher() i=7 2024-09-12T17:43:07.281 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:43:07.311 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:07.311 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:07.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.348+0000 7fb3ee723800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.350+0000 7fb3ee723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.350+0000 7fb3ee723800 20 realm 2024-09-12T17:43:07.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.350+0000 7fb3ee723800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.350+0000 7fb3ee723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.350+0000 7fb3ee723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:07.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.350+0000 7fb3ee723800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.350+0000 7fb3ee723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.350+0000 7fb3ee723800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.351+0000 7fb3ee723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:07.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.351+0000 7fb3ee723800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.351+0000 7fb3ee723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:07.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.351+0000 7fb3ee723800 20 searching for the correct realm 2024-09-12T17:43:07.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.354+0000 7fb3e9c0b640 0 -- 172.21.15.44:0/2772010217 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fb3dc06d3c0 msgr2=0x7fb3dc06be30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:07.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.358+0000 7fb3ea40c640 0 -- 172.21.15.44:0/2772010217 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fb3e00468c0 msgr2=0x7fb3e00353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:07.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.565+0000 7fb3ee723800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:07.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.565+0000 7fb3ee723800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:07.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.565+0000 7fb3ee723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:07.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.565+0000 7fb3ee723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:07.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.565+0000 7fb3ee723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:07.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.565+0000 7fb3ee723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:07.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.565+0000 7fb3ee723800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.565+0000 7fb3ee723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.565+0000 7fb3ee723800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.565+0000 7fb3ee723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:07.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.565+0000 7fb3ee723800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.566+0000 7fb3ee723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:07.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.566+0000 7fb3ee723800 20 zone default found 2024-09-12T17:43:07.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.566+0000 7fb3ee723800 4 Realm: () 2024-09-12T17:43:07.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.566+0000 7fb3ee723800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:07.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.566+0000 7fb3ee723800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:07.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.566+0000 7fb3ee723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:07.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.566+0000 7fb3ee723800 20 zonegroup default 2024-09-12T17:43:07.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.566+0000 7fb3ee723800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.566+0000 7fb3ee723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.566+0000 7fb3ee723800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.566+0000 7fb3ee723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.566+0000 7fb3ee723800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.566+0000 7fb3ee723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.566+0000 7fb3ee723800 20 started sync module instance, tier type = 2024-09-12T17:43:07.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.566+0000 7fb3ee723800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:07.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.576+0000 7fb3ee723800 20 add_watcher() i=0 2024-09-12T17:43:07.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.576+0000 7fb3ee723800 20 add_watcher() i=1 2024-09-12T17:43:07.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.576+0000 7fb3ee723800 20 add_watcher() i=2 2024-09-12T17:43:07.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.576+0000 7fb3ee723800 20 add_watcher() i=3 2024-09-12T17:43:07.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.576+0000 7fb3ee723800 20 add_watcher() i=4 2024-09-12T17:43:07.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.576+0000 7fb3ee723800 20 add_watcher() i=5 2024-09-12T17:43:07.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.576+0000 7fb3ee723800 20 add_watcher() i=6 2024-09-12T17:43:07.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.577+0000 7fb3ee723800 20 add_watcher() i=7 2024-09-12T17:43:07.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.577+0000 7fb3ee723800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:07.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.578+0000 7fb2a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:07.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.579+0000 7fb3ee723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:07.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.579+0000 7fb3ee723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:07.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.579+0000 7fb3ee723800 5 note: GC not initialized 2024-09-12T17:43:07.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.579+0000 7fb21b7fe640 20 reqs_thread_entry: start 2024-09-12T17:43:07.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.579+0000 7fb3ee723800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:07.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.579+0000 7fb3ee723800 20 Filter name: none 2024-09-12T17:43:07.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.579+0000 7fb2197fa640 20 reqs_thread_entry: start 2024-09-12T17:43:07.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.579+0000 7fb3ee723800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.580+0000 7fb3ee723800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:07.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.580+0000 7fb3ee723800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.580+0000 7fb3ee723800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:07.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.580+0000 7fb3ee723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:07.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.580+0000 7fb3ee723800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.581+0000 7fb3ee723800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:07.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.581+0000 7fb3ee723800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.581+0000 7fb3ee723800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:07.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.581+0000 7fb3ee723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:07.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.583+0000 7fb2a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:07.586 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.585+0000 7fb3ee723800 20 remove_watcher() i=0 2024-09-12T17:43:07.586 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.585+0000 7fb3ee723800 2 removed watcher, disabling cache 2024-09-12T17:43:07.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.586+0000 7fb3ee723800 20 remove_watcher() i=1 2024-09-12T17:43:07.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.588+0000 7fb3ee723800 20 remove_watcher() i=2 2024-09-12T17:43:07.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.589+0000 7fb3ee723800 20 remove_watcher() i=3 2024-09-12T17:43:07.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.590+0000 7fb3ee723800 20 remove_watcher() i=4 2024-09-12T17:43:07.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.591+0000 7fb3ee723800 20 remove_watcher() i=5 2024-09-12T17:43:07.593 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.592+0000 7fb3ee723800 20 remove_watcher() i=6 2024-09-12T17:43:07.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.593+0000 7fb3ee723800 20 remove_watcher() i=7 2024-09-12T17:43:07.606 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:07.606 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:43:07.606 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-trim-reshard-log-entries id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:43:07.607 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:07.681 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T17:43:07.681 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:07.913 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:43:07.942 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:07.942 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:07.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.979+0000 7f9b2500f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.981+0000 7f9b2500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.981+0000 7f9b2500f800 20 realm 2024-09-12T17:43:07.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.981+0000 7f9b2500f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.981+0000 7f9b2500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.981+0000 7f9b2500f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:07.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.981+0000 7f9b2500f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.982+0000 7f9b2500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:07.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.982+0000 7f9b2500f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.982+0000 7f9b2500f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:07.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.982+0000 7f9b2500f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:07.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.983+0000 7f9b2500f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:07.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.983+0000 7f9b2500f800 20 searching for the correct realm 2024-09-12T17:43:07.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.986+0000 7f9b232fa640 0 -- 172.21.15.44:0/766355026 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f9b1807b050 msgr2=0x7f9b18060800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:07.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:07.989+0000 7f9b22af9640 0 -- 172.21.15.44:0/766355026 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f9b180872a0 msgr2=0x7f9b18083950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:08.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.195+0000 7f9b2500f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:08.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.195+0000 7f9b2500f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:08.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.195+0000 7f9b2500f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:08.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.195+0000 7f9b2500f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:08.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.195+0000 7f9b2500f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:08.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.195+0000 7f9b2500f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:08.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.195+0000 7f9b2500f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.196+0000 7f9b2500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.196+0000 7f9b2500f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.196+0000 7f9b2500f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:08.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.196+0000 7f9b2500f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.196+0000 7f9b2500f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:08.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.196+0000 7f9b2500f800 20 zone default found 2024-09-12T17:43:08.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.196+0000 7f9b2500f800 4 Realm: () 2024-09-12T17:43:08.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.196+0000 7f9b2500f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:08.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.196+0000 7f9b2500f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:08.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.196+0000 7f9b2500f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:08.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.196+0000 7f9b2500f800 20 zonegroup default 2024-09-12T17:43:08.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.196+0000 7f9b2500f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.197+0000 7f9b2500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.197+0000 7f9b2500f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.197+0000 7f9b2500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.197+0000 7f9b2500f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.197+0000 7f9b2500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.197+0000 7f9b2500f800 20 started sync module instance, tier type = 2024-09-12T17:43:08.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.197+0000 7f9b2500f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:08.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.208+0000 7f9b2500f800 20 add_watcher() i=0 2024-09-12T17:43:08.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.208+0000 7f9b2500f800 20 add_watcher() i=1 2024-09-12T17:43:08.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.208+0000 7f9b2500f800 20 add_watcher() i=2 2024-09-12T17:43:08.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.208+0000 7f9b2500f800 20 add_watcher() i=3 2024-09-12T17:43:08.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.208+0000 7f9b2500f800 20 add_watcher() i=4 2024-09-12T17:43:08.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.208+0000 7f9b2500f800 20 add_watcher() i=5 2024-09-12T17:43:08.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.208+0000 7f9b2500f800 20 add_watcher() i=6 2024-09-12T17:43:08.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.209+0000 7f9b2500f800 20 add_watcher() i=7 2024-09-12T17:43:08.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.209+0000 7f9b2500f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:08.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.211+0000 7f99d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:08.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.211+0000 7f9b2500f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:08.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.211+0000 7f9b2500f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:08.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.211+0000 7f9b2500f800 5 note: GC not initialized 2024-09-12T17:43:08.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.211+0000 7f9953fff640 20 reqs_thread_entry: start 2024-09-12T17:43:08.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.211+0000 7f9b2500f800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:08.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.211+0000 7f9b2500f800 20 Filter name: none 2024-09-12T17:43:08.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.211+0000 7f9951ffb640 20 reqs_thread_entry: start 2024-09-12T17:43:08.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.211+0000 7f9b2500f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.212+0000 7f9b2500f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:08.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.212+0000 7f9b2500f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.213+0000 7f9b2500f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:08.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.213+0000 7f9b2500f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:08.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.213+0000 7f9b2500f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.213+0000 7f9b2500f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:08.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.213+0000 7f9b2500f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.213+0000 7f9b2500f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:08.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.213+0000 7f9b2500f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:08.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.215+0000 7f99d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:08.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.218+0000 7f9b2500f800 20 remove_watcher() i=0 2024-09-12T17:43:08.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.218+0000 7f9b2500f800 2 removed watcher, disabling cache 2024-09-12T17:43:08.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.219+0000 7f9b2500f800 20 remove_watcher() i=1 2024-09-12T17:43:08.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.220+0000 7f9b2500f800 20 remove_watcher() i=2 2024-09-12T17:43:08.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.221+0000 7f9b2500f800 20 remove_watcher() i=3 2024-09-12T17:43:08.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.223+0000 7f9b2500f800 20 remove_watcher() i=4 2024-09-12T17:43:08.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.224+0000 7f9b2500f800 20 remove_watcher() i=5 2024-09-12T17:43:08.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.225+0000 7f9b2500f800 20 remove_watcher() i=6 2024-09-12T17:43:08.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.226+0000 7f9b2500f800 20 remove_watcher() i=7 2024-09-12T17:43:08.238 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:08.238 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:43:08.238 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-trim-reshard-log-entries id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:08.238 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:08.240 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T17:43:08.277 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:08.277 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:08.316 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.315+0000 7f869f740800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.318 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.316+0000 7f869f740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.316+0000 7f869f740800 20 realm 2024-09-12T17:43:08.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.316+0000 7f869f740800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.317+0000 7f869f740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.317+0000 7f869f740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:08.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.317+0000 7f869f740800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.317+0000 7f869f740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.317+0000 7f869f740800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.318+0000 7f869f740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:08.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.318+0000 7f869f740800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.318+0000 7f869f740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:08.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.318+0000 7f869f740800 20 searching for the correct realm 2024-09-12T17:43:08.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.322+0000 7f869bcc1640 0 -- 172.21.15.44:0/4207658122 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x55f05aad4720 msgr2=0x55f05aad6b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:08.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.325+0000 7f869acbf640 0 -- 172.21.15.44:0/4207658122 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f868c018070 msgr2=0x7f868c05f990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:08.330 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.329+0000 7f869f740800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:08.330 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.329+0000 7f869f740800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:08.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.329+0000 7f869f740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:08.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.329+0000 7f869f740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:08.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.329+0000 7f869f740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:08.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.329+0000 7f869f740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:08.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.329+0000 7f869f740800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.329+0000 7f869f740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.329+0000 7f869f740800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.332 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.329+0000 7f869f740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:08.332 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.329+0000 7f869f740800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.330+0000 7f869f740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:08.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.330+0000 7f869f740800 20 zone default found 2024-09-12T17:43:08.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.330+0000 7f869f740800 4 Realm: () 2024-09-12T17:43:08.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.330+0000 7f869f740800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:08.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.330+0000 7f869f740800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:08.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.330+0000 7f869f740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:08.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.330+0000 7f869f740800 20 zonegroup default 2024-09-12T17:43:08.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.330+0000 7f869f740800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.330+0000 7f869f740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.330+0000 7f869f740800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.330+0000 7f869f740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.330+0000 7f869f740800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.330+0000 7f869f740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.330+0000 7f869f740800 20 started sync module instance, tier type = 2024-09-12T17:43:08.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.330+0000 7f869f740800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:08.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.340+0000 7f869f740800 20 add_watcher() i=0 2024-09-12T17:43:08.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.340+0000 7f869f740800 20 add_watcher() i=1 2024-09-12T17:43:08.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.340+0000 7f869f740800 20 add_watcher() i=2 2024-09-12T17:43:08.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.340+0000 7f869f740800 20 add_watcher() i=3 2024-09-12T17:43:08.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.340+0000 7f869f740800 20 add_watcher() i=4 2024-09-12T17:43:08.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.340+0000 7f869f740800 20 add_watcher() i=5 2024-09-12T17:43:08.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.340+0000 7f869f740800 20 add_watcher() i=6 2024-09-12T17:43:08.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.340+0000 7f869f740800 20 add_watcher() i=7 2024-09-12T17:43:08.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.340+0000 7f869f740800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:08.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.342+0000 7f8551fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:08.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.342+0000 7f869f740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:08.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.343+0000 7f869f740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:08.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.343+0000 7f869f740800 5 note: GC not initialized 2024-09-12T17:43:08.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.343+0000 7f8550fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:08.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.343+0000 7f869f740800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:08.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.343+0000 7f869f740800 20 Filter name: none 2024-09-12T17:43:08.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.343+0000 7f84ca7fc640 20 reqs_thread_entry: start 2024-09-12T17:43:08.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.343+0000 7f869f740800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:43:08.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.343+0000 7f869f740800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.344+0000 7f869f740800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:08.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.344+0000 7f869f740800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:43:08.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.344+0000 7f869f740800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:43:08.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.344+0000 7f869f740800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27 : miss 2024-09-12T17:43:08.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.344+0000 7f869f740800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.344+0000 7f869f740800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:08.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.344+0000 7f869f740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27 info.flags=0x17 2024-09-12T17:43:08.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.344+0000 7f869f740800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27 to cache LRU end 2024-09-12T17:43:08.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.344+0000 7f869f740800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:08.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.344+0000 7f869f740800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:08.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.344+0000 7f869f740800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27 2024-09-12T17:43:08.350 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.349+0000 7f869f740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27 info.flags=0x17 2024-09-12T17:43:08.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.349+0000 7f869f740800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27 to cache LRU end 2024-09-12T17:43:08.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.349+0000 7f869f740800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:08.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.349+0000 7f869f740800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27, ofs0, ns] 2024-09-12T17:43:08.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.349+0000 7f857effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562417 cookie 94490801877904 notifier 6479 bl.length()=1023 2024-09-12T17:43:08.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.349+0000 7f857effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27 info.flags=0x17 2024-09-12T17:43:08.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.349+0000 7f857effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27 to cache LRU end 2024-09-12T17:43:08.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.349+0000 7f857effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:08.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.349+0000 7f869f740800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27]): orig_sources= new_sources= 2024-09-12T17:43:08.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.349+0000 7f869f740800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27]): potential sources added=[] removed=[] 2024-09-12T17:43:08.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.349+0000 7f869f740800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27]): orig_dests= new_dests= 2024-09-12T17:43:08.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.349+0000 7f869f740800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27]): potential dests added=[] removed=[] 2024-09-12T17:43:08.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.349+0000 7f869f740800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T17:43:08.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.349+0000 7f869f740800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:43:08.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.0 2024-09-12T17:43:08.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.0 2024-09-12T17:43:08.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.1 2024-09-12T17:43:08.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.1 2024-09-12T17:43:08.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.2 2024-09-12T17:43:08.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.2 2024-09-12T17:43:08.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.3 2024-09-12T17:43:08.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.3 2024-09-12T17:43:08.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.4 2024-09-12T17:43:08.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.4 2024-09-12T17:43:08.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.5 2024-09-12T17:43:08.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.5 2024-09-12T17:43:08.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.6 2024-09-12T17:43:08.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.6 2024-09-12T17:43:08.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.7 2024-09-12T17:43:08.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.7 2024-09-12T17:43:08.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.8 2024-09-12T17:43:08.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.8 2024-09-12T17:43:08.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.9 2024-09-12T17:43:08.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.9 2024-09-12T17:43:08.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.10 2024-09-12T17:43:08.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.10 2024-09-12T17:43:08.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.11 2024-09-12T17:43:08.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1.11 2024-09-12T17:43:08.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.0 2024-09-12T17:43:08.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.352+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.1 2024-09-12T17:43:08.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.353+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.2 2024-09-12T17:43:08.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.353+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.3 2024-09-12T17:43:08.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.353+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.4 2024-09-12T17:43:08.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.354+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.5 2024-09-12T17:43:08.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.355+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.6 2024-09-12T17:43:08.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.355+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.7 2024-09-12T17:43:08.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.356+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.8 2024-09-12T17:43:08.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.356+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.9 2024-09-12T17:43:08.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.357+0000 7f869f740800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27.10 2024-09-12T17:43:08.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.360+0000 7f869f740800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:08.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.360+0000 7f869f740800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27 2024-09-12T17:43:08.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.361+0000 7f869f740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27 info.flags=0x17 2024-09-12T17:43:08.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.361+0000 7f869f740800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27 to cache LRU end 2024-09-12T17:43:08.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.361+0000 7f869f740800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:08.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.361+0000 7f869f740800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27, ofs0, ns] 2024-09-12T17:43:08.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.361+0000 7f857e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562418 cookie 94490801877904 notifier 6479 bl.length()=991 2024-09-12T17:43:08.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.361+0000 7f857e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27 info.flags=0x17 2024-09-12T17:43:08.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.361+0000 7f857e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27 to cache LRU end 2024-09-12T17:43:08.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.361+0000 7f857e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:08.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.361+0000 7f869f740800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27]): orig_sources= new_sources= 2024-09-12T17:43:08.363 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.361+0000 7f869f740800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27]): potential sources added=[] removed=[] 2024-09-12T17:43:08.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.361+0000 7f869f740800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27]): orig_dests= new_dests= 2024-09-12T17:43:08.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.361+0000 7f869f740800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27]): potential dests added=[] removed=[] 2024-09-12T17:43:08.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.363+0000 7f869f740800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:43:08.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.365+0000 7f8551fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:08.369 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.367+0000 7f869f740800 20 remove_watcher() i=0 2024-09-12T17:43:08.369 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.367+0000 7f869f740800 2 removed watcher, disabling cache 2024-09-12T17:43:08.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.369+0000 7f869f740800 20 remove_watcher() i=1 2024-09-12T17:43:08.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.370+0000 7f869f740800 20 remove_watcher() i=2 2024-09-12T17:43:08.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.371+0000 7f869f740800 20 remove_watcher() i=3 2024-09-12T17:43:08.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.372+0000 7f869f740800 20 remove_watcher() i=4 2024-09-12T17:43:08.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.373+0000 7f869f740800 20 remove_watcher() i=5 2024-09-12T17:43:08.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.374+0000 7f869f740800 20 remove_watcher() i=6 2024-09-12T17:43:08.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.375+0000 7f869f740800 20 remove_watcher() i=7 2024-09-12T17:43:08.389 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:43:08.418 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:08.418 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:08.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.455+0000 7fe754340800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.456+0000 7fe754340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.456+0000 7fe754340800 20 realm 2024-09-12T17:43:08.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.456+0000 7fe754340800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.457+0000 7fe754340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.457+0000 7fe754340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:08.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.457+0000 7fe754340800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.457+0000 7fe754340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.457+0000 7fe754340800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.458+0000 7fe754340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:08.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.458+0000 7fe754340800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.458+0000 7fe754340800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:08.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.458+0000 7fe754340800 20 searching for the correct realm 2024-09-12T17:43:08.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.461+0000 7fe750887640 0 -- 172.21.15.44:0/763074032 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x5613f96545c0 msgr2=0x5613f9656a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:08.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.465+0000 7fe750086640 0 -- 172.21.15.44:0/763074032 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fe744086850 msgr2=0x7fe74406f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:08.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.469+0000 7fe754340800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:08.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.469+0000 7fe754340800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:08.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.469+0000 7fe754340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:08.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.469+0000 7fe754340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:08.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.469+0000 7fe754340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:08.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.469+0000 7fe754340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:08.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.469+0000 7fe754340800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.469+0000 7fe754340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.469+0000 7fe754340800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.470+0000 7fe754340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:08.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.470+0000 7fe754340800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.470+0000 7fe754340800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:08.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.470+0000 7fe754340800 20 zone default found 2024-09-12T17:43:08.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.470+0000 7fe754340800 4 Realm: () 2024-09-12T17:43:08.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.470+0000 7fe754340800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:08.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.470+0000 7fe754340800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:08.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.470+0000 7fe754340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:08.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.470+0000 7fe754340800 20 zonegroup default 2024-09-12T17:43:08.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.470+0000 7fe754340800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.470+0000 7fe754340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.470+0000 7fe754340800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.470+0000 7fe754340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.470+0000 7fe754340800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.471+0000 7fe754340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.471+0000 7fe754340800 20 started sync module instance, tier type = 2024-09-12T17:43:08.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.471+0000 7fe754340800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:08.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.480+0000 7fe754340800 20 add_watcher() i=0 2024-09-12T17:43:08.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.480+0000 7fe754340800 20 add_watcher() i=1 2024-09-12T17:43:08.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.480+0000 7fe754340800 20 add_watcher() i=2 2024-09-12T17:43:08.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.480+0000 7fe754340800 20 add_watcher() i=3 2024-09-12T17:43:08.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.480+0000 7fe754340800 20 add_watcher() i=4 2024-09-12T17:43:08.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.480+0000 7fe754340800 20 add_watcher() i=5 2024-09-12T17:43:08.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.480+0000 7fe754340800 20 add_watcher() i=6 2024-09-12T17:43:08.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.481+0000 7fe754340800 20 add_watcher() i=7 2024-09-12T17:43:08.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.481+0000 7fe754340800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:08.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.482+0000 7fe6077de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:08.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.483+0000 7fe754340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:08.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.483+0000 7fe754340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:08.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.483+0000 7fe754340800 5 note: GC not initialized 2024-09-12T17:43:08.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.483+0000 7fe6067dc640 20 reqs_thread_entry: start 2024-09-12T17:43:08.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.483+0000 7fe754340800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:08.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.483+0000 7fe754340800 20 Filter name: none 2024-09-12T17:43:08.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.483+0000 7fe5ff7fe640 20 reqs_thread_entry: start 2024-09-12T17:43:08.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.483+0000 7fe754340800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.484+0000 7fe754340800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:08.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.484+0000 7fe754340800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.484+0000 7fe754340800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:08.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.484+0000 7fe754340800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:08.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.484+0000 7fe754340800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.485+0000 7fe754340800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:08.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.485+0000 7fe754340800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.485+0000 7fe754340800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:08.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.485+0000 7fe754340800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:08.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.487+0000 7fe6077de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:08.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.489+0000 7fe754340800 20 remove_watcher() i=0 2024-09-12T17:43:08.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.489+0000 7fe754340800 2 removed watcher, disabling cache 2024-09-12T17:43:08.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.490+0000 7fe754340800 20 remove_watcher() i=1 2024-09-12T17:43:08.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.491+0000 7fe754340800 20 remove_watcher() i=2 2024-09-12T17:43:08.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.492+0000 7fe754340800 20 remove_watcher() i=3 2024-09-12T17:43:08.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.493+0000 7fe754340800 20 remove_watcher() i=4 2024-09-12T17:43:08.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.494+0000 7fe754340800 20 remove_watcher() i=5 2024-09-12T17:43:08.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.495+0000 7fe754340800 20 remove_watcher() i=6 2024-09-12T17:43:08.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.496+0000 7fe754340800 20 remove_watcher() i=7 2024-09-12T17:43:08.509 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:08.509 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:43:08.509 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-trim-reshard-log-entries id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:43:08.509 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:08.585 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T17:43:08.585 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:08.788 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:43:08.817 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:08.817 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:08.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.854+0000 7f24ddc14800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.856+0000 7f24ddc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.856+0000 7f24ddc14800 20 realm 2024-09-12T17:43:08.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.856+0000 7f24ddc14800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.856+0000 7f24ddc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.856+0000 7f24ddc14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:08.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.856+0000 7f24ddc14800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.856+0000 7f24ddc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:08.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.856+0000 7f24ddc14800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.857+0000 7f24ddc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:08.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.857+0000 7f24ddc14800 20 rados->read ofs=0 len=0 2024-09-12T17:43:08.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.858+0000 7f24ddc14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:08.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.858+0000 7f24ddc14800 20 searching for the correct realm 2024-09-12T17:43:08.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.861+0000 7f24d9acc640 0 -- 172.21.15.44:0/191272666 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f24c401a040 msgr2=0x7f24c403f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:08.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:08.865+0000 7f24d92cb640 0 -- 172.21.15.44:0/191272666 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f24c40093c0 msgr2=0x7f24c4009840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:09.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.071+0000 7f24ddc14800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:09.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.071+0000 7f24ddc14800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:09.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.071+0000 7f24ddc14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:09.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.071+0000 7f24ddc14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:09.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.071+0000 7f24ddc14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:09.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.071+0000 7f24ddc14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:09.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.071+0000 7f24ddc14800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.072+0000 7f24ddc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.072+0000 7f24ddc14800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.072+0000 7f24ddc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.072+0000 7f24ddc14800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.072+0000 7f24ddc14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:09.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.072+0000 7f24ddc14800 20 zone default found 2024-09-12T17:43:09.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.072+0000 7f24ddc14800 4 Realm: () 2024-09-12T17:43:09.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.072+0000 7f24ddc14800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:09.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.072+0000 7f24ddc14800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:09.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.072+0000 7f24ddc14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:09.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.072+0000 7f24ddc14800 20 zonegroup default 2024-09-12T17:43:09.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.072+0000 7f24ddc14800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.073+0000 7f24ddc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.073+0000 7f24ddc14800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.073+0000 7f24ddc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.073+0000 7f24ddc14800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.073+0000 7f24ddc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.073+0000 7f24ddc14800 20 started sync module instance, tier type = 2024-09-12T17:43:09.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.073+0000 7f24ddc14800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:09.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.082+0000 7f24ddc14800 20 add_watcher() i=0 2024-09-12T17:43:09.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.082+0000 7f24ddc14800 20 add_watcher() i=1 2024-09-12T17:43:09.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.082+0000 7f24ddc14800 20 add_watcher() i=2 2024-09-12T17:43:09.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.082+0000 7f24ddc14800 20 add_watcher() i=3 2024-09-12T17:43:09.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.082+0000 7f24ddc14800 20 add_watcher() i=4 2024-09-12T17:43:09.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.082+0000 7f24ddc14800 20 add_watcher() i=5 2024-09-12T17:43:09.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.082+0000 7f24ddc14800 20 add_watcher() i=6 2024-09-12T17:43:09.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.084+0000 7f24ddc14800 20 add_watcher() i=7 2024-09-12T17:43:09.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.084+0000 7f24ddc14800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:09.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.086+0000 7f238ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.086+0000 7f24ddc14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:09.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.086+0000 7f24ddc14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:09.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.086+0000 7f24ddc14800 5 note: GC not initialized 2024-09-12T17:43:09.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.087+0000 7f238efe5640 20 reqs_thread_entry: start 2024-09-12T17:43:09.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.087+0000 7f24ddc14800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:09.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.087+0000 7f24ddc14800 20 Filter name: none 2024-09-12T17:43:09.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.087+0000 7f238cfe1640 20 reqs_thread_entry: start 2024-09-12T17:43:09.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.087+0000 7f24ddc14800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.088+0000 7f24ddc14800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:09.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.088+0000 7f24ddc14800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.088+0000 7f24ddc14800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:09.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.088+0000 7f24ddc14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:09.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.088+0000 7f24ddc14800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.089+0000 7f24ddc14800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:09.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.089+0000 7f24ddc14800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.089+0000 7f24ddc14800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:09.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.089+0000 7f24ddc14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:09.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.091+0000 7f238ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.094+0000 7f24ddc14800 20 remove_watcher() i=0 2024-09-12T17:43:09.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.094+0000 7f24ddc14800 2 removed watcher, disabling cache 2024-09-12T17:43:09.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.095+0000 7f24ddc14800 20 remove_watcher() i=1 2024-09-12T17:43:09.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.096+0000 7f24ddc14800 20 remove_watcher() i=2 2024-09-12T17:43:09.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.097+0000 7f24ddc14800 20 remove_watcher() i=3 2024-09-12T17:43:09.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.099+0000 7f24ddc14800 20 remove_watcher() i=4 2024-09-12T17:43:09.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.100+0000 7f24ddc14800 20 remove_watcher() i=5 2024-09-12T17:43:09.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.101+0000 7f24ddc14800 20 remove_watcher() i=6 2024-09-12T17:43:09.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.102+0000 7f24ddc14800 20 remove_watcher() i=7 2024-09-12T17:43:09.114 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.114 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:43:09.114 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-trim-reshard-log-entries id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:09.114 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.115 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T17:43:09.151 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:09.151 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:09.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.188+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.190+0000 7f4d55f28800 20 realm 2024-09-12T17:43:09.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.190+0000 7f4d55f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:09.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.191+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.191+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.191+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:09.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.191+0000 7f4d55f28800 20 searching for the correct realm 2024-09-12T17:43:09.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.195+0000 7f4d5146e640 0 -- 172.21.15.44:0/112386571 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x558d639ebaf0 msgr2=0x558d639edf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:09.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.198+0000 7f4d5146e640 0 -- 172.21.15.44:0/112386571 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f4d440dc040 msgr2=0x7f4d440e3ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:09.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:09.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:09.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:09.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:09.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:09.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:09.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.202+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:09.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.203+0000 7f4d55f28800 20 zone default found 2024-09-12T17:43:09.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.203+0000 7f4d55f28800 4 Realm: () 2024-09-12T17:43:09.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.203+0000 7f4d55f28800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:09.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.203+0000 7f4d55f28800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:09.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.203+0000 7f4d55f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:09.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.203+0000 7f4d55f28800 20 zonegroup default 2024-09-12T17:43:09.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.204+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.204+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.204+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.204+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.204+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.204+0000 7f4d55f28800 20 started sync module instance, tier type = 2024-09-12T17:43:09.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.204+0000 7f4d55f28800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:09.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=0 2024-09-12T17:43:09.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=1 2024-09-12T17:43:09.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=2 2024-09-12T17:43:09.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=3 2024-09-12T17:43:09.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=4 2024-09-12T17:43:09.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=5 2024-09-12T17:43:09.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=6 2024-09-12T17:43:09.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.214+0000 7f4d55f28800 20 add_watcher() i=7 2024-09-12T17:43:09.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.214+0000 7f4d55f28800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:09.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.216+0000 7f4c07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.216+0000 7f4d55f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:09.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.216+0000 7f4d55f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:09.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.216+0000 7f4d55f28800 5 note: GC not initialized 2024-09-12T17:43:09.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.216+0000 7f4c06fe5640 20 reqs_thread_entry: start 2024-09-12T17:43:09.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.216+0000 7f4d55f28800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:09.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.217+0000 7f4d55f28800 20 Filter name: none 2024-09-12T17:43:09.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.217+0000 7f4c04fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:09.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.217+0000 7f4d55f28800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:43:09.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.217+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.217+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:09.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.217+0000 7f4d55f28800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:43:09.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.217+0000 7f4d55f28800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:43:09.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.217+0000 7f4d55f28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 : miss 2024-09-12T17:43:09.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.217+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.217+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:09.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.218+0000 7f4d55f28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:09.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.218+0000 7f4d55f28800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:09.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.218+0000 7f4d55f28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:09.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.218+0000 7f4d55f28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.218+0000 7f4d55f28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 2024-09-12T17:43:09.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.222+0000 7f4d55f28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:09.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.222+0000 7f4d55f28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:09.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.222+0000 7f4d55f28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.222+0000 7f4d55f28800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28, ofs0, ns] 2024-09-12T17:43:09.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.223+0000 7f4c357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562421 cookie 94065750161264 notifier 6981 bl.length()=1023 2024-09-12T17:43:09.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.223+0000 7f4c357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:09.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.223+0000 7f4c357fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:09.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.223+0000 7f4c357fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.223+0000 7f4d55f28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): orig_sources= new_sources= 2024-09-12T17:43:09.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.223+0000 7f4d55f28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): potential sources added=[] removed=[] 2024-09-12T17:43:09.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.223+0000 7f4d55f28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): orig_dests= new_dests= 2024-09-12T17:43:09.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.223+0000 7f4d55f28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): potential dests added=[] removed=[] 2024-09-12T17:43:09.225 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4d55f28800 time 2024-09-12T17:43:09.225027+0000 2024-09-12T17:43:09.226 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:43:09.248 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:09.248 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4d5778c71a] 2024-09-12T17:43:09.248 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4d5778c8d8] 2024-09-12T17:43:09.248 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558d6214d841] 2024-09-12T17:43:09.249 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd7489e) [0x558d6265b89e] 2024-09-12T17:43:09.249 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558d6215d50d] 2024-09-12T17:43:09.249 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:43:09.249 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4d56429590] 2024-09-12T17:43:09.249 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:43:09.249 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:43:09.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.224+0000 7f4d55f28800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4d55f28800 time 2024-09-12T17:43:09.225027+0000 2024-09-12T17:43:09.249 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:43:09.249 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.249 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:09.249 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4d5778c71a] 2024-09-12T17:43:09.249 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4d5778c8d8] 2024-09-12T17:43:09.250 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558d6214d841] 2024-09-12T17:43:09.250 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd7489e) [0x558d6265b89e] 2024-09-12T17:43:09.250 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558d6215d50d] 2024-09-12T17:43:09.250 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:43:09.250 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4d56429590] 2024-09-12T17:43:09.250 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:43:09.250 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:43:09.250 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.250 INFO:tasks.workunit.client.0.smithi044.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:43:09.250 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f4d55f28800 thread_name:radosgw-admin 2024-09-12T17:43:09.250 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:09.250 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4d5643e6f0] 2024-09-12T17:43:09.250 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4d5648b99c] 2024-09-12T17:43:09.250 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:43:09.251 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:43:09.251 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4d5778c774] 2024-09-12T17:43:09.251 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4d5778c8d8] 2024-09-12T17:43:09.251 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558d6214d841] 2024-09-12T17:43:09.251 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd7489e) [0x558d6265b89e] 2024-09-12T17:43:09.251 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558d6215d50d] 2024-09-12T17:43:09.251 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:43:09.251 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4d56429590] 2024-09-12T17:43:09.251 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:43:09.251 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:43:09.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.225+0000 7f4d55f28800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:43:09.251 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f4d55f28800 thread_name:radosgw-admin 2024-09-12T17:43:09.251 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.251 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:09.252 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4d5643e6f0] 2024-09-12T17:43:09.252 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4d5648b99c] 2024-09-12T17:43:09.252 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:43:09.252 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:43:09.252 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4d5778c774] 2024-09-12T17:43:09.252 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4d5778c8d8] 2024-09-12T17:43:09.252 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558d6214d841] 2024-09-12T17:43:09.252 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd7489e) [0x558d6265b89e] 2024-09-12T17:43:09.252 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558d6215d50d] 2024-09-12T17:43:09.252 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:43:09.252 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4d56429590] 2024-09-12T17:43:09.252 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:43:09.252 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:43:09.253 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:43:09.253 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.253 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:43:09.253 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:43:09.171+0000 7f4d55f28800 10 monclient: get_monmap_and_config success 2024-09-12T17:43:09.253 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:43:09.171+0000 7f4d55f28800 4 set_mon_vals no callback set 2024-09-12T17:43:09.253 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:43:09.172+0000 7f4d55f28800 10 monclient: shutdown 2024-09-12T17:43:09.253 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 asok(0x558d636df730) unregister_commands rotate-key 2024-09-12T17:43:09.253 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:43:09.172+0000 7f4d55f28800 10 monclient: build_initial_monmap 2024-09-12T17:43:09.253 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:43:09.172+0000 7f4d55f28800 1 build_initial for_mkfs: 0 2024-09-12T17:43:09.253 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:43:09.172+0000 7f4d55f28800 10 monclient: monmap: 2024-09-12T17:43:09.253 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:43:09.253 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:09.253 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:43:09.253 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:43:09.254 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:09.254 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.254 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:43:09.254 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:43:09.254 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:43:09.254 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.254 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding auth protocol: cephx 2024-09-12T17:43:09.254 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding auth protocol: cephx 2024-09-12T17:43:09.254 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding auth protocol: cephx 2024-09-12T17:43:09.254 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: secure 2024-09-12T17:43:09.254 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: crc 2024-09-12T17:43:09.254 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: secure 2024-09-12T17:43:09.254 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: crc 2024-09-12T17:43:09.255 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: secure 2024-09-12T17:43:09.255 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: crc 2024-09-12T17:43:09.255 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: crc 2024-09-12T17:43:09.255 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: secure 2024-09-12T17:43:09.255 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: crc 2024-09-12T17:43:09.255 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: secure 2024-09-12T17:43:09.255 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: crc 2024-09-12T17:43:09.255 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: secure 2024-09-12T17:43:09.255 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:43:09.172+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.255 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:43:09.172+0000 7f4d55f28800 1 librados: starting msgr at 2024-09-12T17:43:09.255 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:43:09.172+0000 7f4d55f28800 1 librados: starting objecter 2024-09-12T17:43:09.255 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 asok(0x558d636df730) register_command objecter_requests hook 0x558d63908c40 2024-09-12T17:43:09.255 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:43:09.172+0000 7f4d55f28800 1 librados: setting wanted keys 2024-09-12T17:43:09.255 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:43:09.172+0000 7f4d55f28800 1 librados: calling monclient init 2024-09-12T17:43:09.256 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:43:09.172+0000 7f4d55f28800 10 monclient: init 2024-09-12T17:43:09.256 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding auth protocol: cephx 2024-09-12T17:43:09.256 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding auth protocol: cephx 2024-09-12T17:43:09.256 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding auth protocol: cephx 2024-09-12T17:43:09.256 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: secure 2024-09-12T17:43:09.256 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: crc 2024-09-12T17:43:09.256 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: secure 2024-09-12T17:43:09.256 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: crc 2024-09-12T17:43:09.256 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: secure 2024-09-12T17:43:09.256 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: crc 2024-09-12T17:43:09.256 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: crc 2024-09-12T17:43:09.256 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: secure 2024-09-12T17:43:09.256 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: crc 2024-09-12T17:43:09.257 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: secure 2024-09-12T17:43:09.257 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: crc 2024-09-12T17:43:09.257 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: secure 2024-09-12T17:43:09.257 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:43:09.172+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.257 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:43:09.173+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.257 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:43:09.173+0000 7f4d55f28800 5 asok(0x558d636df730) register_command rotate-key hook 0x558d63901c28 2024-09-12T17:43:09.257 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:09.257 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:43:09.257 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-c con 0x558d6378b110 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:43:09.257 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-a con 0x558d63844890 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:43:09.257 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-b con 0x558d6384fef0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:43:09.257 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.257 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.258 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.258 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:09.258 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient(hunting): authenticate will time out at 1961.810193s 2024-09-12T17:43:09.258 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:43:09.173+0000 7f4d5146e640 10 monclient(hunting): get_auth_request con 0x558d63844890 auth_method 0 2024-09-12T17:43:09.258 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:43:09.173+0000 7f4d5146e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.258 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:43:09.173+0000 7f4d5146e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.258 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:43:09.173+0000 7f4d5146e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.258 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient(hunting): get_auth_request con 0x558d6378b110 auth_method 0 2024-09-12T17:43:09.258 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.258 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.258 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.258 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:43:09.173+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.258 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:43:09.173+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.259 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:43:09.173+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.259 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.259 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.259 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.259 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_done global_id 6521 payload 824 2024-09-12T17:43:09.259 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient: _finish_hunting 0 2024-09-12T17:43:09.259 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 1 monclient: found mon.noname-c 2024-09-12T17:43:09.259 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:43:09.259 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:09.259 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:43:09.259 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: dump: 2024-09-12T17:43:09.259 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:09.259 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:09.260 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.260 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.260 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:09.260 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.260 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:09.260 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:09.260 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:09.260 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.260 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: _finish_auth 0 2024-09-12T17:43:09.260 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: _check_auth_tickets 2024-09-12T17:43:09.260 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:09.260 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:09.260 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:43:09.260 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: dump: 2024-09-12T17:43:09.261 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:09.261 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:09.261 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.261 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.261 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:09.261 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.261 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:09.261 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:09.261 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:09.261 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.261 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:43:09.173+0000 7f4d55f28800 5 monclient: authenticate success, global_id 6521 2024-09-12T17:43:09.261 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient: _renew_subs 2024-09-12T17:43:09.261 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:43:09.173+0000 7f4c3fe07640 4 set_mon_vals no callback set 2024-09-12T17:43:09.262 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:09.262 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient: _renew_subs 2024-09-12T17:43:09.262 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:09.262 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:43:09.174+0000 7f4d55f28800 1 librados: init done 2024-09-12T17:43:09.262 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:43:09.175+0000 7f4c3e604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:09.262 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:43:09.175+0000 7f4c3e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:09.262 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:43:09.175+0000 7f4c3e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:09.262 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:43:09.176+0000 7f4d5146e640 10 monclient: get_auth_request con 0x7f4c380764a0 auth_method 0 2024-09-12T17:43:09.262 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:43:09.176+0000 7f4d52470640 10 monclient: get_auth_request con 0x558d639287f0 auth_method 0 2024-09-12T17:43:09.262 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:43:09.177+0000 7f4d51c6f640 10 monclient: get_auth_request con 0x558d6394cbf0 auth_method 0 2024-09-12T17:43:09.262 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:43:09.178+0000 7f4d5146e640 10 monclient: get_auth_request con 0x558d63952160 auth_method 0 2024-09-12T17:43:09.262 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:43:09.179+0000 7f4d55f28800 10 monclient: build_initial_monmap 2024-09-12T17:43:09.262 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:43:09.179+0000 7f4d55f28800 1 build_initial for_mkfs: 0 2024-09-12T17:43:09.263 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:43:09.179+0000 7f4d55f28800 10 monclient: monmap: 2024-09-12T17:43:09.263 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:43:09.263 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:09.263 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:43:09.263 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:43:09.263 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:09.263 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.263 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:43:09.263 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:43:09.263 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:43:09.263 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.264 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding auth protocol: cephx 2024-09-12T17:43:09.264 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding auth protocol: cephx 2024-09-12T17:43:09.264 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding auth protocol: cephx 2024-09-12T17:43:09.264 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: secure 2024-09-12T17:43:09.264 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: crc 2024-09-12T17:43:09.264 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: secure 2024-09-12T17:43:09.264 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: crc 2024-09-12T17:43:09.264 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: secure 2024-09-12T17:43:09.264 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: crc 2024-09-12T17:43:09.264 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: crc 2024-09-12T17:43:09.264 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: secure 2024-09-12T17:43:09.264 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: crc 2024-09-12T17:43:09.264 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: secure 2024-09-12T17:43:09.265 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: crc 2024-09-12T17:43:09.265 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: secure 2024-09-12T17:43:09.265 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:43:09.179+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.265 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 asok(0x558d636df730) register_command objecter_requests cmddesc objecter_requests hook 0x558d639599d0 EEXIST 2024-09-12T17:43:09.265 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:43:09.179+0000 7f4d55f28800 10 monclient: init 2024-09-12T17:43:09.265 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding auth protocol: cephx 2024-09-12T17:43:09.265 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding auth protocol: cephx 2024-09-12T17:43:09.265 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding auth protocol: cephx 2024-09-12T17:43:09.265 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: secure 2024-09-12T17:43:09.265 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: crc 2024-09-12T17:43:09.265 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: secure 2024-09-12T17:43:09.265 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: crc 2024-09-12T17:43:09.265 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: secure 2024-09-12T17:43:09.265 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: crc 2024-09-12T17:43:09.266 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: crc 2024-09-12T17:43:09.266 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: secure 2024-09-12T17:43:09.266 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: crc 2024-09-12T17:43:09.266 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: secure 2024-09-12T17:43:09.266 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: crc 2024-09-12T17:43:09.266 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: secure 2024-09-12T17:43:09.266 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:43:09.180+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.266 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:43:09.180+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.266 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:43:09.180+0000 7f4d55f28800 5 asok(0x558d636df730) register_command rotate-key cmddesc rotate-key hook 0x558d639550e0 EEXIST 2024-09-12T17:43:09.266 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:09.266 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:43:09.266 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-c con 0x558d6397d6c0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:43:09.266 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-b con 0x558d6397f990 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:43:09.267 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-a con 0x558d6397be90 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:43:09.267 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.267 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.267 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.267 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:09.267 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient(hunting): authenticate will time out at 1961.817350s 2024-09-12T17:43:09.267 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient(hunting): get_auth_request con 0x558d6397d6c0 auth_method 0 2024-09-12T17:43:09.267 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.267 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.267 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.267 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:43:09.180+0000 7f4d52470640 10 monclient(hunting): get_auth_request con 0x558d6397be90 auth_method 0 2024-09-12T17:43:09.267 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:43:09.180+0000 7f4d52470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.267 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:43:09.180+0000 7f4d52470640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.268 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:43:09.180+0000 7f4d52470640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.268 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.268 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.268 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.268 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:43:09.180+0000 7f4d5146e640 10 monclient(hunting): get_auth_request con 0x558d6397f990 auth_method 0 2024-09-12T17:43:09.268 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:43:09.180+0000 7f4d5146e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.268 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:43:09.180+0000 7f4d5146e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.268 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:43:09.180+0000 7f4d5146e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.268 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:43:09.180+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.268 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:43:09.180+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.268 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:43:09.180+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.268 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:43:09.180+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.269 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:43:09.180+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.269 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:43:09.180+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.269 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_done global_id 6524 payload 824 2024-09-12T17:43:09.269 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient: _finish_hunting 0 2024-09-12T17:43:09.269 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 1 monclient: found mon.noname-c 2024-09-12T17:43:09.269 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:43:09.269 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:43:09.180+0000 7f4c377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:09.269 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:43:09.180+0000 7f4c377fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:43:09.270 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:43:09.180+0000 7f4c377fe640 10 monclient: dump: 2024-09-12T17:43:09.270 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:09.270 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:09.270 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.270 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.270 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:09.271 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.271 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:09.271 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:09.271 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:09.271 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.271 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:43:09.180+0000 7f4c377fe640 10 monclient: _finish_auth 0 2024-09-12T17:43:09.271 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:43:09.180+0000 7f4c377fe640 10 monclient: _check_auth_tickets 2024-09-12T17:43:09.271 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:43:09.181+0000 7f4d55f28800 5 monclient: authenticate success, global_id 6524 2024-09-12T17:43:09.271 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:43:09.181+0000 7f4c377fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:09.271 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:43:09.181+0000 7f4c377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:09.271 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:43:09.181+0000 7f4c377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:43:09.271 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:43:09.181+0000 7f4c377fe640 10 monclient: dump: 2024-09-12T17:43:09.272 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:09.272 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:09.272 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.272 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.272 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:09.273 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.273 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:09.273 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:09.273 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:09.273 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.273 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:43:09.181+0000 7f4d55f28800 10 monclient: _renew_subs 2024-09-12T17:43:09.273 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:43:09.181+0000 7f4d55f28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:09.274 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:43:09.181+0000 7f4d52c71640 4 set_mon_vals no callback set 2024-09-12T17:43:09.274 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:43:09.181+0000 7f4d55f28800 10 monclient: _renew_subs 2024-09-12T17:43:09.274 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:43:09.181+0000 7f4d55f28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:09.274 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:43:09.182+0000 7f4c377fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:09.274 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:43:09.182+0000 7f4c377fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:09.274 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:43:09.182+0000 7f4c377fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:09.274 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:43:09.182+0000 7f4d5146e640 10 monclient: get_auth_request con 0x7f4c2c076380 auth_method 0 2024-09-12T17:43:09.274 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:43:09.183+0000 7f4d55f28800 10 monclient: get_monmap_and_config 2024-09-12T17:43:09.274 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:43:09.183+0000 7f4d55f28800 10 monclient: build_initial_monmap 2024-09-12T17:43:09.274 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:43:09.183+0000 7f4d55f28800 1 build_initial for_mkfs: 0 2024-09-12T17:43:09.274 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:43:09.183+0000 7f4d55f28800 10 monclient: monmap: 2024-09-12T17:43:09.274 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:43:09.274 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:09.275 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:43:09.275 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:43:09.275 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:09.275 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.275 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:43:09.275 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:43:09.275 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:43:09.275 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.275 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding auth protocol: cephx 2024-09-12T17:43:09.275 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding auth protocol: cephx 2024-09-12T17:43:09.275 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding auth protocol: cephx 2024-09-12T17:43:09.275 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: secure 2024-09-12T17:43:09.275 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: crc 2024-09-12T17:43:09.275 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: secure 2024-09-12T17:43:09.276 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: crc 2024-09-12T17:43:09.276 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: secure 2024-09-12T17:43:09.276 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: crc 2024-09-12T17:43:09.276 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: crc 2024-09-12T17:43:09.276 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: secure 2024-09-12T17:43:09.276 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: crc 2024-09-12T17:43:09.276 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: secure 2024-09-12T17:43:09.276 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: crc 2024-09-12T17:43:09.276 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: secure 2024-09-12T17:43:09.277 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:43:09.183+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.277 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:43:09.183+0000 7f4d55f28800 10 monclient: init 2024-09-12T17:43:09.277 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding auth protocol: cephx 2024-09-12T17:43:09.277 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding auth protocol: cephx 2024-09-12T17:43:09.277 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding auth protocol: cephx 2024-09-12T17:43:09.277 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: secure 2024-09-12T17:43:09.277 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: crc 2024-09-12T17:43:09.277 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: secure 2024-09-12T17:43:09.277 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: crc 2024-09-12T17:43:09.277 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: secure 2024-09-12T17:43:09.277 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: crc 2024-09-12T17:43:09.277 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: crc 2024-09-12T17:43:09.277 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: secure 2024-09-12T17:43:09.277 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: crc 2024-09-12T17:43:09.278 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: secure 2024-09-12T17:43:09.278 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: crc 2024-09-12T17:43:09.278 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: secure 2024-09-12T17:43:09.278 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:43:09.183+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.278 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:43:09.183+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.278 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:43:09.184+0000 7f4d55f28800 5 asok(0x558d636df730) register_command rotate-key cmddesc rotate-key hook 0x7ffeb2852f58 EEXIST 2024-09-12T17:43:09.278 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:09.278 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:43:09.278 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-a con 0x558d639d16d0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:43:09.278 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-c con 0x558d639cbc70 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:43:09.278 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-b con 0x558d639a1510 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:43:09.278 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.279 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.279 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.279 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:09.279 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient(hunting): authenticate will time out at 1961.821108s 2024-09-12T17:43:09.279 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient(hunting): get_auth_request con 0x558d639cbc70 auth_method 0 2024-09-12T17:43:09.279 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.279 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.279 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.279 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:43:09.184+0000 7f4d51c6f640 10 monclient(hunting): get_auth_request con 0x558d639d16d0 auth_method 0 2024-09-12T17:43:09.279 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:43:09.184+0000 7f4d51c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.279 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:43:09.184+0000 7f4d51c6f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.279 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:43:09.184+0000 7f4d51c6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.279 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:43:09.184+0000 7f4d52470640 10 monclient(hunting): get_auth_request con 0x558d639a1510 auth_method 0 2024-09-12T17:43:09.279 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:43:09.184+0000 7f4d52470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.280 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:43:09.184+0000 7f4d52470640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.280 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:43:09.184+0000 7f4d52470640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.280 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.280 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.280 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.280 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:43:09.184+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.280 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:43:09.184+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.280 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:43:09.184+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.280 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:43:09.184+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.280 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:43:09.184+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.280 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:43:09.184+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.280 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient(hunting): handle_auth_done global_id 6527 payload 274 2024-09-12T17:43:09.280 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient: _finish_hunting 0 2024-09-12T17:43:09.281 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:43:09.184+0000 7f4d5146e640 1 monclient: found mon.noname-c 2024-09-12T17:43:09.281 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:43:09.281 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:09.281 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:43:09.281 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: dump: 2024-09-12T17:43:09.281 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:09.281 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:09.281 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.281 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.281 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:09.281 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.281 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:09.281 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:09.281 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:09.282 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.282 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: _finish_auth 0 2024-09-12T17:43:09.282 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: _check_auth_tickets 2024-09-12T17:43:09.282 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:09.282 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:43:09.184+0000 7f4d55f28800 5 monclient: authenticate success, global_id 6527 2024-09-12T17:43:09.282 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient: get_monmap_and_config success 2024-09-12T17:43:09.282 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:43:09.184+0000 7f4d55f28800 4 set_mon_vals no callback set 2024-09-12T17:43:09.282 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:09.282 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:43:09.282 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: dump: 2024-09-12T17:43:09.282 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:09.282 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:09.282 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.282 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.283 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:09.283 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.283 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:09.283 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:09.283 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:09.283 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.283 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:43:09.185+0000 7f4d55f28800 10 monclient: shutdown 2024-09-12T17:43:09.283 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:43:09.185+0000 7f4d55f28800 10 monclient: build_initial_monmap 2024-09-12T17:43:09.283 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:43:09.185+0000 7f4d55f28800 1 build_initial for_mkfs: 0 2024-09-12T17:43:09.283 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:43:09.185+0000 7f4d55f28800 10 monclient: monmap: 2024-09-12T17:43:09.283 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:43:09.283 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:09.283 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:43:09.284 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:43:09.284 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:09.284 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.284 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:43:09.284 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:43:09.284 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:43:09.284 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.284 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding auth protocol: cephx 2024-09-12T17:43:09.284 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding auth protocol: cephx 2024-09-12T17:43:09.284 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding auth protocol: cephx 2024-09-12T17:43:09.284 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: secure 2024-09-12T17:43:09.284 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: crc 2024-09-12T17:43:09.284 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: secure 2024-09-12T17:43:09.285 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: crc 2024-09-12T17:43:09.285 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: secure 2024-09-12T17:43:09.285 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: crc 2024-09-12T17:43:09.285 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: crc 2024-09-12T17:43:09.285 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: secure 2024-09-12T17:43:09.285 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: crc 2024-09-12T17:43:09.285 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: secure 2024-09-12T17:43:09.285 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: crc 2024-09-12T17:43:09.285 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: secure 2024-09-12T17:43:09.285 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:43:09.185+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.285 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:43:09.185+0000 7f4d55f28800 1 librados: starting msgr at 2024-09-12T17:43:09.285 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:43:09.185+0000 7f4d55f28800 1 librados: starting objecter 2024-09-12T17:43:09.286 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 asok(0x558d636df730) register_command objecter_requests cmddesc objecter_requests hook 0x558d639836d0 EEXIST 2024-09-12T17:43:09.286 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:43:09.185+0000 7f4d55f28800 1 librados: setting wanted keys 2024-09-12T17:43:09.286 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:43:09.185+0000 7f4d55f28800 1 librados: calling monclient init 2024-09-12T17:43:09.286 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:43:09.185+0000 7f4d55f28800 10 monclient: init 2024-09-12T17:43:09.286 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding auth protocol: cephx 2024-09-12T17:43:09.286 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding auth protocol: cephx 2024-09-12T17:43:09.286 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding auth protocol: cephx 2024-09-12T17:43:09.286 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: secure 2024-09-12T17:43:09.286 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: crc 2024-09-12T17:43:09.286 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: secure 2024-09-12T17:43:09.286 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: crc 2024-09-12T17:43:09.286 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: secure 2024-09-12T17:43:09.286 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: crc 2024-09-12T17:43:09.286 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: crc 2024-09-12T17:43:09.287 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: secure 2024-09-12T17:43:09.287 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: crc 2024-09-12T17:43:09.287 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: secure 2024-09-12T17:43:09.287 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: crc 2024-09-12T17:43:09.287 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: secure 2024-09-12T17:43:09.287 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:43:09.186+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.287 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:43:09.186+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.287 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:43:09.186+0000 7f4d55f28800 5 asok(0x558d636df730) register_command rotate-key cmddesc rotate-key hook 0x558d639955b8 EEXIST 2024-09-12T17:43:09.287 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:09.287 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:43:09.287 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-b con 0x558d639a1510 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:43:09.287 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-c con 0x558d639cbc70 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:43:09.287 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-a con 0x558d639d16d0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:43:09.288 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.288 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.288 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.288 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:09.288 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient(hunting): authenticate will time out at 1961.823407s 2024-09-12T17:43:09.288 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient(hunting): get_auth_request con 0x558d639d16d0 auth_method 0 2024-09-12T17:43:09.288 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.288 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.288 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.288 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:43:09.186+0000 7f4d5146e640 10 monclient(hunting): get_auth_request con 0x558d639cbc70 auth_method 0 2024-09-12T17:43:09.288 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:43:09.186+0000 7f4d5146e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.288 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:43:09.186+0000 7f4d5146e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.288 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:43:09.186+0000 7f4d5146e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.289 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:43:09.186+0000 7f4d51c6f640 10 monclient(hunting): get_auth_request con 0x558d639a1510 auth_method 0 2024-09-12T17:43:09.289 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:43:09.186+0000 7f4d51c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.289 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:43:09.186+0000 7f4d51c6f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.289 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:43:09.186+0000 7f4d51c6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.289 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.289 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.289 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.289 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:43:09.186+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.289 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:43:09.186+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.289 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:43:09.186+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.289 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:43:09.186+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.289 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:43:09.186+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.289 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:43:09.186+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.290 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient(hunting): handle_auth_done global_id 6981 payload 824 2024-09-12T17:43:09.290 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient: _finish_hunting 0 2024-09-12T17:43:09.290 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:43:09.186+0000 7f4d52470640 1 monclient: found mon.noname-a 2024-09-12T17:43:09.290 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:43:09.290 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:09.290 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:43:09.290 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: dump: 2024-09-12T17:43:09.290 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:09.290 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:09.290 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.290 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.290 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:09.290 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.291 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:09.291 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:09.291 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:09.291 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.291 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: _finish_auth 0 2024-09-12T17:43:09.291 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: _check_auth_tickets 2024-09-12T17:43:09.291 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:09.291 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:09.291 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:43:09.291 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: dump: 2024-09-12T17:43:09.291 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:09.291 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:09.291 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.291 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.292 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:09.292 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.292 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:09.292 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:09.292 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:09.292 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.292 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:43:09.187+0000 7f4d55f28800 5 monclient: authenticate success, global_id 6981 2024-09-12T17:43:09.292 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:43:09.187+0000 7f4d55f28800 10 monclient: _renew_subs 2024-09-12T17:43:09.292 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:43:09.187+0000 7f4d55f28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:43:09.292 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:43:09.187+0000 7f4c357fa640 4 set_mon_vals no callback set 2024-09-12T17:43:09.292 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:43:09.187+0000 7f4d55f28800 10 monclient: _renew_subs 2024-09-12T17:43:09.292 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:43:09.187+0000 7f4d55f28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:43:09.292 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:43:09.187+0000 7f4d55f28800 1 librados: init done 2024-09-12T17:43:09.293 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:43:09.187+0000 7f4d55f28800 5 asok(0x558d636df730) register_command cr dump hook 0x558d639cad28 2024-09-12T17:43:09.293 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:43:09.188+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.293 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:43:09.189+0000 7f4c237fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:09.293 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:43:09.189+0000 7f4c237fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:09.293 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:43:09.189+0000 7f4c237fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:09.293 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:43:09.189+0000 7f4d51c6f640 10 monclient: get_auth_request con 0x7f4c1c076470 auth_method 0 2024-09-12T17:43:09.293 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:43:09.189+0000 7f4d5146e640 10 monclient: get_auth_request con 0x558d639ebaf0 auth_method 0 2024-09-12T17:43:09.293 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.293 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:43:09.190+0000 7f4d55f28800 20 realm 2024-09-12T17:43:09.293 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.293 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.293 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:43:09.190+0000 7f4d55f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:09.293 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.293 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.294 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.294 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:43:09.191+0000 7f4d51c6f640 10 monclient: get_auth_request con 0x558d639efcf0 auth_method 0 2024-09-12T17:43:09.294 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:43:09.191+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.294 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:43:09.191+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.294 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:43:09.191+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:09.294 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:43:09.191+0000 7f4d55f28800 20 searching for the correct realm 2024-09-12T17:43:09.294 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:43:09.192+0000 7f4d5146e640 10 monclient: get_auth_request con 0x558d639f4f60 auth_method 0 2024-09-12T17:43:09.294 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:43:09.192+0000 7f4d52470640 10 monclient: get_auth_request con 0x7f4d4804d040 auth_method 0 2024-09-12T17:43:09.294 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:43:09.193+0000 7f4d51c6f640 10 monclient: get_auth_request con 0x7f4d4c065590 auth_method 0 2024-09-12T17:43:09.294 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:43:09.194+0000 7f4d5146e640 10 monclient: get_auth_request con 0x7f4d440dc040 auth_method 0 2024-09-12T17:43:09.294 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:43:09.195+0000 7f4d5146e640 0 -- 172.21.15.44:0/112386571 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x558d639ebaf0 msgr2=0x558d639edf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:09.294 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:43:09.195+0000 7f4c237fe640 1 client.6981.objecter ms_handle_reset 0x558d639ebaf0 session 0x558d639eb420 osd.1 2024-09-12T17:43:09.294 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:43:09.195+0000 7f4c237fe640 10 monclient: _renew_subs 2024-09-12T17:43:09.295 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:43:09.195+0000 7f4c237fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:43:09.295 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:43:09.195+0000 7f4d5146e640 10 monclient: get_auth_request con 0x7f4c1c086290 auth_method 0 2024-09-12T17:43:09.295 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:43:09.196+0000 7f4d52470640 10 monclient: get_auth_request con 0x7f4d4805d040 auth_method 0 2024-09-12T17:43:09.295 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:43:09.198+0000 7f4d51c6f640 10 monclient: get_auth_request con 0x7f4d48036070 auth_method 0 2024-09-12T17:43:09.295 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:43:09.198+0000 7f4d5146e640 0 -- 172.21.15.44:0/112386571 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f4d440dc040 msgr2=0x7f4d440e3ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:09.295 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:43:09.199+0000 7f4c237fe640 1 client.6981.objecter ms_handle_reset 0x7f4d440dc040 session 0x7f4d440e2040 osd.4 2024-09-12T17:43:09.295 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:43:09.199+0000 7f4d5146e640 10 monclient: get_auth_request con 0x558d639ebaf0 auth_method 0 2024-09-12T17:43:09.295 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:09.295 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:09.295 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:09.295 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:09.295 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:09.295 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:09.295 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:43:09.202+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.296 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.296 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.296 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.296 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.296 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:09.296 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:43:09.203+0000 7f4d55f28800 20 zone default found 2024-09-12T17:43:09.296 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:43:09.203+0000 7f4d55f28800 4 Realm: () 2024-09-12T17:43:09.296 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:43:09.203+0000 7f4d55f28800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:09.296 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:43:09.203+0000 7f4d55f28800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:09.296 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:43:09.203+0000 7f4d55f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:09.296 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:43:09.203+0000 7f4d55f28800 20 zonegroup default 2024-09-12T17:43:09.296 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.296 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:43:09.204+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.296 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:43:09.204+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.297 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:43:09.204+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.297 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:43:09.204+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.297 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:43:09.204+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.297 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:43:09.204+0000 7f4d55f28800 20 started sync module instance, tier type = 2024-09-12T17:43:09.297 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:43:09.204+0000 7f4d55f28800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:09.297 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=0 2024-09-12T17:43:09.297 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=1 2024-09-12T17:43:09.297 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=2 2024-09-12T17:43:09.297 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=3 2024-09-12T17:43:09.297 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=4 2024-09-12T17:43:09.297 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=5 2024-09-12T17:43:09.297 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=6 2024-09-12T17:43:09.297 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:43:09.214+0000 7f4d55f28800 20 add_watcher() i=7 2024-09-12T17:43:09.297 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:43:09.214+0000 7f4d55f28800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:09.298 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding auth protocol: cephx 2024-09-12T17:43:09.298 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding auth protocol: cephx 2024-09-12T17:43:09.298 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding auth protocol: cephx 2024-09-12T17:43:09.298 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: secure 2024-09-12T17:43:09.298 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: crc 2024-09-12T17:43:09.298 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: secure 2024-09-12T17:43:09.298 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: crc 2024-09-12T17:43:09.298 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: secure 2024-09-12T17:43:09.298 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: crc 2024-09-12T17:43:09.298 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: crc 2024-09-12T17:43:09.298 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: secure 2024-09-12T17:43:09.298 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: crc 2024-09-12T17:43:09.298 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: secure 2024-09-12T17:43:09.299 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: crc 2024-09-12T17:43:09.299 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: secure 2024-09-12T17:43:09.299 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:43:09.216+0000 7f4c07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.299 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:43:09.216+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.299 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:43:09.216+0000 7f4d55f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:09.299 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:43:09.216+0000 7f4d55f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:09.299 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 asok(0x558d636df730) register_command cache list hook 0x558d639c8000 2024-09-12T17:43:09.299 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 asok(0x558d636df730) register_command cache inspect hook 0x558d639c8000 2024-09-12T17:43:09.299 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 asok(0x558d636df730) register_command cache erase hook 0x558d639c8000 2024-09-12T17:43:09.299 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 asok(0x558d636df730) register_command cache zap hook 0x558d639c8000 2024-09-12T17:43:09.299 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 note: GC not initialized 2024-09-12T17:43:09.299 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:43:09.216+0000 7f4c06fe5640 20 reqs_thread_entry: start 2024-09-12T17:43:09.299 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 asok(0x558d636df730) register_command sync trace show hook 0x7f4d4802c050 2024-09-12T17:43:09.300 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 asok(0x558d636df730) register_command sync trace history hook 0x7f4d4802c050 2024-09-12T17:43:09.300 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 asok(0x558d636df730) register_command sync trace active hook 0x7f4d4802c050 2024-09-12T17:43:09.300 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 asok(0x558d636df730) register_command sync trace active_short hook 0x7f4d4802c050 2024-09-12T17:43:09.300 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:43:09.216+0000 7f4d55f28800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:09.300 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:43:09.217+0000 7f4d55f28800 20 Filter name: none 2024-09-12T17:43:09.300 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:43:09.217+0000 7f4c04fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:09.300 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:43:09.217+0000 7f4d55f28800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:43:09.300 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:43:09.217+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.300 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:43:09.217+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:09.300 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:43:09.217+0000 7f4d55f28800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:43:09.300 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:43:09.217+0000 7f4d55f28800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:43:09.300 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:43:09.217+0000 7f4d55f28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 : miss 2024-09-12T17:43:09.300 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:43:09.217+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.301 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:43:09.217+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:09.301 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:43:09.218+0000 7f4d55f28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:09.301 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:43:09.218+0000 7f4d55f28800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:09.301 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:43:09.218+0000 7f4d55f28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:09.301 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:43:09.218+0000 7f4d55f28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.301 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:43:09.218+0000 7f4d55f28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 2024-09-12T17:43:09.301 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:43:09.222+0000 7f4d55f28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:09.301 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:43:09.222+0000 7f4d55f28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:09.301 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:43:09.222+0000 7f4d55f28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.301 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:43:09.222+0000 7f4d55f28800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28, ofs0, ns] 2024-09-12T17:43:09.301 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:43:09.223+0000 7f4c357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562421 cookie 94065750161264 notifier 6981 bl.length()=1023 2024-09-12T17:43:09.301 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:43:09.223+0000 7f4c357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:09.301 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:43:09.223+0000 7f4c357fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:09.301 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:43:09.223+0000 7f4c357fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.302 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:43:09.223+0000 7f4d55f28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): orig_sources= new_sources= 2024-09-12T17:43:09.302 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:43:09.223+0000 7f4d55f28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): potential sources added=[] removed=[] 2024-09-12T17:43:09.302 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:43:09.223+0000 7f4d55f28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): orig_dests= new_dests= 2024-09-12T17:43:09.302 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:43:09.223+0000 7f4d55f28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): potential dests added=[] removed=[] 2024-09-12T17:43:09.302 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:43:09.224+0000 7f4d55f28800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4d55f28800 time 2024-09-12T17:43:09.225027+0000 2024-09-12T17:43:09.302 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:43:09.302 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.302 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:09.302 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4d5778c71a] 2024-09-12T17:43:09.302 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4d5778c8d8] 2024-09-12T17:43:09.302 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558d6214d841] 2024-09-12T17:43:09.302 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd7489e) [0x558d6265b89e] 2024-09-12T17:43:09.303 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558d6215d50d] 2024-09-12T17:43:09.303 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:43:09.303 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4d56429590] 2024-09-12T17:43:09.303 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:43:09.303 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:43:09.303 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.303 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:43:09.225+0000 7f4d55f28800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:43:09.303 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f4d55f28800 thread_name:radosgw-admin 2024-09-12T17:43:09.303 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.303 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:09.303 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4d5643e6f0] 2024-09-12T17:43:09.303 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4d5648b99c] 2024-09-12T17:43:09.303 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:43:09.303 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:43:09.304 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4d5778c774] 2024-09-12T17:43:09.304 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4d5778c8d8] 2024-09-12T17:43:09.304 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558d6214d841] 2024-09-12T17:43:09.304 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd7489e) [0x558d6265b89e] 2024-09-12T17:43:09.304 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558d6215d50d] 2024-09-12T17:43:09.304 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:43:09.304 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4d56429590] 2024-09-12T17:43:09.304 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:43:09.304 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:43:09.304 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:43:09.304 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.304 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:43:09.305 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:43:09.305 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:43:09.305 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:43:09.305 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:43:09.305 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:43:09.305 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:43:09.305 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:43:09.305 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:43:09.305 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:43:09.305 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:43:09.305 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:43:09.305 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:43:09.305 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:43:09.305 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:43:09.306 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:43:09.306 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:43:09.306 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:43:09.306 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:43:09.306 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:43:09.306 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:43:09.306 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:43:09.306 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:43:09.306 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:43:09.306 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:43:09.306 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:43:09.306 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:43:09.306 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:43:09.306 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:43:09.307 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:43:09.307 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:43:09.307 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:43:09.307 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:43:09.307 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:43:09.307 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:43:09.307 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:43:09.307 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:43:09.307 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:43:09.307 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:43:09.307 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:43:09.307 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:43:09.307 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:43:09.307 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:43:09.308 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:43:09.308 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:43:09.308 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:43:09.308 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:43:09.308 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:43:09.308 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:43:09.308 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:43:09.308 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:43:09.308 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:43:09.308 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:43:09.308 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:43:09.308 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:43:09.308 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:43:09.309 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:43:09.309 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:43:09.309 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:43:09.309 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:43:09.309 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:43:09.309 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:43:09.309 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:43:09.309 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:43:09.309 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:43:09.309 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:43:09.309 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:43:09.309 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:43:09.309 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:43:09.309 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:43:09.309 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:43:09.310 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:43:09.310 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:43:09.310 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:43:09.310 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:43:09.310 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:43:09.310 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:43:09.310 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:43:09.310 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:43:09.310 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:43:09.310 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:43:09.310 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:43:09.310 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:43:09.310 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:43:09.311 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:43:09.311 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:43:09.311 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:43:09.311 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:43:09.311 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:43:09.311 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:43:09.311 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:43:09.311 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:43:09.311 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:43:09.311 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:43:09.311 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4c04fe1640 / http_manager 2024-09-12T17:43:09.312 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4c06fe5640 / http_manager 2024-09-12T17:43:09.312 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4c07fe7640 / rgw_dt_lg_renew 2024-09-12T17:43:09.312 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4c237fe640 / ms_dispatch 2024-09-12T17:43:09.312 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4c357fa640 / io_context_pool 2024-09-12T17:43:09.312 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4c377fe640 / ms_dispatch 2024-09-12T17:43:09.312 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4c3e604640 / ms_dispatch 2024-09-12T17:43:09.312 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4c3fe07640 / io_context_pool 2024-09-12T17:43:09.312 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4d5146e640 / msgr-worker-2 2024-09-12T17:43:09.312 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4d51c6f640 / msgr-worker-1 2024-09-12T17:43:09.312 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4d52470640 / msgr-worker-0 2024-09-12T17:43:09.312 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4d52c71640 / io_context_pool 2024-09-12T17:43:09.312 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4d55f28800 / radosgw-admin 2024-09-12T17:43:09.312 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:43:09.312 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:43:09.313 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/log/ceph/ceph-client.admin.107943.log 2024-09-12T17:43:09.313 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:43:09.313 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:43:09.313 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:43:09.171+0000 7f4d55f28800 10 monclient: get_monmap_and_config success 2024-09-12T17:43:09.313 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:43:09.171+0000 7f4d55f28800 4 set_mon_vals no callback set 2024-09-12T17:43:09.313 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:43:09.172+0000 7f4d55f28800 10 monclient: shutdown 2024-09-12T17:43:09.313 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 asok(0x558d636df730) unregister_commands rotate-key 2024-09-12T17:43:09.313 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:43:09.172+0000 7f4d55f28800 10 monclient: build_initial_monmap 2024-09-12T17:43:09.313 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:43:09.172+0000 7f4d55f28800 1 build_initial for_mkfs: 0 2024-09-12T17:43:09.313 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:43:09.172+0000 7f4d55f28800 10 monclient: monmap: 2024-09-12T17:43:09.313 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:43:09.313 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:09.313 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:43:09.313 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:43:09.314 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:09.314 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.314 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:43:09.314 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:43:09.314 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:43:09.314 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.314 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding auth protocol: cephx 2024-09-12T17:43:09.314 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding auth protocol: cephx 2024-09-12T17:43:09.314 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding auth protocol: cephx 2024-09-12T17:43:09.314 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: secure 2024-09-12T17:43:09.314 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: crc 2024-09-12T17:43:09.314 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: secure 2024-09-12T17:43:09.314 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: crc 2024-09-12T17:43:09.315 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: secure 2024-09-12T17:43:09.315 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: crc 2024-09-12T17:43:09.315 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: crc 2024-09-12T17:43:09.315 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: secure 2024-09-12T17:43:09.315 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: crc 2024-09-12T17:43:09.315 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: secure 2024-09-12T17:43:09.315 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: crc 2024-09-12T17:43:09.315 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d639072f0) adding con mode: secure 2024-09-12T17:43:09.315 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:43:09.172+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.315 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:43:09.172+0000 7f4d55f28800 1 librados: starting msgr at 2024-09-12T17:43:09.315 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:43:09.172+0000 7f4d55f28800 1 librados: starting objecter 2024-09-12T17:43:09.315 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 asok(0x558d636df730) register_command objecter_requests hook 0x558d63908c40 2024-09-12T17:43:09.315 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:43:09.172+0000 7f4d55f28800 1 librados: setting wanted keys 2024-09-12T17:43:09.316 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:43:09.172+0000 7f4d55f28800 1 librados: calling monclient init 2024-09-12T17:43:09.316 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:43:09.172+0000 7f4d55f28800 10 monclient: init 2024-09-12T17:43:09.316 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding auth protocol: cephx 2024-09-12T17:43:09.316 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding auth protocol: cephx 2024-09-12T17:43:09.316 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding auth protocol: cephx 2024-09-12T17:43:09.316 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: secure 2024-09-12T17:43:09.316 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: crc 2024-09-12T17:43:09.316 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: secure 2024-09-12T17:43:09.316 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: crc 2024-09-12T17:43:09.316 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: secure 2024-09-12T17:43:09.316 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: crc 2024-09-12T17:43:09.316 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: crc 2024-09-12T17:43:09.316 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: secure 2024-09-12T17:43:09.317 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: crc 2024-09-12T17:43:09.317 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: secure 2024-09-12T17:43:09.317 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: crc 2024-09-12T17:43:09.317 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:43:09.172+0000 7f4d55f28800 5 AuthRegistry(0x558d63901ae0) adding con mode: secure 2024-09-12T17:43:09.317 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:43:09.172+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.317 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:43:09.173+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.317 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:43:09.173+0000 7f4d55f28800 5 asok(0x558d636df730) register_command rotate-key hook 0x558d63901c28 2024-09-12T17:43:09.317 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:09.317 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:43:09.317 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-c con 0x558d6378b110 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:43:09.317 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-a con 0x558d63844890 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:43:09.317 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-b con 0x558d6384fef0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:43:09.317 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.317 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.318 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.318 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:09.318 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient(hunting): authenticate will time out at 1961.810193s 2024-09-12T17:43:09.318 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:43:09.173+0000 7f4d5146e640 10 monclient(hunting): get_auth_request con 0x558d63844890 auth_method 0 2024-09-12T17:43:09.318 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:43:09.173+0000 7f4d5146e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.318 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:43:09.173+0000 7f4d5146e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.318 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:43:09.173+0000 7f4d5146e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.318 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient(hunting): get_auth_request con 0x558d6378b110 auth_method 0 2024-09-12T17:43:09.318 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.318 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.318 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.318 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:43:09.173+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.318 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:43:09.173+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.319 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:43:09.173+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.319 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.319 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.319 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.319 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_done global_id 6521 payload 824 2024-09-12T17:43:09.319 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient: _finish_hunting 0 2024-09-12T17:43:09.319 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 1 monclient: found mon.noname-c 2024-09-12T17:43:09.319 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:43:09.173+0000 7f4d51c6f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:43:09.319 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:09.319 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:43:09.319 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: dump: 2024-09-12T17:43:09.319 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:09.319 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:09.319 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.320 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.320 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:09.320 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.320 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:09.320 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:09.320 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:09.320 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.320 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: _finish_auth 0 2024-09-12T17:43:09.320 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: _check_auth_tickets 2024-09-12T17:43:09.320 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:09.320 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:09.320 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:43:09.320 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:43:09.173+0000 7f4c3e604640 10 monclient: dump: 2024-09-12T17:43:09.320 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:09.321 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:09.321 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.321 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.321 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:09.321 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.321 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:09.321 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:09.321 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:09.321 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.321 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:43:09.173+0000 7f4d55f28800 5 monclient: authenticate success, global_id 6521 2024-09-12T17:43:09.321 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient: _renew_subs 2024-09-12T17:43:09.321 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:43:09.173+0000 7f4c3fe07640 4 set_mon_vals no callback set 2024-09-12T17:43:09.321 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:09.321 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient: _renew_subs 2024-09-12T17:43:09.322 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:43:09.173+0000 7f4d55f28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:09.322 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:43:09.174+0000 7f4d55f28800 1 librados: init done 2024-09-12T17:43:09.322 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:43:09.175+0000 7f4c3e604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:09.322 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:43:09.175+0000 7f4c3e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:09.322 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:43:09.175+0000 7f4c3e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:09.322 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:43:09.176+0000 7f4d5146e640 10 monclient: get_auth_request con 0x7f4c380764a0 auth_method 0 2024-09-12T17:43:09.322 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:43:09.176+0000 7f4d52470640 10 monclient: get_auth_request con 0x558d639287f0 auth_method 0 2024-09-12T17:43:09.322 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:43:09.177+0000 7f4d51c6f640 10 monclient: get_auth_request con 0x558d6394cbf0 auth_method 0 2024-09-12T17:43:09.322 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:43:09.178+0000 7f4d5146e640 10 monclient: get_auth_request con 0x558d63952160 auth_method 0 2024-09-12T17:43:09.322 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:43:09.179+0000 7f4d55f28800 10 monclient: build_initial_monmap 2024-09-12T17:43:09.322 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:43:09.179+0000 7f4d55f28800 1 build_initial for_mkfs: 0 2024-09-12T17:43:09.323 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:43:09.179+0000 7f4d55f28800 10 monclient: monmap: 2024-09-12T17:43:09.323 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:43:09.323 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:09.323 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:43:09.323 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:43:09.323 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:09.323 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.323 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:43:09.323 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:43:09.323 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:43:09.323 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.323 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding auth protocol: cephx 2024-09-12T17:43:09.323 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding auth protocol: cephx 2024-09-12T17:43:09.324 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding auth protocol: cephx 2024-09-12T17:43:09.324 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: secure 2024-09-12T17:43:09.324 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: crc 2024-09-12T17:43:09.324 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: secure 2024-09-12T17:43:09.324 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: crc 2024-09-12T17:43:09.324 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: secure 2024-09-12T17:43:09.324 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: crc 2024-09-12T17:43:09.324 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: crc 2024-09-12T17:43:09.324 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: secure 2024-09-12T17:43:09.324 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: crc 2024-09-12T17:43:09.324 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: secure 2024-09-12T17:43:09.324 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: crc 2024-09-12T17:43:09.324 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63955fe0) adding con mode: secure 2024-09-12T17:43:09.325 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:43:09.179+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.325 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 asok(0x558d636df730) register_command objecter_requests cmddesc objecter_requests hook 0x558d639599d0 EEXIST 2024-09-12T17:43:09.325 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:43:09.179+0000 7f4d55f28800 10 monclient: init 2024-09-12T17:43:09.325 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding auth protocol: cephx 2024-09-12T17:43:09.325 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding auth protocol: cephx 2024-09-12T17:43:09.325 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding auth protocol: cephx 2024-09-12T17:43:09.325 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: secure 2024-09-12T17:43:09.325 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: crc 2024-09-12T17:43:09.325 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: secure 2024-09-12T17:43:09.325 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: crc 2024-09-12T17:43:09.325 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: secure 2024-09-12T17:43:09.325 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: crc 2024-09-12T17:43:09.325 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: crc 2024-09-12T17:43:09.326 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: secure 2024-09-12T17:43:09.326 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: crc 2024-09-12T17:43:09.326 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: secure 2024-09-12T17:43:09.326 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: crc 2024-09-12T17:43:09.326 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:43:09.179+0000 7f4d55f28800 5 AuthRegistry(0x558d63954f98) adding con mode: secure 2024-09-12T17:43:09.326 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:43:09.180+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.326 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:43:09.180+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.326 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:43:09.180+0000 7f4d55f28800 5 asok(0x558d636df730) register_command rotate-key cmddesc rotate-key hook 0x558d639550e0 EEXIST 2024-09-12T17:43:09.326 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:09.326 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:43:09.326 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-c con 0x558d6397d6c0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:43:09.326 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-b con 0x558d6397f990 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:43:09.326 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-a con 0x558d6397be90 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:43:09.326 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.327 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.327 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.327 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:09.327 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:43:09.180+0000 7f4d55f28800 10 monclient(hunting): authenticate will time out at 1961.817350s 2024-09-12T17:43:09.327 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient(hunting): get_auth_request con 0x558d6397d6c0 auth_method 0 2024-09-12T17:43:09.327 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.327 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.327 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.327 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:43:09.180+0000 7f4d52470640 10 monclient(hunting): get_auth_request con 0x558d6397be90 auth_method 0 2024-09-12T17:43:09.327 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:43:09.180+0000 7f4d52470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.327 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:43:09.180+0000 7f4d52470640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.327 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:43:09.180+0000 7f4d52470640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.327 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.328 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.328 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.328 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:43:09.180+0000 7f4d5146e640 10 monclient(hunting): get_auth_request con 0x558d6397f990 auth_method 0 2024-09-12T17:43:09.328 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:43:09.180+0000 7f4d5146e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.328 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:43:09.180+0000 7f4d5146e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.328 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:43:09.180+0000 7f4d5146e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.328 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:43:09.180+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.328 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:43:09.180+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.328 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:43:09.180+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.328 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:43:09.180+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.328 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:43:09.180+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.328 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:43:09.180+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.328 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_done global_id 6524 payload 824 2024-09-12T17:43:09.328 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient: _finish_hunting 0 2024-09-12T17:43:09.329 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 1 monclient: found mon.noname-c 2024-09-12T17:43:09.329 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:43:09.180+0000 7f4d51c6f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:43:09.329 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:43:09.180+0000 7f4c377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:09.329 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:43:09.180+0000 7f4c377fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:43:09.329 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:43:09.180+0000 7f4c377fe640 10 monclient: dump: 2024-09-12T17:43:09.329 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:09.329 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:09.329 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.329 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.329 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:09.329 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.329 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:09.329 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:09.329 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:09.330 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.330 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:43:09.180+0000 7f4c377fe640 10 monclient: _finish_auth 0 2024-09-12T17:43:09.330 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:43:09.180+0000 7f4c377fe640 10 monclient: _check_auth_tickets 2024-09-12T17:43:09.330 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:43:09.181+0000 7f4d55f28800 5 monclient: authenticate success, global_id 6524 2024-09-12T17:43:09.330 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:43:09.181+0000 7f4c377fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:09.330 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:43:09.181+0000 7f4c377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:09.331 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:43:09.181+0000 7f4c377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:43:09.331 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:43:09.181+0000 7f4c377fe640 10 monclient: dump: 2024-09-12T17:43:09.331 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:09.331 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:09.331 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.331 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.331 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:09.331 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.332 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:09.332 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:09.332 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:09.332 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.332 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:43:09.181+0000 7f4d55f28800 10 monclient: _renew_subs 2024-09-12T17:43:09.332 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:43:09.181+0000 7f4d55f28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:09.332 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:43:09.181+0000 7f4d52c71640 4 set_mon_vals no callback set 2024-09-12T17:43:09.332 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:43:09.181+0000 7f4d55f28800 10 monclient: _renew_subs 2024-09-12T17:43:09.332 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:43:09.181+0000 7f4d55f28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:09.333 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:43:09.182+0000 7f4c377fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:09.333 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:43:09.182+0000 7f4c377fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:09.333 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:43:09.182+0000 7f4c377fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:09.333 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:43:09.182+0000 7f4d5146e640 10 monclient: get_auth_request con 0x7f4c2c076380 auth_method 0 2024-09-12T17:43:09.333 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:43:09.183+0000 7f4d55f28800 10 monclient: get_monmap_and_config 2024-09-12T17:43:09.333 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:43:09.183+0000 7f4d55f28800 10 monclient: build_initial_monmap 2024-09-12T17:43:09.333 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:43:09.183+0000 7f4d55f28800 1 build_initial for_mkfs: 0 2024-09-12T17:43:09.333 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:43:09.183+0000 7f4d55f28800 10 monclient: monmap: 2024-09-12T17:43:09.334 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:43:09.334 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:09.334 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:43:09.334 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:43:09.334 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:09.334 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.334 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:43:09.334 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:43:09.334 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:43:09.334 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.334 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding auth protocol: cephx 2024-09-12T17:43:09.335 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding auth protocol: cephx 2024-09-12T17:43:09.335 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding auth protocol: cephx 2024-09-12T17:43:09.335 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: secure 2024-09-12T17:43:09.335 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: crc 2024-09-12T17:43:09.335 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: secure 2024-09-12T17:43:09.335 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: crc 2024-09-12T17:43:09.335 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: secure 2024-09-12T17:43:09.335 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: crc 2024-09-12T17:43:09.335 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: crc 2024-09-12T17:43:09.335 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: secure 2024-09-12T17:43:09.335 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: crc 2024-09-12T17:43:09.335 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: secure 2024-09-12T17:43:09.336 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: crc 2024-09-12T17:43:09.336 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x558d6399d0f0) adding con mode: secure 2024-09-12T17:43:09.336 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:43:09.183+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.336 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:43:09.183+0000 7f4d55f28800 10 monclient: init 2024-09-12T17:43:09.336 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding auth protocol: cephx 2024-09-12T17:43:09.336 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding auth protocol: cephx 2024-09-12T17:43:09.336 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding auth protocol: cephx 2024-09-12T17:43:09.336 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: secure 2024-09-12T17:43:09.336 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: crc 2024-09-12T17:43:09.336 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: secure 2024-09-12T17:43:09.336 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: crc 2024-09-12T17:43:09.336 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: secure 2024-09-12T17:43:09.336 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: crc 2024-09-12T17:43:09.337 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: crc 2024-09-12T17:43:09.337 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: secure 2024-09-12T17:43:09.337 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: crc 2024-09-12T17:43:09.337 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: secure 2024-09-12T17:43:09.337 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: crc 2024-09-12T17:43:09.337 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:43:09.183+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb2852e10) adding con mode: secure 2024-09-12T17:43:09.337 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:43:09.183+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.337 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:43:09.183+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.337 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:43:09.184+0000 7f4d55f28800 5 asok(0x558d636df730) register_command rotate-key cmddesc rotate-key hook 0x7ffeb2852f58 EEXIST 2024-09-12T17:43:09.337 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:09.337 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:43:09.337 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-a con 0x558d639d16d0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:43:09.338 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-c con 0x558d639cbc70 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:43:09.338 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-b con 0x558d639a1510 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:43:09.338 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.338 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.338 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.338 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:09.338 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient(hunting): authenticate will time out at 1961.821108s 2024-09-12T17:43:09.338 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient(hunting): get_auth_request con 0x558d639cbc70 auth_method 0 2024-09-12T17:43:09.338 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.338 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.338 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.338 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:43:09.184+0000 7f4d51c6f640 10 monclient(hunting): get_auth_request con 0x558d639d16d0 auth_method 0 2024-09-12T17:43:09.338 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:43:09.184+0000 7f4d51c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.339 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:43:09.184+0000 7f4d51c6f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.339 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:43:09.184+0000 7f4d51c6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.339 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:43:09.184+0000 7f4d52470640 10 monclient(hunting): get_auth_request con 0x558d639a1510 auth_method 0 2024-09-12T17:43:09.339 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:43:09.184+0000 7f4d52470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.339 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:43:09.184+0000 7f4d52470640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.339 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:43:09.184+0000 7f4d52470640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.339 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.339 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.339 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.339 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:43:09.184+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.339 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:43:09.184+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.339 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:43:09.184+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.339 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:43:09.184+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.340 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:43:09.184+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.340 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:43:09.184+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.340 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient(hunting): handle_auth_done global_id 6527 payload 274 2024-09-12T17:43:09.340 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient: _finish_hunting 0 2024-09-12T17:43:09.340 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:43:09.184+0000 7f4d5146e640 1 monclient: found mon.noname-c 2024-09-12T17:43:09.340 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:43:09.184+0000 7f4d5146e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:43:09.340 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:09.340 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:43:09.340 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: dump: 2024-09-12T17:43:09.340 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:09.340 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:09.340 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.341 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.341 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:09.341 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.341 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:09.341 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:09.341 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:09.341 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.341 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: _finish_auth 0 2024-09-12T17:43:09.341 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: _check_auth_tickets 2024-09-12T17:43:09.341 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:09.341 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:43:09.184+0000 7f4d55f28800 5 monclient: authenticate success, global_id 6527 2024-09-12T17:43:09.342 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:43:09.184+0000 7f4d55f28800 10 monclient: get_monmap_and_config success 2024-09-12T17:43:09.342 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:43:09.184+0000 7f4d55f28800 4 set_mon_vals no callback set 2024-09-12T17:43:09.342 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:09.342 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:43:09.342 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:43:09.184+0000 7f4c357fa640 10 monclient: dump: 2024-09-12T17:43:09.342 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:09.342 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:09.342 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.342 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.342 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:09.342 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:43:09.185+0000 7f4d55f28800 10 monclient: shutdown 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:43:09.185+0000 7f4d55f28800 10 monclient: build_initial_monmap 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:43:09.185+0000 7f4d55f28800 1 build_initial for_mkfs: 0 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:43:09.185+0000 7f4d55f28800 10 monclient: monmap: 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:43:09.343 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding auth protocol: cephx 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding auth protocol: cephx 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding auth protocol: cephx 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: secure 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: crc 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: secure 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: crc 2024-09-12T17:43:09.344 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: secure 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: crc 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: crc 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: secure 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: crc 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: secure 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: crc 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d639c3d20) adding con mode: secure 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:43:09.185+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:43:09.185+0000 7f4d55f28800 1 librados: starting msgr at 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:43:09.185+0000 7f4d55f28800 1 librados: starting objecter 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 asok(0x558d636df730) register_command objecter_requests cmddesc objecter_requests hook 0x558d639836d0 EEXIST 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:43:09.185+0000 7f4d55f28800 1 librados: setting wanted keys 2024-09-12T17:43:09.345 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:43:09.185+0000 7f4d55f28800 1 librados: calling monclient init 2024-09-12T17:43:09.346 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:43:09.185+0000 7f4d55f28800 10 monclient: init 2024-09-12T17:43:09.346 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding auth protocol: cephx 2024-09-12T17:43:09.346 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding auth protocol: cephx 2024-09-12T17:43:09.346 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding auth protocol: cephx 2024-09-12T17:43:09.346 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: secure 2024-09-12T17:43:09.346 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: crc 2024-09-12T17:43:09.346 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: secure 2024-09-12T17:43:09.346 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: crc 2024-09-12T17:43:09.346 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: secure 2024-09-12T17:43:09.346 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: crc 2024-09-12T17:43:09.346 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: crc 2024-09-12T17:43:09.346 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: secure 2024-09-12T17:43:09.346 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: crc 2024-09-12T17:43:09.347 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: secure 2024-09-12T17:43:09.347 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: crc 2024-09-12T17:43:09.347 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:43:09.185+0000 7f4d55f28800 5 AuthRegistry(0x558d63995470) adding con mode: secure 2024-09-12T17:43:09.347 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:43:09.186+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.347 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:43:09.186+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.347 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:43:09.186+0000 7f4d55f28800 5 asok(0x558d636df730) register_command rotate-key cmddesc rotate-key hook 0x558d639955b8 EEXIST 2024-09-12T17:43:09.347 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:09.347 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:43:09.347 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-b con 0x558d639a1510 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:43:09.347 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-c con 0x558d639cbc70 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:43:09.347 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient(hunting): picked mon.noname-a con 0x558d639d16d0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:43:09.347 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.347 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.348 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:09.348 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:09.348 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:43:09.186+0000 7f4d55f28800 10 monclient(hunting): authenticate will time out at 1961.823407s 2024-09-12T17:43:09.348 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient(hunting): get_auth_request con 0x558d639d16d0 auth_method 0 2024-09-12T17:43:09.348 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.348 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.348 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.348 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:43:09.186+0000 7f4d5146e640 10 monclient(hunting): get_auth_request con 0x558d639cbc70 auth_method 0 2024-09-12T17:43:09.348 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:43:09.186+0000 7f4d5146e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.348 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:43:09.186+0000 7f4d5146e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.348 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:43:09.186+0000 7f4d5146e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.348 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:43:09.186+0000 7f4d51c6f640 10 monclient(hunting): get_auth_request con 0x558d639a1510 auth_method 0 2024-09-12T17:43:09.348 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:43:09.186+0000 7f4d51c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:09.349 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:43:09.186+0000 7f4d51c6f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:09.349 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:43:09.186+0000 7f4d51c6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:09.349 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.349 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.349 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.349 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:43:09.186+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.349 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:43:09.186+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.349 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:43:09.186+0000 7f4d5146e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.349 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:43:09.186+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:09.349 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:43:09.186+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:09.349 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:43:09.186+0000 7f4d51c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:09.349 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient(hunting): handle_auth_done global_id 6981 payload 824 2024-09-12T17:43:09.349 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient: _finish_hunting 0 2024-09-12T17:43:09.350 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:43:09.186+0000 7f4d52470640 1 monclient: found mon.noname-a 2024-09-12T17:43:09.350 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:43:09.186+0000 7f4d52470640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:43:09.350 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:09.350 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:43:09.350 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: dump: 2024-09-12T17:43:09.350 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:09.350 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:09.350 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.350 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.350 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:09.351 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.351 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:09.351 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:09.351 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:09.351 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.351 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: _finish_auth 0 2024-09-12T17:43:09.351 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: _check_auth_tickets 2024-09-12T17:43:09.351 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:09.351 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:09.351 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:43:09.351 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:43:09.187+0000 7f4c237fe640 10 monclient: dump: 2024-09-12T17:43:09.352 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:09.352 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:09.352 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.352 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:09.352 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:09.352 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:09.352 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:09.352 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:09.352 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:09.352 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.352 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:43:09.187+0000 7f4d55f28800 5 monclient: authenticate success, global_id 6981 2024-09-12T17:43:09.353 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:43:09.187+0000 7f4d55f28800 10 monclient: _renew_subs 2024-09-12T17:43:09.353 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:43:09.187+0000 7f4d55f28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:43:09.353 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:43:09.187+0000 7f4c357fa640 4 set_mon_vals no callback set 2024-09-12T17:43:09.353 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:43:09.187+0000 7f4d55f28800 10 monclient: _renew_subs 2024-09-12T17:43:09.353 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:43:09.187+0000 7f4d55f28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:43:09.353 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:43:09.187+0000 7f4d55f28800 1 librados: init done 2024-09-12T17:43:09.353 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:43:09.187+0000 7f4d55f28800 5 asok(0x558d636df730) register_command cr dump hook 0x558d639cad28 2024-09-12T17:43:09.353 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:43:09.188+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.353 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:43:09.189+0000 7f4c237fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:09.353 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:43:09.189+0000 7f4c237fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:09.353 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:43:09.189+0000 7f4c237fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:09.354 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:43:09.189+0000 7f4d51c6f640 10 monclient: get_auth_request con 0x7f4c1c076470 auth_method 0 2024-09-12T17:43:09.354 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:43:09.189+0000 7f4d5146e640 10 monclient: get_auth_request con 0x558d639ebaf0 auth_method 0 2024-09-12T17:43:09.354 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.354 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:43:09.190+0000 7f4d55f28800 20 realm 2024-09-12T17:43:09.354 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.354 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.354 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:43:09.190+0000 7f4d55f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:09.354 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.354 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.354 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:43:09.190+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.355 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:43:09.191+0000 7f4d51c6f640 10 monclient: get_auth_request con 0x558d639efcf0 auth_method 0 2024-09-12T17:43:09.355 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:43:09.191+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.355 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:43:09.191+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.355 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:43:09.191+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:09.355 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:43:09.191+0000 7f4d55f28800 20 searching for the correct realm 2024-09-12T17:43:09.355 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:43:09.192+0000 7f4d5146e640 10 monclient: get_auth_request con 0x558d639f4f60 auth_method 0 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:43:09.192+0000 7f4d52470640 10 monclient: get_auth_request con 0x7f4d4804d040 auth_method 0 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:43:09.193+0000 7f4d51c6f640 10 monclient: get_auth_request con 0x7f4d4c065590 auth_method 0 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:43:09.194+0000 7f4d5146e640 10 monclient: get_auth_request con 0x7f4d440dc040 auth_method 0 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:43:09.195+0000 7f4d5146e640 0 -- 172.21.15.44:0/112386571 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x558d639ebaf0 msgr2=0x558d639edf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:43:09.195+0000 7f4c237fe640 1 client.6981.objecter ms_handle_reset 0x558d639ebaf0 session 0x558d639eb420 osd.1 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:43:09.195+0000 7f4c237fe640 10 monclient: _renew_subs 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:43:09.195+0000 7f4c237fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:43:09.195+0000 7f4d5146e640 10 monclient: get_auth_request con 0x7f4c1c086290 auth_method 0 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:43:09.196+0000 7f4d52470640 10 monclient: get_auth_request con 0x7f4d4805d040 auth_method 0 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:43:09.198+0000 7f4d51c6f640 10 monclient: get_auth_request con 0x7f4d48036070 auth_method 0 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:43:09.198+0000 7f4d5146e640 0 -- 172.21.15.44:0/112386571 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f4d440dc040 msgr2=0x7f4d440e3ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:09.356 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:43:09.199+0000 7f4c237fe640 1 client.6981.objecter ms_handle_reset 0x7f4d440dc040 session 0x7f4d440e2040 osd.4 2024-09-12T17:43:09.357 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:43:09.199+0000 7f4d5146e640 10 monclient: get_auth_request con 0x558d639ebaf0 auth_method 0 2024-09-12T17:43:09.357 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:09.357 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:09.357 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:09.357 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:09.357 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:09.357 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:43:09.202+0000 7f4d55f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:09.358 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:43:09.202+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.358 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.358 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.358 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.358 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.358 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:09.358 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:43:09.203+0000 7f4d55f28800 20 zone default found 2024-09-12T17:43:09.358 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:43:09.203+0000 7f4d55f28800 4 Realm: () 2024-09-12T17:43:09.358 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:43:09.203+0000 7f4d55f28800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:09.358 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:43:09.203+0000 7f4d55f28800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:09.359 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:43:09.203+0000 7f4d55f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:09.359 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:43:09.203+0000 7f4d55f28800 20 zonegroup default 2024-09-12T17:43:09.359 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:43:09.203+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.359 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:43:09.204+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.359 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:43:09.204+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.359 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:43:09.204+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.359 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:43:09.204+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.359 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:43:09.204+0000 7f4d55f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.360 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:43:09.204+0000 7f4d55f28800 20 started sync module instance, tier type = 2024-09-12T17:43:09.360 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:43:09.204+0000 7f4d55f28800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:09.360 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=0 2024-09-12T17:43:09.360 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=1 2024-09-12T17:43:09.360 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=2 2024-09-12T17:43:09.360 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=3 2024-09-12T17:43:09.360 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=4 2024-09-12T17:43:09.360 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=5 2024-09-12T17:43:09.360 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:43:09.213+0000 7f4d55f28800 20 add_watcher() i=6 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:43:09.214+0000 7f4d55f28800 20 add_watcher() i=7 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:43:09.214+0000 7f4d55f28800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding auth protocol: cephx 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding auth protocol: cephx 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding auth protocol: cephx 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: secure 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: crc 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: secure 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: crc 2024-09-12T17:43:09.361 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: secure 2024-09-12T17:43:09.362 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: crc 2024-09-12T17:43:09.362 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: crc 2024-09-12T17:43:09.362 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: secure 2024-09-12T17:43:09.362 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: crc 2024-09-12T17:43:09.362 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: secure 2024-09-12T17:43:09.362 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: crc 2024-09-12T17:43:09.362 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 AuthRegistry(0x7ffeb28532e0) adding con mode: secure 2024-09-12T17:43:09.362 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:43:09.216+0000 7f4c07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.362 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:43:09.216+0000 7f4d55f28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:09.362 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:43:09.216+0000 7f4d55f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:09.362 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:43:09.216+0000 7f4d55f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:09.362 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 asok(0x558d636df730) register_command cache list hook 0x558d639c8000 2024-09-12T17:43:09.363 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 asok(0x558d636df730) register_command cache inspect hook 0x558d639c8000 2024-09-12T17:43:09.363 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 asok(0x558d636df730) register_command cache erase hook 0x558d639c8000 2024-09-12T17:43:09.363 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 asok(0x558d636df730) register_command cache zap hook 0x558d639c8000 2024-09-12T17:43:09.363 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 note: GC not initialized 2024-09-12T17:43:09.363 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:43:09.216+0000 7f4c06fe5640 20 reqs_thread_entry: start 2024-09-12T17:43:09.363 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 asok(0x558d636df730) register_command sync trace show hook 0x7f4d4802c050 2024-09-12T17:43:09.363 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 asok(0x558d636df730) register_command sync trace history hook 0x7f4d4802c050 2024-09-12T17:43:09.363 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 asok(0x558d636df730) register_command sync trace active hook 0x7f4d4802c050 2024-09-12T17:43:09.363 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:43:09.216+0000 7f4d55f28800 5 asok(0x558d636df730) register_command sync trace active_short hook 0x7f4d4802c050 2024-09-12T17:43:09.363 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:43:09.216+0000 7f4d55f28800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:09.363 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:43:09.217+0000 7f4d55f28800 20 Filter name: none 2024-09-12T17:43:09.363 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:43:09.217+0000 7f4c04fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:09.363 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:43:09.217+0000 7f4d55f28800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:43:09.364 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:43:09.217+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.364 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:43:09.217+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:09.364 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:43:09.217+0000 7f4d55f28800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:43:09.364 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:43:09.217+0000 7f4d55f28800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:43:09.364 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:43:09.217+0000 7f4d55f28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 : miss 2024-09-12T17:43:09.364 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:43:09.217+0000 7f4d55f28800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.364 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:43:09.217+0000 7f4d55f28800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:09.364 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:43:09.218+0000 7f4d55f28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:09.364 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:43:09.218+0000 7f4d55f28800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:09.364 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:43:09.218+0000 7f4d55f28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:09.364 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:43:09.218+0000 7f4d55f28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.364 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:43:09.218+0000 7f4d55f28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 2024-09-12T17:43:09.365 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:43:09.222+0000 7f4d55f28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:09.365 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:43:09.222+0000 7f4d55f28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:09.365 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:43:09.222+0000 7f4d55f28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.365 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:43:09.222+0000 7f4d55f28800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28, ofs0, ns] 2024-09-12T17:43:09.365 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:43:09.223+0000 7f4c357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562421 cookie 94065750161264 notifier 6981 bl.length()=1023 2024-09-12T17:43:09.365 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:43:09.223+0000 7f4c357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:09.365 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:43:09.223+0000 7f4c357fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:09.365 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:43:09.223+0000 7f4c357fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.365 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:43:09.223+0000 7f4d55f28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): orig_sources= new_sources= 2024-09-12T17:43:09.365 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:43:09.223+0000 7f4d55f28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): potential sources added=[] removed=[] 2024-09-12T17:43:09.366 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:43:09.223+0000 7f4d55f28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): orig_dests= new_dests= 2024-09-12T17:43:09.366 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:43:09.223+0000 7f4d55f28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): potential dests added=[] removed=[] 2024-09-12T17:43:09.366 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:43:09.224+0000 7f4d55f28800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4d55f28800 time 2024-09-12T17:43:09.225027+0000 2024-09-12T17:43:09.366 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:43:09.366 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.366 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:09.366 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4d5778c71a] 2024-09-12T17:43:09.366 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4d5778c8d8] 2024-09-12T17:43:09.366 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558d6214d841] 2024-09-12T17:43:09.367 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd7489e) [0x558d6265b89e] 2024-09-12T17:43:09.367 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558d6215d50d] 2024-09-12T17:43:09.367 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:43:09.367 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4d56429590] 2024-09-12T17:43:09.367 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:43:09.367 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:43:09.367 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.367 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:43:09.225+0000 7f4d55f28800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:43:09.367 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f4d55f28800 thread_name:radosgw-admin 2024-09-12T17:43:09.367 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.367 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:09.367 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4d5643e6f0] 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4d5648b99c] 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4d5778c774] 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4d5778c8d8] 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558d6214d841] 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd7489e) [0x558d6265b89e] 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558d6215d50d] 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4d56429590] 2024-09-12T17:43:09.368 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:43:09.369 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:43:09.370 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:43:09.371 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:43:09.372 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:43:09.372 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:43:09.372 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:43:09.372 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:43:09.372 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:43:09.372 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:43:09.372 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:43:09.372 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:43:09.372 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:43:09.372 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:43:09.372 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:43:09.372 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:43:09.372 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:43:09.373 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:43:09.373 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:43:09.373 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:43:09.373 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:43:09.373 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:43:09.373 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:43:09.373 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:43:09.373 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:43:09.373 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:43:09.373 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:43:09.373 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:43:09.373 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:43:09.373 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:43:09.374 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:43:09.374 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:43:09.374 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:43:09.374 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:43:09.374 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:43:09.374 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:43:09.374 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:43:09.374 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:43:09.374 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:43:09.374 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:43:09.374 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:43:09.374 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:43:09.375 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:43:09.375 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:43:09.375 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:43:09.375 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:43:09.375 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:43:09.375 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:43:09.375 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:43:09.375 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:43:09.375 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:43:09.375 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:43:09.375 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:43:09.375 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:43:09.375 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:43:09.376 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:43:09.376 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:43:09.376 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:43:09.376 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:43:09.376 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:43:09.376 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:43:09.376 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:43:09.376 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:43:09.376 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4c04fe1640 / http_manager 2024-09-12T17:43:09.376 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4c06fe5640 / http_manager 2024-09-12T17:43:09.376 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4c07fe7640 / rgw_dt_lg_renew 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4c237fe640 / ms_dispatch 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4c357fa640 / io_context_pool 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4c377fe640 / ms_dispatch 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4c3e604640 / ms_dispatch 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4c3fe07640 / io_context_pool 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4d5146e640 / msgr-worker-2 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4d51c6f640 / msgr-worker-1 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4d52470640 / msgr-worker-0 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4d52c71640 / io_context_pool 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi044.stderr: 7f4d55f28800 / radosgw-admin 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:43:09.377 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:43:09.226728Z_555bb325-84a9-4de4-a181-ef4d71224f8b/log 2024-09-12T17:43:09.378 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:43:09.378 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:43:09.383 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:09.383 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:09.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.303+0000 7f577ad19800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.305+0000 7f577ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.305+0000 7f577ad19800 20 realm 2024-09-12T17:43:09.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.305+0000 7f577ad19800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.305+0000 7f577ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.305+0000 7f577ad19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:09.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.305+0000 7f577ad19800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.305+0000 7f577ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.305+0000 7f577ad19800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.306+0000 7f577ad19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.306+0000 7f577ad19800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.307+0000 7f577ad19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.307+0000 7f577ad19800 20 searching for the correct realm 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.310+0000 7f5778009640 0 -- 172.21.15.44:0/2784239440 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x557a4ad780d0 msgr2=0x557a4ad7a4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.313+0000 7f577880a640 0 -- 172.21.15.44:0/2784239440 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f576c06e990 msgr2=0x7f576c0719b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.318+0000 7f577ad19800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.318+0000 7f577ad19800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.318+0000 7f577ad19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.318+0000 7f577ad19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.318+0000 7f577ad19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:09.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.318+0000 7f577ad19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.318+0000 7f577ad19800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.318+0000 7f577ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.318+0000 7f577ad19800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.319+0000 7f577ad19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.319+0000 7f577ad19800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.319+0000 7f577ad19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.319+0000 7f577ad19800 20 zone default found 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.319+0000 7f577ad19800 4 Realm: () 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.319+0000 7f577ad19800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.319+0000 7f577ad19800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.319+0000 7f577ad19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.319+0000 7f577ad19800 20 zonegroup default 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.319+0000 7f577ad19800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.319+0000 7f577ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.319+0000 7f577ad19800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.320+0000 7f577ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.320+0000 7f577ad19800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.320+0000 7f577ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.320+0000 7f577ad19800 20 started sync module instance, tier type = 2024-09-12T17:43:09.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.320+0000 7f577ad19800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:09.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.329+0000 7f577ad19800 20 add_watcher() i=0 2024-09-12T17:43:09.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.329+0000 7f577ad19800 20 add_watcher() i=1 2024-09-12T17:43:09.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.329+0000 7f577ad19800 20 add_watcher() i=2 2024-09-12T17:43:09.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.329+0000 7f577ad19800 20 add_watcher() i=3 2024-09-12T17:43:09.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.329+0000 7f577ad19800 20 add_watcher() i=4 2024-09-12T17:43:09.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.329+0000 7f577ad19800 20 add_watcher() i=5 2024-09-12T17:43:09.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.329+0000 7f577ad19800 20 add_watcher() i=6 2024-09-12T17:43:09.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.330+0000 7f577ad19800 20 add_watcher() i=7 2024-09-12T17:43:09.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.330+0000 7f577ad19800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:09.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.332+0000 7f562efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.332+0000 7f577ad19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:09.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.332+0000 7f577ad19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:09.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.332+0000 7f577ad19800 5 note: GC not initialized 2024-09-12T17:43:09.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.332+0000 7f562dfe3640 20 reqs_thread_entry: start 2024-09-12T17:43:09.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.332+0000 7f577ad19800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:09.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.332+0000 7f577ad19800 20 Filter name: none 2024-09-12T17:43:09.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.332+0000 7f559f7fe640 20 reqs_thread_entry: start 2024-09-12T17:43:09.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.333+0000 7f577ad19800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.333+0000 7f577ad19800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:09.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.333+0000 7f577ad19800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.333+0000 7f577ad19800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:43:09.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.333+0000 7f577ad19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:09.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.334+0000 7f577ad19800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.334+0000 7f577ad19800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:09.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.334+0000 7f577ad19800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.334+0000 7f577ad19800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:43:09.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.334+0000 7f577ad19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:09.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.336+0000 7f562efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.338+0000 7f577ad19800 20 remove_watcher() i=0 2024-09-12T17:43:09.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.338+0000 7f577ad19800 2 removed watcher, disabling cache 2024-09-12T17:43:09.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.339+0000 7f577ad19800 20 remove_watcher() i=1 2024-09-12T17:43:09.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.340+0000 7f577ad19800 20 remove_watcher() i=2 2024-09-12T17:43:09.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.342+0000 7f577ad19800 20 remove_watcher() i=3 2024-09-12T17:43:09.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.343+0000 7f577ad19800 20 remove_watcher() i=4 2024-09-12T17:43:09.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.344+0000 7f577ad19800 20 remove_watcher() i=5 2024-09-12T17:43:09.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.345+0000 7f577ad19800 20 remove_watcher() i=6 2024-09-12T17:43:09.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.346+0000 7f577ad19800 20 remove_watcher() i=7 2024-09-12T17:43:09.389 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.389 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:43:09.389 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-trim-reshard-log-entries id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:09.389 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:09.412 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:43:09.445 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:09.445 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:09.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.482+0000 7f8308b23800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.484+0000 7f8308b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.484+0000 7f8308b23800 20 realm 2024-09-12T17:43:09.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.484+0000 7f8308b23800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.484+0000 7f8308b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.484+0000 7f8308b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:09.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.484+0000 7f8308b23800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.485+0000 7f8308b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.485+0000 7f8308b23800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.485+0000 7f8308b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.485+0000 7f8308b23800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.486+0000 7f8308b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:09.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.486+0000 7f8308b23800 20 searching for the correct realm 2024-09-12T17:43:09.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.489+0000 7f82fffff640 0 -- 172.21.15.44:0/3019005718 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x556d10e291d0 msgr2=0x556d10e2b690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:09.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.694+0000 7f830480c640 0 -- 172.21.15.44:0/3019005718 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f82f00ab1c0 msgr2=0x7f82f00706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:09.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.900+0000 7f8308b23800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:09.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.900+0000 7f8308b23800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:09.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.900+0000 7f8308b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:09.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.900+0000 7f8308b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:09.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.900+0000 7f8308b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:09.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.900+0000 7f8308b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:09.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.900+0000 7f8308b23800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.900+0000 7f8308b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.900+0000 7f8308b23800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.900+0000 7f8308b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:09.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.900+0000 7f8308b23800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.900+0000 7f8308b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:09.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.901+0000 7f8308b23800 20 zone default found 2024-09-12T17:43:09.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.901+0000 7f8308b23800 4 Realm: () 2024-09-12T17:43:09.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.901+0000 7f8308b23800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:09.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.901+0000 7f8308b23800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:09.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.901+0000 7f8308b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:09.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.901+0000 7f8308b23800 20 zonegroup default 2024-09-12T17:43:09.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.901+0000 7f8308b23800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.901+0000 7f8308b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.901+0000 7f8308b23800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.901+0000 7f8308b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.901+0000 7f8308b23800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.901+0000 7f8308b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:09.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.902+0000 7f8308b23800 20 started sync module instance, tier type = 2024-09-12T17:43:09.906 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.902+0000 7f8308b23800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:09.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.912+0000 7f8308b23800 20 add_watcher() i=0 2024-09-12T17:43:09.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.912+0000 7f8308b23800 20 add_watcher() i=1 2024-09-12T17:43:09.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.912+0000 7f8308b23800 20 add_watcher() i=2 2024-09-12T17:43:09.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.912+0000 7f8308b23800 20 add_watcher() i=3 2024-09-12T17:43:09.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.912+0000 7f8308b23800 20 add_watcher() i=4 2024-09-12T17:43:09.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.912+0000 7f8308b23800 20 add_watcher() i=5 2024-09-12T17:43:09.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.912+0000 7f8308b23800 20 add_watcher() i=6 2024-09-12T17:43:09.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.913+0000 7f8308b23800 20 add_watcher() i=7 2024-09-12T17:43:09.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.913+0000 7f8308b23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:09.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.915+0000 7f81bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.915+0000 7f8308b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:09.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.915+0000 7f8308b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:09.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.915+0000 7f8308b23800 5 note: GC not initialized 2024-09-12T17:43:09.918 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.915+0000 7f81ba7e4640 20 reqs_thread_entry: start 2024-09-12T17:43:09.918 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.916+0000 7f8308b23800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:09.918 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.916+0000 7f8308b23800 20 Filter name: none 2024-09-12T17:43:09.918 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.916+0000 7f81b37fe640 20 reqs_thread_entry: start 2024-09-12T17:43:09.918 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.916+0000 7f8308b23800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:43:09.918 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.916+0000 7f8308b23800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.916+0000 7f8308b23800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:09.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.916+0000 7f8308b23800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:43:09.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.916+0000 7f8308b23800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:43:09.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.916+0000 7f8308b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 : miss 2024-09-12T17:43:09.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.916+0000 7f8308b23800 20 rados->read ofs=0 len=0 2024-09-12T17:43:09.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.917+0000 7f8308b23800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:43:09.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.917+0000 7f8308b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:09.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.917+0000 7f8308b23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:09.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.917+0000 7f8308b23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:09.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.917+0000 7f8308b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:09.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.917+0000 7f8308b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 2024-09-12T17:43:09.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.918+0000 7f8308b23800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to be held by another RGW process; skipping for now 2024-09-12T17:43:09.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.919+0000 7f81bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:09.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.921+0000 7f8308b23800 20 remove_watcher() i=0 2024-09-12T17:43:09.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.921+0000 7f8308b23800 2 removed watcher, disabling cache 2024-09-12T17:43:09.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.923+0000 7f8308b23800 20 remove_watcher() i=1 2024-09-12T17:43:09.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.924+0000 7f8308b23800 20 remove_watcher() i=2 2024-09-12T17:43:09.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.925+0000 7f8308b23800 20 remove_watcher() i=3 2024-09-12T17:43:09.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.926+0000 7f8308b23800 20 remove_watcher() i=4 2024-09-12T17:43:09.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.927+0000 7f8308b23800 20 remove_watcher() i=5 2024-09-12T17:43:09.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.928+0000 7f8308b23800 20 remove_watcher() i=6 2024-09-12T17:43:09.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:09.929+0000 7f8308b23800 20 remove_watcher() i=7 2024-09-12T17:43:09.942 INFO:tasks.workunit.client.0.smithi044.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:43:39.973 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:43:40.009 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:40.009 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:40.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.054+0000 7fdf80240800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.056+0000 7fdf80240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.056+0000 7fdf80240800 20 realm 2024-09-12T17:43:40.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.056+0000 7fdf80240800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.056+0000 7fdf80240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.056+0000 7fdf80240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:40.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.056+0000 7fdf80240800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.056+0000 7fdf80240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.056+0000 7fdf80240800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.057+0000 7fdf80240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:40.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.057+0000 7fdf80240800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.058+0000 7fdf80240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:40.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.058+0000 7fdf80240800 20 searching for the correct realm 2024-09-12T17:43:40.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.061+0000 7fdf75529640 0 -- 172.21.15.44:0/3128625029 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fdf700b5040 msgr2=0x7fdf700db820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:40.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.065+0000 7fdf7dd2a640 0 -- 172.21.15.44:0/3128625029 >> [v2:172.21.15.181:6826/1273321942,v1:172.21.15.181:6827/1273321942] conn(0x56417f6c2e10 msgr2=0x56417f6c5240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:40.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.071+0000 7fdf80240800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:40.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.071+0000 7fdf80240800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:40.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.071+0000 7fdf80240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:40.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.071+0000 7fdf80240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:40.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.071+0000 7fdf80240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:40.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.071+0000 7fdf80240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:40.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.071+0000 7fdf80240800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.072+0000 7fdf80240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.072+0000 7fdf80240800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.072+0000 7fdf80240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:40.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.072+0000 7fdf80240800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.073+0000 7fdf80240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:40.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.073+0000 7fdf80240800 20 zone default found 2024-09-12T17:43:40.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.073+0000 7fdf80240800 4 Realm: () 2024-09-12T17:43:40.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.073+0000 7fdf80240800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:40.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.073+0000 7fdf80240800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:40.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.073+0000 7fdf80240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:40.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.073+0000 7fdf80240800 20 zonegroup default 2024-09-12T17:43:40.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.073+0000 7fdf80240800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.073+0000 7fdf80240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.073+0000 7fdf80240800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.073+0000 7fdf80240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.073+0000 7fdf80240800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.074+0000 7fdf80240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.074+0000 7fdf80240800 20 started sync module instance, tier type = 2024-09-12T17:43:40.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.074+0000 7fdf80240800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:40.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.084+0000 7fdf80240800 20 add_watcher() i=0 2024-09-12T17:43:40.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.084+0000 7fdf80240800 20 add_watcher() i=1 2024-09-12T17:43:40.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.084+0000 7fdf80240800 20 add_watcher() i=2 2024-09-12T17:43:40.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.084+0000 7fdf80240800 20 add_watcher() i=3 2024-09-12T17:43:40.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.084+0000 7fdf80240800 20 add_watcher() i=4 2024-09-12T17:43:40.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.084+0000 7fdf80240800 20 add_watcher() i=5 2024-09-12T17:43:40.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.084+0000 7fdf80240800 20 add_watcher() i=6 2024-09-12T17:43:40.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.085+0000 7fdf80240800 20 add_watcher() i=7 2024-09-12T17:43:40.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.085+0000 7fdf80240800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:40.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.086+0000 7fde33fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:40.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.087+0000 7fdf80240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:40.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.087+0000 7fdf80240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:40.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.087+0000 7fdf80240800 5 note: GC not initialized 2024-09-12T17:43:40.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.087+0000 7fde32fe5640 20 reqs_thread_entry: start 2024-09-12T17:43:40.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.087+0000 7fdf80240800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:40.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.087+0000 7fdf80240800 20 Filter name: none 2024-09-12T17:43:40.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.087+0000 7fde30fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:40.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.087+0000 7fdf80240800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:43:40.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.087+0000 7fdf80240800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.088+0000 7fdf80240800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:40.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.088+0000 7fdf80240800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:43:40.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.088+0000 7fdf80240800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:43:40.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.088+0000 7fdf80240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 : miss 2024-09-12T17:43:40.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.088+0000 7fdf80240800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.088+0000 7fdf80240800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:43:40.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.088+0000 7fdf80240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:40.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.088+0000 7fdf80240800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:40.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.088+0000 7fdf80240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:40.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.088+0000 7fdf80240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:40.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.088+0000 7fdf80240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 2024-09-12T17:43:40.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.090+0000 7fdf80240800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:43:40.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.098+0000 7fdf80240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:40.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.098+0000 7fdf80240800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:40.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.098+0000 7fdf80240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:40.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.098+0000 7fdf80240800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28, ofs0, ns] 2024-09-12T17:43:40.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.098+0000 7fde617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562422 cookie 94839310691344 notifier 7038 bl.length()=1023 2024-09-12T17:43:40.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.098+0000 7fde617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:40.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.098+0000 7fde617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:40.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.098+0000 7fde617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:40.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.099+0000 7fdf80240800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): orig_sources= new_sources= 2024-09-12T17:43:40.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.099+0000 7fdf80240800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): potential sources added=[] removed=[] 2024-09-12T17:43:40.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.099+0000 7fdf80240800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): orig_dests= new_dests= 2024-09-12T17:43:40.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.099+0000 7fdf80240800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): potential dests added=[] removed=[] 2024-09-12T17:43:40.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.0 2024-09-12T17:43:40.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.0 2024-09-12T17:43:40.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.1 2024-09-12T17:43:40.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.1 2024-09-12T17:43:40.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.2 2024-09-12T17:43:40.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.2 2024-09-12T17:43:40.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.3 2024-09-12T17:43:40.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.3 2024-09-12T17:43:40.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.4 2024-09-12T17:43:40.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.4 2024-09-12T17:43:40.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.5 2024-09-12T17:43:40.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.5 2024-09-12T17:43:40.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.6 2024-09-12T17:43:40.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.6 2024-09-12T17:43:40.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.7 2024-09-12T17:43:40.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.7 2024-09-12T17:43:40.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.8 2024-09-12T17:43:40.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.8 2024-09-12T17:43:40.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.9 2024-09-12T17:43:40.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.9 2024-09-12T17:43:40.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.10 2024-09-12T17:43:40.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.10 2024-09-12T17:43:40.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.11 2024-09-12T17:43:40.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2.11 2024-09-12T17:43:40.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.103+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.0 2024-09-12T17:43:40.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.104+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.1 2024-09-12T17:43:40.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.105+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2 2024-09-12T17:43:40.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.105+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.3 2024-09-12T17:43:40.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.106+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.4 2024-09-12T17:43:40.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.106+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.5 2024-09-12T17:43:40.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.107+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.6 2024-09-12T17:43:40.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.108+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.7 2024-09-12T17:43:40.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.108+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.8 2024-09-12T17:43:40.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.108+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.9 2024-09-12T17:43:40.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.109+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.10 2024-09-12T17:43:40.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.112+0000 7fdf80240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:40.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.112+0000 7fdf80240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 2024-09-12T17:43:40.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.113+0000 7fdf80240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:40.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.114+0000 7fdf80240800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:40.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.114+0000 7fdf80240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:40.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.114+0000 7fdf80240800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28, ofs0, ns] 2024-09-12T17:43:40.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.114+0000 7fde60ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562423 cookie 94839310691344 notifier 7038 bl.length()=1023 2024-09-12T17:43:40.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.114+0000 7fde60ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:40.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.114+0000 7fde60ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:40.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.114+0000 7fde60ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:40.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.114+0000 7fdf80240800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): orig_sources= new_sources= 2024-09-12T17:43:40.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.114+0000 7fdf80240800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): potential sources added=[] removed=[] 2024-09-12T17:43:40.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.114+0000 7fdf80240800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): orig_dests= new_dests= 2024-09-12T17:43:40.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.114+0000 7fdf80240800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): potential dests added=[] removed=[] 2024-09-12T17:43:40.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.116+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.0 2024-09-12T17:43:40.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.117+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.1 2024-09-12T17:43:40.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.117+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.2 2024-09-12T17:43:40.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.117+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.3 2024-09-12T17:43:40.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.118+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.4 2024-09-12T17:43:40.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.118+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.5 2024-09-12T17:43:40.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.118+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.6 2024-09-12T17:43:40.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.119+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.7 2024-09-12T17:43:40.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.119+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.8 2024-09-12T17:43:40.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.119+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.9 2024-09-12T17:43:40.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.120+0000 7fdf80240800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28.10 2024-09-12T17:43:40.121 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.120+0000 7fdf80240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:40.121 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.120+0000 7fdf80240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 2024-09-12T17:43:40.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.121+0000 7fdf80240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:40.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.121+0000 7fdf80240800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:40.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.121+0000 7fdf80240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:40.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.121+0000 7fdf80240800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28, ofs0, ns] 2024-09-12T17:43:40.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.122+0000 7fde60ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562424 cookie 94839310691344 notifier 7038 bl.length()=991 2024-09-12T17:43:40.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.122+0000 7fde60ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 info.flags=0x17 2024-09-12T17:43:40.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.122+0000 7fde60ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 to cache LRU end 2024-09-12T17:43:40.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.122+0000 7fde60ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:40.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.122+0000 7fdf80240800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): orig_sources= new_sources= 2024-09-12T17:43:40.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.122+0000 7fdf80240800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): potential sources added=[] removed=[] 2024-09-12T17:43:40.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.122+0000 7fdf80240800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): orig_dests= new_dests= 2024-09-12T17:43:40.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.122+0000 7fdf80240800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28]): potential dests added=[] removed=[] 2024-09-12T17:43:40.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.125+0000 7fdf80240800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:43:40.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.127+0000 7fde33fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:40.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.129+0000 7fdf80240800 20 remove_watcher() i=0 2024-09-12T17:43:40.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.129+0000 7fdf80240800 2 removed watcher, disabling cache 2024-09-12T17:43:40.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.130+0000 7fdf80240800 20 remove_watcher() i=1 2024-09-12T17:43:40.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.131+0000 7fdf80240800 20 remove_watcher() i=2 2024-09-12T17:43:40.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.132+0000 7fdf80240800 20 remove_watcher() i=3 2024-09-12T17:43:40.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.133+0000 7fdf80240800 20 remove_watcher() i=4 2024-09-12T17:43:40.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.134+0000 7fdf80240800 20 remove_watcher() i=5 2024-09-12T17:43:40.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.135+0000 7fdf80240800 20 remove_watcher() i=6 2024-09-12T17:43:40.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.136+0000 7fdf80240800 20 remove_watcher() i=7 2024-09-12T17:43:40.149 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:43:40.179 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:40.179 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:40.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.218+0000 7f433a13e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.220+0000 7f433a13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.220+0000 7f433a13e800 20 realm 2024-09-12T17:43:40.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.220+0000 7f433a13e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.220+0000 7f433a13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.220+0000 7f433a13e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:40.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.220+0000 7f433a13e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.220+0000 7f433a13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.220+0000 7f433a13e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.221+0000 7f433a13e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:40.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.221+0000 7f433a13e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.221+0000 7f433a13e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:40.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.221+0000 7f433a13e800 20 searching for the correct realm 2024-09-12T17:43:40.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.224+0000 7f43356bf640 0 -- 172.21.15.44:0/82600906 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55d74c1724c0 msgr2=0x55d74c1748b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:40.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.228+0000 7f4335ec0640 0 -- 172.21.15.44:0/82600906 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f432c008420 msgr2=0x7f432c0088a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:40.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.232+0000 7f433a13e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:40.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.232+0000 7f433a13e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:40.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.232+0000 7f433a13e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:40.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.232+0000 7f433a13e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:40.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.232+0000 7f433a13e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:40.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.232+0000 7f433a13e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:40.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.232+0000 7f433a13e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.232+0000 7f433a13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.232+0000 7f433a13e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.233+0000 7f433a13e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:40.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.233+0000 7f433a13e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.233+0000 7f433a13e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:40.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.233+0000 7f433a13e800 20 zone default found 2024-09-12T17:43:40.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.233+0000 7f433a13e800 4 Realm: () 2024-09-12T17:43:40.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.233+0000 7f433a13e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:40.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.233+0000 7f433a13e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:40.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.233+0000 7f433a13e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:40.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.233+0000 7f433a13e800 20 zonegroup default 2024-09-12T17:43:40.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.233+0000 7f433a13e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.233+0000 7f433a13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.233+0000 7f433a13e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.234+0000 7f433a13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.234+0000 7f433a13e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.234+0000 7f433a13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.234+0000 7f433a13e800 20 started sync module instance, tier type = 2024-09-12T17:43:40.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.234+0000 7f433a13e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:40.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.243+0000 7f433a13e800 20 add_watcher() i=0 2024-09-12T17:43:40.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.243+0000 7f433a13e800 20 add_watcher() i=1 2024-09-12T17:43:40.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.243+0000 7f433a13e800 20 add_watcher() i=2 2024-09-12T17:43:40.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.243+0000 7f433a13e800 20 add_watcher() i=3 2024-09-12T17:43:40.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.243+0000 7f433a13e800 20 add_watcher() i=4 2024-09-12T17:43:40.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.243+0000 7f433a13e800 20 add_watcher() i=5 2024-09-12T17:43:40.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.243+0000 7f433a13e800 20 add_watcher() i=6 2024-09-12T17:43:40.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.244+0000 7f433a13e800 20 add_watcher() i=7 2024-09-12T17:43:40.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.244+0000 7f433a13e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:40.246 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.245+0000 7f41e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:40.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.246+0000 7f433a13e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:40.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.246+0000 7f433a13e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:40.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.246+0000 7f433a13e800 5 note: GC not initialized 2024-09-12T17:43:40.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.246+0000 7f41e67fc640 20 reqs_thread_entry: start 2024-09-12T17:43:40.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.246+0000 7f433a13e800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:40.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.246+0000 7f433a13e800 20 Filter name: none 2024-09-12T17:43:40.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.246+0000 7f4157fff640 20 reqs_thread_entry: start 2024-09-12T17:43:40.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.246+0000 7f433a13e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.247+0000 7f433a13e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:40.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.247+0000 7f433a13e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.247+0000 7f433a13e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:40.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.247+0000 7f433a13e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:40.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.247+0000 7f433a13e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.248+0000 7f433a13e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:43:40.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.248+0000 7f433a13e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.248+0000 7f433a13e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:43:40.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.248+0000 7f433a13e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:40.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.250+0000 7f41e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:40.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.252+0000 7f433a13e800 20 remove_watcher() i=0 2024-09-12T17:43:40.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.252+0000 7f433a13e800 2 removed watcher, disabling cache 2024-09-12T17:43:40.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.253+0000 7f433a13e800 20 remove_watcher() i=1 2024-09-12T17:43:40.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.254+0000 7f433a13e800 20 remove_watcher() i=2 2024-09-12T17:43:40.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.255+0000 7f433a13e800 20 remove_watcher() i=3 2024-09-12T17:43:40.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.256+0000 7f433a13e800 20 remove_watcher() i=4 2024-09-12T17:43:40.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.257+0000 7f433a13e800 20 remove_watcher() i=5 2024-09-12T17:43:40.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.258+0000 7f433a13e800 20 remove_watcher() i=6 2024-09-12T17:43:40.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.259+0000 7f433a13e800 20 remove_watcher() i=7 2024-09-12T17:43:40.270 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:40.270 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:43:40.270 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-trim-reshard-log-entries id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:43:40.271 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:40.346 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T17:43:40.346 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:40.546 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:43:40.576 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:40.576 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:40.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.615+0000 7ff7de91f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.616+0000 7ff7de91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.616+0000 7ff7de91f800 20 realm 2024-09-12T17:43:40.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.616+0000 7ff7de91f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.617+0000 7ff7de91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.617+0000 7ff7de91f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:40.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.617+0000 7ff7de91f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.617+0000 7ff7de91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.617+0000 7ff7de91f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.619 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.618+0000 7ff7de91f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:40.619 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.618+0000 7ff7de91f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.619 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.618+0000 7ff7de91f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:40.619 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.618+0000 7ff7de91f800 20 searching for the correct realm 2024-09-12T17:43:40.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.622+0000 7ff7daea3640 0 -- 172.21.15.44:0/3561864418 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x55fa4596cca0 msgr2=0x55fa4596f160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:40.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.625+0000 7ff7d9ea1640 0 -- 172.21.15.44:0/3561864418 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7ff7cc09c040 msgr2=0x7ff7cc09d940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:40.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.629+0000 7ff7de91f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:40.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.629+0000 7ff7de91f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:40.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.629+0000 7ff7de91f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:40.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.629+0000 7ff7de91f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:40.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.629+0000 7ff7de91f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:40.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.629+0000 7ff7de91f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:40.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.629+0000 7ff7de91f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.629+0000 7ff7de91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.629+0000 7ff7de91f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.629+0000 7ff7de91f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:40.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.629+0000 7ff7de91f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.630+0000 7ff7de91f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:40.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.630+0000 7ff7de91f800 20 zone default found 2024-09-12T17:43:40.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.630+0000 7ff7de91f800 4 Realm: () 2024-09-12T17:43:40.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.630+0000 7ff7de91f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:40.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.630+0000 7ff7de91f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:40.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.630+0000 7ff7de91f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:40.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.630+0000 7ff7de91f800 20 zonegroup default 2024-09-12T17:43:40.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.630+0000 7ff7de91f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.630+0000 7ff7de91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.630+0000 7ff7de91f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.630+0000 7ff7de91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.630+0000 7ff7de91f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.630+0000 7ff7de91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.630+0000 7ff7de91f800 20 started sync module instance, tier type = 2024-09-12T17:43:40.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.630+0000 7ff7de91f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:40.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.639+0000 7ff7de91f800 20 add_watcher() i=0 2024-09-12T17:43:40.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.639+0000 7ff7de91f800 20 add_watcher() i=1 2024-09-12T17:43:40.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.639+0000 7ff7de91f800 20 add_watcher() i=2 2024-09-12T17:43:40.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.639+0000 7ff7de91f800 20 add_watcher() i=3 2024-09-12T17:43:40.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.639+0000 7ff7de91f800 20 add_watcher() i=4 2024-09-12T17:43:40.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.639+0000 7ff7de91f800 20 add_watcher() i=5 2024-09-12T17:43:40.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.639+0000 7ff7de91f800 20 add_watcher() i=6 2024-09-12T17:43:40.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.640+0000 7ff7de91f800 20 add_watcher() i=7 2024-09-12T17:43:40.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.640+0000 7ff7de91f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:40.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.642+0000 7ff690fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:40.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.642+0000 7ff7de91f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:40.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.642+0000 7ff7de91f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:40.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.642+0000 7ff7de91f800 5 note: GC not initialized 2024-09-12T17:43:40.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.642+0000 7ff60b7fe640 20 reqs_thread_entry: start 2024-09-12T17:43:40.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.642+0000 7ff7de91f800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:40.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.643+0000 7ff7de91f800 20 Filter name: none 2024-09-12T17:43:40.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.643+0000 7ff6097fa640 20 reqs_thread_entry: start 2024-09-12T17:43:40.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.643+0000 7ff7de91f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.643+0000 7ff7de91f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:43:40.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.643+0000 7ff7de91f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.644+0000 7ff7de91f800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:43:40.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.644+0000 7ff7de91f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:40.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.644+0000 7ff7de91f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.644+0000 7ff7de91f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:43:40.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.644+0000 7ff7de91f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.645+0000 7ff7de91f800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:43:40.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.645+0000 7ff7de91f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:40.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.647+0000 7ff690fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:40.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.649+0000 7ff7de91f800 20 remove_watcher() i=0 2024-09-12T17:43:40.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.649+0000 7ff7de91f800 2 removed watcher, disabling cache 2024-09-12T17:43:40.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.650+0000 7ff7de91f800 20 remove_watcher() i=1 2024-09-12T17:43:40.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.650+0000 7ff7de91f800 20 remove_watcher() i=2 2024-09-12T17:43:40.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.651+0000 7ff7de91f800 20 remove_watcher() i=3 2024-09-12T17:43:40.653 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.652+0000 7ff7de91f800 20 remove_watcher() i=4 2024-09-12T17:43:40.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.653+0000 7ff7de91f800 20 remove_watcher() i=5 2024-09-12T17:43:40.655 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.654+0000 7ff7de91f800 20 remove_watcher() i=6 2024-09-12T17:43:40.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.655+0000 7ff7de91f800 20 remove_watcher() i=7 2024-09-12T17:43:40.667 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:40.667 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:43:40.667 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-block-writes id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:40.667 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:40.669 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T17:43:40.703 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:40.703 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:40.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.741+0000 7f2471d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.744+0000 7f2471d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.744+0000 7f2471d2e800 20 realm 2024-09-12T17:43:40.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.744+0000 7f2471d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.745+0000 7f2471d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.745+0000 7f2471d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:40.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.745+0000 7f2471d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.745+0000 7f2471d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.745+0000 7f2471d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.746+0000 7f2471d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:40.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.746+0000 7f2471d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.746+0000 7f2471d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:40.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.746+0000 7f2471d2e800 20 searching for the correct realm 2024-09-12T17:43:40.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.749+0000 7f246d16a640 0 -- 172.21.15.44:0/2767181383 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f246004c030 msgr2=0x7f2460072150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:40.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.752+0000 7f246d96b640 0 -- 172.21.15.44:0/2767181383 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f246403a410 msgr2=0x7f246403a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:40.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.959+0000 7f2471d2e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:40.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.959+0000 7f2471d2e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:40.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.959+0000 7f2471d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:40.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.959+0000 7f2471d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:40.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.959+0000 7f2471d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:40.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.959+0000 7f2471d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:40.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.959+0000 7f2471d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.961 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.959+0000 7f2471d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.961 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.959+0000 7f2471d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.961 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.959+0000 7f2471d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:40.961 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.959+0000 7f2471d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.960+0000 7f2471d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:40.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.960+0000 7f2471d2e800 20 zone default found 2024-09-12T17:43:40.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.960+0000 7f2471d2e800 4 Realm: () 2024-09-12T17:43:40.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.960+0000 7f2471d2e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:40.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.960+0000 7f2471d2e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:40.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.960+0000 7f2471d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:40.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.960+0000 7f2471d2e800 20 zonegroup default 2024-09-12T17:43:40.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.960+0000 7f2471d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.960+0000 7f2471d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.960+0000 7f2471d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.960+0000 7f2471d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.960+0000 7f2471d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.961+0000 7f2471d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:40.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.961+0000 7f2471d2e800 20 started sync module instance, tier type = 2024-09-12T17:43:40.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.961+0000 7f2471d2e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:40.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.970+0000 7f2471d2e800 20 add_watcher() i=0 2024-09-12T17:43:40.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.970+0000 7f2471d2e800 20 add_watcher() i=1 2024-09-12T17:43:40.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.970+0000 7f2471d2e800 20 add_watcher() i=2 2024-09-12T17:43:40.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.970+0000 7f2471d2e800 20 add_watcher() i=3 2024-09-12T17:43:40.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.970+0000 7f2471d2e800 20 add_watcher() i=4 2024-09-12T17:43:40.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.970+0000 7f2471d2e800 20 add_watcher() i=5 2024-09-12T17:43:40.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.970+0000 7f2471d2e800 20 add_watcher() i=6 2024-09-12T17:43:40.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.970+0000 7f2471d2e800 20 add_watcher() i=7 2024-09-12T17:43:40.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.970+0000 7f2471d2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:40.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.972+0000 7f231ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:40.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.972+0000 7f2471d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:40.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.972+0000 7f2471d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:40.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.973+0000 7f2471d2e800 5 note: GC not initialized 2024-09-12T17:43:40.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.973+0000 7f231effd640 20 reqs_thread_entry: start 2024-09-12T17:43:40.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.973+0000 7f2471d2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:40.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.973+0000 7f2471d2e800 20 Filter name: none 2024-09-12T17:43:40.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.973+0000 7f231cff9640 20 reqs_thread_entry: start 2024-09-12T17:43:40.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.973+0000 7f2471d2e800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:43:40.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.973+0000 7f2471d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.973+0000 7f2471d2e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:43:40.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.974+0000 7f2471d2e800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:43:40.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.974+0000 7f2471d2e800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:43:40.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.974+0000 7f2471d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 : miss 2024-09-12T17:43:40.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.974+0000 7f2471d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:40.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.974+0000 7f2471d2e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:43:40.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.974+0000 7f2471d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 info.flags=0x17 2024-09-12T17:43:40.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.974+0000 7f2471d2e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 to cache LRU end 2024-09-12T17:43:40.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.974+0000 7f2471d2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:40.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.974+0000 7f2471d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:40.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.974+0000 7f2471d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 2024-09-12T17:43:40.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.980+0000 7f2471d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 info.flags=0x17 2024-09-12T17:43:40.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.980+0000 7f2471d2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 to cache LRU end 2024-09-12T17:43:40.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.980+0000 7f2471d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:40.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.980+0000 7f2471d2e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29, ofs0, ns] 2024-09-12T17:43:40.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.980+0000 7f23517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562427 cookie 94012949157808 notifier 7092 bl.length()=999 2024-09-12T17:43:40.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.980+0000 7f23517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 info.flags=0x17 2024-09-12T17:43:40.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.980+0000 7f23517fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 to cache LRU end 2024-09-12T17:43:40.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.980+0000 7f23517fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:40.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.980+0000 7f2471d2e800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): orig_sources= new_sources= 2024-09-12T17:43:40.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.980+0000 7f2471d2e800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): potential sources added=[] removed=[] 2024-09-12T17:43:40.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.980+0000 7f2471d2e800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): orig_dests= new_dests= 2024-09-12T17:43:40.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.980+0000 7f2471d2e800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): potential dests added=[] removed=[] 2024-09-12T17:43:40.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.0 2024-09-12T17:43:40.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.0 2024-09-12T17:43:40.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.1 2024-09-12T17:43:40.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.1 2024-09-12T17:43:40.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.2 2024-09-12T17:43:40.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.2 2024-09-12T17:43:40.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.3 2024-09-12T17:43:40.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.3 2024-09-12T17:43:40.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.4 2024-09-12T17:43:40.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.4 2024-09-12T17:43:40.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.5 2024-09-12T17:43:40.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.5 2024-09-12T17:43:40.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.6 2024-09-12T17:43:40.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.6 2024-09-12T17:43:40.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.7 2024-09-12T17:43:40.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.7 2024-09-12T17:43:40.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.8 2024-09-12T17:43:40.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.8 2024-09-12T17:43:40.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.9 2024-09-12T17:43:40.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.9 2024-09-12T17:43:40.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.10 2024-09-12T17:43:40.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.10 2024-09-12T17:43:40.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.11 2024-09-12T17:43:40.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.11 2024-09-12T17:43:40.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.985+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.0 2024-09-12T17:43:40.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.986+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1 2024-09-12T17:43:40.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.986+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.2 2024-09-12T17:43:40.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.987+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.3 2024-09-12T17:43:40.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.987+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.4 2024-09-12T17:43:40.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.988+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.5 2024-09-12T17:43:40.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.989+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.6 2024-09-12T17:43:40.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.989+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.7 2024-09-12T17:43:40.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.990+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.8 2024-09-12T17:43:40.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.990+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.9 2024-09-12T17:43:40.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.991+0000 7f2471d2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.10 2024-09-12T17:43:40.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.994+0000 7f2471d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:40.994 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.994+0000 7f2471d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 2024-09-12T17:43:40.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.995+0000 7f2471d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 info.flags=0x17 2024-09-12T17:43:40.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.995+0000 7f2471d2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 to cache LRU end 2024-09-12T17:43:40.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.995+0000 7f2471d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:40.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.995+0000 7f2471d2e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29, ofs0, ns] 2024-09-12T17:43:40.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.995+0000 7f2350ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562428 cookie 94012949157808 notifier 7092 bl.length()=999 2024-09-12T17:43:40.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.995+0000 7f2350ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 info.flags=0x17 2024-09-12T17:43:40.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.995+0000 7f2350ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 to cache LRU end 2024-09-12T17:43:40.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.995+0000 7f2350ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:40.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.996+0000 7f2471d2e800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): orig_sources= new_sources= 2024-09-12T17:43:40.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.996+0000 7f2471d2e800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): potential sources added=[] removed=[] 2024-09-12T17:43:40.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.996+0000 7f2471d2e800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): orig_dests= new_dests= 2024-09-12T17:43:40.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.996+0000 7f2471d2e800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): potential dests added=[] removed=[] 2024-09-12T17:43:40.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.996+0000 7f2471d2e800 -1 Injecting error=-5 at location=block_writes 2024-09-12T17:43:40.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:40.996+0000 7f2471d2e800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:43:41.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.001+0000 7f2471d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:41.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.001+0000 7f2471d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 2024-09-12T17:43:41.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.002+0000 7f2471d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 info.flags=0x17 2024-09-12T17:43:41.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.002+0000 7f2471d2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 to cache LRU end 2024-09-12T17:43:41.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.002+0000 7f2471d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:41.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.002+0000 7f2471d2e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29, ofs0, ns] 2024-09-12T17:43:41.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.002+0000 7f2350ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562429 cookie 94012949157808 notifier 7092 bl.length()=967 2024-09-12T17:43:41.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.002+0000 7f2350ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 info.flags=0x17 2024-09-12T17:43:41.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.002+0000 7f2350ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 to cache LRU end 2024-09-12T17:43:41.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.002+0000 7f2350ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:41.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.003+0000 7f2471d2e800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): orig_sources= new_sources= 2024-09-12T17:43:41.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.003+0000 7f2471d2e800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): potential sources added=[] removed=[] 2024-09-12T17:43:41.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.003+0000 7f2471d2e800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): orig_dests= new_dests= 2024-09-12T17:43:41.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.003+0000 7f2471d2e800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): potential dests added=[] removed=[] 2024-09-12T17:43:41.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.005+0000 7f2471d2e800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T17:43:41.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.007+0000 7f231ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:41.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.009+0000 7f2471d2e800 20 remove_watcher() i=0 2024-09-12T17:43:41.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.009+0000 7f2471d2e800 2 removed watcher, disabling cache 2024-09-12T17:43:41.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.010+0000 7f2471d2e800 20 remove_watcher() i=1 2024-09-12T17:43:41.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.011+0000 7f2471d2e800 20 remove_watcher() i=2 2024-09-12T17:43:41.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.012+0000 7f2471d2e800 20 remove_watcher() i=3 2024-09-12T17:43:41.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.013+0000 7f2471d2e800 20 remove_watcher() i=4 2024-09-12T17:43:41.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.014+0000 7f2471d2e800 20 remove_watcher() i=5 2024-09-12T17:43:41.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.015+0000 7f2471d2e800 20 remove_watcher() i=6 2024-09-12T17:43:41.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.016+0000 7f2471d2e800 20 remove_watcher() i=7 2024-09-12T17:43:41.029 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:43:41.059 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:41.059 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:41.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.096+0000 7f6849f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.098+0000 7f6849f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.098+0000 7f6849f2e800 20 realm 2024-09-12T17:43:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.098+0000 7f6849f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.099+0000 7f6849f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.099+0000 7f6849f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:41.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.099+0000 7f6849f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.099+0000 7f6849f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.099+0000 7f6849f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.100+0000 7f6849f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:41.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.100+0000 7f6849f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.100+0000 7f6849f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:41.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.100+0000 7f6849f2e800 20 searching for the correct realm 2024-09-12T17:43:41.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.103+0000 7f6845363640 0 -- 172.21.15.44:0/3004576570 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x560674ea29f0 msgr2=0x560674ea4e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:41.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.107+0000 7f6845b64640 0 -- 172.21.15.44:0/3004576570 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f683c09ab80 msgr2=0x7f683c051820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:41.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.111+0000 7f6849f2e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:41.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.111+0000 7f6849f2e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:41.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.111+0000 7f6849f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:41.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.111+0000 7f6849f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:41.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.111+0000 7f6849f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:41.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.111+0000 7f6849f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:41.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.111+0000 7f6849f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.112+0000 7f6849f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.112+0000 7f6849f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.112+0000 7f6849f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:41.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.112+0000 7f6849f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.112+0000 7f6849f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:41.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.112+0000 7f6849f2e800 20 zone default found 2024-09-12T17:43:41.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.112+0000 7f6849f2e800 4 Realm: () 2024-09-12T17:43:41.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.112+0000 7f6849f2e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:41.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.112+0000 7f6849f2e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:41.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.112+0000 7f6849f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:41.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.112+0000 7f6849f2e800 20 zonegroup default 2024-09-12T17:43:41.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.112+0000 7f6849f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.112+0000 7f6849f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.112+0000 7f6849f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.113+0000 7f6849f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.113+0000 7f6849f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.113+0000 7f6849f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.113+0000 7f6849f2e800 20 started sync module instance, tier type = 2024-09-12T17:43:41.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.113+0000 7f6849f2e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:41.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.122+0000 7f6849f2e800 20 add_watcher() i=0 2024-09-12T17:43:41.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.122+0000 7f6849f2e800 20 add_watcher() i=1 2024-09-12T17:43:41.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.122+0000 7f6849f2e800 20 add_watcher() i=2 2024-09-12T17:43:41.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.122+0000 7f6849f2e800 20 add_watcher() i=3 2024-09-12T17:43:41.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.122+0000 7f6849f2e800 20 add_watcher() i=4 2024-09-12T17:43:41.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.122+0000 7f6849f2e800 20 add_watcher() i=5 2024-09-12T17:43:41.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.122+0000 7f6849f2e800 20 add_watcher() i=6 2024-09-12T17:43:41.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.122+0000 7f6849f2e800 20 add_watcher() i=7 2024-09-12T17:43:41.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.122+0000 7f6849f2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:41.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.124+0000 7f66f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:41.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.124+0000 7f6849f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:41.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.124+0000 7f6849f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:41.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.124+0000 7f6849f2e800 5 note: GC not initialized 2024-09-12T17:43:41.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.125+0000 7f66f67fc640 20 reqs_thread_entry: start 2024-09-12T17:43:41.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.125+0000 7f6849f2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:41.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.125+0000 7f6849f2e800 20 Filter name: none 2024-09-12T17:43:41.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.125+0000 7f6667fff640 20 reqs_thread_entry: start 2024-09-12T17:43:41.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.125+0000 7f6849f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.125+0000 7f6849f2e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:43:41.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.125+0000 7f6849f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.126+0000 7f6849f2e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:43:41.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.126+0000 7f6849f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:41.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.126+0000 7f6849f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.126+0000 7f6849f2e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:43:41.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.126+0000 7f6849f2e800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.127+0000 7f6849f2e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:43:41.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.127+0000 7f6849f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:41.129 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.129+0000 7f66f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:41.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.131+0000 7f6849f2e800 20 remove_watcher() i=0 2024-09-12T17:43:41.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.131+0000 7f6849f2e800 2 removed watcher, disabling cache 2024-09-12T17:43:41.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.132+0000 7f6849f2e800 20 remove_watcher() i=1 2024-09-12T17:43:41.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.133+0000 7f6849f2e800 20 remove_watcher() i=2 2024-09-12T17:43:41.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.133+0000 7f6849f2e800 20 remove_watcher() i=3 2024-09-12T17:43:41.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.134+0000 7f6849f2e800 20 remove_watcher() i=4 2024-09-12T17:43:41.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.135+0000 7f6849f2e800 20 remove_watcher() i=5 2024-09-12T17:43:41.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.136+0000 7f6849f2e800 20 remove_watcher() i=6 2024-09-12T17:43:41.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.137+0000 7f6849f2e800 20 remove_watcher() i=7 2024-09-12T17:43:41.153 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:41.153 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:43:41.153 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-block-writes id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:41.153 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:41.201 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:43:41.234 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:41.234 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:41.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.272+0000 7f333dd34800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.274+0000 7f333dd34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.274+0000 7f333dd34800 20 realm 2024-09-12T17:43:41.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.274+0000 7f333dd34800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.274+0000 7f333dd34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.274+0000 7f333dd34800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:41.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.274+0000 7f333dd34800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.274+0000 7f333dd34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.274+0000 7f333dd34800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.275+0000 7f333dd34800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:41.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.275+0000 7f333dd34800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.275+0000 7f333dd34800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:41.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.275+0000 7f333dd34800 20 searching for the correct realm 2024-09-12T17:43:41.279 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.279+0000 7f333a2b8640 0 -- 172.21.15.44:0/1772304109 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f3324030070 msgr2=0x7f3324035040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:41.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.282+0000 7f3339ab7640 0 -- 172.21.15.44:0/1772304109 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f3324079540 msgr2=0x7f33240463d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:41.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.489+0000 7f333dd34800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:41.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.489+0000 7f333dd34800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:41.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.489+0000 7f333dd34800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:41.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.489+0000 7f333dd34800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:41.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.489+0000 7f333dd34800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:41.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.489+0000 7f333dd34800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:41.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.489+0000 7f333dd34800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.489+0000 7f333dd34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.489+0000 7f333dd34800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.489+0000 7f333dd34800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:41.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.489+0000 7f333dd34800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.490+0000 7f333dd34800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:41.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.490+0000 7f333dd34800 20 zone default found 2024-09-12T17:43:41.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.490+0000 7f333dd34800 4 Realm: () 2024-09-12T17:43:41.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.490+0000 7f333dd34800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:41.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.490+0000 7f333dd34800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:41.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.490+0000 7f333dd34800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:41.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.490+0000 7f333dd34800 20 zonegroup default 2024-09-12T17:43:41.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.490+0000 7f333dd34800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.490+0000 7f333dd34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.490+0000 7f333dd34800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.490+0000 7f333dd34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.490+0000 7f333dd34800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.490+0000 7f333dd34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.490+0000 7f333dd34800 20 started sync module instance, tier type = 2024-09-12T17:43:41.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.490+0000 7f333dd34800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:41.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.500+0000 7f333dd34800 20 add_watcher() i=0 2024-09-12T17:43:41.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.500+0000 7f333dd34800 20 add_watcher() i=1 2024-09-12T17:43:41.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.500+0000 7f333dd34800 20 add_watcher() i=2 2024-09-12T17:43:41.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.500+0000 7f333dd34800 20 add_watcher() i=3 2024-09-12T17:43:41.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.500+0000 7f333dd34800 20 add_watcher() i=4 2024-09-12T17:43:41.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.500+0000 7f333dd34800 20 add_watcher() i=5 2024-09-12T17:43:41.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.500+0000 7f333dd34800 20 add_watcher() i=6 2024-09-12T17:43:41.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.501+0000 7f333dd34800 20 add_watcher() i=7 2024-09-12T17:43:41.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.501+0000 7f333dd34800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:41.503 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.503+0000 7f31eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:41.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.503+0000 7f333dd34800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:41.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.503+0000 7f333dd34800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:41.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.503+0000 7f333dd34800 5 note: GC not initialized 2024-09-12T17:43:41.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.503+0000 7f31ea7fc640 20 reqs_thread_entry: start 2024-09-12T17:43:41.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.503+0000 7f333dd34800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:41.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.503+0000 7f333dd34800 20 Filter name: none 2024-09-12T17:43:41.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.504+0000 7f315ffff640 20 reqs_thread_entry: start 2024-09-12T17:43:41.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.504+0000 7f333dd34800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:43:41.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.504+0000 7f333dd34800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.504+0000 7f333dd34800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:43:41.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.504+0000 7f333dd34800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:43:41.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.504+0000 7f333dd34800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:43:41.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.504+0000 7f333dd34800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 : miss 2024-09-12T17:43:41.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.504+0000 7f333dd34800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.505+0000 7f333dd34800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:43:41.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.505+0000 7f333dd34800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 info.flags=0x17 2024-09-12T17:43:41.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.505+0000 7f333dd34800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 to cache LRU end 2024-09-12T17:43:41.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.505+0000 7f333dd34800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:41.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.505+0000 7f333dd34800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:41.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.505+0000 7f333dd34800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 2024-09-12T17:43:41.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.510+0000 7f333dd34800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 info.flags=0x17 2024-09-12T17:43:41.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.510+0000 7f333dd34800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 to cache LRU end 2024-09-12T17:43:41.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.510+0000 7f333dd34800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:41.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.510+0000 7f333dd34800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29, ofs0, ns] 2024-09-12T17:43:41.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.511+0000 7f321d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562430 cookie 94033023579568 notifier 6665 bl.length()=999 2024-09-12T17:43:41.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.511+0000 7f321d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 info.flags=0x17 2024-09-12T17:43:41.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.511+0000 7f321d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 to cache LRU end 2024-09-12T17:43:41.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.511+0000 7f321d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:41.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.511+0000 7f333dd34800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): orig_sources= new_sources= 2024-09-12T17:43:41.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.511+0000 7f333dd34800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): potential sources added=[] removed=[] 2024-09-12T17:43:41.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.511+0000 7f333dd34800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): orig_dests= new_dests= 2024-09-12T17:43:41.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.511+0000 7f333dd34800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): potential dests added=[] removed=[] 2024-09-12T17:43:41.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.0 2024-09-12T17:43:41.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.0 2024-09-12T17:43:41.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.1 2024-09-12T17:43:41.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.1 2024-09-12T17:43:41.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.2 2024-09-12T17:43:41.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.2 2024-09-12T17:43:41.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.3 2024-09-12T17:43:41.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.3 2024-09-12T17:43:41.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.4 2024-09-12T17:43:41.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.4 2024-09-12T17:43:41.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.5 2024-09-12T17:43:41.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.5 2024-09-12T17:43:41.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.6 2024-09-12T17:43:41.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.6 2024-09-12T17:43:41.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.7 2024-09-12T17:43:41.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.7 2024-09-12T17:43:41.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.8 2024-09-12T17:43:41.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.8 2024-09-12T17:43:41.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.9 2024-09-12T17:43:41.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.9 2024-09-12T17:43:41.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.10 2024-09-12T17:43:41.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.10 2024-09-12T17:43:41.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.11 2024-09-12T17:43:41.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1.11 2024-09-12T17:43:41.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.516+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.0 2024-09-12T17:43:41.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.517+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1 2024-09-12T17:43:41.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.517+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.2 2024-09-12T17:43:41.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.517+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.3 2024-09-12T17:43:41.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.518+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.4 2024-09-12T17:43:41.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.519+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.5 2024-09-12T17:43:41.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.519+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.6 2024-09-12T17:43:41.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.520+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.7 2024-09-12T17:43:41.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.520+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.8 2024-09-12T17:43:41.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.521+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.9 2024-09-12T17:43:41.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.521+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.10 2024-09-12T17:43:41.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.525+0000 7f333dd34800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:41.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.525+0000 7f333dd34800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 2024-09-12T17:43:41.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.526+0000 7f333dd34800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 info.flags=0x17 2024-09-12T17:43:41.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.526+0000 7f333dd34800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 to cache LRU end 2024-09-12T17:43:41.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.526+0000 7f333dd34800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:41.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.526+0000 7f333dd34800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29, ofs0, ns] 2024-09-12T17:43:41.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.526+0000 7f321d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562431 cookie 94033023579568 notifier 6665 bl.length()=999 2024-09-12T17:43:41.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.526+0000 7f321d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 info.flags=0x17 2024-09-12T17:43:41.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.526+0000 7f321d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 to cache LRU end 2024-09-12T17:43:41.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.526+0000 7f321d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:41.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.527+0000 7f333dd34800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): orig_sources= new_sources= 2024-09-12T17:43:41.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.527+0000 7f333dd34800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): potential sources added=[] removed=[] 2024-09-12T17:43:41.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.527+0000 7f333dd34800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): orig_dests= new_dests= 2024-09-12T17:43:41.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.527+0000 7f333dd34800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): potential dests added=[] removed=[] 2024-09-12T17:43:41.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.529+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.0 2024-09-12T17:43:41.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.529+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.1 2024-09-12T17:43:41.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.529+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.2 2024-09-12T17:43:41.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.530+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.3 2024-09-12T17:43:41.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.530+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.4 2024-09-12T17:43:41.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.530+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.5 2024-09-12T17:43:41.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.531+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.6 2024-09-12T17:43:41.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.531+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.7 2024-09-12T17:43:41.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.531+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.8 2024-09-12T17:43:41.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.531+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.9 2024-09-12T17:43:41.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.532+0000 7f333dd34800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29.10 2024-09-12T17:43:41.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.532+0000 7f333dd34800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:41.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.532+0000 7f333dd34800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 2024-09-12T17:43:41.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.534+0000 7f333dd34800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 info.flags=0x17 2024-09-12T17:43:41.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.534+0000 7f333dd34800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 to cache LRU end 2024-09-12T17:43:41.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.534+0000 7f333dd34800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:41.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.534+0000 7f333dd34800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29, ofs0, ns] 2024-09-12T17:43:41.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.534+0000 7f321d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562432 cookie 94033023579568 notifier 6665 bl.length()=967 2024-09-12T17:43:41.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.534+0000 7f321d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 info.flags=0x17 2024-09-12T17:43:41.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.534+0000 7f321d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 to cache LRU end 2024-09-12T17:43:41.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.534+0000 7f321d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:41.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.534+0000 7f333dd34800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): orig_sources= new_sources= 2024-09-12T17:43:41.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.534+0000 7f333dd34800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): potential sources added=[] removed=[] 2024-09-12T17:43:41.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.534+0000 7f333dd34800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): orig_dests= new_dests= 2024-09-12T17:43:41.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.534+0000 7f333dd34800 20 handle_bi_update(): bucket=:error-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29]): potential dests added=[] removed=[] 2024-09-12T17:43:41.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.536+0000 7f333dd34800 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:43:41.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.538+0000 7f31eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:41.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.540+0000 7f333dd34800 20 remove_watcher() i=0 2024-09-12T17:43:41.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.540+0000 7f333dd34800 2 removed watcher, disabling cache 2024-09-12T17:43:41.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.541+0000 7f333dd34800 20 remove_watcher() i=1 2024-09-12T17:43:41.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.542+0000 7f333dd34800 20 remove_watcher() i=2 2024-09-12T17:43:41.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.543+0000 7f333dd34800 20 remove_watcher() i=3 2024-09-12T17:43:41.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.544+0000 7f333dd34800 20 remove_watcher() i=4 2024-09-12T17:43:41.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.545+0000 7f333dd34800 20 remove_watcher() i=5 2024-09-12T17:43:41.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.546+0000 7f333dd34800 20 remove_watcher() i=6 2024-09-12T17:43:41.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.547+0000 7f333dd34800 20 remove_watcher() i=7 2024-09-12T17:43:41.560 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:43:41.589 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:41.589 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:41.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.627+0000 7f638a735800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.629+0000 7f638a735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.629+0000 7f638a735800 20 realm 2024-09-12T17:43:41.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.629+0000 7f638a735800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.629+0000 7f638a735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.629+0000 7f638a735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:41.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.629+0000 7f638a735800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.629+0000 7f638a735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.629+0000 7f638a735800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.631 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.630+0000 7f638a735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:41.631 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.630+0000 7f638a735800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.631 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.630+0000 7f638a735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:41.631 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.630+0000 7f638a735800 20 searching for the correct realm 2024-09-12T17:43:41.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.634+0000 7f6386ce5640 0 -- 172.21.15.44:0/1072353400 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f637c04b040 msgr2=0x7f637c04c940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:41.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.637+0000 7f63864e4640 0 -- 172.21.15.44:0/1072353400 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f637c031040 msgr2=0x7f637c05e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:41.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.843+0000 7f638a735800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:41.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.843+0000 7f638a735800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:41.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.843+0000 7f638a735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:41.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.843+0000 7f638a735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:41.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.843+0000 7f638a735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:41.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.843+0000 7f638a735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:41.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.843+0000 7f638a735800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.843+0000 7f638a735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.844+0000 7f638a735800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.844+0000 7f638a735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:41.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.844+0000 7f638a735800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.844+0000 7f638a735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:41.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.844+0000 7f638a735800 20 zone default found 2024-09-12T17:43:41.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.844+0000 7f638a735800 4 Realm: () 2024-09-12T17:43:41.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.844+0000 7f638a735800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:41.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.844+0000 7f638a735800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:41.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.844+0000 7f638a735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:41.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.844+0000 7f638a735800 20 zonegroup default 2024-09-12T17:43:41.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.844+0000 7f638a735800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.844+0000 7f638a735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.844+0000 7f638a735800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.845+0000 7f638a735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.845+0000 7f638a735800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.845+0000 7f638a735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:41.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.845+0000 7f638a735800 20 started sync module instance, tier type = 2024-09-12T17:43:41.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.845+0000 7f638a735800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:41.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.854+0000 7f638a735800 20 add_watcher() i=0 2024-09-12T17:43:41.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.854+0000 7f638a735800 20 add_watcher() i=1 2024-09-12T17:43:41.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.854+0000 7f638a735800 20 add_watcher() i=2 2024-09-12T17:43:41.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.854+0000 7f638a735800 20 add_watcher() i=3 2024-09-12T17:43:41.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.854+0000 7f638a735800 20 add_watcher() i=4 2024-09-12T17:43:41.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.854+0000 7f638a735800 20 add_watcher() i=5 2024-09-12T17:43:41.855 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.854+0000 7f638a735800 20 add_watcher() i=6 2024-09-12T17:43:41.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.855+0000 7f638a735800 20 add_watcher() i=7 2024-09-12T17:43:41.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.855+0000 7f638a735800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:41.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.857+0000 7f623cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:41.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.857+0000 7f638a735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:41.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.857+0000 7f638a735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:41.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.857+0000 7f638a735800 5 note: GC not initialized 2024-09-12T17:43:41.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.858+0000 7f61b77fe640 20 reqs_thread_entry: start 2024-09-12T17:43:41.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.858+0000 7f638a735800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:41.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.858+0000 7f638a735800 20 Filter name: none 2024-09-12T17:43:41.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.858+0000 7f61b57fa640 20 reqs_thread_entry: start 2024-09-12T17:43:41.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.858+0000 7f638a735800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.858+0000 7f638a735800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:43:41.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.858+0000 7f638a735800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.859+0000 7f638a735800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:43:41.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.859+0000 7f638a735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:41.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.859+0000 7f638a735800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.860+0000 7f638a735800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:43:41.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.860+0000 7f638a735800 20 rados->read ofs=0 len=0 2024-09-12T17:43:41.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.860+0000 7f638a735800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:43:41.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.860+0000 7f638a735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:41.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.863+0000 7f623cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:41.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.865+0000 7f638a735800 20 remove_watcher() i=0 2024-09-12T17:43:41.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.865+0000 7f638a735800 2 removed watcher, disabling cache 2024-09-12T17:43:41.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.866+0000 7f638a735800 20 remove_watcher() i=1 2024-09-12T17:43:41.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.867+0000 7f638a735800 20 remove_watcher() i=2 2024-09-12T17:43:41.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.868+0000 7f638a735800 20 remove_watcher() i=3 2024-09-12T17:43:41.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.869+0000 7f638a735800 20 remove_watcher() i=4 2024-09-12T17:43:41.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.870+0000 7f638a735800 20 remove_watcher() i=5 2024-09-12T17:43:41.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.871+0000 7f638a735800 20 remove_watcher() i=6 2024-09-12T17:43:41.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:41.872+0000 7f638a735800 20 remove_watcher() i=7 2024-09-12T17:43:41.884 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:41.884 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:43:41.884 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-block-writes id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:43:41.884 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:41.961 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T17:43:41.961 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.167 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:43:42.197 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:42.197 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:42.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.237+0000 7f1b21e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.239+0000 7f1b21e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.239+0000 7f1b21e0f800 20 realm 2024-09-12T17:43:42.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.239+0000 7f1b21e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.239+0000 7f1b21e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.239+0000 7f1b21e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:42.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.239+0000 7f1b21e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.239+0000 7f1b21e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.239+0000 7f1b21e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.240+0000 7f1b21e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:42.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.240+0000 7f1b21e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.241+0000 7f1b21e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:42.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.241+0000 7f1b21e0f800 20 searching for the correct realm 2024-09-12T17:43:42.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.242+0000 7f1b200fa640 0 -- 172.21.15.44:0/1510114717 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f1b0809a070 msgr2=0x7f1b080a10b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:42.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.245+0000 7f1b200fa640 0 -- 172.21.15.44:0/1510114717 >> [v2:172.21.15.181:6810/2228110208,v1:172.21.15.181:6811/2228110208] conn(0x7f1b08029040 msgr2=0x7f1b080727c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:42.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.251+0000 7f1b21e0f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:42.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.251+0000 7f1b21e0f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:42.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.251+0000 7f1b21e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:42.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.251+0000 7f1b21e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:42.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.251+0000 7f1b21e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:42.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.251+0000 7f1b21e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:42.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.251+0000 7f1b21e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.252+0000 7f1b21e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.252+0000 7f1b21e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.252+0000 7f1b21e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:42.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.252+0000 7f1b21e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.252+0000 7f1b21e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:42.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.252+0000 7f1b21e0f800 20 zone default found 2024-09-12T17:43:42.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.252+0000 7f1b21e0f800 4 Realm: () 2024-09-12T17:43:42.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.252+0000 7f1b21e0f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:42.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.252+0000 7f1b21e0f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:42.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.252+0000 7f1b21e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:42.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.252+0000 7f1b21e0f800 20 zonegroup default 2024-09-12T17:43:42.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.252+0000 7f1b21e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.252+0000 7f1b21e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.252+0000 7f1b21e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.253+0000 7f1b21e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.253+0000 7f1b21e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.253+0000 7f1b21e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.253+0000 7f1b21e0f800 20 started sync module instance, tier type = 2024-09-12T17:43:42.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.253+0000 7f1b21e0f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:42.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.262+0000 7f1b21e0f800 20 add_watcher() i=0 2024-09-12T17:43:42.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.262+0000 7f1b21e0f800 20 add_watcher() i=1 2024-09-12T17:43:42.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.262+0000 7f1b21e0f800 20 add_watcher() i=2 2024-09-12T17:43:42.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.262+0000 7f1b21e0f800 20 add_watcher() i=3 2024-09-12T17:43:42.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.262+0000 7f1b21e0f800 20 add_watcher() i=4 2024-09-12T17:43:42.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.262+0000 7f1b21e0f800 20 add_watcher() i=5 2024-09-12T17:43:42.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.262+0000 7f1b21e0f800 20 add_watcher() i=6 2024-09-12T17:43:42.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.262+0000 7f1b21e0f800 20 add_watcher() i=7 2024-09-12T17:43:42.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.262+0000 7f1b21e0f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:42.265 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.264+0000 7f19d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:42.265 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.264+0000 7f1b21e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:42.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.264+0000 7f1b21e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:42.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.264+0000 7f1b21e0f800 5 note: GC not initialized 2024-09-12T17:43:42.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.265+0000 7f19d4fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:42.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.265+0000 7f1b21e0f800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:42.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.265+0000 7f1b21e0f800 20 Filter name: none 2024-09-12T17:43:42.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.265+0000 7f194e7fc640 20 reqs_thread_entry: start 2024-09-12T17:43:42.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.265+0000 7f1b21e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.265+0000 7f1b21e0f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:43:42.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.265+0000 7f1b21e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.266+0000 7f1b21e0f800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:43:42.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.266+0000 7f1b21e0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:42.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.266+0000 7f1b21e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.266+0000 7f1b21e0f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:43:42.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.266+0000 7f1b21e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.267+0000 7f1b21e0f800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:43:42.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.267+0000 7f1b21e0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:42.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.268+0000 7f19d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:42.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.270+0000 7f1b21e0f800 20 remove_watcher() i=0 2024-09-12T17:43:42.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.270+0000 7f1b21e0f800 2 removed watcher, disabling cache 2024-09-12T17:43:42.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.271+0000 7f1b21e0f800 20 remove_watcher() i=1 2024-09-12T17:43:42.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.272+0000 7f1b21e0f800 20 remove_watcher() i=2 2024-09-12T17:43:42.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.273+0000 7f1b21e0f800 20 remove_watcher() i=3 2024-09-12T17:43:42.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.275+0000 7f1b21e0f800 20 remove_watcher() i=4 2024-09-12T17:43:42.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.275+0000 7f1b21e0f800 20 remove_watcher() i=5 2024-09-12T17:43:42.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.276+0000 7f1b21e0f800 20 remove_watcher() i=6 2024-09-12T17:43:42.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.277+0000 7f1b21e0f800 20 remove_watcher() i=7 2024-09-12T17:43:42.289 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.289 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:43:42.289 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-block-writes id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:42.289 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.291 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T17:43:42.325 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:42.325 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:42.364 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.363+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.365 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.365+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.365+0000 7f3093975800 20 realm 2024-09-12T17:43:42.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.365+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.365+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.365+0000 7f3093975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:42.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.365+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.365+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.365+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.366+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:42.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.366+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.366+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:42.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.366+0000 7f3093975800 20 searching for the correct realm 2024-09-12T17:43:42.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.369+0000 7f3090c5e640 0 -- 172.21.15.44:0/3896616902 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55e76646b690 msgr2=0x55e76646db50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:42.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.373+0000 7f309145f640 0 -- 172.21.15.44:0/3896616902 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f30880157d0 msgr2=0x7f30880887a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:42.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:42.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:42.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:42.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:42.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:42.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:42.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.377+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.377+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.377+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.378+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:42.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.378+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.378+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:42.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.378+0000 7f3093975800 20 zone default found 2024-09-12T17:43:42.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.378+0000 7f3093975800 4 Realm: () 2024-09-12T17:43:42.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.378+0000 7f3093975800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:42.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.378+0000 7f3093975800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:42.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.378+0000 7f3093975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:42.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.378+0000 7f3093975800 20 zonegroup default 2024-09-12T17:43:42.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.378+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.378+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.378+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.379+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.379+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.379+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.379+0000 7f3093975800 20 started sync module instance, tier type = 2024-09-12T17:43:42.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.379+0000 7f3093975800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:42.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=0 2024-09-12T17:43:42.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=1 2024-09-12T17:43:42.388 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=2 2024-09-12T17:43:42.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=3 2024-09-12T17:43:42.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=4 2024-09-12T17:43:42.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=5 2024-09-12T17:43:42.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=6 2024-09-12T17:43:42.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.389+0000 7f3093975800 20 add_watcher() i=7 2024-09-12T17:43:42.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.389+0000 7f3093975800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:42.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.390+0000 7f2f47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:42.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.391+0000 7f3093975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:42.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.391+0000 7f3093975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:42.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.391+0000 7f3093975800 5 note: GC not initialized 2024-09-12T17:43:42.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.391+0000 7f2f46fe5640 20 reqs_thread_entry: start 2024-09-12T17:43:42.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.391+0000 7f3093975800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:42.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.391+0000 7f3093975800 20 Filter name: none 2024-09-12T17:43:42.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.391+0000 7f2f44fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:42.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.391+0000 7f3093975800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:43:42.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.391+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.391+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:43:42.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.391+0000 7f3093975800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:43:42.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.391+0000 7f3093975800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:43:42.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.392+0000 7f3093975800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 : miss 2024-09-12T17:43:42.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.392+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.392+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:43:42.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.392+0000 7f3093975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:43:42.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.392+0000 7f3093975800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:43:42.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.392+0000 7f3093975800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:42.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.392+0000 7f3093975800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.392+0000 7f3093975800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 2024-09-12T17:43:42.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.397+0000 7f3093975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:43:42.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.397+0000 7f3093975800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:43:42.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.397+0000 7f3093975800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.397+0000 7f3093975800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30, ofs0, ns] 2024-09-12T17:43:42.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.397+0000 7f2f74ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562435 cookie 94452341739840 notifier 6716 bl.length()=999 2024-09-12T17:43:42.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.397+0000 7f2f74ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:43:42.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.397+0000 7f2f74ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:43:42.398 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.397+0000 7f2f74ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.398+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_sources= new_sources= 2024-09-12T17:43:42.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.398+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:43:42.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.398+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_dests= new_dests= 2024-09-12T17:43:42.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.398+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:43:42.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.0 2024-09-12T17:43:42.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.0 2024-09-12T17:43:42.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.1 2024-09-12T17:43:42.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.1 2024-09-12T17:43:42.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.2 2024-09-12T17:43:42.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.2 2024-09-12T17:43:42.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.3 2024-09-12T17:43:42.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.3 2024-09-12T17:43:42.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.4 2024-09-12T17:43:42.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.4 2024-09-12T17:43:42.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.5 2024-09-12T17:43:42.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.5 2024-09-12T17:43:42.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.6 2024-09-12T17:43:42.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.6 2024-09-12T17:43:42.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.7 2024-09-12T17:43:42.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.7 2024-09-12T17:43:42.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.8 2024-09-12T17:43:42.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.8 2024-09-12T17:43:42.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.9 2024-09-12T17:43:42.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.9 2024-09-12T17:43:42.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.10 2024-09-12T17:43:42.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.10 2024-09-12T17:43:42.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.11 2024-09-12T17:43:42.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.11 2024-09-12T17:43:42.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.0 2024-09-12T17:43:42.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1 2024-09-12T17:43:42.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.403+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2 2024-09-12T17:43:42.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.403+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.3 2024-09-12T17:43:42.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.404+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.4 2024-09-12T17:43:42.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.404+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.5 2024-09-12T17:43:42.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.405+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.6 2024-09-12T17:43:42.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.405+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.7 2024-09-12T17:43:42.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.406+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.8 2024-09-12T17:43:42.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.406+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.9 2024-09-12T17:43:42.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.407+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.10 2024-09-12T17:43:42.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.410+0000 7f3093975800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:42.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.410+0000 7f3093975800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 2024-09-12T17:43:42.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.411+0000 7f3093975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:43:42.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.411+0000 7f3093975800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:43:42.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.411+0000 7f3093975800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.411+0000 7f3093975800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30, ofs0, ns] 2024-09-12T17:43:42.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.411+0000 7f2f67fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562436 cookie 94452341739840 notifier 6716 bl.length()=999 2024-09-12T17:43:42.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.411+0000 7f2f67fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:43:42.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.411+0000 7f2f67fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:43:42.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.411+0000 7f2f67fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.412+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_sources= new_sources= 2024-09-12T17:43:42.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.412+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:43:42.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.412+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_dests= new_dests= 2024-09-12T17:43:42.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.412+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:43:42.413 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3093975800 time 2024-09-12T17:43:42.412968+0000 2024-09-12T17:43:42.413 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:43:42.414 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:42.414 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3096f8c71a] 2024-09-12T17:43:42.414 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3096f8c8d8] 2024-09-12T17:43:42.414 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e7644f9841] 2024-09-12T17:43:42.414 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55e76450879e] 2024-09-12T17:43:42.414 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e7645095d4] 2024-09-12T17:43:42.414 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:43:42.414 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3095c29590] 2024-09-12T17:43:42.414 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:43:42.415 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:43:42.415 INFO:tasks.workunit.client.0.smithi044.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:43:42.415 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f3093975800 thread_name:radosgw-admin 2024-09-12T17:43:42.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.413+0000 7f3093975800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3093975800 time 2024-09-12T17:43:42.412968+0000 2024-09-12T17:43:42.415 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:43:42.415 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.415 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:42.415 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3096f8c71a] 2024-09-12T17:43:42.415 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3096f8c8d8] 2024-09-12T17:43:42.416 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e7644f9841] 2024-09-12T17:43:42.416 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55e76450879e] 2024-09-12T17:43:42.416 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e7645095d4] 2024-09-12T17:43:42.416 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:43:42.416 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3095c29590] 2024-09-12T17:43:42.416 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:43:42.416 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:43:42.416 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.432 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:42.432 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3095c3e6f0] 2024-09-12T17:43:42.432 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3095c8b99c] 2024-09-12T17:43:42.433 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:43:42.433 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:43:42.433 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3096f8c774] 2024-09-12T17:43:42.433 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3096f8c8d8] 2024-09-12T17:43:42.433 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e7644f9841] 2024-09-12T17:43:42.433 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55e76450879e] 2024-09-12T17:43:42.433 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e7645095d4] 2024-09-12T17:43:42.433 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:43:42.433 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3095c29590] 2024-09-12T17:43:42.433 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:43:42.433 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:43:42.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.414+0000 7f3093975800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:43:42.434 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f3093975800 thread_name:radosgw-admin 2024-09-12T17:43:42.434 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.434 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:42.434 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3095c3e6f0] 2024-09-12T17:43:42.434 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3095c8b99c] 2024-09-12T17:43:42.434 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:43:42.434 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:43:42.434 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3096f8c774] 2024-09-12T17:43:42.434 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3096f8c8d8] 2024-09-12T17:43:42.434 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e7644f9841] 2024-09-12T17:43:42.434 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55e76450879e] 2024-09-12T17:43:42.434 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e7645095d4] 2024-09-12T17:43:42.435 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:43:42.435 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3095c29590] 2024-09-12T17:43:42.435 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:43:42.435 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:43:42.435 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:43:42.435 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.435 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:43:42.435 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:43:42.347+0000 7f3093975800 5 AuthRegistry(0x55e766378dc0) adding con mode: secure 2024-09-12T17:43:42.435 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:43:42.347+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.435 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:43:42.348+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.435 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:43:42.348+0000 7f3093975800 5 asok(0x55e766156730) register_command rotate-key hook 0x55e766378f08 2024-09-12T17:43:42.436 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:42.436 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:43:42.436 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient(hunting): picked mon.noname-b con 0x55e7662bb670 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:43:42.436 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient(hunting): picked mon.noname-c con 0x55e7662be510 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:43:42.436 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient(hunting): picked mon.noname-a con 0x55e7662c1a90 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:43:42.436 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.436 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.436 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.437 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:42.437 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient(hunting): authenticate will time out at 1994.984178s 2024-09-12T17:43:42.437 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient(hunting): get_auth_request con 0x55e7662be510 auth_method 0 2024-09-12T17:43:42.437 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.437 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.437 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.437 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:43:42.348+0000 7f3091c60640 10 monclient(hunting): get_auth_request con 0x55e7662c1a90 auth_method 0 2024-09-12T17:43:42.437 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:43:42.348+0000 7f3091c60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.437 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:43:42.348+0000 7f3091c60640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.437 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:43:42.348+0000 7f3091c60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.437 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.437 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.437 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.437 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:43:42.348+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.438 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:43:42.348+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.438 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:43:42.348+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.438 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient(hunting): handle_auth_done global_id 6707 payload 824 2024-09-12T17:43:42.438 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient: _finish_hunting 0 2024-09-12T17:43:42.438 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:43:42.348+0000 7f3090c5e640 1 monclient: found mon.noname-c 2024-09-12T17:43:42.438 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:43:42.438 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:42.438 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:43:42.438 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: dump: 2024-09-12T17:43:42.438 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:42.438 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:42.438 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.438 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.439 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:42.439 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.439 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:42.439 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:42.439 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:42.439 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.439 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: _finish_auth 0 2024-09-12T17:43:42.439 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: _check_auth_tickets 2024-09-12T17:43:42.439 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:43:42.348+0000 7f3093975800 5 monclient: authenticate success, global_id 6707 2024-09-12T17:43:42.439 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient: _renew_subs 2024-09-12T17:43:42.439 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:42.439 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:42.440 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:42.440 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:43:42.440 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: dump: 2024-09-12T17:43:42.440 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:42.440 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:42.440 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.440 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.440 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:42.440 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.440 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:42.440 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:42.440 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:42.440 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.441 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:43:42.348+0000 7f2f7f606640 4 set_mon_vals no callback set 2024-09-12T17:43:42.441 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient: _renew_subs 2024-09-12T17:43:42.441 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:42.441 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:43:42.348+0000 7f3093975800 1 librados: init done 2024-09-12T17:43:42.441 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:43:42.350+0000 7f2f7de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:42.441 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:43:42.350+0000 7f2f7de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:42.441 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:43:42.350+0000 7f2f7de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:42.441 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:43:42.351+0000 7f309145f640 10 monclient: get_auth_request con 0x7f2f780764a0 auth_method 0 2024-09-12T17:43:42.441 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:43:42.351+0000 7f3091c60640 10 monclient: get_auth_request con 0x55e7663a18b0 auth_method 0 2024-09-12T17:43:42.441 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:43:42.352+0000 7f309145f640 10 monclient: get_auth_request con 0x55e7663c4000 auth_method 0 2024-09-12T17:43:42.441 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:43:42.353+0000 7f3090c5e640 10 monclient: get_auth_request con 0x55e7663c7860 auth_method 0 2024-09-12T17:43:42.441 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:43:42.354+0000 7f3093975800 10 monclient: build_initial_monmap 2024-09-12T17:43:42.441 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:43:42.354+0000 7f3093975800 1 build_initial for_mkfs: 0 2024-09-12T17:43:42.441 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:43:42.354+0000 7f3093975800 10 monclient: monmap: 2024-09-12T17:43:42.442 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:43:42.442 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:42.442 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:43:42.442 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:43:42.442 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:42.442 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.442 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:43:42.442 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:43:42.442 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:43:42.442 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.442 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding auth protocol: cephx 2024-09-12T17:43:42.442 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding auth protocol: cephx 2024-09-12T17:43:42.442 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding auth protocol: cephx 2024-09-12T17:43:42.442 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: secure 2024-09-12T17:43:42.443 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: crc 2024-09-12T17:43:42.443 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: secure 2024-09-12T17:43:42.443 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: crc 2024-09-12T17:43:42.443 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: secure 2024-09-12T17:43:42.443 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: crc 2024-09-12T17:43:42.443 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: crc 2024-09-12T17:43:42.443 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: secure 2024-09-12T17:43:42.443 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: crc 2024-09-12T17:43:42.443 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: secure 2024-09-12T17:43:42.443 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: crc 2024-09-12T17:43:42.443 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: secure 2024-09-12T17:43:42.443 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:43:42.354+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.443 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:43:42.354+0000 7f3093975800 5 asok(0x55e766156730) register_command objecter_requests cmddesc objecter_requests hook 0x55e7663d0c60 EEXIST 2024-09-12T17:43:42.444 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:43:42.354+0000 7f3093975800 10 monclient: init 2024-09-12T17:43:42.444 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding auth protocol: cephx 2024-09-12T17:43:42.444 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding auth protocol: cephx 2024-09-12T17:43:42.444 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding auth protocol: cephx 2024-09-12T17:43:42.444 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: secure 2024-09-12T17:43:42.444 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: crc 2024-09-12T17:43:42.444 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: secure 2024-09-12T17:43:42.444 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: crc 2024-09-12T17:43:42.444 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: secure 2024-09-12T17:43:42.444 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: crc 2024-09-12T17:43:42.444 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: crc 2024-09-12T17:43:42.444 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: secure 2024-09-12T17:43:42.444 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: crc 2024-09-12T17:43:42.444 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: secure 2024-09-12T17:43:42.445 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: crc 2024-09-12T17:43:42.445 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: secure 2024-09-12T17:43:42.445 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:43:42.355+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.445 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:43:42.355+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.445 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:43:42.355+0000 7f3093975800 5 asok(0x55e766156730) register_command rotate-key cmddesc rotate-key hook 0x55e7663cc370 EEXIST 2024-09-12T17:43:42.445 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:42.445 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:43:42.445 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient(hunting): picked mon.noname-a con 0x55e7663f4950 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:43:42.445 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient(hunting): picked mon.noname-b con 0x55e7663f6c20 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:43:42.445 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient(hunting): picked mon.noname-c con 0x55e7663f3120 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:43:42.445 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.445 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.445 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.445 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:42.446 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient(hunting): authenticate will time out at 1994.991345s 2024-09-12T17:43:42.446 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient(hunting): get_auth_request con 0x55e7663f4950 auth_method 0 2024-09-12T17:43:42.446 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.446 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.446 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.446 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:43:42.355+0000 7f3091c60640 10 monclient(hunting): get_auth_request con 0x55e7663f3120 auth_method 0 2024-09-12T17:43:42.446 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:43:42.355+0000 7f3091c60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.446 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:43:42.355+0000 7f3091c60640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.446 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:43:42.355+0000 7f3091c60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.446 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.446 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.447 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.447 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:43:42.355+0000 7f3090c5e640 10 monclient(hunting): get_auth_request con 0x55e7663f6c20 auth_method 0 2024-09-12T17:43:42.447 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:43:42.355+0000 7f3090c5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.447 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:43:42.355+0000 7f3090c5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.447 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:43:42.355+0000 7f3090c5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.447 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:43:42.355+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.447 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:43:42.355+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.447 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:43:42.355+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.447 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:43:42.355+0000 7f3090c5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.447 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:43:42.355+0000 7f3090c5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.447 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:43:42.355+0000 7f3090c5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.447 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient(hunting): handle_auth_done global_id 7182 payload 824 2024-09-12T17:43:42.447 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient: _finish_hunting 0 2024-09-12T17:43:42.447 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:43:42.355+0000 7f309145f640 1 monclient: found mon.noname-a 2024-09-12T17:43:42.448 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:43:42.448 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:42.448 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:43:42.448 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: dump: 2024-09-12T17:43:42.448 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:42.448 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:42.448 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.448 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.448 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:42.448 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.448 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:42.448 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:42.448 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:42.448 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.448 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: _finish_auth 0 2024-09-12T17:43:42.449 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:43:42.449 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:42.449 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:42.449 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:43:42.449 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: dump: 2024-09-12T17:43:42.449 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:42.449 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:42.449 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.449 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.449 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:42.449 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.449 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:42.449 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:42.450 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:42.450 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.450 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:43:42.356+0000 7f3093975800 5 monclient: authenticate success, global_id 7182 2024-09-12T17:43:42.450 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:43:42.356+0000 7f3093975800 10 monclient: _renew_subs 2024-09-12T17:43:42.450 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:43:42.356+0000 7f3092461640 4 set_mon_vals no callback set 2024-09-12T17:43:42.450 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:43:42.356+0000 7f3093975800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:43:42.450 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:43:42.356+0000 7f3093975800 10 monclient: _renew_subs 2024-09-12T17:43:42.450 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:43:42.356+0000 7f3093975800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:43:42.450 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:43:42.357+0000 7f2f76ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:42.450 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:43:42.358+0000 7f2f76ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:42.450 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:43:42.358+0000 7f2f76ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:42.451 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:43:42.358+0000 7f3093975800 10 monclient: get_monmap_and_config 2024-09-12T17:43:42.451 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:43:42.358+0000 7f3093975800 10 monclient: build_initial_monmap 2024-09-12T17:43:42.451 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:43:42.358+0000 7f3093975800 1 build_initial for_mkfs: 0 2024-09-12T17:43:42.451 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:43:42.358+0000 7f3090c5e640 10 monclient: get_auth_request con 0x7f2f68076380 auth_method 0 2024-09-12T17:43:42.451 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:43:42.358+0000 7f3093975800 10 monclient: monmap: 2024-09-12T17:43:42.451 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:43:42.451 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:42.451 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:43:42.451 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:43:42.451 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:42.451 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.451 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:43:42.452 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:43:42.452 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:43:42.452 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.452 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding auth protocol: cephx 2024-09-12T17:43:42.452 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding auth protocol: cephx 2024-09-12T17:43:42.452 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding auth protocol: cephx 2024-09-12T17:43:42.452 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: secure 2024-09-12T17:43:42.452 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: crc 2024-09-12T17:43:42.452 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: secure 2024-09-12T17:43:42.452 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: crc 2024-09-12T17:43:42.452 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: secure 2024-09-12T17:43:42.452 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: crc 2024-09-12T17:43:42.452 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: crc 2024-09-12T17:43:42.453 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: secure 2024-09-12T17:43:42.453 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: crc 2024-09-12T17:43:42.453 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: secure 2024-09-12T17:43:42.453 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: crc 2024-09-12T17:43:42.453 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: secure 2024-09-12T17:43:42.453 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:43:42.358+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.453 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:43:42.358+0000 7f3093975800 10 monclient: init 2024-09-12T17:43:42.453 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding auth protocol: cephx 2024-09-12T17:43:42.453 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding auth protocol: cephx 2024-09-12T17:43:42.454 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding auth protocol: cephx 2024-09-12T17:43:42.454 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: secure 2024-09-12T17:43:42.454 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: crc 2024-09-12T17:43:42.454 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: secure 2024-09-12T17:43:42.454 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: crc 2024-09-12T17:43:42.454 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: secure 2024-09-12T17:43:42.454 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: crc 2024-09-12T17:43:42.454 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: crc 2024-09-12T17:43:42.454 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: secure 2024-09-12T17:43:42.454 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: crc 2024-09-12T17:43:42.454 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: secure 2024-09-12T17:43:42.454 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: crc 2024-09-12T17:43:42.454 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: secure 2024-09-12T17:43:42.454 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:43:42.359+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.455 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:43:42.359+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.455 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:43:42.359+0000 7f3093975800 5 asok(0x55e766156730) register_command rotate-key cmddesc rotate-key hook 0x7ffce93015a8 EEXIST 2024-09-12T17:43:42.455 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:42.455 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:43:42.455 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient(hunting): picked mon.noname-a con 0x55e7664489d0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:43:42.455 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient(hunting): picked mon.noname-b con 0x55e766439320 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:43:42.455 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient(hunting): picked mon.noname-c con 0x55e766443e00 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:43:42.455 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.455 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.455 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.455 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:42.455 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient(hunting): authenticate will time out at 1994.995346s 2024-09-12T17:43:42.456 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient(hunting): get_auth_request con 0x55e7664489d0 auth_method 0 2024-09-12T17:43:42.456 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.456 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.456 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.456 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:43:42.359+0000 7f3091c60640 10 monclient(hunting): get_auth_request con 0x55e766443e00 auth_method 0 2024-09-12T17:43:42.456 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:43:42.359+0000 7f3091c60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.456 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:43:42.359+0000 7f3091c60640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.456 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:43:42.359+0000 7f3091c60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.456 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.456 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.456 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.456 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:43:42.359+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.457 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:43:42.359+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.457 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:43:42.359+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.457 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:43:42.359+0000 7f3090c5e640 10 monclient(hunting): get_auth_request con 0x55e766439320 auth_method 0 2024-09-12T17:43:42.457 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:43:42.359+0000 7f3090c5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.457 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:43:42.359+0000 7f3090c5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.457 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:43:42.359+0000 7f3090c5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.457 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient(hunting): handle_auth_done global_id 7185 payload 274 2024-09-12T17:43:42.457 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient: _finish_hunting 0 2024-09-12T17:43:42.457 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:43:42.359+0000 7f309145f640 1 monclient: found mon.noname-a 2024-09-12T17:43:42.457 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:43:42.457 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:42.457 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:43:42.457 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: dump: 2024-09-12T17:43:42.458 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:42.458 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:42.458 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.458 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.458 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:42.458 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.458 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:42.458 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:42.458 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:42.458 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.458 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: _finish_auth 0 2024-09-12T17:43:42.458 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:43:42.459 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:42.459 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:42.459 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:43:42.459 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: dump: 2024-09-12T17:43:42.459 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:42.459 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:42.459 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.459 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.459 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:42.459 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.459 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:42.459 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:42.460 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:42.460 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.460 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:43:42.359+0000 7f3093975800 5 monclient: authenticate success, global_id 7185 2024-09-12T17:43:42.460 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient: get_monmap_and_config success 2024-09-12T17:43:42.460 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:43:42.359+0000 7f3093975800 4 set_mon_vals no callback set 2024-09-12T17:43:42.460 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:43:42.360+0000 7f3093975800 10 monclient: shutdown 2024-09-12T17:43:42.460 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:43:42.360+0000 7f3093975800 10 monclient: build_initial_monmap 2024-09-12T17:43:42.460 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:43:42.360+0000 7f3093975800 1 build_initial for_mkfs: 0 2024-09-12T17:43:42.460 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:43:42.360+0000 7f3093975800 10 monclient: monmap: 2024-09-12T17:43:42.460 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:43:42.460 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:42.461 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:43:42.461 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:43:42.461 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:42.461 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.461 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:43:42.461 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:43:42.461 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:43:42.461 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.461 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding auth protocol: cephx 2024-09-12T17:43:42.461 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding auth protocol: cephx 2024-09-12T17:43:42.461 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding auth protocol: cephx 2024-09-12T17:43:42.461 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: secure 2024-09-12T17:43:42.461 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: crc 2024-09-12T17:43:42.462 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: secure 2024-09-12T17:43:42.462 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: crc 2024-09-12T17:43:42.462 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: secure 2024-09-12T17:43:42.462 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: crc 2024-09-12T17:43:42.462 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: crc 2024-09-12T17:43:42.462 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: secure 2024-09-12T17:43:42.462 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: crc 2024-09-12T17:43:42.462 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: secure 2024-09-12T17:43:42.462 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: crc 2024-09-12T17:43:42.463 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: secure 2024-09-12T17:43:42.463 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:43:42.360+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.463 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:43:42.360+0000 7f3093975800 1 librados: starting msgr at 2024-09-12T17:43:42.463 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:43:42.360+0000 7f3093975800 1 librados: starting objecter 2024-09-12T17:43:42.463 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:43:42.360+0000 7f3093975800 5 asok(0x55e766156730) register_command objecter_requests cmddesc objecter_requests hook 0x55e7663f4fd0 EEXIST 2024-09-12T17:43:42.463 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:43:42.361+0000 7f3093975800 1 librados: setting wanted keys 2024-09-12T17:43:42.463 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:43:42.361+0000 7f3093975800 1 librados: calling monclient init 2024-09-12T17:43:42.463 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient: init 2024-09-12T17:43:42.463 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding auth protocol: cephx 2024-09-12T17:43:42.463 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding auth protocol: cephx 2024-09-12T17:43:42.464 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding auth protocol: cephx 2024-09-12T17:43:42.464 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: secure 2024-09-12T17:43:42.464 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: crc 2024-09-12T17:43:42.464 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: secure 2024-09-12T17:43:42.464 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: crc 2024-09-12T17:43:42.464 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: secure 2024-09-12T17:43:42.464 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: crc 2024-09-12T17:43:42.464 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: crc 2024-09-12T17:43:42.464 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: secure 2024-09-12T17:43:42.464 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: crc 2024-09-12T17:43:42.464 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: secure 2024-09-12T17:43:42.464 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: crc 2024-09-12T17:43:42.465 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: secure 2024-09-12T17:43:42.465 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:43:42.361+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.465 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:43:42.361+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.465 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:43:42.361+0000 7f3093975800 5 asok(0x55e766156730) register_command rotate-key cmddesc rotate-key hook 0x55e76640c848 EEXIST 2024-09-12T17:43:42.465 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:42.465 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:43:42.465 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient(hunting): picked mon.noname-c con 0x55e766439320 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:43:42.465 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient(hunting): picked mon.noname-b con 0x55e766443e00 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:43:42.465 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient(hunting): picked mon.noname-a con 0x55e7664489d0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:43:42.465 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.465 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.465 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.465 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:42.465 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient(hunting): authenticate will time out at 1994.997630s 2024-09-12T17:43:42.466 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient(hunting): get_auth_request con 0x55e766439320 auth_method 0 2024-09-12T17:43:42.466 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.466 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.466 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.466 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:43:42.361+0000 7f3091c60640 10 monclient(hunting): get_auth_request con 0x55e7664489d0 auth_method 0 2024-09-12T17:43:42.466 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:43:42.361+0000 7f3091c60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.466 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:43:42.361+0000 7f3091c60640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.466 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:43:42.361+0000 7f3091c60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.466 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.466 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.466 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.466 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:43:42.361+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.467 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:43:42.361+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.467 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:43:42.361+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.467 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:43:42.361+0000 7f3090c5e640 10 monclient(hunting): get_auth_request con 0x55e766443e00 auth_method 0 2024-09-12T17:43:42.467 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:43:42.361+0000 7f3090c5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.467 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:43:42.361+0000 7f3090c5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.467 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:43:42.361+0000 7f3090c5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.467 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient(hunting): handle_auth_done global_id 6716 payload 824 2024-09-12T17:43:42.467 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient: _finish_hunting 0 2024-09-12T17:43:42.467 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:43:42.361+0000 7f309145f640 1 monclient: found mon.noname-c 2024-09-12T17:43:42.467 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:43:42.467 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:42.467 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:43:42.467 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: dump: 2024-09-12T17:43:42.467 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:42.468 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:42.468 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.468 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.468 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:42.468 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.468 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:42.468 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:42.468 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:42.468 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.468 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: _finish_auth 0 2024-09-12T17:43:42.468 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: dump: 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:42.469 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:43:42.362+0000 7f3093975800 5 monclient: authenticate success, global_id 6716 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:43:42.362+0000 7f3093975800 10 monclient: _renew_subs 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:43:42.362+0000 7f2f74ff9640 4 set_mon_vals no callback set 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:43:42.362+0000 7f3093975800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:43:42.362+0000 7f3093975800 10 monclient: _renew_subs 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:43:42.362+0000 7f3093975800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:43:42.362+0000 7f3093975800 1 librados: init done 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:43:42.362+0000 7f3093975800 5 asok(0x55e766156730) register_command cr dump hook 0x55e76643c1f8 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:43:42.363+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:43:42.364+0000 7f2f66ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:43:42.364+0000 7f2f66ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:42.470 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:43:42.364+0000 7f2f66ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:42.471 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:43:42.364+0000 7f3090c5e640 10 monclient: get_auth_request con 0x7f2f5c076470 auth_method 0 2024-09-12T17:43:42.471 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:43:42.364+0000 7f3091c60640 10 monclient: get_auth_request con 0x55e7664621e0 auth_method 0 2024-09-12T17:43:42.471 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:43:42.365+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.471 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:43:42.365+0000 7f3093975800 20 realm 2024-09-12T17:43:42.471 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:43:42.365+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.471 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:43:42.365+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.471 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:43:42.365+0000 7f3093975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:42.471 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:43:42.365+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.471 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:43:42.365+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.471 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:43:42.365+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.471 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:43:42.365+0000 7f309145f640 10 monclient: get_auth_request con 0x55e766466530 auth_method 0 2024-09-12T17:43:42.471 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:43:42.366+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:42.472 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:43:42.366+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.472 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:43:42.366+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:42.472 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:43:42.366+0000 7f3093975800 20 searching for the correct realm 2024-09-12T17:43:42.472 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:43:42.366+0000 7f3090c5e640 10 monclient: get_auth_request con 0x55e76646b690 auth_method 0 2024-09-12T17:43:42.472 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:43:42.367+0000 7f3091c60640 10 monclient: get_auth_request con 0x7f308801f060 auth_method 0 2024-09-12T17:43:42.472 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:43:42.368+0000 7f309145f640 10 monclient: get_auth_request con 0x7f308c025040 auth_method 0 2024-09-12T17:43:42.472 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:43:42.368+0000 7f3090c5e640 10 monclient: get_auth_request con 0x7f30840af040 auth_method 0 2024-09-12T17:43:42.472 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:43:42.369+0000 7f3090c5e640 0 -- 172.21.15.44:0/3896616902 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55e76646b690 msgr2=0x55e76646db50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:42.472 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:43:42.369+0000 7f2f66ffd640 1 client.6716.objecter ms_handle_reset 0x55e76646b690 session 0x55e76646b010 osd.3 2024-09-12T17:43:42.472 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:43:42.369+0000 7f2f66ffd640 10 monclient: _renew_subs 2024-09-12T17:43:42.472 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:43:42.369+0000 7f2f66ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:42.472 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:43:42.370+0000 7f3090c5e640 10 monclient: get_auth_request con 0x7f2f5c0862f0 auth_method 0 2024-09-12T17:43:42.473 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:43:42.370+0000 7f3091c60640 10 monclient: get_auth_request con 0x7f3088069040 auth_method 0 2024-09-12T17:43:42.473 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:43:42.372+0000 7f309145f640 10 monclient: get_auth_request con 0x7f30880157d0 auth_method 0 2024-09-12T17:43:42.473 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:43:42.373+0000 7f309145f640 0 -- 172.21.15.44:0/3896616902 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f30880157d0 msgr2=0x7f30880887a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:42.473 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:43:42.373+0000 7f2f66ffd640 1 client.6716.objecter ms_handle_reset 0x7f30880157d0 session 0x7f3088056040 osd.0 2024-09-12T17:43:42.473 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:43:42.373+0000 7f309145f640 10 monclient: get_auth_request con 0x55e76646b690 auth_method 0 2024-09-12T17:43:42.473 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:42.473 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:42.473 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:42.473 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:42.473 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:42.474 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:42.474 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:43:42.377+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.474 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:43:42.377+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.474 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:43:42.377+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.474 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:43:42.378+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:42.474 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:43:42.378+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.474 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:43:42.378+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:42.474 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:43:42.378+0000 7f3093975800 20 zone default found 2024-09-12T17:43:42.474 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:43:42.378+0000 7f3093975800 4 Realm: () 2024-09-12T17:43:42.474 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:43:42.378+0000 7f3093975800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:42.474 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:43:42.378+0000 7f3093975800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:42.475 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:43:42.378+0000 7f3093975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:42.475 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:43:42.378+0000 7f3093975800 20 zonegroup default 2024-09-12T17:43:42.475 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:43:42.378+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.475 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:43:42.378+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.475 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:43:42.378+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.475 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:43:42.379+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.475 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:43:42.379+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.475 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:43:42.379+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.475 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:43:42.379+0000 7f3093975800 20 started sync module instance, tier type = 2024-09-12T17:43:42.475 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:43:42.379+0000 7f3093975800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:42.475 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=0 2024-09-12T17:43:42.476 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=1 2024-09-12T17:43:42.476 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=2 2024-09-12T17:43:42.476 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=3 2024-09-12T17:43:42.476 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=4 2024-09-12T17:43:42.476 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=5 2024-09-12T17:43:42.476 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=6 2024-09-12T17:43:42.476 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:43:42.389+0000 7f3093975800 20 add_watcher() i=7 2024-09-12T17:43:42.476 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:43:42.389+0000 7f3093975800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:42.476 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding auth protocol: cephx 2024-09-12T17:43:42.476 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding auth protocol: cephx 2024-09-12T17:43:42.476 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding auth protocol: cephx 2024-09-12T17:43:42.476 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: secure 2024-09-12T17:43:42.477 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: crc 2024-09-12T17:43:42.477 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: secure 2024-09-12T17:43:42.477 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: crc 2024-09-12T17:43:42.477 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: secure 2024-09-12T17:43:42.477 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: crc 2024-09-12T17:43:42.477 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:43:42.390+0000 7f2f47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:42.477 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: crc 2024-09-12T17:43:42.477 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: secure 2024-09-12T17:43:42.477 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: crc 2024-09-12T17:43:42.477 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: secure 2024-09-12T17:43:42.477 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: crc 2024-09-12T17:43:42.477 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: secure 2024-09-12T17:43:42.477 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:43:42.391+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.478 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:43:42.391+0000 7f3093975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:42.478 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:43:42.391+0000 7f3093975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:42.478 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:43:42.391+0000 7f3093975800 5 asok(0x55e766156730) register_command cache list hook 0x55e76643aec0 2024-09-12T17:43:42.478 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:43:42.391+0000 7f3093975800 5 asok(0x55e766156730) register_command cache inspect hook 0x55e76643aec0 2024-09-12T17:43:42.478 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:43:42.391+0000 7f3093975800 5 asok(0x55e766156730) register_command cache erase hook 0x55e76643aec0 2024-09-12T17:43:42.478 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:43:42.391+0000 7f3093975800 5 asok(0x55e766156730) register_command cache zap hook 0x55e76643aec0 2024-09-12T17:43:42.478 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:43:42.391+0000 7f3093975800 5 note: GC not initialized 2024-09-12T17:43:42.478 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:43:42.391+0000 7f2f46fe5640 20 reqs_thread_entry: start 2024-09-12T17:43:42.478 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:43:42.391+0000 7f3093975800 5 asok(0x55e766156730) register_command sync trace show hook 0x7f308408f020 2024-09-12T17:43:42.478 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:43:42.391+0000 7f3093975800 5 asok(0x55e766156730) register_command sync trace history hook 0x7f308408f020 2024-09-12T17:43:42.478 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:43:42.391+0000 7f3093975800 5 asok(0x55e766156730) register_command sync trace active hook 0x7f308408f020 2024-09-12T17:43:42.478 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:43:42.391+0000 7f3093975800 5 asok(0x55e766156730) register_command sync trace active_short hook 0x7f308408f020 2024-09-12T17:43:42.478 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:43:42.391+0000 7f3093975800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:42.479 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:43:42.391+0000 7f3093975800 20 Filter name: none 2024-09-12T17:43:42.479 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:43:42.391+0000 7f2f44fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:42.479 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:43:42.391+0000 7f3093975800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:43:42.479 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:43:42.391+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.479 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:43:42.391+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:43:42.479 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:43:42.391+0000 7f3093975800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:43:42.479 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:43:42.391+0000 7f3093975800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:43:42.479 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:43:42.392+0000 7f3093975800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 : miss 2024-09-12T17:43:42.479 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:43:42.392+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.479 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:43:42.392+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:43:42.479 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:43:42.392+0000 7f3093975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:43:42.479 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:43:42.392+0000 7f3093975800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:43:42.479 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:43:42.392+0000 7f3093975800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:42.479 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:43:42.392+0000 7f3093975800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.480 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:43:42.392+0000 7f3093975800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 2024-09-12T17:43:42.480 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:43:42.397+0000 7f3093975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:43:42.480 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:43:42.397+0000 7f3093975800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:43:42.480 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:43:42.397+0000 7f3093975800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.480 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:43:42.397+0000 7f3093975800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30, ofs0, ns] 2024-09-12T17:43:42.480 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:43:42.397+0000 7f2f74ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562435 cookie 94452341739840 notifier 6716 bl.length()=999 2024-09-12T17:43:42.480 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:43:42.397+0000 7f2f74ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:43:42.480 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:43:42.397+0000 7f2f74ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:43:42.480 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:43:42.397+0000 7f2f74ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.480 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:43:42.398+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_sources= new_sources= 2024-09-12T17:43:42.480 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:43:42.398+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:43:42.480 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:43:42.398+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_dests= new_dests= 2024-09-12T17:43:42.481 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:43:42.398+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:43:42.481 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.0 2024-09-12T17:43:42.481 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.0 2024-09-12T17:43:42.481 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.1 2024-09-12T17:43:42.481 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.1 2024-09-12T17:43:42.481 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.2 2024-09-12T17:43:42.481 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.2 2024-09-12T17:43:42.481 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.3 2024-09-12T17:43:42.481 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.3 2024-09-12T17:43:42.481 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.4 2024-09-12T17:43:42.481 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.4 2024-09-12T17:43:42.481 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.5 2024-09-12T17:43:42.481 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.5 2024-09-12T17:43:42.482 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.6 2024-09-12T17:43:42.482 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.6 2024-09-12T17:43:42.482 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.7 2024-09-12T17:43:42.482 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.7 2024-09-12T17:43:42.482 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.8 2024-09-12T17:43:42.482 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.8 2024-09-12T17:43:42.482 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.9 2024-09-12T17:43:42.482 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.9 2024-09-12T17:43:42.482 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.10 2024-09-12T17:43:42.482 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.10 2024-09-12T17:43:42.482 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.11 2024-09-12T17:43:42.482 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.11 2024-09-12T17:43:42.482 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.0 2024-09-12T17:43:42.483 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1 2024-09-12T17:43:42.483 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:43:42.403+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2 2024-09-12T17:43:42.483 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:43:42.403+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.3 2024-09-12T17:43:42.483 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:43:42.404+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.4 2024-09-12T17:43:42.483 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:43:42.404+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.5 2024-09-12T17:43:42.483 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:43:42.405+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.6 2024-09-12T17:43:42.483 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:43:42.405+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.7 2024-09-12T17:43:42.483 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:43:42.406+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.8 2024-09-12T17:43:42.483 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:43:42.406+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.9 2024-09-12T17:43:42.483 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:43:42.407+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.10 2024-09-12T17:43:42.483 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:43:42.410+0000 7f3093975800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:42.483 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:43:42.410+0000 7f3093975800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 2024-09-12T17:43:42.483 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:43:42.411+0000 7f3093975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:43:42.483 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:43:42.411+0000 7f3093975800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:43:42.483 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:43:42.411+0000 7f3093975800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.484 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:43:42.411+0000 7f3093975800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30, ofs0, ns] 2024-09-12T17:43:42.484 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:43:42.411+0000 7f2f67fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562436 cookie 94452341739840 notifier 6716 bl.length()=999 2024-09-12T17:43:42.484 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:43:42.411+0000 7f2f67fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:43:42.484 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:43:42.411+0000 7f2f67fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:43:42.484 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:43:42.411+0000 7f2f67fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.484 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:43:42.412+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_sources= new_sources= 2024-09-12T17:43:42.484 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:43:42.412+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:43:42.484 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:43:42.412+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_dests= new_dests= 2024-09-12T17:43:42.484 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:43:42.412+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:43:42.484 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:43:42.413+0000 7f3093975800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3093975800 time 2024-09-12T17:43:42.412968+0000 2024-09-12T17:43:42.484 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:43:42.484 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.484 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:42.485 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3096f8c71a] 2024-09-12T17:43:42.485 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3096f8c8d8] 2024-09-12T17:43:42.485 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e7644f9841] 2024-09-12T17:43:42.485 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55e76450879e] 2024-09-12T17:43:42.485 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e7645095d4] 2024-09-12T17:43:42.485 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:43:42.485 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3095c29590] 2024-09-12T17:43:42.485 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:43:42.485 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:43:42.485 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.485 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:43:42.414+0000 7f3093975800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:43:42.485 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f3093975800 thread_name:radosgw-admin 2024-09-12T17:43:42.486 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.486 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:42.486 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3095c3e6f0] 2024-09-12T17:43:42.486 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3095c8b99c] 2024-09-12T17:43:42.486 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:43:42.486 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:43:42.486 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3096f8c774] 2024-09-12T17:43:42.486 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3096f8c8d8] 2024-09-12T17:43:42.486 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e7644f9841] 2024-09-12T17:43:42.486 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55e76450879e] 2024-09-12T17:43:42.486 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e7645095d4] 2024-09-12T17:43:42.486 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:43:42.486 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3095c29590] 2024-09-12T17:43:42.487 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:43:42.487 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:43:42.487 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:43:42.487 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.487 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:43:42.487 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:43:42.487 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:43:42.487 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:43:42.487 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:43:42.487 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:43:42.487 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:43:42.487 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:43:42.487 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:43:42.488 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:43:42.488 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:43:42.488 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:43:42.488 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:43:42.488 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:43:42.488 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:43:42.488 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:43:42.488 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:43:42.488 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:43:42.489 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:43:42.489 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:43:42.489 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:43:42.489 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:43:42.489 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:43:42.489 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:43:42.489 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:43:42.489 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:43:42.489 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:43:42.489 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:43:42.489 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:43:42.490 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:43:42.490 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:43:42.490 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:43:42.490 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:43:42.490 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:43:42.490 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:43:42.490 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:43:42.490 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:43:42.490 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:43:42.490 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:43:42.490 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:43:42.490 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:43:42.491 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:43:42.491 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:43:42.491 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:43:42.491 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:43:42.491 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:43:42.491 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:43:42.491 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:43:42.491 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:43:42.491 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:43:42.491 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:43:42.491 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:43:42.491 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:43:42.491 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:43:42.492 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:43:42.492 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:43:42.492 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:43:42.492 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:43:42.492 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:43:42.492 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:43:42.492 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:43:42.492 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:43:42.492 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:43:42.492 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:43:42.493 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:43:42.493 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:43:42.493 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:43:42.493 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:43:42.493 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:43:42.493 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:43:42.493 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:43:42.493 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:43:42.493 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:43:42.493 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:43:42.493 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:43:42.493 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:43:42.493 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:43:42.494 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:43:42.494 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:43:42.494 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:43:42.494 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:43:42.494 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:43:42.494 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:43:42.494 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:43:42.494 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:43:42.494 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:43:42.494 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:43:42.494 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:43:42.494 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:43:42.494 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:43:42.494 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:43:42.495 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:43:42.495 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:43:42.495 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:43:42.495 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f44fe1640 / http_manager 2024-09-12T17:43:42.495 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f46fe5640 / http_manager 2024-09-12T17:43:42.495 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f47fe7640 / rgw_dt_lg_renew 2024-09-12T17:43:42.495 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f66ffd640 / ms_dispatch 2024-09-12T17:43:42.495 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f67fff640 / io_context_pool 2024-09-12T17:43:42.495 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f74ff9640 / io_context_pool 2024-09-12T17:43:42.495 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f76ffd640 / ms_dispatch 2024-09-12T17:43:42.495 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f7de03640 / ms_dispatch 2024-09-12T17:43:42.495 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f7f606640 / io_context_pool 2024-09-12T17:43:42.495 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3090c5e640 / msgr-worker-2 2024-09-12T17:43:42.495 INFO:tasks.workunit.client.0.smithi044.stderr: 7f309145f640 / msgr-worker-1 2024-09-12T17:43:42.496 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3091c60640 / msgr-worker-0 2024-09-12T17:43:42.496 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3092461640 / io_context_pool 2024-09-12T17:43:42.496 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3093975800 / radosgw-admin 2024-09-12T17:43:42.496 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:43:42.496 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:43:42.496 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/log/ceph/ceph-client.admin.114424.log 2024-09-12T17:43:42.496 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:43:42.496 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:43:42.497 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:43:42.347+0000 7f3093975800 5 AuthRegistry(0x55e766378dc0) adding con mode: secure 2024-09-12T17:43:42.497 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:43:42.347+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.497 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:43:42.348+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.497 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:43:42.348+0000 7f3093975800 5 asok(0x55e766156730) register_command rotate-key hook 0x55e766378f08 2024-09-12T17:43:42.497 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:42.497 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:43:42.497 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient(hunting): picked mon.noname-b con 0x55e7662bb670 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:43:42.497 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient(hunting): picked mon.noname-c con 0x55e7662be510 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:43:42.497 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient(hunting): picked mon.noname-a con 0x55e7662c1a90 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:43:42.497 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.497 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.497 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.497 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:42.498 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient(hunting): authenticate will time out at 1994.984178s 2024-09-12T17:43:42.498 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient(hunting): get_auth_request con 0x55e7662be510 auth_method 0 2024-09-12T17:43:42.498 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.498 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.498 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.498 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:43:42.348+0000 7f3091c60640 10 monclient(hunting): get_auth_request con 0x55e7662c1a90 auth_method 0 2024-09-12T17:43:42.498 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:43:42.348+0000 7f3091c60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.498 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:43:42.348+0000 7f3091c60640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.498 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:43:42.348+0000 7f3091c60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.498 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.498 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.498 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.498 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:43:42.348+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.498 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:43:42.348+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.499 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:43:42.348+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.499 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient(hunting): handle_auth_done global_id 6707 payload 824 2024-09-12T17:43:42.499 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient: _finish_hunting 0 2024-09-12T17:43:42.499 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:43:42.348+0000 7f3090c5e640 1 monclient: found mon.noname-c 2024-09-12T17:43:42.499 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:43:42.348+0000 7f3090c5e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:43:42.499 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:42.499 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:43:42.499 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: dump: 2024-09-12T17:43:42.499 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:42.499 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:42.499 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.499 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.499 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:42.499 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.499 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:42.500 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:42.500 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:42.500 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.500 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: _finish_auth 0 2024-09-12T17:43:42.500 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: _check_auth_tickets 2024-09-12T17:43:42.500 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:43:42.348+0000 7f3093975800 5 monclient: authenticate success, global_id 6707 2024-09-12T17:43:42.500 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient: _renew_subs 2024-09-12T17:43:42.500 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:42.500 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:42.500 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:42.500 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:43:42.500 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:43:42.348+0000 7f2f7de03640 10 monclient: dump: 2024-09-12T17:43:42.500 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:42.501 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:42.501 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.501 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.501 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:42.501 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.501 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:42.501 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:42.501 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:42.501 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.501 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:43:42.348+0000 7f2f7f606640 4 set_mon_vals no callback set 2024-09-12T17:43:42.501 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient: _renew_subs 2024-09-12T17:43:42.501 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:43:42.348+0000 7f3093975800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:42.502 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:43:42.348+0000 7f3093975800 1 librados: init done 2024-09-12T17:43:42.502 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:43:42.350+0000 7f2f7de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:42.502 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:43:42.350+0000 7f2f7de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:42.502 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:43:42.350+0000 7f2f7de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:42.502 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:43:42.351+0000 7f309145f640 10 monclient: get_auth_request con 0x7f2f780764a0 auth_method 0 2024-09-12T17:43:42.502 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:43:42.351+0000 7f3091c60640 10 monclient: get_auth_request con 0x55e7663a18b0 auth_method 0 2024-09-12T17:43:42.502 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:43:42.352+0000 7f309145f640 10 monclient: get_auth_request con 0x55e7663c4000 auth_method 0 2024-09-12T17:43:42.502 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:43:42.353+0000 7f3090c5e640 10 monclient: get_auth_request con 0x55e7663c7860 auth_method 0 2024-09-12T17:43:42.502 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:43:42.354+0000 7f3093975800 10 monclient: build_initial_monmap 2024-09-12T17:43:42.502 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:43:42.354+0000 7f3093975800 1 build_initial for_mkfs: 0 2024-09-12T17:43:42.502 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:43:42.354+0000 7f3093975800 10 monclient: monmap: 2024-09-12T17:43:42.502 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:43:42.502 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:42.503 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:43:42.503 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:43:42.503 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:42.503 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.503 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:43:42.503 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:43:42.503 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:43:42.503 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.503 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding auth protocol: cephx 2024-09-12T17:43:42.503 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding auth protocol: cephx 2024-09-12T17:43:42.503 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding auth protocol: cephx 2024-09-12T17:43:42.503 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: secure 2024-09-12T17:43:42.503 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: crc 2024-09-12T17:43:42.504 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: secure 2024-09-12T17:43:42.504 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: crc 2024-09-12T17:43:42.504 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: secure 2024-09-12T17:43:42.504 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: crc 2024-09-12T17:43:42.504 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: crc 2024-09-12T17:43:42.504 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: secure 2024-09-12T17:43:42.504 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: crc 2024-09-12T17:43:42.504 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: secure 2024-09-12T17:43:42.504 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: crc 2024-09-12T17:43:42.504 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cd270) adding con mode: secure 2024-09-12T17:43:42.504 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:43:42.354+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.504 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:43:42.354+0000 7f3093975800 5 asok(0x55e766156730) register_command objecter_requests cmddesc objecter_requests hook 0x55e7663d0c60 EEXIST 2024-09-12T17:43:42.504 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:43:42.354+0000 7f3093975800 10 monclient: init 2024-09-12T17:43:42.505 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding auth protocol: cephx 2024-09-12T17:43:42.505 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding auth protocol: cephx 2024-09-12T17:43:42.505 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding auth protocol: cephx 2024-09-12T17:43:42.505 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: secure 2024-09-12T17:43:42.505 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: crc 2024-09-12T17:43:42.505 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: secure 2024-09-12T17:43:42.505 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: crc 2024-09-12T17:43:42.505 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: secure 2024-09-12T17:43:42.505 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: crc 2024-09-12T17:43:42.505 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: crc 2024-09-12T17:43:42.505 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: secure 2024-09-12T17:43:42.505 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: crc 2024-09-12T17:43:42.505 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: secure 2024-09-12T17:43:42.506 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: crc 2024-09-12T17:43:42.506 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:43:42.354+0000 7f3093975800 5 AuthRegistry(0x55e7663cc228) adding con mode: secure 2024-09-12T17:43:42.506 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:43:42.355+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.506 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:43:42.355+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.506 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:43:42.355+0000 7f3093975800 5 asok(0x55e766156730) register_command rotate-key cmddesc rotate-key hook 0x55e7663cc370 EEXIST 2024-09-12T17:43:42.506 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:42.506 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:43:42.506 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient(hunting): picked mon.noname-a con 0x55e7663f4950 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:43:42.506 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient(hunting): picked mon.noname-b con 0x55e7663f6c20 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:43:42.506 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient(hunting): picked mon.noname-c con 0x55e7663f3120 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:43:42.506 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.506 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.506 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.506 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:42.507 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:43:42.355+0000 7f3093975800 10 monclient(hunting): authenticate will time out at 1994.991345s 2024-09-12T17:43:42.507 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient(hunting): get_auth_request con 0x55e7663f4950 auth_method 0 2024-09-12T17:43:42.507 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.507 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.507 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.507 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:43:42.355+0000 7f3091c60640 10 monclient(hunting): get_auth_request con 0x55e7663f3120 auth_method 0 2024-09-12T17:43:42.507 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:43:42.355+0000 7f3091c60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.507 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:43:42.355+0000 7f3091c60640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.507 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:43:42.355+0000 7f3091c60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.507 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.507 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.507 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.507 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:43:42.355+0000 7f3090c5e640 10 monclient(hunting): get_auth_request con 0x55e7663f6c20 auth_method 0 2024-09-12T17:43:42.508 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:43:42.355+0000 7f3090c5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.508 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:43:42.355+0000 7f3090c5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.508 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:43:42.355+0000 7f3090c5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.508 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:43:42.355+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.508 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:43:42.355+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.508 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:43:42.355+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.508 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:43:42.355+0000 7f3090c5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.508 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:43:42.355+0000 7f3090c5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.508 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:43:42.355+0000 7f3090c5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.508 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient(hunting): handle_auth_done global_id 7182 payload 824 2024-09-12T17:43:42.508 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient: _finish_hunting 0 2024-09-12T17:43:42.508 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:43:42.355+0000 7f309145f640 1 monclient: found mon.noname-a 2024-09-12T17:43:42.508 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:43:42.355+0000 7f309145f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:43:42.509 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:42.509 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:43:42.509 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: dump: 2024-09-12T17:43:42.509 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:42.509 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:42.509 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.509 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.509 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:42.509 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.509 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:42.509 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:42.509 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:42.509 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.510 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: _finish_auth 0 2024-09-12T17:43:42.510 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:43:42.510 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:42.510 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:42.510 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:43:42.510 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:43:42.356+0000 7f2f76ffd640 10 monclient: dump: 2024-09-12T17:43:42.510 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:42.510 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:42.510 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.510 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.510 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:42.510 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.510 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:42.511 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:42.511 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:42.511 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.511 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:43:42.356+0000 7f3093975800 5 monclient: authenticate success, global_id 7182 2024-09-12T17:43:42.511 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:43:42.356+0000 7f3093975800 10 monclient: _renew_subs 2024-09-12T17:43:42.511 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:43:42.356+0000 7f3092461640 4 set_mon_vals no callback set 2024-09-12T17:43:42.511 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:43:42.356+0000 7f3093975800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:43:42.511 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:43:42.356+0000 7f3093975800 10 monclient: _renew_subs 2024-09-12T17:43:42.511 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:43:42.356+0000 7f3093975800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:43:42.512 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:43:42.357+0000 7f2f76ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:42.512 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:43:42.358+0000 7f2f76ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:42.512 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:43:42.358+0000 7f2f76ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:42.512 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:43:42.358+0000 7f3093975800 10 monclient: get_monmap_and_config 2024-09-12T17:43:42.512 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:43:42.358+0000 7f3093975800 10 monclient: build_initial_monmap 2024-09-12T17:43:42.512 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:43:42.358+0000 7f3093975800 1 build_initial for_mkfs: 0 2024-09-12T17:43:42.512 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:43:42.358+0000 7f3090c5e640 10 monclient: get_auth_request con 0x7f2f68076380 auth_method 0 2024-09-12T17:43:42.512 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:43:42.358+0000 7f3093975800 10 monclient: monmap: 2024-09-12T17:43:42.512 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:43:42.512 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:42.512 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:43:42.512 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:43:42.512 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:42.513 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.513 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:43:42.513 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:43:42.513 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:43:42.513 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.513 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding auth protocol: cephx 2024-09-12T17:43:42.513 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding auth protocol: cephx 2024-09-12T17:43:42.513 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding auth protocol: cephx 2024-09-12T17:43:42.513 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: secure 2024-09-12T17:43:42.513 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: crc 2024-09-12T17:43:42.513 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: secure 2024-09-12T17:43:42.513 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: crc 2024-09-12T17:43:42.513 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: secure 2024-09-12T17:43:42.514 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: crc 2024-09-12T17:43:42.514 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: crc 2024-09-12T17:43:42.514 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: secure 2024-09-12T17:43:42.514 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: crc 2024-09-12T17:43:42.514 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: secure 2024-09-12T17:43:42.514 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: crc 2024-09-12T17:43:42.514 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x55e7664143f0) adding con mode: secure 2024-09-12T17:43:42.514 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:43:42.358+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.514 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:43:42.358+0000 7f3093975800 10 monclient: init 2024-09-12T17:43:42.514 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding auth protocol: cephx 2024-09-12T17:43:42.514 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding auth protocol: cephx 2024-09-12T17:43:42.515 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding auth protocol: cephx 2024-09-12T17:43:42.515 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: secure 2024-09-12T17:43:42.515 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: crc 2024-09-12T17:43:42.515 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: secure 2024-09-12T17:43:42.515 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: crc 2024-09-12T17:43:42.515 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: secure 2024-09-12T17:43:42.515 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: crc 2024-09-12T17:43:42.515 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: crc 2024-09-12T17:43:42.515 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: secure 2024-09-12T17:43:42.515 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: crc 2024-09-12T17:43:42.515 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: secure 2024-09-12T17:43:42.515 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: crc 2024-09-12T17:43:42.516 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:43:42.358+0000 7f3093975800 5 AuthRegistry(0x7ffce9301460) adding con mode: secure 2024-09-12T17:43:42.516 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:43:42.359+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.516 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:43:42.359+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.516 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:43:42.359+0000 7f3093975800 5 asok(0x55e766156730) register_command rotate-key cmddesc rotate-key hook 0x7ffce93015a8 EEXIST 2024-09-12T17:43:42.516 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:42.516 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:43:42.516 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient(hunting): picked mon.noname-a con 0x55e7664489d0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:43:42.516 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient(hunting): picked mon.noname-b con 0x55e766439320 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:43:42.516 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient(hunting): picked mon.noname-c con 0x55e766443e00 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:43:42.516 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.517 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.517 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.517 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:42.517 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient(hunting): authenticate will time out at 1994.995346s 2024-09-12T17:43:42.517 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient(hunting): get_auth_request con 0x55e7664489d0 auth_method 0 2024-09-12T17:43:42.517 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.517 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.517 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.517 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:43:42.359+0000 7f3091c60640 10 monclient(hunting): get_auth_request con 0x55e766443e00 auth_method 0 2024-09-12T17:43:42.517 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:43:42.359+0000 7f3091c60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.517 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:43:42.359+0000 7f3091c60640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.517 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:43:42.359+0000 7f3091c60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.517 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:43:42.359+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:43:42.359+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:43:42.359+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:43:42.359+0000 7f3090c5e640 10 monclient(hunting): get_auth_request con 0x55e766439320 auth_method 0 2024-09-12T17:43:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:43:42.359+0000 7f3090c5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:43:42.359+0000 7f3090c5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:43:42.359+0000 7f3090c5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient(hunting): handle_auth_done global_id 7185 payload 274 2024-09-12T17:43:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient: _finish_hunting 0 2024-09-12T17:43:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:43:42.359+0000 7f309145f640 1 monclient: found mon.noname-a 2024-09-12T17:43:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:43:42.359+0000 7f309145f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:43:42.519 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:42.519 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:43:42.519 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: dump: 2024-09-12T17:43:42.519 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:42.519 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:42.519 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.519 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.519 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:42.519 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.519 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:42.519 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:42.519 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:42.519 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.520 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: _finish_auth 0 2024-09-12T17:43:42.520 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:43:42.520 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:42.520 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:42.520 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:43:42.520 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:43:42.359+0000 7f2f74ff9640 10 monclient: dump: 2024-09-12T17:43:42.520 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:42.520 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:42.520 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.520 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.520 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:42.520 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.520 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:42.520 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:42.521 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:42.521 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.521 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:43:42.359+0000 7f3093975800 5 monclient: authenticate success, global_id 7185 2024-09-12T17:43:42.521 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:43:42.359+0000 7f3093975800 10 monclient: get_monmap_and_config success 2024-09-12T17:43:42.521 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:43:42.359+0000 7f3093975800 4 set_mon_vals no callback set 2024-09-12T17:43:42.521 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:43:42.360+0000 7f3093975800 10 monclient: shutdown 2024-09-12T17:43:42.521 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:43:42.360+0000 7f3093975800 10 monclient: build_initial_monmap 2024-09-12T17:43:42.521 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:43:42.360+0000 7f3093975800 1 build_initial for_mkfs: 0 2024-09-12T17:43:42.521 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:43:42.360+0000 7f3093975800 10 monclient: monmap: 2024-09-12T17:43:42.521 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:43:42.521 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:43:42.521 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:43:42.521 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:43:42.522 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:43:42.522 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.522 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:43:42.522 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:43:42.522 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:43:42.522 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.522 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding auth protocol: cephx 2024-09-12T17:43:42.522 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding auth protocol: cephx 2024-09-12T17:43:42.522 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding auth protocol: cephx 2024-09-12T17:43:42.522 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: secure 2024-09-12T17:43:42.522 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: crc 2024-09-12T17:43:42.522 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: secure 2024-09-12T17:43:42.522 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: crc 2024-09-12T17:43:42.522 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: secure 2024-09-12T17:43:42.523 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: crc 2024-09-12T17:43:42.523 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: crc 2024-09-12T17:43:42.523 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: secure 2024-09-12T17:43:42.523 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: crc 2024-09-12T17:43:42.523 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: secure 2024-09-12T17:43:42.523 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: crc 2024-09-12T17:43:42.523 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:43:42.360+0000 7f3093975800 5 AuthRegistry(0x55e766417f30) adding con mode: secure 2024-09-12T17:43:42.523 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:43:42.360+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.523 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:43:42.360+0000 7f3093975800 1 librados: starting msgr at 2024-09-12T17:43:42.523 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:43:42.360+0000 7f3093975800 1 librados: starting objecter 2024-09-12T17:43:42.523 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:43:42.360+0000 7f3093975800 5 asok(0x55e766156730) register_command objecter_requests cmddesc objecter_requests hook 0x55e7663f4fd0 EEXIST 2024-09-12T17:43:42.523 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:43:42.361+0000 7f3093975800 1 librados: setting wanted keys 2024-09-12T17:43:42.523 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:43:42.361+0000 7f3093975800 1 librados: calling monclient init 2024-09-12T17:43:42.524 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient: init 2024-09-12T17:43:42.524 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding auth protocol: cephx 2024-09-12T17:43:42.524 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding auth protocol: cephx 2024-09-12T17:43:42.524 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding auth protocol: cephx 2024-09-12T17:43:42.524 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: secure 2024-09-12T17:43:42.524 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: crc 2024-09-12T17:43:42.524 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: secure 2024-09-12T17:43:42.524 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: crc 2024-09-12T17:43:42.524 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: secure 2024-09-12T17:43:42.524 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: crc 2024-09-12T17:43:42.524 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: crc 2024-09-12T17:43:42.524 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: secure 2024-09-12T17:43:42.524 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: crc 2024-09-12T17:43:42.525 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: secure 2024-09-12T17:43:42.525 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: crc 2024-09-12T17:43:42.525 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:43:42.361+0000 7f3093975800 5 AuthRegistry(0x55e76640c700) adding con mode: secure 2024-09-12T17:43:42.525 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:43:42.361+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.525 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:43:42.361+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.525 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:43:42.361+0000 7f3093975800 5 asok(0x55e766156730) register_command rotate-key cmddesc rotate-key hook 0x55e76640c848 EEXIST 2024-09-12T17:43:42.525 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient: _reopen_session rank -1 2024-09-12T17:43:42.525 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:43:42.525 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient(hunting): picked mon.noname-c con 0x55e766439320 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:43:42.525 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient(hunting): picked mon.noname-b con 0x55e766443e00 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:43:42.526 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient(hunting): picked mon.noname-a con 0x55e7664489d0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:43:42.526 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.526 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.526 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient(hunting): start opening mon connection 2024-09-12T17:43:42.526 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient(hunting): _renew_subs 2024-09-12T17:43:42.526 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:43:42.361+0000 7f3093975800 10 monclient(hunting): authenticate will time out at 1994.997630s 2024-09-12T17:43:42.526 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient(hunting): get_auth_request con 0x55e766439320 auth_method 0 2024-09-12T17:43:42.526 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.526 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.526 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.527 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:43:42.361+0000 7f3091c60640 10 monclient(hunting): get_auth_request con 0x55e7664489d0 auth_method 0 2024-09-12T17:43:42.527 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:43:42.361+0000 7f3091c60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.527 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:43:42.361+0000 7f3091c60640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.527 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:43:42.361+0000 7f3091c60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.527 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.527 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.527 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.527 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:43:42.361+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:43:42.527 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:43:42.361+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:43:42.527 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:43:42.361+0000 7f3091c60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:43:42.528 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:43:42.361+0000 7f3090c5e640 10 monclient(hunting): get_auth_request con 0x55e766443e00 auth_method 0 2024-09-12T17:43:42.528 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:43:42.361+0000 7f3090c5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:43:42.528 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:43:42.361+0000 7f3090c5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:43:42.528 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:43:42.361+0000 7f3090c5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:43:42.528 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient(hunting): handle_auth_done global_id 6716 payload 824 2024-09-12T17:43:42.528 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient: _finish_hunting 0 2024-09-12T17:43:42.528 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:43:42.361+0000 7f309145f640 1 monclient: found mon.noname-c 2024-09-12T17:43:42.528 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:43:42.361+0000 7f309145f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:43:42.529 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:42.529 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:43:42.529 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: dump: 2024-09-12T17:43:42.529 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:42.529 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:42.529 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.529 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.529 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:42.530 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.530 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:42.530 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:42.530 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:42.530 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.530 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: _finish_auth 0 2024-09-12T17:43:42.530 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:43:42.530 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:43:42.530 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:43:42.530 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:43:42.530 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:43:42.362+0000 7f2f66ffd640 10 monclient: dump: 2024-09-12T17:43:42.530 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:43:42.530 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:43:42.531 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.531 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:43:42.531 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:43:42.531 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:43:42.531 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:43:42.531 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:43:42.531 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:43:42.531 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.532 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:43:42.362+0000 7f3093975800 5 monclient: authenticate success, global_id 6716 2024-09-12T17:43:42.532 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:43:42.362+0000 7f3093975800 10 monclient: _renew_subs 2024-09-12T17:43:42.532 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:43:42.362+0000 7f2f74ff9640 4 set_mon_vals no callback set 2024-09-12T17:43:42.532 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:43:42.362+0000 7f3093975800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:42.532 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:43:42.362+0000 7f3093975800 10 monclient: _renew_subs 2024-09-12T17:43:42.532 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:43:42.362+0000 7f3093975800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:42.532 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:43:42.362+0000 7f3093975800 1 librados: init done 2024-09-12T17:43:42.532 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:43:42.362+0000 7f3093975800 5 asok(0x55e766156730) register_command cr dump hook 0x55e76643c1f8 2024-09-12T17:43:42.533 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:43:42.363+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.533 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:43:42.364+0000 7f2f66ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:43:42.533 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:43:42.364+0000 7f2f66ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:42.533 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:43:42.364+0000 7f2f66ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:43:42.533 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:43:42.364+0000 7f3090c5e640 10 monclient: get_auth_request con 0x7f2f5c076470 auth_method 0 2024-09-12T17:43:42.533 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:43:42.364+0000 7f3091c60640 10 monclient: get_auth_request con 0x55e7664621e0 auth_method 0 2024-09-12T17:43:42.533 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:43:42.365+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.533 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:43:42.365+0000 7f3093975800 20 realm 2024-09-12T17:43:42.533 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:43:42.365+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.533 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:43:42.365+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.533 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:43:42.365+0000 7f3093975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:42.533 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:43:42.365+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.533 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:43:42.365+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.534 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:43:42.365+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.534 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:43:42.365+0000 7f309145f640 10 monclient: get_auth_request con 0x55e766466530 auth_method 0 2024-09-12T17:43:42.534 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:43:42.366+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:42.534 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:43:42.366+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.534 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:43:42.366+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:42.534 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:43:42.366+0000 7f3093975800 20 searching for the correct realm 2024-09-12T17:43:42.534 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:43:42.366+0000 7f3090c5e640 10 monclient: get_auth_request con 0x55e76646b690 auth_method 0 2024-09-12T17:43:42.534 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:43:42.367+0000 7f3091c60640 10 monclient: get_auth_request con 0x7f308801f060 auth_method 0 2024-09-12T17:43:42.534 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:43:42.368+0000 7f309145f640 10 monclient: get_auth_request con 0x7f308c025040 auth_method 0 2024-09-12T17:43:42.534 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:43:42.368+0000 7f3090c5e640 10 monclient: get_auth_request con 0x7f30840af040 auth_method 0 2024-09-12T17:43:42.534 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:43:42.369+0000 7f3090c5e640 0 -- 172.21.15.44:0/3896616902 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55e76646b690 msgr2=0x55e76646db50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:42.535 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:43:42.369+0000 7f2f66ffd640 1 client.6716.objecter ms_handle_reset 0x55e76646b690 session 0x55e76646b010 osd.3 2024-09-12T17:43:42.535 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:43:42.369+0000 7f2f66ffd640 10 monclient: _renew_subs 2024-09-12T17:43:42.535 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:43:42.369+0000 7f2f66ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:43:42.535 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:43:42.370+0000 7f3090c5e640 10 monclient: get_auth_request con 0x7f2f5c0862f0 auth_method 0 2024-09-12T17:43:42.535 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:43:42.370+0000 7f3091c60640 10 monclient: get_auth_request con 0x7f3088069040 auth_method 0 2024-09-12T17:43:42.535 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:43:42.372+0000 7f309145f640 10 monclient: get_auth_request con 0x7f30880157d0 auth_method 0 2024-09-12T17:43:42.535 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:43:42.373+0000 7f309145f640 0 -- 172.21.15.44:0/3896616902 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f30880157d0 msgr2=0x7f30880887a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:42.535 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:43:42.373+0000 7f2f66ffd640 1 client.6716.objecter ms_handle_reset 0x7f30880157d0 session 0x7f3088056040 osd.0 2024-09-12T17:43:42.535 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:43:42.373+0000 7f309145f640 10 monclient: get_auth_request con 0x55e76646b690 auth_method 0 2024-09-12T17:43:42.535 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:42.535 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:42.535 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:42.535 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:42.536 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:42.536 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:43:42.377+0000 7f3093975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:42.536 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:43:42.377+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.536 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:43:42.377+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.536 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:43:42.377+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.536 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:43:42.378+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:42.536 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:43:42.378+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.536 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:43:42.378+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:42.536 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:43:42.378+0000 7f3093975800 20 zone default found 2024-09-12T17:43:42.536 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:43:42.378+0000 7f3093975800 4 Realm: () 2024-09-12T17:43:42.537 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:43:42.378+0000 7f3093975800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:42.537 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:43:42.378+0000 7f3093975800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:42.537 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:43:42.378+0000 7f3093975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:42.537 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:43:42.378+0000 7f3093975800 20 zonegroup default 2024-09-12T17:43:42.537 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:43:42.378+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.537 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:43:42.378+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.537 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:43:42.378+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.537 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:43:42.379+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.537 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:43:42.379+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.537 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:43:42.379+0000 7f3093975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.537 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:43:42.379+0000 7f3093975800 20 started sync module instance, tier type = 2024-09-12T17:43:42.537 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:43:42.379+0000 7f3093975800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:42.538 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=0 2024-09-12T17:43:42.538 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=1 2024-09-12T17:43:42.538 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=2 2024-09-12T17:43:42.538 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=3 2024-09-12T17:43:42.538 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=4 2024-09-12T17:43:42.538 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=5 2024-09-12T17:43:42.538 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:43:42.388+0000 7f3093975800 20 add_watcher() i=6 2024-09-12T17:43:42.538 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:43:42.389+0000 7f3093975800 20 add_watcher() i=7 2024-09-12T17:43:42.538 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:43:42.389+0000 7f3093975800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:42.538 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding auth protocol: cephx 2024-09-12T17:43:42.538 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding auth protocol: cephx 2024-09-12T17:43:42.538 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding auth protocol: cephx 2024-09-12T17:43:42.538 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: secure 2024-09-12T17:43:42.539 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: crc 2024-09-12T17:43:42.539 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: secure 2024-09-12T17:43:42.539 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: crc 2024-09-12T17:43:42.539 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: secure 2024-09-12T17:43:42.539 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: crc 2024-09-12T17:43:42.539 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:43:42.390+0000 7f2f47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:42.539 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: crc 2024-09-12T17:43:42.539 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: secure 2024-09-12T17:43:42.539 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: crc 2024-09-12T17:43:42.539 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: secure 2024-09-12T17:43:42.539 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: crc 2024-09-12T17:43:42.539 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:43:42.390+0000 7f3093975800 5 AuthRegistry(0x7ffce9301930) adding con mode: secure 2024-09-12T17:43:42.539 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:43:42.391+0000 7f3093975800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:43:42.540 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:43:42.391+0000 7f3093975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:42.540 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:43:42.391+0000 7f3093975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:42.540 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:43:42.391+0000 7f3093975800 5 asok(0x55e766156730) register_command cache list hook 0x55e76643aec0 2024-09-12T17:43:42.540 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:43:42.391+0000 7f3093975800 5 asok(0x55e766156730) register_command cache inspect hook 0x55e76643aec0 2024-09-12T17:43:42.540 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:43:42.391+0000 7f3093975800 5 asok(0x55e766156730) register_command cache erase hook 0x55e76643aec0 2024-09-12T17:43:42.540 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:43:42.391+0000 7f3093975800 5 asok(0x55e766156730) register_command cache zap hook 0x55e76643aec0 2024-09-12T17:43:42.540 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:43:42.391+0000 7f3093975800 5 note: GC not initialized 2024-09-12T17:43:42.540 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:43:42.391+0000 7f2f46fe5640 20 reqs_thread_entry: start 2024-09-12T17:43:42.540 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:43:42.391+0000 7f3093975800 5 asok(0x55e766156730) register_command sync trace show hook 0x7f308408f020 2024-09-12T17:43:42.540 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:43:42.391+0000 7f3093975800 5 asok(0x55e766156730) register_command sync trace history hook 0x7f308408f020 2024-09-12T17:43:42.540 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:43:42.391+0000 7f3093975800 5 asok(0x55e766156730) register_command sync trace active hook 0x7f308408f020 2024-09-12T17:43:42.540 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:43:42.391+0000 7f3093975800 5 asok(0x55e766156730) register_command sync trace active_short hook 0x7f308408f020 2024-09-12T17:43:42.540 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:43:42.391+0000 7f3093975800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:42.541 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:43:42.391+0000 7f3093975800 20 Filter name: none 2024-09-12T17:43:42.541 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:43:42.391+0000 7f2f44fe1640 20 reqs_thread_entry: start 2024-09-12T17:43:42.541 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:43:42.391+0000 7f3093975800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:43:42.541 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:43:42.391+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.541 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:43:42.391+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:43:42.541 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:43:42.391+0000 7f3093975800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:43:42.541 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:43:42.391+0000 7f3093975800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:43:42.541 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:43:42.392+0000 7f3093975800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 : miss 2024-09-12T17:43:42.541 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:43:42.392+0000 7f3093975800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.541 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:43:42.392+0000 7f3093975800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:43:42.541 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:43:42.392+0000 7f3093975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:43:42.541 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:43:42.392+0000 7f3093975800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:43:42.541 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:43:42.392+0000 7f3093975800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:42.542 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:43:42.392+0000 7f3093975800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.542 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:43:42.392+0000 7f3093975800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 2024-09-12T17:43:42.542 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:43:42.397+0000 7f3093975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:43:42.542 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:43:42.397+0000 7f3093975800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:43:42.542 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:43:42.397+0000 7f3093975800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.542 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:43:42.397+0000 7f3093975800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30, ofs0, ns] 2024-09-12T17:43:42.542 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:43:42.397+0000 7f2f74ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562435 cookie 94452341739840 notifier 6716 bl.length()=999 2024-09-12T17:43:42.542 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:43:42.397+0000 7f2f74ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:43:42.542 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:43:42.397+0000 7f2f74ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:43:42.542 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:43:42.397+0000 7f2f74ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.542 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:43:42.398+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_sources= new_sources= 2024-09-12T17:43:42.542 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:43:42.398+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:43:42.542 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:43:42.398+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_dests= new_dests= 2024-09-12T17:43:42.543 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:43:42.398+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:43:42.543 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.0 2024-09-12T17:43:42.543 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.0 2024-09-12T17:43:42.543 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.1 2024-09-12T17:43:42.543 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.1 2024-09-12T17:43:42.543 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.2 2024-09-12T17:43:42.543 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.2 2024-09-12T17:43:42.543 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.3 2024-09-12T17:43:42.543 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.3 2024-09-12T17:43:42.543 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.4 2024-09-12T17:43:42.543 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.4 2024-09-12T17:43:42.544 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.5 2024-09-12T17:43:42.544 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.5 2024-09-12T17:43:42.544 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.6 2024-09-12T17:43:42.544 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.6 2024-09-12T17:43:42.544 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.7 2024-09-12T17:43:42.544 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.7 2024-09-12T17:43:42.544 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.8 2024-09-12T17:43:42.544 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.8 2024-09-12T17:43:42.544 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.9 2024-09-12T17:43:42.544 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.9 2024-09-12T17:43:42.544 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.10 2024-09-12T17:43:42.544 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.10 2024-09-12T17:43:42.544 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:43:42.402+0000 7f3093975800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.11 2024-09-12T17:43:42.545 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1.11 2024-09-12T17:43:42.545 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.0 2024-09-12T17:43:42.545 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:43:42.402+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1 2024-09-12T17:43:42.545 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:43:42.403+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2 2024-09-12T17:43:42.545 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:43:42.403+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.3 2024-09-12T17:43:42.545 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:43:42.404+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.4 2024-09-12T17:43:42.545 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:43:42.404+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.5 2024-09-12T17:43:42.545 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:43:42.405+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.6 2024-09-12T17:43:42.545 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:43:42.405+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.7 2024-09-12T17:43:42.545 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:43:42.406+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.8 2024-09-12T17:43:42.546 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:43:42.406+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.9 2024-09-12T17:43:42.546 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:43:42.407+0000 7f3093975800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.10 2024-09-12T17:43:42.546 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:43:42.410+0000 7f3093975800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:43:42.546 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:43:42.410+0000 7f3093975800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 2024-09-12T17:43:42.546 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:43:42.411+0000 7f3093975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:43:42.546 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:43:42.411+0000 7f3093975800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:43:42.546 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:43:42.411+0000 7f3093975800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.546 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:43:42.411+0000 7f3093975800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30, ofs0, ns] 2024-09-12T17:43:42.546 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:43:42.411+0000 7f2f67fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562436 cookie 94452341739840 notifier 6716 bl.length()=999 2024-09-12T17:43:42.546 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:43:42.411+0000 7f2f67fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:43:42.546 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:43:42.411+0000 7f2f67fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:43:42.546 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:43:42.411+0000 7f2f67fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:42.547 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:43:42.412+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_sources= new_sources= 2024-09-12T17:43:42.547 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:43:42.412+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:43:42.547 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:43:42.412+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_dests= new_dests= 2024-09-12T17:43:42.547 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:43:42.412+0000 7f3093975800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:43:42.547 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:43:42.413+0000 7f3093975800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3093975800 time 2024-09-12T17:43:42.412968+0000 2024-09-12T17:43:42.547 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:43:42.547 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.547 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:42.547 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3096f8c71a] 2024-09-12T17:43:42.547 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3096f8c8d8] 2024-09-12T17:43:42.548 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e7644f9841] 2024-09-12T17:43:42.548 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55e76450879e] 2024-09-12T17:43:42.548 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e7645095d4] 2024-09-12T17:43:42.548 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:43:42.548 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3095c29590] 2024-09-12T17:43:42.548 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:43:42.548 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:43:42.548 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.548 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:43:42.414+0000 7f3093975800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:43:42.548 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f3093975800 thread_name:radosgw-admin 2024-09-12T17:43:42.548 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.548 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:43:42.549 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3095c3e6f0] 2024-09-12T17:43:42.549 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3095c8b99c] 2024-09-12T17:43:42.549 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:43:42.549 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:43:42.549 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3096f8c774] 2024-09-12T17:43:42.549 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3096f8c8d8] 2024-09-12T17:43:42.549 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e7644f9841] 2024-09-12T17:43:42.549 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55e76450879e] 2024-09-12T17:43:42.549 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e7645095d4] 2024-09-12T17:43:42.549 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:43:42.549 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3095c29590] 2024-09-12T17:43:42.549 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:43:42.549 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:43:42.550 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:43:42.550 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.550 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:43:42.550 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:43:42.550 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:43:42.550 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:43:42.550 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:43:42.550 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:43:42.550 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:43:42.550 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:43:42.550 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:43:42.550 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:43:42.550 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:43:42.550 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:43:42.551 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:43:42.551 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:43:42.551 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:43:42.551 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:43:42.551 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:43:42.551 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:43:42.551 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:43:42.551 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:43:42.551 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:43:42.551 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:43:42.551 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:43:42.552 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:43:42.552 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:43:42.552 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:43:42.552 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:43:42.552 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:43:42.552 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:43:42.552 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:43:42.552 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:43:42.552 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:43:42.552 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:43:42.552 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:43:42.552 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:43:42.552 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:43:42.553 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:43:42.553 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:43:42.553 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:43:42.553 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:43:42.553 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:43:42.553 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:43:42.553 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:43:42.553 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:43:42.553 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:43:42.553 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:43:42.553 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:43:42.554 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:43:42.554 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:43:42.554 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:43:42.554 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:43:42.554 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:43:42.554 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:43:42.555 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:43:42.555 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:43:42.555 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:43:42.555 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:43:42.555 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:43:42.555 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:43:42.556 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:43:42.556 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:43:42.556 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:43:42.556 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:43:42.556 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:43:42.556 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:43:42.556 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:43:42.556 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:43:42.556 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:43:42.556 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:43:42.556 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:43:42.557 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:43:42.557 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:43:42.557 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:43:42.557 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:43:42.557 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:43:42.557 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:43:42.557 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:43:42.557 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:43:42.557 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:43:42.557 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:43:42.557 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:43:42.557 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:43:42.557 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:43:42.558 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:43:42.558 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:43:42.558 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:43:42.558 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:43:42.558 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:43:42.558 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:43:42.558 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:43:42.558 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:43:42.558 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:43:42.558 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:43:42.558 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:43:42.558 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f44fe1640 / http_manager 2024-09-12T17:43:42.558 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f46fe5640 / http_manager 2024-09-12T17:43:42.558 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f47fe7640 / rgw_dt_lg_renew 2024-09-12T17:43:42.559 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f66ffd640 / ms_dispatch 2024-09-12T17:43:42.559 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f67fff640 / io_context_pool 2024-09-12T17:43:42.559 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f74ff9640 / io_context_pool 2024-09-12T17:43:42.559 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f76ffd640 / ms_dispatch 2024-09-12T17:43:42.559 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f7de03640 / ms_dispatch 2024-09-12T17:43:42.559 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f7f606640 / io_context_pool 2024-09-12T17:43:42.559 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3090c5e640 / msgr-worker-2 2024-09-12T17:43:42.559 INFO:tasks.workunit.client.0.smithi044.stderr: 7f309145f640 / msgr-worker-1 2024-09-12T17:43:42.559 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3091c60640 / msgr-worker-0 2024-09-12T17:43:42.559 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3092461640 / io_context_pool 2024-09-12T17:43:42.559 INFO:tasks.workunit.client.0.smithi044.stderr: 7f3093975800 / radosgw-admin 2024-09-12T17:43:42.559 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:43:42.559 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:43:42.559 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:43:42.414585Z_d91d3464-19ec-45fc-9184-7ebe5349d833/log 2024-09-12T17:43:42.560 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:43:42.560 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:43:42.561 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:42.561 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:42.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.492+0000 7fd940c1b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.493+0000 7fd940c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.493+0000 7fd940c1b800 20 realm 2024-09-12T17:43:42.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.493+0000 7fd940c1b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.494+0000 7fd940c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.494+0000 7fd940c1b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:42.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.494+0000 7fd940c1b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.494+0000 7fd940c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.494+0000 7fd940c1b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.494+0000 7fd940c1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:42.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.494+0000 7fd940c1b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.495+0000 7fd940c1b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:42.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.495+0000 7fd940c1b800 20 searching for the correct realm 2024-09-12T17:43:42.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.498+0000 7fd93bbea640 0 -- 172.21.15.44:0/3874089267 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fd92c086130 msgr2=0x7fd92c08f2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:42.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.501+0000 7fd93c3eb640 0 -- 172.21.15.44:0/3874089267 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fd93000d8f0 msgr2=0x7fd93002d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:42.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.707+0000 7fd940c1b800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:42.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.707+0000 7fd940c1b800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:42.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.707+0000 7fd940c1b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:42.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.707+0000 7fd940c1b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:42.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.707+0000 7fd940c1b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:42.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.707+0000 7fd940c1b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:42.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.707+0000 7fd940c1b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.707+0000 7fd940c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.707+0000 7fd940c1b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.708+0000 7fd940c1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:42.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.708+0000 7fd940c1b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.708+0000 7fd940c1b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:42.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.708+0000 7fd940c1b800 20 zone default found 2024-09-12T17:43:42.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.708+0000 7fd940c1b800 4 Realm: () 2024-09-12T17:43:42.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.708+0000 7fd940c1b800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:42.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.708+0000 7fd940c1b800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:42.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.708+0000 7fd940c1b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:42.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.708+0000 7fd940c1b800 20 zonegroup default 2024-09-12T17:43:42.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.708+0000 7fd940c1b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.708+0000 7fd940c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.708+0000 7fd940c1b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.709+0000 7fd940c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.709+0000 7fd940c1b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.709+0000 7fd940c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:42.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.709+0000 7fd940c1b800 20 started sync module instance, tier type = 2024-09-12T17:43:42.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.709+0000 7fd940c1b800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:42.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.718+0000 7fd940c1b800 20 add_watcher() i=0 2024-09-12T17:43:42.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.718+0000 7fd940c1b800 20 add_watcher() i=1 2024-09-12T17:43:42.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.718+0000 7fd940c1b800 20 add_watcher() i=2 2024-09-12T17:43:42.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.718+0000 7fd940c1b800 20 add_watcher() i=3 2024-09-12T17:43:42.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.718+0000 7fd940c1b800 20 add_watcher() i=4 2024-09-12T17:43:42.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.718+0000 7fd940c1b800 20 add_watcher() i=5 2024-09-12T17:43:42.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.718+0000 7fd940c1b800 20 add_watcher() i=6 2024-09-12T17:43:42.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.719+0000 7fd940c1b800 20 add_watcher() i=7 2024-09-12T17:43:42.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.719+0000 7fd940c1b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:42.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.721+0000 7fd7f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:42.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.721+0000 7fd940c1b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:42.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.721+0000 7fd940c1b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:42.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.721+0000 7fd940c1b800 5 note: GC not initialized 2024-09-12T17:43:42.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.721+0000 7fd7f1fdb640 20 reqs_thread_entry: start 2024-09-12T17:43:42.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.722+0000 7fd940c1b800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:42.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.722+0000 7fd940c1b800 20 Filter name: none 2024-09-12T17:43:42.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.722+0000 7fd7637fe640 20 reqs_thread_entry: start 2024-09-12T17:43:42.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.722+0000 7fd940c1b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.722+0000 7fd940c1b800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:43:42.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.722+0000 7fd940c1b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.723+0000 7fd940c1b800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:43:42.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.723+0000 7fd940c1b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:42.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.723+0000 7fd940c1b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.723+0000 7fd940c1b800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:43:42.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.723+0000 7fd940c1b800 20 rados->read ofs=0 len=0 2024-09-12T17:43:42.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.723+0000 7fd940c1b800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:43:42.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.723+0000 7fd940c1b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:43:42.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.725+0000 7fd7f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:42.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.727+0000 7fd940c1b800 20 remove_watcher() i=0 2024-09-12T17:43:42.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.727+0000 7fd940c1b800 2 removed watcher, disabling cache 2024-09-12T17:43:42.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.728+0000 7fd940c1b800 20 remove_watcher() i=1 2024-09-12T17:43:42.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.729+0000 7fd940c1b800 20 remove_watcher() i=2 2024-09-12T17:43:42.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.730+0000 7fd940c1b800 20 remove_watcher() i=3 2024-09-12T17:43:42.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.731+0000 7fd940c1b800 20 remove_watcher() i=4 2024-09-12T17:43:42.733 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.732+0000 7fd940c1b800 20 remove_watcher() i=5 2024-09-12T17:43:42.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.733+0000 7fd940c1b800 20 remove_watcher() i=6 2024-09-12T17:43:42.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:42.734+0000 7fd940c1b800 20 remove_watcher() i=7 2024-09-12T17:43:42.746 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.746 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:43:42.747 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-block-writes id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:43:42.747 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:43:42.800 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:43:42.834 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:42.834 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:43.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.074+0000 7f8abc336800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.075+0000 7f8abc336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.075+0000 7f8abc336800 20 realm 2024-09-12T17:43:43.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.075+0000 7f8abc336800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.076+0000 7f8abc336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.076+0000 7f8abc336800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:43:43.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.076+0000 7f8abc336800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.076+0000 7f8abc336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.076+0000 7f8abc336800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.077+0000 7f8abc336800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:43.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.077+0000 7f8abc336800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.077+0000 7f8abc336800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:43:43.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.077+0000 7f8abc336800 20 searching for the correct realm 2024-09-12T17:43:43.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.080+0000 7f8ab78b6640 0 -- 172.21.15.44:0/3825119534 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f8aa80912a0 msgr2=0x7f8aa806e470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:43:43.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.084+0000 7f8ab80b7640 0 -- 172.21.15.44:0/3825119534 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f8aac07c450 msgr2=0x7f8aac07c8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:43:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.291+0000 7f8abc336800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:43:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.291+0000 7f8abc336800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:43:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.291+0000 7f8abc336800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:43:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.291+0000 7f8abc336800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:43:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.291+0000 7f8abc336800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:43:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.291+0000 7f8abc336800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:43:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.291+0000 7f8abc336800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.291+0000 7f8abc336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.291+0000 7f8abc336800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.292+0000 7f8abc336800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:43:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.292+0000 7f8abc336800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.292+0000 7f8abc336800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:43:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.292+0000 7f8abc336800 20 zone default found 2024-09-12T17:43:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.292+0000 7f8abc336800 4 Realm: () 2024-09-12T17:43:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.292+0000 7f8abc336800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:43:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.292+0000 7f8abc336800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:43:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.292+0000 7f8abc336800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:43:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.292+0000 7f8abc336800 20 zonegroup default 2024-09-12T17:43:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.292+0000 7f8abc336800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.292+0000 7f8abc336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.292+0000 7f8abc336800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.293+0000 7f8abc336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.293+0000 7f8abc336800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.293+0000 7f8abc336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:43:43.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.293+0000 7f8abc336800 20 started sync module instance, tier type = 2024-09-12T17:43:43.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.293+0000 7f8abc336800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:43:43.304 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.303+0000 7f8abc336800 20 add_watcher() i=0 2024-09-12T17:43:43.304 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.303+0000 7f8abc336800 20 add_watcher() i=1 2024-09-12T17:43:43.304 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.303+0000 7f8abc336800 20 add_watcher() i=2 2024-09-12T17:43:43.304 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.303+0000 7f8abc336800 20 add_watcher() i=3 2024-09-12T17:43:43.304 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.303+0000 7f8abc336800 20 add_watcher() i=4 2024-09-12T17:43:43.304 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.303+0000 7f8abc336800 20 add_watcher() i=5 2024-09-12T17:43:43.304 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.303+0000 7f8abc336800 20 add_watcher() i=6 2024-09-12T17:43:43.304 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.304+0000 7f8abc336800 20 add_watcher() i=7 2024-09-12T17:43:43.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.304+0000 7f8abc336800 2 all 8 watchers are set, enabling cache 2024-09-12T17:43:43.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.306+0000 7f896efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:43.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.306+0000 7f8abc336800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:43:43.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.306+0000 7f8abc336800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:43:43.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.306+0000 7f8abc336800 5 note: GC not initialized 2024-09-12T17:43:43.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.306+0000 7f896dfdb640 20 reqs_thread_entry: start 2024-09-12T17:43:43.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.306+0000 7f8abc336800 20 init_complete bucket index max shards: 11 2024-09-12T17:43:43.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.306+0000 7f8abc336800 20 Filter name: none 2024-09-12T17:43:43.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.307+0000 7f88df7fe640 20 reqs_thread_entry: start 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.307+0000 7f8abc336800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.307+0000 7f8abc336800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.307+0000 7f8abc336800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.307+0000 7f8abc336800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.307+0000 7f8abc336800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:43:43.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.307+0000 7f8abc336800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 : miss 2024-09-12T17:43:43.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.307+0000 7f8abc336800 20 rados->read ofs=0 len=0 2024-09-12T17:43:43.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.307+0000 7f8abc336800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:43:43.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.307+0000 7f8abc336800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:43:43.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.307+0000 7f8abc336800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:43:43.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.307+0000 7f8abc336800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:43:43.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.307+0000 7f8abc336800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:43:43.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.307+0000 7f8abc336800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 2024-09-12T17:43:43.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.309+0000 7f8abc336800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to be held by another RGW process; skipping for now 2024-09-12T17:43:43.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.310+0000 7f896efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:43:43.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.312+0000 7f8abc336800 20 remove_watcher() i=0 2024-09-12T17:43:43.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.312+0000 7f8abc336800 2 removed watcher, disabling cache 2024-09-12T17:43:43.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.313+0000 7f8abc336800 20 remove_watcher() i=1 2024-09-12T17:43:43.314 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.314+0000 7f8abc336800 20 remove_watcher() i=2 2024-09-12T17:43:43.315 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.315+0000 7f8abc336800 20 remove_watcher() i=3 2024-09-12T17:43:43.316 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.316+0000 7f8abc336800 20 remove_watcher() i=4 2024-09-12T17:43:43.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.317+0000 7f8abc336800 20 remove_watcher() i=5 2024-09-12T17:43:43.318 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.318+0000 7f8abc336800 20 remove_watcher() i=6 2024-09-12T17:43:43.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:43:43.319+0000 7f8abc336800 20 remove_watcher() i=7 2024-09-12T17:43:43.331 INFO:tasks.workunit.client.0.smithi044.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:44:13.348 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:44:13.384 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:13.461 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:13.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.426+0000 7f26ec6b9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.428+0000 7f26ec6b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:13.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.428+0000 7f26ec6b9800 20 realm 2024-09-12T17:44:13.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.428+0000 7f26ec6b9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.428+0000 7f26ec6b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:13.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.428+0000 7f26ec6b9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:13.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.428+0000 7f26ec6b9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.428+0000 7f26ec6b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:13.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.428+0000 7f26ec6b9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.429+0000 7f26ec6b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:13.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.429+0000 7f26ec6b9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.429+0000 7f26ec6b9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:13.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.429+0000 7f26ec6b9800 20 searching for the correct realm 2024-09-12T17:44:13.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.432+0000 7f26e99a2640 0 -- 172.21.15.44:0/2037540952 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f26dc0a6be0 msgr2=0x7f26dc044e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:13.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.437+0000 7f26ea1a3640 0 -- 172.21.15.44:0/2037540952 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f26e008eb20 msgr2=0x7f26e008a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:13.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.645+0000 7f26ec6b9800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:13.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.645+0000 7f26ec6b9800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:13.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.645+0000 7f26ec6b9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:13.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.645+0000 7f26ec6b9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:13.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.645+0000 7f26ec6b9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:13.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.645+0000 7f26ec6b9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:13.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.645+0000 7f26ec6b9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.645+0000 7f26ec6b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:13.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.645+0000 7f26ec6b9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.645+0000 7f26ec6b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:13.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.645+0000 7f26ec6b9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.646+0000 7f26ec6b9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:13.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.646+0000 7f26ec6b9800 20 zone default found 2024-09-12T17:44:13.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.646+0000 7f26ec6b9800 4 Realm: () 2024-09-12T17:44:13.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.646+0000 7f26ec6b9800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:13.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.646+0000 7f26ec6b9800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:13.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.646+0000 7f26ec6b9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:13.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.646+0000 7f26ec6b9800 20 zonegroup default 2024-09-12T17:44:13.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.646+0000 7f26ec6b9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.646+0000 7f26ec6b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:13.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.646+0000 7f26ec6b9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.647+0000 7f26ec6b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:13.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.647+0000 7f26ec6b9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.647+0000 7f26ec6b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:13.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.647+0000 7f26ec6b9800 20 started sync module instance, tier type = 2024-09-12T17:44:13.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.647+0000 7f26ec6b9800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:13.659 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.658+0000 7f26ec6b9800 20 add_watcher() i=0 2024-09-12T17:44:13.659 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.658+0000 7f26ec6b9800 20 add_watcher() i=1 2024-09-12T17:44:13.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.658+0000 7f26ec6b9800 20 add_watcher() i=2 2024-09-12T17:44:13.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.658+0000 7f26ec6b9800 20 add_watcher() i=3 2024-09-12T17:44:13.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.658+0000 7f26ec6b9800 20 add_watcher() i=4 2024-09-12T17:44:13.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.658+0000 7f26ec6b9800 20 add_watcher() i=5 2024-09-12T17:44:13.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.658+0000 7f26ec6b9800 20 add_watcher() i=6 2024-09-12T17:44:13.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.659+0000 7f26ec6b9800 20 add_watcher() i=7 2024-09-12T17:44:13.660 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.659+0000 7f26ec6b9800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:13.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.661+0000 7f25a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:13.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.661+0000 7f26ec6b9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:13.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.661+0000 7f26ec6b9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:13.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.661+0000 7f26ec6b9800 5 note: GC not initialized 2024-09-12T17:44:13.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.661+0000 7f251b7fe640 20 reqs_thread_entry: start 2024-09-12T17:44:13.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.662+0000 7f26ec6b9800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:13.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.662+0000 7f26ec6b9800 20 Filter name: none 2024-09-12T17:44:13.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.662+0000 7f25197fa640 20 reqs_thread_entry: start 2024-09-12T17:44:13.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.662+0000 7f26ec6b9800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:44:13.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.662+0000 7f26ec6b9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.662+0000 7f26ec6b9800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:44:13.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.662+0000 7f26ec6b9800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:44:13.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.662+0000 7f26ec6b9800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:44:13.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.662+0000 7f26ec6b9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 : miss 2024-09-12T17:44:13.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.662+0000 7f26ec6b9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.663+0000 7f26ec6b9800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:44:13.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.663+0000 7f26ec6b9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:44:13.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.663+0000 7f26ec6b9800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:44:13.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.663+0000 7f26ec6b9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:13.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.663+0000 7f26ec6b9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:13.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.663+0000 7f26ec6b9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 2024-09-12T17:44:13.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.664+0000 7f26ec6b9800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:44:13.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.671+0000 7f26ec6b9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:44:13.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.671+0000 7f26ec6b9800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:44:13.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.671+0000 7f26ec6b9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:13.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.671+0000 7f26ec6b9800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30, ofs0, ns] 2024-09-12T17:44:13.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.671+0000 7f25cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562437 cookie 94756734830000 notifier 6767 bl.length()=999 2024-09-12T17:44:13.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.671+0000 7f25cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:44:13.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.671+0000 7f25cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:44:13.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.671+0000 7f25cd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:13.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.672+0000 7f26ec6b9800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_sources= new_sources= 2024-09-12T17:44:13.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.672+0000 7f26ec6b9800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:44:13.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.672+0000 7f26ec6b9800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_dests= new_dests= 2024-09-12T17:44:13.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.672+0000 7f26ec6b9800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:44:13.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.0 2024-09-12T17:44:13.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.0 2024-09-12T17:44:13.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.1 2024-09-12T17:44:13.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.1 2024-09-12T17:44:13.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.2 2024-09-12T17:44:13.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.2 2024-09-12T17:44:13.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.3 2024-09-12T17:44:13.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.3 2024-09-12T17:44:13.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.4 2024-09-12T17:44:13.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.4 2024-09-12T17:44:13.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.5 2024-09-12T17:44:13.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.5 2024-09-12T17:44:13.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.6 2024-09-12T17:44:13.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.6 2024-09-12T17:44:13.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.7 2024-09-12T17:44:13.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.7 2024-09-12T17:44:13.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.8 2024-09-12T17:44:13.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.8 2024-09-12T17:44:13.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.9 2024-09-12T17:44:13.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.9 2024-09-12T17:44:13.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.10 2024-09-12T17:44:13.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.10 2024-09-12T17:44:13.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.11 2024-09-12T17:44:13.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2.11 2024-09-12T17:44:13.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.680+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.0 2024-09-12T17:44:13.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.681+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1 2024-09-12T17:44:13.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.681+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2 2024-09-12T17:44:13.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.682+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.3 2024-09-12T17:44:13.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.683+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.4 2024-09-12T17:44:13.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.684+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.5 2024-09-12T17:44:13.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.684+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.6 2024-09-12T17:44:13.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.685+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.7 2024-09-12T17:44:13.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.685+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.8 2024-09-12T17:44:13.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.686+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.9 2024-09-12T17:44:13.688 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.686+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.10 2024-09-12T17:44:13.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.690+0000 7f26ec6b9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:13.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.690+0000 7f26ec6b9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 2024-09-12T17:44:13.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.691+0000 7f26ec6b9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:44:13.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.691+0000 7f26ec6b9800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:44:13.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.691+0000 7f26ec6b9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:13.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.691+0000 7f26ec6b9800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30, ofs0, ns] 2024-09-12T17:44:13.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.692+0000 7f25cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562438 cookie 94756734830000 notifier 6767 bl.length()=999 2024-09-12T17:44:13.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.692+0000 7f25cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:44:13.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.692+0000 7f25cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:44:13.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.692+0000 7f25cd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:13.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.692+0000 7f26ec6b9800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_sources= new_sources= 2024-09-12T17:44:13.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.692+0000 7f26ec6b9800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:44:13.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.692+0000 7f26ec6b9800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_dests= new_dests= 2024-09-12T17:44:13.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.692+0000 7f26ec6b9800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:44:13.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.695+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.0 2024-09-12T17:44:13.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.695+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.1 2024-09-12T17:44:13.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.695+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.2 2024-09-12T17:44:13.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.696+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.3 2024-09-12T17:44:13.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.696+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.4 2024-09-12T17:44:13.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.697+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.5 2024-09-12T17:44:13.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.697+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.6 2024-09-12T17:44:13.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.697+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.7 2024-09-12T17:44:13.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.698+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.8 2024-09-12T17:44:13.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.698+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.9 2024-09-12T17:44:13.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.699+0000 7f26ec6b9800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30.10 2024-09-12T17:44:13.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.699+0000 7f26ec6b9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:13.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.699+0000 7f26ec6b9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 2024-09-12T17:44:13.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.700+0000 7f26ec6b9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:44:13.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.700+0000 7f26ec6b9800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:44:13.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.700+0000 7f26ec6b9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:13.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.700+0000 7f26ec6b9800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30, ofs0, ns] 2024-09-12T17:44:13.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.701+0000 7f25cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562439 cookie 94756734830000 notifier 6767 bl.length()=967 2024-09-12T17:44:13.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.701+0000 7f25cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 info.flags=0x17 2024-09-12T17:44:13.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.701+0000 7f25cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 to cache LRU end 2024-09-12T17:44:13.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.701+0000 7f25cd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:13.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.701+0000 7f26ec6b9800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_sources= new_sources= 2024-09-12T17:44:13.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.701+0000 7f26ec6b9800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential sources added=[] removed=[] 2024-09-12T17:44:13.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.701+0000 7f26ec6b9800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): orig_dests= new_dests= 2024-09-12T17:44:13.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.701+0000 7f26ec6b9800 20 handle_bi_update(): bucket=:abort-at-block-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30]): potential dests added=[] removed=[] 2024-09-12T17:44:13.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.704+0000 7f26ec6b9800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:44:13.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.706+0000 7f25a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:13.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.708+0000 7f26ec6b9800 20 remove_watcher() i=0 2024-09-12T17:44:13.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.708+0000 7f26ec6b9800 2 removed watcher, disabling cache 2024-09-12T17:44:13.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.709+0000 7f26ec6b9800 20 remove_watcher() i=1 2024-09-12T17:44:13.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.710+0000 7f26ec6b9800 20 remove_watcher() i=2 2024-09-12T17:44:13.713 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.712+0000 7f26ec6b9800 20 remove_watcher() i=3 2024-09-12T17:44:13.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.713+0000 7f26ec6b9800 20 remove_watcher() i=4 2024-09-12T17:44:13.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.714+0000 7f26ec6b9800 20 remove_watcher() i=5 2024-09-12T17:44:13.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.715+0000 7f26ec6b9800 20 remove_watcher() i=6 2024-09-12T17:44:13.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.716+0000 7f26ec6b9800 20 remove_watcher() i=7 2024-09-12T17:44:13.730 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:44:13.760 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:13.760 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:13.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.797+0000 7fbc3792a800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.799+0000 7fbc3792a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:13.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.799+0000 7fbc3792a800 20 realm 2024-09-12T17:44:13.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.799+0000 7fbc3792a800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.799+0000 7fbc3792a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:13.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.799+0000 7fbc3792a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:13.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.799+0000 7fbc3792a800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.799+0000 7fbc3792a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:13.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.799+0000 7fbc3792a800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.800+0000 7fbc3792a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:13.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.800+0000 7fbc3792a800 20 rados->read ofs=0 len=0 2024-09-12T17:44:13.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.801+0000 7fbc3792a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:13.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.801+0000 7fbc3792a800 20 searching for the correct realm 2024-09-12T17:44:13.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.803+0000 7fbc32ed9640 0 -- 172.21.15.44:0/3997715790 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fbc24090070 msgr2=0x7fbc2404d130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:13.809 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:13.808+0000 7fbc336da640 0 -- 172.21.15.44:0/3997715790 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fbc28067910 msgr2=0x7fbc28066a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:14.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.014+0000 7fbc3792a800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:14.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.014+0000 7fbc3792a800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:14.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.014+0000 7fbc3792a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:14.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.014+0000 7fbc3792a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:14.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.014+0000 7fbc3792a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:14.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.014+0000 7fbc3792a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:14.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.014+0000 7fbc3792a800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.014+0000 7fbc3792a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:14.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.014+0000 7fbc3792a800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.014+0000 7fbc3792a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:14.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.014+0000 7fbc3792a800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.015+0000 7fbc3792a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:14.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.015+0000 7fbc3792a800 20 zone default found 2024-09-12T17:44:14.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.015+0000 7fbc3792a800 4 Realm: () 2024-09-12T17:44:14.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.015+0000 7fbc3792a800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:14.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.015+0000 7fbc3792a800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:14.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.015+0000 7fbc3792a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:14.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.015+0000 7fbc3792a800 20 zonegroup default 2024-09-12T17:44:14.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.015+0000 7fbc3792a800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.015+0000 7fbc3792a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:14.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.015+0000 7fbc3792a800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.015+0000 7fbc3792a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:14.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.015+0000 7fbc3792a800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.015+0000 7fbc3792a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:14.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.015+0000 7fbc3792a800 20 started sync module instance, tier type = 2024-09-12T17:44:14.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.015+0000 7fbc3792a800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:14.027 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.025+0000 7fbc3792a800 20 add_watcher() i=0 2024-09-12T17:44:14.027 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.025+0000 7fbc3792a800 20 add_watcher() i=1 2024-09-12T17:44:14.027 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.025+0000 7fbc3792a800 20 add_watcher() i=2 2024-09-12T17:44:14.027 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.025+0000 7fbc3792a800 20 add_watcher() i=3 2024-09-12T17:44:14.027 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.025+0000 7fbc3792a800 20 add_watcher() i=4 2024-09-12T17:44:14.027 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.025+0000 7fbc3792a800 20 add_watcher() i=5 2024-09-12T17:44:14.027 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.025+0000 7fbc3792a800 20 add_watcher() i=6 2024-09-12T17:44:14.028 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.026+0000 7fbc3792a800 20 add_watcher() i=7 2024-09-12T17:44:14.028 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.026+0000 7fbc3792a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:14.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.028+0000 7fbae9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:14.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.028+0000 7fbc3792a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:14.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.028+0000 7fbc3792a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:14.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.028+0000 7fbc3792a800 5 note: GC not initialized 2024-09-12T17:44:14.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.028+0000 7fbae8fe1640 20 reqs_thread_entry: start 2024-09-12T17:44:14.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.029+0000 7fbc3792a800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:14.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.029+0000 7fbc3792a800 20 Filter name: none 2024-09-12T17:44:14.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.029+0000 7fba627fc640 20 reqs_thread_entry: start 2024-09-12T17:44:14.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.029+0000 7fbc3792a800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.029+0000 7fbc3792a800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:44:14.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.029+0000 7fbc3792a800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.030+0000 7fbc3792a800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:44:14.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.030+0000 7fbc3792a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:14.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.030+0000 7fbc3792a800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.030+0000 7fbc3792a800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:44:14.032 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.030+0000 7fbc3792a800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.030+0000 7fbc3792a800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:44:14.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.030+0000 7fbc3792a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:14.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.032+0000 7fbae9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:14.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.035+0000 7fbc3792a800 20 remove_watcher() i=0 2024-09-12T17:44:14.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.035+0000 7fbc3792a800 2 removed watcher, disabling cache 2024-09-12T17:44:14.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.036+0000 7fbc3792a800 20 remove_watcher() i=1 2024-09-12T17:44:14.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.037+0000 7fbc3792a800 20 remove_watcher() i=2 2024-09-12T17:44:14.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.038+0000 7fbc3792a800 20 remove_watcher() i=3 2024-09-12T17:44:14.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.039+0000 7fbc3792a800 20 remove_watcher() i=4 2024-09-12T17:44:14.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.040+0000 7fbc3792a800 20 remove_watcher() i=5 2024-09-12T17:44:14.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.041+0000 7fbc3792a800 20 remove_watcher() i=6 2024-09-12T17:44:14.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.042+0000 7fbc3792a800 20 remove_watcher() i=7 2024-09-12T17:44:14.055 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:14.055 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:44:14.055 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-block-writes id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:44:14.055 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:14.135 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T17:44:14.135 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:14.339 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:44:14.368 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:14.368 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:14.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.405+0000 7fafa2e13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.407+0000 7fafa2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:14.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.407+0000 7fafa2e13800 20 realm 2024-09-12T17:44:14.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.407+0000 7fafa2e13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.407+0000 7fafa2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:14.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.407+0000 7fafa2e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:14.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.407+0000 7fafa2e13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.407+0000 7fafa2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:14.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.407+0000 7fafa2e13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.408+0000 7fafa2e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:14.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.408+0000 7fafa2e13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.408+0000 7fafa2e13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:14.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.408+0000 7fafa2e13800 20 searching for the correct realm 2024-09-12T17:44:14.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.612+0000 7faf9e522640 0 -- 172.21.15.44:0/1768328574 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7faf98073040 msgr2=0x7faf98055920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:14.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.616+0000 7faf9e522640 0 -- 172.21.15.44:0/1768328574 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7fae68086290 msgr2=0x7fae680886c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:14.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.621+0000 7fafa2e13800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:14.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.621+0000 7fafa2e13800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:14.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.621+0000 7fafa2e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:14.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.621+0000 7fafa2e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:14.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.621+0000 7fafa2e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:14.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.621+0000 7fafa2e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:14.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.621+0000 7fafa2e13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.621+0000 7fafa2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:14.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.621+0000 7fafa2e13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.622+0000 7fafa2e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:14.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.622+0000 7fafa2e13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.622+0000 7fafa2e13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:14.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.622+0000 7fafa2e13800 20 zone default found 2024-09-12T17:44:14.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.622+0000 7fafa2e13800 4 Realm: () 2024-09-12T17:44:14.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.622+0000 7fafa2e13800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:14.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.622+0000 7fafa2e13800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:14.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.622+0000 7fafa2e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:14.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.622+0000 7fafa2e13800 20 zonegroup default 2024-09-12T17:44:14.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.622+0000 7fafa2e13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.622+0000 7fafa2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:14.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.622+0000 7fafa2e13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.623+0000 7fafa2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:14.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.623+0000 7fafa2e13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.623+0000 7fafa2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:14.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.623+0000 7fafa2e13800 20 started sync module instance, tier type = 2024-09-12T17:44:14.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.623+0000 7fafa2e13800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:14.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.632+0000 7fafa2e13800 20 add_watcher() i=0 2024-09-12T17:44:14.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.632+0000 7fafa2e13800 20 add_watcher() i=1 2024-09-12T17:44:14.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.632+0000 7fafa2e13800 20 add_watcher() i=2 2024-09-12T17:44:14.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.632+0000 7fafa2e13800 20 add_watcher() i=3 2024-09-12T17:44:14.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.632+0000 7fafa2e13800 20 add_watcher() i=4 2024-09-12T17:44:14.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.632+0000 7fafa2e13800 20 add_watcher() i=5 2024-09-12T17:44:14.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.632+0000 7fafa2e13800 20 add_watcher() i=6 2024-09-12T17:44:14.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.633+0000 7fafa2e13800 20 add_watcher() i=7 2024-09-12T17:44:14.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.633+0000 7fafa2e13800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:14.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.635+0000 7fae54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:14.637 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.635+0000 7fafa2e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:14.637 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.635+0000 7fafa2e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:14.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.635+0000 7fafa2e13800 5 note: GC not initialized 2024-09-12T17:44:14.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.635+0000 7fadcf7fe640 20 reqs_thread_entry: start 2024-09-12T17:44:14.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.636+0000 7fafa2e13800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:14.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.636+0000 7fafa2e13800 20 Filter name: none 2024-09-12T17:44:14.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.636+0000 7fadcd7fa640 20 reqs_thread_entry: start 2024-09-12T17:44:14.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.636+0000 7fafa2e13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.637+0000 7fafa2e13800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:14.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.637+0000 7fafa2e13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.637+0000 7fafa2e13800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:14.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.637+0000 7fafa2e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:14.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.637+0000 7fafa2e13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.638+0000 7fafa2e13800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:14.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.638+0000 7fafa2e13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.638+0000 7fafa2e13800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:14.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.638+0000 7fafa2e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:14.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.640+0000 7fae54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:14.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.642+0000 7fafa2e13800 20 remove_watcher() i=0 2024-09-12T17:44:14.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.642+0000 7fafa2e13800 2 removed watcher, disabling cache 2024-09-12T17:44:14.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.643+0000 7fafa2e13800 20 remove_watcher() i=1 2024-09-12T17:44:14.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.644+0000 7fafa2e13800 20 remove_watcher() i=2 2024-09-12T17:44:14.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.645+0000 7fafa2e13800 20 remove_watcher() i=3 2024-09-12T17:44:14.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.647+0000 7fafa2e13800 20 remove_watcher() i=4 2024-09-12T17:44:14.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.647+0000 7fafa2e13800 20 remove_watcher() i=5 2024-09-12T17:44:14.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.648+0000 7fafa2e13800 20 remove_watcher() i=6 2024-09-12T17:44:14.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.649+0000 7fafa2e13800 20 remove_watcher() i=7 2024-09-12T17:44:14.661 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:14.662 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:44:14.662 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-commit-target-layout id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:44:14.662 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:14.664 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T17:44:14.699 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:14.699 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:14.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.736+0000 7f72a7430800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.738+0000 7f72a7430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:14.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.738+0000 7f72a7430800 20 realm 2024-09-12T17:44:14.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.738+0000 7f72a7430800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.738+0000 7f72a7430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:14.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.738+0000 7f72a7430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:14.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.738+0000 7f72a7430800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.738+0000 7f72a7430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:14.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.738+0000 7f72a7430800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.739+0000 7f72a7430800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:14.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.739+0000 7f72a7430800 20 rados->read ofs=0 len=0 2024-09-12T17:44:14.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.739+0000 7f72a7430800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:14.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.740+0000 7f72a7430800 20 searching for the correct realm 2024-09-12T17:44:14.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.742+0000 7f72a1fcb640 0 -- 172.21.15.44:0/2763711174 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f72940b8e80 msgr2=0x7f72940a5900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:14.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:14.948+0000 7f72a27cc640 0 -- 172.21.15.44:0/2763711174 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f7298069420 msgr2=0x7f7298069880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:15.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.154+0000 7f72a7430800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:15.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.154+0000 7f72a7430800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:15.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.154+0000 7f72a7430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:15.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.154+0000 7f72a7430800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:15.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.154+0000 7f72a7430800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:15.157 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.154+0000 7f72a7430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:15.157 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.154+0000 7f72a7430800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.157 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.154+0000 7f72a7430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:15.157 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.154+0000 7f72a7430800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.155+0000 7f72a7430800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:15.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.155+0000 7f72a7430800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.155+0000 7f72a7430800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:15.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.155+0000 7f72a7430800 20 zone default found 2024-09-12T17:44:15.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.155+0000 7f72a7430800 4 Realm: () 2024-09-12T17:44:15.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.155+0000 7f72a7430800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:15.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.155+0000 7f72a7430800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:15.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.155+0000 7f72a7430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:15.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.155+0000 7f72a7430800 20 zonegroup default 2024-09-12T17:44:15.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.155+0000 7f72a7430800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.156+0000 7f72a7430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:15.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.156+0000 7f72a7430800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.156+0000 7f72a7430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:15.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.156+0000 7f72a7430800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.156+0000 7f72a7430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:15.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.156+0000 7f72a7430800 20 started sync module instance, tier type = 2024-09-12T17:44:15.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.156+0000 7f72a7430800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:15.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.166+0000 7f72a7430800 20 add_watcher() i=0 2024-09-12T17:44:15.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.166+0000 7f72a7430800 20 add_watcher() i=1 2024-09-12T17:44:15.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.166+0000 7f72a7430800 20 add_watcher() i=2 2024-09-12T17:44:15.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.166+0000 7f72a7430800 20 add_watcher() i=3 2024-09-12T17:44:15.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.166+0000 7f72a7430800 20 add_watcher() i=4 2024-09-12T17:44:15.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.166+0000 7f72a7430800 20 add_watcher() i=5 2024-09-12T17:44:15.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.166+0000 7f72a7430800 20 add_watcher() i=6 2024-09-12T17:44:15.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.167+0000 7f72a7430800 20 add_watcher() i=7 2024-09-12T17:44:15.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.167+0000 7f72a7430800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:15.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.169+0000 7f7158fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:15.171 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.169+0000 7f72a7430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:15.171 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.169+0000 7f72a7430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:15.171 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.169+0000 7f72a7430800 5 note: GC not initialized 2024-09-12T17:44:15.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.170+0000 7f70d37fe640 20 reqs_thread_entry: start 2024-09-12T17:44:15.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.170+0000 7f72a7430800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:15.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.170+0000 7f72a7430800 20 Filter name: none 2024-09-12T17:44:15.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.170+0000 7f70d17fa640 20 reqs_thread_entry: start 2024-09-12T17:44:15.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.170+0000 7f72a7430800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:44:15.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.170+0000 7f72a7430800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.171+0000 7f72a7430800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:15.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.171+0000 7f72a7430800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:44:15.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.171+0000 7f72a7430800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:44:15.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.171+0000 7f72a7430800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 : miss 2024-09-12T17:44:15.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.171+0000 7f72a7430800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.171+0000 7f72a7430800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:15.174 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.171+0000 7f72a7430800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 info.flags=0x17 2024-09-12T17:44:15.174 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.171+0000 7f72a7430800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 to cache LRU end 2024-09-12T17:44:15.174 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.171+0000 7f72a7430800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:15.174 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.171+0000 7f72a7430800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:15.174 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.171+0000 7f72a7430800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 2024-09-12T17:44:15.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.176+0000 7f72a7430800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 info.flags=0x17 2024-09-12T17:44:15.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.176+0000 7f72a7430800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 to cache LRU end 2024-09-12T17:44:15.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.176+0000 7f72a7430800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:15.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.176+0000 7f72a7430800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31, ofs0, ns] 2024-09-12T17:44:15.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.177+0000 7f7185ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562430 cookie 94404092972224 notifier 7302 bl.length()=1015 2024-09-12T17:44:15.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.177+0000 7f7185ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 info.flags=0x17 2024-09-12T17:44:15.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.177+0000 7f7185ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 to cache LRU end 2024-09-12T17:44:15.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.177+0000 7f7185ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:15.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.177+0000 7f72a7430800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): orig_sources= new_sources= 2024-09-12T17:44:15.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.177+0000 7f72a7430800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): potential sources added=[] removed=[] 2024-09-12T17:44:15.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.177+0000 7f72a7430800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): orig_dests= new_dests= 2024-09-12T17:44:15.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.177+0000 7f72a7430800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): potential dests added=[] removed=[] 2024-09-12T17:44:15.186 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.0 2024-09-12T17:44:15.186 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.0 2024-09-12T17:44:15.186 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.1 2024-09-12T17:44:15.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.1 2024-09-12T17:44:15.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.2 2024-09-12T17:44:15.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.2 2024-09-12T17:44:15.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.3 2024-09-12T17:44:15.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.3 2024-09-12T17:44:15.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.4 2024-09-12T17:44:15.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.4 2024-09-12T17:44:15.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.5 2024-09-12T17:44:15.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.5 2024-09-12T17:44:15.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.6 2024-09-12T17:44:15.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.6 2024-09-12T17:44:15.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.7 2024-09-12T17:44:15.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.7 2024-09-12T17:44:15.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.8 2024-09-12T17:44:15.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.8 2024-09-12T17:44:15.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.9 2024-09-12T17:44:15.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.9 2024-09-12T17:44:15.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.10 2024-09-12T17:44:15.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.10 2024-09-12T17:44:15.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.11 2024-09-12T17:44:15.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1.11 2024-09-12T17:44:15.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.183+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.0 2024-09-12T17:44:15.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.184+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1 2024-09-12T17:44:15.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.184+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2 2024-09-12T17:44:15.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.185+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.3 2024-09-12T17:44:15.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.185+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.4 2024-09-12T17:44:15.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.186+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.5 2024-09-12T17:44:15.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.186+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.6 2024-09-12T17:44:15.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.187+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.7 2024-09-12T17:44:15.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.187+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.8 2024-09-12T17:44:15.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.188+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.9 2024-09-12T17:44:15.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.189+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.10 2024-09-12T17:44:15.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.192+0000 7f72a7430800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:15.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.192+0000 7f72a7430800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 2024-09-12T17:44:15.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.193+0000 7f72a7430800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 info.flags=0x17 2024-09-12T17:44:15.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.193+0000 7f72a7430800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 to cache LRU end 2024-09-12T17:44:15.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.193+0000 7f72a7430800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:15.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.193+0000 7f72a7430800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31, ofs0, ns] 2024-09-12T17:44:15.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.194+0000 7f71857fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562431 cookie 94404092972224 notifier 7302 bl.length()=1015 2024-09-12T17:44:15.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.194+0000 7f71857fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 info.flags=0x17 2024-09-12T17:44:15.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.194+0000 7f71857fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 to cache LRU end 2024-09-12T17:44:15.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.194+0000 7f71857fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:15.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.194+0000 7f72a7430800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): orig_sources= new_sources= 2024-09-12T17:44:15.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.194+0000 7f72a7430800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): potential sources added=[] removed=[] 2024-09-12T17:44:15.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.194+0000 7f72a7430800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): orig_dests= new_dests= 2024-09-12T17:44:15.196 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.194+0000 7f72a7430800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): potential dests added=[] removed=[] 2024-09-12T17:44:15.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.196+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.0 2024-09-12T17:44:15.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.197+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1 2024-09-12T17:44:15.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.197+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2 2024-09-12T17:44:15.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.197+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.3 2024-09-12T17:44:15.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.198+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.4 2024-09-12T17:44:15.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.198+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.5 2024-09-12T17:44:15.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.198+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.6 2024-09-12T17:44:15.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.199+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.7 2024-09-12T17:44:15.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.199+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.8 2024-09-12T17:44:15.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.199+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.9 2024-09-12T17:44:15.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.200+0000 7f72a7430800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.10 2024-09-12T17:44:15.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.200+0000 7f72a7430800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T17:44:15.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.200+0000 7f72a7430800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T17:44:15.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.204+0000 7f7158fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:15.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.206+0000 7f72a7430800 20 remove_watcher() i=0 2024-09-12T17:44:15.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.206+0000 7f72a7430800 2 removed watcher, disabling cache 2024-09-12T17:44:15.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.207+0000 7f72a7430800 20 remove_watcher() i=1 2024-09-12T17:44:15.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.208+0000 7f72a7430800 20 remove_watcher() i=2 2024-09-12T17:44:15.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.209+0000 7f72a7430800 20 remove_watcher() i=3 2024-09-12T17:44:15.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.210+0000 7f72a7430800 20 remove_watcher() i=4 2024-09-12T17:44:15.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.211+0000 7f72a7430800 20 remove_watcher() i=5 2024-09-12T17:44:15.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.213+0000 7f72a7430800 20 remove_watcher() i=6 2024-09-12T17:44:15.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.214+0000 7f72a7430800 20 remove_watcher() i=7 2024-09-12T17:44:15.228 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:44:15.258 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:15.258 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:15.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.295+0000 7fe1aa240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.297+0000 7fe1aa240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:15.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.297+0000 7fe1aa240800 20 realm 2024-09-12T17:44:15.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.297+0000 7fe1aa240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.297+0000 7fe1aa240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:15.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.297+0000 7fe1aa240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:15.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.297+0000 7fe1aa240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.297+0000 7fe1aa240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:15.299 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.297+0000 7fe1aa240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.300 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.298+0000 7fe1aa240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:15.300 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.298+0000 7fe1aa240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.300 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.299+0000 7fe1aa240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:15.300 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.299+0000 7fe1aa240800 20 searching for the correct realm 2024-09-12T17:44:15.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.502+0000 7fe1a7529640 0 -- 172.21.15.44:0/2895420386 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fe19806d060 msgr2=0x7fe1980ad8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:15.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.506+0000 7fe1a7d2a640 0 -- 172.21.15.44:0/2895420386 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fe19c051040 msgr2=0x7fe19c03e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:15.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.712+0000 7fe1aa240800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:15.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.712+0000 7fe1aa240800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:15.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.712+0000 7fe1aa240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:15.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.712+0000 7fe1aa240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:15.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.712+0000 7fe1aa240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:15.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.712+0000 7fe1aa240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:15.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.712+0000 7fe1aa240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.713+0000 7fe1aa240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:15.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.713+0000 7fe1aa240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.713+0000 7fe1aa240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:15.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.713+0000 7fe1aa240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.713+0000 7fe1aa240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:15.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.713+0000 7fe1aa240800 20 zone default found 2024-09-12T17:44:15.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.713+0000 7fe1aa240800 4 Realm: () 2024-09-12T17:44:15.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.713+0000 7fe1aa240800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:15.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.713+0000 7fe1aa240800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:15.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.713+0000 7fe1aa240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:15.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.713+0000 7fe1aa240800 20 zonegroup default 2024-09-12T17:44:15.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.713+0000 7fe1aa240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.714+0000 7fe1aa240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:15.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.714+0000 7fe1aa240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.714+0000 7fe1aa240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:15.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.714+0000 7fe1aa240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.714+0000 7fe1aa240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:15.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.714+0000 7fe1aa240800 20 started sync module instance, tier type = 2024-09-12T17:44:15.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.714+0000 7fe1aa240800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:15.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.724+0000 7fe1aa240800 20 add_watcher() i=0 2024-09-12T17:44:15.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.724+0000 7fe1aa240800 20 add_watcher() i=1 2024-09-12T17:44:15.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.724+0000 7fe1aa240800 20 add_watcher() i=2 2024-09-12T17:44:15.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.724+0000 7fe1aa240800 20 add_watcher() i=3 2024-09-12T17:44:15.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.724+0000 7fe1aa240800 20 add_watcher() i=4 2024-09-12T17:44:15.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.724+0000 7fe1aa240800 20 add_watcher() i=5 2024-09-12T17:44:15.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.724+0000 7fe1aa240800 20 add_watcher() i=6 2024-09-12T17:44:15.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.725+0000 7fe1aa240800 20 add_watcher() i=7 2024-09-12T17:44:15.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.725+0000 7fe1aa240800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:15.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.727+0000 7fe05dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:15.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.728+0000 7fe1aa240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:15.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.728+0000 7fe1aa240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:15.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.728+0000 7fe1aa240800 5 note: GC not initialized 2024-09-12T17:44:15.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.728+0000 7fe05cfe1640 20 reqs_thread_entry: start 2024-09-12T17:44:15.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.728+0000 7fe1aa240800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:15.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.728+0000 7fe1aa240800 20 Filter name: none 2024-09-12T17:44:15.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.728+0000 7fdfd67fc640 20 reqs_thread_entry: start 2024-09-12T17:44:15.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.728+0000 7fe1aa240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.729+0000 7fe1aa240800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:15.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.729+0000 7fe1aa240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.730+0000 7fe1aa240800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:44:15.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.730+0000 7fe1aa240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:15.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.730+0000 7fe1aa240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.730+0000 7fe1aa240800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:15.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.730+0000 7fe1aa240800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.730+0000 7fe1aa240800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:44:15.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.730+0000 7fe1aa240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:15.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.732+0000 7fe05dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:15.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.735+0000 7fe1aa240800 20 remove_watcher() i=0 2024-09-12T17:44:15.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.735+0000 7fe1aa240800 2 removed watcher, disabling cache 2024-09-12T17:44:15.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.736+0000 7fe1aa240800 20 remove_watcher() i=1 2024-09-12T17:44:15.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.737+0000 7fe1aa240800 20 remove_watcher() i=2 2024-09-12T17:44:15.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.738+0000 7fe1aa240800 20 remove_watcher() i=3 2024-09-12T17:44:15.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.739+0000 7fe1aa240800 20 remove_watcher() i=4 2024-09-12T17:44:15.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.740+0000 7fe1aa240800 20 remove_watcher() i=5 2024-09-12T17:44:15.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.742+0000 7fe1aa240800 20 remove_watcher() i=6 2024-09-12T17:44:15.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.743+0000 7fe1aa240800 20 remove_watcher() i=7 2024-09-12T17:44:15.756 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:15.756 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:44:15.756 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-commit-target-layout id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:44:15.757 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:15.810 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:44:15.843 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:15.844 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:15.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.883+0000 7f2281146800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.885+0000 7f2281146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:15.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.885+0000 7f2281146800 20 realm 2024-09-12T17:44:15.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.885+0000 7f2281146800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.885+0000 7f2281146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:15.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.885+0000 7f2281146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:15.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.885+0000 7f2281146800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.885+0000 7f2281146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:15.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.885+0000 7f2281146800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.886+0000 7f2281146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:15.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.886+0000 7f2281146800 20 rados->read ofs=0 len=0 2024-09-12T17:44:15.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.886+0000 7f2281146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:15.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.886+0000 7f2281146800 20 searching for the correct realm 2024-09-12T17:44:15.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:15.888+0000 7f227ec30640 0 -- 172.21.15.44:0/1807464893 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7f2278004040 msgr2=0x7f22780650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:16.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.094+0000 7f227f431640 0 -- 172.21.15.44:0/1807464893 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f2274020060 msgr2=0x7f22740990b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:16.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.099+0000 7f2281146800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:16.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.099+0000 7f2281146800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:16.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.099+0000 7f2281146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:16.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.099+0000 7f2281146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:16.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.099+0000 7f2281146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:16.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.099+0000 7f2281146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:16.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.099+0000 7f2281146800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.099+0000 7f2281146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.099+0000 7f2281146800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.100+0000 7f2281146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:16.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.100+0000 7f2281146800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.100+0000 7f2281146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:16.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.100+0000 7f2281146800 20 zone default found 2024-09-12T17:44:16.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.100+0000 7f2281146800 4 Realm: () 2024-09-12T17:44:16.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.100+0000 7f2281146800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:16.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.100+0000 7f2281146800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:16.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.100+0000 7f2281146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:16.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.100+0000 7f2281146800 20 zonegroup default 2024-09-12T17:44:16.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.100+0000 7f2281146800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.101+0000 7f2281146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.101+0000 7f2281146800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.101+0000 7f2281146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.101+0000 7f2281146800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.101+0000 7f2281146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.101+0000 7f2281146800 20 started sync module instance, tier type = 2024-09-12T17:44:16.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.101+0000 7f2281146800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:16.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.111+0000 7f2281146800 20 add_watcher() i=0 2024-09-12T17:44:16.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.111+0000 7f2281146800 20 add_watcher() i=1 2024-09-12T17:44:16.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.111+0000 7f2281146800 20 add_watcher() i=2 2024-09-12T17:44:16.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.111+0000 7f2281146800 20 add_watcher() i=3 2024-09-12T17:44:16.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.111+0000 7f2281146800 20 add_watcher() i=4 2024-09-12T17:44:16.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.111+0000 7f2281146800 20 add_watcher() i=5 2024-09-12T17:44:16.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.111+0000 7f2281146800 20 add_watcher() i=6 2024-09-12T17:44:16.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.112+0000 7f2281146800 20 add_watcher() i=7 2024-09-12T17:44:16.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.112+0000 7f2281146800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:16.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.113+0000 7f21317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:16.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.114+0000 7f2281146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:16.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.114+0000 7f2281146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:16.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.114+0000 7f2281146800 5 note: GC not initialized 2024-09-12T17:44:16.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.114+0000 7f20abfff640 20 reqs_thread_entry: start 2024-09-12T17:44:16.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.114+0000 7f2281146800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:16.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.114+0000 7f2281146800 20 Filter name: none 2024-09-12T17:44:16.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.114+0000 7f20a9ffb640 20 reqs_thread_entry: start 2024-09-12T17:44:16.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.114+0000 7f2281146800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:44:16.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.114+0000 7f2281146800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.115+0000 7f2281146800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:16.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.115+0000 7f2281146800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:44:16.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.115+0000 7f2281146800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:44:16.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.115+0000 7f2281146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 : miss 2024-09-12T17:44:16.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.115+0000 7f2281146800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.115+0000 7f2281146800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:44:16.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.115+0000 7f2281146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 info.flags=0x17 2024-09-12T17:44:16.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.115+0000 7f2281146800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 to cache LRU end 2024-09-12T17:44:16.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.115+0000 7f2281146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:16.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.115+0000 7f2281146800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:16.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.115+0000 7f2281146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 2024-09-12T17:44:16.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.116+0000 7f2281146800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:44:16.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.124+0000 7f2281146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 info.flags=0x17 2024-09-12T17:44:16.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.124+0000 7f2281146800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 to cache LRU end 2024-09-12T17:44:16.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.124+0000 7f2281146800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:16.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.124+0000 7f2281146800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31, ofs0, ns] 2024-09-12T17:44:16.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.124+0000 7f21627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562432 cookie 94234237050160 notifier 7335 bl.length()=1015 2024-09-12T17:44:16.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.124+0000 7f21627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 info.flags=0x17 2024-09-12T17:44:16.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.124+0000 7f21627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 to cache LRU end 2024-09-12T17:44:16.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.124+0000 7f21627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:16.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.124+0000 7f2281146800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): orig_sources= new_sources= 2024-09-12T17:44:16.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.124+0000 7f2281146800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): potential sources added=[] removed=[] 2024-09-12T17:44:16.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.124+0000 7f2281146800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): orig_dests= new_dests= 2024-09-12T17:44:16.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.124+0000 7f2281146800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): potential dests added=[] removed=[] 2024-09-12T17:44:16.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.0 2024-09-12T17:44:16.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.0 2024-09-12T17:44:16.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.1 2024-09-12T17:44:16.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.1 2024-09-12T17:44:16.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.2 2024-09-12T17:44:16.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.2 2024-09-12T17:44:16.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.3 2024-09-12T17:44:16.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.3 2024-09-12T17:44:16.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.4 2024-09-12T17:44:16.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.4 2024-09-12T17:44:16.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.5 2024-09-12T17:44:16.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.5 2024-09-12T17:44:16.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.6 2024-09-12T17:44:16.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.6 2024-09-12T17:44:16.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.7 2024-09-12T17:44:16.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.7 2024-09-12T17:44:16.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.8 2024-09-12T17:44:16.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.8 2024-09-12T17:44:16.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.9 2024-09-12T17:44:16.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.9 2024-09-12T17:44:16.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.10 2024-09-12T17:44:16.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.10 2024-09-12T17:44:16.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.11 2024-09-12T17:44:16.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2.11 2024-09-12T17:44:16.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.129+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.0 2024-09-12T17:44:16.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.130+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1 2024-09-12T17:44:16.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.130+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2 2024-09-12T17:44:16.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.131+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.3 2024-09-12T17:44:16.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.131+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.4 2024-09-12T17:44:16.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.132+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.5 2024-09-12T17:44:16.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.132+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.6 2024-09-12T17:44:16.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.133+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.7 2024-09-12T17:44:16.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.133+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.8 2024-09-12T17:44:16.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.133+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.9 2024-09-12T17:44:16.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.134+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.10 2024-09-12T17:44:16.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.137+0000 7f2281146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:16.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.137+0000 7f2281146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 2024-09-12T17:44:16.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.138+0000 7f2281146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 info.flags=0x17 2024-09-12T17:44:16.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.138+0000 7f2281146800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 to cache LRU end 2024-09-12T17:44:16.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.138+0000 7f2281146800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:16.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.138+0000 7f2281146800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31, ofs0, ns] 2024-09-12T17:44:16.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.138+0000 7f2161ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562433 cookie 94234237050160 notifier 7335 bl.length()=1015 2024-09-12T17:44:16.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.138+0000 7f2161ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 info.flags=0x17 2024-09-12T17:44:16.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.138+0000 7f2161ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 to cache LRU end 2024-09-12T17:44:16.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.138+0000 7f2161ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:16.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.139+0000 7f2281146800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): orig_sources= new_sources= 2024-09-12T17:44:16.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.139+0000 7f2281146800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): potential sources added=[] removed=[] 2024-09-12T17:44:16.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.139+0000 7f2281146800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): orig_dests= new_dests= 2024-09-12T17:44:16.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.139+0000 7f2281146800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): potential dests added=[] removed=[] 2024-09-12T17:44:16.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.141+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.0 2024-09-12T17:44:16.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.142+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.1 2024-09-12T17:44:16.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.142+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.2 2024-09-12T17:44:16.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.142+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.3 2024-09-12T17:44:16.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.143+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.4 2024-09-12T17:44:16.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.143+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.5 2024-09-12T17:44:16.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.143+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.6 2024-09-12T17:44:16.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.143+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.7 2024-09-12T17:44:16.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.144+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.8 2024-09-12T17:44:16.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.144+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.9 2024-09-12T17:44:16.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.145+0000 7f2281146800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31.10 2024-09-12T17:44:16.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.145+0000 7f2281146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:16.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.145+0000 7f2281146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 2024-09-12T17:44:16.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.147+0000 7f2281146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 info.flags=0x17 2024-09-12T17:44:16.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.147+0000 7f2281146800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 to cache LRU end 2024-09-12T17:44:16.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.147+0000 7f2281146800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:16.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.147+0000 7f2281146800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31, ofs0, ns] 2024-09-12T17:44:16.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.147+0000 7f2161ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562434 cookie 94234237050160 notifier 7335 bl.length()=983 2024-09-12T17:44:16.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.147+0000 7f2161ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 info.flags=0x17 2024-09-12T17:44:16.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.147+0000 7f2161ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 to cache LRU end 2024-09-12T17:44:16.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.147+0000 7f2161ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:16.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.148+0000 7f2281146800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): orig_sources= new_sources= 2024-09-12T17:44:16.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.148+0000 7f2281146800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): potential sources added=[] removed=[] 2024-09-12T17:44:16.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.148+0000 7f2281146800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): orig_dests= new_dests= 2024-09-12T17:44:16.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.148+0000 7f2281146800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31]): potential dests added=[] removed=[] 2024-09-12T17:44:16.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.150+0000 7f2281146800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:44:16.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.152+0000 7f21317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:16.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.154+0000 7f2281146800 20 remove_watcher() i=0 2024-09-12T17:44:16.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.154+0000 7f2281146800 2 removed watcher, disabling cache 2024-09-12T17:44:16.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.155+0000 7f2281146800 20 remove_watcher() i=1 2024-09-12T17:44:16.157 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.156+0000 7f2281146800 20 remove_watcher() i=2 2024-09-12T17:44:16.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.157+0000 7f2281146800 20 remove_watcher() i=3 2024-09-12T17:44:16.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.158+0000 7f2281146800 20 remove_watcher() i=4 2024-09-12T17:44:16.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.159+0000 7f2281146800 20 remove_watcher() i=5 2024-09-12T17:44:16.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.160+0000 7f2281146800 20 remove_watcher() i=6 2024-09-12T17:44:16.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.161+0000 7f2281146800 20 remove_watcher() i=7 2024-09-12T17:44:16.176 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:44:16.205 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:16.206 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:16.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.243+0000 7f44e7a0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.245+0000 7f44e7a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.245+0000 7f44e7a0e800 20 realm 2024-09-12T17:44:16.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.245+0000 7f44e7a0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.245+0000 7f44e7a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.245+0000 7f44e7a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:16.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.245+0000 7f44e7a0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.245+0000 7f44e7a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.245+0000 7f44e7a0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.246+0000 7f44e7a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:16.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.246+0000 7f44e7a0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.246+0000 7f44e7a0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:16.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.246+0000 7f44e7a0e800 20 searching for the correct realm 2024-09-12T17:44:16.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.250+0000 7f44e2858640 0 -- 172.21.15.44:0/2998555075 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55cb757f60f0 msgr2=0x55cb757f84e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:16.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.253+0000 7f44e3059640 0 -- 172.21.15.44:0/2998555075 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f44d8008410 msgr2=0x7f44d8008890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:16.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.257+0000 7f44e7a0e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:16.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.257+0000 7f44e7a0e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:16.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.257+0000 7f44e7a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:16.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.257+0000 7f44e7a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:16.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.257+0000 7f44e7a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:16.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.257+0000 7f44e7a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:16.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.257+0000 7f44e7a0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.258+0000 7f44e7a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.258+0000 7f44e7a0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.258+0000 7f44e7a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:16.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.258+0000 7f44e7a0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.258+0000 7f44e7a0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:16.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.258+0000 7f44e7a0e800 20 zone default found 2024-09-12T17:44:16.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.258+0000 7f44e7a0e800 4 Realm: () 2024-09-12T17:44:16.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.258+0000 7f44e7a0e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:16.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.258+0000 7f44e7a0e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:16.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.258+0000 7f44e7a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:16.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.258+0000 7f44e7a0e800 20 zonegroup default 2024-09-12T17:44:16.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.258+0000 7f44e7a0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.258+0000 7f44e7a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.258+0000 7f44e7a0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.259+0000 7f44e7a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.259+0000 7f44e7a0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.259+0000 7f44e7a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.259+0000 7f44e7a0e800 20 started sync module instance, tier type = 2024-09-12T17:44:16.262 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.259+0000 7f44e7a0e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:16.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.268+0000 7f44e7a0e800 20 add_watcher() i=0 2024-09-12T17:44:16.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.268+0000 7f44e7a0e800 20 add_watcher() i=1 2024-09-12T17:44:16.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.268+0000 7f44e7a0e800 20 add_watcher() i=2 2024-09-12T17:44:16.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.268+0000 7f44e7a0e800 20 add_watcher() i=3 2024-09-12T17:44:16.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.268+0000 7f44e7a0e800 20 add_watcher() i=4 2024-09-12T17:44:16.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.268+0000 7f44e7a0e800 20 add_watcher() i=5 2024-09-12T17:44:16.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.268+0000 7f44e7a0e800 20 add_watcher() i=6 2024-09-12T17:44:16.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.269+0000 7f44e7a0e800 20 add_watcher() i=7 2024-09-12T17:44:16.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.269+0000 7f44e7a0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:16.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.270+0000 7f4399fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:16.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.271+0000 7f44e7a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:16.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.271+0000 7f44e7a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:16.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.271+0000 7f44e7a0e800 5 note: GC not initialized 2024-09-12T17:44:16.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.271+0000 7f4398fe1640 20 reqs_thread_entry: start 2024-09-12T17:44:16.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.271+0000 7f44e7a0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:16.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.271+0000 7f44e7a0e800 20 Filter name: none 2024-09-12T17:44:16.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.271+0000 7f43127fc640 20 reqs_thread_entry: start 2024-09-12T17:44:16.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.271+0000 7f44e7a0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.272+0000 7f44e7a0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:16.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.272+0000 7f44e7a0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.272+0000 7f44e7a0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:16.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.272+0000 7f44e7a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:16.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.272+0000 7f44e7a0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.273+0000 7f44e7a0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:16.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.273+0000 7f44e7a0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.273+0000 7f44e7a0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:16.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.273+0000 7f44e7a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:16.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.275+0000 7f4399fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:16.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.277+0000 7f44e7a0e800 20 remove_watcher() i=0 2024-09-12T17:44:16.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.277+0000 7f44e7a0e800 2 removed watcher, disabling cache 2024-09-12T17:44:16.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.278+0000 7f44e7a0e800 20 remove_watcher() i=1 2024-09-12T17:44:16.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.279+0000 7f44e7a0e800 20 remove_watcher() i=2 2024-09-12T17:44:16.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.280+0000 7f44e7a0e800 20 remove_watcher() i=3 2024-09-12T17:44:16.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.281+0000 7f44e7a0e800 20 remove_watcher() i=4 2024-09-12T17:44:16.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.282+0000 7f44e7a0e800 20 remove_watcher() i=5 2024-09-12T17:44:16.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.283+0000 7f44e7a0e800 20 remove_watcher() i=6 2024-09-12T17:44:16.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.284+0000 7f44e7a0e800 20 remove_watcher() i=7 2024-09-12T17:44:16.297 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:16.297 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:44:16.297 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-commit-target-layout id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:44:16.297 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:16.376 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T17:44:16.376 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:16.571 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:44:16.600 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:16.600 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:16.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.637+0000 7fc2bc810800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.639+0000 7fc2bc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.639+0000 7fc2bc810800 20 realm 2024-09-12T17:44:16.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.639+0000 7fc2bc810800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.639+0000 7fc2bc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.639+0000 7fc2bc810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:16.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.639+0000 7fc2bc810800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.639+0000 7fc2bc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.639+0000 7fc2bc810800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.640+0000 7fc2bc810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:16.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.640+0000 7fc2bc810800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.641+0000 7fc2bc810800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:16.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.641+0000 7fc2bc810800 20 searching for the correct realm 2024-09-12T17:44:16.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.645+0000 7fc2b77df640 0 -- 172.21.15.44:0/202625064 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fc2a806b030 msgr2=0x7fc2a8056800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:16.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.649+0000 7fc2b7fe0640 0 -- 172.21.15.44:0/202625064 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fc2ac0143f0 msgr2=0x7fc2ac014850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:16.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.856+0000 7fc2bc810800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:16.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.856+0000 7fc2bc810800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:16.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.856+0000 7fc2bc810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:16.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.856+0000 7fc2bc810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:16.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.856+0000 7fc2bc810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:16.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.856+0000 7fc2bc810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:16.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.856+0000 7fc2bc810800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.856+0000 7fc2bc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.856+0000 7fc2bc810800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.856+0000 7fc2bc810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:16.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.856+0000 7fc2bc810800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.857+0000 7fc2bc810800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:16.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.857+0000 7fc2bc810800 20 zone default found 2024-09-12T17:44:16.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.857+0000 7fc2bc810800 4 Realm: () 2024-09-12T17:44:16.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.857+0000 7fc2bc810800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:16.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.857+0000 7fc2bc810800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:16.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.857+0000 7fc2bc810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:16.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.857+0000 7fc2bc810800 20 zonegroup default 2024-09-12T17:44:16.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.857+0000 7fc2bc810800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.857+0000 7fc2bc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.857+0000 7fc2bc810800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.857+0000 7fc2bc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.857+0000 7fc2bc810800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.857+0000 7fc2bc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.857+0000 7fc2bc810800 20 started sync module instance, tier type = 2024-09-12T17:44:16.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.857+0000 7fc2bc810800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:16.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.867+0000 7fc2bc810800 20 add_watcher() i=0 2024-09-12T17:44:16.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.867+0000 7fc2bc810800 20 add_watcher() i=1 2024-09-12T17:44:16.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.867+0000 7fc2bc810800 20 add_watcher() i=2 2024-09-12T17:44:16.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.867+0000 7fc2bc810800 20 add_watcher() i=3 2024-09-12T17:44:16.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.867+0000 7fc2bc810800 20 add_watcher() i=4 2024-09-12T17:44:16.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.867+0000 7fc2bc810800 20 add_watcher() i=5 2024-09-12T17:44:16.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.867+0000 7fc2bc810800 20 add_watcher() i=6 2024-09-12T17:44:16.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.868+0000 7fc2bc810800 20 add_watcher() i=7 2024-09-12T17:44:16.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.868+0000 7fc2bc810800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:16.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.869+0000 7fc16dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:16.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.870+0000 7fc2bc810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:16.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.870+0000 7fc2bc810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:16.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.870+0000 7fc2bc810800 5 note: GC not initialized 2024-09-12T17:44:16.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.870+0000 7fc16cfe1640 20 reqs_thread_entry: start 2024-09-12T17:44:16.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.870+0000 7fc2bc810800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:16.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.870+0000 7fc2bc810800 20 Filter name: none 2024-09-12T17:44:16.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.870+0000 7fc0e67fc640 20 reqs_thread_entry: start 2024-09-12T17:44:16.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.870+0000 7fc2bc810800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.871+0000 7fc2bc810800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:16.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.871+0000 7fc2bc810800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.872+0000 7fc2bc810800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:16.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.872+0000 7fc2bc810800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:16.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.872+0000 7fc2bc810800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.872+0000 7fc2bc810800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:16.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.872+0000 7fc2bc810800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.873+0000 7fc2bc810800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:16.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.873+0000 7fc2bc810800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:16.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.875+0000 7fc16dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:16.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.877+0000 7fc2bc810800 20 remove_watcher() i=0 2024-09-12T17:44:16.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.877+0000 7fc2bc810800 2 removed watcher, disabling cache 2024-09-12T17:44:16.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.878+0000 7fc2bc810800 20 remove_watcher() i=1 2024-09-12T17:44:16.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.879+0000 7fc2bc810800 20 remove_watcher() i=2 2024-09-12T17:44:16.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.880+0000 7fc2bc810800 20 remove_watcher() i=3 2024-09-12T17:44:16.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.881+0000 7fc2bc810800 20 remove_watcher() i=4 2024-09-12T17:44:16.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.882+0000 7fc2bc810800 20 remove_watcher() i=5 2024-09-12T17:44:16.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.883+0000 7fc2bc810800 20 remove_watcher() i=6 2024-09-12T17:44:16.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.884+0000 7fc2bc810800 20 remove_watcher() i=7 2024-09-12T17:44:16.897 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:16.897 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:44:16.897 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-commit-target-layout id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:44:16.897 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:16.898 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T17:44:16.935 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:16.935 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:16.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.973+0000 7fbabbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.975+0000 7fbabbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.975+0000 7fbabbc0e800 20 realm 2024-09-12T17:44:16.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.975+0000 7fbabbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.975+0000 7fbabbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.975+0000 7fbabbc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:16.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.975+0000 7fbabbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.976+0000 7fbabbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:16.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.976+0000 7fbabbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.976+0000 7fbabbc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:16.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.976+0000 7fbabbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:16.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.977+0000 7fbabbc0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:16.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.977+0000 7fbabbc0e800 20 searching for the correct realm 2024-09-12T17:44:16.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.979+0000 7fbab6a58640 0 -- 172.21.15.44:0/1443796549 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fbab0072380 msgr2=0x7fbab0068300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:16.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:16.983+0000 7fbab7259640 0 -- 172.21.15.44:0/1443796549 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fbaa007a100 msgr2=0x7fbaa006b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:17.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.188+0000 7fbabbc0e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:17.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.188+0000 7fbabbc0e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:17.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.188+0000 7fbabbc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:17.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.188+0000 7fbabbc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:17.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.188+0000 7fbabbc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:17.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.188+0000 7fbabbc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:17.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.188+0000 7fbabbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.189+0000 7fbabbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.189+0000 7fbabbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.189+0000 7fbabbc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:17.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.189+0000 7fbabbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.189+0000 7fbabbc0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:17.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.189+0000 7fbabbc0e800 20 zone default found 2024-09-12T17:44:17.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.189+0000 7fbabbc0e800 4 Realm: () 2024-09-12T17:44:17.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.189+0000 7fbabbc0e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:17.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.189+0000 7fbabbc0e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:17.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.189+0000 7fbabbc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:17.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.189+0000 7fbabbc0e800 20 zonegroup default 2024-09-12T17:44:17.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.189+0000 7fbabbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.189+0000 7fbabbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.189+0000 7fbabbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.190+0000 7fbabbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.190+0000 7fbabbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.190+0000 7fbabbc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.190+0000 7fbabbc0e800 20 started sync module instance, tier type = 2024-09-12T17:44:17.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.190+0000 7fbabbc0e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:17.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.200+0000 7fbabbc0e800 20 add_watcher() i=0 2024-09-12T17:44:17.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.200+0000 7fbabbc0e800 20 add_watcher() i=1 2024-09-12T17:44:17.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.200+0000 7fbabbc0e800 20 add_watcher() i=2 2024-09-12T17:44:17.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.200+0000 7fbabbc0e800 20 add_watcher() i=3 2024-09-12T17:44:17.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.200+0000 7fbabbc0e800 20 add_watcher() i=4 2024-09-12T17:44:17.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.200+0000 7fbabbc0e800 20 add_watcher() i=5 2024-09-12T17:44:17.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.200+0000 7fbabbc0e800 20 add_watcher() i=6 2024-09-12T17:44:17.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.201+0000 7fbabbc0e800 20 add_watcher() i=7 2024-09-12T17:44:17.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.201+0000 7fbabbc0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:17.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.203+0000 7fb96e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:17.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.203+0000 7fbabbc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:17.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.203+0000 7fbabbc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:17.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.203+0000 7fbabbc0e800 5 note: GC not initialized 2024-09-12T17:44:17.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.203+0000 7fb96d7e2640 20 reqs_thread_entry: start 2024-09-12T17:44:17.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.203+0000 7fbabbc0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:17.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.203+0000 7fbabbc0e800 20 Filter name: none 2024-09-12T17:44:17.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.204+0000 7fb9667fc640 20 reqs_thread_entry: start 2024-09-12T17:44:17.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.204+0000 7fbabbc0e800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:44:17.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.204+0000 7fbabbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.204+0000 7fbabbc0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:17.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.204+0000 7fbabbc0e800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:44:17.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.204+0000 7fbabbc0e800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:44:17.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.204+0000 7fbabbc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 : miss 2024-09-12T17:44:17.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.204+0000 7fbabbc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.205+0000 7fbabbc0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:17.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.205+0000 7fbabbc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 info.flags=0x17 2024-09-12T17:44:17.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.205+0000 7fbabbc0e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 to cache LRU end 2024-09-12T17:44:17.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.205+0000 7fbabbc0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:17.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.205+0000 7fbabbc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:17.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.205+0000 7fbabbc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 2024-09-12T17:44:17.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.210+0000 7fbabbc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 info.flags=0x17 2024-09-12T17:44:17.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.210+0000 7fbabbc0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 to cache LRU end 2024-09-12T17:44:17.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.210+0000 7fbabbc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:17.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.210+0000 7fbabbc0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32, ofs0, ns] 2024-09-12T17:44:17.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.211+0000 7fb99affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562437 cookie 94781243369424 notifier 6902 bl.length()=1015 2024-09-12T17:44:17.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.211+0000 7fb99affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 info.flags=0x17 2024-09-12T17:44:17.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.211+0000 7fb99affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 to cache LRU end 2024-09-12T17:44:17.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.211+0000 7fb99affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:17.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.211+0000 7fbabbc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32]): orig_sources= new_sources= 2024-09-12T17:44:17.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.211+0000 7fbabbc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32]): potential sources added=[] removed=[] 2024-09-12T17:44:17.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.211+0000 7fbabbc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32]): orig_dests= new_dests= 2024-09-12T17:44:17.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.211+0000 7fbabbc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32]): potential dests added=[] removed=[] 2024-09-12T17:44:17.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.0 2024-09-12T17:44:17.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.0 2024-09-12T17:44:17.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.1 2024-09-12T17:44:17.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.1 2024-09-12T17:44:17.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.2 2024-09-12T17:44:17.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.2 2024-09-12T17:44:17.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.3 2024-09-12T17:44:17.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.3 2024-09-12T17:44:17.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.4 2024-09-12T17:44:17.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.4 2024-09-12T17:44:17.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.5 2024-09-12T17:44:17.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.5 2024-09-12T17:44:17.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.6 2024-09-12T17:44:17.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.6 2024-09-12T17:44:17.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.7 2024-09-12T17:44:17.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.7 2024-09-12T17:44:17.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.8 2024-09-12T17:44:17.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.8 2024-09-12T17:44:17.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.9 2024-09-12T17:44:17.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.9 2024-09-12T17:44:17.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.10 2024-09-12T17:44:17.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.10 2024-09-12T17:44:17.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.11 2024-09-12T17:44:17.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1.11 2024-09-12T17:44:17.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.0 2024-09-12T17:44:17.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.216+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1 2024-09-12T17:44:17.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.217+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.2 2024-09-12T17:44:17.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.218+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.3 2024-09-12T17:44:17.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.218+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.4 2024-09-12T17:44:17.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.218+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.5 2024-09-12T17:44:17.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.219+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.6 2024-09-12T17:44:17.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.220+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.7 2024-09-12T17:44:17.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.220+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.8 2024-09-12T17:44:17.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.220+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.9 2024-09-12T17:44:17.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.221+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.10 2024-09-12T17:44:17.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.224+0000 7fbabbc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:17.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.224+0000 7fbabbc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 2024-09-12T17:44:17.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.225+0000 7fbabbc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 info.flags=0x17 2024-09-12T17:44:17.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.225+0000 7fbabbc0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 to cache LRU end 2024-09-12T17:44:17.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.225+0000 7fbabbc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:17.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.225+0000 7fbabbc0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32, ofs0, ns] 2024-09-12T17:44:17.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.226+0000 7fb99a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562438 cookie 94781243369424 notifier 6902 bl.length()=1015 2024-09-12T17:44:17.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.226+0000 7fb99a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 info.flags=0x17 2024-09-12T17:44:17.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.226+0000 7fb99a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 to cache LRU end 2024-09-12T17:44:17.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.226+0000 7fb99a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:17.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.226+0000 7fbabbc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32]): orig_sources= new_sources= 2024-09-12T17:44:17.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.226+0000 7fbabbc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32]): potential sources added=[] removed=[] 2024-09-12T17:44:17.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.226+0000 7fbabbc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32]): orig_dests= new_dests= 2024-09-12T17:44:17.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.226+0000 7fbabbc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32]): potential dests added=[] removed=[] 2024-09-12T17:44:17.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.228+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.0 2024-09-12T17:44:17.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.229+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.1 2024-09-12T17:44:17.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.229+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.2 2024-09-12T17:44:17.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.229+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.3 2024-09-12T17:44:17.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.230+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.4 2024-09-12T17:44:17.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.230+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.5 2024-09-12T17:44:17.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.230+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.6 2024-09-12T17:44:17.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.231+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.7 2024-09-12T17:44:17.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.231+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.8 2024-09-12T17:44:17.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.231+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.9 2024-09-12T17:44:17.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.232+0000 7fbabbc0e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32.10 2024-09-12T17:44:17.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.232+0000 7fbabbc0e800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T17:44:17.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.232+0000 7fbabbc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:17.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.232+0000 7fbabbc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 2024-09-12T17:44:17.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.235+0000 7fbabbc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 info.flags=0x17 2024-09-12T17:44:17.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.235+0000 7fbabbc0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 to cache LRU end 2024-09-12T17:44:17.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.235+0000 7fbabbc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:17.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.235+0000 7fbabbc0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32, ofs0, ns] 2024-09-12T17:44:17.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.235+0000 7fb99a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562439 cookie 94781243369424 notifier 6902 bl.length()=983 2024-09-12T17:44:17.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.235+0000 7fb99a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 info.flags=0x17 2024-09-12T17:44:17.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.235+0000 7fb99a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 to cache LRU end 2024-09-12T17:44:17.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.235+0000 7fb99a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:17.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.235+0000 7fbabbc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32]): orig_sources= new_sources= 2024-09-12T17:44:17.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.235+0000 7fbabbc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32]): potential sources added=[] removed=[] 2024-09-12T17:44:17.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.235+0000 7fbabbc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32]): orig_dests= new_dests= 2024-09-12T17:44:17.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.235+0000 7fbabbc0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32]): potential dests added=[] removed=[] 2024-09-12T17:44:17.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.237+0000 7fbabbc0e800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:44:17.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.238+0000 7fb96e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:17.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.241+0000 7fbabbc0e800 20 remove_watcher() i=0 2024-09-12T17:44:17.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.241+0000 7fbabbc0e800 2 removed watcher, disabling cache 2024-09-12T17:44:17.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.242+0000 7fbabbc0e800 20 remove_watcher() i=1 2024-09-12T17:44:17.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.243+0000 7fbabbc0e800 20 remove_watcher() i=2 2024-09-12T17:44:17.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.244+0000 7fbabbc0e800 20 remove_watcher() i=3 2024-09-12T17:44:17.246 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.245+0000 7fbabbc0e800 20 remove_watcher() i=4 2024-09-12T17:44:17.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.246+0000 7fbabbc0e800 20 remove_watcher() i=5 2024-09-12T17:44:17.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.247+0000 7fbabbc0e800 20 remove_watcher() i=6 2024-09-12T17:44:17.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.248+0000 7fbabbc0e800 20 remove_watcher() i=7 2024-09-12T17:44:17.263 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:44:17.292 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:17.292 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:17.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.329+0000 7f44be735800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.331+0000 7f44be735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.331+0000 7f44be735800 20 realm 2024-09-12T17:44:17.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.331+0000 7f44be735800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.331+0000 7f44be735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.331+0000 7f44be735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:17.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.331+0000 7f44be735800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.332+0000 7f44be735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.332+0000 7f44be735800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.332+0000 7f44be735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:17.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.332+0000 7f44be735800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.333+0000 7f44be735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:17.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.333+0000 7f44be735800 20 searching for the correct realm 2024-09-12T17:44:17.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.334+0000 7f44ba4e4640 0 -- 172.21.15.44:0/400564412 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x55caae214530 msgr2=0x7f44b4005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:17.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.539+0000 7f44bace5640 0 -- 172.21.15.44:0/400564412 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f44a401c040 msgr2=0x7f44a4067cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:17.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.545+0000 7f44be735800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:17.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.545+0000 7f44be735800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:17.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.545+0000 7f44be735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:17.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.545+0000 7f44be735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:17.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.545+0000 7f44be735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:17.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.545+0000 7f44be735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:17.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.545+0000 7f44be735800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.545+0000 7f44be735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.545+0000 7f44be735800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.545+0000 7f44be735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:17.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.545+0000 7f44be735800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.546+0000 7f44be735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:17.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.546+0000 7f44be735800 20 zone default found 2024-09-12T17:44:17.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.546+0000 7f44be735800 4 Realm: () 2024-09-12T17:44:17.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.546+0000 7f44be735800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:17.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.546+0000 7f44be735800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:17.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.546+0000 7f44be735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:17.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.546+0000 7f44be735800 20 zonegroup default 2024-09-12T17:44:17.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.546+0000 7f44be735800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.546+0000 7f44be735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.546+0000 7f44be735800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.546+0000 7f44be735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.546+0000 7f44be735800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.546+0000 7f44be735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.546+0000 7f44be735800 20 started sync module instance, tier type = 2024-09-12T17:44:17.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.546+0000 7f44be735800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:17.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.556+0000 7f44be735800 20 add_watcher() i=0 2024-09-12T17:44:17.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.556+0000 7f44be735800 20 add_watcher() i=1 2024-09-12T17:44:17.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.556+0000 7f44be735800 20 add_watcher() i=2 2024-09-12T17:44:17.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.556+0000 7f44be735800 20 add_watcher() i=3 2024-09-12T17:44:17.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.556+0000 7f44be735800 20 add_watcher() i=4 2024-09-12T17:44:17.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.556+0000 7f44be735800 20 add_watcher() i=5 2024-09-12T17:44:17.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.556+0000 7f44be735800 20 add_watcher() i=6 2024-09-12T17:44:17.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.557+0000 7f44be735800 20 add_watcher() i=7 2024-09-12T17:44:17.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.557+0000 7f44be735800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:17.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.559+0000 7f4370fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:17.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.559+0000 7f44be735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:17.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.559+0000 7f44be735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:17.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.559+0000 7f44be735800 5 note: GC not initialized 2024-09-12T17:44:17.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.559+0000 7f42eb7fe640 20 reqs_thread_entry: start 2024-09-12T17:44:17.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.559+0000 7f44be735800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:17.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.559+0000 7f44be735800 20 Filter name: none 2024-09-12T17:44:17.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.560+0000 7f42e97fa640 20 reqs_thread_entry: start 2024-09-12T17:44:17.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.560+0000 7f44be735800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.560+0000 7f44be735800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:17.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.560+0000 7f44be735800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.561+0000 7f44be735800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:17.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.561+0000 7f44be735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:17.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.561+0000 7f44be735800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.561+0000 7f44be735800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:17.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.561+0000 7f44be735800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.562+0000 7f44be735800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:17.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.562+0000 7f44be735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:17.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.563+0000 7f4370fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:17.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.565+0000 7f44be735800 20 remove_watcher() i=0 2024-09-12T17:44:17.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.565+0000 7f44be735800 2 removed watcher, disabling cache 2024-09-12T17:44:17.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.567+0000 7f44be735800 20 remove_watcher() i=1 2024-09-12T17:44:17.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.568+0000 7f44be735800 20 remove_watcher() i=2 2024-09-12T17:44:17.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.569+0000 7f44be735800 20 remove_watcher() i=3 2024-09-12T17:44:17.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.570+0000 7f44be735800 20 remove_watcher() i=4 2024-09-12T17:44:17.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.571+0000 7f44be735800 20 remove_watcher() i=5 2024-09-12T17:44:17.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.572+0000 7f44be735800 20 remove_watcher() i=6 2024-09-12T17:44:17.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.573+0000 7f44be735800 20 remove_watcher() i=7 2024-09-12T17:44:17.585 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:17.586 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:44:17.586 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-commit-target-layout id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:44:17.586 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:17.663 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T17:44:17.663 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:17.866 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:44:17.895 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:17.895 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:17.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.933+0000 7fa86babb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.936 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.934+0000 7fa86babb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.936 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.934+0000 7fa86babb800 20 realm 2024-09-12T17:44:17.936 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.934+0000 7fa86babb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.935+0000 7fa86babb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.935+0000 7fa86babb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:17.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.935+0000 7fa86babb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.935+0000 7fa86babb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:17.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.935+0000 7fa86babb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.936+0000 7fa86babb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:17.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.936+0000 7fa86babb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:17.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.936+0000 7fa86babb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:17.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.936+0000 7fa86babb800 20 searching for the correct realm 2024-09-12T17:44:17.941 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.939+0000 7fa869da6640 0 -- 172.21.15.44:0/1284136307 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7fa85403cae0 msgr2=0x7fa85405fc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:17.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:17.943+0000 7fa8695a5640 0 -- 172.21.15.44:0/1284136307 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fa85408f960 msgr2=0x7fa854048920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:18.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.149+0000 7fa86babb800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:18.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.149+0000 7fa86babb800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:18.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.149+0000 7fa86babb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:18.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.149+0000 7fa86babb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:18.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.149+0000 7fa86babb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:18.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.149+0000 7fa86babb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:18.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.149+0000 7fa86babb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.149+0000 7fa86babb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.149+0000 7fa86babb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.149+0000 7fa86babb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:18.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.149+0000 7fa86babb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.150+0000 7fa86babb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:18.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.150+0000 7fa86babb800 20 zone default found 2024-09-12T17:44:18.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.150+0000 7fa86babb800 4 Realm: () 2024-09-12T17:44:18.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.150+0000 7fa86babb800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:18.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.150+0000 7fa86babb800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:18.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.150+0000 7fa86babb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:18.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.150+0000 7fa86babb800 20 zonegroup default 2024-09-12T17:44:18.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.150+0000 7fa86babb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.150+0000 7fa86babb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.150+0000 7fa86babb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.150+0000 7fa86babb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.150+0000 7fa86babb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.151+0000 7fa86babb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.151+0000 7fa86babb800 20 started sync module instance, tier type = 2024-09-12T17:44:18.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.151+0000 7fa86babb800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:18.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.161+0000 7fa86babb800 20 add_watcher() i=0 2024-09-12T17:44:18.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.161+0000 7fa86babb800 20 add_watcher() i=1 2024-09-12T17:44:18.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.161+0000 7fa86babb800 20 add_watcher() i=2 2024-09-12T17:44:18.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.161+0000 7fa86babb800 20 add_watcher() i=3 2024-09-12T17:44:18.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.161+0000 7fa86babb800 20 add_watcher() i=4 2024-09-12T17:44:18.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.161+0000 7fa86babb800 20 add_watcher() i=5 2024-09-12T17:44:18.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.161+0000 7fa86babb800 20 add_watcher() i=6 2024-09-12T17:44:18.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.162+0000 7fa86babb800 20 add_watcher() i=7 2024-09-12T17:44:18.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.162+0000 7fa86babb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:18.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.163+0000 7fa71f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:18.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.164+0000 7fa86babb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:18.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.164+0000 7fa86babb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:18.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.164+0000 7fa86babb800 5 note: GC not initialized 2024-09-12T17:44:18.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.164+0000 7fa71e7e4640 20 reqs_thread_entry: start 2024-09-12T17:44:18.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.164+0000 7fa86babb800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:18.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.164+0000 7fa86babb800 20 Filter name: none 2024-09-12T17:44:18.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.164+0000 7fa68ffff640 20 reqs_thread_entry: start 2024-09-12T17:44:18.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.165+0000 7fa86babb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.165+0000 7fa86babb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:18.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.165+0000 7fa86babb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.166+0000 7fa86babb800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:18.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.166+0000 7fa86babb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:18.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.166+0000 7fa86babb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.166+0000 7fa86babb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:18.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.166+0000 7fa86babb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.166+0000 7fa86babb800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:18.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.166+0000 7fa86babb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:18.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.168+0000 7fa71f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:18.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.170+0000 7fa86babb800 20 remove_watcher() i=0 2024-09-12T17:44:18.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.170+0000 7fa86babb800 2 removed watcher, disabling cache 2024-09-12T17:44:18.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.171+0000 7fa86babb800 20 remove_watcher() i=1 2024-09-12T17:44:18.174 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.172+0000 7fa86babb800 20 remove_watcher() i=2 2024-09-12T17:44:18.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.173+0000 7fa86babb800 20 remove_watcher() i=3 2024-09-12T17:44:18.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.174+0000 7fa86babb800 20 remove_watcher() i=4 2024-09-12T17:44:18.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.176+0000 7fa86babb800 20 remove_watcher() i=5 2024-09-12T17:44:18.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.176+0000 7fa86babb800 20 remove_watcher() i=6 2024-09-12T17:44:18.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.178+0000 7fa86babb800 20 remove_watcher() i=7 2024-09-12T17:44:18.191 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.191 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:44:18.191 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-commit-target-layout id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:44:18.191 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.193 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T17:44:18.228 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:18.228 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:18.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.266+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.267+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.267+0000 7f61b0abb800 20 realm 2024-09-12T17:44:18.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.267+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.267+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.267+0000 7f61b0abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:18.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.268+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.268+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.268+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.269+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:18.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.269+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.269+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:18.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.269+0000 7f61b0abb800 20 searching for the correct realm 2024-09-12T17:44:18.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.272+0000 7f61aeda6640 0 -- 172.21.15.44:0/1622173523 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f61a4017070 msgr2=0x7f61a40619a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:18.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.276+0000 7f61ae5a5640 0 -- 172.21.15.44:0/1622173523 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f61a405eaf0 msgr2=0x7f61a408f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:18.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:18.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:18.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:18.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:18.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:18.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:18.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.482+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.482+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.482+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:18.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:18.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.483+0000 7f61b0abb800 20 zone default found 2024-09-12T17:44:18.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.483+0000 7f61b0abb800 4 Realm: () 2024-09-12T17:44:18.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.483+0000 7f61b0abb800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:18.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.483+0000 7f61b0abb800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:18.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.483+0000 7f61b0abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:18.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.483+0000 7f61b0abb800 20 zonegroup default 2024-09-12T17:44:18.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.484+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.484+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.484+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.484+0000 7f61b0abb800 20 started sync module instance, tier type = 2024-09-12T17:44:18.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.484+0000 7f61b0abb800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:18.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=0 2024-09-12T17:44:18.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=1 2024-09-12T17:44:18.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=2 2024-09-12T17:44:18.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=3 2024-09-12T17:44:18.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=4 2024-09-12T17:44:18.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=5 2024-09-12T17:44:18.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=6 2024-09-12T17:44:18.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=7 2024-09-12T17:44:18.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.494+0000 7f61b0abb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:18.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.496+0000 7f6064fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:18.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.496+0000 7f61b0abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:18.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.496+0000 7f61b0abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:18.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.496+0000 7f61b0abb800 5 note: GC not initialized 2024-09-12T17:44:18.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.497+0000 7f5fdf7fe640 20 reqs_thread_entry: start 2024-09-12T17:44:18.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.497+0000 7f61b0abb800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:18.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.497+0000 7f61b0abb800 20 Filter name: none 2024-09-12T17:44:18.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.497+0000 7f5fdd7fa640 20 reqs_thread_entry: start 2024-09-12T17:44:18.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.497+0000 7f61b0abb800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:44:18.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.497+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.497+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:18.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.497+0000 7f61b0abb800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:44:18.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.497+0000 7f61b0abb800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:44:18.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.497+0000 7f61b0abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 : miss 2024-09-12T17:44:18.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.497+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.498+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:18.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.498+0000 7f61b0abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:18.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.498+0000 7f61b0abb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:18.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.498+0000 7f61b0abb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:18.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.498+0000 7f61b0abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.498+0000 7f61b0abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 2024-09-12T17:44:18.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.503+0000 7f61b0abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:18.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.503+0000 7f61b0abb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:18.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.503+0000 7f61b0abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.503+0000 7f61b0abb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33, ofs0, ns] 2024-09-12T17:44:18.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.503+0000 7f60917fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562428 cookie 94822310317552 notifier 6950 bl.length()=1015 2024-09-12T17:44:18.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.503+0000 7f60917fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:18.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.503+0000 7f60917fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:18.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.503+0000 7f60917fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.503+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_sources= new_sources= 2024-09-12T17:44:18.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.503+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:44:18.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.503+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_dests= new_dests= 2024-09-12T17:44:18.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.503+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:44:18.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.0 2024-09-12T17:44:18.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.0 2024-09-12T17:44:18.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.1 2024-09-12T17:44:18.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.1 2024-09-12T17:44:18.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.2 2024-09-12T17:44:18.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.2 2024-09-12T17:44:18.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.3 2024-09-12T17:44:18.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.3 2024-09-12T17:44:18.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.4 2024-09-12T17:44:18.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.4 2024-09-12T17:44:18.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.5 2024-09-12T17:44:18.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.5 2024-09-12T17:44:18.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.6 2024-09-12T17:44:18.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.6 2024-09-12T17:44:18.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.7 2024-09-12T17:44:18.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.7 2024-09-12T17:44:18.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.8 2024-09-12T17:44:18.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.8 2024-09-12T17:44:18.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.9 2024-09-12T17:44:18.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.9 2024-09-12T17:44:18.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.10 2024-09-12T17:44:18.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.10 2024-09-12T17:44:18.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.11 2024-09-12T17:44:18.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.11 2024-09-12T17:44:18.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.0 2024-09-12T17:44:18.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1 2024-09-12T17:44:18.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.509+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.2 2024-09-12T17:44:18.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.509+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.3 2024-09-12T17:44:18.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.510+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.4 2024-09-12T17:44:18.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.510+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.5 2024-09-12T17:44:18.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.511+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.6 2024-09-12T17:44:18.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.512+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.7 2024-09-12T17:44:18.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.512+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.8 2024-09-12T17:44:18.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.513+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.9 2024-09-12T17:44:18.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.513+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.10 2024-09-12T17:44:18.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.516+0000 7f61b0abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:18.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.516+0000 7f61b0abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 2024-09-12T17:44:18.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.518+0000 7f61b0abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:18.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.518+0000 7f61b0abb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:18.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.518+0000 7f61b0abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.518+0000 7f61b0abb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33, ofs0, ns] 2024-09-12T17:44:18.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.518+0000 7f6091ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562429 cookie 94822310317552 notifier 6950 bl.length()=1015 2024-09-12T17:44:18.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.518+0000 7f6091ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:18.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.518+0000 7f6091ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:18.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.518+0000 7f6091ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.518+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_sources= new_sources= 2024-09-12T17:44:18.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.518+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:44:18.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.518+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_dests= new_dests= 2024-09-12T17:44:18.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.518+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:44:18.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.521+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.0 2024-09-12T17:44:18.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.521+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1 2024-09-12T17:44:18.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.522+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.2 2024-09-12T17:44:18.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.522+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.3 2024-09-12T17:44:18.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.522+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.4 2024-09-12T17:44:18.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.523+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.5 2024-09-12T17:44:18.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.524+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.6 2024-09-12T17:44:18.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.524+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.7 2024-09-12T17:44:18.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.525+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.8 2024-09-12T17:44:18.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.525+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.9 2024-09-12T17:44:18.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.525+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.10 2024-09-12T17:44:18.528 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f61b0abb800 time 2024-09-12T17:44:18.527565+0000 2024-09-12T17:44:18.528 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:44:18.528 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:18.528 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f61b3f8c71a] 2024-09-12T17:44:18.528 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f61b3f8c8d8] 2024-09-12T17:44:18.529 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563d89283841] 2024-09-12T17:44:18.529 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x563d89293827] 2024-09-12T17:44:18.529 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2024-09-12T17:44:18.529 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f61b2c29590] 2024-09-12T17:44:18.529 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2024-09-12T17:44:18.529 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2024-09-12T17:44:18.530 INFO:tasks.workunit.client.0.smithi044.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:44:18.530 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f61b0abb800 thread_name:radosgw-admin 2024-09-12T17:44:18.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.526+0000 7f61b0abb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f61b0abb800 time 2024-09-12T17:44:18.527565+0000 2024-09-12T17:44:18.530 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:44:18.530 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.530 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:18.530 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f61b3f8c71a] 2024-09-12T17:44:18.531 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f61b3f8c8d8] 2024-09-12T17:44:18.531 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563d89283841] 2024-09-12T17:44:18.531 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x563d89293827] 2024-09-12T17:44:18.531 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2024-09-12T17:44:18.531 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f61b2c29590] 2024-09-12T17:44:18.531 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2024-09-12T17:44:18.532 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2024-09-12T17:44:18.532 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.554 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:18.554 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f61b2c3e6f0] 2024-09-12T17:44:18.554 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f61b2c8b99c] 2024-09-12T17:44:18.554 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:44:18.554 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:44:18.554 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f61b3f8c774] 2024-09-12T17:44:18.554 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f61b3f8c8d8] 2024-09-12T17:44:18.554 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563d89283841] 2024-09-12T17:44:18.554 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x563d89293827] 2024-09-12T17:44:18.554 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2024-09-12T17:44:18.555 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f61b2c29590] 2024-09-12T17:44:18.555 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2024-09-12T17:44:18.555 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2024-09-12T17:44:18.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.527+0000 7f61b0abb800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:44:18.555 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f61b0abb800 thread_name:radosgw-admin 2024-09-12T17:44:18.555 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.555 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:18.555 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f61b2c3e6f0] 2024-09-12T17:44:18.555 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f61b2c8b99c] 2024-09-12T17:44:18.555 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:44:18.555 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:44:18.555 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f61b3f8c774] 2024-09-12T17:44:18.555 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f61b3f8c8d8] 2024-09-12T17:44:18.556 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563d89283841] 2024-09-12T17:44:18.556 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x563d89293827] 2024-09-12T17:44:18.556 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2024-09-12T17:44:18.556 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f61b2c29590] 2024-09-12T17:44:18.556 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2024-09-12T17:44:18.556 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2024-09-12T17:44:18.556 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:44:18.556 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.556 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:44:18.556 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:44:18.250+0000 7f61ae5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.556 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:44:18.250+0000 7f61ae5a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.556 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:44:18.250+0000 7f61ae5a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.556 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:44:18.250+0000 7f61adda4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.557 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:44:18.250+0000 7f61adda4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.557 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:44:18.250+0000 7f61adda4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.557 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:44:18.250+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.557 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:44:18.250+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.557 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:44:18.250+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.557 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:44:18.250+0000 7f61aeda6640 10 monclient(hunting): get_auth_request con 0x563d8a047f80 auth_method 0 2024-09-12T17:44:18.557 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:44:18.250+0000 7f61aeda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.557 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:44:18.250+0000 7f61aeda6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.557 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:44:18.250+0000 7f61aeda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.557 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:44:18.251+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.557 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:44:18.251+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.557 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:44:18.251+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.557 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:44:18.251+0000 7f61adda4640 10 monclient(hunting): handle_auth_done global_id 6941 payload 824 2024-09-12T17:44:18.558 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:44:18.251+0000 7f61adda4640 10 monclient: _finish_hunting 0 2024-09-12T17:44:18.558 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:44:18.251+0000 7f61adda4640 1 monclient: found mon.noname-c 2024-09-12T17:44:18.558 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:44:18.251+0000 7f61adda4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:44:18.558 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:18.558 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:18.558 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: dump: 2024-09-12T17:44:18.558 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:18.558 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:18.558 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.558 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.558 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:18.558 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.559 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:18.559 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:18.559 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:18.559 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.559 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: _finish_auth 0 2024-09-12T17:44:18.559 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: _check_auth_tickets 2024-09-12T17:44:18.559 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:18.559 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:18.559 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:18.559 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: dump: 2024-09-12T17:44:18.559 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:18.559 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:18.559 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.559 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.560 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:18.560 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.560 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:18.560 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:18.560 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:18.560 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.560 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:44:18.251+0000 7f61b0abb800 5 monclient: authenticate success, global_id 6941 2024-09-12T17:44:18.560 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:44:18.251+0000 7f609c608640 4 set_mon_vals no callback set 2024-09-12T17:44:18.560 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:44:18.251+0000 7f61b0abb800 10 monclient: _renew_subs 2024-09-12T17:44:18.560 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:44:18.251+0000 7f61b0abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:18.560 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:44:18.251+0000 7f61b0abb800 10 monclient: _renew_subs 2024-09-12T17:44:18.560 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:44:18.251+0000 7f61b0abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:18.561 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:44:18.251+0000 7f61b0abb800 1 librados: init done 2024-09-12T17:44:18.561 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:44:18.253+0000 7f609ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:18.561 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:44:18.253+0000 7f609ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:18.561 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:44:18.253+0000 7f609ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:18.561 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:44:18.253+0000 7f61ae5a5640 10 monclient: get_auth_request con 0x7f6094076470 auth_method 0 2024-09-12T17:44:18.561 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:44:18.253+0000 7f61aeda6640 10 monclient: get_auth_request con 0x563d8a147270 auth_method 0 2024-09-12T17:44:18.561 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:44:18.254+0000 7f61ae5a5640 10 monclient: get_auth_request con 0x563d8a14a450 auth_method 0 2024-09-12T17:44:18.561 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:44:18.256+0000 7f61adda4640 10 monclient: get_auth_request con 0x563d8a14f4e0 auth_method 0 2024-09-12T17:44:18.561 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:44:18.256+0000 7f61b0abb800 10 monclient: build_initial_monmap 2024-09-12T17:44:18.561 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:44:18.256+0000 7f61b0abb800 1 build_initial for_mkfs: 0 2024-09-12T17:44:18.561 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:44:18.256+0000 7f61b0abb800 10 monclient: monmap: 2024-09-12T17:44:18.561 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:44:18.561 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:18.562 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:44:18.562 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:44:18.562 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:18.562 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.562 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:44:18.562 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:44:18.562 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:44:18.562 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.562 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding auth protocol: cephx 2024-09-12T17:44:18.562 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding auth protocol: cephx 2024-09-12T17:44:18.562 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding auth protocol: cephx 2024-09-12T17:44:18.562 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: secure 2024-09-12T17:44:18.562 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: crc 2024-09-12T17:44:18.563 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: secure 2024-09-12T17:44:18.563 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: crc 2024-09-12T17:44:18.563 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: secure 2024-09-12T17:44:18.563 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: crc 2024-09-12T17:44:18.563 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: crc 2024-09-12T17:44:18.563 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: secure 2024-09-12T17:44:18.563 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: crc 2024-09-12T17:44:18.563 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: secure 2024-09-12T17:44:18.563 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: crc 2024-09-12T17:44:18.563 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: secure 2024-09-12T17:44:18.563 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:44:18.257+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.564 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command objecter_requests cmddesc objecter_requests hook 0x563d8a156c90 EEXIST 2024-09-12T17:44:18.564 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient: init 2024-09-12T17:44:18.564 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding auth protocol: cephx 2024-09-12T17:44:18.564 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding auth protocol: cephx 2024-09-12T17:44:18.564 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding auth protocol: cephx 2024-09-12T17:44:18.564 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: secure 2024-09-12T17:44:18.564 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: crc 2024-09-12T17:44:18.564 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: secure 2024-09-12T17:44:18.564 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: crc 2024-09-12T17:44:18.564 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: secure 2024-09-12T17:44:18.564 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: crc 2024-09-12T17:44:18.564 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: crc 2024-09-12T17:44:18.564 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: secure 2024-09-12T17:44:18.565 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: crc 2024-09-12T17:44:18.565 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: secure 2024-09-12T17:44:18.565 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: crc 2024-09-12T17:44:18.565 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: secure 2024-09-12T17:44:18.565 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:44:18.257+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.565 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:44:18.257+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.565 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command rotate-key cmddesc rotate-key hook 0x563d8a1523a0 EEXIST 2024-09-12T17:44:18.565 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:18.565 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:44:18.565 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-a con 0x563d8a17a980 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:44:18.565 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-b con 0x563d8a17cc50 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:44:18.565 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-c con 0x563d8a179150 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:44:18.565 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.566 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.566 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.566 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:18.566 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient(hunting): authenticate will time out at 2030.894813s 2024-09-12T17:44:18.566 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:44:18.257+0000 7f61ae5a5640 10 monclient(hunting): get_auth_request con 0x563d8a17a980 auth_method 0 2024-09-12T17:44:18.566 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:44:18.257+0000 7f61ae5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.566 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:44:18.257+0000 7f61ae5a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.566 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:44:18.257+0000 7f61ae5a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.566 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:44:18.257+0000 7f61aeda6640 10 monclient(hunting): get_auth_request con 0x563d8a179150 auth_method 0 2024-09-12T17:44:18.566 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:44:18.257+0000 7f61aeda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.566 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:44:18.257+0000 7f61aeda6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.566 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:44:18.257+0000 7f61aeda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.567 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:44:18.257+0000 7f61adda4640 10 monclient(hunting): get_auth_request con 0x563d8a17cc50 auth_method 0 2024-09-12T17:44:18.567 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:44:18.258+0000 7f61adda4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.567 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:44:18.258+0000 7f61adda4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.567 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:44:18.258+0000 7f61adda4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.567 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:44:18.258+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.567 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:44:18.258+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.567 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:44:18.258+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.567 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:44:18.258+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.567 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:44:18.258+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.567 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:44:18.258+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.567 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:44:18.258+0000 7f61adda4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.567 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:44:18.258+0000 7f61adda4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.567 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:44:18.258+0000 7f61adda4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.568 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:44:18.258+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_done global_id 7437 payload 824 2024-09-12T17:44:18.568 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:44:18.258+0000 7f61ae5a5640 10 monclient: _finish_hunting 0 2024-09-12T17:44:18.568 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:44:18.258+0000 7f61ae5a5640 1 monclient: found mon.noname-a 2024-09-12T17:44:18.568 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:44:18.258+0000 7f61ae5a5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:44:18.568 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:18.568 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:44:18.568 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: dump: 2024-09-12T17:44:18.568 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:18.568 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:18.568 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.568 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.568 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:18.569 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.569 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:18.569 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:18.569 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:18.569 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.569 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: _finish_auth 0 2024-09-12T17:44:18.569 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: _check_auth_tickets 2024-09-12T17:44:18.569 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:18.569 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:18.569 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:44:18.569 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: dump: 2024-09-12T17:44:18.570 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:18.570 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:18.570 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.570 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.570 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:18.570 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.570 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:18.570 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:18.570 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:18.570 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.570 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:44:18.258+0000 7f61b0abb800 5 monclient: authenticate success, global_id 7437 2024-09-12T17:44:18.570 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:44:18.258+0000 7f61b0abb800 10 monclient: _renew_subs 2024-09-12T17:44:18.571 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:44:18.258+0000 7f61b0abb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:44:18.571 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:44:18.258+0000 7f61af5a7640 4 set_mon_vals no callback set 2024-09-12T17:44:18.571 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:44:18.258+0000 7f61b0abb800 10 monclient: _renew_subs 2024-09-12T17:44:18.571 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:44:18.258+0000 7f61b0abb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:44:18.571 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:44:18.260+0000 7f6093fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:18.571 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:44:18.260+0000 7f6093fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:18.571 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:44:18.260+0000 7f6093fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:18.571 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:44:18.260+0000 7f61adda4640 10 monclient: get_auth_request con 0x7f6088076380 auth_method 0 2024-09-12T17:44:18.571 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:44:18.260+0000 7f61b0abb800 10 monclient: get_monmap_and_config 2024-09-12T17:44:18.571 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:44:18.260+0000 7f61b0abb800 10 monclient: build_initial_monmap 2024-09-12T17:44:18.571 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:44:18.260+0000 7f61b0abb800 1 build_initial for_mkfs: 0 2024-09-12T17:44:18.571 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:44:18.260+0000 7f61b0abb800 10 monclient: monmap: 2024-09-12T17:44:18.572 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:44:18.572 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:18.572 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:44:18.572 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:44:18.572 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:18.572 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.572 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:44:18.572 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:44:18.572 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:44:18.572 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.572 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding auth protocol: cephx 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding auth protocol: cephx 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding auth protocol: cephx 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: secure 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: crc 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: secure 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: crc 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: secure 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: crc 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: crc 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: secure 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: crc 2024-09-12T17:44:18.573 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: secure 2024-09-12T17:44:18.574 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: crc 2024-09-12T17:44:18.574 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: secure 2024-09-12T17:44:18.574 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:44:18.261+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.574 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient: init 2024-09-12T17:44:18.574 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding auth protocol: cephx 2024-09-12T17:44:18.574 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding auth protocol: cephx 2024-09-12T17:44:18.574 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding auth protocol: cephx 2024-09-12T17:44:18.574 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: secure 2024-09-12T17:44:18.574 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: crc 2024-09-12T17:44:18.574 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: secure 2024-09-12T17:44:18.574 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: crc 2024-09-12T17:44:18.574 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: secure 2024-09-12T17:44:18.575 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: crc 2024-09-12T17:44:18.575 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: crc 2024-09-12T17:44:18.575 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: secure 2024-09-12T17:44:18.575 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: crc 2024-09-12T17:44:18.575 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: secure 2024-09-12T17:44:18.575 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: crc 2024-09-12T17:44:18.575 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: secure 2024-09-12T17:44:18.575 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:44:18.261+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.575 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:44:18.261+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.575 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command rotate-key cmddesc rotate-key hook 0x7ffc709dffa8 EEXIST 2024-09-12T17:44:18.575 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:18.575 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:44:18.575 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-a con 0x563d8a1d6650 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:44:18.576 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-b con 0x563d8a1d0b80 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:44:18.576 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-c con 0x563d8a1c2070 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:44:18.576 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.576 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.576 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.576 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:18.576 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient(hunting): authenticate will time out at 2030.898941s 2024-09-12T17:44:18.576 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:44:18.262+0000 7f61ae5a5640 10 monclient(hunting): get_auth_request con 0x563d8a1d6650 auth_method 0 2024-09-12T17:44:18.576 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:44:18.262+0000 7f61ae5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.576 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:44:18.262+0000 7f61ae5a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.576 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:44:18.262+0000 7f61ae5a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.576 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient(hunting): get_auth_request con 0x563d8a1c2070 auth_method 0 2024-09-12T17:44:18.577 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.577 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.577 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.577 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.577 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.577 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.577 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:44:18.262+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.577 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:44:18.262+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.577 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:44:18.262+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.577 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:44:18.262+0000 7f61adda4640 10 monclient(hunting): get_auth_request con 0x563d8a1d0b80 auth_method 0 2024-09-12T17:44:18.577 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:44:18.262+0000 7f61adda4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.577 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:44:18.262+0000 7f61adda4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.577 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:44:18.262+0000 7f61adda4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.578 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient(hunting): handle_auth_done global_id 6947 payload 274 2024-09-12T17:44:18.578 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient: _finish_hunting 0 2024-09-12T17:44:18.578 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:44:18.262+0000 7f61aeda6640 1 monclient: found mon.noname-c 2024-09-12T17:44:18.578 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:44:18.578 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:18.578 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:18.578 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: dump: 2024-09-12T17:44:18.578 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:18.578 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:18.578 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.578 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.578 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:18.579 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.579 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:18.579 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:18.579 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:18.579 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.579 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: _finish_auth 0 2024-09-12T17:44:18.579 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:44:18.579 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:18.579 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:44:18.262+0000 7f61b0abb800 5 monclient: authenticate success, global_id 6947 2024-09-12T17:44:18.579 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:44:18.262+0000 7f61b0abb800 10 monclient: get_monmap_and_config success 2024-09-12T17:44:18.579 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:44:18.262+0000 7f61b0abb800 4 set_mon_vals no callback set 2024-09-12T17:44:18.579 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:18.579 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:18.580 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: dump: 2024-09-12T17:44:18.580 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:18.580 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:18.580 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.580 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.580 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:18.580 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.580 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:18.580 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:18.580 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:18.580 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.580 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:44:18.263+0000 7f61b0abb800 10 monclient: shutdown 2024-09-12T17:44:18.581 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:44:18.263+0000 7f61b0abb800 10 monclient: build_initial_monmap 2024-09-12T17:44:18.581 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:44:18.263+0000 7f61b0abb800 1 build_initial for_mkfs: 0 2024-09-12T17:44:18.581 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:44:18.263+0000 7f61b0abb800 10 monclient: monmap: 2024-09-12T17:44:18.581 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:44:18.581 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:18.581 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:44:18.581 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:44:18.581 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:18.581 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.581 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:44:18.581 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:44:18.581 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:44:18.582 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.582 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding auth protocol: cephx 2024-09-12T17:44:18.582 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding auth protocol: cephx 2024-09-12T17:44:18.582 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding auth protocol: cephx 2024-09-12T17:44:18.582 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: secure 2024-09-12T17:44:18.582 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: crc 2024-09-12T17:44:18.582 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: secure 2024-09-12T17:44:18.582 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: crc 2024-09-12T17:44:18.582 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: secure 2024-09-12T17:44:18.582 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: crc 2024-09-12T17:44:18.582 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: crc 2024-09-12T17:44:18.582 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: secure 2024-09-12T17:44:18.583 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: crc 2024-09-12T17:44:18.583 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: secure 2024-09-12T17:44:18.583 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: crc 2024-09-12T17:44:18.583 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: secure 2024-09-12T17:44:18.583 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:44:18.263+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.583 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:44:18.263+0000 7f61b0abb800 1 librados: starting msgr at 2024-09-12T17:44:18.583 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:44:18.263+0000 7f61b0abb800 1 librados: starting objecter 2024-09-12T17:44:18.583 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command objecter_requests cmddesc objecter_requests hook 0x563d8a19a0a0 EEXIST 2024-09-12T17:44:18.583 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:44:18.263+0000 7f61b0abb800 1 librados: setting wanted keys 2024-09-12T17:44:18.583 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:44:18.263+0000 7f61b0abb800 1 librados: calling monclient init 2024-09-12T17:44:18.583 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:44:18.263+0000 7f61b0abb800 10 monclient: init 2024-09-12T17:44:18.583 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding auth protocol: cephx 2024-09-12T17:44:18.583 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding auth protocol: cephx 2024-09-12T17:44:18.583 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding auth protocol: cephx 2024-09-12T17:44:18.584 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: secure 2024-09-12T17:44:18.584 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: crc 2024-09-12T17:44:18.584 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: secure 2024-09-12T17:44:18.584 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: crc 2024-09-12T17:44:18.584 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: secure 2024-09-12T17:44:18.584 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: crc 2024-09-12T17:44:18.584 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: crc 2024-09-12T17:44:18.584 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: secure 2024-09-12T17:44:18.584 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: crc 2024-09-12T17:44:18.584 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: secure 2024-09-12T17:44:18.584 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: crc 2024-09-12T17:44:18.584 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: secure 2024-09-12T17:44:18.584 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:44:18.263+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.585 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:44:18.264+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.585 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:44:18.264+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command rotate-key cmddesc rotate-key hook 0x563d8a192878 EEXIST 2024-09-12T17:44:18.585 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:18.585 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:44:18.585 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-c con 0x563d8a1c2070 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:44:18.585 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-b con 0x563d8a1d0b80 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:44:18.585 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-a con 0x563d8a1d6650 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:44:18.585 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.585 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.585 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.585 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:18.585 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient(hunting): authenticate will time out at 2030.901184s 2024-09-12T17:44:18.586 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient(hunting): get_auth_request con 0x563d8a1c2070 auth_method 0 2024-09-12T17:44:18.586 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.586 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.586 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.586 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:44:18.264+0000 7f61aeda6640 10 monclient(hunting): get_auth_request con 0x563d8a1d6650 auth_method 0 2024-09-12T17:44:18.586 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:44:18.264+0000 7f61aeda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.586 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:44:18.264+0000 7f61aeda6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.586 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:44:18.264+0000 7f61aeda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.586 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.586 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.586 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.586 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:44:18.264+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.586 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:44:18.264+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.587 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:44:18.264+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.587 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:44:18.264+0000 7f61adda4640 10 monclient(hunting): get_auth_request con 0x563d8a1d0b80 auth_method 0 2024-09-12T17:44:18.587 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:44:18.264+0000 7f61adda4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.587 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:44:18.264+0000 7f61adda4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.587 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:44:18.264+0000 7f61adda4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.587 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_done global_id 6950 payload 824 2024-09-12T17:44:18.587 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient: _finish_hunting 0 2024-09-12T17:44:18.587 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 1 monclient: found mon.noname-c 2024-09-12T17:44:18.587 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:44:18.587 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:18.587 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:18.587 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: dump: 2024-09-12T17:44:18.587 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:18.588 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:18.588 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.588 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.588 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:18.588 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.588 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:18.588 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:18.588 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:18.588 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.588 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: _finish_auth 0 2024-09-12T17:44:18.588 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: _check_auth_tickets 2024-09-12T17:44:18.588 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:18.589 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:18.589 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:18.589 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: dump: 2024-09-12T17:44:18.589 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:18.589 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:18.589 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.589 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.589 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:18.589 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.589 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:18.589 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:18.589 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:18.589 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.589 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:44:18.264+0000 7f61b0abb800 5 monclient: authenticate success, global_id 6950 2024-09-12T17:44:18.590 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:44:18.264+0000 7f6091ffb640 4 set_mon_vals no callback set 2024-09-12T17:44:18.590 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient: _renew_subs 2024-09-12T17:44:18.590 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:18.590 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient: _renew_subs 2024-09-12T17:44:18.590 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:18.590 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:44:18.264+0000 7f61b0abb800 1 librados: init done 2024-09-12T17:44:18.590 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:44:18.264+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command cr dump hook 0x563d8a1d0fb8 2024-09-12T17:44:18.590 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:44:18.266+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.590 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:44:18.266+0000 7f607ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:18.590 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:44:18.266+0000 7f607ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:18.590 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:44:18.266+0000 7f607ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:18.590 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:44:18.267+0000 7f61adda4640 10 monclient: get_auth_request con 0x7f6078076470 auth_method 0 2024-09-12T17:44:18.590 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:44:18.267+0000 7f61aeda6640 10 monclient: get_auth_request con 0x563d8a1eb720 auth_method 0 2024-09-12T17:44:18.590 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:44:18.267+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.591 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:44:18.267+0000 7f61b0abb800 20 realm 2024-09-12T17:44:18.591 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:44:18.267+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.591 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:44:18.267+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.591 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:44:18.267+0000 7f61b0abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:18.591 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:44:18.268+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.591 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:44:18.268+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.591 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:44:18.268+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.591 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:44:18.268+0000 7f61ae5a5640 10 monclient: get_auth_request con 0x563d8a1ef990 auth_method 0 2024-09-12T17:44:18.591 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:44:18.269+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:18.591 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:44:18.269+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.591 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:44:18.269+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:18.591 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:44:18.269+0000 7f61b0abb800 20 searching for the correct realm 2024-09-12T17:44:18.591 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:44:18.269+0000 7f61adda4640 10 monclient: get_auth_request con 0x563d8a1f4c20 auth_method 0 2024-09-12T17:44:18.592 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:44:18.270+0000 7f61aeda6640 10 monclient: get_auth_request con 0x7f61a4017070 auth_method 0 2024-09-12T17:44:18.592 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:44:18.270+0000 7f61ae5a5640 10 monclient: get_auth_request con 0x7f61a8071b00 auth_method 0 2024-09-12T17:44:18.592 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:44:18.271+0000 7f61adda4640 10 monclient: get_auth_request con 0x7f61a0028c00 auth_method 0 2024-09-12T17:44:18.592 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:44:18.272+0000 7f61aeda6640 0 -- 172.21.15.44:0/1622173523 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f61a4017070 msgr2=0x7f61a40619a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:18.592 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:44:18.272+0000 7f607ffff640 1 client.6950.objecter ms_handle_reset 0x7f61a4017070 session 0x7f61a4096580 osd.7 2024-09-12T17:44:18.592 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:44:18.272+0000 7f607ffff640 10 monclient: _renew_subs 2024-09-12T17:44:18.592 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:44:18.272+0000 7f607ffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:18.592 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:44:18.272+0000 7f61aeda6640 10 monclient: get_auth_request con 0x7f6078086290 auth_method 0 2024-09-12T17:44:18.592 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:44:18.274+0000 7f61aeda6640 10 monclient: get_auth_request con 0x7f61a400e070 auth_method 0 2024-09-12T17:44:18.592 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:44:18.276+0000 7f61ae5a5640 10 monclient: get_auth_request con 0x7f61a405eaf0 auth_method 0 2024-09-12T17:44:18.592 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:44:18.276+0000 7f61ae5a5640 0 -- 172.21.15.44:0/1622173523 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f61a405eaf0 msgr2=0x7f61a408f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:18.593 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:44:18.477+0000 7f61ae5a5640 10 monclient: get_auth_request con 0x7f61a405eaf0 auth_method 0 2024-09-12T17:44:18.593 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:18.593 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:18.593 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:18.593 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:18.593 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:18.593 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:18.593 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.593 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.593 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.593 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:18.593 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.593 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:18.594 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:44:18.483+0000 7f61b0abb800 20 zone default found 2024-09-12T17:44:18.594 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:44:18.483+0000 7f61b0abb800 4 Realm: () 2024-09-12T17:44:18.594 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:44:18.483+0000 7f61b0abb800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:18.594 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:44:18.483+0000 7f61b0abb800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:18.594 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:44:18.483+0000 7f61b0abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:18.594 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:44:18.483+0000 7f61b0abb800 20 zonegroup default 2024-09-12T17:44:18.594 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.594 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.594 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.594 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:44:18.484+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.594 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:44:18.484+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.594 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:44:18.484+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.595 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:44:18.484+0000 7f61b0abb800 20 started sync module instance, tier type = 2024-09-12T17:44:18.595 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:44:18.484+0000 7f61b0abb800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:18.595 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:44:18.490+0000 7f607ffff640 1 client.6950.objecter ms_handle_reset 0x7f61a400e070 session 0x7f61a4097e80 osd.6 2024-09-12T17:44:18.595 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:44:18.491+0000 7f61aeda6640 10 monclient: get_auth_request con 0x7f61a4017070 auth_method 0 2024-09-12T17:44:18.595 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=0 2024-09-12T17:44:18.595 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=1 2024-09-12T17:44:18.595 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=2 2024-09-12T17:44:18.595 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=3 2024-09-12T17:44:18.595 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=4 2024-09-12T17:44:18.595 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=5 2024-09-12T17:44:18.595 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=6 2024-09-12T17:44:18.595 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=7 2024-09-12T17:44:18.595 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:44:18.494+0000 7f61b0abb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:18.596 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding auth protocol: cephx 2024-09-12T17:44:18.596 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding auth protocol: cephx 2024-09-12T17:44:18.596 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding auth protocol: cephx 2024-09-12T17:44:18.596 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: secure 2024-09-12T17:44:18.596 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: crc 2024-09-12T17:44:18.596 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: secure 2024-09-12T17:44:18.596 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: crc 2024-09-12T17:44:18.596 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: secure 2024-09-12T17:44:18.596 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: crc 2024-09-12T17:44:18.596 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: crc 2024-09-12T17:44:18.596 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: secure 2024-09-12T17:44:18.596 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:44:18.496+0000 7f6064fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:18.597 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: crc 2024-09-12T17:44:18.597 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: secure 2024-09-12T17:44:18.597 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: crc 2024-09-12T17:44:18.597 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: secure 2024-09-12T17:44:18.597 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:44:18.496+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.597 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:44:18.496+0000 7f61b0abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:18.597 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:44:18.496+0000 7f61b0abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:18.597 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command cache list hook 0x563d8a1c5c50 2024-09-12T17:44:18.597 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command cache inspect hook 0x563d8a1c5c50 2024-09-12T17:44:18.597 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command cache erase hook 0x563d8a1c5c50 2024-09-12T17:44:18.597 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command cache zap hook 0x563d8a1c5c50 2024-09-12T17:44:18.597 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 note: GC not initialized 2024-09-12T17:44:18.597 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:44:18.497+0000 7f5fdf7fe640 20 reqs_thread_entry: start 2024-09-12T17:44:18.598 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:44:18.497+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command sync trace show hook 0x7f61a804ef20 2024-09-12T17:44:18.598 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:44:18.497+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command sync trace history hook 0x7f61a804ef20 2024-09-12T17:44:18.598 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:44:18.497+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command sync trace active hook 0x7f61a804ef20 2024-09-12T17:44:18.598 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:44:18.497+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command sync trace active_short hook 0x7f61a804ef20 2024-09-12T17:44:18.598 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:44:18.497+0000 7f61b0abb800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:18.598 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:44:18.497+0000 7f61b0abb800 20 Filter name: none 2024-09-12T17:44:18.598 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:44:18.497+0000 7f5fdd7fa640 20 reqs_thread_entry: start 2024-09-12T17:44:18.598 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:44:18.497+0000 7f61b0abb800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:44:18.598 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:44:18.497+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.598 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:44:18.497+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:18.598 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:44:18.497+0000 7f61b0abb800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:44:18.598 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:44:18.497+0000 7f61b0abb800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:44:18.599 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:44:18.497+0000 7f61b0abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 : miss 2024-09-12T17:44:18.599 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:44:18.497+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.599 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:44:18.498+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:18.599 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:44:18.498+0000 7f61b0abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:18.599 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:44:18.498+0000 7f61b0abb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:18.599 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:44:18.498+0000 7f61b0abb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:18.599 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:44:18.498+0000 7f61b0abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.599 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:44:18.498+0000 7f61b0abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 2024-09-12T17:44:18.599 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:44:18.503+0000 7f61b0abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:18.599 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:44:18.503+0000 7f61b0abb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:18.599 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:44:18.503+0000 7f61b0abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.599 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:44:18.503+0000 7f61b0abb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33, ofs0, ns] 2024-09-12T17:44:18.599 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:44:18.503+0000 7f60917fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562428 cookie 94822310317552 notifier 6950 bl.length()=1015 2024-09-12T17:44:18.600 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:44:18.503+0000 7f60917fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:18.600 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:44:18.503+0000 7f60917fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:18.600 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:44:18.503+0000 7f60917fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.600 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:44:18.503+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_sources= new_sources= 2024-09-12T17:44:18.600 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:44:18.503+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:44:18.600 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:44:18.503+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_dests= new_dests= 2024-09-12T17:44:18.600 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:44:18.503+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:44:18.600 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.0 2024-09-12T17:44:18.600 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.0 2024-09-12T17:44:18.600 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.1 2024-09-12T17:44:18.600 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.1 2024-09-12T17:44:18.600 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.2 2024-09-12T17:44:18.601 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.2 2024-09-12T17:44:18.601 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.3 2024-09-12T17:44:18.601 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.3 2024-09-12T17:44:18.601 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.4 2024-09-12T17:44:18.601 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.4 2024-09-12T17:44:18.601 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.5 2024-09-12T17:44:18.601 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.5 2024-09-12T17:44:18.601 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.6 2024-09-12T17:44:18.601 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.6 2024-09-12T17:44:18.601 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.7 2024-09-12T17:44:18.601 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.7 2024-09-12T17:44:18.601 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.8 2024-09-12T17:44:18.602 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.8 2024-09-12T17:44:18.602 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.9 2024-09-12T17:44:18.602 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.9 2024-09-12T17:44:18.602 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.10 2024-09-12T17:44:18.602 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.10 2024-09-12T17:44:18.602 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.11 2024-09-12T17:44:18.602 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.11 2024-09-12T17:44:18.602 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.0 2024-09-12T17:44:18.602 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1 2024-09-12T17:44:18.602 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:44:18.509+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.2 2024-09-12T17:44:18.602 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:44:18.509+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.3 2024-09-12T17:44:18.602 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:44:18.510+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.4 2024-09-12T17:44:18.603 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:44:18.510+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.5 2024-09-12T17:44:18.603 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:44:18.511+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.6 2024-09-12T17:44:18.603 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:44:18.512+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.7 2024-09-12T17:44:18.603 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:44:18.512+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.8 2024-09-12T17:44:18.603 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:44:18.513+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.9 2024-09-12T17:44:18.603 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:44:18.513+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.10 2024-09-12T17:44:18.603 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:44:18.516+0000 7f61b0abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:18.603 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:44:18.516+0000 7f61b0abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 2024-09-12T17:44:18.603 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:44:18.518+0000 7f61b0abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:18.603 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:44:18.518+0000 7f61b0abb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:18.603 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:44:18.518+0000 7f61b0abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.603 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:44:18.518+0000 7f61b0abb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33, ofs0, ns] 2024-09-12T17:44:18.604 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:44:18.518+0000 7f6091ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562429 cookie 94822310317552 notifier 6950 bl.length()=1015 2024-09-12T17:44:18.604 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:44:18.518+0000 7f6091ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:18.604 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:44:18.518+0000 7f6091ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:18.604 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:44:18.518+0000 7f6091ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.604 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:44:18.518+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_sources= new_sources= 2024-09-12T17:44:18.604 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:44:18.518+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:44:18.604 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:44:18.518+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_dests= new_dests= 2024-09-12T17:44:18.604 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:44:18.518+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:44:18.604 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:44:18.521+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.0 2024-09-12T17:44:18.604 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:44:18.521+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1 2024-09-12T17:44:18.604 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:44:18.522+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.2 2024-09-12T17:44:18.605 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:44:18.522+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.3 2024-09-12T17:44:18.605 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:44:18.522+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.4 2024-09-12T17:44:18.605 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:44:18.523+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.5 2024-09-12T17:44:18.605 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:44:18.524+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.6 2024-09-12T17:44:18.605 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:44:18.524+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.7 2024-09-12T17:44:18.605 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:44:18.525+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.8 2024-09-12T17:44:18.605 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:44:18.525+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.9 2024-09-12T17:44:18.605 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:44:18.525+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.10 2024-09-12T17:44:18.605 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:44:18.526+0000 7f61b0abb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f61b0abb800 time 2024-09-12T17:44:18.527565+0000 2024-09-12T17:44:18.605 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:44:18.605 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.606 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:18.606 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f61b3f8c71a] 2024-09-12T17:44:18.606 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f61b3f8c8d8] 2024-09-12T17:44:18.606 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563d89283841] 2024-09-12T17:44:18.606 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x563d89293827] 2024-09-12T17:44:18.606 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2024-09-12T17:44:18.606 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f61b2c29590] 2024-09-12T17:44:18.606 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2024-09-12T17:44:18.606 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2024-09-12T17:44:18.606 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.606 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:44:18.527+0000 7f61b0abb800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:44:18.607 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f61b0abb800 thread_name:radosgw-admin 2024-09-12T17:44:18.607 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.607 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:18.607 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f61b2c3e6f0] 2024-09-12T17:44:18.607 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f61b2c8b99c] 2024-09-12T17:44:18.607 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:44:18.607 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:44:18.607 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f61b3f8c774] 2024-09-12T17:44:18.607 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f61b3f8c8d8] 2024-09-12T17:44:18.607 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563d89283841] 2024-09-12T17:44:18.607 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x563d89293827] 2024-09-12T17:44:18.607 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2024-09-12T17:44:18.607 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f61b2c29590] 2024-09-12T17:44:18.608 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2024-09-12T17:44:18.608 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2024-09-12T17:44:18.608 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:44:18.608 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.608 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:44:18.608 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:44:18.608 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:44:18.608 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:44:18.608 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:44:18.608 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:44:18.608 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:44:18.608 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:44:18.608 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:44:18.609 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:44:18.609 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:44:18.609 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:44:18.609 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:44:18.609 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:44:18.609 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:44:18.609 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:44:18.609 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:44:18.609 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:44:18.609 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:44:18.609 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:44:18.609 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:44:18.609 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:44:18.609 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:44:18.610 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:44:18.610 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:44:18.610 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:44:18.610 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:44:18.610 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:44:18.610 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:44:18.610 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:44:18.610 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:44:18.610 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:44:18.610 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:44:18.610 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:44:18.610 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:44:18.610 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:44:18.611 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:44:18.611 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:44:18.611 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:44:18.611 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:44:18.611 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:44:18.611 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:44:18.611 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:44:18.611 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:44:18.611 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:44:18.611 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:44:18.611 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:44:18.611 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:44:18.611 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:44:18.612 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:44:18.612 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:44:18.612 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:44:18.612 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:44:18.612 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:44:18.612 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:44:18.612 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:44:18.612 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:44:18.612 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:44:18.612 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:44:18.612 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:44:18.612 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:44:18.612 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:44:18.613 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:44:18.613 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:44:18.613 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:44:18.613 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:44:18.613 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:44:18.613 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:44:18.613 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:44:18.613 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:44:18.613 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:44:18.613 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:44:18.613 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:44:18.613 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:44:18.613 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:44:18.614 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:44:18.614 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:44:18.614 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:44:18.614 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:44:18.614 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:44:18.614 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:44:18.614 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:44:18.614 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:44:18.614 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:44:18.614 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:44:18.614 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:44:18.614 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:44:18.615 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:44:18.615 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:44:18.615 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:44:18.615 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:44:18.615 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:44:18.615 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:44:18.615 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:44:18.615 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5fdd7fa640 / http_manager 2024-09-12T17:44:18.615 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5fdf7fe640 / http_manager 2024-09-12T17:44:18.615 INFO:tasks.workunit.client.0.smithi044.stderr: 7f6064fe1640 / rgw_dt_lg_renew 2024-09-12T17:44:18.615 INFO:tasks.workunit.client.0.smithi044.stderr: 7f607ffff640 / ms_dispatch 2024-09-12T17:44:18.615 INFO:tasks.workunit.client.0.smithi044.stderr: 7f60917fa640 / io_context_pool 2024-09-12T17:44:18.615 INFO:tasks.workunit.client.0.smithi044.stderr: 7f6091ffb640 / io_context_pool 2024-09-12T17:44:18.615 INFO:tasks.workunit.client.0.smithi044.stderr: 7f6093fff640 / ms_dispatch 2024-09-12T17:44:18.615 INFO:tasks.workunit.client.0.smithi044.stderr: 7f609ae05640 / ms_dispatch 2024-09-12T17:44:18.616 INFO:tasks.workunit.client.0.smithi044.stderr: 7f609c608640 / io_context_pool 2024-09-12T17:44:18.616 INFO:tasks.workunit.client.0.smithi044.stderr: 7f61adda4640 / msgr-worker-2 2024-09-12T17:44:18.616 INFO:tasks.workunit.client.0.smithi044.stderr: 7f61ae5a5640 / msgr-worker-1 2024-09-12T17:44:18.616 INFO:tasks.workunit.client.0.smithi044.stderr: 7f61aeda6640 / msgr-worker-0 2024-09-12T17:44:18.616 INFO:tasks.workunit.client.0.smithi044.stderr: 7f61af5a7640 / io_context_pool 2024-09-12T17:44:18.616 INFO:tasks.workunit.client.0.smithi044.stderr: 7f61b0abb800 / radosgw-admin 2024-09-12T17:44:18.616 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:44:18.616 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:44:18.616 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/log/ceph/ceph-client.admin.122670.log 2024-09-12T17:44:18.616 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:44:18.616 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:44:18.616 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:44:18.250+0000 7f61ae5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.616 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:44:18.250+0000 7f61ae5a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.616 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:44:18.250+0000 7f61ae5a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.617 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:44:18.250+0000 7f61adda4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.617 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:44:18.250+0000 7f61adda4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.617 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:44:18.250+0000 7f61adda4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.617 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:44:18.250+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.617 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:44:18.250+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.617 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:44:18.250+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.617 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:44:18.250+0000 7f61aeda6640 10 monclient(hunting): get_auth_request con 0x563d8a047f80 auth_method 0 2024-09-12T17:44:18.617 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:44:18.250+0000 7f61aeda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.617 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:44:18.250+0000 7f61aeda6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.617 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:44:18.250+0000 7f61aeda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.617 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:44:18.251+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.617 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:44:18.251+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.618 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:44:18.251+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.618 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:44:18.251+0000 7f61adda4640 10 monclient(hunting): handle_auth_done global_id 6941 payload 824 2024-09-12T17:44:18.618 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:44:18.251+0000 7f61adda4640 10 monclient: _finish_hunting 0 2024-09-12T17:44:18.618 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:44:18.251+0000 7f61adda4640 1 monclient: found mon.noname-c 2024-09-12T17:44:18.618 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:44:18.251+0000 7f61adda4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:44:18.618 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:18.618 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:18.618 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: dump: 2024-09-12T17:44:18.618 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:18.618 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:18.618 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.618 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.618 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:18.619 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.619 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:18.619 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:18.619 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:18.619 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.619 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: _finish_auth 0 2024-09-12T17:44:18.619 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: _check_auth_tickets 2024-09-12T17:44:18.619 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:18.619 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:18.619 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:18.619 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:44:18.251+0000 7f609ae05640 10 monclient: dump: 2024-09-12T17:44:18.619 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:18.619 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:18.619 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.620 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.620 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:18.620 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.620 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:18.620 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:18.620 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:18.620 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.620 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:44:18.251+0000 7f61b0abb800 5 monclient: authenticate success, global_id 6941 2024-09-12T17:44:18.620 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:44:18.251+0000 7f609c608640 4 set_mon_vals no callback set 2024-09-12T17:44:18.620 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:44:18.251+0000 7f61b0abb800 10 monclient: _renew_subs 2024-09-12T17:44:18.620 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:44:18.251+0000 7f61b0abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:18.620 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:44:18.251+0000 7f61b0abb800 10 monclient: _renew_subs 2024-09-12T17:44:18.620 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:44:18.251+0000 7f61b0abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:18.621 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:44:18.251+0000 7f61b0abb800 1 librados: init done 2024-09-12T17:44:18.621 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:44:18.253+0000 7f609ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:18.621 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:44:18.253+0000 7f609ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:18.621 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:44:18.253+0000 7f609ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:18.621 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:44:18.253+0000 7f61ae5a5640 10 monclient: get_auth_request con 0x7f6094076470 auth_method 0 2024-09-12T17:44:18.621 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:44:18.253+0000 7f61aeda6640 10 monclient: get_auth_request con 0x563d8a147270 auth_method 0 2024-09-12T17:44:18.621 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:44:18.254+0000 7f61ae5a5640 10 monclient: get_auth_request con 0x563d8a14a450 auth_method 0 2024-09-12T17:44:18.621 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:44:18.256+0000 7f61adda4640 10 monclient: get_auth_request con 0x563d8a14f4e0 auth_method 0 2024-09-12T17:44:18.621 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:44:18.256+0000 7f61b0abb800 10 monclient: build_initial_monmap 2024-09-12T17:44:18.621 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:44:18.256+0000 7f61b0abb800 1 build_initial for_mkfs: 0 2024-09-12T17:44:18.621 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:44:18.256+0000 7f61b0abb800 10 monclient: monmap: 2024-09-12T17:44:18.621 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:44:18.621 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:18.622 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:44:18.622 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:44:18.622 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:18.622 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.622 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:44:18.622 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:44:18.622 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:44:18.622 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.622 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding auth protocol: cephx 2024-09-12T17:44:18.622 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding auth protocol: cephx 2024-09-12T17:44:18.622 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding auth protocol: cephx 2024-09-12T17:44:18.622 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: secure 2024-09-12T17:44:18.622 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: crc 2024-09-12T17:44:18.623 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: secure 2024-09-12T17:44:18.623 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: crc 2024-09-12T17:44:18.623 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: secure 2024-09-12T17:44:18.623 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: crc 2024-09-12T17:44:18.623 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: crc 2024-09-12T17:44:18.623 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: secure 2024-09-12T17:44:18.623 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: crc 2024-09-12T17:44:18.623 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: secure 2024-09-12T17:44:18.623 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: crc 2024-09-12T17:44:18.623 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:44:18.256+0000 7f61b0abb800 5 AuthRegistry(0x563d8a1532a0) adding con mode: secure 2024-09-12T17:44:18.623 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:44:18.257+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.623 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command objecter_requests cmddesc objecter_requests hook 0x563d8a156c90 EEXIST 2024-09-12T17:44:18.623 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient: init 2024-09-12T17:44:18.624 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding auth protocol: cephx 2024-09-12T17:44:18.624 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding auth protocol: cephx 2024-09-12T17:44:18.624 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding auth protocol: cephx 2024-09-12T17:44:18.624 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: secure 2024-09-12T17:44:18.624 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: crc 2024-09-12T17:44:18.624 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: secure 2024-09-12T17:44:18.624 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: crc 2024-09-12T17:44:18.624 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: secure 2024-09-12T17:44:18.624 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: crc 2024-09-12T17:44:18.624 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: crc 2024-09-12T17:44:18.624 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: secure 2024-09-12T17:44:18.624 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: crc 2024-09-12T17:44:18.624 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: secure 2024-09-12T17:44:18.625 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: crc 2024-09-12T17:44:18.625 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 AuthRegistry(0x563d8a152258) adding con mode: secure 2024-09-12T17:44:18.625 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:44:18.257+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.625 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:44:18.257+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.625 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:44:18.257+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command rotate-key cmddesc rotate-key hook 0x563d8a1523a0 EEXIST 2024-09-12T17:44:18.625 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:18.625 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:44:18.625 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-a con 0x563d8a17a980 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:44:18.625 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-b con 0x563d8a17cc50 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:44:18.625 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-c con 0x563d8a179150 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:44:18.625 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.625 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.626 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.626 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:18.626 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:44:18.257+0000 7f61b0abb800 10 monclient(hunting): authenticate will time out at 2030.894813s 2024-09-12T17:44:18.626 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:44:18.257+0000 7f61ae5a5640 10 monclient(hunting): get_auth_request con 0x563d8a17a980 auth_method 0 2024-09-12T17:44:18.626 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:44:18.257+0000 7f61ae5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.626 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:44:18.257+0000 7f61ae5a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.626 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:44:18.257+0000 7f61ae5a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.626 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:44:18.257+0000 7f61aeda6640 10 monclient(hunting): get_auth_request con 0x563d8a179150 auth_method 0 2024-09-12T17:44:18.626 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:44:18.257+0000 7f61aeda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.626 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:44:18.257+0000 7f61aeda6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.626 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:44:18.257+0000 7f61aeda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.626 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:44:18.257+0000 7f61adda4640 10 monclient(hunting): get_auth_request con 0x563d8a17cc50 auth_method 0 2024-09-12T17:44:18.626 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:44:18.258+0000 7f61adda4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.626 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:44:18.258+0000 7f61adda4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.627 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:44:18.258+0000 7f61adda4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.627 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:44:18.258+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.627 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:44:18.258+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.627 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:44:18.258+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.627 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:44:18.258+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.627 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:44:18.258+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.627 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:44:18.258+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.627 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:44:18.258+0000 7f61adda4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.627 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:44:18.258+0000 7f61adda4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.627 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:44:18.258+0000 7f61adda4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.627 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:44:18.258+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_done global_id 7437 payload 824 2024-09-12T17:44:18.627 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:44:18.258+0000 7f61ae5a5640 10 monclient: _finish_hunting 0 2024-09-12T17:44:18.628 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:44:18.258+0000 7f61ae5a5640 1 monclient: found mon.noname-a 2024-09-12T17:44:18.628 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:44:18.258+0000 7f61ae5a5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:44:18.628 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:18.628 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:44:18.628 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: dump: 2024-09-12T17:44:18.628 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:18.628 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:18.628 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.628 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.628 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:18.628 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.628 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:18.629 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:18.629 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:18.629 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.629 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: _finish_auth 0 2024-09-12T17:44:18.629 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: _check_auth_tickets 2024-09-12T17:44:18.629 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:18.629 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:18.629 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:44:18.629 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:44:18.258+0000 7f6093fff640 10 monclient: dump: 2024-09-12T17:44:18.629 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:18.629 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:18.629 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.629 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.629 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:18.630 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.630 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:18.630 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:18.630 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:18.630 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.630 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:44:18.258+0000 7f61b0abb800 5 monclient: authenticate success, global_id 7437 2024-09-12T17:44:18.630 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:44:18.258+0000 7f61b0abb800 10 monclient: _renew_subs 2024-09-12T17:44:18.630 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:44:18.258+0000 7f61b0abb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:44:18.630 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:44:18.258+0000 7f61af5a7640 4 set_mon_vals no callback set 2024-09-12T17:44:18.630 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:44:18.258+0000 7f61b0abb800 10 monclient: _renew_subs 2024-09-12T17:44:18.630 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:44:18.258+0000 7f61b0abb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:44:18.630 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:44:18.260+0000 7f6093fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:18.630 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:44:18.260+0000 7f6093fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:18.630 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:44:18.260+0000 7f6093fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:18.630 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:44:18.260+0000 7f61adda4640 10 monclient: get_auth_request con 0x7f6088076380 auth_method 0 2024-09-12T17:44:18.631 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:44:18.260+0000 7f61b0abb800 10 monclient: get_monmap_and_config 2024-09-12T17:44:18.631 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:44:18.260+0000 7f61b0abb800 10 monclient: build_initial_monmap 2024-09-12T17:44:18.631 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:44:18.260+0000 7f61b0abb800 1 build_initial for_mkfs: 0 2024-09-12T17:44:18.631 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:44:18.260+0000 7f61b0abb800 10 monclient: monmap: 2024-09-12T17:44:18.631 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:44:18.631 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:18.631 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:44:18.631 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:44:18.631 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:18.631 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.631 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:44:18.631 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:44:18.631 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:44:18.631 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.632 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding auth protocol: cephx 2024-09-12T17:44:18.632 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding auth protocol: cephx 2024-09-12T17:44:18.632 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding auth protocol: cephx 2024-09-12T17:44:18.632 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: secure 2024-09-12T17:44:18.632 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: crc 2024-09-12T17:44:18.632 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: secure 2024-09-12T17:44:18.632 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: crc 2024-09-12T17:44:18.632 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: secure 2024-09-12T17:44:18.632 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: crc 2024-09-12T17:44:18.632 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: crc 2024-09-12T17:44:18.632 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: secure 2024-09-12T17:44:18.632 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: crc 2024-09-12T17:44:18.632 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: secure 2024-09-12T17:44:18.633 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: crc 2024-09-12T17:44:18.633 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a640) adding con mode: secure 2024-09-12T17:44:18.633 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:44:18.261+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.633 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient: init 2024-09-12T17:44:18.633 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding auth protocol: cephx 2024-09-12T17:44:18.633 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding auth protocol: cephx 2024-09-12T17:44:18.633 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding auth protocol: cephx 2024-09-12T17:44:18.633 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: secure 2024-09-12T17:44:18.633 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: crc 2024-09-12T17:44:18.633 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: secure 2024-09-12T17:44:18.633 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: crc 2024-09-12T17:44:18.633 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: secure 2024-09-12T17:44:18.634 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: crc 2024-09-12T17:44:18.634 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: crc 2024-09-12T17:44:18.634 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: secure 2024-09-12T17:44:18.634 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: crc 2024-09-12T17:44:18.634 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: secure 2024-09-12T17:44:18.634 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: crc 2024-09-12T17:44:18.634 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709dfe60) adding con mode: secure 2024-09-12T17:44:18.634 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:44:18.261+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.634 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:44:18.261+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.634 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:44:18.261+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command rotate-key cmddesc rotate-key hook 0x7ffc709dffa8 EEXIST 2024-09-12T17:44:18.634 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:18.634 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:44:18.634 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-a con 0x563d8a1d6650 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:44:18.635 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-b con 0x563d8a1d0b80 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:44:18.635 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-c con 0x563d8a1c2070 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:44:18.635 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.635 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.635 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.635 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:18.635 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:44:18.261+0000 7f61b0abb800 10 monclient(hunting): authenticate will time out at 2030.898941s 2024-09-12T17:44:18.635 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:44:18.262+0000 7f61ae5a5640 10 monclient(hunting): get_auth_request con 0x563d8a1d6650 auth_method 0 2024-09-12T17:44:18.635 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:44:18.262+0000 7f61ae5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.635 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:44:18.262+0000 7f61ae5a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.635 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:44:18.262+0000 7f61ae5a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.635 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient(hunting): get_auth_request con 0x563d8a1c2070 auth_method 0 2024-09-12T17:44:18.635 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.635 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.636 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.636 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.636 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.636 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.636 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:44:18.262+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.636 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:44:18.262+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.636 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:44:18.262+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.636 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:44:18.262+0000 7f61adda4640 10 monclient(hunting): get_auth_request con 0x563d8a1d0b80 auth_method 0 2024-09-12T17:44:18.636 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:44:18.262+0000 7f61adda4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.636 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:44:18.262+0000 7f61adda4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.636 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:44:18.262+0000 7f61adda4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.636 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient(hunting): handle_auth_done global_id 6947 payload 274 2024-09-12T17:44:18.636 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient: _finish_hunting 0 2024-09-12T17:44:18.636 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:44:18.262+0000 7f61aeda6640 1 monclient: found mon.noname-c 2024-09-12T17:44:18.637 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:44:18.262+0000 7f61aeda6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:44:18.637 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:18.637 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:18.637 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: dump: 2024-09-12T17:44:18.637 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:18.637 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:18.637 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.637 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.637 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:18.637 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.637 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:18.637 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:18.638 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:18.638 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.638 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: _finish_auth 0 2024-09-12T17:44:18.638 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:44:18.638 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:18.638 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:44:18.262+0000 7f61b0abb800 5 monclient: authenticate success, global_id 6947 2024-09-12T17:44:18.638 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:44:18.262+0000 7f61b0abb800 10 monclient: get_monmap_and_config success 2024-09-12T17:44:18.638 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:44:18.262+0000 7f61b0abb800 4 set_mon_vals no callback set 2024-09-12T17:44:18.638 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:18.638 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:18.638 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:44:18.262+0000 7f6091ffb640 10 monclient: dump: 2024-09-12T17:44:18.638 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:18.638 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:18.639 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.639 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.639 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:18.639 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.639 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:18.639 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:18.639 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:18.639 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.639 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:44:18.263+0000 7f61b0abb800 10 monclient: shutdown 2024-09-12T17:44:18.639 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:44:18.263+0000 7f61b0abb800 10 monclient: build_initial_monmap 2024-09-12T17:44:18.639 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:44:18.263+0000 7f61b0abb800 1 build_initial for_mkfs: 0 2024-09-12T17:44:18.639 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:44:18.263+0000 7f61b0abb800 10 monclient: monmap: 2024-09-12T17:44:18.639 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:44:18.639 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:18.640 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:44:18.640 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:44:18.640 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:18.640 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.640 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:44:18.640 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:44:18.640 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:44:18.640 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.640 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding auth protocol: cephx 2024-09-12T17:44:18.640 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding auth protocol: cephx 2024-09-12T17:44:18.640 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding auth protocol: cephx 2024-09-12T17:44:18.640 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: secure 2024-09-12T17:44:18.640 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: crc 2024-09-12T17:44:18.641 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: secure 2024-09-12T17:44:18.641 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: crc 2024-09-12T17:44:18.641 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: secure 2024-09-12T17:44:18.641 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: crc 2024-09-12T17:44:18.641 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: crc 2024-09-12T17:44:18.641 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: secure 2024-09-12T17:44:18.641 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: crc 2024-09-12T17:44:18.641 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: secure 2024-09-12T17:44:18.641 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: crc 2024-09-12T17:44:18.641 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a19a5f0) adding con mode: secure 2024-09-12T17:44:18.641 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:44:18.263+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.641 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:44:18.263+0000 7f61b0abb800 1 librados: starting msgr at 2024-09-12T17:44:18.642 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:44:18.263+0000 7f61b0abb800 1 librados: starting objecter 2024-09-12T17:44:18.642 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command objecter_requests cmddesc objecter_requests hook 0x563d8a19a0a0 EEXIST 2024-09-12T17:44:18.642 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:44:18.263+0000 7f61b0abb800 1 librados: setting wanted keys 2024-09-12T17:44:18.642 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:44:18.263+0000 7f61b0abb800 1 librados: calling monclient init 2024-09-12T17:44:18.642 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:44:18.263+0000 7f61b0abb800 10 monclient: init 2024-09-12T17:44:18.642 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding auth protocol: cephx 2024-09-12T17:44:18.642 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding auth protocol: cephx 2024-09-12T17:44:18.642 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding auth protocol: cephx 2024-09-12T17:44:18.642 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: secure 2024-09-12T17:44:18.642 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: crc 2024-09-12T17:44:18.642 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: secure 2024-09-12T17:44:18.642 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: crc 2024-09-12T17:44:18.642 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: secure 2024-09-12T17:44:18.643 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: crc 2024-09-12T17:44:18.643 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: crc 2024-09-12T17:44:18.643 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: secure 2024-09-12T17:44:18.643 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: crc 2024-09-12T17:44:18.643 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: secure 2024-09-12T17:44:18.643 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: crc 2024-09-12T17:44:18.643 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:44:18.263+0000 7f61b0abb800 5 AuthRegistry(0x563d8a192730) adding con mode: secure 2024-09-12T17:44:18.643 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:44:18.263+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.643 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:44:18.264+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.643 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:44:18.264+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command rotate-key cmddesc rotate-key hook 0x563d8a192878 EEXIST 2024-09-12T17:44:18.643 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:18.644 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:44:18.644 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-c con 0x563d8a1c2070 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:44:18.644 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-b con 0x563d8a1d0b80 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:44:18.644 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient(hunting): picked mon.noname-a con 0x563d8a1d6650 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:44:18.644 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.644 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.644 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:18.644 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:18.644 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient(hunting): authenticate will time out at 2030.901184s 2024-09-12T17:44:18.644 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient(hunting): get_auth_request con 0x563d8a1c2070 auth_method 0 2024-09-12T17:44:18.644 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.644 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.644 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.644 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:44:18.264+0000 7f61aeda6640 10 monclient(hunting): get_auth_request con 0x563d8a1d6650 auth_method 0 2024-09-12T17:44:18.645 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:44:18.264+0000 7f61aeda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.645 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:44:18.264+0000 7f61aeda6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.645 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:44:18.264+0000 7f61aeda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.645 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.645 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.645 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.645 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:44:18.264+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:18.645 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:44:18.264+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:18.645 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:44:18.264+0000 7f61aeda6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:18.645 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:44:18.264+0000 7f61adda4640 10 monclient(hunting): get_auth_request con 0x563d8a1d0b80 auth_method 0 2024-09-12T17:44:18.645 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:44:18.264+0000 7f61adda4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:18.645 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:44:18.264+0000 7f61adda4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:18.645 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:44:18.264+0000 7f61adda4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:18.646 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient(hunting): handle_auth_done global_id 6950 payload 824 2024-09-12T17:44:18.646 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient: _finish_hunting 0 2024-09-12T17:44:18.646 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 1 monclient: found mon.noname-c 2024-09-12T17:44:18.646 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:44:18.264+0000 7f61ae5a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:44:18.646 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:18.646 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:18.646 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: dump: 2024-09-12T17:44:18.646 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:18.646 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:18.646 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.646 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.646 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:18.646 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.646 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:18.647 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:18.647 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:18.647 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.647 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: _finish_auth 0 2024-09-12T17:44:18.647 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: _check_auth_tickets 2024-09-12T17:44:18.647 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:18.647 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:18.647 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:18.647 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:44:18.264+0000 7f607ffff640 10 monclient: dump: 2024-09-12T17:44:18.647 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:18.647 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:18.647 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.648 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:18.648 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:18.648 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:18.648 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:18.648 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:18.648 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:18.648 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.648 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:44:18.264+0000 7f61b0abb800 5 monclient: authenticate success, global_id 6950 2024-09-12T17:44:18.648 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:44:18.264+0000 7f6091ffb640 4 set_mon_vals no callback set 2024-09-12T17:44:18.648 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient: _renew_subs 2024-09-12T17:44:18.648 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:18.648 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient: _renew_subs 2024-09-12T17:44:18.648 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:44:18.264+0000 7f61b0abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:18.649 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:44:18.264+0000 7f61b0abb800 1 librados: init done 2024-09-12T17:44:18.649 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:44:18.264+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command cr dump hook 0x563d8a1d0fb8 2024-09-12T17:44:18.649 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:44:18.266+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.649 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:44:18.266+0000 7f607ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:18.649 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:44:18.266+0000 7f607ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:18.649 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:44:18.266+0000 7f607ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:18.649 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:44:18.267+0000 7f61adda4640 10 monclient: get_auth_request con 0x7f6078076470 auth_method 0 2024-09-12T17:44:18.649 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:44:18.267+0000 7f61aeda6640 10 monclient: get_auth_request con 0x563d8a1eb720 auth_method 0 2024-09-12T17:44:18.649 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:44:18.267+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.649 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:44:18.267+0000 7f61b0abb800 20 realm 2024-09-12T17:44:18.649 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:44:18.267+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.649 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:44:18.267+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.650 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:44:18.267+0000 7f61b0abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:18.650 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:44:18.268+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.650 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:44:18.268+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.650 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:44:18.268+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.650 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:44:18.268+0000 7f61ae5a5640 10 monclient: get_auth_request con 0x563d8a1ef990 auth_method 0 2024-09-12T17:44:18.650 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:44:18.269+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:18.650 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:44:18.269+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.650 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:44:18.269+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:18.650 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:44:18.269+0000 7f61b0abb800 20 searching for the correct realm 2024-09-12T17:44:18.650 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:44:18.269+0000 7f61adda4640 10 monclient: get_auth_request con 0x563d8a1f4c20 auth_method 0 2024-09-12T17:44:18.650 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:44:18.270+0000 7f61aeda6640 10 monclient: get_auth_request con 0x7f61a4017070 auth_method 0 2024-09-12T17:44:18.650 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:44:18.270+0000 7f61ae5a5640 10 monclient: get_auth_request con 0x7f61a8071b00 auth_method 0 2024-09-12T17:44:18.650 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:44:18.271+0000 7f61adda4640 10 monclient: get_auth_request con 0x7f61a0028c00 auth_method 0 2024-09-12T17:44:18.650 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:44:18.272+0000 7f61aeda6640 0 -- 172.21.15.44:0/1622173523 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f61a4017070 msgr2=0x7f61a40619a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:18.651 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:44:18.272+0000 7f607ffff640 1 client.6950.objecter ms_handle_reset 0x7f61a4017070 session 0x7f61a4096580 osd.7 2024-09-12T17:44:18.651 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:44:18.272+0000 7f607ffff640 10 monclient: _renew_subs 2024-09-12T17:44:18.651 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:44:18.272+0000 7f607ffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:18.651 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:44:18.272+0000 7f61aeda6640 10 monclient: get_auth_request con 0x7f6078086290 auth_method 0 2024-09-12T17:44:18.651 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:44:18.274+0000 7f61aeda6640 10 monclient: get_auth_request con 0x7f61a400e070 auth_method 0 2024-09-12T17:44:18.651 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:44:18.276+0000 7f61ae5a5640 10 monclient: get_auth_request con 0x7f61a405eaf0 auth_method 0 2024-09-12T17:44:18.651 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:44:18.276+0000 7f61ae5a5640 0 -- 172.21.15.44:0/1622173523 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f61a405eaf0 msgr2=0x7f61a408f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:18.651 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:44:18.477+0000 7f61ae5a5640 10 monclient: get_auth_request con 0x7f61a405eaf0 auth_method 0 2024-09-12T17:44:18.651 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:18.651 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:18.651 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:18.651 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:18.651 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:18.652 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:18.652 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.652 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.652 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:44:18.482+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.652 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:18.652 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.652 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:18.652 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:44:18.483+0000 7f61b0abb800 20 zone default found 2024-09-12T17:44:18.652 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:44:18.483+0000 7f61b0abb800 4 Realm: () 2024-09-12T17:44:18.652 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:44:18.483+0000 7f61b0abb800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:18.652 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:44:18.483+0000 7f61b0abb800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:18.652 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:44:18.483+0000 7f61b0abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:18.652 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:44:18.483+0000 7f61b0abb800 20 zonegroup default 2024-09-12T17:44:18.653 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.653 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.653 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:44:18.483+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.653 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:44:18.484+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.653 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:44:18.484+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.653 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:44:18.484+0000 7f61b0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.653 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:44:18.484+0000 7f61b0abb800 20 started sync module instance, tier type = 2024-09-12T17:44:18.653 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:44:18.484+0000 7f61b0abb800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:18.653 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:44:18.490+0000 7f607ffff640 1 client.6950.objecter ms_handle_reset 0x7f61a400e070 session 0x7f61a4097e80 osd.6 2024-09-12T17:44:18.653 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:44:18.491+0000 7f61aeda6640 10 monclient: get_auth_request con 0x7f61a4017070 auth_method 0 2024-09-12T17:44:18.653 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=0 2024-09-12T17:44:18.653 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=1 2024-09-12T17:44:18.654 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=2 2024-09-12T17:44:18.654 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=3 2024-09-12T17:44:18.654 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=4 2024-09-12T17:44:18.654 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=5 2024-09-12T17:44:18.654 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=6 2024-09-12T17:44:18.654 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:44:18.494+0000 7f61b0abb800 20 add_watcher() i=7 2024-09-12T17:44:18.654 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:44:18.494+0000 7f61b0abb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:18.654 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding auth protocol: cephx 2024-09-12T17:44:18.654 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding auth protocol: cephx 2024-09-12T17:44:18.654 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding auth protocol: cephx 2024-09-12T17:44:18.654 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: secure 2024-09-12T17:44:18.654 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: crc 2024-09-12T17:44:18.654 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: secure 2024-09-12T17:44:18.654 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: crc 2024-09-12T17:44:18.655 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: secure 2024-09-12T17:44:18.655 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: crc 2024-09-12T17:44:18.655 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: crc 2024-09-12T17:44:18.655 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: secure 2024-09-12T17:44:18.655 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:44:18.496+0000 7f6064fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:18.655 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: crc 2024-09-12T17:44:18.655 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: secure 2024-09-12T17:44:18.655 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: crc 2024-09-12T17:44:18.655 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 AuthRegistry(0x7ffc709e0330) adding con mode: secure 2024-09-12T17:44:18.655 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:44:18.496+0000 7f61b0abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:18.655 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:44:18.496+0000 7f61b0abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:18.655 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:44:18.496+0000 7f61b0abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:18.655 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command cache list hook 0x563d8a1c5c50 2024-09-12T17:44:18.656 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command cache inspect hook 0x563d8a1c5c50 2024-09-12T17:44:18.656 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command cache erase hook 0x563d8a1c5c50 2024-09-12T17:44:18.656 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command cache zap hook 0x563d8a1c5c50 2024-09-12T17:44:18.656 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:44:18.496+0000 7f61b0abb800 5 note: GC not initialized 2024-09-12T17:44:18.656 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:44:18.497+0000 7f5fdf7fe640 20 reqs_thread_entry: start 2024-09-12T17:44:18.656 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:44:18.497+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command sync trace show hook 0x7f61a804ef20 2024-09-12T17:44:18.656 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:44:18.497+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command sync trace history hook 0x7f61a804ef20 2024-09-12T17:44:18.656 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:44:18.497+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command sync trace active hook 0x7f61a804ef20 2024-09-12T17:44:18.656 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:44:18.497+0000 7f61b0abb800 5 asok(0x563d89edc730) register_command sync trace active_short hook 0x7f61a804ef20 2024-09-12T17:44:18.656 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:44:18.497+0000 7f61b0abb800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:18.656 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:44:18.497+0000 7f61b0abb800 20 Filter name: none 2024-09-12T17:44:18.656 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:44:18.497+0000 7f5fdd7fa640 20 reqs_thread_entry: start 2024-09-12T17:44:18.656 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:44:18.497+0000 7f61b0abb800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:44:18.657 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:44:18.497+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.657 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:44:18.497+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:18.657 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:44:18.497+0000 7f61b0abb800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:44:18.657 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:44:18.497+0000 7f61b0abb800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:44:18.657 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:44:18.497+0000 7f61b0abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 : miss 2024-09-12T17:44:18.657 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:44:18.497+0000 7f61b0abb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.657 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:44:18.498+0000 7f61b0abb800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:18.657 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:44:18.498+0000 7f61b0abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:18.657 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:44:18.498+0000 7f61b0abb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:18.657 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:44:18.498+0000 7f61b0abb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:18.657 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:44:18.498+0000 7f61b0abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.657 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:44:18.498+0000 7f61b0abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 2024-09-12T17:44:18.657 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:44:18.503+0000 7f61b0abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:18.657 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:44:18.503+0000 7f61b0abb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:18.658 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:44:18.503+0000 7f61b0abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.658 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:44:18.503+0000 7f61b0abb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33, ofs0, ns] 2024-09-12T17:44:18.658 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:44:18.503+0000 7f60917fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562428 cookie 94822310317552 notifier 6950 bl.length()=1015 2024-09-12T17:44:18.658 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:44:18.503+0000 7f60917fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:18.658 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:44:18.503+0000 7f60917fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:18.658 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:44:18.503+0000 7f60917fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.658 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:44:18.503+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_sources= new_sources= 2024-09-12T17:44:18.658 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:44:18.503+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:44:18.658 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:44:18.503+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_dests= new_dests= 2024-09-12T17:44:18.658 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:44:18.503+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:44:18.658 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.0 2024-09-12T17:44:18.658 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.0 2024-09-12T17:44:18.659 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.1 2024-09-12T17:44:18.659 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.1 2024-09-12T17:44:18.659 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.2 2024-09-12T17:44:18.659 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.2 2024-09-12T17:44:18.659 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.3 2024-09-12T17:44:18.659 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.3 2024-09-12T17:44:18.659 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.4 2024-09-12T17:44:18.659 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.4 2024-09-12T17:44:18.659 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.5 2024-09-12T17:44:18.659 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.5 2024-09-12T17:44:18.659 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.6 2024-09-12T17:44:18.659 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.6 2024-09-12T17:44:18.660 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.7 2024-09-12T17:44:18.660 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.7 2024-09-12T17:44:18.660 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.8 2024-09-12T17:44:18.660 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.8 2024-09-12T17:44:18.660 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.9 2024-09-12T17:44:18.660 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.9 2024-09-12T17:44:18.660 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.10 2024-09-12T17:44:18.660 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.10 2024-09-12T17:44:18.660 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:44:18.508+0000 7f61b0abb800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.11 2024-09-12T17:44:18.660 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.11 2024-09-12T17:44:18.660 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.0 2024-09-12T17:44:18.660 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:44:18.508+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1 2024-09-12T17:44:18.660 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:44:18.509+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.2 2024-09-12T17:44:18.661 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:44:18.509+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.3 2024-09-12T17:44:18.661 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:44:18.510+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.4 2024-09-12T17:44:18.661 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:44:18.510+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.5 2024-09-12T17:44:18.661 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:44:18.511+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.6 2024-09-12T17:44:18.661 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:44:18.512+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.7 2024-09-12T17:44:18.661 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:44:18.512+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.8 2024-09-12T17:44:18.661 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:44:18.513+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.9 2024-09-12T17:44:18.661 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:44:18.513+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.10 2024-09-12T17:44:18.661 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:44:18.516+0000 7f61b0abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:18.661 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:44:18.516+0000 7f61b0abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 2024-09-12T17:44:18.661 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:44:18.518+0000 7f61b0abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:18.661 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:44:18.518+0000 7f61b0abb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:18.661 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:44:18.518+0000 7f61b0abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.662 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:44:18.518+0000 7f61b0abb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33, ofs0, ns] 2024-09-12T17:44:18.662 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:44:18.518+0000 7f6091ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562429 cookie 94822310317552 notifier 6950 bl.length()=1015 2024-09-12T17:44:18.662 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:44:18.518+0000 7f6091ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:18.662 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:44:18.518+0000 7f6091ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:18.662 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:44:18.518+0000 7f6091ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:18.662 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:44:18.518+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_sources= new_sources= 2024-09-12T17:44:18.662 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:44:18.518+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:44:18.662 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:44:18.518+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_dests= new_dests= 2024-09-12T17:44:18.662 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:44:18.518+0000 7f61b0abb800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:44:18.662 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:44:18.521+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.0 2024-09-12T17:44:18.662 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:44:18.521+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1 2024-09-12T17:44:18.662 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:44:18.522+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.2 2024-09-12T17:44:18.663 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:44:18.522+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.3 2024-09-12T17:44:18.663 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:44:18.522+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.4 2024-09-12T17:44:18.663 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:44:18.523+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.5 2024-09-12T17:44:18.663 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:44:18.524+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.6 2024-09-12T17:44:18.663 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:44:18.524+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.7 2024-09-12T17:44:18.663 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:44:18.525+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.8 2024-09-12T17:44:18.663 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:44:18.525+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.9 2024-09-12T17:44:18.663 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:44:18.525+0000 7f61b0abb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.10 2024-09-12T17:44:18.663 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:44:18.526+0000 7f61b0abb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f61b0abb800 time 2024-09-12T17:44:18.527565+0000 2024-09-12T17:44:18.663 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:44:18.663 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.663 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:18.664 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f61b3f8c71a] 2024-09-12T17:44:18.664 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f61b3f8c8d8] 2024-09-12T17:44:18.664 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563d89283841] 2024-09-12T17:44:18.664 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x563d89293827] 2024-09-12T17:44:18.664 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2024-09-12T17:44:18.664 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f61b2c29590] 2024-09-12T17:44:18.664 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2024-09-12T17:44:18.664 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2024-09-12T17:44:18.664 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.664 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:44:18.527+0000 7f61b0abb800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:44:18.664 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f61b0abb800 thread_name:radosgw-admin 2024-09-12T17:44:18.664 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.664 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:18.664 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f61b2c3e6f0] 2024-09-12T17:44:18.665 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f61b2c8b99c] 2024-09-12T17:44:18.665 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:44:18.665 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:44:18.665 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f61b3f8c774] 2024-09-12T17:44:18.665 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f61b3f8c8d8] 2024-09-12T17:44:18.665 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563d89283841] 2024-09-12T17:44:18.665 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x563d89293827] 2024-09-12T17:44:18.665 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2024-09-12T17:44:18.665 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f61b2c29590] 2024-09-12T17:44:18.665 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2024-09-12T17:44:18.665 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2024-09-12T17:44:18.665 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:44:18.665 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.666 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:44:18.666 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:44:18.666 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:44:18.666 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:44:18.666 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:44:18.666 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:44:18.666 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:44:18.666 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:44:18.666 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:44:18.666 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:44:18.666 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:44:18.666 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:44:18.666 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:44:18.666 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:44:18.667 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:44:18.667 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:44:18.667 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:44:18.667 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:44:18.667 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:44:18.667 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:44:18.667 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:44:18.667 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:44:18.667 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:44:18.667 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:44:18.667 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:44:18.667 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:44:18.668 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:44:18.668 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:44:18.668 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:44:18.668 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:44:18.668 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:44:18.668 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:44:18.668 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:44:18.668 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:44:18.668 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:44:18.668 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:44:18.668 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:44:18.668 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:44:18.668 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:44:18.668 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:44:18.669 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:44:18.669 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:44:18.669 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:44:18.669 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:44:18.669 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:44:18.669 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:44:18.669 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:44:18.669 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:44:18.669 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:44:18.669 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:44:18.669 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:44:18.669 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:44:18.669 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:44:18.669 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:44:18.670 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:44:18.670 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:44:18.670 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:44:18.670 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:44:18.670 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:44:18.670 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:44:18.670 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:44:18.670 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:44:18.670 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:44:18.670 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:44:18.670 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:44:18.670 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:44:18.670 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:44:18.671 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:44:18.671 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:44:18.671 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:44:18.671 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:44:18.671 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:44:18.671 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:44:18.671 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:44:18.671 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:44:18.671 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:44:18.671 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:44:18.671 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:44:18.671 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:44:18.671 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:44:18.671 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:44:18.672 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:44:18.672 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:44:18.672 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:44:18.672 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:44:18.672 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:44:18.672 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:44:18.672 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:44:18.672 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:44:18.672 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:44:18.672 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:44:18.672 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:44:18.672 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:44:18.672 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:44:18.672 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5fdd7fa640 / http_manager 2024-09-12T17:44:18.673 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5fdf7fe640 / http_manager 2024-09-12T17:44:18.673 INFO:tasks.workunit.client.0.smithi044.stderr: 7f6064fe1640 / rgw_dt_lg_renew 2024-09-12T17:44:18.673 INFO:tasks.workunit.client.0.smithi044.stderr: 7f607ffff640 / ms_dispatch 2024-09-12T17:44:18.673 INFO:tasks.workunit.client.0.smithi044.stderr: 7f60917fa640 / io_context_pool 2024-09-12T17:44:18.673 INFO:tasks.workunit.client.0.smithi044.stderr: 7f6091ffb640 / io_context_pool 2024-09-12T17:44:18.673 INFO:tasks.workunit.client.0.smithi044.stderr: 7f6093fff640 / ms_dispatch 2024-09-12T17:44:18.673 INFO:tasks.workunit.client.0.smithi044.stderr: 7f609ae05640 / ms_dispatch 2024-09-12T17:44:18.673 INFO:tasks.workunit.client.0.smithi044.stderr: 7f609c608640 / io_context_pool 2024-09-12T17:44:18.673 INFO:tasks.workunit.client.0.smithi044.stderr: 7f61adda4640 / msgr-worker-2 2024-09-12T17:44:18.673 INFO:tasks.workunit.client.0.smithi044.stderr: 7f61ae5a5640 / msgr-worker-1 2024-09-12T17:44:18.673 INFO:tasks.workunit.client.0.smithi044.stderr: 7f61aeda6640 / msgr-worker-0 2024-09-12T17:44:18.673 INFO:tasks.workunit.client.0.smithi044.stderr: 7f61af5a7640 / io_context_pool 2024-09-12T17:44:18.673 INFO:tasks.workunit.client.0.smithi044.stderr: 7f61b0abb800 / radosgw-admin 2024-09-12T17:44:18.674 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:44:18.674 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:44:18.674 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:44:18.528993Z_bebbc494-ea8d-4623-a208-9669fd4965ed/log 2024-09-12T17:44:18.674 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:44:18.674 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:44:18.675 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:18.675 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:18.675 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.607+0000 7fcde5575800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.608+0000 7fcde5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.608+0000 7fcde5575800 20 realm 2024-09-12T17:44:18.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.608+0000 7fcde5575800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.609+0000 7fcde5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.609+0000 7fcde5575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:18.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.609+0000 7fcde5575800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.609+0000 7fcde5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.609+0000 7fcde5575800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.610+0000 7fcde5575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:18.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.610+0000 7fcde5575800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.610+0000 7fcde5575800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:18.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.610+0000 7fcde5575800 20 searching for the correct realm 2024-09-12T17:44:18.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.613+0000 7fcde3860640 0 -- 172.21.15.44:0/3328102890 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7fcdd807b2f0 msgr2=0x7fcdd80aa560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:18.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.616+0000 7fcde305f640 0 -- 172.21.15.44:0/3328102890 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fcdd806f210 msgr2=0x7fcdd807b9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:18.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.822+0000 7fcde5575800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:18.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.822+0000 7fcde5575800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:18.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.822+0000 7fcde5575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:18.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.822+0000 7fcde5575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:18.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.822+0000 7fcde5575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:18.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.822+0000 7fcde5575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:18.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.822+0000 7fcde5575800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.822+0000 7fcde5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.822+0000 7fcde5575800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.822+0000 7fcde5575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:18.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.822+0000 7fcde5575800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.823+0000 7fcde5575800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:18.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.823+0000 7fcde5575800 20 zone default found 2024-09-12T17:44:18.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.823+0000 7fcde5575800 4 Realm: () 2024-09-12T17:44:18.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.823+0000 7fcde5575800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:18.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.823+0000 7fcde5575800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:18.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.823+0000 7fcde5575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:18.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.823+0000 7fcde5575800 20 zonegroup default 2024-09-12T17:44:18.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.823+0000 7fcde5575800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.823+0000 7fcde5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.823+0000 7fcde5575800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.823+0000 7fcde5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.823+0000 7fcde5575800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.824+0000 7fcde5575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:18.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.824+0000 7fcde5575800 20 started sync module instance, tier type = 2024-09-12T17:44:18.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.824+0000 7fcde5575800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:18.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.833+0000 7fcde5575800 20 add_watcher() i=0 2024-09-12T17:44:18.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.833+0000 7fcde5575800 20 add_watcher() i=1 2024-09-12T17:44:18.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.833+0000 7fcde5575800 20 add_watcher() i=2 2024-09-12T17:44:18.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.833+0000 7fcde5575800 20 add_watcher() i=3 2024-09-12T17:44:18.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.833+0000 7fcde5575800 20 add_watcher() i=4 2024-09-12T17:44:18.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.833+0000 7fcde5575800 20 add_watcher() i=5 2024-09-12T17:44:18.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.833+0000 7fcde5575800 20 add_watcher() i=6 2024-09-12T17:44:18.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.834+0000 7fcde5575800 20 add_watcher() i=7 2024-09-12T17:44:18.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.834+0000 7fcde5575800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:18.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.836+0000 7fcc99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:18.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.836+0000 7fcde5575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:18.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.836+0000 7fcde5575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:18.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.836+0000 7fcde5575800 5 note: GC not initialized 2024-09-12T17:44:18.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.836+0000 7fcc98fe1640 20 reqs_thread_entry: start 2024-09-12T17:44:18.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.836+0000 7fcde5575800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:18.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.837+0000 7fcde5575800 20 Filter name: none 2024-09-12T17:44:18.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.837+0000 7fcc127fc640 20 reqs_thread_entry: start 2024-09-12T17:44:18.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.837+0000 7fcde5575800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.837+0000 7fcde5575800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:18.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.837+0000 7fcde5575800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.838+0000 7fcde5575800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:44:18.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.838+0000 7fcde5575800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:18.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.838+0000 7fcde5575800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.838+0000 7fcde5575800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:18.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.838+0000 7fcde5575800 20 rados->read ofs=0 len=0 2024-09-12T17:44:18.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.838+0000 7fcde5575800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:44:18.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.839+0000 7fcde5575800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:18.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.840+0000 7fcc99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:18.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.842+0000 7fcde5575800 20 remove_watcher() i=0 2024-09-12T17:44:18.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.842+0000 7fcde5575800 2 removed watcher, disabling cache 2024-09-12T17:44:18.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.843+0000 7fcde5575800 20 remove_watcher() i=1 2024-09-12T17:44:18.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.844+0000 7fcde5575800 20 remove_watcher() i=2 2024-09-12T17:44:18.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.845+0000 7fcde5575800 20 remove_watcher() i=3 2024-09-12T17:44:18.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.847+0000 7fcde5575800 20 remove_watcher() i=4 2024-09-12T17:44:18.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.848+0000 7fcde5575800 20 remove_watcher() i=5 2024-09-12T17:44:18.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.849+0000 7fcde5575800 20 remove_watcher() i=6 2024-09-12T17:44:18.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:18.850+0000 7fcde5575800 20 remove_watcher() i=7 2024-09-12T17:44:18.862 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:18.863 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:44:18.863 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-commit-target-layout id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:44:18.863 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:48.953 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:44:48.992 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:48.992 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:49.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.036+0000 7f8392620800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.038+0000 7f8392620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.038+0000 7f8392620800 20 realm 2024-09-12T17:44:49.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.038+0000 7f8392620800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.038+0000 7f8392620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.038+0000 7f8392620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:49.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.038+0000 7f8392620800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.038+0000 7f8392620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.038+0000 7f8392620800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.039+0000 7f8392620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:49.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.039+0000 7f8392620800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.039+0000 7f8392620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:49.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.039+0000 7f8392620800 20 searching for the correct realm 2024-09-12T17:44:49.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.043+0000 7f8387909640 0 -- 172.21.15.44:0/1960125100 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55a9bec61c50 msgr2=0x55a9bec64110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:49.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.048+0000 7f839010a640 0 -- 172.21.15.44:0/1960125100 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f8378094350 msgr2=0x7f837809f160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:49.053 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.053+0000 7f8392620800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:49.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.053+0000 7f8392620800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:49.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.053+0000 7f8392620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:49.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.053+0000 7f8392620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:49.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.053+0000 7f8392620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:49.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.053+0000 7f8392620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:49.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.053+0000 7f8392620800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.053+0000 7f8392620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.053+0000 7f8392620800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.054+0000 7f8392620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:49.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.054+0000 7f8392620800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.054+0000 7f8392620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:49.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.054+0000 7f8392620800 20 zone default found 2024-09-12T17:44:49.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.054+0000 7f8392620800 4 Realm: () 2024-09-12T17:44:49.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.054+0000 7f8392620800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:49.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.054+0000 7f8392620800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:49.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.054+0000 7f8392620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:49.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.054+0000 7f8392620800 20 zonegroup default 2024-09-12T17:44:49.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.054+0000 7f8392620800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.055+0000 7f8392620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.055+0000 7f8392620800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.055+0000 7f8392620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.055+0000 7f8392620800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.055+0000 7f8392620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.055+0000 7f8392620800 20 started sync module instance, tier type = 2024-09-12T17:44:49.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.055+0000 7f8392620800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:49.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.066+0000 7f8392620800 20 add_watcher() i=0 2024-09-12T17:44:49.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.066+0000 7f8392620800 20 add_watcher() i=1 2024-09-12T17:44:49.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.066+0000 7f8392620800 20 add_watcher() i=2 2024-09-12T17:44:49.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.066+0000 7f8392620800 20 add_watcher() i=3 2024-09-12T17:44:49.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.066+0000 7f8392620800 20 add_watcher() i=4 2024-09-12T17:44:49.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.066+0000 7f8392620800 20 add_watcher() i=5 2024-09-12T17:44:49.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.066+0000 7f8392620800 20 add_watcher() i=6 2024-09-12T17:44:49.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.067+0000 7f8392620800 20 add_watcher() i=7 2024-09-12T17:44:49.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.067+0000 7f8392620800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:49.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.069+0000 7f8246fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:49.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.070+0000 7f8392620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:49.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.070+0000 7f8392620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:49.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.070+0000 7f8392620800 5 note: GC not initialized 2024-09-12T17:44:49.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.070+0000 7f8245fdb640 20 reqs_thread_entry: start 2024-09-12T17:44:49.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.070+0000 7f8392620800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:49.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.070+0000 7f8392620800 20 Filter name: none 2024-09-12T17:44:49.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.070+0000 7f81b77fe640 20 reqs_thread_entry: start 2024-09-12T17:44:49.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.070+0000 7f8392620800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:44:49.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.070+0000 7f8392620800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.071+0000 7f8392620800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:49.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.071+0000 7f8392620800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:44:49.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.071+0000 7f8392620800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:44:49.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.071+0000 7f8392620800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 : miss 2024-09-12T17:44:49.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.071+0000 7f8392620800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.071+0000 7f8392620800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:49.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.071+0000 7f8392620800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:49.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.071+0000 7f8392620800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:49.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.071+0000 7f8392620800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:49.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.071+0000 7f8392620800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:49.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.071+0000 7f8392620800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 2024-09-12T17:44:49.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.077+0000 7f8392620800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:49.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.077+0000 7f8392620800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:49.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.077+0000 7f8392620800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:49.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.077+0000 7f8392620800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33, ofs0, ns] 2024-09-12T17:44:49.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.077+0000 7f82677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562431 cookie 94187538495680 notifier 7482 bl.length()=1015 2024-09-12T17:44:49.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.077+0000 7f82677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:49.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.077+0000 7f82677fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:49.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.077+0000 7f82677fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:49.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.078+0000 7f8392620800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_sources= new_sources= 2024-09-12T17:44:49.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.078+0000 7f8392620800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:44:49.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.078+0000 7f8392620800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_dests= new_dests= 2024-09-12T17:44:49.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.078+0000 7f8392620800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:44:49.083 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.0 2024-09-12T17:44:49.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.0 2024-09-12T17:44:49.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.1 2024-09-12T17:44:49.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.1 2024-09-12T17:44:49.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.2 2024-09-12T17:44:49.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.2 2024-09-12T17:44:49.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.3 2024-09-12T17:44:49.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.3 2024-09-12T17:44:49.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.4 2024-09-12T17:44:49.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.4 2024-09-12T17:44:49.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.5 2024-09-12T17:44:49.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.5 2024-09-12T17:44:49.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.6 2024-09-12T17:44:49.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.6 2024-09-12T17:44:49.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.7 2024-09-12T17:44:49.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.7 2024-09-12T17:44:49.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.8 2024-09-12T17:44:49.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.8 2024-09-12T17:44:49.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.9 2024-09-12T17:44:49.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.9 2024-09-12T17:44:49.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.10 2024-09-12T17:44:49.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.10 2024-09-12T17:44:49.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.11 2024-09-12T17:44:49.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1.11 2024-09-12T17:44:49.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.0 2024-09-12T17:44:49.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.083+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1 2024-09-12T17:44:49.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.084+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.2 2024-09-12T17:44:49.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.084+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.3 2024-09-12T17:44:49.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.085+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.4 2024-09-12T17:44:49.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.085+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.5 2024-09-12T17:44:49.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.086+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.6 2024-09-12T17:44:49.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.086+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.7 2024-09-12T17:44:49.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.087+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.8 2024-09-12T17:44:49.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.087+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.9 2024-09-12T17:44:49.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.087+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.10 2024-09-12T17:44:49.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.091+0000 7f8392620800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:49.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.091+0000 7f8392620800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 2024-09-12T17:44:49.093 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.092+0000 7f8392620800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:49.093 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.092+0000 7f8392620800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:49.093 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.092+0000 7f8392620800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:49.093 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.092+0000 7f8392620800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33, ofs0, ns] 2024-09-12T17:44:49.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.093+0000 7f82677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562432 cookie 94187538495680 notifier 7482 bl.length()=1015 2024-09-12T17:44:49.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.093+0000 7f82677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:49.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.093+0000 7f82677fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:49.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.093+0000 7f82677fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:49.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.093+0000 7f8392620800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_sources= new_sources= 2024-09-12T17:44:49.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.093+0000 7f8392620800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:44:49.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.093+0000 7f8392620800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_dests= new_dests= 2024-09-12T17:44:49.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.093+0000 7f8392620800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:44:49.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.095+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.0 2024-09-12T17:44:49.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.096+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.1 2024-09-12T17:44:49.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.096+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.2 2024-09-12T17:44:49.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.096+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.3 2024-09-12T17:44:49.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.097+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.4 2024-09-12T17:44:49.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.097+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.5 2024-09-12T17:44:49.098 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.097+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.6 2024-09-12T17:44:49.098 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.098+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.7 2024-09-12T17:44:49.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.098+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.8 2024-09-12T17:44:49.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.099+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.9 2024-09-12T17:44:49.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.099+0000 7f8392620800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33.10 2024-09-12T17:44:49.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.099+0000 7f8392620800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:49.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.100+0000 7f8392620800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 2024-09-12T17:44:49.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.101+0000 7f8392620800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:49.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.101+0000 7f8392620800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:49.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.101+0000 7f8392620800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:49.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.101+0000 7f8392620800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33, ofs0, ns] 2024-09-12T17:44:49.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.101+0000 7f82677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562433 cookie 94187538495680 notifier 7482 bl.length()=983 2024-09-12T17:44:49.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.101+0000 7f82677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 info.flags=0x17 2024-09-12T17:44:49.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.101+0000 7f82677fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 to cache LRU end 2024-09-12T17:44:49.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.101+0000 7f82677fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:49.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.102+0000 7f8392620800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_sources= new_sources= 2024-09-12T17:44:49.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.102+0000 7f8392620800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential sources added=[] removed=[] 2024-09-12T17:44:49.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.102+0000 7f8392620800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): orig_dests= new_dests= 2024-09-12T17:44:49.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.102+0000 7f8392620800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33]): potential dests added=[] removed=[] 2024-09-12T17:44:49.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.104+0000 7f8392620800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:44:49.107 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.106+0000 7f8246fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:49.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.109+0000 7f8392620800 20 remove_watcher() i=0 2024-09-12T17:44:49.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.109+0000 7f8392620800 2 removed watcher, disabling cache 2024-09-12T17:44:49.110 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.110+0000 7f8392620800 20 remove_watcher() i=1 2024-09-12T17:44:49.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.111+0000 7f8392620800 20 remove_watcher() i=2 2024-09-12T17:44:49.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.112+0000 7f8392620800 20 remove_watcher() i=3 2024-09-12T17:44:49.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.114+0000 7f8392620800 20 remove_watcher() i=4 2024-09-12T17:44:49.115 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.115+0000 7f8392620800 20 remove_watcher() i=5 2024-09-12T17:44:49.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.116+0000 7f8392620800 20 remove_watcher() i=6 2024-09-12T17:44:49.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.117+0000 7f8392620800 20 remove_watcher() i=7 2024-09-12T17:44:49.130 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:44:49.159 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:49.159 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:49.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.198+0000 7f5542a87800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.201+0000 7f5542a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.201+0000 7f5542a87800 20 realm 2024-09-12T17:44:49.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.201+0000 7f5542a87800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.201+0000 7f5542a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.201+0000 7f5542a87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:49.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.201+0000 7f5542a87800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.201+0000 7f5542a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.201+0000 7f5542a87800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.202+0000 7f5542a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:49.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.202+0000 7f5542a87800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.203+0000 7f5542a87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:49.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.203+0000 7f5542a87800 20 searching for the correct realm 2024-09-12T17:44:49.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.204+0000 7f5540571640 0 -- 172.21.15.44:0/3815898521 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7f553806d920 msgr2=0x7f553806c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:49.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.411+0000 7f5540d72640 0 -- 172.21.15.44:0/3815898521 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f552809d040 msgr2=0x7f552807b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:49.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:49.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:49.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:49.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:49.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:49.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:49.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:49.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:49.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 20 zone default found 2024-09-12T17:44:49.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 4 Realm: () 2024-09-12T17:44:49.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:49.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:49.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:49.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 20 zonegroup default 2024-09-12T17:44:49.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.417+0000 7f5542a87800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.418+0000 7f5542a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.418+0000 7f5542a87800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.418+0000 7f5542a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.418+0000 7f5542a87800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.418+0000 7f5542a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.418+0000 7f5542a87800 20 started sync module instance, tier type = 2024-09-12T17:44:49.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.418+0000 7f5542a87800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:49.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.428+0000 7f5542a87800 20 add_watcher() i=0 2024-09-12T17:44:49.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.428+0000 7f5542a87800 20 add_watcher() i=1 2024-09-12T17:44:49.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.428+0000 7f5542a87800 20 add_watcher() i=2 2024-09-12T17:44:49.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.428+0000 7f5542a87800 20 add_watcher() i=3 2024-09-12T17:44:49.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.428+0000 7f5542a87800 20 add_watcher() i=4 2024-09-12T17:44:49.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.428+0000 7f5542a87800 20 add_watcher() i=5 2024-09-12T17:44:49.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.428+0000 7f5542a87800 20 add_watcher() i=6 2024-09-12T17:44:49.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.429+0000 7f5542a87800 20 add_watcher() i=7 2024-09-12T17:44:49.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.429+0000 7f5542a87800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:49.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.430+0000 7f53f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:49.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.431+0000 7f5542a87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:49.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.431+0000 7f5542a87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:49.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.431+0000 7f5542a87800 5 note: GC not initialized 2024-09-12T17:44:49.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.431+0000 7f53f5fdb640 20 reqs_thread_entry: start 2024-09-12T17:44:49.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.431+0000 7f5542a87800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:49.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.431+0000 7f5542a87800 20 Filter name: none 2024-09-12T17:44:49.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.431+0000 7f53637fe640 20 reqs_thread_entry: start 2024-09-12T17:44:49.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.431+0000 7f5542a87800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.432+0000 7f5542a87800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:49.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.432+0000 7f5542a87800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.432+0000 7f5542a87800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:49.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.432+0000 7f5542a87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:49.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.432+0000 7f5542a87800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.433+0000 7f5542a87800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:44:49.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.433+0000 7f5542a87800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.433+0000 7f5542a87800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:44:49.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.433+0000 7f5542a87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:49.435 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.435+0000 7f53f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:49.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.437+0000 7f5542a87800 20 remove_watcher() i=0 2024-09-12T17:44:49.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.437+0000 7f5542a87800 2 removed watcher, disabling cache 2024-09-12T17:44:49.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.439+0000 7f5542a87800 20 remove_watcher() i=1 2024-09-12T17:44:49.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.440+0000 7f5542a87800 20 remove_watcher() i=2 2024-09-12T17:44:49.442 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.441+0000 7f5542a87800 20 remove_watcher() i=3 2024-09-12T17:44:49.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.442+0000 7f5542a87800 20 remove_watcher() i=4 2024-09-12T17:44:49.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.443+0000 7f5542a87800 20 remove_watcher() i=5 2024-09-12T17:44:49.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.444+0000 7f5542a87800 20 remove_watcher() i=6 2024-09-12T17:44:49.446 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.445+0000 7f5542a87800 20 remove_watcher() i=7 2024-09-12T17:44:49.457 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:49.457 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:44:49.457 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-commit-target-layout id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:44:49.457 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:49.536 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T17:44:49.536 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:49.775 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:44:49.804 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:49.804 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:49.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.842+0000 7f57b60bb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.844+0000 7f57b60bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.844+0000 7f57b60bb800 20 realm 2024-09-12T17:44:49.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.844+0000 7f57b60bb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.844+0000 7f57b60bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.844+0000 7f57b60bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:49.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.844+0000 7f57b60bb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.844+0000 7f57b60bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.844+0000 7f57b60bb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.845+0000 7f57b60bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:49.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.845+0000 7f57b60bb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.845+0000 7f57b60bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:49.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.845+0000 7f57b60bb800 20 searching for the correct realm 2024-09-12T17:44:49.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.848+0000 7f57b33a4640 0 -- 172.21.15.44:0/862837317 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55731a8bec20 msgr2=0x55731a8c1010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:49.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.852+0000 7f57b3ba5640 0 -- 172.21.15.44:0/862837317 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f57a800d3c0 msgr2=0x7f57a800d840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:49.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.856+0000 7f57b60bb800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:49.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.856+0000 7f57b60bb800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:49.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.856+0000 7f57b60bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:49.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.856+0000 7f57b60bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:49.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.856+0000 7f57b60bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:49.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.856+0000 7f57b60bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:49.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.856+0000 7f57b60bb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.856+0000 7f57b60bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.856+0000 7f57b60bb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.856+0000 7f57b60bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.856+0000 7f57b60bb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.857+0000 7f57b60bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.857+0000 7f57b60bb800 20 zone default found 2024-09-12T17:44:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.857+0000 7f57b60bb800 4 Realm: () 2024-09-12T17:44:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.857+0000 7f57b60bb800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.857+0000 7f57b60bb800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.857+0000 7f57b60bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.857+0000 7f57b60bb800 20 zonegroup default 2024-09-12T17:44:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.857+0000 7f57b60bb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.857+0000 7f57b60bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.857+0000 7f57b60bb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.857+0000 7f57b60bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.857+0000 7f57b60bb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.858+0000 7f57b60bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.858+0000 7f57b60bb800 20 started sync module instance, tier type = 2024-09-12T17:44:49.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.858+0000 7f57b60bb800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:49.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.867+0000 7f57b60bb800 20 add_watcher() i=0 2024-09-12T17:44:49.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.867+0000 7f57b60bb800 20 add_watcher() i=1 2024-09-12T17:44:49.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.867+0000 7f57b60bb800 20 add_watcher() i=2 2024-09-12T17:44:49.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.867+0000 7f57b60bb800 20 add_watcher() i=3 2024-09-12T17:44:49.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.867+0000 7f57b60bb800 20 add_watcher() i=4 2024-09-12T17:44:49.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.867+0000 7f57b60bb800 20 add_watcher() i=5 2024-09-12T17:44:49.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.867+0000 7f57b60bb800 20 add_watcher() i=6 2024-09-12T17:44:49.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.868+0000 7f57b60bb800 20 add_watcher() i=7 2024-09-12T17:44:49.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.868+0000 7f57b60bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:49.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.870+0000 7f5669fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:49.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.871+0000 7f57b60bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:49.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.871+0000 7f57b60bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:49.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.871+0000 7f57b60bb800 5 note: GC not initialized 2024-09-12T17:44:49.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.871+0000 7f5668fe1640 20 reqs_thread_entry: start 2024-09-12T17:44:49.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.871+0000 7f57b60bb800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:49.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.871+0000 7f57b60bb800 20 Filter name: none 2024-09-12T17:44:49.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.871+0000 7f55e27fc640 20 reqs_thread_entry: start 2024-09-12T17:44:49.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.871+0000 7f57b60bb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.872+0000 7f57b60bb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:44:49.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.872+0000 7f57b60bb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.872+0000 7f57b60bb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:44:49.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.872+0000 7f57b60bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:49.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.872+0000 7f57b60bb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.872+0000 7f57b60bb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:44:49.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.872+0000 7f57b60bb800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.873+0000 7f57b60bb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:44:49.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.873+0000 7f57b60bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:49.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.875+0000 7f5669fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:49.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.877+0000 7f57b60bb800 20 remove_watcher() i=0 2024-09-12T17:44:49.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.877+0000 7f57b60bb800 2 removed watcher, disabling cache 2024-09-12T17:44:49.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.878+0000 7f57b60bb800 20 remove_watcher() i=1 2024-09-12T17:44:49.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.879+0000 7f57b60bb800 20 remove_watcher() i=2 2024-09-12T17:44:49.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.880+0000 7f57b60bb800 20 remove_watcher() i=3 2024-09-12T17:44:49.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.881+0000 7f57b60bb800 20 remove_watcher() i=4 2024-09-12T17:44:49.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.882+0000 7f57b60bb800 20 remove_watcher() i=5 2024-09-12T17:44:49.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.883+0000 7f57b60bb800 20 remove_watcher() i=6 2024-09-12T17:44:49.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.884+0000 7f57b60bb800 20 remove_watcher() i=7 2024-09-12T17:44:49.895 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:49.896 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:44:49.896 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-do-reshard id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:44:49.896 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:49.897 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T17:44:49.932 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:49.932 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:49.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.971+0000 7f4f0db25800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.973+0000 7f4f0db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.973+0000 7f4f0db25800 20 realm 2024-09-12T17:44:49.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.973+0000 7f4f0db25800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.973+0000 7f4f0db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.973+0000 7f4f0db25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:49.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.973+0000 7f4f0db25800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.974+0000 7f4f0db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:49.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.974+0000 7f4f0db25800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.974+0000 7f4f0db25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:49.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.974+0000 7f4f0db25800 20 rados->read ofs=0 len=0 2024-09-12T17:44:49.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.975+0000 7f4f0db25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:49.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.975+0000 7f4f0db25800 20 searching for the correct realm 2024-09-12T17:44:49.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:49.977+0000 7f4f097ae640 0 -- 172.21.15.44:0/550373940 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x561011944700 msgr2=0x7f4f04024410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:50.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.182+0000 7f4f09faf640 0 -- 172.21.15.44:0/550373940 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f4f000b5c20 msgr2=0x7f4f000c0270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:50.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.188+0000 7f4f0db25800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:50.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.188+0000 7f4f0db25800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:50.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.188+0000 7f4f0db25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:50.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.188+0000 7f4f0db25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:50.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.188+0000 7f4f0db25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:50.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.188+0000 7f4f0db25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:50.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.188+0000 7f4f0db25800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.189+0000 7f4f0db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.189+0000 7f4f0db25800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.189+0000 7f4f0db25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:50.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.189+0000 7f4f0db25800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.190+0000 7f4f0db25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:50.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.190+0000 7f4f0db25800 20 zone default found 2024-09-12T17:44:50.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.190+0000 7f4f0db25800 4 Realm: () 2024-09-12T17:44:50.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.190+0000 7f4f0db25800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:50.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.190+0000 7f4f0db25800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:50.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.190+0000 7f4f0db25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:50.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.190+0000 7f4f0db25800 20 zonegroup default 2024-09-12T17:44:50.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.190+0000 7f4f0db25800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.190+0000 7f4f0db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.190+0000 7f4f0db25800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.190+0000 7f4f0db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.190+0000 7f4f0db25800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.191+0000 7f4f0db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.191+0000 7f4f0db25800 20 started sync module instance, tier type = 2024-09-12T17:44:50.193 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.191+0000 7f4f0db25800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:50.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.200+0000 7f4f0db25800 20 add_watcher() i=0 2024-09-12T17:44:50.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.200+0000 7f4f0db25800 20 add_watcher() i=1 2024-09-12T17:44:50.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.200+0000 7f4f0db25800 20 add_watcher() i=2 2024-09-12T17:44:50.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.200+0000 7f4f0db25800 20 add_watcher() i=3 2024-09-12T17:44:50.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.200+0000 7f4f0db25800 20 add_watcher() i=4 2024-09-12T17:44:50.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.200+0000 7f4f0db25800 20 add_watcher() i=5 2024-09-12T17:44:50.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.200+0000 7f4f0db25800 20 add_watcher() i=6 2024-09-12T17:44:50.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.201+0000 7f4f0db25800 20 add_watcher() i=7 2024-09-12T17:44:50.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.201+0000 7f4f0db25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:50.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.203+0000 7f4dbf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:50.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.203+0000 7f4f0db25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:50.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.203+0000 7f4f0db25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:50.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.203+0000 7f4f0db25800 5 note: GC not initialized 2024-09-12T17:44:50.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.203+0000 7f4dbe7e4640 20 reqs_thread_entry: start 2024-09-12T17:44:50.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.203+0000 7f4f0db25800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:50.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.203+0000 7f4f0db25800 20 Filter name: none 2024-09-12T17:44:50.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.204+0000 7f4d2ffff640 20 reqs_thread_entry: start 2024-09-12T17:44:50.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.204+0000 7f4f0db25800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:44:50.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.204+0000 7f4f0db25800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.204+0000 7f4f0db25800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:44:50.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.204+0000 7f4f0db25800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:44:50.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.204+0000 7f4f0db25800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:44:50.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.204+0000 7f4f0db25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 : miss 2024-09-12T17:44:50.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.204+0000 7f4f0db25800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.204+0000 7f4f0db25800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:44:50.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.204+0000 7f4f0db25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 info.flags=0x17 2024-09-12T17:44:50.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.204+0000 7f4f0db25800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 to cache LRU end 2024-09-12T17:44:50.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.204+0000 7f4f0db25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:50.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.204+0000 7f4f0db25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:50.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.204+0000 7f4f0db25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 2024-09-12T17:44:50.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.210+0000 7f4f0db25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 info.flags=0x17 2024-09-12T17:44:50.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.210+0000 7f4f0db25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 to cache LRU end 2024-09-12T17:44:50.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.210+0000 7f4f0db25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:50.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.210+0000 7f4f0db25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34, ofs0, ns] 2024-09-12T17:44:50.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.210+0000 7f4decff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562442 cookie 94627016779328 notifier 7539 bl.length()=995 2024-09-12T17:44:50.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.210+0000 7f4decff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 info.flags=0x17 2024-09-12T17:44:50.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.210+0000 7f4decff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 to cache LRU end 2024-09-12T17:44:50.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.210+0000 7f4decff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:50.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.210+0000 7f4f0db25800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): orig_sources= new_sources= 2024-09-12T17:44:50.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.210+0000 7f4f0db25800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): potential sources added=[] removed=[] 2024-09-12T17:44:50.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.210+0000 7f4f0db25800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): orig_dests= new_dests= 2024-09-12T17:44:50.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.210+0000 7f4f0db25800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): potential dests added=[] removed=[] 2024-09-12T17:44:50.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.216+0000 7f4f0db25800 -1 Injecting error=-5 at location=do_reshard 2024-09-12T17:44:50.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.223+0000 7f4f0db25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:50.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.223+0000 7f4f0db25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 2024-09-12T17:44:50.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.224+0000 7f4f0db25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 info.flags=0x17 2024-09-12T17:44:50.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.224+0000 7f4f0db25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 to cache LRU end 2024-09-12T17:44:50.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.224+0000 7f4f0db25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:50.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.224+0000 7f4f0db25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34, ofs0, ns] 2024-09-12T17:44:50.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.225+0000 7f4ddbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562443 cookie 94627016779328 notifier 7539 bl.length()=963 2024-09-12T17:44:50.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.225+0000 7f4ddbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 info.flags=0x17 2024-09-12T17:44:50.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.225+0000 7f4ddbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 to cache LRU end 2024-09-12T17:44:50.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.225+0000 7f4ddbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:50.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.225+0000 7f4f0db25800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): orig_sources= new_sources= 2024-09-12T17:44:50.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.225+0000 7f4f0db25800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): potential sources added=[] removed=[] 2024-09-12T17:44:50.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.225+0000 7f4f0db25800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): orig_dests= new_dests= 2024-09-12T17:44:50.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.225+0000 7f4f0db25800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): potential dests added=[] removed=[] 2024-09-12T17:44:50.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.225+0000 7f4f0db25800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T17:44:50.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.227+0000 7f4dbf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:50.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.229+0000 7f4f0db25800 20 remove_watcher() i=0 2024-09-12T17:44:50.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.229+0000 7f4f0db25800 2 removed watcher, disabling cache 2024-09-12T17:44:50.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.230+0000 7f4f0db25800 20 remove_watcher() i=1 2024-09-12T17:44:50.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.231+0000 7f4f0db25800 20 remove_watcher() i=2 2024-09-12T17:44:50.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.232+0000 7f4f0db25800 20 remove_watcher() i=3 2024-09-12T17:44:50.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.233+0000 7f4f0db25800 20 remove_watcher() i=4 2024-09-12T17:44:50.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.234+0000 7f4f0db25800 20 remove_watcher() i=5 2024-09-12T17:44:50.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.235+0000 7f4f0db25800 20 remove_watcher() i=6 2024-09-12T17:44:50.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.236+0000 7f4f0db25800 20 remove_watcher() i=7 2024-09-12T17:44:50.250 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:44:50.279 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:50.279 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:50.319 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.317+0000 7f63d293e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.319+0000 7f63d293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.319+0000 7f63d293e800 20 realm 2024-09-12T17:44:50.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.319+0000 7f63d293e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.319+0000 7f63d293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.319+0000 7f63d293e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:50.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.319+0000 7f63d293e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.319+0000 7f63d293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.319+0000 7f63d293e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.320+0000 7f63d293e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:50.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.320+0000 7f63d293e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.320+0000 7f63d293e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:50.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.321+0000 7f63d293e800 20 searching for the correct realm 2024-09-12T17:44:50.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.322+0000 7f63ce6c0640 0 -- 172.21.15.44:0/626080848 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x559e1a0a3450 msgr2=0x7f63c802b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:50.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.527+0000 7f63ceec1640 0 -- 172.21.15.44:0/626080848 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f63b80030f0 msgr2=0x7f63c40023d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:50.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.533+0000 7f63d293e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:50.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.533+0000 7f63d293e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:50.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.533+0000 7f63d293e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:50.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.533+0000 7f63d293e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:50.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.533+0000 7f63d293e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:50.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.533+0000 7f63d293e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:50.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.533+0000 7f63d293e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.533+0000 7f63d293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.533+0000 7f63d293e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.534+0000 7f63d293e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:50.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.534+0000 7f63d293e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.534+0000 7f63d293e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:50.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.534+0000 7f63d293e800 20 zone default found 2024-09-12T17:44:50.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.534+0000 7f63d293e800 4 Realm: () 2024-09-12T17:44:50.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.534+0000 7f63d293e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:50.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.534+0000 7f63d293e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:50.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.534+0000 7f63d293e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:50.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.534+0000 7f63d293e800 20 zonegroup default 2024-09-12T17:44:50.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.534+0000 7f63d293e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.534+0000 7f63d293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.534+0000 7f63d293e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.535+0000 7f63d293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.535+0000 7f63d293e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.535+0000 7f63d293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.535+0000 7f63d293e800 20 started sync module instance, tier type = 2024-09-12T17:44:50.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.535+0000 7f63d293e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:50.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.544+0000 7f63d293e800 20 add_watcher() i=0 2024-09-12T17:44:50.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.544+0000 7f63d293e800 20 add_watcher() i=1 2024-09-12T17:44:50.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.544+0000 7f63d293e800 20 add_watcher() i=2 2024-09-12T17:44:50.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.544+0000 7f63d293e800 20 add_watcher() i=3 2024-09-12T17:44:50.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.544+0000 7f63d293e800 20 add_watcher() i=4 2024-09-12T17:44:50.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.544+0000 7f63d293e800 20 add_watcher() i=5 2024-09-12T17:44:50.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.544+0000 7f63d293e800 20 add_watcher() i=6 2024-09-12T17:44:50.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.545+0000 7f63d293e800 20 add_watcher() i=7 2024-09-12T17:44:50.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.545+0000 7f63d293e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:50.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.547+0000 7f6284fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:50.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.547+0000 7f63d293e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:50.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.547+0000 7f63d293e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:50.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.548+0000 7f63d293e800 5 note: GC not initialized 2024-09-12T17:44:50.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.548+0000 7f61ff7fe640 20 reqs_thread_entry: start 2024-09-12T17:44:50.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.548+0000 7f63d293e800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:50.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.548+0000 7f63d293e800 20 Filter name: none 2024-09-12T17:44:50.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.548+0000 7f61fd7fa640 20 reqs_thread_entry: start 2024-09-12T17:44:50.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.548+0000 7f63d293e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.548+0000 7f63d293e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:44:50.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.548+0000 7f63d293e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.549+0000 7f63d293e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:44:50.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.549+0000 7f63d293e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:50.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.549+0000 7f63d293e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.549+0000 7f63d293e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:44:50.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.549+0000 7f63d293e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.550+0000 7f63d293e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:44:50.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.550+0000 7f63d293e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:50.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.552+0000 7f6284fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:50.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.554+0000 7f63d293e800 20 remove_watcher() i=0 2024-09-12T17:44:50.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.554+0000 7f63d293e800 2 removed watcher, disabling cache 2024-09-12T17:44:50.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.555+0000 7f63d293e800 20 remove_watcher() i=1 2024-09-12T17:44:50.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.557+0000 7f63d293e800 20 remove_watcher() i=2 2024-09-12T17:44:50.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.558+0000 7f63d293e800 20 remove_watcher() i=3 2024-09-12T17:44:50.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.559+0000 7f63d293e800 20 remove_watcher() i=4 2024-09-12T17:44:50.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.560+0000 7f63d293e800 20 remove_watcher() i=5 2024-09-12T17:44:50.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.561+0000 7f63d293e800 20 remove_watcher() i=6 2024-09-12T17:44:50.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.562+0000 7f63d293e800 20 remove_watcher() i=7 2024-09-12T17:44:50.574 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:50.574 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:44:50.574 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-do-reshard id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:44:50.574 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:50.630 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:44:50.662 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:50.662 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:50.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.700+0000 7f0d6df23800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.701+0000 7f0d6df23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.701+0000 7f0d6df23800 20 realm 2024-09-12T17:44:50.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.701+0000 7f0d6df23800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.701+0000 7f0d6df23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.701+0000 7f0d6df23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:50.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.701+0000 7f0d6df23800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.701+0000 7f0d6df23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.701+0000 7f0d6df23800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.702+0000 7f0d6df23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:50.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.702+0000 7f0d6df23800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.703+0000 7f0d6df23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:50.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.703+0000 7f0d6df23800 20 searching for the correct realm 2024-09-12T17:44:50.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.706+0000 7f0d6940b640 0 -- 172.21.15.44:0/1480524111 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x556f06dafc10 msgr2=0x556f06db20d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:50.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.709+0000 7f0d69c0c640 0 -- 172.21.15.44:0/1480524111 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f0d60061910 msgr2=0x7f0d60081430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:50.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.713+0000 7f0d6df23800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:50.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.713+0000 7f0d6df23800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:50.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.713+0000 7f0d6df23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:50.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.713+0000 7f0d6df23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:50.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.713+0000 7f0d6df23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:50.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.713+0000 7f0d6df23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:50.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.713+0000 7f0d6df23800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.713+0000 7f0d6df23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.713+0000 7f0d6df23800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.714+0000 7f0d6df23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:50.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.714+0000 7f0d6df23800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.714+0000 7f0d6df23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:50.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.714+0000 7f0d6df23800 20 zone default found 2024-09-12T17:44:50.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.714+0000 7f0d6df23800 4 Realm: () 2024-09-12T17:44:50.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.714+0000 7f0d6df23800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:50.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.714+0000 7f0d6df23800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:50.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.714+0000 7f0d6df23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:50.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.714+0000 7f0d6df23800 20 zonegroup default 2024-09-12T17:44:50.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.714+0000 7f0d6df23800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.714+0000 7f0d6df23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.714+0000 7f0d6df23800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.715+0000 7f0d6df23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.715+0000 7f0d6df23800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.715+0000 7f0d6df23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.715+0000 7f0d6df23800 20 started sync module instance, tier type = 2024-09-12T17:44:50.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.715+0000 7f0d6df23800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:50.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.724+0000 7f0d6df23800 20 add_watcher() i=0 2024-09-12T17:44:50.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.724+0000 7f0d6df23800 20 add_watcher() i=1 2024-09-12T17:44:50.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.724+0000 7f0d6df23800 20 add_watcher() i=2 2024-09-12T17:44:50.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.724+0000 7f0d6df23800 20 add_watcher() i=3 2024-09-12T17:44:50.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.724+0000 7f0d6df23800 20 add_watcher() i=4 2024-09-12T17:44:50.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.724+0000 7f0d6df23800 20 add_watcher() i=5 2024-09-12T17:44:50.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.724+0000 7f0d6df23800 20 add_watcher() i=6 2024-09-12T17:44:50.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.726+0000 7f0d6df23800 20 add_watcher() i=7 2024-09-12T17:44:50.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.726+0000 7f0d6df23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:50.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.728+0000 7f0c1b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:50.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.728+0000 7f0d6df23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:50.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.728+0000 7f0d6df23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:50.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.728+0000 7f0d6df23800 5 note: GC not initialized 2024-09-12T17:44:50.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.728+0000 7f0c1a7fc640 20 reqs_thread_entry: start 2024-09-12T17:44:50.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.728+0000 7f0d6df23800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:50.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.728+0000 7f0d6df23800 20 Filter name: none 2024-09-12T17:44:50.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.728+0000 7f0b8bfff640 20 reqs_thread_entry: start 2024-09-12T17:44:50.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.729+0000 7f0d6df23800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:44:50.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.729+0000 7f0d6df23800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.729+0000 7f0d6df23800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:44:50.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.729+0000 7f0d6df23800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:44:50.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.729+0000 7f0d6df23800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:44:50.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.729+0000 7f0d6df23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 : miss 2024-09-12T17:44:50.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.729+0000 7f0d6df23800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.729+0000 7f0d6df23800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:44:50.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.729+0000 7f0d6df23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 info.flags=0x17 2024-09-12T17:44:50.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.729+0000 7f0d6df23800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 to cache LRU end 2024-09-12T17:44:50.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.729+0000 7f0d6df23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:50.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.729+0000 7f0d6df23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:50.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.729+0000 7f0d6df23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 2024-09-12T17:44:50.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.734+0000 7f0d6df23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 info.flags=0x17 2024-09-12T17:44:50.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.734+0000 7f0d6df23800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 to cache LRU end 2024-09-12T17:44:50.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.734+0000 7f0d6df23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:50.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.734+0000 7f0d6df23800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34, ofs0, ns] 2024-09-12T17:44:50.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.734+0000 7f0c4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562444 cookie 93935344770336 notifier 7575 bl.length()=995 2024-09-12T17:44:50.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.734+0000 7f0c4cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 info.flags=0x17 2024-09-12T17:44:50.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.734+0000 7f0c4cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 to cache LRU end 2024-09-12T17:44:50.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.734+0000 7f0c4cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:50.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.735+0000 7f0d6df23800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): orig_sources= new_sources= 2024-09-12T17:44:50.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.735+0000 7f0d6df23800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): potential sources added=[] removed=[] 2024-09-12T17:44:50.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.735+0000 7f0d6df23800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): orig_dests= new_dests= 2024-09-12T17:44:50.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.735+0000 7f0d6df23800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): potential dests added=[] removed=[] 2024-09-12T17:44:50.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.0 2024-09-12T17:44:50.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.0 2024-09-12T17:44:50.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.1 2024-09-12T17:44:50.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.1 2024-09-12T17:44:50.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.2 2024-09-12T17:44:50.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.2 2024-09-12T17:44:50.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.3 2024-09-12T17:44:50.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.3 2024-09-12T17:44:50.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.4 2024-09-12T17:44:50.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.4 2024-09-12T17:44:50.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.5 2024-09-12T17:44:50.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.5 2024-09-12T17:44:50.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.6 2024-09-12T17:44:50.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.6 2024-09-12T17:44:50.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.7 2024-09-12T17:44:50.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.7 2024-09-12T17:44:50.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.8 2024-09-12T17:44:50.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.8 2024-09-12T17:44:50.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.9 2024-09-12T17:44:50.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.9 2024-09-12T17:44:50.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.10 2024-09-12T17:44:50.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.10 2024-09-12T17:44:50.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.11 2024-09-12T17:44:50.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1.11 2024-09-12T17:44:50.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.740+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.0 2024-09-12T17:44:50.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.741+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1 2024-09-12T17:44:50.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.741+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.2 2024-09-12T17:44:50.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.741+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.3 2024-09-12T17:44:50.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.742+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.4 2024-09-12T17:44:50.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.743+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.5 2024-09-12T17:44:50.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.743+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.6 2024-09-12T17:44:50.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.743+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.7 2024-09-12T17:44:50.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.744+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.8 2024-09-12T17:44:50.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.745+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.9 2024-09-12T17:44:50.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.746+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.10 2024-09-12T17:44:50.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.749+0000 7f0d6df23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:50.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.749+0000 7f0d6df23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 2024-09-12T17:44:50.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.750+0000 7f0d6df23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 info.flags=0x17 2024-09-12T17:44:50.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.750+0000 7f0d6df23800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 to cache LRU end 2024-09-12T17:44:50.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.750+0000 7f0d6df23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:50.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.750+0000 7f0d6df23800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34, ofs0, ns] 2024-09-12T17:44:50.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.750+0000 7f0c4d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562445 cookie 93935344770336 notifier 7575 bl.length()=995 2024-09-12T17:44:50.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.750+0000 7f0c4d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 info.flags=0x17 2024-09-12T17:44:50.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.750+0000 7f0c4d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 to cache LRU end 2024-09-12T17:44:50.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.750+0000 7f0c4d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:50.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.750+0000 7f0d6df23800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): orig_sources= new_sources= 2024-09-12T17:44:50.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.750+0000 7f0d6df23800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): potential sources added=[] removed=[] 2024-09-12T17:44:50.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.750+0000 7f0d6df23800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): orig_dests= new_dests= 2024-09-12T17:44:50.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.750+0000 7f0d6df23800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): potential dests added=[] removed=[] 2024-09-12T17:44:50.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.754+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.0 2024-09-12T17:44:50.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.754+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.1 2024-09-12T17:44:50.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.754+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.2 2024-09-12T17:44:50.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.754+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.3 2024-09-12T17:44:50.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.755+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.4 2024-09-12T17:44:50.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.755+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.5 2024-09-12T17:44:50.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.755+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.6 2024-09-12T17:44:50.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.756+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.7 2024-09-12T17:44:50.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.756+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.8 2024-09-12T17:44:50.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.756+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.9 2024-09-12T17:44:50.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.756+0000 7f0d6df23800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34.10 2024-09-12T17:44:50.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.757+0000 7f0d6df23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:44:50.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.757+0000 7f0d6df23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 2024-09-12T17:44:50.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.758+0000 7f0d6df23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 info.flags=0x17 2024-09-12T17:44:50.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.758+0000 7f0d6df23800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 to cache LRU end 2024-09-12T17:44:50.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.758+0000 7f0d6df23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:50.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.758+0000 7f0d6df23800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34, ofs0, ns] 2024-09-12T17:44:50.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.758+0000 7f0c4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562446 cookie 93935344770336 notifier 7575 bl.length()=963 2024-09-12T17:44:50.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.758+0000 7f0c4cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 info.flags=0x17 2024-09-12T17:44:50.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.758+0000 7f0c4cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 to cache LRU end 2024-09-12T17:44:50.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.758+0000 7f0c4cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:50.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.759+0000 7f0d6df23800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): orig_sources= new_sources= 2024-09-12T17:44:50.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.759+0000 7f0d6df23800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): potential sources added=[] removed=[] 2024-09-12T17:44:50.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.759+0000 7f0d6df23800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): orig_dests= new_dests= 2024-09-12T17:44:50.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.759+0000 7f0d6df23800 20 handle_bi_update(): bucket=:error-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34]): potential dests added=[] removed=[] 2024-09-12T17:44:50.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.762+0000 7f0d6df23800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T17:44:50.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.764+0000 7f0c1b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:50.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.767+0000 7f0d6df23800 20 remove_watcher() i=0 2024-09-12T17:44:50.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.767+0000 7f0d6df23800 2 removed watcher, disabling cache 2024-09-12T17:44:50.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.768+0000 7f0d6df23800 20 remove_watcher() i=1 2024-09-12T17:44:50.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.769+0000 7f0d6df23800 20 remove_watcher() i=2 2024-09-12T17:44:50.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.770+0000 7f0d6df23800 20 remove_watcher() i=3 2024-09-12T17:44:50.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.772+0000 7f0d6df23800 20 remove_watcher() i=4 2024-09-12T17:44:50.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.774+0000 7f0d6df23800 20 remove_watcher() i=5 2024-09-12T17:44:50.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.775+0000 7f0d6df23800 20 remove_watcher() i=6 2024-09-12T17:44:50.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.776+0000 7f0d6df23800 20 remove_watcher() i=7 2024-09-12T17:44:50.790 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:44:50.819 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:50.819 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:50.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.856+0000 7f0433e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.858+0000 7f0433e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.858+0000 7f0433e2f800 20 realm 2024-09-12T17:44:50.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.858+0000 7f0433e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.858+0000 7f0433e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.858+0000 7f0433e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:50.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.858+0000 7f0433e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.859+0000 7f0433e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.859+0000 7f0433e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.860+0000 7f0433e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:50.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.860+0000 7f0433e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.860+0000 7f0433e2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:50.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.860+0000 7f0433e2f800 20 searching for the correct realm 2024-09-12T17:44:50.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.863+0000 7f0431118640 0 -- 172.21.15.44:0/2730247047 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f042406b020 msgr2=0x7f04240baa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:50.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:50.867+0000 7f0431919640 0 -- 172.21.15.44:0/2730247047 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f0428026040 msgr2=0x7f042805da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:51.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.073+0000 7f0433e2f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:51.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.073+0000 7f0433e2f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:51.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.073+0000 7f0433e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:51.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.073+0000 7f0433e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:51.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.073+0000 7f0433e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:51.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.073+0000 7f0433e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:51.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.073+0000 7f0433e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.073+0000 7f0433e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:51.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.073+0000 7f0433e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.074+0000 7f0433e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:51.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.074+0000 7f0433e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.074+0000 7f0433e2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:51.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.074+0000 7f0433e2f800 20 zone default found 2024-09-12T17:44:51.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.074+0000 7f0433e2f800 4 Realm: () 2024-09-12T17:44:51.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.074+0000 7f0433e2f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:51.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.074+0000 7f0433e2f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:51.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.074+0000 7f0433e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:51.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.074+0000 7f0433e2f800 20 zonegroup default 2024-09-12T17:44:51.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.074+0000 7f0433e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.074+0000 7f0433e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:51.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.074+0000 7f0433e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.075+0000 7f0433e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:51.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.075+0000 7f0433e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.075+0000 7f0433e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:51.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.075+0000 7f0433e2f800 20 started sync module instance, tier type = 2024-09-12T17:44:51.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.075+0000 7f0433e2f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:51.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.086+0000 7f0433e2f800 20 add_watcher() i=0 2024-09-12T17:44:51.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.086+0000 7f0433e2f800 20 add_watcher() i=1 2024-09-12T17:44:51.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.086+0000 7f0433e2f800 20 add_watcher() i=2 2024-09-12T17:44:51.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.086+0000 7f0433e2f800 20 add_watcher() i=3 2024-09-12T17:44:51.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.086+0000 7f0433e2f800 20 add_watcher() i=4 2024-09-12T17:44:51.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.086+0000 7f0433e2f800 20 add_watcher() i=5 2024-09-12T17:44:51.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.086+0000 7f0433e2f800 20 add_watcher() i=6 2024-09-12T17:44:51.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.087+0000 7f0433e2f800 20 add_watcher() i=7 2024-09-12T17:44:51.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.087+0000 7f0433e2f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:51.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.088+0000 7f02e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:51.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.089+0000 7f0433e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:51.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.089+0000 7f0433e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:51.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.089+0000 7f0433e2f800 5 note: GC not initialized 2024-09-12T17:44:51.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.089+0000 7f02e27fc640 20 reqs_thread_entry: start 2024-09-12T17:44:51.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.089+0000 7f0433e2f800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:51.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.089+0000 7f0433e2f800 20 Filter name: none 2024-09-12T17:44:51.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.089+0000 7f0253fff640 20 reqs_thread_entry: start 2024-09-12T17:44:51.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.089+0000 7f0433e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.090+0000 7f0433e2f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:44:51.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.090+0000 7f0433e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.090+0000 7f0433e2f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:44:51.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.090+0000 7f0433e2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:51.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.090+0000 7f0433e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.090+0000 7f0433e2f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:44:51.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.090+0000 7f0433e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.093 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.091+0000 7f0433e2f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:44:51.093 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.091+0000 7f0433e2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:51.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.093+0000 7f02e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:51.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.095+0000 7f0433e2f800 20 remove_watcher() i=0 2024-09-12T17:44:51.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.095+0000 7f0433e2f800 2 removed watcher, disabling cache 2024-09-12T17:44:51.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.097+0000 7f0433e2f800 20 remove_watcher() i=1 2024-09-12T17:44:51.101 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.099+0000 7f0433e2f800 20 remove_watcher() i=2 2024-09-12T17:44:51.102 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.100+0000 7f0433e2f800 20 remove_watcher() i=3 2024-09-12T17:44:51.103 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.101+0000 7f0433e2f800 20 remove_watcher() i=4 2024-09-12T17:44:51.104 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.103+0000 7f0433e2f800 20 remove_watcher() i=5 2024-09-12T17:44:51.105 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.104+0000 7f0433e2f800 20 remove_watcher() i=6 2024-09-12T17:44:51.106 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.105+0000 7f0433e2f800 20 remove_watcher() i=7 2024-09-12T17:44:51.118 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:51.118 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:44:51.118 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-do-reshard id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:44:51.118 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:51.194 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T17:44:51.194 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:51.398 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:44:51.427 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:51.427 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:51.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.464+0000 7f949132d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.467 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.466+0000 7f949132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:51.467 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.466+0000 7f949132d800 20 realm 2024-09-12T17:44:51.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.466+0000 7f949132d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.466+0000 7f949132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:51.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.466+0000 7f949132d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:51.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.466+0000 7f949132d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.466+0000 7f949132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:51.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.466+0000 7f949132d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.467+0000 7f949132d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:51.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.467+0000 7f949132d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.467+0000 7f949132d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:51.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.467+0000 7f949132d800 20 searching for the correct realm 2024-09-12T17:44:51.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.470+0000 7f948c875640 0 -- 172.21.15.44:0/3874283495 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f9480083b30 msgr2=0x7f94800033d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:51.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.676+0000 7f948d076640 0 -- 172.21.15.44:0/3874283495 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f9484066450 msgr2=0x7f94840668d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:51.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.883+0000 7f949132d800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:51.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.883+0000 7f949132d800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:51.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.883+0000 7f949132d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:51.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.883+0000 7f949132d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:51.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.883+0000 7f949132d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:51.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.883+0000 7f949132d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:51.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.883+0000 7f949132d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.883+0000 7f949132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:51.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.883+0000 7f949132d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.883+0000 7f949132d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:51.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.883+0000 7f949132d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.884+0000 7f949132d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:51.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.884+0000 7f949132d800 20 zone default found 2024-09-12T17:44:51.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.884+0000 7f949132d800 4 Realm: () 2024-09-12T17:44:51.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.884+0000 7f949132d800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:51.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.884+0000 7f949132d800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:51.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.884+0000 7f949132d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:51.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.884+0000 7f949132d800 20 zonegroup default 2024-09-12T17:44:51.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.884+0000 7f949132d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.884+0000 7f949132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:51.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.884+0000 7f949132d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.885+0000 7f949132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:51.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.885+0000 7f949132d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.885+0000 7f949132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:51.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.885+0000 7f949132d800 20 started sync module instance, tier type = 2024-09-12T17:44:51.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.885+0000 7f949132d800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:51.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.895+0000 7f949132d800 20 add_watcher() i=0 2024-09-12T17:44:51.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.895+0000 7f949132d800 20 add_watcher() i=1 2024-09-12T17:44:51.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.895+0000 7f949132d800 20 add_watcher() i=2 2024-09-12T17:44:51.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.895+0000 7f949132d800 20 add_watcher() i=3 2024-09-12T17:44:51.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.895+0000 7f949132d800 20 add_watcher() i=4 2024-09-12T17:44:51.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.895+0000 7f949132d800 20 add_watcher() i=5 2024-09-12T17:44:51.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.895+0000 7f949132d800 20 add_watcher() i=6 2024-09-12T17:44:51.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.896+0000 7f949132d800 20 add_watcher() i=7 2024-09-12T17:44:51.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.896+0000 7f949132d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:51.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.898+0000 7f93437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:51.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.899+0000 7f949132d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:51.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.899+0000 7f949132d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:51.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.899+0000 7f949132d800 5 note: GC not initialized 2024-09-12T17:44:51.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.899+0000 7f93427e4640 20 reqs_thread_entry: start 2024-09-12T17:44:51.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.899+0000 7f949132d800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:51.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.899+0000 7f949132d800 20 Filter name: none 2024-09-12T17:44:51.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.899+0000 7f92b3fff640 20 reqs_thread_entry: start 2024-09-12T17:44:51.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.899+0000 7f949132d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.900+0000 7f949132d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:44:51.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.900+0000 7f949132d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.901+0000 7f949132d800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:44:51.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.901+0000 7f949132d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:51.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.901+0000 7f949132d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.901+0000 7f949132d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:44:51.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.901+0000 7f949132d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:51.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.901+0000 7f949132d800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:44:51.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.901+0000 7f949132d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:51.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.903+0000 7f93437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:51.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.905+0000 7f949132d800 20 remove_watcher() i=0 2024-09-12T17:44:51.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.905+0000 7f949132d800 2 removed watcher, disabling cache 2024-09-12T17:44:51.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.907+0000 7f949132d800 20 remove_watcher() i=1 2024-09-12T17:44:51.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.908+0000 7f949132d800 20 remove_watcher() i=2 2024-09-12T17:44:51.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.909+0000 7f949132d800 20 remove_watcher() i=3 2024-09-12T17:44:51.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.910+0000 7f949132d800 20 remove_watcher() i=4 2024-09-12T17:44:51.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.911+0000 7f949132d800 20 remove_watcher() i=5 2024-09-12T17:44:51.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.912+0000 7f949132d800 20 remove_watcher() i=6 2024-09-12T17:44:51.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:51.913+0000 7f949132d800 20 remove_watcher() i=7 2024-09-12T17:44:51.927 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:51.927 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:44:51.927 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-do-reshard id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:44:51.927 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:51.929 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:44:51.964 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:51.964 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:52.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.002+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.004+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.004+0000 7f58dc7a9800 20 realm 2024-09-12T17:44:52.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.004+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.004+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.004+0000 7f58dc7a9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:52.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.004+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.005+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.005+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.005+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:52.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.005+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.006+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:52.008 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.006+0000 7f58dc7a9800 20 searching for the correct realm 2024-09-12T17:44:52.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.010+0000 7f58daa94640 0 -- 172.21.15.44:0/1731959580 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f58d008f040 msgr2=0x7f58d008f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:52.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.013+0000 7f58da293640 0 -- 172.21.15.44:0/1731959580 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f58d00a3920 msgr2=0x7f58d00823f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:52.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:52.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:52.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:52.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:52.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:52.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:52.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:52.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:52.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 zone default found 2024-09-12T17:44:52.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.222+0000 7f58dc7a9800 4 Realm: () 2024-09-12T17:44:52.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.222+0000 7f58dc7a9800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:52.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.222+0000 7f58dc7a9800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:52.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.222+0000 7f58dc7a9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:52.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 zonegroup default 2024-09-12T17:44:52.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.223+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.223+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.223+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.223+0000 7f58dc7a9800 20 started sync module instance, tier type = 2024-09-12T17:44:52.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.223+0000 7f58dc7a9800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:52.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=0 2024-09-12T17:44:52.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=1 2024-09-12T17:44:52.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=2 2024-09-12T17:44:52.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=3 2024-09-12T17:44:52.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=4 2024-09-12T17:44:52.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=5 2024-09-12T17:44:52.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=6 2024-09-12T17:44:52.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.233+0000 7f58dc7a9800 20 add_watcher() i=7 2024-09-12T17:44:52.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.233+0000 7f58dc7a9800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:52.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.235+0000 7f5790fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:52.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.235+0000 7f58dc7a9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:52.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.235+0000 7f58dc7a9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:52.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 note: GC not initialized 2024-09-12T17:44:52.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.235+0000 7f570b7fe640 20 reqs_thread_entry: start 2024-09-12T17:44:52.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.235+0000 7f58dc7a9800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:52.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.235+0000 7f58dc7a9800 20 Filter name: none 2024-09-12T17:44:52.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.235+0000 7f57097fa640 20 reqs_thread_entry: start 2024-09-12T17:44:52.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.236+0000 7f58dc7a9800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:44:52.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.236+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.236+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:44:52.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.236+0000 7f58dc7a9800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:44:52.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.236+0000 7f58dc7a9800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:44:52.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.236+0000 7f58dc7a9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 : miss 2024-09-12T17:44:52.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.236+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.237+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:44:52.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.237+0000 7f58dc7a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:44:52.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.237+0000 7f58dc7a9800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:44:52.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.237+0000 7f58dc7a9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:52.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.237+0000 7f58dc7a9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:52.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.237+0000 7f58dc7a9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 2024-09-12T17:44:52.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.242+0000 7f58dc7a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:44:52.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.242+0000 7f58dc7a9800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:44:52.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.242+0000 7f58dc7a9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:52.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.242+0000 7f58dc7a9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35, ofs0, ns] 2024-09-12T17:44:52.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.242+0000 7f57bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562438 cookie 94736040483104 notifier 7632 bl.length()=995 2024-09-12T17:44:52.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.242+0000 7f57bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:44:52.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.242+0000 7f57bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:44:52.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.242+0000 7f57bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:52.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.242+0000 7f58dc7a9800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): orig_sources= new_sources= 2024-09-12T17:44:52.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.242+0000 7f58dc7a9800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): potential sources added=[] removed=[] 2024-09-12T17:44:52.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.242+0000 7f58dc7a9800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): orig_dests= new_dests= 2024-09-12T17:44:52.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.242+0000 7f58dc7a9800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): potential dests added=[] removed=[] 2024-09-12T17:44:52.248 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f58dc7a9800 time 2024-09-12T17:44:52.248860+0000 2024-09-12T17:44:52.249 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:44:52.249 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:52.250 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f58dfd8c71a] 2024-09-12T17:44:52.250 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f58dfd8c8d8] 2024-09-12T17:44:52.250 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562971769841] 2024-09-12T17:44:52.250 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56297177957a] 2024-09-12T17:44:52.250 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2024-09-12T17:44:52.250 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f58dea29590] 2024-09-12T17:44:52.251 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2024-09-12T17:44:52.251 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2024-09-12T17:44:52.251 INFO:tasks.workunit.client.0.smithi044.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:44:52.251 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f58dc7a9800 thread_name:radosgw-admin 2024-09-12T17:44:52.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.248+0000 7f58dc7a9800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f58dc7a9800 time 2024-09-12T17:44:52.248860+0000 2024-09-12T17:44:52.251 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:44:52.252 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.252 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:52.252 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f58dfd8c71a] 2024-09-12T17:44:52.252 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f58dfd8c8d8] 2024-09-12T17:44:52.252 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562971769841] 2024-09-12T17:44:52.252 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56297177957a] 2024-09-12T17:44:52.252 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2024-09-12T17:44:52.252 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f58dea29590] 2024-09-12T17:44:52.252 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2024-09-12T17:44:52.253 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2024-09-12T17:44:52.253 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.269 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:52.269 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f58dea3e6f0] 2024-09-12T17:44:52.269 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f58dea8b99c] 2024-09-12T17:44:52.269 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:44:52.269 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:44:52.269 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f58dfd8c774] 2024-09-12T17:44:52.269 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f58dfd8c8d8] 2024-09-12T17:44:52.269 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562971769841] 2024-09-12T17:44:52.270 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56297177957a] 2024-09-12T17:44:52.270 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2024-09-12T17:44:52.270 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f58dea29590] 2024-09-12T17:44:52.270 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2024-09-12T17:44:52.270 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2024-09-12T17:44:52.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.248+0000 7f58dc7a9800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:44:52.270 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f58dc7a9800 thread_name:radosgw-admin 2024-09-12T17:44:52.270 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.270 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:52.270 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f58dea3e6f0] 2024-09-12T17:44:52.270 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f58dea8b99c] 2024-09-12T17:44:52.270 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:44:52.271 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:44:52.271 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f58dfd8c774] 2024-09-12T17:44:52.271 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f58dfd8c8d8] 2024-09-12T17:44:52.271 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562971769841] 2024-09-12T17:44:52.271 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56297177957a] 2024-09-12T17:44:52.271 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2024-09-12T17:44:52.271 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f58dea29590] 2024-09-12T17:44:52.271 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2024-09-12T17:44:52.271 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2024-09-12T17:44:52.271 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:44:52.271 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.271 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:44:52.271 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:44:51.984+0000 7f58daa94640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:44:52.272 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.272 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:52.272 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: dump: 2024-09-12T17:44:52.272 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.272 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.272 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.272 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.272 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.272 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.273 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.273 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.273 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.273 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.273 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: _finish_auth 0 2024-09-12T17:44:52.273 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: _check_auth_tickets 2024-09-12T17:44:52.273 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:52.273 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:44:51.985+0000 7f58dc7a9800 5 monclient: authenticate success, global_id 7103 2024-09-12T17:44:52.273 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:44:51.985+0000 7f58dc7a9800 10 monclient: get_monmap_and_config success 2024-09-12T17:44:52.273 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:44:51.985+0000 7f58dc7a9800 4 set_mon_vals no callback set 2024-09-12T17:44:52.273 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.273 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:52.274 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: dump: 2024-09-12T17:44:52.274 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.274 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.274 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.274 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.274 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.274 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.274 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.274 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.274 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.274 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.274 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 10 monclient: shutdown 2024-09-12T17:44:52.275 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 asok(0x562973d87730) unregister_commands rotate-key 2024-09-12T17:44:52.275 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 10 monclient: build_initial_monmap 2024-09-12T17:44:52.275 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 1 build_initial for_mkfs: 0 2024-09-12T17:44:52.275 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 10 monclient: monmap: 2024-09-12T17:44:52.275 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:44:52.275 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:52.275 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:44:52.275 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:44:52.275 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:52.275 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.275 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:44:52.275 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:44:52.275 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:44:52.276 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.276 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding auth protocol: cephx 2024-09-12T17:44:52.276 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding auth protocol: cephx 2024-09-12T17:44:52.276 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding auth protocol: cephx 2024-09-12T17:44:52.276 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: secure 2024-09-12T17:44:52.276 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: crc 2024-09-12T17:44:52.276 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: secure 2024-09-12T17:44:52.276 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: crc 2024-09-12T17:44:52.276 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: secure 2024-09-12T17:44:52.276 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: crc 2024-09-12T17:44:52.276 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: crc 2024-09-12T17:44:52.276 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: secure 2024-09-12T17:44:52.276 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: crc 2024-09-12T17:44:52.277 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: secure 2024-09-12T17:44:52.277 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: crc 2024-09-12T17:44:52.277 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: secure 2024-09-12T17:44:52.277 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.277 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 1 librados: starting msgr at 2024-09-12T17:44:52.277 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 1 librados: starting objecter 2024-09-12T17:44:52.277 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command objecter_requests hook 0x562973fb02f0 2024-09-12T17:44:52.277 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 1 librados: setting wanted keys 2024-09-12T17:44:52.277 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 1 librados: calling monclient init 2024-09-12T17:44:52.277 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 10 monclient: init 2024-09-12T17:44:52.277 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding auth protocol: cephx 2024-09-12T17:44:52.277 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding auth protocol: cephx 2024-09-12T17:44:52.277 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding auth protocol: cephx 2024-09-12T17:44:52.278 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: secure 2024-09-12T17:44:52.278 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: crc 2024-09-12T17:44:52.278 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: secure 2024-09-12T17:44:52.278 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: crc 2024-09-12T17:44:52.278 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: secure 2024-09-12T17:44:52.278 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: crc 2024-09-12T17:44:52.278 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: crc 2024-09-12T17:44:52.278 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: secure 2024-09-12T17:44:52.278 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: crc 2024-09-12T17:44:52.278 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: secure 2024-09-12T17:44:52.278 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: crc 2024-09-12T17:44:52.278 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: secure 2024-09-12T17:44:52.278 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.279 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.280 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command rotate-key hook 0x562973fa8908 2024-09-12T17:44:52.280 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:52.280 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:44:52.280 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-c con 0x562973e548e0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:44:52.280 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-a con 0x562973e56780 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:44:52.280 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-b con 0x562973eeb970 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:44:52.280 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.280 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.280 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.280 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:52.280 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient(hunting): authenticate will time out at 2064.624272s 2024-09-12T17:44:52.280 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient(hunting): get_auth_request con 0x562973e548e0 auth_method 0 2024-09-12T17:44:52.281 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.281 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.281 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.281 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:44:51.987+0000 7f58d9a92640 10 monclient(hunting): get_auth_request con 0x562973e56780 auth_method 0 2024-09-12T17:44:52.281 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:44:51.987+0000 7f58d9a92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.281 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:44:51.987+0000 7f58d9a92640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.281 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:44:51.987+0000 7f58d9a92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.281 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.281 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.282 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.282 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:44:51.987+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.282 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:44:51.987+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.282 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:44:51.987+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.282 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient(hunting): handle_auth_done global_id 7106 payload 824 2024-09-12T17:44:52.282 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient: _finish_hunting 0 2024-09-12T17:44:52.282 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:44:51.987+0000 7f58da293640 1 monclient: found mon.noname-c 2024-09-12T17:44:52.282 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:44:52.282 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.282 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:52.282 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: dump: 2024-09-12T17:44:52.283 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.283 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.283 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.283 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.283 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.283 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.283 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.283 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.283 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.284 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.284 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: _finish_auth 0 2024-09-12T17:44:52.284 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: _check_auth_tickets 2024-09-12T17:44:52.284 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:52.284 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.284 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:52.284 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: dump: 2024-09-12T17:44:52.284 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.284 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.284 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.284 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.284 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.284 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.285 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.285 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.285 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 5 monclient: authenticate success, global_id 7106 2024-09-12T17:44:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient: _renew_subs 2024-09-12T17:44:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:44:51.987+0000 7f57c8608640 4 set_mon_vals no callback set 2024-09-12T17:44:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:44:51.988+0000 7f58dc7a9800 10 monclient: _renew_subs 2024-09-12T17:44:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:44:51.988+0000 7f58dc7a9800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:52.285 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:44:51.988+0000 7f58dc7a9800 1 librados: init done 2024-09-12T17:44:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:44:51.989+0000 7f57c6e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:44:51.989+0000 7f57c6e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:44:51.989+0000 7f57c6e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:44:51.990+0000 7f58d9a92640 10 monclient: get_auth_request con 0x7f57c0076470 auth_method 0 2024-09-12T17:44:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:44:51.990+0000 7f58daa94640 10 monclient: get_auth_request con 0x562973fedc90 auth_method 0 2024-09-12T17:44:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:44:51.991+0000 7f58da293640 10 monclient: get_auth_request con 0x562973ff7320 auth_method 0 2024-09-12T17:44:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:44:51.992+0000 7f58d9a92640 10 monclient: get_auth_request con 0x562973ffc3b0 auth_method 0 2024-09-12T17:44:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 10 monclient: build_initial_monmap 2024-09-12T17:44:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 1 build_initial for_mkfs: 0 2024-09-12T17:44:52.286 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 10 monclient: monmap: 2024-09-12T17:44:52.286 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:44:52.286 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:52.286 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:44:52.287 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:44:52.287 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:52.287 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.287 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:44:52.287 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:44:52.287 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:44:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding auth protocol: cephx 2024-09-12T17:44:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding auth protocol: cephx 2024-09-12T17:44:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding auth protocol: cephx 2024-09-12T17:44:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: secure 2024-09-12T17:44:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: crc 2024-09-12T17:44:52.287 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: secure 2024-09-12T17:44:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: crc 2024-09-12T17:44:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: secure 2024-09-12T17:44:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: crc 2024-09-12T17:44:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: crc 2024-09-12T17:44:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: secure 2024-09-12T17:44:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: crc 2024-09-12T17:44:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: secure 2024-09-12T17:44:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: crc 2024-09-12T17:44:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: secure 2024-09-12T17:44:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.288 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command objecter_requests cmddesc objecter_requests hook 0x562974003770 EEXIST 2024-09-12T17:44:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 10 monclient: init 2024-09-12T17:44:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding auth protocol: cephx 2024-09-12T17:44:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding auth protocol: cephx 2024-09-12T17:44:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding auth protocol: cephx 2024-09-12T17:44:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: secure 2024-09-12T17:44:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: crc 2024-09-12T17:44:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: secure 2024-09-12T17:44:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: crc 2024-09-12T17:44:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: secure 2024-09-12T17:44:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: crc 2024-09-12T17:44:52.289 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: crc 2024-09-12T17:44:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: secure 2024-09-12T17:44:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: crc 2024-09-12T17:44:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: secure 2024-09-12T17:44:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: crc 2024-09-12T17:44:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: secure 2024-09-12T17:44:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command rotate-key cmddesc rotate-key hook 0x562973fff3c0 EEXIST 2024-09-12T17:44:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:44:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-c con 0x562974027a90 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:44:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-a con 0x562974027e70 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:44:52.290 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-b con 0x5629740267a0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:44:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient(hunting): authenticate will time out at 2064.631542s 2024-09-12T17:44:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:44:51.994+0000 7f58d9a92640 10 monclient(hunting): get_auth_request con 0x562974027e70 auth_method 0 2024-09-12T17:44:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:44:51.994+0000 7f58d9a92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:44:51.994+0000 7f58d9a92640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:44:51.994+0000 7f58d9a92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient(hunting): get_auth_request con 0x562974027a90 auth_method 0 2024-09-12T17:44:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.291 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:44:51.994+0000 7f58daa94640 10 monclient(hunting): get_auth_request con 0x5629740267a0 auth_method 0 2024-09-12T17:44:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:44:51.994+0000 7f58daa94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:44:51.994+0000 7f58daa94640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:44:51.994+0000 7f58daa94640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:44:51.994+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:44:51.994+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:44:51.994+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:44:51.994+0000 7f58daa94640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:44:51.994+0000 7f58daa94640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.292 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:44:51.994+0000 7f58daa94640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient(hunting): handle_auth_done global_id 7109 payload 824 2024-09-12T17:44:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient: _finish_hunting 0 2024-09-12T17:44:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:44:51.994+0000 7f58da293640 1 monclient: found mon.noname-c 2024-09-12T17:44:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:44:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.293 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:52.294 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: dump: 2024-09-12T17:44:52.294 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.294 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.294 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.294 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.294 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.294 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.294 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.294 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.294 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.294 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.295 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: _finish_auth 0 2024-09-12T17:44:52.295 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: _check_auth_tickets 2024-09-12T17:44:52.295 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:52.295 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.295 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:52.295 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: dump: 2024-09-12T17:44:52.295 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.295 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.295 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.295 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.295 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.296 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.296 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.296 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.296 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:44:51.995+0000 7f58dc7a9800 5 monclient: authenticate success, global_id 7109 2024-09-12T17:44:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:44:51.995+0000 7f58dc7a9800 10 monclient: _renew_subs 2024-09-12T17:44:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:44:51.995+0000 7f58dc7a9800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:44:51.995+0000 7f58db295640 4 set_mon_vals no callback set 2024-09-12T17:44:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:44:51.995+0000 7f58dc7a9800 10 monclient: _renew_subs 2024-09-12T17:44:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:44:51.995+0000 7f58dc7a9800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:52.296 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:44:51.997+0000 7f57bffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:52.297 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:44:51.997+0000 7f57bffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:52.297 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:44:51.997+0000 7f57bffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:52.297 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:44:51.997+0000 7f58d9a92640 10 monclient: get_auth_request con 0x7f57b4076380 auth_method 0 2024-09-12T17:44:52.297 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 10 monclient: get_monmap_and_config 2024-09-12T17:44:52.297 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 10 monclient: build_initial_monmap 2024-09-12T17:44:52.297 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 1 build_initial for_mkfs: 0 2024-09-12T17:44:52.297 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 10 monclient: monmap: 2024-09-12T17:44:52.297 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:44:52.297 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:52.297 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:44:52.298 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:44:52.298 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:52.298 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.298 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:44:52.298 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:44:52.298 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:44:52.298 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.298 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding auth protocol: cephx 2024-09-12T17:44:52.298 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding auth protocol: cephx 2024-09-12T17:44:52.298 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding auth protocol: cephx 2024-09-12T17:44:52.298 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: secure 2024-09-12T17:44:52.298 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: crc 2024-09-12T17:44:52.298 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: secure 2024-09-12T17:44:52.299 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: crc 2024-09-12T17:44:52.299 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: secure 2024-09-12T17:44:52.299 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: crc 2024-09-12T17:44:52.299 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: crc 2024-09-12T17:44:52.299 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: secure 2024-09-12T17:44:52.299 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: crc 2024-09-12T17:44:52.299 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: secure 2024-09-12T17:44:52.299 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: crc 2024-09-12T17:44:52.299 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: secure 2024-09-12T17:44:52.299 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.299 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient: init 2024-09-12T17:44:52.299 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding auth protocol: cephx 2024-09-12T17:44:52.300 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding auth protocol: cephx 2024-09-12T17:44:52.300 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding auth protocol: cephx 2024-09-12T17:44:52.300 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: secure 2024-09-12T17:44:52.300 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: crc 2024-09-12T17:44:52.300 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: secure 2024-09-12T17:44:52.300 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: crc 2024-09-12T17:44:52.300 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: secure 2024-09-12T17:44:52.300 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: crc 2024-09-12T17:44:52.300 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: crc 2024-09-12T17:44:52.300 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: secure 2024-09-12T17:44:52.300 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: crc 2024-09-12T17:44:52.300 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: secure 2024-09-12T17:44:52.300 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: crc 2024-09-12T17:44:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: secure 2024-09-12T17:44:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command rotate-key cmddesc rotate-key hook 0x7ffef37353a8 EEXIST 2024-09-12T17:44:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:44:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-c con 0x56297407bfd0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:44:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-a con 0x56297404bde0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:44:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-b con 0x562974077390 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:44:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:52.301 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient(hunting): authenticate will time out at 2064.635559s 2024-09-12T17:44:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:44:51.998+0000 7f58d9a92640 10 monclient(hunting): get_auth_request con 0x56297404bde0 auth_method 0 2024-09-12T17:44:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:44:51.998+0000 7f58d9a92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:44:51.998+0000 7f58d9a92640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:44:51.998+0000 7f58d9a92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient(hunting): get_auth_request con 0x56297407bfd0 auth_method 0 2024-09-12T17:44:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:44:51.998+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:44:51.998+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:44:51.998+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.302 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:44:51.998+0000 7f58daa94640 10 monclient(hunting): get_auth_request con 0x562974077390 auth_method 0 2024-09-12T17:44:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:44:51.998+0000 7f58daa94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:44:51.998+0000 7f58daa94640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:44:51.998+0000 7f58daa94640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient(hunting): handle_auth_done global_id 7112 payload 274 2024-09-12T17:44:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient: _finish_hunting 0 2024-09-12T17:44:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:44:51.998+0000 7f58da293640 1 monclient: found mon.noname-c 2024-09-12T17:44:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:44:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:52.303 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: dump: 2024-09-12T17:44:52.304 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.304 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.304 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.304 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.304 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.304 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.304 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.304 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.304 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.304 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.304 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: _finish_auth 0 2024-09-12T17:44:52.304 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: _check_auth_tickets 2024-09-12T17:44:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:52.305 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: dump: 2024-09-12T17:44:52.305 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.305 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.305 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.305 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.306 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.306 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.306 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.306 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.306 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.306 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.306 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 monclient: authenticate success, global_id 7112 2024-09-12T17:44:52.306 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 10 monclient: get_monmap_and_config success 2024-09-12T17:44:52.306 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 4 set_mon_vals no callback set 2024-09-12T17:44:52.306 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 10 monclient: shutdown 2024-09-12T17:44:52.306 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 10 monclient: build_initial_monmap 2024-09-12T17:44:52.306 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 1 build_initial for_mkfs: 0 2024-09-12T17:44:52.306 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 10 monclient: monmap: 2024-09-12T17:44:52.307 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:44:52.307 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:52.307 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:44:52.307 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:44:52.307 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:52.307 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.307 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:44:52.307 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:44:52.307 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:44:52.307 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.307 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding auth protocol: cephx 2024-09-12T17:44:52.307 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding auth protocol: cephx 2024-09-12T17:44:52.307 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding auth protocol: cephx 2024-09-12T17:44:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: secure 2024-09-12T17:44:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: crc 2024-09-12T17:44:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: secure 2024-09-12T17:44:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: crc 2024-09-12T17:44:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: secure 2024-09-12T17:44:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: crc 2024-09-12T17:44:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: crc 2024-09-12T17:44:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: secure 2024-09-12T17:44:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: crc 2024-09-12T17:44:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: secure 2024-09-12T17:44:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: crc 2024-09-12T17:44:52.308 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: secure 2024-09-12T17:44:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 1 librados: starting msgr at 2024-09-12T17:44:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 1 librados: starting objecter 2024-09-12T17:44:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command objecter_requests cmddesc objecter_requests hook 0x5629740298e0 EEXIST 2024-09-12T17:44:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 1 librados: setting wanted keys 2024-09-12T17:44:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 1 librados: calling monclient init 2024-09-12T17:44:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient: init 2024-09-12T17:44:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding auth protocol: cephx 2024-09-12T17:44:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding auth protocol: cephx 2024-09-12T17:44:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding auth protocol: cephx 2024-09-12T17:44:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: secure 2024-09-12T17:44:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: crc 2024-09-12T17:44:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: secure 2024-09-12T17:44:52.309 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: crc 2024-09-12T17:44:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: secure 2024-09-12T17:44:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: crc 2024-09-12T17:44:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: crc 2024-09-12T17:44:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: secure 2024-09-12T17:44:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: crc 2024-09-12T17:44:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: secure 2024-09-12T17:44:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: crc 2024-09-12T17:44:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: secure 2024-09-12T17:44:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command rotate-key cmddesc rotate-key hook 0x56297403c498 EEXIST 2024-09-12T17:44:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:52.310 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:44:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-a con 0x56297404bde0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:44:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-b con 0x562974077390 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:44:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-c con 0x56297407bfd0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:44:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient(hunting): authenticate will time out at 2064.637860s 2024-09-12T17:44:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:44:52.000+0000 7f58da293640 10 monclient(hunting): get_auth_request con 0x56297404bde0 auth_method 0 2024-09-12T17:44:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:44:52.000+0000 7f58da293640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:44:52.000+0000 7f58da293640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:44:52.000+0000 7f58da293640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.311 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:44:52.000+0000 7f58daa94640 10 monclient(hunting): get_auth_request con 0x56297407bfd0 auth_method 0 2024-09-12T17:44:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:44:52.000+0000 7f58daa94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:44:52.000+0000 7f58daa94640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:44:52.000+0000 7f58daa94640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:44:52.001+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:44:52.001+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:44:52.001+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:44:52.001+0000 7f58daa94640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:44:52.001+0000 7f58daa94640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:44:52.001+0000 7f58daa94640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:44:52.001+0000 7f58da293640 10 monclient(hunting): handle_auth_done global_id 7632 payload 824 2024-09-12T17:44:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:44:52.001+0000 7f58da293640 10 monclient: _finish_hunting 0 2024-09-12T17:44:52.312 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:44:52.001+0000 7f58da293640 1 monclient: found mon.noname-a 2024-09-12T17:44:52.313 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:44:52.001+0000 7f58da293640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:44:52.313 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.313 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:44:52.313 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: dump: 2024-09-12T17:44:52.313 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.313 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.313 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.313 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.313 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.313 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.313 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.313 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.314 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: _finish_auth 0 2024-09-12T17:44:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: _check_auth_tickets 2024-09-12T17:44:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:44:52.314 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: dump: 2024-09-12T17:44:52.314 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.314 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.314 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.314 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.314 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.314 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.315 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.315 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.315 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:44:52.001+0000 7f58dc7a9800 5 monclient: authenticate success, global_id 7632 2024-09-12T17:44:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:44:52.001+0000 7f57bdffb640 4 set_mon_vals no callback set 2024-09-12T17:44:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:44:52.001+0000 7f58dc7a9800 10 monclient: _renew_subs 2024-09-12T17:44:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:44:52.001+0000 7f58dc7a9800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:44:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:44:52.001+0000 7f58dc7a9800 10 monclient: _renew_subs 2024-09-12T17:44:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:44:52.001+0000 7f58dc7a9800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:44:52.315 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:44:52.001+0000 7f58dc7a9800 1 librados: init done 2024-09-12T17:44:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:44:52.001+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command cr dump hook 0x56297406b0a8 2024-09-12T17:44:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:44:52.002+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:44:52.003+0000 7f57abfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:44:52.003+0000 7f57abfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:44:52.003+0000 7f57abfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:44:52.004+0000 7f58d9a92640 10 monclient: get_auth_request con 0x7f57a4076470 auth_method 0 2024-09-12T17:44:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:44:52.004+0000 7f58daa94640 10 monclient: get_auth_request con 0x562974095480 auth_method 0 2024-09-12T17:44:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:44:52.004+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:44:52.004+0000 7f58dc7a9800 20 realm 2024-09-12T17:44:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:44:52.004+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:44:52.004+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.316 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:44:52.004+0000 7f58dc7a9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:44:52.004+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:44:52.005+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:44:52.005+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:44:52.005+0000 7f58da293640 10 monclient: get_auth_request con 0x562974099670 auth_method 0 2024-09-12T17:44:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:44:52.005+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:44:52.005+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:44:52.006+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:44:52.006+0000 7f58dc7a9800 20 searching for the correct realm 2024-09-12T17:44:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:44:52.006+0000 7f58d9a92640 10 monclient: get_auth_request con 0x56297409e580 auth_method 0 2024-09-12T17:44:52.317 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:44:52.007+0000 7f58daa94640 10 monclient: get_auth_request con 0x7f58d008f040 auth_method 0 2024-09-12T17:44:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:44:52.008+0000 7f58da293640 10 monclient: get_auth_request con 0x7f58d4014470 auth_method 0 2024-09-12T17:44:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:44:52.008+0000 7f58d9a92640 10 monclient: get_auth_request con 0x7f58cc06c070 auth_method 0 2024-09-12T17:44:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:44:52.010+0000 7f58daa94640 0 -- 172.21.15.44:0/1731959580 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f58d008f040 msgr2=0x7f58d008f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:44:52.010+0000 7f57abfff640 1 client.7632.objecter ms_handle_reset 0x7f58d008f040 session 0x7f58d0088040 osd.7 2024-09-12T17:44:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:44:52.010+0000 7f57abfff640 10 monclient: _renew_subs 2024-09-12T17:44:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:44:52.010+0000 7f57abfff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:44:52.318 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:44:52.010+0000 7f58daa94640 10 monclient: get_auth_request con 0x7f57a4086290 auth_method 0 2024-09-12T17:44:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:44:52.011+0000 7f58daa94640 10 monclient: get_auth_request con 0x7f58d0078410 auth_method 0 2024-09-12T17:44:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:44:52.013+0000 7f58da293640 10 monclient: get_auth_request con 0x7f58d00a3920 auth_method 0 2024-09-12T17:44:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:44:52.013+0000 7f58da293640 0 -- 172.21.15.44:0/1731959580 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f58d00a3920 msgr2=0x7f58d00823f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:44:52.215+0000 7f58da293640 10 monclient: get_auth_request con 0x7f58d00a3920 auth_method 0 2024-09-12T17:44:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:52.319 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 zone default found 2024-09-12T17:44:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 4 Realm: () 2024-09-12T17:44:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 zonegroup default 2024-09-12T17:44:52.320 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:44:52.223+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:44:52.223+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:44:52.223+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:44:52.223+0000 7f58dc7a9800 20 started sync module instance, tier type = 2024-09-12T17:44:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:44:52.223+0000 7f58dc7a9800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=0 2024-09-12T17:44:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=1 2024-09-12T17:44:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=2 2024-09-12T17:44:52.321 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=3 2024-09-12T17:44:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=4 2024-09-12T17:44:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=5 2024-09-12T17:44:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=6 2024-09-12T17:44:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:44:52.233+0000 7f58dc7a9800 20 add_watcher() i=7 2024-09-12T17:44:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:44:52.233+0000 7f58dc7a9800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding auth protocol: cephx 2024-09-12T17:44:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding auth protocol: cephx 2024-09-12T17:44:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding auth protocol: cephx 2024-09-12T17:44:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: secure 2024-09-12T17:44:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: crc 2024-09-12T17:44:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: secure 2024-09-12T17:44:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: crc 2024-09-12T17:44:52.322 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: secure 2024-09-12T17:44:52.323 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: crc 2024-09-12T17:44:52.323 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:44:52.235+0000 7f5790fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:52.323 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: crc 2024-09-12T17:44:52.323 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: secure 2024-09-12T17:44:52.323 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: crc 2024-09-12T17:44:52.323 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: secure 2024-09-12T17:44:52.323 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: crc 2024-09-12T17:44:52.323 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: secure 2024-09-12T17:44:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command cache list hook 0x5629740726d0 2024-09-12T17:44:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command cache inspect hook 0x5629740726d0 2024-09-12T17:44:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command cache erase hook 0x5629740726d0 2024-09-12T17:44:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command cache zap hook 0x5629740726d0 2024-09-12T17:44:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 note: GC not initialized 2024-09-12T17:44:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:44:52.235+0000 7f570b7fe640 20 reqs_thread_entry: start 2024-09-12T17:44:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command sync trace show hook 0x7f58cc079070 2024-09-12T17:44:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command sync trace history hook 0x7f58cc079070 2024-09-12T17:44:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command sync trace active hook 0x7f58cc079070 2024-09-12T17:44:52.324 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command sync trace active_short hook 0x7f58cc079070 2024-09-12T17:44:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 20 Filter name: none 2024-09-12T17:44:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:44:52.235+0000 7f57097fa640 20 reqs_thread_entry: start 2024-09-12T17:44:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:44:52.236+0000 7f58dc7a9800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:44:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:44:52.236+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:44:52.236+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:44:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:44:52.236+0000 7f58dc7a9800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:44:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:44:52.236+0000 7f58dc7a9800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:44:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:44:52.236+0000 7f58dc7a9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 : miss 2024-09-12T17:44:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:44:52.236+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:44:52.237+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:44:52.325 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:44:52.237+0000 7f58dc7a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:44:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:44:52.237+0000 7f58dc7a9800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:44:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:44:52.237+0000 7f58dc7a9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:44:52.237+0000 7f58dc7a9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:44:52.237+0000 7f58dc7a9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 2024-09-12T17:44:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:44:52.242+0000 7f58dc7a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:44:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:44:52.242+0000 7f58dc7a9800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:44:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:44:52.242+0000 7f58dc7a9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:44:52.242+0000 7f58dc7a9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35, ofs0, ns] 2024-09-12T17:44:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:44:52.242+0000 7f57bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562438 cookie 94736040483104 notifier 7632 bl.length()=995 2024-09-12T17:44:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:44:52.242+0000 7f57bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:44:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:44:52.242+0000 7f57bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:44:52.326 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:44:52.242+0000 7f57bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:44:52.242+0000 7f58dc7a9800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): orig_sources= new_sources= 2024-09-12T17:44:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:44:52.242+0000 7f58dc7a9800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): potential sources added=[] removed=[] 2024-09-12T17:44:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:44:52.242+0000 7f58dc7a9800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): orig_dests= new_dests= 2024-09-12T17:44:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:44:52.242+0000 7f58dc7a9800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): potential dests added=[] removed=[] 2024-09-12T17:44:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:44:52.248+0000 7f58dc7a9800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f58dc7a9800 time 2024-09-12T17:44:52.248860+0000 2024-09-12T17:44:52.327 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:44:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.327 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f58dfd8c71a] 2024-09-12T17:44:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f58dfd8c8d8] 2024-09-12T17:44:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562971769841] 2024-09-12T17:44:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56297177957a] 2024-09-12T17:44:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2024-09-12T17:44:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f58dea29590] 2024-09-12T17:44:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2024-09-12T17:44:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2024-09-12T17:44:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:44:52.248+0000 7f58dc7a9800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:44:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f58dc7a9800 thread_name:radosgw-admin 2024-09-12T17:44:52.328 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f58dea3e6f0] 2024-09-12T17:44:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f58dea8b99c] 2024-09-12T17:44:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:44:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:44:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f58dfd8c774] 2024-09-12T17:44:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f58dfd8c8d8] 2024-09-12T17:44:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562971769841] 2024-09-12T17:44:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56297177957a] 2024-09-12T17:44:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2024-09-12T17:44:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f58dea29590] 2024-09-12T17:44:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2024-09-12T17:44:52.329 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2024-09-12T17:44:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:44:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.330 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:44:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:44:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:44:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:44:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:44:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:44:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:44:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:44:52.330 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:44:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:44:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:44:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:44:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:44:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:44:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:44:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:44:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:44:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:44:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:44:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:44:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:44:52.331 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:44:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:44:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:44:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:44:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:44:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:44:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:44:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:44:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:44:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:44:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:44:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:44:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:44:52.332 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:44:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:44:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:44:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:44:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:44:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:44:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:44:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:44:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:44:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:44:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:44:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:44:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:44:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:44:52.333 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:44:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:44:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:44:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:44:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:44:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:44:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:44:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:44:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:44:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:44:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:44:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:44:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:44:52.334 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:44:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:44:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:44:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:44:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:44:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:44:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:44:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:44:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:44:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:44:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:44:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:44:52.335 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:44:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:44:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:44:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:44:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:44:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:44:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:44:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:44:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:44:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:44:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:44:52.336 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:44:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:44:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:44:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:44:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:44:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:44:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:44:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:44:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:44:52.337 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:44:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 7f57097fa640 / http_manager 2024-09-12T17:44:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 7f570b7fe640 / http_manager 2024-09-12T17:44:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5790fe1640 / rgw_dt_lg_renew 2024-09-12T17:44:52.337 INFO:tasks.workunit.client.0.smithi044.stderr: 7f57abfff640 / ms_dispatch 2024-09-12T17:44:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 7f57bd7fa640 / io_context_pool 2024-09-12T17:44:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 7f57bdffb640 / io_context_pool 2024-09-12T17:44:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 7f57bffff640 / ms_dispatch 2024-09-12T17:44:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 7f57c6e05640 / ms_dispatch 2024-09-12T17:44:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 7f57c8608640 / io_context_pool 2024-09-12T17:44:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 7f58d9a92640 / msgr-worker-2 2024-09-12T17:44:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 7f58da293640 / msgr-worker-1 2024-09-12T17:44:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 7f58daa94640 / msgr-worker-0 2024-09-12T17:44:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 7f58db295640 / io_context_pool 2024-09-12T17:44:52.338 INFO:tasks.workunit.client.0.smithi044.stderr: 7f58dc7a9800 / radosgw-admin 2024-09-12T17:44:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:44:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:44:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/log/ceph/ceph-client.admin.128560.log 2024-09-12T17:44:52.339 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:44:52.339 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:44:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:44:51.984+0000 7f58daa94640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:44:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:52.339 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: dump: 2024-09-12T17:44:52.339 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.339 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.339 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.339 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.340 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.340 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.340 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.340 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.340 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: _finish_auth 0 2024-09-12T17:44:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: _check_auth_tickets 2024-09-12T17:44:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:44:51.985+0000 7f58dc7a9800 5 monclient: authenticate success, global_id 7103 2024-09-12T17:44:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:44:51.985+0000 7f58dc7a9800 10 monclient: get_monmap_and_config success 2024-09-12T17:44:52.340 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:44:51.985+0000 7f58dc7a9800 4 set_mon_vals no callback set 2024-09-12T17:44:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:52.341 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:44:51.985+0000 7f57c8608640 10 monclient: dump: 2024-09-12T17:44:52.341 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.341 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.341 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.341 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.341 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.341 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.341 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.341 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.341 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 10 monclient: shutdown 2024-09-12T17:44:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 asok(0x562973d87730) unregister_commands rotate-key 2024-09-12T17:44:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 10 monclient: build_initial_monmap 2024-09-12T17:44:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 1 build_initial for_mkfs: 0 2024-09-12T17:44:52.342 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 10 monclient: monmap: 2024-09-12T17:44:52.342 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:44:52.342 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:52.342 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:44:52.342 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:44:52.342 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:52.342 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.342 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:44:52.342 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:44:52.343 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:44:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding auth protocol: cephx 2024-09-12T17:44:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding auth protocol: cephx 2024-09-12T17:44:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding auth protocol: cephx 2024-09-12T17:44:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: secure 2024-09-12T17:44:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: crc 2024-09-12T17:44:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: secure 2024-09-12T17:44:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: crc 2024-09-12T17:44:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: secure 2024-09-12T17:44:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: crc 2024-09-12T17:44:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: crc 2024-09-12T17:44:52.343 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: secure 2024-09-12T17:44:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: crc 2024-09-12T17:44:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: secure 2024-09-12T17:44:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: crc 2024-09-12T17:44:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fadfc0) adding con mode: secure 2024-09-12T17:44:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 1 librados: starting msgr at 2024-09-12T17:44:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 1 librados: starting objecter 2024-09-12T17:44:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command objecter_requests hook 0x562973fb02f0 2024-09-12T17:44:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 1 librados: setting wanted keys 2024-09-12T17:44:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 1 librados: calling monclient init 2024-09-12T17:44:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 10 monclient: init 2024-09-12T17:44:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding auth protocol: cephx 2024-09-12T17:44:52.344 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding auth protocol: cephx 2024-09-12T17:44:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding auth protocol: cephx 2024-09-12T17:44:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: secure 2024-09-12T17:44:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: crc 2024-09-12T17:44:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: secure 2024-09-12T17:44:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: crc 2024-09-12T17:44:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: secure 2024-09-12T17:44:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: crc 2024-09-12T17:44:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: crc 2024-09-12T17:44:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: secure 2024-09-12T17:44:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: crc 2024-09-12T17:44:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: secure 2024-09-12T17:44:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: crc 2024-09-12T17:44:52.345 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 5 AuthRegistry(0x562973fa87c0) adding con mode: secure 2024-09-12T17:44:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:44:51.986+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command rotate-key hook 0x562973fa8908 2024-09-12T17:44:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:44:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-c con 0x562973e548e0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:44:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-a con 0x562973e56780 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:44:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-b con 0x562973eeb970 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:44:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient(hunting): authenticate will time out at 2064.624272s 2024-09-12T17:44:52.346 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient(hunting): get_auth_request con 0x562973e548e0 auth_method 0 2024-09-12T17:44:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:44:51.987+0000 7f58d9a92640 10 monclient(hunting): get_auth_request con 0x562973e56780 auth_method 0 2024-09-12T17:44:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:44:51.987+0000 7f58d9a92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:44:51.987+0000 7f58d9a92640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:44:51.987+0000 7f58d9a92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:44:51.987+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.347 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:44:51.987+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:44:51.987+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient(hunting): handle_auth_done global_id 7106 payload 824 2024-09-12T17:44:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient: _finish_hunting 0 2024-09-12T17:44:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:44:51.987+0000 7f58da293640 1 monclient: found mon.noname-c 2024-09-12T17:44:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:44:51.987+0000 7f58da293640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:44:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:52.348 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: dump: 2024-09-12T17:44:52.348 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.348 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.348 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.348 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.349 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.349 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.349 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.349 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.349 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: _finish_auth 0 2024-09-12T17:44:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: _check_auth_tickets 2024-09-12T17:44:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:52.349 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:44:51.987+0000 7f57c6e05640 10 monclient: dump: 2024-09-12T17:44:52.349 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.350 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.350 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.350 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.350 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.350 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.350 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.351 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.351 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.351 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.351 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 5 monclient: authenticate success, global_id 7106 2024-09-12T17:44:52.351 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient: _renew_subs 2024-09-12T17:44:52.351 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:44:51.987+0000 7f58dc7a9800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:44:51.987+0000 7f57c8608640 4 set_mon_vals no callback set 2024-09-12T17:44:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:44:51.988+0000 7f58dc7a9800 10 monclient: _renew_subs 2024-09-12T17:44:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:44:51.988+0000 7f58dc7a9800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:44:51.988+0000 7f58dc7a9800 1 librados: init done 2024-09-12T17:44:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:44:51.989+0000 7f57c6e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:44:51.989+0000 7f57c6e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:44:51.989+0000 7f57c6e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:44:51.990+0000 7f58d9a92640 10 monclient: get_auth_request con 0x7f57c0076470 auth_method 0 2024-09-12T17:44:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:44:51.990+0000 7f58daa94640 10 monclient: get_auth_request con 0x562973fedc90 auth_method 0 2024-09-12T17:44:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:44:51.991+0000 7f58da293640 10 monclient: get_auth_request con 0x562973ff7320 auth_method 0 2024-09-12T17:44:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:44:51.992+0000 7f58d9a92640 10 monclient: get_auth_request con 0x562973ffc3b0 auth_method 0 2024-09-12T17:44:52.352 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 10 monclient: build_initial_monmap 2024-09-12T17:44:52.353 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 1 build_initial for_mkfs: 0 2024-09-12T17:44:52.353 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 10 monclient: monmap: 2024-09-12T17:44:52.353 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:44:52.353 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:52.353 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:44:52.353 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:44:52.353 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:52.354 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.354 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:44:52.354 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:44:52.354 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:44:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding auth protocol: cephx 2024-09-12T17:44:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding auth protocol: cephx 2024-09-12T17:44:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding auth protocol: cephx 2024-09-12T17:44:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: secure 2024-09-12T17:44:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: crc 2024-09-12T17:44:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: secure 2024-09-12T17:44:52.354 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: crc 2024-09-12T17:44:52.355 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: secure 2024-09-12T17:44:52.355 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: crc 2024-09-12T17:44:52.355 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: crc 2024-09-12T17:44:52.355 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: secure 2024-09-12T17:44:52.355 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: crc 2024-09-12T17:44:52.355 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: secure 2024-09-12T17:44:52.355 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: crc 2024-09-12T17:44:52.355 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x5629740002c0) adding con mode: secure 2024-09-12T17:44:52.355 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.355 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command objecter_requests cmddesc objecter_requests hook 0x562974003770 EEXIST 2024-09-12T17:44:52.355 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 10 monclient: init 2024-09-12T17:44:52.355 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding auth protocol: cephx 2024-09-12T17:44:52.355 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding auth protocol: cephx 2024-09-12T17:44:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding auth protocol: cephx 2024-09-12T17:44:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: secure 2024-09-12T17:44:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: crc 2024-09-12T17:44:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: secure 2024-09-12T17:44:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: crc 2024-09-12T17:44:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: secure 2024-09-12T17:44:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: crc 2024-09-12T17:44:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: crc 2024-09-12T17:44:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: secure 2024-09-12T17:44:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: crc 2024-09-12T17:44:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: secure 2024-09-12T17:44:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: crc 2024-09-12T17:44:52.356 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:44:51.993+0000 7f58dc7a9800 5 AuthRegistry(0x562973fff278) adding con mode: secure 2024-09-12T17:44:52.357 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.357 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.357 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command rotate-key cmddesc rotate-key hook 0x562973fff3c0 EEXIST 2024-09-12T17:44:52.357 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:52.357 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:44:52.357 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-c con 0x562974027a90 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:44:52.357 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-a con 0x562974027e70 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:44:52.357 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-b con 0x5629740267a0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:44:52.357 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.357 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.357 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:44:51.994+0000 7f58dc7a9800 10 monclient(hunting): authenticate will time out at 2064.631542s 2024-09-12T17:44:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:44:51.994+0000 7f58d9a92640 10 monclient(hunting): get_auth_request con 0x562974027e70 auth_method 0 2024-09-12T17:44:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:44:51.994+0000 7f58d9a92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:44:51.994+0000 7f58d9a92640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:44:51.994+0000 7f58d9a92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient(hunting): get_auth_request con 0x562974027a90 auth_method 0 2024-09-12T17:44:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:44:51.994+0000 7f58daa94640 10 monclient(hunting): get_auth_request con 0x5629740267a0 auth_method 0 2024-09-12T17:44:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:44:51.994+0000 7f58daa94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.358 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:44:51.994+0000 7f58daa94640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:44:51.994+0000 7f58daa94640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:44:51.994+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:44:51.994+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:44:51.994+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:44:51.994+0000 7f58daa94640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:44:51.994+0000 7f58daa94640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:44:51.994+0000 7f58daa94640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient(hunting): handle_auth_done global_id 7109 payload 824 2024-09-12T17:44:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient: _finish_hunting 0 2024-09-12T17:44:52.359 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:44:51.994+0000 7f58da293640 1 monclient: found mon.noname-c 2024-09-12T17:44:52.360 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:44:51.994+0000 7f58da293640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:44:52.360 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.360 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:52.360 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: dump: 2024-09-12T17:44:52.360 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.360 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.360 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.360 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.360 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.360 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.360 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.360 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.360 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: _finish_auth 0 2024-09-12T17:44:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: _check_auth_tickets 2024-09-12T17:44:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:52.361 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:44:51.995+0000 7f57bffff640 10 monclient: dump: 2024-09-12T17:44:52.361 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.361 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.361 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.361 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.361 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.361 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.362 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.362 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.362 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:44:51.995+0000 7f58dc7a9800 5 monclient: authenticate success, global_id 7109 2024-09-12T17:44:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:44:51.995+0000 7f58dc7a9800 10 monclient: _renew_subs 2024-09-12T17:44:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:44:51.995+0000 7f58dc7a9800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:44:51.995+0000 7f58db295640 4 set_mon_vals no callback set 2024-09-12T17:44:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:44:51.995+0000 7f58dc7a9800 10 monclient: _renew_subs 2024-09-12T17:44:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:44:51.995+0000 7f58dc7a9800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:44:52.362 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:44:51.997+0000 7f57bffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:44:51.997+0000 7f57bffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:44:51.997+0000 7f57bffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:44:51.997+0000 7f58d9a92640 10 monclient: get_auth_request con 0x7f57b4076380 auth_method 0 2024-09-12T17:44:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 10 monclient: get_monmap_and_config 2024-09-12T17:44:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 10 monclient: build_initial_monmap 2024-09-12T17:44:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 1 build_initial for_mkfs: 0 2024-09-12T17:44:52.363 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 10 monclient: monmap: 2024-09-12T17:44:52.363 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:44:52.363 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:52.363 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:44:52.363 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:44:52.363 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:52.363 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.363 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:44:52.364 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:44:52.364 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:44:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding auth protocol: cephx 2024-09-12T17:44:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding auth protocol: cephx 2024-09-12T17:44:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding auth protocol: cephx 2024-09-12T17:44:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: secure 2024-09-12T17:44:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: crc 2024-09-12T17:44:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: secure 2024-09-12T17:44:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: crc 2024-09-12T17:44:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: secure 2024-09-12T17:44:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: crc 2024-09-12T17:44:52.364 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: crc 2024-09-12T17:44:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: secure 2024-09-12T17:44:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: crc 2024-09-12T17:44:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: secure 2024-09-12T17:44:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: crc 2024-09-12T17:44:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 5 AuthRegistry(0x562974047930) adding con mode: secure 2024-09-12T17:44:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:44:51.997+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient: init 2024-09-12T17:44:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding auth protocol: cephx 2024-09-12T17:44:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding auth protocol: cephx 2024-09-12T17:44:52.365 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding auth protocol: cephx 2024-09-12T17:44:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: secure 2024-09-12T17:44:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: crc 2024-09-12T17:44:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: secure 2024-09-12T17:44:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: crc 2024-09-12T17:44:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: secure 2024-09-12T17:44:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: crc 2024-09-12T17:44:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: crc 2024-09-12T17:44:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: secure 2024-09-12T17:44:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: crc 2024-09-12T17:44:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: secure 2024-09-12T17:44:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: crc 2024-09-12T17:44:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735260) adding con mode: secure 2024-09-12T17:44:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.366 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command rotate-key cmddesc rotate-key hook 0x7ffef37353a8 EEXIST 2024-09-12T17:44:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:44:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-c con 0x56297407bfd0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:44:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-a con 0x56297404bde0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:44:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-b con 0x562974077390 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:44:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:44:51.998+0000 7f58dc7a9800 10 monclient(hunting): authenticate will time out at 2064.635559s 2024-09-12T17:44:52.367 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:44:51.998+0000 7f58d9a92640 10 monclient(hunting): get_auth_request con 0x56297404bde0 auth_method 0 2024-09-12T17:44:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:44:51.998+0000 7f58d9a92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:44:51.998+0000 7f58d9a92640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:44:51.998+0000 7f58d9a92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient(hunting): get_auth_request con 0x56297407bfd0 auth_method 0 2024-09-12T17:44:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:44:51.998+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:44:51.998+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:44:51.998+0000 7f58d9a92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.368 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:44:51.998+0000 7f58daa94640 10 monclient(hunting): get_auth_request con 0x562974077390 auth_method 0 2024-09-12T17:44:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:44:51.998+0000 7f58daa94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:44:51.998+0000 7f58daa94640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:44:51.998+0000 7f58daa94640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient(hunting): handle_auth_done global_id 7112 payload 274 2024-09-12T17:44:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient: _finish_hunting 0 2024-09-12T17:44:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:44:51.998+0000 7f58da293640 1 monclient: found mon.noname-c 2024-09-12T17:44:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:44:51.998+0000 7f58da293640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:44:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:44:52.369 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: dump: 2024-09-12T17:44:52.369 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.369 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.370 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.370 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.370 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.370 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.370 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.370 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.370 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: _finish_auth 0 2024-09-12T17:44:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: _check_auth_tickets 2024-09-12T17:44:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.370 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:44:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:44:51.999+0000 7f57bdffb640 10 monclient: dump: 2024-09-12T17:44:52.371 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.371 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.371 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.371 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.371 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.371 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.371 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.371 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.371 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 monclient: authenticate success, global_id 7112 2024-09-12T17:44:52.371 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 10 monclient: get_monmap_and_config success 2024-09-12T17:44:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 4 set_mon_vals no callback set 2024-09-12T17:44:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 10 monclient: shutdown 2024-09-12T17:44:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 10 monclient: build_initial_monmap 2024-09-12T17:44:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 1 build_initial for_mkfs: 0 2024-09-12T17:44:52.372 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 10 monclient: monmap: 2024-09-12T17:44:52.372 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:44:52.372 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:44:52.372 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:44:52.372 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:44:52.372 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:44:52.372 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.372 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:44:52.372 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:44:52.373 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:44:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding auth protocol: cephx 2024-09-12T17:44:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding auth protocol: cephx 2024-09-12T17:44:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding auth protocol: cephx 2024-09-12T17:44:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: secure 2024-09-12T17:44:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: crc 2024-09-12T17:44:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: secure 2024-09-12T17:44:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: crc 2024-09-12T17:44:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: secure 2024-09-12T17:44:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: crc 2024-09-12T17:44:52.373 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: crc 2024-09-12T17:44:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: secure 2024-09-12T17:44:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: crc 2024-09-12T17:44:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: secure 2024-09-12T17:44:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: crc 2024-09-12T17:44:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:44:51.999+0000 7f58dc7a9800 5 AuthRegistry(0x56297406e260) adding con mode: secure 2024-09-12T17:44:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 1 librados: starting msgr at 2024-09-12T17:44:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 1 librados: starting objecter 2024-09-12T17:44:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command objecter_requests cmddesc objecter_requests hook 0x5629740298e0 EEXIST 2024-09-12T17:44:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 1 librados: setting wanted keys 2024-09-12T17:44:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 1 librados: calling monclient init 2024-09-12T17:44:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient: init 2024-09-12T17:44:52.374 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding auth protocol: cephx 2024-09-12T17:44:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding auth protocol: cephx 2024-09-12T17:44:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding auth protocol: cephx 2024-09-12T17:44:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: secure 2024-09-12T17:44:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: crc 2024-09-12T17:44:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: secure 2024-09-12T17:44:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: crc 2024-09-12T17:44:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: secure 2024-09-12T17:44:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: crc 2024-09-12T17:44:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: crc 2024-09-12T17:44:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: secure 2024-09-12T17:44:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: crc 2024-09-12T17:44:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: secure 2024-09-12T17:44:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: crc 2024-09-12T17:44:52.375 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 AuthRegistry(0x56297403c350) adding con mode: secure 2024-09-12T17:44:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command rotate-key cmddesc rotate-key hook 0x56297403c498 EEXIST 2024-09-12T17:44:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient: _reopen_session rank -1 2024-09-12T17:44:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:44:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-a con 0x56297404bde0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:44:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-b con 0x562974077390 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:44:52.376 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient(hunting): picked mon.noname-c con 0x56297407bfd0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:44:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient(hunting): start opening mon connection 2024-09-12T17:44:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient(hunting): _renew_subs 2024-09-12T17:44:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:44:52.000+0000 7f58dc7a9800 10 monclient(hunting): authenticate will time out at 2064.637860s 2024-09-12T17:44:52.377 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:44:52.000+0000 7f58da293640 10 monclient(hunting): get_auth_request con 0x56297404bde0 auth_method 0 2024-09-12T17:44:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:44:52.000+0000 7f58da293640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:44:52.000+0000 7f58da293640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:44:52.000+0000 7f58da293640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:44:52.000+0000 7f58daa94640 10 monclient(hunting): get_auth_request con 0x56297407bfd0 auth_method 0 2024-09-12T17:44:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:44:52.000+0000 7f58daa94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:44:52.378 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:44:52.000+0000 7f58daa94640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:44:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:44:52.000+0000 7f58daa94640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:44:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:44:52.001+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:44:52.001+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:44:52.001+0000 7f58da293640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:44:52.001+0000 7f58daa94640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:44:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:44:52.001+0000 7f58daa94640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:44:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:44:52.001+0000 7f58daa94640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:44:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:44:52.001+0000 7f58da293640 10 monclient(hunting): handle_auth_done global_id 7632 payload 824 2024-09-12T17:44:52.379 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:44:52.001+0000 7f58da293640 10 monclient: _finish_hunting 0 2024-09-12T17:44:52.380 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:44:52.001+0000 7f58da293640 1 monclient: found mon.noname-a 2024-09-12T17:44:52.380 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:44:52.001+0000 7f58da293640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:44:52.380 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.380 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:44:52.380 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: dump: 2024-09-12T17:44:52.380 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.380 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.380 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.380 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.380 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.380 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.380 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.381 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.381 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.381 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.381 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: _finish_auth 0 2024-09-12T17:44:52.381 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: _check_auth_tickets 2024-09-12T17:44:52.381 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:44:52.381 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:44:52.381 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:44:52.381 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:44:52.001+0000 7f57abfff640 10 monclient: dump: 2024-09-12T17:44:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:44:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:44:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:44:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:44:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:44:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:44:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:44:52.382 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:44:52.382 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.382 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:44:52.001+0000 7f58dc7a9800 5 monclient: authenticate success, global_id 7632 2024-09-12T17:44:52.382 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:44:52.001+0000 7f57bdffb640 4 set_mon_vals no callback set 2024-09-12T17:44:52.382 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:44:52.001+0000 7f58dc7a9800 10 monclient: _renew_subs 2024-09-12T17:44:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:44:52.001+0000 7f58dc7a9800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:44:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:44:52.001+0000 7f58dc7a9800 10 monclient: _renew_subs 2024-09-12T17:44:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:44:52.001+0000 7f58dc7a9800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:44:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:44:52.001+0000 7f58dc7a9800 1 librados: init done 2024-09-12T17:44:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:44:52.001+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command cr dump hook 0x56297406b0a8 2024-09-12T17:44:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:44:52.002+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:44:52.003+0000 7f57abfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:44:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:44:52.003+0000 7f57abfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:44:52.003+0000 7f57abfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:44:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:44:52.004+0000 7f58d9a92640 10 monclient: get_auth_request con 0x7f57a4076470 auth_method 0 2024-09-12T17:44:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:44:52.004+0000 7f58daa94640 10 monclient: get_auth_request con 0x562974095480 auth_method 0 2024-09-12T17:44:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:44:52.004+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:44:52.004+0000 7f58dc7a9800 20 realm 2024-09-12T17:44:52.383 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:44:52.004+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:44:52.004+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:44:52.004+0000 7f58dc7a9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:44:52.004+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:44:52.005+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:44:52.005+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:44:52.005+0000 7f58da293640 10 monclient: get_auth_request con 0x562974099670 auth_method 0 2024-09-12T17:44:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:44:52.005+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:44:52.005+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:44:52.006+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:44:52.006+0000 7f58dc7a9800 20 searching for the correct realm 2024-09-12T17:44:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:44:52.006+0000 7f58d9a92640 10 monclient: get_auth_request con 0x56297409e580 auth_method 0 2024-09-12T17:44:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:44:52.007+0000 7f58daa94640 10 monclient: get_auth_request con 0x7f58d008f040 auth_method 0 2024-09-12T17:44:52.384 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:44:52.008+0000 7f58da293640 10 monclient: get_auth_request con 0x7f58d4014470 auth_method 0 2024-09-12T17:44:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:44:52.008+0000 7f58d9a92640 10 monclient: get_auth_request con 0x7f58cc06c070 auth_method 0 2024-09-12T17:44:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:44:52.010+0000 7f58daa94640 0 -- 172.21.15.44:0/1731959580 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f58d008f040 msgr2=0x7f58d008f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:44:52.010+0000 7f57abfff640 1 client.7632.objecter ms_handle_reset 0x7f58d008f040 session 0x7f58d0088040 osd.7 2024-09-12T17:44:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:44:52.010+0000 7f57abfff640 10 monclient: _renew_subs 2024-09-12T17:44:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:44:52.010+0000 7f57abfff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:44:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:44:52.010+0000 7f58daa94640 10 monclient: get_auth_request con 0x7f57a4086290 auth_method 0 2024-09-12T17:44:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:44:52.011+0000 7f58daa94640 10 monclient: get_auth_request con 0x7f58d0078410 auth_method 0 2024-09-12T17:44:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:44:52.013+0000 7f58da293640 10 monclient: get_auth_request con 0x7f58d00a3920 auth_method 0 2024-09-12T17:44:52.385 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:44:52.013+0000 7f58da293640 0 -- 172.21.15.44:0/1731959580 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f58d00a3920 msgr2=0x7f58d00823f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:52.387 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:44:52.215+0000 7f58da293640 10 monclient: get_auth_request con 0x7f58d00a3920 auth_method 0 2024-09-12T17:44:52.387 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:44:52.221+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 zone default found 2024-09-12T17:44:52.388 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 4 Realm: () 2024-09-12T17:44:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 zonegroup default 2024-09-12T17:44:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:44:52.222+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:44:52.223+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:44:52.223+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:44:52.223+0000 7f58dc7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:44:52.223+0000 7f58dc7a9800 20 started sync module instance, tier type = 2024-09-12T17:44:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:44:52.223+0000 7f58dc7a9800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:52.389 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=0 2024-09-12T17:44:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=1 2024-09-12T17:44:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=2 2024-09-12T17:44:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=3 2024-09-12T17:44:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=4 2024-09-12T17:44:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=5 2024-09-12T17:44:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:44:52.232+0000 7f58dc7a9800 20 add_watcher() i=6 2024-09-12T17:44:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:44:52.233+0000 7f58dc7a9800 20 add_watcher() i=7 2024-09-12T17:44:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:44:52.233+0000 7f58dc7a9800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding auth protocol: cephx 2024-09-12T17:44:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding auth protocol: cephx 2024-09-12T17:44:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding auth protocol: cephx 2024-09-12T17:44:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: secure 2024-09-12T17:44:52.390 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: crc 2024-09-12T17:44:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: secure 2024-09-12T17:44:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: crc 2024-09-12T17:44:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: secure 2024-09-12T17:44:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: crc 2024-09-12T17:44:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:44:52.235+0000 7f5790fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: crc 2024-09-12T17:44:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: secure 2024-09-12T17:44:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: crc 2024-09-12T17:44:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: secure 2024-09-12T17:44:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: crc 2024-09-12T17:44:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 AuthRegistry(0x7ffef3735730) adding con mode: secure 2024-09-12T17:44:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:44:52.391 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command cache list hook 0x5629740726d0 2024-09-12T17:44:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command cache inspect hook 0x5629740726d0 2024-09-12T17:44:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command cache erase hook 0x5629740726d0 2024-09-12T17:44:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command cache zap hook 0x5629740726d0 2024-09-12T17:44:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 note: GC not initialized 2024-09-12T17:44:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:44:52.235+0000 7f570b7fe640 20 reqs_thread_entry: start 2024-09-12T17:44:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command sync trace show hook 0x7f58cc079070 2024-09-12T17:44:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command sync trace history hook 0x7f58cc079070 2024-09-12T17:44:52.392 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command sync trace active hook 0x7f58cc079070 2024-09-12T17:44:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 5 asok(0x562973d87730) register_command sync trace active_short hook 0x7f58cc079070 2024-09-12T17:44:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:44:52.235+0000 7f58dc7a9800 20 Filter name: none 2024-09-12T17:44:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:44:52.235+0000 7f57097fa640 20 reqs_thread_entry: start 2024-09-12T17:44:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:44:52.236+0000 7f58dc7a9800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:44:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:44:52.236+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:44:52.236+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:44:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:44:52.236+0000 7f58dc7a9800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:44:52.393 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:44:52.236+0000 7f58dc7a9800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:44:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:44:52.236+0000 7f58dc7a9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 : miss 2024-09-12T17:44:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:44:52.236+0000 7f58dc7a9800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:44:52.237+0000 7f58dc7a9800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:44:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:44:52.237+0000 7f58dc7a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:44:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:44:52.237+0000 7f58dc7a9800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:44:52.394 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:44:52.237+0000 7f58dc7a9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:44:52.237+0000 7f58dc7a9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:44:52.237+0000 7f58dc7a9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 2024-09-12T17:44:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:44:52.242+0000 7f58dc7a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:44:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:44:52.242+0000 7f58dc7a9800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:44:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:44:52.242+0000 7f58dc7a9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:44:52.242+0000 7f58dc7a9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35, ofs0, ns] 2024-09-12T17:44:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:44:52.242+0000 7f57bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562438 cookie 94736040483104 notifier 7632 bl.length()=995 2024-09-12T17:44:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:44:52.242+0000 7f57bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:44:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:44:52.242+0000 7f57bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:44:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:44:52.242+0000 7f57bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:44:52.242+0000 7f58dc7a9800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): orig_sources= new_sources= 2024-09-12T17:44:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:44:52.242+0000 7f58dc7a9800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): potential sources added=[] removed=[] 2024-09-12T17:44:52.395 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:44:52.242+0000 7f58dc7a9800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): orig_dests= new_dests= 2024-09-12T17:44:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:44:52.242+0000 7f58dc7a9800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): potential dests added=[] removed=[] 2024-09-12T17:44:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:44:52.248+0000 7f58dc7a9800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f58dc7a9800 time 2024-09-12T17:44:52.248860+0000 2024-09-12T17:44:52.396 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:44:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f58dfd8c71a] 2024-09-12T17:44:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f58dfd8c8d8] 2024-09-12T17:44:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562971769841] 2024-09-12T17:44:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56297177957a] 2024-09-12T17:44:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2024-09-12T17:44:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f58dea29590] 2024-09-12T17:44:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2024-09-12T17:44:52.396 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2024-09-12T17:44:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:44:52.248+0000 7f58dc7a9800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:44:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f58dc7a9800 thread_name:radosgw-admin 2024-09-12T17:44:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:44:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f58dea3e6f0] 2024-09-12T17:44:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f58dea8b99c] 2024-09-12T17:44:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:44:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:44:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f58dfd8c774] 2024-09-12T17:44:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f58dfd8c8d8] 2024-09-12T17:44:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562971769841] 2024-09-12T17:44:52.397 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56297177957a] 2024-09-12T17:44:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2024-09-12T17:44:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f58dea29590] 2024-09-12T17:44:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2024-09-12T17:44:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2024-09-12T17:44:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:44:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.398 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:44:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:44:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:44:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:44:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:44:52.398 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:44:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:44:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:44:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:44:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:44:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:44:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:44:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:44:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:44:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:44:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:44:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:44:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:44:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:44:52.399 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:44:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:44:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:44:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:44:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:44:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:44:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:44:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:44:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:44:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:44:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:44:52.400 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:44:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:44:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:44:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:44:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:44:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:44:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:44:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:44:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:44:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:44:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:44:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:44:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:44:52.401 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:44:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:44:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:44:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:44:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:44:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:44:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:44:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:44:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:44:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:44:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:44:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:44:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:44:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:44:52.402 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:44:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:44:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:44:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:44:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:44:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:44:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:44:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:44:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:44:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:44:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:44:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:44:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:44:52.403 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:44:52.404 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:44:52.404 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:44:52.404 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:44:52.404 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:44:52.404 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:44:52.404 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:44:52.404 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:44:52.404 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:44:52.404 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:44:52.404 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:44:52.404 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:44:52.404 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:44:52.405 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:44:52.405 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:44:52.405 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:44:52.405 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:44:52.405 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:44:52.405 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:44:52.405 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:44:52.405 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:44:52.405 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:44:52.405 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:44:52.405 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:44:52.405 INFO:tasks.workunit.client.0.smithi044.stderr: 7f57097fa640 / http_manager 2024-09-12T17:44:52.406 INFO:tasks.workunit.client.0.smithi044.stderr: 7f570b7fe640 / http_manager 2024-09-12T17:44:52.406 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5790fe1640 / rgw_dt_lg_renew 2024-09-12T17:44:52.406 INFO:tasks.workunit.client.0.smithi044.stderr: 7f57abfff640 / ms_dispatch 2024-09-12T17:44:52.406 INFO:tasks.workunit.client.0.smithi044.stderr: 7f57bd7fa640 / io_context_pool 2024-09-12T17:44:52.406 INFO:tasks.workunit.client.0.smithi044.stderr: 7f57bdffb640 / io_context_pool 2024-09-12T17:44:52.406 INFO:tasks.workunit.client.0.smithi044.stderr: 7f57bffff640 / ms_dispatch 2024-09-12T17:44:52.406 INFO:tasks.workunit.client.0.smithi044.stderr: 7f57c6e05640 / ms_dispatch 2024-09-12T17:44:52.406 INFO:tasks.workunit.client.0.smithi044.stderr: 7f57c8608640 / io_context_pool 2024-09-12T17:44:52.406 INFO:tasks.workunit.client.0.smithi044.stderr: 7f58d9a92640 / msgr-worker-2 2024-09-12T17:44:52.406 INFO:tasks.workunit.client.0.smithi044.stderr: 7f58da293640 / msgr-worker-1 2024-09-12T17:44:52.406 INFO:tasks.workunit.client.0.smithi044.stderr: 7f58daa94640 / msgr-worker-0 2024-09-12T17:44:52.406 INFO:tasks.workunit.client.0.smithi044.stderr: 7f58db295640 / io_context_pool 2024-09-12T17:44:52.406 INFO:tasks.workunit.client.0.smithi044.stderr: 7f58dc7a9800 / radosgw-admin 2024-09-12T17:44:52.406 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:44:52.406 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:44:52.407 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:44:52.250265Z_1b9349c1-7f70-4980-b201-196578dd4a17/log 2024-09-12T17:44:52.407 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:44:52.407 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:44:52.408 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:52.408 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:52.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.327+0000 7efdc093d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.328+0000 7efdc093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.328+0000 7efdc093d800 20 realm 2024-09-12T17:44:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.328+0000 7efdc093d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.329+0000 7efdc093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.329+0000 7efdc093d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.329+0000 7efdc093d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.329+0000 7efdc093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.329+0000 7efdc093d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.330+0000 7efdc093d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.330+0000 7efdc093d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.330+0000 7efdc093d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.330+0000 7efdc093d800 20 searching for the correct realm 2024-09-12T17:44:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.333+0000 7efdbbe29640 0 -- 172.21.15.44:0/3786845859 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7efdac096050 msgr2=0x7efdac04c1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:52.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.336+0000 7efdbc62a640 0 -- 172.21.15.44:0/3786845859 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7efda406c920 msgr2=0x7efda4096400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:52.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.543+0000 7efdc093d800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:52.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.543+0000 7efdc093d800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:52.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.543+0000 7efdc093d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:52.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.543+0000 7efdc093d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:52.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.543+0000 7efdc093d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:52.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.543+0000 7efdc093d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:52.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.543+0000 7efdc093d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.544+0000 7efdc093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.544+0000 7efdc093d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.544+0000 7efdc093d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:52.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.544+0000 7efdc093d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.544+0000 7efdc093d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:52.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.544+0000 7efdc093d800 20 zone default found 2024-09-12T17:44:52.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.544+0000 7efdc093d800 4 Realm: () 2024-09-12T17:44:52.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.544+0000 7efdc093d800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:52.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.544+0000 7efdc093d800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:52.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.544+0000 7efdc093d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:52.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.544+0000 7efdc093d800 20 zonegroup default 2024-09-12T17:44:52.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.544+0000 7efdc093d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.545+0000 7efdc093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.545+0000 7efdc093d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.545+0000 7efdc093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.545+0000 7efdc093d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.545+0000 7efdc093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.545+0000 7efdc093d800 20 started sync module instance, tier type = 2024-09-12T17:44:52.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.545+0000 7efdc093d800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:52.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.555+0000 7efdc093d800 20 add_watcher() i=0 2024-09-12T17:44:52.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.555+0000 7efdc093d800 20 add_watcher() i=1 2024-09-12T17:44:52.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.555+0000 7efdc093d800 20 add_watcher() i=2 2024-09-12T17:44:52.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.555+0000 7efdc093d800 20 add_watcher() i=3 2024-09-12T17:44:52.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.555+0000 7efdc093d800 20 add_watcher() i=4 2024-09-12T17:44:52.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.555+0000 7efdc093d800 20 add_watcher() i=5 2024-09-12T17:44:52.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.555+0000 7efdc093d800 20 add_watcher() i=6 2024-09-12T17:44:52.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.556+0000 7efdc093d800 20 add_watcher() i=7 2024-09-12T17:44:52.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.556+0000 7efdc093d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:52.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.557+0000 7efc72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:52.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.557+0000 7efdc093d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:52.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.557+0000 7efdc093d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:52.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.558+0000 7efdc093d800 5 note: GC not initialized 2024-09-12T17:44:52.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.558+0000 7efc71fdb640 20 reqs_thread_entry: start 2024-09-12T17:44:52.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.558+0000 7efdc093d800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:52.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.558+0000 7efdc093d800 20 Filter name: none 2024-09-12T17:44:52.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.558+0000 7efbe37fe640 20 reqs_thread_entry: start 2024-09-12T17:44:52.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.558+0000 7efdc093d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.559+0000 7efdc093d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:44:52.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.559+0000 7efdc093d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.559+0000 7efdc093d800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:44:52.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.559+0000 7efdc093d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:52.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.559+0000 7efdc093d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.560+0000 7efdc093d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:44:52.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.560+0000 7efdc093d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.560+0000 7efdc093d800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:44:52.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.560+0000 7efdc093d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:44:52.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.561+0000 7efc72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:52.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.564+0000 7efdc093d800 20 remove_watcher() i=0 2024-09-12T17:44:52.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.564+0000 7efdc093d800 2 removed watcher, disabling cache 2024-09-12T17:44:52.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.566+0000 7efdc093d800 20 remove_watcher() i=1 2024-09-12T17:44:52.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.567+0000 7efdc093d800 20 remove_watcher() i=2 2024-09-12T17:44:52.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.568+0000 7efdc093d800 20 remove_watcher() i=3 2024-09-12T17:44:52.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.569+0000 7efdc093d800 20 remove_watcher() i=4 2024-09-12T17:44:52.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.570+0000 7efdc093d800 20 remove_watcher() i=5 2024-09-12T17:44:52.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.571+0000 7efdc093d800 20 remove_watcher() i=6 2024-09-12T17:44:52.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.572+0000 7efdc093d800 20 remove_watcher() i=7 2024-09-12T17:44:52.584 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.584 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:44:52.584 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-do-reshard id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:44:52.585 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:44:52.637 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:44:52.670 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:52.670 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:52.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.708+0000 7f0a1b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.710+0000 7f0a1b13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.710+0000 7f0a1b13d800 20 realm 2024-09-12T17:44:52.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.710+0000 7f0a1b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.710+0000 7f0a1b13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.710+0000 7f0a1b13d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:52.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.710+0000 7f0a1b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.710+0000 7f0a1b13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:52.713 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.710+0000 7f0a1b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.713 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.711+0000 7f0a1b13d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:52.713 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.711+0000 7f0a1b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:52.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.711+0000 7f0a1b13d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:52.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.711+0000 7f0a1b13d800 20 searching for the correct realm 2024-09-12T17:44:52.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.715+0000 7f0a16629640 0 -- 172.21.15.44:0/2103460315 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f0a0809c070 msgr2=0x7f0a080d5ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:52.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:52.921+0000 7f0a16e2a640 0 -- 172.21.15.44:0/2103460315 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f0a0c071040 msgr2=0x7f0a0c068860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:53.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.128+0000 7f0a1b13d800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:44:53.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.128+0000 7f0a1b13d800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:44:53.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.128+0000 7f0a1b13d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:53.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.128+0000 7f0a1b13d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:53.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.128+0000 7f0a1b13d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:53.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.128+0000 7f0a1b13d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:53.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.128+0000 7f0a1b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.128+0000 7f0a1b13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.128+0000 7f0a1b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.128+0000 7f0a1b13d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:53.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.128+0000 7f0a1b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.129+0000 7f0a1b13d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:53.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.129+0000 7f0a1b13d800 20 zone default found 2024-09-12T17:44:53.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.129+0000 7f0a1b13d800 4 Realm: () 2024-09-12T17:44:53.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.129+0000 7f0a1b13d800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:44:53.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.129+0000 7f0a1b13d800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:44:53.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.129+0000 7f0a1b13d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:53.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.129+0000 7f0a1b13d800 20 zonegroup default 2024-09-12T17:44:53.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.129+0000 7f0a1b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.129+0000 7f0a1b13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.129+0000 7f0a1b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.130+0000 7f0a1b13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.130+0000 7f0a1b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.130+0000 7f0a1b13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:53.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.130+0000 7f0a1b13d800 20 started sync module instance, tier type = 2024-09-12T17:44:53.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.130+0000 7f0a1b13d800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:44:53.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.140+0000 7f0a1b13d800 20 add_watcher() i=0 2024-09-12T17:44:53.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.140+0000 7f0a1b13d800 20 add_watcher() i=1 2024-09-12T17:44:53.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.140+0000 7f0a1b13d800 20 add_watcher() i=2 2024-09-12T17:44:53.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.140+0000 7f0a1b13d800 20 add_watcher() i=3 2024-09-12T17:44:53.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.140+0000 7f0a1b13d800 20 add_watcher() i=4 2024-09-12T17:44:53.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.140+0000 7f0a1b13d800 20 add_watcher() i=5 2024-09-12T17:44:53.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.140+0000 7f0a1b13d800 20 add_watcher() i=6 2024-09-12T17:44:53.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.141+0000 7f0a1b13d800 20 add_watcher() i=7 2024-09-12T17:44:53.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.141+0000 7f0a1b13d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:53.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.143+0000 7f08cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:53.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.143+0000 7f0a1b13d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:53.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.143+0000 7f0a1b13d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:53.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.143+0000 7f0a1b13d800 5 note: GC not initialized 2024-09-12T17:44:53.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.144+0000 7f0847fff640 20 reqs_thread_entry: start 2024-09-12T17:44:53.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.144+0000 7f0a1b13d800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:53.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.144+0000 7f0a1b13d800 20 Filter name: none 2024-09-12T17:44:53.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.144+0000 7f0845ffb640 20 reqs_thread_entry: start 2024-09-12T17:44:53.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.144+0000 7f0a1b13d800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:44:53.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.144+0000 7f0a1b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.144+0000 7f0a1b13d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:44:53.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.144+0000 7f0a1b13d800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:44:53.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.144+0000 7f0a1b13d800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:44:53.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.144+0000 7f0a1b13d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 : miss 2024-09-12T17:44:53.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.144+0000 7f0a1b13d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:53.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.145+0000 7f0a1b13d800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:44:53.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.145+0000 7f0a1b13d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:44:53.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.145+0000 7f0a1b13d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:44:53.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.145+0000 7f0a1b13d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:44:53.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.145+0000 7f0a1b13d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:44:53.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.145+0000 7f0a1b13d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 2024-09-12T17:44:53.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.146+0000 7f0a1b13d800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to be held by another RGW process; skipping for now 2024-09-12T17:44:53.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.147+0000 7f08cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:53.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.150+0000 7f0a1b13d800 20 remove_watcher() i=0 2024-09-12T17:44:53.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.150+0000 7f0a1b13d800 2 removed watcher, disabling cache 2024-09-12T17:44:53.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.151+0000 7f0a1b13d800 20 remove_watcher() i=1 2024-09-12T17:44:53.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.152+0000 7f0a1b13d800 20 remove_watcher() i=2 2024-09-12T17:44:53.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.153+0000 7f0a1b13d800 20 remove_watcher() i=3 2024-09-12T17:44:53.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.154+0000 7f0a1b13d800 20 remove_watcher() i=4 2024-09-12T17:44:53.157 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.155+0000 7f0a1b13d800 20 remove_watcher() i=5 2024-09-12T17:44:53.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.156+0000 7f0a1b13d800 20 remove_watcher() i=6 2024-09-12T17:44:53.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:44:53.157+0000 7f0a1b13d800 20 remove_watcher() i=7 2024-09-12T17:44:53.170 INFO:tasks.workunit.client.0.smithi044.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:45:23.197 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:45:23.234 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:23.234 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:23.279 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.279+0000 7f3245325800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.280+0000 7f3245325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:23.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.280+0000 7f3245325800 20 realm 2024-09-12T17:45:23.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.280+0000 7f3245325800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.280+0000 7f3245325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:23.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.280+0000 7f3245325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:23.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.280+0000 7f3245325800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.281+0000 7f3245325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:23.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.281+0000 7f3245325800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.282+0000 7f3245325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:23.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.282+0000 7f3245325800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.282+0000 7f3245325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:23.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.282+0000 7f3245325800 20 searching for the correct realm 2024-09-12T17:45:23.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.285+0000 7f32407b4640 0 -- 172.21.15.44:0/2911325366 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f3230031070 msgr2=0x7f323004b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:23.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.289+0000 7f3240fb5640 0 -- 172.21.15.44:0/2911325366 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f32340b2340 msgr2=0x7f32340da820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:23.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.496+0000 7f3245325800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:23.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.496+0000 7f3245325800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:23.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.496+0000 7f3245325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:23.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.496+0000 7f3245325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:23.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.496+0000 7f3245325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:23.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.496+0000 7f3245325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:23.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.496+0000 7f3245325800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.496+0000 7f3245325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:23.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.496+0000 7f3245325800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.497+0000 7f3245325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:23.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.497+0000 7f3245325800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.497+0000 7f3245325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:23.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.497+0000 7f3245325800 20 zone default found 2024-09-12T17:45:23.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.497+0000 7f3245325800 4 Realm: () 2024-09-12T17:45:23.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.497+0000 7f3245325800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:23.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.497+0000 7f3245325800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:23.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.497+0000 7f3245325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:23.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.497+0000 7f3245325800 20 zonegroup default 2024-09-12T17:45:23.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.497+0000 7f3245325800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.498+0000 7f3245325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:23.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.498+0000 7f3245325800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.498+0000 7f3245325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:23.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.498+0000 7f3245325800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.498+0000 7f3245325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:23.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.498+0000 7f3245325800 20 started sync module instance, tier type = 2024-09-12T17:45:23.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.498+0000 7f3245325800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:23.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.509+0000 7f3245325800 20 add_watcher() i=0 2024-09-12T17:45:23.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.509+0000 7f3245325800 20 add_watcher() i=1 2024-09-12T17:45:23.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.509+0000 7f3245325800 20 add_watcher() i=2 2024-09-12T17:45:23.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.509+0000 7f3245325800 20 add_watcher() i=3 2024-09-12T17:45:23.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.509+0000 7f3245325800 20 add_watcher() i=4 2024-09-12T17:45:23.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.509+0000 7f3245325800 20 add_watcher() i=5 2024-09-12T17:45:23.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.509+0000 7f3245325800 20 add_watcher() i=6 2024-09-12T17:45:23.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.510+0000 7f3245325800 20 add_watcher() i=7 2024-09-12T17:45:23.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.510+0000 7f3245325800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:23.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.512+0000 7f30f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:23.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.512+0000 7f3245325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:23.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.512+0000 7f3245325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:23.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.512+0000 7f3245325800 5 note: GC not initialized 2024-09-12T17:45:23.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.512+0000 7f30f5fe3640 20 reqs_thread_entry: start 2024-09-12T17:45:23.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.513+0000 7f3245325800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:23.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.513+0000 7f3245325800 20 Filter name: none 2024-09-12T17:45:23.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.513+0000 7f30677fe640 20 reqs_thread_entry: start 2024-09-12T17:45:23.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.513+0000 7f3245325800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:45:23.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.513+0000 7f3245325800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.514+0000 7f3245325800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:45:23.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.514+0000 7f3245325800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:45:23.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.514+0000 7f3245325800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:45:23.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.514+0000 7f3245325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 : miss 2024-09-12T17:45:23.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.514+0000 7f3245325800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.514+0000 7f3245325800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:45:23.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.514+0000 7f3245325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:45:23.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.514+0000 7f3245325800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:45:23.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.514+0000 7f3245325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:23.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.514+0000 7f3245325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:23.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.514+0000 7f3245325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 2024-09-12T17:45:23.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.516+0000 7f3245325800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:45:23.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.522+0000 7f3245325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:45:23.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.522+0000 7f3245325800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:45:23.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.522+0000 7f3245325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:23.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.522+0000 7f3245325800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35, ofs0, ns] 2024-09-12T17:45:23.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.523+0000 7f31177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562439 cookie 94843689969536 notifier 7163 bl.length()=995 2024-09-12T17:45:23.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.523+0000 7f31177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:45:23.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.523+0000 7f31177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:45:23.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.523+0000 7f31177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:23.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.523+0000 7f3245325800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): orig_sources= new_sources= 2024-09-12T17:45:23.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.523+0000 7f3245325800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): potential sources added=[] removed=[] 2024-09-12T17:45:23.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.523+0000 7f3245325800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): orig_dests= new_dests= 2024-09-12T17:45:23.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.523+0000 7f3245325800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): potential dests added=[] removed=[] 2024-09-12T17:45:23.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.0 2024-09-12T17:45:23.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.0 2024-09-12T17:45:23.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.1 2024-09-12T17:45:23.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.1 2024-09-12T17:45:23.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.2 2024-09-12T17:45:23.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.2 2024-09-12T17:45:23.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.3 2024-09-12T17:45:23.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.3 2024-09-12T17:45:23.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.4 2024-09-12T17:45:23.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.4 2024-09-12T17:45:23.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.5 2024-09-12T17:45:23.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.5 2024-09-12T17:45:23.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.6 2024-09-12T17:45:23.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.6 2024-09-12T17:45:23.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.7 2024-09-12T17:45:23.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.7 2024-09-12T17:45:23.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.8 2024-09-12T17:45:23.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.8 2024-09-12T17:45:23.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.9 2024-09-12T17:45:23.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.9 2024-09-12T17:45:23.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.10 2024-09-12T17:45:23.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.10 2024-09-12T17:45:23.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.11 2024-09-12T17:45:23.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2.11 2024-09-12T17:45:23.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.528+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.0 2024-09-12T17:45:23.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.529+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.1 2024-09-12T17:45:23.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.529+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2 2024-09-12T17:45:23.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.530+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.3 2024-09-12T17:45:23.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.530+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.4 2024-09-12T17:45:23.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.531+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.5 2024-09-12T17:45:23.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.531+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.6 2024-09-12T17:45:23.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.532+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.7 2024-09-12T17:45:23.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.532+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.8 2024-09-12T17:45:23.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.533+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.9 2024-09-12T17:45:23.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.534+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.10 2024-09-12T17:45:23.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.538+0000 7f3245325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:45:23.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.538+0000 7f3245325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 2024-09-12T17:45:23.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.540+0000 7f3245325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:45:23.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.540+0000 7f3245325800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:45:23.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.540+0000 7f3245325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:23.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.540+0000 7f3245325800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35, ofs0, ns] 2024-09-12T17:45:23.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.540+0000 7f3117fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562440 cookie 94843689969536 notifier 7163 bl.length()=995 2024-09-12T17:45:23.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.540+0000 7f3117fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:45:23.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.540+0000 7f3117fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:45:23.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.540+0000 7f3117fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:23.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.541+0000 7f3245325800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): orig_sources= new_sources= 2024-09-12T17:45:23.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.541+0000 7f3245325800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): potential sources added=[] removed=[] 2024-09-12T17:45:23.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.541+0000 7f3245325800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): orig_dests= new_dests= 2024-09-12T17:45:23.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.541+0000 7f3245325800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): potential dests added=[] removed=[] 2024-09-12T17:45:23.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.543+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.0 2024-09-12T17:45:23.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.543+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.1 2024-09-12T17:45:23.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.544+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.2 2024-09-12T17:45:23.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.544+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.3 2024-09-12T17:45:23.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.544+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.4 2024-09-12T17:45:23.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.545+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.5 2024-09-12T17:45:23.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.545+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.6 2024-09-12T17:45:23.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.545+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.7 2024-09-12T17:45:23.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.546+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.8 2024-09-12T17:45:23.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.546+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.9 2024-09-12T17:45:23.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.546+0000 7f3245325800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35.10 2024-09-12T17:45:23.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.547+0000 7f3245325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:45:23.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.547+0000 7f3245325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 2024-09-12T17:45:23.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.548+0000 7f3245325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:45:23.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.548+0000 7f3245325800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:45:23.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.548+0000 7f3245325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:23.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.548+0000 7f3245325800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35, ofs0, ns] 2024-09-12T17:45:23.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.549+0000 7f3117fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562441 cookie 94843689969536 notifier 7163 bl.length()=963 2024-09-12T17:45:23.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.549+0000 7f3117fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 info.flags=0x17 2024-09-12T17:45:23.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.549+0000 7f3117fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 to cache LRU end 2024-09-12T17:45:23.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.549+0000 7f3117fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:23.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.549+0000 7f3245325800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): orig_sources= new_sources= 2024-09-12T17:45:23.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.549+0000 7f3245325800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): potential sources added=[] removed=[] 2024-09-12T17:45:23.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.549+0000 7f3245325800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): orig_dests= new_dests= 2024-09-12T17:45:23.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.549+0000 7f3245325800 20 handle_bi_update(): bucket=:abort-at-do-reshard[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35]): potential dests added=[] removed=[] 2024-09-12T17:45:23.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.552+0000 7f3245325800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T17:45:23.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.554+0000 7f30f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:23.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.557+0000 7f3245325800 20 remove_watcher() i=0 2024-09-12T17:45:23.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.557+0000 7f3245325800 2 removed watcher, disabling cache 2024-09-12T17:45:23.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.558+0000 7f3245325800 20 remove_watcher() i=1 2024-09-12T17:45:23.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.559+0000 7f3245325800 20 remove_watcher() i=2 2024-09-12T17:45:23.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.560+0000 7f3245325800 20 remove_watcher() i=3 2024-09-12T17:45:23.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.561+0000 7f3245325800 20 remove_watcher() i=4 2024-09-12T17:45:23.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.562+0000 7f3245325800 20 remove_watcher() i=5 2024-09-12T17:45:23.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.563+0000 7f3245325800 20 remove_watcher() i=6 2024-09-12T17:45:23.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.564+0000 7f3245325800 20 remove_watcher() i=7 2024-09-12T17:45:23.578 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:45:23.608 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:23.608 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:23.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.647+0000 7f4225935800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.648+0000 7f4225935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:23.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.648+0000 7f4225935800 20 realm 2024-09-12T17:45:23.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.648+0000 7f4225935800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.649+0000 7f4225935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:23.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.649+0000 7f4225935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:23.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.649+0000 7f4225935800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.649+0000 7f4225935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:23.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.649+0000 7f4225935800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.650+0000 7f4225935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:23.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.650+0000 7f4225935800 20 rados->read ofs=0 len=0 2024-09-12T17:45:23.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.650+0000 7f4225935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:23.651 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.650+0000 7f4225935800 20 searching for the correct realm 2024-09-12T17:45:23.653 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.653+0000 7f4220e7c640 0 -- 172.21.15.44:0/938030941 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f4214047040 msgr2=0x7f42140533f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:23.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:23.860+0000 7f422167d640 0 -- 172.21.15.44:0/938030941 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f42180af820 msgr2=0x7f42180e1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:24.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.068+0000 7f4225935800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:24.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.068+0000 7f4225935800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:24.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.068+0000 7f4225935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:24.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.068+0000 7f4225935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:24.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.068+0000 7f4225935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:24.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.068+0000 7f4225935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:24.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.068+0000 7f4225935800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.068+0000 7f4225935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.068+0000 7f4225935800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.069+0000 7f4225935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:24.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.069+0000 7f4225935800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.069+0000 7f4225935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:24.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.069+0000 7f4225935800 20 zone default found 2024-09-12T17:45:24.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.069+0000 7f4225935800 4 Realm: () 2024-09-12T17:45:24.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.069+0000 7f4225935800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:24.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.069+0000 7f4225935800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.069+0000 7f4225935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.069+0000 7f4225935800 20 zonegroup default 2024-09-12T17:45:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.069+0000 7f4225935800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.069+0000 7f4225935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.069+0000 7f4225935800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.070+0000 7f4225935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.070+0000 7f4225935800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.070+0000 7f4225935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.070+0000 7f4225935800 20 started sync module instance, tier type = 2024-09-12T17:45:24.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.070+0000 7f4225935800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:24.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.080+0000 7f4225935800 20 add_watcher() i=0 2024-09-12T17:45:24.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.080+0000 7f4225935800 20 add_watcher() i=1 2024-09-12T17:45:24.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.080+0000 7f4225935800 20 add_watcher() i=2 2024-09-12T17:45:24.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.080+0000 7f4225935800 20 add_watcher() i=3 2024-09-12T17:45:24.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.080+0000 7f4225935800 20 add_watcher() i=4 2024-09-12T17:45:24.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.080+0000 7f4225935800 20 add_watcher() i=5 2024-09-12T17:45:24.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.080+0000 7f4225935800 20 add_watcher() i=6 2024-09-12T17:45:24.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.082+0000 7f4225935800 20 add_watcher() i=7 2024-09-12T17:45:24.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.082+0000 7f4225935800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:24.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.084+0000 7f40d7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:24.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.084+0000 7f4225935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:24.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.084+0000 7f4225935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:24.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.084+0000 7f4225935800 5 note: GC not initialized 2024-09-12T17:45:24.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.084+0000 7f40d6fe5640 20 reqs_thread_entry: start 2024-09-12T17:45:24.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.085+0000 7f4225935800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:24.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.085+0000 7f4225935800 20 Filter name: none 2024-09-12T17:45:24.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.085+0000 7f40d4fe1640 20 reqs_thread_entry: start 2024-09-12T17:45:24.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.085+0000 7f4225935800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.085+0000 7f4225935800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:45:24.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.085+0000 7f4225935800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.086+0000 7f4225935800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:45:24.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.086+0000 7f4225935800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:24.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.086+0000 7f4225935800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.086+0000 7f4225935800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:45:24.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.086+0000 7f4225935800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.087+0000 7f4225935800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:45:24.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.087+0000 7f4225935800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:24.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.089+0000 7f40d7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:24.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.091+0000 7f4225935800 20 remove_watcher() i=0 2024-09-12T17:45:24.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.091+0000 7f4225935800 2 removed watcher, disabling cache 2024-09-12T17:45:24.093 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.092+0000 7f4225935800 20 remove_watcher() i=1 2024-09-12T17:45:24.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.094+0000 7f4225935800 20 remove_watcher() i=2 2024-09-12T17:45:24.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.095+0000 7f4225935800 20 remove_watcher() i=3 2024-09-12T17:45:24.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.096+0000 7f4225935800 20 remove_watcher() i=4 2024-09-12T17:45:24.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.097+0000 7f4225935800 20 remove_watcher() i=5 2024-09-12T17:45:24.098 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.098+0000 7f4225935800 20 remove_watcher() i=6 2024-09-12T17:45:24.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.099+0000 7f4225935800 20 remove_watcher() i=7 2024-09-12T17:45:24.111 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:24.111 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:45:24.111 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-do-reshard id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:45:24.111 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:24.191 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T17:45:24.191 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:24.399 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:45:24.428 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:24.428 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:24.467 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.467+0000 7f113b719800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.468+0000 7f113b719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.468+0000 7f113b719800 20 realm 2024-09-12T17:45:24.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.468+0000 7f113b719800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.469+0000 7f113b719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.469+0000 7f113b719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:24.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.469+0000 7f113b719800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.469+0000 7f113b719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.469+0000 7f113b719800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.470+0000 7f113b719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:24.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.470+0000 7f113b719800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.470+0000 7f113b719800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:24.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.470+0000 7f113b719800 20 searching for the correct realm 2024-09-12T17:45:24.472 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.472+0000 7f1139203640 0 -- 172.21.15.44:0/1195877406 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7f1134027040 msgr2=0x7f113403a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:45:24.678 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.678+0000 7f1139a04640 0 -- 172.21.15.44:0/1195877406 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f1130046040 msgr2=0x7f1130046930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:24.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.683+0000 7f113b719800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:24.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.683+0000 7f113b719800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:24.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.683+0000 7f113b719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:24.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.683+0000 7f113b719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:24.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.683+0000 7f113b719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:24.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.683+0000 7f113b719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:24.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.683+0000 7f113b719800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.683+0000 7f113b719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.683+0000 7f113b719800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.684+0000 7f113b719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:24.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.684+0000 7f113b719800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.684+0000 7f113b719800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:24.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.684+0000 7f113b719800 20 zone default found 2024-09-12T17:45:24.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.684+0000 7f113b719800 4 Realm: () 2024-09-12T17:45:24.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.684+0000 7f113b719800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:24.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.684+0000 7f113b719800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:24.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.684+0000 7f113b719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:24.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.684+0000 7f113b719800 20 zonegroup default 2024-09-12T17:45:24.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.684+0000 7f113b719800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.684+0000 7f113b719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.684+0000 7f113b719800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.685+0000 7f113b719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.685+0000 7f113b719800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.685+0000 7f113b719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.685+0000 7f113b719800 20 started sync module instance, tier type = 2024-09-12T17:45:24.688 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.685+0000 7f113b719800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:24.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.694+0000 7f113b719800 20 add_watcher() i=0 2024-09-12T17:45:24.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.694+0000 7f113b719800 20 add_watcher() i=1 2024-09-12T17:45:24.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.694+0000 7f113b719800 20 add_watcher() i=2 2024-09-12T17:45:24.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.694+0000 7f113b719800 20 add_watcher() i=3 2024-09-12T17:45:24.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.694+0000 7f113b719800 20 add_watcher() i=4 2024-09-12T17:45:24.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.694+0000 7f113b719800 20 add_watcher() i=5 2024-09-12T17:45:24.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.694+0000 7f113b719800 20 add_watcher() i=6 2024-09-12T17:45:24.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.695+0000 7f113b719800 20 add_watcher() i=7 2024-09-12T17:45:24.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.695+0000 7f113b719800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:24.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.697+0000 7f0fef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:24.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.697+0000 7f113b719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:24.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.697+0000 7f113b719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:24.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.697+0000 7f113b719800 5 note: GC not initialized 2024-09-12T17:45:24.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.697+0000 7f0fee7e4640 20 reqs_thread_entry: start 2024-09-12T17:45:24.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.697+0000 7f113b719800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:24.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.697+0000 7f113b719800 20 Filter name: none 2024-09-12T17:45:24.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.697+0000 7f0f5ffff640 20 reqs_thread_entry: start 2024-09-12T17:45:24.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.698+0000 7f113b719800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.698+0000 7f113b719800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:24.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.698+0000 7f113b719800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.699+0000 7f113b719800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:45:24.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.699+0000 7f113b719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:24.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.699+0000 7f113b719800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.699+0000 7f113b719800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:24.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.699+0000 7f113b719800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.699+0000 7f113b719800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:45:24.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.699+0000 7f113b719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:24.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.701+0000 7f0fef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:24.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.703+0000 7f113b719800 20 remove_watcher() i=0 2024-09-12T17:45:24.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.703+0000 7f113b719800 2 removed watcher, disabling cache 2024-09-12T17:45:24.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.705+0000 7f113b719800 20 remove_watcher() i=1 2024-09-12T17:45:24.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.706+0000 7f113b719800 20 remove_watcher() i=2 2024-09-12T17:45:24.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.707+0000 7f113b719800 20 remove_watcher() i=3 2024-09-12T17:45:24.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.708+0000 7f113b719800 20 remove_watcher() i=4 2024-09-12T17:45:24.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.709+0000 7f113b719800 20 remove_watcher() i=5 2024-09-12T17:45:24.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.710+0000 7f113b719800 20 remove_watcher() i=6 2024-09-12T17:45:24.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.711+0000 7f113b719800 20 remove_watcher() i=7 2024-09-12T17:45:24.722 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:24.722 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:45:24.722 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-logrecord-writes id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:45:24.722 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:24.724 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T17:45:24.759 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:24.759 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:24.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.799+0000 7f9d7a575800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.801+0000 7f9d7a575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.801+0000 7f9d7a575800 20 realm 2024-09-12T17:45:24.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.801+0000 7f9d7a575800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.801+0000 7f9d7a575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.801+0000 7f9d7a575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:24.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.801+0000 7f9d7a575800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.801+0000 7f9d7a575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.801+0000 7f9d7a575800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.802+0000 7f9d7a575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:24.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.802+0000 7f9d7a575800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.802+0000 7f9d7a575800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:24.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.802+0000 7f9d7a575800 20 searching for the correct realm 2024-09-12T17:45:24.807 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.806+0000 7f9d77865640 0 -- 172.21.15.44:0/3171375734 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f9d6806c770 msgr2=0x7f9d68072f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:45:24.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.810+0000 7f9d77865640 0 -- 172.21.15.44:0/3171375734 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f9c400862f0 msgr2=0x7f9c40088720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:24.814 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.813+0000 7f9d7a575800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:24.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.813+0000 7f9d7a575800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:24.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.813+0000 7f9d7a575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:24.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.813+0000 7f9d7a575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:24.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.813+0000 7f9d7a575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:24.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.813+0000 7f9d7a575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:24.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.813+0000 7f9d7a575800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.814+0000 7f9d7a575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.814+0000 7f9d7a575800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.814+0000 7f9d7a575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:24.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.814+0000 7f9d7a575800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.816 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.814+0000 7f9d7a575800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:24.816 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.814+0000 7f9d7a575800 20 zone default found 2024-09-12T17:45:24.816 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.814+0000 7f9d7a575800 4 Realm: () 2024-09-12T17:45:24.816 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.814+0000 7f9d7a575800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:24.816 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.814+0000 7f9d7a575800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:24.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.814+0000 7f9d7a575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:24.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.814+0000 7f9d7a575800 20 zonegroup default 2024-09-12T17:45:24.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.814+0000 7f9d7a575800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.815+0000 7f9d7a575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.815+0000 7f9d7a575800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.815+0000 7f9d7a575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.815+0000 7f9d7a575800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.815+0000 7f9d7a575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.815+0000 7f9d7a575800 20 started sync module instance, tier type = 2024-09-12T17:45:24.817 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.815+0000 7f9d7a575800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:24.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.824+0000 7f9d7a575800 20 add_watcher() i=0 2024-09-12T17:45:24.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.824+0000 7f9d7a575800 20 add_watcher() i=1 2024-09-12T17:45:24.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.824+0000 7f9d7a575800 20 add_watcher() i=2 2024-09-12T17:45:24.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.824+0000 7f9d7a575800 20 add_watcher() i=3 2024-09-12T17:45:24.824 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.824+0000 7f9d7a575800 20 add_watcher() i=4 2024-09-12T17:45:24.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.824+0000 7f9d7a575800 20 add_watcher() i=5 2024-09-12T17:45:24.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.824+0000 7f9d7a575800 20 add_watcher() i=6 2024-09-12T17:45:24.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.825+0000 7f9d7a575800 20 add_watcher() i=7 2024-09-12T17:45:24.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.825+0000 7f9d7a575800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:24.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.826+0000 7f9c2efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:24.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.827+0000 7f9d7a575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:24.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.827+0000 7f9d7a575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:24.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.827+0000 7f9d7a575800 5 note: GC not initialized 2024-09-12T17:45:24.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.827+0000 7f9c2dfdb640 20 reqs_thread_entry: start 2024-09-12T17:45:24.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.827+0000 7f9d7a575800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:24.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.827+0000 7f9d7a575800 20 Filter name: none 2024-09-12T17:45:24.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.827+0000 7f9b9f7fe640 20 reqs_thread_entry: start 2024-09-12T17:45:24.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.827+0000 7f9d7a575800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:45:24.828 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.827+0000 7f9d7a575800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.829 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.828+0000 7f9d7a575800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:24.829 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.828+0000 7f9d7a575800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:45:24.829 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.828+0000 7f9d7a575800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:45:24.829 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.828+0000 7f9d7a575800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 : miss 2024-09-12T17:45:24.829 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.828+0000 7f9d7a575800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.829 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.828+0000 7f9d7a575800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:45:24.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.828+0000 7f9d7a575800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 info.flags=0x17 2024-09-12T17:45:24.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.828+0000 7f9d7a575800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 to cache LRU end 2024-09-12T17:45:24.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.828+0000 7f9d7a575800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:24.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.828+0000 7f9d7a575800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:24.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.828+0000 7f9d7a575800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 2024-09-12T17:45:24.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.833+0000 7f9d7a575800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 info.flags=0x17 2024-09-12T17:45:24.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.833+0000 7f9d7a575800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 to cache LRU end 2024-09-12T17:45:24.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.833+0000 7f9d7a575800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:24.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.833+0000 7f9d7a575800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36, ofs0, ns] 2024-09-12T17:45:24.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.833+0000 7f9c4f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562444 cookie 94746499994800 notifier 7211 bl.length()=1007 2024-09-12T17:45:24.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.833+0000 7f9c4f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 info.flags=0x17 2024-09-12T17:45:24.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.833+0000 7f9c4f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 to cache LRU end 2024-09-12T17:45:24.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.833+0000 7f9c4f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:24.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.834+0000 7f9d7a575800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): orig_sources= new_sources= 2024-09-12T17:45:24.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.834+0000 7f9d7a575800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): potential sources added=[] removed=[] 2024-09-12T17:45:24.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.834+0000 7f9d7a575800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): orig_dests= new_dests= 2024-09-12T17:45:24.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.834+0000 7f9d7a575800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): potential dests added=[] removed=[] 2024-09-12T17:45:24.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.836+0000 7f9d7a575800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T17:45:24.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.836+0000 7f9d7a575800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:45:24.841 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.841+0000 7f9d7a575800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:45:24.841 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.841+0000 7f9d7a575800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 2024-09-12T17:45:24.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.842+0000 7f9d7a575800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 info.flags=0x17 2024-09-12T17:45:24.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.842+0000 7f9d7a575800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 to cache LRU end 2024-09-12T17:45:24.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.842+0000 7f9d7a575800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:24.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.842+0000 7f9d7a575800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36, ofs0, ns] 2024-09-12T17:45:24.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.842+0000 7f9c4f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562445 cookie 94746499994800 notifier 7211 bl.length()=975 2024-09-12T17:45:24.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.842+0000 7f9c4f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 info.flags=0x17 2024-09-12T17:45:24.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.842+0000 7f9c4f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 to cache LRU end 2024-09-12T17:45:24.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.842+0000 7f9c4f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:24.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.842+0000 7f9d7a575800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): orig_sources= new_sources= 2024-09-12T17:45:24.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.842+0000 7f9d7a575800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): potential sources added=[] removed=[] 2024-09-12T17:45:24.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.842+0000 7f9d7a575800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): orig_dests= new_dests= 2024-09-12T17:45:24.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.842+0000 7f9d7a575800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): potential dests added=[] removed=[] 2024-09-12T17:45:24.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.844+0000 7f9c2efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:24.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.847+0000 7f9d7a575800 20 remove_watcher() i=0 2024-09-12T17:45:24.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.847+0000 7f9d7a575800 2 removed watcher, disabling cache 2024-09-12T17:45:24.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.848+0000 7f9d7a575800 20 remove_watcher() i=1 2024-09-12T17:45:24.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.849+0000 7f9d7a575800 20 remove_watcher() i=2 2024-09-12T17:45:24.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.850+0000 7f9d7a575800 20 remove_watcher() i=3 2024-09-12T17:45:24.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.851+0000 7f9d7a575800 20 remove_watcher() i=4 2024-09-12T17:45:24.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.852+0000 7f9d7a575800 20 remove_watcher() i=5 2024-09-12T17:45:24.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.853+0000 7f9d7a575800 20 remove_watcher() i=6 2024-09-12T17:45:24.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.854+0000 7f9d7a575800 20 remove_watcher() i=7 2024-09-12T17:45:24.867 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:45:24.896 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:24.896 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:24.935 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.935+0000 7f1040887800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.937+0000 7f1040887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.937+0000 7f1040887800 20 realm 2024-09-12T17:45:24.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.937+0000 7f1040887800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.937+0000 7f1040887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.937+0000 7f1040887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:24.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.937+0000 7f1040887800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.937+0000 7f1040887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:24.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.937+0000 7f1040887800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.938+0000 7f1040887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:24.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.938+0000 7f1040887800 20 rados->read ofs=0 len=0 2024-09-12T17:45:24.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.938+0000 7f1040887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:24.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.938+0000 7f1040887800 20 searching for the correct realm 2024-09-12T17:45:24.941 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.941+0000 7f103db70640 0 -- 172.21.15.44:0/1950422941 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f103006b030 msgr2=0x7f10300daa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:24.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:24.945+0000 7f103e371640 0 -- 172.21.15.44:0/1950422941 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f1034065ee0 msgr2=0x7f1034081680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:45:25.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.152+0000 7f1040887800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:25.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.152+0000 7f1040887800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:25.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.152+0000 7f1040887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:25.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.152+0000 7f1040887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:25.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.152+0000 7f1040887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:25.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.152+0000 7f1040887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:25.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.152+0000 7f1040887800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.152+0000 7f1040887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.152+0000 7f1040887800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.153+0000 7f1040887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:25.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.153+0000 7f1040887800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.153+0000 7f1040887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:25.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.153+0000 7f1040887800 20 zone default found 2024-09-12T17:45:25.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.153+0000 7f1040887800 4 Realm: () 2024-09-12T17:45:25.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.153+0000 7f1040887800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:25.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.153+0000 7f1040887800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:25.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.153+0000 7f1040887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:25.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.153+0000 7f1040887800 20 zonegroup default 2024-09-12T17:45:25.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.153+0000 7f1040887800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.153+0000 7f1040887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.153+0000 7f1040887800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.154+0000 7f1040887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.154+0000 7f1040887800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.154+0000 7f1040887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.154+0000 7f1040887800 20 started sync module instance, tier type = 2024-09-12T17:45:25.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.154+0000 7f1040887800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:25.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.165+0000 7f1040887800 20 add_watcher() i=0 2024-09-12T17:45:25.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.165+0000 7f1040887800 20 add_watcher() i=1 2024-09-12T17:45:25.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.165+0000 7f1040887800 20 add_watcher() i=2 2024-09-12T17:45:25.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.165+0000 7f1040887800 20 add_watcher() i=3 2024-09-12T17:45:25.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.165+0000 7f1040887800 20 add_watcher() i=4 2024-09-12T17:45:25.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.165+0000 7f1040887800 20 add_watcher() i=5 2024-09-12T17:45:25.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.165+0000 7f1040887800 20 add_watcher() i=6 2024-09-12T17:45:25.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.166+0000 7f1040887800 20 add_watcher() i=7 2024-09-12T17:45:25.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.166+0000 7f1040887800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:25.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.167+0000 7f0ef4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:25.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.168+0000 7f1040887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:25.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.168+0000 7f1040887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:25.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.168+0000 7f1040887800 5 note: GC not initialized 2024-09-12T17:45:25.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.168+0000 7f0e6f7fe640 20 reqs_thread_entry: start 2024-09-12T17:45:25.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.168+0000 7f1040887800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:25.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.168+0000 7f1040887800 20 Filter name: none 2024-09-12T17:45:25.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.168+0000 7f0e6d7fa640 20 reqs_thread_entry: start 2024-09-12T17:45:25.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.168+0000 7f1040887800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.169+0000 7f1040887800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:25.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.169+0000 7f1040887800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.170+0000 7f1040887800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:45:25.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.170+0000 7f1040887800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:25.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.170+0000 7f1040887800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.171 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.170+0000 7f1040887800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:25.171 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.170+0000 7f1040887800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.171 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.170+0000 7f1040887800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:45:25.171 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.171+0000 7f1040887800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:25.173 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.172+0000 7f0ef4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:25.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.174+0000 7f1040887800 20 remove_watcher() i=0 2024-09-12T17:45:25.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.174+0000 7f1040887800 2 removed watcher, disabling cache 2024-09-12T17:45:25.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.176+0000 7f1040887800 20 remove_watcher() i=1 2024-09-12T17:45:25.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.177+0000 7f1040887800 20 remove_watcher() i=2 2024-09-12T17:45:25.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.178+0000 7f1040887800 20 remove_watcher() i=3 2024-09-12T17:45:25.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.179+0000 7f1040887800 20 remove_watcher() i=4 2024-09-12T17:45:25.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.180+0000 7f1040887800 20 remove_watcher() i=5 2024-09-12T17:45:25.181 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.181+0000 7f1040887800 20 remove_watcher() i=6 2024-09-12T17:45:25.182 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.182+0000 7f1040887800 20 remove_watcher() i=7 2024-09-12T17:45:25.194 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:25.194 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:45:25.194 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-logrecord-writes id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:45:25.194 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:25.247 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:45:25.281 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:25.281 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:25.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.320+0000 7f7c67098800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.321+0000 7f7c67098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.321+0000 7f7c67098800 20 realm 2024-09-12T17:45:25.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.321+0000 7f7c67098800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.322+0000 7f7c67098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.322+0000 7f7c67098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:25.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.322+0000 7f7c67098800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.322+0000 7f7c67098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.322+0000 7f7c67098800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.323 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.323+0000 7f7c67098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:25.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.323+0000 7f7c67098800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.323+0000 7f7c67098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:25.324 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.323+0000 7f7c67098800 20 searching for the correct realm 2024-09-12T17:45:25.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.326+0000 7f7c65383640 0 -- 172.21.15.44:0/4239240800 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f7c4c035040 msgr2=0x7f7c4c00f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:25.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.329+0000 7f7c64b82640 0 -- 172.21.15.44:0/4239240800 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f7c4c035420 msgr2=0x7f7c4c0358a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:45:25.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.536+0000 7f7c67098800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:25.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.536+0000 7f7c67098800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:25.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.536+0000 7f7c67098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:25.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.536+0000 7f7c67098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:25.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.536+0000 7f7c67098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:25.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.536+0000 7f7c67098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:25.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.536+0000 7f7c67098800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.536+0000 7f7c67098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.536+0000 7f7c67098800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.537+0000 7f7c67098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:25.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.537+0000 7f7c67098800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.537+0000 7f7c67098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:25.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.537+0000 7f7c67098800 20 zone default found 2024-09-12T17:45:25.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.537+0000 7f7c67098800 4 Realm: () 2024-09-12T17:45:25.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.537+0000 7f7c67098800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:25.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.537+0000 7f7c67098800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:25.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.537+0000 7f7c67098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:25.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.537+0000 7f7c67098800 20 zonegroup default 2024-09-12T17:45:25.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.537+0000 7f7c67098800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.537+0000 7f7c67098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.537+0000 7f7c67098800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.538+0000 7f7c67098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.538+0000 7f7c67098800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.538+0000 7f7c67098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.538+0000 7f7c67098800 20 started sync module instance, tier type = 2024-09-12T17:45:25.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.538+0000 7f7c67098800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:25.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.547+0000 7f7c67098800 20 add_watcher() i=0 2024-09-12T17:45:25.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.547+0000 7f7c67098800 20 add_watcher() i=1 2024-09-12T17:45:25.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.547+0000 7f7c67098800 20 add_watcher() i=2 2024-09-12T17:45:25.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.547+0000 7f7c67098800 20 add_watcher() i=3 2024-09-12T17:45:25.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.547+0000 7f7c67098800 20 add_watcher() i=4 2024-09-12T17:45:25.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.547+0000 7f7c67098800 20 add_watcher() i=5 2024-09-12T17:45:25.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.547+0000 7f7c67098800 20 add_watcher() i=6 2024-09-12T17:45:25.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.548+0000 7f7c67098800 20 add_watcher() i=7 2024-09-12T17:45:25.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.548+0000 7f7c67098800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:25.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.550+0000 7f7b1afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:25.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.550+0000 7f7c67098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:25.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.550+0000 7f7c67098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:25.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.550+0000 7f7c67098800 5 note: GC not initialized 2024-09-12T17:45:25.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.550+0000 7f7b19fe3640 20 reqs_thread_entry: start 2024-09-12T17:45:25.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.551+0000 7f7c67098800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:25.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.551+0000 7f7c67098800 20 Filter name: none 2024-09-12T17:45:25.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.551+0000 7f7a8b7fe640 20 reqs_thread_entry: start 2024-09-12T17:45:25.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.551+0000 7f7c67098800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:45:25.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.551+0000 7f7c67098800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.551+0000 7f7c67098800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:25.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.551+0000 7f7c67098800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:45:25.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.551+0000 7f7c67098800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:45:25.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.551+0000 7f7c67098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 : miss 2024-09-12T17:45:25.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.551+0000 7f7c67098800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.552+0000 7f7c67098800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:45:25.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.552+0000 7f7c67098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 info.flags=0x17 2024-09-12T17:45:25.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.552+0000 7f7c67098800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 to cache LRU end 2024-09-12T17:45:25.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.552+0000 7f7c67098800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:25.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.552+0000 7f7c67098800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:25.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.552+0000 7f7c67098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 2024-09-12T17:45:25.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.557+0000 7f7c67098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 info.flags=0x17 2024-09-12T17:45:25.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.557+0000 7f7c67098800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 to cache LRU end 2024-09-12T17:45:25.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.557+0000 7f7c67098800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:25.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.557+0000 7f7c67098800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36, ofs0, ns] 2024-09-12T17:45:25.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.557+0000 7f7b3bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562446 cookie 94638530530992 notifier 7785 bl.length()=1007 2024-09-12T17:45:25.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.557+0000 7f7b3bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 info.flags=0x17 2024-09-12T17:45:25.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.557+0000 7f7b3bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 to cache LRU end 2024-09-12T17:45:25.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.557+0000 7f7b3bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:25.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.557+0000 7f7c67098800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): orig_sources= new_sources= 2024-09-12T17:45:25.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.557+0000 7f7c67098800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): potential sources added=[] removed=[] 2024-09-12T17:45:25.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.557+0000 7f7c67098800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): orig_dests= new_dests= 2024-09-12T17:45:25.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.557+0000 7f7c67098800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): potential dests added=[] removed=[] 2024-09-12T17:45:25.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.0 2024-09-12T17:45:25.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.0 2024-09-12T17:45:25.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.1 2024-09-12T17:45:25.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.1 2024-09-12T17:45:25.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.2 2024-09-12T17:45:25.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.2 2024-09-12T17:45:25.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.3 2024-09-12T17:45:25.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.3 2024-09-12T17:45:25.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.4 2024-09-12T17:45:25.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.4 2024-09-12T17:45:25.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.5 2024-09-12T17:45:25.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.5 2024-09-12T17:45:25.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.6 2024-09-12T17:45:25.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.6 2024-09-12T17:45:25.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.7 2024-09-12T17:45:25.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.7 2024-09-12T17:45:25.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.8 2024-09-12T17:45:25.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.8 2024-09-12T17:45:25.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.9 2024-09-12T17:45:25.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.9 2024-09-12T17:45:25.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.10 2024-09-12T17:45:25.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.10 2024-09-12T17:45:25.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.11 2024-09-12T17:45:25.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1.11 2024-09-12T17:45:25.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.562+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.0 2024-09-12T17:45:25.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.563+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1 2024-09-12T17:45:25.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.564+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.2 2024-09-12T17:45:25.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.564+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.3 2024-09-12T17:45:25.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.564+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.4 2024-09-12T17:45:25.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.565+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.5 2024-09-12T17:45:25.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.565+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.6 2024-09-12T17:45:25.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.566+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.7 2024-09-12T17:45:25.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.567+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.8 2024-09-12T17:45:25.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.567+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.9 2024-09-12T17:45:25.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.568+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.10 2024-09-12T17:45:25.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.571+0000 7f7c67098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:45:25.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.571+0000 7f7c67098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 2024-09-12T17:45:25.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.572+0000 7f7c67098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 info.flags=0x17 2024-09-12T17:45:25.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.572+0000 7f7c67098800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 to cache LRU end 2024-09-12T17:45:25.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.572+0000 7f7c67098800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:25.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.572+0000 7f7c67098800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36, ofs0, ns] 2024-09-12T17:45:25.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.572+0000 7f7b3bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562447 cookie 94638530530992 notifier 7785 bl.length()=1007 2024-09-12T17:45:25.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.572+0000 7f7b3bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 info.flags=0x17 2024-09-12T17:45:25.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.572+0000 7f7b3bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 to cache LRU end 2024-09-12T17:45:25.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.572+0000 7f7b3bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:25.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.573+0000 7f7c67098800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): orig_sources= new_sources= 2024-09-12T17:45:25.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.573+0000 7f7c67098800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): potential sources added=[] removed=[] 2024-09-12T17:45:25.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.573+0000 7f7c67098800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): orig_dests= new_dests= 2024-09-12T17:45:25.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.573+0000 7f7c67098800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): potential dests added=[] removed=[] 2024-09-12T17:45:25.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.575+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.0 2024-09-12T17:45:25.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.575+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.1 2024-09-12T17:45:25.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.576+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.2 2024-09-12T17:45:25.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.576+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.3 2024-09-12T17:45:25.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.576+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.4 2024-09-12T17:45:25.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.577+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.5 2024-09-12T17:45:25.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.577+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.6 2024-09-12T17:45:25.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.577+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.7 2024-09-12T17:45:25.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.578+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.8 2024-09-12T17:45:25.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.578+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.9 2024-09-12T17:45:25.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.579+0000 7f7c67098800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36.10 2024-09-12T17:45:25.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.579+0000 7f7c67098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:45:25.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.579+0000 7f7c67098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 2024-09-12T17:45:25.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.580+0000 7f7c67098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 info.flags=0x17 2024-09-12T17:45:25.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.580+0000 7f7c67098800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 to cache LRU end 2024-09-12T17:45:25.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.580+0000 7f7c67098800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:25.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.580+0000 7f7c67098800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36, ofs0, ns] 2024-09-12T17:45:25.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.580+0000 7f7b3bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562448 cookie 94638530530992 notifier 7785 bl.length()=975 2024-09-12T17:45:25.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.580+0000 7f7b3bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 info.flags=0x17 2024-09-12T17:45:25.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.580+0000 7f7b3bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 to cache LRU end 2024-09-12T17:45:25.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.580+0000 7f7b3bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:25.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.581+0000 7f7c67098800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): orig_sources= new_sources= 2024-09-12T17:45:25.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.581+0000 7f7c67098800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): potential sources added=[] removed=[] 2024-09-12T17:45:25.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.581+0000 7f7c67098800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): orig_dests= new_dests= 2024-09-12T17:45:25.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.581+0000 7f7c67098800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36]): potential dests added=[] removed=[] 2024-09-12T17:45:25.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.584+0000 7f7c67098800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:45:25.586 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.586+0000 7f7b1afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:25.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.588+0000 7f7c67098800 20 remove_watcher() i=0 2024-09-12T17:45:25.589 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.588+0000 7f7c67098800 2 removed watcher, disabling cache 2024-09-12T17:45:25.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.590+0000 7f7c67098800 20 remove_watcher() i=1 2024-09-12T17:45:25.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.591+0000 7f7c67098800 20 remove_watcher() i=2 2024-09-12T17:45:25.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.592+0000 7f7c67098800 20 remove_watcher() i=3 2024-09-12T17:45:25.593 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.593+0000 7f7c67098800 20 remove_watcher() i=4 2024-09-12T17:45:25.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.594+0000 7f7c67098800 20 remove_watcher() i=5 2024-09-12T17:45:25.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.595+0000 7f7c67098800 20 remove_watcher() i=6 2024-09-12T17:45:25.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.596+0000 7f7c67098800 20 remove_watcher() i=7 2024-09-12T17:45:25.609 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:45:25.638 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:25.639 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:25.678 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.677+0000 7f1122c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.679+0000 7f1122c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.679+0000 7f1122c0e800 20 realm 2024-09-12T17:45:25.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.679+0000 7f1122c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.679+0000 7f1122c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.679+0000 7f1122c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:25.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.679+0000 7f1122c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.679+0000 7f1122c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.679+0000 7f1122c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.680+0000 7f1122c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:25.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.680+0000 7f1122c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.680+0000 7f1122c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:25.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.680+0000 7f1122c0e800 20 searching for the correct realm 2024-09-12T17:45:25.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.684+0000 7f111ea5a640 0 -- 172.21.15.44:0/790166290 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f11140b2070 msgr2=0x7f11140bd8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:25.688 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.687+0000 7f111e259640 0 -- 172.21.15.44:0/790166290 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f111406a070 msgr2=0x7f11140d23d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:25.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.692+0000 7f1122c0e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:25.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.692+0000 7f1122c0e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:25.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.692+0000 7f1122c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:25.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.692+0000 7f1122c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:25.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.692+0000 7f1122c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:25.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.692+0000 7f1122c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:25.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.692+0000 7f1122c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.692+0000 7f1122c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.692+0000 7f1122c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.692+0000 7f1122c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:25.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.692+0000 7f1122c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.693+0000 7f1122c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:25.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.693+0000 7f1122c0e800 20 zone default found 2024-09-12T17:45:25.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.693+0000 7f1122c0e800 4 Realm: () 2024-09-12T17:45:25.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.693+0000 7f1122c0e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:25.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.693+0000 7f1122c0e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:25.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.693+0000 7f1122c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:25.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.693+0000 7f1122c0e800 20 zonegroup default 2024-09-12T17:45:25.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.693+0000 7f1122c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.693+0000 7f1122c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.693+0000 7f1122c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.693+0000 7f1122c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.693+0000 7f1122c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.694+0000 7f1122c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:25.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.694+0000 7f1122c0e800 20 started sync module instance, tier type = 2024-09-12T17:45:25.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.694+0000 7f1122c0e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:25.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.703+0000 7f1122c0e800 20 add_watcher() i=0 2024-09-12T17:45:25.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.703+0000 7f1122c0e800 20 add_watcher() i=1 2024-09-12T17:45:25.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.703+0000 7f1122c0e800 20 add_watcher() i=2 2024-09-12T17:45:25.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.703+0000 7f1122c0e800 20 add_watcher() i=3 2024-09-12T17:45:25.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.703+0000 7f1122c0e800 20 add_watcher() i=4 2024-09-12T17:45:25.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.703+0000 7f1122c0e800 20 add_watcher() i=5 2024-09-12T17:45:25.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.703+0000 7f1122c0e800 20 add_watcher() i=6 2024-09-12T17:45:25.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.704+0000 7f1122c0e800 20 add_watcher() i=7 2024-09-12T17:45:25.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.704+0000 7f1122c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:25.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.705+0000 7f0fd4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:25.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.706+0000 7f1122c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:25.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.706+0000 7f1122c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:25.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.706+0000 7f1122c0e800 5 note: GC not initialized 2024-09-12T17:45:25.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.706+0000 7f0f4f7fe640 20 reqs_thread_entry: start 2024-09-12T17:45:25.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.706+0000 7f1122c0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:25.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.706+0000 7f1122c0e800 20 Filter name: none 2024-09-12T17:45:25.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.706+0000 7f0f4d7fa640 20 reqs_thread_entry: start 2024-09-12T17:45:25.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.706+0000 7f1122c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.707+0000 7f1122c0e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:25.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.707+0000 7f1122c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.707+0000 7f1122c0e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:45:25.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.707+0000 7f1122c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:25.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.707+0000 7f1122c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.708+0000 7f1122c0e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:25.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.708+0000 7f1122c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:45:25.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.708+0000 7f1122c0e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:45:25.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.708+0000 7f1122c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:25.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.710+0000 7f0fd4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:25.713 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.713+0000 7f1122c0e800 20 remove_watcher() i=0 2024-09-12T17:45:25.713 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.713+0000 7f1122c0e800 2 removed watcher, disabling cache 2024-09-12T17:45:25.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.714+0000 7f1122c0e800 20 remove_watcher() i=1 2024-09-12T17:45:25.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.715+0000 7f1122c0e800 20 remove_watcher() i=2 2024-09-12T17:45:25.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.716+0000 7f1122c0e800 20 remove_watcher() i=3 2024-09-12T17:45:25.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.717+0000 7f1122c0e800 20 remove_watcher() i=4 2024-09-12T17:45:25.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.718+0000 7f1122c0e800 20 remove_watcher() i=5 2024-09-12T17:45:25.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.719+0000 7f1122c0e800 20 remove_watcher() i=6 2024-09-12T17:45:25.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:25.720+0000 7f1122c0e800 20 remove_watcher() i=7 2024-09-12T17:45:25.731 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:25.731 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:45:25.731 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-logrecord-writes id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:45:25.731 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:25.807 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T17:45:25.807 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.008 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:45:26.037 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:26.037 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:26.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.076+0000 7f315ae12800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.077+0000 7f315ae12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.077+0000 7f315ae12800 20 realm 2024-09-12T17:45:26.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.077+0000 7f315ae12800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.077+0000 7f315ae12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.077+0000 7f315ae12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:26.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.077+0000 7f315ae12800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.078+0000 7f315ae12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.078+0000 7f315ae12800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.078+0000 7f315ae12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.078+0000 7f315ae12800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.079+0000 7f315ae12800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:26.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.079+0000 7f315ae12800 20 searching for the correct realm 2024-09-12T17:45:26.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.082+0000 7f3155ddf640 0 -- 172.21.15.44:0/1045332505 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f31480a1040 msgr2=0x7f314806d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.086+0000 7f31565e0640 0 -- 172.21.15.44:0/1045332505 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f314c061960 msgr2=0x7f314c05e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:45:26.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.293+0000 7f315ae12800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:26.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.293+0000 7f315ae12800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:26.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.293+0000 7f315ae12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:26.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.293+0000 7f315ae12800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:26.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.293+0000 7f315ae12800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:26.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.293+0000 7f315ae12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:26.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.293+0000 7f315ae12800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.293+0000 7f315ae12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.293+0000 7f315ae12800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.294+0000 7f315ae12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.294+0000 7f315ae12800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.294+0000 7f315ae12800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:26.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.294+0000 7f315ae12800 20 zone default found 2024-09-12T17:45:26.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.294+0000 7f315ae12800 4 Realm: () 2024-09-12T17:45:26.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.294+0000 7f315ae12800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:26.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.294+0000 7f315ae12800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:26.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.294+0000 7f315ae12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:26.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.294+0000 7f315ae12800 20 zonegroup default 2024-09-12T17:45:26.296 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.294+0000 7f315ae12800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.294+0000 7f315ae12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.294+0000 7f315ae12800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.295+0000 7f315ae12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.295+0000 7f315ae12800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.295+0000 7f315ae12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.295+0000 7f315ae12800 20 started sync module instance, tier type = 2024-09-12T17:45:26.297 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.295+0000 7f315ae12800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:26.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.304+0000 7f315ae12800 20 add_watcher() i=0 2024-09-12T17:45:26.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.304+0000 7f315ae12800 20 add_watcher() i=1 2024-09-12T17:45:26.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.304+0000 7f315ae12800 20 add_watcher() i=2 2024-09-12T17:45:26.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.304+0000 7f315ae12800 20 add_watcher() i=3 2024-09-12T17:45:26.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.304+0000 7f315ae12800 20 add_watcher() i=4 2024-09-12T17:45:26.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.304+0000 7f315ae12800 20 add_watcher() i=5 2024-09-12T17:45:26.305 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.304+0000 7f315ae12800 20 add_watcher() i=6 2024-09-12T17:45:26.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.305+0000 7f315ae12800 20 add_watcher() i=7 2024-09-12T17:45:26.306 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.305+0000 7f315ae12800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:26.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.307+0000 7f300cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:26.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.307+0000 7f315ae12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:26.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.307+0000 7f315ae12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:26.308 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.307+0000 7f315ae12800 5 note: GC not initialized 2024-09-12T17:45:26.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.307+0000 7f2f877fe640 20 reqs_thread_entry: start 2024-09-12T17:45:26.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.307+0000 7f315ae12800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:26.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.307+0000 7f315ae12800 20 Filter name: none 2024-09-12T17:45:26.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.308+0000 7f2f857fa640 20 reqs_thread_entry: start 2024-09-12T17:45:26.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.308+0000 7f315ae12800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.308+0000 7f315ae12800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:26.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.308+0000 7f315ae12800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.309+0000 7f315ae12800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:45:26.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.309+0000 7f315ae12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:26.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.309+0000 7f315ae12800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.309+0000 7f315ae12800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:26.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.309+0000 7f315ae12800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.309+0000 7f315ae12800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:45:26.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.310+0000 7f315ae12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:26.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.311+0000 7f300cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:26.314 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.314+0000 7f315ae12800 20 remove_watcher() i=0 2024-09-12T17:45:26.314 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.314+0000 7f315ae12800 2 removed watcher, disabling cache 2024-09-12T17:45:26.315 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.315+0000 7f315ae12800 20 remove_watcher() i=1 2024-09-12T17:45:26.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.316+0000 7f315ae12800 20 remove_watcher() i=2 2024-09-12T17:45:26.318 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.317+0000 7f315ae12800 20 remove_watcher() i=3 2024-09-12T17:45:26.318 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.318+0000 7f315ae12800 20 remove_watcher() i=4 2024-09-12T17:45:26.320 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.319+0000 7f315ae12800 20 remove_watcher() i=5 2024-09-12T17:45:26.321 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.320+0000 7f315ae12800 20 remove_watcher() i=6 2024-09-12T17:45:26.322 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.321+0000 7f315ae12800 20 remove_watcher() i=7 2024-09-12T17:45:26.333 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.333 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:45:26.333 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-logrecord-writes id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:45:26.333 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.334 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T17:45:26.369 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:26.370 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:26.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.407+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.409+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.409+0000 7fd779d21800 20 realm 2024-09-12T17:45:26.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.409+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.409+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.409+0000 7fd779d21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:26.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.409+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.410+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.410+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.410+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.410+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.411+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:26.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.411+0000 7fd779d21800 20 searching for the correct realm 2024-09-12T17:45:26.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.414+0000 7fd775155640 0 -- 172.21.15.44:0/3284105154 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55ed92dab570 msgr2=0x55ed92dada30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.417+0000 7fd775956640 0 -- 172.21.15.44:0/3284105154 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fd76c037400 msgr2=0x7fd76c037840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:26.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:26.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:26.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:26.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:26.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:26.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.422+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.422+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.422+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.422+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.422+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:26.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.423+0000 7fd779d21800 20 zone default found 2024-09-12T17:45:26.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.423+0000 7fd779d21800 4 Realm: () 2024-09-12T17:45:26.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.423+0000 7fd779d21800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:26.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.423+0000 7fd779d21800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:26.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.423+0000 7fd779d21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:26.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.423+0000 7fd779d21800 20 zonegroup default 2024-09-12T17:45:26.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.424+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.424+0000 7fd779d21800 20 started sync module instance, tier type = 2024-09-12T17:45:26.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.424+0000 7fd779d21800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:26.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=0 2024-09-12T17:45:26.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=1 2024-09-12T17:45:26.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=2 2024-09-12T17:45:26.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=3 2024-09-12T17:45:26.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=4 2024-09-12T17:45:26.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=5 2024-09-12T17:45:26.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=6 2024-09-12T17:45:26.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.434+0000 7fd779d21800 20 add_watcher() i=7 2024-09-12T17:45:26.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.434+0000 7fd779d21800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:26.436 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.435+0000 7fd627fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:26.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.436+0000 7fd779d21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:26.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.436+0000 7fd779d21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:26.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.436+0000 7fd779d21800 5 note: GC not initialized 2024-09-12T17:45:26.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.436+0000 7fd626ffd640 20 reqs_thread_entry: start 2024-09-12T17:45:26.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.436+0000 7fd779d21800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:26.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.436+0000 7fd779d21800 20 Filter name: none 2024-09-12T17:45:26.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.436+0000 7fd624ff9640 20 reqs_thread_entry: start 2024-09-12T17:45:26.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.436+0000 7fd779d21800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:45:26.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.436+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.437+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:26.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.437+0000 7fd779d21800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:45:26.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.437+0000 7fd779d21800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:45:26.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.437+0000 7fd779d21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 : miss 2024-09-12T17:45:26.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.437+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.437+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:45:26.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.437+0000 7fd779d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:26.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.437+0000 7fd779d21800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:26.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.437+0000 7fd779d21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:26.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.437+0000 7fd779d21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:26.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.437+0000 7fd779d21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 2024-09-12T17:45:26.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.443+0000 7fd779d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:26.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.443+0000 7fd779d21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:26.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.443+0000 7fd779d21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:26.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.443+0000 7fd779d21800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37, ofs0, ns] 2024-09-12T17:45:26.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.443+0000 7fd658ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562380 cookie 94478859452272 notifier 7301 bl.length()=1007 2024-09-12T17:45:26.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.443+0000 7fd658ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:26.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.443+0000 7fd658ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:26.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.443+0000 7fd658ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:26.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.443+0000 7fd779d21800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): orig_sources= new_sources= 2024-09-12T17:45:26.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.443+0000 7fd779d21800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): potential sources added=[] removed=[] 2024-09-12T17:45:26.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.443+0000 7fd779d21800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): orig_dests= new_dests= 2024-09-12T17:45:26.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.443+0000 7fd779d21800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): potential dests added=[] removed=[] 2024-09-12T17:45:26.447 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd779d21800 time 2024-09-12T17:45:26.447574+0000 2024-09-12T17:45:26.447 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:45:26.448 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:26.448 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd77b38c71a] 2024-09-12T17:45:26.448 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd77b38c8d8] 2024-09-12T17:45:26.448 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ed919af841] 2024-09-12T17:45:26.448 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd7490c) [0x55ed91ebd90c] 2024-09-12T17:45:26.448 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ed919bf50d] 2024-09-12T17:45:26.448 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:45:26.449 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd77a029590] 2024-09-12T17:45:26.449 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:45:26.449 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:45:26.449 INFO:tasks.workunit.client.0.smithi044.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:45:26.449 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7fd779d21800 thread_name:radosgw-admin 2024-09-12T17:45:26.449 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.447+0000 7fd779d21800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd779d21800 time 2024-09-12T17:45:26.447574+0000 2024-09-12T17:45:26.449 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:45:26.449 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.449 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:26.449 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd77b38c71a] 2024-09-12T17:45:26.449 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd77b38c8d8] 2024-09-12T17:45:26.449 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ed919af841] 2024-09-12T17:45:26.449 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd7490c) [0x55ed91ebd90c] 2024-09-12T17:45:26.450 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ed919bf50d] 2024-09-12T17:45:26.450 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:45:26.450 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd77a029590] 2024-09-12T17:45:26.450 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:45:26.450 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:45:26.450 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.467 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:26.467 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd77a03e6f0] 2024-09-12T17:45:26.467 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd77a08b99c] 2024-09-12T17:45:26.467 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:45:26.467 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:45:26.467 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd77b38c774] 2024-09-12T17:45:26.467 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd77b38c8d8] 2024-09-12T17:45:26.467 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ed919af841] 2024-09-12T17:45:26.467 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd7490c) [0x55ed91ebd90c] 2024-09-12T17:45:26.468 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ed919bf50d] 2024-09-12T17:45:26.468 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:45:26.468 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd77a029590] 2024-09-12T17:45:26.468 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:45:26.468 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:45:26.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.448+0000 7fd779d21800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:45:26.468 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7fd779d21800 thread_name:radosgw-admin 2024-09-12T17:45:26.468 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.468 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:26.468 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd77a03e6f0] 2024-09-12T17:45:26.468 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd77a08b99c] 2024-09-12T17:45:26.468 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:45:26.469 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:45:26.469 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd77b38c774] 2024-09-12T17:45:26.469 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd77b38c8d8] 2024-09-12T17:45:26.469 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ed919af841] 2024-09-12T17:45:26.469 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd7490c) [0x55ed91ebd90c] 2024-09-12T17:45:26.469 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ed919bf50d] 2024-09-12T17:45:26.469 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:45:26.469 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd77a029590] 2024-09-12T17:45:26.469 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:45:26.469 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:45:26.469 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:45:26.469 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.469 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:45:26.470 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:45:26.390+0000 7fd779d21800 4 set_mon_vals no callback set 2024-09-12T17:45:26.470 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:45:26.390+0000 7fd663e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.470 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:45:26.390+0000 7fd663e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:45:26.470 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:45:26.390+0000 7fd663e07640 10 monclient: dump: 2024-09-12T17:45:26.470 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.470 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.470 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.470 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.470 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.470 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.470 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.470 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.470 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.471 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.471 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:45:26.391+0000 7fd779d21800 10 monclient: shutdown 2024-09-12T17:45:26.471 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 asok(0x55ed92a94730) unregister_commands rotate-key 2024-09-12T17:45:26.471 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:45:26.391+0000 7fd779d21800 10 monclient: build_initial_monmap 2024-09-12T17:45:26.471 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:45:26.391+0000 7fd779d21800 1 build_initial for_mkfs: 0 2024-09-12T17:45:26.471 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:45:26.391+0000 7fd779d21800 10 monclient: monmap: 2024-09-12T17:45:26.471 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:45:26.471 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:26.471 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:45:26.471 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:45:26.471 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:26.471 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.471 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:45:26.472 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:45:26.472 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:45:26.472 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.472 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding auth protocol: cephx 2024-09-12T17:45:26.472 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding auth protocol: cephx 2024-09-12T17:45:26.472 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding auth protocol: cephx 2024-09-12T17:45:26.472 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: secure 2024-09-12T17:45:26.472 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: crc 2024-09-12T17:45:26.472 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: secure 2024-09-12T17:45:26.472 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: crc 2024-09-12T17:45:26.472 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: secure 2024-09-12T17:45:26.472 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: crc 2024-09-12T17:45:26.472 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: crc 2024-09-12T17:45:26.473 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: secure 2024-09-12T17:45:26.473 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: crc 2024-09-12T17:45:26.473 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: secure 2024-09-12T17:45:26.473 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: crc 2024-09-12T17:45:26.473 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: secure 2024-09-12T17:45:26.473 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:45:26.391+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.473 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:45:26.391+0000 7fd779d21800 1 librados: starting msgr at 2024-09-12T17:45:26.473 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:45:26.391+0000 7fd779d21800 1 librados: starting objecter 2024-09-12T17:45:26.473 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command objecter_requests hook 0x55ed92ce8410 2024-09-12T17:45:26.473 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:45:26.392+0000 7fd779d21800 1 librados: setting wanted keys 2024-09-12T17:45:26.473 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:45:26.392+0000 7fd779d21800 1 librados: calling monclient init 2024-09-12T17:45:26.473 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient: init 2024-09-12T17:45:26.473 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding auth protocol: cephx 2024-09-12T17:45:26.474 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding auth protocol: cephx 2024-09-12T17:45:26.474 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding auth protocol: cephx 2024-09-12T17:45:26.474 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: secure 2024-09-12T17:45:26.474 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: crc 2024-09-12T17:45:26.474 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: secure 2024-09-12T17:45:26.474 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: crc 2024-09-12T17:45:26.474 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: secure 2024-09-12T17:45:26.474 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: crc 2024-09-12T17:45:26.474 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: crc 2024-09-12T17:45:26.474 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: secure 2024-09-12T17:45:26.474 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: crc 2024-09-12T17:45:26.474 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: secure 2024-09-12T17:45:26.474 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: crc 2024-09-12T17:45:26.474 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: secure 2024-09-12T17:45:26.475 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:45:26.392+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.475 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:45:26.392+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.475 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command rotate-key hook 0x55ed92cb6aa8 2024-09-12T17:45:26.475 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:26.475 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:45:26.475 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-c con 0x55ed92b2ac20 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:45:26.475 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-a con 0x55ed92bfc500 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:45:26.475 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-b con 0x55ed92bfc970 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:45:26.475 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.475 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.475 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.475 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:26.475 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient(hunting): authenticate will time out at 2099.028543s 2024-09-12T17:45:26.476 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient(hunting): get_auth_request con 0x55ed92b2ac20 auth_method 0 2024-09-12T17:45:26.476 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.476 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.476 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.476 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:45:26.392+0000 7fd775155640 10 monclient(hunting): get_auth_request con 0x55ed92bfc500 auth_method 0 2024-09-12T17:45:26.476 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:45:26.392+0000 7fd775155640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.476 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:45:26.392+0000 7fd775155640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.476 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:45:26.392+0000 7fd775155640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.476 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:45:26.392+0000 7fd776157640 10 monclient(hunting): get_auth_request con 0x55ed92bfc970 auth_method 0 2024-09-12T17:45:26.476 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:45:26.392+0000 7fd776157640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.476 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:45:26.392+0000 7fd776157640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.476 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:45:26.392+0000 7fd776157640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.477 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.477 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.477 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.477 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:45:26.392+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.477 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:45:26.392+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.477 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:45:26.392+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.477 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:45:26.392+0000 7fd776157640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.477 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:45:26.392+0000 7fd776157640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.477 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:45:26.392+0000 7fd776157640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.477 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient(hunting): handle_auth_done global_id 7292 payload 824 2024-09-12T17:45:26.477 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient: _finish_hunting 0 2024-09-12T17:45:26.477 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:45:26.392+0000 7fd775956640 1 monclient: found mon.noname-c 2024-09-12T17:45:26.477 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.477 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.478 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:45:26.478 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: dump: 2024-09-12T17:45:26.478 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.478 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.478 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.478 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.478 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.478 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.478 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.478 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.478 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.478 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.478 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: _finish_auth 0 2024-09-12T17:45:26.478 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.479 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.479 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.479 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:45:26.479 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: dump: 2024-09-12T17:45:26.479 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.479 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.479 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.479 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.479 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.479 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.479 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.479 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.479 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.480 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.480 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:45:26.393+0000 7fd779d21800 5 monclient: authenticate success, global_id 7292 2024-09-12T17:45:26.480 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:45:26.393+0000 7fd779d21800 10 monclient: _renew_subs 2024-09-12T17:45:26.480 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:45:26.393+0000 7fd663e07640 4 set_mon_vals no callback set 2024-09-12T17:45:26.480 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:45:26.393+0000 7fd779d21800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.480 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:45:26.393+0000 7fd779d21800 10 monclient: _renew_subs 2024-09-12T17:45:26.480 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:45:26.393+0000 7fd779d21800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.480 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:45:26.393+0000 7fd779d21800 1 librados: init done 2024-09-12T17:45:26.480 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:45:26.395+0000 7fd662604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:26.480 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:45:26.395+0000 7fd662604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:45:26.480 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:45:26.395+0000 7fd662604640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:45:26.480 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:45:26.395+0000 7fd775155640 10 monclient: get_auth_request con 0x7fd65c076470 auth_method 0 2024-09-12T17:45:26.480 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:45:26.395+0000 7fd776157640 10 monclient: get_auth_request con 0x55ed92ce0480 auth_method 0 2024-09-12T17:45:26.481 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:45:26.396+0000 7fd775956640 10 monclient: get_auth_request con 0x55ed92d03ed0 auth_method 0 2024-09-12T17:45:26.481 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:45:26.397+0000 7fd775155640 10 monclient: get_auth_request con 0x55ed92d08f60 auth_method 0 2024-09-12T17:45:26.481 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:45:26.398+0000 7fd779d21800 10 monclient: build_initial_monmap 2024-09-12T17:45:26.481 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:45:26.398+0000 7fd779d21800 1 build_initial for_mkfs: 0 2024-09-12T17:45:26.481 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:45:26.398+0000 7fd779d21800 10 monclient: monmap: 2024-09-12T17:45:26.481 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:45:26.481 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:26.481 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:45:26.481 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:45:26.481 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:26.481 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.481 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:45:26.481 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:45:26.481 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:45:26.482 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.482 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding auth protocol: cephx 2024-09-12T17:45:26.482 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding auth protocol: cephx 2024-09-12T17:45:26.482 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding auth protocol: cephx 2024-09-12T17:45:26.482 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: secure 2024-09-12T17:45:26.482 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: crc 2024-09-12T17:45:26.482 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: secure 2024-09-12T17:45:26.482 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: crc 2024-09-12T17:45:26.482 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: secure 2024-09-12T17:45:26.482 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: crc 2024-09-12T17:45:26.482 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: crc 2024-09-12T17:45:26.482 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: secure 2024-09-12T17:45:26.482 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: crc 2024-09-12T17:45:26.483 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: secure 2024-09-12T17:45:26.483 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: crc 2024-09-12T17:45:26.483 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: secure 2024-09-12T17:45:26.483 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:45:26.398+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.483 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command objecter_requests cmddesc objecter_requests hook 0x55ed92d102d0 EEXIST 2024-09-12T17:45:26.483 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient: init 2024-09-12T17:45:26.483 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding auth protocol: cephx 2024-09-12T17:45:26.483 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding auth protocol: cephx 2024-09-12T17:45:26.483 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding auth protocol: cephx 2024-09-12T17:45:26.483 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: secure 2024-09-12T17:45:26.483 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: crc 2024-09-12T17:45:26.483 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: secure 2024-09-12T17:45:26.483 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: crc 2024-09-12T17:45:26.483 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: secure 2024-09-12T17:45:26.484 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: crc 2024-09-12T17:45:26.484 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: crc 2024-09-12T17:45:26.484 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: secure 2024-09-12T17:45:26.484 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: crc 2024-09-12T17:45:26.484 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: secure 2024-09-12T17:45:26.484 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: crc 2024-09-12T17:45:26.484 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: secure 2024-09-12T17:45:26.484 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:45:26.399+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.484 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:45:26.399+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.484 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command rotate-key cmddesc rotate-key hook 0x55ed92d0bf00 EEXIST 2024-09-12T17:45:26.484 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:26.484 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:45:26.484 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-c con 0x55ed92d345f0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:45:26.485 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-a con 0x55ed92d349d0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:45:26.485 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-b con 0x55ed92d33300 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:45:26.485 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.485 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.485 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.485 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:26.485 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient(hunting): authenticate will time out at 2099.035770s 2024-09-12T17:45:26.485 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:45:26.399+0000 7fd775956640 10 monclient(hunting): get_auth_request con 0x55ed92d345f0 auth_method 0 2024-09-12T17:45:26.485 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:45:26.399+0000 7fd775956640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.485 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:45:26.399+0000 7fd775956640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.485 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:45:26.399+0000 7fd775956640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.485 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:45:26.399+0000 7fd775155640 10 monclient(hunting): get_auth_request con 0x55ed92d349d0 auth_method 0 2024-09-12T17:45:26.485 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:45:26.399+0000 7fd775155640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.486 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:45:26.399+0000 7fd775155640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.486 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:45:26.399+0000 7fd775155640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.486 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:45:26.399+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.486 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:45:26.399+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.486 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:45:26.399+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.486 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:45:26.399+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.486 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:45:26.399+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.486 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:45:26.400+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.486 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:45:26.400+0000 7fd776157640 10 monclient(hunting): get_auth_request con 0x55ed92d33300 auth_method 0 2024-09-12T17:45:26.486 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:45:26.400+0000 7fd776157640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.487 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:45:26.400+0000 7fd776157640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.487 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:45:26.400+0000 7fd776157640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.487 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:45:26.400+0000 7fd775956640 10 monclient(hunting): handle_auth_done global_id 7295 payload 824 2024-09-12T17:45:26.487 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:45:26.400+0000 7fd775956640 10 monclient: _finish_hunting 0 2024-09-12T17:45:26.487 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:45:26.400+0000 7fd775956640 1 monclient: found mon.noname-c 2024-09-12T17:45:26.487 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:45:26.400+0000 7fd775956640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.487 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.487 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:45:26.487 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: dump: 2024-09-12T17:45:26.487 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.487 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.487 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.487 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.488 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.488 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.488 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.488 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.488 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.488 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.488 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: _finish_auth 0 2024-09-12T17:45:26.488 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.488 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.488 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.488 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:45:26.488 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: dump: 2024-09-12T17:45:26.489 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.489 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.489 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.489 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.489 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.489 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.489 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.489 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.489 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.489 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.489 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:45:26.400+0000 7fd779d21800 5 monclient: authenticate success, global_id 7295 2024-09-12T17:45:26.489 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:45:26.400+0000 7fd776958640 4 set_mon_vals no callback set 2024-09-12T17:45:26.489 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:45:26.400+0000 7fd779d21800 10 monclient: _renew_subs 2024-09-12T17:45:26.489 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:45:26.400+0000 7fd779d21800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.490 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:45:26.400+0000 7fd779d21800 10 monclient: _renew_subs 2024-09-12T17:45:26.490 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:45:26.400+0000 7fd779d21800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.490 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:45:26.402+0000 7fd65b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:26.490 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:45:26.402+0000 7fd65b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:45:26.490 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:45:26.402+0000 7fd65b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:45:26.490 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:45:26.402+0000 7fd775155640 10 monclient: get_auth_request con 0x7fd650076380 auth_method 0 2024-09-12T17:45:26.490 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:45:26.402+0000 7fd779d21800 10 monclient: get_monmap_and_config 2024-09-12T17:45:26.490 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:45:26.402+0000 7fd779d21800 10 monclient: build_initial_monmap 2024-09-12T17:45:26.490 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:45:26.402+0000 7fd779d21800 1 build_initial for_mkfs: 0 2024-09-12T17:45:26.490 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:45:26.402+0000 7fd779d21800 10 monclient: monmap: 2024-09-12T17:45:26.490 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:45:26.490 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:26.490 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:45:26.491 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:45:26.491 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:26.491 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.491 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:45:26.491 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:45:26.491 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:45:26.491 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.491 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding auth protocol: cephx 2024-09-12T17:45:26.491 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding auth protocol: cephx 2024-09-12T17:45:26.491 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding auth protocol: cephx 2024-09-12T17:45:26.491 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: secure 2024-09-12T17:45:26.491 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: crc 2024-09-12T17:45:26.491 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: secure 2024-09-12T17:45:26.491 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: crc 2024-09-12T17:45:26.492 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: secure 2024-09-12T17:45:26.492 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: crc 2024-09-12T17:45:26.492 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: crc 2024-09-12T17:45:26.492 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: secure 2024-09-12T17:45:26.492 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: crc 2024-09-12T17:45:26.492 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: secure 2024-09-12T17:45:26.492 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: crc 2024-09-12T17:45:26.492 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: secure 2024-09-12T17:45:26.492 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:45:26.402+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.492 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:45:26.402+0000 7fd779d21800 10 monclient: init 2024-09-12T17:45:26.492 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding auth protocol: cephx 2024-09-12T17:45:26.492 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding auth protocol: cephx 2024-09-12T17:45:26.492 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding auth protocol: cephx 2024-09-12T17:45:26.493 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: secure 2024-09-12T17:45:26.493 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: crc 2024-09-12T17:45:26.493 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: secure 2024-09-12T17:45:26.493 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: crc 2024-09-12T17:45:26.493 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: secure 2024-09-12T17:45:26.493 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: crc 2024-09-12T17:45:26.493 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: crc 2024-09-12T17:45:26.493 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: secure 2024-09-12T17:45:26.493 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: crc 2024-09-12T17:45:26.493 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: secure 2024-09-12T17:45:26.493 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: crc 2024-09-12T17:45:26.493 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: secure 2024-09-12T17:45:26.493 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:45:26.403+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.494 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:45:26.403+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.494 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:45:26.403+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command rotate-key cmddesc rotate-key hook 0x7ffd46b80568 EEXIST 2024-09-12T17:45:26.494 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:26.494 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:45:26.494 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-a con 0x55ed92d88660 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:45:26.494 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-c con 0x55ed92d595b0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:45:26.494 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-b con 0x55ed92d83f00 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:45:26.494 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.494 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.494 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.494 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:26.494 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient(hunting): authenticate will time out at 2099.039393s 2024-09-12T17:45:26.494 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient(hunting): get_auth_request con 0x55ed92d88660 auth_method 0 2024-09-12T17:45:26.494 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.495 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.495 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.495 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:45:26.403+0000 7fd775155640 10 monclient(hunting): get_auth_request con 0x55ed92d595b0 auth_method 0 2024-09-12T17:45:26.495 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:45:26.403+0000 7fd775155640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.495 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:45:26.403+0000 7fd775155640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.495 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:45:26.403+0000 7fd775155640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.495 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.495 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.495 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.495 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:45:26.403+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.495 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:45:26.403+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.495 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:45:26.403+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.496 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:45:26.403+0000 7fd776157640 10 monclient(hunting): get_auth_request con 0x55ed92d83f00 auth_method 0 2024-09-12T17:45:26.496 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:45:26.403+0000 7fd776157640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.496 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:45:26.403+0000 7fd776157640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.496 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:45:26.403+0000 7fd776157640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.496 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient(hunting): handle_auth_done global_id 7833 payload 274 2024-09-12T17:45:26.496 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient: _finish_hunting 0 2024-09-12T17:45:26.496 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:45:26.403+0000 7fd775956640 1 monclient: found mon.noname-a 2024-09-12T17:45:26.496 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:45:26.496 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:45:26.403+0000 7fd6597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.496 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:45:26.403+0000 7fd6597fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:45:26.496 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:45:26.403+0000 7fd6597fa640 10 monclient: dump: 2024-09-12T17:45:26.496 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.496 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.496 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:45:26.404+0000 7fd6597fa640 10 monclient: _finish_auth 0 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:45:26.404+0000 7fd6597fa640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:45:26.404+0000 7fd6597fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:45:26.404+0000 7fd6597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:45:26.404+0000 7fd6597fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:45:26.497 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:45:26.404+0000 7fd6597fa640 10 monclient: dump: 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 monclient: authenticate success, global_id 7833 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:45:26.404+0000 7fd779d21800 10 monclient: get_monmap_and_config success 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:45:26.404+0000 7fd779d21800 4 set_mon_vals no callback set 2024-09-12T17:45:26.498 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:45:26.404+0000 7fd779d21800 10 monclient: shutdown 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:45:26.404+0000 7fd779d21800 10 monclient: build_initial_monmap 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:45:26.404+0000 7fd779d21800 1 build_initial for_mkfs: 0 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:45:26.404+0000 7fd779d21800 10 monclient: monmap: 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.499 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding auth protocol: cephx 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding auth protocol: cephx 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding auth protocol: cephx 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: secure 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: crc 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: secure 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: crc 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: secure 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: crc 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: crc 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: secure 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: crc 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: secure 2024-09-12T17:45:26.500 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: crc 2024-09-12T17:45:26.501 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: secure 2024-09-12T17:45:26.501 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:45:26.404+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.501 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:45:26.404+0000 7fd779d21800 1 librados: starting msgr at 2024-09-12T17:45:26.501 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:45:26.404+0000 7fd779d21800 1 librados: starting objecter 2024-09-12T17:45:26.501 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command objecter_requests cmddesc objecter_requests hook 0x55ed92d32a30 EEXIST 2024-09-12T17:45:26.501 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:45:26.405+0000 7fd779d21800 1 librados: setting wanted keys 2024-09-12T17:45:26.501 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:45:26.405+0000 7fd779d21800 1 librados: calling monclient init 2024-09-12T17:45:26.501 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient: init 2024-09-12T17:45:26.501 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding auth protocol: cephx 2024-09-12T17:45:26.501 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding auth protocol: cephx 2024-09-12T17:45:26.501 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding auth protocol: cephx 2024-09-12T17:45:26.501 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: secure 2024-09-12T17:45:26.501 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: crc 2024-09-12T17:45:26.502 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: secure 2024-09-12T17:45:26.502 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: crc 2024-09-12T17:45:26.502 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: secure 2024-09-12T17:45:26.502 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: crc 2024-09-12T17:45:26.502 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: crc 2024-09-12T17:45:26.502 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: secure 2024-09-12T17:45:26.502 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: crc 2024-09-12T17:45:26.502 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: secure 2024-09-12T17:45:26.502 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: crc 2024-09-12T17:45:26.502 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: secure 2024-09-12T17:45:26.502 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:45:26.405+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.502 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:45:26.405+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.502 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command rotate-key cmddesc rotate-key hook 0x55ed92d48ff8 EEXIST 2024-09-12T17:45:26.502 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:26.503 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:45:26.503 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-a con 0x55ed92d595b0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:45:26.503 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-b con 0x55ed92d83f00 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:45:26.503 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-c con 0x55ed92d88660 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:45:26.503 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.503 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.503 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.503 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:26.503 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient(hunting): authenticate will time out at 2099.041694s 2024-09-12T17:45:26.503 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:45:26.405+0000 7fd775956640 10 monclient(hunting): get_auth_request con 0x55ed92d595b0 auth_method 0 2024-09-12T17:45:26.503 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:45:26.405+0000 7fd775956640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.503 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:45:26.405+0000 7fd775956640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.503 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:45:26.405+0000 7fd775956640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.504 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:45:26.405+0000 7fd776157640 10 monclient(hunting): get_auth_request con 0x55ed92d88660 auth_method 0 2024-09-12T17:45:26.504 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:45:26.405+0000 7fd776157640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.504 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:45:26.405+0000 7fd776157640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.504 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:45:26.405+0000 7fd776157640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.504 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:45:26.405+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.504 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:45:26.405+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.504 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:45:26.405+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.504 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:45:26.405+0000 7fd776157640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.504 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:45:26.405+0000 7fd776157640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.504 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:45:26.405+0000 7fd776157640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.504 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:45:26.406+0000 7fd776157640 10 monclient(hunting): handle_auth_done global_id 7301 payload 824 2024-09-12T17:45:26.504 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:45:26.406+0000 7fd776157640 10 monclient: _finish_hunting 0 2024-09-12T17:45:26.504 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:45:26.406+0000 7fd776157640 1 monclient: found mon.noname-c 2024-09-12T17:45:26.505 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:45:26.406+0000 7fd776157640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.505 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.505 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:45:26.505 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: dump: 2024-09-12T17:45:26.505 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.505 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.505 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.505 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.505 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.505 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.505 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.505 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.505 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.505 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.506 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: _finish_auth 0 2024-09-12T17:45:26.506 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.506 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.506 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.506 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:45:26.506 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: dump: 2024-09-12T17:45:26.506 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.506 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.506 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.506 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.506 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.506 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.506 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.506 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.506 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.507 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.507 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:45:26.406+0000 7fd779d21800 5 monclient: authenticate success, global_id 7301 2024-09-12T17:45:26.507 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:45:26.406+0000 7fd779d21800 10 monclient: _renew_subs 2024-09-12T17:45:26.507 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:45:26.406+0000 7fd779d21800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.507 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:45:26.406+0000 7fd6597fa640 4 set_mon_vals no callback set 2024-09-12T17:45:26.507 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:45:26.406+0000 7fd779d21800 10 monclient: _renew_subs 2024-09-12T17:45:26.507 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:45:26.406+0000 7fd779d21800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.507 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:45:26.406+0000 7fd779d21800 1 librados: init done 2024-09-12T17:45:26.507 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:45:26.406+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command cr dump hook 0x55ed92d81848 2024-09-12T17:45:26.507 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:45:26.407+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.507 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:45:26.408+0000 7fd6477fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:26.507 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:45:26.408+0000 7fd6477fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:45:26.507 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:45:26.408+0000 7fd6477fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:45:26.508 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:45:26.408+0000 7fd775956640 10 monclient: get_auth_request con 0x7fd640076470 auth_method 0 2024-09-12T17:45:26.508 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:45:26.409+0000 7fd775155640 10 monclient: get_auth_request con 0x55ed92da2140 auth_method 0 2024-09-12T17:45:26.508 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:45:26.409+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.508 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:45:26.409+0000 7fd779d21800 20 realm 2024-09-12T17:45:26.508 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:45:26.409+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.508 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:45:26.409+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.508 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:45:26.409+0000 7fd779d21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:26.508 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:45:26.409+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.508 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:45:26.410+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.508 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:45:26.410+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.508 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:45:26.410+0000 7fd775956640 10 monclient: get_auth_request con 0x55ed92da6440 auth_method 0 2024-09-12T17:45:26.508 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:45:26.410+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.508 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:45:26.410+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.508 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:45:26.411+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:45:26.411+0000 7fd779d21800 20 searching for the correct realm 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:45:26.411+0000 7fd775155640 10 monclient: get_auth_request con 0x55ed92dab570 auth_method 0 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:45:26.412+0000 7fd776157640 10 monclient: get_auth_request con 0x7fd76c02a070 auth_method 0 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:45:26.413+0000 7fd775956640 10 monclient: get_auth_request con 0x7fd7700a7e60 auth_method 0 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:45:26.413+0000 7fd775155640 10 monclient: get_auth_request con 0x7fd768027030 auth_method 0 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:45:26.414+0000 7fd775155640 0 -- 172.21.15.44:0/3284105154 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55ed92dab570 msgr2=0x55ed92dada30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:45:26.414+0000 7fd6477fe640 1 client.7301.objecter ms_handle_reset 0x55ed92dab570 session 0x55ed92daaef0 osd.3 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:45:26.414+0000 7fd6477fe640 10 monclient: _renew_subs 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:45:26.414+0000 7fd6477fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:45:26.414+0000 7fd775155640 10 monclient: get_auth_request con 0x7fd640086290 auth_method 0 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:45:26.415+0000 7fd776157640 10 monclient: get_auth_request con 0x7fd76c01a040 auth_method 0 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:45:26.417+0000 7fd775956640 10 monclient: get_auth_request con 0x7fd76c037400 auth_method 0 2024-09-12T17:45:26.509 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:45:26.417+0000 7fd775956640 0 -- 172.21.15.44:0/3284105154 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fd76c037400 msgr2=0x7fd76c037840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:45:26.417+0000 7fd6477fe640 1 client.7301.objecter ms_handle_reset 0x7fd76c037400 session 0x7fd76c019950 osd.0 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:45:26.418+0000 7fd775956640 10 monclient: get_auth_request con 0x55ed92dab570 auth_method 0 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.511 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:26.511 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:45:26.423+0000 7fd779d21800 20 zone default found 2024-09-12T17:45:26.511 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:45:26.423+0000 7fd779d21800 4 Realm: () 2024-09-12T17:45:26.511 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:45:26.423+0000 7fd779d21800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:26.511 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:45:26.423+0000 7fd779d21800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:26.511 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:45:26.423+0000 7fd779d21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:26.511 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:45:26.423+0000 7fd779d21800 20 zonegroup default 2024-09-12T17:45:26.511 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.511 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.511 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.511 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.511 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.511 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:45:26.424+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.511 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:45:26.424+0000 7fd779d21800 20 started sync module instance, tier type = 2024-09-12T17:45:26.512 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:45:26.424+0000 7fd779d21800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:26.512 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=0 2024-09-12T17:45:26.512 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=1 2024-09-12T17:45:26.512 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=2 2024-09-12T17:45:26.512 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=3 2024-09-12T17:45:26.512 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=4 2024-09-12T17:45:26.512 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=5 2024-09-12T17:45:26.512 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=6 2024-09-12T17:45:26.512 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:45:26.434+0000 7fd779d21800 20 add_watcher() i=7 2024-09-12T17:45:26.512 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:45:26.434+0000 7fd779d21800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:26.512 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding auth protocol: cephx 2024-09-12T17:45:26.512 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding auth protocol: cephx 2024-09-12T17:45:26.512 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding auth protocol: cephx 2024-09-12T17:45:26.512 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: secure 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: crc 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: secure 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: crc 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: secure 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: crc 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:45:26.435+0000 7fd627fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: crc 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: secure 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: crc 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: secure 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: crc 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: secure 2024-09-12T17:45:26.513 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:45:26.436+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.514 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:45:26.436+0000 7fd779d21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:26.514 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:45:26.436+0000 7fd779d21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:26.514 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command cache list hook 0x55ed92d79d10 2024-09-12T17:45:26.514 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command cache inspect hook 0x55ed92d79d10 2024-09-12T17:45:26.514 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command cache erase hook 0x55ed92d79d10 2024-09-12T17:45:26.514 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command cache zap hook 0x55ed92d79d10 2024-09-12T17:45:26.514 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 note: GC not initialized 2024-09-12T17:45:26.514 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:45:26.436+0000 7fd626ffd640 20 reqs_thread_entry: start 2024-09-12T17:45:26.514 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command sync trace show hook 0x7fd768087070 2024-09-12T17:45:26.514 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command sync trace history hook 0x7fd768087070 2024-09-12T17:45:26.514 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command sync trace active hook 0x7fd768087070 2024-09-12T17:45:26.514 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command sync trace active_short hook 0x7fd768087070 2024-09-12T17:45:26.514 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:45:26.436+0000 7fd779d21800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:45:26.436+0000 7fd779d21800 20 Filter name: none 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:45:26.436+0000 7fd624ff9640 20 reqs_thread_entry: start 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:45:26.436+0000 7fd779d21800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:45:26.436+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:45:26.437+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:45:26.437+0000 7fd779d21800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:45:26.437+0000 7fd779d21800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:45:26.437+0000 7fd779d21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 : miss 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:45:26.437+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:45:26.437+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:45:26.437+0000 7fd779d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:45:26.437+0000 7fd779d21800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:26.515 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:45:26.437+0000 7fd779d21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:26.516 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:45:26.437+0000 7fd779d21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:26.516 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:45:26.437+0000 7fd779d21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 2024-09-12T17:45:26.516 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:45:26.443+0000 7fd779d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:26.516 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:45:26.443+0000 7fd779d21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:26.516 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:45:26.443+0000 7fd779d21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:26.516 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:45:26.443+0000 7fd779d21800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37, ofs0, ns] 2024-09-12T17:45:26.516 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:45:26.443+0000 7fd658ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562380 cookie 94478859452272 notifier 7301 bl.length()=1007 2024-09-12T17:45:26.516 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:45:26.443+0000 7fd658ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:26.516 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:45:26.443+0000 7fd658ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:26.516 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:45:26.443+0000 7fd658ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:26.516 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:45:26.443+0000 7fd779d21800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): orig_sources= new_sources= 2024-09-12T17:45:26.516 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:45:26.443+0000 7fd779d21800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): potential sources added=[] removed=[] 2024-09-12T17:45:26.516 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:45:26.443+0000 7fd779d21800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): orig_dests= new_dests= 2024-09-12T17:45:26.517 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:45:26.443+0000 7fd779d21800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): potential dests added=[] removed=[] 2024-09-12T17:45:26.517 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:45:26.443+0000 7fd6477fe640 1 client.7301.objecter ms_handle_reset 0x55ed92da6440 session 0x55ed92da5330 osd.5 2024-09-12T17:45:26.517 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:45:26.444+0000 7fd6477fe640 1 client.7301.objecter ms_handle_reset 0x55ed92da2140 session 0x55ed92da1a70 osd.1 2024-09-12T17:45:26.517 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:45:26.444+0000 7fd775956640 10 monclient: get_auth_request con 0x55ed92da6440 auth_method 0 2024-09-12T17:45:26.517 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:45:26.445+0000 7fd775155640 10 monclient: get_auth_request con 0x7fd76c037400 auth_method 0 2024-09-12T17:45:26.517 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:45:26.447+0000 7fd779d21800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd779d21800 time 2024-09-12T17:45:26.447574+0000 2024-09-12T17:45:26.517 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:45:26.517 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.517 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:26.517 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd77b38c71a] 2024-09-12T17:45:26.517 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd77b38c8d8] 2024-09-12T17:45:26.517 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ed919af841] 2024-09-12T17:45:26.517 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd7490c) [0x55ed91ebd90c] 2024-09-12T17:45:26.517 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ed919bf50d] 2024-09-12T17:45:26.518 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:45:26.518 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd77a029590] 2024-09-12T17:45:26.518 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:45:26.518 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:45:26.518 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.518 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:45:26.448+0000 7fd779d21800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:45:26.518 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7fd779d21800 thread_name:radosgw-admin 2024-09-12T17:45:26.518 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.518 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:26.518 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd77a03e6f0] 2024-09-12T17:45:26.518 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd77a08b99c] 2024-09-12T17:45:26.518 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:45:26.518 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:45:26.518 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd77b38c774] 2024-09-12T17:45:26.519 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd77b38c8d8] 2024-09-12T17:45:26.519 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ed919af841] 2024-09-12T17:45:26.519 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd7490c) [0x55ed91ebd90c] 2024-09-12T17:45:26.519 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ed919bf50d] 2024-09-12T17:45:26.519 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:45:26.519 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd77a029590] 2024-09-12T17:45:26.519 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:45:26.519 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:45:26.519 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:45:26.519 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.519 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:45:26.519 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:45:26.519 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:45:26.520 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:45:26.520 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:45:26.520 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:45:26.520 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:45:26.520 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:45:26.520 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:45:26.520 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:45:26.520 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:45:26.520 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:45:26.520 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:45:26.520 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:45:26.520 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:45:26.520 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:45:26.520 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:45:26.520 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:45:26.521 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:45:26.521 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:45:26.521 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:45:26.521 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:45:26.521 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:45:26.521 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:45:26.521 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:45:26.521 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:45:26.521 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:45:26.521 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:45:26.521 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:45:26.521 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:45:26.521 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:45:26.522 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:45:26.522 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:45:26.522 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:45:26.522 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:45:26.522 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:45:26.522 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:45:26.522 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:45:26.522 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:45:26.522 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:45:26.522 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:45:26.522 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:45:26.522 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:45:26.522 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:45:26.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:45:26.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:45:26.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:45:26.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:45:26.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:45:26.523 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:45:26.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:45:26.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:45:26.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:45:26.523 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:45:26.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:45:26.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:45:26.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:45:26.523 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:45:26.524 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:45:26.524 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:45:26.524 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:45:26.524 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:45:26.524 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:45:26.524 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:45:26.524 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:45:26.524 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:45:26.524 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:45:26.524 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:45:26.524 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:45:26.524 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:45:26.524 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:45:26.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:45:26.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:45:26.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:45:26.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:45:26.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:45:26.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:45:26.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:45:26.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:45:26.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:45:26.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:45:26.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:45:26.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:45:26.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:45:26.525 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:45:26.526 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:45:26.526 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:45:26.526 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:45:26.526 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:45:26.526 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:45:26.526 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:45:26.526 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:45:26.526 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:45:26.526 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:45:26.526 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd624ff9640 / http_manager 2024-09-12T17:45:26.526 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd626ffd640 / http_manager 2024-09-12T17:45:26.526 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd627fff640 / rgw_dt_lg_renew 2024-09-12T17:45:26.526 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd6477fe640 / ms_dispatch 2024-09-12T17:45:26.526 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd658ff9640 / io_context_pool 2024-09-12T17:45:26.527 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd6597fa640 / io_context_pool 2024-09-12T17:45:26.527 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd65b7fe640 / ms_dispatch 2024-09-12T17:45:26.527 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd662604640 / ms_dispatch 2024-09-12T17:45:26.527 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd663e07640 / io_context_pool 2024-09-12T17:45:26.527 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd775155640 / msgr-worker-2 2024-09-12T17:45:26.527 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd775956640 / msgr-worker-1 2024-09-12T17:45:26.527 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd776157640 / msgr-worker-0 2024-09-12T17:45:26.527 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd776958640 / io_context_pool 2024-09-12T17:45:26.527 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd779d21800 / radosgw-admin 2024-09-12T17:45:26.527 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:45:26.527 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:45:26.527 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/log/ceph/ceph-client.admin.135040.log 2024-09-12T17:45:26.527 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:45:26.527 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:45:26.528 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:45:26.390+0000 7fd779d21800 4 set_mon_vals no callback set 2024-09-12T17:45:26.528 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:45:26.390+0000 7fd663e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.528 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:45:26.390+0000 7fd663e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:45:26.528 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:45:26.390+0000 7fd663e07640 10 monclient: dump: 2024-09-12T17:45:26.528 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.528 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.528 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.528 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.528 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.528 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.528 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.528 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.528 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.529 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.529 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:45:26.391+0000 7fd779d21800 10 monclient: shutdown 2024-09-12T17:45:26.529 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 asok(0x55ed92a94730) unregister_commands rotate-key 2024-09-12T17:45:26.529 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:45:26.391+0000 7fd779d21800 10 monclient: build_initial_monmap 2024-09-12T17:45:26.529 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:45:26.391+0000 7fd779d21800 1 build_initial for_mkfs: 0 2024-09-12T17:45:26.529 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:45:26.391+0000 7fd779d21800 10 monclient: monmap: 2024-09-12T17:45:26.529 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:45:26.529 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:26.529 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:45:26.529 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:45:26.529 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:26.529 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.529 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:45:26.529 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:45:26.530 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:45:26.530 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.530 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding auth protocol: cephx 2024-09-12T17:45:26.530 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding auth protocol: cephx 2024-09-12T17:45:26.530 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding auth protocol: cephx 2024-09-12T17:45:26.530 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: secure 2024-09-12T17:45:26.530 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: crc 2024-09-12T17:45:26.530 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: secure 2024-09-12T17:45:26.530 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: crc 2024-09-12T17:45:26.530 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: secure 2024-09-12T17:45:26.530 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: crc 2024-09-12T17:45:26.530 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: crc 2024-09-12T17:45:26.530 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: secure 2024-09-12T17:45:26.530 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: crc 2024-09-12T17:45:26.531 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: secure 2024-09-12T17:45:26.531 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: crc 2024-09-12T17:45:26.531 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 AuthRegistry(0x55ed92cbbf90) adding con mode: secure 2024-09-12T17:45:26.531 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:45:26.391+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.531 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:45:26.391+0000 7fd779d21800 1 librados: starting msgr at 2024-09-12T17:45:26.531 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:45:26.391+0000 7fd779d21800 1 librados: starting objecter 2024-09-12T17:45:26.531 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:45:26.391+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command objecter_requests hook 0x55ed92ce8410 2024-09-12T17:45:26.531 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:45:26.392+0000 7fd779d21800 1 librados: setting wanted keys 2024-09-12T17:45:26.531 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:45:26.392+0000 7fd779d21800 1 librados: calling monclient init 2024-09-12T17:45:26.531 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient: init 2024-09-12T17:45:26.531 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding auth protocol: cephx 2024-09-12T17:45:26.531 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding auth protocol: cephx 2024-09-12T17:45:26.531 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding auth protocol: cephx 2024-09-12T17:45:26.532 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: secure 2024-09-12T17:45:26.532 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: crc 2024-09-12T17:45:26.532 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: secure 2024-09-12T17:45:26.532 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: crc 2024-09-12T17:45:26.532 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: secure 2024-09-12T17:45:26.532 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: crc 2024-09-12T17:45:26.532 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: crc 2024-09-12T17:45:26.532 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: secure 2024-09-12T17:45:26.532 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: crc 2024-09-12T17:45:26.532 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: secure 2024-09-12T17:45:26.532 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: crc 2024-09-12T17:45:26.532 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 AuthRegistry(0x55ed92cb6960) adding con mode: secure 2024-09-12T17:45:26.532 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:45:26.392+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.533 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:45:26.392+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.533 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:45:26.392+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command rotate-key hook 0x55ed92cb6aa8 2024-09-12T17:45:26.533 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:26.533 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:45:26.533 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-c con 0x55ed92b2ac20 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:45:26.533 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-a con 0x55ed92bfc500 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:45:26.533 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-b con 0x55ed92bfc970 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:45:26.533 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.533 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.533 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.533 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:26.533 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:45:26.392+0000 7fd779d21800 10 monclient(hunting): authenticate will time out at 2099.028543s 2024-09-12T17:45:26.533 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient(hunting): get_auth_request con 0x55ed92b2ac20 auth_method 0 2024-09-12T17:45:26.534 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.534 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.534 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.534 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:45:26.392+0000 7fd775155640 10 monclient(hunting): get_auth_request con 0x55ed92bfc500 auth_method 0 2024-09-12T17:45:26.534 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:45:26.392+0000 7fd775155640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.534 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:45:26.392+0000 7fd775155640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.534 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:45:26.392+0000 7fd775155640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.534 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:45:26.392+0000 7fd776157640 10 monclient(hunting): get_auth_request con 0x55ed92bfc970 auth_method 0 2024-09-12T17:45:26.534 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:45:26.392+0000 7fd776157640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.534 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:45:26.392+0000 7fd776157640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.534 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:45:26.392+0000 7fd776157640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.534 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.534 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.534 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.535 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:45:26.392+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.535 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:45:26.392+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.535 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:45:26.392+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.535 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:45:26.392+0000 7fd776157640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.535 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:45:26.392+0000 7fd776157640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.535 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:45:26.392+0000 7fd776157640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.535 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient(hunting): handle_auth_done global_id 7292 payload 824 2024-09-12T17:45:26.535 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient: _finish_hunting 0 2024-09-12T17:45:26.535 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:45:26.392+0000 7fd775956640 1 monclient: found mon.noname-c 2024-09-12T17:45:26.535 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:45:26.392+0000 7fd775956640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.535 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.535 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:45:26.535 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: dump: 2024-09-12T17:45:26.535 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: _finish_auth 0 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.536 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.537 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:45:26.537 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:45:26.393+0000 7fd662604640 10 monclient: dump: 2024-09-12T17:45:26.537 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.537 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.537 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.537 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.537 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.537 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.537 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.537 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.537 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.537 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.537 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:45:26.393+0000 7fd779d21800 5 monclient: authenticate success, global_id 7292 2024-09-12T17:45:26.537 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:45:26.393+0000 7fd779d21800 10 monclient: _renew_subs 2024-09-12T17:45:26.538 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:45:26.393+0000 7fd663e07640 4 set_mon_vals no callback set 2024-09-12T17:45:26.538 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:45:26.393+0000 7fd779d21800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.538 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:45:26.393+0000 7fd779d21800 10 monclient: _renew_subs 2024-09-12T17:45:26.538 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:45:26.393+0000 7fd779d21800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.538 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:45:26.393+0000 7fd779d21800 1 librados: init done 2024-09-12T17:45:26.538 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:45:26.395+0000 7fd662604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:26.538 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:45:26.395+0000 7fd662604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:45:26.538 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:45:26.395+0000 7fd662604640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:45:26.538 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:45:26.395+0000 7fd775155640 10 monclient: get_auth_request con 0x7fd65c076470 auth_method 0 2024-09-12T17:45:26.538 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:45:26.395+0000 7fd776157640 10 monclient: get_auth_request con 0x55ed92ce0480 auth_method 0 2024-09-12T17:45:26.538 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:45:26.396+0000 7fd775956640 10 monclient: get_auth_request con 0x55ed92d03ed0 auth_method 0 2024-09-12T17:45:26.538 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:45:26.397+0000 7fd775155640 10 monclient: get_auth_request con 0x55ed92d08f60 auth_method 0 2024-09-12T17:45:26.538 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:45:26.398+0000 7fd779d21800 10 monclient: build_initial_monmap 2024-09-12T17:45:26.539 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:45:26.398+0000 7fd779d21800 1 build_initial for_mkfs: 0 2024-09-12T17:45:26.539 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:45:26.398+0000 7fd779d21800 10 monclient: monmap: 2024-09-12T17:45:26.539 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:45:26.539 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:26.539 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:45:26.539 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:45:26.539 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:26.539 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.539 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:45:26.539 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:45:26.539 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:45:26.539 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.539 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding auth protocol: cephx 2024-09-12T17:45:26.539 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding auth protocol: cephx 2024-09-12T17:45:26.540 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding auth protocol: cephx 2024-09-12T17:45:26.540 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: secure 2024-09-12T17:45:26.540 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: crc 2024-09-12T17:45:26.540 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: secure 2024-09-12T17:45:26.540 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: crc 2024-09-12T17:45:26.540 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: secure 2024-09-12T17:45:26.540 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: crc 2024-09-12T17:45:26.540 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: crc 2024-09-12T17:45:26.540 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: secure 2024-09-12T17:45:26.540 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: crc 2024-09-12T17:45:26.540 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: secure 2024-09-12T17:45:26.540 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: crc 2024-09-12T17:45:26.540 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:45:26.398+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0ce00) adding con mode: secure 2024-09-12T17:45:26.541 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:45:26.398+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.541 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command objecter_requests cmddesc objecter_requests hook 0x55ed92d102d0 EEXIST 2024-09-12T17:45:26.541 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient: init 2024-09-12T17:45:26.541 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding auth protocol: cephx 2024-09-12T17:45:26.541 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding auth protocol: cephx 2024-09-12T17:45:26.541 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding auth protocol: cephx 2024-09-12T17:45:26.541 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: secure 2024-09-12T17:45:26.541 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: crc 2024-09-12T17:45:26.541 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: secure 2024-09-12T17:45:26.541 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: crc 2024-09-12T17:45:26.541 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: secure 2024-09-12T17:45:26.541 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: crc 2024-09-12T17:45:26.541 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: crc 2024-09-12T17:45:26.541 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: secure 2024-09-12T17:45:26.542 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: crc 2024-09-12T17:45:26.542 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: secure 2024-09-12T17:45:26.542 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: crc 2024-09-12T17:45:26.542 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 AuthRegistry(0x55ed92d0bdb8) adding con mode: secure 2024-09-12T17:45:26.542 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:45:26.399+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.542 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:45:26.399+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.542 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:45:26.399+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command rotate-key cmddesc rotate-key hook 0x55ed92d0bf00 EEXIST 2024-09-12T17:45:26.542 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:26.542 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:45:26.542 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-c con 0x55ed92d345f0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:45:26.542 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-a con 0x55ed92d349d0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:45:26.542 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-b con 0x55ed92d33300 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:45:26.542 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.543 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.543 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.543 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:26.543 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:45:26.399+0000 7fd779d21800 10 monclient(hunting): authenticate will time out at 2099.035770s 2024-09-12T17:45:26.543 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:45:26.399+0000 7fd775956640 10 monclient(hunting): get_auth_request con 0x55ed92d345f0 auth_method 0 2024-09-12T17:45:26.543 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:45:26.399+0000 7fd775956640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.543 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:45:26.399+0000 7fd775956640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.543 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:45:26.399+0000 7fd775956640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.543 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:45:26.399+0000 7fd775155640 10 monclient(hunting): get_auth_request con 0x55ed92d349d0 auth_method 0 2024-09-12T17:45:26.543 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:45:26.399+0000 7fd775155640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.543 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:45:26.399+0000 7fd775155640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.543 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:45:26.399+0000 7fd775155640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.543 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:45:26.399+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.543 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:45:26.399+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.544 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:45:26.399+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.544 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:45:26.399+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.544 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:45:26.399+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.544 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:45:26.400+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.544 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:45:26.400+0000 7fd776157640 10 monclient(hunting): get_auth_request con 0x55ed92d33300 auth_method 0 2024-09-12T17:45:26.544 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:45:26.400+0000 7fd776157640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.544 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:45:26.400+0000 7fd776157640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.544 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:45:26.400+0000 7fd776157640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.544 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:45:26.400+0000 7fd775956640 10 monclient(hunting): handle_auth_done global_id 7295 payload 824 2024-09-12T17:45:26.544 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:45:26.400+0000 7fd775956640 10 monclient: _finish_hunting 0 2024-09-12T17:45:26.544 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:45:26.400+0000 7fd775956640 1 monclient: found mon.noname-c 2024-09-12T17:45:26.544 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:45:26.400+0000 7fd775956640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.544 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.545 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:45:26.545 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: dump: 2024-09-12T17:45:26.545 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.545 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.545 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.545 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.545 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.545 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.545 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.545 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.545 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.545 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.545 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: _finish_auth 0 2024-09-12T17:45:26.546 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.546 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.546 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.546 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:45:26.546 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:45:26.400+0000 7fd65b7fe640 10 monclient: dump: 2024-09-12T17:45:26.546 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.546 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.546 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.546 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.546 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.546 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.546 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.546 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.546 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.547 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.547 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:45:26.400+0000 7fd779d21800 5 monclient: authenticate success, global_id 7295 2024-09-12T17:45:26.547 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:45:26.400+0000 7fd776958640 4 set_mon_vals no callback set 2024-09-12T17:45:26.547 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:45:26.400+0000 7fd779d21800 10 monclient: _renew_subs 2024-09-12T17:45:26.547 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:45:26.400+0000 7fd779d21800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.547 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:45:26.400+0000 7fd779d21800 10 monclient: _renew_subs 2024-09-12T17:45:26.547 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:45:26.400+0000 7fd779d21800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.547 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:45:26.402+0000 7fd65b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:26.547 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:45:26.402+0000 7fd65b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:45:26.547 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:45:26.402+0000 7fd65b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:45:26.547 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:45:26.402+0000 7fd775155640 10 monclient: get_auth_request con 0x7fd650076380 auth_method 0 2024-09-12T17:45:26.548 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:45:26.402+0000 7fd779d21800 10 monclient: get_monmap_and_config 2024-09-12T17:45:26.548 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:45:26.402+0000 7fd779d21800 10 monclient: build_initial_monmap 2024-09-12T17:45:26.548 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:45:26.402+0000 7fd779d21800 1 build_initial for_mkfs: 0 2024-09-12T17:45:26.548 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:45:26.402+0000 7fd779d21800 10 monclient: monmap: 2024-09-12T17:45:26.548 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:45:26.548 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:26.548 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:45:26.548 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:45:26.548 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:26.548 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.548 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:45:26.548 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:45:26.548 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:45:26.549 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.549 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding auth protocol: cephx 2024-09-12T17:45:26.549 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding auth protocol: cephx 2024-09-12T17:45:26.549 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding auth protocol: cephx 2024-09-12T17:45:26.549 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: secure 2024-09-12T17:45:26.549 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: crc 2024-09-12T17:45:26.549 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: secure 2024-09-12T17:45:26.549 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: crc 2024-09-12T17:45:26.549 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: secure 2024-09-12T17:45:26.549 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: crc 2024-09-12T17:45:26.549 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: crc 2024-09-12T17:45:26.549 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: secure 2024-09-12T17:45:26.549 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: crc 2024-09-12T17:45:26.550 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: secure 2024-09-12T17:45:26.550 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: crc 2024-09-12T17:45:26.550 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x55ed92d54000) adding con mode: secure 2024-09-12T17:45:26.550 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:45:26.402+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.550 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:45:26.402+0000 7fd779d21800 10 monclient: init 2024-09-12T17:45:26.550 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding auth protocol: cephx 2024-09-12T17:45:26.550 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding auth protocol: cephx 2024-09-12T17:45:26.550 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding auth protocol: cephx 2024-09-12T17:45:26.550 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: secure 2024-09-12T17:45:26.550 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: crc 2024-09-12T17:45:26.550 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: secure 2024-09-12T17:45:26.550 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: crc 2024-09-12T17:45:26.550 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: secure 2024-09-12T17:45:26.551 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: crc 2024-09-12T17:45:26.551 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: crc 2024-09-12T17:45:26.551 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: secure 2024-09-12T17:45:26.551 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: crc 2024-09-12T17:45:26.551 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: secure 2024-09-12T17:45:26.551 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: crc 2024-09-12T17:45:26.551 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:45:26.402+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b80420) adding con mode: secure 2024-09-12T17:45:26.551 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:45:26.403+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.551 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:45:26.403+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.551 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:45:26.403+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command rotate-key cmddesc rotate-key hook 0x7ffd46b80568 EEXIST 2024-09-12T17:45:26.551 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:26.551 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:45:26.551 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-a con 0x55ed92d88660 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:45:26.552 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-c con 0x55ed92d595b0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:45:26.552 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-b con 0x55ed92d83f00 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:45:26.552 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.552 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.552 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.552 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:26.552 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:45:26.403+0000 7fd779d21800 10 monclient(hunting): authenticate will time out at 2099.039393s 2024-09-12T17:45:26.552 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient(hunting): get_auth_request con 0x55ed92d88660 auth_method 0 2024-09-12T17:45:26.552 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.552 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.552 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.552 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:45:26.403+0000 7fd775155640 10 monclient(hunting): get_auth_request con 0x55ed92d595b0 auth_method 0 2024-09-12T17:45:26.552 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:45:26.403+0000 7fd775155640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.553 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:45:26.403+0000 7fd775155640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.553 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:45:26.403+0000 7fd775155640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.553 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.553 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.553 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.553 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:45:26.403+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.553 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:45:26.403+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.553 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:45:26.403+0000 7fd775155640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.553 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:45:26.403+0000 7fd776157640 10 monclient(hunting): get_auth_request con 0x55ed92d83f00 auth_method 0 2024-09-12T17:45:26.553 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:45:26.403+0000 7fd776157640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.553 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:45:26.403+0000 7fd776157640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.553 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:45:26.403+0000 7fd776157640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.553 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient(hunting): handle_auth_done global_id 7833 payload 274 2024-09-12T17:45:26.554 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient: _finish_hunting 0 2024-09-12T17:45:26.554 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:45:26.403+0000 7fd775956640 1 monclient: found mon.noname-a 2024-09-12T17:45:26.554 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:45:26.403+0000 7fd775956640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:45:26.554 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:45:26.403+0000 7fd6597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.554 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:45:26.403+0000 7fd6597fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:45:26.554 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:45:26.403+0000 7fd6597fa640 10 monclient: dump: 2024-09-12T17:45:26.554 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.554 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.554 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.554 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.554 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.554 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.554 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.554 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.555 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.555 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.555 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:45:26.404+0000 7fd6597fa640 10 monclient: _finish_auth 0 2024-09-12T17:45:26.555 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:45:26.404+0000 7fd6597fa640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.555 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:45:26.404+0000 7fd6597fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.555 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:45:26.404+0000 7fd6597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.555 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:45:26.404+0000 7fd6597fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:45:26.555 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:45:26.404+0000 7fd6597fa640 10 monclient: dump: 2024-09-12T17:45:26.555 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.555 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.555 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.555 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.555 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.555 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.556 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.556 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.556 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.556 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.556 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 monclient: authenticate success, global_id 7833 2024-09-12T17:45:26.556 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:45:26.404+0000 7fd779d21800 10 monclient: get_monmap_and_config success 2024-09-12T17:45:26.556 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:45:26.404+0000 7fd779d21800 4 set_mon_vals no callback set 2024-09-12T17:45:26.556 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:45:26.404+0000 7fd779d21800 10 monclient: shutdown 2024-09-12T17:45:26.556 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:45:26.404+0000 7fd779d21800 10 monclient: build_initial_monmap 2024-09-12T17:45:26.556 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:45:26.404+0000 7fd779d21800 1 build_initial for_mkfs: 0 2024-09-12T17:45:26.556 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:45:26.404+0000 7fd779d21800 10 monclient: monmap: 2024-09-12T17:45:26.556 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:45:26.556 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:45:26.557 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:45:26.557 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:45:26.557 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:45:26.557 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.557 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:45:26.557 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:45:26.557 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:45:26.557 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.557 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding auth protocol: cephx 2024-09-12T17:45:26.557 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding auth protocol: cephx 2024-09-12T17:45:26.557 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding auth protocol: cephx 2024-09-12T17:45:26.557 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: secure 2024-09-12T17:45:26.557 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: crc 2024-09-12T17:45:26.558 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: secure 2024-09-12T17:45:26.558 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: crc 2024-09-12T17:45:26.558 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: secure 2024-09-12T17:45:26.558 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: crc 2024-09-12T17:45:26.558 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: crc 2024-09-12T17:45:26.558 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: secure 2024-09-12T17:45:26.558 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: crc 2024-09-12T17:45:26.558 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: secure 2024-09-12T17:45:26.558 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: crc 2024-09-12T17:45:26.558 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:45:26.404+0000 7fd779d21800 5 AuthRegistry(0x55ed92d7a230) adding con mode: secure 2024-09-12T17:45:26.558 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:45:26.404+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.558 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:45:26.404+0000 7fd779d21800 1 librados: starting msgr at 2024-09-12T17:45:26.558 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:45:26.404+0000 7fd779d21800 1 librados: starting objecter 2024-09-12T17:45:26.558 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command objecter_requests cmddesc objecter_requests hook 0x55ed92d32a30 EEXIST 2024-09-12T17:45:26.559 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:45:26.405+0000 7fd779d21800 1 librados: setting wanted keys 2024-09-12T17:45:26.559 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:45:26.405+0000 7fd779d21800 1 librados: calling monclient init 2024-09-12T17:45:26.559 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient: init 2024-09-12T17:45:26.559 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding auth protocol: cephx 2024-09-12T17:45:26.559 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding auth protocol: cephx 2024-09-12T17:45:26.559 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding auth protocol: cephx 2024-09-12T17:45:26.559 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: secure 2024-09-12T17:45:26.559 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: crc 2024-09-12T17:45:26.559 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: secure 2024-09-12T17:45:26.559 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: crc 2024-09-12T17:45:26.559 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: secure 2024-09-12T17:45:26.559 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: crc 2024-09-12T17:45:26.559 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: crc 2024-09-12T17:45:26.560 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: secure 2024-09-12T17:45:26.560 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: crc 2024-09-12T17:45:26.560 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: secure 2024-09-12T17:45:26.560 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: crc 2024-09-12T17:45:26.560 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 AuthRegistry(0x55ed92d48eb0) adding con mode: secure 2024-09-12T17:45:26.560 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:45:26.405+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.560 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:45:26.405+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.560 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:45:26.405+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command rotate-key cmddesc rotate-key hook 0x55ed92d48ff8 EEXIST 2024-09-12T17:45:26.560 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient: _reopen_session rank -1 2024-09-12T17:45:26.560 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:45:26.560 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-a con 0x55ed92d595b0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:45:26.560 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-b con 0x55ed92d83f00 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:45:26.560 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient(hunting): picked mon.noname-c con 0x55ed92d88660 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:45:26.561 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.561 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.561 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient(hunting): start opening mon connection 2024-09-12T17:45:26.561 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient(hunting): _renew_subs 2024-09-12T17:45:26.561 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:45:26.405+0000 7fd779d21800 10 monclient(hunting): authenticate will time out at 2099.041694s 2024-09-12T17:45:26.561 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:45:26.405+0000 7fd775956640 10 monclient(hunting): get_auth_request con 0x55ed92d595b0 auth_method 0 2024-09-12T17:45:26.561 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:45:26.405+0000 7fd775956640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.561 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:45:26.405+0000 7fd775956640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.561 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:45:26.405+0000 7fd775956640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.561 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:45:26.405+0000 7fd776157640 10 monclient(hunting): get_auth_request con 0x55ed92d88660 auth_method 0 2024-09-12T17:45:26.561 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:45:26.405+0000 7fd776157640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:45:26.561 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:45:26.405+0000 7fd776157640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:45:26.561 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:45:26.405+0000 7fd776157640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:45:26.562 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:45:26.405+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.562 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:45:26.405+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.562 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:45:26.405+0000 7fd775956640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.562 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:45:26.405+0000 7fd776157640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:45:26.562 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:45:26.405+0000 7fd776157640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:45:26.562 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:45:26.405+0000 7fd776157640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:45:26.562 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:45:26.406+0000 7fd776157640 10 monclient(hunting): handle_auth_done global_id 7301 payload 824 2024-09-12T17:45:26.562 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:45:26.406+0000 7fd776157640 10 monclient: _finish_hunting 0 2024-09-12T17:45:26.562 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:45:26.406+0000 7fd776157640 1 monclient: found mon.noname-c 2024-09-12T17:45:26.562 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:45:26.406+0000 7fd776157640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.562 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.562 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:45:26.562 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: dump: 2024-09-12T17:45:26.563 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.563 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.563 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.563 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.563 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.563 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.563 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.563 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.563 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.563 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.563 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: _finish_auth 0 2024-09-12T17:45:26.563 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: _check_auth_tickets 2024-09-12T17:45:26.563 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:45:26.563 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:45:26.564 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:45:26.564 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:45:26.406+0000 7fd6477fe640 10 monclient: dump: 2024-09-12T17:45:26.564 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:45:26.564 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:45:26.564 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.564 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:45:26.564 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:45:26.564 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:45:26.564 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:45:26.564 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:45:26.564 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:45:26.564 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.564 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:45:26.406+0000 7fd779d21800 5 monclient: authenticate success, global_id 7301 2024-09-12T17:45:26.565 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:45:26.406+0000 7fd779d21800 10 monclient: _renew_subs 2024-09-12T17:45:26.565 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:45:26.406+0000 7fd779d21800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.565 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:45:26.406+0000 7fd6597fa640 4 set_mon_vals no callback set 2024-09-12T17:45:26.565 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:45:26.406+0000 7fd779d21800 10 monclient: _renew_subs 2024-09-12T17:45:26.565 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:45:26.406+0000 7fd779d21800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.565 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:45:26.406+0000 7fd779d21800 1 librados: init done 2024-09-12T17:45:26.565 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:45:26.406+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command cr dump hook 0x55ed92d81848 2024-09-12T17:45:26.565 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:45:26.407+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.565 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:45:26.408+0000 7fd6477fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:45:26.565 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:45:26.408+0000 7fd6477fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:45:26.565 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:45:26.408+0000 7fd6477fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:45:26.565 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:45:26.408+0000 7fd775956640 10 monclient: get_auth_request con 0x7fd640076470 auth_method 0 2024-09-12T17:45:26.565 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:45:26.409+0000 7fd775155640 10 monclient: get_auth_request con 0x55ed92da2140 auth_method 0 2024-09-12T17:45:26.566 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:45:26.409+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.566 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:45:26.409+0000 7fd779d21800 20 realm 2024-09-12T17:45:26.566 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:45:26.409+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.566 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:45:26.409+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.566 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:45:26.409+0000 7fd779d21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:26.566 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:45:26.409+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.566 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:45:26.410+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.566 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:45:26.410+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.566 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:45:26.410+0000 7fd775956640 10 monclient: get_auth_request con 0x55ed92da6440 auth_method 0 2024-09-12T17:45:26.566 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:45:26.410+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.566 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:45:26.410+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.566 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:45:26.411+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:26.566 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:45:26.411+0000 7fd779d21800 20 searching for the correct realm 2024-09-12T17:45:26.566 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:45:26.411+0000 7fd775155640 10 monclient: get_auth_request con 0x55ed92dab570 auth_method 0 2024-09-12T17:45:26.567 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:45:26.412+0000 7fd776157640 10 monclient: get_auth_request con 0x7fd76c02a070 auth_method 0 2024-09-12T17:45:26.567 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:45:26.413+0000 7fd775956640 10 monclient: get_auth_request con 0x7fd7700a7e60 auth_method 0 2024-09-12T17:45:26.567 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:45:26.413+0000 7fd775155640 10 monclient: get_auth_request con 0x7fd768027030 auth_method 0 2024-09-12T17:45:26.567 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:45:26.414+0000 7fd775155640 0 -- 172.21.15.44:0/3284105154 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55ed92dab570 msgr2=0x55ed92dada30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.567 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:45:26.414+0000 7fd6477fe640 1 client.7301.objecter ms_handle_reset 0x55ed92dab570 session 0x55ed92daaef0 osd.3 2024-09-12T17:45:26.567 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:45:26.414+0000 7fd6477fe640 10 monclient: _renew_subs 2024-09-12T17:45:26.567 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:45:26.414+0000 7fd6477fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:45:26.567 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:45:26.414+0000 7fd775155640 10 monclient: get_auth_request con 0x7fd640086290 auth_method 0 2024-09-12T17:45:26.567 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:45:26.415+0000 7fd776157640 10 monclient: get_auth_request con 0x7fd76c01a040 auth_method 0 2024-09-12T17:45:26.567 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:45:26.417+0000 7fd775956640 10 monclient: get_auth_request con 0x7fd76c037400 auth_method 0 2024-09-12T17:45:26.567 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:45:26.417+0000 7fd775956640 0 -- 172.21.15.44:0/3284105154 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fd76c037400 msgr2=0x7fd76c037840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.567 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:45:26.417+0000 7fd6477fe640 1 client.7301.objecter ms_handle_reset 0x7fd76c037400 session 0x7fd76c019950 osd.0 2024-09-12T17:45:26.567 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:45:26.418+0000 7fd775956640 10 monclient: get_auth_request con 0x55ed92dab570 auth_method 0 2024-09-12T17:45:26.567 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:26.568 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:26.568 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:26.568 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:26.568 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:26.568 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:26.568 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.568 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.568 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.568 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.569 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:45:26.422+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.569 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:26.569 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:45:26.423+0000 7fd779d21800 20 zone default found 2024-09-12T17:45:26.569 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:45:26.423+0000 7fd779d21800 4 Realm: () 2024-09-12T17:45:26.569 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:45:26.423+0000 7fd779d21800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:26.569 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:45:26.423+0000 7fd779d21800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:26.569 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:45:26.423+0000 7fd779d21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:26.569 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:45:26.423+0000 7fd779d21800 20 zonegroup default 2024-09-12T17:45:26.569 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.569 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.569 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.569 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.569 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:45:26.423+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.570 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:45:26.424+0000 7fd779d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.570 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:45:26.424+0000 7fd779d21800 20 started sync module instance, tier type = 2024-09-12T17:45:26.570 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:45:26.424+0000 7fd779d21800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:26.570 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=0 2024-09-12T17:45:26.570 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=1 2024-09-12T17:45:26.570 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=2 2024-09-12T17:45:26.570 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=3 2024-09-12T17:45:26.570 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=4 2024-09-12T17:45:26.570 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=5 2024-09-12T17:45:26.570 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:45:26.433+0000 7fd779d21800 20 add_watcher() i=6 2024-09-12T17:45:26.570 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:45:26.434+0000 7fd779d21800 20 add_watcher() i=7 2024-09-12T17:45:26.570 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:45:26.434+0000 7fd779d21800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:26.570 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding auth protocol: cephx 2024-09-12T17:45:26.570 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding auth protocol: cephx 2024-09-12T17:45:26.571 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding auth protocol: cephx 2024-09-12T17:45:26.571 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: secure 2024-09-12T17:45:26.571 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: crc 2024-09-12T17:45:26.571 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: secure 2024-09-12T17:45:26.571 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: crc 2024-09-12T17:45:26.571 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: secure 2024-09-12T17:45:26.571 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: crc 2024-09-12T17:45:26.571 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:45:26.435+0000 7fd627fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:26.571 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: crc 2024-09-12T17:45:26.571 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: secure 2024-09-12T17:45:26.571 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: crc 2024-09-12T17:45:26.571 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: secure 2024-09-12T17:45:26.571 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: crc 2024-09-12T17:45:26.571 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:45:26.435+0000 7fd779d21800 5 AuthRegistry(0x7ffd46b808f0) adding con mode: secure 2024-09-12T17:45:26.572 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:45:26.436+0000 7fd779d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:45:26.572 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:45:26.436+0000 7fd779d21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:26.572 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:45:26.436+0000 7fd779d21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:26.572 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command cache list hook 0x55ed92d79d10 2024-09-12T17:45:26.572 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command cache inspect hook 0x55ed92d79d10 2024-09-12T17:45:26.572 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command cache erase hook 0x55ed92d79d10 2024-09-12T17:45:26.572 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command cache zap hook 0x55ed92d79d10 2024-09-12T17:45:26.572 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 note: GC not initialized 2024-09-12T17:45:26.572 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:45:26.436+0000 7fd626ffd640 20 reqs_thread_entry: start 2024-09-12T17:45:26.572 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command sync trace show hook 0x7fd768087070 2024-09-12T17:45:26.572 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command sync trace history hook 0x7fd768087070 2024-09-12T17:45:26.572 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command sync trace active hook 0x7fd768087070 2024-09-12T17:45:26.572 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:45:26.436+0000 7fd779d21800 5 asok(0x55ed92a94730) register_command sync trace active_short hook 0x7fd768087070 2024-09-12T17:45:26.573 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:45:26.436+0000 7fd779d21800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:26.573 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:45:26.436+0000 7fd779d21800 20 Filter name: none 2024-09-12T17:45:26.573 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:45:26.436+0000 7fd624ff9640 20 reqs_thread_entry: start 2024-09-12T17:45:26.573 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:45:26.436+0000 7fd779d21800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:45:26.573 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:45:26.436+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.573 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:45:26.437+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:26.573 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:45:26.437+0000 7fd779d21800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:45:26.573 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:45:26.437+0000 7fd779d21800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:45:26.573 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:45:26.437+0000 7fd779d21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 : miss 2024-09-12T17:45:26.573 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:45:26.437+0000 7fd779d21800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.573 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:45:26.437+0000 7fd779d21800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:45:26.573 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:45:26.437+0000 7fd779d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:26.573 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:45:26.437+0000 7fd779d21800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:26.574 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:45:26.437+0000 7fd779d21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:26.574 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:45:26.437+0000 7fd779d21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:26.574 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:45:26.437+0000 7fd779d21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 2024-09-12T17:45:26.574 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:45:26.443+0000 7fd779d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:26.574 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:45:26.443+0000 7fd779d21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:26.574 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:45:26.443+0000 7fd779d21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:26.574 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:45:26.443+0000 7fd779d21800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37, ofs0, ns] 2024-09-12T17:45:26.574 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:45:26.443+0000 7fd658ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562380 cookie 94478859452272 notifier 7301 bl.length()=1007 2024-09-12T17:45:26.574 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:45:26.443+0000 7fd658ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:26.574 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:45:26.443+0000 7fd658ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:26.574 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:45:26.443+0000 7fd658ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:26.574 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:45:26.443+0000 7fd779d21800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): orig_sources= new_sources= 2024-09-12T17:45:26.574 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:45:26.443+0000 7fd779d21800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): potential sources added=[] removed=[] 2024-09-12T17:45:26.575 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:45:26.443+0000 7fd779d21800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): orig_dests= new_dests= 2024-09-12T17:45:26.575 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:45:26.443+0000 7fd779d21800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): potential dests added=[] removed=[] 2024-09-12T17:45:26.575 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:45:26.443+0000 7fd6477fe640 1 client.7301.objecter ms_handle_reset 0x55ed92da6440 session 0x55ed92da5330 osd.5 2024-09-12T17:45:26.575 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:45:26.444+0000 7fd6477fe640 1 client.7301.objecter ms_handle_reset 0x55ed92da2140 session 0x55ed92da1a70 osd.1 2024-09-12T17:45:26.575 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:45:26.444+0000 7fd775956640 10 monclient: get_auth_request con 0x55ed92da6440 auth_method 0 2024-09-12T17:45:26.575 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:45:26.445+0000 7fd775155640 10 monclient: get_auth_request con 0x7fd76c037400 auth_method 0 2024-09-12T17:45:26.575 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:45:26.447+0000 7fd779d21800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd779d21800 time 2024-09-12T17:45:26.447574+0000 2024-09-12T17:45:26.575 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:45:26.575 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.575 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:26.575 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd77b38c71a] 2024-09-12T17:45:26.575 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd77b38c8d8] 2024-09-12T17:45:26.575 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ed919af841] 2024-09-12T17:45:26.575 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd7490c) [0x55ed91ebd90c] 2024-09-12T17:45:26.576 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ed919bf50d] 2024-09-12T17:45:26.576 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:45:26.576 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd77a029590] 2024-09-12T17:45:26.576 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:45:26.576 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:45:26.576 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.576 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:45:26.448+0000 7fd779d21800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:45:26.576 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7fd779d21800 thread_name:radosgw-admin 2024-09-12T17:45:26.576 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.576 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:45:26.576 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd77a03e6f0] 2024-09-12T17:45:26.576 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd77a08b99c] 2024-09-12T17:45:26.576 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:45:26.577 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:45:26.577 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd77b38c774] 2024-09-12T17:45:26.577 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd77b38c8d8] 2024-09-12T17:45:26.577 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ed919af841] 2024-09-12T17:45:26.577 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd7490c) [0x55ed91ebd90c] 2024-09-12T17:45:26.577 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ed919bf50d] 2024-09-12T17:45:26.577 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:45:26.577 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd77a029590] 2024-09-12T17:45:26.577 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:45:26.577 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:45:26.577 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:45:26.577 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.577 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:45:26.578 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:45:26.578 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:45:26.578 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:45:26.578 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:45:26.578 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:45:26.578 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:45:26.578 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:45:26.578 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:45:26.578 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:45:26.578 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:45:26.578 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:45:26.578 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:45:26.578 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:45:26.578 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:45:26.579 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:45:26.579 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:45:26.579 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:45:26.579 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:45:26.579 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:45:26.579 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:45:26.579 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:45:26.579 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:45:26.579 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:45:26.579 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:45:26.579 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:45:26.579 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:45:26.579 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:45:26.579 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:45:26.580 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:45:26.580 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:45:26.580 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:45:26.580 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:45:26.580 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:45:26.580 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:45:26.580 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:45:26.580 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:45:26.580 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:45:26.580 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:45:26.580 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:45:26.580 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:45:26.580 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:45:26.580 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:45:26.581 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:45:26.581 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:45:26.581 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:45:26.581 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:45:26.581 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:45:26.581 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:45:26.581 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:45:26.581 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:45:26.581 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:45:26.581 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:45:26.581 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:45:26.581 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:45:26.581 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:45:26.582 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:45:26.582 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:45:26.582 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:45:26.582 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:45:26.582 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:45:26.582 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:45:26.582 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:45:26.582 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:45:26.582 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:45:26.582 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:45:26.582 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:45:26.582 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:45:26.582 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:45:26.582 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:45:26.583 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:45:26.583 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:45:26.583 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:45:26.583 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:45:26.583 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:45:26.583 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:45:26.583 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:45:26.583 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:45:26.583 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:45:26.583 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:45:26.583 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:45:26.583 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:45:26.583 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:45:26.583 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:45:26.583 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:45:26.584 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:45:26.584 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:45:26.584 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:45:26.584 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:45:26.584 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:45:26.584 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:45:26.584 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:45:26.584 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:45:26.584 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:45:26.584 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd624ff9640 / http_manager 2024-09-12T17:45:26.584 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd626ffd640 / http_manager 2024-09-12T17:45:26.584 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd627fff640 / rgw_dt_lg_renew 2024-09-12T17:45:26.584 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd6477fe640 / ms_dispatch 2024-09-12T17:45:26.584 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd658ff9640 / io_context_pool 2024-09-12T17:45:26.585 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd6597fa640 / io_context_pool 2024-09-12T17:45:26.585 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd65b7fe640 / ms_dispatch 2024-09-12T17:45:26.585 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd662604640 / ms_dispatch 2024-09-12T17:45:26.585 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd663e07640 / io_context_pool 2024-09-12T17:45:26.585 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd775155640 / msgr-worker-2 2024-09-12T17:45:26.585 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd775956640 / msgr-worker-1 2024-09-12T17:45:26.585 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd776157640 / msgr-worker-0 2024-09-12T17:45:26.585 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd776958640 / io_context_pool 2024-09-12T17:45:26.585 INFO:tasks.workunit.client.0.smithi044.stderr: 7fd779d21800 / radosgw-admin 2024-09-12T17:45:26.585 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:45:26.585 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:45:26.585 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:45:26.449242Z_d9f5fad2-746a-4b50-9b53-01194ade38fe/log 2024-09-12T17:45:26.585 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:45:26.585 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:45:26.587 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:26.587 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:26.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.525+0000 7f5252a13800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.527+0000 7f5252a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.527+0000 7f5252a13800 20 realm 2024-09-12T17:45:26.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.527+0000 7f5252a13800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.527+0000 7f5252a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.527+0000 7f5252a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:26.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.527+0000 7f5252a13800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.527+0000 7f5252a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.527+0000 7f5252a13800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.528+0000 7f5252a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.528+0000 7f5252a13800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.529+0000 7f5252a13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:26.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.529+0000 7f5252a13800 20 searching for the correct realm 2024-09-12T17:45:26.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.533+0000 7f524e949640 0 -- 172.21.15.44:0/1914286071 >> [v2:172.21.15.181:6810/2228110208,v1:172.21.15.181:6811/2228110208] conn(0x7f5238014930 msgr2=0x7f523804a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.739+0000 7f524e148640 0 -- 172.21.15.44:0/1914286071 >> [v2:172.21.15.181:6826/1273321942,v1:172.21.15.181:6827/1273321942] conn(0x5630c613adb0 msgr2=0x5630c613d1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:26.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.742+0000 7f5252a13800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:26.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.742+0000 7f5252a13800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.742+0000 7f5252a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.742+0000 7f5252a13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.742+0000 7f5252a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.742+0000 7f5252a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.742+0000 7f5252a13800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.742+0000 7f5252a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.742+0000 7f5252a13800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.742+0000 7f5252a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.742+0000 7f5252a13800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.743+0000 7f5252a13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:26.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.743+0000 7f5252a13800 20 zone default found 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.743+0000 7f5252a13800 4 Realm: () 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.743+0000 7f5252a13800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.743+0000 7f5252a13800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.743+0000 7f5252a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.743+0000 7f5252a13800 20 zonegroup default 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.743+0000 7f5252a13800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.743+0000 7f5252a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.743+0000 7f5252a13800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.744+0000 7f5252a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.744+0000 7f5252a13800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.744+0000 7f5252a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.744+0000 7f5252a13800 20 started sync module instance, tier type = 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.744+0000 7f5252a13800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.753+0000 7f5252a13800 20 add_watcher() i=0 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.753+0000 7f5252a13800 20 add_watcher() i=1 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.753+0000 7f5252a13800 20 add_watcher() i=2 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.753+0000 7f5252a13800 20 add_watcher() i=3 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.753+0000 7f5252a13800 20 add_watcher() i=4 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.753+0000 7f5252a13800 20 add_watcher() i=5 2024-09-12T17:45:26.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.753+0000 7f5252a13800 20 add_watcher() i=6 2024-09-12T17:45:26.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.754+0000 7f5252a13800 20 add_watcher() i=7 2024-09-12T17:45:26.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.754+0000 7f5252a13800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:26.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.756+0000 7f5104fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.756+0000 7f5252a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.756+0000 7f5252a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.756+0000 7f5252a13800 5 note: GC not initialized 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.756+0000 7f507f7fe640 20 reqs_thread_entry: start 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.756+0000 7f5252a13800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:26.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.757+0000 7f5252a13800 20 Filter name: none 2024-09-12T17:45:26.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.757+0000 7f507d7fa640 20 reqs_thread_entry: start 2024-09-12T17:45:26.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.757+0000 7f5252a13800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.758+0000 7f5252a13800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:26.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.758+0000 7f5252a13800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.758+0000 7f5252a13800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.758+0000 7f5252a13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.758+0000 7f5252a13800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.758+0000 7f5252a13800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.758+0000 7f5252a13800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.759+0000 7f5252a13800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:45:26.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.759+0000 7f5252a13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:26.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.761+0000 7f5104fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:26.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.763+0000 7f5252a13800 20 remove_watcher() i=0 2024-09-12T17:45:26.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.763+0000 7f5252a13800 2 removed watcher, disabling cache 2024-09-12T17:45:26.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.764+0000 7f5252a13800 20 remove_watcher() i=1 2024-09-12T17:45:26.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.765+0000 7f5252a13800 20 remove_watcher() i=2 2024-09-12T17:45:26.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.766+0000 7f5252a13800 20 remove_watcher() i=3 2024-09-12T17:45:26.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.768+0000 7f5252a13800 20 remove_watcher() i=4 2024-09-12T17:45:26.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.769+0000 7f5252a13800 20 remove_watcher() i=5 2024-09-12T17:45:26.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.770+0000 7f5252a13800 20 remove_watcher() i=6 2024-09-12T17:45:26.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.771+0000 7f5252a13800 20 remove_watcher() i=7 2024-09-12T17:45:26.782 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.782 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:45:26.782 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-logrecord-writes id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:45:26.782 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:26.834 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:45:26.868 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:26.869 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:26.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.907+0000 7f3499d3c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.909+0000 7f3499d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.909+0000 7f3499d3c800 20 realm 2024-09-12T17:45:26.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.909+0000 7f3499d3c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.909+0000 7f3499d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.909+0000 7f3499d3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:26.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.909+0000 7f3499d3c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.909+0000 7f3499d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:26.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.909+0000 7f3499d3c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.910+0000 7f3499d3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:26.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.910+0000 7f3499d3c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:26.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.910+0000 7f3499d3c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:26.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.910+0000 7f3499d3c800 20 searching for the correct realm 2024-09-12T17:45:26.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:26.913+0000 7f3495280640 0 -- 172.21.15.44:0/1815430712 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f34880093c0 msgr2=0x7f34880e4a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:45:27.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.119+0000 7f3495a81640 0 -- 172.21.15.44:0/1815430712 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f348c05f4a0 msgr2=0x7f348c07a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:45:27.326 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.326+0000 7f3499d3c800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:27.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.326+0000 7f3499d3c800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:27.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.326+0000 7f3499d3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:27.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.326+0000 7f3499d3c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:27.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.326+0000 7f3499d3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:27.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.326+0000 7f3499d3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:27.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.326+0000 7f3499d3c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.326+0000 7f3499d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:27.327 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.326+0000 7f3499d3c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.328 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.326+0000 7f3499d3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:27.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.326+0000 7f3499d3c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.327+0000 7f3499d3c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:27.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.327+0000 7f3499d3c800 20 zone default found 2024-09-12T17:45:27.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.327+0000 7f3499d3c800 4 Realm: () 2024-09-12T17:45:27.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.327+0000 7f3499d3c800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:27.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.327+0000 7f3499d3c800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:27.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.327+0000 7f3499d3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:27.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.327+0000 7f3499d3c800 20 zonegroup default 2024-09-12T17:45:27.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.327+0000 7f3499d3c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.327+0000 7f3499d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:27.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.327+0000 7f3499d3c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.327+0000 7f3499d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:27.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.327+0000 7f3499d3c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.330 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.328+0000 7f3499d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:27.330 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.328+0000 7f3499d3c800 20 started sync module instance, tier type = 2024-09-12T17:45:27.330 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.328+0000 7f3499d3c800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:27.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.337+0000 7f3499d3c800 20 add_watcher() i=0 2024-09-12T17:45:27.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.337+0000 7f3499d3c800 20 add_watcher() i=1 2024-09-12T17:45:27.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.337+0000 7f3499d3c800 20 add_watcher() i=2 2024-09-12T17:45:27.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.337+0000 7f3499d3c800 20 add_watcher() i=3 2024-09-12T17:45:27.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.337+0000 7f3499d3c800 20 add_watcher() i=4 2024-09-12T17:45:27.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.337+0000 7f3499d3c800 20 add_watcher() i=5 2024-09-12T17:45:27.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.337+0000 7f3499d3c800 20 add_watcher() i=6 2024-09-12T17:45:27.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.338+0000 7f3499d3c800 20 add_watcher() i=7 2024-09-12T17:45:27.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.338+0000 7f3499d3c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:27.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.340+0000 7f33477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:27.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.340+0000 7f3499d3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:27.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.340+0000 7f3499d3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:27.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.340+0000 7f3499d3c800 5 note: GC not initialized 2024-09-12T17:45:27.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.341+0000 7f33467fc640 20 reqs_thread_entry: start 2024-09-12T17:45:27.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.341+0000 7f3499d3c800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:27.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.341+0000 7f3499d3c800 20 Filter name: none 2024-09-12T17:45:27.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.341+0000 7f32b7fff640 20 reqs_thread_entry: start 2024-09-12T17:45:27.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.341+0000 7f3499d3c800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:45:27.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.341+0000 7f3499d3c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.342+0000 7f3499d3c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:27.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.342+0000 7f3499d3c800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:45:27.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.342+0000 7f3499d3c800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:45:27.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.342+0000 7f3499d3c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 : miss 2024-09-12T17:45:27.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.342+0000 7f3499d3c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:27.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.342+0000 7f3499d3c800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:45:27.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.342+0000 7f3499d3c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:27.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.342+0000 7f3499d3c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:27.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.342+0000 7f3499d3c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:27.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.342+0000 7f3499d3c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:27.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.342+0000 7f3499d3c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 2024-09-12T17:45:27.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.343+0000 7f3499d3c800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to be held by another RGW process; skipping for now 2024-09-12T17:45:27.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.344+0000 7f33477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:27.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.346+0000 7f3499d3c800 20 remove_watcher() i=0 2024-09-12T17:45:27.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.346+0000 7f3499d3c800 2 removed watcher, disabling cache 2024-09-12T17:45:27.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.347+0000 7f3499d3c800 20 remove_watcher() i=1 2024-09-12T17:45:27.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.349+0000 7f3499d3c800 20 remove_watcher() i=2 2024-09-12T17:45:27.350 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.350+0000 7f3499d3c800 20 remove_watcher() i=3 2024-09-12T17:45:27.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.351+0000 7f3499d3c800 20 remove_watcher() i=4 2024-09-12T17:45:27.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.352+0000 7f3499d3c800 20 remove_watcher() i=5 2024-09-12T17:45:27.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.353+0000 7f3499d3c800 20 remove_watcher() i=6 2024-09-12T17:45:27.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:27.354+0000 7f3499d3c800 20 remove_watcher() i=7 2024-09-12T17:45:27.366 INFO:tasks.workunit.client.0.smithi044.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:45:57.385 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:45:57.422 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:57.422 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:57.467 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.466+0000 7f3292933800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.467+0000 7f3292933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.467+0000 7f3292933800 20 realm 2024-09-12T17:45:57.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.467+0000 7f3292933800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.467+0000 7f3292933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.467+0000 7f3292933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:57.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.467+0000 7f3292933800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.468+0000 7f3292933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.468+0000 7f3292933800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.469+0000 7f3292933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:57.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.469+0000 7f3292933800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.469+0000 7f3292933800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:57.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.469+0000 7f3292933800 20 searching for the correct realm 2024-09-12T17:45:57.475 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.473+0000 7f328de19640 0 -- 172.21.15.44:0/3552544861 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x561d1230dc00 msgr2=0x561d12310090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:57.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.478+0000 7f328e61a640 0 -- 172.21.15.44:0/3552544861 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f32840760c0 msgr2=0x7f328404c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:57.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.482+0000 7f3292933800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:57.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.482+0000 7f3292933800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:57.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.482+0000 7f3292933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:57.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.482+0000 7f3292933800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:57.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.482+0000 7f3292933800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:57.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.482+0000 7f3292933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:57.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.482+0000 7f3292933800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.482+0000 7f3292933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.482+0000 7f3292933800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.483+0000 7f3292933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:57.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.483+0000 7f3292933800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.483+0000 7f3292933800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:57.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.483+0000 7f3292933800 20 zone default found 2024-09-12T17:45:57.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.483+0000 7f3292933800 4 Realm: () 2024-09-12T17:45:57.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.483+0000 7f3292933800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:57.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.483+0000 7f3292933800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:57.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.483+0000 7f3292933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:57.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.483+0000 7f3292933800 20 zonegroup default 2024-09-12T17:45:57.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.483+0000 7f3292933800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.483+0000 7f3292933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.484+0000 7f3292933800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.484+0000 7f3292933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.484+0000 7f3292933800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.484+0000 7f3292933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.484+0000 7f3292933800 20 started sync module instance, tier type = 2024-09-12T17:45:57.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.484+0000 7f3292933800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:57.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.494+0000 7f3292933800 20 add_watcher() i=0 2024-09-12T17:45:57.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.494+0000 7f3292933800 20 add_watcher() i=1 2024-09-12T17:45:57.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.494+0000 7f3292933800 20 add_watcher() i=2 2024-09-12T17:45:57.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.494+0000 7f3292933800 20 add_watcher() i=3 2024-09-12T17:45:57.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.494+0000 7f3292933800 20 add_watcher() i=4 2024-09-12T17:45:57.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.494+0000 7f3292933800 20 add_watcher() i=5 2024-09-12T17:45:57.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.494+0000 7f3292933800 20 add_watcher() i=6 2024-09-12T17:45:57.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.495+0000 7f3292933800 20 add_watcher() i=7 2024-09-12T17:45:57.497 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.495+0000 7f3292933800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:57.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.497+0000 7f3144fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:57.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.497+0000 7f3292933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:57.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.497+0000 7f3292933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:57.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.497+0000 7f3292933800 5 note: GC not initialized 2024-09-12T17:45:57.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.498+0000 7f30bf7fe640 20 reqs_thread_entry: start 2024-09-12T17:45:57.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.498+0000 7f3292933800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:57.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.498+0000 7f3292933800 20 Filter name: none 2024-09-12T17:45:57.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.498+0000 7f30bd7fa640 20 reqs_thread_entry: start 2024-09-12T17:45:57.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.498+0000 7f3292933800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:45:57.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.498+0000 7f3292933800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.499+0000 7f3292933800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:57.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.499+0000 7f3292933800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:45:57.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.499+0000 7f3292933800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:45:57.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.499+0000 7f3292933800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 : miss 2024-09-12T17:45:57.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.499+0000 7f3292933800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.499+0000 7f3292933800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:45:57.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.499+0000 7f3292933800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:57.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.499+0000 7f3292933800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:57.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.499+0000 7f3292933800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:57.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.499+0000 7f3292933800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:57.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.499+0000 7f3292933800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 2024-09-12T17:45:57.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.500+0000 7f3292933800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:45:57.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.508+0000 7f3292933800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:57.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.508+0000 7f3292933800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:57.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.508+0000 7f3292933800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:57.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.508+0000 7f3292933800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37, ofs0, ns] 2024-09-12T17:45:57.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.508+0000 7f3171ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562381 cookie 94682859262288 notifier 7893 bl.length()=1007 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.508+0000 7f3171ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.508+0000 7f3171ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.508+0000 7f3171ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.509+0000 7f3292933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): orig_sources= new_sources= 2024-09-12T17:45:57.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.509+0000 7f3292933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): potential sources added=[] removed=[] 2024-09-12T17:45:57.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.509+0000 7f3292933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): orig_dests= new_dests= 2024-09-12T17:45:57.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.509+0000 7f3292933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): potential dests added=[] removed=[] 2024-09-12T17:45:57.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.0 2024-09-12T17:45:57.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.0 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.1 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.1 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.2 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.2 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.3 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.3 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.4 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.4 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.5 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.5 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.6 2024-09-12T17:45:57.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.6 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.7 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.7 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.8 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.8 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.9 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.9 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.10 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.10 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.11 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2.11 2024-09-12T17:45:57.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.0 2024-09-12T17:45:57.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.514+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.1 2024-09-12T17:45:57.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.515+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2 2024-09-12T17:45:57.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.515+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.3 2024-09-12T17:45:57.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.516+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.4 2024-09-12T17:45:57.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.517+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.5 2024-09-12T17:45:57.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.517+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.6 2024-09-12T17:45:57.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.518+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.7 2024-09-12T17:45:57.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.519+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.8 2024-09-12T17:45:57.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.519+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.9 2024-09-12T17:45:57.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.520+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.10 2024-09-12T17:45:57.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.523+0000 7f3292933800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:45:57.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.523+0000 7f3292933800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 2024-09-12T17:45:57.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.525+0000 7f3292933800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:57.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.525+0000 7f3292933800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:57.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.525+0000 7f3292933800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:57.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.525+0000 7f3292933800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37, ofs0, ns] 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.525+0000 7f31717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562382 cookie 94682859262288 notifier 7893 bl.length()=1007 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.525+0000 7f31717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.525+0000 7f31717fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.525+0000 7f31717fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.525+0000 7f3292933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): orig_sources= new_sources= 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.525+0000 7f3292933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): potential sources added=[] removed=[] 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.525+0000 7f3292933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): orig_dests= new_dests= 2024-09-12T17:45:57.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.525+0000 7f3292933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): potential dests added=[] removed=[] 2024-09-12T17:45:57.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.528+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.0 2024-09-12T17:45:57.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.528+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.1 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.528+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.2 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.529+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.3 2024-09-12T17:45:57.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.529+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.4 2024-09-12T17:45:57.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.529+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.5 2024-09-12T17:45:57.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.530+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.6 2024-09-12T17:45:57.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.531+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.7 2024-09-12T17:45:57.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.531+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.8 2024-09-12T17:45:57.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.532+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.9 2024-09-12T17:45:57.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.532+0000 7f3292933800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37.10 2024-09-12T17:45:57.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.532+0000 7f3292933800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:45:57.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.532+0000 7f3292933800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.534+0000 7f3292933800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.534+0000 7f3292933800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.534+0000 7f3292933800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:57.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.534+0000 7f3292933800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37, ofs0, ns] 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.535+0000 7f3171ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562383 cookie 94682859262288 notifier 7893 bl.length()=975 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.535+0000 7f3171ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 info.flags=0x17 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.535+0000 7f3171ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 to cache LRU end 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.535+0000 7f3171ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.535+0000 7f3292933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): orig_sources= new_sources= 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.535+0000 7f3292933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): potential sources added=[] removed=[] 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.535+0000 7f3292933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): orig_dests= new_dests= 2024-09-12T17:45:57.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.535+0000 7f3292933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37]): potential dests added=[] removed=[] 2024-09-12T17:45:57.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.538+0000 7f3292933800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:45:57.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.540+0000 7f3144fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:57.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.542+0000 7f3292933800 20 remove_watcher() i=0 2024-09-12T17:45:57.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.542+0000 7f3292933800 2 removed watcher, disabling cache 2024-09-12T17:45:57.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.544+0000 7f3292933800 20 remove_watcher() i=1 2024-09-12T17:45:57.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.545+0000 7f3292933800 20 remove_watcher() i=2 2024-09-12T17:45:57.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.546+0000 7f3292933800 20 remove_watcher() i=3 2024-09-12T17:45:57.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.547+0000 7f3292933800 20 remove_watcher() i=4 2024-09-12T17:45:57.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.548+0000 7f3292933800 20 remove_watcher() i=5 2024-09-12T17:45:57.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.549+0000 7f3292933800 20 remove_watcher() i=6 2024-09-12T17:45:57.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.550+0000 7f3292933800 20 remove_watcher() i=7 2024-09-12T17:45:57.565 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:45:57.594 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:57.594 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:57.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.631+0000 7f5102136800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.633+0000 7f5102136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.633+0000 7f5102136800 20 realm 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.633+0000 7f5102136800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.633+0000 7f5102136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.633+0000 7f5102136800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.633+0000 7f5102136800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.633+0000 7f5102136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.633+0000 7f5102136800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.634+0000 7f5102136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.634+0000 7f5102136800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.634+0000 7f5102136800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:57.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.634+0000 7f5102136800 20 searching for the correct realm 2024-09-12T17:45:57.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.638+0000 7f50fd6b6640 0 -- 172.21.15.44:0/3039986822 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55758a3455e0 msgr2=0x55758a3479d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:45:57.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.641+0000 7f50fdeb7640 0 -- 172.21.15.44:0/3039986822 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f50f40c6200 msgr2=0x7f50f40719b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:57.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.847+0000 7f5102136800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:57.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.847+0000 7f5102136800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:57.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.847+0000 7f5102136800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:57.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.847+0000 7f5102136800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:57.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.847+0000 7f5102136800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:57.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.847+0000 7f5102136800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:57.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.847+0000 7f5102136800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.847+0000 7f5102136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.847+0000 7f5102136800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.848+0000 7f5102136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:57.850 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.848+0000 7f5102136800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.848+0000 7f5102136800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:57.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.848+0000 7f5102136800 20 zone default found 2024-09-12T17:45:57.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.848+0000 7f5102136800 4 Realm: () 2024-09-12T17:45:57.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.848+0000 7f5102136800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:57.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.848+0000 7f5102136800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:57.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.848+0000 7f5102136800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:57.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.848+0000 7f5102136800 20 zonegroup default 2024-09-12T17:45:57.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.848+0000 7f5102136800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.848+0000 7f5102136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.848+0000 7f5102136800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.849+0000 7f5102136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.849+0000 7f5102136800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.849+0000 7f5102136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:57.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.849+0000 7f5102136800 20 started sync module instance, tier type = 2024-09-12T17:45:57.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.849+0000 7f5102136800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:57.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.858+0000 7f5102136800 20 add_watcher() i=0 2024-09-12T17:45:57.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.858+0000 7f5102136800 20 add_watcher() i=1 2024-09-12T17:45:57.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.858+0000 7f5102136800 20 add_watcher() i=2 2024-09-12T17:45:57.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.858+0000 7f5102136800 20 add_watcher() i=3 2024-09-12T17:45:57.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.858+0000 7f5102136800 20 add_watcher() i=4 2024-09-12T17:45:57.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.858+0000 7f5102136800 20 add_watcher() i=5 2024-09-12T17:45:57.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.858+0000 7f5102136800 20 add_watcher() i=6 2024-09-12T17:45:57.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.859+0000 7f5102136800 20 add_watcher() i=7 2024-09-12T17:45:57.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.859+0000 7f5102136800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:57.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.861+0000 7f4faf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:57.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.862+0000 7f5102136800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:57.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.862+0000 7f5102136800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:57.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.862+0000 7f5102136800 5 note: GC not initialized 2024-09-12T17:45:57.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.862+0000 7f4fae7fc640 20 reqs_thread_entry: start 2024-09-12T17:45:57.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.862+0000 7f5102136800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:57.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.862+0000 7f5102136800 20 Filter name: none 2024-09-12T17:45:57.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.862+0000 7f5102136800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.862+0000 7f4f1ffff640 20 reqs_thread_entry: start 2024-09-12T17:45:57.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.863+0000 7f5102136800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:57.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.863+0000 7f5102136800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.863+0000 7f5102136800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:45:57.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.864+0000 7f5102136800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:57.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.864+0000 7f5102136800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.864+0000 7f5102136800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:45:57.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.864+0000 7f5102136800 20 rados->read ofs=0 len=0 2024-09-12T17:45:57.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.864+0000 7f5102136800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:45:57.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.864+0000 7f5102136800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:57.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.866+0000 7f4faf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:57.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.869+0000 7f5102136800 20 remove_watcher() i=0 2024-09-12T17:45:57.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.869+0000 7f5102136800 2 removed watcher, disabling cache 2024-09-12T17:45:57.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.870+0000 7f5102136800 20 remove_watcher() i=1 2024-09-12T17:45:57.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.871+0000 7f5102136800 20 remove_watcher() i=2 2024-09-12T17:45:57.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.872+0000 7f5102136800 20 remove_watcher() i=3 2024-09-12T17:45:57.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.873+0000 7f5102136800 20 remove_watcher() i=4 2024-09-12T17:45:57.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.874+0000 7f5102136800 20 remove_watcher() i=5 2024-09-12T17:45:57.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.875+0000 7f5102136800 20 remove_watcher() i=6 2024-09-12T17:45:57.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:57.876+0000 7f5102136800 20 remove_watcher() i=7 2024-09-12T17:45:57.889 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:57.889 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:45:57.889 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-logrecord-writes id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:45:57.889 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:57.964 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T17:45:57.965 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:58.168 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:45:58.198 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:58.198 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:58.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.235+0000 7f1bb9b46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.237+0000 7f1bb9b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:58.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.237+0000 7f1bb9b46800 20 realm 2024-09-12T17:45:58.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.237+0000 7f1bb9b46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.237+0000 7f1bb9b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:58.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.237+0000 7f1bb9b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:58.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.237+0000 7f1bb9b46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.237+0000 7f1bb9b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:58.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.237+0000 7f1bb9b46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.238+0000 7f1bb9b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:58.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.238+0000 7f1bb9b46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.239+0000 7f1bb9b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:58.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.239+0000 7f1bb9b46800 20 searching for the correct realm 2024-09-12T17:45:58.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.241+0000 7f1bb7e38640 0 -- 172.21.15.44:0/4203972990 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f1bac069c20 msgr2=0x7f1bac066660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:45:58.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.245+0000 7f1bb7637640 0 -- 172.21.15.44:0/4203972990 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f1bac066bf0 msgr2=0x7f1bac0890b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:58.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.451+0000 7f1bb9b46800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:58.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.451+0000 7f1bb9b46800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:58.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.451+0000 7f1bb9b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:58.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.451+0000 7f1bb9b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:58.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.451+0000 7f1bb9b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:58.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.451+0000 7f1bb9b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:58.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.451+0000 7f1bb9b46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.451+0000 7f1bb9b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:58.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.451+0000 7f1bb9b46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.452+0000 7f1bb9b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:58.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.452+0000 7f1bb9b46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.452+0000 7f1bb9b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:58.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.452+0000 7f1bb9b46800 20 zone default found 2024-09-12T17:45:58.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.452+0000 7f1bb9b46800 4 Realm: () 2024-09-12T17:45:58.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.452+0000 7f1bb9b46800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:58.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.452+0000 7f1bb9b46800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:58.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.452+0000 7f1bb9b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:58.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.452+0000 7f1bb9b46800 20 zonegroup default 2024-09-12T17:45:58.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.452+0000 7f1bb9b46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.452+0000 7f1bb9b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:58.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.452+0000 7f1bb9b46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.453+0000 7f1bb9b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:58.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.453+0000 7f1bb9b46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.453+0000 7f1bb9b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:58.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.453+0000 7f1bb9b46800 20 started sync module instance, tier type = 2024-09-12T17:45:58.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.453+0000 7f1bb9b46800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:58.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.462+0000 7f1bb9b46800 20 add_watcher() i=0 2024-09-12T17:45:58.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.462+0000 7f1bb9b46800 20 add_watcher() i=1 2024-09-12T17:45:58.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.462+0000 7f1bb9b46800 20 add_watcher() i=2 2024-09-12T17:45:58.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.462+0000 7f1bb9b46800 20 add_watcher() i=3 2024-09-12T17:45:58.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.462+0000 7f1bb9b46800 20 add_watcher() i=4 2024-09-12T17:45:58.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.462+0000 7f1bb9b46800 20 add_watcher() i=5 2024-09-12T17:45:58.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.462+0000 7f1bb9b46800 20 add_watcher() i=6 2024-09-12T17:45:58.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.463+0000 7f1bb9b46800 20 add_watcher() i=7 2024-09-12T17:45:58.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.463+0000 7f1bb9b46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:58.466 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.465+0000 7f1a6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:58.467 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.465+0000 7f1bb9b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:58.467 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.465+0000 7f1bb9b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:58.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.465+0000 7f1bb9b46800 5 note: GC not initialized 2024-09-12T17:45:58.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.466+0000 7f1a6cfe1640 20 reqs_thread_entry: start 2024-09-12T17:45:58.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.466+0000 7f1bb9b46800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:58.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.466+0000 7f1bb9b46800 20 Filter name: none 2024-09-12T17:45:58.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.466+0000 7f19e67fc640 20 reqs_thread_entry: start 2024-09-12T17:45:58.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.466+0000 7f1bb9b46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.467+0000 7f1bb9b46800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:45:58.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.467+0000 7f1bb9b46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.467+0000 7f1bb9b46800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:45:58.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.467+0000 7f1bb9b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:58.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.467+0000 7f1bb9b46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.467+0000 7f1bb9b46800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:45:58.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.468+0000 7f1bb9b46800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.468+0000 7f1bb9b46800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:45:58.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.468+0000 7f1bb9b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:58.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.470+0000 7f1a6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:58.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.472+0000 7f1bb9b46800 20 remove_watcher() i=0 2024-09-12T17:45:58.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.472+0000 7f1bb9b46800 2 removed watcher, disabling cache 2024-09-12T17:45:58.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.472+0000 7f1bb9b46800 20 remove_watcher() i=1 2024-09-12T17:45:58.475 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.473+0000 7f1bb9b46800 20 remove_watcher() i=2 2024-09-12T17:45:58.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.474+0000 7f1bb9b46800 20 remove_watcher() i=3 2024-09-12T17:45:58.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.476+0000 7f1bb9b46800 20 remove_watcher() i=4 2024-09-12T17:45:58.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.477+0000 7f1bb9b46800 20 remove_watcher() i=5 2024-09-12T17:45:58.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.478+0000 7f1bb9b46800 20 remove_watcher() i=6 2024-09-12T17:45:58.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.479+0000 7f1bb9b46800 20 remove_watcher() i=7 2024-09-12T17:45:58.492 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:58.492 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:45:58.492 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-change-reshard-state id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:45:58.492 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:58.493 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T17:45:58.528 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:58.528 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:58.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.565+0000 7fd63dd36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.567+0000 7fd63dd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:58.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.567+0000 7fd63dd36800 20 realm 2024-09-12T17:45:58.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.567+0000 7fd63dd36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.567+0000 7fd63dd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:58.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.567+0000 7fd63dd36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:58.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.567+0000 7fd63dd36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.568+0000 7fd63dd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:58.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.568+0000 7fd63dd36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.568+0000 7fd63dd36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:58.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.568+0000 7fd63dd36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.569+0000 7fd63dd36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:58.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.569+0000 7fd63dd36800 20 searching for the correct realm 2024-09-12T17:45:58.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.571+0000 7fd6392b6640 0 -- 172.21.15.44:0/2146785484 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fd62c02b070 msgr2=0x7fd62c073420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:58.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.777+0000 7fd639ab7640 0 -- 172.21.15.44:0/2146785484 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fd630066960 msgr2=0x7fd63006e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:58.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.985+0000 7fd63dd36800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:58.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.985+0000 7fd63dd36800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:58.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.985+0000 7fd63dd36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:58.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.985+0000 7fd63dd36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:58.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.985+0000 7fd63dd36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:58.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.985+0000 7fd63dd36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:58.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.985+0000 7fd63dd36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.985+0000 7fd63dd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:58.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.985+0000 7fd63dd36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.985+0000 7fd63dd36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:58.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.985+0000 7fd63dd36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.986+0000 7fd63dd36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:58.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.986+0000 7fd63dd36800 20 zone default found 2024-09-12T17:45:58.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.986+0000 7fd63dd36800 4 Realm: () 2024-09-12T17:45:58.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.986+0000 7fd63dd36800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:58.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.986+0000 7fd63dd36800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:58.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.986+0000 7fd63dd36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:58.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.986+0000 7fd63dd36800 20 zonegroup default 2024-09-12T17:45:58.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.986+0000 7fd63dd36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.986+0000 7fd63dd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:58.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.986+0000 7fd63dd36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.987+0000 7fd63dd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:58.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.987+0000 7fd63dd36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:58.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.987+0000 7fd63dd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:58.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.987+0000 7fd63dd36800 20 started sync module instance, tier type = 2024-09-12T17:45:58.990 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.987+0000 7fd63dd36800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:58.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.997+0000 7fd63dd36800 20 add_watcher() i=0 2024-09-12T17:45:58.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.997+0000 7fd63dd36800 20 add_watcher() i=1 2024-09-12T17:45:58.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.997+0000 7fd63dd36800 20 add_watcher() i=2 2024-09-12T17:45:58.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.997+0000 7fd63dd36800 20 add_watcher() i=3 2024-09-12T17:45:58.999 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.997+0000 7fd63dd36800 20 add_watcher() i=4 2024-09-12T17:45:59.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.997+0000 7fd63dd36800 20 add_watcher() i=5 2024-09-12T17:45:59.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.997+0000 7fd63dd36800 20 add_watcher() i=6 2024-09-12T17:45:59.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.999+0000 7fd63dd36800 20 add_watcher() i=7 2024-09-12T17:45:59.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:58.999+0000 7fd63dd36800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:59.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.000+0000 7fd4eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:59.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.001+0000 7fd63dd36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:59.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.001+0000 7fd63dd36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:59.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.001+0000 7fd63dd36800 5 note: GC not initialized 2024-09-12T17:45:59.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.001+0000 7fd4ea7fc640 20 reqs_thread_entry: start 2024-09-12T17:45:59.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.001+0000 7fd63dd36800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:59.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.001+0000 7fd63dd36800 20 Filter name: none 2024-09-12T17:45:59.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.001+0000 7fd45ffff640 20 reqs_thread_entry: start 2024-09-12T17:45:59.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.001+0000 7fd63dd36800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:45:59.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.001+0000 7fd63dd36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.002+0000 7fd63dd36800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:45:59.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.002+0000 7fd63dd36800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:45:59.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.002+0000 7fd63dd36800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:45:59.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.002+0000 7fd63dd36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 : miss 2024-09-12T17:45:59.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.002+0000 7fd63dd36800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.003+0000 7fd63dd36800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:45:59.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.003+0000 7fd63dd36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 info.flags=0x17 2024-09-12T17:45:59.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.003+0000 7fd63dd36800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 to cache LRU end 2024-09-12T17:45:59.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.003+0000 7fd63dd36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:59.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.003+0000 7fd63dd36800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:59.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.003+0000 7fd63dd36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 2024-09-12T17:45:59.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.008+0000 7fd63dd36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 info.flags=0x17 2024-09-12T17:45:59.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.008+0000 7fd63dd36800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 to cache LRU end 2024-09-12T17:45:59.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.008+0000 7fd63dd36800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:59.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.008+0000 7fd63dd36800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38, ofs0, ns] 2024-09-12T17:45:59.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.009+0000 7fd51cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562451 cookie 94070932003360 notifier 7944 bl.length()=1015 2024-09-12T17:45:59.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.009+0000 7fd51cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 info.flags=0x17 2024-09-12T17:45:59.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.009+0000 7fd51cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 to cache LRU end 2024-09-12T17:45:59.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.009+0000 7fd51cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:59.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.009+0000 7fd63dd36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): orig_sources= new_sources= 2024-09-12T17:45:59.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.009+0000 7fd63dd36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): potential sources added=[] removed=[] 2024-09-12T17:45:59.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.009+0000 7fd63dd36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): orig_dests= new_dests= 2024-09-12T17:45:59.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.009+0000 7fd63dd36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): potential dests added=[] removed=[] 2024-09-12T17:45:59.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.0 2024-09-12T17:45:59.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.0 2024-09-12T17:45:59.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.1 2024-09-12T17:45:59.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.1 2024-09-12T17:45:59.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.2 2024-09-12T17:45:59.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.2 2024-09-12T17:45:59.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.3 2024-09-12T17:45:59.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.3 2024-09-12T17:45:59.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.4 2024-09-12T17:45:59.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.4 2024-09-12T17:45:59.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.5 2024-09-12T17:45:59.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.5 2024-09-12T17:45:59.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.6 2024-09-12T17:45:59.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.6 2024-09-12T17:45:59.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.7 2024-09-12T17:45:59.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.7 2024-09-12T17:45:59.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.8 2024-09-12T17:45:59.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.8 2024-09-12T17:45:59.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.9 2024-09-12T17:45:59.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.9 2024-09-12T17:45:59.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.10 2024-09-12T17:45:59.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.10 2024-09-12T17:45:59.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.11 2024-09-12T17:45:59.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.11 2024-09-12T17:45:59.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.0 2024-09-12T17:45:59.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.014+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1 2024-09-12T17:45:59.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.015+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.2 2024-09-12T17:45:59.018 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.016+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.3 2024-09-12T17:45:59.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.016+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.4 2024-09-12T17:45:59.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.017+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.5 2024-09-12T17:45:59.019 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.017+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.6 2024-09-12T17:45:59.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.018+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.7 2024-09-12T17:45:59.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.019+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.8 2024-09-12T17:45:59.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.019+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.9 2024-09-12T17:45:59.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.020+0000 7fd63dd36800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.10 2024-09-12T17:45:59.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.023+0000 7fd63dd36800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T17:45:59.025 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.023+0000 7fd63dd36800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T17:45:59.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.033+0000 7fd63dd36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:45:59.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.033+0000 7fd63dd36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 2024-09-12T17:45:59.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.034+0000 7fd63dd36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 info.flags=0x17 2024-09-12T17:45:59.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.034+0000 7fd63dd36800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 to cache LRU end 2024-09-12T17:45:59.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.034+0000 7fd63dd36800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:59.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.034+0000 7fd63dd36800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38, ofs0, ns] 2024-09-12T17:45:59.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.034+0000 7fd51cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562452 cookie 94070932003360 notifier 7944 bl.length()=983 2024-09-12T17:45:59.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.034+0000 7fd51cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 info.flags=0x17 2024-09-12T17:45:59.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.034+0000 7fd51cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 to cache LRU end 2024-09-12T17:45:59.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.034+0000 7fd51cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:59.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.035+0000 7fd63dd36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): orig_sources= new_sources= 2024-09-12T17:45:59.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.035+0000 7fd63dd36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): potential sources added=[] removed=[] 2024-09-12T17:45:59.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.035+0000 7fd63dd36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): orig_dests= new_dests= 2024-09-12T17:45:59.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.035+0000 7fd63dd36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): potential dests added=[] removed=[] 2024-09-12T17:45:59.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.035+0000 7fd63dd36800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T17:45:59.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.037+0000 7fd4eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:59.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.039+0000 7fd63dd36800 20 remove_watcher() i=0 2024-09-12T17:45:59.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.039+0000 7fd63dd36800 2 removed watcher, disabling cache 2024-09-12T17:45:59.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.040+0000 7fd63dd36800 20 remove_watcher() i=1 2024-09-12T17:45:59.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.041+0000 7fd63dd36800 20 remove_watcher() i=2 2024-09-12T17:45:59.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.042+0000 7fd63dd36800 20 remove_watcher() i=3 2024-09-12T17:45:59.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.043+0000 7fd63dd36800 20 remove_watcher() i=4 2024-09-12T17:45:59.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.044+0000 7fd63dd36800 20 remove_watcher() i=5 2024-09-12T17:45:59.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.045+0000 7fd63dd36800 20 remove_watcher() i=6 2024-09-12T17:45:59.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.046+0000 7fd63dd36800 20 remove_watcher() i=7 2024-09-12T17:45:59.062 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:45:59.091 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:59.091 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:59.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.129+0000 7f848372c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.131+0000 7f848372c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.131+0000 7f848372c800 20 realm 2024-09-12T17:45:59.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.131+0000 7f848372c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.131+0000 7f848372c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.131+0000 7f848372c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:59.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.131+0000 7f848372c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.132+0000 7f848372c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.132+0000 7f848372c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.132+0000 7f848372c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:59.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.132+0000 7f848372c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.133+0000 7f848372c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:59.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.133+0000 7f848372c800 20 searching for the correct realm 2024-09-12T17:45:59.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.136+0000 7f8477fff640 0 -- 172.21.15.44:0/317718671 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55da3f206640 msgr2=0x55da3f208a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:59.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.139+0000 7f847f44f640 0 -- 172.21.15.44:0/317718671 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f846808db20 msgr2=0x7f846806f8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:59.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.144+0000 7f848372c800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:59.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.144+0000 7f848372c800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:59.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.144+0000 7f848372c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:59.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.144+0000 7f848372c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:59.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.144+0000 7f848372c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:59.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.144+0000 7f848372c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:59.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.144+0000 7f848372c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.144+0000 7f848372c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.144+0000 7f848372c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.144+0000 7f848372c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:59.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.144+0000 7f848372c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.145+0000 7f848372c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:59.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.145+0000 7f848372c800 20 zone default found 2024-09-12T17:45:59.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.145+0000 7f848372c800 4 Realm: () 2024-09-12T17:45:59.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.145+0000 7f848372c800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:59.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.145+0000 7f848372c800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:59.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.145+0000 7f848372c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:59.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.145+0000 7f848372c800 20 zonegroup default 2024-09-12T17:45:59.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.145+0000 7f848372c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.145+0000 7f848372c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.145+0000 7f848372c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.145+0000 7f848372c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.145+0000 7f848372c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.145+0000 7f848372c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.145+0000 7f848372c800 20 started sync module instance, tier type = 2024-09-12T17:45:59.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.145+0000 7f848372c800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:59.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.154+0000 7f848372c800 20 add_watcher() i=0 2024-09-12T17:45:59.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.154+0000 7f848372c800 20 add_watcher() i=1 2024-09-12T17:45:59.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.154+0000 7f848372c800 20 add_watcher() i=2 2024-09-12T17:45:59.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.154+0000 7f848372c800 20 add_watcher() i=3 2024-09-12T17:45:59.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.154+0000 7f848372c800 20 add_watcher() i=4 2024-09-12T17:45:59.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.154+0000 7f848372c800 20 add_watcher() i=5 2024-09-12T17:45:59.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.154+0000 7f848372c800 20 add_watcher() i=6 2024-09-12T17:45:59.157 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.155+0000 7f848372c800 20 add_watcher() i=7 2024-09-12T17:45:59.157 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.155+0000 7f848372c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:59.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.157+0000 7f8335fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:59.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.157+0000 7f848372c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:59.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.157+0000 7f848372c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:59.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.157+0000 7f848372c800 5 note: GC not initialized 2024-09-12T17:45:59.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.158+0000 7f8334fe1640 20 reqs_thread_entry: start 2024-09-12T17:45:59.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.158+0000 7f848372c800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:59.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.158+0000 7f848372c800 20 Filter name: none 2024-09-12T17:45:59.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.158+0000 7f82ae7fc640 20 reqs_thread_entry: start 2024-09-12T17:45:59.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.158+0000 7f848372c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.158+0000 7f848372c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:45:59.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.158+0000 7f848372c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.159+0000 7f848372c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:45:59.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.159+0000 7f848372c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:59.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.159+0000 7f848372c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.159+0000 7f848372c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:45:59.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.159+0000 7f848372c800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.160+0000 7f848372c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:45:59.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.160+0000 7f848372c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:59.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.161+0000 7f8335fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:59.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.163+0000 7f848372c800 20 remove_watcher() i=0 2024-09-12T17:45:59.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.163+0000 7f848372c800 2 removed watcher, disabling cache 2024-09-12T17:45:59.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.164+0000 7f848372c800 20 remove_watcher() i=1 2024-09-12T17:45:59.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.166+0000 7f848372c800 20 remove_watcher() i=2 2024-09-12T17:45:59.168 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.167+0000 7f848372c800 20 remove_watcher() i=3 2024-09-12T17:45:59.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.168+0000 7f848372c800 20 remove_watcher() i=4 2024-09-12T17:45:59.170 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.169+0000 7f848372c800 20 remove_watcher() i=5 2024-09-12T17:45:59.171 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.170+0000 7f848372c800 20 remove_watcher() i=6 2024-09-12T17:45:59.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.171+0000 7f848372c800 20 remove_watcher() i=7 2024-09-12T17:45:59.183 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:59.183 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:45:59.184 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-change-reshard-state id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:45:59.184 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:59.237 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:45:59.268 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:59.269 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:59.307 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.306+0000 7f5b17142800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.307+0000 7f5b17142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.307+0000 7f5b17142800 20 realm 2024-09-12T17:45:59.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.307+0000 7f5b17142800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.307+0000 7f5b17142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.307+0000 7f5b17142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:59.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.307+0000 7f5b17142800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.307+0000 7f5b17142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.307+0000 7f5b17142800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.308+0000 7f5b17142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:59.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.308+0000 7f5b17142800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.310 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.309+0000 7f5b17142800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:59.311 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.309+0000 7f5b17142800 20 searching for the correct realm 2024-09-12T17:45:59.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.312+0000 7f5b13687640 0 -- 172.21.15.44:0/1242253455 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f5afc066040 msgr2=0x7f5afc06d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:45:59.317 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.316+0000 7f5b12e86640 0 -- 172.21.15.44:0/1242253455 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f5afc09a910 msgr2=0x7f5afc064410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:59.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.523+0000 7f5b17142800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:59.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.523+0000 7f5b17142800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:59.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.523+0000 7f5b17142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:59.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.523+0000 7f5b17142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:59.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.523+0000 7f5b17142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:59.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.523+0000 7f5b17142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:59.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.523+0000 7f5b17142800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.523+0000 7f5b17142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.523+0000 7f5b17142800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.523+0000 7f5b17142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:59.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.524+0000 7f5b17142800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.524+0000 7f5b17142800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:59.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.524+0000 7f5b17142800 20 zone default found 2024-09-12T17:45:59.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.524+0000 7f5b17142800 4 Realm: () 2024-09-12T17:45:59.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.524+0000 7f5b17142800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:59.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.524+0000 7f5b17142800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:59.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.524+0000 7f5b17142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:59.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.524+0000 7f5b17142800 20 zonegroup default 2024-09-12T17:45:59.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.524+0000 7f5b17142800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.524+0000 7f5b17142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.524+0000 7f5b17142800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.524+0000 7f5b17142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.524+0000 7f5b17142800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.525+0000 7f5b17142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.525+0000 7f5b17142800 20 started sync module instance, tier type = 2024-09-12T17:45:59.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.525+0000 7f5b17142800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:59.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.534+0000 7f5b17142800 20 add_watcher() i=0 2024-09-12T17:45:59.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.534+0000 7f5b17142800 20 add_watcher() i=1 2024-09-12T17:45:59.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.534+0000 7f5b17142800 20 add_watcher() i=2 2024-09-12T17:45:59.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.534+0000 7f5b17142800 20 add_watcher() i=3 2024-09-12T17:45:59.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.534+0000 7f5b17142800 20 add_watcher() i=4 2024-09-12T17:45:59.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.534+0000 7f5b17142800 20 add_watcher() i=5 2024-09-12T17:45:59.536 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.534+0000 7f5b17142800 20 add_watcher() i=6 2024-09-12T17:45:59.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.535+0000 7f5b17142800 20 add_watcher() i=7 2024-09-12T17:45:59.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.535+0000 7f5b17142800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:59.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.537+0000 7f59c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:59.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.537+0000 7f5b17142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:59.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.537+0000 7f5b17142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:59.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.537+0000 7f5b17142800 5 note: GC not initialized 2024-09-12T17:45:59.539 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.537+0000 7f5943fff640 20 reqs_thread_entry: start 2024-09-12T17:45:59.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.537+0000 7f5b17142800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:59.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.538+0000 7f5b17142800 20 Filter name: none 2024-09-12T17:45:59.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.538+0000 7f5941ffb640 20 reqs_thread_entry: start 2024-09-12T17:45:59.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.538+0000 7f5b17142800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:45:59.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.538+0000 7f5b17142800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.538+0000 7f5b17142800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:45:59.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.538+0000 7f5b17142800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:45:59.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.538+0000 7f5b17142800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:45:59.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.538+0000 7f5b17142800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 : miss 2024-09-12T17:45:59.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.538+0000 7f5b17142800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.539+0000 7f5b17142800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:45:59.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.539+0000 7f5b17142800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 info.flags=0x17 2024-09-12T17:45:59.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.539+0000 7f5b17142800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 to cache LRU end 2024-09-12T17:45:59.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.539+0000 7f5b17142800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:45:59.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.539+0000 7f5b17142800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:59.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.539+0000 7f5b17142800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 2024-09-12T17:45:59.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.543+0000 7f5b17142800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 info.flags=0x17 2024-09-12T17:45:59.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.543+0000 7f5b17142800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 to cache LRU end 2024-09-12T17:45:59.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.543+0000 7f5b17142800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:59.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.544+0000 7f5b17142800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38, ofs0, ns] 2024-09-12T17:45:59.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.544+0000 7f59f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562453 cookie 93862652396704 notifier 7439 bl.length()=1015 2024-09-12T17:45:59.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.544+0000 7f59f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 info.flags=0x17 2024-09-12T17:45:59.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.544+0000 7f59f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 to cache LRU end 2024-09-12T17:45:59.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.544+0000 7f59f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:59.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.544+0000 7f5b17142800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): orig_sources= new_sources= 2024-09-12T17:45:59.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.544+0000 7f5b17142800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): potential sources added=[] removed=[] 2024-09-12T17:45:59.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.544+0000 7f5b17142800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): orig_dests= new_dests= 2024-09-12T17:45:59.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.544+0000 7f5b17142800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): potential dests added=[] removed=[] 2024-09-12T17:45:59.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.0 2024-09-12T17:45:59.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.0 2024-09-12T17:45:59.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.1 2024-09-12T17:45:59.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.1 2024-09-12T17:45:59.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.2 2024-09-12T17:45:59.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.2 2024-09-12T17:45:59.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.3 2024-09-12T17:45:59.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.3 2024-09-12T17:45:59.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.4 2024-09-12T17:45:59.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.4 2024-09-12T17:45:59.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.5 2024-09-12T17:45:59.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.5 2024-09-12T17:45:59.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.6 2024-09-12T17:45:59.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.6 2024-09-12T17:45:59.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.7 2024-09-12T17:45:59.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.7 2024-09-12T17:45:59.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.8 2024-09-12T17:45:59.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.8 2024-09-12T17:45:59.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.9 2024-09-12T17:45:59.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.9 2024-09-12T17:45:59.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.10 2024-09-12T17:45:59.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.10 2024-09-12T17:45:59.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.11 2024-09-12T17:45:59.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1.11 2024-09-12T17:45:59.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.549+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.0 2024-09-12T17:45:59.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.550+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1 2024-09-12T17:45:59.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.550+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.2 2024-09-12T17:45:59.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.550+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.3 2024-09-12T17:45:59.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.551+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.4 2024-09-12T17:45:59.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.551+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.5 2024-09-12T17:45:59.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.552+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.6 2024-09-12T17:45:59.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.553+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.7 2024-09-12T17:45:59.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.553+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.8 2024-09-12T17:45:59.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.554+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.9 2024-09-12T17:45:59.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.554+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.10 2024-09-12T17:45:59.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.558+0000 7f5b17142800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:45:59.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.558+0000 7f5b17142800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 2024-09-12T17:45:59.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.559+0000 7f5b17142800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 info.flags=0x17 2024-09-12T17:45:59.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.559+0000 7f5b17142800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 to cache LRU end 2024-09-12T17:45:59.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.559+0000 7f5b17142800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:59.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.559+0000 7f5b17142800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38, ofs0, ns] 2024-09-12T17:45:59.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.560+0000 7f59f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562454 cookie 93862652396704 notifier 7439 bl.length()=1015 2024-09-12T17:45:59.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.560+0000 7f59f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 info.flags=0x17 2024-09-12T17:45:59.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.560+0000 7f59f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 to cache LRU end 2024-09-12T17:45:59.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.560+0000 7f59f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:59.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.560+0000 7f5b17142800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): orig_sources= new_sources= 2024-09-12T17:45:59.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.560+0000 7f5b17142800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): potential sources added=[] removed=[] 2024-09-12T17:45:59.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.560+0000 7f5b17142800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): orig_dests= new_dests= 2024-09-12T17:45:59.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.560+0000 7f5b17142800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): potential dests added=[] removed=[] 2024-09-12T17:45:59.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.562+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.0 2024-09-12T17:45:59.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.562+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.1 2024-09-12T17:45:59.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.563+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.2 2024-09-12T17:45:59.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.563+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.3 2024-09-12T17:45:59.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.563+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.4 2024-09-12T17:45:59.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.564+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.5 2024-09-12T17:45:59.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.564+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.6 2024-09-12T17:45:59.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.564+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.7 2024-09-12T17:45:59.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.565+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.8 2024-09-12T17:45:59.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.565+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.9 2024-09-12T17:45:59.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.565+0000 7f5b17142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38.10 2024-09-12T17:45:59.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.566+0000 7f5b17142800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:45:59.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.566+0000 7f5b17142800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 2024-09-12T17:45:59.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.567+0000 7f5b17142800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 info.flags=0x17 2024-09-12T17:45:59.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.567+0000 7f5b17142800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 to cache LRU end 2024-09-12T17:45:59.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.567+0000 7f5b17142800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:59.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.567+0000 7f5b17142800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38, ofs0, ns] 2024-09-12T17:45:59.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.567+0000 7f59f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562455 cookie 93862652396704 notifier 7439 bl.length()=983 2024-09-12T17:45:59.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.567+0000 7f59f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 info.flags=0x17 2024-09-12T17:45:59.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.567+0000 7f59f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 to cache LRU end 2024-09-12T17:45:59.569 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.567+0000 7f59f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:45:59.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.567+0000 7f5b17142800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): orig_sources= new_sources= 2024-09-12T17:45:59.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.567+0000 7f5b17142800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): potential sources added=[] removed=[] 2024-09-12T17:45:59.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.567+0000 7f5b17142800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): orig_dests= new_dests= 2024-09-12T17:45:59.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.567+0000 7f5b17142800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38]): potential dests added=[] removed=[] 2024-09-12T17:45:59.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.569+0000 7f5b17142800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T17:45:59.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.571+0000 7f59c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:59.575 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.573+0000 7f5b17142800 20 remove_watcher() i=0 2024-09-12T17:45:59.575 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.573+0000 7f5b17142800 2 removed watcher, disabling cache 2024-09-12T17:45:59.575 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.574+0000 7f5b17142800 20 remove_watcher() i=1 2024-09-12T17:45:59.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.575+0000 7f5b17142800 20 remove_watcher() i=2 2024-09-12T17:45:59.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.576+0000 7f5b17142800 20 remove_watcher() i=3 2024-09-12T17:45:59.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.577+0000 7f5b17142800 20 remove_watcher() i=4 2024-09-12T17:45:59.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.578+0000 7f5b17142800 20 remove_watcher() i=5 2024-09-12T17:45:59.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.579+0000 7f5b17142800 20 remove_watcher() i=6 2024-09-12T17:45:59.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.580+0000 7f5b17142800 20 remove_watcher() i=7 2024-09-12T17:45:59.594 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:45:59.623 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:59.624 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:59.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.661+0000 7faf12939800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.663+0000 7faf12939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.664 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.663+0000 7faf12939800 20 realm 2024-09-12T17:45:59.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.663+0000 7faf12939800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.663+0000 7faf12939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.663+0000 7faf12939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:59.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.663+0000 7faf12939800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.663+0000 7faf12939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.663+0000 7faf12939800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.664+0000 7faf12939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:59.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.664+0000 7faf12939800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.664+0000 7faf12939800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:59.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.664+0000 7faf12939800 20 searching for the correct realm 2024-09-12T17:45:59.668 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.667+0000 7faf07fff640 0 -- 172.21.15.44:0/3089344210 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7faf0004e150 msgr2=0x7faf0008f090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:59.672 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.670+0000 7faf0e5c7640 0 -- 172.21.15.44:0/3089344210 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7faef80ad970 msgr2=0x7faef80aa3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:59.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.876+0000 7faf12939800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:45:59.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.876+0000 7faf12939800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:45:59.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.876+0000 7faf12939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:59.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.876+0000 7faf12939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:59.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.876+0000 7faf12939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:59.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.876+0000 7faf12939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:59.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.876+0000 7faf12939800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.876+0000 7faf12939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.876+0000 7faf12939800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.877+0000 7faf12939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:59.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.877+0000 7faf12939800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.877+0000 7faf12939800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:59.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.877+0000 7faf12939800 20 zone default found 2024-09-12T17:45:59.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.877+0000 7faf12939800 4 Realm: () 2024-09-12T17:45:59.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.877+0000 7faf12939800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:45:59.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.877+0000 7faf12939800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:45:59.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.877+0000 7faf12939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:59.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.877+0000 7faf12939800 20 zonegroup default 2024-09-12T17:45:59.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.877+0000 7faf12939800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.877+0000 7faf12939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.877+0000 7faf12939800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.878+0000 7faf12939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.878+0000 7faf12939800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.878+0000 7faf12939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:59.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.878+0000 7faf12939800 20 started sync module instance, tier type = 2024-09-12T17:45:59.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.878+0000 7faf12939800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:45:59.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.887+0000 7faf12939800 20 add_watcher() i=0 2024-09-12T17:45:59.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.887+0000 7faf12939800 20 add_watcher() i=1 2024-09-12T17:45:59.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.887+0000 7faf12939800 20 add_watcher() i=2 2024-09-12T17:45:59.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.887+0000 7faf12939800 20 add_watcher() i=3 2024-09-12T17:45:59.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.887+0000 7faf12939800 20 add_watcher() i=4 2024-09-12T17:45:59.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.887+0000 7faf12939800 20 add_watcher() i=5 2024-09-12T17:45:59.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.887+0000 7faf12939800 20 add_watcher() i=6 2024-09-12T17:45:59.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.888+0000 7faf12939800 20 add_watcher() i=7 2024-09-12T17:45:59.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.888+0000 7faf12939800 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:59.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.890+0000 7fadc4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:59.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.890+0000 7faf12939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:59.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.890+0000 7faf12939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:59.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.890+0000 7faf12939800 5 note: GC not initialized 2024-09-12T17:45:59.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.890+0000 7fad3f7fe640 20 reqs_thread_entry: start 2024-09-12T17:45:59.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.890+0000 7faf12939800 20 init_complete bucket index max shards: 11 2024-09-12T17:45:59.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.890+0000 7faf12939800 20 Filter name: none 2024-09-12T17:45:59.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.891+0000 7fad3d7fa640 20 reqs_thread_entry: start 2024-09-12T17:45:59.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.891+0000 7faf12939800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.891+0000 7faf12939800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:45:59.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.891+0000 7faf12939800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.892+0000 7faf12939800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:45:59.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.892+0000 7faf12939800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:59.894 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.892+0000 7faf12939800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.894 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.892+0000 7faf12939800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:45:59.894 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.892+0000 7faf12939800 20 rados->read ofs=0 len=0 2024-09-12T17:45:59.894 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.892+0000 7faf12939800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:45:59.894 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.893+0000 7faf12939800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:45:59.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.894+0000 7fadc4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:59.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.896+0000 7faf12939800 20 remove_watcher() i=0 2024-09-12T17:45:59.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.896+0000 7faf12939800 2 removed watcher, disabling cache 2024-09-12T17:45:59.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.897+0000 7faf12939800 20 remove_watcher() i=1 2024-09-12T17:45:59.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.899+0000 7faf12939800 20 remove_watcher() i=2 2024-09-12T17:45:59.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.900+0000 7faf12939800 20 remove_watcher() i=3 2024-09-12T17:45:59.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.901+0000 7faf12939800 20 remove_watcher() i=4 2024-09-12T17:45:59.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.902+0000 7faf12939800 20 remove_watcher() i=5 2024-09-12T17:45:59.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.903+0000 7faf12939800 20 remove_watcher() i=6 2024-09-12T17:45:59.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:45:59.904+0000 7faf12939800 20 remove_watcher() i=7 2024-09-12T17:45:59.916 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:59.916 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:45:59.916 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-change-reshard-state id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:45:59.916 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:45:59.992 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T17:45:59.992 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:00.187 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:46:00.216 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:00.216 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:00.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.253+0000 7fd5696bb800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.255+0000 7fd5696bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.255+0000 7fd5696bb800 20 realm 2024-09-12T17:46:00.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.255+0000 7fd5696bb800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.255+0000 7fd5696bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.257 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.255+0000 7fd5696bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:00.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.256+0000 7fd5696bb800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.256+0000 7fd5696bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.256+0000 7fd5696bb800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.257+0000 7fd5696bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:00.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.257+0000 7fd5696bb800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.257+0000 7fd5696bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:00.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.257+0000 7fd5696bb800 20 searching for the correct realm 2024-09-12T17:46:00.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.260+0000 7fd5669a4640 0 -- 172.21.15.44:0/3706641824 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55f30de37380 msgr2=0x55f30de39770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:00.265 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.264+0000 7fd5671a5640 0 -- 172.21.15.44:0/3706641824 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fd55c0a70d0 msgr2=0x7fd55c07a1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:00.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.267+0000 7fd5696bb800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:00.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:00.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:00.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:00.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:00.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:00.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:00.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:00.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 20 zone default found 2024-09-12T17:46:00.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 4 Realm: () 2024-09-12T17:46:00.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:00.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:00.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:00.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 20 zonegroup default 2024-09-12T17:46:00.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.268+0000 7fd5696bb800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.269+0000 7fd5696bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.269+0000 7fd5696bb800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.269+0000 7fd5696bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.269+0000 7fd5696bb800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.269+0000 7fd5696bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.269+0000 7fd5696bb800 20 started sync module instance, tier type = 2024-09-12T17:46:00.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.269+0000 7fd5696bb800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:00.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.278+0000 7fd5696bb800 20 add_watcher() i=0 2024-09-12T17:46:00.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.278+0000 7fd5696bb800 20 add_watcher() i=1 2024-09-12T17:46:00.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.278+0000 7fd5696bb800 20 add_watcher() i=2 2024-09-12T17:46:00.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.278+0000 7fd5696bb800 20 add_watcher() i=3 2024-09-12T17:46:00.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.278+0000 7fd5696bb800 20 add_watcher() i=4 2024-09-12T17:46:00.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.278+0000 7fd5696bb800 20 add_watcher() i=5 2024-09-12T17:46:00.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.278+0000 7fd5696bb800 20 add_watcher() i=6 2024-09-12T17:46:00.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.279+0000 7fd5696bb800 20 add_watcher() i=7 2024-09-12T17:46:00.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.279+0000 7fd5696bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:00.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.281+0000 7fd41dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:00.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.281+0000 7fd5696bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:00.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.281+0000 7fd5696bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:00.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.281+0000 7fd5696bb800 5 note: GC not initialized 2024-09-12T17:46:00.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.281+0000 7fd41cfe1640 20 reqs_thread_entry: start 2024-09-12T17:46:00.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.282+0000 7fd5696bb800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:00.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.282+0000 7fd5696bb800 20 Filter name: none 2024-09-12T17:46:00.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.282+0000 7fd3967fc640 20 reqs_thread_entry: start 2024-09-12T17:46:00.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.282+0000 7fd5696bb800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.282+0000 7fd5696bb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:46:00.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.282+0000 7fd5696bb800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.283+0000 7fd5696bb800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:46:00.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.283+0000 7fd5696bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:00.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.283+0000 7fd5696bb800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.283+0000 7fd5696bb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:46:00.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.283+0000 7fd5696bb800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.284+0000 7fd5696bb800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:46:00.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.284+0000 7fd5696bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:00.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.285+0000 7fd41dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:00.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.287+0000 7fd5696bb800 20 remove_watcher() i=0 2024-09-12T17:46:00.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.287+0000 7fd5696bb800 2 removed watcher, disabling cache 2024-09-12T17:46:00.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.288+0000 7fd5696bb800 20 remove_watcher() i=1 2024-09-12T17:46:00.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.289+0000 7fd5696bb800 20 remove_watcher() i=2 2024-09-12T17:46:00.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.290+0000 7fd5696bb800 20 remove_watcher() i=3 2024-09-12T17:46:00.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.291+0000 7fd5696bb800 20 remove_watcher() i=4 2024-09-12T17:46:00.293 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.292+0000 7fd5696bb800 20 remove_watcher() i=5 2024-09-12T17:46:00.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.293+0000 7fd5696bb800 20 remove_watcher() i=6 2024-09-12T17:46:00.295 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.294+0000 7fd5696bb800 20 remove_watcher() i=7 2024-09-12T17:46:00.306 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:00.306 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:46:00.306 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-change-reshard-state id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:46:00.306 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:00.308 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T17:46:00.345 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:00.345 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:00.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.382+0000 7f34a500e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.384+0000 7f34a500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.384+0000 7f34a500e800 20 realm 2024-09-12T17:46:00.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.384+0000 7f34a500e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.384+0000 7f34a500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.384+0000 7f34a500e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:00.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.384+0000 7f34a500e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.385+0000 7f34a500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.385+0000 7f34a500e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.385+0000 7f34a500e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:00.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.385+0000 7f34a500e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.386+0000 7f34a500e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:00.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.386+0000 7f34a500e800 20 searching for the correct realm 2024-09-12T17:46:00.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.387+0000 7f34a0f7b640 0 -- 172.21.15.44:0/3206105657 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f34940a4040 msgr2=0x7f349408c440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:00.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.391+0000 7f34a0f7b640 0 -- 172.21.15.44:0/3206105657 >> [v2:172.21.15.181:6810/2228110208,v1:172.21.15.181:6811/2228110208] conn(0x7f349408c060 msgr2=0x7f34940a4420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:00.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.600+0000 7f34a500e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:00.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.600+0000 7f34a500e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:00.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.600+0000 7f34a500e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:00.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.600+0000 7f34a500e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:00.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.600+0000 7f34a500e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:00.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.600+0000 7f34a500e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:00.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.600+0000 7f34a500e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.600+0000 7f34a500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.600+0000 7f34a500e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.601+0000 7f34a500e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:00.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.601+0000 7f34a500e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.601+0000 7f34a500e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:00.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.601+0000 7f34a500e800 20 zone default found 2024-09-12T17:46:00.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.601+0000 7f34a500e800 4 Realm: () 2024-09-12T17:46:00.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.601+0000 7f34a500e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:00.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.601+0000 7f34a500e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:00.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.601+0000 7f34a500e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:00.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.601+0000 7f34a500e800 20 zonegroup default 2024-09-12T17:46:00.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.601+0000 7f34a500e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.601+0000 7f34a500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.601+0000 7f34a500e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.602+0000 7f34a500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.602+0000 7f34a500e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.602+0000 7f34a500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.602+0000 7f34a500e800 20 started sync module instance, tier type = 2024-09-12T17:46:00.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.602+0000 7f34a500e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:00.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.611+0000 7f34a500e800 20 add_watcher() i=0 2024-09-12T17:46:00.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.611+0000 7f34a500e800 20 add_watcher() i=1 2024-09-12T17:46:00.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.611+0000 7f34a500e800 20 add_watcher() i=2 2024-09-12T17:46:00.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.611+0000 7f34a500e800 20 add_watcher() i=3 2024-09-12T17:46:00.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.611+0000 7f34a500e800 20 add_watcher() i=4 2024-09-12T17:46:00.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.611+0000 7f34a500e800 20 add_watcher() i=5 2024-09-12T17:46:00.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.611+0000 7f34a500e800 20 add_watcher() i=6 2024-09-12T17:46:00.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.612+0000 7f34a500e800 20 add_watcher() i=7 2024-09-12T17:46:00.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.612+0000 7f34a500e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:00.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.614+0000 7f33527f4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:00.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.614+0000 7f34a500e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:00.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.614+0000 7f34a500e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:00.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.614+0000 7f34a500e800 5 note: GC not initialized 2024-09-12T17:46:00.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.614+0000 7f33517f2640 20 reqs_thread_entry: start 2024-09-12T17:46:00.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.614+0000 7f34a500e800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:00.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.614+0000 7f34a500e800 20 Filter name: none 2024-09-12T17:46:00.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.615+0000 7f32caffd640 20 reqs_thread_entry: start 2024-09-12T17:46:00.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.615+0000 7f34a500e800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:46:00.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.615+0000 7f34a500e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.615+0000 7f34a500e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:46:00.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.615+0000 7f34a500e800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:46:00.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.615+0000 7f34a500e800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:46:00.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.615+0000 7f34a500e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 : miss 2024-09-12T17:46:00.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.615+0000 7f34a500e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.616+0000 7f34a500e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:46:00.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.616+0000 7f34a500e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 info.flags=0x17 2024-09-12T17:46:00.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.616+0000 7f34a500e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 to cache LRU end 2024-09-12T17:46:00.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.616+0000 7f34a500e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:00.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.616+0000 7f34a500e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:00.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.616+0000 7f34a500e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 2024-09-12T17:46:00.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.620+0000 7f34a500e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 info.flags=0x17 2024-09-12T17:46:00.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.620+0000 7f34a500e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 to cache LRU end 2024-09-12T17:46:00.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.620+0000 7f34a500e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:00.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.620+0000 7f34a500e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39, ofs0, ns] 2024-09-12T17:46:00.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.621+0000 7f33777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562458 cookie 94198160098624 notifier 7493 bl.length()=1015 2024-09-12T17:46:00.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.621+0000 7f33777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 info.flags=0x17 2024-09-12T17:46:00.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.621+0000 7f33777fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 to cache LRU end 2024-09-12T17:46:00.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.621+0000 7f33777fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:00.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.621+0000 7f34a500e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39]): orig_sources= new_sources= 2024-09-12T17:46:00.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.621+0000 7f34a500e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39]): potential sources added=[] removed=[] 2024-09-12T17:46:00.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.621+0000 7f34a500e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39]): orig_dests= new_dests= 2024-09-12T17:46:00.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.621+0000 7f34a500e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39]): potential dests added=[] removed=[] 2024-09-12T17:46:00.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.0 2024-09-12T17:46:00.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.0 2024-09-12T17:46:00.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.1 2024-09-12T17:46:00.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.1 2024-09-12T17:46:00.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.2 2024-09-12T17:46:00.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.2 2024-09-12T17:46:00.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.3 2024-09-12T17:46:00.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.3 2024-09-12T17:46:00.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.4 2024-09-12T17:46:00.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.4 2024-09-12T17:46:00.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.5 2024-09-12T17:46:00.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.5 2024-09-12T17:46:00.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.6 2024-09-12T17:46:00.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.6 2024-09-12T17:46:00.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.7 2024-09-12T17:46:00.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.7 2024-09-12T17:46:00.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.8 2024-09-12T17:46:00.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.8 2024-09-12T17:46:00.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.9 2024-09-12T17:46:00.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.9 2024-09-12T17:46:00.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.10 2024-09-12T17:46:00.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.10 2024-09-12T17:46:00.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.11 2024-09-12T17:46:00.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1.11 2024-09-12T17:46:00.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.625+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.0 2024-09-12T17:46:00.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.626+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1 2024-09-12T17:46:00.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.626+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.2 2024-09-12T17:46:00.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.627+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.3 2024-09-12T17:46:00.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.627+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.4 2024-09-12T17:46:00.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.627+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.5 2024-09-12T17:46:00.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.628+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.6 2024-09-12T17:46:00.631 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.629+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.7 2024-09-12T17:46:00.631 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.629+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.8 2024-09-12T17:46:00.631 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.630+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.9 2024-09-12T17:46:00.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.631+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.10 2024-09-12T17:46:00.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.634+0000 7f34a500e800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T17:46:00.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.634+0000 7f34a500e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 : hit (requested=0x17, cached=0x17) 2024-09-12T17:46:00.637 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.634+0000 7f34a500e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 2024-09-12T17:46:00.637 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.636+0000 7f34a500e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 info.flags=0x17 2024-09-12T17:46:00.637 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.636+0000 7f34a500e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 to cache LRU end 2024-09-12T17:46:00.637 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.636+0000 7f34a500e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:00.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.636+0000 7f34a500e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39, ofs0, ns] 2024-09-12T17:46:00.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.636+0000 7f3376ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562459 cookie 94198160098624 notifier 7493 bl.length()=1015 2024-09-12T17:46:00.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.636+0000 7f3376ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 info.flags=0x17 2024-09-12T17:46:00.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.636+0000 7f3376ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 to cache LRU end 2024-09-12T17:46:00.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.636+0000 7f3376ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:00.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.636+0000 7f34a500e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39]): orig_sources= new_sources= 2024-09-12T17:46:00.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.636+0000 7f34a500e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39]): potential sources added=[] removed=[] 2024-09-12T17:46:00.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.636+0000 7f34a500e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39]): orig_dests= new_dests= 2024-09-12T17:46:00.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.636+0000 7f34a500e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39]): potential dests added=[] removed=[] 2024-09-12T17:46:00.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.638+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.0 2024-09-12T17:46:00.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.639+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.1 2024-09-12T17:46:00.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.639+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.2 2024-09-12T17:46:00.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.639+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.3 2024-09-12T17:46:00.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.639+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.4 2024-09-12T17:46:00.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.640+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.5 2024-09-12T17:46:00.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.640+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.6 2024-09-12T17:46:00.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.640+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.7 2024-09-12T17:46:00.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.641+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.8 2024-09-12T17:46:00.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.641+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.9 2024-09-12T17:46:00.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.641+0000 7f34a500e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39.10 2024-09-12T17:46:00.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.642+0000 7f34a500e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 : hit (requested=0x17, cached=0x17) 2024-09-12T17:46:00.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.642+0000 7f34a500e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 2024-09-12T17:46:00.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.643+0000 7f34a500e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 info.flags=0x17 2024-09-12T17:46:00.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.643+0000 7f34a500e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 to cache LRU end 2024-09-12T17:46:00.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.643+0000 7f34a500e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:00.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.643+0000 7f34a500e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39, ofs0, ns] 2024-09-12T17:46:00.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.643+0000 7f33777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562460 cookie 94198160098624 notifier 7493 bl.length()=983 2024-09-12T17:46:00.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.643+0000 7f33777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 info.flags=0x17 2024-09-12T17:46:00.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.643+0000 7f33777fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 to cache LRU end 2024-09-12T17:46:00.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.643+0000 7f33777fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:00.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.644+0000 7f34a500e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39]): orig_sources= new_sources= 2024-09-12T17:46:00.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.644+0000 7f34a500e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39]): potential sources added=[] removed=[] 2024-09-12T17:46:00.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.644+0000 7f34a500e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39]): orig_dests= new_dests= 2024-09-12T17:46:00.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.644+0000 7f34a500e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39]): potential dests added=[] removed=[] 2024-09-12T17:46:00.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.646+0000 7f34a500e800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T17:46:00.650 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.648+0000 7f33527f4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:00.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.651+0000 7f34a500e800 20 remove_watcher() i=0 2024-09-12T17:46:00.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.651+0000 7f34a500e800 2 removed watcher, disabling cache 2024-09-12T17:46:00.653 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.652+0000 7f34a500e800 20 remove_watcher() i=1 2024-09-12T17:46:00.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.653+0000 7f34a500e800 20 remove_watcher() i=2 2024-09-12T17:46:00.655 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.654+0000 7f34a500e800 20 remove_watcher() i=3 2024-09-12T17:46:00.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.655+0000 7f34a500e800 20 remove_watcher() i=4 2024-09-12T17:46:00.657 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.656+0000 7f34a500e800 20 remove_watcher() i=5 2024-09-12T17:46:00.658 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.657+0000 7f34a500e800 20 remove_watcher() i=6 2024-09-12T17:46:00.659 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.658+0000 7f34a500e800 20 remove_watcher() i=7 2024-09-12T17:46:00.672 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:46:00.702 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:00.702 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:00.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.739+0000 7faf52411800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.741+0000 7faf52411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.741+0000 7faf52411800 20 realm 2024-09-12T17:46:00.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.741+0000 7faf52411800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.741+0000 7faf52411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.741+0000 7faf52411800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:00.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.741+0000 7faf52411800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.742+0000 7faf52411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.742+0000 7faf52411800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.742+0000 7faf52411800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:00.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.742+0000 7faf52411800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.743+0000 7faf52411800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:00.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.743+0000 7faf52411800 20 searching for the correct realm 2024-09-12T17:46:00.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.746+0000 7faf4e323640 0 -- 172.21.15.44:0/277320468 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x55cb1b669500 msgr2=0x55cb1b66b9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:00.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.750+0000 7faf4db22640 0 -- 172.21.15.44:0/277320468 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7faf44082ba0 msgr2=0x7faf44067400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:00.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.753+0000 7faf52411800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:00.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.753+0000 7faf52411800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:00.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.753+0000 7faf52411800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:00.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.753+0000 7faf52411800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:00.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.753+0000 7faf52411800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:00.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.753+0000 7faf52411800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:00.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.753+0000 7faf52411800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.754+0000 7faf52411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.754+0000 7faf52411800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.754+0000 7faf52411800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:00.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.754+0000 7faf52411800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.754+0000 7faf52411800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:00.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.754+0000 7faf52411800 20 zone default found 2024-09-12T17:46:00.757 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.754+0000 7faf52411800 4 Realm: () 2024-09-12T17:46:00.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.754+0000 7faf52411800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:00.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.754+0000 7faf52411800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:00.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.754+0000 7faf52411800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:00.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.754+0000 7faf52411800 20 zonegroup default 2024-09-12T17:46:00.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.754+0000 7faf52411800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.754+0000 7faf52411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.755+0000 7faf52411800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.755+0000 7faf52411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.755+0000 7faf52411800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.755+0000 7faf52411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:00.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.755+0000 7faf52411800 20 started sync module instance, tier type = 2024-09-12T17:46:00.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.755+0000 7faf52411800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:00.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.764+0000 7faf52411800 20 add_watcher() i=0 2024-09-12T17:46:00.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.764+0000 7faf52411800 20 add_watcher() i=1 2024-09-12T17:46:00.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.764+0000 7faf52411800 20 add_watcher() i=2 2024-09-12T17:46:00.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.764+0000 7faf52411800 20 add_watcher() i=3 2024-09-12T17:46:00.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.764+0000 7faf52411800 20 add_watcher() i=4 2024-09-12T17:46:00.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.764+0000 7faf52411800 20 add_watcher() i=5 2024-09-12T17:46:00.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.764+0000 7faf52411800 20 add_watcher() i=6 2024-09-12T17:46:00.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.765+0000 7faf52411800 20 add_watcher() i=7 2024-09-12T17:46:00.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.765+0000 7faf52411800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:00.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.767+0000 7fadff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:00.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.767+0000 7faf52411800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:00.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.767+0000 7faf52411800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:00.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.767+0000 7faf52411800 5 note: GC not initialized 2024-09-12T17:46:00.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.767+0000 7fadfe7fc640 20 reqs_thread_entry: start 2024-09-12T17:46:00.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.767+0000 7faf52411800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:00.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.768+0000 7faf52411800 20 Filter name: none 2024-09-12T17:46:00.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.768+0000 7fad6ffff640 20 reqs_thread_entry: start 2024-09-12T17:46:00.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.768+0000 7faf52411800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.768+0000 7faf52411800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:46:00.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.768+0000 7faf52411800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.769+0000 7faf52411800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:46:00.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.769+0000 7faf52411800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:00.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.769+0000 7faf52411800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.770+0000 7faf52411800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:46:00.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.770+0000 7faf52411800 20 rados->read ofs=0 len=0 2024-09-12T17:46:00.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.770+0000 7faf52411800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:46:00.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.770+0000 7faf52411800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:00.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.772+0000 7fadff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:00.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.774+0000 7faf52411800 20 remove_watcher() i=0 2024-09-12T17:46:00.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.774+0000 7faf52411800 2 removed watcher, disabling cache 2024-09-12T17:46:00.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.775+0000 7faf52411800 20 remove_watcher() i=1 2024-09-12T17:46:00.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.776+0000 7faf52411800 20 remove_watcher() i=2 2024-09-12T17:46:00.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.777+0000 7faf52411800 20 remove_watcher() i=3 2024-09-12T17:46:00.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.778+0000 7faf52411800 20 remove_watcher() i=4 2024-09-12T17:46:00.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.779+0000 7faf52411800 20 remove_watcher() i=5 2024-09-12T17:46:00.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.780+0000 7faf52411800 20 remove_watcher() i=6 2024-09-12T17:46:00.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:00.781+0000 7faf52411800 20 remove_watcher() i=7 2024-09-12T17:46:00.793 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:00.794 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:46:00.794 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: error-at-change-reshard-state id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:46:00.794 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:00.870 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T17:46:00.870 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.073 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:46:01.102 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:01.102 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:01.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.140+0000 7f4edfd26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.142+0000 7f4edfd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.142+0000 7f4edfd26800 20 realm 2024-09-12T17:46:01.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.142+0000 7f4edfd26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.142+0000 7f4edfd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.142+0000 7f4edfd26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:01.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.142+0000 7f4edfd26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.142+0000 7f4edfd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.142+0000 7f4edfd26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.143+0000 7f4edfd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:01.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.143+0000 7f4edfd26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.143+0000 7f4edfd26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:01.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.143+0000 7f4edfd26800 20 searching for the correct realm 2024-09-12T17:46:01.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.145+0000 7f4edb909640 0 -- 172.21.15.44:0/2196558817 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7f4ed4014900 msgr2=0x7f4ed4008420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:01.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.351+0000 7f4edc10a640 0 -- 172.21.15.44:0/2196558817 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f4ec4043060 msgr2=0x7f4ec4077400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:01.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.357+0000 7f4edfd26800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:01.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.357+0000 7f4edfd26800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:01.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.357+0000 7f4edfd26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:01.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.357+0000 7f4edfd26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:01.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.357+0000 7f4edfd26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:01.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.357+0000 7f4edfd26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:01.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.357+0000 7f4edfd26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.357+0000 7f4edfd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.357+0000 7f4edfd26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.358+0000 7f4edfd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:01.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.358+0000 7f4edfd26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.358+0000 7f4edfd26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:01.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.358+0000 7f4edfd26800 20 zone default found 2024-09-12T17:46:01.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.358+0000 7f4edfd26800 4 Realm: () 2024-09-12T17:46:01.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.358+0000 7f4edfd26800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:01.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.358+0000 7f4edfd26800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:01.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.358+0000 7f4edfd26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:01.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.358+0000 7f4edfd26800 20 zonegroup default 2024-09-12T17:46:01.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.358+0000 7f4edfd26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.358+0000 7f4edfd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.358+0000 7f4edfd26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.359+0000 7f4edfd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.359+0000 7f4edfd26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.359+0000 7f4edfd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.359+0000 7f4edfd26800 20 started sync module instance, tier type = 2024-09-12T17:46:01.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.359+0000 7f4edfd26800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:01.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.369+0000 7f4edfd26800 20 add_watcher() i=0 2024-09-12T17:46:01.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.369+0000 7f4edfd26800 20 add_watcher() i=1 2024-09-12T17:46:01.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.369+0000 7f4edfd26800 20 add_watcher() i=2 2024-09-12T17:46:01.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.369+0000 7f4edfd26800 20 add_watcher() i=3 2024-09-12T17:46:01.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.369+0000 7f4edfd26800 20 add_watcher() i=4 2024-09-12T17:46:01.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.369+0000 7f4edfd26800 20 add_watcher() i=5 2024-09-12T17:46:01.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.369+0000 7f4edfd26800 20 add_watcher() i=6 2024-09-12T17:46:01.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.369+0000 7f4edfd26800 20 add_watcher() i=7 2024-09-12T17:46:01.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.369+0000 7f4edfd26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:01.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.371+0000 7f4d927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:01.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.372+0000 7f4edfd26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:01.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.372+0000 7f4edfd26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:01.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.372+0000 7f4edfd26800 5 note: GC not initialized 2024-09-12T17:46:01.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.372+0000 7f4d917e2640 20 reqs_thread_entry: start 2024-09-12T17:46:01.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.372+0000 7f4edfd26800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:01.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.372+0000 7f4edfd26800 20 Filter name: none 2024-09-12T17:46:01.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.372+0000 7f4d8a7fc640 20 reqs_thread_entry: start 2024-09-12T17:46:01.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.372+0000 7f4edfd26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.373+0000 7f4edfd26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:46:01.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.373+0000 7f4edfd26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.374+0000 7f4edfd26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:46:01.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.374+0000 7f4edfd26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:01.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.374+0000 7f4edfd26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.374+0000 7f4edfd26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:46:01.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.374+0000 7f4edfd26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.374+0000 7f4edfd26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:46:01.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.374+0000 7f4edfd26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:01.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.376+0000 7f4d927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:01.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.378+0000 7f4edfd26800 20 remove_watcher() i=0 2024-09-12T17:46:01.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.378+0000 7f4edfd26800 2 removed watcher, disabling cache 2024-09-12T17:46:01.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.380+0000 7f4edfd26800 20 remove_watcher() i=1 2024-09-12T17:46:01.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.381+0000 7f4edfd26800 20 remove_watcher() i=2 2024-09-12T17:46:01.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.382+0000 7f4edfd26800 20 remove_watcher() i=3 2024-09-12T17:46:01.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.383+0000 7f4edfd26800 20 remove_watcher() i=4 2024-09-12T17:46:01.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.384+0000 7f4edfd26800 20 remove_watcher() i=5 2024-09-12T17:46:01.386 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.385+0000 7f4edfd26800 20 remove_watcher() i=6 2024-09-12T17:46:01.387 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.386+0000 7f4edfd26800 20 remove_watcher() i=7 2024-09-12T17:46:01.398 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.398 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:46:01.398 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-change-reshard-state id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:46:01.398 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.400 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T17:46:01.435 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:01.435 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:01.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.472+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.474+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.474+0000 7ff5ecd2b800 20 realm 2024-09-12T17:46:01.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.474+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.474+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.474+0000 7ff5ecd2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:01.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.474+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.475+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.475+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.475+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:01.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.475+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.476+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:01.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.476+0000 7ff5ecd2b800 20 searching for the correct realm 2024-09-12T17:46:01.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.479+0000 7ff5e8272640 0 -- 172.21.15.44:0/3141852951 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7ff5d8028040 msgr2=0x7ff5d805c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:01.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.482+0000 7ff5e8a73640 0 -- 172.21.15.44:0/3141852951 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7ff5dc0b3ab0 msgr2=0x7ff5dc0b2810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:01.690 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:01.690 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:01.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:01.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:01.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:01.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:01.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:01.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:01.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 zone default found 2024-09-12T17:46:01.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.689+0000 7ff5ecd2b800 4 Realm: () 2024-09-12T17:46:01.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.689+0000 7ff5ecd2b800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:01.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.689+0000 7ff5ecd2b800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:01.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.689+0000 7ff5ecd2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:01.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 zonegroup default 2024-09-12T17:46:01.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.690+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.690+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.690+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.690+0000 7ff5ecd2b800 20 started sync module instance, tier type = 2024-09-12T17:46:01.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.690+0000 7ff5ecd2b800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:01.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=0 2024-09-12T17:46:01.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=1 2024-09-12T17:46:01.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=2 2024-09-12T17:46:01.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=3 2024-09-12T17:46:01.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=4 2024-09-12T17:46:01.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=5 2024-09-12T17:46:01.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=6 2024-09-12T17:46:01.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.700+0000 7ff5ecd2b800 20 add_watcher() i=7 2024-09-12T17:46:01.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.701+0000 7ff5ecd2b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:01.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.702+0000 7ff49efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:01.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.702+0000 7ff5ecd2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:01.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.702+0000 7ff5ecd2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:01.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 note: GC not initialized 2024-09-12T17:46:01.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.703+0000 7ff49dfe3640 20 reqs_thread_entry: start 2024-09-12T17:46:01.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.703+0000 7ff5ecd2b800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:01.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.703+0000 7ff5ecd2b800 20 Filter name: none 2024-09-12T17:46:01.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.703+0000 7ff40f7fe640 20 reqs_thread_entry: start 2024-09-12T17:46:01.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.703+0000 7ff5ecd2b800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:46:01.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.703+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.703+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:46:01.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.703+0000 7ff5ecd2b800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:46:01.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.703+0000 7ff5ecd2b800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:46:01.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.703+0000 7ff5ecd2b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 : miss 2024-09-12T17:46:01.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.703+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.704+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:46:01.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.704+0000 7ff5ecd2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:01.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.704+0000 7ff5ecd2b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:01.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.704+0000 7ff5ecd2b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:01.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.704+0000 7ff5ecd2b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:01.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.704+0000 7ff5ecd2b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 2024-09-12T17:46:01.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.709+0000 7ff5ecd2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:01.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.709+0000 7ff5ecd2b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:01.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.709+0000 7ff5ecd2b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:01.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.709+0000 7ff5ecd2b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40, ofs0, ns] 2024-09-12T17:46:01.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.709+0000 7ff4bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562386 cookie 94550095271088 notifier 7547 bl.length()=1015 2024-09-12T17:46:01.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.709+0000 7ff4bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:01.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.709+0000 7ff4bf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:01.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.709+0000 7ff4bf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:01.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.710+0000 7ff5ecd2b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): orig_sources= new_sources= 2024-09-12T17:46:01.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.710+0000 7ff5ecd2b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): potential sources added=[] removed=[] 2024-09-12T17:46:01.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.710+0000 7ff5ecd2b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): orig_dests= new_dests= 2024-09-12T17:46:01.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.710+0000 7ff5ecd2b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): potential dests added=[] removed=[] 2024-09-12T17:46:01.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.0 2024-09-12T17:46:01.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.0 2024-09-12T17:46:01.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.1 2024-09-12T17:46:01.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.1 2024-09-12T17:46:01.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.2 2024-09-12T17:46:01.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.2 2024-09-12T17:46:01.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.3 2024-09-12T17:46:01.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.3 2024-09-12T17:46:01.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.4 2024-09-12T17:46:01.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.4 2024-09-12T17:46:01.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.5 2024-09-12T17:46:01.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.5 2024-09-12T17:46:01.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.6 2024-09-12T17:46:01.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.6 2024-09-12T17:46:01.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.7 2024-09-12T17:46:01.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.7 2024-09-12T17:46:01.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.8 2024-09-12T17:46:01.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.8 2024-09-12T17:46:01.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.9 2024-09-12T17:46:01.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.9 2024-09-12T17:46:01.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.10 2024-09-12T17:46:01.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.10 2024-09-12T17:46:01.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.11 2024-09-12T17:46:01.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.11 2024-09-12T17:46:01.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.0 2024-09-12T17:46:01.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.715+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1 2024-09-12T17:46:01.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.715+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2 2024-09-12T17:46:01.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.716+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.3 2024-09-12T17:46:01.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.716+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.4 2024-09-12T17:46:01.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.716+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.5 2024-09-12T17:46:01.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.717+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.6 2024-09-12T17:46:01.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.717+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.7 2024-09-12T17:46:01.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.718+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.8 2024-09-12T17:46:01.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.718+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.9 2024-09-12T17:46:01.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.719+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.10 2024-09-12T17:46:01.723 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff5ecd2b800 time 2024-09-12T17:46:01.723549+0000 2024-09-12T17:46:01.723 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:46:01.724 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:01.724 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff5ee58c71a] 2024-09-12T17:46:01.724 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff5ee58c8d8] 2024-09-12T17:46:01.724 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fe27b6e841] 2024-09-12T17:46:01.724 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55fe27b7d734] 2024-09-12T17:46:01.725 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55fe27b7e5d4] 2024-09-12T17:46:01.725 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:46:01.725 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff5ed229590] 2024-09-12T17:46:01.725 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:46:01.725 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:46:01.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.722+0000 7ff5ecd2b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff5ecd2b800 time 2024-09-12T17:46:01.723549+0000 2024-09-12T17:46:01.725 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:46:01.725 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.725 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:01.725 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff5ee58c71a] 2024-09-12T17:46:01.725 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff5ee58c8d8] 2024-09-12T17:46:01.725 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fe27b6e841] 2024-09-12T17:46:01.726 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55fe27b7d734] 2024-09-12T17:46:01.726 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55fe27b7e5d4] 2024-09-12T17:46:01.726 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:46:01.726 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff5ed229590] 2024-09-12T17:46:01.726 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:46:01.726 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:46:01.726 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.726 INFO:tasks.workunit.client.0.smithi044.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:46:01.726 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7ff5ecd2b800 thread_name:radosgw-admin 2024-09-12T17:46:01.743 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:01.743 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff5ed23e6f0] 2024-09-12T17:46:01.744 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff5ed28b99c] 2024-09-12T17:46:01.744 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:46:01.744 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:46:01.744 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff5ee58c774] 2024-09-12T17:46:01.744 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff5ee58c8d8] 2024-09-12T17:46:01.744 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fe27b6e841] 2024-09-12T17:46:01.744 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55fe27b7d734] 2024-09-12T17:46:01.744 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55fe27b7e5d4] 2024-09-12T17:46:01.744 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:46:01.744 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff5ed229590] 2024-09-12T17:46:01.744 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:46:01.744 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:46:01.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.723+0000 7ff5ecd2b800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:46:01.745 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7ff5ecd2b800 thread_name:radosgw-admin 2024-09-12T17:46:01.745 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.745 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:01.745 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff5ed23e6f0] 2024-09-12T17:46:01.745 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff5ed28b99c] 2024-09-12T17:46:01.745 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:46:01.745 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:46:01.745 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff5ee58c774] 2024-09-12T17:46:01.745 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff5ee58c8d8] 2024-09-12T17:46:01.745 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fe27b6e841] 2024-09-12T17:46:01.745 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55fe27b7d734] 2024-09-12T17:46:01.745 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55fe27b7e5d4] 2024-09-12T17:46:01.746 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:46:01.746 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff5ed229590] 2024-09-12T17:46:01.746 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:46:01.746 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:46:01.746 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:46:01.746 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.746 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:46:01.746 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28c7abe0) adding con mode: secure 2024-09-12T17:46:01.746 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28c7abe0) adding con mode: crc 2024-09-12T17:46:01.746 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28c7abe0) adding con mode: secure 2024-09-12T17:46:01.746 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.746 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.746 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command rotate-key hook 0x55fe28c7ad28 2024-09-12T17:46:01.746 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:01.747 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:46:01.747 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-a con 0x55fe28b268e0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:01.747 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-b con 0x55fe28b28780 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:46:01.747 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-c con 0x55fe28bbd970 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:46:01.747 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.747 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.747 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.747 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:01.747 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient(hunting): authenticate will time out at 2134.093911s 2024-09-12T17:46:01.747 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient(hunting): get_auth_request con 0x55fe28bbd970 auth_method 0 2024-09-12T17:46:01.747 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.747 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.747 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.748 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:46:01.457+0000 7ff5e8a73640 10 monclient(hunting): get_auth_request con 0x55fe28b268e0 auth_method 0 2024-09-12T17:46:01.748 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:46:01.457+0000 7ff5e8a73640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.748 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:46:01.457+0000 7ff5e8a73640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.748 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:46:01.457+0000 7ff5e8a73640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.748 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:46:01.457+0000 7ff5e8272640 10 monclient(hunting): get_auth_request con 0x55fe28b28780 auth_method 0 2024-09-12T17:46:01.748 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:46:01.457+0000 7ff5e8272640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.748 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:46:01.457+0000 7ff5e8272640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.748 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:46:01.457+0000 7ff5e8272640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.748 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.748 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.748 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.748 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:46:01.457+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.749 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:46:01.457+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.749 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:46:01.457+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.749 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:46:01.457+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.749 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:46:01.457+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.749 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:46:01.457+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.749 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient(hunting): handle_auth_done global_id 7538 payload 824 2024-09-12T17:46:01.749 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient: _finish_hunting 0 2024-09-12T17:46:01.749 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:46:01.457+0000 7ff5e9274640 1 monclient: found mon.noname-c 2024-09-12T17:46:01.749 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.749 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:01.750 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:46:01.750 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: dump: 2024-09-12T17:46:01.750 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:01.750 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:01.750 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.750 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.750 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:01.750 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.750 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:01.750 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:01.750 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:01.750 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.751 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: _finish_auth 0 2024-09-12T17:46:01.751 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: _check_auth_tickets 2024-09-12T17:46:01.751 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:01.751 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:01.751 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:46:01.751 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: dump: 2024-09-12T17:46:01.751 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:01.751 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:01.751 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.751 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.751 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:01.751 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.751 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:01.752 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:01.752 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:01.752 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.752 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:46:01.457+0000 7ff5ecd2b800 5 monclient: authenticate success, global_id 7538 2024-09-12T17:46:01.752 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:46:01.457+0000 7ff5ecd2b800 10 monclient: _renew_subs 2024-09-12T17:46:01.752 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:46:01.457+0000 7ff5ecd2b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.752 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:46:01.457+0000 7ff4d6e0d640 4 set_mon_vals no callback set 2024-09-12T17:46:01.752 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:46:01.457+0000 7ff5ecd2b800 10 monclient: _renew_subs 2024-09-12T17:46:01.752 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:46:01.457+0000 7ff5ecd2b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.752 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:46:01.457+0000 7ff5ecd2b800 1 librados: init done 2024-09-12T17:46:01.752 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:46:01.459+0000 7ff4d560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:01.752 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:46:01.459+0000 7ff4d560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:01.753 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:46:01.459+0000 7ff4d560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:01.753 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:46:01.459+0000 7ff5e8a73640 10 monclient: get_auth_request con 0x7ff4d0076470 auth_method 0 2024-09-12T17:46:01.753 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:46:01.460+0000 7ff5e8272640 10 monclient: get_auth_request con 0x55fe28ca27f0 auth_method 0 2024-09-12T17:46:01.753 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:46:01.460+0000 7ff5e8a73640 10 monclient: get_auth_request con 0x55fe28cc6f20 auth_method 0 2024-09-12T17:46:01.753 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:46:01.462+0000 7ff5e8272640 10 monclient: get_auth_request con 0x55fe28ccc0c0 auth_method 0 2024-09-12T17:46:01.753 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 10 monclient: build_initial_monmap 2024-09-12T17:46:01.753 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 1 build_initial for_mkfs: 0 2024-09-12T17:46:01.753 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 10 monclient: monmap: 2024-09-12T17:46:01.753 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:46:01.753 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:01.753 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:46:01.753 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:46:01.753 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:01.753 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.754 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:46:01.754 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:46:01.754 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:46:01.754 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.754 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding auth protocol: cephx 2024-09-12T17:46:01.754 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding auth protocol: cephx 2024-09-12T17:46:01.754 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding auth protocol: cephx 2024-09-12T17:46:01.754 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: secure 2024-09-12T17:46:01.754 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: crc 2024-09-12T17:46:01.754 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: secure 2024-09-12T17:46:01.754 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: crc 2024-09-12T17:46:01.754 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: secure 2024-09-12T17:46:01.754 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: crc 2024-09-12T17:46:01.754 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: crc 2024-09-12T17:46:01.755 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: secure 2024-09-12T17:46:01.755 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: crc 2024-09-12T17:46:01.755 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: secure 2024-09-12T17:46:01.755 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: crc 2024-09-12T17:46:01.755 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: secure 2024-09-12T17:46:01.755 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.755 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command objecter_requests cmddesc objecter_requests hook 0x55fe28cd3550 EEXIST 2024-09-12T17:46:01.755 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 10 monclient: init 2024-09-12T17:46:01.755 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding auth protocol: cephx 2024-09-12T17:46:01.755 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding auth protocol: cephx 2024-09-12T17:46:01.755 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding auth protocol: cephx 2024-09-12T17:46:01.755 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: secure 2024-09-12T17:46:01.756 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: crc 2024-09-12T17:46:01.756 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: secure 2024-09-12T17:46:01.756 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: crc 2024-09-12T17:46:01.756 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: secure 2024-09-12T17:46:01.756 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: crc 2024-09-12T17:46:01.756 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: crc 2024-09-12T17:46:01.756 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: secure 2024-09-12T17:46:01.756 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: crc 2024-09-12T17:46:01.756 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: secure 2024-09-12T17:46:01.756 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: crc 2024-09-12T17:46:01.756 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: secure 2024-09-12T17:46:01.756 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.757 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.757 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command rotate-key cmddesc rotate-key hook 0x55fe28ccf1f0 EEXIST 2024-09-12T17:46:01.757 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:01.757 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:46:01.757 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-a con 0x55fe28cf7870 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:01.757 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-c con 0x55fe28cf7c50 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:46:01.757 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-b con 0x55fe28cf6580 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:46:01.757 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.757 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.757 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.757 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:01.757 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient(hunting): authenticate will time out at 2134.101281s 2024-09-12T17:46:01.758 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient(hunting): get_auth_request con 0x55fe28cf7c50 auth_method 0 2024-09-12T17:46:01.758 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.758 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.758 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.758 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:46:01.464+0000 7ff5e8a73640 10 monclient(hunting): get_auth_request con 0x55fe28cf7870 auth_method 0 2024-09-12T17:46:01.758 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:46:01.464+0000 7ff5e8a73640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.758 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:46:01.464+0000 7ff5e8a73640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.758 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:46:01.464+0000 7ff5e8a73640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.758 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:46:01.464+0000 7ff5e9274640 10 monclient(hunting): get_auth_request con 0x55fe28cf6580 auth_method 0 2024-09-12T17:46:01.758 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:46:01.464+0000 7ff5e9274640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.758 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:46:01.464+0000 7ff5e9274640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.758 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:46:01.464+0000 7ff5e9274640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.759 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.759 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.759 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.759 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:46:01.464+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.759 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:46:01.464+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.759 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:46:01.464+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.759 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:46:01.464+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.759 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:46:01.464+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.759 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:46:01.464+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.759 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient(hunting): handle_auth_done global_id 7541 payload 824 2024-09-12T17:46:01.759 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient: _finish_hunting 0 2024-09-12T17:46:01.759 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:46:01.464+0000 7ff5e8272640 1 monclient: found mon.noname-c 2024-09-12T17:46:01.760 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.760 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:01.760 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:46:01.760 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: dump: 2024-09-12T17:46:01.760 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:01.760 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:01.760 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.760 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.760 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:01.760 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.760 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:01.760 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:01.760 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:01.761 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.761 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: _finish_auth 0 2024-09-12T17:46:01.761 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:46:01.761 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:01.761 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:01.761 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:46:01.761 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: dump: 2024-09-12T17:46:01.761 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:01.761 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:01.761 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.761 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.761 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:01.762 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.762 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:01.762 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:01.762 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:01.762 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.762 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 5 monclient: authenticate success, global_id 7541 2024-09-12T17:46:01.762 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:46:01.465+0000 7ff5ecd2b800 10 monclient: _renew_subs 2024-09-12T17:46:01.762 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:46:01.465+0000 7ff5ecd2b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.762 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:46:01.464+0000 7ff5e9a75640 4 set_mon_vals no callback set 2024-09-12T17:46:01.762 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:46:01.465+0000 7ff5ecd2b800 10 monclient: _renew_subs 2024-09-12T17:46:01.762 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:46:01.465+0000 7ff5ecd2b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.762 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:46:01.466+0000 7ff4ce7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:01.762 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:46:01.466+0000 7ff4ce7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:01.763 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:46:01.466+0000 7ff4ce7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:01.763 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:46:01.467+0000 7ff5e8a73640 10 monclient: get_auth_request con 0x7ff4c0076380 auth_method 0 2024-09-12T17:46:01.763 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 10 monclient: get_monmap_and_config 2024-09-12T17:46:01.763 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 10 monclient: build_initial_monmap 2024-09-12T17:46:01.763 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 1 build_initial for_mkfs: 0 2024-09-12T17:46:01.763 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 10 monclient: monmap: 2024-09-12T17:46:01.763 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:46:01.763 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:01.763 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:46:01.763 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:46:01.763 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:01.763 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.764 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:46:01.764 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:46:01.764 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:46:01.764 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.764 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding auth protocol: cephx 2024-09-12T17:46:01.764 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding auth protocol: cephx 2024-09-12T17:46:01.764 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding auth protocol: cephx 2024-09-12T17:46:01.764 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: secure 2024-09-12T17:46:01.764 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: crc 2024-09-12T17:46:01.764 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: secure 2024-09-12T17:46:01.764 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: crc 2024-09-12T17:46:01.764 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: secure 2024-09-12T17:46:01.765 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: crc 2024-09-12T17:46:01.765 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: crc 2024-09-12T17:46:01.765 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: secure 2024-09-12T17:46:01.765 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: crc 2024-09-12T17:46:01.765 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: secure 2024-09-12T17:46:01.765 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: crc 2024-09-12T17:46:01.765 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: secure 2024-09-12T17:46:01.765 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.765 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 10 monclient: init 2024-09-12T17:46:01.765 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding auth protocol: cephx 2024-09-12T17:46:01.765 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding auth protocol: cephx 2024-09-12T17:46:01.765 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding auth protocol: cephx 2024-09-12T17:46:01.765 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: secure 2024-09-12T17:46:01.766 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: crc 2024-09-12T17:46:01.766 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: secure 2024-09-12T17:46:01.766 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: crc 2024-09-12T17:46:01.766 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: secure 2024-09-12T17:46:01.766 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: crc 2024-09-12T17:46:01.766 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: crc 2024-09-12T17:46:01.766 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: secure 2024-09-12T17:46:01.766 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: crc 2024-09-12T17:46:01.766 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: secure 2024-09-12T17:46:01.766 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: crc 2024-09-12T17:46:01.766 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: secure 2024-09-12T17:46:01.766 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.766 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.767 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command rotate-key cmddesc rotate-key hook 0x7ffe3c8739f8 EEXIST 2024-09-12T17:46:01.767 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:01.767 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:46:01.767 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-c con 0x55fe28d4bde0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:46:01.767 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-b con 0x55fe28d3c730 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:46:01.767 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-a con 0x55fe28d47210 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:01.767 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.767 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.767 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.767 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:01.767 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient(hunting): authenticate will time out at 2134.105214s 2024-09-12T17:46:01.767 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient(hunting): get_auth_request con 0x55fe28d4bde0 auth_method 0 2024-09-12T17:46:01.768 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.768 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.768 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.768 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:46:01.468+0000 7ff5e9274640 10 monclient(hunting): get_auth_request con 0x55fe28d47210 auth_method 0 2024-09-12T17:46:01.768 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:46:01.468+0000 7ff5e9274640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.768 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:46:01.468+0000 7ff5e9274640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.768 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:46:01.468+0000 7ff5e9274640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.768 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:46:01.468+0000 7ff5e8272640 10 monclient(hunting): get_auth_request con 0x55fe28d3c730 auth_method 0 2024-09-12T17:46:01.768 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:46:01.468+0000 7ff5e8272640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.768 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:46:01.468+0000 7ff5e8272640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.768 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:46:01.468+0000 7ff5e8272640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.768 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.768 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.769 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.769 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:46:01.468+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.769 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:46:01.468+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.769 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:46:01.468+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.769 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:46:01.468+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.769 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:46:01.468+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.769 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:46:01.468+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.769 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_done global_id 7544 payload 274 2024-09-12T17:46:01.769 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient: _finish_hunting 0 2024-09-12T17:46:01.769 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 1 monclient: found mon.noname-c 2024-09-12T17:46:01.769 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.769 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:01.769 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:46:01.769 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: dump: 2024-09-12T17:46:01.770 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:01.770 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:01.770 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.770 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.770 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:01.770 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.770 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:01.770 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:01.770 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:01.770 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.770 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: _finish_auth 0 2024-09-12T17:46:01.770 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: _check_auth_tickets 2024-09-12T17:46:01.770 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 5 monclient: authenticate success, global_id 7544 2024-09-12T17:46:01.771 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:01.771 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient: get_monmap_and_config success 2024-09-12T17:46:01.771 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 4 set_mon_vals no callback set 2024-09-12T17:46:01.771 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:01.771 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:46:01.771 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: dump: 2024-09-12T17:46:01.771 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:01.771 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:01.771 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.771 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.771 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:01.771 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.771 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:01.772 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:01.772 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:01.772 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.772 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 10 monclient: shutdown 2024-09-12T17:46:01.772 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 10 monclient: build_initial_monmap 2024-09-12T17:46:01.772 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 1 build_initial for_mkfs: 0 2024-09-12T17:46:01.772 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 10 monclient: monmap: 2024-09-12T17:46:01.772 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:46:01.772 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:01.772 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:46:01.772 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:46:01.772 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:01.773 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.773 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:46:01.773 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:46:01.773 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:46:01.773 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.773 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding auth protocol: cephx 2024-09-12T17:46:01.773 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding auth protocol: cephx 2024-09-12T17:46:01.773 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding auth protocol: cephx 2024-09-12T17:46:01.773 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: secure 2024-09-12T17:46:01.773 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: crc 2024-09-12T17:46:01.773 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: secure 2024-09-12T17:46:01.773 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: crc 2024-09-12T17:46:01.773 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: secure 2024-09-12T17:46:01.774 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: crc 2024-09-12T17:46:01.774 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: crc 2024-09-12T17:46:01.774 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: secure 2024-09-12T17:46:01.774 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: crc 2024-09-12T17:46:01.774 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: secure 2024-09-12T17:46:01.774 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: crc 2024-09-12T17:46:01.774 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: secure 2024-09-12T17:46:01.774 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.774 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 1 librados: starting msgr at 2024-09-12T17:46:01.774 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 1 librados: starting objecter 2024-09-12T17:46:01.774 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command objecter_requests cmddesc objecter_requests hook 0x55fe28d1d810 EEXIST 2024-09-12T17:46:01.774 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 1 librados: setting wanted keys 2024-09-12T17:46:01.775 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 1 librados: calling monclient init 2024-09-12T17:46:01.775 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 10 monclient: init 2024-09-12T17:46:01.775 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding auth protocol: cephx 2024-09-12T17:46:01.775 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding auth protocol: cephx 2024-09-12T17:46:01.775 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding auth protocol: cephx 2024-09-12T17:46:01.775 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: secure 2024-09-12T17:46:01.775 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: crc 2024-09-12T17:46:01.775 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: secure 2024-09-12T17:46:01.775 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: crc 2024-09-12T17:46:01.775 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: secure 2024-09-12T17:46:01.775 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: crc 2024-09-12T17:46:01.775 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: crc 2024-09-12T17:46:01.775 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: secure 2024-09-12T17:46:01.775 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: crc 2024-09-12T17:46:01.776 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: secure 2024-09-12T17:46:01.776 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: crc 2024-09-12T17:46:01.776 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: secure 2024-09-12T17:46:01.776 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.776 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.776 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command rotate-key cmddesc rotate-key hook 0x55fe28d0c278 EEXIST 2024-09-12T17:46:01.776 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:01.776 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:46:01.776 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-b con 0x55fe28d3c730 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:46:01.776 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-a con 0x55fe28d47210 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:01.776 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-c con 0x55fe28d4bde0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:46:01.776 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.777 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.777 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.777 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:01.777 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient(hunting): authenticate will time out at 2134.107513s 2024-09-12T17:46:01.777 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:46:01.470+0000 7ff5e8272640 10 monclient(hunting): get_auth_request con 0x55fe28d47210 auth_method 0 2024-09-12T17:46:01.777 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:46:01.470+0000 7ff5e8272640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.777 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:46:01.470+0000 7ff5e8272640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.777 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:46:01.470+0000 7ff5e8272640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.777 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient(hunting): get_auth_request con 0x55fe28d4bde0 auth_method 0 2024-09-12T17:46:01.777 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.777 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.777 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.777 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:46:01.470+0000 7ff5e8a73640 10 monclient(hunting): get_auth_request con 0x55fe28d3c730 auth_method 0 2024-09-12T17:46:01.778 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:46:01.470+0000 7ff5e8a73640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.778 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:46:01.470+0000 7ff5e8a73640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.778 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:46:01.470+0000 7ff5e8a73640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.778 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:46:01.470+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.778 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:46:01.470+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.778 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:46:01.470+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.778 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.778 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.778 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.778 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:46:01.470+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.778 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:46:01.470+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.778 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:46:01.470+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.778 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient(hunting): handle_auth_done global_id 7547 payload 824 2024-09-12T17:46:01.779 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient: _finish_hunting 0 2024-09-12T17:46:01.779 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:46:01.470+0000 7ff5e9274640 1 monclient: found mon.noname-c 2024-09-12T17:46:01.779 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.779 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:01.779 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:46:01.779 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: dump: 2024-09-12T17:46:01.779 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:01.779 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:01.779 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.779 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.779 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:01.779 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.779 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:01.780 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:01.780 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:01.780 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.780 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: _finish_auth 0 2024-09-12T17:46:01.780 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:46:01.780 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:01.780 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:46:01.471+0000 7ff4bffff640 4 set_mon_vals no callback set 2024-09-12T17:46:01.780 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:46:01.471+0000 7ff5ecd2b800 5 monclient: authenticate success, global_id 7547 2024-09-12T17:46:01.780 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:46:01.471+0000 7ff5ecd2b800 10 monclient: _renew_subs 2024-09-12T17:46:01.780 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:46:01.471+0000 7ff5ecd2b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.780 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:01.780 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:46:01.780 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: dump: 2024-09-12T17:46:01.780 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:01.781 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:01.781 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.781 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.781 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:01.781 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.781 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:01.781 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:01.781 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:01.781 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.781 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:46:01.471+0000 7ff5ecd2b800 10 monclient: _renew_subs 2024-09-12T17:46:01.781 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:46:01.471+0000 7ff5ecd2b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.781 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:46:01.471+0000 7ff5ecd2b800 1 librados: init done 2024-09-12T17:46:01.782 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:46:01.471+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command cr dump hook 0x55fe28d56aa8 2024-09-12T17:46:01.782 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:46:01.472+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.782 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:46:01.473+0000 7ff4be7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:01.782 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:46:01.473+0000 7ff4be7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:01.782 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:46:01.473+0000 7ff4be7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:01.782 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:46:01.473+0000 7ff5e8a73640 10 monclient: get_auth_request con 0x7ff4b40764a0 auth_method 0 2024-09-12T17:46:01.782 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:46:01.474+0000 7ff5e8272640 10 monclient: get_auth_request con 0x55fe28d66320 auth_method 0 2024-09-12T17:46:01.782 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:46:01.474+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.782 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:46:01.474+0000 7ff5ecd2b800 20 realm 2024-09-12T17:46:01.782 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:46:01.474+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.782 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:46:01.474+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.782 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:46:01.474+0000 7ff5ecd2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:01.782 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:46:01.474+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.783 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:46:01.475+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.783 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:46:01.475+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.783 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:46:01.475+0000 7ff5e8a73640 10 monclient: get_auth_request con 0x55fe28d6a1c0 auth_method 0 2024-09-12T17:46:01.783 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:46:01.475+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:01.783 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:46:01.475+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.783 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:46:01.476+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:01.783 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:46:01.476+0000 7ff5ecd2b800 20 searching for the correct realm 2024-09-12T17:46:01.783 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:46:01.476+0000 7ff5e8272640 10 monclient: get_auth_request con 0x55fe28d6f060 auth_method 0 2024-09-12T17:46:01.783 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:46:01.477+0000 7ff5e9274640 10 monclient: get_auth_request con 0x7ff5dc07d060 auth_method 0 2024-09-12T17:46:01.783 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:46:01.477+0000 7ff5e8a73640 10 monclient: get_auth_request con 0x7ff5e009ec20 auth_method 0 2024-09-12T17:46:01.783 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:46:01.478+0000 7ff5e8272640 10 monclient: get_auth_request con 0x7ff5d8028040 auth_method 0 2024-09-12T17:46:01.783 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:46:01.479+0000 7ff5e8272640 0 -- 172.21.15.44:0/3141852951 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7ff5d8028040 msgr2=0x7ff5d805c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:01.783 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:46:01.479+0000 7ff4be7fc640 1 client.7547.objecter ms_handle_reset 0x7ff5d8028040 session 0x7ff5d8055040 osd.4 2024-09-12T17:46:01.784 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:46:01.479+0000 7ff4be7fc640 10 monclient: _renew_subs 2024-09-12T17:46:01.784 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:46:01.479+0000 7ff4be7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.784 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:46:01.479+0000 7ff5e8272640 10 monclient: get_auth_request con 0x7ff4b40862c0 auth_method 0 2024-09-12T17:46:01.784 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:46:01.480+0000 7ff5e9274640 10 monclient: get_auth_request con 0x7ff5dc065050 auth_method 0 2024-09-12T17:46:01.784 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:46:01.482+0000 7ff5e8a73640 10 monclient: get_auth_request con 0x7ff5dc0b3ab0 auth_method 0 2024-09-12T17:46:01.784 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:46:01.482+0000 7ff5e8a73640 0 -- 172.21.15.44:0/3141852951 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7ff5dc0b3ab0 msgr2=0x7ff5dc0b2810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:01.784 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:46:01.683+0000 7ff5e8a73640 10 monclient: get_auth_request con 0x7ff5dc0b3ab0 auth_method 0 2024-09-12T17:46:01.784 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:01.784 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:01.784 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:01.784 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:01.784 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:01.784 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:01.784 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.785 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.785 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.785 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:01.785 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.785 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:01.785 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 zone default found 2024-09-12T17:46:01.785 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 4 Realm: () 2024-09-12T17:46:01.785 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:01.785 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:01.785 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:01.785 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 zonegroup default 2024-09-12T17:46:01.785 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.785 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.786 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.786 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:46:01.690+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.786 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:46:01.690+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.786 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:46:01.690+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.786 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:46:01.690+0000 7ff5ecd2b800 20 started sync module instance, tier type = 2024-09-12T17:46:01.786 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:46:01.690+0000 7ff5ecd2b800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:01.786 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=0 2024-09-12T17:46:01.786 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=1 2024-09-12T17:46:01.786 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=2 2024-09-12T17:46:01.786 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=3 2024-09-12T17:46:01.786 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=4 2024-09-12T17:46:01.786 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=5 2024-09-12T17:46:01.787 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=6 2024-09-12T17:46:01.787 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:46:01.700+0000 7ff5ecd2b800 20 add_watcher() i=7 2024-09-12T17:46:01.787 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:46:01.701+0000 7ff5ecd2b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:01.787 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding auth protocol: cephx 2024-09-12T17:46:01.787 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding auth protocol: cephx 2024-09-12T17:46:01.787 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding auth protocol: cephx 2024-09-12T17:46:01.787 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: secure 2024-09-12T17:46:01.787 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: crc 2024-09-12T17:46:01.787 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: secure 2024-09-12T17:46:01.787 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: crc 2024-09-12T17:46:01.787 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: secure 2024-09-12T17:46:01.787 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: crc 2024-09-12T17:46:01.787 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: crc 2024-09-12T17:46:01.787 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: secure 2024-09-12T17:46:01.788 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: crc 2024-09-12T17:46:01.788 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: secure 2024-09-12T17:46:01.788 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: crc 2024-09-12T17:46:01.788 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: secure 2024-09-12T17:46:01.788 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:46:01.702+0000 7ff49efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:01.788 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.788 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:01.788 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:01.788 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command cache list hook 0x55fe28d41cc0 2024-09-12T17:46:01.788 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command cache inspect hook 0x55fe28d41cc0 2024-09-12T17:46:01.788 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command cache erase hook 0x55fe28d41cc0 2024-09-12T17:46:01.788 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command cache zap hook 0x55fe28d41cc0 2024-09-12T17:46:01.789 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 note: GC not initialized 2024-09-12T17:46:01.789 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:46:01.703+0000 7ff49dfe3640 20 reqs_thread_entry: start 2024-09-12T17:46:01.789 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command sync trace show hook 0x7ff5d801f070 2024-09-12T17:46:01.789 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command sync trace history hook 0x7ff5d801f070 2024-09-12T17:46:01.789 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command sync trace active hook 0x7ff5d801f070 2024-09-12T17:46:01.789 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command sync trace active_short hook 0x7ff5d801f070 2024-09-12T17:46:01.789 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:01.789 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 20 Filter name: none 2024-09-12T17:46:01.789 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:46:01.703+0000 7ff40f7fe640 20 reqs_thread_entry: start 2024-09-12T17:46:01.789 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:46:01.789 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.789 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:46:01.789 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:46:01.790 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:46:01.790 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 : miss 2024-09-12T17:46:01.790 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.790 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:46:01.704+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:46:01.790 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:46:01.704+0000 7ff5ecd2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:01.790 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:46:01.704+0000 7ff5ecd2b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:01.790 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:46:01.704+0000 7ff5ecd2b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:01.790 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:46:01.704+0000 7ff5ecd2b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:01.790 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:46:01.704+0000 7ff5ecd2b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 2024-09-12T17:46:01.790 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:46:01.709+0000 7ff5ecd2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:01.790 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:46:01.709+0000 7ff5ecd2b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:01.790 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:46:01.709+0000 7ff5ecd2b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:01.790 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:46:01.709+0000 7ff5ecd2b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40, ofs0, ns] 2024-09-12T17:46:01.791 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:46:01.709+0000 7ff4bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562386 cookie 94550095271088 notifier 7547 bl.length()=1015 2024-09-12T17:46:01.791 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:46:01.709+0000 7ff4bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:01.791 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:46:01.709+0000 7ff4bf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:01.791 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:46:01.709+0000 7ff4bf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:01.791 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:46:01.710+0000 7ff5ecd2b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): orig_sources= new_sources= 2024-09-12T17:46:01.791 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:46:01.710+0000 7ff5ecd2b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): potential sources added=[] removed=[] 2024-09-12T17:46:01.791 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:46:01.710+0000 7ff5ecd2b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): orig_dests= new_dests= 2024-09-12T17:46:01.791 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:46:01.710+0000 7ff5ecd2b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): potential dests added=[] removed=[] 2024-09-12T17:46:01.792 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.0 2024-09-12T17:46:01.792 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.0 2024-09-12T17:46:01.792 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.1 2024-09-12T17:46:01.792 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.1 2024-09-12T17:46:01.792 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.2 2024-09-12T17:46:01.792 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.2 2024-09-12T17:46:01.792 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.3 2024-09-12T17:46:01.792 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.3 2024-09-12T17:46:01.792 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.4 2024-09-12T17:46:01.792 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.4 2024-09-12T17:46:01.792 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.5 2024-09-12T17:46:01.792 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.5 2024-09-12T17:46:01.792 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.6 2024-09-12T17:46:01.793 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.6 2024-09-12T17:46:01.793 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.7 2024-09-12T17:46:01.793 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.7 2024-09-12T17:46:01.793 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.8 2024-09-12T17:46:01.793 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.8 2024-09-12T17:46:01.793 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.9 2024-09-12T17:46:01.793 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.9 2024-09-12T17:46:01.793 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.10 2024-09-12T17:46:01.793 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.10 2024-09-12T17:46:01.793 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.11 2024-09-12T17:46:01.793 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.11 2024-09-12T17:46:01.793 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.0 2024-09-12T17:46:01.793 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:46:01.715+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1 2024-09-12T17:46:01.793 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:46:01.715+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2 2024-09-12T17:46:01.794 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:46:01.716+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.3 2024-09-12T17:46:01.794 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:46:01.716+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.4 2024-09-12T17:46:01.794 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:46:01.716+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.5 2024-09-12T17:46:01.794 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:46:01.717+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.6 2024-09-12T17:46:01.794 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:46:01.717+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.7 2024-09-12T17:46:01.794 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:46:01.718+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.8 2024-09-12T17:46:01.794 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:46:01.718+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.9 2024-09-12T17:46:01.794 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:46:01.719+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.10 2024-09-12T17:46:01.794 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:46:01.722+0000 7ff5ecd2b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff5ecd2b800 time 2024-09-12T17:46:01.723549+0000 2024-09-12T17:46:01.794 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:46:01.794 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.794 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:01.794 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff5ee58c71a] 2024-09-12T17:46:01.795 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff5ee58c8d8] 2024-09-12T17:46:01.795 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fe27b6e841] 2024-09-12T17:46:01.795 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55fe27b7d734] 2024-09-12T17:46:01.795 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55fe27b7e5d4] 2024-09-12T17:46:01.795 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:46:01.795 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff5ed229590] 2024-09-12T17:46:01.795 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:46:01.795 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:46:01.795 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.795 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:46:01.723+0000 7ff5ecd2b800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:46:01.795 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7ff5ecd2b800 thread_name:radosgw-admin 2024-09-12T17:46:01.795 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.795 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:01.796 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff5ed23e6f0] 2024-09-12T17:46:01.796 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff5ed28b99c] 2024-09-12T17:46:01.796 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:46:01.796 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:46:01.796 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff5ee58c774] 2024-09-12T17:46:01.796 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff5ee58c8d8] 2024-09-12T17:46:01.796 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fe27b6e841] 2024-09-12T17:46:01.796 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55fe27b7d734] 2024-09-12T17:46:01.796 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55fe27b7e5d4] 2024-09-12T17:46:01.796 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:46:01.796 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff5ed229590] 2024-09-12T17:46:01.796 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:46:01.796 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:46:01.797 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:46:01.797 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.797 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:46:01.797 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:46:01.797 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:46:01.797 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:46:01.797 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:46:01.797 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:46:01.797 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:46:01.797 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:46:01.797 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:46:01.797 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:46:01.797 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:46:01.798 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:46:01.798 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:46:01.798 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:46:01.798 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:46:01.798 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:46:01.798 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:46:01.798 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:46:01.798 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:46:01.798 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:46:01.798 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:46:01.798 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:46:01.798 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:46:01.798 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:46:01.799 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:46:01.799 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:46:01.799 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:46:01.799 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:46:01.799 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:46:01.799 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:46:01.799 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:46:01.799 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:46:01.799 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:46:01.799 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:46:01.799 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:46:01.799 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:46:01.799 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:46:01.799 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:46:01.800 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:46:01.800 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:46:01.800 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:46:01.800 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:46:01.800 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:46:01.800 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:46:01.800 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:46:01.800 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:46:01.800 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:46:01.800 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:46:01.800 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:46:01.800 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:46:01.800 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:46:01.800 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:46:01.801 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:46:01.801 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:46:01.801 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:46:01.801 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:46:01.801 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:46:01.801 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:46:01.801 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:46:01.801 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:46:01.801 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:46:01.801 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:46:01.801 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:46:01.801 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:46:01.801 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:46:01.802 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:46:01.802 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:46:01.802 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:46:01.802 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:46:01.802 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:46:01.802 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:46:01.802 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:46:01.802 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:46:01.802 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:46:01.802 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:46:01.802 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:46:01.802 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:46:01.802 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:46:01.803 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:46:01.803 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:46:01.803 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:46:01.803 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:46:01.803 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:46:01.803 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:46:01.803 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:46:01.803 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:46:01.803 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:46:01.803 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:46:01.803 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:46:01.803 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:46:01.803 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:46:01.803 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:46:01.804 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:46:01.804 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:46:01.804 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff40f7fe640 / http_manager 2024-09-12T17:46:01.804 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff49dfe3640 / http_manager 2024-09-12T17:46:01.804 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff49efe5640 / rgw_dt_lg_renew 2024-09-12T17:46:01.804 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff4be7fc640 / ms_dispatch 2024-09-12T17:46:01.804 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff4bf7fe640 / io_context_pool 2024-09-12T17:46:01.804 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff4bffff640 / io_context_pool 2024-09-12T17:46:01.804 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff4ce7fc640 / ms_dispatch 2024-09-12T17:46:01.804 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff4d560a640 / ms_dispatch 2024-09-12T17:46:01.804 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff4d6e0d640 / io_context_pool 2024-09-12T17:46:01.804 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff5e8272640 / msgr-worker-2 2024-09-12T17:46:01.804 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff5e8a73640 / msgr-worker-1 2024-09-12T17:46:01.804 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff5e9274640 / msgr-worker-0 2024-09-12T17:46:01.805 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff5e9a75640 / io_context_pool 2024-09-12T17:46:01.805 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff5ecd2b800 / radosgw-admin 2024-09-12T17:46:01.805 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:46:01.805 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:46:01.805 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/log/ceph/ceph-client.admin.143287.log 2024-09-12T17:46:01.805 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:46:01.805 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:46:01.805 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28c7abe0) adding con mode: secure 2024-09-12T17:46:01.805 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28c7abe0) adding con mode: crc 2024-09-12T17:46:01.805 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28c7abe0) adding con mode: secure 2024-09-12T17:46:01.805 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.805 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.805 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command rotate-key hook 0x55fe28c7ad28 2024-09-12T17:46:01.806 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:01.806 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:46:01.806 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-a con 0x55fe28b268e0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:01.806 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-b con 0x55fe28b28780 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:46:01.806 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-c con 0x55fe28bbd970 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:46:01.806 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.806 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.806 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.806 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:01.806 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:46:01.456+0000 7ff5ecd2b800 10 monclient(hunting): authenticate will time out at 2134.093911s 2024-09-12T17:46:01.806 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient(hunting): get_auth_request con 0x55fe28bbd970 auth_method 0 2024-09-12T17:46:01.806 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.806 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.806 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.807 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:46:01.457+0000 7ff5e8a73640 10 monclient(hunting): get_auth_request con 0x55fe28b268e0 auth_method 0 2024-09-12T17:46:01.807 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:46:01.457+0000 7ff5e8a73640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.807 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:46:01.457+0000 7ff5e8a73640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.807 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:46:01.457+0000 7ff5e8a73640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.807 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:46:01.457+0000 7ff5e8272640 10 monclient(hunting): get_auth_request con 0x55fe28b28780 auth_method 0 2024-09-12T17:46:01.807 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:46:01.457+0000 7ff5e8272640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.807 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:46:01.457+0000 7ff5e8272640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.807 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:46:01.457+0000 7ff5e8272640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.807 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.807 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.807 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.807 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:46:01.457+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.807 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:46:01.457+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.808 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:46:01.457+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.808 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:46:01.457+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.808 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:46:01.457+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.808 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:46:01.457+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.808 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient(hunting): handle_auth_done global_id 7538 payload 824 2024-09-12T17:46:01.808 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient: _finish_hunting 0 2024-09-12T17:46:01.808 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:46:01.457+0000 7ff5e9274640 1 monclient: found mon.noname-c 2024-09-12T17:46:01.808 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:46:01.457+0000 7ff5e9274640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.808 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:01.808 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:46:01.808 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: dump: 2024-09-12T17:46:01.808 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:01.809 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:01.809 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.809 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.809 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:01.809 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.809 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:01.809 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:01.809 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:01.809 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.809 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: _finish_auth 0 2024-09-12T17:46:01.809 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: _check_auth_tickets 2024-09-12T17:46:01.809 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:01.810 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:01.810 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:46:01.810 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:46:01.457+0000 7ff4d560a640 10 monclient: dump: 2024-09-12T17:46:01.810 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:01.810 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:01.810 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.810 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.810 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:01.810 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.810 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:01.810 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:01.810 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:01.810 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.811 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:46:01.457+0000 7ff5ecd2b800 5 monclient: authenticate success, global_id 7538 2024-09-12T17:46:01.811 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:46:01.457+0000 7ff5ecd2b800 10 monclient: _renew_subs 2024-09-12T17:46:01.811 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:46:01.457+0000 7ff5ecd2b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.811 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:46:01.457+0000 7ff4d6e0d640 4 set_mon_vals no callback set 2024-09-12T17:46:01.811 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:46:01.457+0000 7ff5ecd2b800 10 monclient: _renew_subs 2024-09-12T17:46:01.811 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:46:01.457+0000 7ff5ecd2b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.811 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:46:01.457+0000 7ff5ecd2b800 1 librados: init done 2024-09-12T17:46:01.811 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:46:01.459+0000 7ff4d560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:01.811 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:46:01.459+0000 7ff4d560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:01.811 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:46:01.459+0000 7ff4d560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:01.811 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:46:01.459+0000 7ff5e8a73640 10 monclient: get_auth_request con 0x7ff4d0076470 auth_method 0 2024-09-12T17:46:01.811 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:46:01.460+0000 7ff5e8272640 10 monclient: get_auth_request con 0x55fe28ca27f0 auth_method 0 2024-09-12T17:46:01.811 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:46:01.460+0000 7ff5e8a73640 10 monclient: get_auth_request con 0x55fe28cc6f20 auth_method 0 2024-09-12T17:46:01.811 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:46:01.462+0000 7ff5e8272640 10 monclient: get_auth_request con 0x55fe28ccc0c0 auth_method 0 2024-09-12T17:46:01.812 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 10 monclient: build_initial_monmap 2024-09-12T17:46:01.812 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 1 build_initial for_mkfs: 0 2024-09-12T17:46:01.812 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 10 monclient: monmap: 2024-09-12T17:46:01.812 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:46:01.812 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:01.812 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:46:01.812 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:46:01.812 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:01.812 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.812 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:46:01.812 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:46:01.812 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:46:01.812 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.813 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding auth protocol: cephx 2024-09-12T17:46:01.813 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding auth protocol: cephx 2024-09-12T17:46:01.813 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding auth protocol: cephx 2024-09-12T17:46:01.813 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: secure 2024-09-12T17:46:01.813 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: crc 2024-09-12T17:46:01.813 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: secure 2024-09-12T17:46:01.813 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: crc 2024-09-12T17:46:01.813 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: secure 2024-09-12T17:46:01.813 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: crc 2024-09-12T17:46:01.813 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: crc 2024-09-12T17:46:01.813 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: secure 2024-09-12T17:46:01.813 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: crc 2024-09-12T17:46:01.813 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: secure 2024-09-12T17:46:01.813 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: crc 2024-09-12T17:46:01.814 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28cd0110) adding con mode: secure 2024-09-12T17:46:01.814 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.814 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command objecter_requests cmddesc objecter_requests hook 0x55fe28cd3550 EEXIST 2024-09-12T17:46:01.814 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 10 monclient: init 2024-09-12T17:46:01.814 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding auth protocol: cephx 2024-09-12T17:46:01.814 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding auth protocol: cephx 2024-09-12T17:46:01.814 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding auth protocol: cephx 2024-09-12T17:46:01.814 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: secure 2024-09-12T17:46:01.814 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: crc 2024-09-12T17:46:01.814 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: secure 2024-09-12T17:46:01.814 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: crc 2024-09-12T17:46:01.814 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: secure 2024-09-12T17:46:01.814 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: crc 2024-09-12T17:46:01.815 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: crc 2024-09-12T17:46:01.815 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: secure 2024-09-12T17:46:01.815 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: crc 2024-09-12T17:46:01.815 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: secure 2024-09-12T17:46:01.815 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: crc 2024-09-12T17:46:01.815 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28ccf0a8) adding con mode: secure 2024-09-12T17:46:01.815 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:46:01.463+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.815 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.815 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command rotate-key cmddesc rotate-key hook 0x55fe28ccf1f0 EEXIST 2024-09-12T17:46:01.815 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:01.815 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:46:01.815 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-a con 0x55fe28cf7870 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:01.815 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-c con 0x55fe28cf7c50 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:46:01.815 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-b con 0x55fe28cf6580 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:46:01.816 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.816 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.816 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.816 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:01.816 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 10 monclient(hunting): authenticate will time out at 2134.101281s 2024-09-12T17:46:01.816 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient(hunting): get_auth_request con 0x55fe28cf7c50 auth_method 0 2024-09-12T17:46:01.816 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.816 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.816 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.816 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:46:01.464+0000 7ff5e8a73640 10 monclient(hunting): get_auth_request con 0x55fe28cf7870 auth_method 0 2024-09-12T17:46:01.816 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:46:01.464+0000 7ff5e8a73640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.816 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:46:01.464+0000 7ff5e8a73640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.816 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:46:01.464+0000 7ff5e8a73640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.817 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:46:01.464+0000 7ff5e9274640 10 monclient(hunting): get_auth_request con 0x55fe28cf6580 auth_method 0 2024-09-12T17:46:01.817 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:46:01.464+0000 7ff5e9274640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.817 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:46:01.464+0000 7ff5e9274640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.817 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:46:01.464+0000 7ff5e9274640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.817 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.817 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.817 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.817 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:46:01.464+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.817 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:46:01.464+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.817 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:46:01.464+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.817 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:46:01.464+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.817 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:46:01.464+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.817 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:46:01.464+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.818 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient(hunting): handle_auth_done global_id 7541 payload 824 2024-09-12T17:46:01.818 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient: _finish_hunting 0 2024-09-12T17:46:01.818 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:46:01.464+0000 7ff5e8272640 1 monclient: found mon.noname-c 2024-09-12T17:46:01.818 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:46:01.464+0000 7ff5e8272640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.818 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:01.818 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:46:01.818 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: dump: 2024-09-12T17:46:01.818 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:01.818 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:01.818 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.818 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.818 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:01.818 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.818 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:01.819 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:01.819 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:01.819 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.819 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: _finish_auth 0 2024-09-12T17:46:01.819 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:46:01.819 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:01.819 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:01.819 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:46:01.819 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:46:01.464+0000 7ff4ce7fc640 10 monclient: dump: 2024-09-12T17:46:01.819 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:01.819 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:01.819 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.819 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.820 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:01.820 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.820 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:01.820 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:01.820 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:01.820 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.820 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:46:01.464+0000 7ff5ecd2b800 5 monclient: authenticate success, global_id 7541 2024-09-12T17:46:01.820 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:46:01.465+0000 7ff5ecd2b800 10 monclient: _renew_subs 2024-09-12T17:46:01.820 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:46:01.465+0000 7ff5ecd2b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.820 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:46:01.464+0000 7ff5e9a75640 4 set_mon_vals no callback set 2024-09-12T17:46:01.820 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:46:01.465+0000 7ff5ecd2b800 10 monclient: _renew_subs 2024-09-12T17:46:01.820 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:46:01.465+0000 7ff5ecd2b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.820 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:46:01.466+0000 7ff4ce7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:01.821 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:46:01.466+0000 7ff4ce7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:01.821 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:46:01.466+0000 7ff4ce7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:01.821 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:46:01.467+0000 7ff5e8a73640 10 monclient: get_auth_request con 0x7ff4c0076380 auth_method 0 2024-09-12T17:46:01.821 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 10 monclient: get_monmap_and_config 2024-09-12T17:46:01.821 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 10 monclient: build_initial_monmap 2024-09-12T17:46:01.821 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 1 build_initial for_mkfs: 0 2024-09-12T17:46:01.821 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 10 monclient: monmap: 2024-09-12T17:46:01.821 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:46:01.821 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:01.821 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:46:01.821 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:46:01.821 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:01.821 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.821 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:46:01.822 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:46:01.822 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:46:01.822 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.822 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding auth protocol: cephx 2024-09-12T17:46:01.822 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding auth protocol: cephx 2024-09-12T17:46:01.822 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding auth protocol: cephx 2024-09-12T17:46:01.822 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: secure 2024-09-12T17:46:01.822 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: crc 2024-09-12T17:46:01.822 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: secure 2024-09-12T17:46:01.822 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: crc 2024-09-12T17:46:01.822 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: secure 2024-09-12T17:46:01.822 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: crc 2024-09-12T17:46:01.822 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: crc 2024-09-12T17:46:01.823 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: secure 2024-09-12T17:46:01.823 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: crc 2024-09-12T17:46:01.823 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: secure 2024-09-12T17:46:01.823 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: crc 2024-09-12T17:46:01.823 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d177c0) adding con mode: secure 2024-09-12T17:46:01.823 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.823 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 10 monclient: init 2024-09-12T17:46:01.823 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding auth protocol: cephx 2024-09-12T17:46:01.823 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding auth protocol: cephx 2024-09-12T17:46:01.823 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding auth protocol: cephx 2024-09-12T17:46:01.823 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: secure 2024-09-12T17:46:01.823 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: crc 2024-09-12T17:46:01.823 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: secure 2024-09-12T17:46:01.823 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: crc 2024-09-12T17:46:01.824 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: secure 2024-09-12T17:46:01.824 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: crc 2024-09-12T17:46:01.824 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: crc 2024-09-12T17:46:01.824 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: secure 2024-09-12T17:46:01.824 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: crc 2024-09-12T17:46:01.824 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: secure 2024-09-12T17:46:01.824 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: crc 2024-09-12T17:46:01.824 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c8738b0) adding con mode: secure 2024-09-12T17:46:01.824 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:46:01.467+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.824 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.824 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command rotate-key cmddesc rotate-key hook 0x7ffe3c8739f8 EEXIST 2024-09-12T17:46:01.824 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:01.825 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:46:01.825 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-c con 0x55fe28d4bde0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:46:01.825 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-b con 0x55fe28d3c730 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:46:01.825 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-a con 0x55fe28d47210 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:01.825 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.825 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.825 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.825 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:01.825 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient(hunting): authenticate will time out at 2134.105214s 2024-09-12T17:46:01.825 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient(hunting): get_auth_request con 0x55fe28d4bde0 auth_method 0 2024-09-12T17:46:01.825 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.825 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.825 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.826 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:46:01.468+0000 7ff5e9274640 10 monclient(hunting): get_auth_request con 0x55fe28d47210 auth_method 0 2024-09-12T17:46:01.826 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:46:01.468+0000 7ff5e9274640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.826 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:46:01.468+0000 7ff5e9274640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.826 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:46:01.468+0000 7ff5e9274640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.826 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:46:01.468+0000 7ff5e8272640 10 monclient(hunting): get_auth_request con 0x55fe28d3c730 auth_method 0 2024-09-12T17:46:01.826 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:46:01.468+0000 7ff5e8272640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.826 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:46:01.468+0000 7ff5e8272640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.826 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:46:01.468+0000 7ff5e8272640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.826 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.826 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.826 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.826 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:46:01.468+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.826 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:46:01.468+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.826 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:46:01.468+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.826 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:46:01.468+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.827 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:46:01.468+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.827 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:46:01.468+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.827 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_done global_id 7544 payload 274 2024-09-12T17:46:01.827 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient: _finish_hunting 0 2024-09-12T17:46:01.827 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 1 monclient: found mon.noname-c 2024-09-12T17:46:01.827 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:46:01.468+0000 7ff5e8a73640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.827 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:01.827 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:46:01.827 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: dump: 2024-09-12T17:46:01.827 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:01.827 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:01.827 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.827 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.828 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:01.828 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.828 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:01.828 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:01.828 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:01.828 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.828 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: _finish_auth 0 2024-09-12T17:46:01.828 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: _check_auth_tickets 2024-09-12T17:46:01.828 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 5 monclient: authenticate success, global_id 7544 2024-09-12T17:46:01.828 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:01.828 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 10 monclient: get_monmap_and_config success 2024-09-12T17:46:01.828 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:46:01.468+0000 7ff5ecd2b800 4 set_mon_vals no callback set 2024-09-12T17:46:01.828 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:01.828 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:46:01.829 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:46:01.468+0000 7ff4bffff640 10 monclient: dump: 2024-09-12T17:46:01.829 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:01.829 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:01.829 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.829 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.829 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:01.829 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.829 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:01.829 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:01.829 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:01.829 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.829 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 10 monclient: shutdown 2024-09-12T17:46:01.829 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 10 monclient: build_initial_monmap 2024-09-12T17:46:01.830 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 1 build_initial for_mkfs: 0 2024-09-12T17:46:01.830 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 10 monclient: monmap: 2024-09-12T17:46:01.830 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:46:01.830 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:01.830 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:46:01.830 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:46:01.830 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:01.830 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.830 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:46:01.830 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:46:01.830 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:46:01.830 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.830 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding auth protocol: cephx 2024-09-12T17:46:01.831 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding auth protocol: cephx 2024-09-12T17:46:01.831 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding auth protocol: cephx 2024-09-12T17:46:01.831 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: secure 2024-09-12T17:46:01.831 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: crc 2024-09-12T17:46:01.831 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: secure 2024-09-12T17:46:01.831 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: crc 2024-09-12T17:46:01.831 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: secure 2024-09-12T17:46:01.831 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: crc 2024-09-12T17:46:01.831 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: crc 2024-09-12T17:46:01.831 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: secure 2024-09-12T17:46:01.831 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: crc 2024-09-12T17:46:01.831 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: secure 2024-09-12T17:46:01.831 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: crc 2024-09-12T17:46:01.832 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d1b340) adding con mode: secure 2024-09-12T17:46:01.832 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.832 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 1 librados: starting msgr at 2024-09-12T17:46:01.832 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 1 librados: starting objecter 2024-09-12T17:46:01.832 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command objecter_requests cmddesc objecter_requests hook 0x55fe28d1d810 EEXIST 2024-09-12T17:46:01.832 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 1 librados: setting wanted keys 2024-09-12T17:46:01.832 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 1 librados: calling monclient init 2024-09-12T17:46:01.832 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 10 monclient: init 2024-09-12T17:46:01.832 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding auth protocol: cephx 2024-09-12T17:46:01.832 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding auth protocol: cephx 2024-09-12T17:46:01.832 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding auth protocol: cephx 2024-09-12T17:46:01.832 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: secure 2024-09-12T17:46:01.833 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: crc 2024-09-12T17:46:01.833 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: secure 2024-09-12T17:46:01.833 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: crc 2024-09-12T17:46:01.833 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: secure 2024-09-12T17:46:01.833 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: crc 2024-09-12T17:46:01.833 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: crc 2024-09-12T17:46:01.833 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: secure 2024-09-12T17:46:01.833 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:46:01.469+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: crc 2024-09-12T17:46:01.833 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: secure 2024-09-12T17:46:01.833 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: crc 2024-09-12T17:46:01.833 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 5 AuthRegistry(0x55fe28d0c130) adding con mode: secure 2024-09-12T17:46:01.833 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.834 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.834 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command rotate-key cmddesc rotate-key hook 0x55fe28d0c278 EEXIST 2024-09-12T17:46:01.834 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:01.834 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:46:01.834 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-b con 0x55fe28d3c730 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:46:01.834 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-a con 0x55fe28d47210 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:01.834 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient(hunting): picked mon.noname-c con 0x55fe28d4bde0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:46:01.834 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.834 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.834 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:01.834 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:01.834 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:46:01.470+0000 7ff5ecd2b800 10 monclient(hunting): authenticate will time out at 2134.107513s 2024-09-12T17:46:01.834 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:46:01.470+0000 7ff5e8272640 10 monclient(hunting): get_auth_request con 0x55fe28d47210 auth_method 0 2024-09-12T17:46:01.835 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:46:01.470+0000 7ff5e8272640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.835 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:46:01.470+0000 7ff5e8272640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.835 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:46:01.470+0000 7ff5e8272640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.835 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient(hunting): get_auth_request con 0x55fe28d4bde0 auth_method 0 2024-09-12T17:46:01.835 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.835 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.835 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.835 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:46:01.470+0000 7ff5e8a73640 10 monclient(hunting): get_auth_request con 0x55fe28d3c730 auth_method 0 2024-09-12T17:46:01.835 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:46:01.470+0000 7ff5e8a73640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:01.835 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:46:01.470+0000 7ff5e8a73640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:01.835 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:46:01.470+0000 7ff5e8a73640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:01.835 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:46:01.470+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.835 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:46:01.470+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.836 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:46:01.470+0000 7ff5e8272640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.836 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.836 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.836 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.836 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:46:01.470+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:01.836 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:46:01.470+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:01.836 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:46:01.470+0000 7ff5e8a73640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:01.836 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient(hunting): handle_auth_done global_id 7547 payload 824 2024-09-12T17:46:01.836 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient: _finish_hunting 0 2024-09-12T17:46:01.836 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:46:01.470+0000 7ff5e9274640 1 monclient: found mon.noname-c 2024-09-12T17:46:01.836 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:46:01.470+0000 7ff5e9274640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.836 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:01.837 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:46:01.837 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: dump: 2024-09-12T17:46:01.837 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:01.837 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:01.837 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.837 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.837 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:01.837 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.837 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:01.837 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:01.837 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:01.837 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.837 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: _finish_auth 0 2024-09-12T17:46:01.838 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:46:01.838 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:01.838 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:46:01.471+0000 7ff4bffff640 4 set_mon_vals no callback set 2024-09-12T17:46:01.838 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:46:01.471+0000 7ff5ecd2b800 5 monclient: authenticate success, global_id 7547 2024-09-12T17:46:01.838 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:46:01.471+0000 7ff5ecd2b800 10 monclient: _renew_subs 2024-09-12T17:46:01.838 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:46:01.471+0000 7ff5ecd2b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.838 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:01.838 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:46:01.838 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:46:01.471+0000 7ff4be7fc640 10 monclient: dump: 2024-09-12T17:46:01.838 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:01.838 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:01.838 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.838 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:01.838 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:01.839 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:01.839 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:01.839 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:01.839 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:01.839 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.839 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:46:01.471+0000 7ff5ecd2b800 10 monclient: _renew_subs 2024-09-12T17:46:01.839 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:46:01.471+0000 7ff5ecd2b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.839 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:46:01.471+0000 7ff5ecd2b800 1 librados: init done 2024-09-12T17:46:01.839 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:46:01.471+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command cr dump hook 0x55fe28d56aa8 2024-09-12T17:46:01.839 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:46:01.472+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.839 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:46:01.473+0000 7ff4be7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:01.839 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:46:01.473+0000 7ff4be7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:01.839 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:46:01.473+0000 7ff4be7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:01.839 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:46:01.473+0000 7ff5e8a73640 10 monclient: get_auth_request con 0x7ff4b40764a0 auth_method 0 2024-09-12T17:46:01.840 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:46:01.474+0000 7ff5e8272640 10 monclient: get_auth_request con 0x55fe28d66320 auth_method 0 2024-09-12T17:46:01.840 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:46:01.474+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.840 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:46:01.474+0000 7ff5ecd2b800 20 realm 2024-09-12T17:46:01.840 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:46:01.474+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.840 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:46:01.474+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.840 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:46:01.474+0000 7ff5ecd2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:01.840 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:46:01.474+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.840 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:46:01.475+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.840 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:46:01.475+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.840 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:46:01.475+0000 7ff5e8a73640 10 monclient: get_auth_request con 0x55fe28d6a1c0 auth_method 0 2024-09-12T17:46:01.840 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:46:01.475+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:01.840 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:46:01.475+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.840 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:46:01.476+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:01.841 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:46:01.476+0000 7ff5ecd2b800 20 searching for the correct realm 2024-09-12T17:46:01.841 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:46:01.476+0000 7ff5e8272640 10 monclient: get_auth_request con 0x55fe28d6f060 auth_method 0 2024-09-12T17:46:01.841 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:46:01.477+0000 7ff5e9274640 10 monclient: get_auth_request con 0x7ff5dc07d060 auth_method 0 2024-09-12T17:46:01.841 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:46:01.477+0000 7ff5e8a73640 10 monclient: get_auth_request con 0x7ff5e009ec20 auth_method 0 2024-09-12T17:46:01.841 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:46:01.478+0000 7ff5e8272640 10 monclient: get_auth_request con 0x7ff5d8028040 auth_method 0 2024-09-12T17:46:01.841 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:46:01.479+0000 7ff5e8272640 0 -- 172.21.15.44:0/3141852951 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7ff5d8028040 msgr2=0x7ff5d805c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:01.841 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:46:01.479+0000 7ff4be7fc640 1 client.7547.objecter ms_handle_reset 0x7ff5d8028040 session 0x7ff5d8055040 osd.4 2024-09-12T17:46:01.841 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:46:01.479+0000 7ff4be7fc640 10 monclient: _renew_subs 2024-09-12T17:46:01.841 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:46:01.479+0000 7ff4be7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:46:01.841 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:46:01.479+0000 7ff5e8272640 10 monclient: get_auth_request con 0x7ff4b40862c0 auth_method 0 2024-09-12T17:46:01.841 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:46:01.480+0000 7ff5e9274640 10 monclient: get_auth_request con 0x7ff5dc065050 auth_method 0 2024-09-12T17:46:01.841 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:46:01.482+0000 7ff5e8a73640 10 monclient: get_auth_request con 0x7ff5dc0b3ab0 auth_method 0 2024-09-12T17:46:01.841 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:46:01.482+0000 7ff5e8a73640 0 -- 172.21.15.44:0/3141852951 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7ff5dc0b3ab0 msgr2=0x7ff5dc0b2810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:01.842 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:46:01.683+0000 7ff5e8a73640 10 monclient: get_auth_request con 0x7ff5dc0b3ab0 auth_method 0 2024-09-12T17:46:01.842 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:01.842 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:01.842 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:01.842 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:01.842 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:01.842 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:01.842 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.842 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.842 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:46:01.688+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.842 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:01.842 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.842 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:01.843 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 zone default found 2024-09-12T17:46:01.843 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 4 Realm: () 2024-09-12T17:46:01.843 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:01.843 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:01.843 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:01.843 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 zonegroup default 2024-09-12T17:46:01.843 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.843 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.843 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:46:01.689+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.843 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:46:01.690+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.843 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:46:01.690+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.843 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:46:01.690+0000 7ff5ecd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.843 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:46:01.690+0000 7ff5ecd2b800 20 started sync module instance, tier type = 2024-09-12T17:46:01.843 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:46:01.690+0000 7ff5ecd2b800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:01.844 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=0 2024-09-12T17:46:01.844 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=1 2024-09-12T17:46:01.844 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=2 2024-09-12T17:46:01.844 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=3 2024-09-12T17:46:01.844 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=4 2024-09-12T17:46:01.844 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=5 2024-09-12T17:46:01.844 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:46:01.699+0000 7ff5ecd2b800 20 add_watcher() i=6 2024-09-12T17:46:01.844 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:46:01.700+0000 7ff5ecd2b800 20 add_watcher() i=7 2024-09-12T17:46:01.844 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:46:01.701+0000 7ff5ecd2b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:01.844 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding auth protocol: cephx 2024-09-12T17:46:01.844 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding auth protocol: cephx 2024-09-12T17:46:01.844 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding auth protocol: cephx 2024-09-12T17:46:01.844 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: secure 2024-09-12T17:46:01.845 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: crc 2024-09-12T17:46:01.845 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: secure 2024-09-12T17:46:01.845 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: crc 2024-09-12T17:46:01.845 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: secure 2024-09-12T17:46:01.845 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: crc 2024-09-12T17:46:01.845 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: crc 2024-09-12T17:46:01.845 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: secure 2024-09-12T17:46:01.845 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: crc 2024-09-12T17:46:01.845 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: secure 2024-09-12T17:46:01.845 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: crc 2024-09-12T17:46:01.845 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 AuthRegistry(0x7ffe3c873d80) adding con mode: secure 2024-09-12T17:46:01.845 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:46:01.702+0000 7ff49efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:01.845 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:01.846 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:01.846 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:01.846 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:46:01.702+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command cache list hook 0x55fe28d41cc0 2024-09-12T17:46:01.846 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command cache inspect hook 0x55fe28d41cc0 2024-09-12T17:46:01.846 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command cache erase hook 0x55fe28d41cc0 2024-09-12T17:46:01.846 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command cache zap hook 0x55fe28d41cc0 2024-09-12T17:46:01.846 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 note: GC not initialized 2024-09-12T17:46:01.846 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:46:01.703+0000 7ff49dfe3640 20 reqs_thread_entry: start 2024-09-12T17:46:01.846 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command sync trace show hook 0x7ff5d801f070 2024-09-12T17:46:01.846 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command sync trace history hook 0x7ff5d801f070 2024-09-12T17:46:01.846 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command sync trace active hook 0x7ff5d801f070 2024-09-12T17:46:01.846 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 5 asok(0x55fe28a59730) register_command sync trace active_short hook 0x7ff5d801f070 2024-09-12T17:46:01.846 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:01.846 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 20 Filter name: none 2024-09-12T17:46:01.847 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:46:01.703+0000 7ff40f7fe640 20 reqs_thread_entry: start 2024-09-12T17:46:01.847 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:46:01.847 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.847 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:46:01.847 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:46:01.847 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:46:01.847 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 : miss 2024-09-12T17:46:01.847 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:46:01.703+0000 7ff5ecd2b800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.847 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:46:01.704+0000 7ff5ecd2b800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:46:01.847 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:46:01.704+0000 7ff5ecd2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:01.847 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:46:01.704+0000 7ff5ecd2b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:01.847 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:46:01.704+0000 7ff5ecd2b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:01.847 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:46:01.704+0000 7ff5ecd2b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:01.848 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:46:01.704+0000 7ff5ecd2b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 2024-09-12T17:46:01.848 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:46:01.709+0000 7ff5ecd2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:01.848 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:46:01.709+0000 7ff5ecd2b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:01.848 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:46:01.709+0000 7ff5ecd2b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:01.848 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:46:01.709+0000 7ff5ecd2b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40, ofs0, ns] 2024-09-12T17:46:01.848 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:46:01.709+0000 7ff4bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562386 cookie 94550095271088 notifier 7547 bl.length()=1015 2024-09-12T17:46:01.848 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:46:01.709+0000 7ff4bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:01.848 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:46:01.709+0000 7ff4bf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:01.848 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:46:01.709+0000 7ff4bf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:01.848 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:46:01.710+0000 7ff5ecd2b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): orig_sources= new_sources= 2024-09-12T17:46:01.848 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:46:01.710+0000 7ff5ecd2b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): potential sources added=[] removed=[] 2024-09-12T17:46:01.848 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:46:01.710+0000 7ff5ecd2b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): orig_dests= new_dests= 2024-09-12T17:46:01.848 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:46:01.710+0000 7ff5ecd2b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): potential dests added=[] removed=[] 2024-09-12T17:46:01.848 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.0 2024-09-12T17:46:01.849 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.0 2024-09-12T17:46:01.849 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.1 2024-09-12T17:46:01.849 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.1 2024-09-12T17:46:01.849 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.2 2024-09-12T17:46:01.849 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.2 2024-09-12T17:46:01.849 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.3 2024-09-12T17:46:01.849 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.3 2024-09-12T17:46:01.849 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.4 2024-09-12T17:46:01.849 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.4 2024-09-12T17:46:01.849 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.5 2024-09-12T17:46:01.849 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.5 2024-09-12T17:46:01.849 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.6 2024-09-12T17:46:01.850 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.6 2024-09-12T17:46:01.850 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.7 2024-09-12T17:46:01.850 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.7 2024-09-12T17:46:01.850 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.8 2024-09-12T17:46:01.850 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.8 2024-09-12T17:46:01.850 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.9 2024-09-12T17:46:01.850 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.9 2024-09-12T17:46:01.850 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.10 2024-09-12T17:46:01.850 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.10 2024-09-12T17:46:01.850 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.11 2024-09-12T17:46:01.850 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1.11 2024-09-12T17:46:01.850 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:46:01.714+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.0 2024-09-12T17:46:01.850 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:46:01.715+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1 2024-09-12T17:46:01.851 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:46:01.715+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2 2024-09-12T17:46:01.851 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:46:01.716+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.3 2024-09-12T17:46:01.851 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:46:01.716+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.4 2024-09-12T17:46:01.851 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:46:01.716+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.5 2024-09-12T17:46:01.851 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:46:01.717+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.6 2024-09-12T17:46:01.851 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:46:01.717+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.7 2024-09-12T17:46:01.851 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:46:01.718+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.8 2024-09-12T17:46:01.851 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:46:01.718+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.9 2024-09-12T17:46:01.851 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:46:01.719+0000 7ff5ecd2b800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.10 2024-09-12T17:46:01.851 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:46:01.722+0000 7ff5ecd2b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff5ecd2b800 time 2024-09-12T17:46:01.723549+0000 2024-09-12T17:46:01.851 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:46:01.851 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.851 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:01.852 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff5ee58c71a] 2024-09-12T17:46:01.852 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff5ee58c8d8] 2024-09-12T17:46:01.852 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fe27b6e841] 2024-09-12T17:46:01.852 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55fe27b7d734] 2024-09-12T17:46:01.852 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55fe27b7e5d4] 2024-09-12T17:46:01.852 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:46:01.852 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff5ed229590] 2024-09-12T17:46:01.852 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:46:01.852 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:46:01.852 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.852 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:46:01.723+0000 7ff5ecd2b800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:46:01.852 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7ff5ecd2b800 thread_name:radosgw-admin 2024-09-12T17:46:01.852 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.852 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:01.853 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff5ed23e6f0] 2024-09-12T17:46:01.853 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff5ed28b99c] 2024-09-12T17:46:01.853 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:46:01.853 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:46:01.853 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff5ee58c774] 2024-09-12T17:46:01.853 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff5ee58c8d8] 2024-09-12T17:46:01.853 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fe27b6e841] 2024-09-12T17:46:01.853 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55fe27b7d734] 2024-09-12T17:46:01.853 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55fe27b7e5d4] 2024-09-12T17:46:01.853 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:46:01.853 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff5ed229590] 2024-09-12T17:46:01.853 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:46:01.854 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:46:01.854 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:46:01.854 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.854 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:46:01.854 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:46:01.854 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:46:01.854 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:46:01.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:46:01.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:46:01.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:46:01.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:46:01.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:46:01.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:46:01.854 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:46:01.855 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:46:01.855 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:46:01.855 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:46:01.855 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:46:01.855 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:46:01.855 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:46:01.855 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:46:01.855 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:46:01.855 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:46:01.855 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:46:01.855 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:46:01.855 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:46:01.855 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:46:01.855 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:46:01.855 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:46:01.856 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:46:01.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:46:01.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:46:01.856 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:46:01.856 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:46:01.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:46:01.856 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:46:01.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:46:01.856 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:46:01.856 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:46:01.856 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:46:01.856 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:46:01.856 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:46:01.856 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:46:01.857 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:46:01.857 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:46:01.857 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:46:01.857 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:46:01.857 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:46:01.857 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:46:01.857 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:46:01.857 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:46:01.857 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:46:01.857 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:46:01.857 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:46:01.857 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:46:01.857 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:46:01.858 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:46:01.858 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:46:01.858 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:46:01.858 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:46:01.858 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:46:01.858 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:46:01.858 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:46:01.858 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:46:01.858 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:46:01.858 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:46:01.858 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:46:01.858 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:46:01.858 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:46:01.858 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:46:01.859 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:46:01.859 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:46:01.859 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:46:01.859 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:46:01.859 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:46:01.859 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:46:01.859 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:46:01.859 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:46:01.859 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:46:01.859 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:46:01.859 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:46:01.859 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:46:01.859 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:46:01.860 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:46:01.860 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:46:01.860 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:46:01.860 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:46:01.860 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:46:01.860 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:46:01.860 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:46:01.860 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:46:01.860 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:46:01.860 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:46:01.860 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:46:01.860 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:46:01.860 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:46:01.860 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:46:01.861 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff40f7fe640 / http_manager 2024-09-12T17:46:01.861 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff49dfe3640 / http_manager 2024-09-12T17:46:01.861 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff49efe5640 / rgw_dt_lg_renew 2024-09-12T17:46:01.861 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff4be7fc640 / ms_dispatch 2024-09-12T17:46:01.861 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff4bf7fe640 / io_context_pool 2024-09-12T17:46:01.861 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff4bffff640 / io_context_pool 2024-09-12T17:46:01.861 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff4ce7fc640 / ms_dispatch 2024-09-12T17:46:01.861 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff4d560a640 / ms_dispatch 2024-09-12T17:46:01.861 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff4d6e0d640 / io_context_pool 2024-09-12T17:46:01.861 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff5e8272640 / msgr-worker-2 2024-09-12T17:46:01.861 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff5e8a73640 / msgr-worker-1 2024-09-12T17:46:01.861 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff5e9274640 / msgr-worker-0 2024-09-12T17:46:01.861 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff5e9a75640 / io_context_pool 2024-09-12T17:46:01.861 INFO:tasks.workunit.client.0.smithi044.stderr: 7ff5ecd2b800 / radosgw-admin 2024-09-12T17:46:01.862 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:46:01.862 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:46:01.862 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:46:01.725207Z_848d0d95-c002-441c-96f6-f590c26e1175/log 2024-09-12T17:46:01.862 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:46:01.862 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:46:01.866 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:01.867 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:01.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.803+0000 7fd3fe330800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.804+0000 7fd3fe330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.804+0000 7fd3fe330800 20 realm 2024-09-12T17:46:01.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.804+0000 7fd3fe330800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.804+0000 7fd3fe330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.804+0000 7fd3fe330800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:01.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.804+0000 7fd3fe330800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.805+0000 7fd3fe330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.805+0000 7fd3fe330800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.805+0000 7fd3fe330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:01.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.805+0000 7fd3fe330800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.806+0000 7fd3fe330800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:01.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.806+0000 7fd3fe330800 20 searching for the correct realm 2024-09-12T17:46:01.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.809+0000 7fd3f98af640 0 -- 172.21.15.44:0/1141674403 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x556bfca4a4d0 msgr2=0x556bfca4c8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:01.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.813+0000 7fd3fa0b0640 0 -- 172.21.15.44:0/1141674403 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fd3f001a040 msgr2=0x7fd3f0051410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:01.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.817+0000 7fd3fe330800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:01.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.817+0000 7fd3fe330800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:01.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.817+0000 7fd3fe330800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:01.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.817+0000 7fd3fe330800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:01.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.817+0000 7fd3fe330800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:01.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.817+0000 7fd3fe330800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:01.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.817+0000 7fd3fe330800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.817+0000 7fd3fe330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.817+0000 7fd3fe330800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.817+0000 7fd3fe330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:01.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.818+0000 7fd3fe330800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.818+0000 7fd3fe330800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:01.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.818+0000 7fd3fe330800 20 zone default found 2024-09-12T17:46:01.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.818+0000 7fd3fe330800 4 Realm: () 2024-09-12T17:46:01.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.818+0000 7fd3fe330800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:01.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.818+0000 7fd3fe330800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:01.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.818+0000 7fd3fe330800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:01.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.818+0000 7fd3fe330800 20 zonegroup default 2024-09-12T17:46:01.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.818+0000 7fd3fe330800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.818+0000 7fd3fe330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.818+0000 7fd3fe330800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.819+0000 7fd3fe330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.819+0000 7fd3fe330800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.819+0000 7fd3fe330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.819+0000 7fd3fe330800 20 started sync module instance, tier type = 2024-09-12T17:46:01.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.819+0000 7fd3fe330800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:01.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.828+0000 7fd3fe330800 20 add_watcher() i=0 2024-09-12T17:46:01.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.828+0000 7fd3fe330800 20 add_watcher() i=1 2024-09-12T17:46:01.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.828+0000 7fd3fe330800 20 add_watcher() i=2 2024-09-12T17:46:01.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.828+0000 7fd3fe330800 20 add_watcher() i=3 2024-09-12T17:46:01.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.828+0000 7fd3fe330800 20 add_watcher() i=4 2024-09-12T17:46:01.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.828+0000 7fd3fe330800 20 add_watcher() i=5 2024-09-12T17:46:01.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.828+0000 7fd3fe330800 20 add_watcher() i=6 2024-09-12T17:46:01.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.829+0000 7fd3fe330800 20 add_watcher() i=7 2024-09-12T17:46:01.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.829+0000 7fd3fe330800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:01.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.831+0000 7fd2b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:01.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.831+0000 7fd3fe330800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:01.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.831+0000 7fd3fe330800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:01.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.831+0000 7fd3fe330800 5 note: GC not initialized 2024-09-12T17:46:01.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.831+0000 7fd22b7fe640 20 reqs_thread_entry: start 2024-09-12T17:46:01.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.831+0000 7fd3fe330800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:01.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.832+0000 7fd3fe330800 20 Filter name: none 2024-09-12T17:46:01.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.832+0000 7fd2297fa640 20 reqs_thread_entry: start 2024-09-12T17:46:01.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.832+0000 7fd3fe330800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.832+0000 7fd3fe330800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:46:01.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.832+0000 7fd3fe330800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.833+0000 7fd3fe330800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:46:01.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.833+0000 7fd3fe330800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:01.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.833+0000 7fd3fe330800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.833+0000 7fd3fe330800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:46:01.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.833+0000 7fd3fe330800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.834+0000 7fd3fe330800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:46:01.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.834+0000 7fd3fe330800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:01.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.835+0000 7fd2b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:01.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.838+0000 7fd3fe330800 20 remove_watcher() i=0 2024-09-12T17:46:01.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.838+0000 7fd3fe330800 2 removed watcher, disabling cache 2024-09-12T17:46:01.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.839+0000 7fd3fe330800 20 remove_watcher() i=1 2024-09-12T17:46:01.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.840+0000 7fd3fe330800 20 remove_watcher() i=2 2024-09-12T17:46:01.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.841+0000 7fd3fe330800 20 remove_watcher() i=3 2024-09-12T17:46:01.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.842+0000 7fd3fe330800 20 remove_watcher() i=4 2024-09-12T17:46:01.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.843+0000 7fd3fe330800 20 remove_watcher() i=5 2024-09-12T17:46:01.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.844+0000 7fd3fe330800 20 remove_watcher() i=6 2024-09-12T17:46:01.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.845+0000 7fd3fe330800 20 remove_watcher() i=7 2024-09-12T17:46:01.875 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.875 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:46:01.875 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-change-reshard-state id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:46:01.875 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:01.911 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:46:01.943 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:01.944 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:01.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.981+0000 7f5a94522800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.982+0000 7f5a94522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.982+0000 7f5a94522800 20 realm 2024-09-12T17:46:01.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.982+0000 7f5a94522800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.982+0000 7f5a94522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.982+0000 7f5a94522800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:01.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.982+0000 7f5a94522800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.983+0000 7f5a94522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:01.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.983+0000 7f5a94522800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.983+0000 7f5a94522800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:01.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.983+0000 7f5a94522800 20 rados->read ofs=0 len=0 2024-09-12T17:46:01.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.984+0000 7f5a94522800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:01.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.984+0000 7f5a94522800 20 searching for the correct realm 2024-09-12T17:46:01.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.987+0000 7f5a90a69640 0 -- 172.21.15.44:0/4160703946 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f5a780b4f90 msgr2=0x7f5a780c1a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:01.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:01.990+0000 7f5a90268640 0 -- 172.21.15.44:0/4160703946 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f5a78056b00 msgr2=0x7f5a780aa560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:02.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.196+0000 7f5a94522800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:02.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.196+0000 7f5a94522800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:02.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.196+0000 7f5a94522800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:02.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.196+0000 7f5a94522800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:02.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.196+0000 7f5a94522800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:02.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.196+0000 7f5a94522800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:02.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.196+0000 7f5a94522800 20 rados->read ofs=0 len=0 2024-09-12T17:46:02.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.197+0000 7f5a94522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:02.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.197+0000 7f5a94522800 20 rados->read ofs=0 len=0 2024-09-12T17:46:02.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.197+0000 7f5a94522800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:02.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.197+0000 7f5a94522800 20 rados->read ofs=0 len=0 2024-09-12T17:46:02.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.197+0000 7f5a94522800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:02.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.197+0000 7f5a94522800 20 zone default found 2024-09-12T17:46:02.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.197+0000 7f5a94522800 4 Realm: () 2024-09-12T17:46:02.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.197+0000 7f5a94522800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:02.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.197+0000 7f5a94522800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:02.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.197+0000 7f5a94522800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:02.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.197+0000 7f5a94522800 20 zonegroup default 2024-09-12T17:46:02.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.197+0000 7f5a94522800 20 rados->read ofs=0 len=0 2024-09-12T17:46:02.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.198+0000 7f5a94522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:02.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.198+0000 7f5a94522800 20 rados->read ofs=0 len=0 2024-09-12T17:46:02.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.198+0000 7f5a94522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:02.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.198+0000 7f5a94522800 20 rados->read ofs=0 len=0 2024-09-12T17:46:02.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.198+0000 7f5a94522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:02.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.198+0000 7f5a94522800 20 started sync module instance, tier type = 2024-09-12T17:46:02.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.198+0000 7f5a94522800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:02.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.208+0000 7f5a94522800 20 add_watcher() i=0 2024-09-12T17:46:02.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.208+0000 7f5a94522800 20 add_watcher() i=1 2024-09-12T17:46:02.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.208+0000 7f5a94522800 20 add_watcher() i=2 2024-09-12T17:46:02.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.208+0000 7f5a94522800 20 add_watcher() i=3 2024-09-12T17:46:02.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.208+0000 7f5a94522800 20 add_watcher() i=4 2024-09-12T17:46:02.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.208+0000 7f5a94522800 20 add_watcher() i=5 2024-09-12T17:46:02.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.208+0000 7f5a94522800 20 add_watcher() i=6 2024-09-12T17:46:02.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.209+0000 7f5a94522800 20 add_watcher() i=7 2024-09-12T17:46:02.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.209+0000 7f5a94522800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:02.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.210+0000 7f59467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:02.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.211+0000 7f5a94522800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:02.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.211+0000 7f5a94522800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:02.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.211+0000 7f5a94522800 5 note: GC not initialized 2024-09-12T17:46:02.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.211+0000 7f59457e2640 20 reqs_thread_entry: start 2024-09-12T17:46:02.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.211+0000 7f5a94522800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:02.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.211+0000 7f5a94522800 20 Filter name: none 2024-09-12T17:46:02.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.211+0000 7f58b6ffd640 20 reqs_thread_entry: start 2024-09-12T17:46:02.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.211+0000 7f5a94522800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:46:02.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.211+0000 7f5a94522800 20 rados->read ofs=0 len=0 2024-09-12T17:46:02.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.212+0000 7f5a94522800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:46:02.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.212+0000 7f5a94522800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:46:02.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.212+0000 7f5a94522800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:46:02.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.212+0000 7f5a94522800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 : miss 2024-09-12T17:46:02.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.212+0000 7f5a94522800 20 rados->read ofs=0 len=0 2024-09-12T17:46:02.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.212+0000 7f5a94522800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:46:02.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.212+0000 7f5a94522800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:02.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.212+0000 7f5a94522800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:02.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.212+0000 7f5a94522800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:02.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.212+0000 7f5a94522800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:02.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.212+0000 7f5a94522800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 2024-09-12T17:46:02.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.213+0000 7f5a94522800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to be held by another RGW process; skipping for now 2024-09-12T17:46:02.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.214+0000 7f59467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:02.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.216+0000 7f5a94522800 20 remove_watcher() i=0 2024-09-12T17:46:02.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.216+0000 7f5a94522800 2 removed watcher, disabling cache 2024-09-12T17:46:02.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.218+0000 7f5a94522800 20 remove_watcher() i=1 2024-09-12T17:46:02.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.219+0000 7f5a94522800 20 remove_watcher() i=2 2024-09-12T17:46:02.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.220+0000 7f5a94522800 20 remove_watcher() i=3 2024-09-12T17:46:02.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.221+0000 7f5a94522800 20 remove_watcher() i=4 2024-09-12T17:46:02.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.222+0000 7f5a94522800 20 remove_watcher() i=5 2024-09-12T17:46:02.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.223+0000 7f5a94522800 20 remove_watcher() i=6 2024-09-12T17:46:02.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:02.224+0000 7f5a94522800 20 remove_watcher() i=7 2024-09-12T17:46:02.236 INFO:tasks.workunit.client.0.smithi044.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:46:32.259 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:46:32.295 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:32.295 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:32.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.339+0000 7f9bedcb7800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.341+0000 7f9bedcb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.341+0000 7f9bedcb7800 20 realm 2024-09-12T17:46:32.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.341+0000 7f9bedcb7800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.341+0000 7f9bedcb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.341+0000 7f9bedcb7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:32.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.341+0000 7f9bedcb7800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.341+0000 7f9bedcb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.341+0000 7f9bedcb7800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.342+0000 7f9bedcb7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:32.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.342+0000 7f9bedcb7800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.342+0000 7f9bedcb7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:32.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.342+0000 7f9bedcb7800 20 searching for the correct realm 2024-09-12T17:46:32.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.345+0000 7f9beafa0640 0 -- 172.21.15.44:0/3208802645 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f9bdc086040 msgr2=0x7f9bdc061310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:32.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.350+0000 7f9beb7a1640 0 -- 172.21.15.44:0/3208802645 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f9be008e940 msgr2=0x7f9be00993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:32.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.557+0000 7f9bedcb7800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:32.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.557+0000 7f9bedcb7800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:32.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.557+0000 7f9bedcb7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:32.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.557+0000 7f9bedcb7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:32.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.557+0000 7f9bedcb7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:32.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.557+0000 7f9bedcb7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:32.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.558+0000 7f9bedcb7800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.558+0000 7f9bedcb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.558+0000 7f9bedcb7800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.558+0000 7f9bedcb7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:32.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.558+0000 7f9bedcb7800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.559+0000 7f9bedcb7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:32.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.559+0000 7f9bedcb7800 20 zone default found 2024-09-12T17:46:32.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.559+0000 7f9bedcb7800 4 Realm: () 2024-09-12T17:46:32.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.559+0000 7f9bedcb7800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:32.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.559+0000 7f9bedcb7800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:32.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.559+0000 7f9bedcb7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:32.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.559+0000 7f9bedcb7800 20 zonegroup default 2024-09-12T17:46:32.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.559+0000 7f9bedcb7800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.559+0000 7f9bedcb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.559+0000 7f9bedcb7800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.560+0000 7f9bedcb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.560+0000 7f9bedcb7800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.560+0000 7f9bedcb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.560+0000 7f9bedcb7800 20 started sync module instance, tier type = 2024-09-12T17:46:32.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.560+0000 7f9bedcb7800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:32.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.572+0000 7f9bedcb7800 20 add_watcher() i=0 2024-09-12T17:46:32.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.572+0000 7f9bedcb7800 20 add_watcher() i=1 2024-09-12T17:46:32.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.572+0000 7f9bedcb7800 20 add_watcher() i=2 2024-09-12T17:46:32.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.572+0000 7f9bedcb7800 20 add_watcher() i=3 2024-09-12T17:46:32.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.572+0000 7f9bedcb7800 20 add_watcher() i=4 2024-09-12T17:46:32.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.572+0000 7f9bedcb7800 20 add_watcher() i=5 2024-09-12T17:46:32.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.572+0000 7f9bedcb7800 20 add_watcher() i=6 2024-09-12T17:46:32.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.573+0000 7f9bedcb7800 20 add_watcher() i=7 2024-09-12T17:46:32.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.573+0000 7f9bedcb7800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:32.575 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.575+0000 7f9aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:32.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.575+0000 7f9bedcb7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:32.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.575+0000 7f9bedcb7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:32.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.575+0000 7f9bedcb7800 5 note: GC not initialized 2024-09-12T17:46:32.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.576+0000 7f9aa0fe1640 20 reqs_thread_entry: start 2024-09-12T17:46:32.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.576+0000 7f9bedcb7800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:32.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.576+0000 7f9bedcb7800 20 Filter name: none 2024-09-12T17:46:32.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.576+0000 7f9a1a7fc640 20 reqs_thread_entry: start 2024-09-12T17:46:32.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.576+0000 7f9bedcb7800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:46:32.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.576+0000 7f9bedcb7800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.577+0000 7f9bedcb7800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:46:32.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.577+0000 7f9bedcb7800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:46:32.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.577+0000 7f9bedcb7800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:46:32.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.577+0000 7f9bedcb7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 : miss 2024-09-12T17:46:32.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.577+0000 7f9bedcb7800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.577+0000 7f9bedcb7800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:46:32.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.577+0000 7f9bedcb7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:32.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.577+0000 7f9bedcb7800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:32.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.577+0000 7f9bedcb7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:32.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.577+0000 7f9bedcb7800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:32.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.577+0000 7f9bedcb7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 2024-09-12T17:46:32.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.579+0000 7f9bedcb7800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:46:32.586 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.586+0000 7f9bedcb7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:32.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.586+0000 7f9bedcb7800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:32.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.586+0000 7f9bedcb7800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:32.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.586+0000 7f9bedcb7800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40, ofs0, ns] 2024-09-12T17:46:32.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.586+0000 7f9aceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562387 cookie 94220142095168 notifier 7601 bl.length()=1015 2024-09-12T17:46:32.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.586+0000 7f9aceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:32.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.586+0000 7f9aceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:32.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.586+0000 7f9aceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:32.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.587+0000 7f9bedcb7800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): orig_sources= new_sources= 2024-09-12T17:46:32.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.587+0000 7f9bedcb7800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): potential sources added=[] removed=[] 2024-09-12T17:46:32.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.587+0000 7f9bedcb7800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): orig_dests= new_dests= 2024-09-12T17:46:32.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.587+0000 7f9bedcb7800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): potential dests added=[] removed=[] 2024-09-12T17:46:32.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.0 2024-09-12T17:46:32.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.0 2024-09-12T17:46:32.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.1 2024-09-12T17:46:32.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.1 2024-09-12T17:46:32.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.2 2024-09-12T17:46:32.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.2 2024-09-12T17:46:32.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.3 2024-09-12T17:46:32.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.3 2024-09-12T17:46:32.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.4 2024-09-12T17:46:32.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.4 2024-09-12T17:46:32.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.5 2024-09-12T17:46:32.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.5 2024-09-12T17:46:32.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.6 2024-09-12T17:46:32.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.6 2024-09-12T17:46:32.595 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.7 2024-09-12T17:46:32.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.7 2024-09-12T17:46:32.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.8 2024-09-12T17:46:32.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.8 2024-09-12T17:46:32.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.9 2024-09-12T17:46:32.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.9 2024-09-12T17:46:32.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.10 2024-09-12T17:46:32.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.10 2024-09-12T17:46:32.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.11 2024-09-12T17:46:32.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2.11 2024-09-12T17:46:32.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.593+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.0 2024-09-12T17:46:32.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.594+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1 2024-09-12T17:46:32.598 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.594+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2 2024-09-12T17:46:32.598 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.595+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.3 2024-09-12T17:46:32.598 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.595+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.4 2024-09-12T17:46:32.598 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.596+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.5 2024-09-12T17:46:32.598 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.597+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.6 2024-09-12T17:46:32.599 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.597+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.7 2024-09-12T17:46:32.599 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.598+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.8 2024-09-12T17:46:32.600 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.599+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.9 2024-09-12T17:46:32.600 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.600+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.10 2024-09-12T17:46:32.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.603+0000 7f9bedcb7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 : hit (requested=0x17, cached=0x17) 2024-09-12T17:46:32.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.603+0000 7f9bedcb7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 2024-09-12T17:46:32.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.604+0000 7f9bedcb7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:32.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.604+0000 7f9bedcb7800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:32.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.604+0000 7f9bedcb7800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:32.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.604+0000 7f9bedcb7800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40, ofs0, ns] 2024-09-12T17:46:32.606 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.605+0000 7f9ace7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562388 cookie 94220142095168 notifier 7601 bl.length()=1015 2024-09-12T17:46:32.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.605+0000 7f9ace7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:32.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.605+0000 7f9ace7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:32.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.605+0000 7f9ace7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:32.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.605+0000 7f9bedcb7800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): orig_sources= new_sources= 2024-09-12T17:46:32.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.605+0000 7f9bedcb7800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): potential sources added=[] removed=[] 2024-09-12T17:46:32.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.605+0000 7f9bedcb7800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): orig_dests= new_dests= 2024-09-12T17:46:32.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.605+0000 7f9bedcb7800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): potential dests added=[] removed=[] 2024-09-12T17:46:32.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.608+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.0 2024-09-12T17:46:32.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.608+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.1 2024-09-12T17:46:32.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.609+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.2 2024-09-12T17:46:32.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.609+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.3 2024-09-12T17:46:32.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.610+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.4 2024-09-12T17:46:32.611 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.610+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.5 2024-09-12T17:46:32.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.610+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.6 2024-09-12T17:46:32.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.611+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.7 2024-09-12T17:46:32.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.611+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.8 2024-09-12T17:46:32.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.611+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.9 2024-09-12T17:46:32.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.612+0000 7f9bedcb7800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40.10 2024-09-12T17:46:32.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.612+0000 7f9bedcb7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 : hit (requested=0x17, cached=0x17) 2024-09-12T17:46:32.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.612+0000 7f9bedcb7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 2024-09-12T17:46:32.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.614+0000 7f9bedcb7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:32.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.614+0000 7f9bedcb7800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:32.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.614+0000 7f9bedcb7800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:32.614 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.614+0000 7f9bedcb7800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40, ofs0, ns] 2024-09-12T17:46:32.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.614+0000 7f9ace7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562389 cookie 94220142095168 notifier 7601 bl.length()=983 2024-09-12T17:46:32.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.614+0000 7f9ace7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 info.flags=0x17 2024-09-12T17:46:32.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.614+0000 7f9ace7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 to cache LRU end 2024-09-12T17:46:32.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.614+0000 7f9ace7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:46:32.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.614+0000 7f9bedcb7800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): orig_sources= new_sources= 2024-09-12T17:46:32.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.614+0000 7f9bedcb7800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): potential sources added=[] removed=[] 2024-09-12T17:46:32.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.614+0000 7f9bedcb7800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): orig_dests= new_dests= 2024-09-12T17:46:32.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.614+0000 7f9bedcb7800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40]): potential dests added=[] removed=[] 2024-09-12T17:46:32.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.617+0000 7f9bedcb7800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T17:46:32.620 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.620+0000 7f9aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:32.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.622+0000 7f9bedcb7800 20 remove_watcher() i=0 2024-09-12T17:46:32.623 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.622+0000 7f9bedcb7800 2 removed watcher, disabling cache 2024-09-12T17:46:32.624 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.623+0000 7f9bedcb7800 20 remove_watcher() i=1 2024-09-12T17:46:32.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.625+0000 7f9bedcb7800 20 remove_watcher() i=2 2024-09-12T17:46:32.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.626+0000 7f9bedcb7800 20 remove_watcher() i=3 2024-09-12T17:46:32.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.627+0000 7f9bedcb7800 20 remove_watcher() i=4 2024-09-12T17:46:32.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.628+0000 7f9bedcb7800 20 remove_watcher() i=5 2024-09-12T17:46:32.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.629+0000 7f9bedcb7800 20 remove_watcher() i=6 2024-09-12T17:46:32.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.630+0000 7f9bedcb7800 20 remove_watcher() i=7 2024-09-12T17:46:32.644 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:46:32.674 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:32.674 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:32.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.714+0000 7fa3f8d26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.715+0000 7fa3f8d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.715+0000 7fa3f8d26800 20 realm 2024-09-12T17:46:32.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.715+0000 7fa3f8d26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.715+0000 7fa3f8d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.715+0000 7fa3f8d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:32.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.715+0000 7fa3f8d26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.716+0000 7fa3f8d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.716+0000 7fa3f8d26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.717+0000 7fa3f8d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:32.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.717+0000 7fa3f8d26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.717+0000 7fa3f8d26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:32.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.717+0000 7fa3f8d26800 20 searching for the correct realm 2024-09-12T17:46:32.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.720+0000 7fa3f4108640 0 -- 172.21.15.44:0/391624708 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55c4d0c5aae0 msgr2=0x55c4d0c5cf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:32.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.724+0000 7fa3f4909640 0 -- 172.21.15.44:0/391624708 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fa3e808f3f0 msgr2=0x7fa3e808f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:32.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.728+0000 7fa3f8d26800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:32.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.728+0000 7fa3f8d26800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:32.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.728+0000 7fa3f8d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:32.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.728+0000 7fa3f8d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:32.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.728+0000 7fa3f8d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:32.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.728+0000 7fa3f8d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:32.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.728+0000 7fa3f8d26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.728+0000 7fa3f8d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.728+0000 7fa3f8d26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.728+0000 7fa3f8d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:32.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.728+0000 7fa3f8d26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.729+0000 7fa3f8d26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:32.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.729+0000 7fa3f8d26800 20 zone default found 2024-09-12T17:46:32.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.729+0000 7fa3f8d26800 4 Realm: () 2024-09-12T17:46:32.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.729+0000 7fa3f8d26800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:32.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.729+0000 7fa3f8d26800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:32.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.729+0000 7fa3f8d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:32.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.729+0000 7fa3f8d26800 20 zonegroup default 2024-09-12T17:46:32.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.729+0000 7fa3f8d26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.729+0000 7fa3f8d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.729+0000 7fa3f8d26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.730+0000 7fa3f8d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.730+0000 7fa3f8d26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.730+0000 7fa3f8d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.730+0000 7fa3f8d26800 20 started sync module instance, tier type = 2024-09-12T17:46:32.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.730+0000 7fa3f8d26800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:32.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.739+0000 7fa3f8d26800 20 add_watcher() i=0 2024-09-12T17:46:32.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.739+0000 7fa3f8d26800 20 add_watcher() i=1 2024-09-12T17:46:32.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.739+0000 7fa3f8d26800 20 add_watcher() i=2 2024-09-12T17:46:32.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.739+0000 7fa3f8d26800 20 add_watcher() i=3 2024-09-12T17:46:32.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.739+0000 7fa3f8d26800 20 add_watcher() i=4 2024-09-12T17:46:32.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.739+0000 7fa3f8d26800 20 add_watcher() i=5 2024-09-12T17:46:32.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.739+0000 7fa3f8d26800 20 add_watcher() i=6 2024-09-12T17:46:32.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.740+0000 7fa3f8d26800 20 add_watcher() i=7 2024-09-12T17:46:32.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.740+0000 7fa3f8d26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:32.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.742+0000 7fa2aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:32.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.742+0000 7fa3f8d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:32.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.742+0000 7fa3f8d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:32.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.742+0000 7fa3f8d26800 5 note: GC not initialized 2024-09-12T17:46:32.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.742+0000 7fa2a9fe3640 20 reqs_thread_entry: start 2024-09-12T17:46:32.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.742+0000 7fa3f8d26800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:32.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.743+0000 7fa3f8d26800 20 Filter name: none 2024-09-12T17:46:32.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.743+0000 7fa21b7fe640 20 reqs_thread_entry: start 2024-09-12T17:46:32.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.743+0000 7fa3f8d26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.743+0000 7fa3f8d26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:46:32.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.743+0000 7fa3f8d26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.744+0000 7fa3f8d26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:46:32.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.744+0000 7fa3f8d26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:32.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.744+0000 7fa3f8d26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.744+0000 7fa3f8d26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:46:32.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.744+0000 7fa3f8d26800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.745+0000 7fa3f8d26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:46:32.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.745+0000 7fa3f8d26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:32.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.746+0000 7fa2aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:32.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.749+0000 7fa3f8d26800 20 remove_watcher() i=0 2024-09-12T17:46:32.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.749+0000 7fa3f8d26800 2 removed watcher, disabling cache 2024-09-12T17:46:32.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.750+0000 7fa3f8d26800 20 remove_watcher() i=1 2024-09-12T17:46:32.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.750+0000 7fa3f8d26800 20 remove_watcher() i=2 2024-09-12T17:46:32.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.751+0000 7fa3f8d26800 20 remove_watcher() i=3 2024-09-12T17:46:32.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.753+0000 7fa3f8d26800 20 remove_watcher() i=4 2024-09-12T17:46:32.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.754+0000 7fa3f8d26800 20 remove_watcher() i=5 2024-09-12T17:46:32.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.755+0000 7fa3f8d26800 20 remove_watcher() i=6 2024-09-12T17:46:32.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.756+0000 7fa3f8d26800 20 remove_watcher() i=7 2024-09-12T17:46:32.768 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:32.768 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:46:32.768 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: abort-at-change-reshard-state id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:46:32.768 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:32.844 INFO:tasks.workunit.client.0.smithi044.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T17:46:32.845 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:46:32.874 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:32.874 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:32.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.912+0000 7f53ead24800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.914+0000 7f53ead24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.915+0000 7f53ead24800 20 realm 2024-09-12T17:46:32.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.915+0000 7f53ead24800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.915+0000 7f53ead24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.915+0000 7f53ead24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:32.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.915+0000 7f53ead24800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.915+0000 7f53ead24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.915+0000 7f53ead24800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.916+0000 7f53ead24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:32.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.916+0000 7f53ead24800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.916+0000 7f53ead24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:32.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.916+0000 7f53ead24800 20 searching for the correct realm 2024-09-12T17:46:32.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.919+0000 7f53e61d1640 0 -- 172.21.15.44:0/1402256801 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x557cd326f680 msgr2=0x557cd3271a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:32.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.922+0000 7f53e69d2640 0 -- 172.21.15.44:0/1402256801 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f53dc08f110 msgr2=0x7f53dc08b200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:32.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.927+0000 7f53ead24800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:32.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.927+0000 7f53ead24800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:32.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.927+0000 7f53ead24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:32.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.927+0000 7f53ead24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:32.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.927+0000 7f53ead24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:32.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.927+0000 7f53ead24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:32.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.927+0000 7f53ead24800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.927+0000 7f53ead24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.927+0000 7f53ead24800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.928+0000 7f53ead24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:32.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.928+0000 7f53ead24800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.928+0000 7f53ead24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:32.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.928+0000 7f53ead24800 20 zone default found 2024-09-12T17:46:32.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.928+0000 7f53ead24800 4 Realm: () 2024-09-12T17:46:32.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.928+0000 7f53ead24800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:32.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.928+0000 7f53ead24800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:32.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.928+0000 7f53ead24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:32.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.928+0000 7f53ead24800 20 zonegroup default 2024-09-12T17:46:32.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.928+0000 7f53ead24800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.928+0000 7f53ead24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.928+0000 7f53ead24800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.929+0000 7f53ead24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.929+0000 7f53ead24800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.929+0000 7f53ead24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:32.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.929+0000 7f53ead24800 20 started sync module instance, tier type = 2024-09-12T17:46:32.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.929+0000 7f53ead24800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:32.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.938+0000 7f53ead24800 20 add_watcher() i=0 2024-09-12T17:46:32.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.938+0000 7f53ead24800 20 add_watcher() i=1 2024-09-12T17:46:32.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.938+0000 7f53ead24800 20 add_watcher() i=2 2024-09-12T17:46:32.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.938+0000 7f53ead24800 20 add_watcher() i=3 2024-09-12T17:46:32.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.938+0000 7f53ead24800 20 add_watcher() i=4 2024-09-12T17:46:32.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.938+0000 7f53ead24800 20 add_watcher() i=5 2024-09-12T17:46:32.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.938+0000 7f53ead24800 20 add_watcher() i=6 2024-09-12T17:46:32.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.939+0000 7f53ead24800 20 add_watcher() i=7 2024-09-12T17:46:32.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.939+0000 7f53ead24800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:32.941 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.941+0000 7f529d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:32.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.941+0000 7f53ead24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:32.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.941+0000 7f53ead24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:32.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.941+0000 7f53ead24800 5 note: GC not initialized 2024-09-12T17:46:32.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.941+0000 7f5217fff640 20 reqs_thread_entry: start 2024-09-12T17:46:32.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.941+0000 7f53ead24800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:32.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.942+0000 7f53ead24800 20 Filter name: none 2024-09-12T17:46:32.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.942+0000 7f5215ffb640 20 reqs_thread_entry: start 2024-09-12T17:46:32.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.942+0000 7f53ead24800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.942+0000 7f53ead24800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:32.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.942+0000 7f53ead24800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.943+0000 7f53ead24800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:46:32.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.943+0000 7f53ead24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:32.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.943+0000 7f53ead24800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.943+0000 7f53ead24800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:32.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.943+0000 7f53ead24800 20 rados->read ofs=0 len=0 2024-09-12T17:46:32.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.943+0000 7f53ead24800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:46:32.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.943+0000 7f53ead24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:32.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.945+0000 7f529d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:32.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.947+0000 7f53ead24800 20 remove_watcher() i=0 2024-09-12T17:46:32.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.947+0000 7f53ead24800 2 removed watcher, disabling cache 2024-09-12T17:46:32.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.948+0000 7f53ead24800 20 remove_watcher() i=1 2024-09-12T17:46:32.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.949+0000 7f53ead24800 20 remove_watcher() i=2 2024-09-12T17:46:32.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.950+0000 7f53ead24800 20 remove_watcher() i=3 2024-09-12T17:46:32.952 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.952+0000 7f53ead24800 20 remove_watcher() i=4 2024-09-12T17:46:32.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.954+0000 7f53ead24800 20 remove_watcher() i=5 2024-09-12T17:46:32.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.955+0000 7f53ead24800 20 remove_watcher() i=6 2024-09-12T17:46:32.957 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:32.957+0000 7f53ead24800 20 remove_watcher() i=7 2024-09-12T17:46:32.969 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:32.969 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:46:32.969 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: a-bucket id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T17:46:32.969 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:32.972 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:46:32.999 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:32.999 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:33.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.037+0000 7f8bc0526800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.039+0000 7f8bc0526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.039+0000 7f8bc0526800 20 realm 2024-09-12T17:46:33.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.039+0000 7f8bc0526800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.040+0000 7f8bc0526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.040+0000 7f8bc0526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:33.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.040+0000 7f8bc0526800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.040+0000 7f8bc0526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.040+0000 7f8bc0526800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.041+0000 7f8bc0526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:33.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.041+0000 7f8bc0526800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.041+0000 7f8bc0526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:33.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.041+0000 7f8bc0526800 20 searching for the correct realm 2024-09-12T17:46:33.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.046+0000 7f8bbb9d8640 0 -- 172.21.15.44:0/913170074 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f8bac03a040 msgr2=0x7f8bac074630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:33.053 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.052+0000 7f8bbc9da640 0 -- 172.21.15.44:0/913170074 >> [v2:172.21.15.181:6810/2228110208,v1:172.21.15.181:6811/2228110208] conn(0x7f8bb00be0c0 msgr2=0x7f8bb00be870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:33.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.055+0000 7f8bc0526800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:33.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.055+0000 7f8bc0526800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:33.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.055+0000 7f8bc0526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:33.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.055+0000 7f8bc0526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:33.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.055+0000 7f8bc0526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:33.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.055+0000 7f8bc0526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:33.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.055+0000 7f8bc0526800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.055+0000 7f8bc0526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.055+0000 7f8bc0526800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.056+0000 7f8bc0526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:33.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.056+0000 7f8bc0526800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.056+0000 7f8bc0526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:33.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.056+0000 7f8bc0526800 20 zone default found 2024-09-12T17:46:33.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.056+0000 7f8bc0526800 4 Realm: () 2024-09-12T17:46:33.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.056+0000 7f8bc0526800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:33.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.056+0000 7f8bc0526800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:33.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.056+0000 7f8bc0526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:33.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.056+0000 7f8bc0526800 20 zonegroup default 2024-09-12T17:46:33.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.056+0000 7f8bc0526800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.056+0000 7f8bc0526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.056+0000 7f8bc0526800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.057+0000 7f8bc0526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.057+0000 7f8bc0526800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.057+0000 7f8bc0526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.057+0000 7f8bc0526800 20 started sync module instance, tier type = 2024-09-12T17:46:33.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.057+0000 7f8bc0526800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:33.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.068+0000 7f8bc0526800 20 add_watcher() i=0 2024-09-12T17:46:33.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.068+0000 7f8bc0526800 20 add_watcher() i=1 2024-09-12T17:46:33.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.068+0000 7f8bc0526800 20 add_watcher() i=2 2024-09-12T17:46:33.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.068+0000 7f8bc0526800 20 add_watcher() i=3 2024-09-12T17:46:33.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.068+0000 7f8bc0526800 20 add_watcher() i=4 2024-09-12T17:46:33.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.068+0000 7f8bc0526800 20 add_watcher() i=5 2024-09-12T17:46:33.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.068+0000 7f8bc0526800 20 add_watcher() i=6 2024-09-12T17:46:33.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.069+0000 7f8bc0526800 20 add_watcher() i=7 2024-09-12T17:46:33.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.069+0000 7f8bc0526800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:33.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.071+0000 7f8a72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:33.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.071+0000 7f8bc0526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:33.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.071+0000 7f8bc0526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:33.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.071+0000 7f8bc0526800 5 note: GC not initialized 2024-09-12T17:46:33.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.071+0000 7f8a71fdb640 20 reqs_thread_entry: start 2024-09-12T17:46:33.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.071+0000 7f8bc0526800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:33.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.071+0000 7f8bc0526800 20 Filter name: none 2024-09-12T17:46:33.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.072+0000 7f89e37fe640 20 reqs_thread_entry: start 2024-09-12T17:46:33.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.072+0000 7f8bc0526800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.072+0000 7f8bc0526800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:33.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.072+0000 7f8bc0526800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.072+0000 7f8bc0526800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:46:33.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.072+0000 7f8bc0526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:33.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.072+0000 7f8bc0526800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.073+0000 7f8bc0526800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:33.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.073+0000 7f8bc0526800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.073+0000 7f8bc0526800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:46:33.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.073+0000 7f8bc0526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:33.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.075+0000 7f8a72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:33.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.078+0000 7f8bc0526800 20 remove_watcher() i=0 2024-09-12T17:46:33.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.078+0000 7f8bc0526800 2 removed watcher, disabling cache 2024-09-12T17:46:33.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.079+0000 7f8bc0526800 20 remove_watcher() i=1 2024-09-12T17:46:33.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.081+0000 7f8bc0526800 20 remove_watcher() i=2 2024-09-12T17:46:33.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.082+0000 7f8bc0526800 20 remove_watcher() i=3 2024-09-12T17:46:33.083 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.083+0000 7f8bc0526800 20 remove_watcher() i=4 2024-09-12T17:46:33.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.084+0000 7f8bc0526800 20 remove_watcher() i=5 2024-09-12T17:46:33.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.085+0000 7f8bc0526800 20 remove_watcher() i=6 2024-09-12T17:46:33.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.086+0000 7f8bc0526800 20 remove_watcher() i=7 2024-09-12T17:46:33.099 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T17:46:33.134 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:33.134 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:33.174 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.174+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.175+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.175+0000 7f6058546800 20 realm 2024-09-12T17:46:33.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.175+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.175+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.175+0000 7f6058546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:33.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.175+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.175+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.175+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.176+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:33.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.176+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.177+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:33.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.177+0000 7f6058546800 20 searching for the correct realm 2024-09-12T17:46:33.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.179+0000 7f6056037640 0 -- 172.21.15.44:0/2509361386 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7f605008fd60 msgr2=0x7f605004aaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:33.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.182+0000 7f6056838640 0 -- 172.21.15.44:0/2509361386 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f604c085420 msgr2=0x7f604c085820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:33.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:33.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:33.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:33.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:33.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:33.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:33.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.188+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.188+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.188+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.188+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:33.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.188+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.190 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.189+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:33.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.189+0000 7f6058546800 20 zone default found 2024-09-12T17:46:33.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.189+0000 7f6058546800 4 Realm: () 2024-09-12T17:46:33.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.189+0000 7f6058546800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:33.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.189+0000 7f6058546800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:33.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.189+0000 7f6058546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:33.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.189+0000 7f6058546800 20 zonegroup default 2024-09-12T17:46:33.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.189+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.189+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.189+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.189+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.189+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.189+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.189+0000 7f6058546800 20 started sync module instance, tier type = 2024-09-12T17:46:33.192 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.189+0000 7f6058546800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:33.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=0 2024-09-12T17:46:33.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=1 2024-09-12T17:46:33.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=2 2024-09-12T17:46:33.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=3 2024-09-12T17:46:33.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=4 2024-09-12T17:46:33.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=5 2024-09-12T17:46:33.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=6 2024-09-12T17:46:33.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.200+0000 7f6058546800 20 add_watcher() i=7 2024-09-12T17:46:33.200 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.200+0000 7f6058546800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:33.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.202+0000 7f5f0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:33.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.202+0000 7f6058546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:33.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.202+0000 7f6058546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:33.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.202+0000 7f6058546800 5 note: GC not initialized 2024-09-12T17:46:33.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.202+0000 7f5e877fe640 20 reqs_thread_entry: start 2024-09-12T17:46:33.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.202+0000 7f6058546800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:33.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.203+0000 7f6058546800 20 Filter name: none 2024-09-12T17:46:33.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.203+0000 7f5e857fa640 20 reqs_thread_entry: start 2024-09-12T17:46:33.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.203+0000 7f6058546800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:46:33.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.203+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.203+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:33.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.203+0000 7f6058546800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:46:33.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.203+0000 7f6058546800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:46:33.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.203+0000 7f6058546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:46:33.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.203+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.204+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:46:33.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.204+0000 7f6058546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:46:33.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.204+0000 7f6058546800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:46:33.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.204+0000 7f6058546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:33.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.204+0000 7f6058546800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:33.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.204+0000 7f6058546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:46:33.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.209+0000 7f6058546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:46:33.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.209+0000 7f6058546800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:46:33.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.209+0000 7f6058546800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:33.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.209+0000 7f6058546800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:46:33.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.209+0000 7f5f397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562462 cookie 94185681274512 notifier 8214 bl.length()=911 2024-09-12T17:46:33.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.209+0000 7f5f397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:46:33.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.209+0000 7f5f397fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:46:33.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.209+0000 7f5f397fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:33.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.210+0000 7f6058546800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:46:33.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.210+0000 7f6058546800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:46:33.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.210+0000 7f6058546800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:46:33.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.210+0000 7f6058546800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:46:33.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.0 2024-09-12T17:46:33.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.0 2024-09-12T17:46:33.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.1 2024-09-12T17:46:33.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.1 2024-09-12T17:46:33.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.2 2024-09-12T17:46:33.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.2 2024-09-12T17:46:33.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.3 2024-09-12T17:46:33.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.3 2024-09-12T17:46:33.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.4 2024-09-12T17:46:33.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.4 2024-09-12T17:46:33.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.5 2024-09-12T17:46:33.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.5 2024-09-12T17:46:33.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.6 2024-09-12T17:46:33.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.6 2024-09-12T17:46:33.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.7 2024-09-12T17:46:33.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.7 2024-09-12T17:46:33.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.8 2024-09-12T17:46:33.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.8 2024-09-12T17:46:33.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.9 2024-09-12T17:46:33.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.9 2024-09-12T17:46:33.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.10 2024-09-12T17:46:33.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.10 2024-09-12T17:46:33.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.11 2024-09-12T17:46:33.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.11 2024-09-12T17:46:33.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.12 2024-09-12T17:46:33.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.12 2024-09-12T17:46:33.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.13 2024-09-12T17:46:33.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.13 2024-09-12T17:46:33.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:46:33.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:46:33.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.216+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:46:33.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.216+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:46:33.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.216+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:46:33.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.216+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:46:33.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.217+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:46:33.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.217+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:46:33.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.217+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:46:33.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.217+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:46:33.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.218+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:46:33.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.218+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:46:33.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.219+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:46:33.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.219+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:46:33.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.219+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:46:33.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.219+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:46:33.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.220+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:46:33.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.220+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:46:33.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.220+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:46:33.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.220+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:46:33.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.221+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:46:33.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.221+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:46:33.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.221+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:46:33.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.221+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:46:33.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.222+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:46:33.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.222+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:46:33.227 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6058546800 time 2024-09-12T17:46:33.227085+0000 2024-09-12T17:46:33.227 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:46:33.227 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:33.228 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f605bb8c71a] 2024-09-12T17:46:33.228 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f605bb8c8d8] 2024-09-12T17:46:33.228 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a94decf841] 2024-09-12T17:46:33.228 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55a94dede734] 2024-09-12T17:46:33.228 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a94dedf5d4] 2024-09-12T17:46:33.228 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:46:33.228 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f605a829590] 2024-09-12T17:46:33.228 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:46:33.228 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:46:33.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.227+0000 7f6058546800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6058546800 time 2024-09-12T17:46:33.227085+0000 2024-09-12T17:46:33.229 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:46:33.229 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.229 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:33.229 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f605bb8c71a] 2024-09-12T17:46:33.229 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f605bb8c8d8] 2024-09-12T17:46:33.229 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a94decf841] 2024-09-12T17:46:33.229 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55a94dede734] 2024-09-12T17:46:33.229 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a94dedf5d4] 2024-09-12T17:46:33.230 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:46:33.230 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f605a829590] 2024-09-12T17:46:33.230 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:46:33.230 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:46:33.230 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.230 INFO:tasks.workunit.client.0.smithi044.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:46:33.230 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f6058546800 thread_name:radosgw-admin 2024-09-12T17:46:33.244 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:33.244 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f605a83e6f0] 2024-09-12T17:46:33.244 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f605a88b99c] 2024-09-12T17:46:33.244 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:46:33.244 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:46:33.244 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f605bb8c774] 2024-09-12T17:46:33.244 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f605bb8c8d8] 2024-09-12T17:46:33.244 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a94decf841] 2024-09-12T17:46:33.245 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55a94dede734] 2024-09-12T17:46:33.245 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a94dedf5d4] 2024-09-12T17:46:33.245 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:46:33.245 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f605a829590] 2024-09-12T17:46:33.245 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:46:33.245 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:46:33.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.228+0000 7f6058546800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:46:33.245 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f6058546800 thread_name:radosgw-admin 2024-09-12T17:46:33.245 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.245 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:33.245 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f605a83e6f0] 2024-09-12T17:46:33.245 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f605a88b99c] 2024-09-12T17:46:33.245 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:46:33.246 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:46:33.246 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f605bb8c774] 2024-09-12T17:46:33.246 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f605bb8c8d8] 2024-09-12T17:46:33.246 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a94decf841] 2024-09-12T17:46:33.246 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55a94dede734] 2024-09-12T17:46:33.246 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a94dedf5d4] 2024-09-12T17:46:33.246 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:46:33.246 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f605a829590] 2024-09-12T17:46:33.246 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:46:33.246 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:46:33.246 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:46:33.246 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.247 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:46:33.247 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:46:33.157+0000 7f5f44608640 4 set_mon_vals no callback set 2024-09-12T17:46:33.247 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:46:33.158+0000 7f6058546800 10 monclient: _renew_subs 2024-09-12T17:46:33.247 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:46:33.158+0000 7f6058546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:46:33.247 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:46:33.158+0000 7f6058546800 1 librados: init done 2024-09-12T17:46:33.247 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:46:33.159+0000 7f5f42e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:33.247 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:46:33.159+0000 7f5f42e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:33.247 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:46:33.159+0000 7f5f42e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:33.247 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:46:33.160+0000 7f6055836640 10 monclient: get_auth_request con 0x7f5f3c076470 auth_method 0 2024-09-12T17:46:33.247 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:46:33.160+0000 7f6056838640 10 monclient: get_auth_request con 0x55a950085040 auth_method 0 2024-09-12T17:46:33.247 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:46:33.161+0000 7f6056037640 10 monclient: get_auth_request con 0x55a950088220 auth_method 0 2024-09-12T17:46:33.247 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:46:33.162+0000 7f6055836640 10 monclient: get_auth_request con 0x55a95008bad0 auth_method 0 2024-09-12T17:46:33.247 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:46:33.163+0000 7f6058546800 10 monclient: build_initial_monmap 2024-09-12T17:46:33.248 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:46:33.163+0000 7f6058546800 1 build_initial for_mkfs: 0 2024-09-12T17:46:33.248 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:46:33.163+0000 7f6058546800 10 monclient: monmap: 2024-09-12T17:46:33.248 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:46:33.248 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:33.248 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:46:33.248 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:46:33.248 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:33.248 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.248 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:46:33.248 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:46:33.248 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:46:33.248 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.248 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding auth protocol: cephx 2024-09-12T17:46:33.248 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding auth protocol: cephx 2024-09-12T17:46:33.249 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding auth protocol: cephx 2024-09-12T17:46:33.249 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: secure 2024-09-12T17:46:33.249 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: crc 2024-09-12T17:46:33.249 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: secure 2024-09-12T17:46:33.249 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: crc 2024-09-12T17:46:33.249 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: secure 2024-09-12T17:46:33.249 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: crc 2024-09-12T17:46:33.249 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: crc 2024-09-12T17:46:33.249 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: secure 2024-09-12T17:46:33.249 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: crc 2024-09-12T17:46:33.249 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: secure 2024-09-12T17:46:33.249 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: crc 2024-09-12T17:46:33.249 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: secure 2024-09-12T17:46:33.250 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:46:33.164+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.250 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:46:33.164+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command objecter_requests cmddesc objecter_requests hook 0x55a950094dd0 EEXIST 2024-09-12T17:46:33.250 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient: init 2024-09-12T17:46:33.250 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding auth protocol: cephx 2024-09-12T17:46:33.250 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding auth protocol: cephx 2024-09-12T17:46:33.250 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding auth protocol: cephx 2024-09-12T17:46:33.250 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: secure 2024-09-12T17:46:33.250 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: crc 2024-09-12T17:46:33.250 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: secure 2024-09-12T17:46:33.250 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: crc 2024-09-12T17:46:33.251 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: secure 2024-09-12T17:46:33.251 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: crc 2024-09-12T17:46:33.251 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: crc 2024-09-12T17:46:33.251 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: secure 2024-09-12T17:46:33.251 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: crc 2024-09-12T17:46:33.251 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: secure 2024-09-12T17:46:33.251 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: crc 2024-09-12T17:46:33.251 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: secure 2024-09-12T17:46:33.251 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:46:33.164+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.251 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:46:33.164+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.251 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:46:33.164+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command rotate-key cmddesc rotate-key hook 0x55a9500904d0 EEXIST 2024-09-12T17:46:33.251 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:33.251 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:46:33.252 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient(hunting): picked mon.noname-b con 0x55a9500b8ac0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:46:33.252 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient(hunting): picked mon.noname-c con 0x55a9500bad90 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:46:33.252 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient(hunting): picked mon.noname-a con 0x55a9500b7290 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:33.252 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.252 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.252 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.252 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:33.252 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient(hunting): authenticate will time out at 2165.800803s 2024-09-12T17:46:33.252 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:46:33.164+0000 7f6055836640 10 monclient(hunting): get_auth_request con 0x55a9500bad90 auth_method 0 2024-09-12T17:46:33.252 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:46:33.164+0000 7f6055836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.252 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:46:33.164+0000 7f6055836640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.252 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:46:33.164+0000 7f6055836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.252 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:46:33.164+0000 7f6056838640 10 monclient(hunting): get_auth_request con 0x55a9500b7290 auth_method 0 2024-09-12T17:46:33.253 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:46:33.164+0000 7f6056838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.253 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:46:33.164+0000 7f6056838640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.253 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:46:33.164+0000 7f6056838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.253 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:46:33.164+0000 7f6056037640 10 monclient(hunting): get_auth_request con 0x55a9500b8ac0 auth_method 0 2024-09-12T17:46:33.253 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:46:33.164+0000 7f6056037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.253 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:46:33.164+0000 7f6056037640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.253 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:46:33.164+0000 7f6056037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.253 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:46:33.165+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.253 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:46:33.165+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.253 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:46:33.165+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:33.253 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:46:33.165+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.253 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:46:33.165+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.253 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:46:33.165+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:33.254 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:46:33.165+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.254 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:46:33.165+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.254 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:46:33.165+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:33.254 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:46:33.165+0000 7f6056838640 10 monclient(hunting): handle_auth_done global_id 8208 payload 824 2024-09-12T17:46:33.254 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:46:33.165+0000 7f6056838640 10 monclient: _finish_hunting 0 2024-09-12T17:46:33.254 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:46:33.165+0000 7f6056838640 1 monclient: found mon.noname-a 2024-09-12T17:46:33.254 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:46:33.165+0000 7f6056838640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.254 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:33.254 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:46:33.254 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: dump: 2024-09-12T17:46:33.254 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:33.254 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:33.254 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.254 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.255 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:33.255 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.255 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:33.255 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:33.255 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:33.255 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.255 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: _finish_auth 0 2024-09-12T17:46:33.255 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:46:33.255 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:33.255 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:33.255 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:46:33.255 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: dump: 2024-09-12T17:46:33.255 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:33.255 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:33.256 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.256 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.256 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:33.256 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.256 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:33.256 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:33.256 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:33.256 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.256 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:46:33.165+0000 7f6058546800 5 monclient: authenticate success, global_id 8208 2024-09-12T17:46:33.256 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:46:33.165+0000 7f6058546800 10 monclient: _renew_subs 2024-09-12T17:46:33.256 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:46:33.165+0000 7f6057039640 4 set_mon_vals no callback set 2024-09-12T17:46:33.256 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:46:33.165+0000 7f6058546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.256 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:46:33.165+0000 7f6058546800 10 monclient: _renew_subs 2024-09-12T17:46:33.257 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:46:33.165+0000 7f6058546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.257 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:46:33.167+0000 7f5f3bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:33.257 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:46:33.167+0000 7f5f3bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:33.257 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:46:33.167+0000 7f5f3bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:33.257 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:46:33.167+0000 7f6056037640 10 monclient: get_auth_request con 0x7f5f30076380 auth_method 0 2024-09-12T17:46:33.257 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:46:33.167+0000 7f6058546800 10 monclient: get_monmap_and_config 2024-09-12T17:46:33.257 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:46:33.167+0000 7f6058546800 10 monclient: build_initial_monmap 2024-09-12T17:46:33.257 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:46:33.167+0000 7f6058546800 1 build_initial for_mkfs: 0 2024-09-12T17:46:33.257 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:46:33.167+0000 7f6058546800 10 monclient: monmap: 2024-09-12T17:46:33.257 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:46:33.257 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:33.257 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:46:33.257 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:46:33.257 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:33.258 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.258 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:46:33.258 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:46:33.258 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:46:33.258 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.258 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding auth protocol: cephx 2024-09-12T17:46:33.258 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding auth protocol: cephx 2024-09-12T17:46:33.258 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding auth protocol: cephx 2024-09-12T17:46:33.258 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: secure 2024-09-12T17:46:33.258 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: crc 2024-09-12T17:46:33.258 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: secure 2024-09-12T17:46:33.258 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: crc 2024-09-12T17:46:33.258 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: secure 2024-09-12T17:46:33.259 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: crc 2024-09-12T17:46:33.259 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: crc 2024-09-12T17:46:33.259 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: secure 2024-09-12T17:46:33.259 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: crc 2024-09-12T17:46:33.259 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: secure 2024-09-12T17:46:33.259 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: crc 2024-09-12T17:46:33.259 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: secure 2024-09-12T17:46:33.259 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:46:33.168+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.259 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient: init 2024-09-12T17:46:33.259 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding auth protocol: cephx 2024-09-12T17:46:33.259 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding auth protocol: cephx 2024-09-12T17:46:33.259 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding auth protocol: cephx 2024-09-12T17:46:33.259 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: secure 2024-09-12T17:46:33.259 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: crc 2024-09-12T17:46:33.260 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: secure 2024-09-12T17:46:33.260 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: crc 2024-09-12T17:46:33.260 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: secure 2024-09-12T17:46:33.260 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: crc 2024-09-12T17:46:33.260 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: crc 2024-09-12T17:46:33.260 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: secure 2024-09-12T17:46:33.260 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: crc 2024-09-12T17:46:33.260 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: secure 2024-09-12T17:46:33.260 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: crc 2024-09-12T17:46:33.260 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: secure 2024-09-12T17:46:33.260 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:46:33.168+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.260 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:46:33.168+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.260 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:46:33.168+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command rotate-key cmddesc rotate-key hook 0x7ffdf8f46d48 EEXIST 2024-09-12T17:46:33.261 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:33.261 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:46:33.261 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient(hunting): picked mon.noname-b con 0x55a95010ccc0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:46:33.261 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient(hunting): picked mon.noname-a con 0x55a9500dc820 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:33.261 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient(hunting): picked mon.noname-c con 0x55a9500d9750 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:46:33.261 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.261 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.261 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.261 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:33.261 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient(hunting): authenticate will time out at 2165.804844s 2024-09-12T17:46:33.261 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:46:33.168+0000 7f6055836640 10 monclient(hunting): get_auth_request con 0x55a9500dc820 auth_method 0 2024-09-12T17:46:33.261 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:46:33.168+0000 7f6055836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.261 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:46:33.168+0000 7f6055836640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.262 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:46:33.168+0000 7f6055836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.262 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:46:33.168+0000 7f6056838640 10 monclient(hunting): get_auth_request con 0x55a9500d9750 auth_method 0 2024-09-12T17:46:33.262 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:46:33.168+0000 7f6056838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.262 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:46:33.168+0000 7f6056838640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.262 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:46:33.168+0000 7f6056838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.262 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:46:33.168+0000 7f6056037640 10 monclient(hunting): get_auth_request con 0x55a95010ccc0 auth_method 0 2024-09-12T17:46:33.262 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.262 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.262 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.262 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.262 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.262 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:33.262 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.262 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.263 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:33.263 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.263 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.263 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:33.263 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): handle_auth_done global_id 8211 payload 274 2024-09-12T17:46:33.263 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient: _finish_hunting 0 2024-09-12T17:46:33.263 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:46:33.169+0000 7f6055836640 1 monclient: found mon.noname-a 2024-09-12T17:46:33.263 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.263 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient: ms_handle_reset current mon [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:33.263 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient: _reopen_session rank -1 2024-09-12T17:46:33.263 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:46:33.263 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient(hunting): picked mon.noname-c con 0x55a9500d9750 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:46:33.264 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f5f20004560 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:33.264 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient(hunting): picked mon.noname-b con 0x55a95010ccc0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:46:33.264 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.264 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.264 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.264 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient(hunting): _renew_subs 2024-09-12T17:46:33.264 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient(hunting): ms_handle_reset hunted mon [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:33.264 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): get_auth_request con 0x7f5f20004560 auth_method 0 2024-09-12T17:46:33.264 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.264 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.264 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:46:33.264 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): get_auth_request con 0x55a9500d9750 auth_method 0 2024-09-12T17:46:33.265 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.265 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.265 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:46:33.265 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): get_auth_request con 0x55a95010ccc0 auth_method 0 2024-09-12T17:46:33.265 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.265 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.265 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:46:33.265 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.265 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.265 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:46:33.265 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.265 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.265 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:46:33.265 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.266 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.266 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:46:33.266 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): handle_auth_done global_id 8211 payload 293 2024-09-12T17:46:33.266 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient: _finish_hunting 0 2024-09-12T17:46:33.266 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:46:33.169+0000 7f6055836640 1 monclient: found mon.noname-a 2024-09-12T17:46:33.266 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.266 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:33.266 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:46:33.266 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: dump: 2024-09-12T17:46:33.266 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:33.266 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:33.266 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.266 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.267 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:33.267 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.267 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:33.267 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:33.267 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:33.267 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.267 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: _finish_auth 0 2024-09-12T17:46:33.267 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:46:33.267 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:33.267 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:33.267 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:46:33.267 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: dump: 2024-09-12T17:46:33.267 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:33.268 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:33.268 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.268 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.268 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:33.268 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.268 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:33.268 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:33.268 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:33.268 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.268 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:46:33.170+0000 7f6058546800 5 monclient: authenticate success, global_id 8211 2024-09-12T17:46:33.268 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:46:33.170+0000 7f6058546800 10 monclient: get_monmap_and_config success 2024-09-12T17:46:33.268 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:46:33.170+0000 7f6058546800 4 set_mon_vals no callback set 2024-09-12T17:46:33.268 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:46:33.170+0000 7f6058546800 10 monclient: shutdown 2024-09-12T17:46:33.269 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:46:33.170+0000 7f6058546800 10 monclient: build_initial_monmap 2024-09-12T17:46:33.269 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:46:33.170+0000 7f6058546800 1 build_initial for_mkfs: 0 2024-09-12T17:46:33.269 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:46:33.170+0000 7f6058546800 10 monclient: monmap: 2024-09-12T17:46:33.269 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:46:33.269 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:33.269 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:46:33.269 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:46:33.269 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:33.269 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.269 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:46:33.269 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:46:33.269 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:46:33.269 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.270 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding auth protocol: cephx 2024-09-12T17:46:33.270 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding auth protocol: cephx 2024-09-12T17:46:33.270 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding auth protocol: cephx 2024-09-12T17:46:33.270 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: secure 2024-09-12T17:46:33.270 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: crc 2024-09-12T17:46:33.270 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: secure 2024-09-12T17:46:33.270 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: crc 2024-09-12T17:46:33.270 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: secure 2024-09-12T17:46:33.270 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: crc 2024-09-12T17:46:33.270 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: crc 2024-09-12T17:46:33.270 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: secure 2024-09-12T17:46:33.270 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: crc 2024-09-12T17:46:33.270 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: secure 2024-09-12T17:46:33.270 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: crc 2024-09-12T17:46:33.271 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: secure 2024-09-12T17:46:33.271 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:46:33.171+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.271 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:46:33.171+0000 7f6058546800 1 librados: starting msgr at 2024-09-12T17:46:33.271 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:46:33.171+0000 7f6058546800 1 librados: starting objecter 2024-09-12T17:46:33.271 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:46:33.171+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command objecter_requests cmddesc objecter_requests hook 0x55a9500bacc0 EEXIST 2024-09-12T17:46:33.271 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:46:33.171+0000 7f6058546800 1 librados: setting wanted keys 2024-09-12T17:46:33.271 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:46:33.171+0000 7f6058546800 1 librados: calling monclient init 2024-09-12T17:46:33.271 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient: init 2024-09-12T17:46:33.271 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding auth protocol: cephx 2024-09-12T17:46:33.271 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding auth protocol: cephx 2024-09-12T17:46:33.271 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding auth protocol: cephx 2024-09-12T17:46:33.271 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: secure 2024-09-12T17:46:33.271 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: crc 2024-09-12T17:46:33.272 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: secure 2024-09-12T17:46:33.272 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: crc 2024-09-12T17:46:33.272 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: secure 2024-09-12T17:46:33.272 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: crc 2024-09-12T17:46:33.272 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: crc 2024-09-12T17:46:33.272 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: secure 2024-09-12T17:46:33.272 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: crc 2024-09-12T17:46:33.272 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: secure 2024-09-12T17:46:33.272 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: crc 2024-09-12T17:46:33.272 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: secure 2024-09-12T17:46:33.272 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:46:33.171+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.272 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:46:33.171+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.273 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:46:33.171+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command rotate-key cmddesc rotate-key hook 0x55a9500d09b8 EEXIST 2024-09-12T17:46:33.273 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:33.273 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:46:33.273 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient(hunting): picked mon.noname-b con 0x55a9500d9750 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:46:33.273 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient(hunting): picked mon.noname-c con 0x55a95010ccc0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:46:33.273 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient(hunting): picked mon.noname-a con 0x7f5f20004560 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:33.273 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.273 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.273 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.273 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:33.273 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient(hunting): authenticate will time out at 2165.807880s 2024-09-12T17:46:33.273 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient(hunting): get_auth_request con 0x7f5f20004560 auth_method 0 2024-09-12T17:46:33.273 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.274 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.274 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.274 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:46:33.172+0000 7f6055836640 10 monclient(hunting): get_auth_request con 0x55a95010ccc0 auth_method 0 2024-09-12T17:46:33.274 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:46:33.172+0000 7f6055836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.274 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:46:33.172+0000 7f6055836640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.274 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:46:33.172+0000 7f6055836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.274 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.274 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.274 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:33.274 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:46:33.172+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.274 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:46:33.172+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.274 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:46:33.172+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:33.275 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:46:33.172+0000 7f6056037640 10 monclient(hunting): get_auth_request con 0x55a9500d9750 auth_method 0 2024-09-12T17:46:33.275 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:46:33.172+0000 7f6056037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.275 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:46:33.172+0000 7f6056037640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.275 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:46:33.172+0000 7f6056037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.275 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient(hunting): handle_auth_done global_id 8214 payload 824 2024-09-12T17:46:33.275 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient: _finish_hunting 0 2024-09-12T17:46:33.275 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:46:33.172+0000 7f6056838640 1 monclient: found mon.noname-a 2024-09-12T17:46:33.275 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.275 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:33.275 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:46:33.275 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: dump: 2024-09-12T17:46:33.275 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:33.275 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:33.276 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.276 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.276 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:33.276 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.276 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:33.276 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:33.276 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:33.276 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.276 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: _finish_auth 0 2024-09-12T17:46:33.276 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: _check_auth_tickets 2024-09-12T17:46:33.276 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:33.276 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:33.277 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:46:33.277 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: dump: 2024-09-12T17:46:33.277 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:33.277 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:33.277 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.277 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.277 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:33.277 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.277 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:33.277 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:33.277 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:33.277 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.278 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:46:33.172+0000 7f6058546800 5 monclient: authenticate success, global_id 8214 2024-09-12T17:46:33.278 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:46:33.172+0000 7f6058546800 10 monclient: _renew_subs 2024-09-12T17:46:33.278 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:46:33.172+0000 7f6058546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.278 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:46:33.172+0000 7f5f39ffb640 4 set_mon_vals no callback set 2024-09-12T17:46:33.278 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:46:33.172+0000 7f6058546800 10 monclient: _renew_subs 2024-09-12T17:46:33.278 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:46:33.172+0000 7f6058546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.278 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:46:33.172+0000 7f6058546800 1 librados: init done 2024-09-12T17:46:33.278 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:46:33.172+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command cr dump hook 0x55a950103958 2024-09-12T17:46:33.278 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:46:33.174+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.278 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:46:33.174+0000 7f5f27fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:33.278 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:46:33.174+0000 7f5f27fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:33.278 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:46:33.174+0000 7f5f27fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:33.278 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:46:33.174+0000 7f6056037640 10 monclient: get_auth_request con 0x7f5f20077280 auth_method 0 2024-09-12T17:46:33.279 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:46:33.174+0000 7f6055836640 10 monclient: get_auth_request con 0x55a950127060 auth_method 0 2024-09-12T17:46:33.279 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:46:33.175+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.279 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:46:33.175+0000 7f6058546800 20 realm 2024-09-12T17:46:33.279 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:46:33.175+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.279 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:46:33.175+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.279 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:46:33.175+0000 7f6058546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:33.279 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:46:33.175+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.279 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:46:33.175+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.279 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:46:33.175+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.279 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:46:33.176+0000 7f6056037640 10 monclient: get_auth_request con 0x55a95012b2d0 auth_method 0 2024-09-12T17:46:33.279 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:46:33.176+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:33.279 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:46:33.176+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.279 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:46:33.177+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:33.279 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:46:33.177+0000 7f6058546800 20 searching for the correct realm 2024-09-12T17:46:33.280 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:46:33.177+0000 7f6055836640 10 monclient: get_auth_request con 0x55a950130570 auth_method 0 2024-09-12T17:46:33.280 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:46:33.177+0000 7f6056838640 10 monclient: get_auth_request con 0x7f604c085420 auth_method 0 2024-09-12T17:46:33.280 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:46:33.178+0000 7f6056037640 10 monclient: get_auth_request con 0x7f605008fd60 auth_method 0 2024-09-12T17:46:33.280 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:46:33.179+0000 7f6056037640 0 -- 172.21.15.44:0/2509361386 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7f605008fd60 msgr2=0x7f605004aaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:33.280 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:46:33.179+0000 7f5f27fff640 1 client.8214.objecter ms_handle_reset 0x7f605008fd60 session 0x7f6050029200 osd.2 2024-09-12T17:46:33.280 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:46:33.179+0000 7f5f27fff640 10 monclient: _renew_subs 2024-09-12T17:46:33.280 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:46:33.179+0000 7f5f27fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.280 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:46:33.179+0000 7f6056037640 10 monclient: get_auth_request con 0x7f5f200870a0 auth_method 0 2024-09-12T17:46:33.280 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:46:33.179+0000 7f6055836640 10 monclient: get_auth_request con 0x7f6048061190 auth_method 0 2024-09-12T17:46:33.280 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:46:33.181+0000 7f6056838640 10 monclient: get_auth_request con 0x7f604c07b950 auth_method 0 2024-09-12T17:46:33.280 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:46:33.182+0000 7f6056838640 0 -- 172.21.15.44:0/2509361386 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f604c085420 msgr2=0x7f604c085820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:33.280 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:46:33.182+0000 7f5f27fff640 1 client.8214.objecter ms_handle_reset 0x7f604c085420 session 0x7f604c075040 osd.7 2024-09-12T17:46:33.281 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:46:33.183+0000 7f6056838640 10 monclient: get_auth_request con 0x7f605008fd60 auth_method 0 2024-09-12T17:46:33.281 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:46:33.183+0000 7f6056037640 10 monclient: get_auth_request con 0x7f604c092940 auth_method 0 2024-09-12T17:46:33.281 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:33.281 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:33.281 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:33.281 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:33.281 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:33.281 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:33.281 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:46:33.188+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.281 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:46:33.188+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.281 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:46:33.188+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.281 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:46:33.188+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:33.281 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:46:33.188+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.282 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:46:33.189+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:33.282 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:46:33.189+0000 7f6058546800 20 zone default found 2024-09-12T17:46:33.282 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:46:33.189+0000 7f6058546800 4 Realm: () 2024-09-12T17:46:33.282 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:46:33.189+0000 7f6058546800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:33.282 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:46:33.189+0000 7f6058546800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:33.282 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:46:33.189+0000 7f6058546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:33.282 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:46:33.189+0000 7f6058546800 20 zonegroup default 2024-09-12T17:46:33.282 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:46:33.189+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.282 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:46:33.189+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.282 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:46:33.189+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.282 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:46:33.189+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.282 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:46:33.189+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.282 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:46:33.189+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.283 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:46:33.189+0000 7f6058546800 20 started sync module instance, tier type = 2024-09-12T17:46:33.283 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:46:33.189+0000 7f6058546800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:33.283 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=0 2024-09-12T17:46:33.283 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=1 2024-09-12T17:46:33.283 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=2 2024-09-12T17:46:33.283 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=3 2024-09-12T17:46:33.283 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=4 2024-09-12T17:46:33.283 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=5 2024-09-12T17:46:33.283 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=6 2024-09-12T17:46:33.283 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:46:33.200+0000 7f6058546800 20 add_watcher() i=7 2024-09-12T17:46:33.283 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:46:33.200+0000 7f6058546800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:33.283 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding auth protocol: cephx 2024-09-12T17:46:33.283 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding auth protocol: cephx 2024-09-12T17:46:33.284 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding auth protocol: cephx 2024-09-12T17:46:33.284 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: secure 2024-09-12T17:46:33.284 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: crc 2024-09-12T17:46:33.284 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: secure 2024-09-12T17:46:33.284 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: crc 2024-09-12T17:46:33.284 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: secure 2024-09-12T17:46:33.284 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: crc 2024-09-12T17:46:33.284 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: crc 2024-09-12T17:46:33.284 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: secure 2024-09-12T17:46:33.284 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: crc 2024-09-12T17:46:33.284 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: secure 2024-09-12T17:46:33.284 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: crc 2024-09-12T17:46:33.284 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:46:33.202+0000 7f5f0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:33.285 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: secure 2024-09-12T17:46:33.285 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:46:33.202+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.285 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:46:33.202+0000 7f6058546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:33.285 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:46:33.202+0000 7f6058546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:33.285 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:46:33.202+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command cache list hook 0x55a950102610 2024-09-12T17:46:33.285 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:46:33.202+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command cache inspect hook 0x55a950102610 2024-09-12T17:46:33.285 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:46:33.202+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command cache erase hook 0x55a950102610 2024-09-12T17:46:33.285 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:46:33.202+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command cache zap hook 0x55a950102610 2024-09-12T17:46:33.285 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:46:33.202+0000 7f6058546800 5 note: GC not initialized 2024-09-12T17:46:33.285 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:46:33.202+0000 7f5e877fe640 20 reqs_thread_entry: start 2024-09-12T17:46:33.285 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:46:33.202+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command sync trace show hook 0x7f5f20007090 2024-09-12T17:46:33.285 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:46:33.202+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command sync trace history hook 0x7f5f20007090 2024-09-12T17:46:33.285 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:46:33.202+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command sync trace active hook 0x7f5f20007090 2024-09-12T17:46:33.286 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:46:33.202+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command sync trace active_short hook 0x7f5f20007090 2024-09-12T17:46:33.286 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:46:33.202+0000 7f6058546800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:33.286 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:46:33.203+0000 7f6058546800 20 Filter name: none 2024-09-12T17:46:33.286 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:46:33.203+0000 7f5e857fa640 20 reqs_thread_entry: start 2024-09-12T17:46:33.286 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:46:33.203+0000 7f6058546800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:46:33.286 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:46:33.203+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.286 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:46:33.203+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:33.286 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:46:33.203+0000 7f6058546800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:46:33.286 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:46:33.203+0000 7f6058546800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:46:33.286 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:46:33.203+0000 7f6058546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:46:33.286 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:46:33.203+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.286 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:46:33.204+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:46:33.287 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:46:33.204+0000 7f6058546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:46:33.287 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:46:33.204+0000 7f6058546800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:46:33.287 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:46:33.204+0000 7f6058546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:33.287 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:46:33.204+0000 7f6058546800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:33.287 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:46:33.204+0000 7f6058546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:46:33.287 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:46:33.209+0000 7f6058546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:46:33.287 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:46:33.209+0000 7f6058546800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:46:33.287 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:46:33.209+0000 7f6058546800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:33.287 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:46:33.209+0000 7f6058546800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:46:33.287 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:46:33.209+0000 7f5f397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562462 cookie 94185681274512 notifier 8214 bl.length()=911 2024-09-12T17:46:33.287 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:46:33.209+0000 7f5f397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:46:33.287 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:46:33.209+0000 7f5f397fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:46:33.287 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:46:33.209+0000 7f5f397fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:33.288 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:46:33.210+0000 7f6058546800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:46:33.288 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:46:33.210+0000 7f6058546800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:46:33.288 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:46:33.210+0000 7f6058546800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:46:33.288 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:46:33.210+0000 7f6058546800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:46:33.288 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.0 2024-09-12T17:46:33.288 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.0 2024-09-12T17:46:33.288 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.1 2024-09-12T17:46:33.288 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.1 2024-09-12T17:46:33.288 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.2 2024-09-12T17:46:33.288 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.2 2024-09-12T17:46:33.288 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.3 2024-09-12T17:46:33.289 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.3 2024-09-12T17:46:33.289 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.4 2024-09-12T17:46:33.289 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.4 2024-09-12T17:46:33.289 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.5 2024-09-12T17:46:33.289 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.5 2024-09-12T17:46:33.289 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.6 2024-09-12T17:46:33.289 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.6 2024-09-12T17:46:33.289 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.7 2024-09-12T17:46:33.289 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.7 2024-09-12T17:46:33.289 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.8 2024-09-12T17:46:33.289 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.8 2024-09-12T17:46:33.289 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.9 2024-09-12T17:46:33.289 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.9 2024-09-12T17:46:33.289 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.10 2024-09-12T17:46:33.290 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.10 2024-09-12T17:46:33.290 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.11 2024-09-12T17:46:33.290 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.11 2024-09-12T17:46:33.290 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.12 2024-09-12T17:46:33.290 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.12 2024-09-12T17:46:33.290 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.13 2024-09-12T17:46:33.290 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.13 2024-09-12T17:46:33.290 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:46:33.290 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:46:33.290 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:46:33.216+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:46:33.290 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:46:33.216+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:46:33.290 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:46:33.216+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:46:33.290 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:46:33.216+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:46:33.291 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:46:33.217+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:46:33.291 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:46:33.217+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:46:33.291 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:46:33.217+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:46:33.291 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:46:33.217+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:46:33.291 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:46:33.218+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:46:33.291 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:46:33.218+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:46:33.291 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:46:33.219+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:46:33.291 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:46:33.219+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:46:33.291 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:46:33.219+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:46:33.291 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:46:33.219+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:46:33.291 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:46:33.220+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:46:33.291 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:46:33.220+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:46:33.291 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:46:33.220+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:46:33.291 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:46:33.220+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:46:33.292 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:46:33.221+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:46:33.292 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:46:33.221+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:46:33.292 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:46:33.221+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:46:33.292 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:46:33.221+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:46:33.292 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:46:33.222+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:46:33.292 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:46:33.222+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:46:33.292 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:46:33.227+0000 7f6058546800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6058546800 time 2024-09-12T17:46:33.227085+0000 2024-09-12T17:46:33.292 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:46:33.292 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.292 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:33.292 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f605bb8c71a] 2024-09-12T17:46:33.292 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f605bb8c8d8] 2024-09-12T17:46:33.292 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a94decf841] 2024-09-12T17:46:33.293 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55a94dede734] 2024-09-12T17:46:33.293 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a94dedf5d4] 2024-09-12T17:46:33.293 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:46:33.293 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f605a829590] 2024-09-12T17:46:33.293 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:46:33.293 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:46:33.293 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.293 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:46:33.228+0000 7f6058546800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:46:33.293 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f6058546800 thread_name:radosgw-admin 2024-09-12T17:46:33.294 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.294 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:33.294 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f605a83e6f0] 2024-09-12T17:46:33.294 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f605a88b99c] 2024-09-12T17:46:33.294 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:46:33.294 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:46:33.294 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f605bb8c774] 2024-09-12T17:46:33.294 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f605bb8c8d8] 2024-09-12T17:46:33.294 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a94decf841] 2024-09-12T17:46:33.294 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55a94dede734] 2024-09-12T17:46:33.294 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a94dedf5d4] 2024-09-12T17:46:33.294 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:46:33.295 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f605a829590] 2024-09-12T17:46:33.295 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:46:33.295 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:46:33.295 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:46:33.295 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.295 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:46:33.295 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:46:33.295 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:46:33.295 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:46:33.295 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:46:33.295 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:46:33.295 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:46:33.295 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:46:33.296 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:46:33.296 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:46:33.296 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:46:33.296 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:46:33.296 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:46:33.296 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:46:33.296 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:46:33.296 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:46:33.296 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:46:33.296 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:46:33.296 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:46:33.296 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:46:33.296 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:46:33.297 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:46:33.297 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:46:33.297 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:46:33.297 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:46:33.297 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:46:33.297 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:46:33.297 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:46:33.297 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:46:33.297 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:46:33.297 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:46:33.297 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:46:33.297 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:46:33.297 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:46:33.298 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:46:33.298 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:46:33.298 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:46:33.298 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:46:33.298 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:46:33.298 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:46:33.298 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:46:33.298 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:46:33.298 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:46:33.298 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:46:33.298 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:46:33.298 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:46:33.298 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:46:33.298 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:46:33.299 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:46:33.299 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:46:33.299 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:46:33.299 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:46:33.299 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:46:33.299 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:46:33.299 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:46:33.299 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:46:33.299 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:46:33.299 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:46:33.299 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:46:33.299 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:46:33.299 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:46:33.300 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:46:33.300 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:46:33.300 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:46:33.300 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:46:33.300 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:46:33.300 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:46:33.300 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:46:33.300 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:46:33.300 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:46:33.300 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:46:33.300 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:46:33.300 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:46:33.301 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:46:33.301 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:46:33.301 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:46:33.301 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:46:33.301 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:46:33.301 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:46:33.301 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:46:33.301 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:46:33.301 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:46:33.301 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:46:33.302 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:46:33.302 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:46:33.302 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:46:33.302 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:46:33.302 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:46:33.302 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:46:33.302 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:46:33.302 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:46:33.302 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:46:33.302 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:46:33.302 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:46:33.302 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5e857fa640 / http_manager 2024-09-12T17:46:33.302 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5e877fe640 / http_manager 2024-09-12T17:46:33.303 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5f0cfe1640 / rgw_dt_lg_renew 2024-09-12T17:46:33.303 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5f27fff640 / ms_dispatch 2024-09-12T17:46:33.303 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5f397fa640 / io_context_pool 2024-09-12T17:46:33.303 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5f39ffb640 / io_context_pool 2024-09-12T17:46:33.303 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5f3bfff640 / ms_dispatch 2024-09-12T17:46:33.303 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5f42e05640 / ms_dispatch 2024-09-12T17:46:33.303 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5f44608640 / io_context_pool 2024-09-12T17:46:33.303 INFO:tasks.workunit.client.0.smithi044.stderr: 7f6055836640 / msgr-worker-2 2024-09-12T17:46:33.303 INFO:tasks.workunit.client.0.smithi044.stderr: 7f6056037640 / msgr-worker-1 2024-09-12T17:46:33.303 INFO:tasks.workunit.client.0.smithi044.stderr: 7f6056838640 / msgr-worker-0 2024-09-12T17:46:33.303 INFO:tasks.workunit.client.0.smithi044.stderr: 7f6057039640 / io_context_pool 2024-09-12T17:46:33.303 INFO:tasks.workunit.client.0.smithi044.stderr: 7f6058546800 / radosgw-admin 2024-09-12T17:46:33.303 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:46:33.304 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:46:33.304 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/log/ceph/ceph-client.admin.147411.log 2024-09-12T17:46:33.304 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:46:33.304 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:46:33.304 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:46:33.157+0000 7f5f44608640 4 set_mon_vals no callback set 2024-09-12T17:46:33.304 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:46:33.158+0000 7f6058546800 10 monclient: _renew_subs 2024-09-12T17:46:33.304 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:46:33.158+0000 7f6058546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:46:33.304 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:46:33.158+0000 7f6058546800 1 librados: init done 2024-09-12T17:46:33.304 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:46:33.159+0000 7f5f42e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:33.304 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:46:33.159+0000 7f5f42e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:33.304 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:46:33.159+0000 7f5f42e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:33.304 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:46:33.160+0000 7f6055836640 10 monclient: get_auth_request con 0x7f5f3c076470 auth_method 0 2024-09-12T17:46:33.304 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:46:33.160+0000 7f6056838640 10 monclient: get_auth_request con 0x55a950085040 auth_method 0 2024-09-12T17:46:33.305 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:46:33.161+0000 7f6056037640 10 monclient: get_auth_request con 0x55a950088220 auth_method 0 2024-09-12T17:46:33.305 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:46:33.162+0000 7f6055836640 10 monclient: get_auth_request con 0x55a95008bad0 auth_method 0 2024-09-12T17:46:33.305 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:46:33.163+0000 7f6058546800 10 monclient: build_initial_monmap 2024-09-12T17:46:33.305 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:46:33.163+0000 7f6058546800 1 build_initial for_mkfs: 0 2024-09-12T17:46:33.305 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:46:33.163+0000 7f6058546800 10 monclient: monmap: 2024-09-12T17:46:33.305 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:46:33.305 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:33.305 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:46:33.305 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:46:33.305 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:33.305 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.305 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:46:33.305 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:46:33.305 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:46:33.306 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.306 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding auth protocol: cephx 2024-09-12T17:46:33.306 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding auth protocol: cephx 2024-09-12T17:46:33.306 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding auth protocol: cephx 2024-09-12T17:46:33.306 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: secure 2024-09-12T17:46:33.306 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: crc 2024-09-12T17:46:33.306 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: secure 2024-09-12T17:46:33.306 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: crc 2024-09-12T17:46:33.306 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: secure 2024-09-12T17:46:33.306 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: crc 2024-09-12T17:46:33.306 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: crc 2024-09-12T17:46:33.306 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: secure 2024-09-12T17:46:33.306 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: crc 2024-09-12T17:46:33.307 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: secure 2024-09-12T17:46:33.307 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: crc 2024-09-12T17:46:33.307 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:46:33.163+0000 7f6058546800 5 AuthRegistry(0x55a950091380) adding con mode: secure 2024-09-12T17:46:33.307 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:46:33.164+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.307 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:46:33.164+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command objecter_requests cmddesc objecter_requests hook 0x55a950094dd0 EEXIST 2024-09-12T17:46:33.307 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient: init 2024-09-12T17:46:33.307 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding auth protocol: cephx 2024-09-12T17:46:33.307 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding auth protocol: cephx 2024-09-12T17:46:33.307 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding auth protocol: cephx 2024-09-12T17:46:33.307 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: secure 2024-09-12T17:46:33.307 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: crc 2024-09-12T17:46:33.307 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: secure 2024-09-12T17:46:33.307 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: crc 2024-09-12T17:46:33.308 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: secure 2024-09-12T17:46:33.308 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: crc 2024-09-12T17:46:33.308 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: crc 2024-09-12T17:46:33.308 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: secure 2024-09-12T17:46:33.308 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: crc 2024-09-12T17:46:33.308 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: secure 2024-09-12T17:46:33.308 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: crc 2024-09-12T17:46:33.308 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:46:33.164+0000 7f6058546800 5 AuthRegistry(0x55a950090388) adding con mode: secure 2024-09-12T17:46:33.308 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:46:33.164+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.308 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:46:33.164+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.308 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:46:33.164+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command rotate-key cmddesc rotate-key hook 0x55a9500904d0 EEXIST 2024-09-12T17:46:33.308 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:33.308 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:46:33.309 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient(hunting): picked mon.noname-b con 0x55a9500b8ac0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:46:33.309 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient(hunting): picked mon.noname-c con 0x55a9500bad90 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:46:33.309 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient(hunting): picked mon.noname-a con 0x55a9500b7290 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:33.309 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.309 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.309 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.309 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:33.309 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:46:33.164+0000 7f6058546800 10 monclient(hunting): authenticate will time out at 2165.800803s 2024-09-12T17:46:33.309 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:46:33.164+0000 7f6055836640 10 monclient(hunting): get_auth_request con 0x55a9500bad90 auth_method 0 2024-09-12T17:46:33.310 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:46:33.164+0000 7f6055836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.310 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:46:33.164+0000 7f6055836640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.310 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:46:33.164+0000 7f6055836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.310 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:46:33.164+0000 7f6056838640 10 monclient(hunting): get_auth_request con 0x55a9500b7290 auth_method 0 2024-09-12T17:46:33.310 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:46:33.164+0000 7f6056838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.310 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:46:33.164+0000 7f6056838640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.310 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:46:33.164+0000 7f6056838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.310 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:46:33.164+0000 7f6056037640 10 monclient(hunting): get_auth_request con 0x55a9500b8ac0 auth_method 0 2024-09-12T17:46:33.310 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:46:33.164+0000 7f6056037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.310 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:46:33.164+0000 7f6056037640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.310 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:46:33.164+0000 7f6056037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.310 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:46:33.165+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.310 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:46:33.165+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.311 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:46:33.165+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:33.311 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:46:33.165+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.311 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:46:33.165+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.311 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:46:33.165+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:33.311 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:46:33.165+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.311 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:46:33.165+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.311 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:46:33.165+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:33.311 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:46:33.165+0000 7f6056838640 10 monclient(hunting): handle_auth_done global_id 8208 payload 824 2024-09-12T17:46:33.311 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:46:33.165+0000 7f6056838640 10 monclient: _finish_hunting 0 2024-09-12T17:46:33.311 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:46:33.165+0000 7f6056838640 1 monclient: found mon.noname-a 2024-09-12T17:46:33.311 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:46:33.165+0000 7f6056838640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.311 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:33.311 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:46:33.312 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: dump: 2024-09-12T17:46:33.312 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:33.312 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:33.312 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.312 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.312 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:33.312 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.312 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:33.312 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:33.312 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:33.312 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.313 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: _finish_auth 0 2024-09-12T17:46:33.313 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:46:33.313 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:33.313 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:33.313 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:46:33.313 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:46:33.165+0000 7f5f3bfff640 10 monclient: dump: 2024-09-12T17:46:33.313 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:33.313 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:33.313 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.313 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.313 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:33.314 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.314 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:33.314 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:33.314 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:33.314 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.314 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:46:33.165+0000 7f6058546800 5 monclient: authenticate success, global_id 8208 2024-09-12T17:46:33.314 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:46:33.165+0000 7f6058546800 10 monclient: _renew_subs 2024-09-12T17:46:33.314 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:46:33.165+0000 7f6057039640 4 set_mon_vals no callback set 2024-09-12T17:46:33.314 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:46:33.165+0000 7f6058546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.314 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:46:33.165+0000 7f6058546800 10 monclient: _renew_subs 2024-09-12T17:46:33.314 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:46:33.165+0000 7f6058546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.314 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:46:33.167+0000 7f5f3bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:33.315 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:46:33.167+0000 7f5f3bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:33.315 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:46:33.167+0000 7f5f3bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:33.315 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:46:33.167+0000 7f6056037640 10 monclient: get_auth_request con 0x7f5f30076380 auth_method 0 2024-09-12T17:46:33.315 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:46:33.167+0000 7f6058546800 10 monclient: get_monmap_and_config 2024-09-12T17:46:33.315 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:46:33.167+0000 7f6058546800 10 monclient: build_initial_monmap 2024-09-12T17:46:33.315 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:46:33.167+0000 7f6058546800 1 build_initial for_mkfs: 0 2024-09-12T17:46:33.315 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:46:33.167+0000 7f6058546800 10 monclient: monmap: 2024-09-12T17:46:33.315 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:46:33.315 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:33.316 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:46:33.316 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:46:33.316 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:33.316 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.316 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:46:33.316 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:46:33.316 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:46:33.316 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.316 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding auth protocol: cephx 2024-09-12T17:46:33.316 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding auth protocol: cephx 2024-09-12T17:46:33.316 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding auth protocol: cephx 2024-09-12T17:46:33.316 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: secure 2024-09-12T17:46:33.316 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: crc 2024-09-12T17:46:33.317 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: secure 2024-09-12T17:46:33.317 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: crc 2024-09-12T17:46:33.317 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: secure 2024-09-12T17:46:33.317 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: crc 2024-09-12T17:46:33.317 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: crc 2024-09-12T17:46:33.317 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: secure 2024-09-12T17:46:33.317 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: crc 2024-09-12T17:46:33.317 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: secure 2024-09-12T17:46:33.317 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: crc 2024-09-12T17:46:33.318 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:46:33.167+0000 7f6058546800 5 AuthRegistry(0x55a9500d8780) adding con mode: secure 2024-09-12T17:46:33.318 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:46:33.168+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.318 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient: init 2024-09-12T17:46:33.318 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding auth protocol: cephx 2024-09-12T17:46:33.318 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding auth protocol: cephx 2024-09-12T17:46:33.318 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding auth protocol: cephx 2024-09-12T17:46:33.318 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: secure 2024-09-12T17:46:33.318 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: crc 2024-09-12T17:46:33.318 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: secure 2024-09-12T17:46:33.318 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: crc 2024-09-12T17:46:33.318 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: secure 2024-09-12T17:46:33.318 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: crc 2024-09-12T17:46:33.318 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: crc 2024-09-12T17:46:33.319 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: secure 2024-09-12T17:46:33.319 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: crc 2024-09-12T17:46:33.319 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: secure 2024-09-12T17:46:33.319 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: crc 2024-09-12T17:46:33.319 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:46:33.168+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f46c00) adding con mode: secure 2024-09-12T17:46:33.319 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:46:33.168+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.319 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:46:33.168+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.319 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:46:33.168+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command rotate-key cmddesc rotate-key hook 0x7ffdf8f46d48 EEXIST 2024-09-12T17:46:33.320 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:33.320 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:46:33.320 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient(hunting): picked mon.noname-b con 0x55a95010ccc0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:46:33.320 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient(hunting): picked mon.noname-a con 0x55a9500dc820 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:33.320 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient(hunting): picked mon.noname-c con 0x55a9500d9750 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:46:33.320 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.320 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.320 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.320 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:33.320 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:46:33.168+0000 7f6058546800 10 monclient(hunting): authenticate will time out at 2165.804844s 2024-09-12T17:46:33.321 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:46:33.168+0000 7f6055836640 10 monclient(hunting): get_auth_request con 0x55a9500dc820 auth_method 0 2024-09-12T17:46:33.321 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:46:33.168+0000 7f6055836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.321 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:46:33.168+0000 7f6055836640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.321 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:46:33.168+0000 7f6055836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.321 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:46:33.168+0000 7f6056838640 10 monclient(hunting): get_auth_request con 0x55a9500d9750 auth_method 0 2024-09-12T17:46:33.321 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:46:33.168+0000 7f6056838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.321 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:46:33.168+0000 7f6056838640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.321 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:46:33.168+0000 7f6056838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.322 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:46:33.168+0000 7f6056037640 10 monclient(hunting): get_auth_request con 0x55a95010ccc0 auth_method 0 2024-09-12T17:46:33.322 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.322 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.322 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.322 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.322 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.322 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:33.322 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.322 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.322 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:33.323 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.323 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.323 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:33.323 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): handle_auth_done global_id 8211 payload 274 2024-09-12T17:46:33.323 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient: _finish_hunting 0 2024-09-12T17:46:33.323 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:46:33.169+0000 7f6055836640 1 monclient: found mon.noname-a 2024-09-12T17:46:33.323 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.323 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient: ms_handle_reset current mon [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:33.324 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient: _reopen_session rank -1 2024-09-12T17:46:33.324 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:46:33.324 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient(hunting): picked mon.noname-c con 0x55a9500d9750 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:46:33.324 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f5f20004560 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:33.324 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient(hunting): picked mon.noname-b con 0x55a95010ccc0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:46:33.324 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.324 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.324 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.324 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient(hunting): _renew_subs 2024-09-12T17:46:33.324 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:46:33.169+0000 7f5f39ffb640 10 monclient(hunting): ms_handle_reset hunted mon [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:33.325 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): get_auth_request con 0x7f5f20004560 auth_method 0 2024-09-12T17:46:33.325 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.325 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.325 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:46:33.325 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): get_auth_request con 0x55a9500d9750 auth_method 0 2024-09-12T17:46:33.325 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.325 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.325 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:46:33.325 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): get_auth_request con 0x55a95010ccc0 auth_method 0 2024-09-12T17:46:33.325 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.325 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.326 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:46:33.326 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.326 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.326 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:46:33.169+0000 7f6056037640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:46:33.326 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.326 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.326 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:46:33.326 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.326 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.326 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:46:33.169+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:46:33.326 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient(hunting): handle_auth_done global_id 8211 payload 293 2024-09-12T17:46:33.326 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient: _finish_hunting 0 2024-09-12T17:46:33.326 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:46:33.169+0000 7f6055836640 1 monclient: found mon.noname-a 2024-09-12T17:46:33.327 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:46:33.169+0000 7f6055836640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.327 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:33.327 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:46:33.327 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: dump: 2024-09-12T17:46:33.327 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:33.327 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:33.327 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.327 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.327 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:33.327 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.327 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:33.327 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:33.328 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:33.328 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.328 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: _finish_auth 0 2024-09-12T17:46:33.328 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:46:33.328 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:33.328 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:33.328 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:46:33.328 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:46:33.170+0000 7f5f39ffb640 10 monclient: dump: 2024-09-12T17:46:33.329 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:33.329 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:33.329 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.329 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.329 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:33.329 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.329 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:33.329 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:33.329 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:33.329 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.329 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:46:33.170+0000 7f6058546800 5 monclient: authenticate success, global_id 8211 2024-09-12T17:46:33.330 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:46:33.170+0000 7f6058546800 10 monclient: get_monmap_and_config success 2024-09-12T17:46:33.330 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:46:33.170+0000 7f6058546800 4 set_mon_vals no callback set 2024-09-12T17:46:33.330 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:46:33.170+0000 7f6058546800 10 monclient: shutdown 2024-09-12T17:46:33.330 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:46:33.170+0000 7f6058546800 10 monclient: build_initial_monmap 2024-09-12T17:46:33.330 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:46:33.170+0000 7f6058546800 1 build_initial for_mkfs: 0 2024-09-12T17:46:33.330 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:46:33.170+0000 7f6058546800 10 monclient: monmap: 2024-09-12T17:46:33.330 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:46:33.330 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:46:33.330 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:46:33.330 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:46:33.330 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:46:33.330 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.331 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:46:33.331 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:46:33.331 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:46:33.331 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.331 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding auth protocol: cephx 2024-09-12T17:46:33.331 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding auth protocol: cephx 2024-09-12T17:46:33.331 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding auth protocol: cephx 2024-09-12T17:46:33.331 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: secure 2024-09-12T17:46:33.331 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: crc 2024-09-12T17:46:33.331 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: secure 2024-09-12T17:46:33.331 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: crc 2024-09-12T17:46:33.331 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: secure 2024-09-12T17:46:33.331 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: crc 2024-09-12T17:46:33.332 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: crc 2024-09-12T17:46:33.332 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: secure 2024-09-12T17:46:33.332 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: crc 2024-09-12T17:46:33.332 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: secure 2024-09-12T17:46:33.332 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: crc 2024-09-12T17:46:33.332 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:46:33.170+0000 7f6058546800 5 AuthRegistry(0x55a9500d8730) adding con mode: secure 2024-09-12T17:46:33.332 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:46:33.171+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.332 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:46:33.171+0000 7f6058546800 1 librados: starting msgr at 2024-09-12T17:46:33.332 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:46:33.171+0000 7f6058546800 1 librados: starting objecter 2024-09-12T17:46:33.332 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:46:33.171+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command objecter_requests cmddesc objecter_requests hook 0x55a9500bacc0 EEXIST 2024-09-12T17:46:33.332 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:46:33.171+0000 7f6058546800 1 librados: setting wanted keys 2024-09-12T17:46:33.332 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:46:33.171+0000 7f6058546800 1 librados: calling monclient init 2024-09-12T17:46:33.333 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient: init 2024-09-12T17:46:33.333 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding auth protocol: cephx 2024-09-12T17:46:33.333 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding auth protocol: cephx 2024-09-12T17:46:33.333 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding auth protocol: cephx 2024-09-12T17:46:33.333 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: secure 2024-09-12T17:46:33.333 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: crc 2024-09-12T17:46:33.333 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: secure 2024-09-12T17:46:33.333 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: crc 2024-09-12T17:46:33.333 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: secure 2024-09-12T17:46:33.333 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: crc 2024-09-12T17:46:33.333 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: crc 2024-09-12T17:46:33.334 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: secure 2024-09-12T17:46:33.334 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: crc 2024-09-12T17:46:33.334 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: secure 2024-09-12T17:46:33.334 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: crc 2024-09-12T17:46:33.334 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:46:33.171+0000 7f6058546800 5 AuthRegistry(0x55a9500d0870) adding con mode: secure 2024-09-12T17:46:33.334 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:46:33.171+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.334 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:46:33.171+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.334 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:46:33.171+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command rotate-key cmddesc rotate-key hook 0x55a9500d09b8 EEXIST 2024-09-12T17:46:33.334 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient: _reopen_session rank -1 2024-09-12T17:46:33.334 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:46:33.334 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient(hunting): picked mon.noname-b con 0x55a9500d9750 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:46:33.334 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient(hunting): picked mon.noname-c con 0x55a95010ccc0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:46:33.335 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient(hunting): picked mon.noname-a con 0x7f5f20004560 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:46:33.335 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.335 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.335 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient(hunting): start opening mon connection 2024-09-12T17:46:33.335 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient(hunting): _renew_subs 2024-09-12T17:46:33.335 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:46:33.171+0000 7f6058546800 10 monclient(hunting): authenticate will time out at 2165.807880s 2024-09-12T17:46:33.335 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient(hunting): get_auth_request con 0x7f5f20004560 auth_method 0 2024-09-12T17:46:33.335 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.335 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.335 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.335 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:46:33.172+0000 7f6055836640 10 monclient(hunting): get_auth_request con 0x55a95010ccc0 auth_method 0 2024-09-12T17:46:33.335 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:46:33.172+0000 7f6055836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.335 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:46:33.172+0000 7f6055836640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.336 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:46:33.172+0000 7f6055836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.336 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.336 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.336 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:33.336 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:46:33.172+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:46:33.336 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:46:33.172+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:46:33.336 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:46:33.172+0000 7f6055836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:46:33.336 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:46:33.172+0000 7f6056037640 10 monclient(hunting): get_auth_request con 0x55a9500d9750 auth_method 0 2024-09-12T17:46:33.336 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:46:33.172+0000 7f6056037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:46:33.336 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:46:33.172+0000 7f6056037640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:46:33.336 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:46:33.172+0000 7f6056037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:46:33.336 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient(hunting): handle_auth_done global_id 8214 payload 824 2024-09-12T17:46:33.336 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient: _finish_hunting 0 2024-09-12T17:46:33.337 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:46:33.172+0000 7f6056838640 1 monclient: found mon.noname-a 2024-09-12T17:46:33.337 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:46:33.172+0000 7f6056838640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.337 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:33.337 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:46:33.337 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: dump: 2024-09-12T17:46:33.337 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:33.337 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:33.337 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.337 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.337 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:33.337 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.338 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:33.338 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:33.338 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:33.338 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.338 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: _finish_auth 0 2024-09-12T17:46:33.338 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: _check_auth_tickets 2024-09-12T17:46:33.338 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:46:33.338 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:46:33.338 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:46:33.338 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:46:33.172+0000 7f5f27fff640 10 monclient: dump: 2024-09-12T17:46:33.338 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:46:33.338 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:46:33.338 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.338 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:46:33.339 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:46:33.339 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:46:33.339 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:46:33.339 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:46:33.339 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:46:33.339 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.339 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:46:33.172+0000 7f6058546800 5 monclient: authenticate success, global_id 8214 2024-09-12T17:46:33.339 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:46:33.172+0000 7f6058546800 10 monclient: _renew_subs 2024-09-12T17:46:33.339 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:46:33.172+0000 7f6058546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.339 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:46:33.172+0000 7f5f39ffb640 4 set_mon_vals no callback set 2024-09-12T17:46:33.339 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:46:33.172+0000 7f6058546800 10 monclient: _renew_subs 2024-09-12T17:46:33.339 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:46:33.172+0000 7f6058546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.339 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:46:33.172+0000 7f6058546800 1 librados: init done 2024-09-12T17:46:33.339 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:46:33.172+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command cr dump hook 0x55a950103958 2024-09-12T17:46:33.340 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:46:33.174+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.340 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:46:33.174+0000 7f5f27fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:46:33.340 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:46:33.174+0000 7f5f27fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:33.340 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:46:33.174+0000 7f5f27fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:46:33.340 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:46:33.174+0000 7f6056037640 10 monclient: get_auth_request con 0x7f5f20077280 auth_method 0 2024-09-12T17:46:33.340 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:46:33.174+0000 7f6055836640 10 monclient: get_auth_request con 0x55a950127060 auth_method 0 2024-09-12T17:46:33.340 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:46:33.175+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.340 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:46:33.175+0000 7f6058546800 20 realm 2024-09-12T17:46:33.340 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:46:33.175+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.340 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:46:33.175+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.340 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:46:33.175+0000 7f6058546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:33.340 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:46:33.175+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.340 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:46:33.175+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.340 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:46:33.175+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.341 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:46:33.176+0000 7f6056037640 10 monclient: get_auth_request con 0x55a95012b2d0 auth_method 0 2024-09-12T17:46:33.341 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:46:33.176+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:33.341 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:46:33.176+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.341 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:46:33.177+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:33.341 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:46:33.177+0000 7f6058546800 20 searching for the correct realm 2024-09-12T17:46:33.341 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:46:33.177+0000 7f6055836640 10 monclient: get_auth_request con 0x55a950130570 auth_method 0 2024-09-12T17:46:33.341 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:46:33.177+0000 7f6056838640 10 monclient: get_auth_request con 0x7f604c085420 auth_method 0 2024-09-12T17:46:33.341 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:46:33.178+0000 7f6056037640 10 monclient: get_auth_request con 0x7f605008fd60 auth_method 0 2024-09-12T17:46:33.341 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:46:33.179+0000 7f6056037640 0 -- 172.21.15.44:0/2509361386 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7f605008fd60 msgr2=0x7f605004aaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:33.341 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:46:33.179+0000 7f5f27fff640 1 client.8214.objecter ms_handle_reset 0x7f605008fd60 session 0x7f6050029200 osd.2 2024-09-12T17:46:33.341 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:46:33.179+0000 7f5f27fff640 10 monclient: _renew_subs 2024-09-12T17:46:33.341 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:46:33.179+0000 7f5f27fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:46:33.341 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:46:33.179+0000 7f6056037640 10 monclient: get_auth_request con 0x7f5f200870a0 auth_method 0 2024-09-12T17:46:33.341 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:46:33.179+0000 7f6055836640 10 monclient: get_auth_request con 0x7f6048061190 auth_method 0 2024-09-12T17:46:33.342 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:46:33.181+0000 7f6056838640 10 monclient: get_auth_request con 0x7f604c07b950 auth_method 0 2024-09-12T17:46:33.342 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:46:33.182+0000 7f6056838640 0 -- 172.21.15.44:0/2509361386 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f604c085420 msgr2=0x7f604c085820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:33.342 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:46:33.182+0000 7f5f27fff640 1 client.8214.objecter ms_handle_reset 0x7f604c085420 session 0x7f604c075040 osd.7 2024-09-12T17:46:33.342 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:46:33.183+0000 7f6056838640 10 monclient: get_auth_request con 0x7f605008fd60 auth_method 0 2024-09-12T17:46:33.342 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:46:33.183+0000 7f6056037640 10 monclient: get_auth_request con 0x7f604c092940 auth_method 0 2024-09-12T17:46:33.342 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:33.342 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:33.342 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:33.342 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:33.342 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:33.342 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:46:33.188+0000 7f6058546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:33.342 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:46:33.188+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.342 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:46:33.188+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.343 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:46:33.188+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.343 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:46:33.188+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:33.343 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:46:33.188+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.343 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:46:33.189+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:33.343 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:46:33.189+0000 7f6058546800 20 zone default found 2024-09-12T17:46:33.343 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:46:33.189+0000 7f6058546800 4 Realm: () 2024-09-12T17:46:33.343 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:46:33.189+0000 7f6058546800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:33.343 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:46:33.189+0000 7f6058546800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:33.343 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:46:33.189+0000 7f6058546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:33.343 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:46:33.189+0000 7f6058546800 20 zonegroup default 2024-09-12T17:46:33.343 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:46:33.189+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.343 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:46:33.189+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.343 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:46:33.189+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.344 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:46:33.189+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.344 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:46:33.189+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.344 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:46:33.189+0000 7f6058546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.344 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:46:33.189+0000 7f6058546800 20 started sync module instance, tier type = 2024-09-12T17:46:33.344 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:46:33.189+0000 7f6058546800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:33.344 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=0 2024-09-12T17:46:33.344 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=1 2024-09-12T17:46:33.344 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=2 2024-09-12T17:46:33.344 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=3 2024-09-12T17:46:33.344 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=4 2024-09-12T17:46:33.344 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=5 2024-09-12T17:46:33.344 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:46:33.199+0000 7f6058546800 20 add_watcher() i=6 2024-09-12T17:46:33.344 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:46:33.200+0000 7f6058546800 20 add_watcher() i=7 2024-09-12T17:46:33.344 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:46:33.200+0000 7f6058546800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:33.345 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding auth protocol: cephx 2024-09-12T17:46:33.345 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding auth protocol: cephx 2024-09-12T17:46:33.345 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding auth protocol: cephx 2024-09-12T17:46:33.345 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: secure 2024-09-12T17:46:33.345 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: crc 2024-09-12T17:46:33.345 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: secure 2024-09-12T17:46:33.345 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: crc 2024-09-12T17:46:33.345 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: secure 2024-09-12T17:46:33.345 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: crc 2024-09-12T17:46:33.345 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: crc 2024-09-12T17:46:33.345 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: secure 2024-09-12T17:46:33.345 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: crc 2024-09-12T17:46:33.345 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: secure 2024-09-12T17:46:33.346 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: crc 2024-09-12T17:46:33.346 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:46:33.202+0000 7f5f0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:33.346 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:46:33.202+0000 7f6058546800 5 AuthRegistry(0x7ffdf8f470d0) adding con mode: secure 2024-09-12T17:46:33.346 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:46:33.202+0000 7f6058546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:46:33.346 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:46:33.202+0000 7f6058546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:33.346 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:46:33.202+0000 7f6058546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:33.346 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:46:33.202+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command cache list hook 0x55a950102610 2024-09-12T17:46:33.346 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:46:33.202+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command cache inspect hook 0x55a950102610 2024-09-12T17:46:33.346 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:46:33.202+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command cache erase hook 0x55a950102610 2024-09-12T17:46:33.346 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:46:33.202+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command cache zap hook 0x55a950102610 2024-09-12T17:46:33.346 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:46:33.202+0000 7f6058546800 5 note: GC not initialized 2024-09-12T17:46:33.346 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:46:33.202+0000 7f5e877fe640 20 reqs_thread_entry: start 2024-09-12T17:46:33.346 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:46:33.202+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command sync trace show hook 0x7f5f20007090 2024-09-12T17:46:33.347 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:46:33.202+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command sync trace history hook 0x7f5f20007090 2024-09-12T17:46:33.347 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:46:33.202+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command sync trace active hook 0x7f5f20007090 2024-09-12T17:46:33.347 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:46:33.202+0000 7f6058546800 5 asok(0x55a94fe1a730) register_command sync trace active_short hook 0x7f5f20007090 2024-09-12T17:46:33.347 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:46:33.202+0000 7f6058546800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:33.347 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:46:33.203+0000 7f6058546800 20 Filter name: none 2024-09-12T17:46:33.347 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:46:33.203+0000 7f5e857fa640 20 reqs_thread_entry: start 2024-09-12T17:46:33.347 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:46:33.203+0000 7f6058546800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:46:33.347 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:46:33.203+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.347 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:46:33.203+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:33.347 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:46:33.203+0000 7f6058546800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:46:33.347 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:46:33.203+0000 7f6058546800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:46:33.347 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:46:33.203+0000 7f6058546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:46:33.348 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:46:33.203+0000 7f6058546800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.348 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:46:33.204+0000 7f6058546800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:46:33.348 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:46:33.204+0000 7f6058546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:46:33.348 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:46:33.204+0000 7f6058546800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:46:33.348 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:46:33.204+0000 7f6058546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:33.348 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:46:33.204+0000 7f6058546800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:33.348 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:46:33.204+0000 7f6058546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:46:33.348 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:46:33.209+0000 7f6058546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:46:33.348 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:46:33.209+0000 7f6058546800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:46:33.348 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:46:33.209+0000 7f6058546800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:33.348 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:46:33.209+0000 7f6058546800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:46:33.348 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:46:33.209+0000 7f5f397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562462 cookie 94185681274512 notifier 8214 bl.length()=911 2024-09-12T17:46:33.349 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:46:33.209+0000 7f5f397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:46:33.349 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:46:33.209+0000 7f5f397fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:46:33.349 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:46:33.209+0000 7f5f397fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:33.349 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:46:33.210+0000 7f6058546800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:46:33.349 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:46:33.210+0000 7f6058546800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:46:33.349 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:46:33.210+0000 7f6058546800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:46:33.349 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:46:33.210+0000 7f6058546800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:46:33.349 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.0 2024-09-12T17:46:33.349 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.0 2024-09-12T17:46:33.349 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.1 2024-09-12T17:46:33.349 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.1 2024-09-12T17:46:33.349 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.2 2024-09-12T17:46:33.349 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.2 2024-09-12T17:46:33.350 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.3 2024-09-12T17:46:33.350 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.3 2024-09-12T17:46:33.350 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.4 2024-09-12T17:46:33.350 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.4 2024-09-12T17:46:33.350 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.5 2024-09-12T17:46:33.350 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.5 2024-09-12T17:46:33.350 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.6 2024-09-12T17:46:33.350 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.6 2024-09-12T17:46:33.350 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.7 2024-09-12T17:46:33.350 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.7 2024-09-12T17:46:33.351 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.8 2024-09-12T17:46:33.351 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.8 2024-09-12T17:46:33.351 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.9 2024-09-12T17:46:33.351 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.9 2024-09-12T17:46:33.351 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.10 2024-09-12T17:46:33.351 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.10 2024-09-12T17:46:33.351 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.11 2024-09-12T17:46:33.351 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.11 2024-09-12T17:46:33.351 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.12 2024-09-12T17:46:33.351 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.12 2024-09-12T17:46:33.351 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.13 2024-09-12T17:46:33.351 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.13 2024-09-12T17:46:33.352 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:46:33.215+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:46:33.352 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:46:33.215+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:46:33.352 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:46:33.216+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:46:33.352 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:46:33.216+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:46:33.352 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:46:33.216+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:46:33.352 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:46:33.216+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:46:33.352 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:46:33.217+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:46:33.352 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:46:33.217+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:46:33.352 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:46:33.217+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:46:33.352 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:46:33.217+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:46:33.352 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:46:33.218+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:46:33.352 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:46:33.218+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:46:33.352 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:46:33.219+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:46:33.353 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:46:33.219+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:46:33.353 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:46:33.219+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:46:33.353 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:46:33.219+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:46:33.353 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:46:33.220+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:46:33.353 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:46:33.220+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:46:33.353 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:46:33.220+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:46:33.353 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:46:33.220+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:46:33.353 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:46:33.221+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:46:33.353 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:46:33.221+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:46:33.354 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:46:33.221+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:46:33.354 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:46:33.221+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:46:33.354 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:46:33.222+0000 7f6058546800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:46:33.354 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:46:33.222+0000 7f6058546800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:46:33.354 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:46:33.227+0000 7f6058546800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6058546800 time 2024-09-12T17:46:33.227085+0000 2024-09-12T17:46:33.354 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:46:33.354 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.354 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:33.354 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f605bb8c71a] 2024-09-12T17:46:33.354 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f605bb8c8d8] 2024-09-12T17:46:33.354 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a94decf841] 2024-09-12T17:46:33.354 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55a94dede734] 2024-09-12T17:46:33.354 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a94dedf5d4] 2024-09-12T17:46:33.355 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:46:33.355 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f605a829590] 2024-09-12T17:46:33.355 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:46:33.355 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:46:33.355 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.355 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:46:33.228+0000 7f6058546800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:46:33.355 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f6058546800 thread_name:radosgw-admin 2024-09-12T17:46:33.355 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.355 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:46:33.356 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f605a83e6f0] 2024-09-12T17:46:33.356 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f605a88b99c] 2024-09-12T17:46:33.356 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:46:33.356 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:46:33.356 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f605bb8c774] 2024-09-12T17:46:33.356 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f605bb8c8d8] 2024-09-12T17:46:33.356 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a94decf841] 2024-09-12T17:46:33.356 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55a94dede734] 2024-09-12T17:46:33.356 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a94dedf5d4] 2024-09-12T17:46:33.356 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:46:33.356 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f605a829590] 2024-09-12T17:46:33.356 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:46:33.356 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:46:33.357 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:46:33.357 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:46:33.357 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:46:33.357 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:46:33.357 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:46:33.357 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:46:33.357 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:46:33.357 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:46:33.357 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:46:33.357 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:46:33.357 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:46:33.358 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:46:33.358 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:46:33.358 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:46:33.358 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:46:33.358 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:46:33.358 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:46:33.358 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:46:33.358 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:46:33.358 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:46:33.358 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:46:33.359 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:46:33.359 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:46:33.359 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:46:33.359 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:46:33.359 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:46:33.359 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:46:33.359 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:46:33.359 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:46:33.359 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:46:33.359 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:46:33.359 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:46:33.359 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:46:33.360 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:46:33.360 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:46:33.360 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:46:33.360 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:46:33.360 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:46:33.360 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:46:33.360 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:46:33.360 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:46:33.360 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:46:33.360 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:46:33.361 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:46:33.361 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:46:33.361 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:46:33.361 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:46:33.361 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:46:33.361 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:46:33.361 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:46:33.361 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:46:33.361 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:46:33.362 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:46:33.362 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:46:33.362 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:46:33.362 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:46:33.362 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:46:33.362 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:46:33.362 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:46:33.362 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:46:33.362 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:46:33.362 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:46:33.363 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:46:33.363 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:46:33.363 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:46:33.363 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:46:33.363 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:46:33.363 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:46:33.363 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:46:33.363 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:46:33.363 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:46:33.363 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:46:33.363 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:46:33.364 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:46:33.364 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:46:33.364 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:46:33.364 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:46:33.364 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:46:33.364 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:46:33.364 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:46:33.364 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:46:33.364 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:46:33.364 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:46:33.364 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:46:33.364 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:46:33.365 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:46:33.365 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:46:33.365 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:46:33.365 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:46:33.365 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:46:33.365 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:46:33.365 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:46:33.365 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:46:33.365 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:46:33.365 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:46:33.365 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:46:33.365 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5e857fa640 / http_manager 2024-09-12T17:46:33.366 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5e877fe640 / http_manager 2024-09-12T17:46:33.366 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5f0cfe1640 / rgw_dt_lg_renew 2024-09-12T17:46:33.366 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5f27fff640 / ms_dispatch 2024-09-12T17:46:33.366 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5f397fa640 / io_context_pool 2024-09-12T17:46:33.366 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5f39ffb640 / io_context_pool 2024-09-12T17:46:33.366 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5f3bfff640 / ms_dispatch 2024-09-12T17:46:33.366 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5f42e05640 / ms_dispatch 2024-09-12T17:46:33.366 INFO:tasks.workunit.client.0.smithi044.stderr: 7f5f44608640 / io_context_pool 2024-09-12T17:46:33.366 INFO:tasks.workunit.client.0.smithi044.stderr: 7f6055836640 / msgr-worker-2 2024-09-12T17:46:33.366 INFO:tasks.workunit.client.0.smithi044.stderr: 7f6056037640 / msgr-worker-1 2024-09-12T17:46:33.366 INFO:tasks.workunit.client.0.smithi044.stderr: 7f6056838640 / msgr-worker-0 2024-09-12T17:46:33.366 INFO:tasks.workunit.client.0.smithi044.stderr: 7f6057039640 / io_context_pool 2024-09-12T17:46:33.366 INFO:tasks.workunit.client.0.smithi044.stderr: 7f6058546800 / radosgw-admin 2024-09-12T17:46:33.366 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:46:33.366 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:46:33.367 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:46:33.228873Z_caeffadd-2d64-4c55-9705-b5597e30630e/log 2024-09-12T17:46:33.367 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:46:33.367 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:46:33.371 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:33.372 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:33.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.305+0000 7f1d2d523800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.307+0000 7f1d2d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.307+0000 7f1d2d523800 20 realm 2024-09-12T17:46:33.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.307+0000 7f1d2d523800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.307+0000 7f1d2d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.307+0000 7f1d2d523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:33.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.307+0000 7f1d2d523800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.307+0000 7f1d2d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.307+0000 7f1d2d523800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.308+0000 7f1d2d523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:33.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.308+0000 7f1d2d523800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.308+0000 7f1d2d523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:33.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.308+0000 7f1d2d523800 20 searching for the correct realm 2024-09-12T17:46:33.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.312+0000 7f1d28a0b640 0 -- 172.21.15.44:0/300713059 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f1d1c0b6070 msgr2=0x7f1d1c0a5990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:33.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.316+0000 7f1d29a0d640 0 -- 172.21.15.44:0/300713059 >> [v2:172.21.15.181:6810/2228110208,v1:172.21.15.181:6811/2228110208] conn(0x7f1d20018040 msgr2=0x7f1d20003a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:33.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.319+0000 7f1d2d523800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:33.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.319+0000 7f1d2d523800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:33.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.319+0000 7f1d2d523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:33.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.319+0000 7f1d2d523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:33.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.319+0000 7f1d2d523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:33.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.319+0000 7f1d2d523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:33.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.319+0000 7f1d2d523800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.319+0000 7f1d2d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.319+0000 7f1d2d523800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.319+0000 7f1d2d523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:33.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.319+0000 7f1d2d523800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.320+0000 7f1d2d523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:33.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.320+0000 7f1d2d523800 20 zone default found 2024-09-12T17:46:33.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.320+0000 7f1d2d523800 4 Realm: () 2024-09-12T17:46:33.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.320+0000 7f1d2d523800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:33.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.320+0000 7f1d2d523800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:33.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.320+0000 7f1d2d523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:33.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.320+0000 7f1d2d523800 20 zonegroup default 2024-09-12T17:46:33.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.320+0000 7f1d2d523800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.320+0000 7f1d2d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.320+0000 7f1d2d523800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.320+0000 7f1d2d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.320+0000 7f1d2d523800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.320+0000 7f1d2d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.320+0000 7f1d2d523800 20 started sync module instance, tier type = 2024-09-12T17:46:33.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.320+0000 7f1d2d523800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:33.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.330+0000 7f1d2d523800 20 add_watcher() i=0 2024-09-12T17:46:33.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.330+0000 7f1d2d523800 20 add_watcher() i=1 2024-09-12T17:46:33.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.330+0000 7f1d2d523800 20 add_watcher() i=2 2024-09-12T17:46:33.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.330+0000 7f1d2d523800 20 add_watcher() i=3 2024-09-12T17:46:33.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.330+0000 7f1d2d523800 20 add_watcher() i=4 2024-09-12T17:46:33.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.330+0000 7f1d2d523800 20 add_watcher() i=5 2024-09-12T17:46:33.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.330+0000 7f1d2d523800 20 add_watcher() i=6 2024-09-12T17:46:33.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.330+0000 7f1d2d523800 20 add_watcher() i=7 2024-09-12T17:46:33.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.330+0000 7f1d2d523800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:33.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.332+0000 7f1bdffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:33.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.333+0000 7f1d2d523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:33.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.333+0000 7f1d2d523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:33.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.333+0000 7f1d2d523800 5 note: GC not initialized 2024-09-12T17:46:33.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.333+0000 7f1bdefe5640 20 reqs_thread_entry: start 2024-09-12T17:46:33.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.333+0000 7f1d2d523800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:33.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.333+0000 7f1d2d523800 20 Filter name: none 2024-09-12T17:46:33.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.333+0000 7f1bdcfe1640 20 reqs_thread_entry: start 2024-09-12T17:46:33.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.333+0000 7f1d2d523800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.334+0000 7f1d2d523800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:33.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.334+0000 7f1d2d523800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.335+0000 7f1d2d523800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:46:33.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.335+0000 7f1d2d523800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:33.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.335+0000 7f1d2d523800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.335+0000 7f1d2d523800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:33.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.335+0000 7f1d2d523800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.335+0000 7f1d2d523800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:46:33.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.335+0000 7f1d2d523800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:46:33.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.337+0000 7f1bdffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:33.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.339+0000 7f1d2d523800 20 remove_watcher() i=0 2024-09-12T17:46:33.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.339+0000 7f1d2d523800 2 removed watcher, disabling cache 2024-09-12T17:46:33.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.340+0000 7f1d2d523800 20 remove_watcher() i=1 2024-09-12T17:46:33.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.341+0000 7f1d2d523800 20 remove_watcher() i=2 2024-09-12T17:46:33.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.342+0000 7f1d2d523800 20 remove_watcher() i=3 2024-09-12T17:46:33.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.343+0000 7f1d2d523800 20 remove_watcher() i=4 2024-09-12T17:46:33.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.344+0000 7f1d2d523800 20 remove_watcher() i=5 2024-09-12T17:46:33.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.345+0000 7f1d2d523800 20 remove_watcher() i=6 2024-09-12T17:46:33.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.346+0000 7f1d2d523800 20 remove_watcher() i=7 2024-09-12T17:46:33.377 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:46:33.398 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:33.398 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:33.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.436+0000 7fb3f1942800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.438+0000 7fb3f1942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.438+0000 7fb3f1942800 20 realm 2024-09-12T17:46:33.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.438+0000 7fb3f1942800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.438+0000 7fb3f1942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.438+0000 7fb3f1942800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:33.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.438+0000 7fb3f1942800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.438+0000 7fb3f1942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.438+0000 7fb3f1942800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.439+0000 7fb3f1942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:33.439 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.439+0000 7fb3f1942800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.439+0000 7fb3f1942800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:33.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.439+0000 7fb3f1942800 20 searching for the correct realm 2024-09-12T17:46:33.443 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.443+0000 7fb3ede87640 0 -- 172.21.15.44:0/1104486958 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7fb3e4056c40 msgr2=0x7fb3e407b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:33.446 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.446+0000 7fb3ed686640 0 -- 172.21.15.44:0/1104486958 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fb3e4063930 msgr2=0x7fb3e40873b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:33.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.653+0000 7fb3f1942800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:46:33.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.653+0000 7fb3f1942800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:46:33.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.653+0000 7fb3f1942800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:33.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.653+0000 7fb3f1942800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:33.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.653+0000 7fb3f1942800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:33.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.653+0000 7fb3f1942800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:33.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.653+0000 7fb3f1942800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.654 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.653+0000 7fb3f1942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.655 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.653+0000 7fb3f1942800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.655 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.654+0000 7fb3f1942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:33.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.654+0000 7fb3f1942800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.654+0000 7fb3f1942800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:33.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.654+0000 7fb3f1942800 20 zone default found 2024-09-12T17:46:33.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.654+0000 7fb3f1942800 4 Realm: () 2024-09-12T17:46:33.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.654+0000 7fb3f1942800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:46:33.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.654+0000 7fb3f1942800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:46:33.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.654+0000 7fb3f1942800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:33.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.654+0000 7fb3f1942800 20 zonegroup default 2024-09-12T17:46:33.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.654+0000 7fb3f1942800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.654+0000 7fb3f1942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.654+0000 7fb3f1942800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.655+0000 7fb3f1942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.657 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.655+0000 7fb3f1942800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.657 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.655+0000 7fb3f1942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:33.657 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.655+0000 7fb3f1942800 20 started sync module instance, tier type = 2024-09-12T17:46:33.657 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.655+0000 7fb3f1942800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:46:33.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.664+0000 7fb3f1942800 20 add_watcher() i=0 2024-09-12T17:46:33.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.664+0000 7fb3f1942800 20 add_watcher() i=1 2024-09-12T17:46:33.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.664+0000 7fb3f1942800 20 add_watcher() i=2 2024-09-12T17:46:33.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.664+0000 7fb3f1942800 20 add_watcher() i=3 2024-09-12T17:46:33.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.664+0000 7fb3f1942800 20 add_watcher() i=4 2024-09-12T17:46:33.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.664+0000 7fb3f1942800 20 add_watcher() i=5 2024-09-12T17:46:33.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.664+0000 7fb3f1942800 20 add_watcher() i=6 2024-09-12T17:46:33.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.665+0000 7fb3f1942800 20 add_watcher() i=7 2024-09-12T17:46:33.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.665+0000 7fb3f1942800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:33.668 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.667+0000 7fb2a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:33.669 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.668+0000 7fb3f1942800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:33.669 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.668+0000 7fb3f1942800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:33.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.668+0000 7fb3f1942800 5 note: GC not initialized 2024-09-12T17:46:33.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.668+0000 7fb2a27e4640 20 reqs_thread_entry: start 2024-09-12T17:46:33.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.668+0000 7fb3f1942800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:33.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.668+0000 7fb3f1942800 20 Filter name: none 2024-09-12T17:46:33.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.668+0000 7fb213fff640 20 reqs_thread_entry: start 2024-09-12T17:46:33.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.668+0000 7fb3f1942800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:46:33.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.668+0000 7fb3f1942800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.671 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.669+0000 7fb3f1942800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:46:33.671 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.669+0000 7fb3f1942800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:46:33.671 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.669+0000 7fb3f1942800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:46:33.671 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.669+0000 7fb3f1942800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:46:33.671 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.669+0000 7fb3f1942800 20 rados->read ofs=0 len=0 2024-09-12T17:46:33.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.669+0000 7fb3f1942800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:46:33.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.669+0000 7fb3f1942800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:46:33.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.669+0000 7fb3f1942800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:46:33.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.669+0000 7fb3f1942800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:33.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.669+0000 7fb3f1942800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:46:33.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.669+0000 7fb3f1942800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:46:33.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.669+0000 7fb3f1942800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:46:33.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.669+0000 7fb3f1942800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:46:33.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.670+0000 7fb3f1942800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:46:33.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.670+0000 7fb3f1942800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:46:33.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.670+0000 7fb3f1942800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:46:33.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.670+0000 7fb3f1942800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:46:33.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.671+0000 7fb3f1942800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:46:33.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.671+0000 7fb3f1942800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:46:33.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.671+0000 7fb3f1942800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:46:33.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.671+0000 7fb3f1942800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:46:33.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.671+0000 7fb3f1942800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:46:33.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.671+0000 7fb3f1942800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:46:33.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.672+0000 7fb3f1942800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:46:33.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.672+0000 7fb3f1942800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:46:33.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.672+0000 7fb3f1942800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:46:33.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.672+0000 7fb3f1942800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:46:33.675 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.673+0000 7fb3f1942800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:46:33.675 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.673+0000 7fb3f1942800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:46:33.675 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.673+0000 7fb3f1942800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:46:33.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.673+0000 7fb3f1942800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:46:33.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.674+0000 7fb3f1942800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:46:33.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.674+0000 7fb3f1942800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:46:33.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.674+0000 7fb3f1942800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:46:33.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.674+0000 7fb3f1942800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:46:33.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.674+0000 7fb3f1942800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:46:33.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.674+0000 7fb3f1942800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:46:33.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.676+0000 7fb2a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:33.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.678+0000 7fb3f1942800 20 remove_watcher() i=0 2024-09-12T17:46:33.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.678+0000 7fb3f1942800 2 removed watcher, disabling cache 2024-09-12T17:46:33.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.679+0000 7fb3f1942800 20 remove_watcher() i=1 2024-09-12T17:46:33.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.680+0000 7fb3f1942800 20 remove_watcher() i=2 2024-09-12T17:46:33.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.681+0000 7fb3f1942800 20 remove_watcher() i=3 2024-09-12T17:46:33.683 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.682+0000 7fb3f1942800 20 remove_watcher() i=4 2024-09-12T17:46:33.684 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.683+0000 7fb3f1942800 20 remove_watcher() i=5 2024-09-12T17:46:33.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.684+0000 7fb3f1942800 20 remove_watcher() i=6 2024-09-12T17:46:33.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:46:33.685+0000 7fb3f1942800 20 remove_watcher() i=7 2024-09-12T17:47:03.729 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:47:03.762 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:03.762 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:03.807 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:03.805+0000 7f782631f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:03.809 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:03.807+0000 7f782631f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:03.809 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:03.807+0000 7f782631f800 20 realm 2024-09-12T17:47:03.809 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:03.807+0000 7f782631f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:03.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:03.808+0000 7f782631f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:03.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:03.808+0000 7f782631f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:03.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:03.808+0000 7f782631f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:03.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:03.808+0000 7f782631f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:03.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:03.808+0000 7f782631f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:03.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:03.809+0000 7f782631f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:03.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:03.809+0000 7f782631f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:03.811 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:03.809+0000 7f782631f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:03.811 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:03.809+0000 7f782631f800 20 searching for the correct realm 2024-09-12T17:47:03.814 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:03.813+0000 7f78198a8640 0 -- 172.21.15.44:0/2180247988 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f7814067060 msgr2=0x7f781405f370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:03.818 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:03.817+0000 7f78220a9640 0 -- 172.21.15.44:0/2180247988 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f780c0c2040 msgr2=0x7f780c0c5050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:04.027 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.025+0000 7f782631f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:47:04.027 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.025+0000 7f782631f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:47:04.028 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.025+0000 7f782631f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:04.028 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.025+0000 7f782631f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:04.028 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.025+0000 7f782631f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:04.028 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.025+0000 7f782631f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:04.028 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.026+0000 7f782631f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.028 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.026+0000 7f782631f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.028 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.026+0000 7f782631f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.026+0000 7f782631f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:04.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.026+0000 7f782631f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.027+0000 7f782631f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:04.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.027+0000 7f782631f800 20 zone default found 2024-09-12T17:47:04.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.027+0000 7f782631f800 4 Realm: () 2024-09-12T17:47:04.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.027+0000 7f782631f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:47:04.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.027+0000 7f782631f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:47:04.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.027+0000 7f782631f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:04.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.027+0000 7f782631f800 20 zonegroup default 2024-09-12T17:47:04.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.027+0000 7f782631f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.027+0000 7f782631f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.027+0000 7f782631f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.030 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.027+0000 7f782631f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.027+0000 7f782631f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.028+0000 7f782631f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.028+0000 7f782631f800 20 started sync module instance, tier type = 2024-09-12T17:47:04.031 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.028+0000 7f782631f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:47:04.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.039+0000 7f782631f800 20 add_watcher() i=0 2024-09-12T17:47:04.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.039+0000 7f782631f800 20 add_watcher() i=1 2024-09-12T17:47:04.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.039+0000 7f782631f800 20 add_watcher() i=2 2024-09-12T17:47:04.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.039+0000 7f782631f800 20 add_watcher() i=3 2024-09-12T17:47:04.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.039+0000 7f782631f800 20 add_watcher() i=4 2024-09-12T17:47:04.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.039+0000 7f782631f800 20 add_watcher() i=5 2024-09-12T17:47:04.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.039+0000 7f782631f800 20 add_watcher() i=6 2024-09-12T17:47:04.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.040+0000 7f782631f800 20 add_watcher() i=7 2024-09-12T17:47:04.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.040+0000 7f782631f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:04.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.042+0000 7f76d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:04.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.043+0000 7f782631f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:04.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.043+0000 7f782631f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:04.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.043+0000 7f782631f800 5 note: GC not initialized 2024-09-12T17:47:04.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.043+0000 7f76537fe640 20 reqs_thread_entry: start 2024-09-12T17:47:04.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.043+0000 7f782631f800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:04.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.043+0000 7f782631f800 20 Filter name: none 2024-09-12T17:47:04.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.043+0000 7f76517fa640 20 reqs_thread_entry: start 2024-09-12T17:47:04.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.043+0000 7f782631f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.044+0000 7f782631f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:04.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.044+0000 7f782631f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.045+0000 7f782631f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:47:04.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.045+0000 7f782631f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:04.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.045+0000 7f782631f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.045+0000 7f782631f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:04.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.045+0000 7f782631f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.046+0000 7f782631f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:47:04.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.046+0000 7f782631f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:04.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.048+0000 7f76d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:04.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.051+0000 7f782631f800 20 remove_watcher() i=0 2024-09-12T17:47:04.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.051+0000 7f782631f800 2 removed watcher, disabling cache 2024-09-12T17:47:04.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.052+0000 7f782631f800 20 remove_watcher() i=1 2024-09-12T17:47:04.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.053+0000 7f782631f800 20 remove_watcher() i=2 2024-09-12T17:47:04.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.055+0000 7f782631f800 20 remove_watcher() i=3 2024-09-12T17:47:04.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.056+0000 7f782631f800 20 remove_watcher() i=4 2024-09-12T17:47:04.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.057+0000 7f782631f800 20 remove_watcher() i=5 2024-09-12T17:47:04.060 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.058+0000 7f782631f800 20 remove_watcher() i=6 2024-09-12T17:47:04.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.059+0000 7f782631f800 20 remove_watcher() i=7 2024-09-12T17:47:04.103 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:47:04.133 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:04.134 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:04.174 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.172+0000 7f8d52739800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.174+0000 7f8d52739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.174+0000 7f8d52739800 20 realm 2024-09-12T17:47:04.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.174+0000 7f8d52739800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.174+0000 7f8d52739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.174+0000 7f8d52739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:04.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.174+0000 7f8d52739800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.174+0000 7f8d52739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.174+0000 7f8d52739800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.175+0000 7f8d52739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:04.179 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.175+0000 7f8d52739800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.175+0000 7f8d52739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:04.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.175+0000 7f8d52739800 20 searching for the correct realm 2024-09-12T17:47:04.181 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.178+0000 7f8d4dbcd640 0 -- 172.21.15.44:0/749512887 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f8d400d3040 msgr2=0x7f8d400db990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:04.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.182+0000 7f8d4e3ce640 0 -- 172.21.15.44:0/749512887 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f8d4403e420 msgr2=0x7f8d4403e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:47:04.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.389+0000 7f8d52739800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:47:04.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.389+0000 7f8d52739800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:47:04.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.389+0000 7f8d52739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:04.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.389+0000 7f8d52739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:04.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.389+0000 7f8d52739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:04.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.389+0000 7f8d52739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:04.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.389+0000 7f8d52739800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.389+0000 7f8d52739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.389+0000 7f8d52739800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.390+0000 7f8d52739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:04.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.390+0000 7f8d52739800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.390+0000 7f8d52739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:04.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.390+0000 7f8d52739800 20 zone default found 2024-09-12T17:47:04.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.390+0000 7f8d52739800 4 Realm: () 2024-09-12T17:47:04.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.390+0000 7f8d52739800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:47:04.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.390+0000 7f8d52739800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:47:04.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.390+0000 7f8d52739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:04.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.390+0000 7f8d52739800 20 zonegroup default 2024-09-12T17:47:04.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.390+0000 7f8d52739800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.391+0000 7f8d52739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.391+0000 7f8d52739800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.391+0000 7f8d52739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.391+0000 7f8d52739800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.392+0000 7f8d52739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.392+0000 7f8d52739800 20 started sync module instance, tier type = 2024-09-12T17:47:04.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.392+0000 7f8d52739800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:47:04.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.401+0000 7f8d52739800 20 add_watcher() i=0 2024-09-12T17:47:04.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.401+0000 7f8d52739800 20 add_watcher() i=1 2024-09-12T17:47:04.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.401+0000 7f8d52739800 20 add_watcher() i=2 2024-09-12T17:47:04.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.401+0000 7f8d52739800 20 add_watcher() i=3 2024-09-12T17:47:04.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.401+0000 7f8d52739800 20 add_watcher() i=4 2024-09-12T17:47:04.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.401+0000 7f8d52739800 20 add_watcher() i=5 2024-09-12T17:47:04.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.401+0000 7f8d52739800 20 add_watcher() i=6 2024-09-12T17:47:04.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.402+0000 7f8d52739800 20 add_watcher() i=7 2024-09-12T17:47:04.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.402+0000 7f8d52739800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:04.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.404+0000 7f8c04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:04.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.404+0000 7f8d52739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:04.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.404+0000 7f8d52739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:04.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.404+0000 7f8d52739800 5 note: GC not initialized 2024-09-12T17:47:04.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.404+0000 7f8b7f7fe640 20 reqs_thread_entry: start 2024-09-12T17:47:04.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.405+0000 7f8d52739800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:04.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.405+0000 7f8d52739800 20 Filter name: none 2024-09-12T17:47:04.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.405+0000 7f8b7d7fa640 20 reqs_thread_entry: start 2024-09-12T17:47:04.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.405+0000 7f8d52739800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:47:04.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.405+0000 7f8d52739800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.405+0000 7f8d52739800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:04.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.405+0000 7f8d52739800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:47:04.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.405+0000 7f8d52739800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:47:04.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.405+0000 7f8d52739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:47:04.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.405+0000 7f8d52739800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.406+0000 7f8d52739800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:04.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.406+0000 7f8d52739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:04.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.406+0000 7f8d52739800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:04.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.406+0000 7f8d52739800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:04.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.406+0000 7f8d52739800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:04.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.406+0000 7f8d52739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:47:04.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.406+0000 7f8d52739800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:47:04.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.406+0000 7f8d52739800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:47:04.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.407+0000 7f8d52739800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:47:04.409 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.407+0000 7f8d52739800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:47:04.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.407+0000 7f8d52739800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:47:04.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.407+0000 7f8d52739800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:47:04.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.408+0000 7f8d52739800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:47:04.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.408+0000 7f8d52739800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:47:04.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.408+0000 7f8d52739800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:47:04.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.408+0000 7f8d52739800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:47:04.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.409+0000 7f8d52739800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:47:04.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.409+0000 7f8d52739800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:47:04.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.409+0000 7f8d52739800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:47:04.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.409+0000 7f8d52739800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:47:04.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.409+0000 7f8d52739800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:47:04.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.409+0000 7f8d52739800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:47:04.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.410+0000 7f8d52739800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:47:04.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.410+0000 7f8d52739800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:47:04.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.410+0000 7f8d52739800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:47:04.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.410+0000 7f8d52739800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:47:04.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.411+0000 7f8d52739800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:47:04.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.411+0000 7f8d52739800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:47:04.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.411+0000 7f8d52739800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:47:04.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.411+0000 7f8d52739800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:47:04.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.411+0000 7f8d52739800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:47:04.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.411+0000 7f8d52739800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:47:04.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.413+0000 7f8c04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:04.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.415+0000 7f8d52739800 20 remove_watcher() i=0 2024-09-12T17:47:04.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.415+0000 7f8d52739800 2 removed watcher, disabling cache 2024-09-12T17:47:04.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.416+0000 7f8d52739800 20 remove_watcher() i=1 2024-09-12T17:47:04.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.418+0000 7f8d52739800 20 remove_watcher() i=2 2024-09-12T17:47:04.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.419+0000 7f8d52739800 20 remove_watcher() i=3 2024-09-12T17:47:04.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.420+0000 7f8d52739800 20 remove_watcher() i=4 2024-09-12T17:47:04.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.421+0000 7f8d52739800 20 remove_watcher() i=5 2024-09-12T17:47:04.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.422+0000 7f8d52739800 20 remove_watcher() i=6 2024-09-12T17:47:04.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.423+0000 7f8d52739800 20 remove_watcher() i=7 2024-09-12T17:47:04.438 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:47:04.467 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:04.467 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:04.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.505+0000 7f1c9c80f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.506+0000 7f1c9c80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.506+0000 7f1c9c80f800 20 realm 2024-09-12T17:47:04.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.506+0000 7f1c9c80f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.507+0000 7f1c9c80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.507+0000 7f1c9c80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:04.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.507+0000 7f1c9c80f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.507+0000 7f1c9c80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.507+0000 7f1c9c80f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.508+0000 7f1c9c80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:04.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.508+0000 7f1c9c80f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.508+0000 7f1c9c80f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:04.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.508+0000 7f1c9c80f800 20 searching for the correct realm 2024-09-12T17:47:04.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.512+0000 7f1c9aafa640 0 -- 172.21.15.44:0/45346311 >> [v2:172.21.15.181:6810/2228110208,v1:172.21.15.181:6811/2228110208] conn(0x7f1c9006fba0 msgr2=0x7f1c9006e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:04.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.719+0000 7f1c9a2f9640 0 -- 172.21.15.44:0/45346311 >> [v2:172.21.15.181:6826/1273321942,v1:172.21.15.181:6827/1273321942] conn(0x564a2a37f390 msgr2=0x564a2a381850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:04.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.721+0000 7f1c9c80f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:47:04.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.721+0000 7f1c9c80f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:47:04.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.721+0000 7f1c9c80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:04.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.721+0000 7f1c9c80f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:04.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.721+0000 7f1c9c80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:04.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.721+0000 7f1c9c80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:04.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.721+0000 7f1c9c80f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.722+0000 7f1c9c80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.722+0000 7f1c9c80f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.722+0000 7f1c9c80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:04.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.722+0000 7f1c9c80f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.723+0000 7f1c9c80f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:04.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.723+0000 7f1c9c80f800 20 zone default found 2024-09-12T17:47:04.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.723+0000 7f1c9c80f800 4 Realm: () 2024-09-12T17:47:04.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.723+0000 7f1c9c80f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:47:04.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.723+0000 7f1c9c80f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:47:04.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.723+0000 7f1c9c80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:04.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.723+0000 7f1c9c80f800 20 zonegroup default 2024-09-12T17:47:04.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.723+0000 7f1c9c80f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.723+0000 7f1c9c80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.723+0000 7f1c9c80f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.723+0000 7f1c9c80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.723+0000 7f1c9c80f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.723+0000 7f1c9c80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.723+0000 7f1c9c80f800 20 started sync module instance, tier type = 2024-09-12T17:47:04.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.723+0000 7f1c9c80f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:47:04.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.733+0000 7f1c9c80f800 20 add_watcher() i=0 2024-09-12T17:47:04.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.733+0000 7f1c9c80f800 20 add_watcher() i=1 2024-09-12T17:47:04.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.733+0000 7f1c9c80f800 20 add_watcher() i=2 2024-09-12T17:47:04.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.733+0000 7f1c9c80f800 20 add_watcher() i=3 2024-09-12T17:47:04.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.733+0000 7f1c9c80f800 20 add_watcher() i=4 2024-09-12T17:47:04.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.733+0000 7f1c9c80f800 20 add_watcher() i=5 2024-09-12T17:47:04.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.733+0000 7f1c9c80f800 20 add_watcher() i=6 2024-09-12T17:47:04.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.734+0000 7f1c9c80f800 20 add_watcher() i=7 2024-09-12T17:47:04.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.734+0000 7f1c9c80f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:04.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.735+0000 7f1b50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:04.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.736+0000 7f1c9c80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:04.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.736+0000 7f1c9c80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:04.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.736+0000 7f1c9c80f800 5 note: GC not initialized 2024-09-12T17:47:04.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.736+0000 7f1acb7fe640 20 reqs_thread_entry: start 2024-09-12T17:47:04.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.736+0000 7f1c9c80f800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:04.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.736+0000 7f1c9c80f800 20 Filter name: none 2024-09-12T17:47:04.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.736+0000 7f1ac97fa640 20 reqs_thread_entry: start 2024-09-12T17:47:04.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.736+0000 7f1c9c80f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.737+0000 7f1c9c80f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:04.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.737+0000 7f1c9c80f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.737+0000 7f1c9c80f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:04.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.737+0000 7f1c9c80f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:04.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.737+0000 7f1c9c80f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.738+0000 7f1c9c80f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:04.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.738+0000 7f1c9c80f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.738+0000 7f1c9c80f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:04.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.738+0000 7f1c9c80f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:04.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.740+0000 7f1b50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:04.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.742+0000 7f1c9c80f800 20 remove_watcher() i=0 2024-09-12T17:47:04.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.742+0000 7f1c9c80f800 2 removed watcher, disabling cache 2024-09-12T17:47:04.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.744+0000 7f1c9c80f800 20 remove_watcher() i=1 2024-09-12T17:47:04.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.745+0000 7f1c9c80f800 20 remove_watcher() i=2 2024-09-12T17:47:04.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.746+0000 7f1c9c80f800 20 remove_watcher() i=3 2024-09-12T17:47:04.748 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.747+0000 7f1c9c80f800 20 remove_watcher() i=4 2024-09-12T17:47:04.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.748+0000 7f1c9c80f800 20 remove_watcher() i=5 2024-09-12T17:47:04.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.749+0000 7f1c9c80f800 20 remove_watcher() i=6 2024-09-12T17:47:04.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.750+0000 7f1c9c80f800 20 remove_watcher() i=7 2024-09-12T17:47:04.763 INFO:tasks.workunit.client.0.smithi044.stderr: test: duplicated entries should be purged before reshard 2024-09-12T17:47:04.764 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:47:04.794 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:04.794 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:04.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.831+0000 7f65b6d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.833+0000 7f65b6d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.833+0000 7f65b6d46800 20 realm 2024-09-12T17:47:04.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.833+0000 7f65b6d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.833+0000 7f65b6d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.833+0000 7f65b6d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:04.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.833+0000 7f65b6d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.833+0000 7f65b6d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:04.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.833+0000 7f65b6d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.834+0000 7f65b6d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:04.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.834+0000 7f65b6d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:04.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.835+0000 7f65b6d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:04.836 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.835+0000 7f65b6d46800 20 searching for the correct realm 2024-09-12T17:47:04.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:04.838+0000 7f65b4036640 0 -- 172.21.15.44:0/276825255 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f65a4083940 msgr2=0x7f65a403af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:05.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.045+0000 7f65b4837640 0 -- 172.21.15.44:0/276825255 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f65a8097410 msgr2=0x7f65a8097890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:05.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.252+0000 7f65b6d46800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:47:05.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.252+0000 7f65b6d46800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:47:05.254 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.252+0000 7f65b6d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:05.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.252+0000 7f65b6d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:05.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.252+0000 7f65b6d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:05.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.252+0000 7f65b6d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:05.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.252+0000 7f65b6d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.252+0000 7f65b6d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.255 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.252+0000 7f65b6d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.252+0000 7f65b6d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:05.256 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.252+0000 7f65b6d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.253+0000 7f65b6d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:05.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.253+0000 7f65b6d46800 20 zone default found 2024-09-12T17:47:05.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.253+0000 7f65b6d46800 4 Realm: () 2024-09-12T17:47:05.258 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.253+0000 7f65b6d46800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:47:05.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.253+0000 7f65b6d46800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:47:05.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.253+0000 7f65b6d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:05.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.253+0000 7f65b6d46800 20 zonegroup default 2024-09-12T17:47:05.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.253+0000 7f65b6d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.253+0000 7f65b6d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.253+0000 7f65b6d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.254+0000 7f65b6d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.254+0000 7f65b6d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.254+0000 7f65b6d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.254+0000 7f65b6d46800 20 started sync module instance, tier type = 2024-09-12T17:47:05.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.254+0000 7f65b6d46800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:47:05.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.265+0000 7f65b6d46800 20 add_watcher() i=0 2024-09-12T17:47:05.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.265+0000 7f65b6d46800 20 add_watcher() i=1 2024-09-12T17:47:05.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.265+0000 7f65b6d46800 20 add_watcher() i=2 2024-09-12T17:47:05.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.265+0000 7f65b6d46800 20 add_watcher() i=3 2024-09-12T17:47:05.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.265+0000 7f65b6d46800 20 add_watcher() i=4 2024-09-12T17:47:05.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.265+0000 7f65b6d46800 20 add_watcher() i=5 2024-09-12T17:47:05.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.265+0000 7f65b6d46800 20 add_watcher() i=6 2024-09-12T17:47:05.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.266+0000 7f65b6d46800 20 add_watcher() i=7 2024-09-12T17:47:05.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.266+0000 7f65b6d46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:05.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.268+0000 7f646afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:05.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.268+0000 7f65b6d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:05.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.268+0000 7f65b6d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:05.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.268+0000 7f65b6d46800 5 note: GC not initialized 2024-09-12T17:47:05.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.268+0000 7f6469fe3640 20 reqs_thread_entry: start 2024-09-12T17:47:05.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.268+0000 7f65b6d46800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:05.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.268+0000 7f65b6d46800 20 Filter name: none 2024-09-12T17:47:05.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.269+0000 7f63db7fe640 20 reqs_thread_entry: start 2024-09-12T17:47:05.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.269+0000 7f65b6d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.269+0000 7f65b6d46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:05.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.269+0000 7f65b6d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.270+0000 7f65b6d46800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:05.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.270+0000 7f65b6d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:05.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.270+0000 7f65b6d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.270+0000 7f65b6d46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:05.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.270+0000 7f65b6d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.270+0000 7f65b6d46800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:05.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.270+0000 7f65b6d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:05.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.272+0000 7f646afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:05.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.275+0000 7f65b6d46800 20 remove_watcher() i=0 2024-09-12T17:47:05.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.275+0000 7f65b6d46800 2 removed watcher, disabling cache 2024-09-12T17:47:05.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.276+0000 7f65b6d46800 20 remove_watcher() i=1 2024-09-12T17:47:05.279 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.277+0000 7f65b6d46800 20 remove_watcher() i=2 2024-09-12T17:47:05.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.279+0000 7f65b6d46800 20 remove_watcher() i=3 2024-09-12T17:47:05.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.280+0000 7f65b6d46800 20 remove_watcher() i=4 2024-09-12T17:47:05.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.281+0000 7f65b6d46800 20 remove_watcher() i=5 2024-09-12T17:47:05.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.282+0000 7f65b6d46800 20 remove_watcher() i=6 2024-09-12T17:47:05.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.283+0000 7f65b6d46800 20 remove_watcher() i=7 2024-09-12T17:47:05.297 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.297 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:47:05.297 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: a-bucket id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-12T17:47:05.297 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.298 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:47:05.334 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:05.334 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:05.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.374+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.376+0000 7f8b9120f800 20 realm 2024-09-12T17:47:05.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.376+0000 7f8b9120f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:05.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.377+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:05.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.377+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.377+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:05.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.377+0000 7f8b9120f800 20 searching for the correct realm 2024-09-12T17:47:05.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.381+0000 7f8b8d123640 0 -- 172.21.15.44:0/2033573499 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f8b7804f040 msgr2=0x7f8b78090a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:05.385 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.384+0000 7f8b8c922640 0 -- 172.21.15.44:0/2033573499 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f8b78084880 msgr2=0x7f8b78082f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:05.593 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:47:05.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:47:05.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:05.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:05.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:05.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:05.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.591+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:05.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:05.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.592+0000 7f8b9120f800 20 zone default found 2024-09-12T17:47:05.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.592+0000 7f8b9120f800 4 Realm: () 2024-09-12T17:47:05.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.592+0000 7f8b9120f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:47:05.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.592+0000 7f8b9120f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:47:05.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.592+0000 7f8b9120f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:05.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.592+0000 7f8b9120f800 20 zonegroup default 2024-09-12T17:47:05.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.593+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.593+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.593+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.593+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.593+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.593+0000 7f8b9120f800 20 started sync module instance, tier type = 2024-09-12T17:47:05.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.593+0000 7f8b9120f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:47:05.604 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=0 2024-09-12T17:47:05.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=1 2024-09-12T17:47:05.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=2 2024-09-12T17:47:05.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=3 2024-09-12T17:47:05.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=4 2024-09-12T17:47:05.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=5 2024-09-12T17:47:05.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=6 2024-09-12T17:47:05.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.604+0000 7f8b9120f800 20 add_watcher() i=7 2024-09-12T17:47:05.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.604+0000 7f8b9120f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:05.607 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.605+0000 7f8a42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:05.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.606+0000 7f8b9120f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:05.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.606+0000 7f8b9120f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:05.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.606+0000 7f8b9120f800 5 note: GC not initialized 2024-09-12T17:47:05.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.606+0000 7f8a41fe3640 20 reqs_thread_entry: start 2024-09-12T17:47:05.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.606+0000 7f8b9120f800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:05.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.606+0000 7f8b9120f800 20 Filter name: none 2024-09-12T17:47:05.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.606+0000 7f89b37fe640 20 reqs_thread_entry: start 2024-09-12T17:47:05.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.606+0000 7f8b9120f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:47:05.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.606+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.607+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:05.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.607+0000 7f8b9120f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:47:05.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.607+0000 7f8b9120f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:47:05.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.607+0000 7f8b9120f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:47:05.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.607+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.607+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:05.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.607+0000 7f8b9120f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:05.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.607+0000 7f8b9120f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:05.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.607+0000 7f8b9120f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:05.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.607+0000 7f8b9120f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:05.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.607+0000 7f8b9120f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:47:05.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.614+0000 7f8b9120f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:05.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.614+0000 7f8b9120f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:05.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.614+0000 7f8b9120f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:05.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.614+0000 7f8b9120f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:47:05.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.614+0000 7f8a637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562464 cookie 94806421930096 notifier 8340 bl.length()=911 2024-09-12T17:47:05.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.614+0000 7f8a637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:05.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.614+0000 7f8a637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:05.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.614+0000 7f8a637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:05.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.615+0000 7f8b9120f800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:47:05.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.615+0000 7f8b9120f800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:47:05.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.615+0000 7f8b9120f800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:47:05.617 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.615+0000 7f8b9120f800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:47:05.622 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8b9120f800 time 2024-09-12T17:47:05.622305+0000 2024-09-12T17:47:05.622 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:47:05.640 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:47:05.641 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8b9238c71a] 2024-09-12T17:47:05.641 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8b9238c8d8] 2024-09-12T17:47:05.641 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5639d476e841] 2024-09-12T17:47:05.641 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5639d477e57a] 2024-09-12T17:47:05.641 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2024-09-12T17:47:05.641 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f8b91029590] 2024-09-12T17:47:05.641 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2024-09-12T17:47:05.641 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2024-09-12T17:47:05.642 INFO:tasks.workunit.client.0.smithi044.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:47:05.642 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f8b9120f800 thread_name:radosgw-admin 2024-09-12T17:47:05.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.621+0000 7f8b9120f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8b9120f800 time 2024-09-12T17:47:05.622305+0000 2024-09-12T17:47:05.642 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:47:05.642 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.642 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:47:05.642 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8b9238c71a] 2024-09-12T17:47:05.642 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8b9238c8d8] 2024-09-12T17:47:05.642 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5639d476e841] 2024-09-12T17:47:05.642 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5639d477e57a] 2024-09-12T17:47:05.642 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2024-09-12T17:47:05.642 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f8b91029590] 2024-09-12T17:47:05.642 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2024-09-12T17:47:05.643 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2024-09-12T17:47:05.643 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.643 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:47:05.643 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8b9103e6f0] 2024-09-12T17:47:05.643 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8b9108b99c] 2024-09-12T17:47:05.643 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:47:05.643 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:47:05.643 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8b9238c774] 2024-09-12T17:47:05.643 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8b9238c8d8] 2024-09-12T17:47:05.643 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5639d476e841] 2024-09-12T17:47:05.643 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5639d477e57a] 2024-09-12T17:47:05.643 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2024-09-12T17:47:05.643 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f8b91029590] 2024-09-12T17:47:05.644 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2024-09-12T17:47:05.644 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2024-09-12T17:47:05.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.622+0000 7f8b9120f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:47:05.644 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f8b9120f800 thread_name:radosgw-admin 2024-09-12T17:47:05.644 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.644 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:47:05.644 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8b9103e6f0] 2024-09-12T17:47:05.644 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8b9108b99c] 2024-09-12T17:47:05.644 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:47:05.645 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:47:05.645 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8b9238c774] 2024-09-12T17:47:05.645 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8b9238c8d8] 2024-09-12T17:47:05.645 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5639d476e841] 2024-09-12T17:47:05.645 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5639d477e57a] 2024-09-12T17:47:05.645 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2024-09-12T17:47:05.645 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f8b91029590] 2024-09-12T17:47:05.645 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2024-09-12T17:47:05.645 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2024-09-12T17:47:05.645 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:47:05.645 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.645 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:47:05.646 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:47:05.355+0000 7f8b9120f800 5 asok(0x5639d6e85730) unregister_commands rotate-key 2024-09-12T17:47:05.646 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:47:05.356+0000 7f8b9120f800 10 monclient: build_initial_monmap 2024-09-12T17:47:05.646 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:47:05.356+0000 7f8b9120f800 1 build_initial for_mkfs: 0 2024-09-12T17:47:05.646 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:47:05.356+0000 7f8b9120f800 10 monclient: monmap: 2024-09-12T17:47:05.646 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:47:05.646 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:47:05.646 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:47:05.646 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:47:05.646 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:47:05.646 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.646 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:47:05.646 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:47:05.647 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:47:05.647 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.647 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding auth protocol: cephx 2024-09-12T17:47:05.647 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding auth protocol: cephx 2024-09-12T17:47:05.647 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding auth protocol: cephx 2024-09-12T17:47:05.647 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: secure 2024-09-12T17:47:05.647 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: crc 2024-09-12T17:47:05.647 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: secure 2024-09-12T17:47:05.647 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: crc 2024-09-12T17:47:05.647 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: secure 2024-09-12T17:47:05.647 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: crc 2024-09-12T17:47:05.647 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: crc 2024-09-12T17:47:05.647 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: secure 2024-09-12T17:47:05.648 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: crc 2024-09-12T17:47:05.648 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: secure 2024-09-12T17:47:05.648 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: crc 2024-09-12T17:47:05.648 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: secure 2024-09-12T17:47:05.648 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:47:05.356+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.648 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:47:05.356+0000 7f8b9120f800 1 librados: starting msgr at 2024-09-12T17:47:05.648 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:47:05.356+0000 7f8b9120f800 1 librados: starting objecter 2024-09-12T17:47:05.648 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command objecter_requests hook 0x5639d70aea60 2024-09-12T17:47:05.648 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:47:05.356+0000 7f8b9120f800 1 librados: setting wanted keys 2024-09-12T17:47:05.648 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:47:05.356+0000 7f8b9120f800 1 librados: calling monclient init 2024-09-12T17:47:05.648 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:47:05.356+0000 7f8b9120f800 10 monclient: init 2024-09-12T17:47:05.649 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding auth protocol: cephx 2024-09-12T17:47:05.649 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding auth protocol: cephx 2024-09-12T17:47:05.649 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding auth protocol: cephx 2024-09-12T17:47:05.649 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: secure 2024-09-12T17:47:05.649 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: crc 2024-09-12T17:47:05.649 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: secure 2024-09-12T17:47:05.649 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: crc 2024-09-12T17:47:05.649 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: secure 2024-09-12T17:47:05.649 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: crc 2024-09-12T17:47:05.649 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: crc 2024-09-12T17:47:05.649 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: secure 2024-09-12T17:47:05.650 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: crc 2024-09-12T17:47:05.650 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: secure 2024-09-12T17:47:05.650 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: crc 2024-09-12T17:47:05.650 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: secure 2024-09-12T17:47:05.650 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:47:05.356+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.650 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:47:05.357+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.650 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:47:05.357+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command rotate-key hook 0x5639d70a7ba8 2024-09-12T17:47:05.650 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient: _reopen_session rank -1 2024-09-12T17:47:05.650 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:47:05.650 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-a con 0x5639d6f1bc20 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:05.650 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-c con 0x5639d6fea650 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:05.650 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-b con 0x5639d70d68f0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:05.650 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.651 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.651 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.651 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient(hunting): _renew_subs 2024-09-12T17:47:05.651 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient(hunting): authenticate will time out at 2197.994231s 2024-09-12T17:47:05.651 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient(hunting): get_auth_request con 0x5639d6fea650 auth_method 0 2024-09-12T17:47:05.651 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.651 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.651 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.651 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:47:05.357+0000 7f8b8c922640 10 monclient(hunting): get_auth_request con 0x5639d6f1bc20 auth_method 0 2024-09-12T17:47:05.651 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:47:05.357+0000 7f8b8c922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.651 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:47:05.357+0000 7f8b8c922640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.651 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:47:05.357+0000 7f8b8c922640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.651 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.652 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.652 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.652 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:47:05.357+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.652 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:47:05.357+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.652 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:47:05.357+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.652 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:47:05.357+0000 7f8b8d123640 10 monclient(hunting): get_auth_request con 0x5639d70d68f0 auth_method 0 2024-09-12T17:47:05.652 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:47:05.357+0000 7f8b8d123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.652 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:47:05.357+0000 7f8b8d123640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.652 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:47:05.357+0000 7f8b8d123640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.652 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient(hunting): handle_auth_done global_id 7787 payload 824 2024-09-12T17:47:05.652 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient: _finish_hunting 0 2024-09-12T17:47:05.653 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:47:05.357+0000 7f8b87fff640 1 monclient: found mon.noname-c 2024-09-12T17:47:05.653 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:47:05.653 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:05.653 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:47:05.653 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: dump: 2024-09-12T17:47:05.653 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:05.653 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:05.653 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.653 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.653 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:05.653 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.653 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:05.653 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:05.654 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:05.654 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.654 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: _finish_auth 0 2024-09-12T17:47:05.654 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: _check_auth_tickets 2024-09-12T17:47:05.654 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:47:05.654 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:47:05.357+0000 7f8b9120f800 5 monclient: authenticate success, global_id 7787 2024-09-12T17:47:05.654 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient: _renew_subs 2024-09-12T17:47:05.654 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:47:05.654 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:05.654 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:47:05.654 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: dump: 2024-09-12T17:47:05.654 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:05.655 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:05.655 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.655 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.655 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:05.655 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.655 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:05.655 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:05.655 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:05.655 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.655 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:47:05.357+0000 7f8a7ae05640 4 set_mon_vals no callback set 2024-09-12T17:47:05.655 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient: _renew_subs 2024-09-12T17:47:05.655 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:47:05.655 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:47:05.358+0000 7f8b9120f800 1 librados: init done 2024-09-12T17:47:05.655 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:47:05.359+0000 7f8a79602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:47:05.656 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:47:05.359+0000 7f8a79602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:05.656 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:47:05.359+0000 7f8a79602640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:05.656 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:47:05.360+0000 7f8b8c922640 10 monclient: get_auth_request con 0x7f8a74076470 auth_method 0 2024-09-12T17:47:05.656 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:47:05.360+0000 7f8b8d123640 10 monclient: get_auth_request con 0x5639d70e6730 auth_method 0 2024-09-12T17:47:05.656 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:47:05.361+0000 7f8b8c922640 10 monclient: get_auth_request con 0x5639d70f3600 auth_method 0 2024-09-12T17:47:05.656 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:47:05.362+0000 7f8b87fff640 10 monclient: get_auth_request con 0x5639d70f8690 auth_method 0 2024-09-12T17:47:05.656 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:47:05.363+0000 7f8b9120f800 10 monclient: build_initial_monmap 2024-09-12T17:47:05.656 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:47:05.363+0000 7f8b9120f800 1 build_initial for_mkfs: 0 2024-09-12T17:47:05.656 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:47:05.363+0000 7f8b9120f800 10 monclient: monmap: 2024-09-12T17:47:05.656 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:47:05.656 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:47:05.656 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:47:05.656 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:47:05.657 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:47:05.657 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.657 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:47:05.657 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:47:05.657 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:47:05.657 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.657 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding auth protocol: cephx 2024-09-12T17:47:05.657 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding auth protocol: cephx 2024-09-12T17:47:05.657 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding auth protocol: cephx 2024-09-12T17:47:05.657 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: secure 2024-09-12T17:47:05.657 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: crc 2024-09-12T17:47:05.657 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: secure 2024-09-12T17:47:05.658 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: crc 2024-09-12T17:47:05.658 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: secure 2024-09-12T17:47:05.658 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: crc 2024-09-12T17:47:05.658 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: crc 2024-09-12T17:47:05.658 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: secure 2024-09-12T17:47:05.658 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: crc 2024-09-12T17:47:05.658 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: secure 2024-09-12T17:47:05.658 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: crc 2024-09-12T17:47:05.658 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: secure 2024-09-12T17:47:05.658 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:47:05.364+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.658 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command objecter_requests cmddesc objecter_requests hook 0x5639d70ffb80 EEXIST 2024-09-12T17:47:05.658 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient: init 2024-09-12T17:47:05.659 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding auth protocol: cephx 2024-09-12T17:47:05.659 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding auth protocol: cephx 2024-09-12T17:47:05.659 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding auth protocol: cephx 2024-09-12T17:47:05.659 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: secure 2024-09-12T17:47:05.659 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: crc 2024-09-12T17:47:05.659 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: secure 2024-09-12T17:47:05.659 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: crc 2024-09-12T17:47:05.659 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: secure 2024-09-12T17:47:05.659 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: crc 2024-09-12T17:47:05.659 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: crc 2024-09-12T17:47:05.659 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: secure 2024-09-12T17:47:05.659 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: crc 2024-09-12T17:47:05.660 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: secure 2024-09-12T17:47:05.660 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: crc 2024-09-12T17:47:05.660 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: secure 2024-09-12T17:47:05.660 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:47:05.364+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.660 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:47:05.364+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.660 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command rotate-key cmddesc rotate-key hook 0x5639d70fb7a0 EEXIST 2024-09-12T17:47:05.660 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient: _reopen_session rank -1 2024-09-12T17:47:05.660 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:47:05.660 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-c con 0x5639d7123ea0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:05.660 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-a con 0x5639d7124280 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:05.660 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-b con 0x5639d7122bb0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:05.660 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.660 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.661 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.661 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient(hunting): _renew_subs 2024-09-12T17:47:05.661 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient(hunting): authenticate will time out at 2198.001847s 2024-09-12T17:47:05.661 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:47:05.364+0000 7f8b8c922640 10 monclient(hunting): get_auth_request con 0x5639d7123ea0 auth_method 0 2024-09-12T17:47:05.661 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:47:05.364+0000 7f8b8c922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.661 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:47:05.364+0000 7f8b8c922640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.661 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:47:05.364+0000 7f8b8c922640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.661 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:47:05.364+0000 7f8b87fff640 10 monclient(hunting): get_auth_request con 0x5639d7124280 auth_method 0 2024-09-12T17:47:05.661 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:47:05.364+0000 7f8b87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.661 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:47:05.364+0000 7f8b87fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.661 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:47:05.364+0000 7f8b87fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.661 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:47:05.365+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.662 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:47:05.365+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.662 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:47:05.365+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.662 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:47:05.365+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.662 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:47:05.365+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.662 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:47:05.365+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.662 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:47:05.365+0000 7f8b8d123640 10 monclient(hunting): get_auth_request con 0x5639d7122bb0 auth_method 0 2024-09-12T17:47:05.662 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:47:05.365+0000 7f8b8d123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.662 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:47:05.365+0000 7f8b8d123640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.662 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:47:05.365+0000 7f8b8d123640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.662 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:47:05.365+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.662 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:47:05.365+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.662 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:47:05.365+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.662 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:47:05.365+0000 7f8b8c922640 10 monclient(hunting): handle_auth_done global_id 7790 payload 824 2024-09-12T17:47:05.663 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:47:05.365+0000 7f8b8c922640 10 monclient: _finish_hunting 0 2024-09-12T17:47:05.663 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:47:05.365+0000 7f8b8c922640 1 monclient: found mon.noname-c 2024-09-12T17:47:05.663 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:47:05.365+0000 7f8b8c922640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:47:05.663 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:05.663 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:47:05.663 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: dump: 2024-09-12T17:47:05.663 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:05.663 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:05.663 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.663 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.663 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:05.663 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.664 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:05.664 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:05.664 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:05.664 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.664 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: _finish_auth 0 2024-09-12T17:47:05.664 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: _check_auth_tickets 2024-09-12T17:47:05.664 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:47:05.664 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:05.664 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:47:05.664 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: dump: 2024-09-12T17:47:05.664 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:05.664 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:05.665 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.665 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.665 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:05.665 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.665 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:05.665 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:05.665 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:05.665 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.665 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:47:05.365+0000 7f8b9120f800 5 monclient: authenticate success, global_id 7790 2024-09-12T17:47:05.665 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:47:05.365+0000 7f8b9120f800 10 monclient: _renew_subs 2024-09-12T17:47:05.665 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:47:05.365+0000 7f8b8d924640 4 set_mon_vals no callback set 2024-09-12T17:47:05.665 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:47:05.365+0000 7f8b9120f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:47:05.665 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:47:05.365+0000 7f8b9120f800 10 monclient: _renew_subs 2024-09-12T17:47:05.666 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:47:05.365+0000 7f8b9120f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:47:05.666 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:47:05.367+0000 7f8a727fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:47:05.666 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:47:05.367+0000 7f8a727fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:05.666 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:47:05.367+0000 7f8a727fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:05.666 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:47:05.367+0000 7f8b87fff640 10 monclient: get_auth_request con 0x7f8a64076380 auth_method 0 2024-09-12T17:47:05.666 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:47:05.367+0000 7f8b9120f800 10 monclient: get_monmap_and_config 2024-09-12T17:47:05.666 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:47:05.367+0000 7f8b9120f800 10 monclient: build_initial_monmap 2024-09-12T17:47:05.666 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:47:05.367+0000 7f8b9120f800 1 build_initial for_mkfs: 0 2024-09-12T17:47:05.666 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:47:05.367+0000 7f8b9120f800 10 monclient: monmap: 2024-09-12T17:47:05.666 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:47:05.666 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:47:05.666 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:47:05.666 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:47:05.667 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:47:05.667 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.667 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:47:05.667 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:47:05.667 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:47:05.667 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.667 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding auth protocol: cephx 2024-09-12T17:47:05.667 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding auth protocol: cephx 2024-09-12T17:47:05.667 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding auth protocol: cephx 2024-09-12T17:47:05.667 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: secure 2024-09-12T17:47:05.667 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: crc 2024-09-12T17:47:05.667 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: secure 2024-09-12T17:47:05.667 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: crc 2024-09-12T17:47:05.668 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: secure 2024-09-12T17:47:05.668 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: crc 2024-09-12T17:47:05.668 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: crc 2024-09-12T17:47:05.668 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: secure 2024-09-12T17:47:05.668 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: crc 2024-09-12T17:47:05.668 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: secure 2024-09-12T17:47:05.668 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: crc 2024-09-12T17:47:05.668 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: secure 2024-09-12T17:47:05.668 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:47:05.368+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.668 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient: init 2024-09-12T17:47:05.668 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding auth protocol: cephx 2024-09-12T17:47:05.668 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding auth protocol: cephx 2024-09-12T17:47:05.669 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding auth protocol: cephx 2024-09-12T17:47:05.669 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: secure 2024-09-12T17:47:05.669 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: crc 2024-09-12T17:47:05.669 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: secure 2024-09-12T17:47:05.669 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: crc 2024-09-12T17:47:05.669 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: secure 2024-09-12T17:47:05.669 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: crc 2024-09-12T17:47:05.669 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: crc 2024-09-12T17:47:05.669 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: secure 2024-09-12T17:47:05.669 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: crc 2024-09-12T17:47:05.669 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: secure 2024-09-12T17:47:05.670 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: crc 2024-09-12T17:47:05.670 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: secure 2024-09-12T17:47:05.670 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:47:05.368+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.670 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:47:05.368+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.670 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command rotate-key cmddesc rotate-key hook 0x7fffe49285d8 EEXIST 2024-09-12T17:47:05.670 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient: _reopen_session rank -1 2024-09-12T17:47:05.670 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:47:05.670 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-b con 0x5639d71783f0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:05.670 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-a con 0x5639d7168d40 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:05.670 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-c con 0x5639d7173820 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:05.670 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.671 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.671 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.671 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient(hunting): _renew_subs 2024-09-12T17:47:05.671 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient(hunting): authenticate will time out at 2198.005883s 2024-09-12T17:47:05.671 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:47:05.369+0000 7f8b8d123640 10 monclient(hunting): get_auth_request con 0x5639d7173820 auth_method 0 2024-09-12T17:47:05.671 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:47:05.369+0000 7f8b8d123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.671 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:47:05.369+0000 7f8b8d123640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.671 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:47:05.369+0000 7f8b8d123640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.671 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient(hunting): get_auth_request con 0x5639d7168d40 auth_method 0 2024-09-12T17:47:05.671 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.671 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.671 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.671 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:47:05.369+0000 7f8b8c922640 10 monclient(hunting): get_auth_request con 0x5639d71783f0 auth_method 0 2024-09-12T17:47:05.672 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:47:05.369+0000 7f8b8c922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.672 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:47:05.369+0000 7f8b8c922640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.672 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:47:05.369+0000 7f8b8c922640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.672 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:47:05.369+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.672 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:47:05.369+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.672 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:47:05.369+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.672 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.672 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.672 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.672 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:47:05.369+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.672 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:47:05.369+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.672 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:47:05.369+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.673 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient(hunting): handle_auth_done global_id 8337 payload 274 2024-09-12T17:47:05.673 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient: _finish_hunting 0 2024-09-12T17:47:05.673 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:47:05.369+0000 7f8b87fff640 1 monclient: found mon.noname-a 2024-09-12T17:47:05.673 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:47:05.673 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:05.673 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:47:05.673 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: dump: 2024-09-12T17:47:05.673 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:05.673 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:05.673 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.673 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.673 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:05.673 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.674 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:05.674 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:05.674 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:05.674 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.674 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: _finish_auth 0 2024-09-12T17:47:05.674 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: _check_auth_tickets 2024-09-12T17:47:05.674 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:47:05.674 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:47:05.369+0000 7f8b9120f800 5 monclient: authenticate success, global_id 8337 2024-09-12T17:47:05.674 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:47:05.369+0000 7f8b9120f800 10 monclient: get_monmap_and_config success 2024-09-12T17:47:05.674 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:47:05.369+0000 7f8b9120f800 4 set_mon_vals no callback set 2024-09-12T17:47:05.674 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:05.674 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:47:05.674 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: dump: 2024-09-12T17:47:05.674 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:05.675 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:05.675 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.675 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.675 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:05.675 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.675 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:05.675 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:05.675 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:05.675 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.675 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:47:05.370+0000 7f8b9120f800 10 monclient: shutdown 2024-09-12T17:47:05.675 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:47:05.370+0000 7f8b9120f800 10 monclient: build_initial_monmap 2024-09-12T17:47:05.675 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:47:05.370+0000 7f8b9120f800 1 build_initial for_mkfs: 0 2024-09-12T17:47:05.675 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:47:05.370+0000 7f8b9120f800 10 monclient: monmap: 2024-09-12T17:47:05.675 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:47:05.676 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:47:05.676 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:47:05.676 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:47:05.676 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:47:05.676 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.676 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:47:05.676 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:47:05.676 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:47:05.676 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.676 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding auth protocol: cephx 2024-09-12T17:47:05.676 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding auth protocol: cephx 2024-09-12T17:47:05.676 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding auth protocol: cephx 2024-09-12T17:47:05.677 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: secure 2024-09-12T17:47:05.677 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: crc 2024-09-12T17:47:05.677 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: secure 2024-09-12T17:47:05.677 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: crc 2024-09-12T17:47:05.677 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: secure 2024-09-12T17:47:05.677 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: crc 2024-09-12T17:47:05.677 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: crc 2024-09-12T17:47:05.677 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: secure 2024-09-12T17:47:05.677 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: crc 2024-09-12T17:47:05.677 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: secure 2024-09-12T17:47:05.677 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: crc 2024-09-12T17:47:05.677 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: secure 2024-09-12T17:47:05.678 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:47:05.370+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.678 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:47:05.370+0000 7f8b9120f800 1 librados: starting msgr at 2024-09-12T17:47:05.678 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:47:05.370+0000 7f8b9120f800 1 librados: starting objecter 2024-09-12T17:47:05.678 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command objecter_requests cmddesc objecter_requests hook 0x5639d7149f90 EEXIST 2024-09-12T17:47:05.678 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:47:05.370+0000 7f8b9120f800 1 librados: setting wanted keys 2024-09-12T17:47:05.678 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:47:05.370+0000 7f8b9120f800 1 librados: calling monclient init 2024-09-12T17:47:05.678 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:47:05.370+0000 7f8b9120f800 10 monclient: init 2024-09-12T17:47:05.678 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding auth protocol: cephx 2024-09-12T17:47:05.678 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding auth protocol: cephx 2024-09-12T17:47:05.678 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding auth protocol: cephx 2024-09-12T17:47:05.678 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: secure 2024-09-12T17:47:05.678 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: crc 2024-09-12T17:47:05.679 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: secure 2024-09-12T17:47:05.679 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: crc 2024-09-12T17:47:05.679 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: secure 2024-09-12T17:47:05.679 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: crc 2024-09-12T17:47:05.679 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: crc 2024-09-12T17:47:05.679 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: secure 2024-09-12T17:47:05.679 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: crc 2024-09-12T17:47:05.679 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: secure 2024-09-12T17:47:05.679 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: crc 2024-09-12T17:47:05.679 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: secure 2024-09-12T17:47:05.679 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:47:05.371+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.679 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:47:05.371+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.680 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:47:05.371+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command rotate-key cmddesc rotate-key hook 0x5639d71388a8 EEXIST 2024-09-12T17:47:05.680 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient: _reopen_session rank -1 2024-09-12T17:47:05.680 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:47:05.680 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-b con 0x5639d7168d40 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:05.680 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-c con 0x5639d7173820 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:05.680 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-a con 0x5639d71783f0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:05.680 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.680 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.680 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.680 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient(hunting): _renew_subs 2024-09-12T17:47:05.680 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient(hunting): authenticate will time out at 2198.008430s 2024-09-12T17:47:05.680 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:47:05.371+0000 7f8b87fff640 10 monclient(hunting): get_auth_request con 0x5639d7173820 auth_method 0 2024-09-12T17:47:05.680 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:47:05.371+0000 7f8b87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.681 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:47:05.371+0000 7f8b87fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.681 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:47:05.371+0000 7f8b87fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.681 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient(hunting): get_auth_request con 0x5639d71783f0 auth_method 0 2024-09-12T17:47:05.681 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.681 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.681 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.681 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:47:05.371+0000 7f8b8c922640 10 monclient(hunting): get_auth_request con 0x5639d7168d40 auth_method 0 2024-09-12T17:47:05.681 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:47:05.371+0000 7f8b8c922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.681 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:47:05.371+0000 7f8b8c922640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.681 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:47:05.371+0000 7f8b8c922640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.681 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:47:05.371+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.681 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:47:05.371+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.682 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:47:05.371+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.682 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.682 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.682 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.682 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:47:05.371+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.682 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:47:05.371+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.682 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:47:05.371+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.682 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient(hunting): handle_auth_done global_id 8340 payload 824 2024-09-12T17:47:05.682 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient: _finish_hunting 0 2024-09-12T17:47:05.682 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:47:05.371+0000 7f8b8d123640 1 monclient: found mon.noname-a 2024-09-12T17:47:05.682 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:47:05.682 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:05.683 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:47:05.683 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: dump: 2024-09-12T17:47:05.683 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:05.683 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:05.683 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.683 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.683 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:05.683 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.683 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:05.683 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:05.683 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:05.683 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.683 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: _finish_auth 0 2024-09-12T17:47:05.684 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: _check_auth_tickets 2024-09-12T17:47:05.684 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:47:05.684 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:05.684 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:47:05.684 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: dump: 2024-09-12T17:47:05.684 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:05.684 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:05.684 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.684 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.684 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:05.684 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.684 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:05.684 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:05.685 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:05.685 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.685 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:47:05.372+0000 7f8b9120f800 5 monclient: authenticate success, global_id 8340 2024-09-12T17:47:05.685 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:47:05.372+0000 7f8a63fff640 4 set_mon_vals no callback set 2024-09-12T17:47:05.685 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:47:05.372+0000 7f8b9120f800 10 monclient: _renew_subs 2024-09-12T17:47:05.685 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:47:05.372+0000 7f8b9120f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:47:05.685 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:47:05.372+0000 7f8b9120f800 10 monclient: _renew_subs 2024-09-12T17:47:05.685 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:47:05.372+0000 7f8b9120f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:47:05.685 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:47:05.372+0000 7f8b9120f800 1 librados: init done 2024-09-12T17:47:05.685 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:47:05.372+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command cr dump hook 0x5639d716e528 2024-09-12T17:47:05.685 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:47:05.374+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.685 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:47:05.375+0000 7f8a627fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:47:05.686 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:47:05.375+0000 7f8a627fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:05.686 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:47:05.375+0000 7f8a627fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:05.686 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:47:05.375+0000 7f8b8c922640 10 monclient: get_auth_request con 0x7f8a58076470 auth_method 0 2024-09-12T17:47:05.686 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:47:05.375+0000 7f8b87fff640 10 monclient: get_auth_request con 0x5639d7192610 auth_method 0 2024-09-12T17:47:05.686 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.686 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:47:05.376+0000 7f8b9120f800 20 realm 2024-09-12T17:47:05.686 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.686 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.686 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:47:05.376+0000 7f8b9120f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:05.686 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.686 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.686 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.687 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:47:05.376+0000 7f8b8c922640 10 monclient: get_auth_request con 0x5639d7196800 auth_method 0 2024-09-12T17:47:05.687 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:47:05.377+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:05.687 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:47:05.377+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.687 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:47:05.377+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:05.687 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:47:05.377+0000 7f8b9120f800 20 searching for the correct realm 2024-09-12T17:47:05.687 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:47:05.378+0000 7f8b87fff640 10 monclient: get_auth_request con 0x5639d719ba50 auth_method 0 2024-09-12T17:47:05.687 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:47:05.378+0000 7f8b8d123640 10 monclient: get_auth_request con 0x7f8b7804f040 auth_method 0 2024-09-12T17:47:05.687 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:47:05.379+0000 7f8b8c922640 10 monclient: get_auth_request con 0x7f8b88018040 auth_method 0 2024-09-12T17:47:05.687 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:47:05.380+0000 7f8b87fff640 10 monclient: get_auth_request con 0x7f8b800c9040 auth_method 0 2024-09-12T17:47:05.687 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:47:05.381+0000 7f8b8d123640 0 -- 172.21.15.44:0/2033573499 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f8b7804f040 msgr2=0x7f8b78090a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:05.687 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:47:05.381+0000 7f8a627fc640 1 client.8340.objecter ms_handle_reset 0x7f8b7804f040 session 0x7f8b78057040 osd.7 2024-09-12T17:47:05.687 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:47:05.381+0000 7f8a627fc640 10 monclient: _renew_subs 2024-09-12T17:47:05.687 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:47:05.381+0000 7f8a627fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:47:05.688 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:47:05.381+0000 7f8b8d123640 10 monclient: get_auth_request con 0x7f8a58086290 auth_method 0 2024-09-12T17:47:05.688 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:47:05.382+0000 7f8b8d123640 10 monclient: get_auth_request con 0x7f8b78026030 auth_method 0 2024-09-12T17:47:05.688 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:47:05.384+0000 7f8b8c922640 10 monclient: get_auth_request con 0x7f8b78084880 auth_method 0 2024-09-12T17:47:05.688 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:47:05.384+0000 7f8b8c922640 0 -- 172.21.15.44:0/2033573499 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f8b78084880 msgr2=0x7f8b78082f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:05.688 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:47:05.586+0000 7f8b8c922640 10 monclient: get_auth_request con 0x7f8b78084880 auth_method 0 2024-09-12T17:47:05.688 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:47:05.688 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:47:05.688 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:05.688 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:05.688 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:05.688 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:05.688 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:47:05.591+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.689 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.689 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.689 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:05.689 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.689 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:05.689 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:47:05.592+0000 7f8b9120f800 20 zone default found 2024-09-12T17:47:05.689 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:47:05.592+0000 7f8b9120f800 4 Realm: () 2024-09-12T17:47:05.689 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:47:05.592+0000 7f8b9120f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:47:05.689 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:47:05.592+0000 7f8b9120f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:47:05.689 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:47:05.592+0000 7f8b9120f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:05.689 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:47:05.592+0000 7f8b9120f800 20 zonegroup default 2024-09-12T17:47:05.689 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.689 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:47:05.593+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.690 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:47:05.593+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.690 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:47:05.593+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.690 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:47:05.593+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.690 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:47:05.593+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.690 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:47:05.593+0000 7f8b9120f800 20 started sync module instance, tier type = 2024-09-12T17:47:05.690 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:47:05.593+0000 7f8b9120f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:47:05.690 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=0 2024-09-12T17:47:05.690 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=1 2024-09-12T17:47:05.690 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=2 2024-09-12T17:47:05.690 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=3 2024-09-12T17:47:05.690 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=4 2024-09-12T17:47:05.690 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=5 2024-09-12T17:47:05.690 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=6 2024-09-12T17:47:05.690 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:47:05.604+0000 7f8b9120f800 20 add_watcher() i=7 2024-09-12T17:47:05.691 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:47:05.604+0000 7f8b9120f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:05.691 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding auth protocol: cephx 2024-09-12T17:47:05.691 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding auth protocol: cephx 2024-09-12T17:47:05.691 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding auth protocol: cephx 2024-09-12T17:47:05.691 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: secure 2024-09-12T17:47:05.691 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: crc 2024-09-12T17:47:05.691 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: secure 2024-09-12T17:47:05.691 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: crc 2024-09-12T17:47:05.691 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: secure 2024-09-12T17:47:05.691 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: crc 2024-09-12T17:47:05.691 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: crc 2024-09-12T17:47:05.691 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: secure 2024-09-12T17:47:05.691 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: crc 2024-09-12T17:47:05.692 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: secure 2024-09-12T17:47:05.692 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: crc 2024-09-12T17:47:05.692 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: secure 2024-09-12T17:47:05.692 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:47:05.605+0000 7f8a42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:05.692 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:47:05.606+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.692 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:47:05.606+0000 7f8b9120f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:05.692 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:47:05.606+0000 7f8b9120f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:05.692 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command cache list hook 0x5639d716f6f0 2024-09-12T17:47:05.692 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command cache inspect hook 0x5639d716f6f0 2024-09-12T17:47:05.692 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command cache erase hook 0x5639d716f6f0 2024-09-12T17:47:05.692 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command cache zap hook 0x5639d716f6f0 2024-09-12T17:47:05.692 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 note: GC not initialized 2024-09-12T17:47:05.693 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:47:05.606+0000 7f8a41fe3640 20 reqs_thread_entry: start 2024-09-12T17:47:05.693 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command sync trace show hook 0x7f8b880056b0 2024-09-12T17:47:05.693 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command sync trace history hook 0x7f8b880056b0 2024-09-12T17:47:05.693 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command sync trace active hook 0x7f8b880056b0 2024-09-12T17:47:05.693 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command sync trace active_short hook 0x7f8b880056b0 2024-09-12T17:47:05.693 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:47:05.606+0000 7f8b9120f800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:05.693 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:47:05.606+0000 7f8b9120f800 20 Filter name: none 2024-09-12T17:47:05.693 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:47:05.606+0000 7f89b37fe640 20 reqs_thread_entry: start 2024-09-12T17:47:05.693 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:47:05.606+0000 7f8b9120f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:47:05.693 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:47:05.606+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.693 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:47:05.607+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:05.693 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:47:05.607+0000 7f8b9120f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:47:05.693 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:47:05.607+0000 7f8b9120f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:47:05.694 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:47:05.607+0000 7f8b9120f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:47:05.694 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:47:05.607+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.694 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:47:05.607+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:05.694 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:47:05.607+0000 7f8b9120f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:05.694 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:47:05.607+0000 7f8b9120f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:05.694 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:47:05.607+0000 7f8b9120f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:05.694 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:47:05.607+0000 7f8b9120f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:05.694 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:47:05.607+0000 7f8b9120f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:47:05.694 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:47:05.614+0000 7f8b9120f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:05.694 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:47:05.614+0000 7f8b9120f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:05.694 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:47:05.614+0000 7f8b9120f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:05.694 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:47:05.614+0000 7f8b9120f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:47:05.695 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:47:05.614+0000 7f8a637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562464 cookie 94806421930096 notifier 8340 bl.length()=911 2024-09-12T17:47:05.695 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:47:05.614+0000 7f8a637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:05.695 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:47:05.614+0000 7f8a637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:05.695 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:47:05.614+0000 7f8a637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:05.695 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:47:05.615+0000 7f8b9120f800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:47:05.695 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:47:05.615+0000 7f8b9120f800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:47:05.695 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:47:05.615+0000 7f8b9120f800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:47:05.695 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:47:05.615+0000 7f8b9120f800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:47:05.695 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:47:05.621+0000 7f8b9120f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8b9120f800 time 2024-09-12T17:47:05.622305+0000 2024-09-12T17:47:05.695 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:47:05.695 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.695 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:47:05.695 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8b9238c71a] 2024-09-12T17:47:05.696 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8b9238c8d8] 2024-09-12T17:47:05.696 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5639d476e841] 2024-09-12T17:47:05.696 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5639d477e57a] 2024-09-12T17:47:05.696 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2024-09-12T17:47:05.696 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f8b91029590] 2024-09-12T17:47:05.696 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2024-09-12T17:47:05.696 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2024-09-12T17:47:05.696 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.696 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:47:05.622+0000 7f8b9120f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:47:05.696 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f8b9120f800 thread_name:radosgw-admin 2024-09-12T17:47:05.696 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.696 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:47:05.697 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8b9103e6f0] 2024-09-12T17:47:05.697 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8b9108b99c] 2024-09-12T17:47:05.697 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:47:05.697 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:47:05.697 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8b9238c774] 2024-09-12T17:47:05.697 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8b9238c8d8] 2024-09-12T17:47:05.697 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5639d476e841] 2024-09-12T17:47:05.697 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5639d477e57a] 2024-09-12T17:47:05.697 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2024-09-12T17:47:05.697 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f8b91029590] 2024-09-12T17:47:05.697 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2024-09-12T17:47:05.698 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2024-09-12T17:47:05.698 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:47:05.698 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.698 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:47:05.698 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:47:05.698 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:47:05.698 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:47:05.698 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:47:05.698 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:47:05.698 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:47:05.698 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:47:05.698 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:47:05.698 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:47:05.699 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:47:05.699 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:47:05.699 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:47:05.699 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:47:05.699 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:47:05.699 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:47:05.699 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:47:05.699 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:47:05.699 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:47:05.699 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:47:05.699 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:47:05.699 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:47:05.700 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:47:05.700 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:47:05.700 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:47:05.700 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:47:05.700 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:47:05.700 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:47:05.700 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:47:05.700 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:47:05.700 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:47:05.700 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:47:05.700 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:47:05.700 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:47:05.700 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:47:05.701 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:47:05.701 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:47:05.701 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:47:05.701 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:47:05.701 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:47:05.701 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:47:05.701 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:47:05.701 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:47:05.701 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:47:05.701 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:47:05.701 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:47:05.701 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:47:05.702 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:47:05.702 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:47:05.702 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:47:05.702 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:47:05.702 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:47:05.702 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:47:05.702 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:47:05.702 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:47:05.702 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:47:05.702 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:47:05.702 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:47:05.702 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:47:05.702 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:47:05.702 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:47:05.703 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:47:05.703 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:47:05.703 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:47:05.703 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:47:05.703 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:47:05.703 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:47:05.703 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:47:05.703 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:47:05.703 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:47:05.703 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:47:05.703 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:47:05.703 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:47:05.703 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:47:05.704 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:47:05.704 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:47:05.704 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:47:05.704 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:47:05.704 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:47:05.704 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:47:05.704 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:47:05.704 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:47:05.704 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:47:05.704 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:47:05.704 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:47:05.704 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:47:05.704 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:47:05.705 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:47:05.705 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:47:05.705 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:47:05.705 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:47:05.705 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:47:05.705 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:47:05.705 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:47:05.705 INFO:tasks.workunit.client.0.smithi044.stderr: 7f89b37fe640 / http_manager 2024-09-12T17:47:05.705 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8a41fe3640 / http_manager 2024-09-12T17:47:05.705 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8a42fe5640 / rgw_dt_lg_renew 2024-09-12T17:47:05.705 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8a627fc640 / ms_dispatch 2024-09-12T17:47:05.705 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8a637fe640 / io_context_pool 2024-09-12T17:47:05.705 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8a63fff640 / io_context_pool 2024-09-12T17:47:05.706 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8a727fc640 / ms_dispatch 2024-09-12T17:47:05.706 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8a79602640 / ms_dispatch 2024-09-12T17:47:05.706 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8a7ae05640 / io_context_pool 2024-09-12T17:47:05.706 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8b87fff640 / msgr-worker-2 2024-09-12T17:47:05.706 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8b8c922640 / msgr-worker-1 2024-09-12T17:47:05.706 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8b8d123640 / msgr-worker-0 2024-09-12T17:47:05.706 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8b8d924640 / io_context_pool 2024-09-12T17:47:05.706 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8b9120f800 / radosgw-admin 2024-09-12T17:47:05.706 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:47:05.706 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:47:05.706 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/log/ceph/ceph-client.admin.151534.log 2024-09-12T17:47:05.706 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:47:05.707 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:47:05.707 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:47:05.355+0000 7f8b9120f800 5 asok(0x5639d6e85730) unregister_commands rotate-key 2024-09-12T17:47:05.707 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:47:05.356+0000 7f8b9120f800 10 monclient: build_initial_monmap 2024-09-12T17:47:05.707 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:47:05.356+0000 7f8b9120f800 1 build_initial for_mkfs: 0 2024-09-12T17:47:05.707 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:47:05.356+0000 7f8b9120f800 10 monclient: monmap: 2024-09-12T17:47:05.707 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:47:05.707 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:47:05.707 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:47:05.707 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:47:05.707 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:47:05.707 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.707 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:47:05.707 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:47:05.708 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:47:05.708 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.708 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding auth protocol: cephx 2024-09-12T17:47:05.708 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding auth protocol: cephx 2024-09-12T17:47:05.708 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding auth protocol: cephx 2024-09-12T17:47:05.708 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: secure 2024-09-12T17:47:05.708 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: crc 2024-09-12T17:47:05.708 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: secure 2024-09-12T17:47:05.708 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: crc 2024-09-12T17:47:05.708 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: secure 2024-09-12T17:47:05.708 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: crc 2024-09-12T17:47:05.708 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: crc 2024-09-12T17:47:05.709 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: secure 2024-09-12T17:47:05.709 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: crc 2024-09-12T17:47:05.709 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: secure 2024-09-12T17:47:05.709 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: crc 2024-09-12T17:47:05.709 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70ad250) adding con mode: secure 2024-09-12T17:47:05.709 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:47:05.356+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.709 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:47:05.356+0000 7f8b9120f800 1 librados: starting msgr at 2024-09-12T17:47:05.709 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:47:05.356+0000 7f8b9120f800 1 librados: starting objecter 2024-09-12T17:47:05.709 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command objecter_requests hook 0x5639d70aea60 2024-09-12T17:47:05.709 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:47:05.356+0000 7f8b9120f800 1 librados: setting wanted keys 2024-09-12T17:47:05.709 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:47:05.356+0000 7f8b9120f800 1 librados: calling monclient init 2024-09-12T17:47:05.709 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:47:05.356+0000 7f8b9120f800 10 monclient: init 2024-09-12T17:47:05.710 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding auth protocol: cephx 2024-09-12T17:47:05.710 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding auth protocol: cephx 2024-09-12T17:47:05.710 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding auth protocol: cephx 2024-09-12T17:47:05.710 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: secure 2024-09-12T17:47:05.710 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: crc 2024-09-12T17:47:05.710 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: secure 2024-09-12T17:47:05.710 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: crc 2024-09-12T17:47:05.710 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: secure 2024-09-12T17:47:05.710 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: crc 2024-09-12T17:47:05.710 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: crc 2024-09-12T17:47:05.710 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: secure 2024-09-12T17:47:05.710 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: crc 2024-09-12T17:47:05.711 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: secure 2024-09-12T17:47:05.711 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: crc 2024-09-12T17:47:05.711 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:47:05.356+0000 7f8b9120f800 5 AuthRegistry(0x5639d70a7a60) adding con mode: secure 2024-09-12T17:47:05.711 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:47:05.356+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.711 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:47:05.357+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.711 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:47:05.357+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command rotate-key hook 0x5639d70a7ba8 2024-09-12T17:47:05.711 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient: _reopen_session rank -1 2024-09-12T17:47:05.711 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:47:05.711 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-a con 0x5639d6f1bc20 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:05.711 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-c con 0x5639d6fea650 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:05.711 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-b con 0x5639d70d68f0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:05.711 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.712 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.712 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.712 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient(hunting): _renew_subs 2024-09-12T17:47:05.712 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient(hunting): authenticate will time out at 2197.994231s 2024-09-12T17:47:05.712 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient(hunting): get_auth_request con 0x5639d6fea650 auth_method 0 2024-09-12T17:47:05.712 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.712 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.712 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.712 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:47:05.357+0000 7f8b8c922640 10 monclient(hunting): get_auth_request con 0x5639d6f1bc20 auth_method 0 2024-09-12T17:47:05.712 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:47:05.357+0000 7f8b8c922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.712 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:47:05.357+0000 7f8b8c922640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.712 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:47:05.357+0000 7f8b8c922640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.713 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.713 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.713 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.713 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:47:05.357+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.713 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:47:05.357+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.713 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:47:05.357+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.713 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:47:05.357+0000 7f8b8d123640 10 monclient(hunting): get_auth_request con 0x5639d70d68f0 auth_method 0 2024-09-12T17:47:05.713 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:47:05.357+0000 7f8b8d123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.713 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:47:05.357+0000 7f8b8d123640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.714 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:47:05.357+0000 7f8b8d123640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.714 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient(hunting): handle_auth_done global_id 7787 payload 824 2024-09-12T17:47:05.714 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient: _finish_hunting 0 2024-09-12T17:47:05.714 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:47:05.357+0000 7f8b87fff640 1 monclient: found mon.noname-c 2024-09-12T17:47:05.714 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:47:05.357+0000 7f8b87fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:47:05.716 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:05.716 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:47:05.716 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: dump: 2024-09-12T17:47:05.716 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:05.716 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:05.716 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.717 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.717 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:05.717 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.717 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:05.717 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:05.717 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:05.717 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.717 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: _finish_auth 0 2024-09-12T17:47:05.717 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: _check_auth_tickets 2024-09-12T17:47:05.717 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:47:05.717 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:47:05.357+0000 7f8b9120f800 5 monclient: authenticate success, global_id 7787 2024-09-12T17:47:05.717 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient: _renew_subs 2024-09-12T17:47:05.717 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:47:05.718 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:05.718 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:47:05.718 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:47:05.357+0000 7f8a79602640 10 monclient: dump: 2024-09-12T17:47:05.718 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:05.718 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:05.718 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.718 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.718 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:05.718 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.718 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:05.718 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:05.718 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:05.718 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.719 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:47:05.357+0000 7f8a7ae05640 4 set_mon_vals no callback set 2024-09-12T17:47:05.719 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient: _renew_subs 2024-09-12T17:47:05.719 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:47:05.357+0000 7f8b9120f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:47:05.719 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:47:05.358+0000 7f8b9120f800 1 librados: init done 2024-09-12T17:47:05.719 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:47:05.359+0000 7f8a79602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:47:05.719 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:47:05.359+0000 7f8a79602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:05.719 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:47:05.359+0000 7f8a79602640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:05.719 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:47:05.360+0000 7f8b8c922640 10 monclient: get_auth_request con 0x7f8a74076470 auth_method 0 2024-09-12T17:47:05.719 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:47:05.360+0000 7f8b8d123640 10 monclient: get_auth_request con 0x5639d70e6730 auth_method 0 2024-09-12T17:47:05.719 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:47:05.361+0000 7f8b8c922640 10 monclient: get_auth_request con 0x5639d70f3600 auth_method 0 2024-09-12T17:47:05.719 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:47:05.362+0000 7f8b87fff640 10 monclient: get_auth_request con 0x5639d70f8690 auth_method 0 2024-09-12T17:47:05.719 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:47:05.363+0000 7f8b9120f800 10 monclient: build_initial_monmap 2024-09-12T17:47:05.720 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:47:05.363+0000 7f8b9120f800 1 build_initial for_mkfs: 0 2024-09-12T17:47:05.720 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:47:05.363+0000 7f8b9120f800 10 monclient: monmap: 2024-09-12T17:47:05.720 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:47:05.720 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:47:05.720 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:47:05.720 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:47:05.720 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:47:05.720 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.720 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:47:05.720 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:47:05.720 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:47:05.720 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.721 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding auth protocol: cephx 2024-09-12T17:47:05.721 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding auth protocol: cephx 2024-09-12T17:47:05.721 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding auth protocol: cephx 2024-09-12T17:47:05.721 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: secure 2024-09-12T17:47:05.721 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: crc 2024-09-12T17:47:05.721 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: secure 2024-09-12T17:47:05.721 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: crc 2024-09-12T17:47:05.721 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: secure 2024-09-12T17:47:05.721 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: crc 2024-09-12T17:47:05.721 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: crc 2024-09-12T17:47:05.721 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: secure 2024-09-12T17:47:05.721 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: crc 2024-09-12T17:47:05.722 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: secure 2024-09-12T17:47:05.722 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: crc 2024-09-12T17:47:05.722 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:47:05.363+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fc650) adding con mode: secure 2024-09-12T17:47:05.722 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:47:05.364+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.722 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command objecter_requests cmddesc objecter_requests hook 0x5639d70ffb80 EEXIST 2024-09-12T17:47:05.722 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient: init 2024-09-12T17:47:05.722 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding auth protocol: cephx 2024-09-12T17:47:05.722 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding auth protocol: cephx 2024-09-12T17:47:05.722 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding auth protocol: cephx 2024-09-12T17:47:05.722 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: secure 2024-09-12T17:47:05.722 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: crc 2024-09-12T17:47:05.722 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: secure 2024-09-12T17:47:05.723 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: crc 2024-09-12T17:47:05.723 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: secure 2024-09-12T17:47:05.723 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: crc 2024-09-12T17:47:05.723 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: crc 2024-09-12T17:47:05.723 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: secure 2024-09-12T17:47:05.723 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: crc 2024-09-12T17:47:05.723 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: secure 2024-09-12T17:47:05.723 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: crc 2024-09-12T17:47:05.723 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 AuthRegistry(0x5639d70fb658) adding con mode: secure 2024-09-12T17:47:05.723 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:47:05.364+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.723 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:47:05.364+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.723 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:47:05.364+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command rotate-key cmddesc rotate-key hook 0x5639d70fb7a0 EEXIST 2024-09-12T17:47:05.724 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient: _reopen_session rank -1 2024-09-12T17:47:05.724 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:47:05.724 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-c con 0x5639d7123ea0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:05.724 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-a con 0x5639d7124280 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:05.724 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-b con 0x5639d7122bb0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:05.724 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.724 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.724 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.724 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient(hunting): _renew_subs 2024-09-12T17:47:05.724 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:47:05.364+0000 7f8b9120f800 10 monclient(hunting): authenticate will time out at 2198.001847s 2024-09-12T17:47:05.724 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:47:05.364+0000 7f8b8c922640 10 monclient(hunting): get_auth_request con 0x5639d7123ea0 auth_method 0 2024-09-12T17:47:05.724 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:47:05.364+0000 7f8b8c922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.724 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:47:05.364+0000 7f8b8c922640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.725 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:47:05.364+0000 7f8b8c922640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.725 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:47:05.364+0000 7f8b87fff640 10 monclient(hunting): get_auth_request con 0x5639d7124280 auth_method 0 2024-09-12T17:47:05.725 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:47:05.364+0000 7f8b87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.725 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:47:05.364+0000 7f8b87fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.725 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:47:05.364+0000 7f8b87fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.725 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:47:05.365+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.725 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:47:05.365+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.725 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:47:05.365+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.725 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:47:05.365+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.725 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:47:05.365+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.725 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:47:05.365+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.725 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:47:05.365+0000 7f8b8d123640 10 monclient(hunting): get_auth_request con 0x5639d7122bb0 auth_method 0 2024-09-12T17:47:05.726 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:47:05.365+0000 7f8b8d123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.726 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:47:05.365+0000 7f8b8d123640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.726 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:47:05.365+0000 7f8b8d123640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.726 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:47:05.365+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.726 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:47:05.365+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.726 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:47:05.365+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.726 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:47:05.365+0000 7f8b8c922640 10 monclient(hunting): handle_auth_done global_id 7790 payload 824 2024-09-12T17:47:05.726 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:47:05.365+0000 7f8b8c922640 10 monclient: _finish_hunting 0 2024-09-12T17:47:05.726 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:47:05.365+0000 7f8b8c922640 1 monclient: found mon.noname-c 2024-09-12T17:47:05.726 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:47:05.365+0000 7f8b8c922640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:47:05.726 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:05.726 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:47:05.726 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: dump: 2024-09-12T17:47:05.727 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:05.727 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:05.727 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.727 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.727 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:05.727 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.727 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:05.727 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:05.727 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:05.727 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.727 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: _finish_auth 0 2024-09-12T17:47:05.727 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: _check_auth_tickets 2024-09-12T17:47:05.728 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:47:05.728 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:05.728 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:47:05.728 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:47:05.365+0000 7f8a727fc640 10 monclient: dump: 2024-09-12T17:47:05.728 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:05.728 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:05.728 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.728 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.728 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:05.728 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.728 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:05.728 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:05.728 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:05.728 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.729 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:47:05.365+0000 7f8b9120f800 5 monclient: authenticate success, global_id 7790 2024-09-12T17:47:05.729 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:47:05.365+0000 7f8b9120f800 10 monclient: _renew_subs 2024-09-12T17:47:05.729 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:47:05.365+0000 7f8b8d924640 4 set_mon_vals no callback set 2024-09-12T17:47:05.729 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:47:05.365+0000 7f8b9120f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:47:05.729 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:47:05.365+0000 7f8b9120f800 10 monclient: _renew_subs 2024-09-12T17:47:05.729 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:47:05.365+0000 7f8b9120f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:47:05.729 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:47:05.367+0000 7f8a727fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:47:05.729 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:47:05.367+0000 7f8a727fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:05.729 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:47:05.367+0000 7f8a727fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:05.729 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:47:05.367+0000 7f8b87fff640 10 monclient: get_auth_request con 0x7f8a64076380 auth_method 0 2024-09-12T17:47:05.729 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:47:05.367+0000 7f8b9120f800 10 monclient: get_monmap_and_config 2024-09-12T17:47:05.729 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:47:05.367+0000 7f8b9120f800 10 monclient: build_initial_monmap 2024-09-12T17:47:05.729 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:47:05.367+0000 7f8b9120f800 1 build_initial for_mkfs: 0 2024-09-12T17:47:05.730 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:47:05.367+0000 7f8b9120f800 10 monclient: monmap: 2024-09-12T17:47:05.730 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:47:05.730 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:47:05.730 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:47:05.730 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:47:05.730 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:47:05.730 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.730 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:47:05.730 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:47:05.731 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:47:05.731 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.731 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding auth protocol: cephx 2024-09-12T17:47:05.731 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding auth protocol: cephx 2024-09-12T17:47:05.731 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding auth protocol: cephx 2024-09-12T17:47:05.731 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: secure 2024-09-12T17:47:05.731 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: crc 2024-09-12T17:47:05.731 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: secure 2024-09-12T17:47:05.731 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: crc 2024-09-12T17:47:05.731 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: secure 2024-09-12T17:47:05.731 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: crc 2024-09-12T17:47:05.731 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: crc 2024-09-12T17:47:05.732 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: secure 2024-09-12T17:47:05.732 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: crc 2024-09-12T17:47:05.732 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: secure 2024-09-12T17:47:05.732 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: crc 2024-09-12T17:47:05.732 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:47:05.367+0000 7f8b9120f800 5 AuthRegistry(0x5639d7143dd0) adding con mode: secure 2024-09-12T17:47:05.732 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:47:05.368+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.732 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient: init 2024-09-12T17:47:05.732 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding auth protocol: cephx 2024-09-12T17:47:05.732 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding auth protocol: cephx 2024-09-12T17:47:05.732 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding auth protocol: cephx 2024-09-12T17:47:05.733 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: secure 2024-09-12T17:47:05.733 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: crc 2024-09-12T17:47:05.733 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: secure 2024-09-12T17:47:05.733 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: crc 2024-09-12T17:47:05.733 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: secure 2024-09-12T17:47:05.733 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: crc 2024-09-12T17:47:05.733 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: crc 2024-09-12T17:47:05.733 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: secure 2024-09-12T17:47:05.733 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: crc 2024-09-12T17:47:05.733 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: secure 2024-09-12T17:47:05.733 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: crc 2024-09-12T17:47:05.733 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928490) adding con mode: secure 2024-09-12T17:47:05.734 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:47:05.368+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.734 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:47:05.368+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.734 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:47:05.368+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command rotate-key cmddesc rotate-key hook 0x7fffe49285d8 EEXIST 2024-09-12T17:47:05.734 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient: _reopen_session rank -1 2024-09-12T17:47:05.734 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:47:05.734 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-b con 0x5639d71783f0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:05.734 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-a con 0x5639d7168d40 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:05.734 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-c con 0x5639d7173820 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:05.734 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.734 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.734 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.735 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient(hunting): _renew_subs 2024-09-12T17:47:05.735 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:47:05.368+0000 7f8b9120f800 10 monclient(hunting): authenticate will time out at 2198.005883s 2024-09-12T17:47:05.735 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:47:05.369+0000 7f8b8d123640 10 monclient(hunting): get_auth_request con 0x5639d7173820 auth_method 0 2024-09-12T17:47:05.735 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:47:05.369+0000 7f8b8d123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.735 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:47:05.369+0000 7f8b8d123640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.735 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:47:05.369+0000 7f8b8d123640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.735 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient(hunting): get_auth_request con 0x5639d7168d40 auth_method 0 2024-09-12T17:47:05.735 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.735 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.735 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.735 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:47:05.369+0000 7f8b8c922640 10 monclient(hunting): get_auth_request con 0x5639d71783f0 auth_method 0 2024-09-12T17:47:05.735 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:47:05.369+0000 7f8b8c922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.735 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:47:05.369+0000 7f8b8c922640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.736 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:47:05.369+0000 7f8b8c922640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.736 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:47:05.369+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.736 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:47:05.369+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.736 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:47:05.369+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.736 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.736 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.736 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.736 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:47:05.369+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.736 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:47:05.369+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.736 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:47:05.369+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.736 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient(hunting): handle_auth_done global_id 8337 payload 274 2024-09-12T17:47:05.736 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient: _finish_hunting 0 2024-09-12T17:47:05.736 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:47:05.369+0000 7f8b87fff640 1 monclient: found mon.noname-a 2024-09-12T17:47:05.737 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:47:05.369+0000 7f8b87fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:47:05.737 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:05.737 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:47:05.737 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: dump: 2024-09-12T17:47:05.737 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:05.737 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:05.737 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.737 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.737 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:05.737 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.737 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:05.738 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:05.738 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:05.738 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.738 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: _finish_auth 0 2024-09-12T17:47:05.738 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: _check_auth_tickets 2024-09-12T17:47:05.738 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:47:05.738 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:47:05.369+0000 7f8b9120f800 5 monclient: authenticate success, global_id 8337 2024-09-12T17:47:05.738 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:47:05.369+0000 7f8b9120f800 10 monclient: get_monmap_and_config success 2024-09-12T17:47:05.738 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:47:05.369+0000 7f8b9120f800 4 set_mon_vals no callback set 2024-09-12T17:47:05.738 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:05.738 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:47:05.738 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:47:05.369+0000 7f8a63fff640 10 monclient: dump: 2024-09-12T17:47:05.738 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:05.739 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:05.739 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.739 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.739 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:05.739 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.739 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:05.739 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:05.739 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:05.739 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.739 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:47:05.370+0000 7f8b9120f800 10 monclient: shutdown 2024-09-12T17:47:05.739 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:47:05.370+0000 7f8b9120f800 10 monclient: build_initial_monmap 2024-09-12T17:47:05.739 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:47:05.370+0000 7f8b9120f800 1 build_initial for_mkfs: 0 2024-09-12T17:47:05.739 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:47:05.370+0000 7f8b9120f800 10 monclient: monmap: 2024-09-12T17:47:05.739 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:47:05.740 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:47:05.740 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:47:05.740 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:47:05.740 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:47:05.740 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.740 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:47:05.740 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:47:05.740 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:47:05.740 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.740 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding auth protocol: cephx 2024-09-12T17:47:05.740 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding auth protocol: cephx 2024-09-12T17:47:05.740 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding auth protocol: cephx 2024-09-12T17:47:05.740 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: secure 2024-09-12T17:47:05.741 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: crc 2024-09-12T17:47:05.741 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: secure 2024-09-12T17:47:05.741 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: crc 2024-09-12T17:47:05.741 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: secure 2024-09-12T17:47:05.741 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: crc 2024-09-12T17:47:05.741 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: crc 2024-09-12T17:47:05.741 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: secure 2024-09-12T17:47:05.741 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: crc 2024-09-12T17:47:05.741 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: secure 2024-09-12T17:47:05.741 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: crc 2024-09-12T17:47:05.741 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7147950) adding con mode: secure 2024-09-12T17:47:05.741 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:47:05.370+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.741 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:47:05.370+0000 7f8b9120f800 1 librados: starting msgr at 2024-09-12T17:47:05.742 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:47:05.370+0000 7f8b9120f800 1 librados: starting objecter 2024-09-12T17:47:05.742 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command objecter_requests cmddesc objecter_requests hook 0x5639d7149f90 EEXIST 2024-09-12T17:47:05.742 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:47:05.370+0000 7f8b9120f800 1 librados: setting wanted keys 2024-09-12T17:47:05.742 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:47:05.370+0000 7f8b9120f800 1 librados: calling monclient init 2024-09-12T17:47:05.742 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:47:05.370+0000 7f8b9120f800 10 monclient: init 2024-09-12T17:47:05.742 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding auth protocol: cephx 2024-09-12T17:47:05.742 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding auth protocol: cephx 2024-09-12T17:47:05.742 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding auth protocol: cephx 2024-09-12T17:47:05.742 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: secure 2024-09-12T17:47:05.742 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: crc 2024-09-12T17:47:05.742 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: secure 2024-09-12T17:47:05.742 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: crc 2024-09-12T17:47:05.742 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: secure 2024-09-12T17:47:05.743 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: crc 2024-09-12T17:47:05.743 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: crc 2024-09-12T17:47:05.743 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: secure 2024-09-12T17:47:05.743 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: crc 2024-09-12T17:47:05.743 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: secure 2024-09-12T17:47:05.743 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: crc 2024-09-12T17:47:05.743 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:47:05.370+0000 7f8b9120f800 5 AuthRegistry(0x5639d7138760) adding con mode: secure 2024-09-12T17:47:05.743 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:47:05.371+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.743 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:47:05.371+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.743 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:47:05.371+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command rotate-key cmddesc rotate-key hook 0x5639d71388a8 EEXIST 2024-09-12T17:47:05.743 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient: _reopen_session rank -1 2024-09-12T17:47:05.743 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:47:05.744 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-b con 0x5639d7168d40 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:05.744 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-c con 0x5639d7173820 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:05.744 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient(hunting): picked mon.noname-a con 0x5639d71783f0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:05.744 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.744 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.744 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:05.744 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient(hunting): _renew_subs 2024-09-12T17:47:05.744 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:47:05.371+0000 7f8b9120f800 10 monclient(hunting): authenticate will time out at 2198.008430s 2024-09-12T17:47:05.744 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:47:05.371+0000 7f8b87fff640 10 monclient(hunting): get_auth_request con 0x5639d7173820 auth_method 0 2024-09-12T17:47:05.744 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:47:05.371+0000 7f8b87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.744 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:47:05.371+0000 7f8b87fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.744 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:47:05.371+0000 7f8b87fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.745 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient(hunting): get_auth_request con 0x5639d71783f0 auth_method 0 2024-09-12T17:47:05.745 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.745 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.745 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.745 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:47:05.371+0000 7f8b8c922640 10 monclient(hunting): get_auth_request con 0x5639d7168d40 auth_method 0 2024-09-12T17:47:05.745 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:47:05.371+0000 7f8b8c922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:05.745 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:47:05.371+0000 7f8b8c922640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:05.745 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:47:05.371+0000 7f8b8c922640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:05.745 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:47:05.371+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.745 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:47:05.371+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.745 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:47:05.371+0000 7f8b87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.745 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.745 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.746 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.746 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:47:05.371+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:05.746 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:47:05.371+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:05.746 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:47:05.371+0000 7f8b8c922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:05.746 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient(hunting): handle_auth_done global_id 8340 payload 824 2024-09-12T17:47:05.746 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient: _finish_hunting 0 2024-09-12T17:47:05.746 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:47:05.371+0000 7f8b8d123640 1 monclient: found mon.noname-a 2024-09-12T17:47:05.746 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:47:05.371+0000 7f8b8d123640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:47:05.746 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:05.746 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:47:05.746 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: dump: 2024-09-12T17:47:05.746 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:05.746 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:05.747 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.747 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.747 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:05.747 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.747 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:05.747 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:05.747 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:05.747 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.747 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: _finish_auth 0 2024-09-12T17:47:05.747 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: _check_auth_tickets 2024-09-12T17:47:05.747 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:47:05.747 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:05.747 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:47:05.748 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:47:05.372+0000 7f8a627fc640 10 monclient: dump: 2024-09-12T17:47:05.748 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:05.748 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:05.748 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.748 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:05.748 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:05.748 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:05.748 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:05.748 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:05.748 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:05.748 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.748 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:47:05.372+0000 7f8b9120f800 5 monclient: authenticate success, global_id 8340 2024-09-12T17:47:05.748 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:47:05.372+0000 7f8a63fff640 4 set_mon_vals no callback set 2024-09-12T17:47:05.749 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:47:05.372+0000 7f8b9120f800 10 monclient: _renew_subs 2024-09-12T17:47:05.749 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:47:05.372+0000 7f8b9120f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:47:05.749 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:47:05.372+0000 7f8b9120f800 10 monclient: _renew_subs 2024-09-12T17:47:05.749 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:47:05.372+0000 7f8b9120f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:47:05.749 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:47:05.372+0000 7f8b9120f800 1 librados: init done 2024-09-12T17:47:05.749 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:47:05.372+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command cr dump hook 0x5639d716e528 2024-09-12T17:47:05.749 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:47:05.374+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.749 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:47:05.375+0000 7f8a627fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:47:05.749 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:47:05.375+0000 7f8a627fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:05.749 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:47:05.375+0000 7f8a627fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:05.749 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:47:05.375+0000 7f8b8c922640 10 monclient: get_auth_request con 0x7f8a58076470 auth_method 0 2024-09-12T17:47:05.750 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:47:05.375+0000 7f8b87fff640 10 monclient: get_auth_request con 0x5639d7192610 auth_method 0 2024-09-12T17:47:05.750 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.750 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:47:05.376+0000 7f8b9120f800 20 realm 2024-09-12T17:47:05.750 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.750 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.750 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:47:05.376+0000 7f8b9120f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:05.750 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.750 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.750 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:47:05.376+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.750 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:47:05.376+0000 7f8b8c922640 10 monclient: get_auth_request con 0x5639d7196800 auth_method 0 2024-09-12T17:47:05.750 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:47:05.377+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:05.750 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:47:05.377+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.750 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:47:05.377+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:05.751 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:47:05.377+0000 7f8b9120f800 20 searching for the correct realm 2024-09-12T17:47:05.751 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:47:05.378+0000 7f8b87fff640 10 monclient: get_auth_request con 0x5639d719ba50 auth_method 0 2024-09-12T17:47:05.751 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:47:05.378+0000 7f8b8d123640 10 monclient: get_auth_request con 0x7f8b7804f040 auth_method 0 2024-09-12T17:47:05.751 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:47:05.379+0000 7f8b8c922640 10 monclient: get_auth_request con 0x7f8b88018040 auth_method 0 2024-09-12T17:47:05.751 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:47:05.380+0000 7f8b87fff640 10 monclient: get_auth_request con 0x7f8b800c9040 auth_method 0 2024-09-12T17:47:05.751 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:47:05.381+0000 7f8b8d123640 0 -- 172.21.15.44:0/2033573499 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f8b7804f040 msgr2=0x7f8b78090a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:05.751 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:47:05.381+0000 7f8a627fc640 1 client.8340.objecter ms_handle_reset 0x7f8b7804f040 session 0x7f8b78057040 osd.7 2024-09-12T17:47:05.751 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:47:05.381+0000 7f8a627fc640 10 monclient: _renew_subs 2024-09-12T17:47:05.751 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:47:05.381+0000 7f8a627fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:47:05.751 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:47:05.381+0000 7f8b8d123640 10 monclient: get_auth_request con 0x7f8a58086290 auth_method 0 2024-09-12T17:47:05.751 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:47:05.382+0000 7f8b8d123640 10 monclient: get_auth_request con 0x7f8b78026030 auth_method 0 2024-09-12T17:47:05.751 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:47:05.384+0000 7f8b8c922640 10 monclient: get_auth_request con 0x7f8b78084880 auth_method 0 2024-09-12T17:47:05.752 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:47:05.384+0000 7f8b8c922640 0 -- 172.21.15.44:0/2033573499 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f8b78084880 msgr2=0x7f8b78082f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:05.752 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:47:05.586+0000 7f8b8c922640 10 monclient: get_auth_request con 0x7f8b78084880 auth_method 0 2024-09-12T17:47:05.752 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:47:05.752 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:47:05.752 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:05.752 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:05.752 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:05.752 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:47:05.591+0000 7f8b9120f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:05.752 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:47:05.591+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.752 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.752 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.752 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:05.753 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.753 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:05.753 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:47:05.592+0000 7f8b9120f800 20 zone default found 2024-09-12T17:47:05.753 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:47:05.592+0000 7f8b9120f800 4 Realm: () 2024-09-12T17:47:05.753 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:47:05.592+0000 7f8b9120f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:47:05.753 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:47:05.592+0000 7f8b9120f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:47:05.753 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:47:05.592+0000 7f8b9120f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:05.753 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:47:05.592+0000 7f8b9120f800 20 zonegroup default 2024-09-12T17:47:05.753 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:47:05.592+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.753 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:47:05.593+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.753 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:47:05.593+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.753 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:47:05.593+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.753 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:47:05.593+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.754 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:47:05.593+0000 7f8b9120f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.754 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:47:05.593+0000 7f8b9120f800 20 started sync module instance, tier type = 2024-09-12T17:47:05.754 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:47:05.593+0000 7f8b9120f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:47:05.754 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=0 2024-09-12T17:47:05.754 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=1 2024-09-12T17:47:05.754 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=2 2024-09-12T17:47:05.754 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=3 2024-09-12T17:47:05.754 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=4 2024-09-12T17:47:05.754 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=5 2024-09-12T17:47:05.754 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:47:05.603+0000 7f8b9120f800 20 add_watcher() i=6 2024-09-12T17:47:05.754 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:47:05.604+0000 7f8b9120f800 20 add_watcher() i=7 2024-09-12T17:47:05.754 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:47:05.604+0000 7f8b9120f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:05.754 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding auth protocol: cephx 2024-09-12T17:47:05.755 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding auth protocol: cephx 2024-09-12T17:47:05.755 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding auth protocol: cephx 2024-09-12T17:47:05.755 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: secure 2024-09-12T17:47:05.755 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: crc 2024-09-12T17:47:05.755 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: secure 2024-09-12T17:47:05.755 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: crc 2024-09-12T17:47:05.755 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: secure 2024-09-12T17:47:05.755 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: crc 2024-09-12T17:47:05.755 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: crc 2024-09-12T17:47:05.755 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: secure 2024-09-12T17:47:05.755 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: crc 2024-09-12T17:47:05.755 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: secure 2024-09-12T17:47:05.755 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: crc 2024-09-12T17:47:05.756 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:47:05.605+0000 7f8b9120f800 5 AuthRegistry(0x7fffe4928960) adding con mode: secure 2024-09-12T17:47:05.756 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:47:05.605+0000 7f8a42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:05.756 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:47:05.606+0000 7f8b9120f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:05.756 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:47:05.606+0000 7f8b9120f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:05.756 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:47:05.606+0000 7f8b9120f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:05.756 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command cache list hook 0x5639d716f6f0 2024-09-12T17:47:05.756 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command cache inspect hook 0x5639d716f6f0 2024-09-12T17:47:05.756 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command cache erase hook 0x5639d716f6f0 2024-09-12T17:47:05.756 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command cache zap hook 0x5639d716f6f0 2024-09-12T17:47:05.756 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 note: GC not initialized 2024-09-12T17:47:05.757 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:47:05.606+0000 7f8a41fe3640 20 reqs_thread_entry: start 2024-09-12T17:47:05.757 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command sync trace show hook 0x7f8b880056b0 2024-09-12T17:47:05.757 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command sync trace history hook 0x7f8b880056b0 2024-09-12T17:47:05.757 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command sync trace active hook 0x7f8b880056b0 2024-09-12T17:47:05.757 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:47:05.606+0000 7f8b9120f800 5 asok(0x5639d6e85730) register_command sync trace active_short hook 0x7f8b880056b0 2024-09-12T17:47:05.757 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:47:05.606+0000 7f8b9120f800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:05.757 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:47:05.606+0000 7f8b9120f800 20 Filter name: none 2024-09-12T17:47:05.757 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:47:05.606+0000 7f89b37fe640 20 reqs_thread_entry: start 2024-09-12T17:47:05.757 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:47:05.606+0000 7f8b9120f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:47:05.757 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:47:05.606+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.757 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:47:05.607+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:05.757 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:47:05.607+0000 7f8b9120f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:47:05.758 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:47:05.607+0000 7f8b9120f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:47:05.758 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:47:05.607+0000 7f8b9120f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:47:05.758 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:47:05.607+0000 7f8b9120f800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.758 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:47:05.607+0000 7f8b9120f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:05.758 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:47:05.607+0000 7f8b9120f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:05.758 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:47:05.607+0000 7f8b9120f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:05.758 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:47:05.607+0000 7f8b9120f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:05.758 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:47:05.607+0000 7f8b9120f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:05.758 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:47:05.607+0000 7f8b9120f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:47:05.758 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:47:05.614+0000 7f8b9120f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:05.758 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:47:05.614+0000 7f8b9120f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:05.758 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:47:05.614+0000 7f8b9120f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:05.758 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:47:05.614+0000 7f8b9120f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:47:05.759 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:47:05.614+0000 7f8a637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562464 cookie 94806421930096 notifier 8340 bl.length()=911 2024-09-12T17:47:05.759 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:47:05.614+0000 7f8a637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:05.759 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:47:05.614+0000 7f8a637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:05.759 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:47:05.614+0000 7f8a637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:05.759 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:47:05.615+0000 7f8b9120f800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:47:05.759 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:47:05.615+0000 7f8b9120f800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:47:05.759 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:47:05.615+0000 7f8b9120f800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:47:05.759 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:47:05.615+0000 7f8b9120f800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:47:05.759 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:47:05.621+0000 7f8b9120f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8b9120f800 time 2024-09-12T17:47:05.622305+0000 2024-09-12T17:47:05.759 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:47:05.759 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.759 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:47:05.760 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8b9238c71a] 2024-09-12T17:47:05.760 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8b9238c8d8] 2024-09-12T17:47:05.760 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5639d476e841] 2024-09-12T17:47:05.760 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5639d477e57a] 2024-09-12T17:47:05.760 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2024-09-12T17:47:05.760 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f8b91029590] 2024-09-12T17:47:05.760 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2024-09-12T17:47:05.760 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2024-09-12T17:47:05.760 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.760 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:47:05.622+0000 7f8b9120f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:47:05.760 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f8b9120f800 thread_name:radosgw-admin 2024-09-12T17:47:05.760 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.761 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:47:05.761 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8b9103e6f0] 2024-09-12T17:47:05.761 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8b9108b99c] 2024-09-12T17:47:05.761 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:47:05.761 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:47:05.761 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8b9238c774] 2024-09-12T17:47:05.761 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8b9238c8d8] 2024-09-12T17:47:05.761 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5639d476e841] 2024-09-12T17:47:05.761 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5639d477e57a] 2024-09-12T17:47:05.761 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2024-09-12T17:47:05.761 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f8b91029590] 2024-09-12T17:47:05.761 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2024-09-12T17:47:05.762 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2024-09-12T17:47:05.762 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:47:05.762 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:05.762 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:47:05.762 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:47:05.762 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:47:05.762 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:47:05.762 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:47:05.762 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:47:05.762 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:47:05.762 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:47:05.762 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:47:05.762 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:47:05.762 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:47:05.763 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:47:05.763 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:47:05.763 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:47:05.763 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:47:05.763 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:47:05.763 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:47:05.763 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:47:05.763 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:47:05.763 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:47:05.763 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:47:05.763 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:47:05.763 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:47:05.764 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:47:05.764 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:47:05.764 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:47:05.764 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:47:05.764 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:47:05.764 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:47:05.764 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:47:05.764 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:47:05.764 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:47:05.764 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:47:05.764 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:47:05.764 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:47:05.764 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:47:05.765 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:47:05.765 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:47:05.765 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:47:05.765 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:47:05.765 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:47:05.765 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:47:05.765 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:47:05.765 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:47:05.765 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:47:05.765 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:47:05.765 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:47:05.765 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:47:05.766 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:47:05.766 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:47:05.766 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:47:05.766 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:47:05.766 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:47:05.766 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:47:05.766 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:47:05.766 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:47:05.766 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:47:05.766 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:47:05.766 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:47:05.766 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:47:05.766 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:47:05.766 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:47:05.767 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:47:05.767 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:47:05.767 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:47:05.767 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:47:05.767 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:47:05.767 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:47:05.767 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:47:05.767 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:47:05.767 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:47:05.767 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:47:05.767 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:47:05.767 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:47:05.767 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:47:05.767 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:47:05.768 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:47:05.768 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:47:05.768 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:47:05.768 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:47:05.768 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:47:05.768 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:47:05.768 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:47:05.768 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:47:05.768 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:47:05.768 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:47:05.768 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:47:05.768 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:47:05.769 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:47:05.769 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:47:05.769 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:47:05.769 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:47:05.769 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:47:05.769 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:47:05.769 INFO:tasks.workunit.client.0.smithi044.stderr: 7f89b37fe640 / http_manager 2024-09-12T17:47:05.769 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8a41fe3640 / http_manager 2024-09-12T17:47:05.769 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8a42fe5640 / rgw_dt_lg_renew 2024-09-12T17:47:05.769 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8a627fc640 / ms_dispatch 2024-09-12T17:47:05.769 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8a637fe640 / io_context_pool 2024-09-12T17:47:05.769 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8a63fff640 / io_context_pool 2024-09-12T17:47:05.769 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8a727fc640 / ms_dispatch 2024-09-12T17:47:05.769 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8a79602640 / ms_dispatch 2024-09-12T17:47:05.770 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8a7ae05640 / io_context_pool 2024-09-12T17:47:05.770 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8b87fff640 / msgr-worker-2 2024-09-12T17:47:05.770 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8b8c922640 / msgr-worker-1 2024-09-12T17:47:05.770 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8b8d123640 / msgr-worker-0 2024-09-12T17:47:05.770 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8b8d924640 / io_context_pool 2024-09-12T17:47:05.770 INFO:tasks.workunit.client.0.smithi044.stderr: 7f8b9120f800 / radosgw-admin 2024-09-12T17:47:05.770 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:47:05.770 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:47:05.770 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:47:05.623718Z_4f94005b-c29d-452b-86b9-362a99df2ad6/log 2024-09-12T17:47:05.770 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:47:05.770 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:47:05.775 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:05.775 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:05.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.700+0000 7f0025d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.702+0000 7f0025d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.702+0000 7f0025d2e800 20 realm 2024-09-12T17:47:05.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.702+0000 7f0025d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.702+0000 7f0025d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.702+0000 7f0025d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:05.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.702+0000 7f0025d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.702+0000 7f0025d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.702+0000 7f0025d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.703+0000 7f0025d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:05.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.703+0000 7f0025d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.703+0000 7f0025d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:05.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.703+0000 7f0025d2e800 20 searching for the correct realm 2024-09-12T17:47:05.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.707+0000 7f0022165640 0 -- 172.21.15.44:0/2456857346 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x55751007df90 msgr2=0x557510080410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:05.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.710+0000 7f0021964640 0 -- 172.21.15.44:0/2456857346 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f001802c910 msgr2=0x7f00180393d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:05.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.714+0000 7f0025d2e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:47:05.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.714+0000 7f0025d2e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:47:05.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.714+0000 7f0025d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:05.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.714+0000 7f0025d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:05.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.714+0000 7f0025d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:05.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.714+0000 7f0025d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:05.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.714+0000 7f0025d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.715+0000 7f0025d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.715+0000 7f0025d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.715+0000 7f0025d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:05.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.715+0000 7f0025d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.715+0000 7f0025d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:05.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.715+0000 7f0025d2e800 20 zone default found 2024-09-12T17:47:05.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.715+0000 7f0025d2e800 4 Realm: () 2024-09-12T17:47:05.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.715+0000 7f0025d2e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:47:05.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.715+0000 7f0025d2e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:47:05.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.715+0000 7f0025d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:05.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.715+0000 7f0025d2e800 20 zonegroup default 2024-09-12T17:47:05.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.715+0000 7f0025d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.716+0000 7f0025d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.716+0000 7f0025d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.716+0000 7f0025d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.716+0000 7f0025d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.716+0000 7f0025d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.716+0000 7f0025d2e800 20 started sync module instance, tier type = 2024-09-12T17:47:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.716+0000 7f0025d2e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:47:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.726+0000 7f0025d2e800 20 add_watcher() i=0 2024-09-12T17:47:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.726+0000 7f0025d2e800 20 add_watcher() i=1 2024-09-12T17:47:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.726+0000 7f0025d2e800 20 add_watcher() i=2 2024-09-12T17:47:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.726+0000 7f0025d2e800 20 add_watcher() i=3 2024-09-12T17:47:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.726+0000 7f0025d2e800 20 add_watcher() i=4 2024-09-12T17:47:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.726+0000 7f0025d2e800 20 add_watcher() i=5 2024-09-12T17:47:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.726+0000 7f0025d2e800 20 add_watcher() i=6 2024-09-12T17:47:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.726+0000 7f0025d2e800 20 add_watcher() i=7 2024-09-12T17:47:05.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.726+0000 7f0025d2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.728+0000 7efed37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.728+0000 7f0025d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.728+0000 7f0025d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.728+0000 7f0025d2e800 5 note: GC not initialized 2024-09-12T17:47:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.729+0000 7efed27fc640 20 reqs_thread_entry: start 2024-09-12T17:47:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.729+0000 7f0025d2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.729+0000 7f0025d2e800 20 Filter name: none 2024-09-12T17:47:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.729+0000 7efe43fff640 20 reqs_thread_entry: start 2024-09-12T17:47:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.729+0000 7f0025d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.729+0000 7f0025d2e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.729+0000 7f0025d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.730+0000 7f0025d2e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:47:05.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.730+0000 7f0025d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.730+0000 7f0025d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.730+0000 7f0025d2e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.730+0000 7f0025d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.731+0000 7f0025d2e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:47:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.731+0000 7f0025d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.732+0000 7efed37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.734+0000 7f0025d2e800 20 remove_watcher() i=0 2024-09-12T17:47:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.735+0000 7f0025d2e800 2 removed watcher, disabling cache 2024-09-12T17:47:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.736+0000 7f0025d2e800 20 remove_watcher() i=1 2024-09-12T17:47:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.737+0000 7f0025d2e800 20 remove_watcher() i=2 2024-09-12T17:47:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.738+0000 7f0025d2e800 20 remove_watcher() i=3 2024-09-12T17:47:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.739+0000 7f0025d2e800 20 remove_watcher() i=4 2024-09-12T17:47:05.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.740+0000 7f0025d2e800 20 remove_watcher() i=5 2024-09-12T17:47:05.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.741+0000 7f0025d2e800 20 remove_watcher() i=6 2024-09-12T17:47:05.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.742+0000 7f0025d2e800 20 remove_watcher() i=7 2024-09-12T17:47:05.782 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:47:05.797 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:05.797 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:05.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.835+0000 7fe51c925800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.837+0000 7fe51c925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.837+0000 7fe51c925800 20 realm 2024-09-12T17:47:05.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.837+0000 7fe51c925800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.837+0000 7fe51c925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.837+0000 7fe51c925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:05.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.837+0000 7fe51c925800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.837+0000 7fe51c925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.837+0000 7fe51c925800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.838+0000 7fe51c925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:05.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.838+0000 7fe51c925800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.838+0000 7fe51c925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:05.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.838+0000 7fe51c925800 20 searching for the correct realm 2024-09-12T17:47:05.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.842+0000 7fe517db4640 0 -- 172.21.15.44:0/1010274683 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55888c4b6c90 msgr2=0x55888c4b9150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:05.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.845+0000 7fe5185b5640 0 -- 172.21.15.44:0/1010274683 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fe50003faa0 msgr2=0x7fe500023410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:47:05.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.850+0000 7fe51c925800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:47:05.851 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.850+0000 7fe51c925800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:47:05.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.850+0000 7fe51c925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:05.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.850+0000 7fe51c925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:05.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.850+0000 7fe51c925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:05.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.850+0000 7fe51c925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:05.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.850+0000 7fe51c925800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.850+0000 7fe51c925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.852 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.850+0000 7fe51c925800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.850+0000 7fe51c925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:05.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.850+0000 7fe51c925800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.851+0000 7fe51c925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:05.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.851+0000 7fe51c925800 20 zone default found 2024-09-12T17:47:05.853 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.851+0000 7fe51c925800 4 Realm: () 2024-09-12T17:47:05.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.851+0000 7fe51c925800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:47:05.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.851+0000 7fe51c925800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:47:05.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.851+0000 7fe51c925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:05.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.851+0000 7fe51c925800 20 zonegroup default 2024-09-12T17:47:05.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.851+0000 7fe51c925800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.851+0000 7fe51c925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.851+0000 7fe51c925800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.851+0000 7fe51c925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.851+0000 7fe51c925800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.852+0000 7fe51c925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:05.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.852+0000 7fe51c925800 20 started sync module instance, tier type = 2024-09-12T17:47:05.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.852+0000 7fe51c925800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:47:05.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.860+0000 7fe51c925800 20 add_watcher() i=0 2024-09-12T17:47:05.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.860+0000 7fe51c925800 20 add_watcher() i=1 2024-09-12T17:47:05.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.860+0000 7fe51c925800 20 add_watcher() i=2 2024-09-12T17:47:05.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.860+0000 7fe51c925800 20 add_watcher() i=3 2024-09-12T17:47:05.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.860+0000 7fe51c925800 20 add_watcher() i=4 2024-09-12T17:47:05.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.860+0000 7fe51c925800 20 add_watcher() i=5 2024-09-12T17:47:05.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.860+0000 7fe51c925800 20 add_watcher() i=6 2024-09-12T17:47:05.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.861+0000 7fe51c925800 20 add_watcher() i=7 2024-09-12T17:47:05.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.861+0000 7fe51c925800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:05.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.863+0000 7fe3cf7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:05.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.863+0000 7fe51c925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:05.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.863+0000 7fe51c925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:05.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.863+0000 7fe51c925800 5 note: GC not initialized 2024-09-12T17:47:05.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.864+0000 7fe3ce7dc640 20 reqs_thread_entry: start 2024-09-12T17:47:05.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.864+0000 7fe51c925800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:05.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.864+0000 7fe51c925800 20 Filter name: none 2024-09-12T17:47:05.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.864+0000 7fe3c77fe640 20 reqs_thread_entry: start 2024-09-12T17:47:05.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.864+0000 7fe51c925800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:47:05.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.864+0000 7fe51c925800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.864+0000 7fe51c925800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:05.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.864+0000 7fe51c925800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:47:05.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.864+0000 7fe51c925800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:47:05.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.864+0000 7fe51c925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:47:05.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.864+0000 7fe51c925800 20 rados->read ofs=0 len=0 2024-09-12T17:47:05.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.865+0000 7fe51c925800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:47:05.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.865+0000 7fe51c925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:05.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.865+0000 7fe51c925800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:05.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.865+0000 7fe51c925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:05.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.865+0000 7fe51c925800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:05.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.865+0000 7fe51c925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:47:05.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.865+0000 7fe51c925800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:47:05.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.865+0000 7fe51c925800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:47:05.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.865+0000 7fe51c925800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:47:05.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.865+0000 7fe51c925800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:47:05.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.865+0000 7fe51c925800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:47:05.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.865+0000 7fe51c925800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:47:05.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.866+0000 7fe51c925800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:47:05.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.866+0000 7fe51c925800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:47:05.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.866+0000 7fe51c925800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:47:05.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.866+0000 7fe51c925800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:47:05.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.867+0000 7fe51c925800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:47:05.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.867+0000 7fe51c925800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:47:05.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.867+0000 7fe51c925800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:47:05.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.867+0000 7fe51c925800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:47:05.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.867+0000 7fe51c925800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:47:05.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.867+0000 7fe51c925800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:47:05.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.868+0000 7fe51c925800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:47:05.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.868+0000 7fe51c925800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:47:05.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.868+0000 7fe51c925800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:47:05.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.868+0000 7fe51c925800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:47:05.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.869+0000 7fe51c925800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:47:05.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.869+0000 7fe51c925800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:47:05.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.869+0000 7fe51c925800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:47:05.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.869+0000 7fe51c925800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:47:05.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.870+0000 7fe51c925800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:47:05.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.870+0000 7fe51c925800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:47:05.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.871+0000 7fe3cf7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:05.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.873+0000 7fe51c925800 20 remove_watcher() i=0 2024-09-12T17:47:05.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.873+0000 7fe51c925800 2 removed watcher, disabling cache 2024-09-12T17:47:05.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.874+0000 7fe51c925800 20 remove_watcher() i=1 2024-09-12T17:47:05.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.875+0000 7fe51c925800 20 remove_watcher() i=2 2024-09-12T17:47:05.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.876+0000 7fe51c925800 20 remove_watcher() i=3 2024-09-12T17:47:05.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.877+0000 7fe51c925800 20 remove_watcher() i=4 2024-09-12T17:47:05.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.878+0000 7fe51c925800 20 remove_watcher() i=5 2024-09-12T17:47:05.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.879+0000 7fe51c925800 20 remove_watcher() i=6 2024-09-12T17:47:05.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:05.880+0000 7fe51c925800 20 remove_watcher() i=7 2024-09-12T17:47:35.920 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T17:47:35.958 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:35.959 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:36.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.006+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.008+0000 7f2f4c536800 20 realm 2024-09-12T17:47:36.010 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.008+0000 7f2f4c536800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:36.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.009+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:36.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.009+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.009+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:36.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.009+0000 7f2f4c536800 20 searching for the correct realm 2024-09-12T17:47:36.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.010+0000 7f2f3fab6640 0 -- 172.21.15.44:0/3149487022 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x56459ef398b0 msgr2=0x56459ef3bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:36.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.216+0000 7f2f3fab6640 0 -- 172.21.15.44:0/3149487022 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x56459ef398b0 msgr2=0x56459ef3bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:36.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:47:36.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:47:36.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:36.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:36.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:36.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:36.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.225+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.225+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.226 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.225+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.225+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:36.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.225+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.226+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:36.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.226+0000 7f2f4c536800 20 zone default found 2024-09-12T17:47:36.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.226+0000 7f2f4c536800 4 Realm: () 2024-09-12T17:47:36.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.226+0000 7f2f4c536800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:47:36.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.226+0000 7f2f4c536800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:47:36.227 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.226+0000 7f2f4c536800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:36.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.226+0000 7f2f4c536800 20 zonegroup default 2024-09-12T17:47:36.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.226+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.226+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.226+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.227+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.227+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.227+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.227+0000 7f2f4c536800 20 started sync module instance, tier type = 2024-09-12T17:47:36.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.227+0000 7f2f4c536800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:47:36.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=0 2024-09-12T17:47:36.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=1 2024-09-12T17:47:36.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=2 2024-09-12T17:47:36.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=3 2024-09-12T17:47:36.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=4 2024-09-12T17:47:36.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=5 2024-09-12T17:47:36.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=6 2024-09-12T17:47:36.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.238+0000 7f2f4c536800 20 add_watcher() i=7 2024-09-12T17:47:36.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.238+0000 7f2f4c536800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:36.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.240+0000 7f2dfefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:36.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.241+0000 7f2f4c536800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:36.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.241+0000 7f2f4c536800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:36.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.241+0000 7f2f4c536800 5 note: GC not initialized 2024-09-12T17:47:36.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.241+0000 7f2dfdfdb640 20 reqs_thread_entry: start 2024-09-12T17:47:36.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.241+0000 7f2f4c536800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:36.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.241+0000 7f2f4c536800 20 Filter name: none 2024-09-12T17:47:36.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.241+0000 7f2d6f7fe640 20 reqs_thread_entry: start 2024-09-12T17:47:36.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.241+0000 7f2f4c536800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:47:36.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.241+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.242+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:36.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.242+0000 7f2f4c536800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:47:36.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.242+0000 7f2f4c536800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:47:36.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.242+0000 7f2f4c536800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:47:36.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.242+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.243+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:47:36.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.243+0000 7f2f4c536800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:36.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.243+0000 7f2f4c536800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:36.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.243+0000 7f2f4c536800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:36.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.243+0000 7f2f4c536800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:36.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.243+0000 7f2f4c536800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:47:36.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.244+0000 7f2f4c536800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:47:36.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.251+0000 7f2f4c536800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:36.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.251+0000 7f2f4c536800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:36.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.251+0000 7f2f4c536800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:36.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.251+0000 7f2f4c536800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:47:36.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.252+0000 7f2e1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562465 cookie 94857019504880 notifier 7847 bl.length()=911 2024-09-12T17:47:36.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.252+0000 7f2e1f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:36.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.252+0000 7f2e1f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:36.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.252+0000 7f2e1f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:36.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.252+0000 7f2f4c536800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:47:36.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.252+0000 7f2f4c536800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:47:36.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.252+0000 7f2f4c536800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:47:36.253 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.252+0000 7f2f4c536800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:47:36.257 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2f4c536800 time 2024-09-12T17:47:36.257360+0000 2024-09-12T17:47:36.257 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:47:36.258 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:47:36.258 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2f4dd8c71a] 2024-09-12T17:47:36.258 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2f4dd8c8d8] 2024-09-12T17:47:36.258 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56459ce9f841] 2024-09-12T17:47:36.258 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd7490c) [0x56459d3ad90c] 2024-09-12T17:47:36.258 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56459ceaf50d] 2024-09-12T17:47:36.258 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:47:36.259 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2f4ca29590] 2024-09-12T17:47:36.259 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:47:36.259 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:47:36.259 INFO:tasks.workunit.client.0.smithi044.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:47:36.259 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f2f4c536800 thread_name:radosgw-admin 2024-09-12T17:47:36.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.257+0000 7f2f4c536800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2f4c536800 time 2024-09-12T17:47:36.257360+0000 2024-09-12T17:47:36.259 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:47:36.259 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.259 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:47:36.259 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2f4dd8c71a] 2024-09-12T17:47:36.260 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2f4dd8c8d8] 2024-09-12T17:47:36.260 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56459ce9f841] 2024-09-12T17:47:36.260 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd7490c) [0x56459d3ad90c] 2024-09-12T17:47:36.260 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56459ceaf50d] 2024-09-12T17:47:36.260 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:47:36.260 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2f4ca29590] 2024-09-12T17:47:36.260 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:47:36.260 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:47:36.260 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.279 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:47:36.279 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2f4ca3e6f0] 2024-09-12T17:47:36.280 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2f4ca8b99c] 2024-09-12T17:47:36.280 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:47:36.280 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:47:36.280 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2f4dd8c774] 2024-09-12T17:47:36.280 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2f4dd8c8d8] 2024-09-12T17:47:36.281 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56459ce9f841] 2024-09-12T17:47:36.281 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd7490c) [0x56459d3ad90c] 2024-09-12T17:47:36.281 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56459ceaf50d] 2024-09-12T17:47:36.281 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:47:36.281 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2f4ca29590] 2024-09-12T17:47:36.281 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:47:36.282 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:47:36.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.258+0000 7f2f4c536800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:47:36.282 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f2f4c536800 thread_name:radosgw-admin 2024-09-12T17:47:36.282 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.282 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:47:36.282 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2f4ca3e6f0] 2024-09-12T17:47:36.283 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2f4ca8b99c] 2024-09-12T17:47:36.283 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:47:36.283 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:47:36.283 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2f4dd8c774] 2024-09-12T17:47:36.283 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2f4dd8c8d8] 2024-09-12T17:47:36.283 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56459ce9f841] 2024-09-12T17:47:36.284 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd7490c) [0x56459d3ad90c] 2024-09-12T17:47:36.284 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56459ceaf50d] 2024-09-12T17:47:36.284 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:47:36.284 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2f4ca29590] 2024-09-12T17:47:36.284 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:47:36.284 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:47:36.285 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:47:36.285 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.285 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:47:36.285 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: crc 2024-09-12T17:47:36.285 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: secure 2024-09-12T17:47:36.285 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: crc 2024-09-12T17:47:36.285 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: secure 2024-09-12T17:47:36.285 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: crc 2024-09-12T17:47:36.285 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: crc 2024-09-12T17:47:36.285 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: secure 2024-09-12T17:47:36.286 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: crc 2024-09-12T17:47:36.286 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: secure 2024-09-12T17:47:36.286 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: crc 2024-09-12T17:47:36.286 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: secure 2024-09-12T17:47:36.286 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:47:35.986+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.286 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:47:35.986+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.286 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command rotate-key hook 0x56459ee4b9e8 2024-09-12T17:47:36.286 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient: _reopen_session rank -1 2024-09-12T17:47:36.286 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:47:36.286 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-c con 0x56459ee52100 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:36.286 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-b con 0x56459ee750c0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:36.286 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-a con 0x7f2f34003bd0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:36.286 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.287 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.287 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.287 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient(hunting): _renew_subs 2024-09-12T17:47:36.287 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient(hunting): authenticate will time out at 2228.622804s 2024-09-12T17:47:36.287 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:47:35.986+0000 7f2f482b7640 10 monclient(hunting): get_auth_request con 0x56459ee52100 auth_method 0 2024-09-12T17:47:36.287 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:47:35.986+0000 7f2f482b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.287 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:47:35.986+0000 7f2f482b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.287 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:47:35.986+0000 7f2f482b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.287 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:47:35.986+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request con 0x7f2f34003bd0 auth_method 0 2024-09-12T17:47:36.287 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:47:35.986+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.287 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:47:35.986+0000 7f2f48ab8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.287 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:47:35.986+0000 7f2f48ab8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.287 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:47:35.987+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.288 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:47:35.987+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.288 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:47:35.987+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.288 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:47:35.987+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.288 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:47:35.987+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.288 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:47:35.987+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.288 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:47:35.987+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request con 0x56459ee750c0 auth_method 0 2024-09-12T17:47:36.288 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:47:35.987+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.288 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:47:35.987+0000 7f2f3fab6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.288 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:47:35.987+0000 7f2f3fab6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.288 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:47:35.987+0000 7f2f482b7640 10 monclient(hunting): handle_auth_done global_id 7838 payload 824 2024-09-12T17:47:36.288 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:47:35.987+0000 7f2f482b7640 10 monclient: _finish_hunting 0 2024-09-12T17:47:36.288 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:47:35.987+0000 7f2f482b7640 1 monclient: found mon.noname-c 2024-09-12T17:47:36.288 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:47:35.987+0000 7f2f482b7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:47:36.289 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:36.289 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:47:36.289 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: dump: 2024-09-12T17:47:36.289 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:36.289 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:36.289 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.289 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.289 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:36.289 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.289 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:36.289 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:36.289 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:36.289 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.290 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: _finish_auth 0 2024-09-12T17:47:36.290 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: _check_auth_tickets 2024-09-12T17:47:36.290 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:47:36.290 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:36.290 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:47:36.290 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: dump: 2024-09-12T17:47:36.290 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:36.290 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:36.290 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.290 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.290 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:36.290 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.290 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:36.290 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:36.291 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:36.291 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.291 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:47:35.987+0000 7f2f4c536800 5 monclient: authenticate success, global_id 7838 2024-09-12T17:47:36.291 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:47:35.987+0000 7f2f4c536800 10 monclient: _renew_subs 2024-09-12T17:47:36.291 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:47:35.987+0000 7f2f4c536800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:47:36.291 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:47:35.987+0000 7f2e3660c640 4 set_mon_vals no callback set 2024-09-12T17:47:36.291 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:47:35.987+0000 7f2f4c536800 10 monclient: _renew_subs 2024-09-12T17:47:36.292 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:47:35.987+0000 7f2f4c536800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:47:36.292 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:47:35.987+0000 7f2f4c536800 1 librados: init done 2024-09-12T17:47:36.292 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:47:35.989+0000 7f2e34e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:47:36.292 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:47:35.989+0000 7f2e34e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:36.292 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:47:35.989+0000 7f2e34e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:36.292 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:47:35.990+0000 7f2f3fab6640 10 monclient: get_auth_request con 0x7f2e30076470 auth_method 0 2024-09-12T17:47:36.293 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:47:35.990+0000 7f2f48ab8640 10 monclient: get_auth_request con 0x56459ee95740 auth_method 0 2024-09-12T17:47:36.293 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:47:35.991+0000 7f2f482b7640 10 monclient: get_auth_request con 0x56459ee98920 auth_method 0 2024-09-12T17:47:36.293 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:47:35.994+0000 7f2f3fab6640 10 monclient: get_auth_request con 0x56459ee9d9b0 auth_method 0 2024-09-12T17:47:36.293 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:47:35.995+0000 7f2f4c536800 10 monclient: build_initial_monmap 2024-09-12T17:47:36.293 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:47:35.995+0000 7f2f4c536800 1 build_initial for_mkfs: 0 2024-09-12T17:47:36.293 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:47:35.995+0000 7f2f4c536800 10 monclient: monmap: 2024-09-12T17:47:36.294 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:47:36.294 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:47:36.294 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:47:36.294 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:47:36.294 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:47:36.294 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.294 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:47:36.294 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:47:36.294 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:47:36.294 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.294 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding auth protocol: cephx 2024-09-12T17:47:36.295 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding auth protocol: cephx 2024-09-12T17:47:36.295 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding auth protocol: cephx 2024-09-12T17:47:36.295 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: secure 2024-09-12T17:47:36.295 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: crc 2024-09-12T17:47:36.295 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: secure 2024-09-12T17:47:36.295 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: crc 2024-09-12T17:47:36.296 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: secure 2024-09-12T17:47:36.296 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: crc 2024-09-12T17:47:36.296 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: crc 2024-09-12T17:47:36.296 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: secure 2024-09-12T17:47:36.296 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: crc 2024-09-12T17:47:36.296 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: secure 2024-09-12T17:47:36.296 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: crc 2024-09-12T17:47:36.296 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: secure 2024-09-12T17:47:36.296 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:47:35.995+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.296 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command objecter_requests cmddesc objecter_requests hook 0x56459eea4c40 EEXIST 2024-09-12T17:47:36.296 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:47:35.995+0000 7f2f4c536800 10 monclient: init 2024-09-12T17:47:36.296 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding auth protocol: cephx 2024-09-12T17:47:36.296 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding auth protocol: cephx 2024-09-12T17:47:36.297 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding auth protocol: cephx 2024-09-12T17:47:36.297 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: secure 2024-09-12T17:47:36.297 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: crc 2024-09-12T17:47:36.297 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: secure 2024-09-12T17:47:36.297 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: crc 2024-09-12T17:47:36.297 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: secure 2024-09-12T17:47:36.297 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: crc 2024-09-12T17:47:36.297 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: crc 2024-09-12T17:47:36.297 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: secure 2024-09-12T17:47:36.297 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: crc 2024-09-12T17:47:36.297 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: secure 2024-09-12T17:47:36.297 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: crc 2024-09-12T17:47:36.297 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: secure 2024-09-12T17:47:36.298 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:47:35.995+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.298 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:47:35.996+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.298 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:47:35.996+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command rotate-key cmddesc rotate-key hook 0x56459eea08e0 EEXIST 2024-09-12T17:47:36.298 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient: _reopen_session rank -1 2024-09-12T17:47:36.298 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:47:36.298 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-c con 0x56459eec8f60 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:36.298 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-a con 0x56459eec9340 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:36.298 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-b con 0x56459eec7c70 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:36.298 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.298 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.298 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.298 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient(hunting): _renew_subs 2024-09-12T17:47:36.299 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient(hunting): authenticate will time out at 2228.632295s 2024-09-12T17:47:36.299 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient(hunting): get_auth_request con 0x56459eec8f60 auth_method 0 2024-09-12T17:47:36.299 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.299 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.299 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.299 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:47:35.996+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request con 0x56459eec9340 auth_method 0 2024-09-12T17:47:36.299 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:47:35.996+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.299 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:47:35.996+0000 7f2f3fab6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.300 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:47:35.996+0000 7f2f3fab6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.300 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.300 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.300 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.300 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:47:35.996+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request con 0x56459eec7c70 auth_method 0 2024-09-12T17:47:36.300 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:47:35.996+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.300 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:47:35.996+0000 7f2f48ab8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.300 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:47:35.996+0000 7f2f48ab8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.300 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:47:35.996+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.300 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:47:35.996+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.300 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:47:35.996+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.300 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:47:35.996+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.300 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:47:35.996+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.301 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:47:35.996+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.301 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient(hunting): handle_auth_done global_id 7841 payload 824 2024-09-12T17:47:36.301 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient: _finish_hunting 0 2024-09-12T17:47:36.301 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:47:35.996+0000 7f2f482b7640 1 monclient: found mon.noname-c 2024-09-12T17:47:36.301 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:47:36.301 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:36.301 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:47:36.301 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: dump: 2024-09-12T17:47:36.301 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:36.301 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:36.301 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.301 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.302 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:36.302 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.302 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:36.302 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:36.302 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:36.302 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.302 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: _finish_auth 0 2024-09-12T17:47:36.302 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: _check_auth_tickets 2024-09-12T17:47:36.302 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:47:36.302 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:36.302 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:47:36.302 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: dump: 2024-09-12T17:47:36.302 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:36.302 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:36.303 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.303 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.303 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:36.303 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.303 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:36.303 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:36.303 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:36.303 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.303 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:47:35.997+0000 7f2f4c536800 5 monclient: authenticate success, global_id 7841 2024-09-12T17:47:36.303 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:47:35.997+0000 7f2f492b9640 4 set_mon_vals no callback set 2024-09-12T17:47:36.303 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:47:35.997+0000 7f2f4c536800 10 monclient: _renew_subs 2024-09-12T17:47:36.303 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:47:35.997+0000 7f2f4c536800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:47:36.303 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:47:35.997+0000 7f2f4c536800 10 monclient: _renew_subs 2024-09-12T17:47:36.304 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:47:35.997+0000 7f2f4c536800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:47:36.304 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:47:35.998+0000 7f2e2dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:47:36.304 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:47:35.998+0000 7f2e2dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:36.304 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:47:35.998+0000 7f2e2dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:36.304 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:47:35.999+0000 7f2f3fab6640 10 monclient: get_auth_request con 0x7f2e20076380 auth_method 0 2024-09-12T17:47:36.304 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:47:35.999+0000 7f2f4c536800 10 monclient: get_monmap_and_config 2024-09-12T17:47:36.304 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:47:35.999+0000 7f2f4c536800 10 monclient: build_initial_monmap 2024-09-12T17:47:36.304 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:47:35.999+0000 7f2f4c536800 1 build_initial for_mkfs: 0 2024-09-12T17:47:36.304 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:47:35.999+0000 7f2f4c536800 10 monclient: monmap: 2024-09-12T17:47:36.304 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:47:36.304 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:47:36.304 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:47:36.304 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:47:36.305 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:47:36.305 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.305 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:47:36.305 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:47:36.305 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:47:36.305 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.305 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding auth protocol: cephx 2024-09-12T17:47:36.305 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding auth protocol: cephx 2024-09-12T17:47:36.305 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding auth protocol: cephx 2024-09-12T17:47:36.305 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: secure 2024-09-12T17:47:36.305 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: crc 2024-09-12T17:47:36.305 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: secure 2024-09-12T17:47:36.305 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: crc 2024-09-12T17:47:36.305 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: secure 2024-09-12T17:47:36.306 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: crc 2024-09-12T17:47:36.306 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: crc 2024-09-12T17:47:36.306 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: secure 2024-09-12T17:47:36.306 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: crc 2024-09-12T17:47:36.306 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: secure 2024-09-12T17:47:36.306 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: crc 2024-09-12T17:47:36.306 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: secure 2024-09-12T17:47:36.306 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:47:35.999+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.306 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:47:35.999+0000 7f2f4c536800 10 monclient: init 2024-09-12T17:47:36.306 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding auth protocol: cephx 2024-09-12T17:47:36.306 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding auth protocol: cephx 2024-09-12T17:47:36.306 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding auth protocol: cephx 2024-09-12T17:47:36.306 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: secure 2024-09-12T17:47:36.307 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: crc 2024-09-12T17:47:36.307 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: secure 2024-09-12T17:47:36.307 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: crc 2024-09-12T17:47:36.307 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: secure 2024-09-12T17:47:36.307 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: crc 2024-09-12T17:47:36.307 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: crc 2024-09-12T17:47:36.307 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: secure 2024-09-12T17:47:36.307 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: crc 2024-09-12T17:47:36.307 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: secure 2024-09-12T17:47:36.307 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: crc 2024-09-12T17:47:36.307 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: secure 2024-09-12T17:47:36.307 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:47:36.000+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.307 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:47:36.000+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.307 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:47:36.000+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command rotate-key cmddesc rotate-key hook 0x7ffcec815448 EEXIST 2024-09-12T17:47:36.308 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient: _reopen_session rank -1 2024-09-12T17:47:36.308 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:47:36.308 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-b con 0x56459ef1ce00 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:36.308 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-a con 0x56459ef0d750 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:36.308 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-c con 0x56459ef18230 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:36.308 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.308 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.308 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.308 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient(hunting): _renew_subs 2024-09-12T17:47:36.308 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient(hunting): authenticate will time out at 2228.636377s 2024-09-12T17:47:36.308 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request con 0x56459ef0d750 auth_method 0 2024-09-12T17:47:36.308 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.308 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.309 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.309 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:47:36.000+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request con 0x56459ef18230 auth_method 0 2024-09-12T17:47:36.309 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:47:36.000+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.309 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:47:36.000+0000 7f2f48ab8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.309 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:47:36.000+0000 7f2f48ab8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.309 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.309 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.309 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.309 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:47:36.000+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.309 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:47:36.000+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.309 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:47:36.000+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.309 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:47:36.000+0000 7f2f482b7640 10 monclient(hunting): get_auth_request con 0x56459ef1ce00 auth_method 0 2024-09-12T17:47:36.310 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:47:36.000+0000 7f2f482b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.310 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:47:36.000+0000 7f2f482b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.310 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:47:36.000+0000 7f2f482b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.310 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_done global_id 8388 payload 274 2024-09-12T17:47:36.310 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient: _finish_hunting 0 2024-09-12T17:47:36.310 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 1 monclient: found mon.noname-a 2024-09-12T17:47:36.310 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:47:36.310 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:36.310 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:47:36.310 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: dump: 2024-09-12T17:47:36.310 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:36.310 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:36.310 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.311 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.311 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:36.311 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.311 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:36.311 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:36.311 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:36.311 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.311 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: _finish_auth 0 2024-09-12T17:47:36.311 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:47:36.311 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:47:36.311 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:36.311 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:47:36.311 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: dump: 2024-09-12T17:47:36.312 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:36.312 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:36.312 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.312 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.312 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:36.312 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.312 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:36.312 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:36.312 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:36.312 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.312 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 monclient: authenticate success, global_id 8388 2024-09-12T17:47:36.312 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:47:36.001+0000 7f2f4c536800 10 monclient: get_monmap_and_config success 2024-09-12T17:47:36.312 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:47:36.001+0000 7f2f4c536800 4 set_mon_vals no callback set 2024-09-12T17:47:36.312 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:47:36.001+0000 7f2f4c536800 10 monclient: shutdown 2024-09-12T17:47:36.313 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:47:36.001+0000 7f2f4c536800 10 monclient: build_initial_monmap 2024-09-12T17:47:36.313 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:47:36.001+0000 7f2f4c536800 1 build_initial for_mkfs: 0 2024-09-12T17:47:36.313 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:47:36.001+0000 7f2f4c536800 10 monclient: monmap: 2024-09-12T17:47:36.313 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:47:36.313 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:47:36.313 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:47:36.313 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:47:36.313 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:47:36.313 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.313 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:47:36.313 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:47:36.313 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:47:36.313 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.314 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding auth protocol: cephx 2024-09-12T17:47:36.314 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding auth protocol: cephx 2024-09-12T17:47:36.314 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding auth protocol: cephx 2024-09-12T17:47:36.314 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: secure 2024-09-12T17:47:36.314 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: crc 2024-09-12T17:47:36.314 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: secure 2024-09-12T17:47:36.314 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: crc 2024-09-12T17:47:36.314 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: secure 2024-09-12T17:47:36.314 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: crc 2024-09-12T17:47:36.314 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: crc 2024-09-12T17:47:36.314 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: secure 2024-09-12T17:47:36.314 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: crc 2024-09-12T17:47:36.314 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: secure 2024-09-12T17:47:36.315 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: crc 2024-09-12T17:47:36.315 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: secure 2024-09-12T17:47:36.315 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:47:36.002+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.315 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:47:36.002+0000 7f2f4c536800 1 librados: starting msgr at 2024-09-12T17:47:36.315 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:47:36.002+0000 7f2f4c536800 1 librados: starting objecter 2024-09-12T17:47:36.315 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command objecter_requests cmddesc objecter_requests hook 0x56459eec73a0 EEXIST 2024-09-12T17:47:36.315 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:47:36.002+0000 7f2f4c536800 1 librados: setting wanted keys 2024-09-12T17:47:36.315 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:47:36.002+0000 7f2f4c536800 1 librados: calling monclient init 2024-09-12T17:47:36.315 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient: init 2024-09-12T17:47:36.315 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding auth protocol: cephx 2024-09-12T17:47:36.315 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding auth protocol: cephx 2024-09-12T17:47:36.316 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding auth protocol: cephx 2024-09-12T17:47:36.316 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: secure 2024-09-12T17:47:36.316 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: crc 2024-09-12T17:47:36.316 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: secure 2024-09-12T17:47:36.316 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: crc 2024-09-12T17:47:36.317 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: secure 2024-09-12T17:47:36.317 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: crc 2024-09-12T17:47:36.317 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: crc 2024-09-12T17:47:36.317 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: secure 2024-09-12T17:47:36.317 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: crc 2024-09-12T17:47:36.317 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: secure 2024-09-12T17:47:36.318 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: crc 2024-09-12T17:47:36.318 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: secure 2024-09-12T17:47:36.318 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:47:36.002+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.318 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:47:36.002+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.318 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command rotate-key cmddesc rotate-key hook 0x56459eedd968 EEXIST 2024-09-12T17:47:36.318 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient: _reopen_session rank -1 2024-09-12T17:47:36.318 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:47:36.319 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-b con 0x56459ef0d750 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:36.319 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-a con 0x56459ef18230 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:36.319 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-c con 0x56459ef1ce00 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:36.319 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.319 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.319 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.319 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient(hunting): _renew_subs 2024-09-12T17:47:36.320 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient(hunting): authenticate will time out at 2228.638938s 2024-09-12T17:47:36.320 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request con 0x56459ef1ce00 auth_method 0 2024-09-12T17:47:36.320 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.320 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.320 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.320 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request con 0x56459ef18230 auth_method 0 2024-09-12T17:47:36.320 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.321 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.321 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.321 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.321 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.321 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.321 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.322 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.322 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.322 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): get_auth_request con 0x56459ef0d750 auth_method 0 2024-09-12T17:47:36.322 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.322 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.322 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.323 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_done global_id 7847 payload 824 2024-09-12T17:47:36.323 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient: _finish_hunting 0 2024-09-12T17:47:36.323 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 1 monclient: found mon.noname-c 2024-09-12T17:47:36.323 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:47:36.323 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient: ms_handle_reset current mon [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:36.323 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient: _reopen_session rank -1 2024-09-12T17:47:36.323 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:47:36.323 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient(hunting): picked mon.noname-b con 0x56459ef0d750 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:36.324 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient(hunting): picked mon.noname-c con 0x7f2e100048f0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:36.324 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient(hunting): picked mon.noname-a con 0x56459ef18230 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:36.324 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.324 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.324 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.324 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient(hunting): _renew_subs 2024-09-12T17:47:36.324 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request con 0x56459ef18230 auth_method 0 2024-09-12T17:47:36.324 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.324 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.325 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:47:36.325 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request con 0x7f2e100048f0 auth_method 0 2024-09-12T17:47:36.325 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.325 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.325 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:47:36.325 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): get_auth_request con 0x56459ef0d750 auth_method 0 2024-09-12T17:47:36.325 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.325 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.325 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:47:36.325 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.325 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.325 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:47:36.326 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.326 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.326 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:47:36.326 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.326 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.326 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:47:36.326 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_done global_id 7847 payload 293 2024-09-12T17:47:36.326 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:47:36.004+0000 7f2f48ab8640 10 monclient: _finish_hunting 0 2024-09-12T17:47:36.326 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:47:36.004+0000 7f2f48ab8640 1 monclient: found mon.noname-a 2024-09-12T17:47:36.326 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:47:36.004+0000 7f2f48ab8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:47:36.326 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:36.326 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:47:36.326 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: dump: 2024-09-12T17:47:36.327 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:36.327 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:36.327 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.327 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.327 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:36.327 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.327 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:36.327 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:36.327 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:36.327 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.327 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: _finish_auth 0 2024-09-12T17:47:36.327 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: _check_auth_tickets 2024-09-12T17:47:36.327 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:47:36.327 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:36.328 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:47:36.328 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: dump: 2024-09-12T17:47:36.328 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:36.328 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:36.328 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.328 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.328 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:36.328 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.328 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:36.328 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:36.328 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:36.328 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.328 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:47:36.004+0000 7f2f4c536800 5 monclient: authenticate success, global_id 7847 2024-09-12T17:47:36.329 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:47:36.004+0000 7f2e1f7fe640 4 set_mon_vals no callback set 2024-09-12T17:47:36.329 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:47:36.004+0000 7f2f4c536800 10 monclient: _renew_subs 2024-09-12T17:47:36.329 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:47:36.004+0000 7f2f4c536800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:47:36.329 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:47:36.004+0000 7f2f4c536800 10 monclient: _renew_subs 2024-09-12T17:47:36.329 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:47:36.004+0000 7f2f4c536800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:47:36.329 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:47:36.004+0000 7f2f4c536800 1 librados: init done 2024-09-12T17:47:36.329 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:47:36.004+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command cr dump hook 0x56459ef12cd8 2024-09-12T17:47:36.330 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:47:36.006+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.330 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:47:36.006+0000 7f2e1dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:47:36.330 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:47:36.006+0000 7f2e1dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:36.330 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:47:36.006+0000 7f2e1dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:36.330 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:47:36.007+0000 7f2f482b7640 10 monclient: get_auth_request con 0x56459ef1ce00 auth_method 0 2024-09-12T17:47:36.330 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:47:36.007+0000 7f2f3fab6640 10 monclient: get_auth_request con 0x56459ef30380 auth_method 0 2024-09-12T17:47:36.330 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.330 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:47:36.008+0000 7f2f4c536800 20 realm 2024-09-12T17:47:36.330 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.330 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.330 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:47:36.008+0000 7f2f4c536800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:36.330 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.330 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.330 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.331 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:47:36.008+0000 7f2f482b7640 10 monclient: get_auth_request con 0x56459ef34630 auth_method 0 2024-09-12T17:47:36.331 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:47:36.009+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:36.331 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:47:36.009+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.331 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:47:36.009+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:36.331 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:47:36.009+0000 7f2f4c536800 20 searching for the correct realm 2024-09-12T17:47:36.331 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:47:36.009+0000 7f2f3fab6640 10 monclient: get_auth_request con 0x56459ef398b0 auth_method 0 2024-09-12T17:47:36.331 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:47:36.010+0000 7f2f3fab6640 0 -- 172.21.15.44:0/3149487022 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x56459ef398b0 msgr2=0x56459ef3bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:36.331 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:47:36.211+0000 7f2f3fab6640 10 monclient: get_auth_request con 0x56459ef398b0 auth_method 0 2024-09-12T17:47:36.331 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:47:36.212+0000 7f2f48ab8640 10 monclient: get_auth_request con 0x7f2f3003b070 auth_method 0 2024-09-12T17:47:36.331 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:47:36.213+0000 7f2f482b7640 10 monclient: get_auth_request con 0x7f2f40061040 auth_method 0 2024-09-12T17:47:36.331 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:47:36.214+0000 7f2f3fab6640 10 monclient: get_auth_request con 0x7f2f38011b20 auth_method 0 2024-09-12T17:47:36.331 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:47:36.216+0000 7f2f3fab6640 0 -- 172.21.15.44:0/3149487022 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x56459ef398b0 msgr2=0x56459ef3bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:36.331 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:47:36.216+0000 7f2e1dffb640 1 client.7847.objecter ms_handle_reset 0x56459ef398b0 session 0x56459ef39230 osd.3 2024-09-12T17:47:36.332 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:47:36.216+0000 7f2e1dffb640 10 monclient: _renew_subs 2024-09-12T17:47:36.332 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:47:36.216+0000 7f2e1dffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:47:36.332 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:47:36.216+0000 7f2f3fab6640 10 monclient: get_auth_request con 0x7f2e1008dd80 auth_method 0 2024-09-12T17:47:36.332 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:47:36.217+0000 7f2f48ab8640 10 monclient: get_auth_request con 0x7f2f3001c040 auth_method 0 2024-09-12T17:47:36.332 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:47:36.219+0000 7f2f482b7640 10 monclient: get_auth_request con 0x7f2f3003bb80 auth_method 0 2024-09-12T17:47:36.332 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:47:36.332 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:47:36.332 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:36.332 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:36.332 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:36.332 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:36.332 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.333 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.333 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.333 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:36.333 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.333 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:47:36.226+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:36.333 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:47:36.226+0000 7f2f4c536800 20 zone default found 2024-09-12T17:47:36.333 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:47:36.226+0000 7f2f4c536800 4 Realm: () 2024-09-12T17:47:36.333 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:47:36.226+0000 7f2f4c536800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:47:36.333 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:47:36.226+0000 7f2f4c536800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:47:36.333 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:47:36.226+0000 7f2f4c536800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:36.333 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:47:36.226+0000 7f2f4c536800 20 zonegroup default 2024-09-12T17:47:36.333 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:47:36.226+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.333 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:47:36.226+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.333 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:47:36.226+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.334 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:47:36.227+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.334 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:47:36.227+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.334 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:47:36.227+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.334 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:47:36.227+0000 7f2f4c536800 20 started sync module instance, tier type = 2024-09-12T17:47:36.334 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:47:36.227+0000 7f2f4c536800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:47:36.334 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=0 2024-09-12T17:47:36.334 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=1 2024-09-12T17:47:36.334 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=2 2024-09-12T17:47:36.334 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=3 2024-09-12T17:47:36.334 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=4 2024-09-12T17:47:36.334 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=5 2024-09-12T17:47:36.334 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=6 2024-09-12T17:47:36.334 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:47:36.238+0000 7f2f4c536800 20 add_watcher() i=7 2024-09-12T17:47:36.334 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:47:36.238+0000 7f2f4c536800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:36.335 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding auth protocol: cephx 2024-09-12T17:47:36.335 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding auth protocol: cephx 2024-09-12T17:47:36.335 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding auth protocol: cephx 2024-09-12T17:47:36.335 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: secure 2024-09-12T17:47:36.335 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: crc 2024-09-12T17:47:36.335 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: secure 2024-09-12T17:47:36.335 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: crc 2024-09-12T17:47:36.335 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: secure 2024-09-12T17:47:36.335 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: crc 2024-09-12T17:47:36.335 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: crc 2024-09-12T17:47:36.335 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: secure 2024-09-12T17:47:36.335 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: crc 2024-09-12T17:47:36.335 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: secure 2024-09-12T17:47:36.336 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: crc 2024-09-12T17:47:36.336 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: secure 2024-09-12T17:47:36.336 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:47:36.240+0000 7f2dfefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:36.336 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:47:36.241+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.336 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:47:36.241+0000 7f2f4c536800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:36.336 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:47:36.241+0000 7f2f4c536800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:36.336 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command cache list hook 0x56459ef13500 2024-09-12T17:47:36.336 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command cache inspect hook 0x56459ef13500 2024-09-12T17:47:36.336 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command cache erase hook 0x56459ef13500 2024-09-12T17:47:36.336 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command cache zap hook 0x56459ef13500 2024-09-12T17:47:36.337 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 note: GC not initialized 2024-09-12T17:47:36.337 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:47:36.241+0000 7f2dfdfdb640 20 reqs_thread_entry: start 2024-09-12T17:47:36.337 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command sync trace show hook 0x7f2f3001e440 2024-09-12T17:47:36.337 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command sync trace history hook 0x7f2f3001e440 2024-09-12T17:47:36.337 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command sync trace active hook 0x7f2f3001e440 2024-09-12T17:47:36.337 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command sync trace active_short hook 0x7f2f3001e440 2024-09-12T17:47:36.337 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:47:36.241+0000 7f2f4c536800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:36.337 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:47:36.241+0000 7f2f4c536800 20 Filter name: none 2024-09-12T17:47:36.337 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:47:36.241+0000 7f2d6f7fe640 20 reqs_thread_entry: start 2024-09-12T17:47:36.337 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:47:36.241+0000 7f2f4c536800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:47:36.338 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:47:36.241+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.338 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:47:36.242+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:36.338 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:47:36.242+0000 7f2f4c536800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:47:36.338 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:47:36.242+0000 7f2f4c536800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:47:36.338 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:47:36.242+0000 7f2f4c536800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:47:36.338 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:47:36.242+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.338 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:47:36.243+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:47:36.338 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:47:36.243+0000 7f2f4c536800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:36.338 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:47:36.243+0000 7f2f4c536800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:36.338 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:47:36.243+0000 7f2f4c536800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:36.338 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:47:36.243+0000 7f2f4c536800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:36.338 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:47:36.243+0000 7f2f4c536800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:47:36.338 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:47:36.244+0000 7f2f4c536800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:47:36.339 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:47:36.251+0000 7f2f4c536800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:36.339 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:47:36.251+0000 7f2f4c536800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:36.339 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:47:36.251+0000 7f2f4c536800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:36.339 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:47:36.251+0000 7f2f4c536800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:47:36.339 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:47:36.252+0000 7f2e1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562465 cookie 94857019504880 notifier 7847 bl.length()=911 2024-09-12T17:47:36.339 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:47:36.252+0000 7f2e1f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:36.339 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:47:36.252+0000 7f2e1f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:36.339 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:47:36.252+0000 7f2e1f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:36.339 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:47:36.252+0000 7f2f4c536800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:47:36.339 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:47:36.252+0000 7f2f4c536800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:47:36.339 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:47:36.252+0000 7f2f4c536800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:47:36.339 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:47:36.252+0000 7f2f4c536800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:47:36.340 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:47:36.257+0000 7f2f4c536800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2f4c536800 time 2024-09-12T17:47:36.257360+0000 2024-09-12T17:47:36.340 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:47:36.340 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.340 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:47:36.340 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2f4dd8c71a] 2024-09-12T17:47:36.340 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2f4dd8c8d8] 2024-09-12T17:47:36.340 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56459ce9f841] 2024-09-12T17:47:36.340 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd7490c) [0x56459d3ad90c] 2024-09-12T17:47:36.340 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56459ceaf50d] 2024-09-12T17:47:36.340 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:47:36.340 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2f4ca29590] 2024-09-12T17:47:36.341 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:47:36.341 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:47:36.341 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.341 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:47:36.258+0000 7f2f4c536800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:47:36.341 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f2f4c536800 thread_name:radosgw-admin 2024-09-12T17:47:36.341 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.341 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:47:36.341 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2f4ca3e6f0] 2024-09-12T17:47:36.341 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2f4ca8b99c] 2024-09-12T17:47:36.341 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:47:36.342 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:47:36.342 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2f4dd8c774] 2024-09-12T17:47:36.342 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2f4dd8c8d8] 2024-09-12T17:47:36.342 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56459ce9f841] 2024-09-12T17:47:36.342 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd7490c) [0x56459d3ad90c] 2024-09-12T17:47:36.342 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56459ceaf50d] 2024-09-12T17:47:36.342 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:47:36.342 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2f4ca29590] 2024-09-12T17:47:36.342 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:47:36.342 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:47:36.342 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:47:36.342 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.342 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:47:36.343 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:47:36.343 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:47:36.343 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:47:36.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:47:36.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:47:36.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:47:36.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:47:36.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:47:36.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:47:36.343 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:47:36.343 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:47:36.343 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:47:36.343 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:47:36.343 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:47:36.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:47:36.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:47:36.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:47:36.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:47:36.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:47:36.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:47:36.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:47:36.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:47:36.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:47:36.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:47:36.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:47:36.344 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:47:36.344 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:47:36.345 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:47:36.345 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:47:36.345 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:47:36.345 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:47:36.345 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:47:36.345 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:47:36.345 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:47:36.345 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:47:36.345 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:47:36.345 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:47:36.345 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:47:36.346 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:47:36.346 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:47:36.346 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:47:36.346 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:47:36.346 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:47:36.346 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:47:36.346 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:47:36.346 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:47:36.346 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:47:36.346 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:47:36.346 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:47:36.346 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:47:36.347 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:47:36.347 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:47:36.347 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:47:36.347 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:47:36.347 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:47:36.347 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:47:36.347 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:47:36.347 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:47:36.347 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:47:36.347 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:47:36.347 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:47:36.347 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:47:36.347 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:47:36.348 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:47:36.348 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:47:36.348 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:47:36.348 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:47:36.348 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:47:36.348 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:47:36.348 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:47:36.348 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:47:36.348 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:47:36.348 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:47:36.349 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:47:36.349 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:47:36.349 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:47:36.349 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:47:36.349 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:47:36.349 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:47:36.349 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:47:36.349 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:47:36.349 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:47:36.349 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:47:36.349 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:47:36.349 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:47:36.350 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:47:36.350 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:47:36.350 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:47:36.350 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:47:36.350 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:47:36.350 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:47:36.350 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:47:36.351 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:47:36.351 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2d6f7fe640 / http_manager 2024-09-12T17:47:36.351 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2dfdfdb640 / http_manager 2024-09-12T17:47:36.351 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2dfefdd640 / rgw_dt_lg_renew 2024-09-12T17:47:36.351 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e1dffb640 / ms_dispatch 2024-09-12T17:47:36.351 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e1f7fe640 / io_context_pool 2024-09-12T17:47:36.351 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e2dffb640 / ms_dispatch 2024-09-12T17:47:36.351 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e34e09640 / ms_dispatch 2024-09-12T17:47:36.351 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e3660c640 / io_context_pool 2024-09-12T17:47:36.351 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f3fab6640 / msgr-worker-2 2024-09-12T17:47:36.351 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f482b7640 / msgr-worker-1 2024-09-12T17:47:36.351 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f48ab8640 / msgr-worker-0 2024-09-12T17:47:36.352 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f492b9640 / io_context_pool 2024-09-12T17:47:36.352 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f4c536800 / radosgw-admin 2024-09-12T17:47:36.352 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:47:36.352 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:47:36.352 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/log/ceph/ceph-client.admin.153301.log 2024-09-12T17:47:36.352 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:47:36.352 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:47:36.352 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: crc 2024-09-12T17:47:36.352 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: secure 2024-09-12T17:47:36.352 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: crc 2024-09-12T17:47:36.352 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: secure 2024-09-12T17:47:36.352 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: crc 2024-09-12T17:47:36.352 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: crc 2024-09-12T17:47:36.353 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: secure 2024-09-12T17:47:36.353 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: crc 2024-09-12T17:47:36.353 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: secure 2024-09-12T17:47:36.353 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: crc 2024-09-12T17:47:36.353 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 AuthRegistry(0x56459ee4b8a0) adding con mode: secure 2024-09-12T17:47:36.353 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:47:35.986+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.353 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:47:35.986+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.353 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:47:35.986+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command rotate-key hook 0x56459ee4b9e8 2024-09-12T17:47:36.353 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient: _reopen_session rank -1 2024-09-12T17:47:36.353 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:47:36.353 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-c con 0x56459ee52100 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:36.353 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-b con 0x56459ee750c0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:36.354 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-a con 0x7f2f34003bd0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:36.354 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.354 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.354 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.354 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient(hunting): _renew_subs 2024-09-12T17:47:36.354 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:47:35.986+0000 7f2f4c536800 10 monclient(hunting): authenticate will time out at 2228.622804s 2024-09-12T17:47:36.354 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:47:35.986+0000 7f2f482b7640 10 monclient(hunting): get_auth_request con 0x56459ee52100 auth_method 0 2024-09-12T17:47:36.354 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:47:35.986+0000 7f2f482b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.354 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:47:35.986+0000 7f2f482b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.354 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:47:35.986+0000 7f2f482b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.354 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:47:35.986+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request con 0x7f2f34003bd0 auth_method 0 2024-09-12T17:47:36.354 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:47:35.986+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.354 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:47:35.986+0000 7f2f48ab8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.354 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:47:35.986+0000 7f2f48ab8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.355 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:47:35.987+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.355 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:47:35.987+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.355 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:47:35.987+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.355 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:47:35.987+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.355 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:47:35.987+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.355 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:47:35.987+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.355 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:47:35.987+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request con 0x56459ee750c0 auth_method 0 2024-09-12T17:47:36.355 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:47:35.987+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.355 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:47:35.987+0000 7f2f3fab6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.355 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:47:35.987+0000 7f2f3fab6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.355 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:47:35.987+0000 7f2f482b7640 10 monclient(hunting): handle_auth_done global_id 7838 payload 824 2024-09-12T17:47:36.355 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:47:35.987+0000 7f2f482b7640 10 monclient: _finish_hunting 0 2024-09-12T17:47:36.355 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:47:35.987+0000 7f2f482b7640 1 monclient: found mon.noname-c 2024-09-12T17:47:36.356 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:47:35.987+0000 7f2f482b7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:47:36.356 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:36.356 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:47:36.356 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: dump: 2024-09-12T17:47:36.356 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:36.356 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:36.356 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.356 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.356 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:36.356 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.356 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:36.356 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:36.356 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:36.357 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.357 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: _finish_auth 0 2024-09-12T17:47:36.357 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: _check_auth_tickets 2024-09-12T17:47:36.357 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:47:36.357 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:36.357 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:47:36.357 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:47:35.987+0000 7f2e34e09640 10 monclient: dump: 2024-09-12T17:47:36.357 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:36.357 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:36.357 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.357 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.358 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:36.358 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.358 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:36.358 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:36.358 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:36.358 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.358 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:47:35.987+0000 7f2f4c536800 5 monclient: authenticate success, global_id 7838 2024-09-12T17:47:36.358 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:47:35.987+0000 7f2f4c536800 10 monclient: _renew_subs 2024-09-12T17:47:36.358 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:47:35.987+0000 7f2f4c536800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:47:36.358 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:47:35.987+0000 7f2e3660c640 4 set_mon_vals no callback set 2024-09-12T17:47:36.358 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:47:35.987+0000 7f2f4c536800 10 monclient: _renew_subs 2024-09-12T17:47:36.359 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:47:35.987+0000 7f2f4c536800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:47:36.359 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:47:35.987+0000 7f2f4c536800 1 librados: init done 2024-09-12T17:47:36.359 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:47:35.989+0000 7f2e34e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:47:36.359 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:47:35.989+0000 7f2e34e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:36.359 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:47:35.989+0000 7f2e34e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:36.359 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:47:35.990+0000 7f2f3fab6640 10 monclient: get_auth_request con 0x7f2e30076470 auth_method 0 2024-09-12T17:47:36.359 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:47:35.990+0000 7f2f48ab8640 10 monclient: get_auth_request con 0x56459ee95740 auth_method 0 2024-09-12T17:47:36.359 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:47:35.991+0000 7f2f482b7640 10 monclient: get_auth_request con 0x56459ee98920 auth_method 0 2024-09-12T17:47:36.359 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:47:35.994+0000 7f2f3fab6640 10 monclient: get_auth_request con 0x56459ee9d9b0 auth_method 0 2024-09-12T17:47:36.359 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:47:35.995+0000 7f2f4c536800 10 monclient: build_initial_monmap 2024-09-12T17:47:36.359 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:47:35.995+0000 7f2f4c536800 1 build_initial for_mkfs: 0 2024-09-12T17:47:36.360 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:47:35.995+0000 7f2f4c536800 10 monclient: monmap: 2024-09-12T17:47:36.360 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:47:36.360 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:47:36.360 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:47:36.360 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:47:36.360 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:47:36.360 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.360 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:47:36.360 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:47:36.360 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:47:36.360 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.361 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding auth protocol: cephx 2024-09-12T17:47:36.361 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding auth protocol: cephx 2024-09-12T17:47:36.361 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding auth protocol: cephx 2024-09-12T17:47:36.361 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: secure 2024-09-12T17:47:36.361 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: crc 2024-09-12T17:47:36.361 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: secure 2024-09-12T17:47:36.361 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: crc 2024-09-12T17:47:36.361 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: secure 2024-09-12T17:47:36.361 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: crc 2024-09-12T17:47:36.362 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: crc 2024-09-12T17:47:36.362 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: secure 2024-09-12T17:47:36.362 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: crc 2024-09-12T17:47:36.362 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: secure 2024-09-12T17:47:36.362 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: crc 2024-09-12T17:47:36.362 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea17e0) adding con mode: secure 2024-09-12T17:47:36.362 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:47:35.995+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.362 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command objecter_requests cmddesc objecter_requests hook 0x56459eea4c40 EEXIST 2024-09-12T17:47:36.363 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:47:35.995+0000 7f2f4c536800 10 monclient: init 2024-09-12T17:47:36.363 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding auth protocol: cephx 2024-09-12T17:47:36.363 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding auth protocol: cephx 2024-09-12T17:47:36.363 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding auth protocol: cephx 2024-09-12T17:47:36.363 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: secure 2024-09-12T17:47:36.363 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: crc 2024-09-12T17:47:36.363 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: secure 2024-09-12T17:47:36.363 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: crc 2024-09-12T17:47:36.363 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: secure 2024-09-12T17:47:36.363 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: crc 2024-09-12T17:47:36.363 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: crc 2024-09-12T17:47:36.363 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: secure 2024-09-12T17:47:36.363 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: crc 2024-09-12T17:47:36.364 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: secure 2024-09-12T17:47:36.364 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: crc 2024-09-12T17:47:36.364 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:47:35.995+0000 7f2f4c536800 5 AuthRegistry(0x56459eea0798) adding con mode: secure 2024-09-12T17:47:36.364 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:47:35.995+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.364 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:47:35.996+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.364 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:47:35.996+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command rotate-key cmddesc rotate-key hook 0x56459eea08e0 EEXIST 2024-09-12T17:47:36.364 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient: _reopen_session rank -1 2024-09-12T17:47:36.364 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:47:36.364 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-c con 0x56459eec8f60 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:36.364 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-a con 0x56459eec9340 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:36.364 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-b con 0x56459eec7c70 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:36.364 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.364 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.365 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.365 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient(hunting): _renew_subs 2024-09-12T17:47:36.365 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:47:35.996+0000 7f2f4c536800 10 monclient(hunting): authenticate will time out at 2228.632295s 2024-09-12T17:47:36.365 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient(hunting): get_auth_request con 0x56459eec8f60 auth_method 0 2024-09-12T17:47:36.365 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.365 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.365 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.365 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:47:35.996+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request con 0x56459eec9340 auth_method 0 2024-09-12T17:47:36.365 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:47:35.996+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.365 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:47:35.996+0000 7f2f3fab6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.365 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:47:35.996+0000 7f2f3fab6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.365 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.365 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.366 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.366 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:47:35.996+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request con 0x56459eec7c70 auth_method 0 2024-09-12T17:47:36.366 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:47:35.996+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.366 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:47:35.996+0000 7f2f48ab8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.366 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:47:35.996+0000 7f2f48ab8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.366 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:47:35.996+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.366 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:47:35.996+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.366 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:47:35.996+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.366 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:47:35.996+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.367 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:47:35.996+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.367 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:47:35.996+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.367 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient(hunting): handle_auth_done global_id 7841 payload 824 2024-09-12T17:47:36.367 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient: _finish_hunting 0 2024-09-12T17:47:36.367 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:47:35.996+0000 7f2f482b7640 1 monclient: found mon.noname-c 2024-09-12T17:47:36.367 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:47:35.996+0000 7f2f482b7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:47:36.367 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:36.367 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:47:36.367 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: dump: 2024-09-12T17:47:36.367 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:36.367 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:36.367 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.367 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.367 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:36.368 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.368 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:36.368 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:36.368 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:36.368 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.368 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: _finish_auth 0 2024-09-12T17:47:36.368 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: _check_auth_tickets 2024-09-12T17:47:36.368 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:47:36.368 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:36.368 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:47:36.368 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:47:35.997+0000 7f2e2dffb640 10 monclient: dump: 2024-09-12T17:47:36.368 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:36.369 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:36.369 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.369 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.369 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:36.369 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.369 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:36.369 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:36.369 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:36.369 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.369 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:47:35.997+0000 7f2f4c536800 5 monclient: authenticate success, global_id 7841 2024-09-12T17:47:36.369 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:47:35.997+0000 7f2f492b9640 4 set_mon_vals no callback set 2024-09-12T17:47:36.369 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:47:35.997+0000 7f2f4c536800 10 monclient: _renew_subs 2024-09-12T17:47:36.369 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:47:35.997+0000 7f2f4c536800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:47:36.370 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:47:35.997+0000 7f2f4c536800 10 monclient: _renew_subs 2024-09-12T17:47:36.370 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:47:35.997+0000 7f2f4c536800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:47:36.370 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:47:35.998+0000 7f2e2dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:47:36.370 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:47:35.998+0000 7f2e2dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:36.370 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:47:35.998+0000 7f2e2dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:36.370 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:47:35.999+0000 7f2f3fab6640 10 monclient: get_auth_request con 0x7f2e20076380 auth_method 0 2024-09-12T17:47:36.370 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:47:35.999+0000 7f2f4c536800 10 monclient: get_monmap_and_config 2024-09-12T17:47:36.370 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:47:35.999+0000 7f2f4c536800 10 monclient: build_initial_monmap 2024-09-12T17:47:36.370 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:47:35.999+0000 7f2f4c536800 1 build_initial for_mkfs: 0 2024-09-12T17:47:36.370 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:47:35.999+0000 7f2f4c536800 10 monclient: monmap: 2024-09-12T17:47:36.370 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:47:36.370 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:47:36.370 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:47:36.370 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:47:36.371 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:47:36.371 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.371 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:47:36.371 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:47:36.371 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:47:36.371 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.371 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding auth protocol: cephx 2024-09-12T17:47:36.371 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding auth protocol: cephx 2024-09-12T17:47:36.371 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding auth protocol: cephx 2024-09-12T17:47:36.371 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: secure 2024-09-12T17:47:36.372 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: crc 2024-09-12T17:47:36.372 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: secure 2024-09-12T17:47:36.372 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: crc 2024-09-12T17:47:36.372 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: secure 2024-09-12T17:47:36.372 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: crc 2024-09-12T17:47:36.372 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: crc 2024-09-12T17:47:36.372 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: secure 2024-09-12T17:47:36.372 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: crc 2024-09-12T17:47:36.372 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: secure 2024-09-12T17:47:36.372 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: crc 2024-09-12T17:47:36.372 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x56459eee8880) adding con mode: secure 2024-09-12T17:47:36.372 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:47:35.999+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.373 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:47:35.999+0000 7f2f4c536800 10 monclient: init 2024-09-12T17:47:36.373 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding auth protocol: cephx 2024-09-12T17:47:36.373 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding auth protocol: cephx 2024-09-12T17:47:36.373 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding auth protocol: cephx 2024-09-12T17:47:36.373 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: secure 2024-09-12T17:47:36.373 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: crc 2024-09-12T17:47:36.373 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: secure 2024-09-12T17:47:36.373 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: crc 2024-09-12T17:47:36.373 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: secure 2024-09-12T17:47:36.373 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: crc 2024-09-12T17:47:36.373 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: crc 2024-09-12T17:47:36.373 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: secure 2024-09-12T17:47:36.373 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: crc 2024-09-12T17:47:36.374 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: secure 2024-09-12T17:47:36.374 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: crc 2024-09-12T17:47:36.374 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:47:35.999+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec815300) adding con mode: secure 2024-09-12T17:47:36.374 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:47:36.000+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.374 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:47:36.000+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.374 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:47:36.000+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command rotate-key cmddesc rotate-key hook 0x7ffcec815448 EEXIST 2024-09-12T17:47:36.374 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient: _reopen_session rank -1 2024-09-12T17:47:36.374 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:47:36.374 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-b con 0x56459ef1ce00 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:36.374 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-a con 0x56459ef0d750 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:36.374 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-c con 0x56459ef18230 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:36.375 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.375 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.375 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.375 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient(hunting): _renew_subs 2024-09-12T17:47:36.375 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:47:36.000+0000 7f2f4c536800 10 monclient(hunting): authenticate will time out at 2228.636377s 2024-09-12T17:47:36.375 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request con 0x56459ef0d750 auth_method 0 2024-09-12T17:47:36.375 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.375 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.375 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.375 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:47:36.000+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request con 0x56459ef18230 auth_method 0 2024-09-12T17:47:36.375 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:47:36.000+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.375 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:47:36.000+0000 7f2f48ab8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.375 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:47:36.000+0000 7f2f48ab8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.376 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.376 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.376 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.376 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:47:36.000+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.376 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:47:36.000+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.376 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:47:36.000+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.376 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:47:36.000+0000 7f2f482b7640 10 monclient(hunting): get_auth_request con 0x56459ef1ce00 auth_method 0 2024-09-12T17:47:36.376 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:47:36.000+0000 7f2f482b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.376 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:47:36.000+0000 7f2f482b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.376 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:47:36.000+0000 7f2f482b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.376 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_done global_id 8388 payload 274 2024-09-12T17:47:36.376 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient: _finish_hunting 0 2024-09-12T17:47:36.376 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 1 monclient: found mon.noname-a 2024-09-12T17:47:36.377 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:47:36.000+0000 7f2f3fab6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:47:36.377 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:36.377 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:47:36.377 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: dump: 2024-09-12T17:47:36.377 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:36.377 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:36.377 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.377 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.377 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:36.377 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.377 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:36.377 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:36.377 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:36.377 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.378 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: _finish_auth 0 2024-09-12T17:47:36.378 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:47:36.378 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:47:36.378 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:36.378 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:47:36.378 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:47:36.001+0000 7f2e1f7fe640 10 monclient: dump: 2024-09-12T17:47:36.378 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:36.378 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:36.378 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.378 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.378 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:36.378 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.378 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:36.378 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:36.379 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:36.379 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.379 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 monclient: authenticate success, global_id 8388 2024-09-12T17:47:36.379 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:47:36.001+0000 7f2f4c536800 10 monclient: get_monmap_and_config success 2024-09-12T17:47:36.379 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:47:36.001+0000 7f2f4c536800 4 set_mon_vals no callback set 2024-09-12T17:47:36.379 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:47:36.001+0000 7f2f4c536800 10 monclient: shutdown 2024-09-12T17:47:36.379 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:47:36.001+0000 7f2f4c536800 10 monclient: build_initial_monmap 2024-09-12T17:47:36.379 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:47:36.001+0000 7f2f4c536800 1 build_initial for_mkfs: 0 2024-09-12T17:47:36.379 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:47:36.001+0000 7f2f4c536800 10 monclient: monmap: 2024-09-12T17:47:36.379 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:47:36.379 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:47:36.379 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:47:36.379 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:47:36.379 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:47:36.380 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.380 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:47:36.380 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:47:36.380 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:47:36.380 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.380 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding auth protocol: cephx 2024-09-12T17:47:36.380 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding auth protocol: cephx 2024-09-12T17:47:36.380 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding auth protocol: cephx 2024-09-12T17:47:36.380 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: secure 2024-09-12T17:47:36.380 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: crc 2024-09-12T17:47:36.380 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: secure 2024-09-12T17:47:36.380 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: crc 2024-09-12T17:47:36.380 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: secure 2024-09-12T17:47:36.380 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: crc 2024-09-12T17:47:36.381 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: crc 2024-09-12T17:47:36.381 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: secure 2024-09-12T17:47:36.381 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: crc 2024-09-12T17:47:36.381 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: secure 2024-09-12T17:47:36.381 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: crc 2024-09-12T17:47:36.381 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:47:36.001+0000 7f2f4c536800 5 AuthRegistry(0x56459eeec360) adding con mode: secure 2024-09-12T17:47:36.381 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:47:36.002+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.381 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:47:36.002+0000 7f2f4c536800 1 librados: starting msgr at 2024-09-12T17:47:36.381 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:47:36.002+0000 7f2f4c536800 1 librados: starting objecter 2024-09-12T17:47:36.381 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command objecter_requests cmddesc objecter_requests hook 0x56459eec73a0 EEXIST 2024-09-12T17:47:36.381 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:47:36.002+0000 7f2f4c536800 1 librados: setting wanted keys 2024-09-12T17:47:36.382 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:47:36.002+0000 7f2f4c536800 1 librados: calling monclient init 2024-09-12T17:47:36.382 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient: init 2024-09-12T17:47:36.382 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding auth protocol: cephx 2024-09-12T17:47:36.382 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding auth protocol: cephx 2024-09-12T17:47:36.382 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding auth protocol: cephx 2024-09-12T17:47:36.382 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: secure 2024-09-12T17:47:36.382 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: crc 2024-09-12T17:47:36.382 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: secure 2024-09-12T17:47:36.382 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: crc 2024-09-12T17:47:36.383 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: secure 2024-09-12T17:47:36.383 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: crc 2024-09-12T17:47:36.383 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: crc 2024-09-12T17:47:36.383 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: secure 2024-09-12T17:47:36.383 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: crc 2024-09-12T17:47:36.383 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: secure 2024-09-12T17:47:36.383 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: crc 2024-09-12T17:47:36.383 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 AuthRegistry(0x56459eedd820) adding con mode: secure 2024-09-12T17:47:36.383 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:47:36.002+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.383 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:47:36.002+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.383 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:47:36.002+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command rotate-key cmddesc rotate-key hook 0x56459eedd968 EEXIST 2024-09-12T17:47:36.384 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient: _reopen_session rank -1 2024-09-12T17:47:36.384 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:47:36.384 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-b con 0x56459ef0d750 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:36.384 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-a con 0x56459ef18230 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:36.384 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient(hunting): picked mon.noname-c con 0x56459ef1ce00 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:36.384 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.384 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.384 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.384 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient(hunting): _renew_subs 2024-09-12T17:47:36.384 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:47:36.002+0000 7f2f4c536800 10 monclient(hunting): authenticate will time out at 2228.638938s 2024-09-12T17:47:36.384 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request con 0x56459ef1ce00 auth_method 0 2024-09-12T17:47:36.384 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.384 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.385 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.385 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request con 0x56459ef18230 auth_method 0 2024-09-12T17:47:36.385 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.385 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.385 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.385 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.385 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.385 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.385 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.385 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.385 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:47:36.385 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): get_auth_request con 0x56459ef0d750 auth_method 0 2024-09-12T17:47:36.385 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.386 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.386 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:47:36.386 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_done global_id 7847 payload 824 2024-09-12T17:47:36.386 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient: _finish_hunting 0 2024-09-12T17:47:36.386 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 1 monclient: found mon.noname-c 2024-09-12T17:47:36.386 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:47:36.386 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient: ms_handle_reset current mon [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:36.386 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient: _reopen_session rank -1 2024-09-12T17:47:36.386 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:47:36.386 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient(hunting): picked mon.noname-b con 0x56459ef0d750 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:47:36.386 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient(hunting): picked mon.noname-c con 0x7f2e100048f0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:47:36.386 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient(hunting): picked mon.noname-a con 0x56459ef18230 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:47:36.386 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.387 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.387 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient(hunting): start opening mon connection 2024-09-12T17:47:36.387 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:47:36.003+0000 7f2e1dffb640 10 monclient(hunting): _renew_subs 2024-09-12T17:47:36.387 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request con 0x56459ef18230 auth_method 0 2024-09-12T17:47:36.387 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.387 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.387 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:47:36.387 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request con 0x7f2e100048f0 auth_method 0 2024-09-12T17:47:36.387 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.387 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.387 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:47:36.387 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): get_auth_request con 0x56459ef0d750 auth_method 0 2024-09-12T17:47:36.387 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:47:36.387 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:47:36.388 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:47:36.388 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.388 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.388 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:47:36.388 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.388 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.388 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:47:36.003+0000 7f2f3fab6640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:47:36.388 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:47:36.388 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:47:36.388 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:47:36.003+0000 7f2f482b7640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:47:36.388 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:47:36.003+0000 7f2f48ab8640 10 monclient(hunting): handle_auth_done global_id 7847 payload 293 2024-09-12T17:47:36.388 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:47:36.004+0000 7f2f48ab8640 10 monclient: _finish_hunting 0 2024-09-12T17:47:36.388 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:47:36.004+0000 7f2f48ab8640 1 monclient: found mon.noname-a 2024-09-12T17:47:36.389 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:47:36.004+0000 7f2f48ab8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:47:36.389 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:36.389 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:47:36.389 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: dump: 2024-09-12T17:47:36.389 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:36.389 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:36.389 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.389 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.389 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:36.389 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.389 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:36.389 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:36.389 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:36.389 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.390 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: _finish_auth 0 2024-09-12T17:47:36.390 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: _check_auth_tickets 2024-09-12T17:47:36.390 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:47:36.390 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:47:36.390 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:47:36.390 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:47:36.004+0000 7f2e1dffb640 10 monclient: dump: 2024-09-12T17:47:36.390 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:47:36.390 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:47:36.390 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.390 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:47:36.390 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:47:36.391 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:47:36.391 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:47:36.391 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:47:36.391 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:47:36.391 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.391 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:47:36.004+0000 7f2f4c536800 5 monclient: authenticate success, global_id 7847 2024-09-12T17:47:36.391 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:47:36.004+0000 7f2e1f7fe640 4 set_mon_vals no callback set 2024-09-12T17:47:36.391 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:47:36.004+0000 7f2f4c536800 10 monclient: _renew_subs 2024-09-12T17:47:36.391 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:47:36.004+0000 7f2f4c536800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:47:36.391 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:47:36.004+0000 7f2f4c536800 10 monclient: _renew_subs 2024-09-12T17:47:36.391 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:47:36.004+0000 7f2f4c536800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:47:36.391 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:47:36.004+0000 7f2f4c536800 1 librados: init done 2024-09-12T17:47:36.391 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:47:36.004+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command cr dump hook 0x56459ef12cd8 2024-09-12T17:47:36.391 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:47:36.006+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.392 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:47:36.006+0000 7f2e1dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:47:36.392 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:47:36.006+0000 7f2e1dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:36.392 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:47:36.006+0000 7f2e1dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:47:36.392 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:47:36.007+0000 7f2f482b7640 10 monclient: get_auth_request con 0x56459ef1ce00 auth_method 0 2024-09-12T17:47:36.392 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:47:36.007+0000 7f2f3fab6640 10 monclient: get_auth_request con 0x56459ef30380 auth_method 0 2024-09-12T17:47:36.392 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.392 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:47:36.008+0000 7f2f4c536800 20 realm 2024-09-12T17:47:36.392 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.392 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.393 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:47:36.008+0000 7f2f4c536800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:36.393 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.393 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.393 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:47:36.008+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.393 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:47:36.008+0000 7f2f482b7640 10 monclient: get_auth_request con 0x56459ef34630 auth_method 0 2024-09-12T17:47:36.393 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:47:36.009+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:36.393 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:47:36.009+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.393 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:47:36.009+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:36.393 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:47:36.009+0000 7f2f4c536800 20 searching for the correct realm 2024-09-12T17:47:36.394 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:47:36.009+0000 7f2f3fab6640 10 monclient: get_auth_request con 0x56459ef398b0 auth_method 0 2024-09-12T17:47:36.394 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:47:36.010+0000 7f2f3fab6640 0 -- 172.21.15.44:0/3149487022 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x56459ef398b0 msgr2=0x56459ef3bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:36.394 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:47:36.211+0000 7f2f3fab6640 10 monclient: get_auth_request con 0x56459ef398b0 auth_method 0 2024-09-12T17:47:36.394 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:47:36.212+0000 7f2f48ab8640 10 monclient: get_auth_request con 0x7f2f3003b070 auth_method 0 2024-09-12T17:47:36.394 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:47:36.213+0000 7f2f482b7640 10 monclient: get_auth_request con 0x7f2f40061040 auth_method 0 2024-09-12T17:47:36.394 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:47:36.214+0000 7f2f3fab6640 10 monclient: get_auth_request con 0x7f2f38011b20 auth_method 0 2024-09-12T17:47:36.394 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:47:36.216+0000 7f2f3fab6640 0 -- 172.21.15.44:0/3149487022 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x56459ef398b0 msgr2=0x56459ef3bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:36.394 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:47:36.216+0000 7f2e1dffb640 1 client.7847.objecter ms_handle_reset 0x56459ef398b0 session 0x56459ef39230 osd.3 2024-09-12T17:47:36.394 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:47:36.216+0000 7f2e1dffb640 10 monclient: _renew_subs 2024-09-12T17:47:36.394 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:47:36.216+0000 7f2e1dffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:47:36.394 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:47:36.216+0000 7f2f3fab6640 10 monclient: get_auth_request con 0x7f2e1008dd80 auth_method 0 2024-09-12T17:47:36.394 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:47:36.217+0000 7f2f48ab8640 10 monclient: get_auth_request con 0x7f2f3001c040 auth_method 0 2024-09-12T17:47:36.394 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:47:36.219+0000 7f2f482b7640 10 monclient: get_auth_request con 0x7f2f3003bb80 auth_method 0 2024-09-12T17:47:36.395 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:47:36.395 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:47:36.395 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:36.395 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:36.395 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:36.395 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:36.395 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.395 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.395 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.395 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:36.396 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:47:36.225+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.396 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:47:36.226+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:36.396 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:47:36.226+0000 7f2f4c536800 20 zone default found 2024-09-12T17:47:36.396 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:47:36.226+0000 7f2f4c536800 4 Realm: () 2024-09-12T17:47:36.396 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:47:36.226+0000 7f2f4c536800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:47:36.396 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:47:36.226+0000 7f2f4c536800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:47:36.397 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:47:36.226+0000 7f2f4c536800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:36.397 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:47:36.226+0000 7f2f4c536800 20 zonegroup default 2024-09-12T17:47:36.397 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:47:36.226+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.397 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:47:36.226+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.397 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:47:36.226+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.397 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:47:36.227+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.398 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:47:36.227+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.398 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:47:36.227+0000 7f2f4c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.398 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:47:36.227+0000 7f2f4c536800 20 started sync module instance, tier type = 2024-09-12T17:47:36.398 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:47:36.227+0000 7f2f4c536800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:47:36.398 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=0 2024-09-12T17:47:36.399 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=1 2024-09-12T17:47:36.399 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=2 2024-09-12T17:47:36.399 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=3 2024-09-12T17:47:36.399 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=4 2024-09-12T17:47:36.399 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=5 2024-09-12T17:47:36.399 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:47:36.237+0000 7f2f4c536800 20 add_watcher() i=6 2024-09-12T17:47:36.400 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:47:36.238+0000 7f2f4c536800 20 add_watcher() i=7 2024-09-12T17:47:36.400 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:47:36.238+0000 7f2f4c536800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:36.400 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding auth protocol: cephx 2024-09-12T17:47:36.400 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding auth protocol: cephx 2024-09-12T17:47:36.400 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding auth protocol: cephx 2024-09-12T17:47:36.401 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: secure 2024-09-12T17:47:36.401 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: crc 2024-09-12T17:47:36.401 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: secure 2024-09-12T17:47:36.401 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: crc 2024-09-12T17:47:36.401 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: secure 2024-09-12T17:47:36.402 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: crc 2024-09-12T17:47:36.402 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: crc 2024-09-12T17:47:36.402 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: secure 2024-09-12T17:47:36.402 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: crc 2024-09-12T17:47:36.402 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: secure 2024-09-12T17:47:36.402 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: crc 2024-09-12T17:47:36.403 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:47:36.240+0000 7f2f4c536800 5 AuthRegistry(0x7ffcec8157d0) adding con mode: secure 2024-09-12T17:47:36.403 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:47:36.240+0000 7f2dfefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:36.403 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:47:36.241+0000 7f2f4c536800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:47:36.403 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:47:36.241+0000 7f2f4c536800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:36.403 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:47:36.241+0000 7f2f4c536800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:36.404 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command cache list hook 0x56459ef13500 2024-09-12T17:47:36.404 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command cache inspect hook 0x56459ef13500 2024-09-12T17:47:36.404 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command cache erase hook 0x56459ef13500 2024-09-12T17:47:36.404 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command cache zap hook 0x56459ef13500 2024-09-12T17:47:36.404 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 note: GC not initialized 2024-09-12T17:47:36.404 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:47:36.241+0000 7f2dfdfdb640 20 reqs_thread_entry: start 2024-09-12T17:47:36.405 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command sync trace show hook 0x7f2f3001e440 2024-09-12T17:47:36.405 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command sync trace history hook 0x7f2f3001e440 2024-09-12T17:47:36.405 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command sync trace active hook 0x7f2f3001e440 2024-09-12T17:47:36.405 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:47:36.241+0000 7f2f4c536800 5 asok(0x56459ec2a730) register_command sync trace active_short hook 0x7f2f3001e440 2024-09-12T17:47:36.405 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:47:36.241+0000 7f2f4c536800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:36.406 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:47:36.241+0000 7f2f4c536800 20 Filter name: none 2024-09-12T17:47:36.406 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:47:36.241+0000 7f2d6f7fe640 20 reqs_thread_entry: start 2024-09-12T17:47:36.406 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:47:36.241+0000 7f2f4c536800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:47:36.406 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:47:36.241+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.406 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:47:36.242+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:36.407 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:47:36.242+0000 7f2f4c536800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:47:36.407 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:47:36.242+0000 7f2f4c536800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:47:36.407 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:47:36.242+0000 7f2f4c536800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:47:36.407 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:47:36.242+0000 7f2f4c536800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.407 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:47:36.243+0000 7f2f4c536800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:47:36.407 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:47:36.243+0000 7f2f4c536800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:36.408 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:47:36.243+0000 7f2f4c536800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:36.408 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:47:36.243+0000 7f2f4c536800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:36.408 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:47:36.243+0000 7f2f4c536800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:36.408 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:47:36.243+0000 7f2f4c536800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:47:36.408 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:47:36.244+0000 7f2f4c536800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:47:36.409 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:47:36.251+0000 7f2f4c536800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:36.409 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:47:36.251+0000 7f2f4c536800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:36.409 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:47:36.251+0000 7f2f4c536800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:36.409 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:47:36.251+0000 7f2f4c536800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:47:36.409 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:47:36.252+0000 7f2e1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562465 cookie 94857019504880 notifier 7847 bl.length()=911 2024-09-12T17:47:36.410 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:47:36.252+0000 7f2e1f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:36.410 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:47:36.252+0000 7f2e1f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:36.410 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:47:36.252+0000 7f2e1f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:36.410 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:47:36.252+0000 7f2f4c536800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:47:36.410 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:47:36.252+0000 7f2f4c536800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:47:36.410 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:47:36.252+0000 7f2f4c536800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:47:36.411 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:47:36.252+0000 7f2f4c536800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:47:36.411 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:47:36.257+0000 7f2f4c536800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2f4c536800 time 2024-09-12T17:47:36.257360+0000 2024-09-12T17:47:36.411 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:47:36.411 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.411 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:47:36.412 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2f4dd8c71a] 2024-09-12T17:47:36.412 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2f4dd8c8d8] 2024-09-12T17:47:36.412 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56459ce9f841] 2024-09-12T17:47:36.412 INFO:tasks.workunit.client.0.smithi044.stderr: 4: radosgw-admin(+0xd7490c) [0x56459d3ad90c] 2024-09-12T17:47:36.412 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56459ceaf50d] 2024-09-12T17:47:36.413 INFO:tasks.workunit.client.0.smithi044.stderr: 6: main() 2024-09-12T17:47:36.413 INFO:tasks.workunit.client.0.smithi044.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2f4ca29590] 2024-09-12T17:47:36.413 INFO:tasks.workunit.client.0.smithi044.stderr: 8: __libc_start_main() 2024-09-12T17:47:36.413 INFO:tasks.workunit.client.0.smithi044.stderr: 9: _start() 2024-09-12T17:47:36.413 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.414 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:47:36.258+0000 7f2f4c536800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:47:36.414 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f2f4c536800 thread_name:radosgw-admin 2024-09-12T17:47:36.414 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.414 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:47:36.414 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2f4ca3e6f0] 2024-09-12T17:47:36.414 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2f4ca8b99c] 2024-09-12T17:47:36.415 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:47:36.415 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:47:36.415 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2f4dd8c774] 2024-09-12T17:47:36.415 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2f4dd8c8d8] 2024-09-12T17:47:36.415 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56459ce9f841] 2024-09-12T17:47:36.416 INFO:tasks.workunit.client.0.smithi044.stderr: 8: radosgw-admin(+0xd7490c) [0x56459d3ad90c] 2024-09-12T17:47:36.416 INFO:tasks.workunit.client.0.smithi044.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56459ceaf50d] 2024-09-12T17:47:36.416 INFO:tasks.workunit.client.0.smithi044.stderr: 10: main() 2024-09-12T17:47:36.416 INFO:tasks.workunit.client.0.smithi044.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2f4ca29590] 2024-09-12T17:47:36.416 INFO:tasks.workunit.client.0.smithi044.stderr: 12: __libc_start_main() 2024-09-12T17:47:36.417 INFO:tasks.workunit.client.0.smithi044.stderr: 13: _start() 2024-09-12T17:47:36.417 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:47:36.417 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:47:36.417 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:47:36.417 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:47:36.418 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:47:36.418 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:47:36.418 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:47:36.418 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:47:36.418 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:47:36.418 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:47:36.419 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:47:36.419 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:47:36.419 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:47:36.419 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:47:36.419 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:47:36.420 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:47:36.420 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:47:36.420 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:47:36.420 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:47:36.420 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:47:36.420 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:47:36.421 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:47:36.421 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:47:36.421 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:47:36.421 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:47:36.421 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:47:36.422 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:47:36.422 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:47:36.422 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:47:36.422 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:47:36.422 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:47:36.423 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:47:36.423 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:47:36.423 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:47:36.423 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:47:36.423 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:47:36.423 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:47:36.424 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:47:36.424 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:47:36.424 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:47:36.424 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:47:36.424 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:47:36.425 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:47:36.425 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:47:36.425 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:47:36.425 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:47:36.425 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:47:36.426 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:47:36.426 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:47:36.426 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:47:36.426 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:47:36.426 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:47:36.426 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:47:36.427 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:47:36.427 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:47:36.427 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:47:36.427 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:47:36.427 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:47:36.428 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:47:36.428 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:47:36.428 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:47:36.428 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:47:36.428 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:47:36.428 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:47:36.429 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:47:36.429 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:47:36.429 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:47:36.429 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:47:36.429 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:47:36.430 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:47:36.430 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:47:36.430 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:47:36.430 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:47:36.430 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:47:36.430 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:47:36.431 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:47:36.431 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:47:36.431 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:47:36.431 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:47:36.431 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:47:36.431 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:47:36.432 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:47:36.432 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:47:36.432 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:47:36.432 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:47:36.432 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:47:36.433 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:47:36.433 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:47:36.433 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:47:36.433 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:47:36.433 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:47:36.433 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:47:36.434 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:47:36.434 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:47:36.434 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:47:36.434 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:47:36.434 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2d6f7fe640 / http_manager 2024-09-12T17:47:36.435 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2dfdfdb640 / http_manager 2024-09-12T17:47:36.435 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2dfefdd640 / rgw_dt_lg_renew 2024-09-12T17:47:36.435 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e1dffb640 / ms_dispatch 2024-09-12T17:47:36.435 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e1f7fe640 / io_context_pool 2024-09-12T17:47:36.435 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e2dffb640 / ms_dispatch 2024-09-12T17:47:36.435 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e34e09640 / ms_dispatch 2024-09-12T17:47:36.436 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2e3660c640 / io_context_pool 2024-09-12T17:47:36.436 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f3fab6640 / msgr-worker-2 2024-09-12T17:47:36.436 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f482b7640 / msgr-worker-1 2024-09-12T17:47:36.436 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f48ab8640 / msgr-worker-0 2024-09-12T17:47:36.436 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f492b9640 / io_context_pool 2024-09-12T17:47:36.436 INFO:tasks.workunit.client.0.smithi044.stderr: 7f2f4c536800 / radosgw-admin 2024-09-12T17:47:36.437 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:47:36.437 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:47:36.437 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:47:36.259030Z_a43ef9ad-9026-4785-b331-2046f78231fe/log 2024-09-12T17:47:36.437 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:47:36.440 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:47:36.453 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:36.453 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:36.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.339+0000 7f912d030800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.453 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.340+0000 7f912d030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.340+0000 7f912d030800 20 realm 2024-09-12T17:47:36.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.340+0000 7f912d030800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.341+0000 7f912d030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.341+0000 7f912d030800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:36.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.341+0000 7f912d030800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.341+0000 7f912d030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.341+0000 7f912d030800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.342+0000 7f912d030800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:36.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.342+0000 7f912d030800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.342+0000 7f912d030800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:36.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.342+0000 7f912d030800 20 searching for the correct realm 2024-09-12T17:47:36.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.346+0000 7f9127bcb640 0 -- 172.21.15.44:0/1075510142 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55f82d365930 msgr2=0x55f82d367df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:36.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.349+0000 7f91283cc640 0 -- 172.21.15.44:0/1075510142 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f911c0c8000 msgr2=0x7f911c0be130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:47:36.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.354+0000 7f912d030800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:47:36.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.354+0000 7f912d030800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:47:36.456 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.354+0000 7f912d030800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:36.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.354+0000 7f912d030800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:36.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.354+0000 7f912d030800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:36.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.354+0000 7f912d030800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:36.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.354+0000 7f912d030800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.354+0000 7f912d030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.354+0000 7f912d030800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.355+0000 7f912d030800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:36.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.355+0000 7f912d030800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.355+0000 7f912d030800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:36.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.355+0000 7f912d030800 20 zone default found 2024-09-12T17:47:36.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.355+0000 7f912d030800 4 Realm: () 2024-09-12T17:47:36.457 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.355+0000 7f912d030800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:47:36.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.355+0000 7f912d030800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:47:36.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.355+0000 7f912d030800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:36.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.355+0000 7f912d030800 20 zonegroup default 2024-09-12T17:47:36.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.355+0000 7f912d030800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.355+0000 7f912d030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.355+0000 7f912d030800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.356+0000 7f912d030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.356+0000 7f912d030800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.356+0000 7f912d030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:36.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.356+0000 7f912d030800 20 started sync module instance, tier type = 2024-09-12T17:47:36.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.356+0000 7f912d030800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:47:36.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.365+0000 7f912d030800 20 add_watcher() i=0 2024-09-12T17:47:36.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.365+0000 7f912d030800 20 add_watcher() i=1 2024-09-12T17:47:36.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.365+0000 7f912d030800 20 add_watcher() i=2 2024-09-12T17:47:36.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.365+0000 7f912d030800 20 add_watcher() i=3 2024-09-12T17:47:36.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.365+0000 7f912d030800 20 add_watcher() i=4 2024-09-12T17:47:36.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.365+0000 7f912d030800 20 add_watcher() i=5 2024-09-12T17:47:36.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.366+0000 7f912d030800 20 add_watcher() i=6 2024-09-12T17:47:36.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.366+0000 7f912d030800 20 add_watcher() i=7 2024-09-12T17:47:36.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.366+0000 7f912d030800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:36.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.368+0000 7f8fdefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:36.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.368+0000 7f912d030800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:36.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.368+0000 7f912d030800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:36.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.368+0000 7f912d030800 5 note: GC not initialized 2024-09-12T17:47:36.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.368+0000 7f8fddfdb640 20 reqs_thread_entry: start 2024-09-12T17:47:36.459 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.369+0000 7f912d030800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:36.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.369+0000 7f912d030800 20 Filter name: none 2024-09-12T17:47:36.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.369+0000 7f8f4f7fe640 20 reqs_thread_entry: start 2024-09-12T17:47:36.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.369+0000 7f912d030800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:47:36.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.369+0000 7f912d030800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.369+0000 7f912d030800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:36.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.369+0000 7f912d030800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:47:36.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.369+0000 7f912d030800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:47:36.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.369+0000 7f912d030800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:47:36.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.369+0000 7f912d030800 20 rados->read ofs=0 len=0 2024-09-12T17:47:36.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.370+0000 7f912d030800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:47:36.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.370+0000 7f912d030800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:47:36.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.370+0000 7f912d030800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:47:36.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.370+0000 7f912d030800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:36.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.370+0000 7f912d030800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:36.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.370+0000 7f912d030800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:47:36.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.370+0000 7f912d030800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:47:36.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.370+0000 7f912d030800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:47:36.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.371+0000 7f912d030800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:47:36.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.371+0000 7f912d030800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:47:36.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.371+0000 7f912d030800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:47:36.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.371+0000 7f912d030800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:47:36.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.372+0000 7f912d030800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:47:36.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.372+0000 7f912d030800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:47:36.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.372+0000 7f912d030800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:47:36.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.372+0000 7f912d030800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:47:36.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.373+0000 7f912d030800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:47:36.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.373+0000 7f912d030800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:47:36.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.373+0000 7f912d030800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:47:36.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.373+0000 7f912d030800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:47:36.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.373+0000 7f912d030800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:47:36.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.373+0000 7f912d030800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:47:36.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.374+0000 7f912d030800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:47:36.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.374+0000 7f912d030800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:47:36.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.374+0000 7f912d030800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:47:36.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.374+0000 7f912d030800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:47:36.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.375+0000 7f912d030800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:47:36.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.375+0000 7f912d030800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:47:36.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.375+0000 7f912d030800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:47:36.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.375+0000 7f912d030800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:47:36.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.375+0000 7f912d030800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:47:36.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.375+0000 7f912d030800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:47:36.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.376+0000 7f8fdefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:36.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.379+0000 7f912d030800 20 remove_watcher() i=0 2024-09-12T17:47:36.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.379+0000 7f912d030800 2 removed watcher, disabling cache 2024-09-12T17:47:36.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.380+0000 7f912d030800 20 remove_watcher() i=1 2024-09-12T17:47:36.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.381+0000 7f912d030800 20 remove_watcher() i=2 2024-09-12T17:47:36.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.382+0000 7f912d030800 20 remove_watcher() i=3 2024-09-12T17:47:36.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.383+0000 7f912d030800 20 remove_watcher() i=4 2024-09-12T17:47:36.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.384+0000 7f912d030800 20 remove_watcher() i=5 2024-09-12T17:47:36.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.385+0000 7f912d030800 20 remove_watcher() i=6 2024-09-12T17:47:36.463 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:47:36.386+0000 7f912d030800 20 remove_watcher() i=7 2024-09-12T17:47:36.463 INFO:tasks.workunit.client.0.smithi044.stderr: test: duplicated entries can be purged manually 2024-09-12T17:48:06.426 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:48:06.460 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:06.460 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:06.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.504+0000 7f71f2123800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.506+0000 7f71f2123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.506+0000 7f71f2123800 20 realm 2024-09-12T17:48:06.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.506+0000 7f71f2123800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.506+0000 7f71f2123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.506+0000 7f71f2123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:06.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.506+0000 7f71f2123800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.506+0000 7f71f2123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.506+0000 7f71f2123800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.507+0000 7f71f2123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:06.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.507+0000 7f71f2123800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.507+0000 7f71f2123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:06.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.507+0000 7f71f2123800 20 searching for the correct realm 2024-09-12T17:48:06.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.511+0000 7f71ee614640 0 -- 172.21.15.44:0/306896607 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f71d806b220 msgr2=0x7f71d80610f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:06.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.515+0000 7f71ede13640 0 -- 172.21.15.44:0/306896607 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f71d8098710 msgr2=0x7f71d80176f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:06.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.722+0000 7f71f2123800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:06.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.722+0000 7f71f2123800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:06.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.722+0000 7f71f2123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:06.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.722+0000 7f71f2123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:06.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.722+0000 7f71f2123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:06.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.722+0000 7f71f2123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:06.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.722+0000 7f71f2123800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.722+0000 7f71f2123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.722+0000 7f71f2123800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.722+0000 7f71f2123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:06.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.723+0000 7f71f2123800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.723+0000 7f71f2123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:06.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.723+0000 7f71f2123800 20 zone default found 2024-09-12T17:48:06.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.723+0000 7f71f2123800 4 Realm: () 2024-09-12T17:48:06.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.723+0000 7f71f2123800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:06.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.723+0000 7f71f2123800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:06.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.723+0000 7f71f2123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:06.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.723+0000 7f71f2123800 20 zonegroup default 2024-09-12T17:48:06.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.723+0000 7f71f2123800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.723+0000 7f71f2123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.723+0000 7f71f2123800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.724+0000 7f71f2123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.724+0000 7f71f2123800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.724+0000 7f71f2123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.724+0000 7f71f2123800 20 started sync module instance, tier type = 2024-09-12T17:48:06.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.724+0000 7f71f2123800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:06.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.735+0000 7f71f2123800 20 add_watcher() i=0 2024-09-12T17:48:06.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.735+0000 7f71f2123800 20 add_watcher() i=1 2024-09-12T17:48:06.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.735+0000 7f71f2123800 20 add_watcher() i=2 2024-09-12T17:48:06.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.735+0000 7f71f2123800 20 add_watcher() i=3 2024-09-12T17:48:06.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.735+0000 7f71f2123800 20 add_watcher() i=4 2024-09-12T17:48:06.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.735+0000 7f71f2123800 20 add_watcher() i=5 2024-09-12T17:48:06.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.735+0000 7f71f2123800 20 add_watcher() i=6 2024-09-12T17:48:06.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.736+0000 7f71f2123800 20 add_watcher() i=7 2024-09-12T17:48:06.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.736+0000 7f71f2123800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:06.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.738+0000 7f70a3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:06.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.738+0000 7f71f2123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:06.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.738+0000 7f71f2123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:06.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.738+0000 7f71f2123800 5 note: GC not initialized 2024-09-12T17:48:06.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.738+0000 7f70a2fe5640 20 reqs_thread_entry: start 2024-09-12T17:48:06.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.739+0000 7f71f2123800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:06.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.739+0000 7f71f2123800 20 Filter name: none 2024-09-12T17:48:06.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.739+0000 7f70a0fe1640 20 reqs_thread_entry: start 2024-09-12T17:48:06.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.739+0000 7f71f2123800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.739+0000 7f71f2123800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:06.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.739+0000 7f71f2123800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.740+0000 7f71f2123800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:48:06.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.740+0000 7f71f2123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:06.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.740+0000 7f71f2123800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.740+0000 7f71f2123800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:06.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.740+0000 7f71f2123800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.741+0000 7f71f2123800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:48:06.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.741+0000 7f71f2123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:06.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.743+0000 7f70a3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:06.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.745+0000 7f71f2123800 20 remove_watcher() i=0 2024-09-12T17:48:06.748 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.745+0000 7f71f2123800 2 removed watcher, disabling cache 2024-09-12T17:48:06.748 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.747+0000 7f71f2123800 20 remove_watcher() i=1 2024-09-12T17:48:06.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.748+0000 7f71f2123800 20 remove_watcher() i=2 2024-09-12T17:48:06.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.749+0000 7f71f2123800 20 remove_watcher() i=3 2024-09-12T17:48:06.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.751+0000 7f71f2123800 20 remove_watcher() i=4 2024-09-12T17:48:06.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.752+0000 7f71f2123800 20 remove_watcher() i=5 2024-09-12T17:48:06.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.753+0000 7f71f2123800 20 remove_watcher() i=6 2024-09-12T17:48:06.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.754+0000 7f71f2123800 20 remove_watcher() i=7 2024-09-12T17:48:06.767 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:06.767 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:48:06.767 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: a-bucket id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-12T17:48:06.767 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:06.769 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:48:06.804 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:06.805 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:06.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.843+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.845+0000 7f0071f31800 20 realm 2024-09-12T17:48:06.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.845+0000 7f0071f31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:06.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.846+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:06.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.846+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.846+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:06.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:06.846+0000 7f0071f31800 20 searching for the correct realm 2024-09-12T17:48:07.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.052+0000 7f006d419640 0 -- 172.21.15.44:0/2330354473 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x5596b4e53200 msgr2=0x5596b4e556c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:07.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.056+0000 7f006dc1a640 0 -- 172.21.15.44:0/2330354473 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f0064061910 msgr2=0x7f006409f050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:07.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:07.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:07.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:07.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:07.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:07.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:07.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.060+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.060+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.060+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.061+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:07.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.061+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.061+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:07.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.061+0000 7f0071f31800 20 zone default found 2024-09-12T17:48:07.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.061+0000 7f0071f31800 4 Realm: () 2024-09-12T17:48:07.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.061+0000 7f0071f31800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:07.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.061+0000 7f0071f31800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:07.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.061+0000 7f0071f31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:07.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.061+0000 7f0071f31800 20 zonegroup default 2024-09-12T17:48:07.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.061+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.062+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.062+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.062+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.062+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.062+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.062+0000 7f0071f31800 20 started sync module instance, tier type = 2024-09-12T17:48:07.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.062+0000 7f0071f31800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:07.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=0 2024-09-12T17:48:07.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=1 2024-09-12T17:48:07.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=2 2024-09-12T17:48:07.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=3 2024-09-12T17:48:07.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=4 2024-09-12T17:48:07.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=5 2024-09-12T17:48:07.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=6 2024-09-12T17:48:07.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.073+0000 7f0071f31800 20 add_watcher() i=7 2024-09-12T17:48:07.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.073+0000 7f0071f31800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:07.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.075+0000 7eff1f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:07.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.075+0000 7f0071f31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:07.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.075+0000 7f0071f31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:07.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.075+0000 7f0071f31800 5 note: GC not initialized 2024-09-12T17:48:07.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.076+0000 7eff1e7fc640 20 reqs_thread_entry: start 2024-09-12T17:48:07.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.076+0000 7f0071f31800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:07.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.076+0000 7f0071f31800 20 Filter name: none 2024-09-12T17:48:07.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.076+0000 7efe8ffff640 20 reqs_thread_entry: start 2024-09-12T17:48:07.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.076+0000 7f0071f31800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:48:07.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.076+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.076+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:07.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.076+0000 7f0071f31800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:48:07.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.076+0000 7f0071f31800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:48:07.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.076+0000 7f0071f31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:48:07.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.077+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.077+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:48:07.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.077+0000 7f0071f31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:07.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.077+0000 7f0071f31800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:07.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.077+0000 7f0071f31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:07.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.077+0000 7f0071f31800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:07.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.077+0000 7f0071f31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:48:07.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.078+0000 7f0071f31800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:48:07.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.088+0000 7f0071f31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:07.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.088+0000 7f0071f31800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:07.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.088+0000 7f0071f31800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:07.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.088+0000 7f0071f31800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:48:07.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.088+0000 7eff50ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562466 cookie 94105768381824 notifier 8442 bl.length()=911 2024-09-12T17:48:07.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.088+0000 7eff50ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:07.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.088+0000 7eff50ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:07.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.088+0000 7eff50ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:07.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.089+0000 7f0071f31800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:48:07.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.089+0000 7f0071f31800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:48:07.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.089+0000 7f0071f31800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:48:07.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.089+0000 7f0071f31800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:48:07.096 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0071f31800 time 2024-09-12T17:48:07.096235+0000 2024-09-12T17:48:07.096 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:48:07.096 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:07.096 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f007358c71a] 2024-09-12T17:48:07.097 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f007358c8d8] 2024-09-12T17:48:07.097 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5596b30f1841] 2024-09-12T17:48:07.097 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5596b310157a] 2024-09-12T17:48:07.097 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2024-09-12T17:48:07.097 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f0072229590] 2024-09-12T17:48:07.097 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2024-09-12T17:48:07.097 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2024-09-12T17:48:07.097 INFO:tasks.workunit.client.0.smithi044.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:48:07.097 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f0071f31800 thread_name:radosgw-admin 2024-09-12T17:48:07.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.095+0000 7f0071f31800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0071f31800 time 2024-09-12T17:48:07.096235+0000 2024-09-12T17:48:07.097 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:48:07.097 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.098 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:07.098 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f007358c71a] 2024-09-12T17:48:07.098 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f007358c8d8] 2024-09-12T17:48:07.098 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5596b30f1841] 2024-09-12T17:48:07.098 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5596b310157a] 2024-09-12T17:48:07.098 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2024-09-12T17:48:07.098 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f0072229590] 2024-09-12T17:48:07.098 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2024-09-12T17:48:07.098 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2024-09-12T17:48:07.098 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.117 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:07.117 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f007223e6f0] 2024-09-12T17:48:07.117 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f007228b99c] 2024-09-12T17:48:07.117 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:48:07.118 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:48:07.118 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f007358c774] 2024-09-12T17:48:07.118 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f007358c8d8] 2024-09-12T17:48:07.118 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5596b30f1841] 2024-09-12T17:48:07.118 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5596b310157a] 2024-09-12T17:48:07.118 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2024-09-12T17:48:07.118 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f0072229590] 2024-09-12T17:48:07.118 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2024-09-12T17:48:07.118 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2024-09-12T17:48:07.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.096+0000 7f0071f31800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:48:07.118 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f0071f31800 thread_name:radosgw-admin 2024-09-12T17:48:07.118 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.119 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:07.119 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f007223e6f0] 2024-09-12T17:48:07.119 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f007228b99c] 2024-09-12T17:48:07.119 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:48:07.119 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:48:07.119 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f007358c774] 2024-09-12T17:48:07.119 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f007358c8d8] 2024-09-12T17:48:07.119 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5596b30f1841] 2024-09-12T17:48:07.119 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5596b310157a] 2024-09-12T17:48:07.119 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2024-09-12T17:48:07.119 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f0072229590] 2024-09-12T17:48:07.119 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2024-09-12T17:48:07.119 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2024-09-12T17:48:07.120 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:48:07.120 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.120 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:48:07.120 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:48:06.825+0000 7eff5be07640 10 monclient: _finish_auth 0 2024-09-12T17:48:07.120 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:48:06.825+0000 7eff5be07640 10 monclient: _check_auth_tickets 2024-09-12T17:48:07.120 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:48:06.825+0000 7eff5be07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:07.120 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:48:06.825+0000 7eff5be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.120 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:48:06.825+0000 7eff5be07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:48:07.120 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:48:06.825+0000 7eff5be07640 10 monclient: dump: 2024-09-12T17:48:07.120 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.120 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.120 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.121 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.121 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.121 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.121 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.121 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.121 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.121 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.121 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:48:06.825+0000 7f0071f31800 5 monclient: authenticate success, global_id 7886 2024-09-12T17:48:07.121 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:48:06.825+0000 7f0071f31800 10 monclient: get_monmap_and_config success 2024-09-12T17:48:07.121 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:48:06.825+0000 7f0071f31800 4 set_mon_vals no callback set 2024-09-12T17:48:07.121 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:48:06.825+0000 7f0071f31800 10 monclient: shutdown 2024-09-12T17:48:07.121 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:48:06.825+0000 7f0071f31800 5 asok(0x5596b4b3c730) unregister_commands rotate-key 2024-09-12T17:48:07.121 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:48:06.826+0000 7f0071f31800 10 monclient: build_initial_monmap 2024-09-12T17:48:07.121 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:48:06.826+0000 7f0071f31800 1 build_initial for_mkfs: 0 2024-09-12T17:48:07.122 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:48:06.826+0000 7f0071f31800 10 monclient: monmap: 2024-09-12T17:48:07.122 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:48:07.122 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:07.122 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:48:07.122 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:48:07.122 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:07.122 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.122 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:48:07.122 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:48:07.122 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:48:07.122 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.122 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding auth protocol: cephx 2024-09-12T17:48:07.122 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding auth protocol: cephx 2024-09-12T17:48:07.123 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding auth protocol: cephx 2024-09-12T17:48:07.123 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: secure 2024-09-12T17:48:07.123 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: crc 2024-09-12T17:48:07.123 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: secure 2024-09-12T17:48:07.123 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: crc 2024-09-12T17:48:07.123 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: secure 2024-09-12T17:48:07.123 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: crc 2024-09-12T17:48:07.123 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: crc 2024-09-12T17:48:07.123 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: secure 2024-09-12T17:48:07.123 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: crc 2024-09-12T17:48:07.123 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: secure 2024-09-12T17:48:07.123 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: crc 2024-09-12T17:48:07.123 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: secure 2024-09-12T17:48:07.124 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:48:06.826+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.124 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:48:06.826+0000 7f0071f31800 1 librados: starting msgr at 2024-09-12T17:48:07.124 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:48:06.826+0000 7f0071f31800 1 librados: starting objecter 2024-09-12T17:48:07.124 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command objecter_requests hook 0x5596b4d62c50 2024-09-12T17:48:07.124 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:48:06.826+0000 7f0071f31800 1 librados: setting wanted keys 2024-09-12T17:48:07.124 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:48:06.826+0000 7f0071f31800 1 librados: calling monclient init 2024-09-12T17:48:07.124 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:48:06.826+0000 7f0071f31800 10 monclient: init 2024-09-12T17:48:07.124 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding auth protocol: cephx 2024-09-12T17:48:07.124 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding auth protocol: cephx 2024-09-12T17:48:07.124 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding auth protocol: cephx 2024-09-12T17:48:07.124 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: secure 2024-09-12T17:48:07.124 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: crc 2024-09-12T17:48:07.124 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: secure 2024-09-12T17:48:07.125 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: crc 2024-09-12T17:48:07.125 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: secure 2024-09-12T17:48:07.125 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: crc 2024-09-12T17:48:07.125 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: crc 2024-09-12T17:48:07.125 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: secure 2024-09-12T17:48:07.125 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: crc 2024-09-12T17:48:07.125 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: secure 2024-09-12T17:48:07.125 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: crc 2024-09-12T17:48:07.125 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: secure 2024-09-12T17:48:07.125 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:48:06.826+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.125 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:48:06.826+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.125 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:48:06.827+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command rotate-key hook 0x5596b4d5dc18 2024-09-12T17:48:07.125 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:07.126 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:48:07.126 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-b con 0x5596b4c098e0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:48:07.126 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-c con 0x5596b4c0b780 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:48:07.126 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-a con 0x5596b4ca0970 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:48:07.126 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.126 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.126 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.126 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:07.126 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient(hunting): authenticate will time out at 2259.464123s 2024-09-12T17:48:07.126 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient(hunting): get_auth_request con 0x5596b4c0b780 auth_method 0 2024-09-12T17:48:07.126 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.126 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.126 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.127 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:48:06.827+0000 7f006e41b640 10 monclient(hunting): get_auth_request con 0x5596b4ca0970 auth_method 0 2024-09-12T17:48:07.127 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:48:06.827+0000 7f006e41b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.127 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:48:06.827+0000 7f006e41b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.127 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:48:06.827+0000 7f006e41b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.127 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.127 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.127 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.127 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:48:06.827+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.127 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:48:06.827+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.127 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:48:06.827+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.127 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient(hunting): handle_auth_done global_id 7889 payload 824 2024-09-12T17:48:07.127 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient: _finish_hunting 0 2024-09-12T17:48:07.127 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:48:06.827+0000 7f006d419640 1 monclient: found mon.noname-c 2024-09-12T17:48:07.128 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:48:07.128 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.128 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:48:07.128 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: dump: 2024-09-12T17:48:07.128 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.128 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.128 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.128 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.128 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.128 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.128 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.128 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.128 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.129 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.129 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: _finish_auth 0 2024-09-12T17:48:07.129 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: _check_auth_tickets 2024-09-12T17:48:07.129 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:07.129 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.129 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:48:07.129 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: dump: 2024-09-12T17:48:07.129 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.129 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.129 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.129 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.129 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.129 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.129 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.130 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.130 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.130 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.130 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:48:06.827+0000 7f0071f31800 5 monclient: authenticate success, global_id 7889 2024-09-12T17:48:07.130 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient: _renew_subs 2024-09-12T17:48:07.130 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:48:07.130 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:48:06.827+0000 7eff5be07640 4 set_mon_vals no callback set 2024-09-12T17:48:07.130 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient: _renew_subs 2024-09-12T17:48:07.130 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:48:07.130 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:48:06.827+0000 7f0071f31800 1 librados: init done 2024-09-12T17:48:07.130 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:48:06.829+0000 7eff5a604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:07.130 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:48:06.829+0000 7eff5a604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:48:07.130 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:48:06.829+0000 7eff5a604640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:48:07.131 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:48:06.830+0000 7f006dc1a640 10 monclient: get_auth_request con 0x7eff54076470 auth_method 0 2024-09-12T17:48:07.131 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:48:06.830+0000 7f006e41b640 10 monclient: get_auth_request con 0x5596b4da7130 auth_method 0 2024-09-12T17:48:07.131 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:48:06.831+0000 7f006dc1a640 10 monclient: get_auth_request con 0x5596b4daa310 auth_method 0 2024-09-12T17:48:07.131 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:48:06.832+0000 7f006d419640 10 monclient: get_auth_request con 0x5596b4dadb70 auth_method 0 2024-09-12T17:48:07.131 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:48:06.833+0000 7f0071f31800 10 monclient: build_initial_monmap 2024-09-12T17:48:07.131 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:48:06.833+0000 7f0071f31800 1 build_initial for_mkfs: 0 2024-09-12T17:48:07.131 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:48:06.833+0000 7f0071f31800 10 monclient: monmap: 2024-09-12T17:48:07.131 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:48:07.131 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:07.131 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:48:07.131 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:48:07.131 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:07.131 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.131 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:48:07.132 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:48:07.132 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:48:07.132 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.132 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding auth protocol: cephx 2024-09-12T17:48:07.132 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding auth protocol: cephx 2024-09-12T17:48:07.132 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding auth protocol: cephx 2024-09-12T17:48:07.132 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: secure 2024-09-12T17:48:07.132 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: crc 2024-09-12T17:48:07.132 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: secure 2024-09-12T17:48:07.132 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: crc 2024-09-12T17:48:07.132 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: secure 2024-09-12T17:48:07.132 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: crc 2024-09-12T17:48:07.133 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: crc 2024-09-12T17:48:07.133 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: secure 2024-09-12T17:48:07.133 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: crc 2024-09-12T17:48:07.133 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: secure 2024-09-12T17:48:07.133 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: crc 2024-09-12T17:48:07.133 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: secure 2024-09-12T17:48:07.133 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:48:06.834+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.133 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command objecter_requests cmddesc objecter_requests hook 0x5596b4db6a10 EEXIST 2024-09-12T17:48:07.133 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient: init 2024-09-12T17:48:07.133 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding auth protocol: cephx 2024-09-12T17:48:07.133 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding auth protocol: cephx 2024-09-12T17:48:07.133 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding auth protocol: cephx 2024-09-12T17:48:07.133 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: secure 2024-09-12T17:48:07.134 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: crc 2024-09-12T17:48:07.134 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: secure 2024-09-12T17:48:07.134 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: crc 2024-09-12T17:48:07.134 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: secure 2024-09-12T17:48:07.134 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: crc 2024-09-12T17:48:07.134 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: crc 2024-09-12T17:48:07.134 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: secure 2024-09-12T17:48:07.134 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: crc 2024-09-12T17:48:07.134 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: secure 2024-09-12T17:48:07.134 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: crc 2024-09-12T17:48:07.134 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: secure 2024-09-12T17:48:07.134 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:48:06.834+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.134 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:48:06.834+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.135 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command rotate-key cmddesc rotate-key hook 0x5596b4db26f0 EEXIST 2024-09-12T17:48:07.135 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:07.135 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:48:07.135 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-a con 0x5596b4ddad30 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:48:07.135 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-c con 0x5596b4ddb110 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:48:07.135 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-b con 0x5596b4dd9a40 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:48:07.135 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.135 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.135 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.135 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:07.135 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient(hunting): authenticate will time out at 2259.471830s 2024-09-12T17:48:07.135 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:48:06.834+0000 7f006dc1a640 10 monclient(hunting): get_auth_request con 0x5596b4ddad30 auth_method 0 2024-09-12T17:48:07.135 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:48:06.834+0000 7f006dc1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.135 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:48:06.834+0000 7f006dc1a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.136 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:48:06.834+0000 7f006dc1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.136 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:48:06.834+0000 7f006d419640 10 monclient(hunting): get_auth_request con 0x5596b4ddb110 auth_method 0 2024-09-12T17:48:07.136 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:48:06.834+0000 7f006d419640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.136 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:48:06.834+0000 7f006d419640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.136 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:48:06.834+0000 7f006d419640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.136 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:48:06.835+0000 7f006e41b640 10 monclient(hunting): get_auth_request con 0x5596b4dd9a40 auth_method 0 2024-09-12T17:48:07.136 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:48:06.835+0000 7f006e41b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.136 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:48:06.835+0000 7f006e41b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.136 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:48:06.835+0000 7f006e41b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.136 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:48:06.835+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.136 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:48:06.835+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.136 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:48:06.835+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.136 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:48:06.835+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.137 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:48:06.835+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.137 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:48:06.835+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.137 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:48:06.835+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.137 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:48:06.835+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.137 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:48:06.835+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.137 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:48:06.835+0000 7f006dc1a640 10 monclient(hunting): handle_auth_done global_id 8436 payload 824 2024-09-12T17:48:07.137 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:48:06.835+0000 7f006dc1a640 10 monclient: _finish_hunting 0 2024-09-12T17:48:07.137 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:48:06.835+0000 7f006dc1a640 1 monclient: found mon.noname-a 2024-09-12T17:48:07.137 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:48:06.835+0000 7f006dc1a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:48:07.137 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.137 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:07.137 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: dump: 2024-09-12T17:48:07.137 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.138 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.138 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.138 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.138 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.138 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.138 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.138 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.138 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.138 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.138 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: _finish_auth 0 2024-09-12T17:48:07.138 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: _check_auth_tickets 2024-09-12T17:48:07.138 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:07.138 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.139 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:07.139 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: dump: 2024-09-12T17:48:07.139 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.139 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.139 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.139 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.139 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.139 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.139 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.139 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.139 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.139 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.139 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:48:06.835+0000 7f0071f31800 5 monclient: authenticate success, global_id 8436 2024-09-12T17:48:07.139 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:48:06.835+0000 7f0071f31800 10 monclient: _renew_subs 2024-09-12T17:48:07.140 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:48:06.835+0000 7f0071f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:48:07.140 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:48:06.835+0000 7f006ec1c640 4 set_mon_vals no callback set 2024-09-12T17:48:07.140 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:48:06.835+0000 7f0071f31800 10 monclient: _renew_subs 2024-09-12T17:48:07.140 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:48:06.835+0000 7f0071f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:48:07.140 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:48:06.837+0000 7eff537fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:07.140 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:48:06.837+0000 7eff537fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:48:07.140 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:48:06.837+0000 7eff537fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:48:07.140 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:48:06.837+0000 7f006d419640 10 monclient: get_auth_request con 0x7eff48076380 auth_method 0 2024-09-12T17:48:07.140 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:48:06.837+0000 7f0071f31800 10 monclient: get_monmap_and_config 2024-09-12T17:48:07.140 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:48:06.837+0000 7f0071f31800 10 monclient: build_initial_monmap 2024-09-12T17:48:07.140 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:48:06.837+0000 7f0071f31800 1 build_initial for_mkfs: 0 2024-09-12T17:48:07.140 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:48:06.837+0000 7f0071f31800 10 monclient: monmap: 2024-09-12T17:48:07.140 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:48:07.141 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:07.141 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:48:07.141 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:48:07.141 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:07.141 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.141 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:48:07.141 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:48:07.141 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:48:07.141 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.141 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding auth protocol: cephx 2024-09-12T17:48:07.141 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding auth protocol: cephx 2024-09-12T17:48:07.141 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding auth protocol: cephx 2024-09-12T17:48:07.141 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: secure 2024-09-12T17:48:07.142 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: crc 2024-09-12T17:48:07.142 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: secure 2024-09-12T17:48:07.142 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: crc 2024-09-12T17:48:07.142 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: secure 2024-09-12T17:48:07.142 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: crc 2024-09-12T17:48:07.142 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: crc 2024-09-12T17:48:07.142 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: secure 2024-09-12T17:48:07.142 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: crc 2024-09-12T17:48:07.142 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: secure 2024-09-12T17:48:07.142 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: crc 2024-09-12T17:48:07.142 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: secure 2024-09-12T17:48:07.142 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:48:06.838+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.142 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient: init 2024-09-12T17:48:07.143 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding auth protocol: cephx 2024-09-12T17:48:07.143 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding auth protocol: cephx 2024-09-12T17:48:07.143 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding auth protocol: cephx 2024-09-12T17:48:07.143 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: secure 2024-09-12T17:48:07.143 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: crc 2024-09-12T17:48:07.143 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: secure 2024-09-12T17:48:07.143 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: crc 2024-09-12T17:48:07.143 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: secure 2024-09-12T17:48:07.143 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: crc 2024-09-12T17:48:07.144 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: crc 2024-09-12T17:48:07.144 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: secure 2024-09-12T17:48:07.144 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: crc 2024-09-12T17:48:07.144 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: secure 2024-09-12T17:48:07.144 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: crc 2024-09-12T17:48:07.144 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: secure 2024-09-12T17:48:07.144 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:48:06.838+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.144 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:48:06.838+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.144 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command rotate-key cmddesc rotate-key hook 0x7fff28ed1238 EEXIST 2024-09-12T17:48:07.145 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:07.145 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:48:07.145 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-c con 0x5596b4e2efd0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:48:07.145 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-a con 0x5596b4e2f3b0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:48:07.145 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-b con 0x5596b4e29240 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:48:07.145 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.145 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.145 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.145 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:07.145 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient(hunting): authenticate will time out at 2259.475876s 2024-09-12T17:48:07.145 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:48:06.838+0000 7f006dc1a640 10 monclient(hunting): get_auth_request con 0x5596b4e2efd0 auth_method 0 2024-09-12T17:48:07.145 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.145 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.146 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.146 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:48:06.839+0000 7f006d419640 10 monclient(hunting): get_auth_request con 0x5596b4e2f3b0 auth_method 0 2024-09-12T17:48:07.146 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:48:06.839+0000 7f006d419640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.146 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:48:06.839+0000 7f006d419640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.146 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:48:06.839+0000 7f006d419640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.146 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.146 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.146 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.146 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:48:06.839+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.146 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:48:06.839+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.146 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:48:06.839+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.146 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:48:06.839+0000 7f006e41b640 10 monclient(hunting): get_auth_request con 0x5596b4e29240 auth_method 0 2024-09-12T17:48:07.147 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:48:06.839+0000 7f006e41b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.147 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:48:06.839+0000 7f006e41b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.147 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:48:06.839+0000 7f006e41b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.147 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient(hunting): handle_auth_done global_id 7895 payload 274 2024-09-12T17:48:07.147 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient: _finish_hunting 0 2024-09-12T17:48:07.147 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:48:06.839+0000 7f006dc1a640 1 monclient: found mon.noname-c 2024-09-12T17:48:07.147 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:48:07.147 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.147 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:48:07.147 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: dump: 2024-09-12T17:48:07.147 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.147 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.147 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.148 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.148 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.148 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.148 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.148 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.148 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.148 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.148 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: _finish_auth 0 2024-09-12T17:48:07.148 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: _check_auth_tickets 2024-09-12T17:48:07.148 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:07.148 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.148 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:48:07.148 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: dump: 2024-09-12T17:48:07.149 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.149 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.149 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.149 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.149 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.149 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.149 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.149 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.149 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.149 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.149 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:48:06.839+0000 7f0071f31800 5 monclient: authenticate success, global_id 7895 2024-09-12T17:48:07.149 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:48:06.839+0000 7f0071f31800 10 monclient: get_monmap_and_config success 2024-09-12T17:48:07.149 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:48:06.839+0000 7f0071f31800 4 set_mon_vals no callback set 2024-09-12T17:48:07.150 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:48:06.839+0000 7f0071f31800 10 monclient: shutdown 2024-09-12T17:48:07.150 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:48:06.840+0000 7f0071f31800 10 monclient: build_initial_monmap 2024-09-12T17:48:07.150 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:48:06.840+0000 7f0071f31800 1 build_initial for_mkfs: 0 2024-09-12T17:48:07.150 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:48:06.840+0000 7f0071f31800 10 monclient: monmap: 2024-09-12T17:48:07.150 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:48:07.150 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:07.150 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:48:07.150 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:48:07.150 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:07.150 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.150 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:48:07.150 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:48:07.150 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:48:07.150 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding auth protocol: cephx 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding auth protocol: cephx 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding auth protocol: cephx 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: secure 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: crc 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: secure 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: crc 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: secure 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: crc 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: crc 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: secure 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: crc 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: secure 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: crc 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: secure 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:48:06.840+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:48:06.840+0000 7f0071f31800 1 librados: starting msgr at 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:48:06.840+0000 7f0071f31800 1 librados: starting objecter 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command objecter_requests cmddesc objecter_requests hook 0x5596b4d8b990 EEXIST 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:48:06.840+0000 7f0071f31800 1 librados: setting wanted keys 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:48:06.840+0000 7f0071f31800 1 librados: calling monclient init 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:48:06.840+0000 7f0071f31800 10 monclient: init 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding auth protocol: cephx 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding auth protocol: cephx 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding auth protocol: cephx 2024-09-12T17:48:07.153 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: secure 2024-09-12T17:48:07.153 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: crc 2024-09-12T17:48:07.153 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: secure 2024-09-12T17:48:07.153 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: crc 2024-09-12T17:48:07.153 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: secure 2024-09-12T17:48:07.153 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: crc 2024-09-12T17:48:07.153 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: crc 2024-09-12T17:48:07.153 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: secure 2024-09-12T17:48:07.153 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: crc 2024-09-12T17:48:07.153 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: secure 2024-09-12T17:48:07.153 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: crc 2024-09-12T17:48:07.153 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: secure 2024-09-12T17:48:07.153 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:48:06.840+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.154 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:48:06.841+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.154 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:48:06.841+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command rotate-key cmddesc rotate-key hook 0x5596b4def738 EEXIST 2024-09-12T17:48:07.154 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:07.154 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:48:07.154 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-a con 0x5596b4e2efd0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:48:07.154 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-b con 0x5596b4e2dbe0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:48:07.154 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-c con 0x5596b4e3cf60 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:48:07.154 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.154 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.154 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.154 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:07.154 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient(hunting): authenticate will time out at 2259.478144s 2024-09-12T17:48:07.155 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient(hunting): get_auth_request con 0x5596b4e2efd0 auth_method 0 2024-09-12T17:48:07.155 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.155 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.155 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.155 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:48:06.841+0000 7f006e41b640 10 monclient(hunting): get_auth_request con 0x5596b4e3cf60 auth_method 0 2024-09-12T17:48:07.155 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:48:06.841+0000 7f006e41b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.155 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:48:06.841+0000 7f006e41b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.155 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:48:06.841+0000 7f006e41b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.155 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.155 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.155 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.155 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:48:06.841+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.155 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:48:06.841+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.156 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:48:06.841+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.156 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient(hunting): handle_auth_done global_id 8442 payload 824 2024-09-12T17:48:07.156 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient: _finish_hunting 0 2024-09-12T17:48:07.156 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:48:06.841+0000 7f006dc1a640 1 monclient: found mon.noname-a 2024-09-12T17:48:07.156 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:48:07.156 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:48:06.841+0000 7f006d419640 10 monclient: get_auth_request con 0x5596b4e2dbe0 auth_method 0 2024-09-12T17:48:07.156 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.156 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:07.156 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: dump: 2024-09-12T17:48:07.156 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.156 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.156 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.156 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.157 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.157 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.157 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.157 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.157 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.157 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.157 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: _finish_auth 0 2024-09-12T17:48:07.157 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:48:07.157 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:07.157 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.157 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:07.157 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: dump: 2024-09-12T17:48:07.157 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.158 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.158 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.158 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.158 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.158 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.158 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.158 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.158 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.158 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.158 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:48:06.841+0000 7f0071f31800 5 monclient: authenticate success, global_id 8442 2024-09-12T17:48:07.158 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:48:06.841+0000 7eff517fa640 4 set_mon_vals no callback set 2024-09-12T17:48:07.158 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient: _renew_subs 2024-09-12T17:48:07.158 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:48:07.158 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient: _renew_subs 2024-09-12T17:48:07.159 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:48:07.159 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:48:06.841+0000 7f0071f31800 1 librados: init done 2024-09-12T17:48:07.159 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:48:06.841+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command cr dump hook 0x5596b4e2abe8 2024-09-12T17:48:07.159 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:48:06.843+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.159 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:48:06.844+0000 7eff3f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:07.159 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:48:06.844+0000 7eff3f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:48:07.159 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:48:06.844+0000 7eff3f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:48:07.159 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:48:06.844+0000 7f006d419640 10 monclient: get_auth_request con 0x7eff38076640 auth_method 0 2024-09-12T17:48:07.159 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:48:06.844+0000 7f006e41b640 10 monclient: get_auth_request con 0x5596b4e49c60 auth_method 0 2024-09-12T17:48:07.159 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.159 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:48:06.845+0000 7f0071f31800 20 realm 2024-09-12T17:48:07.159 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.159 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.160 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:48:06.845+0000 7f0071f31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:07.160 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.160 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.160 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.160 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:48:06.845+0000 7f006dc1a640 10 monclient: get_auth_request con 0x5596b4e4df60 auth_method 0 2024-09-12T17:48:07.160 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:48:06.846+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:07.160 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:48:06.846+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.160 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:48:06.846+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:07.160 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:48:06.846+0000 7f0071f31800 20 searching for the correct realm 2024-09-12T17:48:07.160 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:48:06.846+0000 7f006d419640 10 monclient: get_auth_request con 0x5596b4e53200 auth_method 0 2024-09-12T17:48:07.160 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:48:06.847+0000 7f006e41b640 10 monclient: get_auth_request con 0x7f006406b060 auth_method 0 2024-09-12T17:48:07.160 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:48:07.049+0000 7f006e41b640 10 monclient: get_auth_request con 0x7f006406b060 auth_method 0 2024-09-12T17:48:07.160 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:48:07.050+0000 7f006dc1a640 10 monclient: get_auth_request con 0x7f0068017020 auth_method 0 2024-09-12T17:48:07.161 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:48:07.051+0000 7f006d419640 10 monclient: get_auth_request con 0x7f006001d040 auth_method 0 2024-09-12T17:48:07.161 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:48:07.052+0000 7f006d419640 0 -- 172.21.15.44:0/2330354473 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x5596b4e53200 msgr2=0x5596b4e556c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:07.161 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:48:07.052+0000 7eff3f7fe640 1 client.8442.objecter ms_handle_reset 0x5596b4e53200 session 0x5596b4e52b80 osd.3 2024-09-12T17:48:07.161 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:48:07.052+0000 7eff3f7fe640 10 monclient: _renew_subs 2024-09-12T17:48:07.161 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:48:07.052+0000 7eff3f7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:48:07.161 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:48:07.052+0000 7f006d419640 10 monclient: get_auth_request con 0x7eff38086460 auth_method 0 2024-09-12T17:48:07.161 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:48:07.053+0000 7f006e41b640 10 monclient: get_auth_request con 0x7f00640ad620 auth_method 0 2024-09-12T17:48:07.161 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:48:07.055+0000 7f006dc1a640 10 monclient: get_auth_request con 0x7f0064061910 auth_method 0 2024-09-12T17:48:07.161 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:48:07.056+0000 7f006dc1a640 0 -- 172.21.15.44:0/2330354473 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f0064061910 msgr2=0x7f006409f050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:07.161 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:48:07.056+0000 7eff3f7fe640 1 client.8442.objecter ms_handle_reset 0x7f0064061910 session 0x7f00640a3090 osd.0 2024-09-12T17:48:07.161 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:48:07.056+0000 7f006dc1a640 10 monclient: get_auth_request con 0x5596b4e53200 auth_method 0 2024-09-12T17:48:07.161 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:07.161 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:07.162 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:07.162 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:07.162 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:07.162 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:07.162 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.162 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.162 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.162 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:48:07.061+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:07.162 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:48:07.061+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.162 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:48:07.061+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:07.162 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:48:07.061+0000 7f0071f31800 20 zone default found 2024-09-12T17:48:07.162 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:48:07.061+0000 7f0071f31800 4 Realm: () 2024-09-12T17:48:07.162 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:48:07.061+0000 7f0071f31800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:07.163 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:48:07.061+0000 7f0071f31800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:07.163 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:48:07.061+0000 7f0071f31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:07.163 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:48:07.061+0000 7f0071f31800 20 zonegroup default 2024-09-12T17:48:07.163 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:48:07.061+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.163 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:48:07.062+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.163 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:48:07.062+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.163 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:48:07.062+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.163 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:48:07.062+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.163 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:48:07.062+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.163 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:48:07.062+0000 7f0071f31800 20 started sync module instance, tier type = 2024-09-12T17:48:07.163 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:48:07.062+0000 7f0071f31800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:07.163 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=0 2024-09-12T17:48:07.163 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=1 2024-09-12T17:48:07.163 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=2 2024-09-12T17:48:07.164 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=3 2024-09-12T17:48:07.164 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=4 2024-09-12T17:48:07.164 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=5 2024-09-12T17:48:07.164 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=6 2024-09-12T17:48:07.164 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:48:07.073+0000 7f0071f31800 20 add_watcher() i=7 2024-09-12T17:48:07.164 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:48:07.073+0000 7f0071f31800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:07.164 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding auth protocol: cephx 2024-09-12T17:48:07.164 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding auth protocol: cephx 2024-09-12T17:48:07.164 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding auth protocol: cephx 2024-09-12T17:48:07.164 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: secure 2024-09-12T17:48:07.164 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: crc 2024-09-12T17:48:07.164 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: secure 2024-09-12T17:48:07.164 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: crc 2024-09-12T17:48:07.165 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: secure 2024-09-12T17:48:07.168 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: crc 2024-09-12T17:48:07.168 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: crc 2024-09-12T17:48:07.168 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: secure 2024-09-12T17:48:07.168 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: crc 2024-09-12T17:48:07.168 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: secure 2024-09-12T17:48:07.168 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:48:07.075+0000 7eff1f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:07.169 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: crc 2024-09-12T17:48:07.169 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: secure 2024-09-12T17:48:07.169 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:48:07.075+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.169 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:48:07.075+0000 7f0071f31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:07.169 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:48:07.075+0000 7f0071f31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:07.169 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command cache list hook 0x5596b4e3d3c0 2024-09-12T17:48:07.169 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command cache inspect hook 0x5596b4e3d3c0 2024-09-12T17:48:07.169 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command cache erase hook 0x5596b4e3d3c0 2024-09-12T17:48:07.169 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command cache zap hook 0x5596b4e3d3c0 2024-09-12T17:48:07.169 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 note: GC not initialized 2024-09-12T17:48:07.169 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:48:07.076+0000 7eff1e7fc640 20 reqs_thread_entry: start 2024-09-12T17:48:07.169 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:48:07.076+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command sync trace show hook 0x7f006800d7a0 2024-09-12T17:48:07.170 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:48:07.076+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command sync trace history hook 0x7f006800d7a0 2024-09-12T17:48:07.170 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:48:07.076+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command sync trace active hook 0x7f006800d7a0 2024-09-12T17:48:07.170 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:48:07.076+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command sync trace active_short hook 0x7f006800d7a0 2024-09-12T17:48:07.170 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:48:07.076+0000 7f0071f31800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:07.170 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:48:07.076+0000 7f0071f31800 20 Filter name: none 2024-09-12T17:48:07.170 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:48:07.076+0000 7efe8ffff640 20 reqs_thread_entry: start 2024-09-12T17:48:07.170 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:48:07.076+0000 7f0071f31800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:48:07.170 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:48:07.076+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.170 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:48:07.076+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:07.170 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:48:07.076+0000 7f0071f31800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:48:07.170 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:48:07.076+0000 7f0071f31800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:48:07.170 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:48:07.076+0000 7f0071f31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:48:07.171 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:48:07.077+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.171 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:48:07.077+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:48:07.171 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:48:07.077+0000 7f0071f31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:07.171 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:48:07.077+0000 7f0071f31800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:07.171 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:48:07.077+0000 7f0071f31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:07.171 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:48:07.077+0000 7f0071f31800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:07.171 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:48:07.077+0000 7f0071f31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:48:07.171 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:48:07.078+0000 7f0071f31800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:48:07.171 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:48:07.088+0000 7f0071f31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:07.171 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:48:07.088+0000 7f0071f31800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:07.171 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:48:07.088+0000 7f0071f31800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:07.171 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:48:07.088+0000 7f0071f31800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:48:07.171 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:48:07.088+0000 7eff50ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562466 cookie 94105768381824 notifier 8442 bl.length()=911 2024-09-12T17:48:07.172 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:48:07.088+0000 7eff50ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:07.172 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:48:07.088+0000 7eff50ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:07.172 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:48:07.088+0000 7eff50ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:07.172 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:48:07.089+0000 7f0071f31800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:48:07.172 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:48:07.089+0000 7f0071f31800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:48:07.172 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:48:07.089+0000 7f0071f31800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:48:07.172 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:48:07.089+0000 7f0071f31800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:48:07.172 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:48:07.095+0000 7f0071f31800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0071f31800 time 2024-09-12T17:48:07.096235+0000 2024-09-12T17:48:07.172 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:48:07.172 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.172 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:07.172 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f007358c71a] 2024-09-12T17:48:07.172 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f007358c8d8] 2024-09-12T17:48:07.173 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5596b30f1841] 2024-09-12T17:48:07.173 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5596b310157a] 2024-09-12T17:48:07.173 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2024-09-12T17:48:07.173 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f0072229590] 2024-09-12T17:48:07.173 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2024-09-12T17:48:07.173 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2024-09-12T17:48:07.173 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.173 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:48:07.096+0000 7f0071f31800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:48:07.173 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f0071f31800 thread_name:radosgw-admin 2024-09-12T17:48:07.173 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.173 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:07.173 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f007223e6f0] 2024-09-12T17:48:07.173 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f007228b99c] 2024-09-12T17:48:07.174 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:48:07.174 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:48:07.174 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f007358c774] 2024-09-12T17:48:07.174 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f007358c8d8] 2024-09-12T17:48:07.174 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5596b30f1841] 2024-09-12T17:48:07.174 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5596b310157a] 2024-09-12T17:48:07.174 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2024-09-12T17:48:07.174 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f0072229590] 2024-09-12T17:48:07.174 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2024-09-12T17:48:07.174 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2024-09-12T17:48:07.174 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:48:07.174 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.174 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:48:07.174 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:48:07.175 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:48:07.175 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:48:07.175 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:48:07.175 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:48:07.175 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:48:07.175 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:48:07.175 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:48:07.175 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:48:07.175 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:48:07.175 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:48:07.175 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:48:07.175 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:48:07.175 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:48:07.175 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:48:07.176 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:48:07.176 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:48:07.176 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:48:07.176 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:48:07.176 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:48:07.176 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:48:07.176 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:48:07.176 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:48:07.176 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:48:07.176 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:48:07.176 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:48:07.176 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:48:07.176 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:48:07.177 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:48:07.177 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:48:07.177 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:48:07.177 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:48:07.177 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:48:07.177 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:48:07.177 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:48:07.177 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:48:07.177 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:48:07.177 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:48:07.177 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:48:07.177 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:48:07.177 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:48:07.177 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:48:07.178 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:48:07.178 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:48:07.178 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:48:07.178 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:48:07.178 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:48:07.178 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:48:07.178 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:48:07.178 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:48:07.178 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:48:07.178 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:48:07.178 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:48:07.178 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:48:07.178 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:48:07.178 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:48:07.179 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:48:07.179 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:48:07.179 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:48:07.179 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:48:07.179 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:48:07.179 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:48:07.179 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:48:07.179 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:48:07.179 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:48:07.179 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:48:07.179 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:48:07.179 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:48:07.179 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:48:07.180 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:48:07.180 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:48:07.180 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:48:07.180 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:48:07.180 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:48:07.180 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:48:07.180 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:48:07.180 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:48:07.180 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:48:07.180 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:48:07.180 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:48:07.180 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:48:07.180 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:48:07.181 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:48:07.181 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:48:07.181 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:48:07.181 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:48:07.181 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:48:07.181 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:48:07.181 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:48:07.181 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:48:07.181 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:48:07.181 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:48:07.181 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:48:07.181 INFO:tasks.workunit.client.0.smithi044.stderr: 7efe8ffff640 / http_manager 2024-09-12T17:48:07.182 INFO:tasks.workunit.client.0.smithi044.stderr: 7eff1e7fc640 / http_manager 2024-09-12T17:48:07.182 INFO:tasks.workunit.client.0.smithi044.stderr: 7eff1f7fe640 / rgw_dt_lg_renew 2024-09-12T17:48:07.182 INFO:tasks.workunit.client.0.smithi044.stderr: 7eff3f7fe640 / ms_dispatch 2024-09-12T17:48:07.182 INFO:tasks.workunit.client.0.smithi044.stderr: 7eff50ff9640 / io_context_pool 2024-09-12T17:48:07.182 INFO:tasks.workunit.client.0.smithi044.stderr: 7eff517fa640 / io_context_pool 2024-09-12T17:48:07.182 INFO:tasks.workunit.client.0.smithi044.stderr: 7eff537fe640 / ms_dispatch 2024-09-12T17:48:07.182 INFO:tasks.workunit.client.0.smithi044.stderr: 7eff5a604640 / ms_dispatch 2024-09-12T17:48:07.182 INFO:tasks.workunit.client.0.smithi044.stderr: 7eff5be07640 / io_context_pool 2024-09-12T17:48:07.182 INFO:tasks.workunit.client.0.smithi044.stderr: 7f006d419640 / msgr-worker-2 2024-09-12T17:48:07.182 INFO:tasks.workunit.client.0.smithi044.stderr: 7f006dc1a640 / msgr-worker-1 2024-09-12T17:48:07.182 INFO:tasks.workunit.client.0.smithi044.stderr: 7f006e41b640 / msgr-worker-0 2024-09-12T17:48:07.182 INFO:tasks.workunit.client.0.smithi044.stderr: 7f006ec1c640 / io_context_pool 2024-09-12T17:48:07.182 INFO:tasks.workunit.client.0.smithi044.stderr: 7f0071f31800 / radosgw-admin 2024-09-12T17:48:07.183 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:48:07.183 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:48:07.183 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/log/ceph/ceph-client.admin.155068.log 2024-09-12T17:48:07.183 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:48:07.183 INFO:tasks.workunit.client.0.smithi044.stderr:--- begin dump of recent events --- 2024-09-12T17:48:07.183 INFO:tasks.workunit.client.0.smithi044.stderr: -499> 2024-09-12T17:48:06.825+0000 7eff5be07640 10 monclient: _finish_auth 0 2024-09-12T17:48:07.183 INFO:tasks.workunit.client.0.smithi044.stderr: -498> 2024-09-12T17:48:06.825+0000 7eff5be07640 10 monclient: _check_auth_tickets 2024-09-12T17:48:07.183 INFO:tasks.workunit.client.0.smithi044.stderr: -497> 2024-09-12T17:48:06.825+0000 7eff5be07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:07.183 INFO:tasks.workunit.client.0.smithi044.stderr: -496> 2024-09-12T17:48:06.825+0000 7eff5be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.183 INFO:tasks.workunit.client.0.smithi044.stderr: -495> 2024-09-12T17:48:06.825+0000 7eff5be07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:48:07.183 INFO:tasks.workunit.client.0.smithi044.stderr: -494> 2024-09-12T17:48:06.825+0000 7eff5be07640 10 monclient: dump: 2024-09-12T17:48:07.183 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.184 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.184 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.184 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.184 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.184 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.184 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.184 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.184 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.184 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.184 INFO:tasks.workunit.client.0.smithi044.stderr: -493> 2024-09-12T17:48:06.825+0000 7f0071f31800 5 monclient: authenticate success, global_id 7886 2024-09-12T17:48:07.184 INFO:tasks.workunit.client.0.smithi044.stderr: -492> 2024-09-12T17:48:06.825+0000 7f0071f31800 10 monclient: get_monmap_and_config success 2024-09-12T17:48:07.184 INFO:tasks.workunit.client.0.smithi044.stderr: -491> 2024-09-12T17:48:06.825+0000 7f0071f31800 4 set_mon_vals no callback set 2024-09-12T17:48:07.184 INFO:tasks.workunit.client.0.smithi044.stderr: -490> 2024-09-12T17:48:06.825+0000 7f0071f31800 10 monclient: shutdown 2024-09-12T17:48:07.185 INFO:tasks.workunit.client.0.smithi044.stderr: -489> 2024-09-12T17:48:06.825+0000 7f0071f31800 5 asok(0x5596b4b3c730) unregister_commands rotate-key 2024-09-12T17:48:07.185 INFO:tasks.workunit.client.0.smithi044.stderr: -488> 2024-09-12T17:48:06.826+0000 7f0071f31800 10 monclient: build_initial_monmap 2024-09-12T17:48:07.185 INFO:tasks.workunit.client.0.smithi044.stderr: -487> 2024-09-12T17:48:06.826+0000 7f0071f31800 1 build_initial for_mkfs: 0 2024-09-12T17:48:07.185 INFO:tasks.workunit.client.0.smithi044.stderr: -486> 2024-09-12T17:48:06.826+0000 7f0071f31800 10 monclient: monmap: 2024-09-12T17:48:07.185 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:48:07.185 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:07.185 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:48:07.185 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:48:07.185 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:07.185 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.185 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:48:07.185 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:48:07.185 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:48:07.186 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.186 INFO:tasks.workunit.client.0.smithi044.stderr: -485> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding auth protocol: cephx 2024-09-12T17:48:07.186 INFO:tasks.workunit.client.0.smithi044.stderr: -484> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding auth protocol: cephx 2024-09-12T17:48:07.186 INFO:tasks.workunit.client.0.smithi044.stderr: -483> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding auth protocol: cephx 2024-09-12T17:48:07.186 INFO:tasks.workunit.client.0.smithi044.stderr: -482> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: secure 2024-09-12T17:48:07.186 INFO:tasks.workunit.client.0.smithi044.stderr: -481> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: crc 2024-09-12T17:48:07.186 INFO:tasks.workunit.client.0.smithi044.stderr: -480> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: secure 2024-09-12T17:48:07.186 INFO:tasks.workunit.client.0.smithi044.stderr: -479> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: crc 2024-09-12T17:48:07.186 INFO:tasks.workunit.client.0.smithi044.stderr: -478> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: secure 2024-09-12T17:48:07.186 INFO:tasks.workunit.client.0.smithi044.stderr: -477> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: crc 2024-09-12T17:48:07.186 INFO:tasks.workunit.client.0.smithi044.stderr: -476> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: crc 2024-09-12T17:48:07.186 INFO:tasks.workunit.client.0.smithi044.stderr: -475> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: secure 2024-09-12T17:48:07.186 INFO:tasks.workunit.client.0.smithi044.stderr: -474> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: crc 2024-09-12T17:48:07.187 INFO:tasks.workunit.client.0.smithi044.stderr: -473> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: secure 2024-09-12T17:48:07.187 INFO:tasks.workunit.client.0.smithi044.stderr: -472> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: crc 2024-09-12T17:48:07.187 INFO:tasks.workunit.client.0.smithi044.stderr: -471> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d631e0) adding con mode: secure 2024-09-12T17:48:07.187 INFO:tasks.workunit.client.0.smithi044.stderr: -470> 2024-09-12T17:48:06.826+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.187 INFO:tasks.workunit.client.0.smithi044.stderr: -469> 2024-09-12T17:48:06.826+0000 7f0071f31800 1 librados: starting msgr at 2024-09-12T17:48:07.187 INFO:tasks.workunit.client.0.smithi044.stderr: -468> 2024-09-12T17:48:06.826+0000 7f0071f31800 1 librados: starting objecter 2024-09-12T17:48:07.187 INFO:tasks.workunit.client.0.smithi044.stderr: -467> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command objecter_requests hook 0x5596b4d62c50 2024-09-12T17:48:07.187 INFO:tasks.workunit.client.0.smithi044.stderr: -466> 2024-09-12T17:48:06.826+0000 7f0071f31800 1 librados: setting wanted keys 2024-09-12T17:48:07.187 INFO:tasks.workunit.client.0.smithi044.stderr: -465> 2024-09-12T17:48:06.826+0000 7f0071f31800 1 librados: calling monclient init 2024-09-12T17:48:07.187 INFO:tasks.workunit.client.0.smithi044.stderr: -464> 2024-09-12T17:48:06.826+0000 7f0071f31800 10 monclient: init 2024-09-12T17:48:07.187 INFO:tasks.workunit.client.0.smithi044.stderr: -463> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding auth protocol: cephx 2024-09-12T17:48:07.187 INFO:tasks.workunit.client.0.smithi044.stderr: -462> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding auth protocol: cephx 2024-09-12T17:48:07.187 INFO:tasks.workunit.client.0.smithi044.stderr: -461> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding auth protocol: cephx 2024-09-12T17:48:07.188 INFO:tasks.workunit.client.0.smithi044.stderr: -460> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: secure 2024-09-12T17:48:07.188 INFO:tasks.workunit.client.0.smithi044.stderr: -459> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: crc 2024-09-12T17:48:07.188 INFO:tasks.workunit.client.0.smithi044.stderr: -458> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: secure 2024-09-12T17:48:07.188 INFO:tasks.workunit.client.0.smithi044.stderr: -457> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: crc 2024-09-12T17:48:07.188 INFO:tasks.workunit.client.0.smithi044.stderr: -456> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: secure 2024-09-12T17:48:07.188 INFO:tasks.workunit.client.0.smithi044.stderr: -455> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: crc 2024-09-12T17:48:07.188 INFO:tasks.workunit.client.0.smithi044.stderr: -454> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: crc 2024-09-12T17:48:07.188 INFO:tasks.workunit.client.0.smithi044.stderr: -453> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: secure 2024-09-12T17:48:07.188 INFO:tasks.workunit.client.0.smithi044.stderr: -452> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: crc 2024-09-12T17:48:07.188 INFO:tasks.workunit.client.0.smithi044.stderr: -451> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: secure 2024-09-12T17:48:07.188 INFO:tasks.workunit.client.0.smithi044.stderr: -450> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: crc 2024-09-12T17:48:07.188 INFO:tasks.workunit.client.0.smithi044.stderr: -449> 2024-09-12T17:48:06.826+0000 7f0071f31800 5 AuthRegistry(0x5596b4d5dad0) adding con mode: secure 2024-09-12T17:48:07.188 INFO:tasks.workunit.client.0.smithi044.stderr: -448> 2024-09-12T17:48:06.826+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.189 INFO:tasks.workunit.client.0.smithi044.stderr: -447> 2024-09-12T17:48:06.826+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.189 INFO:tasks.workunit.client.0.smithi044.stderr: -446> 2024-09-12T17:48:06.827+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command rotate-key hook 0x5596b4d5dc18 2024-09-12T17:48:07.189 INFO:tasks.workunit.client.0.smithi044.stderr: -445> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:07.189 INFO:tasks.workunit.client.0.smithi044.stderr: -444> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:48:07.189 INFO:tasks.workunit.client.0.smithi044.stderr: -443> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-b con 0x5596b4c098e0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:48:07.189 INFO:tasks.workunit.client.0.smithi044.stderr: -442> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-c con 0x5596b4c0b780 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:48:07.189 INFO:tasks.workunit.client.0.smithi044.stderr: -441> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-a con 0x5596b4ca0970 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:48:07.189 INFO:tasks.workunit.client.0.smithi044.stderr: -440> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.189 INFO:tasks.workunit.client.0.smithi044.stderr: -439> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.189 INFO:tasks.workunit.client.0.smithi044.stderr: -438> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.189 INFO:tasks.workunit.client.0.smithi044.stderr: -437> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:07.189 INFO:tasks.workunit.client.0.smithi044.stderr: -436> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient(hunting): authenticate will time out at 2259.464123s 2024-09-12T17:48:07.189 INFO:tasks.workunit.client.0.smithi044.stderr: -435> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient(hunting): get_auth_request con 0x5596b4c0b780 auth_method 0 2024-09-12T17:48:07.190 INFO:tasks.workunit.client.0.smithi044.stderr: -434> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.190 INFO:tasks.workunit.client.0.smithi044.stderr: -433> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.190 INFO:tasks.workunit.client.0.smithi044.stderr: -432> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.190 INFO:tasks.workunit.client.0.smithi044.stderr: -431> 2024-09-12T17:48:06.827+0000 7f006e41b640 10 monclient(hunting): get_auth_request con 0x5596b4ca0970 auth_method 0 2024-09-12T17:48:07.190 INFO:tasks.workunit.client.0.smithi044.stderr: -430> 2024-09-12T17:48:06.827+0000 7f006e41b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.190 INFO:tasks.workunit.client.0.smithi044.stderr: -429> 2024-09-12T17:48:06.827+0000 7f006e41b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.190 INFO:tasks.workunit.client.0.smithi044.stderr: -428> 2024-09-12T17:48:06.827+0000 7f006e41b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.190 INFO:tasks.workunit.client.0.smithi044.stderr: -427> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.190 INFO:tasks.workunit.client.0.smithi044.stderr: -426> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.190 INFO:tasks.workunit.client.0.smithi044.stderr: -425> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.190 INFO:tasks.workunit.client.0.smithi044.stderr: -424> 2024-09-12T17:48:06.827+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.190 INFO:tasks.workunit.client.0.smithi044.stderr: -423> 2024-09-12T17:48:06.827+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.190 INFO:tasks.workunit.client.0.smithi044.stderr: -422> 2024-09-12T17:48:06.827+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.191 INFO:tasks.workunit.client.0.smithi044.stderr: -421> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient(hunting): handle_auth_done global_id 7889 payload 824 2024-09-12T17:48:07.191 INFO:tasks.workunit.client.0.smithi044.stderr: -420> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient: _finish_hunting 0 2024-09-12T17:48:07.191 INFO:tasks.workunit.client.0.smithi044.stderr: -419> 2024-09-12T17:48:06.827+0000 7f006d419640 1 monclient: found mon.noname-c 2024-09-12T17:48:07.191 INFO:tasks.workunit.client.0.smithi044.stderr: -418> 2024-09-12T17:48:06.827+0000 7f006d419640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:48:07.191 INFO:tasks.workunit.client.0.smithi044.stderr: -417> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.191 INFO:tasks.workunit.client.0.smithi044.stderr: -416> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:48:07.191 INFO:tasks.workunit.client.0.smithi044.stderr: -415> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: dump: 2024-09-12T17:48:07.191 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.191 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.191 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.191 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.191 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.191 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.191 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.192 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.192 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.192 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.192 INFO:tasks.workunit.client.0.smithi044.stderr: -414> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: _finish_auth 0 2024-09-12T17:48:07.192 INFO:tasks.workunit.client.0.smithi044.stderr: -413> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: _check_auth_tickets 2024-09-12T17:48:07.192 INFO:tasks.workunit.client.0.smithi044.stderr: -412> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:07.192 INFO:tasks.workunit.client.0.smithi044.stderr: -411> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.192 INFO:tasks.workunit.client.0.smithi044.stderr: -410> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:48:07.192 INFO:tasks.workunit.client.0.smithi044.stderr: -409> 2024-09-12T17:48:06.827+0000 7eff5a604640 10 monclient: dump: 2024-09-12T17:48:07.192 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.192 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.192 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.193 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.193 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.193 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.193 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.193 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.193 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.193 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.193 INFO:tasks.workunit.client.0.smithi044.stderr: -408> 2024-09-12T17:48:06.827+0000 7f0071f31800 5 monclient: authenticate success, global_id 7889 2024-09-12T17:48:07.193 INFO:tasks.workunit.client.0.smithi044.stderr: -407> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient: _renew_subs 2024-09-12T17:48:07.193 INFO:tasks.workunit.client.0.smithi044.stderr: -406> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:48:07.193 INFO:tasks.workunit.client.0.smithi044.stderr: -405> 2024-09-12T17:48:06.827+0000 7eff5be07640 4 set_mon_vals no callback set 2024-09-12T17:48:07.193 INFO:tasks.workunit.client.0.smithi044.stderr: -404> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient: _renew_subs 2024-09-12T17:48:07.194 INFO:tasks.workunit.client.0.smithi044.stderr: -403> 2024-09-12T17:48:06.827+0000 7f0071f31800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.44:3301/0 2024-09-12T17:48:07.194 INFO:tasks.workunit.client.0.smithi044.stderr: -402> 2024-09-12T17:48:06.827+0000 7f0071f31800 1 librados: init done 2024-09-12T17:48:07.194 INFO:tasks.workunit.client.0.smithi044.stderr: -401> 2024-09-12T17:48:06.829+0000 7eff5a604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:07.194 INFO:tasks.workunit.client.0.smithi044.stderr: -400> 2024-09-12T17:48:06.829+0000 7eff5a604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:48:07.194 INFO:tasks.workunit.client.0.smithi044.stderr: -399> 2024-09-12T17:48:06.829+0000 7eff5a604640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:48:07.194 INFO:tasks.workunit.client.0.smithi044.stderr: -398> 2024-09-12T17:48:06.830+0000 7f006dc1a640 10 monclient: get_auth_request con 0x7eff54076470 auth_method 0 2024-09-12T17:48:07.194 INFO:tasks.workunit.client.0.smithi044.stderr: -397> 2024-09-12T17:48:06.830+0000 7f006e41b640 10 monclient: get_auth_request con 0x5596b4da7130 auth_method 0 2024-09-12T17:48:07.194 INFO:tasks.workunit.client.0.smithi044.stderr: -396> 2024-09-12T17:48:06.831+0000 7f006dc1a640 10 monclient: get_auth_request con 0x5596b4daa310 auth_method 0 2024-09-12T17:48:07.194 INFO:tasks.workunit.client.0.smithi044.stderr: -395> 2024-09-12T17:48:06.832+0000 7f006d419640 10 monclient: get_auth_request con 0x5596b4dadb70 auth_method 0 2024-09-12T17:48:07.194 INFO:tasks.workunit.client.0.smithi044.stderr: -394> 2024-09-12T17:48:06.833+0000 7f0071f31800 10 monclient: build_initial_monmap 2024-09-12T17:48:07.194 INFO:tasks.workunit.client.0.smithi044.stderr: -393> 2024-09-12T17:48:06.833+0000 7f0071f31800 1 build_initial for_mkfs: 0 2024-09-12T17:48:07.194 INFO:tasks.workunit.client.0.smithi044.stderr: -392> 2024-09-12T17:48:06.833+0000 7f0071f31800 10 monclient: monmap: 2024-09-12T17:48:07.194 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:48:07.195 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:07.195 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:48:07.195 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:48:07.195 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:07.195 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.195 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:48:07.195 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:48:07.195 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:48:07.195 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.195 INFO:tasks.workunit.client.0.smithi044.stderr: -391> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding auth protocol: cephx 2024-09-12T17:48:07.195 INFO:tasks.workunit.client.0.smithi044.stderr: -390> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding auth protocol: cephx 2024-09-12T17:48:07.195 INFO:tasks.workunit.client.0.smithi044.stderr: -389> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding auth protocol: cephx 2024-09-12T17:48:07.195 INFO:tasks.workunit.client.0.smithi044.stderr: -388> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: secure 2024-09-12T17:48:07.196 INFO:tasks.workunit.client.0.smithi044.stderr: -387> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: crc 2024-09-12T17:48:07.196 INFO:tasks.workunit.client.0.smithi044.stderr: -386> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: secure 2024-09-12T17:48:07.196 INFO:tasks.workunit.client.0.smithi044.stderr: -385> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: crc 2024-09-12T17:48:07.196 INFO:tasks.workunit.client.0.smithi044.stderr: -384> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: secure 2024-09-12T17:48:07.196 INFO:tasks.workunit.client.0.smithi044.stderr: -383> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: crc 2024-09-12T17:48:07.196 INFO:tasks.workunit.client.0.smithi044.stderr: -382> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: crc 2024-09-12T17:48:07.196 INFO:tasks.workunit.client.0.smithi044.stderr: -381> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: secure 2024-09-12T17:48:07.196 INFO:tasks.workunit.client.0.smithi044.stderr: -380> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: crc 2024-09-12T17:48:07.196 INFO:tasks.workunit.client.0.smithi044.stderr: -379> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: secure 2024-09-12T17:48:07.196 INFO:tasks.workunit.client.0.smithi044.stderr: -378> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: crc 2024-09-12T17:48:07.196 INFO:tasks.workunit.client.0.smithi044.stderr: -377> 2024-09-12T17:48:06.833+0000 7f0071f31800 5 AuthRegistry(0x5596b4db35f0) adding con mode: secure 2024-09-12T17:48:07.196 INFO:tasks.workunit.client.0.smithi044.stderr: -376> 2024-09-12T17:48:06.834+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.196 INFO:tasks.workunit.client.0.smithi044.stderr: -375> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command objecter_requests cmddesc objecter_requests hook 0x5596b4db6a10 EEXIST 2024-09-12T17:48:07.196 INFO:tasks.workunit.client.0.smithi044.stderr: -374> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient: init 2024-09-12T17:48:07.197 INFO:tasks.workunit.client.0.smithi044.stderr: -373> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding auth protocol: cephx 2024-09-12T17:48:07.197 INFO:tasks.workunit.client.0.smithi044.stderr: -372> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding auth protocol: cephx 2024-09-12T17:48:07.197 INFO:tasks.workunit.client.0.smithi044.stderr: -371> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding auth protocol: cephx 2024-09-12T17:48:07.197 INFO:tasks.workunit.client.0.smithi044.stderr: -370> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: secure 2024-09-12T17:48:07.197 INFO:tasks.workunit.client.0.smithi044.stderr: -369> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: crc 2024-09-12T17:48:07.197 INFO:tasks.workunit.client.0.smithi044.stderr: -368> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: secure 2024-09-12T17:48:07.197 INFO:tasks.workunit.client.0.smithi044.stderr: -367> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: crc 2024-09-12T17:48:07.197 INFO:tasks.workunit.client.0.smithi044.stderr: -366> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: secure 2024-09-12T17:48:07.197 INFO:tasks.workunit.client.0.smithi044.stderr: -365> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: crc 2024-09-12T17:48:07.197 INFO:tasks.workunit.client.0.smithi044.stderr: -364> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: crc 2024-09-12T17:48:07.197 INFO:tasks.workunit.client.0.smithi044.stderr: -363> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: secure 2024-09-12T17:48:07.197 INFO:tasks.workunit.client.0.smithi044.stderr: -362> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: crc 2024-09-12T17:48:07.198 INFO:tasks.workunit.client.0.smithi044.stderr: -361> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: secure 2024-09-12T17:48:07.198 INFO:tasks.workunit.client.0.smithi044.stderr: -360> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: crc 2024-09-12T17:48:07.198 INFO:tasks.workunit.client.0.smithi044.stderr: -359> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 AuthRegistry(0x5596b4db25a8) adding con mode: secure 2024-09-12T17:48:07.198 INFO:tasks.workunit.client.0.smithi044.stderr: -358> 2024-09-12T17:48:06.834+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.198 INFO:tasks.workunit.client.0.smithi044.stderr: -357> 2024-09-12T17:48:06.834+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.198 INFO:tasks.workunit.client.0.smithi044.stderr: -356> 2024-09-12T17:48:06.834+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command rotate-key cmddesc rotate-key hook 0x5596b4db26f0 EEXIST 2024-09-12T17:48:07.198 INFO:tasks.workunit.client.0.smithi044.stderr: -355> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:07.198 INFO:tasks.workunit.client.0.smithi044.stderr: -354> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:48:07.198 INFO:tasks.workunit.client.0.smithi044.stderr: -353> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-a con 0x5596b4ddad30 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:48:07.198 INFO:tasks.workunit.client.0.smithi044.stderr: -352> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-c con 0x5596b4ddb110 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:48:07.198 INFO:tasks.workunit.client.0.smithi044.stderr: -351> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-b con 0x5596b4dd9a40 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:48:07.198 INFO:tasks.workunit.client.0.smithi044.stderr: -350> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.198 INFO:tasks.workunit.client.0.smithi044.stderr: -349> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.198 INFO:tasks.workunit.client.0.smithi044.stderr: -348> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.199 INFO:tasks.workunit.client.0.smithi044.stderr: -347> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:07.199 INFO:tasks.workunit.client.0.smithi044.stderr: -346> 2024-09-12T17:48:06.834+0000 7f0071f31800 10 monclient(hunting): authenticate will time out at 2259.471830s 2024-09-12T17:48:07.199 INFO:tasks.workunit.client.0.smithi044.stderr: -345> 2024-09-12T17:48:06.834+0000 7f006dc1a640 10 monclient(hunting): get_auth_request con 0x5596b4ddad30 auth_method 0 2024-09-12T17:48:07.199 INFO:tasks.workunit.client.0.smithi044.stderr: -344> 2024-09-12T17:48:06.834+0000 7f006dc1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.199 INFO:tasks.workunit.client.0.smithi044.stderr: -343> 2024-09-12T17:48:06.834+0000 7f006dc1a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.199 INFO:tasks.workunit.client.0.smithi044.stderr: -342> 2024-09-12T17:48:06.834+0000 7f006dc1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.199 INFO:tasks.workunit.client.0.smithi044.stderr: -341> 2024-09-12T17:48:06.834+0000 7f006d419640 10 monclient(hunting): get_auth_request con 0x5596b4ddb110 auth_method 0 2024-09-12T17:48:07.199 INFO:tasks.workunit.client.0.smithi044.stderr: -340> 2024-09-12T17:48:06.834+0000 7f006d419640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.199 INFO:tasks.workunit.client.0.smithi044.stderr: -339> 2024-09-12T17:48:06.834+0000 7f006d419640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.199 INFO:tasks.workunit.client.0.smithi044.stderr: -338> 2024-09-12T17:48:06.834+0000 7f006d419640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.199 INFO:tasks.workunit.client.0.smithi044.stderr: -337> 2024-09-12T17:48:06.835+0000 7f006e41b640 10 monclient(hunting): get_auth_request con 0x5596b4dd9a40 auth_method 0 2024-09-12T17:48:07.199 INFO:tasks.workunit.client.0.smithi044.stderr: -336> 2024-09-12T17:48:06.835+0000 7f006e41b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.199 INFO:tasks.workunit.client.0.smithi044.stderr: -335> 2024-09-12T17:48:06.835+0000 7f006e41b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.200 INFO:tasks.workunit.client.0.smithi044.stderr: -334> 2024-09-12T17:48:06.835+0000 7f006e41b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.200 INFO:tasks.workunit.client.0.smithi044.stderr: -333> 2024-09-12T17:48:06.835+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.200 INFO:tasks.workunit.client.0.smithi044.stderr: -332> 2024-09-12T17:48:06.835+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.200 INFO:tasks.workunit.client.0.smithi044.stderr: -331> 2024-09-12T17:48:06.835+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.200 INFO:tasks.workunit.client.0.smithi044.stderr: -330> 2024-09-12T17:48:06.835+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.200 INFO:tasks.workunit.client.0.smithi044.stderr: -329> 2024-09-12T17:48:06.835+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.200 INFO:tasks.workunit.client.0.smithi044.stderr: -328> 2024-09-12T17:48:06.835+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.200 INFO:tasks.workunit.client.0.smithi044.stderr: -327> 2024-09-12T17:48:06.835+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.200 INFO:tasks.workunit.client.0.smithi044.stderr: -326> 2024-09-12T17:48:06.835+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.200 INFO:tasks.workunit.client.0.smithi044.stderr: -325> 2024-09-12T17:48:06.835+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.200 INFO:tasks.workunit.client.0.smithi044.stderr: -324> 2024-09-12T17:48:06.835+0000 7f006dc1a640 10 monclient(hunting): handle_auth_done global_id 8436 payload 824 2024-09-12T17:48:07.200 INFO:tasks.workunit.client.0.smithi044.stderr: -323> 2024-09-12T17:48:06.835+0000 7f006dc1a640 10 monclient: _finish_hunting 0 2024-09-12T17:48:07.200 INFO:tasks.workunit.client.0.smithi044.stderr: -322> 2024-09-12T17:48:06.835+0000 7f006dc1a640 1 monclient: found mon.noname-a 2024-09-12T17:48:07.201 INFO:tasks.workunit.client.0.smithi044.stderr: -321> 2024-09-12T17:48:06.835+0000 7f006dc1a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:48:07.201 INFO:tasks.workunit.client.0.smithi044.stderr: -320> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.201 INFO:tasks.workunit.client.0.smithi044.stderr: -319> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:07.201 INFO:tasks.workunit.client.0.smithi044.stderr: -318> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: dump: 2024-09-12T17:48:07.201 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.201 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.201 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.201 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.201 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.201 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.201 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.201 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.201 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.202 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.202 INFO:tasks.workunit.client.0.smithi044.stderr: -317> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: _finish_auth 0 2024-09-12T17:48:07.202 INFO:tasks.workunit.client.0.smithi044.stderr: -316> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: _check_auth_tickets 2024-09-12T17:48:07.202 INFO:tasks.workunit.client.0.smithi044.stderr: -315> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:07.202 INFO:tasks.workunit.client.0.smithi044.stderr: -314> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.202 INFO:tasks.workunit.client.0.smithi044.stderr: -313> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:07.202 INFO:tasks.workunit.client.0.smithi044.stderr: -312> 2024-09-12T17:48:06.835+0000 7eff537fe640 10 monclient: dump: 2024-09-12T17:48:07.202 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.202 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.202 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.202 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.202 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.202 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.202 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.203 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.203 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.203 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.203 INFO:tasks.workunit.client.0.smithi044.stderr: -311> 2024-09-12T17:48:06.835+0000 7f0071f31800 5 monclient: authenticate success, global_id 8436 2024-09-12T17:48:07.203 INFO:tasks.workunit.client.0.smithi044.stderr: -310> 2024-09-12T17:48:06.835+0000 7f0071f31800 10 monclient: _renew_subs 2024-09-12T17:48:07.203 INFO:tasks.workunit.client.0.smithi044.stderr: -309> 2024-09-12T17:48:06.835+0000 7f0071f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:48:07.203 INFO:tasks.workunit.client.0.smithi044.stderr: -308> 2024-09-12T17:48:06.835+0000 7f006ec1c640 4 set_mon_vals no callback set 2024-09-12T17:48:07.203 INFO:tasks.workunit.client.0.smithi044.stderr: -307> 2024-09-12T17:48:06.835+0000 7f0071f31800 10 monclient: _renew_subs 2024-09-12T17:48:07.203 INFO:tasks.workunit.client.0.smithi044.stderr: -306> 2024-09-12T17:48:06.835+0000 7f0071f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:48:07.203 INFO:tasks.workunit.client.0.smithi044.stderr: -305> 2024-09-12T17:48:06.837+0000 7eff537fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:07.203 INFO:tasks.workunit.client.0.smithi044.stderr: -304> 2024-09-12T17:48:06.837+0000 7eff537fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:48:07.203 INFO:tasks.workunit.client.0.smithi044.stderr: -303> 2024-09-12T17:48:06.837+0000 7eff537fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:48:07.203 INFO:tasks.workunit.client.0.smithi044.stderr: -302> 2024-09-12T17:48:06.837+0000 7f006d419640 10 monclient: get_auth_request con 0x7eff48076380 auth_method 0 2024-09-12T17:48:07.204 INFO:tasks.workunit.client.0.smithi044.stderr: -301> 2024-09-12T17:48:06.837+0000 7f0071f31800 10 monclient: get_monmap_and_config 2024-09-12T17:48:07.204 INFO:tasks.workunit.client.0.smithi044.stderr: -300> 2024-09-12T17:48:06.837+0000 7f0071f31800 10 monclient: build_initial_monmap 2024-09-12T17:48:07.204 INFO:tasks.workunit.client.0.smithi044.stderr: -299> 2024-09-12T17:48:06.837+0000 7f0071f31800 1 build_initial for_mkfs: 0 2024-09-12T17:48:07.204 INFO:tasks.workunit.client.0.smithi044.stderr: -298> 2024-09-12T17:48:06.837+0000 7f0071f31800 10 monclient: monmap: 2024-09-12T17:48:07.204 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:48:07.204 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:07.204 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:48:07.204 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:48:07.204 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:07.204 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.204 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:48:07.204 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:48:07.204 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:48:07.205 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.205 INFO:tasks.workunit.client.0.smithi044.stderr: -297> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding auth protocol: cephx 2024-09-12T17:48:07.205 INFO:tasks.workunit.client.0.smithi044.stderr: -296> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding auth protocol: cephx 2024-09-12T17:48:07.205 INFO:tasks.workunit.client.0.smithi044.stderr: -295> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding auth protocol: cephx 2024-09-12T17:48:07.205 INFO:tasks.workunit.client.0.smithi044.stderr: -294> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: secure 2024-09-12T17:48:07.205 INFO:tasks.workunit.client.0.smithi044.stderr: -293> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: crc 2024-09-12T17:48:07.205 INFO:tasks.workunit.client.0.smithi044.stderr: -292> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: secure 2024-09-12T17:48:07.205 INFO:tasks.workunit.client.0.smithi044.stderr: -291> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: crc 2024-09-12T17:48:07.205 INFO:tasks.workunit.client.0.smithi044.stderr: -290> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: secure 2024-09-12T17:48:07.205 INFO:tasks.workunit.client.0.smithi044.stderr: -289> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: crc 2024-09-12T17:48:07.205 INFO:tasks.workunit.client.0.smithi044.stderr: -288> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: crc 2024-09-12T17:48:07.205 INFO:tasks.workunit.client.0.smithi044.stderr: -287> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: secure 2024-09-12T17:48:07.205 INFO:tasks.workunit.client.0.smithi044.stderr: -286> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: crc 2024-09-12T17:48:07.206 INFO:tasks.workunit.client.0.smithi044.stderr: -285> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: secure 2024-09-12T17:48:07.206 INFO:tasks.workunit.client.0.smithi044.stderr: -284> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: crc 2024-09-12T17:48:07.206 INFO:tasks.workunit.client.0.smithi044.stderr: -283> 2024-09-12T17:48:06.837+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac60) adding con mode: secure 2024-09-12T17:48:07.206 INFO:tasks.workunit.client.0.smithi044.stderr: -282> 2024-09-12T17:48:06.838+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.206 INFO:tasks.workunit.client.0.smithi044.stderr: -281> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient: init 2024-09-12T17:48:07.206 INFO:tasks.workunit.client.0.smithi044.stderr: -280> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding auth protocol: cephx 2024-09-12T17:48:07.206 INFO:tasks.workunit.client.0.smithi044.stderr: -279> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding auth protocol: cephx 2024-09-12T17:48:07.206 INFO:tasks.workunit.client.0.smithi044.stderr: -278> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding auth protocol: cephx 2024-09-12T17:48:07.206 INFO:tasks.workunit.client.0.smithi044.stderr: -277> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: secure 2024-09-12T17:48:07.206 INFO:tasks.workunit.client.0.smithi044.stderr: -276> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: crc 2024-09-12T17:48:07.206 INFO:tasks.workunit.client.0.smithi044.stderr: -275> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: secure 2024-09-12T17:48:07.206 INFO:tasks.workunit.client.0.smithi044.stderr: -274> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: crc 2024-09-12T17:48:07.206 INFO:tasks.workunit.client.0.smithi044.stderr: -273> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: secure 2024-09-12T17:48:07.207 INFO:tasks.workunit.client.0.smithi044.stderr: -272> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: crc 2024-09-12T17:48:07.207 INFO:tasks.workunit.client.0.smithi044.stderr: -271> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: crc 2024-09-12T17:48:07.207 INFO:tasks.workunit.client.0.smithi044.stderr: -270> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: secure 2024-09-12T17:48:07.207 INFO:tasks.workunit.client.0.smithi044.stderr: -269> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: crc 2024-09-12T17:48:07.207 INFO:tasks.workunit.client.0.smithi044.stderr: -268> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: secure 2024-09-12T17:48:07.207 INFO:tasks.workunit.client.0.smithi044.stderr: -267> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: crc 2024-09-12T17:48:07.207 INFO:tasks.workunit.client.0.smithi044.stderr: -266> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed10f0) adding con mode: secure 2024-09-12T17:48:07.207 INFO:tasks.workunit.client.0.smithi044.stderr: -265> 2024-09-12T17:48:06.838+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.207 INFO:tasks.workunit.client.0.smithi044.stderr: -264> 2024-09-12T17:48:06.838+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.207 INFO:tasks.workunit.client.0.smithi044.stderr: -263> 2024-09-12T17:48:06.838+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command rotate-key cmddesc rotate-key hook 0x7fff28ed1238 EEXIST 2024-09-12T17:48:07.207 INFO:tasks.workunit.client.0.smithi044.stderr: -262> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:07.207 INFO:tasks.workunit.client.0.smithi044.stderr: -261> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:48:07.207 INFO:tasks.workunit.client.0.smithi044.stderr: -260> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-c con 0x5596b4e2efd0 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:48:07.208 INFO:tasks.workunit.client.0.smithi044.stderr: -259> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-a con 0x5596b4e2f3b0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:48:07.208 INFO:tasks.workunit.client.0.smithi044.stderr: -258> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-b con 0x5596b4e29240 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:48:07.208 INFO:tasks.workunit.client.0.smithi044.stderr: -257> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.208 INFO:tasks.workunit.client.0.smithi044.stderr: -256> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.208 INFO:tasks.workunit.client.0.smithi044.stderr: -255> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.208 INFO:tasks.workunit.client.0.smithi044.stderr: -254> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:07.208 INFO:tasks.workunit.client.0.smithi044.stderr: -253> 2024-09-12T17:48:06.838+0000 7f0071f31800 10 monclient(hunting): authenticate will time out at 2259.475876s 2024-09-12T17:48:07.208 INFO:tasks.workunit.client.0.smithi044.stderr: -252> 2024-09-12T17:48:06.838+0000 7f006dc1a640 10 monclient(hunting): get_auth_request con 0x5596b4e2efd0 auth_method 0 2024-09-12T17:48:07.208 INFO:tasks.workunit.client.0.smithi044.stderr: -251> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.208 INFO:tasks.workunit.client.0.smithi044.stderr: -250> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.208 INFO:tasks.workunit.client.0.smithi044.stderr: -249> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.208 INFO:tasks.workunit.client.0.smithi044.stderr: -248> 2024-09-12T17:48:06.839+0000 7f006d419640 10 monclient(hunting): get_auth_request con 0x5596b4e2f3b0 auth_method 0 2024-09-12T17:48:07.208 INFO:tasks.workunit.client.0.smithi044.stderr: -247> 2024-09-12T17:48:06.839+0000 7f006d419640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.209 INFO:tasks.workunit.client.0.smithi044.stderr: -246> 2024-09-12T17:48:06.839+0000 7f006d419640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.209 INFO:tasks.workunit.client.0.smithi044.stderr: -245> 2024-09-12T17:48:06.839+0000 7f006d419640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.209 INFO:tasks.workunit.client.0.smithi044.stderr: -244> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.209 INFO:tasks.workunit.client.0.smithi044.stderr: -243> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.209 INFO:tasks.workunit.client.0.smithi044.stderr: -242> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.209 INFO:tasks.workunit.client.0.smithi044.stderr: -241> 2024-09-12T17:48:06.839+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.209 INFO:tasks.workunit.client.0.smithi044.stderr: -240> 2024-09-12T17:48:06.839+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.209 INFO:tasks.workunit.client.0.smithi044.stderr: -239> 2024-09-12T17:48:06.839+0000 7f006d419640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.209 INFO:tasks.workunit.client.0.smithi044.stderr: -238> 2024-09-12T17:48:06.839+0000 7f006e41b640 10 monclient(hunting): get_auth_request con 0x5596b4e29240 auth_method 0 2024-09-12T17:48:07.209 INFO:tasks.workunit.client.0.smithi044.stderr: -237> 2024-09-12T17:48:06.839+0000 7f006e41b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.209 INFO:tasks.workunit.client.0.smithi044.stderr: -236> 2024-09-12T17:48:06.839+0000 7f006e41b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.209 INFO:tasks.workunit.client.0.smithi044.stderr: -235> 2024-09-12T17:48:06.839+0000 7f006e41b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.210 INFO:tasks.workunit.client.0.smithi044.stderr: -234> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient(hunting): handle_auth_done global_id 7895 payload 274 2024-09-12T17:48:07.210 INFO:tasks.workunit.client.0.smithi044.stderr: -233> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient: _finish_hunting 0 2024-09-12T17:48:07.210 INFO:tasks.workunit.client.0.smithi044.stderr: -232> 2024-09-12T17:48:06.839+0000 7f006dc1a640 1 monclient: found mon.noname-c 2024-09-12T17:48:07.210 INFO:tasks.workunit.client.0.smithi044.stderr: -231> 2024-09-12T17:48:06.839+0000 7f006dc1a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.44:3301/0 2024-09-12T17:48:07.210 INFO:tasks.workunit.client.0.smithi044.stderr: -230> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.210 INFO:tasks.workunit.client.0.smithi044.stderr: -229> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:48:07.210 INFO:tasks.workunit.client.0.smithi044.stderr: -228> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: dump: 2024-09-12T17:48:07.210 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.210 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.210 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.210 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.210 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.210 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.211 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.211 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.211 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.211 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.211 INFO:tasks.workunit.client.0.smithi044.stderr: -227> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: _finish_auth 0 2024-09-12T17:48:07.211 INFO:tasks.workunit.client.0.smithi044.stderr: -226> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: _check_auth_tickets 2024-09-12T17:48:07.211 INFO:tasks.workunit.client.0.smithi044.stderr: -225> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:07.211 INFO:tasks.workunit.client.0.smithi044.stderr: -224> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.211 INFO:tasks.workunit.client.0.smithi044.stderr: -223> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:48:07.211 INFO:tasks.workunit.client.0.smithi044.stderr: -222> 2024-09-12T17:48:06.839+0000 7eff517fa640 10 monclient: dump: 2024-09-12T17:48:07.211 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.211 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.211 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.212 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.212 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.212 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.212 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.212 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.212 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.212 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.212 INFO:tasks.workunit.client.0.smithi044.stderr: -221> 2024-09-12T17:48:06.839+0000 7f0071f31800 5 monclient: authenticate success, global_id 7895 2024-09-12T17:48:07.212 INFO:tasks.workunit.client.0.smithi044.stderr: -220> 2024-09-12T17:48:06.839+0000 7f0071f31800 10 monclient: get_monmap_and_config success 2024-09-12T17:48:07.212 INFO:tasks.workunit.client.0.smithi044.stderr: -219> 2024-09-12T17:48:06.839+0000 7f0071f31800 4 set_mon_vals no callback set 2024-09-12T17:48:07.212 INFO:tasks.workunit.client.0.smithi044.stderr: -218> 2024-09-12T17:48:06.839+0000 7f0071f31800 10 monclient: shutdown 2024-09-12T17:48:07.212 INFO:tasks.workunit.client.0.smithi044.stderr: -217> 2024-09-12T17:48:06.840+0000 7f0071f31800 10 monclient: build_initial_monmap 2024-09-12T17:48:07.212 INFO:tasks.workunit.client.0.smithi044.stderr: -216> 2024-09-12T17:48:06.840+0000 7f0071f31800 1 build_initial for_mkfs: 0 2024-09-12T17:48:07.213 INFO:tasks.workunit.client.0.smithi044.stderr: -215> 2024-09-12T17:48:06.840+0000 7f0071f31800 10 monclient: monmap: 2024-09-12T17:48:07.213 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 0 2024-09-12T17:48:07.213 INFO:tasks.workunit.client.0.smithi044.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:07.213 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 0.000000 2024-09-12T17:48:07.213 INFO:tasks.workunit.client.0.smithi044.stderr:created 0.000000 2024-09-12T17:48:07.213 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:07.213 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.213 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.noname-a 2024-09-12T17:48:07.213 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-09-12T17:48:07.213 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.noname-c 2024-09-12T17:48:07.213 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.213 INFO:tasks.workunit.client.0.smithi044.stderr: -214> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding auth protocol: cephx 2024-09-12T17:48:07.214 INFO:tasks.workunit.client.0.smithi044.stderr: -213> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding auth protocol: cephx 2024-09-12T17:48:07.214 INFO:tasks.workunit.client.0.smithi044.stderr: -212> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding auth protocol: cephx 2024-09-12T17:48:07.214 INFO:tasks.workunit.client.0.smithi044.stderr: -211> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: secure 2024-09-12T17:48:07.214 INFO:tasks.workunit.client.0.smithi044.stderr: -210> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: crc 2024-09-12T17:48:07.214 INFO:tasks.workunit.client.0.smithi044.stderr: -209> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: secure 2024-09-12T17:48:07.214 INFO:tasks.workunit.client.0.smithi044.stderr: -208> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: crc 2024-09-12T17:48:07.214 INFO:tasks.workunit.client.0.smithi044.stderr: -207> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: secure 2024-09-12T17:48:07.214 INFO:tasks.workunit.client.0.smithi044.stderr: -206> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: crc 2024-09-12T17:48:07.214 INFO:tasks.workunit.client.0.smithi044.stderr: -205> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: crc 2024-09-12T17:48:07.214 INFO:tasks.workunit.client.0.smithi044.stderr: -204> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: secure 2024-09-12T17:48:07.214 INFO:tasks.workunit.client.0.smithi044.stderr: -203> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: crc 2024-09-12T17:48:07.214 INFO:tasks.workunit.client.0.smithi044.stderr: -202> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: secure 2024-09-12T17:48:07.214 INFO:tasks.workunit.client.0.smithi044.stderr: -201> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: crc 2024-09-12T17:48:07.215 INFO:tasks.workunit.client.0.smithi044.stderr: -200> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4dfac10) adding con mode: secure 2024-09-12T17:48:07.215 INFO:tasks.workunit.client.0.smithi044.stderr: -199> 2024-09-12T17:48:06.840+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.215 INFO:tasks.workunit.client.0.smithi044.stderr: -198> 2024-09-12T17:48:06.840+0000 7f0071f31800 1 librados: starting msgr at 2024-09-12T17:48:07.215 INFO:tasks.workunit.client.0.smithi044.stderr: -197> 2024-09-12T17:48:06.840+0000 7f0071f31800 1 librados: starting objecter 2024-09-12T17:48:07.215 INFO:tasks.workunit.client.0.smithi044.stderr: -196> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command objecter_requests cmddesc objecter_requests hook 0x5596b4d8b990 EEXIST 2024-09-12T17:48:07.215 INFO:tasks.workunit.client.0.smithi044.stderr: -195> 2024-09-12T17:48:06.840+0000 7f0071f31800 1 librados: setting wanted keys 2024-09-12T17:48:07.215 INFO:tasks.workunit.client.0.smithi044.stderr: -194> 2024-09-12T17:48:06.840+0000 7f0071f31800 1 librados: calling monclient init 2024-09-12T17:48:07.215 INFO:tasks.workunit.client.0.smithi044.stderr: -193> 2024-09-12T17:48:06.840+0000 7f0071f31800 10 monclient: init 2024-09-12T17:48:07.215 INFO:tasks.workunit.client.0.smithi044.stderr: -192> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding auth protocol: cephx 2024-09-12T17:48:07.215 INFO:tasks.workunit.client.0.smithi044.stderr: -191> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding auth protocol: cephx 2024-09-12T17:48:07.215 INFO:tasks.workunit.client.0.smithi044.stderr: -190> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding auth protocol: cephx 2024-09-12T17:48:07.215 INFO:tasks.workunit.client.0.smithi044.stderr: -189> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: secure 2024-09-12T17:48:07.215 INFO:tasks.workunit.client.0.smithi044.stderr: -188> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: crc 2024-09-12T17:48:07.215 INFO:tasks.workunit.client.0.smithi044.stderr: -187> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: secure 2024-09-12T17:48:07.216 INFO:tasks.workunit.client.0.smithi044.stderr: -186> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: crc 2024-09-12T17:48:07.216 INFO:tasks.workunit.client.0.smithi044.stderr: -185> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: secure 2024-09-12T17:48:07.216 INFO:tasks.workunit.client.0.smithi044.stderr: -184> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: crc 2024-09-12T17:48:07.216 INFO:tasks.workunit.client.0.smithi044.stderr: -183> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: crc 2024-09-12T17:48:07.216 INFO:tasks.workunit.client.0.smithi044.stderr: -182> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: secure 2024-09-12T17:48:07.216 INFO:tasks.workunit.client.0.smithi044.stderr: -181> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: crc 2024-09-12T17:48:07.216 INFO:tasks.workunit.client.0.smithi044.stderr: -180> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: secure 2024-09-12T17:48:07.216 INFO:tasks.workunit.client.0.smithi044.stderr: -179> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: crc 2024-09-12T17:48:07.216 INFO:tasks.workunit.client.0.smithi044.stderr: -178> 2024-09-12T17:48:06.840+0000 7f0071f31800 5 AuthRegistry(0x5596b4def5f0) adding con mode: secure 2024-09-12T17:48:07.216 INFO:tasks.workunit.client.0.smithi044.stderr: -177> 2024-09-12T17:48:06.840+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.216 INFO:tasks.workunit.client.0.smithi044.stderr: -176> 2024-09-12T17:48:06.841+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.216 INFO:tasks.workunit.client.0.smithi044.stderr: -175> 2024-09-12T17:48:06.841+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command rotate-key cmddesc rotate-key hook 0x5596b4def738 EEXIST 2024-09-12T17:48:07.216 INFO:tasks.workunit.client.0.smithi044.stderr: -174> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:07.217 INFO:tasks.workunit.client.0.smithi044.stderr: -173> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:48:07.217 INFO:tasks.workunit.client.0.smithi044.stderr: -172> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-a con 0x5596b4e2efd0 addr [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T17:48:07.217 INFO:tasks.workunit.client.0.smithi044.stderr: -171> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-b con 0x5596b4e2dbe0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-12T17:48:07.217 INFO:tasks.workunit.client.0.smithi044.stderr: -170> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient(hunting): picked mon.noname-c con 0x5596b4e3cf60 addr [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] 2024-09-12T17:48:07.217 INFO:tasks.workunit.client.0.smithi044.stderr: -169> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.217 INFO:tasks.workunit.client.0.smithi044.stderr: -168> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.217 INFO:tasks.workunit.client.0.smithi044.stderr: -167> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:07.217 INFO:tasks.workunit.client.0.smithi044.stderr: -166> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:07.217 INFO:tasks.workunit.client.0.smithi044.stderr: -165> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient(hunting): authenticate will time out at 2259.478144s 2024-09-12T17:48:07.217 INFO:tasks.workunit.client.0.smithi044.stderr: -164> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient(hunting): get_auth_request con 0x5596b4e2efd0 auth_method 0 2024-09-12T17:48:07.217 INFO:tasks.workunit.client.0.smithi044.stderr: -163> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.217 INFO:tasks.workunit.client.0.smithi044.stderr: -162> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.217 INFO:tasks.workunit.client.0.smithi044.stderr: -161> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.218 INFO:tasks.workunit.client.0.smithi044.stderr: -160> 2024-09-12T17:48:06.841+0000 7f006e41b640 10 monclient(hunting): get_auth_request con 0x5596b4e3cf60 auth_method 0 2024-09-12T17:48:07.218 INFO:tasks.workunit.client.0.smithi044.stderr: -159> 2024-09-12T17:48:06.841+0000 7f006e41b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:07.218 INFO:tasks.workunit.client.0.smithi044.stderr: -158> 2024-09-12T17:48:06.841+0000 7f006e41b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:07.218 INFO:tasks.workunit.client.0.smithi044.stderr: -157> 2024-09-12T17:48:06.841+0000 7f006e41b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:07.218 INFO:tasks.workunit.client.0.smithi044.stderr: -156> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.218 INFO:tasks.workunit.client.0.smithi044.stderr: -155> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.218 INFO:tasks.workunit.client.0.smithi044.stderr: -154> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.218 INFO:tasks.workunit.client.0.smithi044.stderr: -153> 2024-09-12T17:48:06.841+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:07.218 INFO:tasks.workunit.client.0.smithi044.stderr: -152> 2024-09-12T17:48:06.841+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:07.218 INFO:tasks.workunit.client.0.smithi044.stderr: -151> 2024-09-12T17:48:06.841+0000 7f006e41b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:07.218 INFO:tasks.workunit.client.0.smithi044.stderr: -150> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient(hunting): handle_auth_done global_id 8442 payload 824 2024-09-12T17:48:07.218 INFO:tasks.workunit.client.0.smithi044.stderr: -149> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient: _finish_hunting 0 2024-09-12T17:48:07.218 INFO:tasks.workunit.client.0.smithi044.stderr: -148> 2024-09-12T17:48:06.841+0000 7f006dc1a640 1 monclient: found mon.noname-a 2024-09-12T17:48:07.219 INFO:tasks.workunit.client.0.smithi044.stderr: -147> 2024-09-12T17:48:06.841+0000 7f006dc1a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.44:3300/0 2024-09-12T17:48:07.219 INFO:tasks.workunit.client.0.smithi044.stderr: -146> 2024-09-12T17:48:06.841+0000 7f006d419640 10 monclient: get_auth_request con 0x5596b4e2dbe0 auth_method 0 2024-09-12T17:48:07.219 INFO:tasks.workunit.client.0.smithi044.stderr: -145> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.219 INFO:tasks.workunit.client.0.smithi044.stderr: -144> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:07.219 INFO:tasks.workunit.client.0.smithi044.stderr: -143> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: dump: 2024-09-12T17:48:07.219 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.219 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.219 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.219 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.219 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.219 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.219 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.219 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.220 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.220 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.220 INFO:tasks.workunit.client.0.smithi044.stderr: -142> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: _finish_auth 0 2024-09-12T17:48:07.220 INFO:tasks.workunit.client.0.smithi044.stderr: -141> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:48:07.220 INFO:tasks.workunit.client.0.smithi044.stderr: -140> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:07.220 INFO:tasks.workunit.client.0.smithi044.stderr: -139> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:07.220 INFO:tasks.workunit.client.0.smithi044.stderr: -138> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:07.220 INFO:tasks.workunit.client.0.smithi044.stderr: -137> 2024-09-12T17:48:06.841+0000 7eff3f7fe640 10 monclient: dump: 2024-09-12T17:48:07.220 INFO:tasks.workunit.client.0.smithi044.stderr:epoch 1 2024-09-12T17:48:07.220 INFO:tasks.workunit.client.0.smithi044.stderr:fsid e2fc0024-c5a5-4250-915f-923340ab7b0f 2024-09-12T17:48:07.220 INFO:tasks.workunit.client.0.smithi044.stderr:last_changed 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.220 INFO:tasks.workunit.client.0.smithi044.stderr:created 2024-09-12T17:22:30.747451+0000 2024-09-12T17:48:07.220 INFO:tasks.workunit.client.0.smithi044.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:07.221 INFO:tasks.workunit.client.0.smithi044.stderr:election_strategy: 1 2024-09-12T17:48:07.221 INFO:tasks.workunit.client.0.smithi044.stderr:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-12T17:48:07.221 INFO:tasks.workunit.client.0.smithi044.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-09-12T17:48:07.221 INFO:tasks.workunit.client.0.smithi044.stderr:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-09-12T17:48:07.221 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.221 INFO:tasks.workunit.client.0.smithi044.stderr: -136> 2024-09-12T17:48:06.841+0000 7f0071f31800 5 monclient: authenticate success, global_id 8442 2024-09-12T17:48:07.221 INFO:tasks.workunit.client.0.smithi044.stderr: -135> 2024-09-12T17:48:06.841+0000 7eff517fa640 4 set_mon_vals no callback set 2024-09-12T17:48:07.221 INFO:tasks.workunit.client.0.smithi044.stderr: -134> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient: _renew_subs 2024-09-12T17:48:07.221 INFO:tasks.workunit.client.0.smithi044.stderr: -133> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:48:07.221 INFO:tasks.workunit.client.0.smithi044.stderr: -132> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient: _renew_subs 2024-09-12T17:48:07.221 INFO:tasks.workunit.client.0.smithi044.stderr: -131> 2024-09-12T17:48:06.841+0000 7f0071f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:48:07.221 INFO:tasks.workunit.client.0.smithi044.stderr: -130> 2024-09-12T17:48:06.841+0000 7f0071f31800 1 librados: init done 2024-09-12T17:48:07.221 INFO:tasks.workunit.client.0.smithi044.stderr: -129> 2024-09-12T17:48:06.841+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command cr dump hook 0x5596b4e2abe8 2024-09-12T17:48:07.221 INFO:tasks.workunit.client.0.smithi044.stderr: -128> 2024-09-12T17:48:06.843+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.222 INFO:tasks.workunit.client.0.smithi044.stderr: -127> 2024-09-12T17:48:06.844+0000 7eff3f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:07.222 INFO:tasks.workunit.client.0.smithi044.stderr: -126> 2024-09-12T17:48:06.844+0000 7eff3f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:48:07.222 INFO:tasks.workunit.client.0.smithi044.stderr: -125> 2024-09-12T17:48:06.844+0000 7eff3f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6800/2827779215,v1:172.21.15.181:6801/2827779215] 2024-09-12T17:48:07.222 INFO:tasks.workunit.client.0.smithi044.stderr: -124> 2024-09-12T17:48:06.844+0000 7f006d419640 10 monclient: get_auth_request con 0x7eff38076640 auth_method 0 2024-09-12T17:48:07.222 INFO:tasks.workunit.client.0.smithi044.stderr: -123> 2024-09-12T17:48:06.844+0000 7f006e41b640 10 monclient: get_auth_request con 0x5596b4e49c60 auth_method 0 2024-09-12T17:48:07.222 INFO:tasks.workunit.client.0.smithi044.stderr: -122> 2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.222 INFO:tasks.workunit.client.0.smithi044.stderr: -121> 2024-09-12T17:48:06.845+0000 7f0071f31800 20 realm 2024-09-12T17:48:07.222 INFO:tasks.workunit.client.0.smithi044.stderr: -120> 2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.222 INFO:tasks.workunit.client.0.smithi044.stderr: -119> 2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.222 INFO:tasks.workunit.client.0.smithi044.stderr: -118> 2024-09-12T17:48:06.845+0000 7f0071f31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:07.222 INFO:tasks.workunit.client.0.smithi044.stderr: -117> 2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.222 INFO:tasks.workunit.client.0.smithi044.stderr: -116> 2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.222 INFO:tasks.workunit.client.0.smithi044.stderr: -115> 2024-09-12T17:48:06.845+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.223 INFO:tasks.workunit.client.0.smithi044.stderr: -114> 2024-09-12T17:48:06.845+0000 7f006dc1a640 10 monclient: get_auth_request con 0x5596b4e4df60 auth_method 0 2024-09-12T17:48:07.223 INFO:tasks.workunit.client.0.smithi044.stderr: -113> 2024-09-12T17:48:06.846+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:07.223 INFO:tasks.workunit.client.0.smithi044.stderr: -112> 2024-09-12T17:48:06.846+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.223 INFO:tasks.workunit.client.0.smithi044.stderr: -111> 2024-09-12T17:48:06.846+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:07.223 INFO:tasks.workunit.client.0.smithi044.stderr: -110> 2024-09-12T17:48:06.846+0000 7f0071f31800 20 searching for the correct realm 2024-09-12T17:48:07.223 INFO:tasks.workunit.client.0.smithi044.stderr: -109> 2024-09-12T17:48:06.846+0000 7f006d419640 10 monclient: get_auth_request con 0x5596b4e53200 auth_method 0 2024-09-12T17:48:07.223 INFO:tasks.workunit.client.0.smithi044.stderr: -108> 2024-09-12T17:48:06.847+0000 7f006e41b640 10 monclient: get_auth_request con 0x7f006406b060 auth_method 0 2024-09-12T17:48:07.223 INFO:tasks.workunit.client.0.smithi044.stderr: -107> 2024-09-12T17:48:07.049+0000 7f006e41b640 10 monclient: get_auth_request con 0x7f006406b060 auth_method 0 2024-09-12T17:48:07.223 INFO:tasks.workunit.client.0.smithi044.stderr: -106> 2024-09-12T17:48:07.050+0000 7f006dc1a640 10 monclient: get_auth_request con 0x7f0068017020 auth_method 0 2024-09-12T17:48:07.223 INFO:tasks.workunit.client.0.smithi044.stderr: -105> 2024-09-12T17:48:07.051+0000 7f006d419640 10 monclient: get_auth_request con 0x7f006001d040 auth_method 0 2024-09-12T17:48:07.223 INFO:tasks.workunit.client.0.smithi044.stderr: -104> 2024-09-12T17:48:07.052+0000 7f006d419640 0 -- 172.21.15.44:0/2330354473 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x5596b4e53200 msgr2=0x5596b4e556c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:07.223 INFO:tasks.workunit.client.0.smithi044.stderr: -103> 2024-09-12T17:48:07.052+0000 7eff3f7fe640 1 client.8442.objecter ms_handle_reset 0x5596b4e53200 session 0x5596b4e52b80 osd.3 2024-09-12T17:48:07.223 INFO:tasks.workunit.client.0.smithi044.stderr: -102> 2024-09-12T17:48:07.052+0000 7eff3f7fe640 10 monclient: _renew_subs 2024-09-12T17:48:07.223 INFO:tasks.workunit.client.0.smithi044.stderr: -101> 2024-09-12T17:48:07.052+0000 7eff3f7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.44:3300/0 2024-09-12T17:48:07.224 INFO:tasks.workunit.client.0.smithi044.stderr: -100> 2024-09-12T17:48:07.052+0000 7f006d419640 10 monclient: get_auth_request con 0x7eff38086460 auth_method 0 2024-09-12T17:48:07.224 INFO:tasks.workunit.client.0.smithi044.stderr: -99> 2024-09-12T17:48:07.053+0000 7f006e41b640 10 monclient: get_auth_request con 0x7f00640ad620 auth_method 0 2024-09-12T17:48:07.224 INFO:tasks.workunit.client.0.smithi044.stderr: -98> 2024-09-12T17:48:07.055+0000 7f006dc1a640 10 monclient: get_auth_request con 0x7f0064061910 auth_method 0 2024-09-12T17:48:07.224 INFO:tasks.workunit.client.0.smithi044.stderr: -97> 2024-09-12T17:48:07.056+0000 7f006dc1a640 0 -- 172.21.15.44:0/2330354473 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f0064061910 msgr2=0x7f006409f050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:07.224 INFO:tasks.workunit.client.0.smithi044.stderr: -96> 2024-09-12T17:48:07.056+0000 7eff3f7fe640 1 client.8442.objecter ms_handle_reset 0x7f0064061910 session 0x7f00640a3090 osd.0 2024-09-12T17:48:07.224 INFO:tasks.workunit.client.0.smithi044.stderr: -95> 2024-09-12T17:48:07.056+0000 7f006dc1a640 10 monclient: get_auth_request con 0x5596b4e53200 auth_method 0 2024-09-12T17:48:07.224 INFO:tasks.workunit.client.0.smithi044.stderr: -94> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:07.224 INFO:tasks.workunit.client.0.smithi044.stderr: -93> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:07.224 INFO:tasks.workunit.client.0.smithi044.stderr: -92> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:07.224 INFO:tasks.workunit.client.0.smithi044.stderr: -91> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:07.224 INFO:tasks.workunit.client.0.smithi044.stderr: -90> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:07.224 INFO:tasks.workunit.client.0.smithi044.stderr: -89> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:07.224 INFO:tasks.workunit.client.0.smithi044.stderr: -88> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.225 INFO:tasks.workunit.client.0.smithi044.stderr: -87> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.225 INFO:tasks.workunit.client.0.smithi044.stderr: -86> 2024-09-12T17:48:07.060+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.225 INFO:tasks.workunit.client.0.smithi044.stderr: -85> 2024-09-12T17:48:07.061+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:07.225 INFO:tasks.workunit.client.0.smithi044.stderr: -84> 2024-09-12T17:48:07.061+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.225 INFO:tasks.workunit.client.0.smithi044.stderr: -83> 2024-09-12T17:48:07.061+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:07.225 INFO:tasks.workunit.client.0.smithi044.stderr: -82> 2024-09-12T17:48:07.061+0000 7f0071f31800 20 zone default found 2024-09-12T17:48:07.225 INFO:tasks.workunit.client.0.smithi044.stderr: -81> 2024-09-12T17:48:07.061+0000 7f0071f31800 4 Realm: () 2024-09-12T17:48:07.225 INFO:tasks.workunit.client.0.smithi044.stderr: -80> 2024-09-12T17:48:07.061+0000 7f0071f31800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:07.225 INFO:tasks.workunit.client.0.smithi044.stderr: -79> 2024-09-12T17:48:07.061+0000 7f0071f31800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:07.225 INFO:tasks.workunit.client.0.smithi044.stderr: -78> 2024-09-12T17:48:07.061+0000 7f0071f31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:07.225 INFO:tasks.workunit.client.0.smithi044.stderr: -77> 2024-09-12T17:48:07.061+0000 7f0071f31800 20 zonegroup default 2024-09-12T17:48:07.225 INFO:tasks.workunit.client.0.smithi044.stderr: -76> 2024-09-12T17:48:07.061+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.225 INFO:tasks.workunit.client.0.smithi044.stderr: -75> 2024-09-12T17:48:07.062+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.226 INFO:tasks.workunit.client.0.smithi044.stderr: -74> 2024-09-12T17:48:07.062+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.226 INFO:tasks.workunit.client.0.smithi044.stderr: -73> 2024-09-12T17:48:07.062+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.226 INFO:tasks.workunit.client.0.smithi044.stderr: -72> 2024-09-12T17:48:07.062+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.226 INFO:tasks.workunit.client.0.smithi044.stderr: -71> 2024-09-12T17:48:07.062+0000 7f0071f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.226 INFO:tasks.workunit.client.0.smithi044.stderr: -70> 2024-09-12T17:48:07.062+0000 7f0071f31800 20 started sync module instance, tier type = 2024-09-12T17:48:07.226 INFO:tasks.workunit.client.0.smithi044.stderr: -69> 2024-09-12T17:48:07.062+0000 7f0071f31800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:07.226 INFO:tasks.workunit.client.0.smithi044.stderr: -68> 2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=0 2024-09-12T17:48:07.226 INFO:tasks.workunit.client.0.smithi044.stderr: -67> 2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=1 2024-09-12T17:48:07.226 INFO:tasks.workunit.client.0.smithi044.stderr: -66> 2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=2 2024-09-12T17:48:07.226 INFO:tasks.workunit.client.0.smithi044.stderr: -65> 2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=3 2024-09-12T17:48:07.226 INFO:tasks.workunit.client.0.smithi044.stderr: -64> 2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=4 2024-09-12T17:48:07.226 INFO:tasks.workunit.client.0.smithi044.stderr: -63> 2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=5 2024-09-12T17:48:07.226 INFO:tasks.workunit.client.0.smithi044.stderr: -62> 2024-09-12T17:48:07.072+0000 7f0071f31800 20 add_watcher() i=6 2024-09-12T17:48:07.227 INFO:tasks.workunit.client.0.smithi044.stderr: -61> 2024-09-12T17:48:07.073+0000 7f0071f31800 20 add_watcher() i=7 2024-09-12T17:48:07.227 INFO:tasks.workunit.client.0.smithi044.stderr: -60> 2024-09-12T17:48:07.073+0000 7f0071f31800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:07.227 INFO:tasks.workunit.client.0.smithi044.stderr: -59> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding auth protocol: cephx 2024-09-12T17:48:07.227 INFO:tasks.workunit.client.0.smithi044.stderr: -58> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding auth protocol: cephx 2024-09-12T17:48:07.227 INFO:tasks.workunit.client.0.smithi044.stderr: -57> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding auth protocol: cephx 2024-09-12T17:48:07.227 INFO:tasks.workunit.client.0.smithi044.stderr: -56> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: secure 2024-09-12T17:48:07.227 INFO:tasks.workunit.client.0.smithi044.stderr: -55> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: crc 2024-09-12T17:48:07.227 INFO:tasks.workunit.client.0.smithi044.stderr: -54> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: secure 2024-09-12T17:48:07.227 INFO:tasks.workunit.client.0.smithi044.stderr: -53> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: crc 2024-09-12T17:48:07.227 INFO:tasks.workunit.client.0.smithi044.stderr: -52> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: secure 2024-09-12T17:48:07.227 INFO:tasks.workunit.client.0.smithi044.stderr: -51> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: crc 2024-09-12T17:48:07.227 INFO:tasks.workunit.client.0.smithi044.stderr: -50> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: crc 2024-09-12T17:48:07.227 INFO:tasks.workunit.client.0.smithi044.stderr: -49> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: secure 2024-09-12T17:48:07.228 INFO:tasks.workunit.client.0.smithi044.stderr: -48> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: crc 2024-09-12T17:48:07.228 INFO:tasks.workunit.client.0.smithi044.stderr: -47> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: secure 2024-09-12T17:48:07.228 INFO:tasks.workunit.client.0.smithi044.stderr: -46> 2024-09-12T17:48:07.075+0000 7eff1f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:07.228 INFO:tasks.workunit.client.0.smithi044.stderr: -45> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: crc 2024-09-12T17:48:07.228 INFO:tasks.workunit.client.0.smithi044.stderr: -44> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 AuthRegistry(0x7fff28ed15c0) adding con mode: secure 2024-09-12T17:48:07.228 INFO:tasks.workunit.client.0.smithi044.stderr: -43> 2024-09-12T17:48:07.075+0000 7f0071f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:07.228 INFO:tasks.workunit.client.0.smithi044.stderr: -42> 2024-09-12T17:48:07.075+0000 7f0071f31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:07.228 INFO:tasks.workunit.client.0.smithi044.stderr: -41> 2024-09-12T17:48:07.075+0000 7f0071f31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:07.228 INFO:tasks.workunit.client.0.smithi044.stderr: -40> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command cache list hook 0x5596b4e3d3c0 2024-09-12T17:48:07.228 INFO:tasks.workunit.client.0.smithi044.stderr: -39> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command cache inspect hook 0x5596b4e3d3c0 2024-09-12T17:48:07.228 INFO:tasks.workunit.client.0.smithi044.stderr: -38> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command cache erase hook 0x5596b4e3d3c0 2024-09-12T17:48:07.228 INFO:tasks.workunit.client.0.smithi044.stderr: -37> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command cache zap hook 0x5596b4e3d3c0 2024-09-12T17:48:07.228 INFO:tasks.workunit.client.0.smithi044.stderr: -36> 2024-09-12T17:48:07.075+0000 7f0071f31800 5 note: GC not initialized 2024-09-12T17:48:07.228 INFO:tasks.workunit.client.0.smithi044.stderr: -35> 2024-09-12T17:48:07.076+0000 7eff1e7fc640 20 reqs_thread_entry: start 2024-09-12T17:48:07.229 INFO:tasks.workunit.client.0.smithi044.stderr: -34> 2024-09-12T17:48:07.076+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command sync trace show hook 0x7f006800d7a0 2024-09-12T17:48:07.229 INFO:tasks.workunit.client.0.smithi044.stderr: -33> 2024-09-12T17:48:07.076+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command sync trace history hook 0x7f006800d7a0 2024-09-12T17:48:07.229 INFO:tasks.workunit.client.0.smithi044.stderr: -32> 2024-09-12T17:48:07.076+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command sync trace active hook 0x7f006800d7a0 2024-09-12T17:48:07.229 INFO:tasks.workunit.client.0.smithi044.stderr: -31> 2024-09-12T17:48:07.076+0000 7f0071f31800 5 asok(0x5596b4b3c730) register_command sync trace active_short hook 0x7f006800d7a0 2024-09-12T17:48:07.229 INFO:tasks.workunit.client.0.smithi044.stderr: -30> 2024-09-12T17:48:07.076+0000 7f0071f31800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:07.229 INFO:tasks.workunit.client.0.smithi044.stderr: -29> 2024-09-12T17:48:07.076+0000 7f0071f31800 20 Filter name: none 2024-09-12T17:48:07.229 INFO:tasks.workunit.client.0.smithi044.stderr: -28> 2024-09-12T17:48:07.076+0000 7efe8ffff640 20 reqs_thread_entry: start 2024-09-12T17:48:07.229 INFO:tasks.workunit.client.0.smithi044.stderr: -27> 2024-09-12T17:48:07.076+0000 7f0071f31800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:48:07.229 INFO:tasks.workunit.client.0.smithi044.stderr: -26> 2024-09-12T17:48:07.076+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.229 INFO:tasks.workunit.client.0.smithi044.stderr: -25> 2024-09-12T17:48:07.076+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:07.229 INFO:tasks.workunit.client.0.smithi044.stderr: -24> 2024-09-12T17:48:07.076+0000 7f0071f31800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:48:07.229 INFO:tasks.workunit.client.0.smithi044.stderr: -23> 2024-09-12T17:48:07.076+0000 7f0071f31800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:48:07.229 INFO:tasks.workunit.client.0.smithi044.stderr: -22> 2024-09-12T17:48:07.076+0000 7f0071f31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:48:07.230 INFO:tasks.workunit.client.0.smithi044.stderr: -21> 2024-09-12T17:48:07.077+0000 7f0071f31800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.230 INFO:tasks.workunit.client.0.smithi044.stderr: -20> 2024-09-12T17:48:07.077+0000 7f0071f31800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:48:07.230 INFO:tasks.workunit.client.0.smithi044.stderr: -19> 2024-09-12T17:48:07.077+0000 7f0071f31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:07.230 INFO:tasks.workunit.client.0.smithi044.stderr: -18> 2024-09-12T17:48:07.077+0000 7f0071f31800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:07.230 INFO:tasks.workunit.client.0.smithi044.stderr: -17> 2024-09-12T17:48:07.077+0000 7f0071f31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:07.230 INFO:tasks.workunit.client.0.smithi044.stderr: -16> 2024-09-12T17:48:07.077+0000 7f0071f31800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:07.230 INFO:tasks.workunit.client.0.smithi044.stderr: -15> 2024-09-12T17:48:07.077+0000 7f0071f31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:48:07.230 INFO:tasks.workunit.client.0.smithi044.stderr: -14> 2024-09-12T17:48:07.078+0000 7f0071f31800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:48:07.230 INFO:tasks.workunit.client.0.smithi044.stderr: -13> 2024-09-12T17:48:07.088+0000 7f0071f31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:07.230 INFO:tasks.workunit.client.0.smithi044.stderr: -12> 2024-09-12T17:48:07.088+0000 7f0071f31800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:07.230 INFO:tasks.workunit.client.0.smithi044.stderr: -11> 2024-09-12T17:48:07.088+0000 7f0071f31800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:07.230 INFO:tasks.workunit.client.0.smithi044.stderr: -10> 2024-09-12T17:48:07.088+0000 7f0071f31800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:48:07.230 INFO:tasks.workunit.client.0.smithi044.stderr: -9> 2024-09-12T17:48:07.088+0000 7eff50ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562466 cookie 94105768381824 notifier 8442 bl.length()=911 2024-09-12T17:48:07.231 INFO:tasks.workunit.client.0.smithi044.stderr: -8> 2024-09-12T17:48:07.088+0000 7eff50ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:07.231 INFO:tasks.workunit.client.0.smithi044.stderr: -7> 2024-09-12T17:48:07.088+0000 7eff50ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:07.231 INFO:tasks.workunit.client.0.smithi044.stderr: -6> 2024-09-12T17:48:07.088+0000 7eff50ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:07.231 INFO:tasks.workunit.client.0.smithi044.stderr: -5> 2024-09-12T17:48:07.089+0000 7f0071f31800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:48:07.231 INFO:tasks.workunit.client.0.smithi044.stderr: -4> 2024-09-12T17:48:07.089+0000 7f0071f31800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:48:07.231 INFO:tasks.workunit.client.0.smithi044.stderr: -3> 2024-09-12T17:48:07.089+0000 7f0071f31800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:48:07.231 INFO:tasks.workunit.client.0.smithi044.stderr: -2> 2024-09-12T17:48:07.089+0000 7f0071f31800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:48:07.231 INFO:tasks.workunit.client.0.smithi044.stderr: -1> 2024-09-12T17:48:07.095+0000 7f0071f31800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0071f31800 time 2024-09-12T17:48:07.096235+0000 2024-09-12T17:48:07.231 INFO:tasks.workunit.client.0.smithi044.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:48:07.231 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.231 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:07.231 INFO:tasks.workunit.client.0.smithi044.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f007358c71a] 2024-09-12T17:48:07.231 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f007358c8d8] 2024-09-12T17:48:07.232 INFO:tasks.workunit.client.0.smithi044.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5596b30f1841] 2024-09-12T17:48:07.232 INFO:tasks.workunit.client.0.smithi044.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5596b310157a] 2024-09-12T17:48:07.232 INFO:tasks.workunit.client.0.smithi044.stderr: 5: main() 2024-09-12T17:48:07.232 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f0072229590] 2024-09-12T17:48:07.232 INFO:tasks.workunit.client.0.smithi044.stderr: 7: __libc_start_main() 2024-09-12T17:48:07.232 INFO:tasks.workunit.client.0.smithi044.stderr: 8: _start() 2024-09-12T17:48:07.232 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.232 INFO:tasks.workunit.client.0.smithi044.stderr: 0> 2024-09-12T17:48:07.096+0000 7f0071f31800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:48:07.232 INFO:tasks.workunit.client.0.smithi044.stderr: in thread 7f0071f31800 thread_name:radosgw-admin 2024-09-12T17:48:07.232 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.232 INFO:tasks.workunit.client.0.smithi044.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:07.232 INFO:tasks.workunit.client.0.smithi044.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f007223e6f0] 2024-09-12T17:48:07.232 INFO:tasks.workunit.client.0.smithi044.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f007228b99c] 2024-09-12T17:48:07.233 INFO:tasks.workunit.client.0.smithi044.stderr: 3: raise() 2024-09-12T17:48:07.233 INFO:tasks.workunit.client.0.smithi044.stderr: 4: abort() 2024-09-12T17:48:07.233 INFO:tasks.workunit.client.0.smithi044.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f007358c774] 2024-09-12T17:48:07.233 INFO:tasks.workunit.client.0.smithi044.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f007358c8d8] 2024-09-12T17:48:07.233 INFO:tasks.workunit.client.0.smithi044.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5596b30f1841] 2024-09-12T17:48:07.233 INFO:tasks.workunit.client.0.smithi044.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5596b310157a] 2024-09-12T17:48:07.233 INFO:tasks.workunit.client.0.smithi044.stderr: 9: main() 2024-09-12T17:48:07.233 INFO:tasks.workunit.client.0.smithi044.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f0072229590] 2024-09-12T17:48:07.233 INFO:tasks.workunit.client.0.smithi044.stderr: 11: __libc_start_main() 2024-09-12T17:48:07.233 INFO:tasks.workunit.client.0.smithi044.stderr: 12: _start() 2024-09-12T17:48:07.233 INFO:tasks.workunit.client.0.smithi044.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:48:07.233 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:07.233 INFO:tasks.workunit.client.0.smithi044.stderr:--- logging levels --- 2024-09-12T17:48:07.233 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 none 2024-09-12T17:48:07.234 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 lockdep 2024-09-12T17:48:07.234 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 context 2024-09-12T17:48:07.234 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 crush 2024-09-12T17:48:07.234 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds 2024-09-12T17:48:07.234 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_balancer 2024-09-12T17:48:07.234 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_locker 2024-09-12T17:48:07.234 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log 2024-09-12T17:48:07.234 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_log_expire 2024-09-12T17:48:07.234 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mds_migrator 2024-09-12T17:48:07.234 INFO:tasks.workunit.client.0.smithi044.stderr: 3/ 5 mds_quiesce 2024-09-12T17:48:07.234 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 buffer 2024-09-12T17:48:07.234 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 timer 2024-09-12T17:48:07.234 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 filer 2024-09-12T17:48:07.234 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 striper 2024-09-12T17:48:07.235 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 1 objecter 2024-09-12T17:48:07.235 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rados 2024-09-12T17:48:07.235 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd 2024-09-12T17:48:07.235 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_mirror 2024-09-12T17:48:07.235 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_replay 2024-09-12T17:48:07.235 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 rbd_pwl 2024-09-12T17:48:07.235 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 journaler 2024-09-12T17:48:07.235 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objectcacher 2024-09-12T17:48:07.235 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:48:07.235 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 client 2024-09-12T17:48:07.235 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 osd 2024-09-12T17:48:07.235 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 optracker 2024-09-12T17:48:07.235 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 objclass 2024-09-12T17:48:07.235 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 filestore 2024-09-12T17:48:07.236 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 journal 2024-09-12T17:48:07.236 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 ms 2024-09-12T17:48:07.236 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mon 2024-09-12T17:48:07.236 INFO:tasks.workunit.client.0.smithi044.stderr: 0/10 monc 2024-09-12T17:48:07.236 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 paxos 2024-09-12T17:48:07.236 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 tp 2024-09-12T17:48:07.236 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 auth 2024-09-12T17:48:07.236 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 crypto 2024-09-12T17:48:07.236 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 finisher 2024-09-12T17:48:07.236 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 reserver 2024-09-12T17:48:07.236 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 heartbeatmap 2024-09-12T17:48:07.236 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 perfcounter 2024-09-12T17:48:07.236 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw 2024-09-12T17:48:07.236 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_sync 2024-09-12T17:48:07.237 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_datacache 2024-09-12T17:48:07.237 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_access 2024-09-12T17:48:07.237 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:48:07.237 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_flight 2024-09-12T17:48:07.237 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:48:07.237 INFO:tasks.workunit.client.0.smithi044.stderr: 20/20 rgw_notification 2024-09-12T17:48:07.237 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 javaclient 2024-09-12T17:48:07.237 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 asok 2024-09-12T17:48:07.237 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 1 throttle 2024-09-12T17:48:07.237 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 0 refs 2024-09-12T17:48:07.237 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 compressor 2024-09-12T17:48:07.237 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluestore 2024-09-12T17:48:07.237 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 bluefs 2024-09-12T17:48:07.237 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 3 bdev 2024-09-12T17:48:07.238 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 kstore 2024-09-12T17:48:07.238 INFO:tasks.workunit.client.0.smithi044.stderr: 4/ 5 rocksdb 2024-09-12T17:48:07.238 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 fuse 2024-09-12T17:48:07.238 INFO:tasks.workunit.client.0.smithi044.stderr: 2/ 5 mgr 2024-09-12T17:48:07.238 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mgrc 2024-09-12T17:48:07.238 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 dpdk 2024-09-12T17:48:07.238 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 eventtrace 2024-09-12T17:48:07.238 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 prioritycache 2024-09-12T17:48:07.238 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 test 2024-09-12T17:48:07.238 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:48:07.238 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cephsqlite 2024-09-12T17:48:07.238 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:48:07.238 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore 2024-09-12T17:48:07.238 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_onode 2024-09-12T17:48:07.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_odata 2024-09-12T17:48:07.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_omap 2024-09-12T17:48:07.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_tm 2024-09-12T17:48:07.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_t 2024-09-12T17:48:07.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:48:07.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_epm 2024-09-12T17:48:07.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_lba 2024-09-12T17:48:07.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:48:07.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_cache 2024-09-12T17:48:07.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_journal 2024-09-12T17:48:07.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_device 2024-09-12T17:48:07.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 seastore_backref 2024-09-12T17:48:07.239 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 alienstore 2024-09-12T17:48:07.239 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 mclock 2024-09-12T17:48:07.240 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 cyanstore 2024-09-12T17:48:07.240 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 ceph_exporter 2024-09-12T17:48:07.240 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 memstore 2024-09-12T17:48:07.240 INFO:tasks.workunit.client.0.smithi044.stderr: 1/ 5 trace 2024-09-12T17:48:07.240 INFO:tasks.workunit.client.0.smithi044.stderr: 0/ 5 ceph_dedup 2024-09-12T17:48:07.240 INFO:tasks.workunit.client.0.smithi044.stderr: -2/-2 (syslog threshold) 2024-09-12T17:48:07.240 INFO:tasks.workunit.client.0.smithi044.stderr: 99/99 (stderr threshold) 2024-09-12T17:48:07.240 INFO:tasks.workunit.client.0.smithi044.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:48:07.240 INFO:tasks.workunit.client.0.smithi044.stderr: 7efe8ffff640 / http_manager 2024-09-12T17:48:07.240 INFO:tasks.workunit.client.0.smithi044.stderr: 7eff1e7fc640 / http_manager 2024-09-12T17:48:07.240 INFO:tasks.workunit.client.0.smithi044.stderr: 7eff1f7fe640 / rgw_dt_lg_renew 2024-09-12T17:48:07.240 INFO:tasks.workunit.client.0.smithi044.stderr: 7eff3f7fe640 / ms_dispatch 2024-09-12T17:48:07.240 INFO:tasks.workunit.client.0.smithi044.stderr: 7eff50ff9640 / io_context_pool 2024-09-12T17:48:07.241 INFO:tasks.workunit.client.0.smithi044.stderr: 7eff517fa640 / io_context_pool 2024-09-12T17:48:07.241 INFO:tasks.workunit.client.0.smithi044.stderr: 7eff537fe640 / ms_dispatch 2024-09-12T17:48:07.241 INFO:tasks.workunit.client.0.smithi044.stderr: 7eff5a604640 / ms_dispatch 2024-09-12T17:48:07.241 INFO:tasks.workunit.client.0.smithi044.stderr: 7eff5be07640 / io_context_pool 2024-09-12T17:48:07.241 INFO:tasks.workunit.client.0.smithi044.stderr: 7f006d419640 / msgr-worker-2 2024-09-12T17:48:07.241 INFO:tasks.workunit.client.0.smithi044.stderr: 7f006dc1a640 / msgr-worker-1 2024-09-12T17:48:07.241 INFO:tasks.workunit.client.0.smithi044.stderr: 7f006e41b640 / msgr-worker-0 2024-09-12T17:48:07.241 INFO:tasks.workunit.client.0.smithi044.stderr: 7f006ec1c640 / io_context_pool 2024-09-12T17:48:07.241 INFO:tasks.workunit.client.0.smithi044.stderr: 7f0071f31800 / radosgw-admin 2024-09-12T17:48:07.241 INFO:tasks.workunit.client.0.smithi044.stderr: max_recent 500 2024-09-12T17:48:07.241 INFO:tasks.workunit.client.0.smithi044.stderr: max_new 1000 2024-09-12T17:48:07.241 INFO:tasks.workunit.client.0.smithi044.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:48:07.097638Z_04697b99-6657-4fdd-aeb5-8e59e4a3a390/log 2024-09-12T17:48:07.241 INFO:tasks.workunit.client.0.smithi044.stderr:--- end dump of recent events --- 2024-09-12T17:48:07.241 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:48:07.246 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:07.246 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:07.246 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.173+0000 7fbff0d22800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.246 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.175+0000 7fbff0d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.246 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.175+0000 7fbff0d22800 20 realm 2024-09-12T17:48:07.246 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.175+0000 7fbff0d22800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.176+0000 7fbff0d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.176+0000 7fbff0d22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.176+0000 7fbff0d22800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.176+0000 7fbff0d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.176+0000 7fbff0d22800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.177+0000 7fbff0d22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.177+0000 7fbff0d22800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.177+0000 7fbff0d22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.177+0000 7fbff0d22800 20 searching for the correct realm 2024-09-12T17:48:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.181+0000 7fbfe7fff640 0 -- 172.21.15.44:0/3919658302 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fbfe00a0230 msgr2=0x7fbfe008cd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.184+0000 7fbfe7fff640 0 -- 172.21.15.44:0/3919658302 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fbeb8086290 msgr2=0x7fbeb80886c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.188+0000 7fbff0d22800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:07.247 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.188+0000 7fbff0d22800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:07.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.188+0000 7fbff0d22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:07.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.188+0000 7fbff0d22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:07.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.188+0000 7fbff0d22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:07.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.188+0000 7fbff0d22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:07.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.188+0000 7fbff0d22800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.188+0000 7fbff0d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.188+0000 7fbff0d22800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.189+0000 7fbff0d22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:07.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.189+0000 7fbff0d22800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.190+0000 7fbff0d22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:07.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.190+0000 7fbff0d22800 20 zone default found 2024-09-12T17:48:07.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.190+0000 7fbff0d22800 4 Realm: () 2024-09-12T17:48:07.248 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.190+0000 7fbff0d22800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:07.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.190+0000 7fbff0d22800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:07.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.190+0000 7fbff0d22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:07.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.190+0000 7fbff0d22800 20 zonegroup default 2024-09-12T17:48:07.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.190+0000 7fbff0d22800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.190+0000 7fbff0d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.190+0000 7fbff0d22800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.190+0000 7fbff0d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.190+0000 7fbff0d22800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.190+0000 7fbff0d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.190+0000 7fbff0d22800 20 started sync module instance, tier type = 2024-09-12T17:48:07.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.190+0000 7fbff0d22800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:07.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.200+0000 7fbff0d22800 20 add_watcher() i=0 2024-09-12T17:48:07.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.200+0000 7fbff0d22800 20 add_watcher() i=1 2024-09-12T17:48:07.249 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.200+0000 7fbff0d22800 20 add_watcher() i=2 2024-09-12T17:48:07.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.200+0000 7fbff0d22800 20 add_watcher() i=3 2024-09-12T17:48:07.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.200+0000 7fbff0d22800 20 add_watcher() i=4 2024-09-12T17:48:07.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.200+0000 7fbff0d22800 20 add_watcher() i=5 2024-09-12T17:48:07.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.200+0000 7fbff0d22800 20 add_watcher() i=6 2024-09-12T17:48:07.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.200+0000 7fbff0d22800 20 add_watcher() i=7 2024-09-12T17:48:07.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.200+0000 7fbff0d22800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:07.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.202+0000 7fbea37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:07.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.203+0000 7fbff0d22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:07.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.203+0000 7fbff0d22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:07.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.203+0000 7fbff0d22800 5 note: GC not initialized 2024-09-12T17:48:07.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.203+0000 7fbea27e4640 20 reqs_thread_entry: start 2024-09-12T17:48:07.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.203+0000 7fbff0d22800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:07.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.203+0000 7fbff0d22800 20 Filter name: none 2024-09-12T17:48:07.250 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.203+0000 7fbea07e0640 20 reqs_thread_entry: start 2024-09-12T17:48:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.203+0000 7fbff0d22800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.204+0000 7fbff0d22800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.204+0000 7fbff0d22800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.204+0000 7fbff0d22800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:48:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.204+0000 7fbff0d22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.204+0000 7fbff0d22800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.205+0000 7fbff0d22800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.205+0000 7fbff0d22800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.205+0000 7fbff0d22800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:48:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.205+0000 7fbff0d22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.207+0000 7fbea37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.209+0000 7fbff0d22800 20 remove_watcher() i=0 2024-09-12T17:48:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.209+0000 7fbff0d22800 2 removed watcher, disabling cache 2024-09-12T17:48:07.251 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.210+0000 7fbff0d22800 20 remove_watcher() i=1 2024-09-12T17:48:07.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.211+0000 7fbff0d22800 20 remove_watcher() i=2 2024-09-12T17:48:07.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.212+0000 7fbff0d22800 20 remove_watcher() i=3 2024-09-12T17:48:07.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.213+0000 7fbff0d22800 20 remove_watcher() i=4 2024-09-12T17:48:07.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.215+0000 7fbff0d22800 20 remove_watcher() i=5 2024-09-12T17:48:07.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.216+0000 7fbff0d22800 20 remove_watcher() i=6 2024-09-12T17:48:07.252 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.216+0000 7fbff0d22800 20 remove_watcher() i=7 2024-09-12T17:48:07.252 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:48:07.270 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:07.270 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:07.309 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.308+0000 7f4943c40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.310+0000 7f4943c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.310+0000 7f4943c40800 20 realm 2024-09-12T17:48:07.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.310+0000 7f4943c40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.310+0000 7f4943c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.310+0000 7f4943c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:07.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.310+0000 7f4943c40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.310+0000 7f4943c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.312 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.310+0000 7f4943c40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.311+0000 7f4943c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:07.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.311+0000 7f4943c40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.311+0000 7f4943c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:07.313 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.311+0000 7f4943c40800 20 searching for the correct realm 2024-09-12T17:48:07.315 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.313+0000 7f494172a640 0 -- 172.21.15.44:0/1083341387 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7f493c01f040 msgr2=0x7f493c01f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:07.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.518+0000 7f4941f2b640 0 -- 172.21.15.44:0/1083341387 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f492c031040 msgr2=0x7f492c075570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:07.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.524+0000 7f4943c40800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:07.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.524+0000 7f4943c40800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:07.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.524+0000 7f4943c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:07.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.524+0000 7f4943c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:07.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.524+0000 7f4943c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:07.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.524+0000 7f4943c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:07.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.524+0000 7f4943c40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.525+0000 7f4943c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.525+0000 7f4943c40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.525+0000 7f4943c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:07.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.525+0000 7f4943c40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.525+0000 7f4943c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:07.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.525+0000 7f4943c40800 20 zone default found 2024-09-12T17:48:07.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.525+0000 7f4943c40800 4 Realm: () 2024-09-12T17:48:07.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.525+0000 7f4943c40800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:07.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.525+0000 7f4943c40800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:07.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.525+0000 7f4943c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:07.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.525+0000 7f4943c40800 20 zonegroup default 2024-09-12T17:48:07.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.525+0000 7f4943c40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.526+0000 7f4943c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.526+0000 7f4943c40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.526+0000 7f4943c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.526+0000 7f4943c40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.526+0000 7f4943c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.526+0000 7f4943c40800 20 started sync module instance, tier type = 2024-09-12T17:48:07.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.526+0000 7f4943c40800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:07.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.536+0000 7f4943c40800 20 add_watcher() i=0 2024-09-12T17:48:07.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.536+0000 7f4943c40800 20 add_watcher() i=1 2024-09-12T17:48:07.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.536+0000 7f4943c40800 20 add_watcher() i=2 2024-09-12T17:48:07.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.536+0000 7f4943c40800 20 add_watcher() i=3 2024-09-12T17:48:07.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.536+0000 7f4943c40800 20 add_watcher() i=4 2024-09-12T17:48:07.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.536+0000 7f4943c40800 20 add_watcher() i=5 2024-09-12T17:48:07.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.536+0000 7f4943c40800 20 add_watcher() i=6 2024-09-12T17:48:07.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.537+0000 7f4943c40800 20 add_watcher() i=7 2024-09-12T17:48:07.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.537+0000 7f4943c40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:07.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.538+0000 7f47f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:07.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.539+0000 7f4943c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:07.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.539+0000 7f4943c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:07.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.539+0000 7f4943c40800 5 note: GC not initialized 2024-09-12T17:48:07.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.539+0000 7f47f67e4640 20 reqs_thread_entry: start 2024-09-12T17:48:07.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.539+0000 7f4943c40800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:07.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.539+0000 7f4943c40800 20 Filter name: none 2024-09-12T17:48:07.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.539+0000 7f4767fff640 20 reqs_thread_entry: start 2024-09-12T17:48:07.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.539+0000 7f4943c40800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:48:07.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.540+0000 7f4943c40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.540+0000 7f4943c40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:07.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.540+0000 7f4943c40800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:48:07.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.540+0000 7f4943c40800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:48:07.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.540+0000 7f4943c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:48:07.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.540+0000 7f4943c40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.540+0000 7f4943c40800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:48:07.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.540+0000 7f4943c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:07.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.540+0000 7f4943c40800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:07.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.540+0000 7f4943c40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:07.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.540+0000 7f4943c40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:07.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.540+0000 7f4943c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:48:07.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.540+0000 7f4943c40800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:48:07.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.541+0000 7f4943c40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:48:07.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.541+0000 7f4943c40800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:48:07.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.541+0000 7f4943c40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:48:07.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.541+0000 7f4943c40800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:48:07.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.541+0000 7f4943c40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:48:07.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.542+0000 7f4943c40800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:48:07.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.542+0000 7f4943c40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:48:07.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.542+0000 7f4943c40800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:48:07.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.542+0000 7f4943c40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:48:07.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.543+0000 7f4943c40800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:48:07.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.543+0000 7f4943c40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:48:07.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.543+0000 7f4943c40800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:48:07.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.543+0000 7f4943c40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:48:07.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.543+0000 7f4943c40800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:48:07.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.543+0000 7f4943c40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:48:07.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.544+0000 7f4943c40800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:48:07.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.544+0000 7f4943c40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:48:07.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.544+0000 7f4943c40800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:48:07.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.544+0000 7f4943c40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:48:07.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.544+0000 7f4943c40800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:48:07.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.544+0000 7f4943c40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:48:07.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.545+0000 7f4943c40800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:48:07.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.545+0000 7f4943c40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:48:07.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.545+0000 7f4943c40800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:48:07.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.545+0000 7f4943c40800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:48:07.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.546+0000 7f47f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:07.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.549+0000 7f4943c40800 20 remove_watcher() i=0 2024-09-12T17:48:07.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.549+0000 7f4943c40800 2 removed watcher, disabling cache 2024-09-12T17:48:07.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.550+0000 7f4943c40800 20 remove_watcher() i=1 2024-09-12T17:48:07.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.551+0000 7f4943c40800 20 remove_watcher() i=2 2024-09-12T17:48:07.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.552+0000 7f4943c40800 20 remove_watcher() i=3 2024-09-12T17:48:07.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.553+0000 7f4943c40800 20 remove_watcher() i=4 2024-09-12T17:48:07.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.554+0000 7f4943c40800 20 remove_watcher() i=5 2024-09-12T17:48:07.557 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.555+0000 7f4943c40800 20 remove_watcher() i=6 2024-09-12T17:48:07.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:07.556+0000 7f4943c40800 20 remove_watcher() i=7 2024-09-12T17:48:37.595 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T17:48:37.628 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:37.628 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:37.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.673+0000 7f6367413800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.675+0000 7f6367413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:37.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.675+0000 7f6367413800 20 realm 2024-09-12T17:48:37.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.675+0000 7f6367413800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.675+0000 7f6367413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:37.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.675+0000 7f6367413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:37.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.675+0000 7f6367413800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.675+0000 7f6367413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:37.676 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.675+0000 7f6367413800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.676+0000 7f6367413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:37.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.676+0000 7f6367413800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.677+0000 7f6367413800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:37.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.677+0000 7f6367413800 20 searching for the correct realm 2024-09-12T17:48:37.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.680+0000 7f6362347640 0 -- 172.21.15.44:0/1979659761 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x563c70d06c90 msgr2=0x563c70d09150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:37.685 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.684+0000 7f6362b48640 0 -- 172.21.15.44:0/1979659761 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f6358043be0 msgr2=0x7f63580a09a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:37.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.690+0000 7f6367413800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:37.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.690+0000 7f6367413800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:37.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.690+0000 7f6367413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:37.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.690+0000 7f6367413800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:37.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.690+0000 7f6367413800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:37.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.690+0000 7f6367413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:37.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.690+0000 7f6367413800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.690+0000 7f6367413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:37.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.690+0000 7f6367413800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.690+0000 7f6367413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:37.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.690+0000 7f6367413800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.691+0000 7f6367413800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:37.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.691+0000 7f6367413800 20 zone default found 2024-09-12T17:48:37.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.691+0000 7f6367413800 4 Realm: () 2024-09-12T17:48:37.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.691+0000 7f6367413800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:37.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.691+0000 7f6367413800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:37.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.691+0000 7f6367413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:37.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.691+0000 7f6367413800 20 zonegroup default 2024-09-12T17:48:37.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.691+0000 7f6367413800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.691+0000 7f6367413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:37.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.691+0000 7f6367413800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.693 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.691+0000 7f6367413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:37.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.691+0000 7f6367413800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.692+0000 7f6367413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:37.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.692+0000 7f6367413800 20 started sync module instance, tier type = 2024-09-12T17:48:37.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.692+0000 7f6367413800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:37.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.701+0000 7f6367413800 20 add_watcher() i=0 2024-09-12T17:48:37.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.701+0000 7f6367413800 20 add_watcher() i=1 2024-09-12T17:48:37.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.701+0000 7f6367413800 20 add_watcher() i=2 2024-09-12T17:48:37.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.701+0000 7f6367413800 20 add_watcher() i=3 2024-09-12T17:48:37.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.701+0000 7f6367413800 20 add_watcher() i=4 2024-09-12T17:48:37.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.701+0000 7f6367413800 20 add_watcher() i=5 2024-09-12T17:48:37.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.701+0000 7f6367413800 20 add_watcher() i=6 2024-09-12T17:48:37.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.703+0000 7f6367413800 20 add_watcher() i=7 2024-09-12T17:48:37.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.703+0000 7f6367413800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:37.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.704+0000 7f62197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:37.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.705+0000 7f6367413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:37.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.705+0000 7f6367413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:37.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.705+0000 7f6367413800 5 note: GC not initialized 2024-09-12T17:48:37.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.705+0000 7f6193fff640 20 reqs_thread_entry: start 2024-09-12T17:48:37.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.705+0000 7f6367413800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:37.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.705+0000 7f6367413800 20 Filter name: none 2024-09-12T17:48:37.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.705+0000 7f6191ffb640 20 reqs_thread_entry: start 2024-09-12T17:48:37.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.705+0000 7f6367413800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:48:37.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.705+0000 7f6367413800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.706+0000 7f6367413800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:37.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.706+0000 7f6367413800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:48:37.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.706+0000 7f6367413800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:48:37.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.706+0000 7f6367413800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:48:37.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.706+0000 7f6367413800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.706+0000 7f6367413800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:48:37.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.706+0000 7f6367413800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:37.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.706+0000 7f6367413800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:37.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.706+0000 7f6367413800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:37.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.706+0000 7f6367413800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:37.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.706+0000 7f6367413800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:48:37.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.710+0000 7f62197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:37.713 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.713+0000 7f6367413800 20 remove_watcher() i=0 2024-09-12T17:48:37.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.713+0000 7f6367413800 2 removed watcher, disabling cache 2024-09-12T17:48:37.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.714+0000 7f6367413800 20 remove_watcher() i=1 2024-09-12T17:48:37.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.715+0000 7f6367413800 20 remove_watcher() i=2 2024-09-12T17:48:37.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.716+0000 7f6367413800 20 remove_watcher() i=3 2024-09-12T17:48:37.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.717+0000 7f6367413800 20 remove_watcher() i=4 2024-09-12T17:48:37.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.718+0000 7f6367413800 20 remove_watcher() i=5 2024-09-12T17:48:37.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.719+0000 7f6367413800 20 remove_watcher() i=6 2024-09-12T17:48:37.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.720+0000 7f6367413800 20 remove_watcher() i=7 2024-09-12T17:48:37.734 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:48:37.763 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:37.764 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:37.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.802+0000 7f87897af800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.804+0000 7f87897af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:37.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.804+0000 7f87897af800 20 realm 2024-09-12T17:48:37.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.804+0000 7f87897af800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.804+0000 7f87897af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:37.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.804+0000 7f87897af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:37.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.804+0000 7f87897af800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.804+0000 7f87897af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:37.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.804+0000 7f87897af800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.805+0000 7f87897af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:37.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.805+0000 7f87897af800 20 rados->read ofs=0 len=0 2024-09-12T17:48:37.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.805+0000 7f87897af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:37.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.805+0000 7f87897af800 20 searching for the correct realm 2024-09-12T17:48:37.809 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.809+0000 7f8787a9a640 0 -- 172.21.15.44:0/1562295793 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f877c07c950 msgr2=0x7f877c057480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:37.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:37.813+0000 7f8787299640 0 -- 172.21.15.44:0/1562295793 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f877c064920 msgr2=0x7f877c07b3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:38.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.020+0000 7f87897af800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:38.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.020+0000 7f87897af800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:38.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.020+0000 7f87897af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:38.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.020+0000 7f87897af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:38.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.020+0000 7f87897af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:38.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.020+0000 7f87897af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:38.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.020+0000 7f87897af800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.020+0000 7f87897af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.020+0000 7f87897af800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.021+0000 7f87897af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:38.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.021+0000 7f87897af800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.021+0000 7f87897af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:38.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.021+0000 7f87897af800 20 zone default found 2024-09-12T17:48:38.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.021+0000 7f87897af800 4 Realm: () 2024-09-12T17:48:38.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.021+0000 7f87897af800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:38.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.021+0000 7f87897af800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:38.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.021+0000 7f87897af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:38.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.021+0000 7f87897af800 20 zonegroup default 2024-09-12T17:48:38.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.021+0000 7f87897af800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.021+0000 7f87897af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.021+0000 7f87897af800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.022+0000 7f87897af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.022+0000 7f87897af800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.022+0000 7f87897af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.023 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.022+0000 7f87897af800 20 started sync module instance, tier type = 2024-09-12T17:48:38.024 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.022+0000 7f87897af800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:38.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.032+0000 7f87897af800 20 add_watcher() i=0 2024-09-12T17:48:38.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.032+0000 7f87897af800 20 add_watcher() i=1 2024-09-12T17:48:38.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.032+0000 7f87897af800 20 add_watcher() i=2 2024-09-12T17:48:38.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.032+0000 7f87897af800 20 add_watcher() i=3 2024-09-12T17:48:38.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.032+0000 7f87897af800 20 add_watcher() i=4 2024-09-12T17:48:38.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.032+0000 7f87897af800 20 add_watcher() i=5 2024-09-12T17:48:38.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.032+0000 7f87897af800 20 add_watcher() i=6 2024-09-12T17:48:38.033 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.033+0000 7f87897af800 20 add_watcher() i=7 2024-09-12T17:48:38.034 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.033+0000 7f87897af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:38.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.035+0000 7f863dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:38.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.035+0000 7f87897af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:38.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.035+0000 7f87897af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:38.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.035+0000 7f87897af800 5 note: GC not initialized 2024-09-12T17:48:38.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.035+0000 7f863cfe1640 20 reqs_thread_entry: start 2024-09-12T17:48:38.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.036+0000 7f87897af800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:38.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.036+0000 7f87897af800 20 Filter name: none 2024-09-12T17:48:38.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.036+0000 7f85b67fc640 20 reqs_thread_entry: start 2024-09-12T17:48:38.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.036+0000 7f87897af800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:48:38.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.036+0000 7f87897af800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.036+0000 7f87897af800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:38.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.036+0000 7f87897af800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:48:38.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.036+0000 7f87897af800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:48:38.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.036+0000 7f87897af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:48:38.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.036+0000 7f87897af800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.037+0000 7f87897af800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:48:38.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.037+0000 7f87897af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:38.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.037+0000 7f87897af800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:38.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.037+0000 7f87897af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:38.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.037+0000 7f87897af800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:38.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.037+0000 7f87897af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:48:38.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.037+0000 7f87897af800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:48:38.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.037+0000 7f87897af800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:48:38.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.037+0000 7f87897af800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:48:38.039 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.037+0000 7f87897af800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:48:38.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.038+0000 7f87897af800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:48:38.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.038+0000 7f87897af800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:48:38.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.038+0000 7f87897af800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:48:38.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.038+0000 7f87897af800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:48:38.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.039+0000 7f87897af800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:48:38.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.039+0000 7f87897af800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:48:38.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.039+0000 7f87897af800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:48:38.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.039+0000 7f87897af800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:48:38.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.039+0000 7f87897af800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:48:38.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.039+0000 7f87897af800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:48:38.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.040+0000 7f87897af800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:48:38.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.040+0000 7f87897af800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:48:38.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.040+0000 7f87897af800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:48:38.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.040+0000 7f87897af800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:48:38.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.041+0000 7f87897af800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:48:38.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.041+0000 7f87897af800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:48:38.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.041+0000 7f87897af800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:48:38.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.041+0000 7f87897af800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:48:38.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.041+0000 7f87897af800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:48:38.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.041+0000 7f87897af800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:48:38.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.042+0000 7f87897af800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:48:38.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.042+0000 7f87897af800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:48:38.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.043+0000 7f863dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:38.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.046+0000 7f87897af800 20 remove_watcher() i=0 2024-09-12T17:48:38.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.046+0000 7f87897af800 2 removed watcher, disabling cache 2024-09-12T17:48:38.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.047+0000 7f87897af800 20 remove_watcher() i=1 2024-09-12T17:48:38.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.048+0000 7f87897af800 20 remove_watcher() i=2 2024-09-12T17:48:38.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.049+0000 7f87897af800 20 remove_watcher() i=3 2024-09-12T17:48:38.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.050+0000 7f87897af800 20 remove_watcher() i=4 2024-09-12T17:48:38.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.051+0000 7f87897af800 20 remove_watcher() i=5 2024-09-12T17:48:38.053 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.052+0000 7f87897af800 20 remove_watcher() i=6 2024-09-12T17:48:38.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.054+0000 7f87897af800 20 remove_watcher() i=7 2024-09-12T17:48:38.065 INFO:tasks.workunit.client.0.smithi044.stderr:check reshard logrecord successfully 2024-09-12T17:48:38.066 INFO:tasks.workunit.client.0.smithi044.stderr: test: reshard versioned bucket 2024-09-12T17:48:38.067 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:48:38.096 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:38.096 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:38.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.135+0000 7faa4eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.137+0000 7faa4eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.138+0000 7faa4eb2e800 20 realm 2024-09-12T17:48:38.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.138+0000 7faa4eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.138+0000 7faa4eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.138+0000 7faa4eb2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:38.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.138+0000 7faa4eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.138+0000 7faa4eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.138+0000 7faa4eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.139+0000 7faa4eb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:38.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.139+0000 7faa4eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.139+0000 7faa4eb2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:38.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.139+0000 7faa4eb2e800 20 searching for the correct realm 2024-09-12T17:48:38.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.141+0000 7faa4a764640 0 -- 172.21.15.44:0/3535362835 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7faa4407c060 msgr2=0x7faa440a7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:38.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.347+0000 7faa4af65640 0 -- 172.21.15.44:0/3535362835 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7faa4006a830 msgr2=0x7faa4008ed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:38.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.353+0000 7faa4eb2e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:38.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.353+0000 7faa4eb2e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:38.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.353+0000 7faa4eb2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:38.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.353+0000 7faa4eb2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:38.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.353+0000 7faa4eb2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:38.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.353+0000 7faa4eb2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:38.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.353+0000 7faa4eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.354+0000 7faa4eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.354+0000 7faa4eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.354+0000 7faa4eb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:38.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.354+0000 7faa4eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.354+0000 7faa4eb2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:38.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.354+0000 7faa4eb2e800 20 zone default found 2024-09-12T17:48:38.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.354+0000 7faa4eb2e800 4 Realm: () 2024-09-12T17:48:38.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.354+0000 7faa4eb2e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:38.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.354+0000 7faa4eb2e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:38.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.354+0000 7faa4eb2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:38.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.354+0000 7faa4eb2e800 20 zonegroup default 2024-09-12T17:48:38.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.354+0000 7faa4eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.355+0000 7faa4eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.355+0000 7faa4eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.355+0000 7faa4eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.355+0000 7faa4eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.355+0000 7faa4eb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.355+0000 7faa4eb2e800 20 started sync module instance, tier type = 2024-09-12T17:48:38.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.355+0000 7faa4eb2e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:38.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.366+0000 7faa4eb2e800 20 add_watcher() i=0 2024-09-12T17:48:38.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.366+0000 7faa4eb2e800 20 add_watcher() i=1 2024-09-12T17:48:38.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.366+0000 7faa4eb2e800 20 add_watcher() i=2 2024-09-12T17:48:38.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.366+0000 7faa4eb2e800 20 add_watcher() i=3 2024-09-12T17:48:38.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.366+0000 7faa4eb2e800 20 add_watcher() i=4 2024-09-12T17:48:38.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.366+0000 7faa4eb2e800 20 add_watcher() i=5 2024-09-12T17:48:38.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.366+0000 7faa4eb2e800 20 add_watcher() i=6 2024-09-12T17:48:38.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.367+0000 7faa4eb2e800 20 add_watcher() i=7 2024-09-12T17:48:38.367 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.367+0000 7faa4eb2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:38.369 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.368+0000 7fa900fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:38.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.369+0000 7faa4eb2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:38.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.369+0000 7faa4eb2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:38.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.369+0000 7faa4eb2e800 5 note: GC not initialized 2024-09-12T17:48:38.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.369+0000 7fa87b7fe640 20 reqs_thread_entry: start 2024-09-12T17:48:38.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.369+0000 7faa4eb2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:38.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.369+0000 7faa4eb2e800 20 Filter name: none 2024-09-12T17:48:38.370 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.369+0000 7fa8797fa640 20 reqs_thread_entry: start 2024-09-12T17:48:38.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.369+0000 7faa4eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.370+0000 7faa4eb2e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:48:38.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.370+0000 7faa4eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.370+0000 7faa4eb2e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:48:38.371 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.370+0000 7faa4eb2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:38.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.370+0000 7faa4eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.371+0000 7faa4eb2e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:48:38.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.371+0000 7faa4eb2e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.371+0000 7faa4eb2e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:48:38.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.371+0000 7faa4eb2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:38.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.373+0000 7fa900fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:38.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.375+0000 7faa4eb2e800 20 remove_watcher() i=0 2024-09-12T17:48:38.376 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.375+0000 7faa4eb2e800 2 removed watcher, disabling cache 2024-09-12T17:48:38.377 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.376+0000 7faa4eb2e800 20 remove_watcher() i=1 2024-09-12T17:48:38.378 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.377+0000 7faa4eb2e800 20 remove_watcher() i=2 2024-09-12T17:48:38.379 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.378+0000 7faa4eb2e800 20 remove_watcher() i=3 2024-09-12T17:48:38.380 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.379+0000 7faa4eb2e800 20 remove_watcher() i=4 2024-09-12T17:48:38.381 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.380+0000 7faa4eb2e800 20 remove_watcher() i=5 2024-09-12T17:48:38.382 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.381+0000 7faa4eb2e800 20 remove_watcher() i=6 2024-09-12T17:48:38.383 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.382+0000 7faa4eb2e800 20 remove_watcher() i=7 2024-09-12T17:48:38.394 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:38.395 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:48:38.395 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: myver id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T17:48:38.395 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:38.396 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-12T17:48:38.427 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:38.427 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:38.467 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.467+0000 7f406fa0f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.469+0000 7f406fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.469+0000 7f406fa0f800 20 realm 2024-09-12T17:48:38.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.469+0000 7f406fa0f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.469+0000 7f406fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.469+0000 7f406fa0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:38.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.469+0000 7f406fa0f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.469+0000 7f406fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.469+0000 7f406fa0f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.470+0000 7f406fa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:38.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.470+0000 7f406fa0f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.470+0000 7f406fa0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:38.471 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.470+0000 7f406fa0f800 20 searching for the correct realm 2024-09-12T17:48:38.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.473+0000 7f406dd01640 0 -- 172.21.15.44:0/2317238698 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f40640b74e0 msgr2=0x7f406407b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:38.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.478+0000 7f406d500640 0 -- 172.21.15.44:0/2317238698 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f40640d00b0 msgr2=0x7f4064054880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:38.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.685+0000 7f406fa0f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:38.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.685+0000 7f406fa0f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:38.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.685+0000 7f406fa0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:38.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.685+0000 7f406fa0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:38.686 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.685+0000 7f406fa0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:38.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.685+0000 7f406fa0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:38.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.685+0000 7f406fa0f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.685+0000 7f406fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.685+0000 7f406fa0f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.686+0000 7f406fa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:38.687 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.686+0000 7f406fa0f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.688 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.686+0000 7f406fa0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:38.688 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.686+0000 7f406fa0f800 20 zone default found 2024-09-12T17:48:38.688 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.686+0000 7f406fa0f800 4 Realm: () 2024-09-12T17:48:38.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.686+0000 7f406fa0f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:38.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.686+0000 7f406fa0f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:38.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.686+0000 7f406fa0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:38.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.686+0000 7f406fa0f800 20 zonegroup default 2024-09-12T17:48:38.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.686+0000 7f406fa0f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.686+0000 7f406fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.686+0000 7f406fa0f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.687+0000 7f406fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.687+0000 7f406fa0f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.687+0000 7f406fa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.687+0000 7f406fa0f800 20 started sync module instance, tier type = 2024-09-12T17:48:38.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.687+0000 7f406fa0f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:38.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.697+0000 7f406fa0f800 20 add_watcher() i=0 2024-09-12T17:48:38.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.697+0000 7f406fa0f800 20 add_watcher() i=1 2024-09-12T17:48:38.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.697+0000 7f406fa0f800 20 add_watcher() i=2 2024-09-12T17:48:38.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.697+0000 7f406fa0f800 20 add_watcher() i=3 2024-09-12T17:48:38.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.697+0000 7f406fa0f800 20 add_watcher() i=4 2024-09-12T17:48:38.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.697+0000 7f406fa0f800 20 add_watcher() i=5 2024-09-12T17:48:38.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.697+0000 7f406fa0f800 20 add_watcher() i=6 2024-09-12T17:48:38.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.698+0000 7f406fa0f800 20 add_watcher() i=7 2024-09-12T17:48:38.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.698+0000 7f406fa0f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:38.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.699+0000 7f3f237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:38.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.700+0000 7f406fa0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:38.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.700+0000 7f406fa0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:38.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.700+0000 7f406fa0f800 5 note: GC not initialized 2024-09-12T17:48:38.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.700+0000 7f3f227e4640 20 reqs_thread_entry: start 2024-09-12T17:48:38.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.700+0000 7f406fa0f800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:38.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.700+0000 7f406fa0f800 20 Filter name: none 2024-09-12T17:48:38.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.700+0000 7f3e93fff640 20 reqs_thread_entry: start 2024-09-12T17:48:38.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.700+0000 7f406fa0f800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:48:38.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.700+0000 7f406fa0f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.701+0000 7f406fa0f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:48:38.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.701+0000 7f406fa0f800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:48:38.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.701+0000 7f406fa0f800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:48:38.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.701+0000 7f406fa0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 : miss 2024-09-12T17:48:38.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.701+0000 7f406fa0f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.701+0000 7f406fa0f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:48:38.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.701+0000 7f406fa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:38.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.701+0000 7f406fa0f800 10 adding default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:38.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.701+0000 7f406fa0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:38.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.701+0000 7f406fa0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:38.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.701+0000 7f406fa0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 2024-09-12T17:48:38.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.707+0000 7f406fa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:38.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.707+0000 7f406fa0f800 10 moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:38.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.707+0000 7f406fa0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:38.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.707+0000 7f406fa0f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19, ofs0, ns] 2024-09-12T17:48:38.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.707+0000 7f3f50ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562449 cookie 94585194065744 notifier 7994 bl.length()=905 2024-09-12T17:48:38.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.707+0000 7f3f50ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:38.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.707+0000 7f3f50ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:38.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.707+0000 7f3f50ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:38.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.708+0000 7f406fa0f800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_sources= new_sources= 2024-09-12T17:48:38.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.708+0000 7f406fa0f800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:48:38.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.708+0000 7f406fa0f800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_dests= new_dests= 2024-09-12T17:48:38.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.708+0000 7f406fa0f800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:48:38.713 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.0 2024-09-12T17:48:38.713 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.0 2024-09-12T17:48:38.713 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.1 2024-09-12T17:48:38.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.1 2024-09-12T17:48:38.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.2 2024-09-12T17:48:38.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.2 2024-09-12T17:48:38.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.3 2024-09-12T17:48:38.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.3 2024-09-12T17:48:38.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.4 2024-09-12T17:48:38.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.4 2024-09-12T17:48:38.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.5 2024-09-12T17:48:38.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.5 2024-09-12T17:48:38.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.6 2024-09-12T17:48:38.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.6 2024-09-12T17:48:38.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.7 2024-09-12T17:48:38.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.7 2024-09-12T17:48:38.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.8 2024-09-12T17:48:38.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.8 2024-09-12T17:48:38.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.9 2024-09-12T17:48:38.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.9 2024-09-12T17:48:38.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.10 2024-09-12T17:48:38.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.10 2024-09-12T17:48:38.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.11 2024-09-12T17:48:38.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.11 2024-09-12T17:48:38.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.712+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.0 2024-09-12T17:48:38.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.713+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1 2024-09-12T17:48:38.716 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.713+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2 2024-09-12T17:48:38.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.714+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3 2024-09-12T17:48:38.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.714+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.4 2024-09-12T17:48:38.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.715+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.5 2024-09-12T17:48:38.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.715+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.6 2024-09-12T17:48:38.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.716+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.7 2024-09-12T17:48:38.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.716+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.8 2024-09-12T17:48:38.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.717+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.9 2024-09-12T17:48:38.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.717+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.10 2024-09-12T17:48:38.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.717+0000 7f406fa0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:38.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.717+0000 7f406fa0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 2024-09-12T17:48:38.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.720+0000 7f406fa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:38.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.720+0000 7f406fa0f800 10 moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:38.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.720+0000 7f406fa0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:38.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.720+0000 7f406fa0f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19, ofs0, ns] 2024-09-12T17:48:38.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.720+0000 7f3f50ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562450 cookie 94585194065744 notifier 7994 bl.length()=905 2024-09-12T17:48:38.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.720+0000 7f3f50ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:38.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.720+0000 7f3f50ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:38.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.720+0000 7f3f50ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:38.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.720+0000 7f406fa0f800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_sources= new_sources= 2024-09-12T17:48:38.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.721+0000 7f406fa0f800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:48:38.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.721+0000 7f406fa0f800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_dests= new_dests= 2024-09-12T17:48:38.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.721+0000 7f406fa0f800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:48:38.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.723+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.0 2024-09-12T17:48:38.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.723+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1 2024-09-12T17:48:38.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.723+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2 2024-09-12T17:48:38.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.724+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3 2024-09-12T17:48:38.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.724+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.4 2024-09-12T17:48:38.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.724+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.5 2024-09-12T17:48:38.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.725+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.6 2024-09-12T17:48:38.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.725+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.7 2024-09-12T17:48:38.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.725+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.8 2024-09-12T17:48:38.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.726+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.9 2024-09-12T17:48:38.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.726+0000 7f406fa0f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.10 2024-09-12T17:48:38.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.726+0000 7f406fa0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:38.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.726+0000 7f406fa0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 2024-09-12T17:48:38.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.727+0000 7f406fa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:38.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.727+0000 7f406fa0f800 10 moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:38.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.727+0000 7f406fa0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:38.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.727+0000 7f406fa0f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19, ofs0, ns] 2024-09-12T17:48:38.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.728+0000 7f3f3ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562451 cookie 94585194065744 notifier 7994 bl.length()=873 2024-09-12T17:48:38.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.728+0000 7f3f3ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:38.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.728+0000 7f3f3ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:38.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.728+0000 7f3f3ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:38.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.728+0000 7f406fa0f800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_sources= new_sources= 2024-09-12T17:48:38.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.728+0000 7f406fa0f800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:48:38.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.728+0000 7f406fa0f800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_dests= new_dests= 2024-09-12T17:48:38.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.728+0000 7f406fa0f800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:48:38.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.730+0000 7f406fa0f800 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-12T17:48:38.733 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.732+0000 7f3f237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:38.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.734+0000 7f406fa0f800 20 remove_watcher() i=0 2024-09-12T17:48:38.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.734+0000 7f406fa0f800 2 removed watcher, disabling cache 2024-09-12T17:48:38.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.735+0000 7f406fa0f800 20 remove_watcher() i=1 2024-09-12T17:48:38.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.736+0000 7f406fa0f800 20 remove_watcher() i=2 2024-09-12T17:48:38.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.737+0000 7f406fa0f800 20 remove_watcher() i=3 2024-09-12T17:48:38.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.739+0000 7f406fa0f800 20 remove_watcher() i=4 2024-09-12T17:48:38.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.740+0000 7f406fa0f800 20 remove_watcher() i=5 2024-09-12T17:48:38.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.740+0000 7f406fa0f800 20 remove_watcher() i=6 2024-09-12T17:48:38.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.742+0000 7f406fa0f800 20 remove_watcher() i=7 2024-09-12T17:48:38.755 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:48:38.784 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:38.784 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:38.823 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.822+0000 7f8216342800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.825 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.824+0000 7f8216342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.824+0000 7f8216342800 20 realm 2024-09-12T17:48:38.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.824+0000 7f8216342800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.825+0000 7f8216342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.825+0000 7f8216342800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:38.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.825+0000 7f8216342800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.825+0000 7f8216342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:38.826 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.825+0000 7f8216342800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.826+0000 7f8216342800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:38.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.826+0000 7f8216342800 20 rados->read ofs=0 len=0 2024-09-12T17:48:38.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.826+0000 7f8216342800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:38.827 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.826+0000 7f8216342800 20 searching for the correct realm 2024-09-12T17:48:38.831 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:38.830+0000 7f8212887640 0 -- 172.21.15.44:0/2068971036 >> [v2:172.21.15.181:6810/2228110208,v1:172.21.15.181:6811/2228110208] conn(0x7f820808a460 msgr2=0x7f820808a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:39.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.036+0000 7f8212086640 0 -- 172.21.15.44:0/2068971036 >> [v2:172.21.15.181:6826/1273321942,v1:172.21.15.181:6827/1273321942] conn(0x56060fbcf2d0 msgr2=0x56060fbd16c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:39.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.039+0000 7f8216342800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:39.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.039+0000 7f8216342800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:39.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.039+0000 7f8216342800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:39.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.039+0000 7f8216342800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:39.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.039+0000 7f8216342800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:39.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.039+0000 7f8216342800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:39.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.039+0000 7f8216342800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.039+0000 7f8216342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:39.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.039+0000 7f8216342800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.040+0000 7f8216342800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:39.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.040+0000 7f8216342800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.040+0000 7f8216342800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:39.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.040+0000 7f8216342800 20 zone default found 2024-09-12T17:48:39.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.040+0000 7f8216342800 4 Realm: () 2024-09-12T17:48:39.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.040+0000 7f8216342800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:39.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.040+0000 7f8216342800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:39.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.040+0000 7f8216342800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:39.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.040+0000 7f8216342800 20 zonegroup default 2024-09-12T17:48:39.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.040+0000 7f8216342800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.040+0000 7f8216342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:39.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.040+0000 7f8216342800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.041+0000 7f8216342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:39.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.041+0000 7f8216342800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.041+0000 7f8216342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:39.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.041+0000 7f8216342800 20 started sync module instance, tier type = 2024-09-12T17:48:39.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.041+0000 7f8216342800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:39.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.051+0000 7f8216342800 20 add_watcher() i=0 2024-09-12T17:48:39.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.051+0000 7f8216342800 20 add_watcher() i=1 2024-09-12T17:48:39.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.051+0000 7f8216342800 20 add_watcher() i=2 2024-09-12T17:48:39.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.051+0000 7f8216342800 20 add_watcher() i=3 2024-09-12T17:48:39.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.051+0000 7f8216342800 20 add_watcher() i=4 2024-09-12T17:48:39.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.051+0000 7f8216342800 20 add_watcher() i=5 2024-09-12T17:48:39.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.051+0000 7f8216342800 20 add_watcher() i=6 2024-09-12T17:48:39.053 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.052+0000 7f8216342800 20 add_watcher() i=7 2024-09-12T17:48:39.053 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.052+0000 7f8216342800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:39.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.054+0000 7f80c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:39.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.054+0000 7f8216342800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:39.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.054+0000 7f8216342800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:39.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.054+0000 7f8216342800 5 note: GC not initialized 2024-09-12T17:48:39.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.054+0000 7f80437fe640 20 reqs_thread_entry: start 2024-09-12T17:48:39.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.054+0000 7f8216342800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:39.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.055+0000 7f8216342800 20 Filter name: none 2024-09-12T17:48:39.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.055+0000 7f80417fa640 20 reqs_thread_entry: start 2024-09-12T17:48:39.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.055+0000 7f8216342800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.055+0000 7f8216342800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:48:39.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.055+0000 7f8216342800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.056+0000 7f8216342800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:48:39.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.056+0000 7f8216342800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:39.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.056+0000 7f8216342800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.056+0000 7f8216342800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:48:39.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.056+0000 7f8216342800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.057+0000 7f8216342800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:48:39.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.057+0000 7f8216342800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:39.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.058+0000 7f80c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:39.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.061+0000 7f8216342800 20 remove_watcher() i=0 2024-09-12T17:48:39.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.061+0000 7f8216342800 2 removed watcher, disabling cache 2024-09-12T17:48:39.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.062+0000 7f8216342800 20 remove_watcher() i=1 2024-09-12T17:48:39.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.063+0000 7f8216342800 20 remove_watcher() i=2 2024-09-12T17:48:39.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.064+0000 7f8216342800 20 remove_watcher() i=3 2024-09-12T17:48:39.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.065+0000 7f8216342800 20 remove_watcher() i=4 2024-09-12T17:48:39.067 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.066+0000 7f8216342800 20 remove_watcher() i=5 2024-09-12T17:48:39.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.067+0000 7f8216342800 20 remove_watcher() i=6 2024-09-12T17:48:39.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.068+0000 7f8216342800 20 remove_watcher() i=7 2024-09-12T17:48:39.079 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:39.080 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:48:39.080 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: myver id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T17:48:39.080 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:39.127 INFO:tasks.workunit.client.0.smithi044.stderr: test: reshard removes olh entries with empty name 2024-09-12T17:48:39.220 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:48:39.249 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:39.249 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:39.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.287+0000 7fc57c975800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.289+0000 7fc57c975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:39.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.289+0000 7fc57c975800 20 realm 2024-09-12T17:48:39.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.289+0000 7fc57c975800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.289+0000 7fc57c975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:39.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.289+0000 7fc57c975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:39.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.289+0000 7fc57c975800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.289+0000 7fc57c975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:39.290 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.289+0000 7fc57c975800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.290+0000 7fc57c975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:39.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.290+0000 7fc57c975800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.291+0000 7fc57c975800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:39.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.291+0000 7fc57c975800 20 searching for the correct realm 2024-09-12T17:48:39.294 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.294+0000 7fc57ac67640 0 -- 172.21.15.44:0/1021865316 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7fc570068f30 msgr2=0x7fc5700679a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:39.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.497+0000 7fc57a466640 0 -- 172.21.15.44:0/1021865316 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fc570071a20 msgr2=0x7fc57000d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:39.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.704+0000 7fc57c975800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:39.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.704+0000 7fc57c975800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:39.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.704+0000 7fc57c975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:39.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.704+0000 7fc57c975800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:39.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.704+0000 7fc57c975800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:39.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.704+0000 7fc57c975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:39.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.704+0000 7fc57c975800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.704+0000 7fc57c975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:39.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.704+0000 7fc57c975800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.705+0000 7fc57c975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:39.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.705+0000 7fc57c975800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.706+0000 7fc57c975800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:39.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.706+0000 7fc57c975800 20 zone default found 2024-09-12T17:48:39.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.706+0000 7fc57c975800 4 Realm: () 2024-09-12T17:48:39.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.706+0000 7fc57c975800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:39.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.706+0000 7fc57c975800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:39.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.706+0000 7fc57c975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:39.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.706+0000 7fc57c975800 20 zonegroup default 2024-09-12T17:48:39.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.706+0000 7fc57c975800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.706+0000 7fc57c975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:39.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.706+0000 7fc57c975800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.706+0000 7fc57c975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:39.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.706+0000 7fc57c975800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.707+0000 7fc57c975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:39.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.707+0000 7fc57c975800 20 started sync module instance, tier type = 2024-09-12T17:48:39.708 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.707+0000 7fc57c975800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:39.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.717+0000 7fc57c975800 20 add_watcher() i=0 2024-09-12T17:48:39.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.717+0000 7fc57c975800 20 add_watcher() i=1 2024-09-12T17:48:39.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.717+0000 7fc57c975800 20 add_watcher() i=2 2024-09-12T17:48:39.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.717+0000 7fc57c975800 20 add_watcher() i=3 2024-09-12T17:48:39.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.717+0000 7fc57c975800 20 add_watcher() i=4 2024-09-12T17:48:39.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.717+0000 7fc57c975800 20 add_watcher() i=5 2024-09-12T17:48:39.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.717+0000 7fc57c975800 20 add_watcher() i=6 2024-09-12T17:48:39.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.718+0000 7fc57c975800 20 add_watcher() i=7 2024-09-12T17:48:39.718 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.718+0000 7fc57c975800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:39.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.719+0000 7fc430fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:39.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.720+0000 7fc57c975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:39.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.720+0000 7fc57c975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:39.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.720+0000 7fc57c975800 5 note: GC not initialized 2024-09-12T17:48:39.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.720+0000 7fc3ab7fe640 20 reqs_thread_entry: start 2024-09-12T17:48:39.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.720+0000 7fc57c975800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:39.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.720+0000 7fc57c975800 20 Filter name: none 2024-09-12T17:48:39.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.720+0000 7fc3a97fa640 20 reqs_thread_entry: start 2024-09-12T17:48:39.721 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.720+0000 7fc57c975800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.721+0000 7fc57c975800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:39.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.721+0000 7fc57c975800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.722+0000 7fc57c975800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:48:39.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.722+0000 7fc57c975800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:39.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.722+0000 7fc57c975800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.722+0000 7fc57c975800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:39.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.722+0000 7fc57c975800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.723+0000 7fc57c975800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:48:39.723 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.723+0000 7fc57c975800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:39.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.726+0000 7fc430fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:39.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.728+0000 7fc57c975800 20 remove_watcher() i=0 2024-09-12T17:48:39.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.728+0000 7fc57c975800 2 removed watcher, disabling cache 2024-09-12T17:48:39.729 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.729+0000 7fc57c975800 20 remove_watcher() i=1 2024-09-12T17:48:39.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.730+0000 7fc57c975800 20 remove_watcher() i=2 2024-09-12T17:48:39.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.731+0000 7fc57c975800 20 remove_watcher() i=3 2024-09-12T17:48:39.733 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.732+0000 7fc57c975800 20 remove_watcher() i=4 2024-09-12T17:48:39.734 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.733+0000 7fc57c975800 20 remove_watcher() i=5 2024-09-12T17:48:39.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.734+0000 7fc57c975800 20 remove_watcher() i=6 2024-09-12T17:48:39.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.735+0000 7fc57c975800 20 remove_watcher() i=7 2024-09-12T17:48:39.747 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:39.747 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:48:39.747 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: a-bucket id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-12T17:48:39.747 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:39.748 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T17:48:39.778 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:39.778 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:39.818 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.817+0000 7f8619013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.819+0000 7f8619013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:39.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.819+0000 7f8619013800 20 realm 2024-09-12T17:48:39.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.819+0000 7f8619013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.819+0000 7f8619013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:39.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.819+0000 7f8619013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:39.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.819+0000 7f8619013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.819+0000 7f8619013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:39.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.819+0000 7f8619013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.820+0000 7f8619013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:39.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.820+0000 7f8619013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:39.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.821+0000 7f8619013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:39.821 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.821+0000 7f8619013800 20 searching for the correct realm 2024-09-12T17:48:39.823 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:39.822+0000 7f8614748640 0 -- 172.21.15.44:0/2174018213 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x55b4a080edd0 msgr2=0x7f860c014970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:40.029 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.029+0000 7f8614f49640 0 -- 172.21.15.44:0/2174018213 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f86080ae070 msgr2=0x7f86080aae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:40.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.034+0000 7f8619013800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:40.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.034+0000 7f8619013800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:40.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.034+0000 7f8619013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:40.035 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.034+0000 7f8619013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:40.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.034+0000 7f8619013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:40.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.034+0000 7f8619013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:40.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.034+0000 7f8619013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.035+0000 7f8619013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.036 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.035+0000 7f8619013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.035+0000 7f8619013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:40.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.035+0000 7f8619013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.035+0000 7f8619013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:40.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.035+0000 7f8619013800 20 zone default found 2024-09-12T17:48:40.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.035+0000 7f8619013800 4 Realm: () 2024-09-12T17:48:40.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.035+0000 7f8619013800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:40.037 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.035+0000 7f8619013800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:40.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.035+0000 7f8619013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:40.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.035+0000 7f8619013800 20 zonegroup default 2024-09-12T17:48:40.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.035+0000 7f8619013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.036+0000 7f8619013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.036+0000 7f8619013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.036+0000 7f8619013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.036+0000 7f8619013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.036+0000 7f8619013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.036+0000 7f8619013800 20 started sync module instance, tier type = 2024-09-12T17:48:40.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.036+0000 7f8619013800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:40.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.046+0000 7f8619013800 20 add_watcher() i=0 2024-09-12T17:48:40.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.046+0000 7f8619013800 20 add_watcher() i=1 2024-09-12T17:48:40.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.046+0000 7f8619013800 20 add_watcher() i=2 2024-09-12T17:48:40.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.046+0000 7f8619013800 20 add_watcher() i=3 2024-09-12T17:48:40.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.046+0000 7f8619013800 20 add_watcher() i=4 2024-09-12T17:48:40.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.046+0000 7f8619013800 20 add_watcher() i=5 2024-09-12T17:48:40.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.046+0000 7f8619013800 20 add_watcher() i=6 2024-09-12T17:48:40.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.047+0000 7f8619013800 20 add_watcher() i=7 2024-09-12T17:48:40.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.047+0000 7f8619013800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:40.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.048+0000 7f84cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:40.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.049+0000 7f8619013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:40.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.049+0000 7f8619013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:40.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.049+0000 7f8619013800 5 note: GC not initialized 2024-09-12T17:48:40.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.049+0000 7f84c9fdb640 20 reqs_thread_entry: start 2024-09-12T17:48:40.050 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.049+0000 7f8619013800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:40.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.049+0000 7f8619013800 20 Filter name: none 2024-09-12T17:48:40.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.049+0000 7f843b7fe640 20 reqs_thread_entry: start 2024-09-12T17:48:40.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.049+0000 7f8619013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.050+0000 7f8619013800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:40.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.050+0000 7f8619013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.050+0000 7f8619013800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:48:40.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.050+0000 7f8619013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:40.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.051+0000 7f84cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:40.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.053+0000 7f8619013800 20 remove_watcher() i=0 2024-09-12T17:48:40.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.053+0000 7f8619013800 2 removed watcher, disabling cache 2024-09-12T17:48:40.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.054+0000 7f8619013800 20 remove_watcher() i=1 2024-09-12T17:48:40.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.055+0000 7f8619013800 20 remove_watcher() i=2 2024-09-12T17:48:40.057 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.056+0000 7f8619013800 20 remove_watcher() i=3 2024-09-12T17:48:40.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.057+0000 7f8619013800 20 remove_watcher() i=4 2024-09-12T17:48:40.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.058+0000 7f8619013800 20 remove_watcher() i=5 2024-09-12T17:48:40.060 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.059+0000 7f8619013800 20 remove_watcher() i=6 2024-09-12T17:48:40.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.060+0000 7f8619013800 20 remove_watcher() i=7 2024-09-12T17:48:40.074 INFO:tasks.workunit.client.0.smithi044.stderr:rados -p default.rgw.buckets.index setomapval .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T17:48:40.100 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:40.101 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:40.117 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T17:48:40.146 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:40.146 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:40.185 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.185+0000 7f7adc40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.186+0000 7f7adc40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.186+0000 7f7adc40e800 20 realm 2024-09-12T17:48:40.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.186+0000 7f7adc40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.187 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.187+0000 7f7adc40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.187+0000 7f7adc40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:40.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.187+0000 7f7adc40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.187+0000 7f7adc40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.188 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.187+0000 7f7adc40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.188+0000 7f7adc40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:40.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.188+0000 7f7adc40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.188+0000 7f7adc40e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:40.189 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.188+0000 7f7adc40e800 20 searching for the correct realm 2024-09-12T17:48:40.191 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.191+0000 7f7ad73df640 0 -- 172.21.15.44:0/874399941 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f7ac80093c0 msgr2=0x7f7ac8007c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:40.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.195+0000 7f7ad7be0640 0 -- 172.21.15.44:0/874399941 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f7acc07d1b0 msgr2=0x7f7acc081140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:40.403 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.401+0000 7f7adc40e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:40.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.401+0000 7f7adc40e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:40.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.401+0000 7f7adc40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:40.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.401+0000 7f7adc40e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:40.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.401+0000 7f7adc40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:40.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.401+0000 7f7adc40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:40.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.401+0000 7f7adc40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.402+0000 7f7adc40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.402+0000 7f7adc40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.402+0000 7f7adc40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:40.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.402+0000 7f7adc40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.402+0000 7f7adc40e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:40.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.402+0000 7f7adc40e800 20 zone default found 2024-09-12T17:48:40.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.402+0000 7f7adc40e800 4 Realm: () 2024-09-12T17:48:40.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.402+0000 7f7adc40e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:40.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.402+0000 7f7adc40e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:40.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.402+0000 7f7adc40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:40.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.402+0000 7f7adc40e800 20 zonegroup default 2024-09-12T17:48:40.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.402+0000 7f7adc40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.403+0000 7f7adc40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.403+0000 7f7adc40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.403+0000 7f7adc40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.403+0000 7f7adc40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.403+0000 7f7adc40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.403+0000 7f7adc40e800 20 started sync module instance, tier type = 2024-09-12T17:48:40.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.403+0000 7f7adc40e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:40.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.413+0000 7f7adc40e800 20 add_watcher() i=0 2024-09-12T17:48:40.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.413+0000 7f7adc40e800 20 add_watcher() i=1 2024-09-12T17:48:40.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.413+0000 7f7adc40e800 20 add_watcher() i=2 2024-09-12T17:48:40.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.413+0000 7f7adc40e800 20 add_watcher() i=3 2024-09-12T17:48:40.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.413+0000 7f7adc40e800 20 add_watcher() i=4 2024-09-12T17:48:40.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.413+0000 7f7adc40e800 20 add_watcher() i=5 2024-09-12T17:48:40.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.413+0000 7f7adc40e800 20 add_watcher() i=6 2024-09-12T17:48:40.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.414+0000 7f7adc40e800 20 add_watcher() i=7 2024-09-12T17:48:40.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.414+0000 7f7adc40e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:40.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.416+0000 7f798dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:40.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.416+0000 7f7adc40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:40.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.416+0000 7f7adc40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:40.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.416+0000 7f7adc40e800 5 note: GC not initialized 2024-09-12T17:48:40.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.416+0000 7f798cfe1640 20 reqs_thread_entry: start 2024-09-12T17:48:40.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.416+0000 7f7adc40e800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:40.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.416+0000 7f7adc40e800 20 Filter name: none 2024-09-12T17:48:40.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.417+0000 7f79067fc640 20 reqs_thread_entry: start 2024-09-12T17:48:40.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.417+0000 7f7adc40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.417+0000 7f7adc40e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:40.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.417+0000 7f7adc40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.418+0000 7f7adc40e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:48:40.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.418+0000 7f7adc40e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:40.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.418+0000 7f7adc40e800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T17:48:40.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.418+0000 7f7adc40e800 20 INFO: main: starting shard=0 2024-09-12T17:48:40.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.418+0000 7f7adc40e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:48:40.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.418+0000 7f7adc40e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:48:40.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.418+0000 7f7adc40e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:48:40.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.418+0000 7f7adc40e800 20 INFO: main: starting shard=1 2024-09-12T17:48:40.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.418+0000 7f7adc40e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:48:40.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.418+0000 7f7adc40e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:48:40.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.419+0000 7f7adc40e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:40.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.419+0000 7f7adc40e800 20 INFO: main: starting shard=2 2024-09-12T17:48:40.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.419+0000 7f7adc40e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:48:40.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.419+0000 7f7adc40e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:48:40.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.420+0000 7f7adc40e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:40.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.420+0000 7f7adc40e800 20 INFO: main: starting shard=3 2024-09-12T17:48:40.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.420+0000 7f7adc40e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:48:40.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.420+0000 7f7adc40e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:48:40.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.421+0000 7f7adc40e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:40.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.421+0000 7f7adc40e800 20 INFO: main: starting shard=4 2024-09-12T17:48:40.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.421+0000 7f7adc40e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:48:40.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.421+0000 7f7adc40e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:48:40.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.421+0000 7f7adc40e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:40.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.421+0000 7f7adc40e800 20 INFO: main: starting shard=5 2024-09-12T17:48:40.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.421+0000 7f7adc40e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:48:40.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.421+0000 7f7adc40e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:48:40.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.422+0000 7f7adc40e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:40.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.422+0000 7f7adc40e800 20 INFO: main: starting shard=6 2024-09-12T17:48:40.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.422+0000 7f7adc40e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:48:40.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.422+0000 7f7adc40e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:48:40.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.422+0000 7f7adc40e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:40.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.422+0000 7f7adc40e800 20 INFO: main: starting shard=7 2024-09-12T17:48:40.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.422+0000 7f7adc40e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:48:40.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.422+0000 7f7adc40e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:48:40.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.423+0000 7f7adc40e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:40.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.423+0000 7f7adc40e800 20 INFO: main: starting shard=8 2024-09-12T17:48:40.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.423+0000 7f7adc40e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:48:40.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.423+0000 7f7adc40e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:48:40.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.424+0000 7f7adc40e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:40.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.424+0000 7f7adc40e800 20 INFO: main: starting shard=9 2024-09-12T17:48:40.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.424+0000 7f7adc40e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:48:40.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.424+0000 7f7adc40e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:48:40.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.424+0000 7f7adc40e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:40.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.424+0000 7f7adc40e800 20 INFO: main: starting shard=10 2024-09-12T17:48:40.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.424+0000 7f7adc40e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:48:40.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.424+0000 7f7adc40e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:48:40.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.425+0000 7f7adc40e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:40.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.425+0000 7f7adc40e800 20 INFO: main: starting shard=11 2024-09-12T17:48:40.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.425+0000 7f7adc40e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:48:40.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.425+0000 7f7adc40e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:48:40.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.425+0000 7f7adc40e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:40.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.425+0000 7f7adc40e800 20 INFO: main: starting shard=12 2024-09-12T17:48:40.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.425+0000 7f7adc40e800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:48:40.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.425+0000 7f7adc40e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:48:40.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.426+0000 7f7adc40e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:40.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.426+0000 7f7adc40e800 20 INFO: main: done 2024-09-12T17:48:40.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.427+0000 7f798dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:40.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.430+0000 7f7adc40e800 20 remove_watcher() i=0 2024-09-12T17:48:40.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.430+0000 7f7adc40e800 2 removed watcher, disabling cache 2024-09-12T17:48:40.431 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.431+0000 7f7adc40e800 20 remove_watcher() i=1 2024-09-12T17:48:40.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.432+0000 7f7adc40e800 20 remove_watcher() i=2 2024-09-12T17:48:40.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.433+0000 7f7adc40e800 20 remove_watcher() i=3 2024-09-12T17:48:40.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.434+0000 7f7adc40e800 20 remove_watcher() i=4 2024-09-12T17:48:40.435 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.435+0000 7f7adc40e800 20 remove_watcher() i=5 2024-09-12T17:48:40.436 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.436+0000 7f7adc40e800 20 remove_watcher() i=6 2024-09-12T17:48:40.438 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.437+0000 7f7adc40e800 20 remove_watcher() i=7 2024-09-12T17:48:40.450 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T17:48:40.482 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:40.482 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:40.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.521+0000 7feac3e13800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.522+0000 7feac3e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.522+0000 7feac3e13800 20 realm 2024-09-12T17:48:40.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.522+0000 7feac3e13800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.523+0000 7feac3e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.523+0000 7feac3e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:40.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.523+0000 7feac3e13800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.523+0000 7feac3e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.523+0000 7feac3e13800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.524+0000 7feac3e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:40.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.524+0000 7feac3e13800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.524+0000 7feac3e13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:40.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.524+0000 7feac3e13800 20 searching for the correct realm 2024-09-12T17:48:40.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.526+0000 7feabed47640 0 -- 172.21.15.44:0/648147854 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7feab0029070 msgr2=0x7feab0078930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:40.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.531+0000 7feabf548640 0 -- 172.21.15.44:0/648147854 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7feab40b30a0 msgr2=0x7feab40b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:40.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.737+0000 7feac3e13800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:40.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.737+0000 7feac3e13800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:40.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.737+0000 7feac3e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:40.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.737+0000 7feac3e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:40.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.737+0000 7feac3e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:40.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.737+0000 7feac3e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:40.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.737+0000 7feac3e13800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.737+0000 7feac3e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.738+0000 7feac3e13800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.738+0000 7feac3e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:40.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.738+0000 7feac3e13800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.738+0000 7feac3e13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:40.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.738+0000 7feac3e13800 20 zone default found 2024-09-12T17:48:40.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.738+0000 7feac3e13800 4 Realm: () 2024-09-12T17:48:40.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.738+0000 7feac3e13800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:40.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.738+0000 7feac3e13800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:40.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.738+0000 7feac3e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:40.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.738+0000 7feac3e13800 20 zonegroup default 2024-09-12T17:48:40.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.738+0000 7feac3e13800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.739+0000 7feac3e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.739+0000 7feac3e13800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.739+0000 7feac3e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.739+0000 7feac3e13800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.740+0000 7feac3e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.740+0000 7feac3e13800 20 started sync module instance, tier type = 2024-09-12T17:48:40.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.740+0000 7feac3e13800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:40.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.749+0000 7feac3e13800 20 add_watcher() i=0 2024-09-12T17:48:40.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.749+0000 7feac3e13800 20 add_watcher() i=1 2024-09-12T17:48:40.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.749+0000 7feac3e13800 20 add_watcher() i=2 2024-09-12T17:48:40.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.749+0000 7feac3e13800 20 add_watcher() i=3 2024-09-12T17:48:40.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.749+0000 7feac3e13800 20 add_watcher() i=4 2024-09-12T17:48:40.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.749+0000 7feac3e13800 20 add_watcher() i=5 2024-09-12T17:48:40.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.749+0000 7feac3e13800 20 add_watcher() i=6 2024-09-12T17:48:40.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.750+0000 7feac3e13800 20 add_watcher() i=7 2024-09-12T17:48:40.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.750+0000 7feac3e13800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:40.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.751+0000 7fe975fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:40.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.752+0000 7feac3e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:40.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.752+0000 7feac3e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:40.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.752+0000 7feac3e13800 5 note: GC not initialized 2024-09-12T17:48:40.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.752+0000 7fe974fe1640 20 reqs_thread_entry: start 2024-09-12T17:48:40.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.752+0000 7feac3e13800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:40.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.752+0000 7feac3e13800 20 Filter name: none 2024-09-12T17:48:40.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.752+0000 7fe8ee7fc640 20 reqs_thread_entry: start 2024-09-12T17:48:40.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.753+0000 7feac3e13800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:48:40.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.753+0000 7feac3e13800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.753+0000 7feac3e13800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:40.754 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.753+0000 7feac3e13800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:48:40.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.753+0000 7feac3e13800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:48:40.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.753+0000 7feac3e13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : miss 2024-09-12T17:48:40.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.753+0000 7feac3e13800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.753+0000 7feac3e13800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:48:40.755 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.753+0000 7feac3e13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:40.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.753+0000 7feac3e13800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:40.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.753+0000 7feac3e13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:40.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.753+0000 7feac3e13800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:40.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.753+0000 7feac3e13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:48:40.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.757+0000 7feac3e13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:40.758 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.757+0000 7feac3e13800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:40.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.757+0000 7feac3e13800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:40.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.757+0000 7feac3e13800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:48:40.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.758+0000 7fe9a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562468 cookie 94633686946128 notifier 8087 bl.length()=911 2024-09-12T17:48:40.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.758+0000 7fe9a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:40.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.758+0000 7fe9a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:40.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.758+0000 7fe9a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:40.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.758+0000 7feac3e13800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:48:40.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.758+0000 7feac3e13800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:48:40.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.758+0000 7feac3e13800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:48:40.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.758+0000 7feac3e13800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:48:40.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.764+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.0 2024-09-12T17:48:40.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.764+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.0 2024-09-12T17:48:40.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.764+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:48:40.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.764+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:48:40.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.765+0000 7feac3e13800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T17:48:40.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.765+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:48:40.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.765+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:48:40.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.765+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:48:40.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.765+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:48:40.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.766+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:48:40.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.766+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:48:40.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.766+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:48:40.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.766+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:48:40.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.767+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:48:40.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.767+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:48:40.767 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.767+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:48:40.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.767+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:48:40.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.767+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:48:40.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.767+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:48:40.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.768+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:48:40.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.768+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:48:40.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.768+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:48:40.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.768+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:48:40.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.769+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:48:40.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.769+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:48:40.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.770+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:48:40.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.770+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:48:40.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.770+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:48:40.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.770+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:48:40.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.771+0000 7feac3e13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:40.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.771+0000 7feac3e13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:48:40.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.772+0000 7feac3e13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:40.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.772+0000 7feac3e13800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:40.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.772+0000 7feac3e13800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:40.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.772+0000 7feac3e13800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:48:40.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.773+0000 7fe9a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562469 cookie 94633686946128 notifier 8087 bl.length()=911 2024-09-12T17:48:40.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.773+0000 7fe9a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:40.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.773+0000 7fe9a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:40.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.773+0000 7fe9a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:40.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.773+0000 7feac3e13800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:48:40.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.773+0000 7feac3e13800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:48:40.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.773+0000 7feac3e13800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:48:40.774 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.773+0000 7feac3e13800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:48:40.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.778+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:48:40.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.778+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.0 2024-09-12T17:48:40.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.779+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:48:40.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.779+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.1 2024-09-12T17:48:40.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.779+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:48:40.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.779+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.2 2024-09-12T17:48:40.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.780+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:48:40.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.780+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.3 2024-09-12T17:48:40.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.780+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:48:40.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.780+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.4 2024-09-12T17:48:40.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.781+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:48:40.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.781+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.5 2024-09-12T17:48:40.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.781+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:48:40.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.781+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.6 2024-09-12T17:48:40.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.781+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:48:40.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.781+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.7 2024-09-12T17:48:40.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.782+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:48:40.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.782+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.8 2024-09-12T17:48:40.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.782+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:48:40.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.782+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.9 2024-09-12T17:48:40.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.782+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:48:40.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.782+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.10 2024-09-12T17:48:40.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.783+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:48:40.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.783+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.11 2024-09-12T17:48:40.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.783+0000 7feac3e13800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:48:40.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.783+0000 7feac3e13800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.2.12 2024-09-12T17:48:40.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.783+0000 7feac3e13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:40.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.783+0000 7feac3e13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 2024-09-12T17:48:40.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.785+0000 7feac3e13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:40.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.785+0000 7feac3e13800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:40.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.785+0000 7feac3e13800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:40.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.785+0000 7feac3e13800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18, ofs0, ns] 2024-09-12T17:48:40.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.785+0000 7fe9a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562470 cookie 94633686946128 notifier 8087 bl.length()=879 2024-09-12T17:48:40.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.785+0000 7fe9a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 info.flags=0x17 2024-09-12T17:48:40.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.785+0000 7fe9a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18 to cache LRU end 2024-09-12T17:48:40.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.785+0000 7fe9a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:40.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.785+0000 7feac3e13800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_sources= new_sources= 2024-09-12T17:48:40.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.785+0000 7feac3e13800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential sources added=[] removed=[] 2024-09-12T17:48:40.786 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.785+0000 7feac3e13800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): orig_dests= new_dests= 2024-09-12T17:48:40.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.785+0000 7feac3e13800 20 handle_bi_update(): bucket=:a-bucket[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18]): potential dests added=[] removed=[] 2024-09-12T17:48:40.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.788+0000 7feac3e13800 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-12T17:48:40.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.790+0000 7fe975fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:40.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.792+0000 7feac3e13800 20 remove_watcher() i=0 2024-09-12T17:48:40.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.792+0000 7feac3e13800 2 removed watcher, disabling cache 2024-09-12T17:48:40.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.793+0000 7feac3e13800 20 remove_watcher() i=1 2024-09-12T17:48:40.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.794+0000 7feac3e13800 20 remove_watcher() i=2 2024-09-12T17:48:40.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.795+0000 7feac3e13800 20 remove_watcher() i=3 2024-09-12T17:48:40.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.796+0000 7feac3e13800 20 remove_watcher() i=4 2024-09-12T17:48:40.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.797+0000 7feac3e13800 20 remove_watcher() i=5 2024-09-12T17:48:40.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.798+0000 7feac3e13800 20 remove_watcher() i=6 2024-09-12T17:48:40.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.799+0000 7feac3e13800 20 remove_watcher() i=7 2024-09-12T17:48:40.812 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T17:48:40.841 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:40.841 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:40.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.880+0000 7f134d32d800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.882+0000 7f134d32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.882+0000 7f134d32d800 20 realm 2024-09-12T17:48:40.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.882+0000 7f134d32d800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.882+0000 7f134d32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.882+0000 7f134d32d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:40.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.882+0000 7f134d32d800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.882+0000 7f134d32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.882+0000 7f134d32d800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.883+0000 7f134d32d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:40.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.883+0000 7f134d32d800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.883+0000 7f134d32d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:40.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.883+0000 7f134d32d800 20 searching for the correct realm 2024-09-12T17:48:40.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:40.885+0000 7f1349076640 0 -- 172.21.15.44:0/2002575944 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x564397255450 msgr2=0x7f1344015900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:41.091 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.090+0000 7f1349877640 0 -- 172.21.15.44:0/2002575944 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f133406dad0 msgr2=0x7f1334066e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:41.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.096+0000 7f134d32d800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:41.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.096+0000 7f134d32d800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:41.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.096+0000 7f134d32d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:41.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.096+0000 7f134d32d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:41.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.096+0000 7f134d32d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:41.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.096+0000 7f134d32d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:41.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.096+0000 7f134d32d800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.096+0000 7f134d32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.097 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.096+0000 7f134d32d800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.098 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.097+0000 7f134d32d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.097+0000 7f134d32d800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.097+0000 7f134d32d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.097+0000 7f134d32d800 20 zone default found 2024-09-12T17:48:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.097+0000 7f134d32d800 4 Realm: () 2024-09-12T17:48:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.097+0000 7f134d32d800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.097+0000 7f134d32d800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.097+0000 7f134d32d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.097+0000 7f134d32d800 20 zonegroup default 2024-09-12T17:48:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.097+0000 7f134d32d800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.097+0000 7f134d32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.097+0000 7f134d32d800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.098+0000 7f134d32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.099 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.098+0000 7f134d32d800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.098+0000 7f134d32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.098+0000 7f134d32d800 20 started sync module instance, tier type = 2024-09-12T17:48:41.100 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.098+0000 7f134d32d800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:41.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.107+0000 7f134d32d800 20 add_watcher() i=0 2024-09-12T17:48:41.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.107+0000 7f134d32d800 20 add_watcher() i=1 2024-09-12T17:48:41.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.107+0000 7f134d32d800 20 add_watcher() i=2 2024-09-12T17:48:41.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.107+0000 7f134d32d800 20 add_watcher() i=3 2024-09-12T17:48:41.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.107+0000 7f134d32d800 20 add_watcher() i=4 2024-09-12T17:48:41.108 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.107+0000 7f134d32d800 20 add_watcher() i=5 2024-09-12T17:48:41.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.107+0000 7f134d32d800 20 add_watcher() i=6 2024-09-12T17:48:41.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.108+0000 7f134d32d800 20 add_watcher() i=7 2024-09-12T17:48:41.109 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.108+0000 7f134d32d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:41.110 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.110+0000 7f11ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:41.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.110+0000 7f134d32d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:41.111 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.110+0000 7f134d32d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:41.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.110+0000 7f134d32d800 5 note: GC not initialized 2024-09-12T17:48:41.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.110+0000 7f11fe7e4640 20 reqs_thread_entry: start 2024-09-12T17:48:41.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.111+0000 7f134d32d800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:41.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.111+0000 7f134d32d800 20 Filter name: none 2024-09-12T17:48:41.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.111+0000 7f116ffff640 20 reqs_thread_entry: start 2024-09-12T17:48:41.112 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.111+0000 7f134d32d800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.111+0000 7f134d32d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:41.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.111+0000 7f134d32d800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.112+0000 7f134d32d800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:48:41.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.112+0000 7f134d32d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:41.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.112+0000 7f134d32d800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T17:48:41.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.112+0000 7f134d32d800 20 INFO: main: starting shard=0 2024-09-12T17:48:41.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.112+0000 7f134d32d800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.0 2024-09-12T17:48:41.113 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.112+0000 7f134d32d800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18.3.0 2024-09-12T17:48:41.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.112+0000 7f134d32d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:41.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.112+0000 7f134d32d800 20 INFO: main: done 2024-09-12T17:48:41.114 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.113+0000 7f11ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:41.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.115+0000 7f134d32d800 20 remove_watcher() i=0 2024-09-12T17:48:41.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.115+0000 7f134d32d800 2 removed watcher, disabling cache 2024-09-12T17:48:41.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.116+0000 7f134d32d800 20 remove_watcher() i=1 2024-09-12T17:48:41.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.117+0000 7f134d32d800 20 remove_watcher() i=2 2024-09-12T17:48:41.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.118+0000 7f134d32d800 20 remove_watcher() i=3 2024-09-12T17:48:41.120 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.119+0000 7f134d32d800 20 remove_watcher() i=4 2024-09-12T17:48:41.121 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.120+0000 7f134d32d800 20 remove_watcher() i=5 2024-09-12T17:48:41.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.121+0000 7f134d32d800 20 remove_watcher() i=6 2024-09-12T17:48:41.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.122+0000 7f134d32d800 20 remove_watcher() i=7 2024-09-12T17:48:41.134 INFO:tasks.workunit.client.0.smithi044.stderr: test: PUT succeeds during reshard 2024-09-12T17:48:41.136 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:48:41.165 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:41.165 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:41.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.204+0000 7f72ee519800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.205+0000 7f72ee519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.205+0000 7f72ee519800 20 realm 2024-09-12T17:48:41.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.205+0000 7f72ee519800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.206+0000 7f72ee519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.206+0000 7f72ee519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:41.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.206+0000 7f72ee519800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.206+0000 7f72ee519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.206+0000 7f72ee519800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.207+0000 7f72ee519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:41.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.207+0000 7f72ee519800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.207+0000 7f72ee519800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:41.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.207+0000 7f72ee519800 20 searching for the correct realm 2024-09-12T17:48:41.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.210+0000 7f72e3fff640 0 -- 172.21.15.44:0/2458586196 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x564650465fd0 msgr2=0x5646504683c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:41.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.214+0000 7f72ec003640 0 -- 172.21.15.44:0/2458586196 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f72d404d4b0 msgr2=0x7f72d4055f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:41.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:41.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:41.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:41.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:41.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:41.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:41.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:41.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:41.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 20 zone default found 2024-09-12T17:48:41.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 4 Realm: () 2024-09-12T17:48:41.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:41.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:41.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:41.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 20 zonegroup default 2024-09-12T17:48:41.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.218+0000 7f72ee519800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.219+0000 7f72ee519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.219+0000 7f72ee519800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.219+0000 7f72ee519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.219+0000 7f72ee519800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.219+0000 7f72ee519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.219+0000 7f72ee519800 20 started sync module instance, tier type = 2024-09-12T17:48:41.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.219+0000 7f72ee519800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:41.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.228+0000 7f72ee519800 20 add_watcher() i=0 2024-09-12T17:48:41.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.228+0000 7f72ee519800 20 add_watcher() i=1 2024-09-12T17:48:41.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.228+0000 7f72ee519800 20 add_watcher() i=2 2024-09-12T17:48:41.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.228+0000 7f72ee519800 20 add_watcher() i=3 2024-09-12T17:48:41.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.228+0000 7f72ee519800 20 add_watcher() i=4 2024-09-12T17:48:41.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.228+0000 7f72ee519800 20 add_watcher() i=5 2024-09-12T17:48:41.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.228+0000 7f72ee519800 20 add_watcher() i=6 2024-09-12T17:48:41.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.229+0000 7f72ee519800 20 add_watcher() i=7 2024-09-12T17:48:41.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.229+0000 7f72ee519800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:41.232 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.232+0000 7f71a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:41.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.232+0000 7f72ee519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:41.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.232+0000 7f72ee519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:41.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.232+0000 7f72ee519800 5 note: GC not initialized 2024-09-12T17:48:41.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.232+0000 7f71a0fe1640 20 reqs_thread_entry: start 2024-09-12T17:48:41.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.232+0000 7f72ee519800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:41.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.232+0000 7f72ee519800 20 Filter name: none 2024-09-12T17:48:41.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.233+0000 7f711a7fc640 20 reqs_thread_entry: start 2024-09-12T17:48:41.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.233+0000 7f72ee519800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.233+0000 7f72ee519800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:48:41.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.233+0000 7f72ee519800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.233+0000 7f72ee519800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:48:41.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.233+0000 7f72ee519800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:41.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.233+0000 7f72ee519800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.234+0000 7f72ee519800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:48:41.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.234+0000 7f72ee519800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.234+0000 7f72ee519800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:48:41.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.234+0000 7f72ee519800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:41.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.236+0000 7f71a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:41.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.238+0000 7f72ee519800 20 remove_watcher() i=0 2024-09-12T17:48:41.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.238+0000 7f72ee519800 2 removed watcher, disabling cache 2024-09-12T17:48:41.239 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.239+0000 7f72ee519800 20 remove_watcher() i=1 2024-09-12T17:48:41.240 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.240+0000 7f72ee519800 20 remove_watcher() i=2 2024-09-12T17:48:41.241 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.241+0000 7f72ee519800 20 remove_watcher() i=3 2024-09-12T17:48:41.242 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.242+0000 7f72ee519800 20 remove_watcher() i=4 2024-09-12T17:48:41.243 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.243+0000 7f72ee519800 20 remove_watcher() i=5 2024-09-12T17:48:41.244 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.244+0000 7f72ee519800 20 remove_watcher() i=6 2024-09-12T17:48:41.245 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.245+0000 7f72ee519800 20 remove_watcher() i=7 2024-09-12T17:48:41.256 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:41.256 INFO:tasks.workunit.client.0.smithi044.stderr:BUCKET_STATS: 2024-09-12T17:48:41.256 INFO:tasks.workunit.client.0.smithi044.stderr:bucket: myver id: fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T17:48:41.256 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:41.258 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-12T17:48:41.292 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:41.292 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:41.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.331+0000 7fcbcb014800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.332+0000 7fcbcb014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.332+0000 7fcbcb014800 20 realm 2024-09-12T17:48:41.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.332+0000 7fcbcb014800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.332+0000 7fcbcb014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.332+0000 7fcbcb014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:41.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.332+0000 7fcbcb014800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.332+0000 7fcbcb014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.332+0000 7fcbcb014800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.333+0000 7fcbcb014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:41.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.333+0000 7fcbcb014800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.334+0000 7fcbcb014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:41.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.334+0000 7fcbcb014800 20 searching for the correct realm 2024-09-12T17:48:41.337 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.336+0000 7fcbc5eca640 0 -- 172.21.15.44:0/1402917306 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fcbb8025040 msgr2=0x7fcbb8055910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:41.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.541+0000 7fcbc66cb640 0 -- 172.21.15.44:0/1402917306 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fcbbc035440 msgr2=0x7fcbbc035880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:41.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.748+0000 7fcbcb014800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:41.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.748+0000 7fcbcb014800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:41.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.748+0000 7fcbcb014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:41.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.748+0000 7fcbcb014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:41.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.748+0000 7fcbcb014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:41.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.748+0000 7fcbcb014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:41.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.748+0000 7fcbcb014800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.748+0000 7fcbcb014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.749 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.748+0000 7fcbcb014800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.748+0000 7fcbcb014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:41.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.748+0000 7fcbcb014800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.749+0000 7fcbcb014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:41.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.749+0000 7fcbcb014800 20 zone default found 2024-09-12T17:48:41.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.749+0000 7fcbcb014800 4 Realm: () 2024-09-12T17:48:41.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.749+0000 7fcbcb014800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:41.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.749+0000 7fcbcb014800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:41.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.749+0000 7fcbcb014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:41.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.749+0000 7fcbcb014800 20 zonegroup default 2024-09-12T17:48:41.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.749+0000 7fcbcb014800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.749+0000 7fcbcb014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.749+0000 7fcbcb014800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.750+0000 7fcbcb014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.751 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.750+0000 7fcbcb014800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.750+0000 7fcbcb014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.750+0000 7fcbcb014800 20 started sync module instance, tier type = 2024-09-12T17:48:41.752 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.750+0000 7fcbcb014800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:41.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.760+0000 7fcbcb014800 20 add_watcher() i=0 2024-09-12T17:48:41.760 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.760+0000 7fcbcb014800 20 add_watcher() i=1 2024-09-12T17:48:41.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.760+0000 7fcbcb014800 20 add_watcher() i=2 2024-09-12T17:48:41.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.760+0000 7fcbcb014800 20 add_watcher() i=3 2024-09-12T17:48:41.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.760+0000 7fcbcb014800 20 add_watcher() i=4 2024-09-12T17:48:41.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.760+0000 7fcbcb014800 20 add_watcher() i=5 2024-09-12T17:48:41.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.760+0000 7fcbcb014800 20 add_watcher() i=6 2024-09-12T17:48:41.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.761+0000 7fcbcb014800 20 add_watcher() i=7 2024-09-12T17:48:41.761 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.761+0000 7fcbcb014800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:41.763 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.763+0000 7fca7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:41.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.763+0000 7fcbcb014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:41.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.763+0000 7fcbcb014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:41.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.763+0000 7fcbcb014800 5 note: GC not initialized 2024-09-12T17:48:41.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.763+0000 7fc9f77fe640 20 reqs_thread_entry: start 2024-09-12T17:48:41.764 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.763+0000 7fcbcb014800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:41.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.764+0000 7fcbcb014800 20 Filter name: none 2024-09-12T17:48:41.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.764+0000 7fc9f57fa640 20 reqs_thread_entry: start 2024-09-12T17:48:41.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.764+0000 7fcbcb014800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:48:41.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.764+0000 7fcbcb014800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.764+0000 7fcbcb014800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:48:41.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.764+0000 7fcbcb014800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:48:41.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.764+0000 7fcbcb014800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:48:41.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.764+0000 7fcbcb014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 : miss 2024-09-12T17:48:41.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.764+0000 7fcbcb014800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.765+0000 7fcbcb014800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:48:41.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.765+0000 7fcbcb014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:41.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.765+0000 7fcbcb014800 10 adding default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:41.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.765+0000 7fcbcb014800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:41.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.765+0000 7fcbcb014800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:41.766 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.765+0000 7fcbcb014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 2024-09-12T17:48:41.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.770+0000 7fcbcb014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:41.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.770+0000 7fcbcb014800 10 moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:41.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.770+0000 7fcbcb014800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:41.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.770+0000 7fcbcb014800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19, ofs0, ns] 2024-09-12T17:48:41.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.770+0000 7fcaa97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562452 cookie 94331919857312 notifier 8138 bl.length()=905 2024-09-12T17:48:41.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.770+0000 7fcaa97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:41.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.770+0000 7fcaa97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:41.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.770+0000 7fcaa97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:41.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.771+0000 7fcbcb014800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_sources= new_sources= 2024-09-12T17:48:41.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.771+0000 7fcbcb014800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:48:41.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.771+0000 7fcbcb014800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_dests= new_dests= 2024-09-12T17:48:41.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.771+0000 7fcbcb014800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:48:41.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:41.775+0000 7fcbcb014800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T17:48:42.278 INFO:tasks.workunit.client.0.smithi044.stderr:put object successful 2024-09-12T17:48:46.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.0 2024-09-12T17:48:46.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.0 2024-09-12T17:48:46.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.1 2024-09-12T17:48:46.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.1 2024-09-12T17:48:46.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.2 2024-09-12T17:48:46.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.2 2024-09-12T17:48:46.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.3 2024-09-12T17:48:46.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.3 2024-09-12T17:48:46.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.4 2024-09-12T17:48:46.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.4 2024-09-12T17:48:46.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.5 2024-09-12T17:48:46.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.5 2024-09-12T17:48:46.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.6 2024-09-12T17:48:46.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.6 2024-09-12T17:48:46.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.7 2024-09-12T17:48:46.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.7 2024-09-12T17:48:46.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.8 2024-09-12T17:48:46.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.8 2024-09-12T17:48:46.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.9 2024-09-12T17:48:46.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.9 2024-09-12T17:48:46.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.10 2024-09-12T17:48:46.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.10 2024-09-12T17:48:46.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.11 2024-09-12T17:48:46.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.11 2024-09-12T17:48:46.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.12 2024-09-12T17:48:46.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.12 2024-09-12T17:48:46.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.0 2024-09-12T17:48:46.779 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.776+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.0 2024-09-12T17:48:46.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.777+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.1 2024-09-12T17:48:46.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.777+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.1 2024-09-12T17:48:46.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.777+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.2 2024-09-12T17:48:46.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.777+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.2 2024-09-12T17:48:46.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.778+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.3 2024-09-12T17:48:46.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.778+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.3 2024-09-12T17:48:46.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.779+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.4 2024-09-12T17:48:46.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.779+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.4 2024-09-12T17:48:46.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.780+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.5 2024-09-12T17:48:46.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.780+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.5 2024-09-12T17:48:46.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.781+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.6 2024-09-12T17:48:46.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.781+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.6 2024-09-12T17:48:46.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.781+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.7 2024-09-12T17:48:46.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.781+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.7 2024-09-12T17:48:46.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.782+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.8 2024-09-12T17:48:46.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.782+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.8 2024-09-12T17:48:46.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.783+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.9 2024-09-12T17:48:46.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.783+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.9 2024-09-12T17:48:46.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.784+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.10 2024-09-12T17:48:46.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.784+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.10 2024-09-12T17:48:46.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.784+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.11 2024-09-12T17:48:46.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.784+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.11 2024-09-12T17:48:46.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.787+0000 7fcbcb014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:46.787 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.787+0000 7fcbcb014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 2024-09-12T17:48:46.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.789+0000 7fcbcb014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:46.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.789+0000 7fcbcb014800 10 moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:46.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.789+0000 7fcbcb014800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:46.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.789+0000 7fcbcb014800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19, ofs0, ns] 2024-09-12T17:48:46.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.789+0000 7fcaa97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562453 cookie 94331919857312 notifier 8138 bl.length()=905 2024-09-12T17:48:46.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.789+0000 7fcaa97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:46.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.789+0000 7fcaa97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:46.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.789+0000 7fcaa97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:46.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.790+0000 7fcbcb014800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_sources= new_sources= 2024-09-12T17:48:46.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.790+0000 7fcbcb014800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:48:46.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.790+0000 7fcbcb014800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_dests= new_dests= 2024-09-12T17:48:46.791 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.790+0000 7fcbcb014800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:48:46.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.793+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.0 2024-09-12T17:48:46.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.793+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.0 2024-09-12T17:48:46.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.794+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.1 2024-09-12T17:48:46.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.794+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.1 2024-09-12T17:48:46.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.794+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.2 2024-09-12T17:48:46.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.794+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.2 2024-09-12T17:48:46.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.794+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.3 2024-09-12T17:48:46.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.794+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.3 2024-09-12T17:48:46.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.795+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.4 2024-09-12T17:48:46.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.795+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.4 2024-09-12T17:48:46.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.795+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.5 2024-09-12T17:48:46.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.795+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.5 2024-09-12T17:48:46.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.796+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.6 2024-09-12T17:48:46.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.796+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.6 2024-09-12T17:48:46.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.796+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.7 2024-09-12T17:48:46.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.796+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.7 2024-09-12T17:48:46.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.797+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.8 2024-09-12T17:48:46.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.797+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.8 2024-09-12T17:48:46.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.797+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.9 2024-09-12T17:48:46.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.797+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.9 2024-09-12T17:48:46.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.798+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.10 2024-09-12T17:48:46.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.798+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.10 2024-09-12T17:48:46.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.798+0000 7fcbcb014800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.11 2024-09-12T17:48:46.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.798+0000 7fcbcb014800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.1.11 2024-09-12T17:48:46.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.800+0000 7fcbcb014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:46.801 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.800+0000 7fcbcb014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 2024-09-12T17:48:46.802 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.802+0000 7fcbcb014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:46.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.802+0000 7fcbcb014800 10 moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:46.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.802+0000 7fcbcb014800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:46.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.802+0000 7fcbcb014800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19, ofs0, ns] 2024-09-12T17:48:46.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.803+0000 7fcaa97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562454 cookie 94331919857312 notifier 8138 bl.length()=873 2024-09-12T17:48:46.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.803+0000 7fcaa97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:46.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.803+0000 7fcaa97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:46.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.803+0000 7fcaa97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:46.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.803+0000 7fcbcb014800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_sources= new_sources= 2024-09-12T17:48:46.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.803+0000 7fcbcb014800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:48:46.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.803+0000 7fcbcb014800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_dests= new_dests= 2024-09-12T17:48:46.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.803+0000 7fcbcb014800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:48:46.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.806+0000 7fcbcb014800 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-12T17:48:46.809 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.808+0000 7fca7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:46.811 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.811+0000 7fcbcb014800 20 remove_watcher() i=0 2024-09-12T17:48:46.811 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.811+0000 7fcbcb014800 2 removed watcher, disabling cache 2024-09-12T17:48:46.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.812+0000 7fcbcb014800 20 remove_watcher() i=1 2024-09-12T17:48:46.814 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.814+0000 7fcbcb014800 20 remove_watcher() i=2 2024-09-12T17:48:46.815 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.815+0000 7fcbcb014800 20 remove_watcher() i=3 2024-09-12T17:48:46.816 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.816+0000 7fcbcb014800 20 remove_watcher() i=4 2024-09-12T17:48:46.818 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.817+0000 7fcbcb014800 20 remove_watcher() i=5 2024-09-12T17:48:46.819 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.818+0000 7fcbcb014800 20 remove_watcher() i=6 2024-09-12T17:48:46.820 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:46.820+0000 7fcbcb014800 20 remove_watcher() i=7 2024-09-12T17:48:47.282 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T17:48:47.282 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T17:48:47.396 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:48:47.807 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:48:49.273 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:48:49.275 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T17:48:49.310 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:49.310 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:49.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.354+0000 7f7acc142800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.356+0000 7f7acc142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.356+0000 7f7acc142800 20 realm 2024-09-12T17:48:49.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.356+0000 7f7acc142800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.356+0000 7f7acc142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.356+0000 7f7acc142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:49.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.356+0000 7f7acc142800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.356+0000 7f7acc142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.356+0000 7f7acc142800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.357+0000 7f7acc142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:49.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.357+0000 7f7acc142800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.358+0000 7f7acc142800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:49.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.358+0000 7f7acc142800 20 searching for the correct realm 2024-09-12T17:48:49.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.361+0000 7f7ac868e640 0 -- 172.21.15.44:0/281624555 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f7abc018070 msgr2=0x7f7abc002860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:49.366 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.365+0000 7f7ac768c640 0 -- 172.21.15.44:0/281624555 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f7ab800ec50 msgr2=0x7f7ab80703d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:49.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.371+0000 7f7acc142800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:49.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.371+0000 7f7acc142800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:49.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.371+0000 7f7acc142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:49.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.371+0000 7f7acc142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:49.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.371+0000 7f7acc142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:49.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.371+0000 7f7acc142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:49.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.371+0000 7f7acc142800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.371+0000 7f7acc142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.372 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.371+0000 7f7acc142800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.373 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.372+0000 7f7acc142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:49.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.372+0000 7f7acc142800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.372+0000 7f7acc142800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:49.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.372+0000 7f7acc142800 20 zone default found 2024-09-12T17:48:49.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.372+0000 7f7acc142800 4 Realm: () 2024-09-12T17:48:49.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.372+0000 7f7acc142800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:49.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.372+0000 7f7acc142800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:49.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.372+0000 7f7acc142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:49.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.372+0000 7f7acc142800 20 zonegroup default 2024-09-12T17:48:49.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.372+0000 7f7acc142800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.372+0000 7f7acc142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.372+0000 7f7acc142800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.373+0000 7f7acc142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.374 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.373+0000 7f7acc142800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.373+0000 7f7acc142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.373+0000 7f7acc142800 20 started sync module instance, tier type = 2024-09-12T17:48:49.375 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.373+0000 7f7acc142800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:49.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.383+0000 7f7acc142800 20 add_watcher() i=0 2024-09-12T17:48:49.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.383+0000 7f7acc142800 20 add_watcher() i=1 2024-09-12T17:48:49.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.383+0000 7f7acc142800 20 add_watcher() i=2 2024-09-12T17:48:49.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.383+0000 7f7acc142800 20 add_watcher() i=3 2024-09-12T17:48:49.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.383+0000 7f7acc142800 20 add_watcher() i=4 2024-09-12T17:48:49.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.383+0000 7f7acc142800 20 add_watcher() i=5 2024-09-12T17:48:49.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.383+0000 7f7acc142800 20 add_watcher() i=6 2024-09-12T17:48:49.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.384+0000 7f7acc142800 20 add_watcher() i=7 2024-09-12T17:48:49.384 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.384+0000 7f7acc142800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:49.389 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.386+0000 7f797dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:49.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.386+0000 7f7acc142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:49.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.386+0000 7f7acc142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:49.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.386+0000 7f7acc142800 5 note: GC not initialized 2024-09-12T17:48:49.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.386+0000 7f797cfe1640 20 reqs_thread_entry: start 2024-09-12T17:48:49.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.386+0000 7f7acc142800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:49.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.386+0000 7f7acc142800 20 Filter name: none 2024-09-12T17:48:49.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.387+0000 7f78f67fc640 20 reqs_thread_entry: start 2024-09-12T17:48:49.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.387+0000 7f7acc142800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.387+0000 7f7acc142800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:48:49.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.387+0000 7f7acc142800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.390 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.388+0000 7f7acc142800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:48:49.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.388+0000 7f7acc142800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:49.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.388+0000 7f7acc142800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T17:48:49.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.388+0000 7f7acc142800 20 INFO: main: starting shard=0 2024-09-12T17:48:49.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.388+0000 7f7acc142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.0 2024-09-12T17:48:49.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.388+0000 7f7acc142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.0 2024-09-12T17:48:49.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.388+0000 7f7acc142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.388+0000 7f7acc142800 20 INFO: main: starting shard=1 2024-09-12T17:48:49.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.388+0000 7f7acc142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.1 2024-09-12T17:48:49.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.388+0000 7f7acc142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.1 2024-09-12T17:48:49.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.389+0000 7f7acc142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.389+0000 7f7acc142800 20 INFO: main: starting shard=2 2024-09-12T17:48:49.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.389+0000 7f7acc142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.2 2024-09-12T17:48:49.391 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.389+0000 7f7acc142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.2 2024-09-12T17:48:49.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.389+0000 7f7acc142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.392 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.389+0000 7f7acc142800 20 INFO: main: starting shard=3 2024-09-12T17:48:49.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.389+0000 7f7acc142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.3 2024-09-12T17:48:49.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.389+0000 7f7acc142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.3 2024-09-12T17:48:49.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.390+0000 7f7acc142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.390+0000 7f7acc142800 20 INFO: main: starting shard=4 2024-09-12T17:48:49.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.390+0000 7f7acc142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.4 2024-09-12T17:48:49.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.390+0000 7f7acc142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.4 2024-09-12T17:48:49.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.391+0000 7f7acc142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.391+0000 7f7acc142800 20 INFO: main: starting shard=5 2024-09-12T17:48:49.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.391+0000 7f7acc142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.5 2024-09-12T17:48:49.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.391+0000 7f7acc142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.5 2024-09-12T17:48:49.393 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.391+0000 7f7acc142800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:48:49.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.391+0000 7f7acc142800 20 INFO: main: starting shard=6 2024-09-12T17:48:49.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.391+0000 7f7acc142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.6 2024-09-12T17:48:49.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.391+0000 7f7acc142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.6 2024-09-12T17:48:49.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.392+0000 7f7acc142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.392+0000 7f7acc142800 20 INFO: main: starting shard=7 2024-09-12T17:48:49.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.392+0000 7f7acc142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.7 2024-09-12T17:48:49.394 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.392+0000 7f7acc142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.7 2024-09-12T17:48:49.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.392+0000 7f7acc142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.392+0000 7f7acc142800 20 INFO: main: starting shard=8 2024-09-12T17:48:49.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.392+0000 7f7acc142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.8 2024-09-12T17:48:49.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.392+0000 7f7acc142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.8 2024-09-12T17:48:49.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.393+0000 7f7acc142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.393+0000 7f7acc142800 20 INFO: main: starting shard=9 2024-09-12T17:48:49.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.393+0000 7f7acc142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.9 2024-09-12T17:48:49.395 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.393+0000 7f7acc142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.9 2024-09-12T17:48:49.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.394+0000 7f7acc142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.394+0000 7f7acc142800 20 INFO: main: starting shard=10 2024-09-12T17:48:49.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.394+0000 7f7acc142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.10 2024-09-12T17:48:49.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.394+0000 7f7acc142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.10 2024-09-12T17:48:49.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.394+0000 7f7acc142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.394+0000 7f7acc142800 20 INFO: main: starting shard=11 2024-09-12T17:48:49.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.394+0000 7f7acc142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.11 2024-09-12T17:48:49.396 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.394+0000 7f7acc142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.11 2024-09-12T17:48:49.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.395+0000 7f7acc142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.395+0000 7f7acc142800 20 INFO: main: starting shard=12 2024-09-12T17:48:49.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.395+0000 7f7acc142800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.12 2024-09-12T17:48:49.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.395+0000 7f7acc142800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.12 2024-09-12T17:48:49.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.396+0000 7f7acc142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.396+0000 7f7acc142800 20 INFO: main: done 2024-09-12T17:48:49.397 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.396+0000 7f797dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:49.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.399+0000 7f7acc142800 20 remove_watcher() i=0 2024-09-12T17:48:49.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.399+0000 7f7acc142800 2 removed watcher, disabling cache 2024-09-12T17:48:49.400 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.400+0000 7f7acc142800 20 remove_watcher() i=1 2024-09-12T17:48:49.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.401+0000 7f7acc142800 20 remove_watcher() i=2 2024-09-12T17:48:49.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.402+0000 7f7acc142800 20 remove_watcher() i=3 2024-09-12T17:48:49.404 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.403+0000 7f7acc142800 20 remove_watcher() i=4 2024-09-12T17:48:49.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.404+0000 7f7acc142800 20 remove_watcher() i=5 2024-09-12T17:48:49.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.405+0000 7f7acc142800 20 remove_watcher() i=6 2024-09-12T17:48:49.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.406+0000 7f7acc142800 20 remove_watcher() i=7 2024-09-12T17:48:49.475 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:48:49.476 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T17:48:49.507 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:49.508 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:49.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.546+0000 7f724580f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.548+0000 7f724580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.548+0000 7f724580f800 20 realm 2024-09-12T17:48:49.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.548+0000 7f724580f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.548+0000 7f724580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.548+0000 7f724580f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:49.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.548+0000 7f724580f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.548+0000 7f724580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.548+0000 7f724580f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.549+0000 7f724580f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:49.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.549+0000 7f724580f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.549+0000 7f724580f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:49.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.549+0000 7f724580f800 20 searching for the correct realm 2024-09-12T17:48:49.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.554+0000 7f7241793640 0 -- 172.21.15.44:0/3910116504 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x562a9ee9ec30 msgr2=0x562a9eea1080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:49.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.557+0000 7f723bfff640 0 -- 172.21.15.44:0/3910116504 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f723402c070 msgr2=0x7f7234037910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:49.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.561+0000 7f724580f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:49.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.561+0000 7f724580f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:49.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.561+0000 7f724580f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:49.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.561+0000 7f724580f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:49.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.561+0000 7f724580f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:49.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.561+0000 7f724580f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:49.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.561+0000 7f724580f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.561+0000 7f724580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.561+0000 7f724580f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.562+0000 7f724580f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:49.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.562+0000 7f724580f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.562+0000 7f724580f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:49.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.562+0000 7f724580f800 20 zone default found 2024-09-12T17:48:49.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.562+0000 7f724580f800 4 Realm: () 2024-09-12T17:48:49.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.562+0000 7f724580f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:49.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.562+0000 7f724580f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:49.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.562+0000 7f724580f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:49.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.562+0000 7f724580f800 20 zonegroup default 2024-09-12T17:48:49.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.562+0000 7f724580f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.562+0000 7f724580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.562+0000 7f724580f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.563+0000 7f724580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.563+0000 7f724580f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.563+0000 7f724580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.563+0000 7f724580f800 20 started sync module instance, tier type = 2024-09-12T17:48:49.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.563+0000 7f724580f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:49.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.572+0000 7f724580f800 20 add_watcher() i=0 2024-09-12T17:48:49.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.572+0000 7f724580f800 20 add_watcher() i=1 2024-09-12T17:48:49.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.572+0000 7f724580f800 20 add_watcher() i=2 2024-09-12T17:48:49.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.572+0000 7f724580f800 20 add_watcher() i=3 2024-09-12T17:48:49.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.572+0000 7f724580f800 20 add_watcher() i=4 2024-09-12T17:48:49.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.572+0000 7f724580f800 20 add_watcher() i=5 2024-09-12T17:48:49.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.572+0000 7f724580f800 20 add_watcher() i=6 2024-09-12T17:48:49.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.573+0000 7f724580f800 20 add_watcher() i=7 2024-09-12T17:48:49.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.573+0000 7f724580f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:49.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.574+0000 7f70f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:49.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.575+0000 7f724580f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:49.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.575+0000 7f724580f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:49.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.575+0000 7f724580f800 5 note: GC not initialized 2024-09-12T17:48:49.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.575+0000 7f70f5fe3640 20 reqs_thread_entry: start 2024-09-12T17:48:49.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.575+0000 7f724580f800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:49.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.575+0000 7f724580f800 20 Filter name: none 2024-09-12T17:48:49.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.575+0000 7f70677fe640 20 reqs_thread_entry: start 2024-09-12T17:48:49.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.575+0000 7f724580f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.576+0000 7f724580f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:48:49.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.576+0000 7f724580f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.576+0000 7f724580f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:48:49.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.576+0000 7f724580f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:49.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.576+0000 7f724580f800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T17:48:49.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.576+0000 7f724580f800 20 INFO: main: starting shard=0 2024-09-12T17:48:49.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.576+0000 7f724580f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.0 2024-09-12T17:48:49.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.576+0000 7f724580f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.0 2024-09-12T17:48:49.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.577+0000 7f724580f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.577+0000 7f724580f800 20 INFO: main: starting shard=1 2024-09-12T17:48:49.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.577+0000 7f724580f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.1 2024-09-12T17:48:49.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.577+0000 7f724580f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.1 2024-09-12T17:48:49.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.577+0000 7f724580f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.577+0000 7f724580f800 20 INFO: main: starting shard=2 2024-09-12T17:48:49.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.577+0000 7f724580f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.2 2024-09-12T17:48:49.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.577+0000 7f724580f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.2 2024-09-12T17:48:49.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.578+0000 7f724580f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.578+0000 7f724580f800 20 INFO: main: starting shard=3 2024-09-12T17:48:49.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.578+0000 7f724580f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.3 2024-09-12T17:48:49.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.578+0000 7f724580f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.3 2024-09-12T17:48:49.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.578+0000 7f724580f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.578+0000 7f724580f800 20 INFO: main: starting shard=4 2024-09-12T17:48:49.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.578+0000 7f724580f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.4 2024-09-12T17:48:49.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.578+0000 7f724580f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.4 2024-09-12T17:48:49.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.579+0000 7f724580f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.579+0000 7f724580f800 20 INFO: main: starting shard=5 2024-09-12T17:48:49.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.579+0000 7f724580f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.5 2024-09-12T17:48:49.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.579+0000 7f724580f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.5 2024-09-12T17:48:49.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.579+0000 7f724580f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.579+0000 7f724580f800 20 INFO: main: starting shard=6 2024-09-12T17:48:49.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.579+0000 7f724580f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.6 2024-09-12T17:48:49.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.579+0000 7f724580f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.6 2024-09-12T17:48:49.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.580+0000 7f724580f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.580+0000 7f724580f800 20 INFO: main: starting shard=7 2024-09-12T17:48:49.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.580+0000 7f724580f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.7 2024-09-12T17:48:49.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.580+0000 7f724580f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.7 2024-09-12T17:48:49.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.581+0000 7f724580f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.581+0000 7f724580f800 20 INFO: main: starting shard=8 2024-09-12T17:48:49.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.581+0000 7f724580f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.8 2024-09-12T17:48:49.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.581+0000 7f724580f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.8 2024-09-12T17:48:49.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.581+0000 7f724580f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.581+0000 7f724580f800 20 INFO: main: starting shard=9 2024-09-12T17:48:49.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.581+0000 7f724580f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.9 2024-09-12T17:48:49.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.581+0000 7f724580f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.9 2024-09-12T17:48:49.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.582+0000 7f724580f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:48:49.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.582+0000 7f724580f800 20 INFO: main: starting shard=10 2024-09-12T17:48:49.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.582+0000 7f724580f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.10 2024-09-12T17:48:49.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.582+0000 7f724580f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.10 2024-09-12T17:48:49.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.582+0000 7f724580f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.582+0000 7f724580f800 20 INFO: main: starting shard=11 2024-09-12T17:48:49.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.582+0000 7f724580f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.11 2024-09-12T17:48:49.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.582+0000 7f724580f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.11 2024-09-12T17:48:49.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.583+0000 7f724580f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.583+0000 7f724580f800 20 INFO: main: starting shard=12 2024-09-12T17:48:49.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.583+0000 7f724580f800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.12 2024-09-12T17:48:49.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.583+0000 7f724580f800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.12 2024-09-12T17:48:49.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.584+0000 7f724580f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.584+0000 7f724580f800 20 INFO: main: done 2024-09-12T17:48:49.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.585+0000 7f70f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:49.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.587+0000 7f724580f800 20 remove_watcher() i=0 2024-09-12T17:48:49.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.587+0000 7f724580f800 2 removed watcher, disabling cache 2024-09-12T17:48:49.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.588+0000 7f724580f800 20 remove_watcher() i=1 2024-09-12T17:48:49.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.589+0000 7f724580f800 20 remove_watcher() i=2 2024-09-12T17:48:49.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.590+0000 7f724580f800 20 remove_watcher() i=3 2024-09-12T17:48:49.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.591+0000 7f724580f800 20 remove_watcher() i=4 2024-09-12T17:48:49.592 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.592+0000 7f724580f800 20 remove_watcher() i=5 2024-09-12T17:48:49.593 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.593+0000 7f724580f800 20 remove_watcher() i=6 2024-09-12T17:48:49.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.594+0000 7f724580f800 20 remove_watcher() i=7 2024-09-12T17:48:49.662 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:48:49.664 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T17:48:49.696 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:49.697 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:49.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.735+0000 7f0f3f936800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.737+0000 7f0f3f936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.737 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.737+0000 7f0f3f936800 20 realm 2024-09-12T17:48:49.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.737+0000 7f0f3f936800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.737+0000 7f0f3f936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.737+0000 7f0f3f936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:49.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.737+0000 7f0f3f936800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.737+0000 7f0f3f936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.737+0000 7f0f3f936800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.738+0000 7f0f3f936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:49.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.738+0000 7f0f3f936800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.738+0000 7f0f3f936800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:49.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.738+0000 7f0f3f936800 20 searching for the correct realm 2024-09-12T17:48:49.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.742+0000 7f0f3beb8640 0 -- 172.21.15.44:0/1323389023 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f0f2407d070 msgr2=0x7f0f2405f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:49.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.745+0000 7f0f3b6b7640 0 -- 172.21.15.44:0/1323389023 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f0f2406bb90 msgr2=0x7f0f24001a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:49.952 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.950+0000 7f0f3f936800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:49.952 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.950+0000 7f0f3f936800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:49.952 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.950+0000 7f0f3f936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:49.952 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.950+0000 7f0f3f936800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:49.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.950+0000 7f0f3f936800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:49.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.950+0000 7f0f3f936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:49.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.950+0000 7f0f3f936800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.951+0000 7f0f3f936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.951+0000 7f0f3f936800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.951+0000 7f0f3f936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:49.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.951+0000 7f0f3f936800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.951+0000 7f0f3f936800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:49.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.951+0000 7f0f3f936800 20 zone default found 2024-09-12T17:48:49.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.951+0000 7f0f3f936800 4 Realm: () 2024-09-12T17:48:49.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.951+0000 7f0f3f936800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:49.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.951+0000 7f0f3f936800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:49.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.951+0000 7f0f3f936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:49.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.951+0000 7f0f3f936800 20 zonegroup default 2024-09-12T17:48:49.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.951+0000 7f0f3f936800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.951+0000 7f0f3f936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.952+0000 7f0f3f936800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.952+0000 7f0f3f936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.952+0000 7f0f3f936800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.952+0000 7f0f3f936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.952+0000 7f0f3f936800 20 started sync module instance, tier type = 2024-09-12T17:48:49.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.952+0000 7f0f3f936800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:49.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.962+0000 7f0f3f936800 20 add_watcher() i=0 2024-09-12T17:48:49.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.962+0000 7f0f3f936800 20 add_watcher() i=1 2024-09-12T17:48:49.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.962+0000 7f0f3f936800 20 add_watcher() i=2 2024-09-12T17:48:49.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.962+0000 7f0f3f936800 20 add_watcher() i=3 2024-09-12T17:48:49.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.962+0000 7f0f3f936800 20 add_watcher() i=4 2024-09-12T17:48:49.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.962+0000 7f0f3f936800 20 add_watcher() i=5 2024-09-12T17:48:49.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.962+0000 7f0f3f936800 20 add_watcher() i=6 2024-09-12T17:48:49.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.963+0000 7f0f3f936800 20 add_watcher() i=7 2024-09-12T17:48:49.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.963+0000 7f0f3f936800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:49.965 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.965+0000 7f0df1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:49.966 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.965+0000 7f0f3f936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:49.966 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.965+0000 7f0f3f936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:49.966 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.965+0000 7f0f3f936800 5 note: GC not initialized 2024-09-12T17:48:49.966 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.965+0000 7f0df0fe1640 20 reqs_thread_entry: start 2024-09-12T17:48:49.966 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.965+0000 7f0f3f936800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:49.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.966+0000 7f0f3f936800 20 Filter name: none 2024-09-12T17:48:49.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.966+0000 7f0d6a7fc640 20 reqs_thread_entry: start 2024-09-12T17:48:49.967 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.966+0000 7f0f3f936800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.968 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.966+0000 7f0f3f936800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:48:49.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.966+0000 7f0f3f936800 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.967+0000 7f0f3f936800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:48:49.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.967+0000 7f0f3f936800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:49.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.967+0000 7f0f3f936800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T17:48:49.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.967+0000 7f0f3f936800 20 INFO: main: starting shard=0 2024-09-12T17:48:49.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.967+0000 7f0f3f936800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.0 2024-09-12T17:48:49.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.967+0000 7f0f3f936800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.0 2024-09-12T17:48:49.969 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.967+0000 7f0f3f936800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:48:49.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.967+0000 7f0f3f936800 20 INFO: main: starting shard=1 2024-09-12T17:48:49.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.967+0000 7f0f3f936800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.1 2024-09-12T17:48:49.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.967+0000 7f0f3f936800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.1 2024-09-12T17:48:49.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.968+0000 7f0f3f936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.968+0000 7f0f3f936800 20 INFO: main: starting shard=2 2024-09-12T17:48:49.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.968+0000 7f0f3f936800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.2 2024-09-12T17:48:49.970 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.968+0000 7f0f3f936800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.2 2024-09-12T17:48:49.972 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.968+0000 7f0f3f936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.968+0000 7f0f3f936800 20 INFO: main: starting shard=3 2024-09-12T17:48:49.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.968+0000 7f0f3f936800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.3 2024-09-12T17:48:49.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.968+0000 7f0f3f936800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.3 2024-09-12T17:48:49.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.969+0000 7f0f3f936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.969+0000 7f0f3f936800 20 INFO: main: starting shard=4 2024-09-12T17:48:49.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.969+0000 7f0f3f936800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.4 2024-09-12T17:48:49.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.969+0000 7f0f3f936800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.4 2024-09-12T17:48:49.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.969+0000 7f0f3f936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.969+0000 7f0f3f936800 20 INFO: main: starting shard=5 2024-09-12T17:48:49.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.969+0000 7f0f3f936800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.5 2024-09-12T17:48:49.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.969+0000 7f0f3f936800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.5 2024-09-12T17:48:49.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.970+0000 7f0f3f936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.970+0000 7f0f3f936800 20 INFO: main: starting shard=6 2024-09-12T17:48:49.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.970+0000 7f0f3f936800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.6 2024-09-12T17:48:49.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.970+0000 7f0f3f936800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.6 2024-09-12T17:48:49.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.970+0000 7f0f3f936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.970+0000 7f0f3f936800 20 INFO: main: starting shard=7 2024-09-12T17:48:49.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.970+0000 7f0f3f936800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.7 2024-09-12T17:48:49.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.970+0000 7f0f3f936800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.7 2024-09-12T17:48:49.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.971+0000 7f0f3f936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.971+0000 7f0f3f936800 20 INFO: main: starting shard=8 2024-09-12T17:48:49.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.971+0000 7f0f3f936800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.8 2024-09-12T17:48:49.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.971+0000 7f0f3f936800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.8 2024-09-12T17:48:49.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.972+0000 7f0f3f936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.972+0000 7f0f3f936800 20 INFO: main: starting shard=9 2024-09-12T17:48:49.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.972+0000 7f0f3f936800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.9 2024-09-12T17:48:49.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.972+0000 7f0f3f936800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.9 2024-09-12T17:48:49.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.972+0000 7f0f3f936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.972+0000 7f0f3f936800 20 INFO: main: starting shard=10 2024-09-12T17:48:49.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.972+0000 7f0f3f936800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.10 2024-09-12T17:48:49.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.972+0000 7f0f3f936800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.10 2024-09-12T17:48:49.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.973+0000 7f0f3f936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.973+0000 7f0f3f936800 20 INFO: main: starting shard=11 2024-09-12T17:48:49.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.973+0000 7f0f3f936800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.11 2024-09-12T17:48:49.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.973+0000 7f0f3f936800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.11 2024-09-12T17:48:49.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.973+0000 7f0f3f936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.973+0000 7f0f3f936800 20 INFO: main: starting shard=12 2024-09-12T17:48:49.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.973+0000 7f0f3f936800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.12 2024-09-12T17:48:49.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.973+0000 7f0f3f936800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.12 2024-09-12T17:48:49.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.974+0000 7f0f3f936800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:48:49.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.974+0000 7f0f3f936800 20 INFO: main: done 2024-09-12T17:48:49.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.975+0000 7f0df1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:49.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.977+0000 7f0f3f936800 20 remove_watcher() i=0 2024-09-12T17:48:49.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.977+0000 7f0f3f936800 2 removed watcher, disabling cache 2024-09-12T17:48:49.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.978+0000 7f0f3f936800 20 remove_watcher() i=1 2024-09-12T17:48:49.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.980+0000 7f0f3f936800 20 remove_watcher() i=2 2024-09-12T17:48:49.981 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.981+0000 7f0f3f936800 20 remove_watcher() i=3 2024-09-12T17:48:49.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.982+0000 7f0f3f936800 20 remove_watcher() i=4 2024-09-12T17:48:49.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.983+0000 7f0f3f936800 20 remove_watcher() i=5 2024-09-12T17:48:49.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.984+0000 7f0f3f936800 20 remove_watcher() i=6 2024-09-12T17:48:49.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:49.985+0000 7f0f3f936800 20 remove_watcher() i=7 2024-09-12T17:48:50.003 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:48:50.412 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:48:50.827 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T17:48:50.859 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:50.859 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:50.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:50.898+0000 7fda6b70c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:50.899+0000 7fda6b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:50.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:50.899+0000 7fda6b70c800 20 realm 2024-09-12T17:48:50.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:50.899+0000 7fda6b70c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:50.900+0000 7fda6b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:50.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:50.900+0000 7fda6b70c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:50.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:50.900+0000 7fda6b70c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:50.900+0000 7fda6b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:50.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:50.900+0000 7fda6b70c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:50.901+0000 7fda6b70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:50.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:50.901+0000 7fda6b70c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:50.901+0000 7fda6b70c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:50.902 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:50.901+0000 7fda6b70c800 20 searching for the correct realm 2024-09-12T17:48:50.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:50.905+0000 7fda699f7640 0 -- 172.21.15.44:0/1098436757 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7fda54027030 msgr2=0x7fda54060a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:50.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:50.908+0000 7fda691f6640 0 -- 172.21.15.44:0/1098436757 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fda54060fc0 msgr2=0x7fda54083240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:51.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.115+0000 7fda6b70c800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:51.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.115+0000 7fda6b70c800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:51.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.115+0000 7fda6b70c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:51.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.115+0000 7fda6b70c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:51.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.115+0000 7fda6b70c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:51.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.115+0000 7fda6b70c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:51.116 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.115+0000 7fda6b70c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.115+0000 7fda6b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.117 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.115+0000 7fda6b70c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.116+0000 7fda6b70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:51.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.116+0000 7fda6b70c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.116+0000 7fda6b70c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:51.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.116+0000 7fda6b70c800 20 zone default found 2024-09-12T17:48:51.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.116+0000 7fda6b70c800 4 Realm: () 2024-09-12T17:48:51.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.116+0000 7fda6b70c800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:51.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.116+0000 7fda6b70c800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:51.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.116+0000 7fda6b70c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:51.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.116+0000 7fda6b70c800 20 zonegroup default 2024-09-12T17:48:51.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.116+0000 7fda6b70c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.117+0000 7fda6b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.117+0000 7fda6b70c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.118 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.117+0000 7fda6b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.117+0000 7fda6b70c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.117+0000 7fda6b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.117+0000 7fda6b70c800 20 started sync module instance, tier type = 2024-09-12T17:48:51.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.117+0000 7fda6b70c800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:51.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.127+0000 7fda6b70c800 20 add_watcher() i=0 2024-09-12T17:48:51.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.127+0000 7fda6b70c800 20 add_watcher() i=1 2024-09-12T17:48:51.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.127+0000 7fda6b70c800 20 add_watcher() i=2 2024-09-12T17:48:51.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.127+0000 7fda6b70c800 20 add_watcher() i=3 2024-09-12T17:48:51.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.127+0000 7fda6b70c800 20 add_watcher() i=4 2024-09-12T17:48:51.129 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.127+0000 7fda6b70c800 20 add_watcher() i=5 2024-09-12T17:48:51.129 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.127+0000 7fda6b70c800 20 add_watcher() i=6 2024-09-12T17:48:51.129 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.128+0000 7fda6b70c800 20 add_watcher() i=7 2024-09-12T17:48:51.129 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.128+0000 7fda6b70c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:51.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.130+0000 7fd91ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:51.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.130+0000 7fda6b70c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:51.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.130+0000 7fda6b70c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:51.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.130+0000 7fda6b70c800 5 note: GC not initialized 2024-09-12T17:48:51.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.130+0000 7fd91efe5640 20 reqs_thread_entry: start 2024-09-12T17:48:51.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.131+0000 7fda6b70c800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:51.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.131+0000 7fda6b70c800 20 Filter name: none 2024-09-12T17:48:51.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.131+0000 7fd91cfe1640 20 reqs_thread_entry: start 2024-09-12T17:48:51.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.131+0000 7fda6b70c800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:48:51.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.131+0000 7fda6b70c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.131+0000 7fda6b70c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:48:51.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.131+0000 7fda6b70c800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:48:51.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.131+0000 7fda6b70c800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:48:51.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.131+0000 7fda6b70c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 : miss 2024-09-12T17:48:51.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.131+0000 7fda6b70c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.132+0000 7fda6b70c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:48:51.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.132+0000 7fda6b70c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:51.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.132+0000 7fda6b70c800 10 adding default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:51.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.132+0000 7fda6b70c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:51.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.132+0000 7fda6b70c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:51.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.132+0000 7fda6b70c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 2024-09-12T17:48:51.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.137+0000 7fda6b70c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:51.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.137+0000 7fda6b70c800 10 moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:51.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.137+0000 7fda6b70c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:51.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.137+0000 7fda6b70c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19, ofs0, ns] 2024-09-12T17:48:51.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.138+0000 7fd93bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562455 cookie 94313019741136 notifier 8222 bl.length()=905 2024-09-12T17:48:51.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.138+0000 7fd93bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:51.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.138+0000 7fd93bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:51.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.138+0000 7fd93bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:51.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.138+0000 7fda6b70c800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_sources= new_sources= 2024-09-12T17:48:51.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.138+0000 7fda6b70c800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:48:51.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.138+0000 7fda6b70c800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_dests= new_dests= 2024-09-12T17:48:51.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.138+0000 7fda6b70c800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:48:51.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.0 2024-09-12T17:48:51.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.0 2024-09-12T17:48:51.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.1 2024-09-12T17:48:51.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.1 2024-09-12T17:48:51.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.2 2024-09-12T17:48:51.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.2 2024-09-12T17:48:51.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.3 2024-09-12T17:48:51.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.3 2024-09-12T17:48:51.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.4 2024-09-12T17:48:51.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.4 2024-09-12T17:48:51.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.5 2024-09-12T17:48:51.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.5 2024-09-12T17:48:51.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.6 2024-09-12T17:48:51.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.6 2024-09-12T17:48:51.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.7 2024-09-12T17:48:51.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.7 2024-09-12T17:48:51.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.8 2024-09-12T17:48:51.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.8 2024-09-12T17:48:51.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.10 2024-09-12T17:48:51.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.10 2024-09-12T17:48:51.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.11 2024-09-12T17:48:51.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.11 2024-09-12T17:48:51.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.12 2024-09-12T17:48:51.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.12 2024-09-12T17:48:51.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.13 2024-09-12T17:48:51.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.13 2024-09-12T17:48:51.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.14 2024-09-12T17:48:51.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.14 2024-09-12T17:48:51.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.15 2024-09-12T17:48:51.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.15 2024-09-12T17:48:51.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.16 2024-09-12T17:48:51.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.16 2024-09-12T17:48:51.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.0 2024-09-12T17:48:51.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.145+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.0 2024-09-12T17:48:51.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.146+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.1 2024-09-12T17:48:51.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.146+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.1 2024-09-12T17:48:51.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.146+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.2 2024-09-12T17:48:51.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.146+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.2 2024-09-12T17:48:51.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.146+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.3 2024-09-12T17:48:51.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.146+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.3 2024-09-12T17:48:51.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.147+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.4 2024-09-12T17:48:51.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.147+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.4 2024-09-12T17:48:51.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.148+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.5 2024-09-12T17:48:51.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.148+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.5 2024-09-12T17:48:51.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.148+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.6 2024-09-12T17:48:51.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.148+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.6 2024-09-12T17:48:51.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.149+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.7 2024-09-12T17:48:51.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.149+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.7 2024-09-12T17:48:51.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.150+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.8 2024-09-12T17:48:51.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.150+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.8 2024-09-12T17:48:51.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.150+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.9 2024-09-12T17:48:51.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.150+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.9 2024-09-12T17:48:51.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.151+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.10 2024-09-12T17:48:51.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.151+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.10 2024-09-12T17:48:51.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.152+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.11 2024-09-12T17:48:51.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.152+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.11 2024-09-12T17:48:51.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.153+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.12 2024-09-12T17:48:51.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.153+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.12 2024-09-12T17:48:51.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.155+0000 7fda6b70c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:51.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.155+0000 7fda6b70c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 2024-09-12T17:48:51.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.156+0000 7fda6b70c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:51.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.156+0000 7fda6b70c800 10 moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:51.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.156+0000 7fda6b70c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:51.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.156+0000 7fda6b70c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19, ofs0, ns] 2024-09-12T17:48:51.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.157+0000 7fd93bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562456 cookie 94313019741136 notifier 8222 bl.length()=905 2024-09-12T17:48:51.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.157+0000 7fd93bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:51.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.157+0000 7fd93bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:51.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.157+0000 7fd93bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:51.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.157+0000 7fda6b70c800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_sources= new_sources= 2024-09-12T17:48:51.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.157+0000 7fda6b70c800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:48:51.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.157+0000 7fda6b70c800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_dests= new_dests= 2024-09-12T17:48:51.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.157+0000 7fda6b70c800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:48:51.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.160+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.0 2024-09-12T17:48:51.160 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.160+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.0 2024-09-12T17:48:51.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.160+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.1 2024-09-12T17:48:51.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.160+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.1 2024-09-12T17:48:51.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.160+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.2 2024-09-12T17:48:51.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.160+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.2 2024-09-12T17:48:51.161 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.161+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.3 2024-09-12T17:48:51.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.161+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.3 2024-09-12T17:48:51.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.161+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.4 2024-09-12T17:48:51.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.161+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.4 2024-09-12T17:48:51.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.161+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.5 2024-09-12T17:48:51.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.161+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.5 2024-09-12T17:48:51.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.162+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.6 2024-09-12T17:48:51.162 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.162+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.6 2024-09-12T17:48:51.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.162+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.7 2024-09-12T17:48:51.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.162+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.7 2024-09-12T17:48:51.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.162+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.8 2024-09-12T17:48:51.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.162+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.8 2024-09-12T17:48:51.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.163+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.9 2024-09-12T17:48:51.163 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.163+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.9 2024-09-12T17:48:51.164 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.163+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.10 2024-09-12T17:48:51.164 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.163+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.10 2024-09-12T17:48:51.164 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.163+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.11 2024-09-12T17:48:51.164 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.163+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.11 2024-09-12T17:48:51.164 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.164+0000 7fda6b70c800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.12 2024-09-12T17:48:51.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.164+0000 7fda6b70c800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.2.12 2024-09-12T17:48:51.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.164+0000 7fda6b70c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:51.165 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.164+0000 7fda6b70c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 2024-09-12T17:48:51.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.166+0000 7fda6b70c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:51.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.166+0000 7fda6b70c800 10 moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:51.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.166+0000 7fda6b70c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:51.166 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.166+0000 7fda6b70c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19, ofs0, ns] 2024-09-12T17:48:51.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.166+0000 7fd93bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562457 cookie 94313019741136 notifier 8222 bl.length()=873 2024-09-12T17:48:51.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.166+0000 7fd93bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:51.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.166+0000 7fd93bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:51.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.166+0000 7fd93bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:51.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.166+0000 7fda6b70c800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_sources= new_sources= 2024-09-12T17:48:51.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.166+0000 7fda6b70c800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential sources added=[] removed=[] 2024-09-12T17:48:51.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.166+0000 7fda6b70c800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): orig_dests= new_dests= 2024-09-12T17:48:51.167 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.166+0000 7fda6b70c800 20 handle_bi_update(): bucket=:myver[fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19]): potential dests added=[] removed=[] 2024-09-12T17:48:51.169 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.169+0000 7fda6b70c800 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-12T17:48:51.172 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.172+0000 7fd91ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:51.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.174+0000 7fda6b70c800 20 remove_watcher() i=0 2024-09-12T17:48:51.175 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.174+0000 7fda6b70c800 2 removed watcher, disabling cache 2024-09-12T17:48:51.176 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.176+0000 7fda6b70c800 20 remove_watcher() i=1 2024-09-12T17:48:51.177 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.177+0000 7fda6b70c800 20 remove_watcher() i=2 2024-09-12T17:48:51.178 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.178+0000 7fda6b70c800 20 remove_watcher() i=3 2024-09-12T17:48:51.180 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.180+0000 7fda6b70c800 20 remove_watcher() i=4 2024-09-12T17:48:51.182 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.182+0000 7fda6b70c800 20 remove_watcher() i=5 2024-09-12T17:48:51.183 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.183+0000 7fda6b70c800 20 remove_watcher() i=6 2024-09-12T17:48:51.184 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.184+0000 7fda6b70c800 20 remove_watcher() i=7 2024-09-12T17:48:51.197 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:48:51.233 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:51.233 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:51.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.272+0000 7f2bfe723800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.273+0000 7f2bfe723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.273+0000 7f2bfe723800 20 realm 2024-09-12T17:48:51.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.273+0000 7f2bfe723800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.273+0000 7f2bfe723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.273+0000 7f2bfe723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:51.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.273+0000 7f2bfe723800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.274+0000 7f2bfe723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.274+0000 7f2bfe723800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.274+0000 7f2bfe723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:51.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.274+0000 7f2bfe723800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.275+0000 7f2bfe723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:51.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.275+0000 7f2bfe723800 20 searching for the correct realm 2024-09-12T17:48:51.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.278+0000 7f2bf9c12640 0 -- 172.21.15.44:0/4262977301 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f2bec04c430 msgr2=0x7f2bec04c810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:51.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.282+0000 7f2bfa413640 0 -- 172.21.15.44:0/4262977301 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f2bf0042b30 msgr2=0x7f2bf006e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:51.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.489+0000 7f2bfe723800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:51.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.489+0000 7f2bfe723800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:51.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.489+0000 7f2bfe723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:51.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.489+0000 7f2bfe723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:51.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.489+0000 7f2bfe723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:51.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.489+0000 7f2bfe723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:51.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.489+0000 7f2bfe723800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.489+0000 7f2bfe723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.489+0000 7f2bfe723800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.489+0000 7f2bfe723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:51.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.489+0000 7f2bfe723800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.490+0000 7f2bfe723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:51.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.490+0000 7f2bfe723800 20 zone default found 2024-09-12T17:48:51.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.490+0000 7f2bfe723800 4 Realm: () 2024-09-12T17:48:51.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.490+0000 7f2bfe723800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:51.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.490+0000 7f2bfe723800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:51.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.490+0000 7f2bfe723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:51.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.490+0000 7f2bfe723800 20 zonegroup default 2024-09-12T17:48:51.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.490+0000 7f2bfe723800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.490+0000 7f2bfe723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.490+0000 7f2bfe723800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.491+0000 7f2bfe723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.491+0000 7f2bfe723800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.491+0000 7f2bfe723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.491+0000 7f2bfe723800 20 started sync module instance, tier type = 2024-09-12T17:48:51.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.491+0000 7f2bfe723800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:51.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.503+0000 7f2bfe723800 20 add_watcher() i=0 2024-09-12T17:48:51.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.503+0000 7f2bfe723800 20 add_watcher() i=1 2024-09-12T17:48:51.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.503+0000 7f2bfe723800 20 add_watcher() i=2 2024-09-12T17:48:51.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.503+0000 7f2bfe723800 20 add_watcher() i=3 2024-09-12T17:48:51.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.503+0000 7f2bfe723800 20 add_watcher() i=4 2024-09-12T17:48:51.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.503+0000 7f2bfe723800 20 add_watcher() i=5 2024-09-12T17:48:51.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.503+0000 7f2bfe723800 20 add_watcher() i=6 2024-09-12T17:48:51.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.504+0000 7f2bfe723800 20 add_watcher() i=7 2024-09-12T17:48:51.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.504+0000 7f2bfe723800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:51.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.506+0000 7f2ab0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:51.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.506+0000 7f2bfe723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:51.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.506+0000 7f2bfe723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:51.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.506+0000 7f2bfe723800 5 note: GC not initialized 2024-09-12T17:48:51.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.506+0000 7f2a2b7fe640 20 reqs_thread_entry: start 2024-09-12T17:48:51.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.507+0000 7f2bfe723800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:51.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.507+0000 7f2bfe723800 20 Filter name: none 2024-09-12T17:48:51.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.507+0000 7f2a297fa640 20 reqs_thread_entry: start 2024-09-12T17:48:51.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.507+0000 7f2bfe723800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:48:51.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.507+0000 7f2bfe723800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.507+0000 7f2bfe723800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:48:51.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.507+0000 7f2bfe723800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:48:51.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.507+0000 7f2bfe723800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:48:51.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.507+0000 7f2bfe723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 : miss 2024-09-12T17:48:51.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.507+0000 7f2bfe723800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.508+0000 7f2bfe723800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:48:51.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.508+0000 7f2bfe723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 info.flags=0x17 2024-09-12T17:48:51.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.508+0000 7f2bfe723800 10 adding default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 to cache LRU end 2024-09-12T17:48:51.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.508+0000 7f2bfe723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:51.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.508+0000 7f2bfe723800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:51.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.508+0000 7f2bfe723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19 2024-09-12T17:48:51.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.508+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.0 2024-09-12T17:48:51.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.508+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.0 2024-09-12T17:48:51.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.509+0000 7f2bfe723800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:48:51.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.509+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.1 2024-09-12T17:48:51.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.509+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.1 2024-09-12T17:48:51.510 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.509+0000 7f2bfe723800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T17:48:51.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.509+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.2 2024-09-12T17:48:51.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.509+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.2 2024-09-12T17:48:51.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.510+0000 7f2bfe723800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:48:51.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.510+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.3 2024-09-12T17:48:51.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.510+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.3 2024-09-12T17:48:51.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.510+0000 7f2bfe723800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:48:51.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.510+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.4 2024-09-12T17:48:51.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.510+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.4 2024-09-12T17:48:51.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.511+0000 7f2bfe723800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:48:51.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.511+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.5 2024-09-12T17:48:51.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.511+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.5 2024-09-12T17:48:51.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.511+0000 7f2bfe723800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T17:48:51.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.511+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.6 2024-09-12T17:48:51.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.511+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.6 2024-09-12T17:48:51.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.512+0000 7f2bfe723800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:48:51.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.512+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.7 2024-09-12T17:48:51.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.512+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.7 2024-09-12T17:48:51.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.512+0000 7f2bfe723800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:48:51.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.512+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.8 2024-09-12T17:48:51.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.512+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.8 2024-09-12T17:48:51.513 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.513+0000 7f2bfe723800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T17:48:51.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.513+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.513+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.513+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.10 2024-09-12T17:48:51.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.513+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.10 2024-09-12T17:48:51.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.514+0000 7f2bfe723800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T17:48:51.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.514+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.11 2024-09-12T17:48:51.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.514+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.11 2024-09-12T17:48:51.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.514+0000 7f2bfe723800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T17:48:51.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.514+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.12 2024-09-12T17:48:51.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.514+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.12 2024-09-12T17:48:51.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.516+0000 7f2bfe723800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T17:48:51.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.516+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.13 2024-09-12T17:48:51.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.516+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.13 2024-09-12T17:48:51.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.516+0000 7f2bfe723800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T17:48:51.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.516+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.14 2024-09-12T17:48:51.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.516+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.14 2024-09-12T17:48:51.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.517+0000 7f2bfe723800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T17:48:51.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.517+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.15 2024-09-12T17:48:51.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.517+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.15 2024-09-12T17:48:51.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.517+0000 7f2bfe723800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T17:48:51.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.517+0000 7f2bfe723800 10 bucket_obj is .dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.16 2024-09-12T17:48:51.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.517+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.16 2024-09-12T17:48:51.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.518+0000 7f2bfe723800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T17:48:51.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.518+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.518+0000 7f2bfe723800 20 get_obj_state: octx=0x55b4a69369b0 obj=myver:x state=0x55b4a6be74b8 s->prefetch_data=0 2024-09-12T17:48:51.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.518+0000 7f2bfe723800 20 get_obj_state: setting s->obj_tag to rzhu6232vp3dr0vhdnhtkecxovegrjll 2024-09-12T17:48:51.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.518+0000 7f2bfe723800 20 get_obj_state_impl: setting s->olh_tag to lf4i2sq2s7ouo72j9ty3ajl1nsp19huy 2024-09-12T17:48:51.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.518+0000 7f2bfe723800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lf4i2sq2s7ouo72j9ty3ajl1nsp19huy 2024-09-12T17:48:51.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.520+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.521 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.521+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.521+0000 7f2bfe723800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T17:48:51.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.521+0000 7f2bfe723800 20 olh_log_entry: epoch=2 op=3 key=x[Bi9kW3fevRR2XEP0VfBvleCrQ2cV4RA] 2024-09-12T17:48:51.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.521+0000 7f2bfe723800 20 get_obj_state: octx=0x55b4a69369b0 obj=myver:_:Bi9kW3fevRR2XEP0VfBvleCrQ2cV4RA_x state=0x55b4a6be4138 s->prefetch_data=0 2024-09-12T17:48:51.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.522+0000 7f2bfe723800 10 manifest: total_size = 12 2024-09-12T17:48:51.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.522+0000 7f2bfe723800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15934259024182514218 2024-09-12T17:48:51.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.522+0000 7f2bfe723800 20 get_obj_state: octx=0x55b4a69369b0 obj=myver:_:Bi9kW3fevRR2XEP0VfBvleCrQ2cV4RA_x state=0x55b4a6be4138 s->prefetch_data=0 2024-09-12T17:48:51.522 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.522+0000 7f2bfe723800 20 prepare_atomic_modification: state is not atomic. state=0x55b4a6be4138 2024-09-12T17:48:51.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.522+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.524+0000 7f2bfe723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:48:51.524 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.524+0000 7f2bfe723800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:48:51.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.524+0000 7f2bfe723800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:48:51.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.524+0000 7f2bfe723800 5 delete_objs_inline: removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19__shadow:Bi9kW3fevRR2XEP0VfBvleCrQ2cV4RA_.KtFQvLgAHDg4NoSq4f_DXXZtyqv4k7N_0 2024-09-12T17:48:51.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.525+0000 7f2addffb640 20 handle_completion(): completion ok for obj=x[Bi9kW3fevRR2XEP0VfBvleCrQ2cV4RA] 2024-09-12T17:48:51.526 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.525+0000 7f2bfe723800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:48:51.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.526+0000 7f2bfe723800 20 get_obj_state: octx=0x55b4a69369b0 obj=myver:x state=0x55b4a6be74b8 s->prefetch_data=0 2024-09-12T17:48:51.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.526+0000 7f2bfe723800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lf4i2sq2s7ouo72j9ty3ajl1nsp19huy 2024-09-12T17:48:51.529 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.529+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.530 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.530+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.530+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.530+0000 7f2bfe723800 20 get_obj_state: octx=0x55b4a69369b0 obj=myver:y state=0x55b4a6be7438 s->prefetch_data=0 2024-09-12T17:48:51.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.531+0000 7f2bfe723800 20 get_obj_state: setting s->obj_tag to slanlmsbowxpqoufwnzh4k0xjfmnp2vj 2024-09-12T17:48:51.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.531+0000 7f2bfe723800 20 get_obj_state_impl: setting s->olh_tag to myc2e5kg0q7npr1396bb9g3x04tnjnw3 2024-09-12T17:48:51.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.531+0000 7f2bfe723800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=myc2e5kg0q7npr1396bb9g3x04tnjnw3 2024-09-12T17:48:51.533 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.533+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.534+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.534+0000 7f2bfe723800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T17:48:51.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.534+0000 7f2bfe723800 20 olh_log_entry: epoch=2 op=3 key=y[lS0f2l0InpkrDZ6LwVaLKj7KqQ3ntxJ] 2024-09-12T17:48:51.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.534+0000 7f2bfe723800 20 get_obj_state: octx=0x55b4a69369b0 obj=myver:_:lS0f2l0InpkrDZ6LwVaLKj7KqQ3ntxJ_y state=0x55b4a6bacbb8 s->prefetch_data=0 2024-09-12T17:48:51.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.534+0000 7f2bfe723800 10 manifest: total_size = 22 2024-09-12T17:48:51.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.534+0000 7f2bfe723800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4924222956439065910 2024-09-12T17:48:51.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.534+0000 7f2bfe723800 20 get_obj_state: octx=0x55b4a69369b0 obj=myver:_:lS0f2l0InpkrDZ6LwVaLKj7KqQ3ntxJ_y state=0x55b4a6bacbb8 s->prefetch_data=0 2024-09-12T17:48:51.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.534+0000 7f2bfe723800 20 prepare_atomic_modification: state is not atomic. state=0x55b4a6bacbb8 2024-09-12T17:48:51.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.534+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.536+0000 7f2bfe723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:48:51.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.536+0000 7f2bfe723800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:48:51.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.536+0000 7f2bfe723800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:48:51.537 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.536+0000 7f2bfe723800 5 delete_objs_inline: removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19__shadow:lS0f2l0InpkrDZ6LwVaLKj7KqQ3ntxJ_.OvlHqsTS_G-1c5RbOpAZKl_P8ymBDNj_0 2024-09-12T17:48:51.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.538+0000 7f2addffb640 20 handle_completion(): completion ok for obj=y[lS0f2l0InpkrDZ6LwVaLKj7KqQ3ntxJ] 2024-09-12T17:48:51.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.538+0000 7f2bfe723800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:48:51.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.539+0000 7f2bfe723800 20 get_obj_state: octx=0x55b4a69369b0 obj=myver:y state=0x55b4a6be7438 s->prefetch_data=0 2024-09-12T17:48:51.540 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.539+0000 7f2bfe723800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=myc2e5kg0q7npr1396bb9g3x04tnjnw3 2024-09-12T17:48:51.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.542+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.543 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.543+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.543+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.543+0000 7f2bfe723800 20 get_obj_state: octx=0x55b4a69369b0 obj=myver:z state=0x55b4a6be7438 s->prefetch_data=0 2024-09-12T17:48:51.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.544+0000 7f2bfe723800 20 get_obj_state: setting s->obj_tag to t21miena3svhsfcyy48kaf9e6qo3nv3g 2024-09-12T17:48:51.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.544+0000 7f2bfe723800 20 get_obj_state_impl: setting s->olh_tag to cil82drgxe2m245wym2po6uksmvxlxw6 2024-09-12T17:48:51.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.544+0000 7f2bfe723800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cil82drgxe2m245wym2po6uksmvxlxw6 2024-09-12T17:48:51.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.545+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.546 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.546+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.546+0000 7f2bfe723800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T17:48:51.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.546+0000 7f2bfe723800 20 olh_log_entry: epoch=2 op=3 key=z[cJwvoe5cFlnla.MwLxvQZNaRA4ZZ2rw] 2024-09-12T17:48:51.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.546+0000 7f2bfe723800 20 get_obj_state: octx=0x55b4a69369b0 obj=myver:_:cJwvoe5cFlnla.MwLxvQZNaRA4ZZ2rw_z state=0x55b4a6bacb78 s->prefetch_data=0 2024-09-12T17:48:51.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.547+0000 7f2bfe723800 10 manifest: total_size = 11 2024-09-12T17:48:51.547 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.547+0000 7f2bfe723800 20 get_obj_state: setting s->obj_tag to fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12490387495261275005 2024-09-12T17:48:51.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.547+0000 7f2bfe723800 20 get_obj_state: octx=0x55b4a69369b0 obj=myver:_:cJwvoe5cFlnla.MwLxvQZNaRA4ZZ2rw_z state=0x55b4a6bacb78 s->prefetch_data=0 2024-09-12T17:48:51.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.547+0000 7f2bfe723800 20 prepare_atomic_modification: state is not atomic. state=0x55b4a6bacb78 2024-09-12T17:48:51.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.547+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.549+0000 7f2bfe723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:48:51.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.549+0000 7f2bfe723800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:48:51.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.549+0000 7f2bfe723800 0 deleting objects inline since gc isn't initialized 2024-09-12T17:48:51.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.549+0000 7f2bfe723800 5 delete_objs_inline: removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19__shadow:cJwvoe5cFlnla.MwLxvQZNaRA4ZZ2rw_.a7m7Ezn8NxiMipG8dZg8Ojfps5qEjAE_0 2024-09-12T17:48:51.550 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.550+0000 7f2addffb640 20 handle_completion(): completion ok for obj=z[cJwvoe5cFlnla.MwLxvQZNaRA4ZZ2rw] 2024-09-12T17:48:51.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.550+0000 7f2bfe723800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:48:51.551 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.551+0000 7f2bfe723800 20 get_obj_state: octx=0x55b4a69369b0 obj=myver:z state=0x55b4a6be7438 s->prefetch_data=0 2024-09-12T17:48:51.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.551+0000 7f2bfe723800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cil82drgxe2m245wym2po6uksmvxlxw6 2024-09-12T17:48:51.554 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.553+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.555+0000 7f2bfe723800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19.3.9 2024-09-12T17:48:51.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.555+0000 7f2bfe723800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T17:48:51.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.555+0000 7f2bfe723800 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T17:48:51.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.556+0000 7f2ab0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:51.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.558+0000 7f2bfe723800 20 remove_watcher() i=0 2024-09-12T17:48:51.558 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.558+0000 7f2bfe723800 2 removed watcher, disabling cache 2024-09-12T17:48:51.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.560+0000 7f2bfe723800 20 remove_watcher() i=1 2024-09-12T17:48:51.561 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.561+0000 7f2bfe723800 20 remove_watcher() i=2 2024-09-12T17:48:51.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.562+0000 7f2bfe723800 20 remove_watcher() i=3 2024-09-12T17:48:51.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.563+0000 7f2bfe723800 20 remove_watcher() i=4 2024-09-12T17:48:51.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.564+0000 7f2bfe723800 20 remove_watcher() i=5 2024-09-12T17:48:51.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.565+0000 7f2bfe723800 20 remove_watcher() i=6 2024-09-12T17:48:51.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.566+0000 7f2bfe723800 20 remove_watcher() i=7 2024-09-12T17:48:51.629 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:48:51.658 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:51.658 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:51.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.697+0000 7fc3b9126800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.699+0000 7fc3b9126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.699 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.699+0000 7fc3b9126800 20 realm 2024-09-12T17:48:51.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.699+0000 7fc3b9126800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.699+0000 7fc3b9126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.699+0000 7fc3b9126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:51.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.699+0000 7fc3b9126800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.699+0000 7fc3b9126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.700 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.699+0000 7fc3b9126800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.700+0000 7fc3b9126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:51.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.700+0000 7fc3b9126800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.700+0000 7fc3b9126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:51.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.700+0000 7fc3b9126800 20 searching for the correct realm 2024-09-12T17:48:51.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.703+0000 7fc3b466e640 0 -- 172.21.15.44:0/508418313 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fc3a4040020 msgr2=0x7fc3a406b4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:51.707 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.706+0000 7fc3b4e6f640 0 -- 172.21.15.44:0/508418313 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fc3a806cc10 msgr2=0x7fc3a80b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:51.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.912+0000 7fc3b9126800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:48:51.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.912+0000 7fc3b9126800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:48:51.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.912+0000 7fc3b9126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:51.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.912+0000 7fc3b9126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:51.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.912+0000 7fc3b9126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:51.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.912+0000 7fc3b9126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:51.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.912+0000 7fc3b9126800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.912+0000 7fc3b9126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.912+0000 7fc3b9126800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.912+0000 7fc3b9126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:51.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.912+0000 7fc3b9126800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.913+0000 7fc3b9126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:51.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.913+0000 7fc3b9126800 20 zone default found 2024-09-12T17:48:51.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.913+0000 7fc3b9126800 4 Realm: () 2024-09-12T17:48:51.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.913+0000 7fc3b9126800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:48:51.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.913+0000 7fc3b9126800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:48:51.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.913+0000 7fc3b9126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:51.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.913+0000 7fc3b9126800 20 zonegroup default 2024-09-12T17:48:51.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.913+0000 7fc3b9126800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.913+0000 7fc3b9126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.913+0000 7fc3b9126800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.913+0000 7fc3b9126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.913+0000 7fc3b9126800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.914+0000 7fc3b9126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.914+0000 7fc3b9126800 20 started sync module instance, tier type = 2024-09-12T17:48:51.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.914+0000 7fc3b9126800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:48:51.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.923+0000 7fc3b9126800 20 add_watcher() i=0 2024-09-12T17:48:51.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.923+0000 7fc3b9126800 20 add_watcher() i=1 2024-09-12T17:48:51.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.923+0000 7fc3b9126800 20 add_watcher() i=2 2024-09-12T17:48:51.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.923+0000 7fc3b9126800 20 add_watcher() i=3 2024-09-12T17:48:51.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.923+0000 7fc3b9126800 20 add_watcher() i=4 2024-09-12T17:48:51.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.923+0000 7fc3b9126800 20 add_watcher() i=5 2024-09-12T17:48:51.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.923+0000 7fc3b9126800 20 add_watcher() i=6 2024-09-12T17:48:51.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.924+0000 7fc3b9126800 20 add_watcher() i=7 2024-09-12T17:48:51.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.924+0000 7fc3b9126800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:51.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.926+0000 7fc26afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:51.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.926+0000 7fc3b9126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:51.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.926+0000 7fc3b9126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:51.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.926+0000 7fc3b9126800 5 note: GC not initialized 2024-09-12T17:48:51.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.926+0000 7fc269fe3640 20 reqs_thread_entry: start 2024-09-12T17:48:51.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.926+0000 7fc3b9126800 20 init_complete bucket index max shards: 11 2024-09-12T17:48:51.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.926+0000 7fc3b9126800 20 Filter name: none 2024-09-12T17:48:51.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.926+0000 7fc1db7fe640 20 reqs_thread_entry: start 2024-09-12T17:48:51.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.927+0000 7fc3b9126800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.927+0000 7fc3b9126800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:48:51.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.927+0000 7fc3b9126800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.927+0000 7fc3b9126800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:48:51.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.927+0000 7fc3b9126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:51.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.927+0000 7fc3b9126800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.928+0000 7fc3b9126800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:48:51.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.928+0000 7fc3b9126800 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.928+0000 7fc3b9126800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:48:51.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.928+0000 7fc3b9126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:51.931 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.930+0000 7fc26afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:51.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.932+0000 7fc3b9126800 20 remove_watcher() i=0 2024-09-12T17:48:51.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.932+0000 7fc3b9126800 2 removed watcher, disabling cache 2024-09-12T17:48:51.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.933+0000 7fc3b9126800 20 remove_watcher() i=1 2024-09-12T17:48:51.935 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.934+0000 7fc3b9126800 20 remove_watcher() i=2 2024-09-12T17:48:51.936 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.935+0000 7fc3b9126800 20 remove_watcher() i=3 2024-09-12T17:48:51.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.936+0000 7fc3b9126800 20 remove_watcher() i=4 2024-09-12T17:48:51.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.937+0000 7fc3b9126800 20 remove_watcher() i=5 2024-09-12T17:48:51.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.938+0000 7fc3b9126800 20 remove_watcher() i=6 2024-09-12T17:48:51.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T17:48:51.939+0000 7fc3b9126800 20 remove_watcher() i=7 2024-09-12T17:48:51.951 INFO:tasks.workunit.client.0.smithi044.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:48:51.951 INFO:tasks.workunit.client.0.smithi044.stderr:Deleting bucket a-bucket 2024-09-12T17:48:51.970 INFO:tasks.workunit.client.0.smithi044.stderr:Deleting bucket myver 2024-09-12T17:48:52.050 INFO:tasks.workunit.client.0.smithi044.stderr:Completed resharding tests 2024-09-12T17:48:52.051 INFO:tasks.workunit.client.0.smithi044.stdout:connected to http://localhost:80 2024-09-12T17:48:52.131 INFO:tasks.workunit.client.0.smithi044.stderr:+ deactivate 2024-09-12T17:48:52.132 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T17:48:52.132 INFO:tasks.workunit.client.0.smithi044.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:48:52.132 INFO:tasks.workunit.client.0.smithi044.stderr:+ export PATH 2024-09-12T17:48:52.132 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:48:52.132 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n '' ']' 2024-09-12T17:48:52.132 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:48:52.132 INFO:tasks.workunit.client.0.smithi044.stderr:+ hash -r 2024-09-12T17:48:52.132 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n '' ']' 2024-09-12T17:48:52.132 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:48:52.132 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:48:52.132 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset -f deactivate 2024-09-12T17:48:52.133 INFO:tasks.workunit.client.0.smithi044.stderr:+ echo OK. 2024-09-12T17:48:52.133 INFO:tasks.workunit.client.0.smithi044.stdout:OK. 2024-09-12T17:48:52.134 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:48:52.134 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:48:52.214 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T17:48:52.214 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:48:52.651 DEBUG:teuthology.parallel:result is None 2024-09-12T17:48:52.651 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:48:52.691 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:48:52.691 DEBUG:teuthology.orchestra.run.smithi044:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:48:52.762 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:48:52.762 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T17:48:52.778 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T17:48:52.779 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T17:48:52.779 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T17:48:52.779 DEBUG:teuthology.orchestra.run.smithi044:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T17:48:52.832 INFO:teuthology.orchestra.run.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T17:48:57.253 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T17:48:57.254 DEBUG:teuthology.orchestra.run.smithi044:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T17:48:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-12T17:48:59.973 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:28:31 ago on Thu 12 Sep 2024 05:20:28 PM UTC. 2024-09-12T17:49:00.118 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-12T17:49:00.119 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-12T17:49:00.119 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-09-12T17:49:00.120 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-12T17:49:00.120 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-12T17:49:00.120 INFO:teuthology.orchestra.run.smithi044.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-12T17:49:00.120 INFO:teuthology.orchestra.run.smithi044.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-12T17:49:00.120 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-09-12T17:49:00.120 INFO:teuthology.orchestra.run.smithi044.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-12T17:49:00.120 INFO:teuthology.orchestra.run.smithi044.stdout:Installing weak dependencies: 2024-09-12T17:49:00.120 INFO:teuthology.orchestra.run.smithi044.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-12T17:49:00.120 INFO:teuthology.orchestra.run.smithi044.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-12T17:49:00.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:00.121 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-12T17:49:00.121 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-09-12T17:49:00.121 INFO:teuthology.orchestra.run.smithi044.stdout:Install 5 Packages 2024-09-12T17:49:00.121 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:00.121 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 46 M 2024-09-12T17:49:00.122 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 166 M 2024-09-12T17:49:00.122 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-12T17:49:00.496 INFO:teuthology.orchestra.run.smithi044.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 1.7 MB/s | 426 kB 00:00 2024-09-12T17:49:01.105 INFO:teuthology.orchestra.run.smithi044.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 4.1 MB/s | 3.5 MB 00:00 2024-09-12T17:49:01.155 INFO:teuthology.orchestra.run.smithi044.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 520 kB/s | 26 kB 00:00 2024-09-12T17:49:02.614 INFO:teuthology.orchestra.run.smithi044.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 3.9 MB/s | 9.3 MB 00:02 2024-09-12T17:49:05.656 INFO:teuthology.orchestra.run.smithi044.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 6.3 MB/s | 32 MB 00:05 2024-09-12T17:49:05.656 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:49:05.656 INFO:teuthology.orchestra.run.smithi044.stdout:Total 8.2 MB/s | 46 MB 00:05 2024-09-12T17:49:06.097 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-12T17:49:06.120 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-12T17:49:06.121 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-12T17:49:06.622 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-12T17:49:06.623 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-12T17:49:07.161 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-12T17:49:07.317 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-12T17:49:07.498 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-12T17:49:08.148 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-12T17:49:08.192 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T17:49:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T17:49:08.468 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T17:49:08.708 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T17:49:08.747 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T17:49:08.755 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T17:49:08.766 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-12T17:49:08.808 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-12T17:49:11.836 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T17:49:11.836 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-12T17:49:11.836 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-12T17:49:11.836 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-12T17:49:11.836 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-12T17:49:12.232 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-12T17:49:12.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:12.233 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-12T17:49:12.233 INFO:teuthology.orchestra.run.smithi044.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-12T17:49:12.233 INFO:teuthology.orchestra.run.smithi044.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T17:49:12.233 INFO:teuthology.orchestra.run.smithi044.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T17:49:12.233 INFO:teuthology.orchestra.run.smithi044.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T17:49:12.233 INFO:teuthology.orchestra.run.smithi044.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-12T17:49:12.233 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:12.233 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-12T17:49:12.715 INFO:teuthology.orchestra.run.smithi044.stdout: Gradle will be installed under /opt/gradle 2024-09-12T17:49:12.822 INFO:teuthology.orchestra.run.smithi044.stderr:--2024-09-12 17:49:12-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T17:49:13.228 INFO:teuthology.orchestra.run.smithi044.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4865, ... 2024-09-12T17:49:13.236 INFO:teuthology.orchestra.run.smithi044.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-12T17:49:13.303 INFO:teuthology.orchestra.run.smithi044.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T17:49:13.304 INFO:teuthology.orchestra.run.smithi044.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T17:49:13.304 INFO:teuthology.orchestra.run.smithi044.stderr:--2024-09-12 17:49:13-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T17:49:13.304 INFO:teuthology.orchestra.run.smithi044.stderr:Resolving github.com (github.com)... 140.82.114.4 2024-09-12T17:49:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:Connecting to github.com (github.com)|140.82.114.4|:443... connected. 2024-09-12T17:49:13.450 INFO:teuthology.orchestra.run.smithi044.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T17:49:13.450 INFO:teuthology.orchestra.run.smithi044.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T174913Z&X-Amz-Expires=300&X-Amz-Signature=8e808c956d4988632fa88c0fdaeedabd02dbf5e89c7929729490c4957417202b&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T17:49:13.450 INFO:teuthology.orchestra.run.smithi044.stderr:--2024-09-12 17:49:13-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T174913Z&X-Amz-Expires=300&X-Amz-Signature=8e808c956d4988632fa88c0fdaeedabd02dbf5e89c7929729490c4957417202b&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T17:49:13.450 INFO:teuthology.orchestra.run.smithi044.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.110.133, 185.199.108.133, ... 2024-09-12T17:49:13.462 INFO:teuthology.orchestra.run.smithi044.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected. 2024-09-12T17:49:13.537 INFO:teuthology.orchestra.run.smithi044.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T17:49:13.537 INFO:teuthology.orchestra.run.smithi044.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T17:49:13.537 INFO:teuthology.orchestra.run.smithi044.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-12T17:49:13.538 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T17:49:13.550 INFO:teuthology.orchestra.run.smithi044.stderr: 0K .......... .......... .......... .......... .......... 0% 3.44M 26s 2024-09-12T17:49:13.562 INFO:teuthology.orchestra.run.smithi044.stderr: 50K .......... .......... .......... .......... .......... 0% 3.83M 25s 2024-09-12T17:49:13.571 INFO:teuthology.orchestra.run.smithi044.stderr: 100K .......... .......... .......... .......... .......... 0% 5.52M 22s 2024-09-12T17:49:13.573 INFO:teuthology.orchestra.run.smithi044.stderr: 150K .......... .......... .......... .......... .......... 0% 22.1M 18s 2024-09-12T17:49:13.575 INFO:teuthology.orchestra.run.smithi044.stderr: 200K .......... .......... .......... .......... .......... 0% 23.3M 15s 2024-09-12T17:49:13.582 INFO:teuthology.orchestra.run.smithi044.stderr: 250K .......... .......... .......... .......... .......... 0% 7.69M 14s 2024-09-12T17:49:13.583 INFO:teuthology.orchestra.run.smithi044.stderr: 300K .......... .......... .......... .......... .......... 0% 35.7M 13s 2024-09-12T17:49:13.585 INFO:teuthology.orchestra.run.smithi044.stderr: 350K .......... .......... .......... .......... .......... 0% 29.9M 11s 2024-09-12T17:49:13.585 INFO:teuthology.orchestra.run.smithi044.stderr: 400K .......... .......... .......... .......... .......... 0% 64.3M 10s 2024-09-12T17:49:13.587 INFO:teuthology.orchestra.run.smithi044.stderr: 450K .......... .......... .......... .......... .......... 0% 47.0M 9s 2024-09-12T17:49:13.588 INFO:teuthology.orchestra.run.smithi044.stderr: 500K .......... .......... .......... .......... .......... 0% 33.7M 9s 2024-09-12T17:49:13.594 INFO:teuthology.orchestra.run.smithi044.stderr: 550K .......... .......... .......... .......... .......... 0% 9.32M 9s 2024-09-12T17:49:13.594 INFO:teuthology.orchestra.run.smithi044.stderr: 600K .......... .......... .......... .......... .......... 0% 337M 8s 2024-09-12T17:49:15.192 INFO:teuthology.orchestra.run.smithi044.stderr: 650K .......... .......... .......... .......... .......... 0% 36.2M 8s 2024-09-12T17:49:15.193 INFO:teuthology.orchestra.run.smithi044.stderr: 700K .......... .......... .......... .......... .......... 0% 78.1M 7s 2024-09-12T17:49:15.193 INFO:teuthology.orchestra.run.smithi044.stderr: 750K .......... .......... .......... .......... .......... 0% 44.6M 7s 2024-09-12T17:49:15.193 INFO:teuthology.orchestra.run.smithi044.stderr: 800K .......... .......... .......... .......... .......... 0% 244M 7s 2024-09-12T17:49:15.193 INFO:teuthology.orchestra.run.smithi044.stderr: 850K .......... .......... .......... .......... .......... 0% 353M 6s 2024-09-12T17:49:15.193 INFO:teuthology.orchestra.run.smithi044.stderr: 900K .......... .......... .......... .......... .......... 1% 38.8M 6s 2024-09-12T17:49:15.193 INFO:teuthology.orchestra.run.smithi044.stderr: 950K .......... .......... .......... .......... .......... 1% 156M 6s 2024-09-12T17:49:15.193 INFO:teuthology.orchestra.run.smithi044.stderr: 1000K .......... .......... .......... .......... .......... 1% 52.5M 6s 2024-09-12T17:49:15.193 INFO:teuthology.orchestra.run.smithi044.stderr: 1050K .......... .......... .......... .......... .......... 1% 322M 5s 2024-09-12T17:49:15.193 INFO:teuthology.orchestra.run.smithi044.stderr: 1100K .......... .......... .......... .......... .......... 1% 164M 5s 2024-09-12T17:49:15.193 INFO:teuthology.orchestra.run.smithi044.stderr: 1150K .......... .......... .......... .......... .......... 1% 9.18M 5s 2024-09-12T17:49:15.193 INFO:teuthology.orchestra.run.smithi044.stderr: 1200K .......... .......... .......... .......... .......... 1% 333M 5s 2024-09-12T17:49:15.194 INFO:teuthology.orchestra.run.smithi044.stderr: 1250K .......... .......... .......... .......... .......... 1% 57.2M 5s 2024-09-12T17:49:15.194 INFO:teuthology.orchestra.run.smithi044.stderr: 1300K .......... .......... .......... .......... .......... 1% 175M 5s 2024-09-12T17:49:15.194 INFO:teuthology.orchestra.run.smithi044.stderr: 1350K .......... .......... .......... .......... .......... 1% 348M 5s 2024-09-12T17:49:15.194 INFO:teuthology.orchestra.run.smithi044.stderr: 1400K .......... .......... .......... .......... .......... 1% 73.0M 5s 2024-09-12T17:49:15.194 INFO:teuthology.orchestra.run.smithi044.stderr: 1450K .......... .......... .......... .......... .......... 1% 255M 4s 2024-09-12T17:49:15.194 INFO:teuthology.orchestra.run.smithi044.stderr: 1500K .......... .......... .......... .......... .......... 1% 108M 4s 2024-09-12T17:49:15.194 INFO:teuthology.orchestra.run.smithi044.stderr: 1550K .......... .......... .......... .......... .......... 1% 336M 4s 2024-09-12T17:49:15.194 INFO:teuthology.orchestra.run.smithi044.stderr: 1600K .......... .......... .......... .......... .......... 1% 180M 4s 2024-09-12T17:49:15.194 INFO:teuthology.orchestra.run.smithi044.stderr: 1650K .......... .......... .......... .......... .......... 1% 144M 4s 2024-09-12T17:49:15.195 INFO:teuthology.orchestra.run.smithi044.stderr: 1700K .......... .......... .......... .......... .......... 1% 132M 4s 2024-09-12T17:49:15.195 INFO:teuthology.orchestra.run.smithi044.stderr: 1750K .......... .......... .......... .......... .......... 1% 221M 4s 2024-09-12T17:49:15.195 INFO:teuthology.orchestra.run.smithi044.stderr: 1800K .......... .......... .......... .......... .......... 1% 109M 4s 2024-09-12T17:49:15.195 INFO:teuthology.orchestra.run.smithi044.stderr: 1850K .......... .......... .......... .......... .......... 2% 214M 4s 2024-09-12T17:49:15.195 INFO:teuthology.orchestra.run.smithi044.stderr: 1900K .......... .......... .......... .......... .......... 2% 149M 3s 2024-09-12T17:49:15.195 INFO:teuthology.orchestra.run.smithi044.stderr: 1950K .......... .......... .......... .......... .......... 2% 153M 3s 2024-09-12T17:49:15.195 INFO:teuthology.orchestra.run.smithi044.stderr: 2000K .......... .......... .......... .......... .......... 2% 291M 3s 2024-09-12T17:49:15.195 INFO:teuthology.orchestra.run.smithi044.stderr: 2050K .......... .......... .......... .......... .......... 2% 171M 3s 2024-09-12T17:49:15.195 INFO:teuthology.orchestra.run.smithi044.stderr: 2100K .......... .......... .......... .......... .......... 2% 169M 3s 2024-09-12T17:49:15.196 INFO:teuthology.orchestra.run.smithi044.stderr: 2150K .......... .......... .......... .......... .......... 2% 173M 3s 2024-09-12T17:49:15.196 INFO:teuthology.orchestra.run.smithi044.stderr: 2200K .......... .......... .......... .......... .......... 2% 324M 3s 2024-09-12T17:49:15.196 INFO:teuthology.orchestra.run.smithi044.stderr: 2250K .......... .......... .......... .......... .......... 2% 173M 3s 2024-09-12T17:49:15.196 INFO:teuthology.orchestra.run.smithi044.stderr: 2300K .......... .......... .......... .......... .......... 2% 10.2M 3s 2024-09-12T17:49:15.196 INFO:teuthology.orchestra.run.smithi044.stderr: 2350K .......... .......... .......... .......... .......... 2% 334M 3s 2024-09-12T17:49:15.196 INFO:teuthology.orchestra.run.smithi044.stderr: 2400K .......... .......... .......... .......... .......... 2% 329M 3s 2024-09-12T17:49:15.196 INFO:teuthology.orchestra.run.smithi044.stderr: 2450K .......... .......... .......... .......... .......... 2% 346M 3s 2024-09-12T17:49:15.196 INFO:teuthology.orchestra.run.smithi044.stderr: 2500K .......... .......... .......... .......... .......... 2% 292M 3s 2024-09-12T17:49:15.196 INFO:teuthology.orchestra.run.smithi044.stderr: 2550K .......... .......... .......... .......... .......... 2% 221M 3s 2024-09-12T17:49:15.196 INFO:teuthology.orchestra.run.smithi044.stderr: 2600K .......... .......... .......... .......... .......... 2% 330M 3s 2024-09-12T17:49:15.197 INFO:teuthology.orchestra.run.smithi044.stderr: 2650K .......... .......... .......... .......... .......... 2% 360M 3s 2024-09-12T17:49:15.197 INFO:teuthology.orchestra.run.smithi044.stderr: 2700K .......... .......... .......... .......... .......... 2% 198M 3s 2024-09-12T17:49:15.197 INFO:teuthology.orchestra.run.smithi044.stderr: 2750K .......... .......... .......... .......... .......... 3% 309M 3s 2024-09-12T17:49:15.197 INFO:teuthology.orchestra.run.smithi044.stderr: 2800K .......... .......... .......... .......... .......... 3% 93.0M 3s 2024-09-12T17:49:15.197 INFO:teuthology.orchestra.run.smithi044.stderr: 2850K .......... .......... .......... .......... .......... 3% 290M 3s 2024-09-12T17:49:15.197 INFO:teuthology.orchestra.run.smithi044.stderr: 2900K .......... .......... .......... .......... .......... 3% 120M 3s 2024-09-12T17:49:15.197 INFO:teuthology.orchestra.run.smithi044.stderr: 2950K .......... .......... .......... .......... .......... 3% 280M 3s 2024-09-12T17:49:15.197 INFO:teuthology.orchestra.run.smithi044.stderr: 3000K .......... .......... .......... .......... .......... 3% 286M 2s 2024-09-12T17:49:15.197 INFO:teuthology.orchestra.run.smithi044.stderr: 3050K .......... .......... .......... .......... .......... 3% 317M 2s 2024-09-12T17:49:15.197 INFO:teuthology.orchestra.run.smithi044.stderr: 3100K .......... .......... .......... .......... .......... 3% 287M 2s 2024-09-12T17:49:15.197 INFO:teuthology.orchestra.run.smithi044.stderr: 3150K .......... .......... .......... .......... .......... 3% 343M 2s 2024-09-12T17:49:15.198 INFO:teuthology.orchestra.run.smithi044.stderr: 3200K .......... .......... .......... .......... .......... 3% 307M 2s 2024-09-12T17:49:15.198 INFO:teuthology.orchestra.run.smithi044.stderr: 3250K .......... .......... .......... .......... .......... 3% 336M 2s 2024-09-12T17:49:15.198 INFO:teuthology.orchestra.run.smithi044.stderr: 3300K .......... .......... .......... .......... .......... 3% 251M 2s 2024-09-12T17:49:15.198 INFO:teuthology.orchestra.run.smithi044.stderr: 3350K .......... .......... .......... .......... .......... 3% 257M 2s 2024-09-12T17:49:15.198 INFO:teuthology.orchestra.run.smithi044.stderr: 3400K .......... .......... .......... .......... .......... 3% 290M 2s 2024-09-12T17:49:15.198 INFO:teuthology.orchestra.run.smithi044.stderr: 3450K .......... .......... .......... .......... .......... 3% 299M 2s 2024-09-12T17:49:15.198 INFO:teuthology.orchestra.run.smithi044.stderr: 3500K .......... .......... .......... .......... .......... 3% 229M 2s 2024-09-12T17:49:15.198 INFO:teuthology.orchestra.run.smithi044.stderr: 3550K .......... .......... .......... .......... .......... 3% 336M 2s 2024-09-12T17:49:15.198 INFO:teuthology.orchestra.run.smithi044.stderr: 3600K .......... .......... .......... .......... .......... 3% 351M 2s 2024-09-12T17:49:15.198 INFO:teuthology.orchestra.run.smithi044.stderr: 3650K .......... .......... .......... .......... .......... 3% 344M 2s 2024-09-12T17:49:15.198 INFO:teuthology.orchestra.run.smithi044.stderr: 3700K .......... .......... .......... .......... .......... 4% 307M 2s 2024-09-12T17:49:15.199 INFO:teuthology.orchestra.run.smithi044.stderr: 3750K .......... .......... .......... .......... .......... 4% 346M 2s 2024-09-12T17:49:15.199 INFO:teuthology.orchestra.run.smithi044.stderr: 3800K .......... .......... .......... .......... .......... 4% 300M 2s 2024-09-12T17:49:15.199 INFO:teuthology.orchestra.run.smithi044.stderr: 3850K .......... .......... .......... .......... .......... 4% 340M 2s 2024-09-12T17:49:15.199 INFO:teuthology.orchestra.run.smithi044.stderr: 3900K .......... .......... .......... .......... .......... 4% 292M 2s 2024-09-12T17:49:15.199 INFO:teuthology.orchestra.run.smithi044.stderr: 3950K .......... .......... .......... .......... .......... 4% 370M 2s 2024-09-12T17:49:15.199 INFO:teuthology.orchestra.run.smithi044.stderr: 4000K .......... .......... .......... .......... .......... 4% 312M 2s 2024-09-12T17:49:15.199 INFO:teuthology.orchestra.run.smithi044.stderr: 4050K .......... .......... .......... .......... .......... 4% 346M 2s 2024-09-12T17:49:15.199 INFO:teuthology.orchestra.run.smithi044.stderr: 4100K .......... .......... .......... .......... .......... 4% 320M 2s 2024-09-12T17:49:15.199 INFO:teuthology.orchestra.run.smithi044.stderr: 4150K .......... .......... .......... .......... .......... 4% 183M 2s 2024-09-12T17:49:15.199 INFO:teuthology.orchestra.run.smithi044.stderr: 4200K .......... .......... .......... .......... .......... 4% 258M 2s 2024-09-12T17:49:15.199 INFO:teuthology.orchestra.run.smithi044.stderr: 4250K .......... .......... .......... .......... .......... 4% 337M 2s 2024-09-12T17:49:15.199 INFO:teuthology.orchestra.run.smithi044.stderr: 4300K .......... .......... .......... .......... .......... 4% 334M 2s 2024-09-12T17:49:15.200 INFO:teuthology.orchestra.run.smithi044.stderr: 4350K .......... .......... .......... .......... .......... 4% 345M 2s 2024-09-12T17:49:15.200 INFO:teuthology.orchestra.run.smithi044.stderr: 4400K .......... .......... .......... .......... .......... 4% 309M 2s 2024-09-12T17:49:15.200 INFO:teuthology.orchestra.run.smithi044.stderr: 4450K .......... .......... .......... .......... .......... 4% 334M 2s 2024-09-12T17:49:15.200 INFO:teuthology.orchestra.run.smithi044.stderr: 4500K .......... .......... .......... .......... .......... 4% 362M 2s 2024-09-12T17:49:15.200 INFO:teuthology.orchestra.run.smithi044.stderr: 4550K .......... .......... .......... .......... .......... 4% 364M 2s 2024-09-12T17:49:15.200 INFO:teuthology.orchestra.run.smithi044.stderr: 4600K .......... .......... .......... .......... .......... 5% 14.1M 2s 2024-09-12T17:49:15.200 INFO:teuthology.orchestra.run.smithi044.stderr: 4650K .......... .......... .......... .......... .......... 5% 290M 2s 2024-09-12T17:49:15.200 INFO:teuthology.orchestra.run.smithi044.stderr: 4700K .......... .......... .......... .......... .......... 5% 308M 2s 2024-09-12T17:49:15.200 INFO:teuthology.orchestra.run.smithi044.stderr: 4750K .......... .......... .......... .......... .......... 5% 253M 2s 2024-09-12T17:49:15.200 INFO:teuthology.orchestra.run.smithi044.stderr: 4800K .......... .......... .......... .......... .......... 5% 232M 2s 2024-09-12T17:49:15.200 INFO:teuthology.orchestra.run.smithi044.stderr: 4850K .......... .......... .......... .......... .......... 5% 261M 2s 2024-09-12T17:49:15.201 INFO:teuthology.orchestra.run.smithi044.stderr: 4900K .......... .......... .......... .......... .......... 5% 261M 2s 2024-09-12T17:49:15.201 INFO:teuthology.orchestra.run.smithi044.stderr: 4950K .......... .......... .......... .......... .......... 5% 214M 2s 2024-09-12T17:49:15.201 INFO:teuthology.orchestra.run.smithi044.stderr: 5000K .......... .......... .......... .......... .......... 5% 212M 2s 2024-09-12T17:49:15.201 INFO:teuthology.orchestra.run.smithi044.stderr: 5050K .......... .......... .......... .......... .......... 5% 334M 2s 2024-09-12T17:49:15.201 INFO:teuthology.orchestra.run.smithi044.stderr: 5100K .......... .......... .......... .......... .......... 5% 340M 2s 2024-09-12T17:49:15.201 INFO:teuthology.orchestra.run.smithi044.stderr: 5150K .......... .......... .......... .......... .......... 5% 332M 2s 2024-09-12T17:49:15.201 INFO:teuthology.orchestra.run.smithi044.stderr: 5200K .......... .......... .......... .......... .......... 5% 282M 2s 2024-09-12T17:49:15.201 INFO:teuthology.orchestra.run.smithi044.stderr: 5250K .......... .......... .......... .......... .......... 5% 345M 2s 2024-09-12T17:49:15.201 INFO:teuthology.orchestra.run.smithi044.stderr: 5300K .......... .......... .......... .......... .......... 5% 332M 2s 2024-09-12T17:49:15.201 INFO:teuthology.orchestra.run.smithi044.stderr: 5350K .......... .......... .......... .......... .......... 5% 292M 2s 2024-09-12T17:49:15.201 INFO:teuthology.orchestra.run.smithi044.stderr: 5400K .......... .......... .......... .......... .......... 5% 357M 2s 2024-09-12T17:49:15.202 INFO:teuthology.orchestra.run.smithi044.stderr: 5450K .......... .......... .......... .......... .......... 5% 340M 2s 2024-09-12T17:49:15.202 INFO:teuthology.orchestra.run.smithi044.stderr: 5500K .......... .......... .......... .......... .......... 5% 313M 2s 2024-09-12T17:49:15.202 INFO:teuthology.orchestra.run.smithi044.stderr: 5550K .......... .......... .......... .......... .......... 6% 293M 1s 2024-09-12T17:49:15.202 INFO:teuthology.orchestra.run.smithi044.stderr: 5600K .......... .......... .......... .......... .......... 6% 333M 1s 2024-09-12T17:49:15.202 INFO:teuthology.orchestra.run.smithi044.stderr: 5650K .......... .......... .......... .......... .......... 6% 339M 1s 2024-09-12T17:49:15.202 INFO:teuthology.orchestra.run.smithi044.stderr: 5700K .......... .......... .......... .......... .......... 6% 290M 1s 2024-09-12T17:49:15.202 INFO:teuthology.orchestra.run.smithi044.stderr: 5750K .......... .......... .......... .......... .......... 6% 352M 1s 2024-09-12T17:49:15.202 INFO:teuthology.orchestra.run.smithi044.stderr: 5800K .......... .......... .......... .......... .......... 6% 352M 1s 2024-09-12T17:49:15.202 INFO:teuthology.orchestra.run.smithi044.stderr: 5850K .......... .......... .......... .......... .......... 6% 338M 1s 2024-09-12T17:49:15.202 INFO:teuthology.orchestra.run.smithi044.stderr: 5900K .......... .......... .......... .......... .......... 6% 269M 1s 2024-09-12T17:49:15.202 INFO:teuthology.orchestra.run.smithi044.stderr: 5950K .......... .......... .......... .......... .......... 6% 307M 1s 2024-09-12T17:49:15.203 INFO:teuthology.orchestra.run.smithi044.stderr: 6000K .......... .......... .......... .......... .......... 6% 320M 1s 2024-09-12T17:49:15.203 INFO:teuthology.orchestra.run.smithi044.stderr: 6050K .......... .......... .......... .......... .......... 6% 285M 1s 2024-09-12T17:49:15.203 INFO:teuthology.orchestra.run.smithi044.stderr: 6100K .......... .......... .......... .......... .......... 6% 280M 1s 2024-09-12T17:49:15.203 INFO:teuthology.orchestra.run.smithi044.stderr: 6150K .......... .......... .......... .......... .......... 6% 331M 1s 2024-09-12T17:49:15.203 INFO:teuthology.orchestra.run.smithi044.stderr: 6200K .......... .......... .......... .......... .......... 6% 271M 1s 2024-09-12T17:49:15.203 INFO:teuthology.orchestra.run.smithi044.stderr: 6250K .......... .......... .......... .......... .......... 6% 289M 1s 2024-09-12T17:49:15.203 INFO:teuthology.orchestra.run.smithi044.stderr: 6300K .......... .......... .......... .......... .......... 6% 261M 1s 2024-09-12T17:49:15.203 INFO:teuthology.orchestra.run.smithi044.stderr: 6350K .......... .......... .......... .......... .......... 6% 307M 1s 2024-09-12T17:49:15.203 INFO:teuthology.orchestra.run.smithi044.stderr: 6400K .......... .......... .......... .......... .......... 6% 319M 1s 2024-09-12T17:49:15.203 INFO:teuthology.orchestra.run.smithi044.stderr: 6450K .......... .......... .......... .......... .......... 6% 318M 1s 2024-09-12T17:49:15.203 INFO:teuthology.orchestra.run.smithi044.stderr: 6500K .......... .......... .......... .......... .......... 7% 301M 1s 2024-09-12T17:49:15.203 INFO:teuthology.orchestra.run.smithi044.stderr: 6550K .......... .......... .......... .......... .......... 7% 327M 1s 2024-09-12T17:49:15.204 INFO:teuthology.orchestra.run.smithi044.stderr: 6600K .......... .......... .......... .......... .......... 7% 336M 1s 2024-09-12T17:49:15.204 INFO:teuthology.orchestra.run.smithi044.stderr: 6650K .......... .......... .......... .......... .......... 7% 345M 1s 2024-09-12T17:49:15.204 INFO:teuthology.orchestra.run.smithi044.stderr: 6700K .......... .......... .......... .......... .......... 7% 272M 1s 2024-09-12T17:49:15.204 INFO:teuthology.orchestra.run.smithi044.stderr: 6750K .......... .......... .......... .......... .......... 7% 331M 1s 2024-09-12T17:49:15.204 INFO:teuthology.orchestra.run.smithi044.stderr: 6800K .......... .......... .......... .......... .......... 7% 296M 1s 2024-09-12T17:49:15.204 INFO:teuthology.orchestra.run.smithi044.stderr: 6850K .......... .......... .......... .......... .......... 7% 355M 1s 2024-09-12T17:49:15.204 INFO:teuthology.orchestra.run.smithi044.stderr: 6900K .......... .......... .......... .......... .......... 7% 280M 1s 2024-09-12T17:49:15.204 INFO:teuthology.orchestra.run.smithi044.stderr: 6950K .......... .......... .......... .......... .......... 7% 171M 1s 2024-09-12T17:49:15.204 INFO:teuthology.orchestra.run.smithi044.stderr: 7000K .......... .......... .......... .......... .......... 7% 206M 1s 2024-09-12T17:49:15.204 INFO:teuthology.orchestra.run.smithi044.stderr: 7050K .......... .......... .......... .......... .......... 7% 297M 1s 2024-09-12T17:49:15.204 INFO:teuthology.orchestra.run.smithi044.stderr: 7100K .......... .......... .......... .......... .......... 7% 292M 1s 2024-09-12T17:49:15.205 INFO:teuthology.orchestra.run.smithi044.stderr: 7150K .......... .......... .......... .......... .......... 7% 354M 1s 2024-09-12T17:49:15.205 INFO:teuthology.orchestra.run.smithi044.stderr: 7200K .......... .......... .......... .......... .......... 7% 364M 1s 2024-09-12T17:49:15.205 INFO:teuthology.orchestra.run.smithi044.stderr: 7250K .......... .......... .......... .......... .......... 7% 356M 1s 2024-09-12T17:49:15.205 INFO:teuthology.orchestra.run.smithi044.stderr: 7300K .......... .......... .......... .......... .......... 7% 284M 1s 2024-09-12T17:49:15.205 INFO:teuthology.orchestra.run.smithi044.stderr: 7350K .......... .......... .......... .......... .......... 7% 344M 1s 2024-09-12T17:49:15.205 INFO:teuthology.orchestra.run.smithi044.stderr: 7400K .......... .......... .......... .......... .......... 8% 306M 1s 2024-09-12T17:49:15.205 INFO:teuthology.orchestra.run.smithi044.stderr: 7450K .......... .......... .......... .......... .......... 8% 366M 1s 2024-09-12T17:49:15.205 INFO:teuthology.orchestra.run.smithi044.stderr: 7500K .......... .......... .......... .......... .......... 8% 328M 1s 2024-09-12T17:49:15.205 INFO:teuthology.orchestra.run.smithi044.stderr: 7550K .......... .......... .......... .......... .......... 8% 26.1M 1s 2024-09-12T17:49:15.205 INFO:teuthology.orchestra.run.smithi044.stderr: 7600K .......... .......... .......... .......... .......... 8% 284M 1s 2024-09-12T17:49:15.205 INFO:teuthology.orchestra.run.smithi044.stderr: 7650K .......... .......... .......... .......... .......... 8% 328M 1s 2024-09-12T17:49:15.206 INFO:teuthology.orchestra.run.smithi044.stderr: 7700K .......... .......... .......... .......... .......... 8% 281M 1s 2024-09-12T17:49:15.206 INFO:teuthology.orchestra.run.smithi044.stderr: 7750K .......... .......... .......... .......... .......... 8% 363M 1s 2024-09-12T17:49:15.206 INFO:teuthology.orchestra.run.smithi044.stderr: 7800K .......... .......... .......... .......... .......... 8% 319M 1s 2024-09-12T17:49:15.206 INFO:teuthology.orchestra.run.smithi044.stderr: 7850K .......... .......... .......... .......... .......... 8% 172M 1s 2024-09-12T17:49:15.206 INFO:teuthology.orchestra.run.smithi044.stderr: 7900K .......... .......... .......... .......... .......... 8% 243M 1s 2024-09-12T17:49:15.206 INFO:teuthology.orchestra.run.smithi044.stderr: 7950K .......... .......... .......... .......... .......... 8% 290M 1s 2024-09-12T17:49:15.206 INFO:teuthology.orchestra.run.smithi044.stderr: 8000K .......... .......... .......... .......... .......... 8% 343M 1s 2024-09-12T17:49:15.206 INFO:teuthology.orchestra.run.smithi044.stderr: 8050K .......... .......... .......... .......... .......... 8% 348M 1s 2024-09-12T17:49:15.206 INFO:teuthology.orchestra.run.smithi044.stderr: 8100K .......... .......... .......... .......... .......... 8% 287M 1s 2024-09-12T17:49:15.206 INFO:teuthology.orchestra.run.smithi044.stderr: 8150K .......... .......... .......... .......... .......... 8% 342M 1s 2024-09-12T17:49:15.206 INFO:teuthology.orchestra.run.smithi044.stderr: 8200K .......... .......... .......... .......... .......... 8% 257M 1s 2024-09-12T17:49:15.206 INFO:teuthology.orchestra.run.smithi044.stderr: 8250K .......... .......... .......... .......... .......... 8% 277M 1s 2024-09-12T17:49:15.207 INFO:teuthology.orchestra.run.smithi044.stderr: 8300K .......... .......... .......... .......... .......... 8% 217M 1s 2024-09-12T17:49:15.207 INFO:teuthology.orchestra.run.smithi044.stderr: 8350K .......... .......... .......... .......... .......... 9% 331M 1s 2024-09-12T17:49:15.207 INFO:teuthology.orchestra.run.smithi044.stderr: 8400K .......... .......... .......... .......... .......... 9% 326M 1s 2024-09-12T17:49:15.207 INFO:teuthology.orchestra.run.smithi044.stderr: 8450K .......... .......... .......... .......... .......... 9% 356M 1s 2024-09-12T17:49:15.207 INFO:teuthology.orchestra.run.smithi044.stderr: 8500K .......... .......... .......... .......... .......... 9% 323M 1s 2024-09-12T17:49:15.207 INFO:teuthology.orchestra.run.smithi044.stderr: 8550K .......... .......... .......... .......... .......... 9% 349M 1s 2024-09-12T17:49:15.207 INFO:teuthology.orchestra.run.smithi044.stderr: 8600K .......... .......... .......... .......... .......... 9% 165M 1s 2024-09-12T17:49:15.207 INFO:teuthology.orchestra.run.smithi044.stderr: 8650K .......... .......... .......... .......... .......... 9% 271M 1s 2024-09-12T17:49:15.207 INFO:teuthology.orchestra.run.smithi044.stderr: 8700K .......... .......... .......... .......... .......... 9% 273M 1s 2024-09-12T17:49:15.207 INFO:teuthology.orchestra.run.smithi044.stderr: 8750K .......... .......... .......... .......... .......... 9% 338M 1s 2024-09-12T17:49:15.207 INFO:teuthology.orchestra.run.smithi044.stderr: 8800K .......... .......... .......... .......... .......... 9% 336M 1s 2024-09-12T17:49:15.208 INFO:teuthology.orchestra.run.smithi044.stderr: 8850K .......... .......... .......... .......... .......... 9% 333M 1s 2024-09-12T17:49:15.208 INFO:teuthology.orchestra.run.smithi044.stderr: 8900K .......... .......... .......... .......... .......... 9% 308M 1s 2024-09-12T17:49:15.208 INFO:teuthology.orchestra.run.smithi044.stderr: 8950K .......... .......... .......... .......... .......... 9% 316M 1s 2024-09-12T17:49:15.208 INFO:teuthology.orchestra.run.smithi044.stderr: 9000K .......... .......... .......... .......... .......... 9% 342M 1s 2024-09-12T17:49:15.208 INFO:teuthology.orchestra.run.smithi044.stderr: 9050K .......... .......... .......... .......... .......... 9% 365M 1s 2024-09-12T17:49:15.208 INFO:teuthology.orchestra.run.smithi044.stderr: 9100K .......... .......... .......... .......... .......... 9% 156M 1s 2024-09-12T17:49:15.208 INFO:teuthology.orchestra.run.smithi044.stderr: 9150K .......... .......... .......... .......... .......... 9% 44.1M 1s 2024-09-12T17:49:15.208 INFO:teuthology.orchestra.run.smithi044.stderr: 9200K .......... .......... .......... .......... .......... 9% 290M 1s 2024-09-12T17:49:15.208 INFO:teuthology.orchestra.run.smithi044.stderr: 9250K .......... .......... .......... .......... .......... 10% 281M 1s 2024-09-12T17:49:15.208 INFO:teuthology.orchestra.run.smithi044.stderr: 9300K .......... .......... .......... .......... .......... 10% 297M 1s 2024-09-12T17:49:15.208 INFO:teuthology.orchestra.run.smithi044.stderr: 9350K .......... .......... .......... .......... .......... 10% 328M 1s 2024-09-12T17:49:15.208 INFO:teuthology.orchestra.run.smithi044.stderr: 9400K .......... .......... .......... .......... .......... 10% 343M 1s 2024-09-12T17:49:15.209 INFO:teuthology.orchestra.run.smithi044.stderr: 9450K .......... .......... .......... .......... .......... 10% 337M 1s 2024-09-12T17:49:15.209 INFO:teuthology.orchestra.run.smithi044.stderr: 9500K .......... .......... .......... .......... .......... 10% 282M 1s 2024-09-12T17:49:15.209 INFO:teuthology.orchestra.run.smithi044.stderr: 9550K .......... .......... .......... .......... .......... 10% 342M 1s 2024-09-12T17:49:15.209 INFO:teuthology.orchestra.run.smithi044.stderr: 9600K .......... .......... .......... .......... .......... 10% 324M 1s 2024-09-12T17:49:15.209 INFO:teuthology.orchestra.run.smithi044.stderr: 9650K .......... .......... .......... .......... .......... 10% 317M 1s 2024-09-12T17:49:15.209 INFO:teuthology.orchestra.run.smithi044.stderr: 9700K .......... .......... .......... .......... .......... 10% 307M 1s 2024-09-12T17:49:15.209 INFO:teuthology.orchestra.run.smithi044.stderr: 9750K .......... .......... .......... .......... .......... 10% 345M 1s 2024-09-12T17:49:15.209 INFO:teuthology.orchestra.run.smithi044.stderr: 9800K .......... .......... .......... .......... .......... 10% 355M 1s 2024-09-12T17:49:15.209 INFO:teuthology.orchestra.run.smithi044.stderr: 9850K .......... .......... .......... .......... .......... 10% 356M 1s 2024-09-12T17:49:15.209 INFO:teuthology.orchestra.run.smithi044.stderr: 9900K .......... .......... .......... .......... .......... 10% 261M 1s 2024-09-12T17:49:15.209 INFO:teuthology.orchestra.run.smithi044.stderr: 9950K .......... .......... .......... .......... .......... 10% 357M 1s 2024-09-12T17:49:15.210 INFO:teuthology.orchestra.run.smithi044.stderr: 10000K .......... .......... .......... .......... .......... 10% 358M 1s 2024-09-12T17:49:15.210 INFO:teuthology.orchestra.run.smithi044.stderr: 10050K .......... .......... .......... .......... .......... 10% 298M 1s 2024-09-12T17:49:15.210 INFO:teuthology.orchestra.run.smithi044.stderr: 10100K .......... .......... .......... .......... .......... 10% 249M 1s 2024-09-12T17:49:15.210 INFO:teuthology.orchestra.run.smithi044.stderr: 10150K .......... .......... .......... .......... .......... 10% 322M 1s 2024-09-12T17:49:15.210 INFO:teuthology.orchestra.run.smithi044.stderr: 10200K .......... .......... .......... .......... .......... 11% 345M 1s 2024-09-12T17:49:15.210 INFO:teuthology.orchestra.run.smithi044.stderr: 10250K .......... .......... .......... .......... .......... 11% 349M 1s 2024-09-12T17:49:15.210 INFO:teuthology.orchestra.run.smithi044.stderr: 10300K .......... .......... .......... .......... .......... 11% 319M 1s 2024-09-12T17:49:15.210 INFO:teuthology.orchestra.run.smithi044.stderr: 10350K .......... .......... .......... .......... .......... 11% 372M 1s 2024-09-12T17:49:15.210 INFO:teuthology.orchestra.run.smithi044.stderr: 10400K .......... .......... .......... .......... .......... 11% 375M 1s 2024-09-12T17:49:15.210 INFO:teuthology.orchestra.run.smithi044.stderr: 10450K .......... .......... .......... .......... .......... 11% 298M 1s 2024-09-12T17:49:15.210 INFO:teuthology.orchestra.run.smithi044.stderr: 10500K .......... .......... .......... .......... .......... 11% 42.4M 1s 2024-09-12T17:49:15.211 INFO:teuthology.orchestra.run.smithi044.stderr: 10550K .......... .......... .......... .......... .......... 11% 256M 1s 2024-09-12T17:49:15.211 INFO:teuthology.orchestra.run.smithi044.stderr: 10600K .......... .......... .......... .......... .......... 11% 283M 1s 2024-09-12T17:49:15.211 INFO:teuthology.orchestra.run.smithi044.stderr: 10650K .......... .......... .......... .......... .......... 11% 289M 1s 2024-09-12T17:49:15.211 INFO:teuthology.orchestra.run.smithi044.stderr: 10700K .......... .......... .......... .......... .......... 11% 366M 1s 2024-09-12T17:49:15.211 INFO:teuthology.orchestra.run.smithi044.stderr: 10750K .......... .......... .......... .......... .......... 11% 372M 1s 2024-09-12T17:49:15.211 INFO:teuthology.orchestra.run.smithi044.stderr: 10800K .......... .......... .......... .......... .......... 11% 350M 1s 2024-09-12T17:49:15.211 INFO:teuthology.orchestra.run.smithi044.stderr: 10850K .......... .......... .......... .......... .......... 11% 123M 1s 2024-09-12T17:49:15.211 INFO:teuthology.orchestra.run.smithi044.stderr: 10900K .......... .......... .......... .......... .......... 11% 349M 1s 2024-09-12T17:49:15.211 INFO:teuthology.orchestra.run.smithi044.stderr: 10950K .......... .......... .......... .......... .......... 11% 351M 1s 2024-09-12T17:49:15.211 INFO:teuthology.orchestra.run.smithi044.stderr: 11000K .......... .......... .......... .......... .......... 11% 326M 1s 2024-09-12T17:49:15.211 INFO:teuthology.orchestra.run.smithi044.stderr: 11050K .......... .......... .......... .......... .......... 11% 298M 1s 2024-09-12T17:49:15.211 INFO:teuthology.orchestra.run.smithi044.stderr: 11100K .......... .......... .......... .......... .......... 12% 356M 1s 2024-09-12T17:49:15.211 INFO:teuthology.orchestra.run.smithi044.stderr: 11150K .......... .......... .......... .......... .......... 12% 331M 1s 2024-09-12T17:49:15.212 INFO:teuthology.orchestra.run.smithi044.stderr: 11200K .......... .......... .......... .......... .......... 12% 357M 1s 2024-09-12T17:49:15.212 INFO:teuthology.orchestra.run.smithi044.stderr: 11250K .......... .......... .......... .......... .......... 12% 327M 1s 2024-09-12T17:49:15.212 INFO:teuthology.orchestra.run.smithi044.stderr: 11300K .......... .......... .......... .......... .......... 12% 353M 1s 2024-09-12T17:49:15.212 INFO:teuthology.orchestra.run.smithi044.stderr: 11350K .......... .......... .......... .......... .......... 12% 382M 1s 2024-09-12T17:49:15.212 INFO:teuthology.orchestra.run.smithi044.stderr: 11400K .......... .......... .......... .......... .......... 12% 97.3M 1s 2024-09-12T17:49:15.212 INFO:teuthology.orchestra.run.smithi044.stderr: 11450K .......... .......... .......... .......... .......... 12% 171M 1s 2024-09-12T17:49:15.212 INFO:teuthology.orchestra.run.smithi044.stderr: 11500K .......... .......... .......... .......... .......... 12% 193M 1s 2024-09-12T17:49:15.212 INFO:teuthology.orchestra.run.smithi044.stderr: 11550K .......... .......... .......... .......... .......... 12% 342M 1s 2024-09-12T17:49:15.212 INFO:teuthology.orchestra.run.smithi044.stderr: 11600K .......... .......... .......... .......... .......... 12% 360M 1s 2024-09-12T17:49:15.212 INFO:teuthology.orchestra.run.smithi044.stderr: 11650K .......... .......... .......... .......... .......... 12% 300M 1s 2024-09-12T17:49:15.212 INFO:teuthology.orchestra.run.smithi044.stderr: 11700K .......... .......... .......... .......... .......... 12% 356M 1s 2024-09-12T17:49:15.213 INFO:teuthology.orchestra.run.smithi044.stderr: 11750K .......... .......... .......... .......... .......... 12% 344M 1s 2024-09-12T17:49:15.213 INFO:teuthology.orchestra.run.smithi044.stderr: 11800K .......... .......... .......... .......... .......... 12% 312M 1s 2024-09-12T17:49:15.213 INFO:teuthology.orchestra.run.smithi044.stderr: 11850K .......... .......... .......... .......... .......... 12% 371M 1s 2024-09-12T17:49:15.213 INFO:teuthology.orchestra.run.smithi044.stderr: 11900K .......... .......... .......... .......... .......... 12% 45.9M 1s 2024-09-12T17:49:15.213 INFO:teuthology.orchestra.run.smithi044.stderr: 11950K .......... .......... .......... .......... .......... 12% 173M 1s 2024-09-12T17:49:15.213 INFO:teuthology.orchestra.run.smithi044.stderr: 12000K .......... .......... .......... .......... .......... 12% 259M 1s 2024-09-12T17:49:15.213 INFO:teuthology.orchestra.run.smithi044.stderr: 12050K .......... .......... .......... .......... .......... 13% 324M 1s 2024-09-12T17:49:15.213 INFO:teuthology.orchestra.run.smithi044.stderr: 12100K .......... .......... .......... .......... .......... 13% 310M 1s 2024-09-12T17:49:15.213 INFO:teuthology.orchestra.run.smithi044.stderr: 12150K .......... .......... .......... .......... .......... 13% 289M 1s 2024-09-12T17:49:15.213 INFO:teuthology.orchestra.run.smithi044.stderr: 12200K .......... .......... .......... .......... .......... 13% 79.4M 1s 2024-09-12T17:49:15.213 INFO:teuthology.orchestra.run.smithi044.stderr: 12250K .......... .......... .......... .......... .......... 13% 150M 1s 2024-09-12T17:49:15.214 INFO:teuthology.orchestra.run.smithi044.stderr: 12300K .......... .......... .......... .......... .......... 13% 334M 1s 2024-09-12T17:49:15.214 INFO:teuthology.orchestra.run.smithi044.stderr: 12350K .......... .......... .......... .......... .......... 13% 316M 1s 2024-09-12T17:49:15.214 INFO:teuthology.orchestra.run.smithi044.stderr: 12400K .......... .......... .......... .......... .......... 13% 292M 1s 2024-09-12T17:49:15.214 INFO:teuthology.orchestra.run.smithi044.stderr: 12450K .......... .......... .......... .......... .......... 13% 268M 1s 2024-09-12T17:49:15.214 INFO:teuthology.orchestra.run.smithi044.stderr: 12500K .......... .......... .......... .......... .......... 13% 340M 1s 2024-09-12T17:49:15.214 INFO:teuthology.orchestra.run.smithi044.stderr: 12550K .......... .......... .......... .......... .......... 13% 346M 1s 2024-09-12T17:49:15.214 INFO:teuthology.orchestra.run.smithi044.stderr: 12600K .......... .......... .......... .......... .......... 13% 349M 1s 2024-09-12T17:49:15.214 INFO:teuthology.orchestra.run.smithi044.stderr: 12650K .......... .......... .......... .......... .......... 13% 299M 1s 2024-09-12T17:49:15.214 INFO:teuthology.orchestra.run.smithi044.stderr: 12700K .......... .......... .......... .......... .......... 13% 353M 1s 2024-09-12T17:49:15.214 INFO:teuthology.orchestra.run.smithi044.stderr: 12750K .......... .......... .......... .......... .......... 13% 319M 1s 2024-09-12T17:49:15.214 INFO:teuthology.orchestra.run.smithi044.stderr: 12800K .......... .......... .......... .......... .......... 13% 363M 1s 2024-09-12T17:49:15.215 INFO:teuthology.orchestra.run.smithi044.stderr: 12850K .......... .......... .......... .......... .......... 13% 321M 1s 2024-09-12T17:49:15.215 INFO:teuthology.orchestra.run.smithi044.stderr: 12900K .......... .......... .......... .......... .......... 13% 359M 1s 2024-09-12T17:49:15.215 INFO:teuthology.orchestra.run.smithi044.stderr: 12950K .......... .......... .......... .......... .......... 13% 362M 1s 2024-09-12T17:49:15.215 INFO:teuthology.orchestra.run.smithi044.stderr: 13000K .......... .......... .......... .......... .......... 14% 372M 1s 2024-09-12T17:49:15.215 INFO:teuthology.orchestra.run.smithi044.stderr: 13050K .......... .......... .......... .......... .......... 14% 315M 1s 2024-09-12T17:49:15.215 INFO:teuthology.orchestra.run.smithi044.stderr: 13100K .......... .......... .......... .......... .......... 14% 348M 1s 2024-09-12T17:49:15.215 INFO:teuthology.orchestra.run.smithi044.stderr: 13150K .......... .......... .......... .......... .......... 14% 376M 1s 2024-09-12T17:49:15.215 INFO:teuthology.orchestra.run.smithi044.stderr: 13200K .......... .......... .......... .......... .......... 14% 379M 1s 2024-09-12T17:49:15.215 INFO:teuthology.orchestra.run.smithi044.stderr: 13250K .......... .......... .......... .......... .......... 14% 343M 1s 2024-09-12T17:49:15.216 INFO:teuthology.orchestra.run.smithi044.stderr: 13300K .......... .......... .......... .......... .......... 14% 379M 1s 2024-09-12T17:49:15.216 INFO:teuthology.orchestra.run.smithi044.stderr: 13350K .......... .......... .......... .......... .......... 14% 73.6M 1s 2024-09-12T17:49:15.216 INFO:teuthology.orchestra.run.smithi044.stderr: 13400K .......... .......... .......... .......... .......... 14% 326M 1s 2024-09-12T17:49:15.216 INFO:teuthology.orchestra.run.smithi044.stderr: 13450K .......... .......... .......... .......... .......... 14% 287M 1s 2024-09-12T17:49:15.216 INFO:teuthology.orchestra.run.smithi044.stderr: 13500K .......... .......... .......... .......... .......... 14% 359M 1s 2024-09-12T17:49:15.216 INFO:teuthology.orchestra.run.smithi044.stderr: 13550K .......... .......... .......... .......... .......... 14% 376M 1s 2024-09-12T17:49:15.216 INFO:teuthology.orchestra.run.smithi044.stderr: 13600K .......... .......... .......... .......... .......... 14% 334M 1s 2024-09-12T17:49:15.216 INFO:teuthology.orchestra.run.smithi044.stderr: 13650K .......... .......... .......... .......... .......... 14% 215M 1s 2024-09-12T17:49:15.216 INFO:teuthology.orchestra.run.smithi044.stderr: 13700K .......... .......... .......... .......... .......... 14% 316M 1s 2024-09-12T17:49:15.216 INFO:teuthology.orchestra.run.smithi044.stderr: 13750K .......... .......... .......... .......... .......... 14% 353M 1s 2024-09-12T17:49:15.216 INFO:teuthology.orchestra.run.smithi044.stderr: 13800K .......... .......... .......... .......... .......... 14% 347M 1s 2024-09-12T17:49:15.217 INFO:teuthology.orchestra.run.smithi044.stderr: 13850K .......... .......... .......... .......... .......... 14% 239M 1s 2024-09-12T17:49:15.217 INFO:teuthology.orchestra.run.smithi044.stderr: 13900K .......... .......... .......... .......... .......... 15% 248M 1s 2024-09-12T17:49:15.217 INFO:teuthology.orchestra.run.smithi044.stderr: 13950K .......... .......... .......... .......... .......... 15% 305M 1s 2024-09-12T17:49:15.217 INFO:teuthology.orchestra.run.smithi044.stderr: 14000K .......... .......... .......... .......... .......... 15% 354M 1s 2024-09-12T17:49:15.217 INFO:teuthology.orchestra.run.smithi044.stderr: 14050K .......... .......... .......... .......... .......... 15% 336M 1s 2024-09-12T17:49:15.217 INFO:teuthology.orchestra.run.smithi044.stderr: 14100K .......... .......... .......... .......... .......... 15% 356M 1s 2024-09-12T17:49:15.217 INFO:teuthology.orchestra.run.smithi044.stderr: 14150K .......... .......... .......... .......... .......... 15% 353M 1s 2024-09-12T17:49:15.217 INFO:teuthology.orchestra.run.smithi044.stderr: 14200K .......... .......... .......... .......... .......... 15% 360M 1s 2024-09-12T17:49:15.217 INFO:teuthology.orchestra.run.smithi044.stderr: 14250K .......... .......... .......... .......... .......... 15% 277M 1s 2024-09-12T17:49:15.217 INFO:teuthology.orchestra.run.smithi044.stderr: 14300K .......... .......... .......... .......... .......... 15% 370M 1s 2024-09-12T17:49:15.217 INFO:teuthology.orchestra.run.smithi044.stderr: 14350K .......... .......... .......... .......... .......... 15% 371M 1s 2024-09-12T17:49:15.218 INFO:teuthology.orchestra.run.smithi044.stderr: 14400K .......... .......... .......... .......... .......... 15% 350M 1s 2024-09-12T17:49:15.218 INFO:teuthology.orchestra.run.smithi044.stderr: 14450K .......... .......... .......... .......... .......... 15% 325M 1s 2024-09-12T17:49:15.218 INFO:teuthology.orchestra.run.smithi044.stderr: 14500K .......... .......... .......... .......... .......... 15% 96.4M 1s 2024-09-12T17:49:15.218 INFO:teuthology.orchestra.run.smithi044.stderr: 14550K .......... .......... .......... .......... .......... 15% 344M 1s 2024-09-12T17:49:15.218 INFO:teuthology.orchestra.run.smithi044.stderr: 14600K .......... .......... .......... .......... .......... 15% 359M 1s 2024-09-12T17:49:15.218 INFO:teuthology.orchestra.run.smithi044.stderr: 14650K .......... .......... .......... .......... .......... 15% 310M 1s 2024-09-12T17:49:15.218 INFO:teuthology.orchestra.run.smithi044.stderr: 14700K .......... .......... .......... .......... .......... 15% 211M 1s 2024-09-12T17:49:15.218 INFO:teuthology.orchestra.run.smithi044.stderr: 14750K .......... .......... .......... .......... .......... 15% 323M 1s 2024-09-12T17:49:15.218 INFO:teuthology.orchestra.run.smithi044.stderr: 14800K .......... .......... .......... .......... .......... 15% 343M 1s 2024-09-12T17:49:15.218 INFO:teuthology.orchestra.run.smithi044.stderr: 14850K .......... .......... .......... .......... .......... 16% 317M 1s 2024-09-12T17:49:15.218 INFO:teuthology.orchestra.run.smithi044.stderr: 14900K .......... .......... .......... .......... .......... 16% 381M 1s 2024-09-12T17:49:15.218 INFO:teuthology.orchestra.run.smithi044.stderr: 14950K .......... .......... .......... .......... .......... 16% 69.2M 1s 2024-09-12T17:49:15.219 INFO:teuthology.orchestra.run.smithi044.stderr: 15000K .......... .......... .......... .......... .......... 16% 138M 1s 2024-09-12T17:49:15.219 INFO:teuthology.orchestra.run.smithi044.stderr: 15050K .......... .......... .......... .......... .......... 16% 98.4M 1s 2024-09-12T17:49:15.219 INFO:teuthology.orchestra.run.smithi044.stderr: 15100K .......... .......... .......... .......... .......... 16% 273M 1s 2024-09-12T17:49:15.219 INFO:teuthology.orchestra.run.smithi044.stderr: 15150K .......... .......... .......... .......... .......... 16% 78.0M 1s 2024-09-12T17:49:15.219 INFO:teuthology.orchestra.run.smithi044.stderr: 15200K .......... .......... .......... .......... .......... 16% 316M 1s 2024-09-12T17:49:15.219 INFO:teuthology.orchestra.run.smithi044.stderr: 15250K .......... .......... .......... .......... .......... 16% 267M 1s 2024-09-12T17:49:15.219 INFO:teuthology.orchestra.run.smithi044.stderr: 15300K .......... .......... .......... .......... .......... 16% 312M 1s 2024-09-12T17:49:15.219 INFO:teuthology.orchestra.run.smithi044.stderr: 15350K .......... .......... .......... .......... .......... 16% 352M 1s 2024-09-12T17:49:15.219 INFO:teuthology.orchestra.run.smithi044.stderr: 15400K .......... .......... .......... .......... .......... 16% 363M 1s 2024-09-12T17:49:15.219 INFO:teuthology.orchestra.run.smithi044.stderr: 15450K .......... .......... .......... .......... .......... 16% 85.3M 1s 2024-09-12T17:49:15.220 INFO:teuthology.orchestra.run.smithi044.stderr: 15500K .......... .......... .......... .......... .......... 16% 350M 1s 2024-09-12T17:49:15.220 INFO:teuthology.orchestra.run.smithi044.stderr: 15550K .......... .......... .......... .......... .......... 16% 357M 1s 2024-09-12T17:49:15.220 INFO:teuthology.orchestra.run.smithi044.stderr: 15600K .......... .......... .......... .......... .......... 16% 358M 1s 2024-09-12T17:49:15.220 INFO:teuthology.orchestra.run.smithi044.stderr: 15650K .......... .......... .......... .......... .......... 16% 328M 1s 2024-09-12T17:49:15.220 INFO:teuthology.orchestra.run.smithi044.stderr: 15700K .......... .......... .......... .......... .......... 16% 375M 1s 2024-09-12T17:49:15.220 INFO:teuthology.orchestra.run.smithi044.stderr: 15750K .......... .......... .......... .......... .......... 17% 369M 1s 2024-09-12T17:49:15.220 INFO:teuthology.orchestra.run.smithi044.stderr: 15800K .......... .......... .......... .......... .......... 17% 331M 1s 2024-09-12T17:49:15.220 INFO:teuthology.orchestra.run.smithi044.stderr: 15850K .......... .......... .......... .......... .......... 17% 300M 1s 2024-09-12T17:49:15.220 INFO:teuthology.orchestra.run.smithi044.stderr: 15900K .......... .......... .......... .......... .......... 17% 365M 1s 2024-09-12T17:49:15.220 INFO:teuthology.orchestra.run.smithi044.stderr: 15950K .......... .......... .......... .......... .......... 17% 362M 1s 2024-09-12T17:49:15.220 INFO:teuthology.orchestra.run.smithi044.stderr: 16000K .......... .......... .......... .......... .......... 17% 368M 1s 2024-09-12T17:49:15.220 INFO:teuthology.orchestra.run.smithi044.stderr: 16050K .......... .......... .......... .......... .......... 17% 343M 1s 2024-09-12T17:49:15.221 INFO:teuthology.orchestra.run.smithi044.stderr: 16100K .......... .......... .......... .......... .......... 17% 43.7M 1s 2024-09-12T17:49:15.221 INFO:teuthology.orchestra.run.smithi044.stderr: 16150K .......... .......... .......... .......... .......... 17% 314M 1s 2024-09-12T17:49:15.221 INFO:teuthology.orchestra.run.smithi044.stderr: 16200K .......... .......... .......... .......... .......... 17% 355M 1s 2024-09-12T17:49:15.221 INFO:teuthology.orchestra.run.smithi044.stderr: 16250K .......... .......... .......... .......... .......... 17% 302M 1s 2024-09-12T17:49:15.221 INFO:teuthology.orchestra.run.smithi044.stderr: 16300K .......... .......... .......... .......... .......... 17% 343M 1s 2024-09-12T17:49:15.221 INFO:teuthology.orchestra.run.smithi044.stderr: 16350K .......... .......... .......... .......... .......... 17% 347M 1s 2024-09-12T17:49:15.221 INFO:teuthology.orchestra.run.smithi044.stderr: 16400K .......... .......... .......... .......... .......... 17% 357M 1s 2024-09-12T17:49:15.221 INFO:teuthology.orchestra.run.smithi044.stderr: 16450K .......... .......... .......... .......... .......... 17% 307M 1s 2024-09-12T17:49:15.221 INFO:teuthology.orchestra.run.smithi044.stderr: 16500K .......... .......... .......... .......... .......... 17% 262M 1s 2024-09-12T17:49:15.221 INFO:teuthology.orchestra.run.smithi044.stderr: 16550K .......... .......... .......... .......... .......... 17% 357M 1s 2024-09-12T17:49:15.221 INFO:teuthology.orchestra.run.smithi044.stderr: 16600K .......... .......... .......... .......... .......... 17% 344M 1s 2024-09-12T17:49:15.221 INFO:teuthology.orchestra.run.smithi044.stderr: 16650K .......... .......... .......... .......... .......... 17% 253M 1s 2024-09-12T17:49:15.222 INFO:teuthology.orchestra.run.smithi044.stderr: 16700K .......... .......... .......... .......... .......... 18% 323M 1s 2024-09-12T17:49:15.222 INFO:teuthology.orchestra.run.smithi044.stderr: 16750K .......... .......... .......... .......... .......... 18% 347M 1s 2024-09-12T17:49:15.222 INFO:teuthology.orchestra.run.smithi044.stderr: 16800K .......... .......... .......... .......... .......... 18% 321M 1s 2024-09-12T17:49:15.222 INFO:teuthology.orchestra.run.smithi044.stderr: 16850K .......... .......... .......... .......... .......... 18% 311M 1s 2024-09-12T17:49:15.222 INFO:teuthology.orchestra.run.smithi044.stderr: 16900K .......... .......... .......... .......... .......... 18% 363M 1s 2024-09-12T17:49:15.222 INFO:teuthology.orchestra.run.smithi044.stderr: 16950K .......... .......... .......... .......... .......... 18% 366M 1s 2024-09-12T17:49:15.222 INFO:teuthology.orchestra.run.smithi044.stderr: 17000K .......... .......... .......... .......... .......... 18% 364M 1s 2024-09-12T17:49:15.222 INFO:teuthology.orchestra.run.smithi044.stderr: 17050K .......... .......... .......... .......... .......... 18% 312M 1s 2024-09-12T17:49:15.222 INFO:teuthology.orchestra.run.smithi044.stderr: 17100K .......... .......... .......... .......... .......... 18% 362M 1s 2024-09-12T17:49:15.222 INFO:teuthology.orchestra.run.smithi044.stderr: 17150K .......... .......... .......... .......... .......... 18% 337M 1s 2024-09-12T17:49:15.222 INFO:teuthology.orchestra.run.smithi044.stderr: 17200K .......... .......... .......... .......... .......... 18% 359M 1s 2024-09-12T17:49:15.222 INFO:teuthology.orchestra.run.smithi044.stderr: 17250K .......... .......... .......... .......... .......... 18% 334M 1s 2024-09-12T17:49:15.223 INFO:teuthology.orchestra.run.smithi044.stderr: 17300K .......... .......... .......... .......... .......... 18% 372M 1s 2024-09-12T17:49:15.223 INFO:teuthology.orchestra.run.smithi044.stderr: 17350K .......... .......... .......... .......... .......... 18% 382M 1s 2024-09-12T17:49:15.223 INFO:teuthology.orchestra.run.smithi044.stderr: 17400K .......... .......... .......... .......... .......... 18% 380M 1s 2024-09-12T17:49:15.223 INFO:teuthology.orchestra.run.smithi044.stderr: 17450K .......... .......... .......... .......... .......... 18% 297M 1s 2024-09-12T17:49:15.223 INFO:teuthology.orchestra.run.smithi044.stderr: 17500K .......... .......... .......... .......... .......... 18% 349M 1s 2024-09-12T17:49:15.223 INFO:teuthology.orchestra.run.smithi044.stderr: 17550K .......... .......... .......... .......... .......... 18% 361M 1s 2024-09-12T17:49:15.223 INFO:teuthology.orchestra.run.smithi044.stderr: 17600K .......... .......... .......... .......... .......... 18% 361M 1s 2024-09-12T17:49:15.223 INFO:teuthology.orchestra.run.smithi044.stderr: 17650K .......... .......... .......... .......... .......... 19% 333M 1s 2024-09-12T17:49:15.223 INFO:teuthology.orchestra.run.smithi044.stderr: 17700K .......... .......... .......... .......... .......... 19% 358M 1s 2024-09-12T17:49:15.223 INFO:teuthology.orchestra.run.smithi044.stderr: 17750K .......... .......... .......... .......... .......... 19% 365M 1s 2024-09-12T17:49:15.223 INFO:teuthology.orchestra.run.smithi044.stderr: 17800K .......... .......... .......... .......... .......... 19% 363M 1s 2024-09-12T17:49:15.223 INFO:teuthology.orchestra.run.smithi044.stderr: 17850K .......... .......... .......... .......... .......... 19% 253M 1s 2024-09-12T17:49:15.224 INFO:teuthology.orchestra.run.smithi044.stderr: 17900K .......... .......... .......... .......... .......... 19% 369M 1s 2024-09-12T17:49:15.224 INFO:teuthology.orchestra.run.smithi044.stderr: 17950K .......... .......... .......... .......... .......... 19% 117M 1s 2024-09-12T17:49:15.224 INFO:teuthology.orchestra.run.smithi044.stderr: 18000K .......... .......... .......... .......... .......... 19% 304M 1s 2024-09-12T17:49:15.224 INFO:teuthology.orchestra.run.smithi044.stderr: 18050K .......... .......... .......... .......... .......... 19% 159M 1s 2024-09-12T17:49:15.224 INFO:teuthology.orchestra.run.smithi044.stderr: 18100K .......... .......... .......... .......... .......... 19% 364M 1s 2024-09-12T17:49:15.224 INFO:teuthology.orchestra.run.smithi044.stderr: 18150K .......... .......... .......... .......... .......... 19% 124M 1s 2024-09-12T17:49:15.224 INFO:teuthology.orchestra.run.smithi044.stderr: 18200K .......... .......... .......... .......... .......... 19% 71.5M 1s 2024-09-12T17:49:15.224 INFO:teuthology.orchestra.run.smithi044.stderr: 18250K .......... .......... .......... .......... .......... 19% 227M 1s 2024-09-12T17:49:15.224 INFO:teuthology.orchestra.run.smithi044.stderr: 18300K .......... .......... .......... .......... .......... 19% 293M 1s 2024-09-12T17:49:15.224 INFO:teuthology.orchestra.run.smithi044.stderr: 18350K .......... .......... .......... .......... .......... 19% 351M 1s 2024-09-12T17:49:15.225 INFO:teuthology.orchestra.run.smithi044.stderr: 18400K .......... .......... .......... .......... .......... 19% 349M 1s 2024-09-12T17:49:15.225 INFO:teuthology.orchestra.run.smithi044.stderr: 18450K .......... .......... .......... .......... .......... 19% 292M 1s 2024-09-12T17:49:15.225 INFO:teuthology.orchestra.run.smithi044.stderr: 18500K .......... .......... .......... .......... .......... 19% 92.2M 1s 2024-09-12T17:49:15.225 INFO:teuthology.orchestra.run.smithi044.stderr: 18550K .......... .......... .......... .......... .......... 20% 243M 1s 2024-09-12T17:49:15.225 INFO:teuthology.orchestra.run.smithi044.stderr: 18600K .......... .......... .......... .......... .......... 20% 119M 1s 2024-09-12T17:49:15.225 INFO:teuthology.orchestra.run.smithi044.stderr: 18650K .......... .......... .......... .......... .......... 20% 295M 1s 2024-09-12T17:49:15.225 INFO:teuthology.orchestra.run.smithi044.stderr: 18700K .......... .......... .......... .......... .......... 20% 351M 1s 2024-09-12T17:49:15.225 INFO:teuthology.orchestra.run.smithi044.stderr: 18750K .......... .......... .......... .......... .......... 20% 362M 1s 2024-09-12T17:49:15.225 INFO:teuthology.orchestra.run.smithi044.stderr: 18800K .......... .......... .......... .......... .......... 20% 364M 1s 2024-09-12T17:49:15.225 INFO:teuthology.orchestra.run.smithi044.stderr: 18850K .......... .......... .......... .......... .......... 20% 329M 1s 2024-09-12T17:49:15.225 INFO:teuthology.orchestra.run.smithi044.stderr: 18900K .......... .......... .......... .......... .......... 20% 334M 1s 2024-09-12T17:49:15.225 INFO:teuthology.orchestra.run.smithi044.stderr: 18950K .......... .......... .......... .......... .......... 20% 163M 1s 2024-09-12T17:49:15.225 INFO:teuthology.orchestra.run.smithi044.stderr: 19000K .......... .......... .......... .......... .......... 20% 361M 1s 2024-09-12T17:49:15.226 INFO:teuthology.orchestra.run.smithi044.stderr: 19050K .......... .......... .......... .......... .......... 20% 379M 1s 2024-09-12T17:49:15.226 INFO:teuthology.orchestra.run.smithi044.stderr: 19100K .......... .......... .......... .......... .......... 20% 61.6M 1s 2024-09-12T17:49:15.226 INFO:teuthology.orchestra.run.smithi044.stderr: 19150K .......... .......... .......... .......... .......... 20% 268M 1s 2024-09-12T17:49:15.226 INFO:teuthology.orchestra.run.smithi044.stderr: 19200K .......... .......... .......... .......... .......... 20% 217M 1s 2024-09-12T17:49:15.226 INFO:teuthology.orchestra.run.smithi044.stderr: 19250K .......... .......... .......... .......... .......... 20% 279M 1s 2024-09-12T17:49:15.226 INFO:teuthology.orchestra.run.smithi044.stderr: 19300K .......... .......... .......... .......... .......... 20% 323M 1s 2024-09-12T17:49:15.226 INFO:teuthology.orchestra.run.smithi044.stderr: 19350K .......... .......... .......... .......... .......... 20% 245M 1s 2024-09-12T17:49:15.226 INFO:teuthology.orchestra.run.smithi044.stderr: 19400K .......... .......... .......... .......... .......... 20% 181M 1s 2024-09-12T17:49:15.226 INFO:teuthology.orchestra.run.smithi044.stderr: 19450K .......... .......... .......... .......... .......... 20% 316M 1s 2024-09-12T17:49:15.226 INFO:teuthology.orchestra.run.smithi044.stderr: 19500K .......... .......... .......... .......... .......... 21% 316M 1s 2024-09-12T17:49:15.226 INFO:teuthology.orchestra.run.smithi044.stderr: 19550K .......... .......... .......... .......... .......... 21% 275M 1s 2024-09-12T17:49:15.226 INFO:teuthology.orchestra.run.smithi044.stderr: 19600K .......... .......... .......... .......... .......... 21% 366M 1s 2024-09-12T17:49:15.226 INFO:teuthology.orchestra.run.smithi044.stderr: 19650K .......... .......... .......... .......... .......... 21% 366M 1s 2024-09-12T17:49:15.227 INFO:teuthology.orchestra.run.smithi044.stderr: 19700K .......... .......... .......... .......... .......... 21% 376M 1s 2024-09-12T17:49:15.227 INFO:teuthology.orchestra.run.smithi044.stderr: 19750K .......... .......... .......... .......... .......... 21% 344M 1s 2024-09-12T17:49:15.227 INFO:teuthology.orchestra.run.smithi044.stderr: 19800K .......... .......... .......... .......... .......... 21% 374M 1s 2024-09-12T17:49:15.227 INFO:teuthology.orchestra.run.smithi044.stderr: 19850K .......... .......... .......... .......... .......... 21% 368M 1s 2024-09-12T17:49:15.227 INFO:teuthology.orchestra.run.smithi044.stderr: 19900K .......... .......... .......... .......... .......... 21% 338M 1s 2024-09-12T17:49:15.227 INFO:teuthology.orchestra.run.smithi044.stderr: 19950K .......... .......... .......... .......... .......... 21% 302M 1s 2024-09-12T17:49:15.227 INFO:teuthology.orchestra.run.smithi044.stderr: 20000K .......... .......... .......... .......... .......... 21% 367M 1s 2024-09-12T17:49:15.227 INFO:teuthology.orchestra.run.smithi044.stderr: 20050K .......... .......... .......... .......... .......... 21% 372M 1s 2024-09-12T17:49:15.227 INFO:teuthology.orchestra.run.smithi044.stderr: 20100K .......... .......... .......... .......... .......... 21% 382M 1s 2024-09-12T17:49:15.227 INFO:teuthology.orchestra.run.smithi044.stderr: 20150K .......... .......... .......... .......... .......... 21% 330M 1s 2024-09-12T17:49:15.227 INFO:teuthology.orchestra.run.smithi044.stderr: 20200K .......... .......... .......... .......... .......... 21% 362M 1s 2024-09-12T17:49:15.227 INFO:teuthology.orchestra.run.smithi044.stderr: 20250K .......... .......... .......... .......... .......... 21% 188M 1s 2024-09-12T17:49:15.227 INFO:teuthology.orchestra.run.smithi044.stderr: 20300K .......... .......... .......... .......... .......... 21% 369M 1s 2024-09-12T17:49:15.228 INFO:teuthology.orchestra.run.smithi044.stderr: 20350K .......... .......... .......... .......... .......... 21% 300M 1s 2024-09-12T17:49:15.228 INFO:teuthology.orchestra.run.smithi044.stderr: 20400K .......... .......... .......... .......... .......... 22% 368M 1s 2024-09-12T17:49:15.228 INFO:teuthology.orchestra.run.smithi044.stderr: 20450K .......... .......... .......... .......... .......... 22% 358M 1s 2024-09-12T17:49:15.228 INFO:teuthology.orchestra.run.smithi044.stderr: 20500K .......... .......... .......... .......... .......... 22% 403M 1s 2024-09-12T17:49:15.228 INFO:teuthology.orchestra.run.smithi044.stderr: 20550K .......... .......... .......... .......... .......... 22% 352M 1s 2024-09-12T17:49:15.228 INFO:teuthology.orchestra.run.smithi044.stderr: 20600K .......... .......... .......... .......... .......... 22% 369M 1s 2024-09-12T17:49:15.228 INFO:teuthology.orchestra.run.smithi044.stderr: 20650K .......... .......... .......... .......... .......... 22% 409M 1s 2024-09-12T17:49:15.228 INFO:teuthology.orchestra.run.smithi044.stderr: 20700K .......... .......... .......... .......... .......... 22% 331M 1s 2024-09-12T17:49:15.228 INFO:teuthology.orchestra.run.smithi044.stderr: 20750K .......... .......... .......... .......... .......... 22% 369M 1s 2024-09-12T17:49:15.228 INFO:teuthology.orchestra.run.smithi044.stderr: 20800K .......... .......... .......... .......... .......... 22% 333M 1s 2024-09-12T17:49:15.228 INFO:teuthology.orchestra.run.smithi044.stderr: 20850K .......... .......... .......... .......... .......... 22% 423M 1s 2024-09-12T17:49:15.228 INFO:teuthology.orchestra.run.smithi044.stderr: 20900K .......... .......... .......... .......... .......... 22% 421M 1s 2024-09-12T17:49:15.228 INFO:teuthology.orchestra.run.smithi044.stderr: 20950K .......... .......... .......... .......... .......... 22% 377M 1s 2024-09-12T17:49:15.229 INFO:teuthology.orchestra.run.smithi044.stderr: 21000K .......... .......... .......... .......... .......... 22% 367M 1s 2024-09-12T17:49:15.229 INFO:teuthology.orchestra.run.smithi044.stderr: 21050K .......... .......... .......... .......... .......... 22% 112M 1s 2024-09-12T17:49:15.229 INFO:teuthology.orchestra.run.smithi044.stderr: 21100K .......... .......... .......... .......... .......... 22% 353M 1s 2024-09-12T17:49:15.229 INFO:teuthology.orchestra.run.smithi044.stderr: 21150K .......... .......... .......... .......... .......... 22% 400M 1s 2024-09-12T17:49:15.229 INFO:teuthology.orchestra.run.smithi044.stderr: 21200K .......... .......... .......... .......... .......... 22% 100M 1s 2024-09-12T17:49:15.229 INFO:teuthology.orchestra.run.smithi044.stderr: 21250K .......... .......... .......... .......... .......... 22% 147M 1s 2024-09-12T17:49:15.229 INFO:teuthology.orchestra.run.smithi044.stderr: 21300K .......... .......... .......... .......... .......... 22% 132M 1s 2024-09-12T17:49:15.229 INFO:teuthology.orchestra.run.smithi044.stderr: 21350K .......... .......... .......... .......... .......... 23% 242M 1s 2024-09-12T17:49:15.229 INFO:teuthology.orchestra.run.smithi044.stderr: 21400K .......... .......... .......... .......... .......... 23% 304M 1s 2024-09-12T17:49:15.229 INFO:teuthology.orchestra.run.smithi044.stderr: 21450K .......... .......... .......... .......... .......... 23% 148M 1s 2024-09-12T17:49:15.229 INFO:teuthology.orchestra.run.smithi044.stderr: 21500K .......... .......... .......... .......... .......... 23% 304M 1s 2024-09-12T17:49:15.229 INFO:teuthology.orchestra.run.smithi044.stderr: 21550K .......... .......... .......... .......... .......... 23% 214M 1s 2024-09-12T17:49:15.230 INFO:teuthology.orchestra.run.smithi044.stderr: 21600K .......... .......... .......... .......... .......... 23% 99.2M 1s 2024-09-12T17:49:15.230 INFO:teuthology.orchestra.run.smithi044.stderr: 21650K .......... .......... .......... .......... .......... 23% 361M 1s 2024-09-12T17:49:15.230 INFO:teuthology.orchestra.run.smithi044.stderr: 21700K .......... .......... .......... .......... .......... 23% 117M 1s 2024-09-12T17:49:15.230 INFO:teuthology.orchestra.run.smithi044.stderr: 21750K .......... .......... .......... .......... .......... 23% 338M 1s 2024-09-12T17:49:15.230 INFO:teuthology.orchestra.run.smithi044.stderr: 21800K .......... .......... .......... .......... .......... 23% 364M 1s 2024-09-12T17:49:15.230 INFO:teuthology.orchestra.run.smithi044.stderr: 21850K .......... .......... .......... .......... .......... 23% 370M 1s 2024-09-12T17:49:15.230 INFO:teuthology.orchestra.run.smithi044.stderr: 21900K .......... .......... .......... .......... .......... 23% 295M 1s 2024-09-12T17:49:15.230 INFO:teuthology.orchestra.run.smithi044.stderr: 21950K .......... .......... .......... .......... .......... 23% 349M 1s 2024-09-12T17:49:15.230 INFO:teuthology.orchestra.run.smithi044.stderr: 22000K .......... .......... .......... .......... .......... 23% 323M 1s 2024-09-12T17:49:15.230 INFO:teuthology.orchestra.run.smithi044.stderr: 22050K .......... .......... .......... .......... .......... 23% 65.5M 1s 2024-09-12T17:49:15.230 INFO:teuthology.orchestra.run.smithi044.stderr: 22100K .......... .......... .......... .......... .......... 23% 285M 1s 2024-09-12T17:49:15.230 INFO:teuthology.orchestra.run.smithi044.stderr: 22150K .......... .......... .......... .......... .......... 23% 295M 1s 2024-09-12T17:49:15.230 INFO:teuthology.orchestra.run.smithi044.stderr: 22200K .......... .......... .......... .......... .......... 23% 333M 1s 2024-09-12T17:49:15.231 INFO:teuthology.orchestra.run.smithi044.stderr: 22250K .......... .......... .......... .......... .......... 24% 202M 1s 2024-09-12T17:49:15.231 INFO:teuthology.orchestra.run.smithi044.stderr: 22300K .......... .......... .......... .......... .......... 24% 303M 1s 2024-09-12T17:49:15.231 INFO:teuthology.orchestra.run.smithi044.stderr: 22350K .......... .......... .......... .......... .......... 24% 277M 1s 2024-09-12T17:49:15.231 INFO:teuthology.orchestra.run.smithi044.stderr: 22400K .......... .......... .......... .......... .......... 24% 344M 1s 2024-09-12T17:49:15.231 INFO:teuthology.orchestra.run.smithi044.stderr: 22450K .......... .......... .......... .......... .......... 24% 233M 1s 2024-09-12T17:49:15.231 INFO:teuthology.orchestra.run.smithi044.stderr: 22500K .......... .......... .......... .......... .......... 24% 312M 1s 2024-09-12T17:49:15.231 INFO:teuthology.orchestra.run.smithi044.stderr: 22550K .......... .......... .......... .......... .......... 24% 374M 1s 2024-09-12T17:49:15.231 INFO:teuthology.orchestra.run.smithi044.stderr: 22600K .......... .......... .......... .......... .......... 24% 85.4M 1s 2024-09-12T17:49:15.231 INFO:teuthology.orchestra.run.smithi044.stderr: 22650K .......... .......... .......... .......... .......... 24% 312M 1s 2024-09-12T17:49:15.231 INFO:teuthology.orchestra.run.smithi044.stderr: 22700K .......... .......... .......... .......... .......... 24% 299M 1s 2024-09-12T17:49:15.231 INFO:teuthology.orchestra.run.smithi044.stderr: 22750K .......... .......... .......... .......... .......... 24% 369M 1s 2024-09-12T17:49:15.231 INFO:teuthology.orchestra.run.smithi044.stderr: 22800K .......... .......... .......... .......... .......... 24% 368M 1s 2024-09-12T17:49:15.231 INFO:teuthology.orchestra.run.smithi044.stderr: 22850K .......... .......... .......... .......... .......... 24% 359M 1s 2024-09-12T17:49:15.232 INFO:teuthology.orchestra.run.smithi044.stderr: 22900K .......... .......... .......... .......... .......... 24% 329M 1s 2024-09-12T17:49:15.232 INFO:teuthology.orchestra.run.smithi044.stderr: 22950K .......... .......... .......... .......... .......... 24% 339M 1s 2024-09-12T17:49:15.232 INFO:teuthology.orchestra.run.smithi044.stderr: 23000K .......... .......... .......... .......... .......... 24% 367M 1s 2024-09-12T17:49:15.232 INFO:teuthology.orchestra.run.smithi044.stderr: 23050K .......... .......... .......... .......... .......... 24% 371M 0s 2024-09-12T17:49:15.232 INFO:teuthology.orchestra.run.smithi044.stderr: 23100K .......... .......... .......... .......... .......... 24% 318M 0s 2024-09-12T17:49:15.232 INFO:teuthology.orchestra.run.smithi044.stderr: 23150K .......... .......... .......... .......... .......... 24% 374M 0s 2024-09-12T17:49:15.232 INFO:teuthology.orchestra.run.smithi044.stderr: 23200K .......... .......... .......... .......... .......... 25% 366M 0s 2024-09-12T17:49:15.232 INFO:teuthology.orchestra.run.smithi044.stderr: 23250K .......... .......... .......... .......... .......... 25% 361M 0s 2024-09-12T17:49:15.232 INFO:teuthology.orchestra.run.smithi044.stderr: 23300K .......... .......... .......... .......... .......... 25% 290M 0s 2024-09-12T17:49:15.232 INFO:teuthology.orchestra.run.smithi044.stderr: 23350K .......... .......... .......... .......... .......... 25% 367M 0s 2024-09-12T17:49:15.232 INFO:teuthology.orchestra.run.smithi044.stderr: 23400K .......... .......... .......... .......... .......... 25% 348M 0s 2024-09-12T17:49:15.232 INFO:teuthology.orchestra.run.smithi044.stderr: 23450K .......... .......... .......... .......... .......... 25% 336M 0s 2024-09-12T17:49:15.233 INFO:teuthology.orchestra.run.smithi044.stderr: 23500K .......... .......... .......... .......... .......... 25% 267M 0s 2024-09-12T17:49:15.233 INFO:teuthology.orchestra.run.smithi044.stderr: 23550K .......... .......... .......... .......... .......... 25% 309M 0s 2024-09-12T17:49:15.233 INFO:teuthology.orchestra.run.smithi044.stderr: 23600K .......... .......... .......... .......... .......... 25% 321M 0s 2024-09-12T17:49:15.233 INFO:teuthology.orchestra.run.smithi044.stderr: 23650K .......... .......... .......... .......... .......... 25% 288M 0s 2024-09-12T17:49:15.233 INFO:teuthology.orchestra.run.smithi044.stderr: 23700K .......... .......... .......... .......... .......... 25% 311M 0s 2024-09-12T17:49:15.233 INFO:teuthology.orchestra.run.smithi044.stderr: 23750K .......... .......... .......... .......... .......... 25% 378M 0s 2024-09-12T17:49:15.233 INFO:teuthology.orchestra.run.smithi044.stderr: 23800K .......... .......... .......... .......... .......... 25% 359M 0s 2024-09-12T17:49:15.233 INFO:teuthology.orchestra.run.smithi044.stderr: 23850K .......... .......... .......... .......... .......... 25% 283M 0s 2024-09-12T17:49:15.233 INFO:teuthology.orchestra.run.smithi044.stderr: 23900K .......... .......... .......... .......... .......... 25% 268M 0s 2024-09-12T17:49:15.233 INFO:teuthology.orchestra.run.smithi044.stderr: 23950K .......... .......... .......... .......... .......... 25% 360M 0s 2024-09-12T17:49:15.233 INFO:teuthology.orchestra.run.smithi044.stderr: 24000K .......... .......... .......... .......... .......... 25% 382M 0s 2024-09-12T17:49:15.234 INFO:teuthology.orchestra.run.smithi044.stderr: 24050K .......... .......... .......... .......... .......... 25% 326M 0s 2024-09-12T17:49:15.234 INFO:teuthology.orchestra.run.smithi044.stderr: 24100K .......... .......... .......... .......... .......... 25% 301M 0s 2024-09-12T17:49:15.234 INFO:teuthology.orchestra.run.smithi044.stderr: 24150K .......... .......... .......... .......... .......... 26% 367M 0s 2024-09-12T17:49:15.234 INFO:teuthology.orchestra.run.smithi044.stderr: 24200K .......... .......... .......... .......... .......... 26% 364M 0s 2024-09-12T17:49:15.234 INFO:teuthology.orchestra.run.smithi044.stderr: 24250K .......... .......... .......... .......... .......... 26% 383M 0s 2024-09-12T17:49:15.234 INFO:teuthology.orchestra.run.smithi044.stderr: 24300K .......... .......... .......... .......... .......... 26% 192M 0s 2024-09-12T17:49:15.234 INFO:teuthology.orchestra.run.smithi044.stderr: 24350K .......... .......... .......... .......... .......... 26% 143M 0s 2024-09-12T17:49:15.234 INFO:teuthology.orchestra.run.smithi044.stderr: 24400K .......... .......... .......... .......... .......... 26% 115M 0s 2024-09-12T17:49:15.234 INFO:teuthology.orchestra.run.smithi044.stderr: 24450K .......... .......... .......... .......... .......... 26% 333M 0s 2024-09-12T17:49:15.234 INFO:teuthology.orchestra.run.smithi044.stderr: 24500K .......... .......... .......... .......... .......... 26% 236M 0s 2024-09-12T17:49:15.234 INFO:teuthology.orchestra.run.smithi044.stderr: 24550K .......... .......... .......... .......... .......... 26% 205M 0s 2024-09-12T17:49:15.234 INFO:teuthology.orchestra.run.smithi044.stderr: 24600K .......... .......... .......... .......... .......... 26% 284M 0s 2024-09-12T17:49:15.235 INFO:teuthology.orchestra.run.smithi044.stderr: 24650K .......... .......... .......... .......... .......... 26% 336M 0s 2024-09-12T17:49:15.235 INFO:teuthology.orchestra.run.smithi044.stderr: 24700K .......... .......... .......... .......... .......... 26% 124M 0s 2024-09-12T17:49:15.235 INFO:teuthology.orchestra.run.smithi044.stderr: 24750K .......... .......... .......... .......... .......... 26% 89.4M 0s 2024-09-12T17:49:15.235 INFO:teuthology.orchestra.run.smithi044.stderr: 24800K .......... .......... .......... .......... .......... 26% 281M 0s 2024-09-12T17:49:15.235 INFO:teuthology.orchestra.run.smithi044.stderr: 24850K .......... .......... .......... .......... .......... 26% 265M 0s 2024-09-12T17:49:15.235 INFO:teuthology.orchestra.run.smithi044.stderr: 24900K .......... .......... .......... .......... .......... 26% 275M 0s 2024-09-12T17:49:15.235 INFO:teuthology.orchestra.run.smithi044.stderr: 24950K .......... .......... .......... .......... .......... 26% 341M 0s 2024-09-12T17:49:15.235 INFO:teuthology.orchestra.run.smithi044.stderr: 25000K .......... .......... .......... .......... .......... 26% 341M 0s 2024-09-12T17:49:15.235 INFO:teuthology.orchestra.run.smithi044.stderr: 25050K .......... .......... .......... .......... .......... 27% 66.2M 0s 2024-09-12T17:49:15.235 INFO:teuthology.orchestra.run.smithi044.stderr: 25100K .......... .......... .......... .......... .......... 27% 283M 0s 2024-09-12T17:49:15.235 INFO:teuthology.orchestra.run.smithi044.stderr: 25150K .......... .......... .......... .......... .......... 27% 354M 0s 2024-09-12T17:49:15.235 INFO:teuthology.orchestra.run.smithi044.stderr: 25200K .......... .......... .......... .......... .......... 27% 379M 0s 2024-09-12T17:49:15.236 INFO:teuthology.orchestra.run.smithi044.stderr: 25250K .......... .......... .......... .......... .......... 27% 132M 0s 2024-09-12T17:49:15.236 INFO:teuthology.orchestra.run.smithi044.stderr: 25300K .......... .......... .......... .......... .......... 27% 309M 0s 2024-09-12T17:49:15.236 INFO:teuthology.orchestra.run.smithi044.stderr: 25350K .......... .......... .......... .......... .......... 27% 313M 0s 2024-09-12T17:49:15.236 INFO:teuthology.orchestra.run.smithi044.stderr: 25400K .......... .......... .......... .......... .......... 27% 382M 0s 2024-09-12T17:49:15.236 INFO:teuthology.orchestra.run.smithi044.stderr: 25450K .......... .......... .......... .......... .......... 27% 372M 0s 2024-09-12T17:49:15.236 INFO:teuthology.orchestra.run.smithi044.stderr: 25500K .......... .......... .......... .......... .......... 27% 299M 0s 2024-09-12T17:49:15.236 INFO:teuthology.orchestra.run.smithi044.stderr: 25550K .......... .......... .......... .......... .......... 27% 337M 0s 2024-09-12T17:49:15.236 INFO:teuthology.orchestra.run.smithi044.stderr: 25600K .......... .......... .......... .......... .......... 27% 379M 0s 2024-09-12T17:49:15.236 INFO:teuthology.orchestra.run.smithi044.stderr: 25650K .......... .......... .......... .......... .......... 27% 98.9M 0s 2024-09-12T17:49:15.236 INFO:teuthology.orchestra.run.smithi044.stderr: 25700K .......... .......... .......... .......... .......... 27% 317M 0s 2024-09-12T17:49:15.236 INFO:teuthology.orchestra.run.smithi044.stderr: 25750K .......... .......... .......... .......... .......... 27% 326M 0s 2024-09-12T17:49:15.236 INFO:teuthology.orchestra.run.smithi044.stderr: 25800K .......... .......... .......... .......... .......... 27% 341M 0s 2024-09-12T17:49:15.237 INFO:teuthology.orchestra.run.smithi044.stderr: 25850K .......... .......... .......... .......... .......... 27% 366M 0s 2024-09-12T17:49:15.237 INFO:teuthology.orchestra.run.smithi044.stderr: 25900K .......... .......... .......... .......... .......... 27% 185M 0s 2024-09-12T17:49:15.237 INFO:teuthology.orchestra.run.smithi044.stderr: 25950K .......... .......... .......... .......... .......... 27% 288M 0s 2024-09-12T17:49:15.237 INFO:teuthology.orchestra.run.smithi044.stderr: 26000K .......... .......... .......... .......... .......... 28% 258M 0s 2024-09-12T17:49:15.237 INFO:teuthology.orchestra.run.smithi044.stderr: 26050K .......... .......... .......... .......... .......... 28% 328M 0s 2024-09-12T17:49:15.237 INFO:teuthology.orchestra.run.smithi044.stderr: 26100K .......... .......... .......... .......... .......... 28% 310M 0s 2024-09-12T17:49:15.237 INFO:teuthology.orchestra.run.smithi044.stderr: 26150K .......... .......... .......... .......... .......... 28% 282M 0s 2024-09-12T17:49:15.237 INFO:teuthology.orchestra.run.smithi044.stderr: 26200K .......... .......... .......... .......... .......... 28% 308M 0s 2024-09-12T17:49:15.237 INFO:teuthology.orchestra.run.smithi044.stderr: 26250K .......... .......... .......... .......... .......... 28% 354M 0s 2024-09-12T17:49:15.237 INFO:teuthology.orchestra.run.smithi044.stderr: 26300K .......... .......... .......... .......... .......... 28% 308M 0s 2024-09-12T17:49:15.237 INFO:teuthology.orchestra.run.smithi044.stderr: 26350K .......... .......... .......... .......... .......... 28% 356M 0s 2024-09-12T17:49:15.238 INFO:teuthology.orchestra.run.smithi044.stderr: 26400K .......... .......... .......... .......... .......... 28% 319M 0s 2024-09-12T17:49:15.238 INFO:teuthology.orchestra.run.smithi044.stderr: 26450K .......... .......... .......... .......... .......... 28% 356M 0s 2024-09-12T17:49:15.238 INFO:teuthology.orchestra.run.smithi044.stderr: 26500K .......... .......... .......... .......... .......... 28% 333M 0s 2024-09-12T17:49:15.238 INFO:teuthology.orchestra.run.smithi044.stderr: 26550K .......... .......... .......... .......... .......... 28% 362M 0s 2024-09-12T17:49:15.238 INFO:teuthology.orchestra.run.smithi044.stderr: 26600K .......... .......... .......... .......... .......... 28% 374M 0s 2024-09-12T17:49:15.238 INFO:teuthology.orchestra.run.smithi044.stderr: 26650K .......... .......... .......... .......... .......... 28% 352M 0s 2024-09-12T17:49:15.238 INFO:teuthology.orchestra.run.smithi044.stderr: 26700K .......... .......... .......... .......... .......... 28% 305M 0s 2024-09-12T17:49:15.238 INFO:teuthology.orchestra.run.smithi044.stderr: 26750K .......... .......... .......... .......... .......... 28% 342M 0s 2024-09-12T17:49:15.238 INFO:teuthology.orchestra.run.smithi044.stderr: 26800K .......... .......... .......... .......... .......... 28% 351M 0s 2024-09-12T17:49:15.238 INFO:teuthology.orchestra.run.smithi044.stderr: 26850K .......... .......... .......... .......... .......... 28% 374M 0s 2024-09-12T17:49:15.238 INFO:teuthology.orchestra.run.smithi044.stderr: 26900K .......... .......... .......... .......... .......... 29% 325M 0s 2024-09-12T17:49:15.238 INFO:teuthology.orchestra.run.smithi044.stderr: 26950K .......... .......... .......... .......... .......... 29% 374M 0s 2024-09-12T17:49:15.238 INFO:teuthology.orchestra.run.smithi044.stderr: 27000K .......... .......... .......... .......... .......... 29% 386M 0s 2024-09-12T17:49:15.239 INFO:teuthology.orchestra.run.smithi044.stderr: 27050K .......... .......... .......... .......... .......... 29% 156M 0s 2024-09-12T17:49:15.239 INFO:teuthology.orchestra.run.smithi044.stderr: 27100K .......... .......... .......... .......... .......... 29% 269M 0s 2024-09-12T17:49:15.239 INFO:teuthology.orchestra.run.smithi044.stderr: 27150K .......... .......... .......... .......... .......... 29% 265M 0s 2024-09-12T17:49:15.239 INFO:teuthology.orchestra.run.smithi044.stderr: 27200K .......... .......... .......... .......... .......... 29% 308M 0s 2024-09-12T17:49:15.239 INFO:teuthology.orchestra.run.smithi044.stderr: 27250K .......... .......... .......... .......... .......... 29% 343M 0s 2024-09-12T17:49:15.239 INFO:teuthology.orchestra.run.smithi044.stderr: 27300K .......... .......... .......... .......... .......... 29% 309M 0s 2024-09-12T17:49:15.239 INFO:teuthology.orchestra.run.smithi044.stderr: 27350K .......... .......... .......... .......... .......... 29% 328M 0s 2024-09-12T17:49:15.239 INFO:teuthology.orchestra.run.smithi044.stderr: 27400K .......... .......... .......... .......... .......... 29% 314M 0s 2024-09-12T17:49:15.239 INFO:teuthology.orchestra.run.smithi044.stderr: 27450K .......... .......... .......... .......... .......... 29% 387M 0s 2024-09-12T17:49:15.239 INFO:teuthology.orchestra.run.smithi044.stderr: 27500K .......... .......... .......... .......... .......... 29% 169M 0s 2024-09-12T17:49:15.239 INFO:teuthology.orchestra.run.smithi044.stderr: 27550K .......... .......... .......... .......... .......... 29% 193M 0s 2024-09-12T17:49:15.239 INFO:teuthology.orchestra.run.smithi044.stderr: 27600K .......... .......... .......... .......... .......... 29% 232M 0s 2024-09-12T17:49:15.240 INFO:teuthology.orchestra.run.smithi044.stderr: 27650K .......... .......... .......... .......... .......... 29% 128M 0s 2024-09-12T17:49:15.240 INFO:teuthology.orchestra.run.smithi044.stderr: 27700K .......... .......... .......... .......... .......... 29% 203M 0s 2024-09-12T17:49:15.240 INFO:teuthology.orchestra.run.smithi044.stderr: 27750K .......... .......... .......... .......... .......... 29% 386M 0s 2024-09-12T17:49:15.240 INFO:teuthology.orchestra.run.smithi044.stderr: 27800K .......... .......... .......... .......... .......... 29% 99.1M 0s 2024-09-12T17:49:15.240 INFO:teuthology.orchestra.run.smithi044.stderr: 27850K .......... .......... .......... .......... .......... 30% 283M 0s 2024-09-12T17:49:15.240 INFO:teuthology.orchestra.run.smithi044.stderr: 27900K .......... .......... .......... .......... .......... 30% 183M 0s 2024-09-12T17:49:15.240 INFO:teuthology.orchestra.run.smithi044.stderr: 27950K .......... .......... .......... .......... .......... 30% 309M 0s 2024-09-12T17:49:15.240 INFO:teuthology.orchestra.run.smithi044.stderr: 28000K .......... .......... .......... .......... .......... 30% 275M 0s 2024-09-12T17:49:15.240 INFO:teuthology.orchestra.run.smithi044.stderr: 28050K .......... .......... .......... .......... .......... 30% 369M 0s 2024-09-12T17:49:15.240 INFO:teuthology.orchestra.run.smithi044.stderr: 28100K .......... .......... .......... .......... .......... 30% 86.8M 0s 2024-09-12T17:49:15.240 INFO:teuthology.orchestra.run.smithi044.stderr: 28150K .......... .......... .......... .......... .......... 30% 145M 0s 2024-09-12T17:49:15.240 INFO:teuthology.orchestra.run.smithi044.stderr: 28200K .......... .......... .......... .......... .......... 30% 359M 0s 2024-09-12T17:49:15.241 INFO:teuthology.orchestra.run.smithi044.stderr: 28250K .......... .......... .......... .......... .......... 30% 93.4M 0s 2024-09-12T17:49:15.241 INFO:teuthology.orchestra.run.smithi044.stderr: 28300K .......... .......... .......... .......... .......... 30% 322M 0s 2024-09-12T17:49:15.241 INFO:teuthology.orchestra.run.smithi044.stderr: 28350K .......... .......... .......... .......... .......... 30% 202M 0s 2024-09-12T17:49:15.241 INFO:teuthology.orchestra.run.smithi044.stderr: 28400K .......... .......... .......... .......... .......... 30% 380M 0s 2024-09-12T17:49:15.241 INFO:teuthology.orchestra.run.smithi044.stderr: 28450K .......... .......... .......... .......... .......... 30% 372M 0s 2024-09-12T17:49:15.241 INFO:teuthology.orchestra.run.smithi044.stderr: 28500K .......... .......... .......... .......... .......... 30% 303M 0s 2024-09-12T17:49:15.241 INFO:teuthology.orchestra.run.smithi044.stderr: 28550K .......... .......... .......... .......... .......... 30% 369M 0s 2024-09-12T17:49:15.241 INFO:teuthology.orchestra.run.smithi044.stderr: 28600K .......... .......... .......... .......... .......... 30% 376M 0s 2024-09-12T17:49:15.241 INFO:teuthology.orchestra.run.smithi044.stderr: 28650K .......... .......... .......... .......... .......... 30% 383M 0s 2024-09-12T17:49:15.241 INFO:teuthology.orchestra.run.smithi044.stderr: 28700K .......... .......... .......... .......... .......... 30% 283M 0s 2024-09-12T17:49:15.241 INFO:teuthology.orchestra.run.smithi044.stderr: 28750K .......... .......... .......... .......... .......... 31% 223M 0s 2024-09-12T17:49:15.241 INFO:teuthology.orchestra.run.smithi044.stderr: 28800K .......... .......... .......... .......... .......... 31% 353M 0s 2024-09-12T17:49:15.242 INFO:teuthology.orchestra.run.smithi044.stderr: 28850K .......... .......... .......... .......... .......... 31% 378M 0s 2024-09-12T17:49:15.242 INFO:teuthology.orchestra.run.smithi044.stderr: 28900K .......... .......... .......... .......... .......... 31% 247M 0s 2024-09-12T17:49:15.242 INFO:teuthology.orchestra.run.smithi044.stderr: 28950K .......... .......... .......... .......... .......... 31% 232M 0s 2024-09-12T17:49:15.242 INFO:teuthology.orchestra.run.smithi044.stderr: 29000K .......... .......... .......... .......... .......... 31% 237M 0s 2024-09-12T17:49:15.242 INFO:teuthology.orchestra.run.smithi044.stderr: 29050K .......... .......... .......... .......... .......... 31% 232M 0s 2024-09-12T17:49:15.242 INFO:teuthology.orchestra.run.smithi044.stderr: 29100K .......... .......... .......... .......... .......... 31% 212M 0s 2024-09-12T17:49:15.242 INFO:teuthology.orchestra.run.smithi044.stderr: 29150K .......... .......... .......... .......... .......... 31% 280M 0s 2024-09-12T17:49:15.242 INFO:teuthology.orchestra.run.smithi044.stderr: 29200K .......... .......... .......... .......... .......... 31% 266M 0s 2024-09-12T17:49:15.242 INFO:teuthology.orchestra.run.smithi044.stderr: 29250K .......... .......... .......... .......... .......... 31% 357M 0s 2024-09-12T17:49:15.242 INFO:teuthology.orchestra.run.smithi044.stderr: 29300K .......... .......... .......... .......... .......... 31% 299M 0s 2024-09-12T17:49:15.242 INFO:teuthology.orchestra.run.smithi044.stderr: 29350K .......... .......... .......... .......... .......... 31% 367M 0s 2024-09-12T17:49:15.242 INFO:teuthology.orchestra.run.smithi044.stderr: 29400K .......... .......... .......... .......... .......... 31% 349M 0s 2024-09-12T17:49:15.243 INFO:teuthology.orchestra.run.smithi044.stderr: 29450K .......... .......... .......... .......... .......... 31% 371M 0s 2024-09-12T17:49:15.243 INFO:teuthology.orchestra.run.smithi044.stderr: 29500K .......... .......... .......... .......... .......... 31% 333M 0s 2024-09-12T17:49:15.243 INFO:teuthology.orchestra.run.smithi044.stderr: 29550K .......... .......... .......... .......... .......... 31% 339M 0s 2024-09-12T17:49:15.243 INFO:teuthology.orchestra.run.smithi044.stderr: 29600K .......... .......... .......... .......... .......... 31% 357M 0s 2024-09-12T17:49:15.243 INFO:teuthology.orchestra.run.smithi044.stderr: 29650K .......... .......... .......... .......... .......... 31% 371M 0s 2024-09-12T17:49:15.243 INFO:teuthology.orchestra.run.smithi044.stderr: 29700K .......... .......... .......... .......... .......... 32% 307M 0s 2024-09-12T17:49:15.243 INFO:teuthology.orchestra.run.smithi044.stderr: 29750K .......... .......... .......... .......... .......... 32% 365M 0s 2024-09-12T17:49:15.243 INFO:teuthology.orchestra.run.smithi044.stderr: 29800K .......... .......... .......... .......... .......... 32% 371M 0s 2024-09-12T17:49:15.243 INFO:teuthology.orchestra.run.smithi044.stderr: 29850K .......... .......... .......... .......... .......... 32% 377M 0s 2024-09-12T17:49:15.243 INFO:teuthology.orchestra.run.smithi044.stderr: 29900K .......... .......... .......... .......... .......... 32% 314M 0s 2024-09-12T17:49:15.243 INFO:teuthology.orchestra.run.smithi044.stderr: 29950K .......... .......... .......... .......... .......... 32% 334M 0s 2024-09-12T17:49:15.243 INFO:teuthology.orchestra.run.smithi044.stderr: 30000K .......... .......... .......... .......... .......... 32% 368M 0s 2024-09-12T17:49:15.244 INFO:teuthology.orchestra.run.smithi044.stderr: 30050K .......... .......... .......... .......... .......... 32% 194M 0s 2024-09-12T17:49:15.244 INFO:teuthology.orchestra.run.smithi044.stderr: 30100K .......... .......... .......... .......... .......... 32% 260M 0s 2024-09-12T17:49:15.244 INFO:teuthology.orchestra.run.smithi044.stderr: 30150K .......... .......... .......... .......... .......... 32% 281M 0s 2024-09-12T17:49:15.244 INFO:teuthology.orchestra.run.smithi044.stderr: 30200K .......... .......... .......... .......... .......... 32% 317M 0s 2024-09-12T17:49:15.244 INFO:teuthology.orchestra.run.smithi044.stderr: 30250K .......... .......... .......... .......... .......... 32% 369M 0s 2024-09-12T17:49:15.244 INFO:teuthology.orchestra.run.smithi044.stderr: 30300K .......... .......... .......... .......... .......... 32% 329M 0s 2024-09-12T17:49:15.244 INFO:teuthology.orchestra.run.smithi044.stderr: 30350K .......... .......... .......... .......... .......... 32% 372M 0s 2024-09-12T17:49:15.244 INFO:teuthology.orchestra.run.smithi044.stderr: 30400K .......... .......... .......... .......... .......... 32% 380M 0s 2024-09-12T17:49:15.244 INFO:teuthology.orchestra.run.smithi044.stderr: 30450K .......... .......... .......... .......... .......... 32% 157M 0s 2024-09-12T17:49:15.244 INFO:teuthology.orchestra.run.smithi044.stderr: 30500K .......... .......... .......... .......... .......... 32% 257M 0s 2024-09-12T17:49:15.244 INFO:teuthology.orchestra.run.smithi044.stderr: 30550K .......... .......... .......... .......... .......... 32% 375M 0s 2024-09-12T17:49:15.244 INFO:teuthology.orchestra.run.smithi044.stderr: 30600K .......... .......... .......... .......... .......... 32% 308M 0s 2024-09-12T17:49:15.244 INFO:teuthology.orchestra.run.smithi044.stderr: 30650K .......... .......... .......... .......... .......... 33% 364M 0s 2024-09-12T17:49:15.245 INFO:teuthology.orchestra.run.smithi044.stderr: 30700K .......... .......... .......... .......... .......... 33% 373M 0s 2024-09-12T17:49:15.245 INFO:teuthology.orchestra.run.smithi044.stderr: 30750K .......... .......... .......... .......... .......... 33% 97.5M 0s 2024-09-12T17:49:15.245 INFO:teuthology.orchestra.run.smithi044.stderr: 30800K .......... .......... .......... .......... .......... 33% 72.1M 0s 2024-09-12T17:49:15.245 INFO:teuthology.orchestra.run.smithi044.stderr: 30850K .......... .......... .......... .......... .......... 33% 362M 0s 2024-09-12T17:49:15.245 INFO:teuthology.orchestra.run.smithi044.stderr: 30900K .......... .......... .......... .......... .......... 33% 347M 0s 2024-09-12T17:49:15.245 INFO:teuthology.orchestra.run.smithi044.stderr: 30950K .......... .......... .......... .......... .......... 33% 335M 0s 2024-09-12T17:49:15.245 INFO:teuthology.orchestra.run.smithi044.stderr: 31000K .......... .......... .......... .......... .......... 33% 395M 0s 2024-09-12T17:49:15.245 INFO:teuthology.orchestra.run.smithi044.stderr: 31050K .......... .......... .......... .......... .......... 33% 125M 0s 2024-09-12T17:49:15.245 INFO:teuthology.orchestra.run.smithi044.stderr: 31100K .......... .......... .......... .......... .......... 33% 104M 0s 2024-09-12T17:49:15.245 INFO:teuthology.orchestra.run.smithi044.stderr: 31150K .......... .......... .......... .......... .......... 33% 293M 0s 2024-09-12T17:49:15.245 INFO:teuthology.orchestra.run.smithi044.stderr: 31200K .......... .......... .......... .......... .......... 33% 390M 0s 2024-09-12T17:49:15.245 INFO:teuthology.orchestra.run.smithi044.stderr: 31250K .......... .......... .......... .......... .......... 33% 157M 0s 2024-09-12T17:49:15.246 INFO:teuthology.orchestra.run.smithi044.stderr: 31300K .......... .......... .......... .......... .......... 33% 160M 0s 2024-09-12T17:49:15.246 INFO:teuthology.orchestra.run.smithi044.stderr: 31350K .......... .......... .......... .......... .......... 33% 131M 0s 2024-09-12T17:49:15.246 INFO:teuthology.orchestra.run.smithi044.stderr: 31400K .......... .......... .......... .......... .......... 33% 157M 0s 2024-09-12T17:49:15.246 INFO:teuthology.orchestra.run.smithi044.stderr: 31450K .......... .......... .......... .......... .......... 33% 229M 0s 2024-09-12T17:49:15.246 INFO:teuthology.orchestra.run.smithi044.stderr: 31500K .......... .......... .......... .......... .......... 33% 258M 0s 2024-09-12T17:49:15.246 INFO:teuthology.orchestra.run.smithi044.stderr: 31550K .......... .......... .......... .......... .......... 34% 263M 0s 2024-09-12T17:49:15.246 INFO:teuthology.orchestra.run.smithi044.stderr: 31600K .......... .......... .......... .......... .......... 34% 351M 0s 2024-09-12T17:49:15.246 INFO:teuthology.orchestra.run.smithi044.stderr: 31650K .......... .......... .......... .......... .......... 34% 383M 0s 2024-09-12T17:49:15.246 INFO:teuthology.orchestra.run.smithi044.stderr: 31700K .......... .......... .......... .......... .......... 34% 376M 0s 2024-09-12T17:49:15.246 INFO:teuthology.orchestra.run.smithi044.stderr: 31750K .......... .......... .......... .......... .......... 34% 333M 0s 2024-09-12T17:49:15.246 INFO:teuthology.orchestra.run.smithi044.stderr: 31800K .......... .......... .......... .......... .......... 34% 356M 0s 2024-09-12T17:49:15.246 INFO:teuthology.orchestra.run.smithi044.stderr: 31850K .......... .......... .......... .......... .......... 34% 385M 0s 2024-09-12T17:49:15.246 INFO:teuthology.orchestra.run.smithi044.stderr: 31900K .......... .......... .......... .......... .......... 34% 386M 0s 2024-09-12T17:49:15.246 INFO:teuthology.orchestra.run.smithi044.stderr: 31950K .......... .......... .......... .......... .......... 34% 327M 0s 2024-09-12T17:49:15.247 INFO:teuthology.orchestra.run.smithi044.stderr: 32000K .......... .......... .......... .......... .......... 34% 387M 0s 2024-09-12T17:49:15.247 INFO:teuthology.orchestra.run.smithi044.stderr: 32050K .......... .......... .......... .......... .......... 34% 388M 0s 2024-09-12T17:49:15.247 INFO:teuthology.orchestra.run.smithi044.stderr: 32100K .......... .......... .......... .......... .......... 34% 131M 0s 2024-09-12T17:49:15.247 INFO:teuthology.orchestra.run.smithi044.stderr: 32150K .......... .......... .......... .......... .......... 34% 335M 0s 2024-09-12T17:49:15.247 INFO:teuthology.orchestra.run.smithi044.stderr: 32200K .......... .......... .......... .......... .......... 34% 308M 0s 2024-09-12T17:49:15.247 INFO:teuthology.orchestra.run.smithi044.stderr: 32250K .......... .......... .......... .......... .......... 34% 367M 0s 2024-09-12T17:49:15.247 INFO:teuthology.orchestra.run.smithi044.stderr: 32300K .......... .......... .......... .......... .......... 34% 243M 0s 2024-09-12T17:49:15.247 INFO:teuthology.orchestra.run.smithi044.stderr: 32350K .......... .......... .......... .......... .......... 34% 268M 0s 2024-09-12T17:49:15.247 INFO:teuthology.orchestra.run.smithi044.stderr: 32400K .......... .......... .......... .......... .......... 34% 344M 0s 2024-09-12T17:49:15.247 INFO:teuthology.orchestra.run.smithi044.stderr: 32450K .......... .......... .......... .......... .......... 34% 186M 0s 2024-09-12T17:49:15.247 INFO:teuthology.orchestra.run.smithi044.stderr: 32500K .......... .......... .......... .......... .......... 35% 320M 0s 2024-09-12T17:49:15.247 INFO:teuthology.orchestra.run.smithi044.stderr: 32550K .......... .......... .......... .......... .......... 35% 154M 0s 2024-09-12T17:49:15.247 INFO:teuthology.orchestra.run.smithi044.stderr: 32600K .......... .......... .......... .......... .......... 35% 225M 0s 2024-09-12T17:49:15.248 INFO:teuthology.orchestra.run.smithi044.stderr: 32650K .......... .......... .......... .......... .......... 35% 375M 0s 2024-09-12T17:49:15.248 INFO:teuthology.orchestra.run.smithi044.stderr: 32700K .......... .......... .......... .......... .......... 35% 327M 0s 2024-09-12T17:49:15.248 INFO:teuthology.orchestra.run.smithi044.stderr: 32750K .......... .......... .......... .......... .......... 35% 272M 0s 2024-09-12T17:49:15.248 INFO:teuthology.orchestra.run.smithi044.stderr: 32800K .......... .......... .......... .......... .......... 35% 328M 0s 2024-09-12T17:49:15.248 INFO:teuthology.orchestra.run.smithi044.stderr: 32850K .......... .......... .......... .......... .......... 35% 344M 0s 2024-09-12T17:49:15.248 INFO:teuthology.orchestra.run.smithi044.stderr: 32900K .......... .......... .......... .......... .......... 35% 383M 0s 2024-09-12T17:49:15.248 INFO:teuthology.orchestra.run.smithi044.stderr: 32950K .......... .......... .......... .......... .......... 35% 336M 0s 2024-09-12T17:49:15.248 INFO:teuthology.orchestra.run.smithi044.stderr: 33000K .......... .......... .......... .......... .......... 35% 368M 0s 2024-09-12T17:49:15.248 INFO:teuthology.orchestra.run.smithi044.stderr: 33050K .......... .......... .......... .......... .......... 35% 377M 0s 2024-09-12T17:49:15.249 INFO:teuthology.orchestra.run.smithi044.stderr: 33100K .......... .......... .......... .......... .......... 35% 380M 0s 2024-09-12T17:49:15.249 INFO:teuthology.orchestra.run.smithi044.stderr: 33150K .......... .......... .......... .......... .......... 35% 326M 0s 2024-09-12T17:49:15.249 INFO:teuthology.orchestra.run.smithi044.stderr: 33200K .......... .......... .......... .......... .......... 35% 388M 0s 2024-09-12T17:49:15.249 INFO:teuthology.orchestra.run.smithi044.stderr: 33250K .......... .......... .......... .......... .......... 35% 401M 0s 2024-09-12T17:49:15.249 INFO:teuthology.orchestra.run.smithi044.stderr: 33300K .......... .......... .......... .......... .......... 35% 364M 0s 2024-09-12T17:49:15.249 INFO:teuthology.orchestra.run.smithi044.stderr: 33350K .......... .......... .......... .......... .......... 35% 325M 0s 2024-09-12T17:49:15.249 INFO:teuthology.orchestra.run.smithi044.stderr: 33400K .......... .......... .......... .......... .......... 36% 393M 0s 2024-09-12T17:49:15.249 INFO:teuthology.orchestra.run.smithi044.stderr: 33450K .......... .......... .......... .......... .......... 36% 176M 0s 2024-09-12T17:49:15.249 INFO:teuthology.orchestra.run.smithi044.stderr: 33500K .......... .......... .......... .......... .......... 36% 238M 0s 2024-09-12T17:49:15.249 INFO:teuthology.orchestra.run.smithi044.stderr: 33550K .......... .......... .......... .......... .......... 36% 320M 0s 2024-09-12T17:49:15.249 INFO:teuthology.orchestra.run.smithi044.stderr: 33600K .......... .......... .......... .......... .......... 36% 351M 0s 2024-09-12T17:49:15.249 INFO:teuthology.orchestra.run.smithi044.stderr: 33650K .......... .......... .......... .......... .......... 36% 371M 0s 2024-09-12T17:49:15.250 INFO:teuthology.orchestra.run.smithi044.stderr: 33700K .......... .......... .......... .......... .......... 36% 387M 0s 2024-09-12T17:49:15.250 INFO:teuthology.orchestra.run.smithi044.stderr: 33750K .......... .......... .......... .......... .......... 36% 349M 0s 2024-09-12T17:49:15.250 INFO:teuthology.orchestra.run.smithi044.stderr: 33800K .......... .......... .......... .......... .......... 36% 386M 0s 2024-09-12T17:49:15.250 INFO:teuthology.orchestra.run.smithi044.stderr: 33850K .......... .......... .......... .......... .......... 36% 59.2M 0s 2024-09-12T17:49:15.250 INFO:teuthology.orchestra.run.smithi044.stderr: 33900K .......... .......... .......... .......... .......... 36% 369M 0s 2024-09-12T17:49:15.250 INFO:teuthology.orchestra.run.smithi044.stderr: 33950K .......... .......... .......... .......... .......... 36% 197M 0s 2024-09-12T17:49:15.250 INFO:teuthology.orchestra.run.smithi044.stderr: 34000K .......... .......... .......... .......... .......... 36% 102M 0s 2024-09-12T17:49:15.250 INFO:teuthology.orchestra.run.smithi044.stderr: 34050K .......... .......... .......... .......... .......... 36% 259M 0s 2024-09-12T17:49:15.250 INFO:teuthology.orchestra.run.smithi044.stderr: 34100K .......... .......... .......... .......... .......... 36% 377M 0s 2024-09-12T17:49:15.250 INFO:teuthology.orchestra.run.smithi044.stderr: 34150K .......... .......... .......... .......... .......... 36% 213M 0s 2024-09-12T17:49:15.250 INFO:teuthology.orchestra.run.smithi044.stderr: 34200K .......... .......... .......... .......... .......... 36% 250M 0s 2024-09-12T17:49:15.251 INFO:teuthology.orchestra.run.smithi044.stderr: 34250K .......... .......... .......... .......... .......... 36% 369M 0s 2024-09-12T17:49:15.251 INFO:teuthology.orchestra.run.smithi044.stderr: 34300K .......... .......... .......... .......... .......... 36% 172M 0s 2024-09-12T17:49:15.251 INFO:teuthology.orchestra.run.smithi044.stderr: 34350K .......... .......... .......... .......... .......... 37% 202M 0s 2024-09-12T17:49:15.251 INFO:teuthology.orchestra.run.smithi044.stderr: 34400K .......... .......... .......... .......... .......... 37% 116M 0s 2024-09-12T17:49:15.251 INFO:teuthology.orchestra.run.smithi044.stderr: 34450K .......... .......... .......... .......... .......... 37% 139M 0s 2024-09-12T17:49:15.251 INFO:teuthology.orchestra.run.smithi044.stderr: 34500K .......... .......... .......... .......... .......... 37% 285M 0s 2024-09-12T17:49:15.251 INFO:teuthology.orchestra.run.smithi044.stderr: 34550K .......... .......... .......... .......... .......... 37% 233M 0s 2024-09-12T17:49:15.251 INFO:teuthology.orchestra.run.smithi044.stderr: 34600K .......... .......... .......... .......... .......... 37% 267M 0s 2024-09-12T17:49:15.251 INFO:teuthology.orchestra.run.smithi044.stderr: 34650K .......... .......... .......... .......... .......... 37% 345M 0s 2024-09-12T17:49:15.251 INFO:teuthology.orchestra.run.smithi044.stderr: 34700K .......... .......... .......... .......... .......... 37% 368M 0s 2024-09-12T17:49:15.251 INFO:teuthology.orchestra.run.smithi044.stderr: 34750K .......... .......... .......... .......... .......... 37% 308M 0s 2024-09-12T17:49:15.251 INFO:teuthology.orchestra.run.smithi044.stderr: 34800K .......... .......... .......... .......... .......... 37% 377M 0s 2024-09-12T17:49:15.251 INFO:teuthology.orchestra.run.smithi044.stderr: 34850K .......... .......... .......... .......... .......... 37% 372M 0s 2024-09-12T17:49:15.252 INFO:teuthology.orchestra.run.smithi044.stderr: 34900K .......... .......... .......... .......... .......... 37% 327M 0s 2024-09-12T17:49:15.252 INFO:teuthology.orchestra.run.smithi044.stderr: 34950K .......... .......... .......... .......... .......... 37% 333M 0s 2024-09-12T17:49:15.252 INFO:teuthology.orchestra.run.smithi044.stderr: 35000K .......... .......... .......... .......... .......... 37% 321M 0s 2024-09-12T17:49:15.252 INFO:teuthology.orchestra.run.smithi044.stderr: 35050K .......... .......... .......... .......... .......... 37% 378M 0s 2024-09-12T17:49:15.252 INFO:teuthology.orchestra.run.smithi044.stderr: 35100K .......... .......... .......... .......... .......... 37% 375M 0s 2024-09-12T17:49:15.252 INFO:teuthology.orchestra.run.smithi044.stderr: 35150K .......... .......... .......... .......... .......... 37% 163M 0s 2024-09-12T17:49:15.252 INFO:teuthology.orchestra.run.smithi044.stderr: 35200K .......... .......... .......... .......... .......... 37% 305M 0s 2024-09-12T17:49:15.252 INFO:teuthology.orchestra.run.smithi044.stderr: 35250K .......... .......... .......... .......... .......... 37% 361M 0s 2024-09-12T17:49:15.252 INFO:teuthology.orchestra.run.smithi044.stderr: 35300K .......... .......... .......... .......... .......... 38% 343M 0s 2024-09-12T17:49:15.252 INFO:teuthology.orchestra.run.smithi044.stderr: 35350K .......... .......... .......... .......... .......... 38% 326M 0s 2024-09-12T17:49:15.252 INFO:teuthology.orchestra.run.smithi044.stderr: 35400K .......... .......... .......... .......... .......... 38% 339M 0s 2024-09-12T17:49:15.252 INFO:teuthology.orchestra.run.smithi044.stderr: 35450K .......... .......... .......... .......... .......... 38% 328M 0s 2024-09-12T17:49:15.253 INFO:teuthology.orchestra.run.smithi044.stderr: 35500K .......... .......... .......... .......... .......... 38% 152M 0s 2024-09-12T17:49:15.253 INFO:teuthology.orchestra.run.smithi044.stderr: 35550K .......... .......... .......... .......... .......... 38% 268M 0s 2024-09-12T17:49:15.253 INFO:teuthology.orchestra.run.smithi044.stderr: 35600K .......... .......... .......... .......... .......... 38% 170M 0s 2024-09-12T17:49:15.253 INFO:teuthology.orchestra.run.smithi044.stderr: 35650K .......... .......... .......... .......... .......... 38% 375M 0s 2024-09-12T17:49:15.253 INFO:teuthology.orchestra.run.smithi044.stderr: 35700K .......... .......... .......... .......... .......... 38% 136M 0s 2024-09-12T17:49:15.253 INFO:teuthology.orchestra.run.smithi044.stderr: 35750K .......... .......... .......... .......... .......... 38% 137M 0s 2024-09-12T17:49:15.253 INFO:teuthology.orchestra.run.smithi044.stderr: 35800K .......... .......... .......... .......... .......... 38% 359M 0s 2024-09-12T17:49:15.253 INFO:teuthology.orchestra.run.smithi044.stderr: 35850K .......... .......... .......... .......... .......... 38% 389M 0s 2024-09-12T17:49:15.253 INFO:teuthology.orchestra.run.smithi044.stderr: 35900K .......... .......... .......... .......... .......... 38% 378M 0s 2024-09-12T17:49:15.253 INFO:teuthology.orchestra.run.smithi044.stderr: 35950K .......... .......... .......... .......... .......... 38% 314M 0s 2024-09-12T17:49:15.253 INFO:teuthology.orchestra.run.smithi044.stderr: 36000K .......... .......... .......... .......... .......... 38% 378M 0s 2024-09-12T17:49:15.253 INFO:teuthology.orchestra.run.smithi044.stderr: 36050K .......... .......... .......... .......... .......... 38% 353M 0s 2024-09-12T17:49:15.254 INFO:teuthology.orchestra.run.smithi044.stderr: 36100K .......... .......... .......... .......... .......... 38% 363M 0s 2024-09-12T17:49:15.254 INFO:teuthology.orchestra.run.smithi044.stderr: 36150K .......... .......... .......... .......... .......... 38% 348M 0s 2024-09-12T17:49:15.254 INFO:teuthology.orchestra.run.smithi044.stderr: 36200K .......... .......... .......... .......... .......... 39% 398M 0s 2024-09-12T17:49:15.254 INFO:teuthology.orchestra.run.smithi044.stderr: 36250K .......... .......... .......... .......... .......... 39% 139M 0s 2024-09-12T17:49:15.254 INFO:teuthology.orchestra.run.smithi044.stderr: 36300K .......... .......... .......... .......... .......... 39% 384M 0s 2024-09-12T17:49:15.254 INFO:teuthology.orchestra.run.smithi044.stderr: 36350K .......... .......... .......... .......... .......... 39% 292M 0s 2024-09-12T17:49:15.254 INFO:teuthology.orchestra.run.smithi044.stderr: 36400K .......... .......... .......... .......... .......... 39% 212M 0s 2024-09-12T17:49:15.254 INFO:teuthology.orchestra.run.smithi044.stderr: 36450K .......... .......... .......... .......... .......... 39% 379M 0s 2024-09-12T17:49:15.254 INFO:teuthology.orchestra.run.smithi044.stderr: 36500K .......... .......... .......... .......... .......... 39% 386M 0s 2024-09-12T17:49:15.254 INFO:teuthology.orchestra.run.smithi044.stderr: 36550K .......... .......... .......... .......... .......... 39% 351M 0s 2024-09-12T17:49:15.254 INFO:teuthology.orchestra.run.smithi044.stderr: 36600K .......... .......... .......... .......... .......... 39% 377M 0s 2024-09-12T17:49:15.254 INFO:teuthology.orchestra.run.smithi044.stderr: 36650K .......... .......... .......... .......... .......... 39% 395M 0s 2024-09-12T17:49:15.254 INFO:teuthology.orchestra.run.smithi044.stderr: 36700K .......... .......... .......... .......... .......... 39% 358M 0s 2024-09-12T17:49:15.255 INFO:teuthology.orchestra.run.smithi044.stderr: 36750K .......... .......... .......... .......... .......... 39% 324M 0s 2024-09-12T17:49:15.255 INFO:teuthology.orchestra.run.smithi044.stderr: 36800K .......... .......... .......... .......... .......... 39% 78.0M 0s 2024-09-12T17:49:15.255 INFO:teuthology.orchestra.run.smithi044.stderr: 36850K .......... .......... .......... .......... .......... 39% 246M 0s 2024-09-12T17:49:15.255 INFO:teuthology.orchestra.run.smithi044.stderr: 36900K .......... .......... .......... .......... .......... 39% 329M 0s 2024-09-12T17:49:15.255 INFO:teuthology.orchestra.run.smithi044.stderr: 36950K .......... .......... .......... .......... .......... 39% 300M 0s 2024-09-12T17:49:15.255 INFO:teuthology.orchestra.run.smithi044.stderr: 37000K .......... .......... .......... .......... .......... 39% 379M 0s 2024-09-12T17:49:15.255 INFO:teuthology.orchestra.run.smithi044.stderr: 37050K .......... .......... .......... .......... .......... 39% 389M 0s 2024-09-12T17:49:15.255 INFO:teuthology.orchestra.run.smithi044.stderr: 37100K .......... .......... .......... .......... .......... 39% 102M 0s 2024-09-12T17:49:15.255 INFO:teuthology.orchestra.run.smithi044.stderr: 37150K .......... .......... .......... .......... .......... 40% 320M 0s 2024-09-12T17:49:15.255 INFO:teuthology.orchestra.run.smithi044.stderr: 37200K .......... .......... .......... .......... .......... 40% 372M 0s 2024-09-12T17:49:15.255 INFO:teuthology.orchestra.run.smithi044.stderr: 37250K .......... .......... .......... .......... .......... 40% 229M 0s 2024-09-12T17:49:15.255 INFO:teuthology.orchestra.run.smithi044.stderr: 37300K .......... .......... .......... .......... .......... 40% 385M 0s 2024-09-12T17:49:15.255 INFO:teuthology.orchestra.run.smithi044.stderr: 37350K .......... .......... .......... .......... .......... 40% 192M 0s 2024-09-12T17:49:15.255 INFO:teuthology.orchestra.run.smithi044.stderr: 37400K .......... .......... .......... .......... .......... 40% 122M 0s 2024-09-12T17:49:15.256 INFO:teuthology.orchestra.run.smithi044.stderr: 37450K .......... .......... .......... .......... .......... 40% 231M 0s 2024-09-12T17:49:15.256 INFO:teuthology.orchestra.run.smithi044.stderr: 37500K .......... .......... .......... .......... .......... 40% 371M 0s 2024-09-12T17:49:15.256 INFO:teuthology.orchestra.run.smithi044.stderr: 37550K .......... .......... .......... .......... .......... 40% 89.4M 0s 2024-09-12T17:49:15.256 INFO:teuthology.orchestra.run.smithi044.stderr: 37600K .......... .......... .......... .......... .......... 40% 244M 0s 2024-09-12T17:49:15.256 INFO:teuthology.orchestra.run.smithi044.stderr: 37650K .......... .......... .......... .......... .......... 40% 368M 0s 2024-09-12T17:49:15.256 INFO:teuthology.orchestra.run.smithi044.stderr: 37700K .......... .......... .......... .......... .......... 40% 257M 0s 2024-09-12T17:49:15.256 INFO:teuthology.orchestra.run.smithi044.stderr: 37750K .......... .......... .......... .......... .......... 40% 337M 0s 2024-09-12T17:49:15.256 INFO:teuthology.orchestra.run.smithi044.stderr: 37800K .......... .......... .......... .......... .......... 40% 84.5M 0s 2024-09-12T17:49:15.256 INFO:teuthology.orchestra.run.smithi044.stderr: 37850K .......... .......... .......... .......... .......... 40% 355M 0s 2024-09-12T17:49:15.256 INFO:teuthology.orchestra.run.smithi044.stderr: 37900K .......... .......... .......... .......... .......... 40% 292M 0s 2024-09-12T17:49:15.256 INFO:teuthology.orchestra.run.smithi044.stderr: 37950K .......... .......... .......... .......... .......... 40% 240M 0s 2024-09-12T17:49:15.256 INFO:teuthology.orchestra.run.smithi044.stderr: 38000K .......... .......... .......... .......... .......... 40% 369M 0s 2024-09-12T17:49:15.257 INFO:teuthology.orchestra.run.smithi044.stderr: 38050K .......... .......... .......... .......... .......... 41% 400M 0s 2024-09-12T17:49:15.257 INFO:teuthology.orchestra.run.smithi044.stderr: 38100K .......... .......... .......... .......... .......... 41% 357M 0s 2024-09-12T17:49:15.257 INFO:teuthology.orchestra.run.smithi044.stderr: 38150K .......... .......... .......... .......... .......... 41% 316M 0s 2024-09-12T17:49:15.257 INFO:teuthology.orchestra.run.smithi044.stderr: 38200K .......... .......... .......... .......... .......... 41% 314M 0s 2024-09-12T17:49:15.257 INFO:teuthology.orchestra.run.smithi044.stderr: 38250K .......... .......... .......... .......... .......... 41% 313M 0s 2024-09-12T17:49:15.257 INFO:teuthology.orchestra.run.smithi044.stderr: 38300K .......... .......... .......... .......... .......... 41% 259M 0s 2024-09-12T17:49:15.257 INFO:teuthology.orchestra.run.smithi044.stderr: 38350K .......... .......... .......... .......... .......... 41% 304M 0s 2024-09-12T17:49:15.257 INFO:teuthology.orchestra.run.smithi044.stderr: 38400K .......... .......... .......... .......... .......... 41% 365M 0s 2024-09-12T17:49:15.257 INFO:teuthology.orchestra.run.smithi044.stderr: 38450K .......... .......... .......... .......... .......... 41% 357M 0s 2024-09-12T17:49:15.257 INFO:teuthology.orchestra.run.smithi044.stderr: 38500K .......... .......... .......... .......... .......... 41% 375M 0s 2024-09-12T17:49:15.257 INFO:teuthology.orchestra.run.smithi044.stderr: 38550K .......... .......... .......... .......... .......... 41% 349M 0s 2024-09-12T17:49:15.258 INFO:teuthology.orchestra.run.smithi044.stderr: 38600K .......... .......... .......... .......... .......... 41% 383M 0s 2024-09-12T17:49:15.258 INFO:teuthology.orchestra.run.smithi044.stderr: 38650K .......... .......... .......... .......... .......... 41% 361M 0s 2024-09-12T17:49:15.258 INFO:teuthology.orchestra.run.smithi044.stderr: 38700K .......... .......... .......... .......... .......... 41% 391M 0s 2024-09-12T17:49:15.258 INFO:teuthology.orchestra.run.smithi044.stderr: 38750K .......... .......... .......... .......... .......... 41% 92.8M 0s 2024-09-12T17:49:15.258 INFO:teuthology.orchestra.run.smithi044.stderr: 38800K .......... .......... .......... .......... .......... 41% 386M 0s 2024-09-12T17:49:15.258 INFO:teuthology.orchestra.run.smithi044.stderr: 38850K .......... .......... .......... .......... .......... 41% 314M 0s 2024-09-12T17:49:15.258 INFO:teuthology.orchestra.run.smithi044.stderr: 38900K .......... .......... .......... .......... .......... 41% 207M 0s 2024-09-12T17:49:15.258 INFO:teuthology.orchestra.run.smithi044.stderr: 38950K .......... .......... .......... .......... .......... 41% 349M 0s 2024-09-12T17:49:15.258 INFO:teuthology.orchestra.run.smithi044.stderr: 39000K .......... .......... .......... .......... .......... 42% 274M 0s 2024-09-12T17:49:15.258 INFO:teuthology.orchestra.run.smithi044.stderr: 39050K .......... .......... .......... .......... .......... 42% 363M 0s 2024-09-12T17:49:15.258 INFO:teuthology.orchestra.run.smithi044.stderr: 39100K .......... .......... .......... .......... .......... 42% 384M 0s 2024-09-12T17:49:15.258 INFO:teuthology.orchestra.run.smithi044.stderr: 39150K .......... .......... .......... .......... .......... 42% 302M 0s 2024-09-12T17:49:15.258 INFO:teuthology.orchestra.run.smithi044.stderr: 39200K .......... .......... .......... .......... .......... 42% 363M 0s 2024-09-12T17:49:15.259 INFO:teuthology.orchestra.run.smithi044.stderr: 39250K .......... .......... .......... .......... .......... 42% 200M 0s 2024-09-12T17:49:15.259 INFO:teuthology.orchestra.run.smithi044.stderr: 39300K .......... .......... .......... .......... .......... 42% 268M 0s 2024-09-12T17:49:15.259 INFO:teuthology.orchestra.run.smithi044.stderr: 39350K .......... .......... .......... .......... .......... 42% 339M 0s 2024-09-12T17:49:15.259 INFO:teuthology.orchestra.run.smithi044.stderr: 39400K .......... .......... .......... .......... .......... 42% 371M 0s 2024-09-12T17:49:15.259 INFO:teuthology.orchestra.run.smithi044.stderr: 39450K .......... .......... .......... .......... .......... 42% 373M 0s 2024-09-12T17:49:15.259 INFO:teuthology.orchestra.run.smithi044.stderr: 39500K .......... .......... .......... .......... .......... 42% 349M 0s 2024-09-12T17:49:15.259 INFO:teuthology.orchestra.run.smithi044.stderr: 39550K .......... .......... .......... .......... .......... 42% 314M 0s 2024-09-12T17:49:15.259 INFO:teuthology.orchestra.run.smithi044.stderr: 39600K .......... .......... .......... .......... .......... 42% 376M 0s 2024-09-12T17:49:15.259 INFO:teuthology.orchestra.run.smithi044.stderr: 39650K .......... .......... .......... .......... .......... 42% 360M 0s 2024-09-12T17:49:15.259 INFO:teuthology.orchestra.run.smithi044.stderr: 39700K .......... .......... .......... .......... .......... 42% 368M 0s 2024-09-12T17:49:15.260 INFO:teuthology.orchestra.run.smithi044.stderr: 39750K .......... .......... .......... .......... .......... 42% 343M 0s 2024-09-12T17:49:15.260 INFO:teuthology.orchestra.run.smithi044.stderr: 39800K .......... .......... .......... .......... .......... 42% 65.9M 0s 2024-09-12T17:49:15.260 INFO:teuthology.orchestra.run.smithi044.stderr: 39850K .......... .......... .......... .......... .......... 42% 347M 0s 2024-09-12T17:49:15.260 INFO:teuthology.orchestra.run.smithi044.stderr: 39900K .......... .......... .......... .......... .......... 43% 364M 0s 2024-09-12T17:49:15.260 INFO:teuthology.orchestra.run.smithi044.stderr: 39950K .......... .......... .......... .......... .......... 43% 306M 0s 2024-09-12T17:49:15.260 INFO:teuthology.orchestra.run.smithi044.stderr: 40000K .......... .......... .......... .......... .......... 43% 355M 0s 2024-09-12T17:49:15.260 INFO:teuthology.orchestra.run.smithi044.stderr: 40050K .......... .......... .......... .......... .......... 43% 211M 0s 2024-09-12T17:49:15.260 INFO:teuthology.orchestra.run.smithi044.stderr: 40100K .......... .......... .......... .......... .......... 43% 364M 0s 2024-09-12T17:49:15.260 INFO:teuthology.orchestra.run.smithi044.stderr: 40150K .......... .......... .......... .......... .......... 43% 338M 0s 2024-09-12T17:49:15.260 INFO:teuthology.orchestra.run.smithi044.stderr: 40200K .......... .......... .......... .......... .......... 43% 339M 0s 2024-09-12T17:49:15.260 INFO:teuthology.orchestra.run.smithi044.stderr: 40250K .......... .......... .......... .......... .......... 43% 275M 0s 2024-09-12T17:49:15.261 INFO:teuthology.orchestra.run.smithi044.stderr: 40300K .......... .......... .......... .......... .......... 43% 349M 0s 2024-09-12T17:49:15.261 INFO:teuthology.orchestra.run.smithi044.stderr: 40350K .......... .......... .......... .......... .......... 43% 227M 0s 2024-09-12T17:49:15.261 INFO:teuthology.orchestra.run.smithi044.stderr: 40400K .......... .......... .......... .......... .......... 43% 195M 0s 2024-09-12T17:49:15.261 INFO:teuthology.orchestra.run.smithi044.stderr: 40450K .......... .......... .......... .......... .......... 43% 123M 0s 2024-09-12T17:49:15.261 INFO:teuthology.orchestra.run.smithi044.stderr: 40500K .......... .......... .......... .......... .......... 43% 229M 0s 2024-09-12T17:49:15.261 INFO:teuthology.orchestra.run.smithi044.stderr: 40550K .......... .......... .......... .......... .......... 43% 347M 0s 2024-09-12T17:49:15.261 INFO:teuthology.orchestra.run.smithi044.stderr: 40600K .......... .......... .......... .......... .......... 43% 100M 0s 2024-09-12T17:49:15.261 INFO:teuthology.orchestra.run.smithi044.stderr: 40650K .......... .......... .......... .......... .......... 43% 146M 0s 2024-09-12T17:49:15.261 INFO:teuthology.orchestra.run.smithi044.stderr: 40700K .......... .......... .......... .......... .......... 43% 363M 0s 2024-09-12T17:49:15.261 INFO:teuthology.orchestra.run.smithi044.stderr: 40750K .......... .......... .......... .......... .......... 43% 255M 0s 2024-09-12T17:49:15.261 INFO:teuthology.orchestra.run.smithi044.stderr: 40800K .......... .......... .......... .......... .......... 43% 367M 0s 2024-09-12T17:49:15.262 INFO:teuthology.orchestra.run.smithi044.stderr: 40850K .......... .......... .......... .......... .......... 44% 79.7M 0s 2024-09-12T17:49:15.262 INFO:teuthology.orchestra.run.smithi044.stderr: 40900K .......... .......... .......... .......... .......... 44% 150M 0s 2024-09-12T17:49:15.262 INFO:teuthology.orchestra.run.smithi044.stderr: 40950K .......... .......... .......... .......... .......... 44% 175M 0s 2024-09-12T17:49:15.262 INFO:teuthology.orchestra.run.smithi044.stderr: 41000K .......... .......... .......... .......... .......... 44% 334M 0s 2024-09-12T17:49:15.262 INFO:teuthology.orchestra.run.smithi044.stderr: 41050K .......... .......... .......... .......... .......... 44% 334M 0s 2024-09-12T17:49:15.262 INFO:teuthology.orchestra.run.smithi044.stderr: 41100K .......... .......... .......... .......... .......... 44% 364M 0s 2024-09-12T17:49:15.262 INFO:teuthology.orchestra.run.smithi044.stderr: 41150K .......... .......... .......... .......... .......... 44% 309M 0s 2024-09-12T17:49:15.262 INFO:teuthology.orchestra.run.smithi044.stderr: 41200K .......... .......... .......... .......... .......... 44% 380M 0s 2024-09-12T17:49:15.262 INFO:teuthology.orchestra.run.smithi044.stderr: 41250K .......... .......... .......... .......... .......... 44% 341M 0s 2024-09-12T17:49:15.262 INFO:teuthology.orchestra.run.smithi044.stderr: 41300K .......... .......... .......... .......... .......... 44% 380M 0s 2024-09-12T17:49:15.262 INFO:teuthology.orchestra.run.smithi044.stderr: 41350K .......... .......... .......... .......... .......... 44% 356M 0s 2024-09-12T17:49:15.262 INFO:teuthology.orchestra.run.smithi044.stderr: 41400K .......... .......... .......... .......... .......... 44% 352M 0s 2024-09-12T17:49:15.263 INFO:teuthology.orchestra.run.smithi044.stderr: 41450K .......... .......... .......... .......... .......... 44% 353M 0s 2024-09-12T17:49:15.263 INFO:teuthology.orchestra.run.smithi044.stderr: 41500K .......... .......... .......... .......... .......... 44% 387M 0s 2024-09-12T17:49:15.263 INFO:teuthology.orchestra.run.smithi044.stderr: 41550K .......... .......... .......... .......... .......... 44% 307M 0s 2024-09-12T17:49:15.263 INFO:teuthology.orchestra.run.smithi044.stderr: 41600K .......... .......... .......... .......... .......... 44% 375M 0s 2024-09-12T17:49:15.263 INFO:teuthology.orchestra.run.smithi044.stderr: 41650K .......... .......... .......... .......... .......... 44% 385M 0s 2024-09-12T17:49:15.263 INFO:teuthology.orchestra.run.smithi044.stderr: 41700K .......... .......... .......... .......... .......... 44% 386M 0s 2024-09-12T17:49:15.263 INFO:teuthology.orchestra.run.smithi044.stderr: 41750K .......... .......... .......... .......... .......... 44% 147M 0s 2024-09-12T17:49:15.263 INFO:teuthology.orchestra.run.smithi044.stderr: 41800K .......... .......... .......... .......... .......... 45% 367M 0s 2024-09-12T17:49:15.263 INFO:teuthology.orchestra.run.smithi044.stderr: 41850K .......... .......... .......... .......... .......... 45% 13.2M 0s 2024-09-12T17:49:15.263 INFO:teuthology.orchestra.run.smithi044.stderr: 41900K .......... .......... .......... .......... .......... 45% 48.8M 0s 2024-09-12T17:49:15.263 INFO:teuthology.orchestra.run.smithi044.stderr: 41950K .......... .......... .......... .......... .......... 45% 192M 0s 2024-09-12T17:49:15.264 INFO:teuthology.orchestra.run.smithi044.stderr: 42000K .......... .......... .......... .......... .......... 45% 365M 0s 2024-09-12T17:49:15.264 INFO:teuthology.orchestra.run.smithi044.stderr: 42050K .......... .......... .......... .......... .......... 45% 366M 0s 2024-09-12T17:49:15.264 INFO:teuthology.orchestra.run.smithi044.stderr: 42100K .......... .......... .......... .......... .......... 45% 374M 0s 2024-09-12T17:49:15.264 INFO:teuthology.orchestra.run.smithi044.stderr: 42150K .......... .......... .......... .......... .......... 45% 312M 0s 2024-09-12T17:49:15.264 INFO:teuthology.orchestra.run.smithi044.stderr: 42200K .......... .......... .......... .......... .......... 45% 267M 0s 2024-09-12T17:49:15.264 INFO:teuthology.orchestra.run.smithi044.stderr: 42250K .......... .......... .......... .......... .......... 45% 277M 0s 2024-09-12T17:49:15.264 INFO:teuthology.orchestra.run.smithi044.stderr: 42300K .......... .......... .......... .......... .......... 45% 316M 0s 2024-09-12T17:49:15.264 INFO:teuthology.orchestra.run.smithi044.stderr: 42350K .......... .......... .......... .......... .......... 45% 243M 0s 2024-09-12T17:49:15.264 INFO:teuthology.orchestra.run.smithi044.stderr: 42400K .......... .......... .......... .......... .......... 45% 309M 0s 2024-09-12T17:49:15.264 INFO:teuthology.orchestra.run.smithi044.stderr: 42450K .......... .......... .......... .......... .......... 45% 331M 0s 2024-09-12T17:49:15.264 INFO:teuthology.orchestra.run.smithi044.stderr: 42500K .......... .......... .......... .......... .......... 45% 310M 0s 2024-09-12T17:49:15.265 INFO:teuthology.orchestra.run.smithi044.stderr: 42550K .......... .......... .......... .......... .......... 45% 313M 0s 2024-09-12T17:49:15.265 INFO:teuthology.orchestra.run.smithi044.stderr: 42600K .......... .......... .......... .......... .......... 45% 383M 0s 2024-09-12T17:49:15.265 INFO:teuthology.orchestra.run.smithi044.stderr: 42650K .......... .......... .......... .......... .......... 45% 378M 0s 2024-09-12T17:49:15.265 INFO:teuthology.orchestra.run.smithi044.stderr: 42700K .......... .......... .......... .......... .......... 46% 378M 0s 2024-09-12T17:49:15.265 INFO:teuthology.orchestra.run.smithi044.stderr: 42750K .......... .......... .......... .......... .......... 46% 342M 0s 2024-09-12T17:49:15.265 INFO:teuthology.orchestra.run.smithi044.stderr: 42800K .......... .......... .......... .......... .......... 46% 376M 0s 2024-09-12T17:49:15.265 INFO:teuthology.orchestra.run.smithi044.stderr: 42850K .......... .......... .......... .......... .......... 46% 389M 0s 2024-09-12T17:49:15.265 INFO:teuthology.orchestra.run.smithi044.stderr: 42900K .......... .......... .......... .......... .......... 46% 361M 0s 2024-09-12T17:49:15.265 INFO:teuthology.orchestra.run.smithi044.stderr: 42950K .......... .......... .......... .......... .......... 46% 322M 0s 2024-09-12T17:49:15.265 INFO:teuthology.orchestra.run.smithi044.stderr: 43000K .......... .......... .......... .......... .......... 46% 375M 0s 2024-09-12T17:49:15.265 INFO:teuthology.orchestra.run.smithi044.stderr: 43050K .......... .......... .......... .......... .......... 46% 392M 0s 2024-09-12T17:49:15.266 INFO:teuthology.orchestra.run.smithi044.stderr: 43100K .......... .......... .......... .......... .......... 46% 388M 0s 2024-09-12T17:49:15.266 INFO:teuthology.orchestra.run.smithi044.stderr: 43150K .......... .......... .......... .......... .......... 46% 363M 0s 2024-09-12T17:49:15.266 INFO:teuthology.orchestra.run.smithi044.stderr: 43200K .......... .......... .......... .......... .......... 46% 387M 0s 2024-09-12T17:49:15.266 INFO:teuthology.orchestra.run.smithi044.stderr: 43250K .......... .......... .......... .......... .......... 46% 384M 0s 2024-09-12T17:49:15.266 INFO:teuthology.orchestra.run.smithi044.stderr: 43300K .......... .......... .......... .......... .......... 46% 323M 0s 2024-09-12T17:49:15.266 INFO:teuthology.orchestra.run.smithi044.stderr: 43350K .......... .......... .......... .......... .......... 46% 376M 0s 2024-09-12T17:49:15.266 INFO:teuthology.orchestra.run.smithi044.stderr: 43400K .......... .......... .......... .......... .......... 46% 338M 0s 2024-09-12T17:49:15.266 INFO:teuthology.orchestra.run.smithi044.stderr: 43450K .......... .......... .......... .......... .......... 46% 386M 0s 2024-09-12T17:49:15.266 INFO:teuthology.orchestra.run.smithi044.stderr: 43500K .......... .......... .......... .......... .......... 46% 382M 0s 2024-09-12T17:49:15.266 INFO:teuthology.orchestra.run.smithi044.stderr: 43550K .......... .......... .......... .......... .......... 46% 387M 0s 2024-09-12T17:49:15.266 INFO:teuthology.orchestra.run.smithi044.stderr: 43600K .......... .......... .......... .......... .......... 46% 299M 0s 2024-09-12T17:49:15.267 INFO:teuthology.orchestra.run.smithi044.stderr: 43650K .......... .......... .......... .......... .......... 47% 313M 0s 2024-09-12T17:49:15.267 INFO:teuthology.orchestra.run.smithi044.stderr: 43700K .......... .......... .......... .......... .......... 47% 334M 0s 2024-09-12T17:49:15.267 INFO:teuthology.orchestra.run.smithi044.stderr: 43750K .......... .......... .......... .......... .......... 47% 317M 0s 2024-09-12T17:49:15.267 INFO:teuthology.orchestra.run.smithi044.stderr: 43800K .......... .......... .......... .......... .......... 47% 320M 0s 2024-09-12T17:49:15.267 INFO:teuthology.orchestra.run.smithi044.stderr: 43850K .......... .......... .......... .......... .......... 47% 316M 0s 2024-09-12T17:49:15.267 INFO:teuthology.orchestra.run.smithi044.stderr: 43900K .......... .......... .......... .......... .......... 47% 304M 0s 2024-09-12T17:49:15.267 INFO:teuthology.orchestra.run.smithi044.stderr: 43950K .......... .......... .......... .......... .......... 47% 351M 0s 2024-09-12T17:49:15.267 INFO:teuthology.orchestra.run.smithi044.stderr: 44000K .......... .......... .......... .......... .......... 47% 311M 0s 2024-09-12T17:49:15.267 INFO:teuthology.orchestra.run.smithi044.stderr: 44050K .......... .......... .......... .......... .......... 47% 357M 0s 2024-09-12T17:49:15.267 INFO:teuthology.orchestra.run.smithi044.stderr: 44100K .......... .......... .......... .......... .......... 47% 322M 0s 2024-09-12T17:49:15.267 INFO:teuthology.orchestra.run.smithi044.stderr: 44150K .......... .......... .......... .......... .......... 47% 358M 0s 2024-09-12T17:49:15.267 INFO:teuthology.orchestra.run.smithi044.stderr: 44200K .......... .......... .......... .......... .......... 47% 345M 0s 2024-09-12T17:49:15.267 INFO:teuthology.orchestra.run.smithi044.stderr: 44250K .......... .......... .......... .......... .......... 47% 369M 0s 2024-09-12T17:49:15.268 INFO:teuthology.orchestra.run.smithi044.stderr: 44300K .......... .......... .......... .......... .......... 47% 299M 0s 2024-09-12T17:49:15.268 INFO:teuthology.orchestra.run.smithi044.stderr: 44350K .......... .......... .......... .......... .......... 47% 328M 0s 2024-09-12T17:49:15.268 INFO:teuthology.orchestra.run.smithi044.stderr: 44400K .......... .......... .......... .......... .......... 47% 418M 0s 2024-09-12T17:49:15.268 INFO:teuthology.orchestra.run.smithi044.stderr: 44450K .......... .......... .......... .......... .......... 47% 204M 0s 2024-09-12T17:49:15.268 INFO:teuthology.orchestra.run.smithi044.stderr: 44500K .......... .......... .......... .......... .......... 47% 391M 0s 2024-09-12T17:49:15.268 INFO:teuthology.orchestra.run.smithi044.stderr: 44550K .......... .......... .......... .......... .......... 48% 332M 0s 2024-09-12T17:49:15.268 INFO:teuthology.orchestra.run.smithi044.stderr: 44600K .......... .......... .......... .......... .......... 48% 400M 0s 2024-09-12T17:49:15.268 INFO:teuthology.orchestra.run.smithi044.stderr: 44650K .......... .......... .......... .......... .......... 48% 376M 0s 2024-09-12T17:49:15.268 INFO:teuthology.orchestra.run.smithi044.stderr: 44700K .......... .......... .......... .......... .......... 48% 396M 0s 2024-09-12T17:49:15.268 INFO:teuthology.orchestra.run.smithi044.stderr: 44750K .......... .......... .......... .......... .......... 48% 360M 0s 2024-09-12T17:49:15.268 INFO:teuthology.orchestra.run.smithi044.stderr: 44800K .......... .......... .......... .......... .......... 48% 396M 0s 2024-09-12T17:49:15.269 INFO:teuthology.orchestra.run.smithi044.stderr: 44850K .......... .......... .......... .......... .......... 48% 396M 0s 2024-09-12T17:49:15.269 INFO:teuthology.orchestra.run.smithi044.stderr: 44900K .......... .......... .......... .......... .......... 48% 17.0M 0s 2024-09-12T17:49:15.269 INFO:teuthology.orchestra.run.smithi044.stderr: 44950K .......... .......... .......... .......... .......... 48% 16.6M 0s 2024-09-12T17:49:15.269 INFO:teuthology.orchestra.run.smithi044.stderr: 45000K .......... .......... .......... .......... .......... 48% 336M 0s 2024-09-12T17:49:15.269 INFO:teuthology.orchestra.run.smithi044.stderr: 45050K .......... .......... .......... .......... .......... 48% 260M 0s 2024-09-12T17:49:15.269 INFO:teuthology.orchestra.run.smithi044.stderr: 45100K .......... .......... .......... .......... .......... 48% 347M 0s 2024-09-12T17:49:15.269 INFO:teuthology.orchestra.run.smithi044.stderr: 45150K .......... .......... .......... .......... .......... 48% 360M 0s 2024-09-12T17:49:15.269 INFO:teuthology.orchestra.run.smithi044.stderr: 45200K .......... .......... .......... .......... .......... 48% 342M 0s 2024-09-12T17:49:15.269 INFO:teuthology.orchestra.run.smithi044.stderr: 45250K .......... .......... .......... .......... .......... 48% 332M 0s 2024-09-12T17:49:15.269 INFO:teuthology.orchestra.run.smithi044.stderr: 45300K .......... .......... .......... .......... .......... 48% 362M 0s 2024-09-12T17:49:15.269 INFO:teuthology.orchestra.run.smithi044.stderr: 45350K .......... .......... .......... .......... .......... 48% 305M 0s 2024-09-12T17:49:15.269 INFO:teuthology.orchestra.run.smithi044.stderr: 45400K .......... .......... .......... .......... .......... 48% 378M 0s 2024-09-12T17:49:15.269 INFO:teuthology.orchestra.run.smithi044.stderr: 45450K .......... .......... .......... .......... .......... 48% 371M 0s 2024-09-12T17:49:15.270 INFO:teuthology.orchestra.run.smithi044.stderr: 45500K .......... .......... .......... .......... .......... 49% 379M 0s 2024-09-12T17:49:15.270 INFO:teuthology.orchestra.run.smithi044.stderr: 45550K .......... .......... .......... .......... .......... 49% 303M 0s 2024-09-12T17:49:15.270 INFO:teuthology.orchestra.run.smithi044.stderr: 45600K .......... .......... .......... .......... .......... 49% 374M 0s 2024-09-12T17:49:15.270 INFO:teuthology.orchestra.run.smithi044.stderr: 45650K .......... .......... .......... .......... .......... 49% 389M 0s 2024-09-12T17:49:15.270 INFO:teuthology.orchestra.run.smithi044.stderr: 45700K .......... .......... .......... .......... .......... 49% 380M 0s 2024-09-12T17:49:15.270 INFO:teuthology.orchestra.run.smithi044.stderr: 45750K .......... .......... .......... .......... .......... 49% 372M 0s 2024-09-12T17:49:15.270 INFO:teuthology.orchestra.run.smithi044.stderr: 45800K .......... .......... .......... .......... .......... 49% 308M 0s 2024-09-12T17:49:15.270 INFO:teuthology.orchestra.run.smithi044.stderr: 45850K .......... .......... .......... .......... .......... 49% 386M 0s 2024-09-12T17:49:15.270 INFO:teuthology.orchestra.run.smithi044.stderr: 45900K .......... .......... .......... .......... .......... 49% 351M 0s 2024-09-12T17:49:15.270 INFO:teuthology.orchestra.run.smithi044.stderr: 45950K .......... .......... .......... .......... .......... 49% 385M 0s 2024-09-12T17:49:15.270 INFO:teuthology.orchestra.run.smithi044.stderr: 46000K .......... .......... .......... .......... .......... 49% 369M 0s 2024-09-12T17:49:15.270 INFO:teuthology.orchestra.run.smithi044.stderr: 46050K .......... .......... .......... .......... .......... 49% 309M 0s 2024-09-12T17:49:15.271 INFO:teuthology.orchestra.run.smithi044.stderr: 46100K .......... .......... .......... .......... .......... 49% 379M 0s 2024-09-12T17:49:15.271 INFO:teuthology.orchestra.run.smithi044.stderr: 46150K .......... .......... .......... .......... .......... 49% 338M 0s 2024-09-12T17:49:15.271 INFO:teuthology.orchestra.run.smithi044.stderr: 46200K .......... .......... .......... .......... .......... 49% 326M 0s 2024-09-12T17:49:15.271 INFO:teuthology.orchestra.run.smithi044.stderr: 46250K .......... .......... .......... .......... .......... 49% 273M 0s 2024-09-12T17:49:15.271 INFO:teuthology.orchestra.run.smithi044.stderr: 46300K .......... .......... .......... .......... .......... 49% 270M 0s 2024-09-12T17:49:15.271 INFO:teuthology.orchestra.run.smithi044.stderr: 46350K .......... .......... .......... .......... .......... 49% 356M 0s 2024-09-12T17:49:15.271 INFO:teuthology.orchestra.run.smithi044.stderr: 46400K .......... .......... .......... .......... .......... 49% 377M 0s 2024-09-12T17:49:15.271 INFO:teuthology.orchestra.run.smithi044.stderr: 46450K .......... .......... .......... .......... .......... 50% 363M 0s 2024-09-12T17:49:15.271 INFO:teuthology.orchestra.run.smithi044.stderr: 46500K .......... .......... .......... .......... .......... 50% 308M 0s 2024-09-12T17:49:15.271 INFO:teuthology.orchestra.run.smithi044.stderr: 46550K .......... .......... .......... .......... .......... 50% 363M 0s 2024-09-12T17:49:15.271 INFO:teuthology.orchestra.run.smithi044.stderr: 46600K .......... .......... .......... .......... .......... 50% 343M 0s 2024-09-12T17:49:15.271 INFO:teuthology.orchestra.run.smithi044.stderr: 46650K .......... .......... .......... .......... .......... 50% 362M 0s 2024-09-12T17:49:15.271 INFO:teuthology.orchestra.run.smithi044.stderr: 46700K .......... .......... .......... .......... .......... 50% 302M 0s 2024-09-12T17:49:15.272 INFO:teuthology.orchestra.run.smithi044.stderr: 46750K .......... .......... .......... .......... .......... 50% 377M 0s 2024-09-12T17:49:15.272 INFO:teuthology.orchestra.run.smithi044.stderr: 46800K .......... .......... .......... .......... .......... 50% 346M 0s 2024-09-12T17:49:15.272 INFO:teuthology.orchestra.run.smithi044.stderr: 46850K .......... .......... .......... .......... .......... 50% 364M 0s 2024-09-12T17:49:15.272 INFO:teuthology.orchestra.run.smithi044.stderr: 46900K .......... .......... .......... .......... .......... 50% 368M 0s 2024-09-12T17:49:15.272 INFO:teuthology.orchestra.run.smithi044.stderr: 46950K .......... .......... .......... .......... .......... 50% 334M 0s 2024-09-12T17:49:15.272 INFO:teuthology.orchestra.run.smithi044.stderr: 47000K .......... .......... .......... .......... .......... 50% 312M 0s 2024-09-12T17:49:15.272 INFO:teuthology.orchestra.run.smithi044.stderr: 47050K .......... .......... .......... .......... .......... 50% 388M 0s 2024-09-12T17:49:15.272 INFO:teuthology.orchestra.run.smithi044.stderr: 47100K .......... .......... .......... .......... .......... 50% 383M 0s 2024-09-12T17:49:15.272 INFO:teuthology.orchestra.run.smithi044.stderr: 47150K .......... .......... .......... .......... .......... 50% 380M 0s 2024-09-12T17:49:15.272 INFO:teuthology.orchestra.run.smithi044.stderr: 47200K .......... .......... .......... .......... .......... 50% 347M 0s 2024-09-12T17:49:15.272 INFO:teuthology.orchestra.run.smithi044.stderr: 47250K .......... .......... .......... .......... .......... 50% 386M 0s 2024-09-12T17:49:15.272 INFO:teuthology.orchestra.run.smithi044.stderr: 47300K .......... .......... .......... .......... .......... 50% 386M 0s 2024-09-12T17:49:15.272 INFO:teuthology.orchestra.run.smithi044.stderr: 47350K .......... .......... .......... .......... .......... 51% 278M 0s 2024-09-12T17:49:15.273 INFO:teuthology.orchestra.run.smithi044.stderr: 47400K .......... .......... .......... .......... .......... 51% 292M 0s 2024-09-12T17:49:15.273 INFO:teuthology.orchestra.run.smithi044.stderr: 47450K .......... .......... .......... .......... .......... 51% 389M 0s 2024-09-12T17:49:15.273 INFO:teuthology.orchestra.run.smithi044.stderr: 47500K .......... .......... .......... .......... .......... 51% 383M 0s 2024-09-12T17:49:15.273 INFO:teuthology.orchestra.run.smithi044.stderr: 47550K .......... .......... .......... .......... .......... 51% 396M 0s 2024-09-12T17:49:15.273 INFO:teuthology.orchestra.run.smithi044.stderr: 47600K .......... .......... .......... .......... .......... 51% 31.6M 0s 2024-09-12T17:49:15.273 INFO:teuthology.orchestra.run.smithi044.stderr: 47650K .......... .......... .......... .......... .......... 51% 249M 0s 2024-09-12T17:49:15.273 INFO:teuthology.orchestra.run.smithi044.stderr: 47700K .......... .......... .......... .......... .......... 51% 321M 0s 2024-09-12T17:49:15.273 INFO:teuthology.orchestra.run.smithi044.stderr: 47750K .......... .......... .......... .......... .......... 51% 396M 0s 2024-09-12T17:49:15.273 INFO:teuthology.orchestra.run.smithi044.stderr: 47800K .......... .......... .......... .......... .......... 51% 393M 0s 2024-09-12T17:49:15.273 INFO:teuthology.orchestra.run.smithi044.stderr: 47850K .......... .......... .......... .......... .......... 51% 307M 0s 2024-09-12T17:49:15.273 INFO:teuthology.orchestra.run.smithi044.stderr: 47900K .......... .......... .......... .......... .......... 51% 389M 0s 2024-09-12T17:49:15.273 INFO:teuthology.orchestra.run.smithi044.stderr: 47950K .......... .......... .......... .......... .......... 51% 399M 0s 2024-09-12T17:49:15.274 INFO:teuthology.orchestra.run.smithi044.stderr: 48000K .......... .......... .......... .......... .......... 51% 398M 0s 2024-09-12T17:49:15.274 INFO:teuthology.orchestra.run.smithi044.stderr: 48050K .......... .......... .......... .......... .......... 51% 261M 0s 2024-09-12T17:49:15.274 INFO:teuthology.orchestra.run.smithi044.stderr: 48100K .......... .......... .......... .......... .......... 51% 26.1M 0s 2024-09-12T17:49:15.274 INFO:teuthology.orchestra.run.smithi044.stderr: 48150K .......... .......... .......... .......... .......... 51% 346M 0s 2024-09-12T17:49:15.274 INFO:teuthology.orchestra.run.smithi044.stderr: 48200K .......... .......... .......... .......... .......... 51% 228M 0s 2024-09-12T17:49:15.274 INFO:teuthology.orchestra.run.smithi044.stderr: 48250K .......... .......... .......... .......... .......... 51% 366M 0s 2024-09-12T17:49:15.274 INFO:teuthology.orchestra.run.smithi044.stderr: 48300K .......... .......... .......... .......... .......... 52% 334M 0s 2024-09-12T17:49:15.274 INFO:teuthology.orchestra.run.smithi044.stderr: 48350K .......... .......... .......... .......... .......... 52% 228M 0s 2024-09-12T17:49:15.274 INFO:teuthology.orchestra.run.smithi044.stderr: 48400K .......... .......... .......... .......... .......... 52% 92.7M 0s 2024-09-12T17:49:15.274 INFO:teuthology.orchestra.run.smithi044.stderr: 48450K .......... .......... .......... .......... .......... 52% 352M 0s 2024-09-12T17:49:15.274 INFO:teuthology.orchestra.run.smithi044.stderr: 48500K .......... .......... .......... .......... .......... 52% 342M 0s 2024-09-12T17:49:15.274 INFO:teuthology.orchestra.run.smithi044.stderr: 48550K .......... .......... .......... .......... .......... 52% 343M 0s 2024-09-12T17:49:15.274 INFO:teuthology.orchestra.run.smithi044.stderr: 48600K .......... .......... .......... .......... .......... 52% 369M 0s 2024-09-12T17:49:15.275 INFO:teuthology.orchestra.run.smithi044.stderr: 48650K .......... .......... .......... .......... .......... 52% 377M 0s 2024-09-12T17:49:15.275 INFO:teuthology.orchestra.run.smithi044.stderr: 48700K .......... .......... .......... .......... .......... 52% 338M 0s 2024-09-12T17:49:15.275 INFO:teuthology.orchestra.run.smithi044.stderr: 48750K .......... .......... .......... .......... .......... 52% 317M 0s 2024-09-12T17:49:15.275 INFO:teuthology.orchestra.run.smithi044.stderr: 48800K .......... .......... .......... .......... .......... 52% 280M 0s 2024-09-12T17:49:15.275 INFO:teuthology.orchestra.run.smithi044.stderr: 48850K .......... .......... .......... .......... .......... 52% 260M 0s 2024-09-12T17:49:15.275 INFO:teuthology.orchestra.run.smithi044.stderr: 48900K .......... .......... .......... .......... .......... 52% 291M 0s 2024-09-12T17:49:15.275 INFO:teuthology.orchestra.run.smithi044.stderr: 48950K .......... .......... .......... .......... .......... 52% 328M 0s 2024-09-12T17:49:15.275 INFO:teuthology.orchestra.run.smithi044.stderr: 49000K .......... .......... .......... .......... .......... 52% 286M 0s 2024-09-12T17:49:15.275 INFO:teuthology.orchestra.run.smithi044.stderr: 49050K .......... .......... .......... .......... .......... 52% 357M 0s 2024-09-12T17:49:15.275 INFO:teuthology.orchestra.run.smithi044.stderr: 49100K .......... .......... .......... .......... .......... 52% 377M 0s 2024-09-12T17:49:15.275 INFO:teuthology.orchestra.run.smithi044.stderr: 49150K .......... .......... .......... .......... .......... 52% 355M 0s 2024-09-12T17:49:15.275 INFO:teuthology.orchestra.run.smithi044.stderr: 49200K .......... .......... .......... .......... .......... 53% 300M 0s 2024-09-12T17:49:15.275 INFO:teuthology.orchestra.run.smithi044.stderr: 49250K .......... .......... .......... .......... .......... 53% 375M 0s 2024-09-12T17:49:15.276 INFO:teuthology.orchestra.run.smithi044.stderr: 49300K .......... .......... .......... .......... .......... 53% 367M 0s 2024-09-12T17:49:15.276 INFO:teuthology.orchestra.run.smithi044.stderr: 49350K .......... .......... .......... .......... .......... 53% 376M 0s 2024-09-12T17:49:15.276 INFO:teuthology.orchestra.run.smithi044.stderr: 49400K .......... .......... .......... .......... .......... 53% 310M 0s 2024-09-12T17:49:15.276 INFO:teuthology.orchestra.run.smithi044.stderr: 49450K .......... .......... .......... .......... .......... 53% 351M 0s 2024-09-12T17:49:15.276 INFO:teuthology.orchestra.run.smithi044.stderr: 49500K .......... .......... .......... .......... .......... 53% 336M 0s 2024-09-12T17:49:15.276 INFO:teuthology.orchestra.run.smithi044.stderr: 49550K .......... .......... .......... .......... .......... 53% 385M 0s 2024-09-12T17:49:15.276 INFO:teuthology.orchestra.run.smithi044.stderr: 49600K .......... .......... .......... .......... .......... 53% 384M 0s 2024-09-12T17:49:15.276 INFO:teuthology.orchestra.run.smithi044.stderr: 49650K .......... .......... .......... .......... .......... 53% 378M 0s 2024-09-12T17:49:15.276 INFO:teuthology.orchestra.run.smithi044.stderr: 49700K .......... .......... .......... .......... .......... 53% 311M 0s 2024-09-12T17:49:15.276 INFO:teuthology.orchestra.run.smithi044.stderr: 49750K .......... .......... .......... .......... .......... 53% 376M 0s 2024-09-12T17:49:15.276 INFO:teuthology.orchestra.run.smithi044.stderr: 49800K .......... .......... .......... .......... .......... 53% 363M 0s 2024-09-12T17:49:15.276 INFO:teuthology.orchestra.run.smithi044.stderr: 49850K .......... .......... .......... .......... .......... 53% 380M 0s 2024-09-12T17:49:15.276 INFO:teuthology.orchestra.run.smithi044.stderr: 49900K .......... .......... .......... .......... .......... 53% 313M 0s 2024-09-12T17:49:15.277 INFO:teuthology.orchestra.run.smithi044.stderr: 49950K .......... .......... .......... .......... .......... 53% 341M 0s 2024-09-12T17:49:15.277 INFO:teuthology.orchestra.run.smithi044.stderr: 50000K .......... .......... .......... .......... .......... 53% 383M 0s 2024-09-12T17:49:15.277 INFO:teuthology.orchestra.run.smithi044.stderr: 50050K .......... .......... .......... .......... .......... 53% 356M 0s 2024-09-12T17:49:15.277 INFO:teuthology.orchestra.run.smithi044.stderr: 50100K .......... .......... .......... .......... .......... 53% 400M 0s 2024-09-12T17:49:15.277 INFO:teuthology.orchestra.run.smithi044.stderr: 50150K .......... .......... .......... .......... .......... 54% 357M 0s 2024-09-12T17:49:15.277 INFO:teuthology.orchestra.run.smithi044.stderr: 50200K .......... .......... .......... .......... .......... 54% 27.7M 0s 2024-09-12T17:49:15.277 INFO:teuthology.orchestra.run.smithi044.stderr: 50250K .......... .......... .......... .......... .......... 54% 342M 0s 2024-09-12T17:49:15.277 INFO:teuthology.orchestra.run.smithi044.stderr: 50300K .......... .......... .......... .......... .......... 54% 266M 0s 2024-09-12T17:49:15.277 INFO:teuthology.orchestra.run.smithi044.stderr: 50350K .......... .......... .......... .......... .......... 54% 245M 0s 2024-09-12T17:49:15.277 INFO:teuthology.orchestra.run.smithi044.stderr: 50400K .......... .......... .......... .......... .......... 54% 301M 0s 2024-09-12T17:49:15.277 INFO:teuthology.orchestra.run.smithi044.stderr: 50450K .......... .......... .......... .......... .......... 54% 361M 0s 2024-09-12T17:49:15.277 INFO:teuthology.orchestra.run.smithi044.stderr: 50500K .......... .......... .......... .......... .......... 54% 376M 0s 2024-09-12T17:49:15.278 INFO:teuthology.orchestra.run.smithi044.stderr: 50550K .......... .......... .......... .......... .......... 54% 306M 0s 2024-09-12T17:49:15.278 INFO:teuthology.orchestra.run.smithi044.stderr: 50600K .......... .......... .......... .......... .......... 54% 371M 0s 2024-09-12T17:49:15.278 INFO:teuthology.orchestra.run.smithi044.stderr: 50650K .......... .......... .......... .......... .......... 54% 325M 0s 2024-09-12T17:49:15.278 INFO:teuthology.orchestra.run.smithi044.stderr: 50700K .......... .......... .......... .......... .......... 54% 345M 0s 2024-09-12T17:49:15.278 INFO:teuthology.orchestra.run.smithi044.stderr: 50750K .......... .......... .......... .......... .......... 54% 367M 0s 2024-09-12T17:49:15.278 INFO:teuthology.orchestra.run.smithi044.stderr: 50800K .......... .......... .......... .......... .......... 54% 380M 0s 2024-09-12T17:49:15.278 INFO:teuthology.orchestra.run.smithi044.stderr: 50850K .......... .......... .......... .......... .......... 54% 352M 0s 2024-09-12T17:49:15.278 INFO:teuthology.orchestra.run.smithi044.stderr: 50900K .......... .......... .......... .......... .......... 54% 388M 0s 2024-09-12T17:49:15.278 INFO:teuthology.orchestra.run.smithi044.stderr: 50950K .......... .......... .......... .......... .......... 54% 396M 0s 2024-09-12T17:49:15.278 INFO:teuthology.orchestra.run.smithi044.stderr: 51000K .......... .......... .......... .......... .......... 54% 398M 0s 2024-09-12T17:49:15.278 INFO:teuthology.orchestra.run.smithi044.stderr: 51050K .......... .......... .......... .......... .......... 55% 310M 0s 2024-09-12T17:49:15.278 INFO:teuthology.orchestra.run.smithi044.stderr: 51100K .......... .......... .......... .......... .......... 55% 394M 0s 2024-09-12T17:49:15.278 INFO:teuthology.orchestra.run.smithi044.stderr: 51150K .......... .......... .......... .......... .......... 55% 110M 0s 2024-09-12T17:49:15.279 INFO:teuthology.orchestra.run.smithi044.stderr: 51200K .......... .......... .......... .......... .......... 55% 95.8M 0s 2024-09-12T17:49:15.279 INFO:teuthology.orchestra.run.smithi044.stderr: 51250K .......... .......... .......... .......... .......... 55% 319M 0s 2024-09-12T17:49:15.279 INFO:teuthology.orchestra.run.smithi044.stderr: 51300K .......... .......... .......... .......... .......... 55% 406M 0s 2024-09-12T17:49:15.279 INFO:teuthology.orchestra.run.smithi044.stderr: 51350K .......... .......... .......... .......... .......... 55% 147M 0s 2024-09-12T17:49:15.279 INFO:teuthology.orchestra.run.smithi044.stderr: 51400K .......... .......... .......... .......... .......... 55% 368M 0s 2024-09-12T17:49:15.279 INFO:teuthology.orchestra.run.smithi044.stderr: 51450K .......... .......... .......... .......... .......... 55% 86.6M 0s 2024-09-12T17:49:15.279 INFO:teuthology.orchestra.run.smithi044.stderr: 51500K .......... .......... .......... .......... .......... 55% 396M 0s 2024-09-12T17:49:15.279 INFO:teuthology.orchestra.run.smithi044.stderr: 51550K .......... .......... .......... .......... .......... 55% 414M 0s 2024-09-12T17:49:15.279 INFO:teuthology.orchestra.run.smithi044.stderr: 51600K .......... .......... .......... .......... .......... 55% 258M 0s 2024-09-12T17:49:15.279 INFO:teuthology.orchestra.run.smithi044.stderr: 51650K .......... .......... .......... .......... .......... 55% 405M 0s 2024-09-12T17:49:15.279 INFO:teuthology.orchestra.run.smithi044.stderr: 51700K .......... .......... .......... .......... .......... 55% 356M 0s 2024-09-12T17:49:15.279 INFO:teuthology.orchestra.run.smithi044.stderr: 51750K .......... .......... .......... .......... .......... 55% 338M 0s 2024-09-12T17:49:15.279 INFO:teuthology.orchestra.run.smithi044.stderr: 51800K .......... .......... .......... .......... .......... 55% 274M 0s 2024-09-12T17:49:15.280 INFO:teuthology.orchestra.run.smithi044.stderr: 51850K .......... .......... .......... .......... .......... 55% 228M 0s 2024-09-12T17:49:15.280 INFO:teuthology.orchestra.run.smithi044.stderr: 51900K .......... .......... .......... .......... .......... 55% 385M 0s 2024-09-12T17:49:15.280 INFO:teuthology.orchestra.run.smithi044.stderr: 51950K .......... .......... .......... .......... .......... 55% 315M 0s 2024-09-12T17:49:15.280 INFO:teuthology.orchestra.run.smithi044.stderr: 52000K .......... .......... .......... .......... .......... 56% 282M 0s 2024-09-12T17:49:15.280 INFO:teuthology.orchestra.run.smithi044.stderr: 52050K .......... .......... .......... .......... .......... 56% 382M 0s 2024-09-12T17:49:15.280 INFO:teuthology.orchestra.run.smithi044.stderr: 52100K .......... .......... .......... .......... .......... 56% 172M 0s 2024-09-12T17:49:15.280 INFO:teuthology.orchestra.run.smithi044.stderr: 52150K .......... .......... .......... .......... .......... 56% 361M 0s 2024-09-12T17:49:15.280 INFO:teuthology.orchestra.run.smithi044.stderr: 52200K .......... .......... .......... .......... .......... 56% 374M 0s 2024-09-12T17:49:15.280 INFO:teuthology.orchestra.run.smithi044.stderr: 52250K .......... .......... .......... .......... .......... 56% 412M 0s 2024-09-12T17:49:15.280 INFO:teuthology.orchestra.run.smithi044.stderr: 52300K .......... .......... .......... .......... .......... 56% 384M 0s 2024-09-12T17:49:15.280 INFO:teuthology.orchestra.run.smithi044.stderr: 52350K .......... .......... .......... .......... .......... 56% 391M 0s 2024-09-12T17:49:15.280 INFO:teuthology.orchestra.run.smithi044.stderr: 52400K .......... .......... .......... .......... .......... 56% 348M 0s 2024-09-12T17:49:15.281 INFO:teuthology.orchestra.run.smithi044.stderr: 52450K .......... .......... .......... .......... .......... 56% 427M 0s 2024-09-12T17:49:15.281 INFO:teuthology.orchestra.run.smithi044.stderr: 52500K .......... .......... .......... .......... .......... 56% 422M 0s 2024-09-12T17:49:15.281 INFO:teuthology.orchestra.run.smithi044.stderr: 52550K .......... .......... .......... .......... .......... 56% 226M 0s 2024-09-12T17:49:15.281 INFO:teuthology.orchestra.run.smithi044.stderr: 52600K .......... .......... .......... .......... .......... 56% 161M 0s 2024-09-12T17:49:15.281 INFO:teuthology.orchestra.run.smithi044.stderr: 52650K .......... .......... .......... .......... .......... 56% 405M 0s 2024-09-12T17:49:15.281 INFO:teuthology.orchestra.run.smithi044.stderr: 52700K .......... .......... .......... .......... .......... 56% 417M 0s 2024-09-12T17:49:15.281 INFO:teuthology.orchestra.run.smithi044.stderr: 52750K .......... .......... .......... .......... .......... 56% 418M 0s 2024-09-12T17:49:15.281 INFO:teuthology.orchestra.run.smithi044.stderr: 52800K .......... .......... .......... .......... .......... 56% 253M 0s 2024-09-12T17:49:15.281 INFO:teuthology.orchestra.run.smithi044.stderr: 52850K .......... .......... .......... .......... .......... 56% 420M 0s 2024-09-12T17:49:15.281 INFO:teuthology.orchestra.run.smithi044.stderr: 52900K .......... .......... .......... .......... .......... 56% 413M 0s 2024-09-12T17:49:15.281 INFO:teuthology.orchestra.run.smithi044.stderr: 52950K .......... .......... .......... .......... .......... 57% 408M 0s 2024-09-12T17:49:15.281 INFO:teuthology.orchestra.run.smithi044.stderr: 53000K .......... .......... .......... .......... .......... 57% 360M 0s 2024-09-12T17:49:15.281 INFO:teuthology.orchestra.run.smithi044.stderr: 53050K .......... .......... .......... .......... .......... 57% 24.3M 0s 2024-09-12T17:49:15.282 INFO:teuthology.orchestra.run.smithi044.stderr: 53100K .......... .......... .......... .......... .......... 57% 383M 0s 2024-09-12T17:49:15.282 INFO:teuthology.orchestra.run.smithi044.stderr: 53150K .......... .......... .......... .......... .......... 57% 332M 0s 2024-09-12T17:49:15.282 INFO:teuthology.orchestra.run.smithi044.stderr: 53200K .......... .......... .......... .......... .......... 57% 379M 0s 2024-09-12T17:49:15.282 INFO:teuthology.orchestra.run.smithi044.stderr: 53250K .......... .......... .......... .......... .......... 57% 369M 0s 2024-09-12T17:49:15.282 INFO:teuthology.orchestra.run.smithi044.stderr: 53300K .......... .......... .......... .......... .......... 57% 313M 0s 2024-09-12T17:49:15.282 INFO:teuthology.orchestra.run.smithi044.stderr: 53350K .......... .......... .......... .......... .......... 57% 373M 0s 2024-09-12T17:49:15.282 INFO:teuthology.orchestra.run.smithi044.stderr: 53400K .......... .......... .......... .......... .......... 57% 345M 0s 2024-09-12T17:49:15.282 INFO:teuthology.orchestra.run.smithi044.stderr: 53450K .......... .......... .......... .......... .......... 57% 380M 0s 2024-09-12T17:49:15.282 INFO:teuthology.orchestra.run.smithi044.stderr: 53500K .......... .......... .......... .......... .......... 57% 225M 0s 2024-09-12T17:49:15.282 INFO:teuthology.orchestra.run.smithi044.stderr: 53550K .......... .......... .......... .......... .......... 57% 273M 0s 2024-09-12T17:49:15.282 INFO:teuthology.orchestra.run.smithi044.stderr: 53600K .......... .......... .......... .......... .......... 57% 309M 0s 2024-09-12T17:49:15.282 INFO:teuthology.orchestra.run.smithi044.stderr: 53650K .......... .......... .......... .......... .......... 57% 323M 0s 2024-09-12T17:49:15.282 INFO:teuthology.orchestra.run.smithi044.stderr: 53700K .......... .......... .......... .......... .......... 57% 304M 0s 2024-09-12T17:49:15.283 INFO:teuthology.orchestra.run.smithi044.stderr: 53750K .......... .......... .......... .......... .......... 57% 366M 0s 2024-09-12T17:49:15.283 INFO:teuthology.orchestra.run.smithi044.stderr: 53800K .......... .......... .......... .......... .......... 57% 383M 0s 2024-09-12T17:49:15.283 INFO:teuthology.orchestra.run.smithi044.stderr: 53850K .......... .......... .......... .......... .......... 58% 394M 0s 2024-09-12T17:49:15.283 INFO:teuthology.orchestra.run.smithi044.stderr: 53900K .......... .......... .......... .......... .......... 58% 325M 0s 2024-09-12T17:49:15.283 INFO:teuthology.orchestra.run.smithi044.stderr: 53950K .......... .......... .......... .......... .......... 58% 97.4M 0s 2024-09-12T17:49:15.283 INFO:teuthology.orchestra.run.smithi044.stderr: 54000K .......... .......... .......... .......... .......... 58% 361M 0s 2024-09-12T17:49:15.283 INFO:teuthology.orchestra.run.smithi044.stderr: 54050K .......... .......... .......... .......... .......... 58% 365M 0s 2024-09-12T17:49:15.283 INFO:teuthology.orchestra.run.smithi044.stderr: 54100K .......... .......... .......... .......... .......... 58% 328M 0s 2024-09-12T17:49:15.283 INFO:teuthology.orchestra.run.smithi044.stderr: 54150K .......... .......... .......... .......... .......... 58% 379M 0s 2024-09-12T17:49:15.283 INFO:teuthology.orchestra.run.smithi044.stderr: 54200K .......... .......... .......... .......... .......... 58% 379M 0s 2024-09-12T17:49:15.283 INFO:teuthology.orchestra.run.smithi044.stderr: 54250K .......... .......... .......... .......... .......... 58% 377M 0s 2024-09-12T17:49:15.283 INFO:teuthology.orchestra.run.smithi044.stderr: 54300K .......... .......... .......... .......... .......... 58% 295M 0s 2024-09-12T17:49:15.283 INFO:teuthology.orchestra.run.smithi044.stderr: 54350K .......... .......... .......... .......... .......... 58% 360M 0s 2024-09-12T17:49:15.284 INFO:teuthology.orchestra.run.smithi044.stderr: 54400K .......... .......... .......... .......... .......... 58% 372M 0s 2024-09-12T17:49:15.284 INFO:teuthology.orchestra.run.smithi044.stderr: 54450K .......... .......... .......... .......... .......... 58% 73.0M 0s 2024-09-12T17:49:15.284 INFO:teuthology.orchestra.run.smithi044.stderr: 54500K .......... .......... .......... .......... .......... 58% 280M 0s 2024-09-12T17:49:15.284 INFO:teuthology.orchestra.run.smithi044.stderr: 54550K .......... .......... .......... .......... .......... 58% 354M 0s 2024-09-12T17:49:15.284 INFO:teuthology.orchestra.run.smithi044.stderr: 54600K .......... .......... .......... .......... .......... 58% 378M 0s 2024-09-12T17:49:15.284 INFO:teuthology.orchestra.run.smithi044.stderr: 54650K .......... .......... .......... .......... .......... 58% 323M 0s 2024-09-12T17:49:15.284 INFO:teuthology.orchestra.run.smithi044.stderr: 54700K .......... .......... .......... .......... .......... 58% 304M 0s 2024-09-12T17:49:15.284 INFO:teuthology.orchestra.run.smithi044.stderr: 54750K .......... .......... .......... .......... .......... 58% 384M 0s 2024-09-12T17:49:15.284 INFO:teuthology.orchestra.run.smithi044.stderr: 54800K .......... .......... .......... .......... .......... 59% 375M 0s 2024-09-12T17:49:15.284 INFO:teuthology.orchestra.run.smithi044.stderr: 54850K .......... .......... .......... .......... .......... 59% 338M 0s 2024-09-12T17:49:15.284 INFO:teuthology.orchestra.run.smithi044.stderr: 54900K .......... .......... .......... .......... .......... 59% 324M 0s 2024-09-12T17:49:15.284 INFO:teuthology.orchestra.run.smithi044.stderr: 54950K .......... .......... .......... .......... .......... 59% 326M 0s 2024-09-12T17:49:15.285 INFO:teuthology.orchestra.run.smithi044.stderr: 55000K .......... .......... .......... .......... .......... 59% 385M 0s 2024-09-12T17:49:15.285 INFO:teuthology.orchestra.run.smithi044.stderr: 55050K .......... .......... .......... .......... .......... 59% 169M 0s 2024-09-12T17:49:15.285 INFO:teuthology.orchestra.run.smithi044.stderr: 55100K .......... .......... .......... .......... .......... 59% 275M 0s 2024-09-12T17:49:15.285 INFO:teuthology.orchestra.run.smithi044.stderr: 55150K .......... .......... .......... .......... .......... 59% 321M 0s 2024-09-12T17:49:15.285 INFO:teuthology.orchestra.run.smithi044.stderr: 55200K .......... .......... .......... .......... .......... 59% 336M 0s 2024-09-12T17:49:15.285 INFO:teuthology.orchestra.run.smithi044.stderr: 55250K .......... .......... .......... .......... .......... 59% 384M 0s 2024-09-12T17:49:15.285 INFO:teuthology.orchestra.run.smithi044.stderr: 55300K .......... .......... .......... .......... .......... 59% 322M 0s 2024-09-12T17:49:15.285 INFO:teuthology.orchestra.run.smithi044.stderr: 55350K .......... .......... .......... .......... .......... 59% 368M 0s 2024-09-12T17:49:15.285 INFO:teuthology.orchestra.run.smithi044.stderr: 55400K .......... .......... .......... .......... .......... 59% 370M 0s 2024-09-12T17:49:15.285 INFO:teuthology.orchestra.run.smithi044.stderr: 55450K .......... .......... .......... .......... .......... 59% 360M 0s 2024-09-12T17:49:15.285 INFO:teuthology.orchestra.run.smithi044.stderr: 55500K .......... .......... .......... .......... .......... 59% 301M 0s 2024-09-12T17:49:15.285 INFO:teuthology.orchestra.run.smithi044.stderr: 55550K .......... .......... .......... .......... .......... 59% 368M 0s 2024-09-12T17:49:15.285 INFO:teuthology.orchestra.run.smithi044.stderr: 55600K .......... .......... .......... .......... .......... 59% 367M 0s 2024-09-12T17:49:15.286 INFO:teuthology.orchestra.run.smithi044.stderr: 55650K .......... .......... .......... .......... .......... 59% 380M 0s 2024-09-12T17:49:15.286 INFO:teuthology.orchestra.run.smithi044.stderr: 55700K .......... .......... .......... .......... .......... 60% 351M 0s 2024-09-12T17:49:15.286 INFO:teuthology.orchestra.run.smithi044.stderr: 55750K .......... .......... .......... .......... .......... 60% 163M 0s 2024-09-12T17:49:15.286 INFO:teuthology.orchestra.run.smithi044.stderr: 55800K .......... .......... .......... .......... .......... 60% 354M 0s 2024-09-12T17:49:15.286 INFO:teuthology.orchestra.run.smithi044.stderr: 55850K .......... .......... .......... .......... .......... 60% 385M 0s 2024-09-12T17:49:15.286 INFO:teuthology.orchestra.run.smithi044.stderr: 55900K .......... .......... .......... .......... .......... 60% 311M 0s 2024-09-12T17:49:15.286 INFO:teuthology.orchestra.run.smithi044.stderr: 55950K .......... .......... .......... .......... .......... 60% 368M 0s 2024-09-12T17:49:15.286 INFO:teuthology.orchestra.run.smithi044.stderr: 56000K .......... .......... .......... .......... .......... 60% 393M 0s 2024-09-12T17:49:15.286 INFO:teuthology.orchestra.run.smithi044.stderr: 56050K .......... .......... .......... .......... .......... 60% 25.4M 0s 2024-09-12T17:49:15.286 INFO:teuthology.orchestra.run.smithi044.stderr: 56100K .......... .......... .......... .......... .......... 60% 308M 0s 2024-09-12T17:49:15.286 INFO:teuthology.orchestra.run.smithi044.stderr: 56150K .......... .......... .......... .......... .......... 60% 357M 0s 2024-09-12T17:49:15.286 INFO:teuthology.orchestra.run.smithi044.stderr: 56200K .......... .......... .......... .......... .......... 60% 266M 0s 2024-09-12T17:49:15.286 INFO:teuthology.orchestra.run.smithi044.stderr: 56250K .......... .......... .......... .......... .......... 60% 301M 0s 2024-09-12T17:49:15.287 INFO:teuthology.orchestra.run.smithi044.stderr: 56300K .......... .......... .......... .......... .......... 60% 300M 0s 2024-09-12T17:49:15.287 INFO:teuthology.orchestra.run.smithi044.stderr: 56350K .......... .......... .......... .......... .......... 60% 331M 0s 2024-09-12T17:49:15.287 INFO:teuthology.orchestra.run.smithi044.stderr: 56400K .......... .......... .......... .......... .......... 60% 334M 0s 2024-09-12T17:49:15.287 INFO:teuthology.orchestra.run.smithi044.stderr: 56450K .......... .......... .......... .......... .......... 60% 310M 0s 2024-09-12T17:49:15.287 INFO:teuthology.orchestra.run.smithi044.stderr: 56500K .......... .......... .......... .......... .......... 60% 311M 0s 2024-09-12T17:49:15.287 INFO:teuthology.orchestra.run.smithi044.stderr: 56550K .......... .......... .......... .......... .......... 60% 353M 0s 2024-09-12T17:49:15.287 INFO:teuthology.orchestra.run.smithi044.stderr: 56600K .......... .......... .......... .......... .......... 60% 373M 0s 2024-09-12T17:49:15.287 INFO:teuthology.orchestra.run.smithi044.stderr: 56650K .......... .......... .......... .......... .......... 61% 374M 0s 2024-09-12T17:49:15.287 INFO:teuthology.orchestra.run.smithi044.stderr: 56700K .......... .......... .......... .......... .......... 61% 309M 0s 2024-09-12T17:49:15.287 INFO:teuthology.orchestra.run.smithi044.stderr: 56750K .......... .......... .......... .......... .......... 61% 235M 0s 2024-09-12T17:49:15.287 INFO:teuthology.orchestra.run.smithi044.stderr: 56800K .......... .......... .......... .......... .......... 61% 289M 0s 2024-09-12T17:49:15.287 INFO:teuthology.orchestra.run.smithi044.stderr: 56850K .......... .......... .......... .......... .......... 61% 91.5M 0s 2024-09-12T17:49:15.288 INFO:teuthology.orchestra.run.smithi044.stderr: 56900K .......... .......... .......... .......... .......... 61% 321M 0s 2024-09-12T17:49:15.288 INFO:teuthology.orchestra.run.smithi044.stderr: 56950K .......... .......... .......... .......... .......... 61% 369M 0s 2024-09-12T17:49:15.288 INFO:teuthology.orchestra.run.smithi044.stderr: 57000K .......... .......... .......... .......... .......... 61% 366M 0s 2024-09-12T17:49:15.288 INFO:teuthology.orchestra.run.smithi044.stderr: 57050K .......... .......... .......... .......... .......... 61% 336M 0s 2024-09-12T17:49:15.288 INFO:teuthology.orchestra.run.smithi044.stderr: 57100K .......... .......... .......... .......... .......... 61% 306M 0s 2024-09-12T17:49:15.288 INFO:teuthology.orchestra.run.smithi044.stderr: 57150K .......... .......... .......... .......... .......... 61% 370M 0s 2024-09-12T17:49:15.288 INFO:teuthology.orchestra.run.smithi044.stderr: 57200K .......... .......... .......... .......... .......... 61% 366M 0s 2024-09-12T17:49:15.288 INFO:teuthology.orchestra.run.smithi044.stderr: 57250K .......... .......... .......... .......... .......... 61% 387M 0s 2024-09-12T17:49:15.288 INFO:teuthology.orchestra.run.smithi044.stderr: 57300K .......... .......... .......... .......... .......... 61% 330M 0s 2024-09-12T17:49:15.288 INFO:teuthology.orchestra.run.smithi044.stderr: 57350K .......... .......... .......... .......... .......... 61% 372M 0s 2024-09-12T17:49:15.288 INFO:teuthology.orchestra.run.smithi044.stderr: 57400K .......... .......... .......... .......... .......... 61% 339M 0s 2024-09-12T17:49:15.288 INFO:teuthology.orchestra.run.smithi044.stderr: 57450K .......... .......... .......... .......... .......... 61% 379M 0s 2024-09-12T17:49:15.288 INFO:teuthology.orchestra.run.smithi044.stderr: 57500K .......... .......... .......... .......... .......... 61% 66.1M 0s 2024-09-12T17:49:15.289 INFO:teuthology.orchestra.run.smithi044.stderr: 57550K .......... .......... .......... .......... .......... 62% 277M 0s 2024-09-12T17:49:15.289 INFO:teuthology.orchestra.run.smithi044.stderr: 57600K .......... .......... .......... .......... .......... 62% 316M 0s 2024-09-12T17:49:15.289 INFO:teuthology.orchestra.run.smithi044.stderr: 57650K .......... .......... .......... .......... .......... 62% 302M 0s 2024-09-12T17:49:15.289 INFO:teuthology.orchestra.run.smithi044.stderr: 57700K .......... .......... .......... .......... .......... 62% 321M 0s 2024-09-12T17:49:15.289 INFO:teuthology.orchestra.run.smithi044.stderr: 57750K .......... .......... .......... .......... .......... 62% 317M 0s 2024-09-12T17:49:15.289 INFO:teuthology.orchestra.run.smithi044.stderr: 57800K .......... .......... .......... .......... .......... 62% 347M 0s 2024-09-12T17:49:15.289 INFO:teuthology.orchestra.run.smithi044.stderr: 57850K .......... .......... .......... .......... .......... 62% 376M 0s 2024-09-12T17:49:15.289 INFO:teuthology.orchestra.run.smithi044.stderr: 57900K .......... .......... .......... .......... .......... 62% 291M 0s 2024-09-12T17:49:15.289 INFO:teuthology.orchestra.run.smithi044.stderr: 57950K .......... .......... .......... .......... .......... 62% 370M 0s 2024-09-12T17:49:15.289 INFO:teuthology.orchestra.run.smithi044.stderr: 58000K .......... .......... .......... .......... .......... 62% 376M 0s 2024-09-12T17:49:15.289 INFO:teuthology.orchestra.run.smithi044.stderr: 58050K .......... .......... .......... .......... .......... 62% 373M 0s 2024-09-12T17:49:15.289 INFO:teuthology.orchestra.run.smithi044.stderr: 58100K .......... .......... .......... .......... .......... 62% 334M 0s 2024-09-12T17:49:15.289 INFO:teuthology.orchestra.run.smithi044.stderr: 58150K .......... .......... .......... .......... .......... 62% 245M 0s 2024-09-12T17:49:15.290 INFO:teuthology.orchestra.run.smithi044.stderr: 58200K .......... .......... .......... .......... .......... 62% 328M 0s 2024-09-12T17:49:15.290 INFO:teuthology.orchestra.run.smithi044.stderr: 58250K .......... .......... .......... .......... .......... 62% 365M 0s 2024-09-12T17:49:15.290 INFO:teuthology.orchestra.run.smithi044.stderr: 58300K .......... .......... .......... .......... .......... 62% 338M 0s 2024-09-12T17:49:15.290 INFO:teuthology.orchestra.run.smithi044.stderr: 58350K .......... .......... .......... .......... .......... 62% 374M 0s 2024-09-12T17:49:15.290 INFO:teuthology.orchestra.run.smithi044.stderr: 58400K .......... .......... .......... .......... .......... 62% 376M 0s 2024-09-12T17:49:15.290 INFO:teuthology.orchestra.run.smithi044.stderr: 58450K .......... .......... .......... .......... .......... 62% 386M 0s 2024-09-12T17:49:15.290 INFO:teuthology.orchestra.run.smithi044.stderr: 58500K .......... .......... .......... .......... .......... 63% 319M 0s 2024-09-12T17:49:15.290 INFO:teuthology.orchestra.run.smithi044.stderr: 58550K .......... .......... .......... .......... .......... 63% 381M 0s 2024-09-12T17:49:15.290 INFO:teuthology.orchestra.run.smithi044.stderr: 58600K .......... .......... .......... .......... .......... 63% 352M 0s 2024-09-12T17:49:15.290 INFO:teuthology.orchestra.run.smithi044.stderr: 58650K .......... .......... .......... .......... .......... 63% 377M 0s 2024-09-12T17:49:15.290 INFO:teuthology.orchestra.run.smithi044.stderr: 58700K .......... .......... .......... .......... .......... 63% 265M 0s 2024-09-12T17:49:15.290 INFO:teuthology.orchestra.run.smithi044.stderr: 58750K .......... .......... .......... .......... .......... 63% 355M 0s 2024-09-12T17:49:15.290 INFO:teuthology.orchestra.run.smithi044.stderr: 58800K .......... .......... .......... .......... .......... 63% 374M 0s 2024-09-12T17:49:15.291 INFO:teuthology.orchestra.run.smithi044.stderr: 58850K .......... .......... .......... .......... .......... 63% 373M 0s 2024-09-12T17:49:15.291 INFO:teuthology.orchestra.run.smithi044.stderr: 58900K .......... .......... .......... .......... .......... 63% 319M 0s 2024-09-12T17:49:15.291 INFO:teuthology.orchestra.run.smithi044.stderr: 58950K .......... .......... .......... .......... .......... 63% 336M 0s 2024-09-12T17:49:15.291 INFO:teuthology.orchestra.run.smithi044.stderr: 59000K .......... .......... .......... .......... .......... 63% 370M 0s 2024-09-12T17:49:15.291 INFO:teuthology.orchestra.run.smithi044.stderr: 59050K .......... .......... .......... .......... .......... 63% 376M 0s 2024-09-12T17:49:15.291 INFO:teuthology.orchestra.run.smithi044.stderr: 59100K .......... .......... .......... .......... .......... 63% 28.5M 0s 2024-09-12T17:49:15.291 INFO:teuthology.orchestra.run.smithi044.stderr: 59150K .......... .......... .......... .......... .......... 63% 312M 0s 2024-09-12T17:49:15.291 INFO:teuthology.orchestra.run.smithi044.stderr: 59200K .......... .......... .......... .......... .......... 63% 224M 0s 2024-09-12T17:49:15.291 INFO:teuthology.orchestra.run.smithi044.stderr: 59250K .......... .......... .......... .......... .......... 63% 358M 0s 2024-09-12T17:49:15.291 INFO:teuthology.orchestra.run.smithi044.stderr: 59300K .......... .......... .......... .......... .......... 63% 126M 0s 2024-09-12T17:49:15.291 INFO:teuthology.orchestra.run.smithi044.stderr: 59350K .......... .......... .......... .......... .......... 63% 329M 0s 2024-09-12T17:49:15.291 INFO:teuthology.orchestra.run.smithi044.stderr: 59400K .......... .......... .......... .......... .......... 63% 355M 0s 2024-09-12T17:49:15.292 INFO:teuthology.orchestra.run.smithi044.stderr: 59450K .......... .......... .......... .......... .......... 64% 377M 0s 2024-09-12T17:49:15.292 INFO:teuthology.orchestra.run.smithi044.stderr: 59500K .......... .......... .......... .......... .......... 64% 365M 0s 2024-09-12T17:49:15.292 INFO:teuthology.orchestra.run.smithi044.stderr: 59550K .......... .......... .......... .......... .......... 64% 374M 0s 2024-09-12T17:49:15.292 INFO:teuthology.orchestra.run.smithi044.stderr: 59600K .......... .......... .......... .......... .......... 64% 319M 0s 2024-09-12T17:49:15.292 INFO:teuthology.orchestra.run.smithi044.stderr: 59650K .......... .......... .......... .......... .......... 64% 371M 0s 2024-09-12T17:49:15.292 INFO:teuthology.orchestra.run.smithi044.stderr: 59700K .......... .......... .......... .......... .......... 64% 338M 0s 2024-09-12T17:49:15.292 INFO:teuthology.orchestra.run.smithi044.stderr: 59750K .......... .......... .......... .......... .......... 64% 380M 0s 2024-09-12T17:49:15.292 INFO:teuthology.orchestra.run.smithi044.stderr: 59800K .......... .......... .......... .......... .......... 64% 275M 0s 2024-09-12T17:49:15.292 INFO:teuthology.orchestra.run.smithi044.stderr: 59850K .......... .......... .......... .......... .......... 64% 298M 0s 2024-09-12T17:49:15.292 INFO:teuthology.orchestra.run.smithi044.stderr: 59900K .......... .......... .......... .......... .......... 64% 371M 0s 2024-09-12T17:49:15.292 INFO:teuthology.orchestra.run.smithi044.stderr: 59950K .......... .......... .......... .......... .......... 64% 119M 0s 2024-09-12T17:49:15.293 INFO:teuthology.orchestra.run.smithi044.stderr: 60000K .......... .......... .......... .......... .......... 64% 99.7M 0s 2024-09-12T17:49:15.293 INFO:teuthology.orchestra.run.smithi044.stderr: 60050K .......... .......... .......... .......... .......... 64% 306M 0s 2024-09-12T17:49:15.293 INFO:teuthology.orchestra.run.smithi044.stderr: 60100K .......... .......... .......... .......... .......... 64% 302M 0s 2024-09-12T17:49:15.293 INFO:teuthology.orchestra.run.smithi044.stderr: 60150K .......... .......... .......... .......... .......... 64% 322M 0s 2024-09-12T17:49:15.293 INFO:teuthology.orchestra.run.smithi044.stderr: 60200K .......... .......... .......... .......... .......... 64% 311M 0s 2024-09-12T17:49:15.293 INFO:teuthology.orchestra.run.smithi044.stderr: 60250K .......... .......... .......... .......... .......... 64% 339M 0s 2024-09-12T17:49:15.293 INFO:teuthology.orchestra.run.smithi044.stderr: 60300K .......... .......... .......... .......... .......... 64% 366M 0s 2024-09-12T17:49:15.293 INFO:teuthology.orchestra.run.smithi044.stderr: 60350K .......... .......... .......... .......... .......... 65% 285M 0s 2024-09-12T17:49:15.293 INFO:teuthology.orchestra.run.smithi044.stderr: 60400K .......... .......... .......... .......... .......... 65% 317M 0s 2024-09-12T17:49:15.293 INFO:teuthology.orchestra.run.smithi044.stderr: 60450K .......... .......... .......... .......... .......... 65% 387M 0s 2024-09-12T17:49:15.293 INFO:teuthology.orchestra.run.smithi044.stderr: 60500K .......... .......... .......... .......... .......... 65% 91.2M 0s 2024-09-12T17:49:15.293 INFO:teuthology.orchestra.run.smithi044.stderr: 60550K .......... .......... .......... .......... .......... 65% 357M 0s 2024-09-12T17:49:15.294 INFO:teuthology.orchestra.run.smithi044.stderr: 60600K .......... .......... .......... .......... .......... 65% 195M 0s 2024-09-12T17:49:15.294 INFO:teuthology.orchestra.run.smithi044.stderr: 60650K .......... .......... .......... .......... .......... 65% 345M 0s 2024-09-12T17:49:15.294 INFO:teuthology.orchestra.run.smithi044.stderr: 60700K .......... .......... .......... .......... .......... 65% 357M 0s 2024-09-12T17:49:15.294 INFO:teuthology.orchestra.run.smithi044.stderr: 60750K .......... .......... .......... .......... .......... 65% 367M 0s 2024-09-12T17:49:15.294 INFO:teuthology.orchestra.run.smithi044.stderr: 60800K .......... .......... .......... .......... .......... 65% 309M 0s 2024-09-12T17:49:15.294 INFO:teuthology.orchestra.run.smithi044.stderr: 60850K .......... .......... .......... .......... .......... 65% 366M 0s 2024-09-12T17:49:15.294 INFO:teuthology.orchestra.run.smithi044.stderr: 60900K .......... .......... .......... .......... .......... 65% 367M 0s 2024-09-12T17:49:15.294 INFO:teuthology.orchestra.run.smithi044.stderr: 60950K .......... .......... .......... .......... .......... 65% 362M 0s 2024-09-12T17:49:15.294 INFO:teuthology.orchestra.run.smithi044.stderr: 61000K .......... .......... .......... .......... .......... 65% 353M 0s 2024-09-12T17:49:15.294 INFO:teuthology.orchestra.run.smithi044.stderr: 61050K .......... .......... .......... .......... .......... 65% 329M 0s 2024-09-12T17:49:15.294 INFO:teuthology.orchestra.run.smithi044.stderr: 61100K .......... .......... .......... .......... .......... 65% 309M 0s 2024-09-12T17:49:15.295 INFO:teuthology.orchestra.run.smithi044.stderr: 61150K .......... .......... .......... .......... .......... 65% 378M 0s 2024-09-12T17:49:15.295 INFO:teuthology.orchestra.run.smithi044.stderr: 61200K .......... .......... .......... .......... .......... 65% 373M 0s 2024-09-12T17:49:15.295 INFO:teuthology.orchestra.run.smithi044.stderr: 61250K .......... .......... .......... .......... .......... 65% 375M 0s 2024-09-12T17:49:15.295 INFO:teuthology.orchestra.run.smithi044.stderr: 61300K .......... .......... .......... .......... .......... 66% 331M 0s 2024-09-12T17:49:15.295 INFO:teuthology.orchestra.run.smithi044.stderr: 61350K .......... .......... .......... .......... .......... 66% 382M 0s 2024-09-12T17:49:15.295 INFO:teuthology.orchestra.run.smithi044.stderr: 61400K .......... .......... .......... .......... .......... 66% 315M 0s 2024-09-12T17:49:15.295 INFO:teuthology.orchestra.run.smithi044.stderr: 61450K .......... .......... .......... .......... .......... 66% 375M 0s 2024-09-12T17:49:15.295 INFO:teuthology.orchestra.run.smithi044.stderr: 61500K .......... .......... .......... .......... .......... 66% 291M 0s 2024-09-12T17:49:15.295 INFO:teuthology.orchestra.run.smithi044.stderr: 61550K .......... .......... .......... .......... .......... 66% 341M 0s 2024-09-12T17:49:15.295 INFO:teuthology.orchestra.run.smithi044.stderr: 61600K .......... .......... .......... .......... .......... 66% 330M 0s 2024-09-12T17:49:15.295 INFO:teuthology.orchestra.run.smithi044.stderr: 61650K .......... .......... .......... .......... .......... 66% 315M 0s 2024-09-12T17:49:15.295 INFO:teuthology.orchestra.run.smithi044.stderr: 61700K .......... .......... .......... .......... .......... 66% 286M 0s 2024-09-12T17:49:15.295 INFO:teuthology.orchestra.run.smithi044.stderr: 61750K .......... .......... .......... .......... .......... 66% 288M 0s 2024-09-12T17:49:15.296 INFO:teuthology.orchestra.run.smithi044.stderr: 61800K .......... .......... .......... .......... .......... 66% 374M 0s 2024-09-12T17:49:15.296 INFO:teuthology.orchestra.run.smithi044.stderr: 61850K .......... .......... .......... .......... .......... 66% 394M 0s 2024-09-12T17:49:15.296 INFO:teuthology.orchestra.run.smithi044.stderr: 61900K .......... .......... .......... .......... .......... 66% 380M 0s 2024-09-12T17:49:15.296 INFO:teuthology.orchestra.run.smithi044.stderr: 61950K .......... .......... .......... .......... .......... 66% 318M 0s 2024-09-12T17:49:15.296 INFO:teuthology.orchestra.run.smithi044.stderr: 62000K .......... .......... .......... .......... .......... 66% 369M 0s 2024-09-12T17:49:15.296 INFO:teuthology.orchestra.run.smithi044.stderr: 62050K .......... .......... .......... .......... .......... 66% 392M 0s 2024-09-12T17:49:15.296 INFO:teuthology.orchestra.run.smithi044.stderr: 62100K .......... .......... .......... .......... .......... 66% 369M 0s 2024-09-12T17:49:15.296 INFO:teuthology.orchestra.run.smithi044.stderr: 62150K .......... .......... .......... .......... .......... 66% 34.2M 0s 2024-09-12T17:49:15.296 INFO:teuthology.orchestra.run.smithi044.stderr: 62200K .......... .......... .......... .......... .......... 67% 303M 0s 2024-09-12T17:49:15.296 INFO:teuthology.orchestra.run.smithi044.stderr: 62250K .......... .......... .......... .......... .......... 67% 259M 0s 2024-09-12T17:49:15.296 INFO:teuthology.orchestra.run.smithi044.stderr: 62300K .......... .......... .......... .......... .......... 67% 283M 0s 2024-09-12T17:49:15.297 INFO:teuthology.orchestra.run.smithi044.stderr: 62350K .......... .......... .......... .......... .......... 67% 89.7M 0s 2024-09-12T17:49:15.297 INFO:teuthology.orchestra.run.smithi044.stderr: 62400K .......... .......... .......... .......... .......... 67% 247M 0s 2024-09-12T17:49:15.297 INFO:teuthology.orchestra.run.smithi044.stderr: 62450K .......... .......... .......... .......... .......... 67% 356M 0s 2024-09-12T17:49:15.297 INFO:teuthology.orchestra.run.smithi044.stderr: 62500K .......... .......... .......... .......... .......... 67% 335M 0s 2024-09-12T17:49:15.297 INFO:teuthology.orchestra.run.smithi044.stderr: 62550K .......... .......... .......... .......... .......... 67% 353M 0s 2024-09-12T17:49:15.297 INFO:teuthology.orchestra.run.smithi044.stderr: 62600K .......... .......... .......... .......... .......... 67% 131M 0s 2024-09-12T17:49:15.297 INFO:teuthology.orchestra.run.smithi044.stderr: 62650K .......... .......... .......... .......... .......... 67% 294M 0s 2024-09-12T17:49:15.297 INFO:teuthology.orchestra.run.smithi044.stderr: 62700K .......... .......... .......... .......... .......... 67% 389M 0s 2024-09-12T17:49:15.297 INFO:teuthology.orchestra.run.smithi044.stderr: 62750K .......... .......... .......... .......... .......... 67% 250M 0s 2024-09-12T17:49:15.297 INFO:teuthology.orchestra.run.smithi044.stderr: 62800K .......... .......... .......... .......... .......... 67% 387M 0s 2024-09-12T17:49:15.297 INFO:teuthology.orchestra.run.smithi044.stderr: 62850K .......... .......... .......... .......... .......... 67% 286M 0s 2024-09-12T17:49:15.298 INFO:teuthology.orchestra.run.smithi044.stderr: 62900K .......... .......... .......... .......... .......... 67% 378M 0s 2024-09-12T17:49:15.298 INFO:teuthology.orchestra.run.smithi044.stderr: 62950K .......... .......... .......... .......... .......... 67% 351M 0s 2024-09-12T17:49:15.298 INFO:teuthology.orchestra.run.smithi044.stderr: 63000K .......... .......... .......... .......... .......... 67% 327M 0s 2024-09-12T17:49:15.298 INFO:teuthology.orchestra.run.smithi044.stderr: 63050K .......... .......... .......... .......... .......... 67% 200M 0s 2024-09-12T17:49:15.298 INFO:teuthology.orchestra.run.smithi044.stderr: 63100K .......... .......... .......... .......... .......... 67% 151M 0s 2024-09-12T17:49:15.298 INFO:teuthology.orchestra.run.smithi044.stderr: 63150K .......... .......... .......... .......... .......... 68% 257M 0s 2024-09-12T17:49:15.298 INFO:teuthology.orchestra.run.smithi044.stderr: 63200K .......... .......... .......... .......... .......... 68% 282M 0s 2024-09-12T17:49:15.298 INFO:teuthology.orchestra.run.smithi044.stderr: 63250K .......... .......... .......... .......... .......... 68% 343M 0s 2024-09-12T17:49:15.298 INFO:teuthology.orchestra.run.smithi044.stderr: 63300K .......... .......... .......... .......... .......... 68% 222M 0s 2024-09-12T17:49:15.298 INFO:teuthology.orchestra.run.smithi044.stderr: 63350K .......... .......... .......... .......... .......... 68% 298M 0s 2024-09-12T17:49:15.298 INFO:teuthology.orchestra.run.smithi044.stderr: 63400K .......... .......... .......... .......... .......... 68% 382M 0s 2024-09-12T17:49:15.299 INFO:teuthology.orchestra.run.smithi044.stderr: 63450K .......... .......... .......... .......... .......... 68% 66.0M 0s 2024-09-12T17:49:15.299 INFO:teuthology.orchestra.run.smithi044.stderr: 63500K .......... .......... .......... .......... .......... 68% 371M 0s 2024-09-12T17:49:15.299 INFO:teuthology.orchestra.run.smithi044.stderr: 63550K .......... .......... .......... .......... .......... 68% 319M 0s 2024-09-12T17:49:15.299 INFO:teuthology.orchestra.run.smithi044.stderr: 63600K .......... .......... .......... .......... .......... 68% 390M 0s 2024-09-12T17:49:15.299 INFO:teuthology.orchestra.run.smithi044.stderr: 63650K .......... .......... .......... .......... .......... 68% 390M 0s 2024-09-12T17:49:15.299 INFO:teuthology.orchestra.run.smithi044.stderr: 63700K .......... .......... .......... .......... .......... 68% 388M 0s 2024-09-12T17:49:15.299 INFO:teuthology.orchestra.run.smithi044.stderr: 63750K .......... .......... .......... .......... .......... 68% 347M 0s 2024-09-12T17:49:15.299 INFO:teuthology.orchestra.run.smithi044.stderr: 63800K .......... .......... .......... .......... .......... 68% 365M 0s 2024-09-12T17:49:15.299 INFO:teuthology.orchestra.run.smithi044.stderr: 63850K .......... .......... .......... .......... .......... 68% 375M 0s 2024-09-12T17:49:15.299 INFO:teuthology.orchestra.run.smithi044.stderr: 63900K .......... .......... .......... .......... .......... 68% 388M 0s 2024-09-12T17:49:15.299 INFO:teuthology.orchestra.run.smithi044.stderr: 63950K .......... .......... .......... .......... .......... 68% 324M 0s 2024-09-12T17:49:15.300 INFO:teuthology.orchestra.run.smithi044.stderr: 64000K .......... .......... .......... .......... .......... 68% 389M 0s 2024-09-12T17:49:15.300 INFO:teuthology.orchestra.run.smithi044.stderr: 64050K .......... .......... .......... .......... .......... 68% 160M 0s 2024-09-12T17:49:15.300 INFO:teuthology.orchestra.run.smithi044.stderr: 64100K .......... .......... .......... .......... .......... 69% 284M 0s 2024-09-12T17:49:15.300 INFO:teuthology.orchestra.run.smithi044.stderr: 64150K .......... .......... .......... .......... .......... 69% 325M 0s 2024-09-12T17:49:15.300 INFO:teuthology.orchestra.run.smithi044.stderr: 64200K .......... .......... .......... .......... .......... 69% 317M 0s 2024-09-12T17:49:15.300 INFO:teuthology.orchestra.run.smithi044.stderr: 64250K .......... .......... .......... .......... .......... 69% 317M 0s 2024-09-12T17:49:15.300 INFO:teuthology.orchestra.run.smithi044.stderr: 64300K .......... .......... .......... .......... .......... 69% 355M 0s 2024-09-12T17:49:15.300 INFO:teuthology.orchestra.run.smithi044.stderr: 64350K .......... .......... .......... .......... .......... 69% 281M 0s 2024-09-12T17:49:15.300 INFO:teuthology.orchestra.run.smithi044.stderr: 64400K .......... .......... .......... .......... .......... 69% 305M 0s 2024-09-12T17:49:15.300 INFO:teuthology.orchestra.run.smithi044.stderr: 64450K .......... .......... .......... .......... .......... 69% 298M 0s 2024-09-12T17:49:15.300 INFO:teuthology.orchestra.run.smithi044.stderr: 64500K .......... .......... .......... .......... .......... 69% 340M 0s 2024-09-12T17:49:15.300 INFO:teuthology.orchestra.run.smithi044.stderr: 64550K .......... .......... .......... .......... .......... 69% 328M 0s 2024-09-12T17:49:15.301 INFO:teuthology.orchestra.run.smithi044.stderr: 64600K .......... .......... .......... .......... .......... 69% 359M 0s 2024-09-12T17:49:15.301 INFO:teuthology.orchestra.run.smithi044.stderr: 64650K .......... .......... .......... .......... .......... 69% 384M 0s 2024-09-12T17:49:15.301 INFO:teuthology.orchestra.run.smithi044.stderr: 64700K .......... .......... .......... .......... .......... 69% 363M 0s 2024-09-12T17:49:15.301 INFO:teuthology.orchestra.run.smithi044.stderr: 64750K .......... .......... .......... .......... .......... 69% 309M 0s 2024-09-12T17:49:15.301 INFO:teuthology.orchestra.run.smithi044.stderr: 64800K .......... .......... .......... .......... .......... 69% 351M 0s 2024-09-12T17:49:15.301 INFO:teuthology.orchestra.run.smithi044.stderr: 64850K .......... .......... .......... .......... .......... 69% 383M 0s 2024-09-12T17:49:15.301 INFO:teuthology.orchestra.run.smithi044.stderr: 64900K .......... .......... .......... .......... .......... 69% 389M 0s 2024-09-12T17:49:15.301 INFO:teuthology.orchestra.run.smithi044.stderr: 64950K .......... .......... .......... .......... .......... 69% 354M 0s 2024-09-12T17:49:15.301 INFO:teuthology.orchestra.run.smithi044.stderr: 65000K .......... .......... .......... .......... .......... 70% 371M 0s 2024-09-12T17:49:15.301 INFO:teuthology.orchestra.run.smithi044.stderr: 65050K .......... .......... .......... .......... .......... 70% 383M 0s 2024-09-12T17:49:15.301 INFO:teuthology.orchestra.run.smithi044.stderr: 65100K .......... .......... .......... .......... .......... 70% 392M 0s 2024-09-12T17:49:15.301 INFO:teuthology.orchestra.run.smithi044.stderr: 65150K .......... .......... .......... .......... .......... 70% 44.3M 0s 2024-09-12T17:49:15.302 INFO:teuthology.orchestra.run.smithi044.stderr: 65200K .......... .......... .......... .......... .......... 70% 362M 0s 2024-09-12T17:49:15.302 INFO:teuthology.orchestra.run.smithi044.stderr: 65250K .......... .......... .......... .......... .......... 70% 233M 0s 2024-09-12T17:49:15.302 INFO:teuthology.orchestra.run.smithi044.stderr: 65300K .......... .......... .......... .......... .......... 70% 368M 0s 2024-09-12T17:49:15.302 INFO:teuthology.orchestra.run.smithi044.stderr: 65350K .......... .......... .......... .......... .......... 70% 291M 0s 2024-09-12T17:49:15.302 INFO:teuthology.orchestra.run.smithi044.stderr: 65400K .......... .......... .......... .......... .......... 70% 128M 0s 2024-09-12T17:49:15.302 INFO:teuthology.orchestra.run.smithi044.stderr: 65450K .......... .......... .......... .......... .......... 70% 134M 0s 2024-09-12T17:49:15.302 INFO:teuthology.orchestra.run.smithi044.stderr: 65500K .......... .......... .......... .......... .......... 70% 376M 0s 2024-09-12T17:49:15.302 INFO:teuthology.orchestra.run.smithi044.stderr: 65550K .......... .......... .......... .......... .......... 70% 177M 0s 2024-09-12T17:49:15.302 INFO:teuthology.orchestra.run.smithi044.stderr: 65600K .......... .......... .......... .......... .......... 70% 106M 0s 2024-09-12T17:49:15.302 INFO:teuthology.orchestra.run.smithi044.stderr: 65650K .......... .......... .......... .......... .......... 70% 342M 0s 2024-09-12T17:49:15.302 INFO:teuthology.orchestra.run.smithi044.stderr: 65700K .......... .......... .......... .......... .......... 70% 204M 0s 2024-09-12T17:49:15.303 INFO:teuthology.orchestra.run.smithi044.stderr: 65750K .......... .......... .......... .......... .......... 70% 280M 0s 2024-09-12T17:49:15.303 INFO:teuthology.orchestra.run.smithi044.stderr: 65800K .......... .......... .......... .......... .......... 70% 375M 0s 2024-09-12T17:49:15.303 INFO:teuthology.orchestra.run.smithi044.stderr: 65850K .......... .......... .......... .......... .......... 70% 347M 0s 2024-09-12T17:49:15.303 INFO:teuthology.orchestra.run.smithi044.stderr: 65900K .......... .......... .......... .......... .......... 70% 367M 0s 2024-09-12T17:49:15.303 INFO:teuthology.orchestra.run.smithi044.stderr: 65950K .......... .......... .......... .......... .......... 71% 322M 0s 2024-09-12T17:49:15.303 INFO:teuthology.orchestra.run.smithi044.stderr: 66000K .......... .......... .......... .......... .......... 71% 141M 0s 2024-09-12T17:49:15.303 INFO:teuthology.orchestra.run.smithi044.stderr: 66050K .......... .......... .......... .......... .......... 71% 368M 0s 2024-09-12T17:49:15.303 INFO:teuthology.orchestra.run.smithi044.stderr: 66100K .......... .......... .......... .......... .......... 71% 368M 0s 2024-09-12T17:49:15.303 INFO:teuthology.orchestra.run.smithi044.stderr: 66150K .......... .......... .......... .......... .......... 71% 334M 0s 2024-09-12T17:49:15.303 INFO:teuthology.orchestra.run.smithi044.stderr: 66200K .......... .......... .......... .......... .......... 71% 376M 0s 2024-09-12T17:49:15.303 INFO:teuthology.orchestra.run.smithi044.stderr: 66250K .......... .......... .......... .......... .......... 71% 398M 0s 2024-09-12T17:49:15.304 INFO:teuthology.orchestra.run.smithi044.stderr: 66300K .......... .......... .......... .......... .......... 71% 377M 0s 2024-09-12T17:49:15.304 INFO:teuthology.orchestra.run.smithi044.stderr: 66350K .......... .......... .......... .......... .......... 71% 311M 0s 2024-09-12T17:49:15.304 INFO:teuthology.orchestra.run.smithi044.stderr: 66400K .......... .......... .......... .......... .......... 71% 328M 0s 2024-09-12T17:49:15.304 INFO:teuthology.orchestra.run.smithi044.stderr: 66450K .......... .......... .......... .......... .......... 71% 60.7M 0s 2024-09-12T17:49:15.304 INFO:teuthology.orchestra.run.smithi044.stderr: 66500K .......... .......... .......... .......... .......... 71% 366M 0s 2024-09-12T17:49:15.304 INFO:teuthology.orchestra.run.smithi044.stderr: 66550K .......... .......... .......... .......... .......... 71% 130M 0s 2024-09-12T17:49:15.304 INFO:teuthology.orchestra.run.smithi044.stderr: 66600K .......... .......... .......... .......... .......... 71% 355M 0s 2024-09-12T17:49:15.304 INFO:teuthology.orchestra.run.smithi044.stderr: 66650K .......... .......... .......... .......... .......... 71% 358M 0s 2024-09-12T17:49:15.304 INFO:teuthology.orchestra.run.smithi044.stderr: 66700K .......... .......... .......... .......... .......... 71% 291M 0s 2024-09-12T17:49:15.304 INFO:teuthology.orchestra.run.smithi044.stderr: 66750K .......... .......... .......... .......... .......... 71% 274M 0s 2024-09-12T17:49:15.304 INFO:teuthology.orchestra.run.smithi044.stderr: 66800K .......... .......... .......... .......... .......... 71% 315M 0s 2024-09-12T17:49:15.304 INFO:teuthology.orchestra.run.smithi044.stderr: 66850K .......... .......... .......... .......... .......... 72% 290M 0s 2024-09-12T17:49:15.305 INFO:teuthology.orchestra.run.smithi044.stderr: 66900K .......... .......... .......... .......... .......... 72% 376M 0s 2024-09-12T17:49:15.305 INFO:teuthology.orchestra.run.smithi044.stderr: 66950K .......... .......... .......... .......... .......... 72% 287M 0s 2024-09-12T17:49:15.305 INFO:teuthology.orchestra.run.smithi044.stderr: 67000K .......... .......... .......... .......... .......... 72% 351M 0s 2024-09-12T17:49:15.305 INFO:teuthology.orchestra.run.smithi044.stderr: 67050K .......... .......... .......... .......... .......... 72% 380M 0s 2024-09-12T17:49:15.305 INFO:teuthology.orchestra.run.smithi044.stderr: 67100K .......... .......... .......... .......... .......... 72% 391M 0s 2024-09-12T17:49:15.305 INFO:teuthology.orchestra.run.smithi044.stderr: 67150K .......... .......... .......... .......... .......... 72% 331M 0s 2024-09-12T17:49:15.305 INFO:teuthology.orchestra.run.smithi044.stderr: 67200K .......... .......... .......... .......... .......... 72% 361M 0s 2024-09-12T17:49:15.305 INFO:teuthology.orchestra.run.smithi044.stderr: 67250K .......... .......... .......... .......... .......... 72% 371M 0s 2024-09-12T17:49:15.305 INFO:teuthology.orchestra.run.smithi044.stderr: 67300K .......... .......... .......... .......... .......... 72% 374M 0s 2024-09-12T17:49:15.305 INFO:teuthology.orchestra.run.smithi044.stderr: 67350K .......... .......... .......... .......... .......... 72% 355M 0s 2024-09-12T17:49:15.305 INFO:teuthology.orchestra.run.smithi044.stderr: 67400K .......... .......... .......... .......... .......... 72% 397M 0s 2024-09-12T17:49:15.306 INFO:teuthology.orchestra.run.smithi044.stderr: 67450K .......... .......... .......... .......... .......... 72% 330M 0s 2024-09-12T17:49:15.306 INFO:teuthology.orchestra.run.smithi044.stderr: 67500K .......... .......... .......... .......... .......... 72% 364M 0s 2024-09-12T17:49:15.306 INFO:teuthology.orchestra.run.smithi044.stderr: 67550K .......... .......... .......... .......... .......... 72% 299M 0s 2024-09-12T17:49:15.306 INFO:teuthology.orchestra.run.smithi044.stderr: 67600K .......... .......... .......... .......... .......... 72% 371M 0s 2024-09-12T17:49:15.306 INFO:teuthology.orchestra.run.smithi044.stderr: 67650K .......... .......... .......... .......... .......... 72% 391M 0s 2024-09-12T17:49:15.306 INFO:teuthology.orchestra.run.smithi044.stderr: 67700K .......... .......... .......... .......... .......... 72% 388M 0s 2024-09-12T17:49:15.306 INFO:teuthology.orchestra.run.smithi044.stderr: 67750K .......... .......... .......... .......... .......... 72% 350M 0s 2024-09-12T17:49:15.306 INFO:teuthology.orchestra.run.smithi044.stderr: 67800K .......... .......... .......... .......... .......... 73% 356M 0s 2024-09-12T17:49:15.306 INFO:teuthology.orchestra.run.smithi044.stderr: 67850K .......... .......... .......... .......... .......... 73% 385M 0s 2024-09-12T17:49:15.306 INFO:teuthology.orchestra.run.smithi044.stderr: 67900K .......... .......... .......... .......... .......... 73% 377M 0s 2024-09-12T17:49:15.306 INFO:teuthology.orchestra.run.smithi044.stderr: 67950K .......... .......... .......... .......... .......... 73% 298M 0s 2024-09-12T17:49:15.306 INFO:teuthology.orchestra.run.smithi044.stderr: 68000K .......... .......... .......... .......... .......... 73% 379M 0s 2024-09-12T17:49:15.307 INFO:teuthology.orchestra.run.smithi044.stderr: 68050K .......... .......... .......... .......... .......... 73% 390M 0s 2024-09-12T17:49:15.307 INFO:teuthology.orchestra.run.smithi044.stderr: 68100K .......... .......... .......... .......... .......... 73% 395M 0s 2024-09-12T17:49:15.307 INFO:teuthology.orchestra.run.smithi044.stderr: 68150K .......... .......... .......... .......... .......... 73% 38.8M 0s 2024-09-12T17:49:15.307 INFO:teuthology.orchestra.run.smithi044.stderr: 68200K .......... .......... .......... .......... .......... 73% 369M 0s 2024-09-12T17:49:15.307 INFO:teuthology.orchestra.run.smithi044.stderr: 68250K .......... .......... .......... .......... .......... 73% 333M 0s 2024-09-12T17:49:15.307 INFO:teuthology.orchestra.run.smithi044.stderr: 68300K .......... .......... .......... .......... .......... 73% 345M 0s 2024-09-12T17:49:15.307 INFO:teuthology.orchestra.run.smithi044.stderr: 68350K .......... .......... .......... .......... .......... 73% 321M 0s 2024-09-12T17:49:15.307 INFO:teuthology.orchestra.run.smithi044.stderr: 68400K .......... .......... .......... .......... .......... 73% 382M 0s 2024-09-12T17:49:15.307 INFO:teuthology.orchestra.run.smithi044.stderr: 68450K .......... .......... .......... .......... .......... 73% 114M 0s 2024-09-12T17:49:15.307 INFO:teuthology.orchestra.run.smithi044.stderr: 68500K .......... .......... .......... .......... .......... 73% 194M 0s 2024-09-12T17:49:15.308 INFO:teuthology.orchestra.run.smithi044.stderr: 68550K .......... .......... .......... .......... .......... 73% 310M 0s 2024-09-12T17:49:15.308 INFO:teuthology.orchestra.run.smithi044.stderr: 68600K .......... .......... .......... .......... .......... 73% 357M 0s 2024-09-12T17:49:15.308 INFO:teuthology.orchestra.run.smithi044.stderr: 68650K .......... .......... .......... .......... .......... 73% 55.0M 0s 2024-09-12T17:49:15.308 INFO:teuthology.orchestra.run.smithi044.stderr: 68700K .......... .......... .......... .......... .......... 74% 354M 0s 2024-09-12T17:49:15.308 INFO:teuthology.orchestra.run.smithi044.stderr: 68750K .......... .......... .......... .......... .......... 74% 285M 0s 2024-09-12T17:49:15.308 INFO:teuthology.orchestra.run.smithi044.stderr: 68800K .......... .......... .......... .......... .......... 74% 394M 0s 2024-09-12T17:49:15.308 INFO:teuthology.orchestra.run.smithi044.stderr: 68850K .......... .......... .......... .......... .......... 74% 390M 0s 2024-09-12T17:49:15.308 INFO:teuthology.orchestra.run.smithi044.stderr: 68900K .......... .......... .......... .......... .......... 74% 138M 0s 2024-09-12T17:49:15.308 INFO:teuthology.orchestra.run.smithi044.stderr: 68950K .......... .......... .......... .......... .......... 74% 276M 0s 2024-09-12T17:49:15.308 INFO:teuthology.orchestra.run.smithi044.stderr: 69000K .......... .......... .......... .......... .......... 74% 352M 0s 2024-09-12T17:49:15.309 INFO:teuthology.orchestra.run.smithi044.stderr: 69050K .......... .......... .......... .......... .......... 74% 331M 0s 2024-09-12T17:49:15.309 INFO:teuthology.orchestra.run.smithi044.stderr: 69100K .......... .......... .......... .......... .......... 74% 380M 0s 2024-09-12T17:49:15.309 INFO:teuthology.orchestra.run.smithi044.stderr: 69150K .......... .......... .......... .......... .......... 74% 317M 0s 2024-09-12T17:49:15.309 INFO:teuthology.orchestra.run.smithi044.stderr: 69200K .......... .......... .......... .......... .......... 74% 352M 0s 2024-09-12T17:49:15.309 INFO:teuthology.orchestra.run.smithi044.stderr: 69250K .......... .......... .......... .......... .......... 74% 392M 0s 2024-09-12T17:49:15.309 INFO:teuthology.orchestra.run.smithi044.stderr: 69300K .......... .......... .......... .......... .......... 74% 393M 0s 2024-09-12T17:49:15.309 INFO:teuthology.orchestra.run.smithi044.stderr: 69350K .......... .......... .......... .......... .......... 74% 346M 0s 2024-09-12T17:49:15.309 INFO:teuthology.orchestra.run.smithi044.stderr: 69400K .......... .......... .......... .......... .......... 74% 385M 0s 2024-09-12T17:49:15.309 INFO:teuthology.orchestra.run.smithi044.stderr: 69450K .......... .......... .......... .......... .......... 74% 396M 0s 2024-09-12T17:49:15.309 INFO:teuthology.orchestra.run.smithi044.stderr: 69500K .......... .......... .......... .......... .......... 74% 399M 0s 2024-09-12T17:49:15.310 INFO:teuthology.orchestra.run.smithi044.stderr: 69550K .......... .......... .......... .......... .......... 74% 79.4M 0s 2024-09-12T17:49:15.310 INFO:teuthology.orchestra.run.smithi044.stderr: 69600K .......... .......... .......... .......... .......... 74% 189M 0s 2024-09-12T17:49:15.310 INFO:teuthology.orchestra.run.smithi044.stderr: 69650K .......... .......... .......... .......... .......... 75% 132M 0s 2024-09-12T17:49:15.310 INFO:teuthology.orchestra.run.smithi044.stderr: 69700K .......... .......... .......... .......... .......... 75% 367M 0s 2024-09-12T17:49:15.310 INFO:teuthology.orchestra.run.smithi044.stderr: 69750K .......... .......... .......... .......... .......... 75% 350M 0s 2024-09-12T17:49:15.310 INFO:teuthology.orchestra.run.smithi044.stderr: 69800K .......... .......... .......... .......... .......... 75% 383M 0s 2024-09-12T17:49:15.310 INFO:teuthology.orchestra.run.smithi044.stderr: 69850K .......... .......... .......... .......... .......... 75% 380M 0s 2024-09-12T17:49:15.310 INFO:teuthology.orchestra.run.smithi044.stderr: 69900K .......... .......... .......... .......... .......... 75% 383M 0s 2024-09-12T17:49:15.310 INFO:teuthology.orchestra.run.smithi044.stderr: 69950K .......... .......... .......... .......... .......... 75% 323M 0s 2024-09-12T17:49:15.310 INFO:teuthology.orchestra.run.smithi044.stderr: 70000K .......... .......... .......... .......... .......... 75% 360M 0s 2024-09-12T17:49:15.310 INFO:teuthology.orchestra.run.smithi044.stderr: 70050K .......... .......... .......... .......... .......... 75% 384M 0s 2024-09-12T17:49:15.311 INFO:teuthology.orchestra.run.smithi044.stderr: 70100K .......... .......... .......... .......... .......... 75% 391M 0s 2024-09-12T17:49:15.311 INFO:teuthology.orchestra.run.smithi044.stderr: 70150K .......... .......... .......... .......... .......... 75% 170M 0s 2024-09-12T17:49:15.311 INFO:teuthology.orchestra.run.smithi044.stderr: 70200K .......... .......... .......... .......... .......... 75% 375M 0s 2024-09-12T17:49:15.311 INFO:teuthology.orchestra.run.smithi044.stderr: 70250K .......... .......... .......... .......... .......... 75% 385M 0s 2024-09-12T17:49:15.311 INFO:teuthology.orchestra.run.smithi044.stderr: 70300K .......... .......... .......... .......... .......... 75% 368M 0s 2024-09-12T17:49:15.311 INFO:teuthology.orchestra.run.smithi044.stderr: 70350K .......... .......... .......... .......... .......... 75% 303M 0s 2024-09-12T17:49:15.311 INFO:teuthology.orchestra.run.smithi044.stderr: 70400K .......... .......... .......... .......... .......... 75% 374M 0s 2024-09-12T17:49:15.311 INFO:teuthology.orchestra.run.smithi044.stderr: 70450K .......... .......... .......... .......... .......... 75% 395M 0s 2024-09-12T17:49:15.311 INFO:teuthology.orchestra.run.smithi044.stderr: 70500K .......... .......... .......... .......... .......... 75% 376M 0s 2024-09-12T17:49:15.311 INFO:teuthology.orchestra.run.smithi044.stderr: 70550K .......... .......... .......... .......... .......... 75% 330M 0s 2024-09-12T17:49:15.311 INFO:teuthology.orchestra.run.smithi044.stderr: 70600K .......... .......... .......... .......... .......... 76% 354M 0s 2024-09-12T17:49:15.312 INFO:teuthology.orchestra.run.smithi044.stderr: 70650K .......... .......... .......... .......... .......... 76% 345M 0s 2024-09-12T17:49:15.312 INFO:teuthology.orchestra.run.smithi044.stderr: 70700K .......... .......... .......... .......... .......... 76% 302M 0s 2024-09-12T17:49:15.312 INFO:teuthology.orchestra.run.smithi044.stderr: 70750K .......... .......... .......... .......... .......... 76% 286M 0s 2024-09-12T17:49:15.312 INFO:teuthology.orchestra.run.smithi044.stderr: 70800K .......... .......... .......... .......... .......... 76% 370M 0s 2024-09-12T17:49:15.312 INFO:teuthology.orchestra.run.smithi044.stderr: 70850K .......... .......... .......... .......... .......... 76% 321M 0s 2024-09-12T17:49:15.312 INFO:teuthology.orchestra.run.smithi044.stderr: 70900K .......... .......... .......... .......... .......... 76% 379M 0s 2024-09-12T17:49:15.312 INFO:teuthology.orchestra.run.smithi044.stderr: 70950K .......... .......... .......... .......... .......... 76% 361M 0s 2024-09-12T17:49:15.312 INFO:teuthology.orchestra.run.smithi044.stderr: 71000K .......... .......... .......... .......... .......... 76% 193M 0s 2024-09-12T17:49:15.312 INFO:teuthology.orchestra.run.smithi044.stderr: 71050K .......... .......... .......... .......... .......... 76% 333M 0s 2024-09-12T17:49:15.312 INFO:teuthology.orchestra.run.smithi044.stderr: 71100K .......... .......... .......... .......... .......... 76% 389M 0s 2024-09-12T17:49:15.312 INFO:teuthology.orchestra.run.smithi044.stderr: 71150K .......... .......... .......... .......... .......... 76% 52.7M 0s 2024-09-12T17:49:15.313 INFO:teuthology.orchestra.run.smithi044.stderr: 71200K .......... .......... .......... .......... .......... 76% 358M 0s 2024-09-12T17:49:15.313 INFO:teuthology.orchestra.run.smithi044.stderr: 71250K .......... .......... .......... .......... .......... 76% 387M 0s 2024-09-12T17:49:15.313 INFO:teuthology.orchestra.run.smithi044.stderr: 71300K .......... .......... .......... .......... .......... 76% 382M 0s 2024-09-12T17:49:15.313 INFO:teuthology.orchestra.run.smithi044.stderr: 71350K .......... .......... .......... .......... .......... 76% 347M 0s 2024-09-12T17:49:15.313 INFO:teuthology.orchestra.run.smithi044.stderr: 71400K .......... .......... .......... .......... .......... 76% 377M 0s 2024-09-12T17:49:15.313 INFO:teuthology.orchestra.run.smithi044.stderr: 71450K .......... .......... .......... .......... .......... 76% 145M 0s 2024-09-12T17:49:15.313 INFO:teuthology.orchestra.run.smithi044.stderr: 71500K .......... .......... .......... .......... .......... 77% 372M 0s 2024-09-12T17:49:15.313 INFO:teuthology.orchestra.run.smithi044.stderr: 71550K .......... .......... .......... .......... .......... 77% 192M 0s 2024-09-12T17:49:15.313 INFO:teuthology.orchestra.run.smithi044.stderr: 71600K .......... .......... .......... .......... .......... 77% 363M 0s 2024-09-12T17:49:15.313 INFO:teuthology.orchestra.run.smithi044.stderr: 71650K .......... .......... .......... .......... .......... 77% 354M 0s 2024-09-12T17:49:15.313 INFO:teuthology.orchestra.run.smithi044.stderr: 71700K .......... .......... .......... .......... .......... 77% 103M 0s 2024-09-12T17:49:15.314 INFO:teuthology.orchestra.run.smithi044.stderr: 71750K .......... .......... .......... .......... .......... 77% 80.7M 0s 2024-09-12T17:49:15.314 INFO:teuthology.orchestra.run.smithi044.stderr: 71800K .......... .......... .......... .......... .......... 77% 352M 0s 2024-09-12T17:49:15.314 INFO:teuthology.orchestra.run.smithi044.stderr: 71850K .......... .......... .......... .......... .......... 77% 73.0M 0s 2024-09-12T17:49:15.314 INFO:teuthology.orchestra.run.smithi044.stderr: 71900K .......... .......... .......... .......... .......... 77% 270M 0s 2024-09-12T17:49:15.314 INFO:teuthology.orchestra.run.smithi044.stderr: 71950K .......... .......... .......... .......... .......... 77% 300M 0s 2024-09-12T17:49:15.314 INFO:teuthology.orchestra.run.smithi044.stderr: 72000K .......... .......... .......... .......... .......... 77% 343M 0s 2024-09-12T17:49:15.314 INFO:teuthology.orchestra.run.smithi044.stderr: 72050K .......... .......... .......... .......... .......... 77% 288M 0s 2024-09-12T17:49:15.314 INFO:teuthology.orchestra.run.smithi044.stderr: 72100K .......... .......... .......... .......... .......... 77% 295M 0s 2024-09-12T17:49:15.314 INFO:teuthology.orchestra.run.smithi044.stderr: 72150K .......... .......... .......... .......... .......... 77% 310M 0s 2024-09-12T17:49:15.314 INFO:teuthology.orchestra.run.smithi044.stderr: 72200K .......... .......... .......... .......... .......... 77% 359M 0s 2024-09-12T17:49:15.314 INFO:teuthology.orchestra.run.smithi044.stderr: 72250K .......... .......... .......... .......... .......... 77% 273M 0s 2024-09-12T17:49:15.314 INFO:teuthology.orchestra.run.smithi044.stderr: 72300K .......... .......... .......... .......... .......... 77% 300M 0s 2024-09-12T17:49:15.315 INFO:teuthology.orchestra.run.smithi044.stderr: 72350K .......... .......... .......... .......... .......... 77% 386M 0s 2024-09-12T17:49:15.315 INFO:teuthology.orchestra.run.smithi044.stderr: 72400K .......... .......... .......... .......... .......... 77% 352M 0s 2024-09-12T17:49:15.315 INFO:teuthology.orchestra.run.smithi044.stderr: 72450K .......... .......... .......... .......... .......... 78% 385M 0s 2024-09-12T17:49:15.315 INFO:teuthology.orchestra.run.smithi044.stderr: 72500K .......... .......... .......... .......... .......... 78% 142M 0s 2024-09-12T17:49:15.315 INFO:teuthology.orchestra.run.smithi044.stderr: 72550K .......... .......... .......... .......... .......... 78% 349M 0s 2024-09-12T17:49:15.315 INFO:teuthology.orchestra.run.smithi044.stderr: 72600K .......... .......... .......... .......... .......... 78% 367M 0s 2024-09-12T17:49:15.315 INFO:teuthology.orchestra.run.smithi044.stderr: 72650K .......... .......... .......... .......... .......... 78% 380M 0s 2024-09-12T17:49:15.315 INFO:teuthology.orchestra.run.smithi044.stderr: 72700K .......... .......... .......... .......... .......... 78% 125M 0s 2024-09-12T17:49:15.315 INFO:teuthology.orchestra.run.smithi044.stderr: 72750K .......... .......... .......... .......... .......... 78% 362M 0s 2024-09-12T17:49:15.315 INFO:teuthology.orchestra.run.smithi044.stderr: 72800K .......... .......... .......... .......... .......... 78% 351M 0s 2024-09-12T17:49:15.315 INFO:teuthology.orchestra.run.smithi044.stderr: 72850K .......... .......... .......... .......... .......... 78% 366M 0s 2024-09-12T17:49:15.315 INFO:teuthology.orchestra.run.smithi044.stderr: 72900K .......... .......... .......... .......... .......... 78% 336M 0s 2024-09-12T17:49:15.316 INFO:teuthology.orchestra.run.smithi044.stderr: 72950K .......... .......... .......... .......... .......... 78% 371M 0s 2024-09-12T17:49:15.316 INFO:teuthology.orchestra.run.smithi044.stderr: 73000K .......... .......... .......... .......... .......... 78% 372M 0s 2024-09-12T17:49:15.316 INFO:teuthology.orchestra.run.smithi044.stderr: 73050K .......... .......... .......... .......... .......... 78% 349M 0s 2024-09-12T17:49:15.316 INFO:teuthology.orchestra.run.smithi044.stderr: 73100K .......... .......... .......... .......... .......... 78% 325M 0s 2024-09-12T17:49:15.316 INFO:teuthology.orchestra.run.smithi044.stderr: 73150K .......... .......... .......... .......... .......... 78% 125M 0s 2024-09-12T17:49:15.316 INFO:teuthology.orchestra.run.smithi044.stderr: 73200K .......... .......... .......... .......... .......... 78% 353M 0s 2024-09-12T17:49:15.316 INFO:teuthology.orchestra.run.smithi044.stderr: 73250K .......... .......... .......... .......... .......... 78% 365M 0s 2024-09-12T17:49:15.316 INFO:teuthology.orchestra.run.smithi044.stderr: 73300K .......... .......... .......... .......... .......... 78% 336M 0s 2024-09-12T17:49:15.316 INFO:teuthology.orchestra.run.smithi044.stderr: 73350K .......... .......... .......... .......... .......... 79% 365M 0s 2024-09-12T17:49:15.316 INFO:teuthology.orchestra.run.smithi044.stderr: 73400K .......... .......... .......... .......... .......... 79% 353M 0s 2024-09-12T17:49:15.316 INFO:teuthology.orchestra.run.smithi044.stderr: 73450K .......... .......... .......... .......... .......... 79% 364M 0s 2024-09-12T17:49:15.317 INFO:teuthology.orchestra.run.smithi044.stderr: 73500K .......... .......... .......... .......... .......... 79% 315M 0s 2024-09-12T17:49:15.317 INFO:teuthology.orchestra.run.smithi044.stderr: 73550K .......... .......... .......... .......... .......... 79% 345M 0s 2024-09-12T17:49:15.317 INFO:teuthology.orchestra.run.smithi044.stderr: 73600K .......... .......... .......... .......... .......... 79% 324M 0s 2024-09-12T17:49:15.317 INFO:teuthology.orchestra.run.smithi044.stderr: 73650K .......... .......... .......... .......... .......... 79% 343M 0s 2024-09-12T17:49:15.317 INFO:teuthology.orchestra.run.smithi044.stderr: 73700K .......... .......... .......... .......... .......... 79% 295M 0s 2024-09-12T17:49:15.317 INFO:teuthology.orchestra.run.smithi044.stderr: 73750K .......... .......... .......... .......... .......... 79% 320M 0s 2024-09-12T17:49:15.317 INFO:teuthology.orchestra.run.smithi044.stderr: 73800K .......... .......... .......... .......... .......... 79% 360M 0s 2024-09-12T17:49:15.317 INFO:teuthology.orchestra.run.smithi044.stderr: 73850K .......... .......... .......... .......... .......... 79% 369M 0s 2024-09-12T17:49:15.317 INFO:teuthology.orchestra.run.smithi044.stderr: 73900K .......... .......... .......... .......... .......... 79% 321M 0s 2024-09-12T17:49:15.317 INFO:teuthology.orchestra.run.smithi044.stderr: 73950K .......... .......... .......... .......... .......... 79% 376M 0s 2024-09-12T17:49:15.317 INFO:teuthology.orchestra.run.smithi044.stderr: 74000K .......... .......... .......... .......... .......... 79% 371M 0s 2024-09-12T17:49:15.317 INFO:teuthology.orchestra.run.smithi044.stderr: 74050K .......... .......... .......... .......... .......... 79% 308M 0s 2024-09-12T17:49:15.318 INFO:teuthology.orchestra.run.smithi044.stderr: 74100K .......... .......... .......... .......... .......... 79% 320M 0s 2024-09-12T17:49:15.318 INFO:teuthology.orchestra.run.smithi044.stderr: 74150K .......... .......... .......... .......... .......... 79% 383M 0s 2024-09-12T17:49:15.318 INFO:teuthology.orchestra.run.smithi044.stderr: 74200K .......... .......... .......... .......... .......... 79% 74.6M 0s 2024-09-12T17:49:15.318 INFO:teuthology.orchestra.run.smithi044.stderr: 74250K .......... .......... .......... .......... .......... 79% 156M 0s 2024-09-12T17:49:15.318 INFO:teuthology.orchestra.run.smithi044.stderr: 74300K .......... .......... .......... .......... .......... 80% 259M 0s 2024-09-12T17:49:15.318 INFO:teuthology.orchestra.run.smithi044.stderr: 74350K .......... .......... .......... .......... .......... 80% 372M 0s 2024-09-12T17:49:15.318 INFO:teuthology.orchestra.run.smithi044.stderr: 74400K .......... .......... .......... .......... .......... 80% 368M 0s 2024-09-12T17:49:15.318 INFO:teuthology.orchestra.run.smithi044.stderr: 74450K .......... .......... .......... .......... .......... 80% 375M 0s 2024-09-12T17:49:15.318 INFO:teuthology.orchestra.run.smithi044.stderr: 74500K .......... .......... .......... .......... .......... 80% 142M 0s 2024-09-12T17:49:15.318 INFO:teuthology.orchestra.run.smithi044.stderr: 74550K .......... .......... .......... .......... .......... 80% 125M 0s 2024-09-12T17:49:15.319 INFO:teuthology.orchestra.run.smithi044.stderr: 74600K .......... .......... .......... .......... .......... 80% 165M 0s 2024-09-12T17:49:15.319 INFO:teuthology.orchestra.run.smithi044.stderr: 74650K .......... .......... .......... .......... .......... 80% 325M 0s 2024-09-12T17:49:15.319 INFO:teuthology.orchestra.run.smithi044.stderr: 74700K .......... .......... .......... .......... .......... 80% 300M 0s 2024-09-12T17:49:15.319 INFO:teuthology.orchestra.run.smithi044.stderr: 74750K .......... .......... .......... .......... .......... 80% 385M 0s 2024-09-12T17:49:15.319 INFO:teuthology.orchestra.run.smithi044.stderr: 74800K .......... .......... .......... .......... .......... 80% 168M 0s 2024-09-12T17:49:15.319 INFO:teuthology.orchestra.run.smithi044.stderr: 74850K .......... .......... .......... .......... .......... 80% 65.2M 0s 2024-09-12T17:49:15.319 INFO:teuthology.orchestra.run.smithi044.stderr: 74900K .......... .......... .......... .......... .......... 80% 253M 0s 2024-09-12T17:49:15.319 INFO:teuthology.orchestra.run.smithi044.stderr: 74950K .......... .......... .......... .......... .......... 80% 196M 0s 2024-09-12T17:49:15.319 INFO:teuthology.orchestra.run.smithi044.stderr: 75000K .......... .......... .......... .......... .......... 80% 321M 0s 2024-09-12T17:49:15.319 INFO:teuthology.orchestra.run.smithi044.stderr: 75050K .......... .......... .......... .......... .......... 80% 365M 0s 2024-09-12T17:49:15.319 INFO:teuthology.orchestra.run.smithi044.stderr: 75100K .......... .......... .......... .......... .......... 80% 245M 0s 2024-09-12T17:49:15.320 INFO:teuthology.orchestra.run.smithi044.stderr: 75150K .......... .......... .......... .......... .......... 80% 367M 0s 2024-09-12T17:49:15.320 INFO:teuthology.orchestra.run.smithi044.stderr: 75200K .......... .......... .......... .......... .......... 81% 383M 0s 2024-09-12T17:49:15.320 INFO:teuthology.orchestra.run.smithi044.stderr: 75250K .......... .......... .......... .......... .......... 81% 357M 0s 2024-09-12T17:49:15.320 INFO:teuthology.orchestra.run.smithi044.stderr: 75300K .......... .......... .......... .......... .......... 81% 331M 0s 2024-09-12T17:49:15.320 INFO:teuthology.orchestra.run.smithi044.stderr: 75350K .......... .......... .......... .......... .......... 81% 369M 0s 2024-09-12T17:49:15.320 INFO:teuthology.orchestra.run.smithi044.stderr: 75400K .......... .......... .......... .......... .......... 81% 369M 0s 2024-09-12T17:49:15.320 INFO:teuthology.orchestra.run.smithi044.stderr: 75450K .......... .......... .......... .......... .......... 81% 84.8M 0s 2024-09-12T17:49:15.320 INFO:teuthology.orchestra.run.smithi044.stderr: 75500K .......... .......... .......... .......... .......... 81% 298M 0s 2024-09-12T17:49:15.320 INFO:teuthology.orchestra.run.smithi044.stderr: 75550K .......... .......... .......... .......... .......... 81% 359M 0s 2024-09-12T17:49:15.320 INFO:teuthology.orchestra.run.smithi044.stderr: 75600K .......... .......... .......... .......... .......... 81% 373M 0s 2024-09-12T17:49:15.321 INFO:teuthology.orchestra.run.smithi044.stderr: 75650K .......... .......... .......... .......... .......... 81% 354M 0s 2024-09-12T17:49:15.321 INFO:teuthology.orchestra.run.smithi044.stderr: 75700K .......... .......... .......... .......... .......... 81% 332M 0s 2024-09-12T17:49:15.321 INFO:teuthology.orchestra.run.smithi044.stderr: 75750K .......... .......... .......... .......... .......... 81% 371M 0s 2024-09-12T17:49:15.321 INFO:teuthology.orchestra.run.smithi044.stderr: 75800K .......... .......... .......... .......... .......... 81% 394M 0s 2024-09-12T17:49:15.321 INFO:teuthology.orchestra.run.smithi044.stderr: 75850K .......... .......... .......... .......... .......... 81% 298M 0s 2024-09-12T17:49:15.321 INFO:teuthology.orchestra.run.smithi044.stderr: 75900K .......... .......... .......... .......... .......... 81% 316M 0s 2024-09-12T17:49:15.321 INFO:teuthology.orchestra.run.smithi044.stderr: 75950K .......... .......... .......... .......... .......... 81% 369M 0s 2024-09-12T17:49:15.321 INFO:teuthology.orchestra.run.smithi044.stderr: 76000K .......... .......... .......... .......... .......... 81% 204M 0s 2024-09-12T17:49:15.321 INFO:teuthology.orchestra.run.smithi044.stderr: 76050K .......... .......... .......... .......... .......... 81% 276M 0s 2024-09-12T17:49:15.321 INFO:teuthology.orchestra.run.smithi044.stderr: 76100K .......... .......... .......... .......... .......... 81% 328M 0s 2024-09-12T17:49:15.321 INFO:teuthology.orchestra.run.smithi044.stderr: 76150K .......... .......... .......... .......... .......... 82% 149M 0s 2024-09-12T17:49:15.322 INFO:teuthology.orchestra.run.smithi044.stderr: 76200K .......... .......... .......... .......... .......... 82% 347M 0s 2024-09-12T17:49:15.322 INFO:teuthology.orchestra.run.smithi044.stderr: 76250K .......... .......... .......... .......... .......... 82% 353M 0s 2024-09-12T17:49:15.322 INFO:teuthology.orchestra.run.smithi044.stderr: 76300K .......... .......... .......... .......... .......... 82% 320M 0s 2024-09-12T17:49:15.322 INFO:teuthology.orchestra.run.smithi044.stderr: 76350K .......... .......... .......... .......... .......... 82% 147M 0s 2024-09-12T17:49:15.322 INFO:teuthology.orchestra.run.smithi044.stderr: 76400K .......... .......... .......... .......... .......... 82% 372M 0s 2024-09-12T17:49:15.322 INFO:teuthology.orchestra.run.smithi044.stderr: 76450K .......... .......... .......... .......... .......... 82% 376M 0s 2024-09-12T17:49:15.322 INFO:teuthology.orchestra.run.smithi044.stderr: 76500K .......... .......... .......... .......... .......... 82% 283M 0s 2024-09-12T17:49:15.322 INFO:teuthology.orchestra.run.smithi044.stderr: 76550K .......... .......... .......... .......... .......... 82% 372M 0s 2024-09-12T17:49:15.322 INFO:teuthology.orchestra.run.smithi044.stderr: 76600K .......... .......... .......... .......... .......... 82% 381M 0s 2024-09-12T17:49:15.322 INFO:teuthology.orchestra.run.smithi044.stderr: 76650K .......... .......... .......... .......... .......... 82% 366M 0s 2024-09-12T17:49:15.322 INFO:teuthology.orchestra.run.smithi044.stderr: 76700K .......... .......... .......... .......... .......... 82% 193M 0s 2024-09-12T17:49:15.322 INFO:teuthology.orchestra.run.smithi044.stderr: 76750K .......... .......... .......... .......... .......... 82% 394M 0s 2024-09-12T17:49:15.322 INFO:teuthology.orchestra.run.smithi044.stderr: 76800K .......... .......... .......... .......... .......... 82% 380M 0s 2024-09-12T17:49:15.323 INFO:teuthology.orchestra.run.smithi044.stderr: 76850K .......... .......... .......... .......... .......... 82% 342M 0s 2024-09-12T17:49:15.323 INFO:teuthology.orchestra.run.smithi044.stderr: 76900K .......... .......... .......... .......... .......... 82% 336M 0s 2024-09-12T17:49:15.323 INFO:teuthology.orchestra.run.smithi044.stderr: 76950K .......... .......... .......... .......... .......... 82% 378M 0s 2024-09-12T17:49:15.323 INFO:teuthology.orchestra.run.smithi044.stderr: 77000K .......... .......... .......... .......... .......... 82% 374M 0s 2024-09-12T17:49:15.323 INFO:teuthology.orchestra.run.smithi044.stderr: 77050K .......... .......... .......... .......... .......... 82% 377M 0s 2024-09-12T17:49:15.323 INFO:teuthology.orchestra.run.smithi044.stderr: 77100K .......... .......... .......... .......... .......... 83% 320M 0s 2024-09-12T17:49:15.323 INFO:teuthology.orchestra.run.smithi044.stderr: 77150K .......... .......... .......... .......... .......... 83% 133M 0s 2024-09-12T17:49:15.323 INFO:teuthology.orchestra.run.smithi044.stderr: 77200K .......... .......... .......... .......... .......... 83% 366M 0s 2024-09-12T17:49:15.323 INFO:teuthology.orchestra.run.smithi044.stderr: 77250K .......... .......... .......... .......... .......... 83% 386M 0s 2024-09-12T17:49:15.323 INFO:teuthology.orchestra.run.smithi044.stderr: 77300K .......... .......... .......... .......... .......... 83% 146M 0s 2024-09-12T17:49:15.324 INFO:teuthology.orchestra.run.smithi044.stderr: 77350K .......... .......... .......... .......... .......... 83% 214M 0s 2024-09-12T17:49:15.324 INFO:teuthology.orchestra.run.smithi044.stderr: 77400K .......... .......... .......... .......... .......... 83% 214M 0s 2024-09-12T17:49:15.324 INFO:teuthology.orchestra.run.smithi044.stderr: 77450K .......... .......... .......... .......... .......... 83% 230M 0s 2024-09-12T17:49:15.324 INFO:teuthology.orchestra.run.smithi044.stderr: 77500K .......... .......... .......... .......... .......... 83% 176M 0s 2024-09-12T17:49:15.324 INFO:teuthology.orchestra.run.smithi044.stderr: 77550K .......... .......... .......... .......... .......... 83% 226M 0s 2024-09-12T17:49:15.324 INFO:teuthology.orchestra.run.smithi044.stderr: 77600K .......... .......... .......... .......... .......... 83% 208M 0s 2024-09-12T17:49:15.324 INFO:teuthology.orchestra.run.smithi044.stderr: 77650K .......... .......... .......... .......... .......... 83% 218M 0s 2024-09-12T17:49:15.324 INFO:teuthology.orchestra.run.smithi044.stderr: 77700K .......... .......... .......... .......... .......... 83% 210M 0s 2024-09-12T17:49:15.324 INFO:teuthology.orchestra.run.smithi044.stderr: 77750K .......... .......... .......... .......... .......... 83% 114M 0s 2024-09-12T17:49:15.324 INFO:teuthology.orchestra.run.smithi044.stderr: 77800K .......... .......... .......... .......... .......... 83% 211M 0s 2024-09-12T17:49:15.324 INFO:teuthology.orchestra.run.smithi044.stderr: 77850K .......... .......... .......... .......... .......... 83% 223M 0s 2024-09-12T17:49:15.324 INFO:teuthology.orchestra.run.smithi044.stderr: 77900K .......... .......... .......... .......... .......... 83% 133M 0s 2024-09-12T17:49:15.325 INFO:teuthology.orchestra.run.smithi044.stderr: 77950K .......... .......... .......... .......... .......... 83% 212M 0s 2024-09-12T17:49:15.325 INFO:teuthology.orchestra.run.smithi044.stderr: 78000K .......... .......... .......... .......... .......... 84% 173M 0s 2024-09-12T17:49:15.325 INFO:teuthology.orchestra.run.smithi044.stderr: 78050K .......... .......... .......... .......... .......... 84% 214M 0s 2024-09-12T17:49:15.325 INFO:teuthology.orchestra.run.smithi044.stderr: 78100K .......... .......... .......... .......... .......... 84% 202M 0s 2024-09-12T17:49:15.325 INFO:teuthology.orchestra.run.smithi044.stderr: 78150K .......... .......... .......... .......... .......... 84% 210M 0s 2024-09-12T17:49:15.325 INFO:teuthology.orchestra.run.smithi044.stderr: 78200K .......... .......... .......... .......... .......... 84% 211M 0s 2024-09-12T17:49:15.325 INFO:teuthology.orchestra.run.smithi044.stderr: 78250K .......... .......... .......... .......... .......... 84% 214M 0s 2024-09-12T17:49:15.325 INFO:teuthology.orchestra.run.smithi044.stderr: 78300K .......... .......... .......... .......... .......... 84% 191M 0s 2024-09-12T17:49:15.325 INFO:teuthology.orchestra.run.smithi044.stderr: 78350K .......... .......... .......... .......... .......... 84% 206M 0s 2024-09-12T17:49:15.325 INFO:teuthology.orchestra.run.smithi044.stderr: 78400K .......... .......... .......... .......... .......... 84% 209M 0s 2024-09-12T17:49:15.325 INFO:teuthology.orchestra.run.smithi044.stderr: 78450K .......... .......... .......... .......... .......... 84% 229M 0s 2024-09-12T17:49:15.325 INFO:teuthology.orchestra.run.smithi044.stderr: 78500K .......... .......... .......... .......... .......... 84% 200M 0s 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi044.stderr: 78550K .......... .......... .......... .......... .......... 84% 219M 0s 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi044.stderr: 78600K .......... .......... .......... .......... .......... 84% 207M 0s 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi044.stderr: 78650K .......... .......... .......... .......... .......... 84% 217M 0s 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi044.stderr: 78700K .......... .......... .......... .......... .......... 84% 177M 0s 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi044.stderr: 78750K .......... .......... .......... .......... .......... 84% 230M 0s 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi044.stderr: 78800K .......... .......... .......... .......... .......... 84% 206M 0s 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi044.stderr: 78850K .......... .......... .......... .......... .......... 84% 224M 0s 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi044.stderr: 78900K .......... .......... .......... .......... .......... 84% 190M 0s 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi044.stderr: 78950K .......... .......... .......... .......... .......... 85% 171M 0s 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi044.stderr: 79000K .......... .......... .......... .......... .......... 85% 180M 0s 2024-09-12T17:49:15.326 INFO:teuthology.orchestra.run.smithi044.stderr: 79050K .......... .......... .......... .......... .......... 85% 225M 0s 2024-09-12T17:49:15.327 INFO:teuthology.orchestra.run.smithi044.stderr: 79100K .......... .......... .......... .......... .......... 85% 145M 0s 2024-09-12T17:49:15.327 INFO:teuthology.orchestra.run.smithi044.stderr: 79150K .......... .......... .......... .......... .......... 85% 179M 0s 2024-09-12T17:49:15.327 INFO:teuthology.orchestra.run.smithi044.stderr: 79200K .......... .......... .......... .......... .......... 85% 216M 0s 2024-09-12T17:49:15.327 INFO:teuthology.orchestra.run.smithi044.stderr: 79250K .......... .......... .......... .......... .......... 85% 223M 0s 2024-09-12T17:49:15.327 INFO:teuthology.orchestra.run.smithi044.stderr: 79300K .......... .......... .......... .......... .......... 85% 202M 0s 2024-09-12T17:49:15.327 INFO:teuthology.orchestra.run.smithi044.stderr: 79350K .......... .......... .......... .......... .......... 85% 189M 0s 2024-09-12T17:49:15.327 INFO:teuthology.orchestra.run.smithi044.stderr: 79400K .......... .......... .......... .......... .......... 85% 217M 0s 2024-09-12T17:49:15.327 INFO:teuthology.orchestra.run.smithi044.stderr: 79450K .......... .......... .......... .......... .......... 85% 221M 0s 2024-09-12T17:49:15.327 INFO:teuthology.orchestra.run.smithi044.stderr: 79500K .......... .......... .......... .......... .......... 85% 185M 0s 2024-09-12T17:49:15.327 INFO:teuthology.orchestra.run.smithi044.stderr: 79550K .......... .......... .......... .......... .......... 85% 220M 0s 2024-09-12T17:49:15.327 INFO:teuthology.orchestra.run.smithi044.stderr: 79600K .......... .......... .......... .......... .......... 85% 211M 0s 2024-09-12T17:49:15.327 INFO:teuthology.orchestra.run.smithi044.stderr: 79650K .......... .......... .......... .......... .......... 85% 217M 0s 2024-09-12T17:49:15.328 INFO:teuthology.orchestra.run.smithi044.stderr: 79700K .......... .......... .......... .......... .......... 85% 197M 0s 2024-09-12T17:49:15.328 INFO:teuthology.orchestra.run.smithi044.stderr: 79750K .......... .......... .......... .......... .......... 85% 221M 0s 2024-09-12T17:49:15.328 INFO:teuthology.orchestra.run.smithi044.stderr: 79800K .......... .......... .......... .......... .......... 85% 218M 0s 2024-09-12T17:49:15.328 INFO:teuthology.orchestra.run.smithi044.stderr: 79850K .......... .......... .......... .......... .......... 86% 218M 0s 2024-09-12T17:49:15.328 INFO:teuthology.orchestra.run.smithi044.stderr: 79900K .......... .......... .......... .......... .......... 86% 177M 0s 2024-09-12T17:49:15.328 INFO:teuthology.orchestra.run.smithi044.stderr: 79950K .......... .......... .......... .......... .......... 86% 231M 0s 2024-09-12T17:49:15.328 INFO:teuthology.orchestra.run.smithi044.stderr: 80000K .......... .......... .......... .......... .......... 86% 214M 0s 2024-09-12T17:49:15.328 INFO:teuthology.orchestra.run.smithi044.stderr: 80050K .......... .......... .......... .......... .......... 86% 224M 0s 2024-09-12T17:49:15.328 INFO:teuthology.orchestra.run.smithi044.stderr: 80100K .......... .......... .......... .......... .......... 86% 204M 0s 2024-09-12T17:49:15.328 INFO:teuthology.orchestra.run.smithi044.stderr: 80150K .......... .......... .......... .......... .......... 86% 211M 0s 2024-09-12T17:49:15.328 INFO:teuthology.orchestra.run.smithi044.stderr: 80200K .......... .......... .......... .......... .......... 86% 224M 0s 2024-09-12T17:49:15.329 INFO:teuthology.orchestra.run.smithi044.stderr: 80250K .......... .......... .......... .......... .......... 86% 188M 0s 2024-09-12T17:49:15.329 INFO:teuthology.orchestra.run.smithi044.stderr: 80300K .......... .......... .......... .......... .......... 86% 185M 0s 2024-09-12T17:49:15.329 INFO:teuthology.orchestra.run.smithi044.stderr: 80350K .......... .......... .......... .......... .......... 86% 211M 0s 2024-09-12T17:49:15.329 INFO:teuthology.orchestra.run.smithi044.stderr: 80400K .......... .......... .......... .......... .......... 86% 219M 0s 2024-09-12T17:49:15.329 INFO:teuthology.orchestra.run.smithi044.stderr: 80450K .......... .......... .......... .......... .......... 86% 212M 0s 2024-09-12T17:49:15.329 INFO:teuthology.orchestra.run.smithi044.stderr: 80500K .......... .......... .......... .......... .......... 86% 195M 0s 2024-09-12T17:49:15.329 INFO:teuthology.orchestra.run.smithi044.stderr: 80550K .......... .......... .......... .......... .......... 86% 177M 0s 2024-09-12T17:49:15.329 INFO:teuthology.orchestra.run.smithi044.stderr: 80600K .......... .......... .......... .......... .......... 86% 224M 0s 2024-09-12T17:49:15.329 INFO:teuthology.orchestra.run.smithi044.stderr: 80650K .......... .......... .......... .......... .......... 86% 207M 0s 2024-09-12T17:49:15.329 INFO:teuthology.orchestra.run.smithi044.stderr: 80700K .......... .......... .......... .......... .......... 86% 185M 0s 2024-09-12T17:49:15.329 INFO:teuthology.orchestra.run.smithi044.stderr: 80750K .......... .......... .......... .......... .......... 86% 229M 0s 2024-09-12T17:49:15.329 INFO:teuthology.orchestra.run.smithi044.stderr: 80800K .......... .......... .......... .......... .......... 87% 222M 0s 2024-09-12T17:49:15.330 INFO:teuthology.orchestra.run.smithi044.stderr: 80850K .......... .......... .......... .......... .......... 87% 224M 0s 2024-09-12T17:49:15.330 INFO:teuthology.orchestra.run.smithi044.stderr: 80900K .......... .......... .......... .......... .......... 87% 190M 0s 2024-09-12T17:49:15.330 INFO:teuthology.orchestra.run.smithi044.stderr: 80950K .......... .......... .......... .......... .......... 87% 209M 0s 2024-09-12T17:49:15.330 INFO:teuthology.orchestra.run.smithi044.stderr: 81000K .......... .......... .......... .......... .......... 87% 227M 0s 2024-09-12T17:49:15.330 INFO:teuthology.orchestra.run.smithi044.stderr: 81050K .......... .......... .......... .......... .......... 87% 227M 0s 2024-09-12T17:49:15.330 INFO:teuthology.orchestra.run.smithi044.stderr: 81100K .......... .......... .......... .......... .......... 87% 176M 0s 2024-09-12T17:49:15.330 INFO:teuthology.orchestra.run.smithi044.stderr: 81150K .......... .......... .......... .......... .......... 87% 226M 0s 2024-09-12T17:49:15.330 INFO:teuthology.orchestra.run.smithi044.stderr: 81200K .......... .......... .......... .......... .......... 87% 217M 0s 2024-09-12T17:49:15.330 INFO:teuthology.orchestra.run.smithi044.stderr: 81250K .......... .......... .......... .......... .......... 87% 217M 0s 2024-09-12T17:49:15.330 INFO:teuthology.orchestra.run.smithi044.stderr: 81300K .......... .......... .......... .......... .......... 87% 195M 0s 2024-09-12T17:49:15.330 INFO:teuthology.orchestra.run.smithi044.stderr: 81350K .......... .......... .......... .......... .......... 87% 207M 0s 2024-09-12T17:49:15.331 INFO:teuthology.orchestra.run.smithi044.stderr: 81400K .......... .......... .......... .......... .......... 87% 220M 0s 2024-09-12T17:49:15.331 INFO:teuthology.orchestra.run.smithi044.stderr: 81450K .......... .......... .......... .......... .......... 87% 217M 0s 2024-09-12T17:49:15.331 INFO:teuthology.orchestra.run.smithi044.stderr: 81500K .......... .......... .......... .......... .......... 87% 174M 0s 2024-09-12T17:49:15.331 INFO:teuthology.orchestra.run.smithi044.stderr: 81550K .......... .......... .......... .......... .......... 87% 170M 0s 2024-09-12T17:49:15.331 INFO:teuthology.orchestra.run.smithi044.stderr: 81600K .......... .......... .......... .......... .......... 87% 178M 0s 2024-09-12T17:49:15.331 INFO:teuthology.orchestra.run.smithi044.stderr: 81650K .......... .......... .......... .......... .......... 87% 182M 0s 2024-09-12T17:49:15.331 INFO:teuthology.orchestra.run.smithi044.stderr: 81700K .......... .......... .......... .......... .......... 87% 186M 0s 2024-09-12T17:49:15.331 INFO:teuthology.orchestra.run.smithi044.stderr: 81750K .......... .......... .......... .......... .......... 88% 207M 0s 2024-09-12T17:49:15.331 INFO:teuthology.orchestra.run.smithi044.stderr: 81800K .......... .......... .......... .......... .......... 88% 233M 0s 2024-09-12T17:49:15.331 INFO:teuthology.orchestra.run.smithi044.stderr: 81850K .......... .......... .......... .......... .......... 88% 225M 0s 2024-09-12T17:49:15.331 INFO:teuthology.orchestra.run.smithi044.stderr: 81900K .......... .......... .......... .......... .......... 88% 196M 0s 2024-09-12T17:49:15.331 INFO:teuthology.orchestra.run.smithi044.stderr: 81950K .......... .......... .......... .......... .......... 88% 177M 0s 2024-09-12T17:49:15.332 INFO:teuthology.orchestra.run.smithi044.stderr: 82000K .......... .......... .......... .......... .......... 88% 222M 0s 2024-09-12T17:49:15.332 INFO:teuthology.orchestra.run.smithi044.stderr: 82050K .......... .......... .......... .......... .......... 88% 202M 0s 2024-09-12T17:49:15.332 INFO:teuthology.orchestra.run.smithi044.stderr: 82100K .......... .......... .......... .......... .......... 88% 219M 0s 2024-09-12T17:49:15.332 INFO:teuthology.orchestra.run.smithi044.stderr: 82150K .......... .......... .......... .......... .......... 88% 207M 0s 2024-09-12T17:49:15.332 INFO:teuthology.orchestra.run.smithi044.stderr: 82200K .......... .......... .......... .......... .......... 88% 219M 0s 2024-09-12T17:49:15.332 INFO:teuthology.orchestra.run.smithi044.stderr: 82250K .......... .......... .......... .......... .......... 88% 179M 0s 2024-09-12T17:49:15.332 INFO:teuthology.orchestra.run.smithi044.stderr: 82300K .......... .......... .......... .......... .......... 88% 230M 0s 2024-09-12T17:49:15.332 INFO:teuthology.orchestra.run.smithi044.stderr: 82350K .......... .......... .......... .......... .......... 88% 202M 0s 2024-09-12T17:49:15.332 INFO:teuthology.orchestra.run.smithi044.stderr: 82400K .......... .......... .......... .......... .......... 88% 222M 0s 2024-09-12T17:49:15.332 INFO:teuthology.orchestra.run.smithi044.stderr: 82450K .......... .......... .......... .......... .......... 88% 203M 0s 2024-09-12T17:49:15.332 INFO:teuthology.orchestra.run.smithi044.stderr: 82500K .......... .......... .......... .......... .......... 88% 233M 0s 2024-09-12T17:49:15.332 INFO:teuthology.orchestra.run.smithi044.stderr: 82550K .......... .......... .......... .......... .......... 88% 210M 0s 2024-09-12T17:49:15.333 INFO:teuthology.orchestra.run.smithi044.stderr: 82600K .......... .......... .......... .......... .......... 88% 228M 0s 2024-09-12T17:49:15.333 INFO:teuthology.orchestra.run.smithi044.stderr: 82650K .......... .......... .......... .......... .......... 89% 148M 0s 2024-09-12T17:49:15.333 INFO:teuthology.orchestra.run.smithi044.stderr: 82700K .......... .......... .......... .......... .......... 89% 226M 0s 2024-09-12T17:49:15.333 INFO:teuthology.orchestra.run.smithi044.stderr: 82750K .......... .......... .......... .......... .......... 89% 146M 0s 2024-09-12T17:49:15.333 INFO:teuthology.orchestra.run.smithi044.stderr: 82800K .......... .......... .......... .......... .......... 89% 227M 0s 2024-09-12T17:49:15.333 INFO:teuthology.orchestra.run.smithi044.stderr: 82850K .......... .......... .......... .......... .......... 89% 183M 0s 2024-09-12T17:49:15.333 INFO:teuthology.orchestra.run.smithi044.stderr: 82900K .......... .......... .......... .......... .......... 89% 228M 0s 2024-09-12T17:49:15.333 INFO:teuthology.orchestra.run.smithi044.stderr: 82950K .......... .......... .......... .......... .......... 89% 215M 0s 2024-09-12T17:49:15.333 INFO:teuthology.orchestra.run.smithi044.stderr: 83000K .......... .......... .......... .......... .......... 89% 216M 0s 2024-09-12T17:49:15.333 INFO:teuthology.orchestra.run.smithi044.stderr: 83050K .......... .......... .......... .......... .......... 89% 182M 0s 2024-09-12T17:49:15.333 INFO:teuthology.orchestra.run.smithi044.stderr: 83100K .......... .......... .......... .......... .......... 89% 223M 0s 2024-09-12T17:49:15.334 INFO:teuthology.orchestra.run.smithi044.stderr: 83150K .......... .......... .......... .......... .......... 89% 206M 0s 2024-09-12T17:49:15.334 INFO:teuthology.orchestra.run.smithi044.stderr: 83200K .......... .......... .......... .......... .......... 89% 228M 0s 2024-09-12T17:49:15.334 INFO:teuthology.orchestra.run.smithi044.stderr: 83250K .......... .......... .......... .......... .......... 89% 197M 0s 2024-09-12T17:49:15.334 INFO:teuthology.orchestra.run.smithi044.stderr: 83300K .......... .......... .......... .......... .......... 89% 222M 0s 2024-09-12T17:49:15.334 INFO:teuthology.orchestra.run.smithi044.stderr: 83350K .......... .......... .......... .......... .......... 89% 225M 0s 2024-09-12T17:49:15.334 INFO:teuthology.orchestra.run.smithi044.stderr: 83400K .......... .......... .......... .......... .......... 89% 207M 0s 2024-09-12T17:49:15.334 INFO:teuthology.orchestra.run.smithi044.stderr: 83450K .......... .......... .......... .......... .......... 89% 179M 0s 2024-09-12T17:49:15.334 INFO:teuthology.orchestra.run.smithi044.stderr: 83500K .......... .......... .......... .......... .......... 89% 216M 0s 2024-09-12T17:49:15.334 INFO:teuthology.orchestra.run.smithi044.stderr: 83550K .......... .......... .......... .......... .......... 89% 220M 0s 2024-09-12T17:49:15.334 INFO:teuthology.orchestra.run.smithi044.stderr: 83600K .......... .......... .......... .......... .......... 90% 211M 0s 2024-09-12T17:49:15.334 INFO:teuthology.orchestra.run.smithi044.stderr: 83650K .......... .......... .......... .......... .......... 90% 207M 0s 2024-09-12T17:49:15.335 INFO:teuthology.orchestra.run.smithi044.stderr: 83700K .......... .......... .......... .......... .......... 90% 225M 0s 2024-09-12T17:49:15.335 INFO:teuthology.orchestra.run.smithi044.stderr: 83750K .......... .......... .......... .......... .......... 90% 229M 0s 2024-09-12T17:49:15.335 INFO:teuthology.orchestra.run.smithi044.stderr: 83800K .......... .......... .......... .......... .......... 90% 218M 0s 2024-09-12T17:49:15.335 INFO:teuthology.orchestra.run.smithi044.stderr: 83850K .......... .......... .......... .......... .......... 90% 186M 0s 2024-09-12T17:49:15.335 INFO:teuthology.orchestra.run.smithi044.stderr: 83900K .......... .......... .......... .......... .......... 90% 225M 0s 2024-09-12T17:49:15.335 INFO:teuthology.orchestra.run.smithi044.stderr: 83950K .......... .......... .......... .......... .......... 90% 217M 0s 2024-09-12T17:49:15.335 INFO:teuthology.orchestra.run.smithi044.stderr: 84000K .......... .......... .......... .......... .......... 90% 226M 0s 2024-09-12T17:49:15.335 INFO:teuthology.orchestra.run.smithi044.stderr: 84050K .......... .......... .......... .......... .......... 90% 194M 0s 2024-09-12T17:49:15.335 INFO:teuthology.orchestra.run.smithi044.stderr: 84100K .......... .......... .......... .......... .......... 90% 225M 0s 2024-09-12T17:49:15.335 INFO:teuthology.orchestra.run.smithi044.stderr: 84150K .......... .......... .......... .......... .......... 90% 194M 0s 2024-09-12T17:49:15.335 INFO:teuthology.orchestra.run.smithi044.stderr: 84200K .......... .......... .......... .......... .......... 90% 202M 0s 2024-09-12T17:49:15.335 INFO:teuthology.orchestra.run.smithi044.stderr: 84250K .......... .......... .......... .......... .......... 90% 167M 0s 2024-09-12T17:49:15.336 INFO:teuthology.orchestra.run.smithi044.stderr: 84300K .......... .......... .......... .......... .......... 90% 179M 0s 2024-09-12T17:49:15.336 INFO:teuthology.orchestra.run.smithi044.stderr: 84350K .......... .......... .......... .......... .......... 90% 187M 0s 2024-09-12T17:49:15.336 INFO:teuthology.orchestra.run.smithi044.stderr: 84400K .......... .......... .......... .......... .......... 90% 200M 0s 2024-09-12T17:49:15.336 INFO:teuthology.orchestra.run.smithi044.stderr: 84450K .......... .......... .......... .......... .......... 90% 197M 0s 2024-09-12T17:49:15.336 INFO:teuthology.orchestra.run.smithi044.stderr: 84500K .......... .......... .......... .......... .......... 91% 220M 0s 2024-09-12T17:49:15.336 INFO:teuthology.orchestra.run.smithi044.stderr: 84550K .......... .......... .......... .......... .......... 91% 215M 0s 2024-09-12T17:49:15.336 INFO:teuthology.orchestra.run.smithi044.stderr: 84600K .......... .......... .......... .......... .......... 91% 224M 0s 2024-09-12T17:49:15.336 INFO:teuthology.orchestra.run.smithi044.stderr: 84650K .......... .......... .......... .......... .......... 91% 177M 0s 2024-09-12T17:49:15.336 INFO:teuthology.orchestra.run.smithi044.stderr: 84700K .......... .......... .......... .......... .......... 91% 214M 0s 2024-09-12T17:49:15.337 INFO:teuthology.orchestra.run.smithi044.stderr: 84750K .......... .......... .......... .......... .......... 91% 220M 0s 2024-09-12T17:49:15.337 INFO:teuthology.orchestra.run.smithi044.stderr: 84800K .......... .......... .......... .......... .......... 91% 215M 0s 2024-09-12T17:49:15.337 INFO:teuthology.orchestra.run.smithi044.stderr: 84850K .......... .......... .......... .......... .......... 91% 198M 0s 2024-09-12T17:49:15.337 INFO:teuthology.orchestra.run.smithi044.stderr: 84900K .......... .......... .......... .......... .......... 91% 226M 0s 2024-09-12T17:49:15.337 INFO:teuthology.orchestra.run.smithi044.stderr: 84950K .......... .......... .......... .......... .......... 91% 208M 0s 2024-09-12T17:49:15.337 INFO:teuthology.orchestra.run.smithi044.stderr: 85000K .......... .......... .......... .......... .......... 91% 227M 0s 2024-09-12T17:49:15.337 INFO:teuthology.orchestra.run.smithi044.stderr: 85050K .......... .......... .......... .......... .......... 91% 175M 0s 2024-09-12T17:49:15.337 INFO:teuthology.orchestra.run.smithi044.stderr: 85100K .......... .......... .......... .......... .......... 91% 214M 0s 2024-09-12T17:49:15.337 INFO:teuthology.orchestra.run.smithi044.stderr: 85150K .......... .......... .......... .......... .......... 91% 214M 0s 2024-09-12T17:49:15.337 INFO:teuthology.orchestra.run.smithi044.stderr: 85200K .......... .......... .......... .......... .......... 91% 222M 0s 2024-09-12T17:49:15.337 INFO:teuthology.orchestra.run.smithi044.stderr: 85250K .......... .......... .......... .......... .......... 91% 208M 0s 2024-09-12T17:49:15.338 INFO:teuthology.orchestra.run.smithi044.stderr: 85300K .......... .......... .......... .......... .......... 91% 220M 0s 2024-09-12T17:49:15.338 INFO:teuthology.orchestra.run.smithi044.stderr: 85350K .......... .......... .......... .......... .......... 91% 227M 0s 2024-09-12T17:49:15.338 INFO:teuthology.orchestra.run.smithi044.stderr: 85400K .......... .......... .......... .......... .......... 91% 211M 0s 2024-09-12T17:49:15.338 INFO:teuthology.orchestra.run.smithi044.stderr: 85450K .......... .......... .......... .......... .......... 92% 138M 0s 2024-09-12T17:49:15.338 INFO:teuthology.orchestra.run.smithi044.stderr: 85500K .......... .......... .......... .......... .......... 92% 188M 0s 2024-09-12T17:49:15.338 INFO:teuthology.orchestra.run.smithi044.stderr: 85550K .......... .......... .......... .......... .......... 92% 225M 0s 2024-09-12T17:49:15.338 INFO:teuthology.orchestra.run.smithi044.stderr: 85600K .......... .......... .......... .......... .......... 92% 214M 0s 2024-09-12T17:49:15.338 INFO:teuthology.orchestra.run.smithi044.stderr: 85650K .......... .......... .......... .......... .......... 92% 162M 0s 2024-09-12T17:49:15.338 INFO:teuthology.orchestra.run.smithi044.stderr: 85700K .......... .......... .......... .......... .......... 92% 185M 0s 2024-09-12T17:49:15.338 INFO:teuthology.orchestra.run.smithi044.stderr: 85750K .......... .......... .......... .......... .......... 92% 192M 0s 2024-09-12T17:49:15.338 INFO:teuthology.orchestra.run.smithi044.stderr: 85800K .......... .......... .......... .......... .......... 92% 190M 0s 2024-09-12T17:49:15.338 INFO:teuthology.orchestra.run.smithi044.stderr: 85850K .......... .......... .......... .......... .......... 92% 181M 0s 2024-09-12T17:49:15.339 INFO:teuthology.orchestra.run.smithi044.stderr: 85900K .......... .......... .......... .......... .......... 92% 216M 0s 2024-09-12T17:49:15.339 INFO:teuthology.orchestra.run.smithi044.stderr: 85950K .......... .......... .......... .......... .......... 92% 214M 0s 2024-09-12T17:49:15.339 INFO:teuthology.orchestra.run.smithi044.stderr: 86000K .......... .......... .......... .......... .......... 92% 221M 0s 2024-09-12T17:49:15.339 INFO:teuthology.orchestra.run.smithi044.stderr: 86050K .......... .......... .......... .......... .......... 92% 196M 0s 2024-09-12T17:49:15.339 INFO:teuthology.orchestra.run.smithi044.stderr: 86100K .......... .......... .......... .......... .......... 92% 216M 0s 2024-09-12T17:49:15.339 INFO:teuthology.orchestra.run.smithi044.stderr: 86150K .......... .......... .......... .......... .......... 92% 215M 0s 2024-09-12T17:49:15.339 INFO:teuthology.orchestra.run.smithi044.stderr: 86200K .......... .......... .......... .......... .......... 92% 222M 0s 2024-09-12T17:49:15.339 INFO:teuthology.orchestra.run.smithi044.stderr: 86250K .......... .......... .......... .......... .......... 92% 187M 0s 2024-09-12T17:49:15.339 INFO:teuthology.orchestra.run.smithi044.stderr: 86300K .......... .......... .......... .......... .......... 92% 203M 0s 2024-09-12T17:49:15.339 INFO:teuthology.orchestra.run.smithi044.stderr: 86350K .......... .......... .......... .......... .......... 93% 220M 0s 2024-09-12T17:49:15.339 INFO:teuthology.orchestra.run.smithi044.stderr: 86400K .......... .......... .......... .......... .......... 93% 221M 0s 2024-09-12T17:49:15.339 INFO:teuthology.orchestra.run.smithi044.stderr: 86450K .......... .......... .......... .......... .......... 93% 198M 0s 2024-09-12T17:49:15.340 INFO:teuthology.orchestra.run.smithi044.stderr: 86500K .......... .......... .......... .......... .......... 93% 222M 0s 2024-09-12T17:49:15.340 INFO:teuthology.orchestra.run.smithi044.stderr: 86550K .......... .......... .......... .......... .......... 93% 208M 0s 2024-09-12T17:49:15.340 INFO:teuthology.orchestra.run.smithi044.stderr: 86600K .......... .......... .......... .......... .......... 93% 229M 0s 2024-09-12T17:49:15.340 INFO:teuthology.orchestra.run.smithi044.stderr: 86650K .......... .......... .......... .......... .......... 93% 184M 0s 2024-09-12T17:49:15.340 INFO:teuthology.orchestra.run.smithi044.stderr: 86700K .......... .......... .......... .......... .......... 93% 215M 0s 2024-09-12T17:49:15.340 INFO:teuthology.orchestra.run.smithi044.stderr: 86750K .......... .......... .......... .......... .......... 93% 198M 0s 2024-09-12T17:49:15.340 INFO:teuthology.orchestra.run.smithi044.stderr: 86800K .......... .......... .......... .......... .......... 93% 229M 0s 2024-09-12T17:49:15.340 INFO:teuthology.orchestra.run.smithi044.stderr: 86850K .......... .......... .......... .......... .......... 93% 199M 0s 2024-09-12T17:49:15.340 INFO:teuthology.orchestra.run.smithi044.stderr: 86900K .......... .......... .......... .......... .......... 93% 219M 0s 2024-09-12T17:49:15.340 INFO:teuthology.orchestra.run.smithi044.stderr: 86950K .......... .......... .......... .......... .......... 93% 193M 0s 2024-09-12T17:49:15.340 INFO:teuthology.orchestra.run.smithi044.stderr: 87000K .......... .......... .......... .......... .......... 93% 198M 0s 2024-09-12T17:49:15.341 INFO:teuthology.orchestra.run.smithi044.stderr: 87050K .......... .......... .......... .......... .......... 93% 170M 0s 2024-09-12T17:49:15.341 INFO:teuthology.orchestra.run.smithi044.stderr: 87100K .......... .......... .......... .......... .......... 93% 212M 0s 2024-09-12T17:49:15.341 INFO:teuthology.orchestra.run.smithi044.stderr: 87150K .......... .......... .......... .......... .......... 93% 188M 0s 2024-09-12T17:49:15.341 INFO:teuthology.orchestra.run.smithi044.stderr: 87200K .......... .......... .......... .......... .......... 93% 220M 0s 2024-09-12T17:49:15.341 INFO:teuthology.orchestra.run.smithi044.stderr: 87250K .......... .......... .......... .......... .......... 93% 203M 0s 2024-09-12T17:49:15.341 INFO:teuthology.orchestra.run.smithi044.stderr: 87300K .......... .......... .......... .......... .......... 94% 218M 0s 2024-09-12T17:49:15.341 INFO:teuthology.orchestra.run.smithi044.stderr: 87350K .......... .......... .......... .......... .......... 94% 211M 0s 2024-09-12T17:49:15.341 INFO:teuthology.orchestra.run.smithi044.stderr: 87400K .......... .......... .......... .......... .......... 94% 220M 0s 2024-09-12T17:49:15.341 INFO:teuthology.orchestra.run.smithi044.stderr: 87450K .......... .......... .......... .......... .......... 94% 193M 0s 2024-09-12T17:49:15.341 INFO:teuthology.orchestra.run.smithi044.stderr: 87500K .......... .......... .......... .......... .......... 94% 220M 0s 2024-09-12T17:49:15.341 INFO:teuthology.orchestra.run.smithi044.stderr: 87550K .......... .......... .......... .......... .......... 94% 178M 0s 2024-09-12T17:49:15.342 INFO:teuthology.orchestra.run.smithi044.stderr: 87600K .......... .......... .......... .......... .......... 94% 221M 0s 2024-09-12T17:49:15.342 INFO:teuthology.orchestra.run.smithi044.stderr: 87650K .......... .......... .......... .......... .......... 94% 214M 0s 2024-09-12T17:49:15.342 INFO:teuthology.orchestra.run.smithi044.stderr: 87700K .......... .......... .......... .......... .......... 94% 223M 0s 2024-09-12T17:49:15.342 INFO:teuthology.orchestra.run.smithi044.stderr: 87750K .......... .......... .......... .......... .......... 94% 197M 0s 2024-09-12T17:49:15.342 INFO:teuthology.orchestra.run.smithi044.stderr: 87800K .......... .......... .......... .......... .......... 94% 210M 0s 2024-09-12T17:49:15.342 INFO:teuthology.orchestra.run.smithi044.stderr: 87850K .......... .......... .......... .......... .......... 94% 231M 0s 2024-09-12T17:49:15.342 INFO:teuthology.orchestra.run.smithi044.stderr: 87900K .......... .......... .......... .......... .......... 94% 227M 0s 2024-09-12T17:49:15.342 INFO:teuthology.orchestra.run.smithi044.stderr: 87950K .......... .......... .......... .......... .......... 94% 175M 0s 2024-09-12T17:49:15.342 INFO:teuthology.orchestra.run.smithi044.stderr: 88000K .......... .......... .......... .......... .......... 94% 219M 0s 2024-09-12T17:49:15.342 INFO:teuthology.orchestra.run.smithi044.stderr: 88050K .......... .......... .......... .......... .......... 94% 221M 0s 2024-09-12T17:49:15.343 INFO:teuthology.orchestra.run.smithi044.stderr: 88100K .......... .......... .......... .......... .......... 94% 212M 0s 2024-09-12T17:49:15.343 INFO:teuthology.orchestra.run.smithi044.stderr: 88150K .......... .......... .......... .......... .......... 94% 207M 0s 2024-09-12T17:49:15.343 INFO:teuthology.orchestra.run.smithi044.stderr: 88200K .......... .......... .......... .......... .......... 94% 185M 0s 2024-09-12T17:49:15.343 INFO:teuthology.orchestra.run.smithi044.stderr: 88250K .......... .......... .......... .......... .......... 95% 174M 0s 2024-09-12T17:49:15.343 INFO:teuthology.orchestra.run.smithi044.stderr: 88300K .......... .......... .......... .......... .......... 95% 196M 0s 2024-09-12T17:49:15.343 INFO:teuthology.orchestra.run.smithi044.stderr: 88350K .......... .......... .......... .......... .......... 95% 157M 0s 2024-09-12T17:49:15.343 INFO:teuthology.orchestra.run.smithi044.stderr: 88400K .......... .......... .......... .......... .......... 95% 190M 0s 2024-09-12T17:49:15.343 INFO:teuthology.orchestra.run.smithi044.stderr: 88450K .......... .......... .......... .......... .......... 95% 207M 0s 2024-09-12T17:49:15.343 INFO:teuthology.orchestra.run.smithi044.stderr: 88500K .......... .......... .......... .......... .......... 95% 223M 0s 2024-09-12T17:49:15.343 INFO:teuthology.orchestra.run.smithi044.stderr: 88550K .......... .......... .......... .......... .......... 95% 207M 0s 2024-09-12T17:49:15.343 INFO:teuthology.orchestra.run.smithi044.stderr: 88600K .......... .......... .......... .......... .......... 95% 213M 0s 2024-09-12T17:49:15.344 INFO:teuthology.orchestra.run.smithi044.stderr: 88650K .......... .......... .......... .......... .......... 95% 225M 0s 2024-09-12T17:49:15.344 INFO:teuthology.orchestra.run.smithi044.stderr: 88700K .......... .......... .......... .......... .......... 95% 230M 0s 2024-09-12T17:49:15.344 INFO:teuthology.orchestra.run.smithi044.stderr: 88750K .......... .......... .......... .......... .......... 95% 186M 0s 2024-09-12T17:49:15.344 INFO:teuthology.orchestra.run.smithi044.stderr: 88800K .......... .......... .......... .......... .......... 95% 227M 0s 2024-09-12T17:49:15.344 INFO:teuthology.orchestra.run.smithi044.stderr: 88850K .......... .......... .......... .......... .......... 95% 342M 0s 2024-09-12T17:49:15.344 INFO:teuthology.orchestra.run.smithi044.stderr: 88900K .......... .......... .......... .......... .......... 95% 357M 0s 2024-09-12T17:49:15.344 INFO:teuthology.orchestra.run.smithi044.stderr: 88950K .......... .......... .......... .......... .......... 95% 320M 0s 2024-09-12T17:49:15.344 INFO:teuthology.orchestra.run.smithi044.stderr: 89000K .......... .......... .......... .......... .......... 95% 363M 0s 2024-09-12T17:49:15.344 INFO:teuthology.orchestra.run.smithi044.stderr: 89050K .......... .......... .......... .......... .......... 95% 362M 0s 2024-09-12T17:49:15.344 INFO:teuthology.orchestra.run.smithi044.stderr: 89100K .......... .......... .......... .......... .......... 95% 361M 0s 2024-09-12T17:49:15.344 INFO:teuthology.orchestra.run.smithi044.stderr: 89150K .......... .......... .......... .......... .......... 96% 285M 0s 2024-09-12T17:49:15.345 INFO:teuthology.orchestra.run.smithi044.stderr: 89200K .......... .......... .......... .......... .......... 96% 350M 0s 2024-09-12T17:49:15.345 INFO:teuthology.orchestra.run.smithi044.stderr: 89250K .......... .......... .......... .......... .......... 96% 354M 0s 2024-09-12T17:49:15.345 INFO:teuthology.orchestra.run.smithi044.stderr: 89300K .......... .......... .......... .......... .......... 96% 358M 0s 2024-09-12T17:49:15.345 INFO:teuthology.orchestra.run.smithi044.stderr: 89350K .......... .......... .......... .......... .......... 96% 316M 0s 2024-09-12T17:49:15.345 INFO:teuthology.orchestra.run.smithi044.stderr: 89400K .......... .......... .......... .......... .......... 96% 359M 0s 2024-09-12T17:49:15.345 INFO:teuthology.orchestra.run.smithi044.stderr: 89450K .......... .......... .......... .......... .......... 96% 323M 0s 2024-09-12T17:49:15.345 INFO:teuthology.orchestra.run.smithi044.stderr: 89500K .......... .......... .......... .......... .......... 96% 337M 0s 2024-09-12T17:49:15.345 INFO:teuthology.orchestra.run.smithi044.stderr: 89550K .......... .......... .......... .......... .......... 96% 308M 0s 2024-09-12T17:49:15.345 INFO:teuthology.orchestra.run.smithi044.stderr: 89600K .......... .......... .......... .......... .......... 96% 343M 0s 2024-09-12T17:49:15.345 INFO:teuthology.orchestra.run.smithi044.stderr: 89650K .......... .......... .......... .......... .......... 96% 349M 0s 2024-09-12T17:49:15.345 INFO:teuthology.orchestra.run.smithi044.stderr: 89700K .......... .......... .......... .......... .......... 96% 349M 0s 2024-09-12T17:49:15.346 INFO:teuthology.orchestra.run.smithi044.stderr: 89750K .......... .......... .......... .......... .......... 96% 309M 0s 2024-09-12T17:49:15.346 INFO:teuthology.orchestra.run.smithi044.stderr: 89800K .......... .......... .......... .......... .......... 96% 337M 0s 2024-09-12T17:49:15.346 INFO:teuthology.orchestra.run.smithi044.stderr: 89850K .......... .......... .......... .......... .......... 96% 311M 0s 2024-09-12T17:49:15.346 INFO:teuthology.orchestra.run.smithi044.stderr: 89900K .......... .......... .......... .......... .......... 96% 353M 0s 2024-09-12T17:49:15.346 INFO:teuthology.orchestra.run.smithi044.stderr: 89950K .......... .......... .......... .......... .......... 96% 293M 0s 2024-09-12T17:49:15.346 INFO:teuthology.orchestra.run.smithi044.stderr: 90000K .......... .......... .......... .......... .......... 96% 364M 0s 2024-09-12T17:49:15.346 INFO:teuthology.orchestra.run.smithi044.stderr: 90050K .......... .......... .......... .......... .......... 96% 330M 0s 2024-09-12T17:49:15.346 INFO:teuthology.orchestra.run.smithi044.stderr: 90100K .......... .......... .......... .......... .......... 97% 323M 0s 2024-09-12T17:49:15.346 INFO:teuthology.orchestra.run.smithi044.stderr: 90150K .......... .......... .......... .......... .......... 97% 334M 0s 2024-09-12T17:49:15.346 INFO:teuthology.orchestra.run.smithi044.stderr: 90200K .......... .......... .......... .......... .......... 97% 356M 0s 2024-09-12T17:49:15.346 INFO:teuthology.orchestra.run.smithi044.stderr: 90250K .......... .......... .......... .......... .......... 97% 335M 0s 2024-09-12T17:49:15.346 INFO:teuthology.orchestra.run.smithi044.stderr: 90300K .......... .......... .......... .......... .......... 97% 366M 0s 2024-09-12T17:49:15.347 INFO:teuthology.orchestra.run.smithi044.stderr: 90350K .......... .......... .......... .......... .......... 97% 303M 0s 2024-09-12T17:49:15.347 INFO:teuthology.orchestra.run.smithi044.stderr: 90400K .......... .......... .......... .......... .......... 97% 328M 0s 2024-09-12T17:49:15.347 INFO:teuthology.orchestra.run.smithi044.stderr: 90450K .......... .......... .......... .......... .......... 97% 352M 0s 2024-09-12T17:49:15.347 INFO:teuthology.orchestra.run.smithi044.stderr: 90500K .......... .......... .......... .......... .......... 97% 346M 0s 2024-09-12T17:49:15.347 INFO:teuthology.orchestra.run.smithi044.stderr: 90550K .......... .......... .......... .......... .......... 97% 332M 0s 2024-09-12T17:49:15.347 INFO:teuthology.orchestra.run.smithi044.stderr: 90600K .......... .......... .......... .......... .......... 97% 346M 0s 2024-09-12T17:49:15.347 INFO:teuthology.orchestra.run.smithi044.stderr: 90650K .......... .......... .......... .......... .......... 97% 363M 0s 2024-09-12T17:49:15.347 INFO:teuthology.orchestra.run.smithi044.stderr: 90700K .......... .......... .......... .......... .......... 97% 382M 0s 2024-09-12T17:49:15.347 INFO:teuthology.orchestra.run.smithi044.stderr: 90750K .......... .......... .......... .......... .......... 97% 301M 0s 2024-09-12T17:49:15.347 INFO:teuthology.orchestra.run.smithi044.stderr: 90800K .......... .......... .......... .......... .......... 97% 361M 0s 2024-09-12T17:49:15.347 INFO:teuthology.orchestra.run.smithi044.stderr: 90850K .......... .......... .......... .......... .......... 97% 181M 0s 2024-09-12T17:49:15.348 INFO:teuthology.orchestra.run.smithi044.stderr: 90900K .......... .......... .......... .......... .......... 97% 327M 0s 2024-09-12T17:49:15.348 INFO:teuthology.orchestra.run.smithi044.stderr: 90950K .......... .......... .......... .......... .......... 97% 282M 0s 2024-09-12T17:49:15.348 INFO:teuthology.orchestra.run.smithi044.stderr: 91000K .......... .......... .......... .......... .......... 98% 375M 0s 2024-09-12T17:49:15.348 INFO:teuthology.orchestra.run.smithi044.stderr: 91050K .......... .......... .......... .......... .......... 98% 259M 0s 2024-09-12T17:49:15.348 INFO:teuthology.orchestra.run.smithi044.stderr: 91100K .......... .......... .......... .......... .......... 98% 103M 0s 2024-09-12T17:49:15.348 INFO:teuthology.orchestra.run.smithi044.stderr: 91150K .......... .......... .......... .......... .......... 98% 283M 0s 2024-09-12T17:49:15.348 INFO:teuthology.orchestra.run.smithi044.stderr: 91200K .......... .......... .......... .......... .......... 98% 154M 0s 2024-09-12T17:49:15.348 INFO:teuthology.orchestra.run.smithi044.stderr: 91250K .......... .......... .......... .......... .......... 98% 161M 0s 2024-09-12T17:49:15.348 INFO:teuthology.orchestra.run.smithi044.stderr: 91300K .......... .......... .......... .......... .......... 98% 283M 0s 2024-09-12T17:49:15.348 INFO:teuthology.orchestra.run.smithi044.stderr: 91350K .......... .......... .......... .......... .......... 98% 261M 0s 2024-09-12T17:49:15.348 INFO:teuthology.orchestra.run.smithi044.stderr: 91400K .......... .......... .......... .......... .......... 98% 94.7M 0s 2024-09-12T17:49:15.348 INFO:teuthology.orchestra.run.smithi044.stderr: 91450K .......... .......... .......... .......... .......... 98% 336M 0s 2024-09-12T17:49:15.349 INFO:teuthology.orchestra.run.smithi044.stderr: 91500K .......... .......... .......... .......... .......... 98% 333M 0s 2024-09-12T17:49:15.349 INFO:teuthology.orchestra.run.smithi044.stderr: 91550K .......... .......... .......... .......... .......... 98% 282M 0s 2024-09-12T17:49:15.349 INFO:teuthology.orchestra.run.smithi044.stderr: 91600K .......... .......... .......... .......... .......... 98% 130M 0s 2024-09-12T17:49:15.349 INFO:teuthology.orchestra.run.smithi044.stderr: 91650K .......... .......... .......... .......... .......... 98% 326M 0s 2024-09-12T17:49:15.349 INFO:teuthology.orchestra.run.smithi044.stderr: 91700K .......... .......... .......... .......... .......... 98% 366M 0s 2024-09-12T17:49:15.349 INFO:teuthology.orchestra.run.smithi044.stderr: 91750K .......... .......... .......... .......... .......... 98% 163M 0s 2024-09-12T17:49:15.349 INFO:teuthology.orchestra.run.smithi044.stderr: 91800K .......... .......... .......... .......... .......... 98% 326M 0s 2024-09-12T17:49:15.349 INFO:teuthology.orchestra.run.smithi044.stderr: 91850K .......... .......... .......... .......... .......... 98% 155M 0s 2024-09-12T17:49:15.349 INFO:teuthology.orchestra.run.smithi044.stderr: 91900K .......... .......... .......... .......... .......... 98% 380M 0s 2024-09-12T17:49:15.349 INFO:teuthology.orchestra.run.smithi044.stderr: 91950K .......... .......... .......... .......... .......... 99% 143M 0s 2024-09-12T17:49:15.349 INFO:teuthology.orchestra.run.smithi044.stderr: 92000K .......... .......... .......... .......... .......... 99% 172M 0s 2024-09-12T17:49:15.349 INFO:teuthology.orchestra.run.smithi044.stderr: 92050K .......... .......... .......... .......... .......... 99% 352M 0s 2024-09-12T17:49:15.350 INFO:teuthology.orchestra.run.smithi044.stderr: 92100K .......... .......... .......... .......... .......... 99% 364M 0s 2024-09-12T17:49:15.350 INFO:teuthology.orchestra.run.smithi044.stderr: 92150K .......... .......... .......... .......... .......... 99% 341M 0s 2024-09-12T17:49:15.350 INFO:teuthology.orchestra.run.smithi044.stderr: 92200K .......... .......... .......... .......... .......... 99% 344M 0s 2024-09-12T17:49:15.350 INFO:teuthology.orchestra.run.smithi044.stderr: 92250K .......... .......... .......... .......... .......... 99% 371M 0s 2024-09-12T17:49:15.350 INFO:teuthology.orchestra.run.smithi044.stderr: 92300K .......... .......... .......... .......... .......... 99% 83.5M 0s 2024-09-12T17:49:15.350 INFO:teuthology.orchestra.run.smithi044.stderr: 92350K .......... .......... .......... .......... .......... 99% 385M 0s 2024-09-12T17:49:15.350 INFO:teuthology.orchestra.run.smithi044.stderr: 92400K .......... .......... .......... .......... .......... 99% 312M 0s 2024-09-12T17:49:15.350 INFO:teuthology.orchestra.run.smithi044.stderr: 92450K .......... .......... .......... .......... .......... 99% 363M 0s 2024-09-12T17:49:15.350 INFO:teuthology.orchestra.run.smithi044.stderr: 92500K .......... .......... .......... .......... .......... 99% 357M 0s 2024-09-12T17:49:15.350 INFO:teuthology.orchestra.run.smithi044.stderr: 92550K .......... .......... .......... .......... .......... 99% 383M 0s 2024-09-12T17:49:15.350 INFO:teuthology.orchestra.run.smithi044.stderr: 92600K .......... .......... .......... .......... .......... 99% 358M 0s 2024-09-12T17:49:15.350 INFO:teuthology.orchestra.run.smithi044.stderr: 92650K .......... .......... .......... .......... .......... 99% 375M 0s 2024-09-12T17:49:15.351 INFO:teuthology.orchestra.run.smithi044.stderr: 92700K .......... .......... .......... .......... .......... 99% 371M 0s 2024-09-12T17:49:15.351 INFO:teuthology.orchestra.run.smithi044.stderr: 92750K .......... .......... .......... .......... .......... 99% 388M 0s 2024-09-12T17:49:15.351 INFO:teuthology.orchestra.run.smithi044.stderr: 92800K .......... .......... .......... .......... .......... 99% 317M 0s 2024-09-12T17:49:15.351 INFO:teuthology.orchestra.run.smithi044.stderr: 92850K .......... .......... .......... .......... .......... 99% 392M 0s 2024-09-12T17:49:15.351 INFO:teuthology.orchestra.run.smithi044.stderr: 92900K 100% 134G=0.5s 2024-09-12T17:49:15.351 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T17:49:15.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12 17:49:13 (202 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-12T17:49:15.351 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T17:49:15.395 INFO:teuthology.orchestra.run.smithi044.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T17:49:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T17:49:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T17:49:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T17:49:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T17:49:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T17:49:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T17:49:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T17:49:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T17:49:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T17:49:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T17:49:15.396 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T17:49:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T17:49:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T17:49:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T17:49:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T17:49:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T17:49:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T17:49:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T17:49:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T17:49:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T17:49:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T17:49:15.397 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T17:49:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T17:49:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T17:49:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T17:49:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T17:49:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T17:49:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T17:49:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T17:49:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T17:49:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T17:49:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T17:49:15.398 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T17:49:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T17:49:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T17:49:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T17:49:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T17:49:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T17:49:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T17:49:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T17:49:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T17:49:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T17:49:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T17:49:15.399 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T17:49:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T17:49:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T17:49:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T17:49:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T17:49:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:49:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T17:49:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T17:49:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T17:49:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T17:49:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T17:49:15.400 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T17:49:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T17:49:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T17:49:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T17:49:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T17:49:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T17:49:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T17:49:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T17:49:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T17:49:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T17:49:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T17:49:15.401 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T17:49:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T17:49:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T17:49:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T17:49:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T17:49:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T17:49:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T17:49:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T17:49:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T17:49:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T17:49:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T17:49:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T17:49:15.402 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T17:49:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T17:49:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T17:49:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T17:49:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T17:49:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T17:49:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T17:49:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T17:49:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T17:49:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T17:49:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T17:49:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T17:49:15.403 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T17:49:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T17:49:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T17:49:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T17:49:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T17:49:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T17:49:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T17:49:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T17:49:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T17:49:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T17:49:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T17:49:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T17:49:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T17:49:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T17:49:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T17:49:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T17:49:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T17:49:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T17:49:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T17:49:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T17:49:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T17:49:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T17:49:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T17:49:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T17:49:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T17:49:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T17:49:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T17:49:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T17:49:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T17:49:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T17:49:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T17:49:15.406 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T17:49:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T17:49:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T17:49:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T17:49:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T17:49:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T17:49:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T17:49:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T17:49:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T17:49:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T17:49:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T17:49:15.407 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T17:49:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T17:49:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T17:49:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T17:49:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T17:49:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T17:49:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T17:49:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T17:49:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T17:49:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T17:49:15.408 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T17:49:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T17:49:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T17:49:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T17:49:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T17:49:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T17:49:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T17:49:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T17:49:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T17:49:15.409 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T17:49:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T17:49:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T17:49:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T17:49:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T17:49:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T17:49:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T17:49:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T17:49:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T17:49:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T17:49:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T17:49:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T17:49:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T17:49:15.410 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T17:49:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T17:49:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T17:49:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T17:49:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T17:49:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T17:49:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T17:49:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T17:49:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T17:49:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T17:49:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T17:49:15.411 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T17:49:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T17:49:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T17:49:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T17:49:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T17:49:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T17:49:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T17:49:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T17:49:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T17:49:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T17:49:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T17:49:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T17:49:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T17:49:15.412 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T17:49:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T17:49:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T17:49:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T17:49:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T17:49:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T17:49:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T17:49:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T17:49:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T17:49:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T17:49:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T17:49:15.413 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T17:49:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T17:49:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T17:49:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T17:49:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T17:49:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T17:49:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T17:49:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T17:49:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T17:49:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T17:49:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T17:49:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T17:49:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T17:49:15.414 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T17:49:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T17:49:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T17:49:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T17:49:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T17:49:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T17:49:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T17:49:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T17:49:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T17:49:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T17:49:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T17:49:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T17:49:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T17:49:15.415 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T17:49:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T17:49:15.416 INFO:teuthology.orchestra.run.smithi044.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-12T17:49:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:15.416 INFO:teuthology.orchestra.run.smithi044.stdout:Welcome to Gradle 6.0.1! 2024-09-12T17:49:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:15.416 INFO:teuthology.orchestra.run.smithi044.stdout:Here are the highlights of this release: 2024-09-12T17:49:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: - Substantial improvements in dependency management, including 2024-09-12T17:49:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T17:49:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: - Advanced control of transitive versions 2024-09-12T17:49:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: - Support for optional features and dependencies 2024-09-12T17:49:15.416 INFO:teuthology.orchestra.run.smithi044.stdout: - Rules to tweak published metadata 2024-09-12T17:49:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: - Support for Java 13 2024-09-12T17:49:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T17:49:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: - New Zinc compiler for Scala 2024-09-12T17:49:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: - VS2019 support 2024-09-12T17:49:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T17:49:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:15.417 INFO:teuthology.orchestra.run.smithi044.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T17:49:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:15.417 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:15.417 INFO:teuthology.orchestra.run.smithi044.stdout:------------------------------------------------------------ 2024-09-12T17:49:15.417 INFO:teuthology.orchestra.run.smithi044.stdout:Gradle 6.0.1 2024-09-12T17:49:15.417 INFO:teuthology.orchestra.run.smithi044.stdout:------------------------------------------------------------ 2024-09-12T17:49:15.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:15.418 INFO:teuthology.orchestra.run.smithi044.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T17:49:15.418 INFO:teuthology.orchestra.run.smithi044.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T17:49:15.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:15.418 INFO:teuthology.orchestra.run.smithi044.stdout:Kotlin: 1.3.50 2024-09-12T17:49:15.418 INFO:teuthology.orchestra.run.smithi044.stdout:Groovy: 2.5.8 2024-09-12T17:49:15.418 INFO:teuthology.orchestra.run.smithi044.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T17:49:15.418 INFO:teuthology.orchestra.run.smithi044.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-12T17:49:15.418 INFO:teuthology.orchestra.run.smithi044.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-12T17:49:15.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:15.419 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T17:49:15.419 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T17:49:15.419 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi044.front.sepia.ceph.com 2024-09-12T17:49:15.419 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T17:49:15.419 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T17:49:15.419 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T17:49:15.639 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T17:49:15.639 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T17:49:15.639 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'UJCCIXRVKGAPYZVXAOIA', 'access_secret': 'o2EKQoC0E/q7tSDuOSNCDDb8S0Fcd9GuBlhPBgh7Bzg1f1Y/idxBvw==', 'region': 'mexico', 'endpoint': 'smithi044.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi044.front.sepia.ceph.com'} 2024-09-12T17:49:15.639 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T17:49:15.639 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'UJCCIXRVKGAPYZVXAOIA', '--secret', 'o2EKQoC0E/q7tSDuOSNCDDb8S0Fcd9GuBlhPBgh7Bzg1f1Y/idxBvw==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T17:49:15.640 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key UJCCIXRVKGAPYZVXAOIA --secret o2EKQoC0E/q7tSDuOSNCDDb8S0Fcd9GuBlhPBgh7Bzg1f1Y/idxBvw== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T17:49:15.707 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:15.707 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:15.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.741+0000 7fc3bb922800 20 rados->read ofs=0 len=0 2024-09-12T17:49:15.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.742+0000 7fc3bb922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:15.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.742+0000 7fc3bb922800 20 realm 2024-09-12T17:49:15.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.742+0000 7fc3bb922800 20 rados->read ofs=0 len=0 2024-09-12T17:49:15.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.742+0000 7fc3bb922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:15.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.742+0000 7fc3bb922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:15.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.742+0000 7fc3bb922800 20 rados->read ofs=0 len=0 2024-09-12T17:49:15.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.743+0000 7fc3bb922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.743+0000 7fc3bb922800 20 rados->read ofs=0 len=0 2024-09-12T17:49:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.744+0000 7fc3bb922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.744+0000 7fc3bb922800 20 rados->read ofs=0 len=0 2024-09-12T17:49:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.744+0000 7fc3bb922800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:15.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.744+0000 7fc3bb922800 20 searching for the correct realm 2024-09-12T17:49:15.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.748+0000 7fc3b6d01640 0 -- 172.21.15.44:0/2411301232 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55bee7d76e10 msgr2=0x55bee7d792d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:15.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.752+0000 7fc3b7502640 0 -- 172.21.15.44:0/2411301232 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fc3ac00a430 msgr2=0x7fc3ac00a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.756+0000 7fc3bb922800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:49:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.756+0000 7fc3bb922800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:49:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.756+0000 7fc3bb922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.756+0000 7fc3bb922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.756+0000 7fc3bb922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.756+0000 7fc3bb922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.756+0000 7fc3bb922800 20 rados->read ofs=0 len=0 2024-09-12T17:49:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.756+0000 7fc3bb922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.756+0000 7fc3bb922800 20 rados->read ofs=0 len=0 2024-09-12T17:49:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.757+0000 7fc3bb922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.757+0000 7fc3bb922800 20 rados->read ofs=0 len=0 2024-09-12T17:49:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.757+0000 7fc3bb922800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.757+0000 7fc3bb922800 20 zone default found 2024-09-12T17:49:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.757+0000 7fc3bb922800 4 Realm: () 2024-09-12T17:49:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.757+0000 7fc3bb922800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:49:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.757+0000 7fc3bb922800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:49:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.757+0000 7fc3bb922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.757+0000 7fc3bb922800 20 zonegroup default 2024-09-12T17:49:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.757+0000 7fc3bb922800 20 rados->read ofs=0 len=0 2024-09-12T17:49:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.757+0000 7fc3bb922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.757+0000 7fc3bb922800 20 rados->read ofs=0 len=0 2024-09-12T17:49:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.758+0000 7fc3bb922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.758+0000 7fc3bb922800 20 rados->read ofs=0 len=0 2024-09-12T17:49:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.758+0000 7fc3bb922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.758+0000 7fc3bb922800 20 started sync module instance, tier type = 2024-09-12T17:49:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.758+0000 7fc3bb922800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:49:15.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.768+0000 7fc3bb922800 20 add_watcher() i=0 2024-09-12T17:49:15.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.768+0000 7fc3bb922800 20 add_watcher() i=1 2024-09-12T17:49:15.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.768+0000 7fc3bb922800 20 add_watcher() i=2 2024-09-12T17:49:15.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.768+0000 7fc3bb922800 20 add_watcher() i=3 2024-09-12T17:49:15.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.768+0000 7fc3bb922800 20 add_watcher() i=4 2024-09-12T17:49:15.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.768+0000 7fc3bb922800 20 add_watcher() i=5 2024-09-12T17:49:15.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.769+0000 7fc3bb922800 20 add_watcher() i=6 2024-09-12T17:49:15.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.769+0000 7fc3bb922800 20 add_watcher() i=7 2024-09-12T17:49:15.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.769+0000 7fc3bb922800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:15.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.771+0000 7fc26dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:15.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.772+0000 7fc3bb922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:15.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.772+0000 7fc3bb922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:15.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.772+0000 7fc3bb922800 5 note: GC not initialized 2024-09-12T17:49:15.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.772+0000 7fc26cfe1640 20 reqs_thread_entry: start 2024-09-12T17:49:15.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.772+0000 7fc3bb922800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:15.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.772+0000 7fc3bb922800 20 Filter name: none 2024-09-12T17:49:15.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.772+0000 7fc1e67fc640 20 reqs_thread_entry: start 2024-09-12T17:49:15.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.772+0000 7fc3bb922800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T17:49:15.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.772+0000 7fc3bb922800 20 rados->read ofs=0 len=0 2024-09-12T17:49:15.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.773+0000 7fc3bb922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:15.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.773+0000 7fc3bb922800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T17:49:15.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.773+0000 7fc3bb922800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:49:15.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.773+0000 7fc3bb922800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T17:49:15.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.773+0000 7fc3bb922800 20 rados->read ofs=0 len=0 2024-09-12T17:49:15.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.773+0000 7fc3bb922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:15.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.773+0000 7fc3bb922800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T17:49:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.773+0000 7fc3bb922800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:49:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.773+0000 7fc3bb922800 10 cache get: name=default.rgw.meta+users.keys+UJCCIXRVKGAPYZVXAOIA : miss 2024-09-12T17:49:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.773+0000 7fc3bb922800 20 rados->read ofs=0 len=0 2024-09-12T17:49:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.773+0000 7fc3bb922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.773+0000 7fc3bb922800 10 cache put: name=default.rgw.meta+users.keys+UJCCIXRVKGAPYZVXAOIA info.flags=0x0 2024-09-12T17:49:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.773+0000 7fc3bb922800 10 adding default.rgw.meta+users.keys+UJCCIXRVKGAPYZVXAOIA to cache LRU end 2024-09-12T17:49:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.773+0000 7fc3bb922800 10 cache get: name=default.rgw.meta+users.keys+UJCCIXRVKGAPYZVXAOIA : hit (negative entry) 2024-09-12T17:49:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.773+0000 7fc3bb922800 10 cache get: name=default.rgw.meta+users.keys+UJCCIXRVKGAPYZVXAOIA : hit (negative entry) 2024-09-12T17:49:15.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.775+0000 7fc3bb922800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T17:49:15.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.775+0000 7fc3bb922800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:49:15.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.775+0000 7fc3bb922800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T17:49:15.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.775+0000 7fc29affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562454 cookie 94278421830816 notifier 8270 bl.length()=670 2024-09-12T17:49:15.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.775+0000 7fc29affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T17:49:15.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.775+0000 7fc29affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:49:15.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.776+0000 7fc3bb922800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T17:49:15.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.776+0000 7fc3bb922800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:49:15.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.776+0000 7fc3bb922800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T17:49:15.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.777+0000 7fc29a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562444 cookie 94278421821072 notifier 8270 bl.length()=200 2024-09-12T17:49:15.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.777+0000 7fc29a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T17:49:15.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.777+0000 7fc29a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:49:15.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.778+0000 7fc3bb922800 10 cache put: name=default.rgw.meta+users.keys+UJCCIXRVKGAPYZVXAOIA info.flags=0x7 2024-09-12T17:49:15.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.778+0000 7fc3bb922800 10 moving default.rgw.meta+users.keys+UJCCIXRVKGAPYZVXAOIA to cache LRU end 2024-09-12T17:49:15.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.778+0000 7fc3bb922800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:UJCCIXRVKGAPYZVXAOIA, ofs0, ns] 2024-09-12T17:49:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.779+0000 7fc29affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562473 cookie 94278421807328 notifier 8270 bl.length()=189 2024-09-12T17:49:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.779+0000 7fc29affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+UJCCIXRVKGAPYZVXAOIA info.flags=0x7 2024-09-12T17:49:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.779+0000 7fc29affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+UJCCIXRVKGAPYZVXAOIA to cache LRU end 2024-09-12T17:49:15.782 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T17:49:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "tester.client.0", 2024-09-12T17:49:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T17:49:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T17:49:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2024-09-12T17:49:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2024-09-12T17:49:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2024-09-12T17:49:15.782 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2024-09-12T17:49:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-12T17:49:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "tester.client.0", 2024-09-12T17:49:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "UJCCIXRVKGAPYZVXAOIA", 2024-09-12T17:49:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "o2EKQoC0E/q7tSDuOSNCDDb8S0Fcd9GuBlhPBgh7Bzg1f1Y/idxBvw==", 2024-09-12T17:49:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: "active": true, 2024-09-12T17:49:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:49:15.775129Z" 2024-09-12T17:49:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T17:49:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-12T17:49:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2024-09-12T17:49:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [], 2024-09-12T17:49:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2024-09-12T17:49:15.783 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2024-09-12T17:49:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2024-09-12T17:49:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2024-09-12T17:49:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2024-09-12T17:49:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:49:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:49:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:49:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:49:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:49:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:49:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2024-09-12T17:49:15.784 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:49:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:49:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:49:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:49:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:49:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:49:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2024-09-12T17:49:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "rgw", 2024-09-12T17:49:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [], 2024-09-12T17:49:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: "account_id": "", 2024-09-12T17:49:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-12T17:49:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:49:15.775119Z", 2024-09-12T17:49:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-09-12T17:49:15.785 INFO:teuthology.orchestra.run.smithi044.stdout: "group_ids": [] 2024-09-12T17:49:15.786 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T17:49:15.786 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:15.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.780+0000 7fc26dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:15.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.783+0000 7fc3bb922800 20 remove_watcher() i=0 2024-09-12T17:49:15.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.783+0000 7fc3bb922800 2 removed watcher, disabling cache 2024-09-12T17:49:15.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.784+0000 7fc3bb922800 20 remove_watcher() i=1 2024-09-12T17:49:15.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.785+0000 7fc3bb922800 20 remove_watcher() i=2 2024-09-12T17:49:15.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.786+0000 7fc3bb922800 20 remove_watcher() i=3 2024-09-12T17:49:15.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.787+0000 7fc3bb922800 20 remove_watcher() i=4 2024-09-12T17:49:15.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.788+0000 7fc3bb922800 20 remove_watcher() i=5 2024-09-12T17:49:15.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.789+0000 7fc3bb922800 20 remove_watcher() i=6 2024-09-12T17:49:15.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:15.790+0000 7fc3bb922800 20 remove_watcher() i=7 2024-09-12T17:49:15.806 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:49:15.806 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T17:49:15.839 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T17:49:15.839 DEBUG:teuthology.orchestra.run.smithi044:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T17:49:15.906 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2024-09-12T17:49:16.000 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:16.000 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:16.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.038+0000 7f2f88f46800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.039+0000 7f2f88f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.039+0000 7f2f88f46800 20 realm 2024-09-12T17:49:16.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.039+0000 7f2f88f46800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.040+0000 7f2f88f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.040+0000 7f2f88f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:16.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.040+0000 7f2f88f46800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.040+0000 7f2f88f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.040+0000 7f2f88f46800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.041+0000 7f2f88f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:16.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.041+0000 7f2f88f46800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.041+0000 7f2f88f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:16.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.041+0000 7f2f88f46800 20 searching for the correct realm 2024-09-12T17:49:16.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.045+0000 7f2f87231640 0 -- 172.21.15.44:0/2840879121 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x55b90933ceb0 msgr2=0x55b90933f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:16.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.048+0000 7f2f86a30640 0 -- 172.21.15.44:0/2840879121 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f2f7c09c450 msgr2=0x7f2f7c09c8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:16.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.053+0000 7f2f88f46800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:49:16.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.053+0000 7f2f88f46800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:49:16.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.053+0000 7f2f88f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:16.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.053+0000 7f2f88f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:16.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.053+0000 7f2f88f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:16.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.053+0000 7f2f88f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:16.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.053+0000 7f2f88f46800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.053+0000 7f2f88f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.053+0000 7f2f88f46800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.053+0000 7f2f88f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:16.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.053+0000 7f2f88f46800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.054+0000 7f2f88f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:16.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.054+0000 7f2f88f46800 20 zone default found 2024-09-12T17:49:16.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.054+0000 7f2f88f46800 4 Realm: () 2024-09-12T17:49:16.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.054+0000 7f2f88f46800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:49:16.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.054+0000 7f2f88f46800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:49:16.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.054+0000 7f2f88f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:16.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.054+0000 7f2f88f46800 20 zonegroup default 2024-09-12T17:49:16.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.054+0000 7f2f88f46800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.054+0000 7f2f88f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.054+0000 7f2f88f46800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.054+0000 7f2f88f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.054+0000 7f2f88f46800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.055+0000 7f2f88f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.055+0000 7f2f88f46800 20 started sync module instance, tier type = 2024-09-12T17:49:16.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.055+0000 7f2f88f46800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:49:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.064+0000 7f2f88f46800 20 add_watcher() i=0 2024-09-12T17:49:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.064+0000 7f2f88f46800 20 add_watcher() i=1 2024-09-12T17:49:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.064+0000 7f2f88f46800 20 add_watcher() i=2 2024-09-12T17:49:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.064+0000 7f2f88f46800 20 add_watcher() i=3 2024-09-12T17:49:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.064+0000 7f2f88f46800 20 add_watcher() i=4 2024-09-12T17:49:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.064+0000 7f2f88f46800 20 add_watcher() i=5 2024-09-12T17:49:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.064+0000 7f2f88f46800 20 add_watcher() i=6 2024-09-12T17:49:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.065+0000 7f2f88f46800 20 add_watcher() i=7 2024-09-12T17:49:16.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.065+0000 7f2f88f46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:16.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.066+0000 7f2e3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:16.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.067+0000 7f2f88f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:16.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.067+0000 7f2f88f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:16.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.102+0000 7f2db7fff640 20 reqs_thread_entry: start 2024-09-12T17:49:16.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.102+0000 7f2f88f46800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:16.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.102+0000 7f2f88f46800 20 Filter name: none 2024-09-12T17:49:16.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.102+0000 7f2db5ffb640 20 reqs_thread_entry: start 2024-09-12T17:49:16.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.102+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:49:16.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.104+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.104+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:49:16.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10051121817283563394', time=2024-09-12T19:40:36.868647+0000, chain.objs.size()=1 2024-09-12T17:49:16.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_.JrjTglM5Sdprzp2FZJxWTNr1l_3C_QL_0 2024-09-12T17:49:16.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15238521963579092362', time=2024-09-12T19:40:37.223811+0000, chain.objs.size()=1 2024-09-12T17:49:16.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8__shadow_.lmx345cWpG8j8K15TY738t8BLrw6WVL_0 2024-09-12T17:49:16.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8802627548243562040', time=2024-09-12T19:42:32.370813+0000, chain.objs.size()=1 2024-09-12T17:49:16.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.fbLQzfdMYeULuDY3yv1hXiecH1RoZU3_0 2024-09-12T17:49:16.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8445515785146502068', time=2024-09-12T19:42:32.376171+0000, chain.objs.size()=1 2024-09-12T17:49:16.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.pDBE0LMzXp1ZDlN4CoUHQ6GV1DXFRaK_0 2024-09-12T17:49:16.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2217065060232453303', time=2024-09-12T19:42:33.450105+0000, chain.objs.size()=1 2024-09-12T17:49:16.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.RGmKUlY83-nAXMz3KZ1EcHn7X0SxY_O_0 2024-09-12T17:49:16.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11666547660317649245', time=2024-09-12T19:43:05.817201+0000, chain.objs.size()=1 2024-09-12T17:49:16.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.58rw7Q34LuhSobNUgTRWX8c5ieTC0Yf_0 2024-09-12T17:49:16.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1284924069439327940', time=2024-09-12T19:43:07.618506+0000, chain.objs.size()=1 2024-09-12T17:49:16.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.QapJClpKKerCbqDrkfNzKObVlLs4J6R_0 2024-09-12T17:49:16.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8054855151490478494', time=2024-09-12T19:43:08.522674+0000, chain.objs.size()=1 2024-09-12T17:49:16.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.O_Nvd486jgiL2XU7I4imV9HNMn8pvlj_0 2024-09-12T17:49:16.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10415286845901396693', time=2024-09-12T19:43:09.365218+0000, chain.objs.size()=1 2024-09-12T17:49:16.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.aJsv93nhbW-RewyftjDKi2e1-dWmt8J_0 2024-09-12T17:49:16.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10596587954589189350', time=2024-09-12T19:43:40.291918+0000, chain.objs.size()=1 2024-09-12T17:49:16.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.6WDEQfr6VWDttwDbmNaab5-HUWnmU9t_0 2024-09-12T17:49:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3499258591435625495', time=2024-09-12T19:44:14.068760+0000, chain.objs.size()=1 2024-09-12T17:49:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.bujoDiZ8jeN429YpDA2qMuMvexhQgeN_0 2024-09-12T17:49:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6384918514174399351', time=2024-09-12T19:44:17.602031+0000, chain.objs.size()=1 2024-09-12T17:49:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.105+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.uh3s7BBCaKNiAVVBCfBDgAUa_qRAwar_0 2024-09-12T17:49:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.107+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.996975655131021306', time=2024-09-12T19:44:17.603207+0000, chain.objs.size()=1 2024-09-12T17:49:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.107+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.MI52VPvGqmtUFhPFDq2Ci7kanTsIHV2_0 2024-09-12T17:49:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.107+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6724161580988592098', time=2024-09-12T19:45:24.125074+0000, chain.objs.size()=1 2024-09-12T17:49:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.107+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.v1D24y8yOxa42hWZQ5QLfPfWgLDhGBs_0 2024-09-12T17:49:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.107+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12409059290850692129', time=2024-09-12T19:48:39.207817+0000, chain.objs.size()=1 2024-09-12T17:49:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.107+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18__shadow_.e00P1dY12359clDoxBMZ8x6WH3jww2M_0 2024-09-12T17:49:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.107+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7104820630719247414', time=2024-09-12T19:48:39.208926+0000, chain.objs.size()=1 2024-09-12T17:49:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.107+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18__shadow_.5fo_Y1SL_tqQ3d-POLRWwU5QRCLvOkU_0 2024-09-12T17:49:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.109+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.111+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:49:16.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.113+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.113+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T17:49:16.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15567176399301549800', time=2024-09-12T19:40:37.048539+0000, chain.objs.size()=1 2024-09-12T17:49:16.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.8gpeL8vs5sCpGXIKFTo4q5foDwE4EbW_0 2024-09-12T17:49:16.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56654444266832317', time=2024-09-12T19:40:37.137429+0000, chain.objs.size()=3 2024-09-12T17:49:16.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-STANDARD.2~s7az6GdIpdGaYGw1bGJjaGivdTrxNF3.1 2024-09-12T17:49:16.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-STANDARD.2~s7az6GdIpdGaYGw1bGJjaGivdTrxNF3.2 2024-09-12T17:49:16.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-STANDARD.2~s7az6GdIpdGaYGw1bGJjaGivdTrxNF3.3 2024-09-12T17:49:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10214965246242706661', time=2024-09-12T19:41:58.440548+0000, chain.objs.size()=1 2024-09-12T17:49:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.ZOQwYFV211Z2wVVDyu7QlaLXCO3p-Sr_0 2024-09-12T17:49:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18372761693101724058', time=2024-09-12T19:41:58.444536+0000, chain.objs.size()=1 2024-09-12T17:49:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.M_GacbGdgNVYL8KhmaJKJmbyOlrsEps_0 2024-09-12T17:49:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13087668008099952575', time=2024-09-12T19:42:32.371549+0000, chain.objs.size()=1 2024-09-12T17:49:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.20zaMMN5B2BHfI0BylnjgP4GmpW9ucm_0 2024-09-12T17:49:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11517247888264761235', time=2024-09-12T19:43:41.898156+0000, chain.objs.size()=1 2024-09-12T17:49:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.-qm-6o3DIENqfMYCLAEKVwaNX-hZIhr_0 2024-09-12T17:49:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15823504252427790476', time=2024-09-12T19:43:41.898892+0000, chain.objs.size()=1 2024-09-12T17:49:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.tvfLT6BvzQci2lHJrr4f8OyAgQ9KUgj_0 2024-09-12T17:49:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14111381102590194199', time=2024-09-12T19:44:51.131094+0000, chain.objs.size()=1 2024-09-12T17:49:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.AOZM6DkThcA_P-Ncj6skHIJhLnvehWi_0 2024-09-12T17:49:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15535451682199996083', time=2024-09-12T19:45:25.745762+0000, chain.objs.size()=1 2024-09-12T17:49:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.G9Tmk4x8LE1j5Y1-FTezm09OlR2wSiE_0 2024-09-12T17:49:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2164079732159830326', time=2024-09-12T19:45:57.910155+0000, chain.objs.size()=1 2024-09-12T17:49:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.114+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.WSJzZp18gZ06NQwES577eVkAWBNmj0R_0 2024-09-12T17:49:16.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.116+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.773249435883864144', time=2024-09-12T19:45:59.939032+0000, chain.objs.size()=1 2024-09-12T17:49:16.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.116+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.v25PGz0J9ZBloSqUyUGWTIvjkA136em_0 2024-09-12T17:49:16.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.116+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.194754629939041106', time=2024-09-12T19:46:32.781825+0000, chain.objs.size()=1 2024-09-12T17:49:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.116+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.68XEvPNw6lYA2OvMFXALz7Pn2q36dx4_0 2024-09-12T17:49:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.116+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8721978761436331104', time=2024-09-12T19:46:32.783903+0000, chain.objs.size()=1 2024-09-12T17:49:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.116+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.u8pP-BgxitBJUhDS44SukBWM3pimfIR_0 2024-09-12T17:49:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.116+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5346718089567284208', time=2024-09-12T19:46:32.788995+0000, chain.objs.size()=1 2024-09-12T17:49:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.116+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.P7Y9Ns8dO0Sq9XqzGIHGrj5N3gbQFmq_0 2024-09-12T17:49:16.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.117+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.119+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:49:16.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.120+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T17:49:16.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12247897905272458158', time=2024-09-12T19:41:57.167112+0000, chain.objs.size()=1 2024-09-12T17:49:16.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.IwR4g930gIk9aQX8ksJOCIwaDEVlrtI_0 2024-09-12T17:49:16.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16787249251469506879', time=2024-09-12T19:42:30.575291+0000, chain.objs.size()=1 2024-09-12T17:49:16.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.5P71w6KAqhhAIJZA7tITSQ_sXwDZCHx_0 2024-09-12T17:49:16.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16666517624257131174', time=2024-09-12T19:43:08.533268+0000, chain.objs.size()=1 2024-09-12T17:49:16.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.58guQ_5vo4Sn8SZOFgqaLY7rCh1bxSC_0 2024-09-12T17:49:16.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9502641330229396857', time=2024-09-12T19:43:40.284463+0000, chain.objs.size()=1 2024-09-12T17:49:16.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.2SHyrlA_Vwse7Agx1yAlc-fqIKUgmHj_0 2024-09-12T17:49:16.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2617260065467773196', time=2024-09-12T19:43:40.285145+0000, chain.objs.size()=1 2024-09-12T17:49:16.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.pGlmQM0X3rN0ZzQlHRQkT4OceHRL8_1_0 2024-09-12T17:49:16.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17351973760518726279', time=2024-09-12T19:43:41.900646+0000, chain.objs.size()=1 2024-09-12T17:49:16.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.OizFOqmX98ZIxEFjE_ZitQ_AaWUvLmI_0 2024-09-12T17:49:16.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8157856688541724953', time=2024-09-12T19:43:41.907417+0000, chain.objs.size()=1 2024-09-12T17:49:16.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.hMNR_731-xKPP0yCY276YpgkKu6B_TU_0 2024-09-12T17:49:16.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2483807281231186503', time=2024-09-12T19:44:16.315430+0000, chain.objs.size()=1 2024-09-12T17:49:16.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.WFBQdAtkhRn9IdEF30QLLhc_LHTEPtG_0 2024-09-12T17:49:16.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9284687315172698184', time=2024-09-12T19:44:17.608195+0000, chain.objs.size()=1 2024-09-12T17:49:16.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.4mXlb3fYqRP64syz-E2GpaFcxmF_2BU_0 2024-09-12T17:49:16.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1626331509617731162', time=2024-09-12T19:45:57.909138+0000, chain.objs.size()=1 2024-09-12T17:49:16.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.121+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.i3gdQXfsWfMcu6eJdrhmLkVvoF5NdMg_0 2024-09-12T17:49:16.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.123+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.126+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:49:16.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.127+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.128+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.128+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:49:16.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.128+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17988251956013575058', time=2024-09-12T19:40:36.892730+0000, chain.objs.size()=1 2024-09-12T17:49:16.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.128+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_.o-7XhA11ORNqC9lztzU1lQZcMONJ3m7_0 2024-09-12T17:49:16.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4895877314120505741', time=2024-09-12T19:41:58.445911+0000, chain.objs.size()=1 2024-09-12T17:49:16.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.OlFSBaCUja5zoWPc2P52WunvtlIQmAw_0 2024-09-12T17:49:16.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12246391800927172091', time=2024-09-12T19:42:30.579465+0000, chain.objs.size()=1 2024-09-12T17:49:16.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.xpC9ntMG8-g4LKwsdQZnkrg0Mk8CXEx_0 2024-09-12T17:49:16.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16593717249373437675', time=2024-09-12T19:42:30.582075+0000, chain.objs.size()=1 2024-09-12T17:49:16.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.Z9OtX08sQ-_Vwoi7-u1WbLzj4FoYpKB_0 2024-09-12T17:49:16.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14147599891742509459', time=2024-09-12T19:43:07.621511+0000, chain.objs.size()=1 2024-09-12T17:49:16.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.twSnQV3dkPhIscdaYoBIPU2sjxZ37fy_0 2024-09-12T17:49:16.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7622022786558538979', time=2024-09-12T19:44:14.073463+0000, chain.objs.size()=1 2024-09-12T17:49:16.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.Yeoh6_bLTd9_6OGPRpRgfEg1WdiI2Bc_0 2024-09-12T17:49:16.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6578800977606912696', time=2024-09-12T19:44:16.311762+0000, chain.objs.size()=1 2024-09-12T17:49:16.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.rtixclXS3xv1moPZRK0gDWfkGQW_z39_0 2024-09-12T17:49:16.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12135171290011670362', time=2024-09-12T19:44:16.312434+0000, chain.objs.size()=1 2024-09-12T17:49:16.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.wM3p0W1kbJi2ol_j-NWNQ_xncsY3TY__0 2024-09-12T17:49:16.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5776579516472340537', time=2024-09-12T19:45:24.134617+0000, chain.objs.size()=1 2024-09-12T17:49:16.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.lo9tcp_CfQc3K7ItNdnX9ksyw-a_zym_0 2024-09-12T17:49:16.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2631782444939556935', time=2024-09-12T19:45:57.909886+0000, chain.objs.size()=1 2024-09-12T17:49:16.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.FrMBZxpqtmhPTvffk5IPaAe4ry2vM3z_0 2024-09-12T17:49:16.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11404292199130651929', time=2024-09-12T19:45:59.932025+0000, chain.objs.size()=1 2024-09-12T17:49:16.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.eFhALR1fknqdf2M93q6z5pDqMP5KWBy_0 2024-09-12T17:49:16.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15033553037647296089', time=2024-09-12T19:45:59.937573+0000, chain.objs.size()=1 2024-09-12T17:49:16.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.129+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.CgJ1hpsszgvLGzul3lNsD406qiDd4Qh_0 2024-09-12T17:49:16.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.130+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11388842112348107684', time=2024-09-12T19:46:32.781933+0000, chain.objs.size()=1 2024-09-12T17:49:16.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.130+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.WU271DsX5MLWchOjKlvmuL4jd85TZ0V_0 2024-09-12T17:49:16.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.132+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.134+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:49:16.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.135+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T17:49:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='_Q28L4CSL7YCQkDoonVHT3WW76LEqRcZ', time=2024-09-12T19:40:37.016603+0000, chain.objs.size()=1 2024-09-12T17:49:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.ZmBOI1NePc1v2d1JGfkF5iivzEQZG8k_0 2024-09-12T17:49:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2022396059726491925', time=2024-09-12T19:41:57.167378+0000, chain.objs.size()=1 2024-09-12T17:49:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.O8NzSu5-5svFQ9MnbtqgSw7xLAEc3Qs_0 2024-09-12T17:49:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4476104097014090783', time=2024-09-12T19:41:58.439689+0000, chain.objs.size()=1 2024-09-12T17:49:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.A1mGR0gfWYVuImNhaXd5CtN1jDDvUxB_0 2024-09-12T17:49:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3613692132399078006', time=2024-09-12T19:43:05.817790+0000, chain.objs.size()=1 2024-09-12T17:49:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.gNzxydC-qccMXLi3rxTNPT_TgtTBCXW_0 2024-09-12T17:49:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3619839107631125402', time=2024-09-12T19:43:08.524080+0000, chain.objs.size()=1 2024-09-12T17:49:16.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.jjchod8jq5vr0ejCWKR-tMBFtX7-7IF_0 2024-09-12T17:49:16.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8727187775042954919', time=2024-09-12T19:43:40.283562+0000, chain.objs.size()=1 2024-09-12T17:49:16.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.6xVhWEPIQ0Gdd3yeUAFM970jK2JMpZL_0 2024-09-12T17:49:16.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2719724656538221094', time=2024-09-12T19:44:14.071417+0000, chain.objs.size()=1 2024-09-12T17:49:16.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.lfMciJRLkZ7NpPuiEwjylhY59bQnUKC_0 2024-09-12T17:49:16.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7270338027691603205', time=2024-09-12T19:44:16.310024+0000, chain.objs.size()=1 2024-09-12T17:49:16.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.o1oUAulCuUC5nL-esNYA3oBVfFJR2_0_0 2024-09-12T17:49:16.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14807576854257890490', time=2024-09-12T19:44:49.479843+0000, chain.objs.size()=1 2024-09-12T17:49:16.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.TxHPW7BiCdcVcej9LWCPbVz-rb9BtFr_0 2024-09-12T17:49:16.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.356070742924913727', time=2024-09-12T19:45:24.128535+0000, chain.objs.size()=1 2024-09-12T17:49:16.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.IxRcWOFA3wAFRdCEf8J24Y8qgNPvf7w_0 2024-09-12T17:49:16.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3837855584886000033', time=2024-09-12T19:45:57.906747+0000, chain.objs.size()=1 2024-09-12T17:49:16.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.8R-M2wwF3QWiuzvKWM1UFbDYO0gYdfl_0 2024-09-12T17:49:16.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17489775716360508793', time=2024-09-12T19:45:59.930030+0000, chain.objs.size()=1 2024-09-12T17:49:16.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.136+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.PTN2Olm4ZMUFMQ4Qj8DIS90H12qUJe4_0 2024-09-12T17:49:16.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.139+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15253512126632085344', time=2024-09-12T19:46:01.864691+0000, chain.objs.size()=1 2024-09-12T17:49:16.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.139+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.1eeALvtKrszBaNatztGEBVcMEVZeIPL_0 2024-09-12T17:49:16.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.139+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17624767068706746360', time=2024-09-12T19:48:39.208446+0000, chain.objs.size()=1 2024-09-12T17:49:16.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.139+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18__shadow_.0AdBIjMQ5ZLTaapFXtLPEn63XubWa-J_0 2024-09-12T17:49:16.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.140+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.142+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:49:16.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.143+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T17:49:16.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7985967715707443855', time=2024-09-12T19:40:36.873742+0000, chain.objs.size()=1 2024-09-12T17:49:16.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_.mphNAp_T8SyFiXgNj4UE5cvEUwGGyrM_0 2024-09-12T17:49:16.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16975845030498995499', time=2024-09-12T19:40:37.012815+0000, chain.objs.size()=1 2024-09-12T17:49:16.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.8gpeL8vs5sCpGXIKFTo4q5foDwE4EbW_0 2024-09-12T17:49:16.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8930169335335412854', time=2024-09-12T19:40:37.024702+0000, chain.objs.size()=1 2024-09-12T17:49:16.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.wy3s7L4_NBufXcO9SyPT3yEm3JKQ7R1_0 2024-09-12T17:49:16.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='_Nhya3JHF49_SJzke0FWKTVh3RQQaWjl', time=2024-09-12T19:40:37.028772+0000, chain.objs.size()=1 2024-09-12T17:49:16.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.mcFO5S-2AHIeVYCdrx1d9OIwQi_lxYA_0 2024-09-12T17:49:16.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15580978071178754962', time=2024-09-12T19:40:37.255287+0000, chain.objs.size()=1 2024-09-12T17:49:16.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9__shadow_._SvutE6LsaCyci3R52ch-6Tth27LY94_0 2024-09-12T17:49:16.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12136205251349844402', time=2024-09-12T19:41:58.444485+0000, chain.objs.size()=1 2024-09-12T17:49:16.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.tqm5rMofQj6qFs3PmPytYB6mja7GouO_0 2024-09-12T17:49:16.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11547202581805340191', time=2024-09-12T19:43:07.620338+0000, chain.objs.size()=1 2024-09-12T17:49:16.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.04DmKB31xhiDpMZMeLE6gOQ-ZN8UiS__0 2024-09-12T17:49:16.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1890793649927829441', time=2024-09-12T19:43:07.621406+0000, chain.objs.size()=1 2024-09-12T17:49:16.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.pPoQI8vZMut2C2Hu-L2JIOXFDll9Ce6_0 2024-09-12T17:49:16.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2439468039092915060', time=2024-09-12T19:43:08.521313+0000, chain.objs.size()=1 2024-09-12T17:49:16.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.kKkrenuDJyaIYNLG1FWsLFDQkbUPOE3_0 2024-09-12T17:49:16.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2671843797455168986', time=2024-09-12T19:43:41.901216+0000, chain.objs.size()=1 2024-09-12T17:49:16.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.144+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.5J3jlF1AUR3uxGzJGc-c-lQ8H8wma2o_0 2024-09-12T17:49:16.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.145+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16721401493055355503', time=2024-09-12T19:44:14.077409+0000, chain.objs.size()=1 2024-09-12T17:49:16.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.145+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.y1Hcud4CK_cJft5NHTyqLq9k_JPn1WT_0 2024-09-12T17:49:16.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.145+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4137289398557792917', time=2024-09-12T19:44:51.136284+0000, chain.objs.size()=1 2024-09-12T17:49:16.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.145+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.wEJUj1bHeAiOp-bUQMOINEEvPXN8Jhu_0 2024-09-12T17:49:16.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.147+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2748795352992259906', time=2024-09-12T19:44:51.138189+0000, chain.objs.size()=1 2024-09-12T17:49:16.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.147+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_._9UfqYygs2NRe1kSxKrqwmHxLXLba-J_0 2024-09-12T17:49:16.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.147+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5826030827604269210', time=2024-09-12T19:45:25.750175+0000, chain.objs.size()=1 2024-09-12T17:49:16.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.147+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.UQgaHO3uPYhvrR1nHGzwVrg-WS8bg6Z_0 2024-09-12T17:49:16.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.147+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11181080997737150939', time=2024-09-12T19:45:57.904980+0000, chain.objs.size()=1 2024-09-12T17:49:16.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.147+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.CMPCaFD_DdoCcc2UziivOfF9rtirsWR_0 2024-09-12T17:49:16.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.147+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11793982418134406186', time=2024-09-12T19:45:59.938393+0000, chain.objs.size()=1 2024-09-12T17:49:16.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.147+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.a1iVtelJb7L_rS0xmlk0xontp8iS9-z_0 2024-09-12T17:49:16.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.147+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17198593336022318274', time=2024-09-12T19:48:51.595362+0000, chain.objs.size()=1 2024-09-12T17:49:16.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.147+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19__shadow:ok93m6G0u-9CAMEpD5SawEEGCn-ML98_.Gb8XI7AVSMJL3xcIc7lgFcvyFUCXOC9_0 2024-09-12T17:49:16.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.149+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.151+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:49:16.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.154+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.154+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:49:16.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9479332390376112689', time=2024-09-12T19:40:37.166804+0000, chain.objs.size()=1 2024-09-12T17:49:16.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14__shadow_.3aic9uIhURhWf82qWkB5cimoepxm-Ga_0 2024-09-12T17:49:16.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14808259787319483991', time=2024-09-12T19:41:57.164799+0000, chain.objs.size()=1 2024-09-12T17:49:16.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.iRrAda7ZiHDb6NTJ6uYtRt19h7yAVKn_0 2024-09-12T17:49:16.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8802190555523864717', time=2024-09-12T19:41:57.167593+0000, chain.objs.size()=1 2024-09-12T17:49:16.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.qY3WJNecpdUwgQBNmA8kLvE6Zf4GXuX_0 2024-09-12T17:49:16.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2765178852994251472', time=2024-09-12T19:42:30.577578+0000, chain.objs.size()=1 2024-09-12T17:49:16.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.oDVxN14dwd-oSjL85EZ5GnGwxqFVnJj_0 2024-09-12T17:49:16.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8443617792033516231', time=2024-09-12T19:42:32.375978+0000, chain.objs.size()=1 2024-09-12T17:49:16.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.WezPNe1PjwI-M3NXN-ZYNdy_Am20aCf_0 2024-09-12T17:49:16.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10871650535096047597', time=2024-09-12T19:42:33.448052+0000, chain.objs.size()=1 2024-09-12T17:49:16.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.gWhEWLEi2Tf8qVLgWitsKQlALa6HyUA_0 2024-09-12T17:49:16.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1859096315604568733', time=2024-09-12T19:43:40.289149+0000, chain.objs.size()=1 2024-09-12T17:49:16.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.lvKo2tm8xwKrHm_AgFczyIugxUGm7FH_0 2024-09-12T17:49:16.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12704888348916852083', time=2024-09-12T19:44:14.070372+0000, chain.objs.size()=1 2024-09-12T17:49:16.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.Ix5vs5AtA3i8FNwM2A4GAHqOnpGR3KL_0 2024-09-12T17:49:16.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13746581700190977022', time=2024-09-12T19:44:16.312373+0000, chain.objs.size()=1 2024-09-12T17:49:16.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.6hZ3nxhhR0ah3SMp8be8wBxIGqLKjB5_0 2024-09-12T17:49:16.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7639205650654201153', time=2024-09-12T19:44:17.600344+0000, chain.objs.size()=1 2024-09-12T17:49:16.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.5UhXeYlKdoLbHWo9JcPAvc2_NEI8UPu_0 2024-09-12T17:49:16.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4977382509075940324', time=2024-09-12T19:44:17.602842+0000, chain.objs.size()=1 2024-09-12T17:49:16.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.PTSVrDNalsSoVqvyvPpnuuxeWznm80w_0 2024-09-12T17:49:16.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16024937303831000600', time=2024-09-12T19:44:49.471453+0000, chain.objs.size()=1 2024-09-12T17:49:16.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.155+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.DUmne_EcvC5Gmm08zmjpkpcXbLPGHF9_0 2024-09-12T17:49:16.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.157+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11340424723899344897', time=2024-09-12T19:44:51.141902+0000, chain.objs.size()=1 2024-09-12T17:49:16.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.157+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.L1jiQ8l0ZWs8PEyx9aVFZsVcjg6hPTK_0 2024-09-12T17:49:16.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.157+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12962629375453775704', time=2024-09-12T19:45:24.124572+0000, chain.objs.size()=1 2024-09-12T17:49:16.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.157+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.tjnHvUkgvcuO9wIxdTcB2UvSPhSIqd8_0 2024-09-12T17:49:16.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.157+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4614851479192888313', time=2024-09-12T19:45:25.746383+0000, chain.objs.size()=1 2024-09-12T17:49:16.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.157+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.47gPWvmBQuUYRoTLQY03ZibNZOcOzVW_0 2024-09-12T17:49:16.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.157+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1691578676580141610', time=2024-09-12T19:46:00.806753+0000, chain.objs.size()=1 2024-09-12T17:49:16.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.157+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.HVjcl4EToli-sQEFzR2PtGSzJOdlt0p_0 2024-09-12T17:49:16.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.157+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15855224038868304105', time=2024-09-12T19:46:32.782611+0000, chain.objs.size()=1 2024-09-12T17:49:16.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.157+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.fEHdICVsSnDjv1MpOwU6I1LCFg3ErGg_0 2024-09-12T17:49:16.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.157+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.92218327385966179', time=2024-09-12T19:46:32.783832+0000, chain.objs.size()=1 2024-09-12T17:49:16.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.157+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.LxhyU1LqbwZZJYDE1Pcj8GGHk6Rbi_8_0 2024-09-12T17:49:16.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.159+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.161+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:49:16.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.162+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T17:49:16.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11031857741125420125', time=2024-09-12T19:40:36.984637+0000, chain.objs.size()=4 2024-09-12T17:49:16.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10__multipart_foo.2~cbGGG6AMZWvqUG-Wz3CdDbg6UFwOK8-.1 2024-09-12T17:49:16.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10__multipart_foo.2~cbGGG6AMZWvqUG-Wz3CdDbg6UFwOK8-.2 2024-09-12T17:49:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10__multipart_foo.2~cbGGG6AMZWvqUG-Wz3CdDbg6UFwOK8-.3 2024-09-12T17:49:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10__multipart_foo.2~cbGGG6AMZWvqUG-Wz3CdDbg6UFwOK8-.4 2024-09-12T17:49:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3776430032419950555', time=2024-09-12T19:40:37.032958+0000, chain.objs.size()=1 2024-09-12T17:49:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.pJ9fvemURAFQva4hPdq2RQXLESba0Ek_0 2024-09-12T17:49:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14035723289373576276', time=2024-09-12T19:40:37.171097+0000, chain.objs.size()=2 2024-09-12T17:49:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14__shadow_.M2JjtGFhFK-uDa8yDBd9lfajzCNbIOC_0 2024-09-12T17:49:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14__shadow_.M2JjtGFhFK-uDa8yDBd9lfajzCNbIOC_1 2024-09-12T17:49:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3215120656833847832', time=2024-09-12T19:41:57.172562+0000, chain.objs.size()=1 2024-09-12T17:49:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.SP4MZ70sFOWuCkE8YQVkhX-CU_6lE6g_0 2024-09-12T17:49:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10467047637003145051', time=2024-09-12T19:43:05.820437+0000, chain.objs.size()=1 2024-09-12T17:49:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.XwhwgaT_xmWgDIoQG48L4tVfAfu1EYE_0 2024-09-12T17:49:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6440693550563159585', time=2024-09-12T19:43:07.626985+0000, chain.objs.size()=1 2024-09-12T17:49:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.HB7Ga1DdR5m1JA2MDCvD4JA8gpxtE8B_0 2024-09-12T17:49:16.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12093832402361504105', time=2024-09-12T19:43:40.288213+0000, chain.objs.size()=1 2024-09-12T17:49:16.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.fMiqXVrH2XPiO1D7Z8h3nDslfOmp5W6_0 2024-09-12T17:49:16.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12672389483671946884', time=2024-09-12T19:43:41.906607+0000, chain.objs.size()=1 2024-09-12T17:49:16.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.163+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.hRsOMx8kWV3O9T_JabAIr2QZ644N1hD_0 2024-09-12T17:49:16.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.166+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18257514307449046360', time=2024-09-12T19:44:14.068141+0000, chain.objs.size()=1 2024-09-12T17:49:16.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.166+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.9H_DIKTlrhLmSH5d1GFicuU-gQLtdWt_0 2024-09-12T17:49:16.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.166+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7135091172183952251', time=2024-09-12T19:44:14.068894+0000, chain.objs.size()=1 2024-09-12T17:49:16.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.166+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.zFskHx0o71JByLNHRayK-Tt6CLfo2gu_0 2024-09-12T17:49:16.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.166+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14621741921138450807', time=2024-09-12T19:44:17.599181+0000, chain.objs.size()=1 2024-09-12T17:49:16.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.166+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.lTsO0pVWRc7G4lBhfiUu1m1FnXc-aj2_0 2024-09-12T17:49:16.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3284167649753039918', time=2024-09-12T19:44:51.134660+0000, chain.objs.size()=1 2024-09-12T17:49:16.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.8i4L_4isFpJd8EPB0TD-qIkixrkwIr2_0 2024-09-12T17:49:16.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8536689233301974349', time=2024-09-12T19:44:52.590946+0000, chain.objs.size()=1 2024-09-12T17:49:16.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.5JLBhMmjsk8zb5ecK8hvK6JVU2ALsks_0 2024-09-12T17:49:16.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10047761206709464740', time=2024-09-12T19:45:25.745972+0000, chain.objs.size()=1 2024-09-12T17:49:16.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.38LMaU04sH-H3AvfRhsAaVDtK4I0hS-_0 2024-09-12T17:49:16.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13863316135417438125', time=2024-09-12T19:45:25.748327+0000, chain.objs.size()=1 2024-09-12T17:49:16.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.5xEKdSS8VaQtP31tfy4X49EovC-Fp-q_0 2024-09-12T17:49:16.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1502217667976682817', time=2024-09-12T19:45:57.912461+0000, chain.objs.size()=1 2024-09-12T17:49:16.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.dtvq9nt0sZfG89x0X6VpIlVIfxy7sir_0 2024-09-12T17:49:16.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6389780955567899408', time=2024-09-12T19:45:57.913142+0000, chain.objs.size()=1 2024-09-12T17:49:16.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.sFHBBPSwZG7ZUMsMucF7NiSgU6zfIvq_0 2024-09-12T17:49:16.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7465704235694685981', time=2024-09-12T19:45:59.931918+0000, chain.objs.size()=1 2024-09-12T17:49:16.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.bbnnMRZTk3Wimyj5SdyWsEApMtjR2aS_0 2024-09-12T17:49:16.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8603472430028500225', time=2024-09-12T19:46:00.810778+0000, chain.objs.size()=1 2024-09-12T17:49:16.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.aKccaz7gk346IZFoV6zn3iIdU5ci0XM_0 2024-09-12T17:49:16.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7354557710464807814', time=2024-09-12T19:46:32.779807+0000, chain.objs.size()=1 2024-09-12T17:49:16.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.fZ2afddwo8nujFk2EGx4te_PLA2mlP6_0 2024-09-12T17:49:16.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12578156485178399278', time=2024-09-12T19:48:39.208311+0000, chain.objs.size()=1 2024-09-12T17:49:16.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.168+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18__shadow_.6Ui4shLL5wPkEeN40YSEDyPWtzreOO5_0 2024-09-12T17:49:16.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.171+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8194601366195006277', time=2024-09-12T19:48:39.209101+0000, chain.objs.size()=1 2024-09-12T17:49:16.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.171+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18__shadow_.FpLxEyDefLm-JH8vmZ1e1am_ulpdymm_0 2024-09-12T17:49:16.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.172+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.174+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:49:16.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.175+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.176+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.176+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T17:49:16.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.176+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8387913938842271588', time=2024-09-12T19:40:36.917169+0000, chain.objs.size()=4 2024-09-12T17:49:16.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12__multipart_foo.2~2ftiJkwWe0bZfPBCAmWZMrTCUAL0pkz.1 2024-09-12T17:49:16.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12__multipart_foo.2~2ftiJkwWe0bZfPBCAmWZMrTCUAL0pkz.2 2024-09-12T17:49:16.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12__multipart_foo.2~2ftiJkwWe0bZfPBCAmWZMrTCUAL0pkz.3 2024-09-12T17:49:16.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12__multipart_foo.2~2ftiJkwWe0bZfPBCAmWZMrTCUAL0pkz.4 2024-09-12T17:49:16.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3594771510936747396', time=2024-09-12T19:41:58.442668+0000, chain.objs.size()=1 2024-09-12T17:49:16.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.BSKXcwaptpkagM47xg_-wnqXOzS_I3m_0 2024-09-12T17:49:16.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9863943248965609359', time=2024-09-12T19:41:58.446494+0000, chain.objs.size()=1 2024-09-12T17:49:16.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.AmrywuFqFtSjdj6iGyBsmVu3tRD691Z_0 2024-09-12T17:49:16.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1533572847495268394', time=2024-09-12T19:42:30.584677+0000, chain.objs.size()=1 2024-09-12T17:49:16.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.NGL7iLYKzc32oA6g_QvP2Gx7LB7EG4v_0 2024-09-12T17:49:16.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13998802974100728635', time=2024-09-12T19:43:05.819313+0000, chain.objs.size()=1 2024-09-12T17:49:16.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.ao6KRB7upZMAykA3VL_RqgO0VBIbQH__0 2024-09-12T17:49:16.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5667354248227855556', time=2024-09-12T19:43:05.820145+0000, chain.objs.size()=1 2024-09-12T17:49:16.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.zA-P4tGTJszm2hxcxbuxqoW9hiMM3UX_0 2024-09-12T17:49:16.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18173907005905052843', time=2024-09-12T19:43:07.622799+0000, chain.objs.size()=1 2024-09-12T17:49:16.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.5sLjOLsmvP6STdxgA6RzYmiRdP4qb84_0 2024-09-12T17:49:16.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3804126504679022483', time=2024-09-12T19:43:08.524722+0000, chain.objs.size()=1 2024-09-12T17:49:16.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.YBBo9wzGW8UvCTmiLvFv7P8FLEo3Lhy_0 2024-09-12T17:49:16.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5369539828140263107', time=2024-09-12T19:43:08.526951+0000, chain.objs.size()=1 2024-09-12T17:49:16.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.177+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.0JGu98KBvcJauScmk7rayrSojiXojAu_0 2024-09-12T17:49:16.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.178+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1519169937768685951', time=2024-09-12T19:43:40.291863+0000, chain.objs.size()=1 2024-09-12T17:49:16.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.178+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.VJ5Ydh3q_NK3Hej5J_Hd6-M0i35_MED_0 2024-09-12T17:49:16.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8235839417961401919', time=2024-09-12T19:44:16.309279+0000, chain.objs.size()=1 2024-09-12T17:49:16.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.mZIYvRln2t4EesiCDuttPGc7Pl0tut8_0 2024-09-12T17:49:16.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16160920507179029330', time=2024-09-12T19:44:16.313242+0000, chain.objs.size()=1 2024-09-12T17:49:16.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.L9plZu0papGnDMOZeRTN-wiKgxhSv_g_0 2024-09-12T17:49:16.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12169042416636128403', time=2024-09-12T19:44:49.470859+0000, chain.objs.size()=1 2024-09-12T17:49:16.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.P4XXYXwTXcXHKWvBvNqeX8uIYYP6Xco_0 2024-09-12T17:49:16.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5185385520285440248', time=2024-09-12T19:44:49.471633+0000, chain.objs.size()=1 2024-09-12T17:49:16.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.xLX57MB0TTPusmLqGX9WzBA0_t59nBx_0 2024-09-12T17:49:16.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14382884533958539877', time=2024-09-12T19:44:49.475750+0000, chain.objs.size()=1 2024-09-12T17:49:16.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.jGyiNJtP0FR_23UoeICpm9e5mIYD2-E_0 2024-09-12T17:49:16.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9553763310813859052', time=2024-09-12T19:45:24.124590+0000, chain.objs.size()=1 2024-09-12T17:49:16.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.Z_HmOKjSl3ISyowj8rXwfLkz8AhuzJY_0 2024-09-12T17:49:16.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17420210699086992723', time=2024-09-12T19:45:25.742575+0000, chain.objs.size()=1 2024-09-12T17:49:16.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.TxKlt5-HQ5icEKSCzQUNsHOuZq5v9jg_0 2024-09-12T17:49:16.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3526214382198422299', time=2024-09-12T19:45:25.745692+0000, chain.objs.size()=1 2024-09-12T17:49:16.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.YtIJlmKqdrSbJR7xxxiDZfO9DYykSsH_0 2024-09-12T17:49:16.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12807657191408996468', time=2024-09-12T19:45:25.754629+0000, chain.objs.size()=1 2024-09-12T17:49:16.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.XKHKVb02AKRdsfJsKPGuDi4W1MKYrr1_0 2024-09-12T17:49:16.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5794057305395231819', time=2024-09-12T19:45:57.903026+0000, chain.objs.size()=1 2024-09-12T17:49:16.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.179+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.BgtFQ5AEQYear5OEtVWrMf0hAeo8TrH_0 2024-09-12T17:49:16.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.180+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4866725966139454061', time=2024-09-12T19:45:59.934084+0000, chain.objs.size()=1 2024-09-12T17:49:16.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.180+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.1DlgkwWJ4e91QqRQR4yblYSjPUrcZ6C_0 2024-09-12T17:49:16.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.180+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10843037769491122858', time=2024-09-12T19:46:00.815156+0000, chain.objs.size()=1 2024-09-12T17:49:16.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.180+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.uLeviNslBQn8F3ygHp_TtVGcEhxqcM__0 2024-09-12T17:49:16.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.180+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15480991562486192232', time=2024-09-12T19:46:00.817023+0000, chain.objs.size()=1 2024-09-12T17:49:16.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.180+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.r7WsyZg2xanWaYeqHv5QNcIeP4Qr2W7_0 2024-09-12T17:49:16.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.181+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5864148481754754225', time=2024-09-12T19:48:39.211257+0000, chain.objs.size()=1 2024-09-12T17:49:16.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.181+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18__shadow_.B752Y0-AC6nx-37iX-ynqPRJ-UqwGzW_0 2024-09-12T17:49:16.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.182+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.185+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:49:16.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.186+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.186+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T17:49:16.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11846168974823483583', time=2024-09-12T19:40:36.960811+0000, chain.objs.size()=4 2024-09-12T17:49:16.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11__multipart_foo.2~b_70D13zZgqrdHe2Je2F8JmHCzCb_jM.1 2024-09-12T17:49:16.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11__multipart_foo.2~b_70D13zZgqrdHe2Je2F8JmHCzCb_jM.2 2024-09-12T17:49:16.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11__multipart_foo.2~b_70D13zZgqrdHe2Je2F8JmHCzCb_jM.3 2024-09-12T17:49:16.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11__multipart_foo.2~b_70D13zZgqrdHe2Je2F8JmHCzCb_jM.4 2024-09-12T17:49:16.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17181285536792801919', time=2024-09-12T19:40:37.227495+0000, chain.objs.size()=1 2024-09-12T17:49:16.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8__shadow_.ca4lfa573vHRUXI_CQbxdsDRo22VDI1_0 2024-09-12T17:49:16.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1715681525875945766', time=2024-09-12T19:41:56.412896+0000, chain.objs.size()=1 2024-09-12T17:49:16.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.cBatM5rjcBSCo2l12hSw3z9MhLGu6jW_0 2024-09-12T17:49:16.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8936450503575767314', time=2024-09-12T19:41:57.167782+0000, chain.objs.size()=1 2024-09-12T17:49:16.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_._DLbWGerf-PBa5Duge-Gzj1X0JwfSiJ_0 2024-09-12T17:49:16.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14226121693168433456', time=2024-09-12T19:42:32.379593+0000, chain.objs.size()=1 2024-09-12T17:49:16.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_._d1qeJyLI9Do-mdHLnMxR1BGbAX5y3m_0 2024-09-12T17:49:16.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.151152996223913350', time=2024-09-12T19:42:33.448835+0000, chain.objs.size()=1 2024-09-12T17:49:16.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.vwsPY5ecsel_tdN7l8a816btR8SfxkB_0 2024-09-12T17:49:16.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5757275961319215973', time=2024-09-12T19:43:07.619265+0000, chain.objs.size()=1 2024-09-12T17:49:16.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.ANoIwmOu_w_1m8BuLX44KoDGNURzRts_0 2024-09-12T17:49:16.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.496462674508201327', time=2024-09-12T19:43:40.284837+0000, chain.objs.size()=1 2024-09-12T17:49:16.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.BljPV1odERl-CrXZeEXcHzR9N4WsX1N_0 2024-09-12T17:49:16.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11085659445790302376', time=2024-09-12T19:44:17.601102+0000, chain.objs.size()=1 2024-09-12T17:49:16.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.187+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.xnAN-Ms1ZeozZKqUOrkXhlcIQgfKRB9_0 2024-09-12T17:49:16.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.189+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8560666576228787020', time=2024-09-12T19:45:24.129500+0000, chain.objs.size()=1 2024-09-12T17:49:16.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.189+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.S8eYkpecgf44z8He0xbPoLZ0WGLwNM6_0 2024-09-12T17:49:16.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.189+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17617281118352184428', time=2024-09-12T19:45:24.131403+0000, chain.objs.size()=1 2024-09-12T17:49:16.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.189+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.nOoNu3wfZwrmjc98QrjwRKrwRNrT-j7_0 2024-09-12T17:49:16.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.189+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11740527049457597863', time=2024-09-12T19:45:24.133214+0000, chain.objs.size()=1 2024-09-12T17:49:16.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.189+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.4XeYsC_dxMIzoVxBtGMSoM_w58vRBKA_0 2024-09-12T17:49:16.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.189+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1941108374354456253', time=2024-09-12T19:45:25.753880+0000, chain.objs.size()=1 2024-09-12T17:49:16.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.189+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.8PWM3yUM2BPehp2pmvsf0vd6qSu3n8-_0 2024-09-12T17:49:16.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.189+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12472713057574402060', time=2024-09-12T19:46:00.808906+0000, chain.objs.size()=1 2024-09-12T17:49:16.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.189+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.Ry8xppQvj2HW-eX005efXh6PUEV8X0l_0 2024-09-12T17:49:16.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.189+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1644658291369745076', time=2024-09-12T19:48:39.212105+0000, chain.objs.size()=1 2024-09-12T17:49:16.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.189+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18__shadow_.E48xl82Quy3-L0zhJTil94QXKsGw37J_0 2024-09-12T17:49:16.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.191+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.193+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:49:16.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.194+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:49:16.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6186622460565601544', time=2024-09-12T19:40:36.864482+0000, chain.objs.size()=1 2024-09-12T17:49:16.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_.xq-3jQ8eAOzBTy16iuVDs7zDMVfs0UI_0 2024-09-12T17:49:16.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8238226426992575810', time=2024-09-12T19:41:57.165030+0000, chain.objs.size()=1 2024-09-12T17:49:16.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.E7crY3AuBajSwWm3IVFHSOt0OWReXql_0 2024-09-12T17:49:16.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17927898594688763926', time=2024-09-12T19:41:57.172841+0000, chain.objs.size()=1 2024-09-12T17:49:16.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.8ORpXI7feFCiB_FZZ0twEh-vQLFoM36_0 2024-09-12T17:49:16.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12081231279875113552', time=2024-09-12T19:41:58.442664+0000, chain.objs.size()=1 2024-09-12T17:49:16.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_._hLt8VaSvIpF83mTBWRmyBveQR8b4bM_0 2024-09-12T17:49:16.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23120107990951425', time=2024-09-12T19:42:30.583914+0000, chain.objs.size()=1 2024-09-12T17:49:16.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.5Cmslu1y9IiimppP4K13iXkF_L65_Lr_0 2024-09-12T17:49:16.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6570639932567393907', time=2024-09-12T19:42:32.380693+0000, chain.objs.size()=1 2024-09-12T17:49:16.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.AUpuXoJAfFQ0QJ44yZ7ohIyo24LF4iq_0 2024-09-12T17:49:16.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7595651167459019465', time=2024-09-12T19:44:14.069626+0000, chain.objs.size()=1 2024-09-12T17:49:16.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.8K2p3sjgWCLq6DjvICjuoD0w1FHiaK7_0 2024-09-12T17:49:16.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5436564002335155084', time=2024-09-12T19:44:16.316469+0000, chain.objs.size()=1 2024-09-12T17:49:16.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.oCukLXMpSKqp0osn-mU0VXNJnYqOXrQ_0 2024-09-12T17:49:16.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12724677060929850660', time=2024-09-12T19:44:17.599922+0000, chain.objs.size()=1 2024-09-12T17:49:16.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.195+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.4bMQffze9LQvaeh1EVv9qcMvLGWirh0_0 2024-09-12T17:49:16.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.196+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13977073649680753983', time=2024-09-12T19:44:17.608146+0000, chain.objs.size()=1 2024-09-12T17:49:16.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.196+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.fucYNsoN1QLJcBWG1AtNLB0jyrY4BCb_0 2024-09-12T17:49:16.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.196+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10335129007762761511', time=2024-09-12T19:45:24.128432+0000, chain.objs.size()=1 2024-09-12T17:49:16.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.196+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.Dik1NSsRMgCM37hKYSdRsLCKBGdNjkj_0 2024-09-12T17:49:16.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.196+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14759179559970849618', time=2024-09-12T19:45:25.747749+0000, chain.objs.size()=1 2024-09-12T17:49:16.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.196+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.JGebMBpTqZM66KMGJRVgFOCsrpg6AP6_0 2024-09-12T17:49:16.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.197+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7728206899953829033', time=2024-09-12T19:48:39.208360+0000, chain.objs.size()=1 2024-09-12T17:49:16.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.197+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18__shadow_._PsuMYDA1vAl7G--h6eQOZTgd7dqT34_0 2024-09-12T17:49:16.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.198+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.200+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:49:16.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.202+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.202+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T17:49:16.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5947264467407574525', time=2024-09-12T19:40:36.885030+0000, chain.objs.size()=1 2024-09-12T17:49:16.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_.5SDVH50VIEsomIAcxgmv_tE-_KjyVGl_0 2024-09-12T17:49:16.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5884166847466213428', time=2024-09-12T19:40:36.896525+0000, chain.objs.size()=1 2024-09-12T17:49:16.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_.ZJWTYsZQFfmBIqKqZ4RoAXKb0DUqHkt_0 2024-09-12T17:49:16.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.273015162164835411', time=2024-09-12T19:40:37.101780+0000, chain.objs.size()=3 2024-09-12T17:49:16.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-STANDARD.2~iXSIErO2B2bnt30qSQCjizSuiZJeov6.1 2024-09-12T17:49:16.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-STANDARD.2~iXSIErO2B2bnt30qSQCjizSuiZJeov6.2 2024-09-12T17:49:16.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-STANDARD.2~iXSIErO2B2bnt30qSQCjizSuiZJeov6.3 2024-09-12T17:49:16.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='_l4g4pkOF2GzDUQ8W7O0YzYpS6ES4YvQ', time=2024-09-12T19:40:37.109409+0000, chain.objs.size()=2 2024-09-12T17:49:16.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.sHK5p-Sfo-_QNkL_hDKobyqYpMGJ3sr_0 2024-09-12T17:49:16.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.sHK5p-Sfo-_QNkL_hDKobyqYpMGJ3sr_1 2024-09-12T17:49:16.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6625355375052573093', time=2024-09-12T19:40:37.234905+0000, chain.objs.size()=1 2024-09-12T17:49:16.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8__shadow_.W6SbKxADuvXvCTRgJm9GJ1jiT7x79a8_0 2024-09-12T17:49:16.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8032868066886114352', time=2024-09-12T19:40:37.266476+0000, chain.objs.size()=1 2024-09-12T17:49:16.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9__shadow_.ZfUsnTwvpP1hs2Kvm0JgNGHJqtlIahS_0 2024-09-12T17:49:16.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3772996194227905054', time=2024-09-12T19:42:30.575266+0000, chain.objs.size()=1 2024-09-12T17:49:16.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.3Iy4wUApoZQXRAsze4fWAYXtnk-B6a3_0 2024-09-12T17:49:16.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9098619047539004626', time=2024-09-12T19:42:30.577083+0000, chain.objs.size()=1 2024-09-12T17:49:16.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.M9-2Rcq3894njCdvOX0D86WZD1a061d_0 2024-09-12T17:49:16.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1607988677447314720', time=2024-09-12T19:42:30.578397+0000, chain.objs.size()=1 2024-09-12T17:49:16.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.203+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.TIpm4LNsOh1rJHt2KOI3_xD8v_sDzOt_0 2024-09-12T17:49:16.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.204+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9304775073066295176', time=2024-09-12T19:42:30.579437+0000, chain.objs.size()=1 2024-09-12T17:49:16.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.204+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.4fXHPUDwqZIQMyCINUvFedMMMWFkL1Z_0 2024-09-12T17:49:16.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.205+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12493327870061711095', time=2024-09-12T19:42:30.584432+0000, chain.objs.size()=1 2024-09-12T17:49:16.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.205+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.YrVCHQ_7f0owUjaVwVeUjLqZu98vMnz_0 2024-09-12T17:49:16.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.205+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9925227467984328742', time=2024-09-12T19:42:32.370848+0000, chain.objs.size()=1 2024-09-12T17:49:16.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.205+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.s2lRKBD_Nddt0_QDt5tElfITsBBKrgz_0 2024-09-12T17:49:16.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.205+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4292933619246867132', time=2024-09-12T19:42:33.447960+0000, chain.objs.size()=1 2024-09-12T17:49:16.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.205+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.9zyvcQp3QOddOuIWodguzXUVJ7Um2ch_0 2024-09-12T17:49:16.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.206+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17476114639190461088', time=2024-09-12T19:43:08.525046+0000, chain.objs.size()=1 2024-09-12T17:49:16.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.206+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.kqW5v3_baAU3j9LcmtR_mFxKAe6kaFp_0 2024-09-12T17:49:16.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.206+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.619986939227332181', time=2024-09-12T19:44:16.318436+0000, chain.objs.size()=1 2024-09-12T17:49:16.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.206+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.ffRx49F_FJ1piXPCMR54O-PotsY5QUS_0 2024-09-12T17:49:16.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.206+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10709773220111759780', time=2024-09-12T19:44:17.600064+0000, chain.objs.size()=1 2024-09-12T17:49:16.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.206+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.rAFLs_BwRkOgx3OHi-lysJ-zV_FUKDk_0 2024-09-12T17:49:16.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.206+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9869709051457217455', time=2024-09-12T19:44:17.604189+0000, chain.objs.size()=1 2024-09-12T17:49:16.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.206+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.ZFN4FawbQFknwn1943M8VApyHSzwSDJ_0 2024-09-12T17:49:16.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.206+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12224042443733855502', time=2024-09-12T19:44:49.479193+0000, chain.objs.size()=1 2024-09-12T17:49:16.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.206+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.FbiY4M7TuQBsxkEPZkY_FlDupn_2LdK_0 2024-09-12T17:49:16.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.206+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7876316634630603063', time=2024-09-12T19:44:51.134249+0000, chain.objs.size()=1 2024-09-12T17:49:16.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.206+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.Jtf9zsbRgoIj6aXycNRSb7hxLYNTrwb_0 2024-09-12T17:49:16.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.206+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2211339437474337643', time=2024-09-12T19:45:25.748030+0000, chain.objs.size()=1 2024-09-12T17:49:16.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.206+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.hdjhySxJklSuD5cUUWxPCwRpj9GpIu1_0 2024-09-12T17:49:16.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.206+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2320670124368559941', time=2024-09-12T19:45:59.928694+0000, chain.objs.size()=1 2024-09-12T17:49:16.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.206+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.LfHal3euXsNVOAjnQe_T_odCQ2bjTMf_0 2024-09-12T17:49:16.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.207+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8515951046913623658', time=2024-09-12T19:46:00.809064+0000, chain.objs.size()=1 2024-09-12T17:49:16.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.207+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.OONVbBdGl4-E6IN4lHL7NfKwL3aKY05_0 2024-09-12T17:49:16.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.207+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2088332565744363979', time=2024-09-12T19:46:32.780547+0000, chain.objs.size()=1 2024-09-12T17:49:16.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.207+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.tnWeAZSUJfvtpuldR8DU0s5qrVDAo5f_0 2024-09-12T17:49:16.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.207+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14619965223146051316', time=2024-09-12T19:46:32.781634+0000, chain.objs.size()=1 2024-09-12T17:49:16.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.207+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.tjJN0ItjLHAItG8AHOmpTY6C2UHLUpk_0 2024-09-12T17:49:16.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.208+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18182602250272290806', time=2024-09-12T19:46:32.789578+0000, chain.objs.size()=1 2024-09-12T17:49:16.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.208+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.zxogHdGoPTLlTE0Dosh16GC0XgT6wvr_0 2024-09-12T17:49:16.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.209+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.211+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:49:16.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.212+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T17:49:16.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14105356822649045311', time=2024-09-12T19:40:36.877469+0000, chain.objs.size()=1 2024-09-12T17:49:16.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_.XYLDszxdZUS4125XAViFazkBBjE6EBT_0 2024-09-12T17:49:16.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='_po98u7HrsoARN11RlmLdn91C40d7EB8', time=2024-09-12T19:40:37.071776+0000, chain.objs.size()=2 2024-09-12T17:49:16.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.4SKXpN0PYw7Iw2JE-ICweP72ZBPMjsV_0 2024-09-12T17:49:16.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.4SKXpN0PYw7Iw2JE-ICweP72ZBPMjsV_1 2024-09-12T17:49:16.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.696212667528781378', time=2024-09-12T19:40:37.231314+0000, chain.objs.size()=1 2024-09-12T17:49:16.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8__shadow_.nj7OBHHSRHEJAmZmTA0Ez66XBvNkUSy_0 2024-09-12T17:49:16.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17234789428242345777', time=2024-09-12T19:41:57.164606+0000, chain.objs.size()=1 2024-09-12T17:49:16.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.3RPR0r2iiMIdz9g4IuybF1oT77bG-fe_0 2024-09-12T17:49:16.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4096042939327106974', time=2024-09-12T19:41:57.166914+0000, chain.objs.size()=1 2024-09-12T17:49:16.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.QJ39OHRzP9aoizQ--XXAESYpP8gaKdv_0 2024-09-12T17:49:16.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7090950601755106003', time=2024-09-12T19:42:32.373237+0000, chain.objs.size()=1 2024-09-12T17:49:16.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.CqCSqJ8sOGs8kt75KmhJRbv6jyhRQZ1_0 2024-09-12T17:49:16.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11238233309919038576', time=2024-09-12T19:42:32.373921+0000, chain.objs.size()=1 2024-09-12T17:49:16.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.ext7aGIY3Yoe2KSQ1ixryYWnZfgyXr__0 2024-09-12T17:49:16.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17652385120691776087', time=2024-09-12T19:42:33.447760+0000, chain.objs.size()=1 2024-09-12T17:49:16.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.hfu2zU4KroVwN-1BRFK99PQvyKQl1Go_0 2024-09-12T17:49:16.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5806412710879773306', time=2024-09-12T19:43:05.817211+0000, chain.objs.size()=1 2024-09-12T17:49:16.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.YVLPlwQBjqjhRe2RbB8LsjVDemFfE0l_0 2024-09-12T17:49:16.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5938206082861217909', time=2024-09-12T19:43:05.825025+0000, chain.objs.size()=1 2024-09-12T17:49:16.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.wN989SFtKy6ngsxTDdPe2IQtCWtbPaH_0 2024-09-12T17:49:16.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3600645528123699421', time=2024-09-12T19:44:14.073610+0000, chain.objs.size()=1 2024-09-12T17:49:16.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.213+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.6dz9m9e8Vy_5T94jyQAIaIUAQ7oKjxW_0 2024-09-12T17:49:16.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.215+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2596776622025675530', time=2024-09-12T19:44:16.320801+0000, chain.objs.size()=1 2024-09-12T17:49:16.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.215+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.ToCL2BjL0R_bYmun7MJVtKzdpKWFZLt_0 2024-09-12T17:49:16.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.217+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11413523343645951036', time=2024-09-12T19:44:50.582093+0000, chain.objs.size()=1 2024-09-12T17:49:16.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.217+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.B6Jo4t1dqqGe2Bw36RVFqsBrcnuUseI_0 2024-09-12T17:49:16.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.217+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9545122125475524458', time=2024-09-12T19:46:00.811330+0000, chain.objs.size()=1 2024-09-12T17:49:16.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.217+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.-AtpG_uRnhf6W_aq2FL0ZXVdPZ6kfS2_0 2024-09-12T17:49:16.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.218+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.220+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:49:16.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.221+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T17:49:16.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='_8wvtmuAVcE6PSSmWu2G5nh5_YuGGHDZ', time=2024-09-12T19:40:37.093898+0000, chain.objs.size()=2 2024-09-12T17:49:16.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.qklC0ajsVzjwgrwOM9zbLXTvd0p0A9i_0 2024-09-12T17:49:16.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.qklC0ajsVzjwgrwOM9zbLXTvd0p0A9i_1 2024-09-12T17:49:16.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1375685704317914323', time=2024-09-12T19:43:41.900381+0000, chain.objs.size()=1 2024-09-12T17:49:16.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.wEYf-087UohTYmbjKuXENvWZkDKsJ5b_0 2024-09-12T17:49:16.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16000120795037121419', time=2024-09-12T19:44:16.314529+0000, chain.objs.size()=1 2024-09-12T17:49:16.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.3sXlQFe1VPz08U1yF5UYckGlgSto9wY_0 2024-09-12T17:49:16.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3300742663845446830', time=2024-09-12T19:44:17.607856+0000, chain.objs.size()=1 2024-09-12T17:49:16.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.jG06N-GdzBi7uyJ4EfO_Dl4n2y0zlqh_0 2024-09-12T17:49:16.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17968507671489948145', time=2024-09-12T19:44:49.471930+0000, chain.objs.size()=1 2024-09-12T17:49:16.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.krVDzM65-Go9nKUvM-fmRowTgJ2MNy0_0 2024-09-12T17:49:16.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8945955093618764623', time=2024-09-12T19:44:51.140784+0000, chain.objs.size()=1 2024-09-12T17:49:16.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.KlCqpriBwyA5WTmbRsgIPj52sJMpRJl_0 2024-09-12T17:49:16.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8819998350841368509', time=2024-09-12T19:45:24.133406+0000, chain.objs.size()=1 2024-09-12T17:49:16.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.5svN4AbcZlYvwRGWJ5er28SAZP5b2dc_0 2024-09-12T17:49:16.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2528984886071338228', time=2024-09-12T19:45:25.750953+0000, chain.objs.size()=1 2024-09-12T17:49:16.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.96E0Iuj0TlHLOLlVlGp59kEa08GJ47D_0 2024-09-12T17:49:16.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.330012076918926256', time=2024-09-12T19:45:59.929472+0000, chain.objs.size()=1 2024-09-12T17:49:16.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.nSByb0Ma_dUcALKHKGqyrKD8vOP-him_0 2024-09-12T17:49:16.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14673365124033659102', time=2024-09-12T19:45:59.932649+0000, chain.objs.size()=1 2024-09-12T17:49:16.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.OEt5E4BMwrFvCkHnQpfWvPOFaX-lOrf_0 2024-09-12T17:49:16.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7162359276085129298', time=2024-09-12T19:46:32.781179+0000, chain.objs.size()=1 2024-09-12T17:49:16.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.222+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.87LrH0N7TnIr_cKwSW8Tytu-_QKRNs0_0 2024-09-12T17:49:16.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.225+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13192340852411350291', time=2024-09-12T19:48:39.207868+0000, chain.objs.size()=1 2024-09-12T17:49:16.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.225+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18__shadow_.-2pU2SqFEPoNkL_0LkgV_uBgL0hMOe2_0 2024-09-12T17:49:16.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.226+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.228+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:49:16.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.229+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T17:49:16.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17883539685741343909', time=2024-09-12T19:40:37.162719+0000, chain.objs.size()=2 2024-09-12T17:49:16.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14__shadow_.OGjzaPL7RJU0k77d7ZJ-G-jtSMg9AFE_0 2024-09-12T17:49:16.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14__shadow_.OGjzaPL7RJU0k77d7ZJ-G-jtSMg9AFE_1 2024-09-12T17:49:16.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13965140996840422782', time=2024-09-12T19:42:33.448425+0000, chain.objs.size()=1 2024-09-12T17:49:16.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.g0T0x__R3MVwcJbaWUyjgOdQDnRpD4y_0 2024-09-12T17:49:16.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2967055313848529289', time=2024-09-12T19:43:05.817839+0000, chain.objs.size()=1 2024-09-12T17:49:16.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.83TWFQcTOQE9boaBTKJThKdUm765dvO_0 2024-09-12T17:49:16.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.883051484095050383', time=2024-09-12T19:43:07.627826+0000, chain.objs.size()=1 2024-09-12T17:49:16.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.rYcsGEeuIwA_cujtNT0zL7nq8t_2PsL_0 2024-09-12T17:49:16.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13422521360647897314', time=2024-09-12T19:43:08.523795+0000, chain.objs.size()=1 2024-09-12T17:49:16.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.LN91x1Zrfy4exTPgMJLUiS59EEb3qHo_0 2024-09-12T17:49:16.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.991721765207431150', time=2024-09-12T19:43:08.532201+0000, chain.objs.size()=1 2024-09-12T17:49:16.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.ZUiy5526sCtW0NDtrNxz7u_ftNmOju2_0 2024-09-12T17:49:16.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.203332412474001328', time=2024-09-12T19:43:40.287962+0000, chain.objs.size()=1 2024-09-12T17:49:16.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.v1P_UwYHEcRc83k6EZEV_PoDeqGafmI_0 2024-09-12T17:49:16.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14971026936296526400', time=2024-09-12T19:43:41.899028+0000, chain.objs.size()=1 2024-09-12T17:49:16.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.4O2wCI35kSpQDADiBd0yAQxtqhJI6m5_0 2024-09-12T17:49:16.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6530454793830653224', time=2024-09-12T19:43:41.899956+0000, chain.objs.size()=1 2024-09-12T17:49:16.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.PP0OZo6aYAORHQzVCvrb-8GakyYbUSg_0 2024-09-12T17:49:16.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11354994928206216946', time=2024-09-12T19:44:16.314566+0000, chain.objs.size()=1 2024-09-12T17:49:16.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.E-CLjCB8ww3AoUv2lLf7jW4QOaHxzYU_0 2024-09-12T17:49:16.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3229758165952417354', time=2024-09-12T19:45:25.748507+0000, chain.objs.size()=1 2024-09-12T17:49:16.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.230+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.HOFIHtCyun_HfI94pnes-K1cBLRrBOf_0 2024-09-12T17:49:16.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.233+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11187711274388664150', time=2024-09-12T19:45:57.904561+0000, chain.objs.size()=1 2024-09-12T17:49:16.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.233+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.rj40-SgOs-n-RMZIixQby5-j15ko2Lz_0 2024-09-12T17:49:16.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.234+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.236+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:49:16.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.238+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.238+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T17:49:16.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='_sIngmwhhEJFO_LEmrJ-X3Vj2laSSNbJ', time=2024-09-12T19:40:37.005090+0000, chain.objs.size()=1 2024-09-12T17:49:16.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.PAoIELUVkCV3N8_HA4qCft9MERzXGqH_0 2024-09-12T17:49:16.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6479784917926609725', time=2024-09-12T19:42:30.578523+0000, chain.objs.size()=1 2024-09-12T17:49:16.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.3U53w4MZDm86XNmgfoG535ziGve6Plt_0 2024-09-12T17:49:16.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6791754973801090320', time=2024-09-12T19:42:33.450881+0000, chain.objs.size()=1 2024-09-12T17:49:16.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.-NN6FetzWdWIXqnIbuy0mohGr0lSDSR_0 2024-09-12T17:49:16.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12848796140324487066', time=2024-09-12T19:43:05.817366+0000, chain.objs.size()=1 2024-09-12T17:49:16.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_._Et2ElgxZ_ZKnJ-WCc34EVSiMgOcJDj_0 2024-09-12T17:49:16.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7983911526973570967', time=2024-09-12T19:43:05.824838+0000, chain.objs.size()=1 2024-09-12T17:49:16.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.-v2-dDRqoPAX7Vk7PVU0lBQ5IncoQS4_0 2024-09-12T17:49:16.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12581265462386900851', time=2024-09-12T19:43:41.897867+0000, chain.objs.size()=1 2024-09-12T17:49:16.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.-6MF1FlkOpQRi0PFGibm9H7WnN0I_vl_0 2024-09-12T17:49:16.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8623887615168699286', time=2024-09-12T19:44:14.072275+0000, chain.objs.size()=1 2024-09-12T17:49:16.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.NCFA2W_jp30mGGUMbDwRu9CYHzjSCgY_0 2024-09-12T17:49:16.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8790675501326639796', time=2024-09-12T19:45:57.911789+0000, chain.objs.size()=1 2024-09-12T17:49:16.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.fXJvBxzX0Su0piuZDL-LTF3fPSFpwLO_0 2024-09-12T17:49:16.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8057468635919425765', time=2024-09-12T19:45:59.932029+0000, chain.objs.size()=1 2024-09-12T17:49:16.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.ABECL460E8nCYvMHGCfoqHR8CjNuzOa_0 2024-09-12T17:49:16.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8060351885060311602', time=2024-09-12T19:46:00.810342+0000, chain.objs.size()=1 2024-09-12T17:49:16.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.PgDlC5aYdeMESaYnTWBeYeoDPKsFrHb_0 2024-09-12T17:49:16.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7896311330592069300', time=2024-09-12T19:46:32.789698+0000, chain.objs.size()=1 2024-09-12T17:49:16.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.239+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.0figSYU89N2NztuLExu1gfxjbgLcK5N_0 2024-09-12T17:49:16.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.241+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.243+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:49:16.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.244+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T17:49:16.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15924639319525217491', time=2024-09-12T19:40:36.881335+0000, chain.objs.size()=1 2024-09-12T17:49:16.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_._DP89vAzz6UafXQ6BO13aCMjU517bkA_0 2024-09-12T17:49:16.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6509013376206427276', time=2024-09-12T19:40:37.113217+0000, chain.objs.size()=3 2024-09-12T17:49:16.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-FROZEN.2~RMRL9v_ZGzvLL32l7BQtIiRkVd-59Kk.1 2024-09-12T17:49:16.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-FROZEN.2~RMRL9v_ZGzvLL32l7BQtIiRkVd-59Kk.2 2024-09-12T17:49:16.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-FROZEN.2~RMRL9v_ZGzvLL32l7BQtIiRkVd-59Kk.3 2024-09-12T17:49:16.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13233250386000930546', time=2024-09-12T19:41:57.167885+0000, chain.objs.size()=1 2024-09-12T17:49:16.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.bGAC3RX0jPFJbc80s25u58QISEmPCRP_0 2024-09-12T17:49:16.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5420402188804943514', time=2024-09-12T19:41:57.172257+0000, chain.objs.size()=1 2024-09-12T17:49:16.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.P0cvosnXOlm6bPVTsDXCBgRPbT1k6Ju_0 2024-09-12T17:49:16.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7378553304997970532', time=2024-09-12T19:42:30.577093+0000, chain.objs.size()=1 2024-09-12T17:49:16.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.35Ao-2ZpQ437LoPBpo-QlINhfsQYJgH_0 2024-09-12T17:49:16.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11998228959273770089', time=2024-09-12T19:42:32.374870+0000, chain.objs.size()=1 2024-09-12T17:49:16.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.BJUkVn3ATO3aneF5hwbLHYuDFv6gdET_0 2024-09-12T17:49:16.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19466855382588396', time=2024-09-12T19:42:33.456680+0000, chain.objs.size()=1 2024-09-12T17:49:16.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.NiItKb9MK0SZo3z5VLH8mGfGRLILTh1_0 2024-09-12T17:49:16.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7374465454132915275', time=2024-09-12T19:43:05.816087+0000, chain.objs.size()=1 2024-09-12T17:49:16.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.qfyI3xFBG3tHct9FUv7NYPiwJk-7MQQ_0 2024-09-12T17:49:16.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.737323527138346736', time=2024-09-12T19:43:07.619568+0000, chain.objs.size()=1 2024-09-12T17:49:16.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.Gaj3lKw2V_R6Y4AUh-U1PSQMSdQ70AF_0 2024-09-12T17:49:16.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14506217065542209179', time=2024-09-12T19:43:08.528467+0000, chain.objs.size()=1 2024-09-12T17:49:16.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.245+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.VyCG85sclZwPGT4inO1EVT14gSwdyX5_0 2024-09-12T17:49:16.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6780951672121538160', time=2024-09-12T19:43:08.530729+0000, chain.objs.size()=1 2024-09-12T17:49:16.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.Cjsuegm89eGZiAbpvbEYTljkxKhSNOM_0 2024-09-12T17:49:16.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10145692645515907401', time=2024-09-12T19:43:41.900022+0000, chain.objs.size()=1 2024-09-12T17:49:16.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.C7E82emvWH1_ZWbzhljiXUzJgdTfVEw_0 2024-09-12T17:49:16.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8177164261668213886', time=2024-09-12T19:44:16.314565+0000, chain.objs.size()=1 2024-09-12T17:49:16.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.6q3mwJi9gZ-vGpQGNbS3LJ9zZ6fedMy_0 2024-09-12T17:49:16.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8982242836863142066', time=2024-09-12T19:44:16.315523+0000, chain.objs.size()=1 2024-09-12T17:49:16.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.QwYTQTuzA8_WeVW2gzH8gG9iDSR1Wqq_0 2024-09-12T17:49:16.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9035945988437218435', time=2024-09-12T19:44:49.471066+0000, chain.objs.size()=1 2024-09-12T17:49:16.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.rn1zX9Bk_cJ4-MUQgIIfk9Z-bVNQIJt_0 2024-09-12T17:49:16.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6046161055195158941', time=2024-09-12T19:45:57.904648+0000, chain.objs.size()=1 2024-09-12T17:49:16.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.Oyj23JuC_cQNdQele0fhdjeL78PfcEd_0 2024-09-12T17:49:16.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.361359323570821645', time=2024-09-12T19:45:59.931883+0000, chain.objs.size()=1 2024-09-12T17:49:16.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.4oKHKLwclilOEBu44hSoRJ6ig4Xz7n3_0 2024-09-12T17:49:16.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16875461741032701065', time=2024-09-12T19:46:32.783511+0000, chain.objs.size()=1 2024-09-12T17:49:16.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.qMf64UnQowa6EGcsneQeYNJotEMwQwU_0 2024-09-12T17:49:16.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6946167903630348425', time=2024-09-12T19:48:39.207685+0000, chain.objs.size()=1 2024-09-12T17:49:16.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18__shadow_.4CcXKceKELQegmpfuce67XgVWMNJwdO_0 2024-09-12T17:49:16.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16009805199588066130', time=2024-09-12T19:48:51.595491+0000, chain.objs.size()=1 2024-09-12T17:49:16.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.248+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19__shadow:OLaIQyzN4qOABtg6apKudHaC5rG1BTu_.bt6Gr4rq5ZD0zrCsx5DFF1ao0nN17-7_0 2024-09-12T17:49:16.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.250+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.253+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:49:16.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.254+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.254+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T17:49:16.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8185051609922464666', time=2024-09-12T19:40:37.097602+0000, chain.objs.size()=3 2024-09-12T17:49:16.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-LUKEWARM.2~ssz7_zxUOUxqBgdsXGLL_9cUfBs2Tgo.1 2024-09-12T17:49:16.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-LUKEWARM.2~ssz7_zxUOUxqBgdsXGLL_9cUfBs2Tgo.2 2024-09-12T17:49:16.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-LUKEWARM.2~ssz7_zxUOUxqBgdsXGLL_9cUfBs2Tgo.3 2024-09-12T17:49:16.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6135469553827132502', time=2024-09-12T19:41:57.164234+0000, chain.objs.size()=1 2024-09-12T17:49:16.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.R92-A6EF7KTpnQy9hpIOPLwaPKwKm-9_0 2024-09-12T17:49:16.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2399146937807494041', time=2024-09-12T19:42:30.581199+0000, chain.objs.size()=1 2024-09-12T17:49:16.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.dgaA1IF6zzhgEOzysRzR4dfsAKL6DCq_0 2024-09-12T17:49:16.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1029217977824277060', time=2024-09-12T19:42:33.456204+0000, chain.objs.size()=1 2024-09-12T17:49:16.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.VhL0j_jVA1LaCisiDxjSk9xv882FvPQ_0 2024-09-12T17:49:16.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11326381187636103351', time=2024-09-12T19:43:05.816249+0000, chain.objs.size()=1 2024-09-12T17:49:16.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.2uOVn5gl6-Tk0dgd2LsZ1MT7CGTAjaU_0 2024-09-12T17:49:16.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1258183816854530999', time=2024-09-12T19:43:07.619539+0000, chain.objs.size()=1 2024-09-12T17:49:16.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.WwixCEP0Kj5d9TrY8n18SlmyX4kHFex_0 2024-09-12T17:49:16.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4499136163928953761', time=2024-09-12T19:43:07.623570+0000, chain.objs.size()=1 2024-09-12T17:49:16.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.fOvFD6uJtSxSfUPYbjf7nsTE0RXm0Fr_0 2024-09-12T17:49:16.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5555881210586585104', time=2024-09-12T19:45:25.746537+0000, chain.objs.size()=1 2024-09-12T17:49:16.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.bb_efJJaXPr2PUCk4f310WOiL35P5vw_0 2024-09-12T17:49:16.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13884422283123424454', time=2024-09-12T19:45:25.747697+0000, chain.objs.size()=1 2024-09-12T17:49:16.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.Vd9zOtLUk6zldl0uosDhF_JicTxetFM_0 2024-09-12T17:49:16.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2240253222512760298', time=2024-09-12T19:48:39.209762+0000, chain.objs.size()=1 2024-09-12T17:49:16.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.255+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18__shadow_.iE037STCl-HPhLHc4DSQCfzM6A1104V_0 2024-09-12T17:49:16.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.257+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.260+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:49:16.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.261+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T17:49:16.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='_e-VKmUqIQEL1CqtVdQ6__2_t0CSv0XW', time=2024-09-12T19:40:37.079851+0000, chain.objs.size()=2 2024-09-12T17:49:16.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.4sW-IHpgMqy1laQvHuremRuKLkP_-Qb_0 2024-09-12T17:49:16.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.4sW-IHpgMqy1laQvHuremRuKLkP_-Qb_1 2024-09-12T17:49:16.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8197730925047866208', time=2024-09-12T19:41:57.168269+0000, chain.objs.size()=1 2024-09-12T17:49:16.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.56Nrexisn20QbMnk435-G8tDfnuWDJB_0 2024-09-12T17:49:16.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14781232669476658051', time=2024-09-12T19:41:58.448121+0000, chain.objs.size()=1 2024-09-12T17:49:16.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.XDLqGHgOS-RdVokOAV9CLaI89JuW_76_0 2024-09-12T17:49:16.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15364132121258362000', time=2024-09-12T19:42:30.574862+0000, chain.objs.size()=1 2024-09-12T17:49:16.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.nFbqiQHBd6CXzqfQt9yYDDCUDe0t_L7_0 2024-09-12T17:49:16.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14813671426183866974', time=2024-09-12T19:42:33.448664+0000, chain.objs.size()=1 2024-09-12T17:49:16.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.ZEcCnKjQoP7HGeF_98P3TA3Qjt0sBom_0 2024-09-12T17:49:16.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3879181535993454224', time=2024-09-12T19:42:34.482927+0000, chain.objs.size()=1 2024-09-12T17:49:16.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.CIJfQa1jtwPmkHocec_uoYes9cI7n05_0 2024-09-12T17:49:16.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14169491223596658431', time=2024-09-12T19:43:07.628869+0000, chain.objs.size()=1 2024-09-12T17:49:16.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.VOQExq7tFCdpTihTbCO6Vh18fYfbzHL_0 2024-09-12T17:49:16.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6500073372622559091', time=2024-09-12T19:43:08.524595+0000, chain.objs.size()=1 2024-09-12T17:49:16.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.uUh9Un2v7TA_vKoGw7OnwiJe1Z-zwJQ_0 2024-09-12T17:49:16.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1799797641144803544', time=2024-09-12T19:43:41.902865+0000, chain.objs.size()=1 2024-09-12T17:49:16.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.KKI_vn91_5GcfNBpfjPsnm91EZbuTjS_0 2024-09-12T17:49:16.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8327591203021420689', time=2024-09-12T19:43:41.907321+0000, chain.objs.size()=1 2024-09-12T17:49:16.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.XLTnU0jRCkUi7mlU6RuKdbfkX6Ef2FQ_0 2024-09-12T17:49:16.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4847629956167609682', time=2024-09-12T19:44:14.070297+0000, chain.objs.size()=1 2024-09-12T17:49:16.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.262+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.2fkYfkl-Eyog2W13H3qXF44641IxfZu_0 2024-09-12T17:49:16.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.265+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12410067471445911098', time=2024-09-12T19:44:15.763225+0000, chain.objs.size()=1 2024-09-12T17:49:16.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.265+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.s6dUVgL-fhkG-OcHMl8dUON5sQidBMb_0 2024-09-12T17:49:16.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.265+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11050922870040750364', time=2024-09-12T19:44:48.904635+0000, chain.objs.size()=1 2024-09-12T17:49:16.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.265+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.5xQqvKhzjimVfIyKZZO1_atYKnHkA0G_0 2024-09-12T17:49:16.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.265+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15744202468099784196', time=2024-09-12T19:44:49.471983+0000, chain.objs.size()=1 2024-09-12T17:49:16.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.265+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.GiBPAyymivaWf7fNmTi2MbrFyLTpqWX_0 2024-09-12T17:49:16.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.265+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9047704914933403295', time=2024-09-12T19:44:51.135457+0000, chain.objs.size()=1 2024-09-12T17:49:16.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.265+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.0v5nl9BIUH-5Jg1wjKFyFV1XtvHObOR_0 2024-09-12T17:49:16.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.265+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15705464920763503495', time=2024-09-12T19:46:00.806819+0000, chain.objs.size()=1 2024-09-12T17:49:16.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.265+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.Mtaa9EE89-ALo2MYHrhKfSWDQGaXF7q_0 2024-09-12T17:49:16.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.265+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11694564262616767142', time=2024-09-12T19:46:00.808839+0000, chain.objs.size()=1 2024-09-12T17:49:16.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.265+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.lwQtYMRq37ixS-NkPfqtnpNY43INXU3_0 2024-09-12T17:49:16.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.265+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6861321178642340093', time=2024-09-12T19:46:32.783191+0000, chain.objs.size()=1 2024-09-12T17:49:16.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.265+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.zWN-5L9p_ISNnMZourLCKYSKLlh_eur_0 2024-09-12T17:49:16.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.265+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4632982735323657483', time=2024-09-12T19:48:51.595886+0000, chain.objs.size()=1 2024-09-12T17:49:16.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.265+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19__shadow:eLwx9QFfTwSo4OJmAdOzMC-zfq13aul_.PqxBuRFov_9YFry_yKFvR7VkrfiNuAh_0 2024-09-12T17:49:16.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.266+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.269+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:49:16.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.270+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T17:49:16.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='_TXzTEVJVXDd4oVuqZNVD9sq-UJjQvjv', time=2024-09-12T19:40:37.083921+0000, chain.objs.size()=2 2024-09-12T17:49:16.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.Zo45XUJJ78hthOTePv8jHQVRuw6B-2D_0 2024-09-12T17:49:16.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.Zo45XUJJ78hthOTePv8jHQVRuw6B-2D_1 2024-09-12T17:49:16.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3028398640669717044', time=2024-09-12T19:41:58.438389+0000, chain.objs.size()=1 2024-09-12T17:49:16.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.g44ARBc5DXbLYDHvmcv8zqTcX_7H4lj_0 2024-09-12T17:49:16.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4311699908441625638', time=2024-09-12T19:41:58.439328+0000, chain.objs.size()=1 2024-09-12T17:49:16.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.0WlU-M6vx2MVCNA6FoMvA_vO3vma4Uv_0 2024-09-12T17:49:16.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4922728903866305273', time=2024-09-12T19:42:30.575446+0000, chain.objs.size()=1 2024-09-12T17:49:16.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.ZCznbtep89HqU2-7GjiHEvrCq03iHtm_0 2024-09-12T17:49:16.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7549708614367456910', time=2024-09-12T19:42:30.578430+0000, chain.objs.size()=1 2024-09-12T17:49:16.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.uSqbYmLAQQ2XaCPQOTXj7nqKNN9__Y3_0 2024-09-12T17:49:16.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16045117580339130544', time=2024-09-12T19:42:31.829942+0000, chain.objs.size()=1 2024-09-12T17:49:16.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.WljhOWB2kZ7NvYm-vwzKdAoMN4hTyb3_0 2024-09-12T17:49:16.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5566227784017243259', time=2024-09-12T19:44:51.134522+0000, chain.objs.size()=1 2024-09-12T17:49:16.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.4zErzavNmxSPDKxTFHERRqmN2mMFYO6_0 2024-09-12T17:49:16.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8581243592708123255', time=2024-09-12T19:45:24.127563+0000, chain.objs.size()=1 2024-09-12T17:49:16.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.BSnb4eqgKHj_zV6HEIaLPt0yFIEKlKn_0 2024-09-12T17:49:16.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14515696332259881518', time=2024-09-12T19:45:24.129220+0000, chain.objs.size()=1 2024-09-12T17:49:16.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.LKouRNpa67uMsd1HHJ9aWXrPK1l-DTb_0 2024-09-12T17:49:16.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15894727082068611151', time=2024-09-12T19:45:24.133730+0000, chain.objs.size()=1 2024-09-12T17:49:16.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.1DmYNE14kYTFdB2X4JIfZYJeIZoivs2_0 2024-09-12T17:49:16.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2400867072785445159', time=2024-09-12T19:45:57.907780+0000, chain.objs.size()=1 2024-09-12T17:49:16.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.271+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.JqBlp_hVY0LdlgRJccChYo1DIvBkVVA_0 2024-09-12T17:49:16.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.275+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11527138875916799993', time=2024-09-12T19:45:59.931555+0000, chain.objs.size()=1 2024-09-12T17:49:16.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.275+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.zqOFxLZ6vjC_iuEShioamPmFV5Jm2yy_0 2024-09-12T17:49:16.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.275+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7109165414981000950', time=2024-09-12T19:46:00.806965+0000, chain.objs.size()=1 2024-09-12T17:49:16.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.276+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.0VGzEaexTnUlMkIcBaYOLU-oXaNv7d9_0 2024-09-12T17:49:16.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.276+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294801721766900225', time=2024-09-12T19:46:00.816831+0000, chain.objs.size()=1 2024-09-12T17:49:16.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.276+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.qDNEvWqeBhWGOCDvgWyKjti4x1KQ0MH_0 2024-09-12T17:49:16.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.277+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.279+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:49:16.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.280+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T17:49:16.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2740950164466902422', time=2024-09-12T19:40:37.133058+0000, chain.objs.size()=3 2024-09-12T17:49:16.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-FROZEN.2~sKqHMa903xXWiLZcw2L7IcbpKpArytK.1 2024-09-12T17:49:16.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-FROZEN.2~sKqHMa903xXWiLZcw2L7IcbpKpArytK.2 2024-09-12T17:49:16.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-FROZEN.2~sKqHMa903xXWiLZcw2L7IcbpKpArytK.3 2024-09-12T17:49:16.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4402616036650318100', time=2024-09-12T19:41:58.447278+0000, chain.objs.size()=1 2024-09-12T17:49:16.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.0wBvAEvI8Rn9bQ7I4TZbHvQ6b-y7Dwa_0 2024-09-12T17:49:16.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6559574380280005034', time=2024-09-12T19:42:32.374399+0000, chain.objs.size()=1 2024-09-12T17:49:16.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.VVhkEuTtl-80RsPM2x81iScTOCh95go_0 2024-09-12T17:49:16.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17869235795113165649', time=2024-09-12T19:43:05.820697+0000, chain.objs.size()=1 2024-09-12T17:49:16.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.fqXmYOa_QgtILWY1qCA7-BT-fSkHPDO_0 2024-09-12T17:49:16.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3309348393951285588', time=2024-09-12T19:43:07.622369+0000, chain.objs.size()=1 2024-09-12T17:49:16.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.JD-2pDJUPzu6XwHbERXv6ajBaOwgDJE_0 2024-09-12T17:49:16.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16316189974006535068', time=2024-09-12T19:43:07.624278+0000, chain.objs.size()=1 2024-09-12T17:49:16.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.YDOPtgau39UHWfz5mk_1vZBn1l_7WK-_0 2024-09-12T17:49:16.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.100873166532164141', time=2024-09-12T19:44:16.319305+0000, chain.objs.size()=1 2024-09-12T17:49:16.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.UpCKZdQyyhKbKMP5bKAzdtms4SMT_vB_0 2024-09-12T17:49:16.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6524988872597319760', time=2024-09-12T19:44:49.471059+0000, chain.objs.size()=1 2024-09-12T17:49:16.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.uquk3qoEBQ34dnzIfpGyMhU1mrmBMG5_0 2024-09-12T17:49:16.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16186452799348948359', time=2024-09-12T19:44:49.472983+0000, chain.objs.size()=1 2024-09-12T17:49:16.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.SDNondDShY8UgHx4H42LZbd8oRgk79S_0 2024-09-12T17:49:16.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7584358927171312365', time=2024-09-12T19:44:49.475535+0000, chain.objs.size()=1 2024-09-12T17:49:16.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.281+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.o5kChb6P-Da7CNBzd_EfQE-JhnM0EhU_0 2024-09-12T17:49:16.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.284+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8315241782620641713', time=2024-09-12T19:44:51.132453+0000, chain.objs.size()=1 2024-09-12T17:49:16.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.284+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.9ifx20vIJJ1z4POu0PS_v9n6GviBXSe_0 2024-09-12T17:49:16.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.285+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16285275972686046517', time=2024-09-12T19:45:24.123627+0000, chain.objs.size()=1 2024-09-12T17:49:16.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.285+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.Jou0AhWb4c-duVwh7TUGNOqXD6xAZHr_0 2024-09-12T17:49:16.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.285+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14789141939415549861', time=2024-09-12T19:45:57.902584+0000, chain.objs.size()=1 2024-09-12T17:49:16.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.285+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.cHF0Npy8ZNtlco8cKUK12o84Wi_NMEY_0 2024-09-12T17:49:16.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.285+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7012156346946693090', time=2024-09-12T19:46:00.810665+0000, chain.objs.size()=1 2024-09-12T17:49:16.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.285+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_._W4vAw8ADBlTfDUg_OGWd0kqP-7df79_0 2024-09-12T17:49:16.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.286+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.288+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:49:16.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T17:49:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15280298842536700199', time=2024-09-12T19:41:58.439451+0000, chain.objs.size()=1 2024-09-12T17:49:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.KboTTWk7EiRQg6jLh6wYGk2ZEINIGpC_0 2024-09-12T17:49:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14778986852157784357', time=2024-09-12T19:41:58.440215+0000, chain.objs.size()=1 2024-09-12T17:49:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.h57pfD31-FBTx9hXngEOAIuNwkrkLUZ_0 2024-09-12T17:49:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4153198288074635153', time=2024-09-12T19:42:33.450379+0000, chain.objs.size()=1 2024-09-12T17:49:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.FQehhUy_8fget2M_b8-eMRCob6e9Vag_0 2024-09-12T17:49:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17769857572366450140', time=2024-09-12T19:43:05.817103+0000, chain.objs.size()=1 2024-09-12T17:49:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.uq24ECVxEsgWjbcy4a6xechGQu2rA3q_0 2024-09-12T17:49:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9939393126155847845', time=2024-09-12T19:43:06.875694+0000, chain.objs.size()=1 2024-09-12T17:49:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.xLtxlPwP3TK0w_KCKp5lhCLFiML9ppl_0 2024-09-12T17:49:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15976242711728746861', time=2024-09-12T19:44:49.474058+0000, chain.objs.size()=1 2024-09-12T17:49:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.tZ-NfXg5nWVnnOdsLk8IZuxnV3YDdgO_0 2024-09-12T17:49:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3951283401994751807', time=2024-09-12T19:44:49.477550+0000, chain.objs.size()=1 2024-09-12T17:49:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.GjmoA7n-3RJFsnPYNoMTUxurDGvZwYX_0 2024-09-12T17:49:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18018314357439357423', time=2024-09-12T19:45:59.930581+0000, chain.objs.size()=1 2024-09-12T17:49:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.zq-Eh5ag5XBssq1rkLG169K4Phf7Ws7_0 2024-09-12T17:49:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9936379985450062303', time=2024-09-12T19:46:32.784618+0000, chain.objs.size()=1 2024-09-12T17:49:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.Y6yF-54MwIXs_4jHOvda5JtATKjnxj8_0 2024-09-12T17:49:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5703780466596443345', time=2024-09-12T19:46:32.786642+0000, chain.objs.size()=1 2024-09-12T17:49:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.7W_ktOvtAwcTkcPj9D6JHn4nGpXSuu9_0 2024-09-12T17:49:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7813453517443725466', time=2024-09-12T19:48:39.208672+0000, chain.objs.size()=1 2024-09-12T17:49:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.290+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18__shadow_.S_hmTI8FhDTHio5HFAFzhssjaZ_6PXV_0 2024-09-12T17:49:16.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.293+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.295+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:49:16.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.296+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T17:49:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2324725440601752248', time=2024-09-12T19:40:37.259116+0000, chain.objs.size()=1 2024-09-12T17:49:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9__shadow_.JIuc0aQxsz9ededklDzH-LSd9-BOfO8_0 2024-09-12T17:49:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18016615940133487494', time=2024-09-12T19:41:58.438460+0000, chain.objs.size()=1 2024-09-12T17:49:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.7sdrFhLlzlUGjsj13YvHg5RDmvPTeOt_0 2024-09-12T17:49:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.746521153466575419', time=2024-09-12T19:42:33.450165+0000, chain.objs.size()=1 2024-09-12T17:49:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.QMvmHjLvfG2jLzfcafasDSthmVJpVGT_0 2024-09-12T17:49:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3920358242261909468', time=2024-09-12T19:43:07.623062+0000, chain.objs.size()=1 2024-09-12T17:49:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.GdRv-K3EximXX7k_gQZB1oL0UxyJ-Ug_0 2024-09-12T17:49:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8137590449737961872', time=2024-09-12T19:43:08.525369+0000, chain.objs.size()=1 2024-09-12T17:49:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.c2dE6qR_pDmYvDo8YCCllJlMQ-msMBd_0 2024-09-12T17:49:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7468448412706218732', time=2024-09-12T19:43:08.530820+0000, chain.objs.size()=1 2024-09-12T17:49:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.voFpJvFy70sC_bzQJAVj5QLfvSW5Tpo_0 2024-09-12T17:49:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12171969040991147128', time=2024-09-12T19:43:40.283233+0000, chain.objs.size()=1 2024-09-12T17:49:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.JeZnAOnC3ng4YNyudA3NafGywrWvCwK_0 2024-09-12T17:49:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8812341085785668955', time=2024-09-12T19:44:14.070790+0000, chain.objs.size()=1 2024-09-12T17:49:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.L29U_ltUzuPH9cbDTBqC-hxgUHHzLMy_0 2024-09-12T17:49:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10766028764021913282', time=2024-09-12T19:44:49.471640+0000, chain.objs.size()=1 2024-09-12T17:49:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.L0fGe8DHBsURYKnqX_rI2p7ly7jxWwu_0 2024-09-12T17:49:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18051922522633328808', time=2024-09-12T19:45:57.904240+0000, chain.objs.size()=1 2024-09-12T17:49:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.W0Fi59du5h9mbiRPeebz2uhuAxmt53R_0 2024-09-12T17:49:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14521692909445186706', time=2024-09-12T19:46:00.808992+0000, chain.objs.size()=1 2024-09-12T17:49:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.297+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.xrUiJ6zJIg5P1-fMP7OKxmBerQWvaHT_0 2024-09-12T17:49:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.299+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.301+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:49:16.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.303+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:49:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1353612114100302435', time=2024-09-12T19:40:36.937203+0000, chain.objs.size()=4 2024-09-12T17:49:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13__multipart_foo.2~d1dEjAZ3nPNEaAp64t2Qslnc9uHGIXj.1 2024-09-12T17:49:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13__multipart_foo.2~d1dEjAZ3nPNEaAp64t2Qslnc9uHGIXj.2 2024-09-12T17:49:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13__multipart_foo.2~d1dEjAZ3nPNEaAp64t2Qslnc9uHGIXj.3 2024-09-12T17:49:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13__multipart_foo.2~d1dEjAZ3nPNEaAp64t2Qslnc9uHGIXj.4 2024-09-12T17:49:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6941519797814577745', time=2024-09-12T19:41:57.169669+0000, chain.objs.size()=1 2024-09-12T17:49:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.eeOfiuzjtbI_o1sa-wmd5EObYt1XNv6_0 2024-09-12T17:49:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11070243605197498928', time=2024-09-12T19:41:58.442151+0000, chain.objs.size()=1 2024-09-12T17:49:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.4pXv0Dy2cP-16fv7mHuRAsUv1RDrBPX_0 2024-09-12T17:49:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5522807803070450673', time=2024-09-12T19:42:32.381072+0000, chain.objs.size()=1 2024-09-12T17:49:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.PMIr4l7rjgwqF71r1edW2Q4qd0z9Vfy_0 2024-09-12T17:49:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14475925205840507411', time=2024-09-12T19:43:42.752621+0000, chain.objs.size()=1 2024-09-12T17:49:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.q0sy0Vhu9wZoearPBZtE4YKfvZEsSeS_0 2024-09-12T17:49:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17044054384423943158', time=2024-09-12T19:44:14.070106+0000, chain.objs.size()=1 2024-09-12T17:49:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.xAkCsgWkIXcevVlgsQ0hV0bASAGz_jF_0 2024-09-12T17:49:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13742428782209696318', time=2024-09-12T19:44:16.310312+0000, chain.objs.size()=1 2024-09-12T17:49:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.4AQk7ayYt6U1-sMb7g0lOI0xgQkaRSH_0 2024-09-12T17:49:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6313741681845798289', time=2024-09-12T19:44:17.599911+0000, chain.objs.size()=1 2024-09-12T17:49:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.TkE5Vh8Gme7s94ICScrba3DQOknT_OH_0 2024-09-12T17:49:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9962913727948797405', time=2024-09-12T19:44:51.135603+0000, chain.objs.size()=1 2024-09-12T17:49:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.304+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.xQa8A2A_OEguCHi5weU9-p7jFu_b51H_0 2024-09-12T17:49:16.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.309+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14568472465870859600', time=2024-09-12T19:45:24.125037+0000, chain.objs.size()=1 2024-09-12T17:49:16.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.309+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_._LdjIiSO1E_T3hBUX6PcVpous5FrPK4_0 2024-09-12T17:49:16.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.309+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10010804985229042939', time=2024-09-12T19:45:25.749045+0000, chain.objs.size()=1 2024-09-12T17:49:16.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.309+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.baySwwvdDO72hlw740ZRIiQK_w1OsDD_0 2024-09-12T17:49:16.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.309+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2023201874911523345', time=2024-09-12T19:45:57.907997+0000, chain.objs.size()=1 2024-09-12T17:49:16.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.309+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.aNL113Jd7sb4gpNysVDTPK4L4QhVYCK_0 2024-09-12T17:49:16.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.309+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14683039162599917182', time=2024-09-12T19:45:59.928905+0000, chain.objs.size()=1 2024-09-12T17:49:16.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.309+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.C4AD6VehoTonEphLPj0drrL0hXPCEQk_0 2024-09-12T17:49:16.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.310+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.312+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:49:16.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.314+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.314+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T17:49:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12794308448852367148', time=2024-09-12T19:40:36.888875+0000, chain.objs.size()=1 2024-09-12T17:49:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5__shadow_.vnmohf16Y4Y2g1QDvYDCsM-mihY1qZW_0 2024-09-12T17:49:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2740387141388103082', time=2024-09-12T19:40:37.040631+0000, chain.objs.size()=1 2024-09-12T17:49:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.pJ9fvemURAFQva4hPdq2RQXLESba0Ek_0 2024-09-12T17:49:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11050587786955050156', time=2024-09-12T19:40:37.075245+0000, chain.objs.size()=3 2024-09-12T17:49:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-FROZEN.2~RMRL9v_ZGzvLL32l7BQtIiRkVd-59Kk.1 2024-09-12T17:49:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-FROZEN.2~RMRL9v_ZGzvLL32l7BQtIiRkVd-59Kk.2 2024-09-12T17:49:16.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-FROZEN.2~RMRL9v_ZGzvLL32l7BQtIiRkVd-59Kk.3 2024-09-12T17:49:16.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8062856710261337979', time=2024-09-12T19:41:58.448663+0000, chain.objs.size()=1 2024-09-12T17:49:16.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.BiokAoDQtkOe5OsihupQT7wIdPuNdin_0 2024-09-12T17:49:16.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8799903772486332789', time=2024-09-12T19:42:33.456417+0000, chain.objs.size()=1 2024-09-12T17:49:16.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.VQKv6gZrAd1o-Fx3-tJJfiORZLKRxqz_0 2024-09-12T17:49:16.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3940940296777308441', time=2024-09-12T19:43:07.619617+0000, chain.objs.size()=1 2024-09-12T17:49:16.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.-HuXekVry38oXZHMIUaiVlxVDzkJ4mU_0 2024-09-12T17:49:16.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12712623164508927179', time=2024-09-12T19:43:08.524735+0000, chain.objs.size()=1 2024-09-12T17:49:16.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.0WyiLHqvgVdxP2jjl95aSu9mJjB47Hv_0 2024-09-12T17:49:16.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5406244622415131315', time=2024-09-12T19:43:08.525392+0000, chain.objs.size()=1 2024-09-12T17:49:16.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.7ZzobT5nasZb825wLqiQmH7RhR6bVdM_0 2024-09-12T17:49:16.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10254031702600902001', time=2024-09-12T19:43:40.284574+0000, chain.objs.size()=1 2024-09-12T17:49:16.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.wggdVrkrL979WRaAcXKBtLf6Uh3sYgt_0 2024-09-12T17:49:16.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3620394026043215120', time=2024-09-12T19:43:40.285570+0000, chain.objs.size()=1 2024-09-12T17:49:16.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.315+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.OkS8dHcWO3LCQmhj8S6BG3GFG14F5bm_0 2024-09-12T17:49:16.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.317+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7602778944803010533', time=2024-09-12T19:43:41.899099+0000, chain.objs.size()=1 2024-09-12T17:49:16.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.317+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.tWLaHXaKYD63G_mx06LQx9gmVuEbr5c_0 2024-09-12T17:49:16.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.317+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16209837889568295907', time=2024-09-12T19:44:17.598183+0000, chain.objs.size()=1 2024-09-12T17:49:16.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.317+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.d_os6P-4YgUu36ZQvo9WTtajkfK5atJ_0 2024-09-12T17:49:16.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.318+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4905371228938767993', time=2024-09-12T19:44:51.135468+0000, chain.objs.size()=1 2024-09-12T17:49:16.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.318+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.rgDQSvkTUmJzK91vW73LSV_BGU6QgVB_0 2024-09-12T17:49:16.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.318+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15804486709975015070', time=2024-09-12T19:45:57.904640+0000, chain.objs.size()=1 2024-09-12T17:49:16.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.318+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.b7uhbOzSeVOOxJwXgWZCqUDkRnSUIrc_0 2024-09-12T17:49:16.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.318+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12488987189673306436', time=2024-09-12T19:45:59.190357+0000, chain.objs.size()=1 2024-09-12T17:49:16.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.318+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.gmaGqc8loClRxdkhZKLx2k3N8jLFSKW_0 2024-09-12T17:49:16.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.319+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.321+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:49:16.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.323+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.323+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T17:49:16.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12400660657098538879', time=2024-09-12T19:40:37.090116+0000, chain.objs.size()=3 2024-09-12T17:49:16.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-STANDARD.2~iXSIErO2B2bnt30qSQCjizSuiZJeov6.1 2024-09-12T17:49:16.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-STANDARD.2~iXSIErO2B2bnt30qSQCjizSuiZJeov6.2 2024-09-12T17:49:16.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-STANDARD.2~iXSIErO2B2bnt30qSQCjizSuiZJeov6.3 2024-09-12T17:49:16.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18263488518417133553', time=2024-09-12T19:40:37.140963+0000, chain.objs.size()=3 2024-09-12T17:49:16.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-LUKEWARM.2~-6Gu2OqSRD9WQ9P2FG_Y5JqhVrWzr8F.1 2024-09-12T17:49:16.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-LUKEWARM.2~-6Gu2OqSRD9WQ9P2FG_Y5JqhVrWzr8F.2 2024-09-12T17:49:16.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15__multipart_foo-LUKEWARM.2~-6Gu2OqSRD9WQ9P2FG_Y5JqhVrWzr8F.3 2024-09-12T17:49:16.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13595991226678257463', time=2024-09-12T19:41:57.165415+0000, chain.objs.size()=1 2024-09-12T17:49:16.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.F6kl2zNIublQacveFgzvhpfXVDlpqKh_0 2024-09-12T17:49:16.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1237676080887308997', time=2024-09-12T19:42:30.573335+0000, chain.objs.size()=1 2024-09-12T17:49:16.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.DXsjmUhL9xBW94CL5jIE1cw-B2uaD7u_0 2024-09-12T17:49:16.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1033890812107764035', time=2024-09-12T19:42:32.373269+0000, chain.objs.size()=1 2024-09-12T17:49:16.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.STy3AfmXSVSygKeN6eknSing0N0UhW9_0 2024-09-12T17:49:16.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3341428241055268268', time=2024-09-12T19:42:32.374976+0000, chain.objs.size()=1 2024-09-12T17:49:16.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.7A5MD9YmKjgS1NbQ4CbPQ5zOdQPqeDj_0 2024-09-12T17:49:16.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10948716260347221809', time=2024-09-12T19:42:33.449966+0000, chain.objs.size()=1 2024-09-12T17:49:16.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.vuk1LNdUVPyLk3RxR1ur57C-jtzA7P4_0 2024-09-12T17:49:16.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11632433492476906576', time=2024-09-12T19:43:05.820407+0000, chain.objs.size()=1 2024-09-12T17:49:16.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.324+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.x072FRR2XrTyPA0vw3QWBASF7tmpD96_0 2024-09-12T17:49:16.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13082951291792192192', time=2024-09-12T19:43:40.283723+0000, chain.objs.size()=1 2024-09-12T17:49:16.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.PM2AN3VUbR7QeOEheRHbljZsezM8M-S_0 2024-09-12T17:49:16.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16519681634376611805', time=2024-09-12T19:43:40.287708+0000, chain.objs.size()=1 2024-09-12T17:49:16.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.3p8CEePSjBijNYoLDfIrWd-eAptoLOZ_0 2024-09-12T17:49:16.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8574048111117350456', time=2024-09-12T19:43:41.904568+0000, chain.objs.size()=1 2024-09-12T17:49:16.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.gEOp46F_nHkHtf1JYdAqpGngOQDIp2X_0 2024-09-12T17:49:16.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1151523778703814379', time=2024-09-12T19:44:14.070459+0000, chain.objs.size()=1 2024-09-12T17:49:16.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.YIp2Raf7mpBO5mvPonr4K0BPe_W9hj0_0 2024-09-12T17:49:16.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6337945828737970455', time=2024-09-12T19:44:14.076723+0000, chain.objs.size()=1 2024-09-12T17:49:16.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.6c7DcYMJrLlxk82n9DONRmInz4lss8E_0 2024-09-12T17:49:16.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4465503852239905650', time=2024-09-12T19:44:16.315283+0000, chain.objs.size()=1 2024-09-12T17:49:16.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.81w5YhIVMx8UYm08b32bAkXycyXMNYK_0 2024-09-12T17:49:16.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16319174295256241350', time=2024-09-12T19:44:49.473015+0000, chain.objs.size()=1 2024-09-12T17:49:16.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.lab6yf1ZxwzSSrBpzgVQ2-vdCTiViWG_0 2024-09-12T17:49:16.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13606603538257504809', time=2024-09-12T19:44:51.131522+0000, chain.objs.size()=1 2024-09-12T17:49:16.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.YJiIuOgbAmqEJ0tF3beGI3QlzTw4vCv_0 2024-09-12T17:49:16.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8267976096517389597', time=2024-09-12T19:44:51.132849+0000, chain.objs.size()=1 2024-09-12T17:49:16.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.tenn_eD_8FC5YlApkM1rjgdgYwFyor9_0 2024-09-12T17:49:16.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18006963707286829176', time=2024-09-12T19:45:24.125606+0000, chain.objs.size()=1 2024-09-12T17:49:16.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.m4PNBICJ7zIZT-crc1iaQD-ho999rV__0 2024-09-12T17:49:16.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6615961989025533483', time=2024-09-12T19:46:00.812200+0000, chain.objs.size()=1 2024-09-12T17:49:16.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.327+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.Tfv2C6l9lPku06gAEtH8eyRwBGdUUKd_0 2024-09-12T17:49:16.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.328+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1893158342134295756', time=2024-09-12T19:48:47.302892+0000, chain.objs.size()=1 2024-09-12T17:49:16.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.328+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19__shadow:iB3px-6H.wcUkKTj9jKNsWe2ygibrTH_.mwftxdQBUpu5LmYvjCduI5u6lb7OMc5_0 2024-09-12T17:49:16.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.330+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.332+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:49:16.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.333+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T17:49:16.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='_WDpieQU95iIZ8-3lNzufZ74DpkCwhlp', time=2024-09-12T19:40:37.044142+0000, chain.objs.size()=1 2024-09-12T17:49:16.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.ng1Ob48byQ4MsIAcmDB7VyDnpvpVvPC_0 2024-09-12T17:49:16.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='_QC5_W-CSLd1KvVqMwHZEqTzOudNw6Iw', time=2024-09-12T19:40:37.068220+0000, chain.objs.size()=2 2024-09-12T17:49:16.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.vcZqT-_ukM84fMRPL_w3-NkeZaf9r22_0 2024-09-12T17:49:16.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__shadow_.vcZqT-_ukM84fMRPL_w3-NkeZaf9r22_1 2024-09-12T17:49:16.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14729610525299173085', time=2024-09-12T19:40:37.262685+0000, chain.objs.size()=1 2024-09-12T17:49:16.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9__shadow_.6u5BHXdudgTeWpEmAg6hBXiKEdbdmAj_0 2024-09-12T17:49:16.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15468766585441663700', time=2024-09-12T19:42:30.579863+0000, chain.objs.size()=1 2024-09-12T17:49:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.T5TmM8XxP3UE2l6TgVZXYla9fcWvqs6_0 2024-09-12T17:49:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12256046913571937882', time=2024-09-12T19:42:32.371154+0000, chain.objs.size()=1 2024-09-12T17:49:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.uRApY2JHHJB6zk44mkNquxTrWbvFcsZ_0 2024-09-12T17:49:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2330033464716761628', time=2024-09-12T19:42:32.371902+0000, chain.objs.size()=1 2024-09-12T17:49:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.OT95aNhDp-sc4AtXbxFvoClYP2v8PIT_0 2024-09-12T17:49:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8917741906980678653', time=2024-09-12T19:42:32.373404+0000, chain.objs.size()=1 2024-09-12T17:49:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.KsbA5YcjtfWe5nyhBJN0p5WH2XPA1JR_0 2024-09-12T17:49:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.619505579148259072', time=2024-09-12T19:42:32.376212+0000, chain.objs.size()=1 2024-09-12T17:49:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.oJkSKlIrY-PTAqy9-j_0Yq3NMDQii0i_0 2024-09-12T17:49:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10350376662562587358', time=2024-09-12T19:43:08.525418+0000, chain.objs.size()=1 2024-09-12T17:49:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.rr5M3IDbwl7m3iyjoipQoIsvuXozQdp_0 2024-09-12T17:49:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9710981630007579026', time=2024-09-12T19:43:40.285907+0000, chain.objs.size()=1 2024-09-12T17:49:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.QY6JoP2jPAZs66l9JT_ETyxaoACDPyA_0 2024-09-12T17:49:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6650529985989524995', time=2024-09-12T19:43:41.897682+0000, chain.objs.size()=1 2024-09-12T17:49:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.334+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.x95nWbt4brhuYWqDM6r1LGp8ODaQ8Uf_0 2024-09-12T17:49:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.336+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16410827271672900331', time=2024-09-12T19:43:41.899659+0000, chain.objs.size()=1 2024-09-12T17:49:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.336+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.Y7XxUJoP47bNOlEWHOWi2J7imQn92WB_0 2024-09-12T17:49:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4002503272092346295', time=2024-09-12T19:44:14.067797+0000, chain.objs.size()=1 2024-09-12T17:49:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.z6_F_MohroSBk7UXQXk-7UR7Hql19Yp_0 2024-09-12T17:49:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6663137316899725171', time=2024-09-12T19:44:16.312892+0000, chain.objs.size()=1 2024-09-12T17:49:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.KpUfhtyIGS5nFrdwIb4hY33Vwf3FxiU_0 2024-09-12T17:49:16.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15715834064423939486', time=2024-09-12T19:44:17.602523+0000, chain.objs.size()=1 2024-09-12T17:49:16.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.0vWNn9TfUQTQYS4MCuB2cbMQvXVWXXH_0 2024-09-12T17:49:16.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4342446194271718989', time=2024-09-12T19:45:24.128612+0000, chain.objs.size()=1 2024-09-12T17:49:16.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.QE35xC4lFxDZcOeEZj4CZlqMtkM3g6g_0 2024-09-12T17:49:16.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10345003848358894162', time=2024-09-12T19:45:25.200082+0000, chain.objs.size()=1 2024-09-12T17:49:16.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.1Zb-MXimX28UMPXSvZx7huGBpQVi5mK_0 2024-09-12T17:49:16.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14681809385727920437', time=2024-09-12T19:45:25.747002+0000, chain.objs.size()=1 2024-09-12T17:49:16.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.RQVeNcpTBwH40si7WgBXuopG02oonAb_0 2024-09-12T17:49:16.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6202872542806932773', time=2024-09-12T19:45:25.754367+0000, chain.objs.size()=1 2024-09-12T17:49:16.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.SklcQC5nI7-i4SoeANClFFSSkQqDtqh_0 2024-09-12T17:49:16.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8299063162751884965', time=2024-09-12T19:45:57.904551+0000, chain.objs.size()=1 2024-09-12T17:49:16.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.JNZIWSQyN47uYVlRIg70ybZS4xbXx67_0 2024-09-12T17:49:16.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5299572227546808133', time=2024-09-12T19:46:00.812583+0000, chain.objs.size()=1 2024-09-12T17:49:16.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.337+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.b7c9ZNhe1qdecUX4xSz886fMezuL5C2_0 2024-09-12T17:49:16.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.339+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.342+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:49:16.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.343+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.343+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T17:49:16.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2761698620202402553', time=2024-09-12T19:40:37.036804+0000, chain.objs.size()=1 2024-09-12T17:49:16.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.wy3s7L4_NBufXcO9SyPT3yEm3JKQ7R1_0 2024-09-12T17:49:16.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12399687057703097763', time=2024-09-12T19:42:33.455919+0000, chain.objs.size()=1 2024-09-12T17:49:16.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.95_bojpDOZBN4D4RKoziRrHKiw-H1f2_0 2024-09-12T17:49:16.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16969786085605534285', time=2024-09-12T19:43:05.815221+0000, chain.objs.size()=1 2024-09-12T17:49:16.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.NYP5P-KQ9R9lfFBuePjM7RwuAvELFAu_0 2024-09-12T17:49:16.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8280069096774061755', time=2024-09-12T19:43:07.618671+0000, chain.objs.size()=1 2024-09-12T17:49:16.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.DVQr9EN-vGGARtKATOm4lIezztrMyHP_0 2024-09-12T17:49:16.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9990894037490259602', time=2024-09-12T19:43:40.285113+0000, chain.objs.size()=1 2024-09-12T17:49:16.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.is8NCeD5QFZekhQxuoO2eQAfUAZejTR_0 2024-09-12T17:49:16.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.247004692511531425', time=2024-09-12T19:44:16.316358+0000, chain.objs.size()=1 2024-09-12T17:49:16.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.31__shadow_.k1JxDAD9wMwNxHje_yFowMTkwNuxO5k_0 2024-09-12T17:49:16.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8942285524301976506', time=2024-09-12T19:44:17.598422+0000, chain.objs.size()=1 2024-09-12T17:49:16.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.fBqAFJPuQ1HM8R9hOebC4rhF383zNzl_0 2024-09-12T17:49:16.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16789638841796208470', time=2024-09-12T19:44:51.133313+0000, chain.objs.size()=1 2024-09-12T17:49:16.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.lHVeIVJvIEoRebZF-hgfoYGEDZz3pEs_0 2024-09-12T17:49:16.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324977648656646788', time=2024-09-12T19:45:59.933324+0000, chain.objs.size()=1 2024-09-12T17:49:16.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.91b1UPVj3weDUvEdYlht0lDc71quRz7_0 2024-09-12T17:49:16.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8543359593049442805', time=2024-09-12T19:46:32.779374+0000, chain.objs.size()=1 2024-09-12T17:49:16.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.345+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_._IQRGkUvBD9moQQjnbdPVATtqG3I0bX_0 2024-09-12T17:49:16.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.347+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.349+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:49:16.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.351+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.351+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:49:16.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='_ElmnEhibCY_7WzESMxDsB7fL7hcF91P', time=2024-09-12T19:40:37.008836+0000, chain.objs.size()=1 2024-09-12T17:49:16.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.O8vX1gFnKOFam4dZ1ZITLlHYI-d3Yjt_0 2024-09-12T17:49:16.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='_ZVXHi9l2X9jLyaqf-KshmRqRxO18PO-', time=2024-09-12T19:40:37.020297+0000, chain.objs.size()=1 2024-09-12T17:49:16.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16__shadow_.y0piGTJli67xM1wOhoShyUL-yIlLSvz_0 2024-09-12T17:49:16.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4550273877101734634', time=2024-09-12T19:41:57.165196+0000, chain.objs.size()=1 2024-09-12T17:49:16.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.xqr_WZT1yfOkIsar6uRHs0Z81t63caw_0 2024-09-12T17:49:16.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.116463616091816919', time=2024-09-12T19:41:58.448846+0000, chain.objs.size()=1 2024-09-12T17:49:16.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.6AjjZxnOlXdio0EKXNzegIC_2gzuQlI_0 2024-09-12T17:49:16.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14437001285529895846', time=2024-09-12T19:42:33.451293+0000, chain.objs.size()=1 2024-09-12T17:49:16.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.2o6GN10dE62bJlY_pZ397Vyn0ZBjPBw_0 2024-09-12T17:49:16.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9385645539902804749', time=2024-09-12T19:42:33.452194+0000, chain.objs.size()=1 2024-09-12T17:49:16.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.McVm3UNLP1nSmOiH3A6S5m4i6x4Vp6C_0 2024-09-12T17:49:16.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15138712022373792098', time=2024-09-12T19:43:05.817206+0000, chain.objs.size()=1 2024-09-12T17:49:16.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.HF3NIn1Lb7IPFT1N7yKm47ZU7cXwCg-_0 2024-09-12T17:49:16.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8495496824510206769', time=2024-09-12T19:43:07.622678+0000, chain.objs.size()=1 2024-09-12T17:49:16.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.KjBFlic9NvyAbv53Ky1Ja6Meg8kV_0W_0 2024-09-12T17:49:16.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12836128348686533128', time=2024-09-12T19:43:40.284596+0000, chain.objs.size()=1 2024-09-12T17:49:16.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.UwCVfyOsDM4hmGvkUj2lxE9MON0o5FY_0 2024-09-12T17:49:16.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9487568595783986025', time=2024-09-12T19:43:41.898257+0000, chain.objs.size()=1 2024-09-12T17:49:16.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.85T-UMz2dlDf8dCMqWzXlFpaiDOmLEP_0 2024-09-12T17:49:16.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4565829532859031100', time=2024-09-12T19:43:41.899995+0000, chain.objs.size()=1 2024-09-12T17:49:16.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.uxgdH9NmSftdcazBcs0uFU8Fxr2vxuf_0 2024-09-12T17:49:16.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2725784924291961356', time=2024-09-12T19:44:14.077780+0000, chain.objs.size()=1 2024-09-12T17:49:16.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.352+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.oqIGnuUmkCnwukA9w5qcUO4NU6V9OcN_0 2024-09-12T17:49:16.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.354+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3666148870415181851', time=2024-09-12T19:44:17.607942+0000, chain.objs.size()=1 2024-09-12T17:49:16.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.354+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.3C8U_UmOQ7FAm76ePjNZABMYAyxOGxb_0 2024-09-12T17:49:16.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.355+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5071303293216128525', time=2024-09-12T19:44:49.480716+0000, chain.objs.size()=1 2024-09-12T17:49:16.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.355+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.W4QRyLP27YSwAfHzr1sb6KgmDdNHivD_0 2024-09-12T17:49:16.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.355+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12861626336684215935', time=2024-09-12T19:45:24.127838+0000, chain.objs.size()=1 2024-09-12T17:49:16.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.355+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.t0ifRSQYGmOjXQE-JwZ3wRENsUiJrVH_0 2024-09-12T17:49:16.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.355+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17881360524689030882', time=2024-09-12T19:45:57.905945+0000, chain.objs.size()=1 2024-09-12T17:49:16.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.355+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.36uTmIoxteAjRjUgK7y4sCy1iBHT5lO_0 2024-09-12T17:49:16.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.355+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18104576298110979503', time=2024-09-12T19:45:59.930111+0000, chain.objs.size()=1 2024-09-12T17:49:16.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.355+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.2r3x_WG9G6RlmU-7wXckPfjtpQakUZA_0 2024-09-12T17:49:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.355+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18379149862699649696', time=2024-09-12T19:46:00.807222+0000, chain.objs.size()=1 2024-09-12T17:49:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.355+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.wxx2FU0J8YvN3sr-VEc6tIByNSfX-gH_0 2024-09-12T17:49:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.356+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.359+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:49:16.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.360+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T17:49:16.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15133360683174628902', time=2024-09-12T19:41:58.438596+0000, chain.objs.size()=1 2024-09-12T17:49:16.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.u3ZYHO_k_sqEzp06OoA-lkzORe1ItaL_0 2024-09-12T17:49:16.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6511952541964108327', time=2024-09-12T19:42:33.448866+0000, chain.objs.size()=1 2024-09-12T17:49:16.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.l8of9tC-e_7mtEwas0i8ZTW7TeU5hVK_0 2024-09-12T17:49:16.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13399282873841974717', time=2024-09-12T19:42:33.450111+0000, chain.objs.size()=1 2024-09-12T17:49:16.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.rpcoFzFF6-32Xu55VAwUefyLcId1hYQ_0 2024-09-12T17:49:16.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10079251837671622839', time=2024-09-12T19:42:33.453377+0000, chain.objs.size()=1 2024-09-12T17:49:16.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24__shadow_.VbyQ70sCb3z2opv4oRygzGYKIlgwHRJ_0 2024-09-12T17:49:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11907537289959959252', time=2024-09-12T19:43:05.824953+0000, chain.objs.size()=1 2024-09-12T17:49:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.FLZJMAI3BdwK9iGAjuNK6NLAl2TTr8p_0 2024-09-12T17:49:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18104576759823576898', time=2024-09-12T19:43:40.286433+0000, chain.objs.size()=1 2024-09-12T17:49:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.YVpOyiuuvuTZr5YGKiXUBNJvNvIbBgz_0 2024-09-12T17:49:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17604166169874872312', time=2024-09-12T19:43:40.292286+0000, chain.objs.size()=1 2024-09-12T17:49:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.28__shadow_.nJZHb_xQxcdR6H4sfTFnMLgoSLcWUq__0 2024-09-12T17:49:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12142843656290572218', time=2024-09-12T19:44:14.071398+0000, chain.objs.size()=1 2024-09-12T17:49:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.Km3SBkw93sCLKV9YHDjNTih3bY4JU1v_0 2024-09-12T17:49:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8107306256612877314', time=2024-09-12T19:44:17.600855+0000, chain.objs.size()=1 2024-09-12T17:49:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.6sUbVv-udcOWd5Y4Mx3zHD8Fcn2Q7WB_0 2024-09-12T17:49:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13444121903760706462', time=2024-09-12T19:44:49.472314+0000, chain.objs.size()=1 2024-09-12T17:49:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.QcDhd8ZywWByGjScplJWYEbCcvG5rnD_0 2024-09-12T17:49:16.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12620298621750555620', time=2024-09-12T19:44:51.134181+0000, chain.objs.size()=1 2024-09-12T17:49:16.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.jWtXNLZqBZ0U0GVu6i8BIhyrNawqqWU_0 2024-09-12T17:49:16.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9673263533348894638', time=2024-09-12T19:44:51.141666+0000, chain.objs.size()=1 2024-09-12T17:49:16.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.361+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.SCO6yw_zGHB-jhF3SZENl_jWCr3L6sw_0 2024-09-12T17:49:16.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.363+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3103513372496742185', time=2024-09-12T19:45:26.788330+0000, chain.objs.size()=1 2024-09-12T17:49:16.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.363+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.mPkF81rNJ_pRUpd4UKj9us0jL9uXyWS_0 2024-09-12T17:49:16.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.363+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3609722333928941871', time=2024-09-12T19:45:57.905098+0000, chain.objs.size()=1 2024-09-12T17:49:16.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.363+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.37__shadow_.V2ycdTjrLCmoVkPMgQbWqPwNymyrfW8_0 2024-09-12T17:49:16.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.364+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12036864006413429100', time=2024-09-12T19:45:59.931872+0000, chain.objs.size()=1 2024-09-12T17:49:16.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.364+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.GZAZPBeinppnRrKaguPftMroYqcv03H_0 2024-09-12T17:49:16.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.364+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17070640528081231913', time=2024-09-12T19:46:00.815537+0000, chain.objs.size()=1 2024-09-12T17:49:16.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.364+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.GEp6J6O4WG3o-f10u7bDXbZYnaPqF5B_0 2024-09-12T17:49:16.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.364+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4830632760666129788', time=2024-09-12T19:46:32.782502+0000, chain.objs.size()=1 2024-09-12T17:49:16.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.364+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.nxq2EDPscCmXzNGtI8fllQR02D5yddx_0 2024-09-12T17:49:16.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.366+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.368+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:49:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.369+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.370+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.370+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T17:49:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.370+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5454804254851416269', time=2024-09-12T19:43:07.618713+0000, chain.objs.size()=1 2024-09-12T17:49:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.370+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.26__shadow_.ri2iYbkqhDGL3QoFsBYke5ao-I_lNM__0 2024-09-12T17:49:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.370+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11553525209689440269', time=2024-09-12T19:43:08.525999+0000, chain.objs.size()=1 2024-09-12T17:49:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.370+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.jgs5MnKw8N3kQuftkRuVvbKeET721jm_0 2024-09-12T17:49:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.370+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1011706891906878819', time=2024-09-12T19:43:41.155663+0000, chain.objs.size()=1 2024-09-12T17:49:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.370+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.29__shadow_.u9QsRXpvNHNPqZNwwYUZ2jw4YghRvFf_0 2024-09-12T17:49:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.371+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2109371576143688169', time=2024-09-12T19:44:14.072069+0000, chain.objs.size()=1 2024-09-12T17:49:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.371+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.30__shadow_.LHLWual6_g8hx1GkSbphEWdFUhOlUK9_0 2024-09-12T17:49:16.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.371+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4547022262913127995', time=2024-09-12T19:44:17.602537+0000, chain.objs.size()=1 2024-09-12T17:49:16.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.371+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.wFHWuUUqSaY0SR1pDYriCeTO3r-v3ox_0 2024-09-12T17:49:16.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.371+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.874852600097549734', time=2024-09-12T19:44:49.471329+0000, chain.objs.size()=1 2024-09-12T17:49:16.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.371+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.33__shadow_.7aQseNfZtQLvO5y-wz-j97dRTA8TSrX_0 2024-09-12T17:49:16.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.371+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5362903360244943897', time=2024-09-12T19:44:51.134209+0000, chain.objs.size()=1 2024-09-12T17:49:16.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.371+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.7sQ-C64-Yqtoak6dy-ertiKfiuchMuo_0 2024-09-12T17:49:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.371+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15271704902208331605', time=2024-09-12T19:44:51.134771+0000, chain.objs.size()=1 2024-09-12T17:49:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.371+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.34__shadow_.IGFxGdZG8pXibU2_2uS_Dl5luwLY0s-_0 2024-09-12T17:49:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.371+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18435283001231482651', time=2024-09-12T19:45:24.129794+0000, chain.objs.size()=1 2024-09-12T17:49:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.371+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.35__shadow_.sjOmHbQ1waotkD1HczYTGPBBCOQbwdb_0 2024-09-12T17:49:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.371+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16053532335377184465', time=2024-09-12T19:46:00.808445+0000, chain.objs.size()=1 2024-09-12T17:49:16.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.371+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.wUXXZGLfJKmilqtLwqpGdsC32s6XVq__0 2024-09-12T17:49:16.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.373+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.375+0000 7f2f88f46800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:49:16.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.376+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T17:49:16.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7780619493950604204', time=2024-09-12T19:40:37.105615+0000, chain.objs.size()=3 2024-09-12T17:49:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-LUKEWARM.2~ssz7_zxUOUxqBgdsXGLL_9cUfBs2Tgo.1 2024-09-12T17:49:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-LUKEWARM.2~ssz7_zxUOUxqBgdsXGLL_9cUfBs2Tgo.2 2024-09-12T17:49:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17__multipart_foo-LUKEWARM.2~ssz7_zxUOUxqBgdsXGLL_9cUfBs2Tgo.3 2024-09-12T17:49:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1900134430783772363', time=2024-09-12T19:41:57.163225+0000, chain.objs.size()=1 2024-09-12T17:49:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.EfBvER2lUqBKelJc8pjHFOHoSUqEmo2_0 2024-09-12T17:49:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1332368498447801411', time=2024-09-12T19:41:57.167992+0000, chain.objs.size()=1 2024-09-12T17:49:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20__shadow_.iXQ5Q_FUEXbPf_WOKhFcJgwQ_byKoFo_0 2024-09-12T17:49:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.999770631265769772', time=2024-09-12T19:41:58.446438+0000, chain.objs.size()=1 2024-09-12T17:49:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.21__shadow_.JAsJFHvPPEvH40-nVQBnt_1sByQjeyG_0 2024-09-12T17:49:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10662997655889412207', time=2024-09-12T19:41:59.681164+0000, chain.objs.size()=1 2024-09-12T17:49:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.22__shadow_.HmaUZvFOp48xGOSG9eQn-jP-150oG27_0 2024-09-12T17:49:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3331497552562354899', time=2024-09-12T19:42:32.372324+0000, chain.objs.size()=1 2024-09-12T17:49:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.23__shadow_.N7hLVa9Z08mi52w25j16ObP7MlqWynI_0 2024-09-12T17:49:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17612630538615891892', time=2024-09-12T19:43:05.816123+0000, chain.objs.size()=1 2024-09-12T17:49:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.25__shadow_.JY9g55Y3HlQe0q-JrBcDmPprEWdNyez_0 2024-09-12T17:49:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9677985987777848631', time=2024-09-12T19:43:08.523752+0000, chain.objs.size()=1 2024-09-12T17:49:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.qDBc8D8Fr-GhpUm5-LbCTnzd9zeO876_0 2024-09-12T17:49:16.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13735506166321499411', time=2024-09-12T19:43:08.526066+0000, chain.objs.size()=1 2024-09-12T17:49:16.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.27__shadow_.rEEr8BiWMzAdrEthNpHO08zuIOs46by_0 2024-09-12T17:49:16.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6603598386531762895', time=2024-09-12T19:44:17.600901+0000, chain.objs.size()=1 2024-09-12T17:49:16.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.377+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.32__shadow_.ndaa0yG8k3mfL0nuWxcTsL0EAmZY1Yp_0 2024-09-12T17:49:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.380+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12114279031203319186', time=2024-09-12T19:45:25.750611+0000, chain.objs.size()=1 2024-09-12T17:49:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.380+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.36__shadow_.3h5IS97UzRCZ5wPZYqUMdVzk3WeoFM9_0 2024-09-12T17:49:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.380+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15855935752730968712', time=2024-09-12T19:45:59.933254+0000, chain.objs.size()=1 2024-09-12T17:49:16.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.380+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.38__shadow_.PIuc6RbsG5PLJM-RlJ_Y_VgvwjxPYUj_0 2024-09-12T17:49:16.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.380+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10334574699240800445', time=2024-09-12T19:46:00.808899+0000, chain.objs.size()=1 2024-09-12T17:49:16.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.380+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.39__shadow_.E1U94OvvIQjDN8ylCvEREssiQifNhoU_0 2024-09-12T17:49:16.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.380+0000 7f2f88f46800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15503015251235777759', time=2024-09-12T19:46:32.781801+0000, chain.objs.size()=1 2024-09-12T17:49:16.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.380+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40__shadow_.4fFli2SuWBiDkMIMl9R6F531b9WZ1N6_0 2024-09-12T17:49:16.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.382+0000 7f2f88f46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:16.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.385+0000 7f2e3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:16.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.387+0000 7f2f88f46800 20 remove_watcher() i=0 2024-09-12T17:49:16.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.387+0000 7f2f88f46800 2 removed watcher, disabling cache 2024-09-12T17:49:16.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.388+0000 7f2f88f46800 20 remove_watcher() i=1 2024-09-12T17:49:16.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.389+0000 7f2f88f46800 20 remove_watcher() i=2 2024-09-12T17:49:16.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.390+0000 7f2f88f46800 20 remove_watcher() i=3 2024-09-12T17:49:16.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.391+0000 7f2f88f46800 20 remove_watcher() i=4 2024-09-12T17:49:16.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.392+0000 7f2f88f46800 20 remove_watcher() i=5 2024-09-12T17:49:16.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.393+0000 7f2f88f46800 20 remove_watcher() i=6 2024-09-12T17:49:16.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.394+0000 7f2f88f46800 20 remove_watcher() i=7 2024-09-12T17:49:16.407 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2024-09-12T17:49:16.501 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:16.501 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:16.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.538+0000 7f282400f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.540+0000 7f282400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.540+0000 7f282400f800 20 realm 2024-09-12T17:49:16.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.540+0000 7f282400f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.541+0000 7f282400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.541+0000 7f282400f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:16.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.541+0000 7f282400f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.541+0000 7f282400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.541+0000 7f282400f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.542+0000 7f282400f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:16.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.542+0000 7f282400f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.542+0000 7f282400f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:16.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.542+0000 7f282400f800 20 searching for the correct realm 2024-09-12T17:49:16.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.544+0000 7f281ef47640 0 -- 172.21.15.44:0/2449598215 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f281008c040 msgr2=0x7f281008c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:16.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.548+0000 7f281f748640 0 -- 172.21.15.44:0/2449598215 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f28140712d0 msgr2=0x7f28140a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:16.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.756+0000 7f282400f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:49:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.756+0000 7f282400f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:49:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.756+0000 7f282400f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.756+0000 7f282400f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.756+0000 7f282400f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.756+0000 7f282400f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.756+0000 7f282400f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.756+0000 7f282400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.756+0000 7f282400f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.757+0000 7f282400f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.757+0000 7f282400f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.757+0000 7f282400f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.757+0000 7f282400f800 20 zone default found 2024-09-12T17:49:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.757+0000 7f282400f800 4 Realm: () 2024-09-12T17:49:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.757+0000 7f282400f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:49:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.757+0000 7f282400f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:49:16.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.757+0000 7f282400f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:16.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.757+0000 7f282400f800 20 zonegroup default 2024-09-12T17:49:16.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.757+0000 7f282400f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.757+0000 7f282400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.757+0000 7f282400f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.758+0000 7f282400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.758+0000 7f282400f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.758+0000 7f282400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.758+0000 7f282400f800 20 started sync module instance, tier type = 2024-09-12T17:49:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.758+0000 7f282400f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:49:16.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.767+0000 7f282400f800 20 add_watcher() i=0 2024-09-12T17:49:16.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.767+0000 7f282400f800 20 add_watcher() i=1 2024-09-12T17:49:16.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.767+0000 7f282400f800 20 add_watcher() i=2 2024-09-12T17:49:16.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.767+0000 7f282400f800 20 add_watcher() i=3 2024-09-12T17:49:16.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.767+0000 7f282400f800 20 add_watcher() i=4 2024-09-12T17:49:16.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.767+0000 7f282400f800 20 add_watcher() i=5 2024-09-12T17:49:16.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.767+0000 7f282400f800 20 add_watcher() i=6 2024-09-12T17:49:16.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.768+0000 7f282400f800 20 add_watcher() i=7 2024-09-12T17:49:16.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.768+0000 7f282400f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:16.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.769+0000 7f26d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:16.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.769+0000 7f282400f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:16.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.769+0000 7f282400f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:16.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.803+0000 7f26d4fe1640 20 reqs_thread_entry: start 2024-09-12T17:49:16.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.803+0000 7f282400f800 20 init_complete bucket index max shards: 11 2024-09-12T17:49:16.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.803+0000 7f282400f800 20 Filter name: none 2024-09-12T17:49:16.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.804+0000 7f264e7fc640 20 reqs_thread_entry: start 2024-09-12T17:49:16.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.804+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:49:16.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.805+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.805+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.806+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.806+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:49:16.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.808+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.808+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.809+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.810+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:49:16.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.811+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.811+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.812+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.812+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:49:16.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.814+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.814+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.814+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.815+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:49:16.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.817+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.817+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.817+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.818+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:49:16.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.820+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.820+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.820+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.821+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:49:16.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.823+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.823+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.824+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.825+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:49:16.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.827+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.827+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.828+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.829+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:49:16.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.830+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.830+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.831+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.832+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:49:16.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.833+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.834+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.834+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.835+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:49:16.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.837+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.837+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.838+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.838+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:49:16.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.840+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.840+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.840+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.841+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:49:16.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.843+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.843+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.843+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.844+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:49:16.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.846+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.846+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.846+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.847+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:49:16.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.849+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.849+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.849+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.850+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:49:16.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.852+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.852+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.852+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.853+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:49:16.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.855+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.855+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.855+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.857+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:49:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.858+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.858+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.859+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.860+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:49:16.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.861+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.861+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.862+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.862+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:49:16.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.864+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.865+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.865+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.866+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:49:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.868+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.868+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.868+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.869+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:49:16.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.871+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.871+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.871+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.872+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:49:16.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.874+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.874+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.874+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.875+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:49:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.877+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.877+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.877+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.878+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:49:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.880+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.880+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.881+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.882+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:49:16.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.883+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.883+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.883+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.885+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:49:16.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.886+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.886+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.887+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.888+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:49:16.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.889+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.889+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.889+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.890+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:49:16.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.892+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.892+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.893+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.894+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:49:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.895+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.895+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.896+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.897+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:49:16.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.898+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.898+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.899+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.900+0000 7f282400f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:49:16.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.901+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.902+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.902+0000 7f282400f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:16.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.904+0000 7f26d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:16.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.906+0000 7f282400f800 20 remove_watcher() i=0 2024-09-12T17:49:16.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.906+0000 7f282400f800 2 removed watcher, disabling cache 2024-09-12T17:49:16.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.907+0000 7f282400f800 20 remove_watcher() i=1 2024-09-12T17:49:16.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.908+0000 7f282400f800 20 remove_watcher() i=2 2024-09-12T17:49:16.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.909+0000 7f282400f800 20 remove_watcher() i=3 2024-09-12T17:49:16.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.910+0000 7f282400f800 20 remove_watcher() i=4 2024-09-12T17:49:16.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.911+0000 7f282400f800 20 remove_watcher() i=5 2024-09-12T17:49:16.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.912+0000 7f282400f800 20 remove_watcher() i=6 2024-09-12T17:49:16.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:49:16.912+0000 7f282400f800 20 remove_watcher() i=7 2024-09-12T17:49:16.926 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T17:49:17.460 INFO:teuthology.orchestra.run.smithi044.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T17:49:21.160 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :clean UP-TO-DATE 2024-09-12T17:49:39.759 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :compileJava 2024-09-12T17:49:39.858 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :processResources 2024-09-12T17:49:39.859 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :classes 2024-09-12T17:49:40.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:40.760 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :compileTestJava 2024-09-12T17:49:40.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:40.760 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:49:40.760 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :testClasses 2024-09-12T17:49:40.760 INFO:teuthology.orchestra.run.smithi044.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:49:40.760 INFO:teuthology.orchestra.run.smithi044.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:49:46.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:46.659 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :test 2024-09-12T17:49:46.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:46.659 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T17:49:47.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:47.159 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T17:49:47.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:47.359 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T17:49:47.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:47.359 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T17:49:47.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:47.658 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T17:49:48.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:48.159 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T17:49:48.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:48.359 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T17:49:48.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:48.359 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T17:49:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:48.459 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T17:49:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:48.459 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T17:49:48.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:48.758 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T17:49:49.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:49.358 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T17:49:49.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:49.658 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T17:49:49.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:49.859 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T17:49:49.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12 17:49:49,777 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:49:53.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:53.559 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T17:49:53.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:53.859 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T17:49:53.859 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:53.859 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T17:49:54.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:54.059 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T17:49:54.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:54.059 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T17:49:54.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:54.658 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T17:49:54.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:54.958 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T17:49:55.259 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:55.259 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T17:49:55.259 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:55.259 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T17:49:55.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:55.358 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T17:49:57.861 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:57.861 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T17:49:58.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:58.058 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T17:49:58.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:58.458 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T17:49:58.758 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:58.758 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T17:49:59.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:59.058 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T17:49:59.258 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:49:59.258 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T17:50:04.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:04.159 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T17:50:04.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:04.358 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T17:50:05.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:05.358 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T17:50:05.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:05.558 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T17:50:06.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:06.059 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T17:50:06.258 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:06.258 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T17:50:06.559 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:06.559 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T17:50:07.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:07.059 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T17:50:07.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:07.059 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T17:50:07.259 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:07.259 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T17:50:07.259 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:07.259 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T17:50:07.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:07.459 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T17:50:07.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:07.459 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T17:50:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:07.759 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T17:50:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:07.759 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T17:50:07.959 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:07.959 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T17:50:07.959 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:07.959 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T17:50:08.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:08.158 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T17:50:08.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:08.159 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T17:50:08.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:08.358 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T17:50:08.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:08.358 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T17:50:08.558 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:08.558 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T17:50:09.258 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:09.258 INFO:teuthology.orchestra.run.smithi044.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T17:50:09.458 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:09.458 INFO:teuthology.orchestra.run.smithi044.stdout:---------------------------------------------------------------------- 2024-09-12T17:50:09.459 INFO:teuthology.orchestra.run.smithi044.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T17:50:09.459 INFO:teuthology.orchestra.run.smithi044.stdout:---------------------------------------------------------------------- 2024-09-12T17:50:09.503 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:09.503 INFO:teuthology.orchestra.run.smithi044.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:50:09.503 INFO:teuthology.orchestra.run.smithi044.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:50:09.504 INFO:teuthology.orchestra.run.smithi044.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:50:09.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:09.504 INFO:teuthology.orchestra.run.smithi044.stdout:BUILD SUCCESSFUL in 52s 2024-09-12T17:50:09.504 INFO:teuthology.orchestra.run.smithi044.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T17:50:09.822 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2024-09-12T17:50:09.877 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:09.878 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:09.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:09.916+0000 7fb11cb75800 20 rados->read ofs=0 len=0 2024-09-12T17:50:09.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:09.917+0000 7fb11cb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:09.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:09.917+0000 7fb11cb75800 20 realm 2024-09-12T17:50:09.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:09.917+0000 7fb11cb75800 20 rados->read ofs=0 len=0 2024-09-12T17:50:09.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:09.917+0000 7fb11cb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:09.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:09.917+0000 7fb11cb75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:09.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:09.917+0000 7fb11cb75800 20 rados->read ofs=0 len=0 2024-09-12T17:50:09.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:09.917+0000 7fb11cb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:09.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:09.917+0000 7fb11cb75800 20 rados->read ofs=0 len=0 2024-09-12T17:50:09.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:09.918+0000 7fb11cb75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:09.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:09.918+0000 7fb11cb75800 20 rados->read ofs=0 len=0 2024-09-12T17:50:09.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:09.918+0000 7fb11cb75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:09.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:09.918+0000 7fb11cb75800 20 searching for the correct realm 2024-09-12T17:50:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:09.921+0000 7fb113fff640 0 -- 172.21.15.44:0/1076768026 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fb10c0433e0 msgr2=0x7fb10c043800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:10.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.127+0000 7fb11a65f640 0 -- 172.21.15.44:0/1076768026 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fb1040d5b90 msgr2=0x7fb1040b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:10.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.334+0000 7fb11cb75800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:50:10.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.334+0000 7fb11cb75800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:50:10.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.334+0000 7fb11cb75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:10.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.334+0000 7fb11cb75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:10.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.334+0000 7fb11cb75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:10.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.334+0000 7fb11cb75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:10.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.334+0000 7fb11cb75800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.334+0000 7fb11cb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:10.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.334+0000 7fb11cb75800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.335+0000 7fb11cb75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:10.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.335+0000 7fb11cb75800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.335+0000 7fb11cb75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:10.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.335+0000 7fb11cb75800 20 zone default found 2024-09-12T17:50:10.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.335+0000 7fb11cb75800 4 Realm: () 2024-09-12T17:50:10.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.335+0000 7fb11cb75800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:50:10.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.335+0000 7fb11cb75800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:50:10.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.335+0000 7fb11cb75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:10.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.335+0000 7fb11cb75800 20 zonegroup default 2024-09-12T17:50:10.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.335+0000 7fb11cb75800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.336+0000 7fb11cb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:10.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.336+0000 7fb11cb75800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.336+0000 7fb11cb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:10.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.336+0000 7fb11cb75800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.336+0000 7fb11cb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:10.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.336+0000 7fb11cb75800 20 started sync module instance, tier type = 2024-09-12T17:50:10.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.336+0000 7fb11cb75800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:50:10.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.346+0000 7fb11cb75800 20 add_watcher() i=0 2024-09-12T17:50:10.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.346+0000 7fb11cb75800 20 add_watcher() i=1 2024-09-12T17:50:10.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.346+0000 7fb11cb75800 20 add_watcher() i=2 2024-09-12T17:50:10.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.346+0000 7fb11cb75800 20 add_watcher() i=3 2024-09-12T17:50:10.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.346+0000 7fb11cb75800 20 add_watcher() i=4 2024-09-12T17:50:10.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.346+0000 7fb11cb75800 20 add_watcher() i=5 2024-09-12T17:50:10.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.346+0000 7fb11cb75800 20 add_watcher() i=6 2024-09-12T17:50:10.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.347+0000 7fb11cb75800 20 add_watcher() i=7 2024-09-12T17:50:10.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.347+0000 7fb11cb75800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:10.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.349+0000 7fafd0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:10.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.349+0000 7fb11cb75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:10.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.349+0000 7fb11cb75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:10.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.387+0000 7faf4b7fe640 20 reqs_thread_entry: start 2024-09-12T17:50:10.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.387+0000 7fb11cb75800 20 init_complete bucket index max shards: 11 2024-09-12T17:50:10.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.387+0000 7fb11cb75800 20 Filter name: none 2024-09-12T17:50:10.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.387+0000 7faf497fa640 20 reqs_thread_entry: start 2024-09-12T17:50:10.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.387+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:50:10.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.389+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.389+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.389+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.390+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:50:10.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.392+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.392+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.393+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.394+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:50:10.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.395+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.395+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.396+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.397+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:50:10.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.398+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.399+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.399+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.400+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:50:10.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.402+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.402+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.403+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:10.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.403+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16873397838477217807', time=2024-09-12T19:50:09.261792+0000, chain.objs.size()=11 2024-09-12T17:50:10.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.403+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.67__multipart_key1.2~P_thT2iS-8yAS6s2TB3X6mDhQ8lKIZT.1 2024-09-12T17:50:10.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.403+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.67__multipart_key1.2~P_thT2iS-8yAS6s2TB3X6mDhQ8lKIZT.2 2024-09-12T17:50:10.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.403+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.67__multipart_key1.2~P_thT2iS-8yAS6s2TB3X6mDhQ8lKIZT.3 2024-09-12T17:50:10.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.403+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.67__multipart_key1.2~P_thT2iS-8yAS6s2TB3X6mDhQ8lKIZT.4 2024-09-12T17:50:10.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.403+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.67__multipart_key1.2~P_thT2iS-8yAS6s2TB3X6mDhQ8lKIZT.5 2024-09-12T17:50:10.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.403+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.67__multipart_key1.2~P_thT2iS-8yAS6s2TB3X6mDhQ8lKIZT.6 2024-09-12T17:50:10.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.403+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.67__multipart_key1.2~P_thT2iS-8yAS6s2TB3X6mDhQ8lKIZT.7 2024-09-12T17:50:10.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.403+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.67__multipart_key1.2~P_thT2iS-8yAS6s2TB3X6mDhQ8lKIZT.8 2024-09-12T17:50:10.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.403+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.67__multipart_key1.2~P_thT2iS-8yAS6s2TB3X6mDhQ8lKIZT.9 2024-09-12T17:50:10.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.403+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.67__multipart_key1.2~P_thT2iS-8yAS6s2TB3X6mDhQ8lKIZT.10 2024-09-12T17:50:10.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.403+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.67__multipart_key1.2~P_thT2iS-8yAS6s2TB3X6mDhQ8lKIZT.11 2024-09-12T17:50:10.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.407+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.409+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:50:10.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.411+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.412+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.412+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.413+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:50:10.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.414+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.415+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.415+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:10.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.415+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4983697077390840293', time=2024-09-12T19:49:48.230866+0000, chain.objs.size()=5 2024-09-12T17:50:10.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.415+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.43__multipart_key1.2~0iPUblnIiQiSZTzz7JE6NB7Px5ZGmtC.1 2024-09-12T17:50:10.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.415+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.43__multipart_key1.2~0iPUblnIiQiSZTzz7JE6NB7Px5ZGmtC.2 2024-09-12T17:50:10.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.415+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.43__multipart_key1.2~0iPUblnIiQiSZTzz7JE6NB7Px5ZGmtC.3 2024-09-12T17:50:10.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.415+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.43__multipart_key1.2~0iPUblnIiQiSZTzz7JE6NB7Px5ZGmtC.4 2024-09-12T17:50:10.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.415+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.43__multipart_key1.2~0iPUblnIiQiSZTzz7JE6NB7Px5ZGmtC.5 2024-09-12T17:50:10.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.419+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.421+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:50:10.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.422+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.423+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.423+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.423+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13144532696956134498', time=2024-09-12T19:50:04.095709+0000, chain.objs.size()=11 2024-09-12T17:50:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.423+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~9K9HrZaGP5r6pgovUbibV9VAQboGhw6.1 2024-09-12T17:50:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.423+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__shadow_key1.2~9K9HrZaGP5r6pgovUbibV9VAQboGhw6.1_1 2024-09-12T17:50:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.423+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~9K9HrZaGP5r6pgovUbibV9VAQboGhw6.2 2024-09-12T17:50:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.424+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__shadow_key1.2~9K9HrZaGP5r6pgovUbibV9VAQboGhw6.2_1 2024-09-12T17:50:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.424+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~9K9HrZaGP5r6pgovUbibV9VAQboGhw6.3 2024-09-12T17:50:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.424+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__shadow_key1.2~9K9HrZaGP5r6pgovUbibV9VAQboGhw6.3_1 2024-09-12T17:50:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.424+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~9K9HrZaGP5r6pgovUbibV9VAQboGhw6.4 2024-09-12T17:50:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.424+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__shadow_key1.2~9K9HrZaGP5r6pgovUbibV9VAQboGhw6.4_1 2024-09-12T17:50:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.424+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~9K9HrZaGP5r6pgovUbibV9VAQboGhw6.5 2024-09-12T17:50:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.424+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__shadow_key1.2~9K9HrZaGP5r6pgovUbibV9VAQboGhw6.5_1 2024-09-12T17:50:10.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.424+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~9K9HrZaGP5r6pgovUbibV9VAQboGhw6.6 2024-09-12T17:50:10.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.428+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.430+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:50:10.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.431+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.432+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.432+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.432+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11558850849750665608', time=2024-09-12T19:50:03.340148+0000, chain.objs.size()=11 2024-09-12T17:50:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.432+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~poomnGw7Xoj4kP_tnX7DqDJzbt1CMZ4.1 2024-09-12T17:50:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.432+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__shadow_key1.2~poomnGw7Xoj4kP_tnX7DqDJzbt1CMZ4.1_1 2024-09-12T17:50:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.432+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~poomnGw7Xoj4kP_tnX7DqDJzbt1CMZ4.2 2024-09-12T17:50:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.432+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__shadow_key1.2~poomnGw7Xoj4kP_tnX7DqDJzbt1CMZ4.2_1 2024-09-12T17:50:10.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.432+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~poomnGw7Xoj4kP_tnX7DqDJzbt1CMZ4.3 2024-09-12T17:50:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.432+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__shadow_key1.2~poomnGw7Xoj4kP_tnX7DqDJzbt1CMZ4.3_1 2024-09-12T17:50:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.432+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~poomnGw7Xoj4kP_tnX7DqDJzbt1CMZ4.4 2024-09-12T17:50:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.432+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__shadow_key1.2~poomnGw7Xoj4kP_tnX7DqDJzbt1CMZ4.4_1 2024-09-12T17:50:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.432+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~poomnGw7Xoj4kP_tnX7DqDJzbt1CMZ4.5 2024-09-12T17:50:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.432+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__shadow_key1.2~poomnGw7Xoj4kP_tnX7DqDJzbt1CMZ4.5_1 2024-09-12T17:50:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.432+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~poomnGw7Xoj4kP_tnX7DqDJzbt1CMZ4.6 2024-09-12T17:50:10.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.436+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.439+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:50:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.440+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.441+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.441+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:10.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.441+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17953215776033290045', time=2024-09-12T19:50:01.839610+0000, chain.objs.size()=11 2024-09-12T17:50:10.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.441+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~QfBwKBw2Y18pwnLdO-w9eDsdoZKTCh1.1 2024-09-12T17:50:10.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.441+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~QfBwKBw2Y18pwnLdO-w9eDsdoZKTCh1.2 2024-09-12T17:50:10.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.441+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~QfBwKBw2Y18pwnLdO-w9eDsdoZKTCh1.3 2024-09-12T17:50:10.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.441+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~QfBwKBw2Y18pwnLdO-w9eDsdoZKTCh1.4 2024-09-12T17:50:10.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.441+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~QfBwKBw2Y18pwnLdO-w9eDsdoZKTCh1.5 2024-09-12T17:50:10.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.441+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~QfBwKBw2Y18pwnLdO-w9eDsdoZKTCh1.6 2024-09-12T17:50:10.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.441+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~QfBwKBw2Y18pwnLdO-w9eDsdoZKTCh1.7 2024-09-12T17:50:10.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.441+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~QfBwKBw2Y18pwnLdO-w9eDsdoZKTCh1.8 2024-09-12T17:50:10.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.441+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~QfBwKBw2Y18pwnLdO-w9eDsdoZKTCh1.9 2024-09-12T17:50:10.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.441+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~QfBwKBw2Y18pwnLdO-w9eDsdoZKTCh1.10 2024-09-12T17:50:10.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.441+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~QfBwKBw2Y18pwnLdO-w9eDsdoZKTCh1.11 2024-09-12T17:50:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.446+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.448+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:50:10.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.449+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.449+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.450+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.450+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14213483966536821518', time=2024-09-12T19:49:52.998600+0000, chain.objs.size()=5 2024-09-12T17:50:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.450+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~cF7z2olNRDc3TLT0VC4PQN4BsTqUCDS.1 2024-09-12T17:50:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.450+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__shadow_key1.2~cF7z2olNRDc3TLT0VC4PQN4BsTqUCDS.1_1 2024-09-12T17:50:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.450+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~cF7z2olNRDc3TLT0VC4PQN4BsTqUCDS.2 2024-09-12T17:50:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.450+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__shadow_key1.2~cF7z2olNRDc3TLT0VC4PQN4BsTqUCDS.2_1 2024-09-12T17:50:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.450+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~cF7z2olNRDc3TLT0VC4PQN4BsTqUCDS.3 2024-09-12T17:50:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.453+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.455+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:50:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.457+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.457+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.458+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:50:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.458+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9814251593877965026', time=2024-09-12T19:49:53.694046+0000, chain.objs.size()=4 2024-09-12T17:50:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.458+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.47__shadow_.Z35pMmkp1ZKgcjZo967jsS7lrV14AAJ_0 2024-09-12T17:50:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.458+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.47__shadow_.Z35pMmkp1ZKgcjZo967jsS7lrV14AAJ_1 2024-09-12T17:50:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.458+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.47__shadow_.Z35pMmkp1ZKgcjZo967jsS7lrV14AAJ_2 2024-09-12T17:50:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.458+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.47__shadow_.Z35pMmkp1ZKgcjZo967jsS7lrV14AAJ_3 2024-09-12T17:50:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.458+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8791302786208994708', time=2024-09-12T19:50:06.077170+0000, chain.objs.size()=5 2024-09-12T17:50:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.458+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.58__multipart_key1.2~H0Nb5BAgac5hWUdUFokwVefZwh3gbqf.1 2024-09-12T17:50:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.458+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.58__multipart_key1.2~H0Nb5BAgac5hWUdUFokwVefZwh3gbqf.2 2024-09-12T17:50:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.458+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.58__multipart_key1.2~H0Nb5BAgac5hWUdUFokwVefZwh3gbqf.3 2024-09-12T17:50:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.458+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.58__multipart_key1.2~H0Nb5BAgac5hWUdUFokwVefZwh3gbqf.4 2024-09-12T17:50:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.458+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.58__multipart_key1.2~H0Nb5BAgac5hWUdUFokwVefZwh3gbqf.5 2024-09-12T17:50:10.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.461+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.464+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:50:10.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.465+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.465+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.466+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:50:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.466+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10628090959448957635', time=2024-09-12T19:49:49.351209+0000, chain.objs.size()=5 2024-09-12T17:50:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.466+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.45__multipart_key1.2~FqWSzBsKkRlmy-rtngB3dAcj1w-u1qB.1 2024-09-12T17:50:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.466+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.45__multipart_key1.2~FqWSzBsKkRlmy-rtngB3dAcj1w-u1qB.2 2024-09-12T17:50:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.466+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.45__multipart_key1.2~FqWSzBsKkRlmy-rtngB3dAcj1w-u1qB.3 2024-09-12T17:50:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.466+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.45__multipart_key1.2~FqWSzBsKkRlmy-rtngB3dAcj1w-u1qB.4 2024-09-12T17:50:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.466+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.45__multipart_key1.2~FqWSzBsKkRlmy-rtngB3dAcj1w-u1qB.5 2024-09-12T17:50:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.466+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5069075768306096679', time=2024-09-12T19:49:52.573555+0000, chain.objs.size()=5 2024-09-12T17:50:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.466+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~0_AP7N-Bi2MZVrMAzA7WD4gQHDQQB6U.1 2024-09-12T17:50:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.466+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~0_AP7N-Bi2MZVrMAzA7WD4gQHDQQB6U.2 2024-09-12T17:50:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.466+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~0_AP7N-Bi2MZVrMAzA7WD4gQHDQQB6U.3 2024-09-12T17:50:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.466+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~0_AP7N-Bi2MZVrMAzA7WD4gQHDQQB6U.4 2024-09-12T17:50:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.466+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~0_AP7N-Bi2MZVrMAzA7WD4gQHDQQB6U.5 2024-09-12T17:50:10.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.469+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.471+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:50:10.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.473+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.473+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.473+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:10.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.473+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3087763458143451439', time=2024-09-12T19:50:04.234681+0000, chain.objs.size()=11 2024-09-12T17:50:10.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.473+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~ymDEsr-m-uqYwQfiyE_anPHuQsj-S1d.1 2024-09-12T17:50:10.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.473+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__shadow_key1.2~ymDEsr-m-uqYwQfiyE_anPHuQsj-S1d.1_1 2024-09-12T17:50:10.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.473+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~ymDEsr-m-uqYwQfiyE_anPHuQsj-S1d.2 2024-09-12T17:50:10.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.473+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__shadow_key1.2~ymDEsr-m-uqYwQfiyE_anPHuQsj-S1d.2_1 2024-09-12T17:50:10.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.473+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~ymDEsr-m-uqYwQfiyE_anPHuQsj-S1d.3 2024-09-12T17:50:10.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.473+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__shadow_key1.2~ymDEsr-m-uqYwQfiyE_anPHuQsj-S1d.3_1 2024-09-12T17:50:10.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.473+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~ymDEsr-m-uqYwQfiyE_anPHuQsj-S1d.4 2024-09-12T17:50:10.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.473+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__shadow_key1.2~ymDEsr-m-uqYwQfiyE_anPHuQsj-S1d.4_1 2024-09-12T17:50:10.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.473+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~ymDEsr-m-uqYwQfiyE_anPHuQsj-S1d.5 2024-09-12T17:50:10.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.473+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__shadow_key1.2~ymDEsr-m-uqYwQfiyE_anPHuQsj-S1d.5_1 2024-09-12T17:50:10.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.473+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~ymDEsr-m-uqYwQfiyE_anPHuQsj-S1d.6 2024-09-12T17:50:10.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.478+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.480+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:50:10.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.481+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.482+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.482+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:10.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.482+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8971236111055679028', time=2024-09-12T19:50:07.771190+0000, chain.objs.size()=1 2024-09-12T17:50:10.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.482+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.63__shadow_.FjzXA0JRP9nD3Ru2Ufd6VSNF_43l21m_0 2024-09-12T17:50:10.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.483+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.485+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:50:10.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.486+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.487+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.487+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.488+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:50:10.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.490+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.490+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.490+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:10.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.490+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2952064777130457485', time=2024-09-12T19:49:57.866480+0000, chain.objs.size()=5 2024-09-12T17:50:10.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.491+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.53__multipart_key1.2~NhAyXtrwH049629NcHk7ABBWuK-_PQO.1 2024-09-12T17:50:10.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.491+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.53__multipart_key1.2~NhAyXtrwH049629NcHk7ABBWuK-_PQO.2 2024-09-12T17:50:10.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.491+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.53__multipart_key1.2~NhAyXtrwH049629NcHk7ABBWuK-_PQO.3 2024-09-12T17:50:10.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.491+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.53__multipart_key1.2~NhAyXtrwH049629NcHk7ABBWuK-_PQO.4 2024-09-12T17:50:10.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.491+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.53__multipart_key1.2~NhAyXtrwH049629NcHk7ABBWuK-_PQO.5 2024-09-12T17:50:10.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.493+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.496+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:50:10.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.497+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.498+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.498+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:50:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.498+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16057066597132913605', time=2024-09-12T19:49:58.554345+0000, chain.objs.size()=1 2024-09-12T17:50:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.498+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.54__shadow_.FHKo0cGgYKr1elaqreyePRDyTmhOvUa_0 2024-09-12T17:50:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.498+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7558979010896052757', time=2024-09-12T19:50:04.847005+0000, chain.objs.size()=1 2024-09-12T17:50:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.498+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.57__shadow_.2Rd2h5qkJRmeM1A2V8uVBuxy374LDDz_0 2024-09-12T17:50:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.498+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13140845009178007614', time=2024-09-12T19:50:05.376828+0000, chain.objs.size()=5 2024-09-12T17:50:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.499+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.57__multipart_key1.2~eioygABKEHVSnkWEMq1nunJGzPAFIp1.1 2024-09-12T17:50:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.499+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.57__multipart_key1.2~eioygABKEHVSnkWEMq1nunJGzPAFIp1.2 2024-09-12T17:50:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.499+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.57__multipart_key1.2~eioygABKEHVSnkWEMq1nunJGzPAFIp1.3 2024-09-12T17:50:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.499+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.57__multipart_key1.2~eioygABKEHVSnkWEMq1nunJGzPAFIp1.4 2024-09-12T17:50:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.499+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.57__multipart_key1.2~eioygABKEHVSnkWEMq1nunJGzPAFIp1.5 2024-09-12T17:50:10.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.504+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.506+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:50:10.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.508+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.508+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.509+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:10.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.509+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17037339528467088542', time=2024-09-12T19:50:07.324357+0000, chain.objs.size()=1 2024-09-12T17:50:10.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.509+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.61__shadow_.hj2u-FIRFeyHZPNWfdOXBpXJjdwVtbP_0 2024-09-12T17:50:10.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.510+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.513+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:50:10.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.514+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.514+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.515+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:10.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.515+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3113491518602166401', time=2024-09-12T19:49:53.570266+0000, chain.objs.size()=5 2024-09-12T17:50:10.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.515+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~N96PA-6GN00GZ9tCMphhczcqZa_um8V.1 2024-09-12T17:50:10.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.515+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__shadow_key1.2~N96PA-6GN00GZ9tCMphhczcqZa_um8V.1_1 2024-09-12T17:50:10.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.515+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~N96PA-6GN00GZ9tCMphhczcqZa_um8V.2 2024-09-12T17:50:10.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.515+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__shadow_key1.2~N96PA-6GN00GZ9tCMphhczcqZa_um8V.2_1 2024-09-12T17:50:10.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.515+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~N96PA-6GN00GZ9tCMphhczcqZa_um8V.3 2024-09-12T17:50:10.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.517+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.519+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:50:10.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.521+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.521+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.521+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.522+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:50:10.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.524+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.524+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.524+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:10.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.524+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8100217160047045682', time=2024-09-12T19:49:51.586217+0000, chain.objs.size()=5 2024-09-12T17:50:10.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.524+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~oBfpx7cTQa3hzlz3EGpf7IB1E0MfjQA.1 2024-09-12T17:50:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.524+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~oBfpx7cTQa3hzlz3EGpf7IB1E0MfjQA.2 2024-09-12T17:50:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.524+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~oBfpx7cTQa3hzlz3EGpf7IB1E0MfjQA.3 2024-09-12T17:50:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.524+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~oBfpx7cTQa3hzlz3EGpf7IB1E0MfjQA.4 2024-09-12T17:50:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.524+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~oBfpx7cTQa3hzlz3EGpf7IB1E0MfjQA.5 2024-09-12T17:50:10.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.527+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.529+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:50:10.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.531+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.531+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.532+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:50:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.532+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3308556198214127094', time=2024-09-12T19:49:58.530491+0000, chain.objs.size()=5 2024-09-12T17:50:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.532+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.54__multipart_file.mpg.2~aqW_oSXlXebaR7BgftGYGSf_20gi6lj.1 2024-09-12T17:50:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.532+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.54__multipart_file.mpg.2~aqW_oSXlXebaR7BgftGYGSf_20gi6lj.2 2024-09-12T17:50:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.532+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.54__multipart_file.mpg.2~aqW_oSXlXebaR7BgftGYGSf_20gi6lj.3 2024-09-12T17:50:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.532+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.54__multipart_file.mpg.2~aqW_oSXlXebaR7BgftGYGSf_20gi6lj.4 2024-09-12T17:50:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.532+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.54__multipart_file.mpg.2~aqW_oSXlXebaR7BgftGYGSf_20gi6lj.5 2024-09-12T17:50:10.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.532+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11017147884864089486', time=2024-09-12T19:49:58.548455+0000, chain.objs.size()=1 2024-09-12T17:50:10.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.532+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.54__shadow_.XYew3NpbsNy18Fi6desxM6YKzMbXdi8_0 2024-09-12T17:50:10.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.532+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3413043253671333968', time=2024-09-12T19:50:01.014052+0000, chain.objs.size()=11 2024-09-12T17:50:10.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.532+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~mGS4lQioF4Q1HbNGpPmTHrtznWCQACL.1 2024-09-12T17:50:10.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.532+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~mGS4lQioF4Q1HbNGpPmTHrtznWCQACL.2 2024-09-12T17:50:10.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.532+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~mGS4lQioF4Q1HbNGpPmTHrtznWCQACL.3 2024-09-12T17:50:10.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.532+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~mGS4lQioF4Q1HbNGpPmTHrtznWCQACL.4 2024-09-12T17:50:10.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.532+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~mGS4lQioF4Q1HbNGpPmTHrtznWCQACL.5 2024-09-12T17:50:10.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.532+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~mGS4lQioF4Q1HbNGpPmTHrtznWCQACL.6 2024-09-12T17:50:10.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.535+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~mGS4lQioF4Q1HbNGpPmTHrtznWCQACL.7 2024-09-12T17:50:10.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.535+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~mGS4lQioF4Q1HbNGpPmTHrtznWCQACL.8 2024-09-12T17:50:10.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.535+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~mGS4lQioF4Q1HbNGpPmTHrtznWCQACL.9 2024-09-12T17:50:10.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.535+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~mGS4lQioF4Q1HbNGpPmTHrtznWCQACL.10 2024-09-12T17:50:10.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.535+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~mGS4lQioF4Q1HbNGpPmTHrtznWCQACL.11 2024-09-12T17:50:10.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.538+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.540+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:50:10.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.542+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:50:10.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17877947476448870874', time=2024-09-12T19:49:52.134831+0000, chain.objs.size()=5 2024-09-12T17:50:10.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~Z8-ufN8cKis5KkpqidhmyWodxChMcIC.1 2024-09-12T17:50:10.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~Z8-ufN8cKis5KkpqidhmyWodxChMcIC.2 2024-09-12T17:50:10.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~Z8-ufN8cKis5KkpqidhmyWodxChMcIC.3 2024-09-12T17:50:10.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~Z8-ufN8cKis5KkpqidhmyWodxChMcIC.4 2024-09-12T17:50:10.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~Z8-ufN8cKis5KkpqidhmyWodxChMcIC.5 2024-09-12T17:50:10.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4384327269951306386', time=2024-09-12T19:49:55.044189+0000, chain.objs.size()=5 2024-09-12T17:50:10.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.52__multipart_key1.2~F1Q7uNOfHpljA7OOZJRbyMXQJ2N7RlT.1 2024-09-12T17:50:10.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.52__multipart_key1.2~F1Q7uNOfHpljA7OOZJRbyMXQJ2N7RlT.2 2024-09-12T17:50:10.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.52__multipart_key1.2~F1Q7uNOfHpljA7OOZJRbyMXQJ2N7RlT.3 2024-09-12T17:50:10.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.52__multipart_key1.2~F1Q7uNOfHpljA7OOZJRbyMXQJ2N7RlT.4 2024-09-12T17:50:10.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.52__multipart_key1.2~F1Q7uNOfHpljA7OOZJRbyMXQJ2N7RlT.5 2024-09-12T17:50:10.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='2~b6GdWblZt7uR2VsIQerUUEr66AhXgxK', time=2024-09-12T19:49:59.105494+0000, chain.objs.size()=3 2024-09-12T17:50:10.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.55__multipart_key1.2~b6GdWblZt7uR2VsIQerUUEr66AhXgxK.7 2024-09-12T17:50:10.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.543+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.55__multipart_key1.2~b6GdWblZt7uR2VsIQerUUEr66AhXgxK.10 2024-09-12T17:50:10.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.547+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.55__multipart_key1.2~b6GdWblZt7uR2VsIQerUUEr66AhXgxK.13 2024-09-12T17:50:10.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.549+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.551+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:50:10.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.552+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.553+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.553+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:10.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.553+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13068369057187782437', time=2024-09-12T19:50:07.098817+0000, chain.objs.size()=1 2024-09-12T17:50:10.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.553+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.60__shadow_.jYrG-Fm3opAQf5szmxyH2ttakLoXQyZ_0 2024-09-12T17:50:10.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.554+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.556+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:50:10.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.558+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.558+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.559+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:50:10.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.559+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8702441358516361205', time=2024-09-12T19:49:53.427861+0000, chain.objs.size()=5 2024-09-12T17:50:10.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.559+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~iW8pV3YTlF4015NAgv5U-ePCfovg5fi.1 2024-09-12T17:50:10.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.559+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__shadow_key1.2~iW8pV3YTlF4015NAgv5U-ePCfovg5fi.1_1 2024-09-12T17:50:10.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.559+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~iW8pV3YTlF4015NAgv5U-ePCfovg5fi.2 2024-09-12T17:50:10.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.559+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__shadow_key1.2~iW8pV3YTlF4015NAgv5U-ePCfovg5fi.2_1 2024-09-12T17:50:10.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.559+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.48__multipart_key1.2~iW8pV3YTlF4015NAgv5U-ePCfovg5fi.3 2024-09-12T17:50:10.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.559+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10267867878367885514', time=2024-09-12T19:49:58.542758+0000, chain.objs.size()=5 2024-09-12T17:50:10.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.559+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.54__multipart_file2.mpg.2~LY2CGb7Ce0aX8tDjOBPImQdvGRmwCII.1 2024-09-12T17:50:10.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.559+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.54__multipart_file2.mpg.2~LY2CGb7Ce0aX8tDjOBPImQdvGRmwCII.2 2024-09-12T17:50:10.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.559+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.54__multipart_file2.mpg.2~LY2CGb7Ce0aX8tDjOBPImQdvGRmwCII.3 2024-09-12T17:50:10.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.559+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.54__multipart_file2.mpg.2~LY2CGb7Ce0aX8tDjOBPImQdvGRmwCII.4 2024-09-12T17:50:10.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.559+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.54__multipart_file2.mpg.2~LY2CGb7Ce0aX8tDjOBPImQdvGRmwCII.5 2024-09-12T17:50:10.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.563+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.565+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:50:10.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.566+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.567+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.567+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:50:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.567+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='2~saWI_Ae8e8ZJy2gtN3B6vFjz_OHvX9l', time=2024-09-12T19:49:47.068544+0000, chain.objs.size()=5 2024-09-12T17:50:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.567+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.41__multipart_key1.2~saWI_Ae8e8ZJy2gtN3B6vFjz_OHvX9l.1 2024-09-12T17:50:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.567+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.41__multipart_key1.2~saWI_Ae8e8ZJy2gtN3B6vFjz_OHvX9l.2 2024-09-12T17:50:10.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.567+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.41__multipart_key1.2~saWI_Ae8e8ZJy2gtN3B6vFjz_OHvX9l.3 2024-09-12T17:50:10.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.567+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.41__multipart_key1.2~saWI_Ae8e8ZJy2gtN3B6vFjz_OHvX9l.4 2024-09-12T17:50:10.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.567+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.41__multipart_key1.2~saWI_Ae8e8ZJy2gtN3B6vFjz_OHvX9l.5 2024-09-12T17:50:10.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.567+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9024222068345934734', time=2024-09-12T19:50:02.611250+0000, chain.objs.size()=10 2024-09-12T17:50:10.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.567+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~smYZygGnC_vXuO8BGUvJU8FthM3ckkz.1 2024-09-12T17:50:10.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.567+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~smYZygGnC_vXuO8BGUvJU8FthM3ckkz.2 2024-09-12T17:50:10.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.567+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~smYZygGnC_vXuO8BGUvJU8FthM3ckkz.3 2024-09-12T17:50:10.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.567+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~smYZygGnC_vXuO8BGUvJU8FthM3ckkz.4 2024-09-12T17:50:10.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.567+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~smYZygGnC_vXuO8BGUvJU8FthM3ckkz.5 2024-09-12T17:50:10.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.567+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~smYZygGnC_vXuO8BGUvJU8FthM3ckkz.6 2024-09-12T17:50:10.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.567+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~smYZygGnC_vXuO8BGUvJU8FthM3ckkz.7 2024-09-12T17:50:10.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.571+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~smYZygGnC_vXuO8BGUvJU8FthM3ckkz.8 2024-09-12T17:50:10.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.571+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~smYZygGnC_vXuO8BGUvJU8FthM3ckkz.9 2024-09-12T17:50:10.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.571+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.56__multipart_key1.2~smYZygGnC_vXuO8BGUvJU8FthM3ckkz.10 2024-09-12T17:50:10.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.575+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.577+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:50:10.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.578+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.579+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.579+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:50:10.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.579+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17253222573544313134', time=2024-09-12T19:49:49.475136+0000, chain.objs.size()=5 2024-09-12T17:50:10.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.579+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.45__multipart_key1.2~FqWSzBsKkRlmy-rtngB3dAcj1w-u1qB.1 2024-09-12T17:50:10.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.579+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.45__multipart_key1.2~FqWSzBsKkRlmy-rtngB3dAcj1w-u1qB.2 2024-09-12T17:50:10.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.579+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.45__multipart_key1.2~FqWSzBsKkRlmy-rtngB3dAcj1w-u1qB.3 2024-09-12T17:50:10.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.579+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.45__multipart_key1.2~FqWSzBsKkRlmy-rtngB3dAcj1w-u1qB.4 2024-09-12T17:50:10.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.579+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.45__multipart_key1.2~FqWSzBsKkRlmy-rtngB3dAcj1w-u1qB.5 2024-09-12T17:50:10.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.579+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4422861962247279448', time=2024-09-12T19:50:07.547044+0000, chain.objs.size()=1 2024-09-12T17:50:10.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.579+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.62__shadow_.ZPX_8JZmkcMHFWYXc7lV40dooV0umFW_0 2024-09-12T17:50:10.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.579+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4815106970197633193', time=2024-09-12T19:50:07.998903+0000, chain.objs.size()=1 2024-09-12T17:50:10.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.579+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.64__shadow_.SMOOhAhpUSDQtk3u4Ge3A_3TDt4APMA_0 2024-09-12T17:50:10.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.582+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.584+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:50:10.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.585+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.586+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.586+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:10.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.586+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16801816524438260583', time=2024-09-12T19:50:08.221856+0000, chain.objs.size()=1 2024-09-12T17:50:10.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.586+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.65__shadow_.CIhHb1wfX71ncnWdjph7NLkG2dT7pAR_0 2024-09-12T17:50:10.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.588+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.590+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:50:10.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.591+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.592+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.592+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.593+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:50:10.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.595+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.595+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.595+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:10.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.595+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7120229719570626630', time=2024-09-12T19:49:58.536689+0000, chain.objs.size()=1 2024-09-12T17:50:10.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.595+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.54__shadow_.wpcFuoAMddX77WLuhu6pX2d_xiDkCVS_0 2024-09-12T17:50:10.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.597+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.599+0000 7fb11cb75800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:50:10.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.600+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.601+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:10.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.601+0000 7fb11cb75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:10.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.601+0000 7fb11cb75800 20 garbage collection: RGWGC::process iterating over entry tag='2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf', time=2024-09-12T19:50:06.915251+0000, chain.objs.size()=92 2024-09-12T17:50:10.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.601+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.1 2024-09-12T17:50:10.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.601+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.2 2024-09-12T17:50:10.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.601+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.3 2024-09-12T17:50:10.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.601+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.4 2024-09-12T17:50:10.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.601+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.5 2024-09-12T17:50:10.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.601+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.6 2024-09-12T17:50:10.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.601+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.7 2024-09-12T17:50:10.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.601+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.8 2024-09-12T17:50:10.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.601+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.9 2024-09-12T17:50:10.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.601+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.10 2024-09-12T17:50:10.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.601+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.11 2024-09-12T17:50:10.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.601+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.12 2024-09-12T17:50:10.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.603+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.13 2024-09-12T17:50:10.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.603+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.14 2024-09-12T17:50:10.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.603+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.15 2024-09-12T17:50:10.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.603+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.16 2024-09-12T17:50:10.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.604+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.17 2024-09-12T17:50:10.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.604+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.18 2024-09-12T17:50:10.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.604+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.19 2024-09-12T17:50:10.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.604+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.20 2024-09-12T17:50:10.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.605+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.21 2024-09-12T17:50:10.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.605+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.22 2024-09-12T17:50:10.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.605+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.23 2024-09-12T17:50:10.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.605+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.24 2024-09-12T17:50:10.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.607+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.25 2024-09-12T17:50:10.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.607+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.26 2024-09-12T17:50:10.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.607+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.27 2024-09-12T17:50:10.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.607+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.28 2024-09-12T17:50:10.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.610+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.29 2024-09-12T17:50:10.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.610+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.30 2024-09-12T17:50:10.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.610+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.31 2024-09-12T17:50:10.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.610+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.32 2024-09-12T17:50:10.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.610+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.33 2024-09-12T17:50:10.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.610+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.34 2024-09-12T17:50:10.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.610+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.35 2024-09-12T17:50:10.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.610+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.36 2024-09-12T17:50:10.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.612+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.37 2024-09-12T17:50:10.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.612+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.38 2024-09-12T17:50:10.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.612+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.39 2024-09-12T17:50:10.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.615+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.40 2024-09-12T17:50:10.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.616+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.41 2024-09-12T17:50:10.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.616+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.42 2024-09-12T17:50:10.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.616+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.43 2024-09-12T17:50:10.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.616+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.44 2024-09-12T17:50:10.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.616+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.45 2024-09-12T17:50:10.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.616+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.46 2024-09-12T17:50:10.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.616+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.47 2024-09-12T17:50:10.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.616+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.48 2024-09-12T17:50:10.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.616+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.49 2024-09-12T17:50:10.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.616+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.50 2024-09-12T17:50:10.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.621+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.51 2024-09-12T17:50:10.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.621+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.52 2024-09-12T17:50:10.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.621+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.53 2024-09-12T17:50:10.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.621+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.54 2024-09-12T17:50:10.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.621+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.55 2024-09-12T17:50:10.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.622+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.56 2024-09-12T17:50:10.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.622+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.57 2024-09-12T17:50:10.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.622+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.58 2024-09-12T17:50:10.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.622+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.59 2024-09-12T17:50:10.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.622+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.60 2024-09-12T17:50:10.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.622+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.61 2024-09-12T17:50:10.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.623+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.62 2024-09-12T17:50:10.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.624+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.63 2024-09-12T17:50:10.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.624+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.64 2024-09-12T17:50:10.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.624+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.65 2024-09-12T17:50:10.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.624+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.66 2024-09-12T17:50:10.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.624+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.67 2024-09-12T17:50:10.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.624+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.68 2024-09-12T17:50:10.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.624+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.69 2024-09-12T17:50:10.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.624+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.70 2024-09-12T17:50:10.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.624+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.71 2024-09-12T17:50:10.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.624+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.72 2024-09-12T17:50:10.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.625+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.73 2024-09-12T17:50:10.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.630+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.74 2024-09-12T17:50:10.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.630+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.75 2024-09-12T17:50:10.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.630+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.76 2024-09-12T17:50:10.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.630+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.77 2024-09-12T17:50:10.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.630+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.78 2024-09-12T17:50:10.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.630+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.79 2024-09-12T17:50:10.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.630+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.80 2024-09-12T17:50:10.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.630+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.81 2024-09-12T17:50:10.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.630+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.82 2024-09-12T17:50:10.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.630+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.83 2024-09-12T17:50:10.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.630+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.84 2024-09-12T17:50:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.635+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.85 2024-09-12T17:50:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.635+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.86 2024-09-12T17:50:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.635+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.87 2024-09-12T17:50:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.635+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.88 2024-09-12T17:50:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.635+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.89 2024-09-12T17:50:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.635+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.90 2024-09-12T17:50:10.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.635+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.91 2024-09-12T17:50:10.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.635+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.59__multipart_key1.2~ch0tRhDVlm0kc4rSDga_cJHdJ9jYgPf.92 2024-09-12T17:50:10.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.641+0000 7fb11cb75800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:10.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.647+0000 7fafd0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:10.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.650+0000 7fb11cb75800 20 remove_watcher() i=0 2024-09-12T17:50:10.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.650+0000 7fb11cb75800 2 removed watcher, disabling cache 2024-09-12T17:50:10.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.651+0000 7fb11cb75800 20 remove_watcher() i=1 2024-09-12T17:50:10.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.652+0000 7fb11cb75800 20 remove_watcher() i=2 2024-09-12T17:50:10.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.653+0000 7fb11cb75800 20 remove_watcher() i=3 2024-09-12T17:50:10.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.654+0000 7fb11cb75800 20 remove_watcher() i=4 2024-09-12T17:50:10.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.655+0000 7fb11cb75800 20 remove_watcher() i=5 2024-09-12T17:50:10.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.656+0000 7fb11cb75800 20 remove_watcher() i=6 2024-09-12T17:50:10.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.657+0000 7fb11cb75800 20 remove_watcher() i=7 2024-09-12T17:50:10.670 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2024-09-12T17:50:10.724 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:10.724 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:10.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.762+0000 7f3b44298800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.763+0000 7f3b44298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:10.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.763+0000 7f3b44298800 20 realm 2024-09-12T17:50:10.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.763+0000 7f3b44298800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.763+0000 7f3b44298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.763+0000 7f3b44298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.763+0000 7f3b44298800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.764+0000 7f3b44298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.764+0000 7f3b44298800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.764+0000 7f3b44298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:10.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.764+0000 7f3b44298800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.765+0000 7f3b44298800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:10.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.765+0000 7f3b44298800 20 searching for the correct realm 2024-09-12T17:50:10.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.767+0000 7f3b41581640 0 -- 172.21.15.44:0/108363984 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f3b3406f040 msgr2=0x7f3b34067780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:50:10.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.771+0000 7f3b41d82640 0 -- 172.21.15.44:0/108363984 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f3b380ac050 msgr2=0x7f3b380e1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:10.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.977+0000 7f3b44298800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:50:10.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.977+0000 7f3b44298800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:50:10.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.977+0000 7f3b44298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:10.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.977+0000 7f3b44298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:10.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.977+0000 7f3b44298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:10.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.977+0000 7f3b44298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:10.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.977+0000 7f3b44298800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.977+0000 7f3b44298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:10.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.977+0000 7f3b44298800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.978+0000 7f3b44298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:10.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.978+0000 7f3b44298800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.978+0000 7f3b44298800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:10.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.978+0000 7f3b44298800 20 zone default found 2024-09-12T17:50:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.978+0000 7f3b44298800 4 Realm: () 2024-09-12T17:50:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.978+0000 7f3b44298800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:50:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.978+0000 7f3b44298800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:50:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.978+0000 7f3b44298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.978+0000 7f3b44298800 20 zonegroup default 2024-09-12T17:50:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.978+0000 7f3b44298800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.978+0000 7f3b44298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.978+0000 7f3b44298800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.979+0000 7f3b44298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.979+0000 7f3b44298800 20 rados->read ofs=0 len=0 2024-09-12T17:50:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.979+0000 7f3b44298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.979+0000 7f3b44298800 20 started sync module instance, tier type = 2024-09-12T17:50:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.979+0000 7f3b44298800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:50:10.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.988+0000 7f3b44298800 20 add_watcher() i=0 2024-09-12T17:50:10.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.988+0000 7f3b44298800 20 add_watcher() i=1 2024-09-12T17:50:10.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.988+0000 7f3b44298800 20 add_watcher() i=2 2024-09-12T17:50:10.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.988+0000 7f3b44298800 20 add_watcher() i=3 2024-09-12T17:50:10.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.988+0000 7f3b44298800 20 add_watcher() i=4 2024-09-12T17:50:10.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.988+0000 7f3b44298800 20 add_watcher() i=5 2024-09-12T17:50:10.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.988+0000 7f3b44298800 20 add_watcher() i=6 2024-09-12T17:50:10.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.989+0000 7f3b44298800 20 add_watcher() i=7 2024-09-12T17:50:10.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.989+0000 7f3b44298800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:10.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.991+0000 7f39f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:10.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.991+0000 7f3b44298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:10.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:10.991+0000 7f3b44298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:11.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.029+0000 7f39f27fc640 20 reqs_thread_entry: start 2024-09-12T17:50:11.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.029+0000 7f3b44298800 20 init_complete bucket index max shards: 11 2024-09-12T17:50:11.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.030+0000 7f3b44298800 20 Filter name: none 2024-09-12T17:50:11.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.030+0000 7f3963fff640 20 reqs_thread_entry: start 2024-09-12T17:50:11.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.030+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:50:11.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.031+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.031+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.032+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.033+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:50:11.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.034+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.034+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.034+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.035+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:50:11.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.036+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.037+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.037+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.038+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:50:11.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.039+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.040+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.040+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.041+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:50:11.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.043+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.043+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.043+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.044+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:50:11.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.045+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.046+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.046+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.047+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:50:11.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.049+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.049+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.049+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.051+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:50:11.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.052+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.052+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.053+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.054+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:50:11.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.055+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.056+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.056+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.057+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:50:11.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.058+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.058+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.059+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.060+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:50:11.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.061+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.061+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.062+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.063+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:50:11.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.064+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.064+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.065+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.066+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:50:11.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.067+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.068+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.068+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.069+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:50:11.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.071+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.072+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.072+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.073+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:50:11.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.074+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.075+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.075+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.076+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:50:11.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.078+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.078+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.079+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.079+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:50:11.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.081+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.082+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.082+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.083+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:50:11.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.084+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.085+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.085+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.086+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:50:11.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.087+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.088+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.088+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.089+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:50:11.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.091+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.091+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.092+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.093+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:50:11.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.094+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.094+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.095+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.096+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:50:11.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.097+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.098+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.098+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.099+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:50:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.101+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.101+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.102+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.102+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:50:11.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.104+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.104+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.104+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.105+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:50:11.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.106+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.107+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.107+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.108+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:50:11.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.109+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.110+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.110+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.111+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:50:11.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.112+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.113+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.113+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.114+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:50:11.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.115+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.116+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.116+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.117+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:50:11.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.119+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.119+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.119+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.121+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:50:11.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.122+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.122+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.122+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.124+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:50:11.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.126+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.126+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.126+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.127+0000 7f3b44298800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:50:11.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.129+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.129+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.129+0000 7f3b44298800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.132+0000 7f39f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:11.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.133+0000 7f3b44298800 20 remove_watcher() i=0 2024-09-12T17:50:11.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.133+0000 7f3b44298800 2 removed watcher, disabling cache 2024-09-12T17:50:11.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.134+0000 7f3b44298800 20 remove_watcher() i=1 2024-09-12T17:50:11.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.135+0000 7f3b44298800 20 remove_watcher() i=2 2024-09-12T17:50:11.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.136+0000 7f3b44298800 20 remove_watcher() i=3 2024-09-12T17:50:11.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.137+0000 7f3b44298800 20 remove_watcher() i=4 2024-09-12T17:50:11.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.139+0000 7f3b44298800 20 remove_watcher() i=5 2024-09-12T17:50:11.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.140+0000 7f3b44298800 20 remove_watcher() i=6 2024-09-12T17:50:11.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.141+0000 7f3b44298800 20 remove_watcher() i=7 2024-09-12T17:50:11.154 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2024-09-12T17:50:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:11.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.245+0000 7f4c08925800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.247+0000 7f4c08925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:11.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.247+0000 7f4c08925800 20 realm 2024-09-12T17:50:11.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.247+0000 7f4c08925800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.247+0000 7f4c08925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:11.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.247+0000 7f4c08925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:11.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.247+0000 7f4c08925800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.247+0000 7f4c08925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:11.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.247+0000 7f4c08925800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.248+0000 7f4c08925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:11.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.248+0000 7f4c08925800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.248+0000 7f4c08925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:11.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.248+0000 7f4c08925800 20 searching for the correct realm 2024-09-12T17:50:11.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.251+0000 7f4c03d32640 0 -- 172.21.15.44:0/2541833669 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f4bf4096060 msgr2=0x7f4bf408e090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:11.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.255+0000 7f4c04533640 0 -- 172.21.15.44:0/2541833669 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f4bf8049940 msgr2=0x7f4bf802a3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:50:11.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.461+0000 7f4c08925800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:50:11.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.461+0000 7f4c08925800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:50:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.461+0000 7f4c08925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.461+0000 7f4c08925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.461+0000 7f4c08925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.461+0000 7f4c08925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.461+0000 7f4c08925800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.462+0000 7f4c08925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.462+0000 7f4c08925800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.462+0000 7f4c08925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.462+0000 7f4c08925800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.462+0000 7f4c08925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:11.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.462+0000 7f4c08925800 20 zone default found 2024-09-12T17:50:11.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.462+0000 7f4c08925800 4 Realm: () 2024-09-12T17:50:11.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.462+0000 7f4c08925800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:50:11.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.462+0000 7f4c08925800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:50:11.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.462+0000 7f4c08925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.462+0000 7f4c08925800 20 zonegroup default 2024-09-12T17:50:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.462+0000 7f4c08925800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.463+0000 7f4c08925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.463+0000 7f4c08925800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.463+0000 7f4c08925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.463+0000 7f4c08925800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.463+0000 7f4c08925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.463+0000 7f4c08925800 20 started sync module instance, tier type = 2024-09-12T17:50:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.463+0000 7f4c08925800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:50:11.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.472+0000 7f4c08925800 20 add_watcher() i=0 2024-09-12T17:50:11.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.472+0000 7f4c08925800 20 add_watcher() i=1 2024-09-12T17:50:11.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.472+0000 7f4c08925800 20 add_watcher() i=2 2024-09-12T17:50:11.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.472+0000 7f4c08925800 20 add_watcher() i=3 2024-09-12T17:50:11.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.472+0000 7f4c08925800 20 add_watcher() i=4 2024-09-12T17:50:11.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.472+0000 7f4c08925800 20 add_watcher() i=5 2024-09-12T17:50:11.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.472+0000 7f4c08925800 20 add_watcher() i=6 2024-09-12T17:50:11.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.474+0000 7f4c08925800 20 add_watcher() i=7 2024-09-12T17:50:11.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.474+0000 7f4c08925800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:11.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.476+0000 7f4abafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:11.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.476+0000 7f4c08925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:11.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.476+0000 7f4c08925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:11.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.514+0000 7f4ab9fdb640 20 reqs_thread_entry: start 2024-09-12T17:50:11.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.514+0000 7f4c08925800 20 init_complete bucket index max shards: 11 2024-09-12T17:50:11.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.515+0000 7f4c08925800 20 Filter name: none 2024-09-12T17:50:11.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.515+0000 7f4a2b7fe640 20 reqs_thread_entry: start 2024-09-12T17:50:11.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.515+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:50:11.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.516+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.517+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.517+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.518+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:50:11.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.519+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.520+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.520+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.521+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:50:11.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.523+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.523+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.523+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.524+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:50:11.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.526+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.526+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.526+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.527+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:50:11.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.529+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.529+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.529+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.530+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:50:11.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.532+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.532+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.533+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.534+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:50:11.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.535+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.535+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.536+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.537+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:50:11.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.538+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.538+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.539+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.540+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:50:11.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.541+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.542+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.542+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.543+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:50:11.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.544+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.544+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.545+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.545+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:50:11.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.547+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.547+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.548+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.550+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:50:11.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.551+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.552+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.552+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.553+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:50:11.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.554+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.555+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.555+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.556+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:50:11.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.558+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.558+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.559+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.560+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:50:11.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.561+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.561+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.562+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.563+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:50:11.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.564+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.565+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.565+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.566+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:50:11.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.567+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.568+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.568+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.569+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:50:11.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.570+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.571+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.571+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.572+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:50:11.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.573+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.574+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.574+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.575+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:50:11.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.576+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.577+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.577+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.578+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:50:11.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.579+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.580+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.580+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.581+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:50:11.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.582+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.583+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.583+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.584+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:50:11.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.585+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.586+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.586+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.587+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:50:11.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.588+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.589+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.589+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.590+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:50:11.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.592+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.592+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.592+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.594+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:50:11.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.595+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.595+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.596+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.596+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:50:11.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.598+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.598+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.599+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.600+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:50:11.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.601+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.601+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.601+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.602+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:50:11.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.604+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.604+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.605+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.606+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:50:11.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.607+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.607+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.608+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.609+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:50:11.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.610+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.610+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.611+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.612+0000 7f4c08925800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:50:11.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.613+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.614+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.614+0000 7f4c08925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.616+0000 7f4abafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:11.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.618+0000 7f4c08925800 20 remove_watcher() i=0 2024-09-12T17:50:11.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.618+0000 7f4c08925800 2 removed watcher, disabling cache 2024-09-12T17:50:11.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.620+0000 7f4c08925800 20 remove_watcher() i=1 2024-09-12T17:50:11.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.621+0000 7f4c08925800 20 remove_watcher() i=2 2024-09-12T17:50:11.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.622+0000 7f4c08925800 20 remove_watcher() i=3 2024-09-12T17:50:11.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.623+0000 7f4c08925800 20 remove_watcher() i=4 2024-09-12T17:50:11.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.624+0000 7f4c08925800 20 remove_watcher() i=5 2024-09-12T17:50:11.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.624+0000 7f4c08925800 20 remove_watcher() i=6 2024-09-12T17:50:11.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.625+0000 7f4c08925800 20 remove_watcher() i=7 2024-09-12T17:50:11.639 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2024-09-12T17:50:11.692 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:11.692 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.730+0000 7f5c217a9800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.732+0000 7f5c217a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.732+0000 7f5c217a9800 20 realm 2024-09-12T17:50:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.732+0000 7f5c217a9800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.732+0000 7f5c217a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.732+0000 7f5c217a9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.732+0000 7f5c217a9800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.733+0000 7f5c217a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:11.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.733+0000 7f5c217a9800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.733+0000 7f5c217a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:11.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.733+0000 7f5c217a9800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.734+0000 7f5c217a9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:11.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.734+0000 7f5c217a9800 20 searching for the correct realm 2024-09-12T17:50:11.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.737+0000 7f5c1fa94640 0 -- 172.21.15.44:0/3712101714 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f5c14024070 msgr2=0x7f5c140477a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:11.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.740+0000 7f5c1f293640 0 -- 172.21.15.44:0/3712101714 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f5c140639b0 msgr2=0x7f5c14099980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:11.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.745+0000 7f5c217a9800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:50:11.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.745+0000 7f5c217a9800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:50:11.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.745+0000 7f5c217a9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:11.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.745+0000 7f5c217a9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:11.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.745+0000 7f5c217a9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:11.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.745+0000 7f5c217a9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:11.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.745+0000 7f5c217a9800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.745+0000 7f5c217a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:11.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.745+0000 7f5c217a9800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.745+0000 7f5c217a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.745+0000 7f5c217a9800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.746+0000 7f5c217a9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.746+0000 7f5c217a9800 20 zone default found 2024-09-12T17:50:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.746+0000 7f5c217a9800 4 Realm: () 2024-09-12T17:50:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.746+0000 7f5c217a9800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:50:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.746+0000 7f5c217a9800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:50:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.746+0000 7f5c217a9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.746+0000 7f5c217a9800 20 zonegroup default 2024-09-12T17:50:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.746+0000 7f5c217a9800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.746+0000 7f5c217a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.746+0000 7f5c217a9800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.747+0000 7f5c217a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:11.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.747+0000 7f5c217a9800 20 rados->read ofs=0 len=0 2024-09-12T17:50:11.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.747+0000 7f5c217a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:11.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.747+0000 7f5c217a9800 20 started sync module instance, tier type = 2024-09-12T17:50:11.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.747+0000 7f5c217a9800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:50:11.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.756+0000 7f5c217a9800 20 add_watcher() i=0 2024-09-12T17:50:11.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.756+0000 7f5c217a9800 20 add_watcher() i=1 2024-09-12T17:50:11.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.756+0000 7f5c217a9800 20 add_watcher() i=2 2024-09-12T17:50:11.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.756+0000 7f5c217a9800 20 add_watcher() i=3 2024-09-12T17:50:11.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.756+0000 7f5c217a9800 20 add_watcher() i=4 2024-09-12T17:50:11.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.756+0000 7f5c217a9800 20 add_watcher() i=5 2024-09-12T17:50:11.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.756+0000 7f5c217a9800 20 add_watcher() i=6 2024-09-12T17:50:11.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.757+0000 7f5c217a9800 20 add_watcher() i=7 2024-09-12T17:50:11.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.757+0000 7f5c217a9800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:11.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.759+0000 7f5ad5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.759+0000 7f5c217a9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.759+0000 7f5c217a9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:11.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.796+0000 7f5ad4fe1640 20 reqs_thread_entry: start 2024-09-12T17:50:11.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.796+0000 7f5c217a9800 20 init_complete bucket index max shards: 11 2024-09-12T17:50:11.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.796+0000 7f5c217a9800 20 Filter name: none 2024-09-12T17:50:11.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.796+0000 7f5a4e7fc640 20 reqs_thread_entry: start 2024-09-12T17:50:11.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.796+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:50:11.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.797+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.798+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.798+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.799+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:50:11.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.802+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.802+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.802+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.804+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:50:11.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.805+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.805+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.806+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.806+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:50:11.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.808+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.808+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.808+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.809+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:50:11.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.811+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.811+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.812+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.813+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:50:11.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.816+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.817+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.817+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.818+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:50:11.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.819+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.820+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.820+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.821+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:50:11.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.822+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.822+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.823+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.824+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:50:11.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.825+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.826+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.826+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.827+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:50:11.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.828+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.829+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.829+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.830+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:50:11.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.831+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.832+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.832+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.833+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:50:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.834+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.835+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.835+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.836+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:50:11.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.837+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.838+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.838+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.839+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:50:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.840+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.841+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.841+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.842+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:50:11.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.843+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.843+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.844+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.845+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:50:11.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.846+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.847+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.847+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.848+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:50:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.849+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.850+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.850+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.851+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:50:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.853+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.853+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.853+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.854+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:50:11.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.856+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.857+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.857+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.858+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:50:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.860+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.860+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.860+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.861+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:50:11.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.863+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.863+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.863+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.865+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:50:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.866+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.866+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.867+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.868+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:50:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.869+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.869+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.870+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.871+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:50:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.872+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.873+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.873+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.874+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:50:11.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.876+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.876+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.876+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.878+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:50:11.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.879+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.880+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.880+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.881+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:50:11.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.882+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.883+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.883+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.884+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:50:11.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.885+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.886+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.886+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.887+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:50:11.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.888+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.889+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.889+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.890+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:50:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.891+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.892+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.892+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.893+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:50:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.895+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.895+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.896+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.897+0000 7f5c217a9800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:50:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.898+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.899+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.899+0000 7f5c217a9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:11.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.901+0000 7f5ad5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:11.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.903+0000 7f5c217a9800 20 remove_watcher() i=0 2024-09-12T17:50:11.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.903+0000 7f5c217a9800 2 removed watcher, disabling cache 2024-09-12T17:50:11.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.904+0000 7f5c217a9800 20 remove_watcher() i=1 2024-09-12T17:50:11.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.905+0000 7f5c217a9800 20 remove_watcher() i=2 2024-09-12T17:50:11.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.906+0000 7f5c217a9800 20 remove_watcher() i=3 2024-09-12T17:50:11.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.907+0000 7f5c217a9800 20 remove_watcher() i=4 2024-09-12T17:50:11.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.908+0000 7f5c217a9800 20 remove_watcher() i=5 2024-09-12T17:50:11.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.909+0000 7f5c217a9800 20 remove_watcher() i=6 2024-09-12T17:50:11.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:11.910+0000 7f5c217a9800 20 remove_watcher() i=7 2024-09-12T17:50:11.922 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T17:50:12.538 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :clean 2024-09-12T17:50:13.335 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :compileJava 2024-09-12T17:50:13.335 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :processResources 2024-09-12T17:50:13.336 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :classes 2024-09-12T17:50:13.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:13.835 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :compileTestJava 2024-09-12T17:50:13.836 INFO:teuthology.orchestra.run.smithi044.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:50:13.836 INFO:teuthology.orchestra.run.smithi044.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:50:13.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:13.837 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:50:13.837 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :testClasses 2024-09-12T17:50:15.836 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:15.837 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :test 2024-09-12T17:50:15.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:15.837 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T17:50:15.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12 17:50:15,172 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:50:15.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:15.837 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T17:50:15.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:15.837 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T17:50:15.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:15.837 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T17:50:15.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:15.838 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T17:50:15.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:15.838 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T17:50:15.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:15.838 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T17:50:16.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:16.035 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T17:50:16.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:16.035 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T17:50:16.135 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:16.135 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T17:50:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:16.235 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T17:50:16.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:16.435 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T17:50:16.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:16.435 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T17:50:16.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:16.535 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T17:50:16.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:16.635 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T17:50:16.935 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:16.935 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T17:50:17.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:17.035 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T17:50:17.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T17:50:17.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T17:50:17.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:17.335 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------- 2024-09-12T17:50:17.335 INFO:teuthology.orchestra.run.smithi044.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T17:50:17.335 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------- 2024-09-12T17:50:17.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:17.340 INFO:teuthology.orchestra.run.smithi044.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:50:17.341 INFO:teuthology.orchestra.run.smithi044.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:50:17.341 INFO:teuthology.orchestra.run.smithi044.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:50:17.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:17.341 INFO:teuthology.orchestra.run.smithi044.stdout:BUILD SUCCESSFUL in 5s 2024-09-12T17:50:17.341 INFO:teuthology.orchestra.run.smithi044.stdout:5 actionable tasks: 5 executed 2024-09-12T17:50:17.345 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2024-09-12T17:50:17.398 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:17.398 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:17.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.435+0000 7f04ba51f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.437+0000 7f04ba51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:17.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.437+0000 7f04ba51f800 20 realm 2024-09-12T17:50:17.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.437+0000 7f04ba51f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.437+0000 7f04ba51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:17.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.437+0000 7f04ba51f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:17.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.437+0000 7f04ba51f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.437+0000 7f04ba51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:17.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.437+0000 7f04ba51f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.438+0000 7f04ba51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:17.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.438+0000 7f04ba51f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.439+0000 7f04ba51f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:17.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.439+0000 7f04ba51f800 20 searching for the correct realm 2024-09-12T17:50:17.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.442+0000 7f04b5aa1640 0 -- 172.21.15.44:0/929843960 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f04a8092070 msgr2=0x7f04a8092450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:17.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.446+0000 7f04b62a2640 0 -- 172.21.15.44:0/929843960 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f04ac05f040 msgr2=0x7f04ac05f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:17.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.653+0000 7f04ba51f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:50:17.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.653+0000 7f04ba51f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:50:17.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.653+0000 7f04ba51f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:17.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.653+0000 7f04ba51f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:17.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.653+0000 7f04ba51f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:17.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.653+0000 7f04ba51f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:17.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.653+0000 7f04ba51f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.653+0000 7f04ba51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:17.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.653+0000 7f04ba51f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.654+0000 7f04ba51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:17.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.654+0000 7f04ba51f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.654+0000 7f04ba51f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:17.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.654+0000 7f04ba51f800 20 zone default found 2024-09-12T17:50:17.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.654+0000 7f04ba51f800 4 Realm: () 2024-09-12T17:50:17.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.654+0000 7f04ba51f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:50:17.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.654+0000 7f04ba51f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:50:17.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.654+0000 7f04ba51f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:17.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.654+0000 7f04ba51f800 20 zonegroup default 2024-09-12T17:50:17.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.654+0000 7f04ba51f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.655+0000 7f04ba51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:17.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.655+0000 7f04ba51f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.655+0000 7f04ba51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:17.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.655+0000 7f04ba51f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.655+0000 7f04ba51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:17.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.655+0000 7f04ba51f800 20 started sync module instance, tier type = 2024-09-12T17:50:17.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.655+0000 7f04ba51f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:50:17.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.668+0000 7f04ba51f800 20 add_watcher() i=0 2024-09-12T17:50:17.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.668+0000 7f04ba51f800 20 add_watcher() i=1 2024-09-12T17:50:17.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.668+0000 7f04ba51f800 20 add_watcher() i=2 2024-09-12T17:50:17.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.668+0000 7f04ba51f800 20 add_watcher() i=3 2024-09-12T17:50:17.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.668+0000 7f04ba51f800 20 add_watcher() i=4 2024-09-12T17:50:17.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.668+0000 7f04ba51f800 20 add_watcher() i=5 2024-09-12T17:50:17.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.668+0000 7f04ba51f800 20 add_watcher() i=6 2024-09-12T17:50:17.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.669+0000 7f04ba51f800 20 add_watcher() i=7 2024-09-12T17:50:17.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.669+0000 7f04ba51f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:17.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.670+0000 7f036cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:17.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.671+0000 7f04ba51f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:17.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.671+0000 7f04ba51f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:17.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.712+0000 7f02e77fe640 20 reqs_thread_entry: start 2024-09-12T17:50:17.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.712+0000 7f04ba51f800 20 init_complete bucket index max shards: 11 2024-09-12T17:50:17.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.712+0000 7f04ba51f800 20 Filter name: none 2024-09-12T17:50:17.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.712+0000 7f02e57fa640 20 reqs_thread_entry: start 2024-09-12T17:50:17.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.713+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:50:17.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.714+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.715+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.715+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.716+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:50:17.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.718+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.718+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.718+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.720+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:50:17.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.721+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.721+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.722+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.723+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:50:17.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.724+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.725+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.725+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.726+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:50:17.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.728+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.728+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.729+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.730+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:50:17.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.731+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.731+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.732+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.733+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:50:17.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.734+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.734+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.735+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.735+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:50:17.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.737+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.737+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.737+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.738+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:50:17.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.740+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.741+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.741+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.743+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:50:17.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.744+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.744+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.745+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.745+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:50:17.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.747+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.747+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.748+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.749+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:50:17.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.750+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.750+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.751+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.752+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:50:17.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.753+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.754+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.754+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.755+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:50:17.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.756+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.757+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.757+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:17.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.757+0000 7f04ba51f800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7099458133107730430', time=2024-09-12T19:50:16.792232+0000, chain.objs.size()=1 2024-09-12T17:50:17.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.757+0000 7f04ba51f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.73__shadow_.twIcM9jpEI7f9KtlBuZF10b51iVMTaO_0 2024-09-12T17:50:17.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.758+0000 7f04ba51f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:17.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.760+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:50:17.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.762+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.762+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.763+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:17.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.763+0000 7f04ba51f800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3249469336019059007', time=2024-09-12T19:50:16.260180+0000, chain.objs.size()=1 2024-09-12T17:50:17.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.763+0000 7f04ba51f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.72__shadow_.9J96BOdflO6mLlGblcWWvKwmeesDMDg_0 2024-09-12T17:50:17.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.764+0000 7f04ba51f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:17.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.766+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:50:17.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.767+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.767+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.768+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.769+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:50:17.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.770+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.771+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.771+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.772+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:50:17.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.774+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.774+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.775+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.776+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:50:17.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.777+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.778+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.778+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.780+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:50:17.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.781+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.782+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.782+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.783+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:50:17.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.784+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.785+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.785+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.787+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:50:17.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.789+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.789+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.789+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.790+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:50:17.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.792+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.792+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.792+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.794+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:50:17.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.795+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.795+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.796+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.797+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:50:17.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.798+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.799+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.799+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.800+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:50:17.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.802+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.802+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.802+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.803+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:50:17.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.805+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.805+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.805+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.807+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:50:17.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.808+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.808+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.808+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.809+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:50:17.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.811+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.811+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.811+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.813+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:50:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.814+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.815+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.815+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.816+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:50:17.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.817+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.818+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.818+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.819+0000 7f04ba51f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:50:17.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.820+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.821+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:17.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.821+0000 7f04ba51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:17.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.824+0000 7f036cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:17.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.826+0000 7f04ba51f800 20 remove_watcher() i=0 2024-09-12T17:50:17.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.826+0000 7f04ba51f800 2 removed watcher, disabling cache 2024-09-12T17:50:17.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.827+0000 7f04ba51f800 20 remove_watcher() i=1 2024-09-12T17:50:17.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.828+0000 7f04ba51f800 20 remove_watcher() i=2 2024-09-12T17:50:17.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.829+0000 7f04ba51f800 20 remove_watcher() i=3 2024-09-12T17:50:17.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.830+0000 7f04ba51f800 20 remove_watcher() i=4 2024-09-12T17:50:17.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.831+0000 7f04ba51f800 20 remove_watcher() i=5 2024-09-12T17:50:17.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.832+0000 7f04ba51f800 20 remove_watcher() i=6 2024-09-12T17:50:17.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.833+0000 7f04ba51f800 20 remove_watcher() i=7 2024-09-12T17:50:17.846 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2024-09-12T17:50:17.899 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:17.899 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:17.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.937+0000 7f5a03d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.938+0000 7f5a03d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:17.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.938+0000 7f5a03d2e800 20 realm 2024-09-12T17:50:17.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.938+0000 7f5a03d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.938+0000 7f5a03d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:17.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.938+0000 7f5a03d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:17.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.938+0000 7f5a03d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.939+0000 7f5a03d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:17.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.939+0000 7f5a03d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.939+0000 7f5a03d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:17.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.939+0000 7f5a03d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.940+0000 7f5a03d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:17.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.940+0000 7f5a03d2e800 20 searching for the correct realm 2024-09-12T17:50:17.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.943+0000 7f5a002b1640 0 -- 172.21.15.44:0/3811381077 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x5620b22a5a20 msgr2=0x5620b22a7e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:17.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.947+0000 7f59ffab0640 0 -- 172.21.15.44:0/3811381077 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f59f40d28b0 msgr2=0x7f59f4082520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:17.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.950+0000 7f5a03d2e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:50:17.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.950+0000 7f5a03d2e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:50:17.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.950+0000 7f5a03d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:17.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.950+0000 7f5a03d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:17.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.950+0000 7f5a03d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:17.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.950+0000 7f5a03d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:17.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.950+0000 7f5a03d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.951+0000 7f5a03d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:17.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.951+0000 7f5a03d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.951+0000 7f5a03d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:17.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.951+0000 7f5a03d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.951+0000 7f5a03d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:17.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.951+0000 7f5a03d2e800 20 zone default found 2024-09-12T17:50:17.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.951+0000 7f5a03d2e800 4 Realm: () 2024-09-12T17:50:17.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.951+0000 7f5a03d2e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:50:17.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.951+0000 7f5a03d2e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:50:17.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.951+0000 7f5a03d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.951+0000 7f5a03d2e800 20 zonegroup default 2024-09-12T17:50:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.951+0000 7f5a03d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.952+0000 7f5a03d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.952+0000 7f5a03d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.952+0000 7f5a03d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.952+0000 7f5a03d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.952+0000 7f5a03d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.952+0000 7f5a03d2e800 20 started sync module instance, tier type = 2024-09-12T17:50:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.952+0000 7f5a03d2e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:50:17.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.961+0000 7f5a03d2e800 20 add_watcher() i=0 2024-09-12T17:50:17.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.961+0000 7f5a03d2e800 20 add_watcher() i=1 2024-09-12T17:50:17.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.961+0000 7f5a03d2e800 20 add_watcher() i=2 2024-09-12T17:50:17.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.961+0000 7f5a03d2e800 20 add_watcher() i=3 2024-09-12T17:50:17.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.961+0000 7f5a03d2e800 20 add_watcher() i=4 2024-09-12T17:50:17.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.961+0000 7f5a03d2e800 20 add_watcher() i=5 2024-09-12T17:50:17.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.961+0000 7f5a03d2e800 20 add_watcher() i=6 2024-09-12T17:50:17.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.962+0000 7f5a03d2e800 20 add_watcher() i=7 2024-09-12T17:50:17.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.962+0000 7f5a03d2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:17.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.964+0000 7f58b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:17.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.964+0000 7f5a03d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:17.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:17.964+0000 7f5a03d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:18.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.001+0000 7f58b4fe1640 20 reqs_thread_entry: start 2024-09-12T17:50:18.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.001+0000 7f5a03d2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:50:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.001+0000 7f5a03d2e800 20 Filter name: none 2024-09-12T17:50:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.001+0000 7f582e7fc640 20 reqs_thread_entry: start 2024-09-12T17:50:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.002+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:50:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.003+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.003+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.004+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.005+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:50:18.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.006+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.007+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.007+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.009+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:50:18.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.012+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.012+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.012+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.014+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:50:18.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.017+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.018+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.018+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.020+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:50:18.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.021+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.022+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.022+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.023+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:50:18.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.025+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.025+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.026+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.027+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:50:18.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.028+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.028+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.029+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.030+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:50:18.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.031+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.032+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.032+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.033+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:50:18.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.034+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.034+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.035+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.036+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:50:18.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.037+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.038+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.038+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.039+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:50:18.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.040+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.041+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.041+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.042+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:50:18.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.043+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.044+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.044+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.045+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:50:18.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.046+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.047+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.047+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.048+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:50:18.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.050+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.050+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.050+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.052+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:50:18.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.053+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.054+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.054+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.055+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:50:18.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.058+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.059+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.059+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.061+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:50:18.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.062+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.063+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.063+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.064+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:50:18.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.065+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.066+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.066+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.067+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:50:18.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.069+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.070+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.070+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.071+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:50:18.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.074+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.074+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.075+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.076+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:50:18.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.079+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.080+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.080+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.082+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:50:18.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.083+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.084+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.084+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.085+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:50:18.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.087+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.087+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.087+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.089+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:50:18.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.090+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.091+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.091+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.092+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:50:18.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.093+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.094+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.094+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.095+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:50:18.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.096+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.097+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.097+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.098+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:50:18.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.100+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.100+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.101+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.102+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:50:18.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.105+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.105+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.105+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.107+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:50:18.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.108+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.109+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.109+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.110+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:50:18.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.112+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.112+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.112+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.114+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:50:18.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.115+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.116+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.116+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.117+0000 7f5a03d2e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:50:18.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.118+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.119+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.119+0000 7f5a03d2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.121+0000 7f58b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:18.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.123+0000 7f5a03d2e800 20 remove_watcher() i=0 2024-09-12T17:50:18.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.123+0000 7f5a03d2e800 2 removed watcher, disabling cache 2024-09-12T17:50:18.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.124+0000 7f5a03d2e800 20 remove_watcher() i=1 2024-09-12T17:50:18.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.125+0000 7f5a03d2e800 20 remove_watcher() i=2 2024-09-12T17:50:18.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.127+0000 7f5a03d2e800 20 remove_watcher() i=3 2024-09-12T17:50:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.128+0000 7f5a03d2e800 20 remove_watcher() i=4 2024-09-12T17:50:18.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.129+0000 7f5a03d2e800 20 remove_watcher() i=5 2024-09-12T17:50:18.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.130+0000 7f5a03d2e800 20 remove_watcher() i=6 2024-09-12T17:50:18.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.131+0000 7f5a03d2e800 20 remove_watcher() i=7 2024-09-12T17:50:18.144 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2024-09-12T17:50:18.197 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:18.198 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:18.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.236+0000 7fcbda325800 20 rados->read ofs=0 len=0 2024-09-12T17:50:18.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.237+0000 7fcbda325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:18.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.237+0000 7fcbda325800 20 realm 2024-09-12T17:50:18.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.237+0000 7fcbda325800 20 rados->read ofs=0 len=0 2024-09-12T17:50:18.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.238+0000 7fcbda325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:18.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.238+0000 7fcbda325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:18.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.238+0000 7fcbda325800 20 rados->read ofs=0 len=0 2024-09-12T17:50:18.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.238+0000 7fcbda325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:18.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.238+0000 7fcbda325800 20 rados->read ofs=0 len=0 2024-09-12T17:50:18.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.239+0000 7fcbda325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:18.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.239+0000 7fcbda325800 20 rados->read ofs=0 len=0 2024-09-12T17:50:18.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.239+0000 7fcbda325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:18.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.239+0000 7fcbda325800 20 searching for the correct realm 2024-09-12T17:50:18.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.241+0000 7fcbd57b4640 0 -- 172.21.15.44:0/1463960781 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fcbc8050040 msgr2=0x7fcbc805f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:18.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.448+0000 7fcbd5fb5640 0 -- 172.21.15.44:0/1463960781 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fcbc0096920 msgr2=0x7fcbc0093390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:18.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.655+0000 7fcbda325800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:50:18.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.655+0000 7fcbda325800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:50:18.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.655+0000 7fcbda325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:18.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.655+0000 7fcbda325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:18.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.655+0000 7fcbda325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:18.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.655+0000 7fcbda325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:18.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.655+0000 7fcbda325800 20 rados->read ofs=0 len=0 2024-09-12T17:50:18.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.656+0000 7fcbda325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:18.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.656+0000 7fcbda325800 20 rados->read ofs=0 len=0 2024-09-12T17:50:18.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.656+0000 7fcbda325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:18.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.656+0000 7fcbda325800 20 rados->read ofs=0 len=0 2024-09-12T17:50:18.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.657+0000 7fcbda325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:18.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.657+0000 7fcbda325800 20 zone default found 2024-09-12T17:50:18.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.657+0000 7fcbda325800 4 Realm: () 2024-09-12T17:50:18.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.657+0000 7fcbda325800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:50:18.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.657+0000 7fcbda325800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:50:18.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.657+0000 7fcbda325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:18.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.657+0000 7fcbda325800 20 zonegroup default 2024-09-12T17:50:18.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.657+0000 7fcbda325800 20 rados->read ofs=0 len=0 2024-09-12T17:50:18.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.657+0000 7fcbda325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:18.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.657+0000 7fcbda325800 20 rados->read ofs=0 len=0 2024-09-12T17:50:18.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.657+0000 7fcbda325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:18.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.658+0000 7fcbda325800 20 rados->read ofs=0 len=0 2024-09-12T17:50:18.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.658+0000 7fcbda325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:18.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.658+0000 7fcbda325800 20 started sync module instance, tier type = 2024-09-12T17:50:18.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.658+0000 7fcbda325800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:50:18.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.667+0000 7fcbda325800 20 add_watcher() i=0 2024-09-12T17:50:18.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.667+0000 7fcbda325800 20 add_watcher() i=1 2024-09-12T17:50:18.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.667+0000 7fcbda325800 20 add_watcher() i=2 2024-09-12T17:50:18.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.667+0000 7fcbda325800 20 add_watcher() i=3 2024-09-12T17:50:18.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.667+0000 7fcbda325800 20 add_watcher() i=4 2024-09-12T17:50:18.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.667+0000 7fcbda325800 20 add_watcher() i=5 2024-09-12T17:50:18.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.667+0000 7fcbda325800 20 add_watcher() i=6 2024-09-12T17:50:18.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.668+0000 7fcbda325800 20 add_watcher() i=7 2024-09-12T17:50:18.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.668+0000 7fcbda325800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:18.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.670+0000 7fca877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:18.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.670+0000 7fcbda325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:18.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.670+0000 7fcbda325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:18.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.706+0000 7fca867fc640 20 reqs_thread_entry: start 2024-09-12T17:50:18.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.707+0000 7fcbda325800 20 init_complete bucket index max shards: 11 2024-09-12T17:50:18.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.707+0000 7fcbda325800 20 Filter name: none 2024-09-12T17:50:18.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.707+0000 7fc9f7fff640 20 reqs_thread_entry: start 2024-09-12T17:50:18.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.707+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:50:18.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.708+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.709+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.709+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.710+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:50:18.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.711+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.712+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.712+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.713+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:50:18.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.715+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.715+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.715+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.716+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:50:18.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.718+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.718+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.718+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.720+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:50:18.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.721+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.722+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.722+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.723+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:50:18.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.724+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.725+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.725+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.726+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:50:18.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.728+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.728+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.728+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.730+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:50:18.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.731+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.731+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.732+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.733+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:50:18.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.734+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.735+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.735+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.737+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:50:18.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.739+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.739+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.739+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.741+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:50:18.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.743+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.743+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.743+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.744+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:50:18.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.746+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.746+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.746+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.748+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:50:18.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.749+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.750+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.750+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.751+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:50:18.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.754+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.754+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.755+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.756+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:50:18.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.759+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.760+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.760+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.761+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:50:18.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.762+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.763+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.763+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.764+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:50:18.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.766+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.766+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.766+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.767+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:50:18.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.769+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.769+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.769+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.770+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:50:18.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.772+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.772+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.773+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.774+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:50:18.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.775+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.776+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.776+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.777+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:50:18.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.778+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.779+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.779+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.780+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:50:18.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.782+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.782+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.782+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.783+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:50:18.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.784+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.785+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.785+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.786+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:50:18.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.787+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.788+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.788+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.789+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:50:18.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.790+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.791+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.791+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.792+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:50:18.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.793+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.794+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.794+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.795+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:50:18.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.796+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.797+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.797+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.798+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:50:18.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.799+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.800+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.800+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.801+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:50:18.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.803+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.803+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.803+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.804+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:50:18.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.806+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.806+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.806+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.807+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:50:18.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.809+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.809+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.809+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.810+0000 7fcbda325800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:50:18.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.812+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.812+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:18.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.812+0000 7fcbda325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:18.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.814+0000 7fca877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:18.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.816+0000 7fcbda325800 20 remove_watcher() i=0 2024-09-12T17:50:18.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.816+0000 7fcbda325800 2 removed watcher, disabling cache 2024-09-12T17:50:18.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.817+0000 7fcbda325800 20 remove_watcher() i=1 2024-09-12T17:50:18.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.818+0000 7fcbda325800 20 remove_watcher() i=2 2024-09-12T17:50:18.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.819+0000 7fcbda325800 20 remove_watcher() i=3 2024-09-12T17:50:18.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.820+0000 7fcbda325800 20 remove_watcher() i=4 2024-09-12T17:50:18.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.821+0000 7fcbda325800 20 remove_watcher() i=5 2024-09-12T17:50:18.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.822+0000 7fcbda325800 20 remove_watcher() i=6 2024-09-12T17:50:18.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.823+0000 7fcbda325800 20 remove_watcher() i=7 2024-09-12T17:50:18.836 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2024-09-12T17:50:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:18.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.927+0000 7f7058214800 20 rados->read ofs=0 len=0 2024-09-12T17:50:18.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.928+0000 7f7058214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:18.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.928+0000 7f7058214800 20 realm 2024-09-12T17:50:18.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.928+0000 7f7058214800 20 rados->read ofs=0 len=0 2024-09-12T17:50:18.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.928+0000 7f7058214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:18.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.928+0000 7f7058214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:18.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.928+0000 7f7058214800 20 rados->read ofs=0 len=0 2024-09-12T17:50:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.929+0000 7f7058214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:18.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.929+0000 7f7058214800 20 rados->read ofs=0 len=0 2024-09-12T17:50:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.930+0000 7f7058214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.930+0000 7f7058214800 20 rados->read ofs=0 len=0 2024-09-12T17:50:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.930+0000 7f7058214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:18.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.930+0000 7f7058214800 20 searching for the correct realm 2024-09-12T17:50:18.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.933+0000 7f70540cc640 0 -- 172.21.15.44:0/2141666816 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f7048024020 msgr2=0x7f7048045f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:18.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:18.936+0000 7f70538cb640 0 -- 172.21.15.44:0/2141666816 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f7048004b60 msgr2=0x7f7048050170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:19.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.142+0000 7f7058214800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:50:19.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.142+0000 7f7058214800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:50:19.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.142+0000 7f7058214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:19.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.142+0000 7f7058214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:19.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.142+0000 7f7058214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:19.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.142+0000 7f7058214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:19.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.142+0000 7f7058214800 20 rados->read ofs=0 len=0 2024-09-12T17:50:19.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.142+0000 7f7058214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:19.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.142+0000 7f7058214800 20 rados->read ofs=0 len=0 2024-09-12T17:50:19.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.143+0000 7f7058214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:19.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.143+0000 7f7058214800 20 rados->read ofs=0 len=0 2024-09-12T17:50:19.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.143+0000 7f7058214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:19.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.143+0000 7f7058214800 20 zone default found 2024-09-12T17:50:19.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.143+0000 7f7058214800 4 Realm: () 2024-09-12T17:50:19.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.143+0000 7f7058214800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:50:19.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.143+0000 7f7058214800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:50:19.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.143+0000 7f7058214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:19.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.143+0000 7f7058214800 20 zonegroup default 2024-09-12T17:50:19.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.143+0000 7f7058214800 20 rados->read ofs=0 len=0 2024-09-12T17:50:19.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.143+0000 7f7058214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:19.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.143+0000 7f7058214800 20 rados->read ofs=0 len=0 2024-09-12T17:50:19.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.144+0000 7f7058214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:19.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.144+0000 7f7058214800 20 rados->read ofs=0 len=0 2024-09-12T17:50:19.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.145+0000 7f7058214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:19.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.145+0000 7f7058214800 20 started sync module instance, tier type = 2024-09-12T17:50:19.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.145+0000 7f7058214800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:50:19.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.154+0000 7f7058214800 20 add_watcher() i=0 2024-09-12T17:50:19.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.154+0000 7f7058214800 20 add_watcher() i=1 2024-09-12T17:50:19.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.154+0000 7f7058214800 20 add_watcher() i=2 2024-09-12T17:50:19.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.154+0000 7f7058214800 20 add_watcher() i=3 2024-09-12T17:50:19.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.154+0000 7f7058214800 20 add_watcher() i=4 2024-09-12T17:50:19.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.154+0000 7f7058214800 20 add_watcher() i=5 2024-09-12T17:50:19.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.154+0000 7f7058214800 20 add_watcher() i=6 2024-09-12T17:50:19.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.155+0000 7f7058214800 20 add_watcher() i=7 2024-09-12T17:50:19.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.155+0000 7f7058214800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:19.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.157+0000 7f6f09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:19.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.157+0000 7f7058214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:19.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.157+0000 7f7058214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.195+0000 7f6f08fe1640 20 reqs_thread_entry: start 2024-09-12T17:50:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.196+0000 7f7058214800 20 init_complete bucket index max shards: 11 2024-09-12T17:50:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.196+0000 7f7058214800 20 Filter name: none 2024-09-12T17:50:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.196+0000 7f6e827fc640 20 reqs_thread_entry: start 2024-09-12T17:50:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.196+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:50:19.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.197+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.198+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.198+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.199+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:50:19.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.200+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.201+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.201+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.202+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:50:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.204+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.204+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.204+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.205+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:50:19.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.207+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.207+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.207+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.208+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:50:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.210+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.210+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.210+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.211+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:50:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.213+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.214+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.214+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.216+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:50:19.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.217+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.218+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.218+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.219+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:50:19.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.220+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.221+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.221+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.222+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:50:19.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.223+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.224+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.224+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.225+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:50:19.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.226+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.227+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.227+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.228+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:50:19.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.230+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.231+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.231+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.232+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:50:19.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.233+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.234+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.234+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.235+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:50:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.236+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.237+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.237+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.239+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:50:19.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.240+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.241+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.241+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.242+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:50:19.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.243+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.244+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.244+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.245+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:50:19.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.246+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.246+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.247+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.248+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:50:19.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.249+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.250+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.250+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.251+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:50:19.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.252+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.253+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.253+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.254+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:50:19.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.256+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.256+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.256+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.257+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:50:19.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.259+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.259+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.259+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.261+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:50:19.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.262+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.262+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.263+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.264+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:50:19.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.265+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.266+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.266+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.267+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:50:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.270+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.270+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.270+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.272+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:50:19.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.274+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.274+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.275+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.276+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:50:19.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.277+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.277+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.277+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.278+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:50:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.280+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.280+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.280+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.281+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:50:19.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.282+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.283+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.283+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.284+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:50:19.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.286+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.286+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.287+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.288+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:50:19.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.289+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.290+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.290+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.291+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:50:19.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.294+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.295+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.295+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.297+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:50:19.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.300+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.300+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.300+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.302+0000 7f7058214800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:50:19.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.303+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.304+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:19.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.304+0000 7f7058214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:19.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.306+0000 7f6f09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:19.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.308+0000 7f7058214800 20 remove_watcher() i=0 2024-09-12T17:50:19.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.308+0000 7f7058214800 2 removed watcher, disabling cache 2024-09-12T17:50:19.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.310+0000 7f7058214800 20 remove_watcher() i=1 2024-09-12T17:50:19.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.311+0000 7f7058214800 20 remove_watcher() i=2 2024-09-12T17:50:19.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.312+0000 7f7058214800 20 remove_watcher() i=3 2024-09-12T17:50:19.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.313+0000 7f7058214800 20 remove_watcher() i=4 2024-09-12T17:50:19.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.314+0000 7f7058214800 20 remove_watcher() i=5 2024-09-12T17:50:19.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.315+0000 7f7058214800 20 remove_watcher() i=6 2024-09-12T17:50:19.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:19.316+0000 7f7058214800 20 remove_watcher() i=7 2024-09-12T17:50:19.329 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T17:50:19.980 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :clean 2024-09-12T17:50:20.576 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :compileJava 2024-09-12T17:50:20.576 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :processResources 2024-09-12T17:50:20.576 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :classes 2024-09-12T17:50:21.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:21.176 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :compileTestJava 2024-09-12T17:50:21.177 INFO:teuthology.orchestra.run.smithi044.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:50:21.177 INFO:teuthology.orchestra.run.smithi044.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:50:21.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:21.178 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:50:21.178 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :testClasses 2024-09-12T17:50:23.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:23.178 INFO:teuthology.orchestra.run.smithi044.stdout:> Task :test 2024-09-12T17:50:23.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:23.178 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests STANDARD_OUT 2024-09-12T17:50:23.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12 17:50:22,445 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:50:23.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:23.178 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T17:50:23.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:23.178 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T17:50:23.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:23.178 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T17:50:23.178 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:23.178 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T17:50:23.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:23.276 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T17:50:23.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:23.276 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T17:50:23.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:23.477 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T17:50:24.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:24.477 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T17:50:24.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:24.676 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T17:50:24.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:24.776 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T17:50:24.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:24.976 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T17:50:25.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:25.076 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T17:50:25.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:25.276 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T17:50:25.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:25.276 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T17:50:25.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:25.377 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T17:50:25.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:25.377 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T17:50:25.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:25.576 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T17:50:25.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:25.776 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T17:50:25.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:25.976 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T17:50:25.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:25.977 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T17:50:26.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:26.176 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T17:50:26.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:26.177 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T17:50:26.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:26.376 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T17:50:26.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:26.476 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T17:50:26.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:26.676 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T17:50:26.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:26.676 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T17:50:26.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:26.876 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T17:50:26.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:26.976 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T17:50:27.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:27.176 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T17:50:27.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:27.177 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T17:50:27.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:27.476 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T17:50:27.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:27.576 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T17:50:27.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:27.776 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T17:50:28.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:28.276 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T17:50:28.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:28.576 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T17:50:32.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:32.877 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T17:50:33.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T17:50:33.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:33.276 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T17:50:33.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T17:50:33.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:33.476 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T17:50:33.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:33.776 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T17:50:34.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:34.276 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T17:50:34.475 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:34.476 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T17:50:34.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:34.576 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T17:50:34.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:34.676 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T17:50:35.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:35.376 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T17:50:35.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:35.476 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T17:50:35.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:35.976 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T17:50:36.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:36.276 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T17:50:37.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:37.176 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T17:50:37.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:37.376 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T17:50:39.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:39.977 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T17:50:40.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:40.276 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T17:50:41.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:41.076 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T17:50:41.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:41.276 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T17:50:41.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:41.776 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T17:50:41.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:41.976 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T17:50:42.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:42.376 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T17:50:42.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:42.776 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T17:50:42.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:42.776 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T17:50:42.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:42.876 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T17:50:42.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:42.876 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T17:50:43.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:43.076 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T17:50:43.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:43.176 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T17:50:43.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:43.376 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T17:50:43.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:43.376 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T17:50:43.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:43.576 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T17:50:43.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:43.676 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T17:50:43.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:43.876 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T17:50:43.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:43.877 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T17:50:44.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:44.076 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T17:50:44.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:44.076 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T17:50:44.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:44.276 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T17:50:44.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:44.376 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T17:50:44.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:44.576 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T17:50:44.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:44.676 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T17:50:44.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:44.876 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T17:50:44.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:44.976 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T17:50:45.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:45.176 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T17:50:45.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:45.276 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T17:50:45.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:45.476 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T17:50:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:45.577 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T17:50:45.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:45.776 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T17:50:45.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:45.876 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T17:50:46.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:46.076 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T17:50:46.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:46.176 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T17:50:46.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:46.376 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T17:50:46.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:46.476 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T17:50:46.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:46.676 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T17:50:46.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:46.776 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T17:50:46.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:46.976 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T17:50:47.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:47.076 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T17:50:47.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:47.276 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T17:50:47.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:47.376 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T17:50:47.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:47.576 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T17:50:47.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:47.576 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T17:50:47.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:47.876 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T17:50:47.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:47.876 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T17:50:48.075 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:48.076 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T17:50:48.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:48.176 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T17:50:48.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:48.376 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T17:50:48.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:48.476 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T17:50:48.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:48.676 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T17:50:48.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:48.776 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T17:50:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:48.976 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T17:50:49.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:49.076 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T17:50:49.275 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:49.276 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T17:50:49.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:49.376 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T17:50:49.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:49.576 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T17:50:49.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:49.676 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T17:50:49.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:49.876 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T17:50:49.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:49.876 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T17:50:50.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:50.176 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T17:50:50.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:50.176 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T17:50:50.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:50.376 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T17:50:50.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:50.476 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T17:50:50.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:50.676 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T17:50:50.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:50.776 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T17:50:50.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:50.976 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T17:50:50.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:50.976 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T17:50:51.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:51.176 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T17:50:51.176 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:51.176 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T17:50:51.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:51.376 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T17:50:51.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:51.376 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T17:50:51.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:51.576 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T17:50:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:51.676 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T17:50:51.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:51.876 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T17:50:51.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:51.976 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T17:50:52.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:52.076 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T17:50:52.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:52.076 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T17:50:52.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:52.276 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T17:50:52.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:52.376 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T17:50:52.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:52.576 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T17:50:52.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:52.676 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T17:50:52.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:52.876 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T17:50:52.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:52.876 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T17:50:53.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:53.076 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T17:50:53.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:53.376 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T17:50:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:53.576 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T17:50:53.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:53.976 INFO:teuthology.orchestra.run.smithi044.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T17:50:54.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:54.138 INFO:teuthology.orchestra.run.smithi044.stdout:---------------------------------------------------------------------- 2024-09-12T17:50:54.138 INFO:teuthology.orchestra.run.smithi044.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T17:50:54.138 INFO:teuthology.orchestra.run.smithi044.stdout:---------------------------------------------------------------------- 2024-09-12T17:50:54.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:54.138 INFO:teuthology.orchestra.run.smithi044.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:50:54.138 INFO:teuthology.orchestra.run.smithi044.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:50:54.138 INFO:teuthology.orchestra.run.smithi044.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:50:54.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:54.138 INFO:teuthology.orchestra.run.smithi044.stdout:BUILD SUCCESSFUL in 34s 2024-09-12T17:50:54.138 INFO:teuthology.orchestra.run.smithi044.stdout:5 actionable tasks: 5 executed 2024-09-12T17:50:54.153 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2024-09-12T17:50:54.208 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:54.208 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:54.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.248+0000 7f3f89b24800 20 rados->read ofs=0 len=0 2024-09-12T17:50:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.249+0000 7f3f89b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.249+0000 7f3f89b24800 20 realm 2024-09-12T17:50:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.249+0000 7f3f89b24800 20 rados->read ofs=0 len=0 2024-09-12T17:50:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.249+0000 7f3f89b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.249+0000 7f3f89b24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.249+0000 7f3f89b24800 20 rados->read ofs=0 len=0 2024-09-12T17:50:54.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.250+0000 7f3f89b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:54.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.250+0000 7f3f89b24800 20 rados->read ofs=0 len=0 2024-09-12T17:50:54.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.251+0000 7f3f89b24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:54.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.251+0000 7f3f89b24800 20 rados->read ofs=0 len=0 2024-09-12T17:50:54.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.251+0000 7f3f89b24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.251+0000 7f3f89b24800 20 searching for the correct realm 2024-09-12T17:50:54.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.254+0000 7f3f85f03640 0 -- 172.21.15.44:0/3849959499 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f3f7c039040 msgr2=0x7f3f7c022410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.257+0000 7f3f85702640 0 -- 172.21.15.44:0/3849959499 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f3f7c044900 msgr2=0x7f3f7c008430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:50:54.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.463+0000 7f3f89b24800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:50:54.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.463+0000 7f3f89b24800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:50:54.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.463+0000 7f3f89b24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:54.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.463+0000 7f3f89b24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:54.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.463+0000 7f3f89b24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:54.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.463+0000 7f3f89b24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:54.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.463+0000 7f3f89b24800 20 rados->read ofs=0 len=0 2024-09-12T17:50:54.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.464+0000 7f3f89b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:54.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.464+0000 7f3f89b24800 20 rados->read ofs=0 len=0 2024-09-12T17:50:54.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.464+0000 7f3f89b24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:54.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.464+0000 7f3f89b24800 20 rados->read ofs=0 len=0 2024-09-12T17:50:54.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.465+0000 7f3f89b24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:54.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.465+0000 7f3f89b24800 20 zone default found 2024-09-12T17:50:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.465+0000 7f3f89b24800 4 Realm: () 2024-09-12T17:50:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.465+0000 7f3f89b24800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:50:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.465+0000 7f3f89b24800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:50:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.465+0000 7f3f89b24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.465+0000 7f3f89b24800 20 zonegroup default 2024-09-12T17:50:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.465+0000 7f3f89b24800 20 rados->read ofs=0 len=0 2024-09-12T17:50:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.465+0000 7f3f89b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.465+0000 7f3f89b24800 20 rados->read ofs=0 len=0 2024-09-12T17:50:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.465+0000 7f3f89b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.465+0000 7f3f89b24800 20 rados->read ofs=0 len=0 2024-09-12T17:50:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.465+0000 7f3f89b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.465+0000 7f3f89b24800 20 started sync module instance, tier type = 2024-09-12T17:50:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.465+0000 7f3f89b24800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:50:54.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.475+0000 7f3f89b24800 20 add_watcher() i=0 2024-09-12T17:50:54.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.475+0000 7f3f89b24800 20 add_watcher() i=1 2024-09-12T17:50:54.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.475+0000 7f3f89b24800 20 add_watcher() i=2 2024-09-12T17:50:54.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.475+0000 7f3f89b24800 20 add_watcher() i=3 2024-09-12T17:50:54.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.475+0000 7f3f89b24800 20 add_watcher() i=4 2024-09-12T17:50:54.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.475+0000 7f3f89b24800 20 add_watcher() i=5 2024-09-12T17:50:54.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.475+0000 7f3f89b24800 20 add_watcher() i=6 2024-09-12T17:50:54.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.476+0000 7f3f89b24800 20 add_watcher() i=7 2024-09-12T17:50:54.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.476+0000 7f3f89b24800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:54.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.478+0000 7f3e3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:54.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.478+0000 7f3f89b24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:54.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.478+0000 7f3f89b24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:54.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.514+0000 7f3e3a7e4640 20 reqs_thread_entry: start 2024-09-12T17:50:54.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.514+0000 7f3f89b24800 20 init_complete bucket index max shards: 11 2024-09-12T17:50:54.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.514+0000 7f3f89b24800 20 Filter name: none 2024-09-12T17:50:54.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.514+0000 7f3dabfff640 20 reqs_thread_entry: start 2024-09-12T17:50:54.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.514+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:50:54.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.515+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.516+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.517+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:50:54.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.517+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6181850798311267509', time=2024-09-12T19:50:42.914386+0000, chain.objs.size()=1 2024-09-12T17:50:54.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.517+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.107__shadow_.Cd42lgvj0p_LoveEY2SZRJoYIa5n9wz_0 2024-09-12T17:50:54.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.517+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8493142730218476009', time=2024-09-12T19:50:45.316386+0000, chain.objs.size()=1 2024-09-12T17:50:54.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.517+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.116__shadow_.-KVO_AgwtqyQve8PuWabKfsI1AhZ0Wx_0 2024-09-12T17:50:54.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.517+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2373257582884738349', time=2024-09-12T19:50:47.370168+0000, chain.objs.size()=1 2024-09-12T17:50:54.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.517+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.123__shadow_.CX_Bsy9M-lmFFEYYPdIIFuKesMBR0Nn_0 2024-09-12T17:50:54.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.518+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.520+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:50:54.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.521+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.522+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.522+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:50:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.522+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7773830843435683149', time=2024-09-12T19:50:46.190774+0000, chain.objs.size()=1 2024-09-12T17:50:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.522+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.119__shadow_.WuJSIzmxSNXjR_GSvY6g_EE3LSt7vs7_0 2024-09-12T17:50:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.522+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4924303532803562923', time=2024-09-12T19:50:46.787728+0000, chain.objs.size()=1 2024-09-12T17:50:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.522+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.121__shadow_.T25ASblrBWDUhoADlz6InrZiK2rvosS_0 2024-09-12T17:50:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.522+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9245063868064492787', time=2024-09-12T19:50:53.975668+0000, chain.objs.size()=1 2024-09-12T17:50:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.522+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.145__shadow_.E2ihAxPMaiOAzpgQcdIRZFG3vI8vXVd_0 2024-09-12T17:50:54.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.523+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.525+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:50:54.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.527+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.527+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.527+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:50:54.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.527+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11048943072193008398', time=2024-09-12T19:50:28.438525+0000, chain.objs.size()=5 2024-09-12T17:50:54.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.527+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.92__multipart_key1.2~TQIlXogkID0cse3Qg-AGBHjWw-HXApk.1 2024-09-12T17:50:54.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.527+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.92__multipart_key1.2~TQIlXogkID0cse3Qg-AGBHjWw-HXApk.2 2024-09-12T17:50:54.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.528+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.92__multipart_key1.2~TQIlXogkID0cse3Qg-AGBHjWw-HXApk.3 2024-09-12T17:50:54.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.528+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.92__multipart_key1.2~TQIlXogkID0cse3Qg-AGBHjWw-HXApk.4 2024-09-12T17:50:54.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.528+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.92__multipart_key1.2~TQIlXogkID0cse3Qg-AGBHjWw-HXApk.5 2024-09-12T17:50:54.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.528+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11943191492653145388', time=2024-09-12T19:50:32.787019+0000, chain.objs.size()=5 2024-09-12T17:50:54.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.528+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~9NK1cUXQuNGNMZSRVWsMIohcJYeEVDw.1 2024-09-12T17:50:54.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.528+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__shadow_key1.2~9NK1cUXQuNGNMZSRVWsMIohcJYeEVDw.1_1 2024-09-12T17:50:54.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.528+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~9NK1cUXQuNGNMZSRVWsMIohcJYeEVDw.2 2024-09-12T17:50:54.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.528+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__shadow_key1.2~9NK1cUXQuNGNMZSRVWsMIohcJYeEVDw.2_1 2024-09-12T17:50:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.528+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~9NK1cUXQuNGNMZSRVWsMIohcJYeEVDw.3 2024-09-12T17:50:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.528+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13358071945006300465', time=2024-09-12T19:50:45.621157+0000, chain.objs.size()=1 2024-09-12T17:50:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.528+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.117__shadow_.PPUkp-fA8vwKGEOeReB9uRLI6E7ecW8_0 2024-09-12T17:50:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.528+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3709897333031282123', time=2024-09-12T19:50:45.895643+0000, chain.objs.size()=1 2024-09-12T17:50:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.528+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.118__shadow_.xXwYpvV2qPJCj75CLniTi8KqcfowhLu_0 2024-09-12T17:50:54.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.531+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7746114897642503417', time=2024-09-12T19:50:48.517632+0000, chain.objs.size()=1 2024-09-12T17:50:54.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.531+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.127__shadow_.PAYge45UsH6AsFm0rwdP4r3PDvLcmDo_0 2024-09-12T17:50:54.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.531+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10109976611989678489', time=2024-09-12T19:50:50.524185+0000, chain.objs.size()=1 2024-09-12T17:50:54.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.531+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.134__shadow_.nE1EOFqbd9WSTBrdyrtWp63bpiknEAa_0 2024-09-12T17:50:54.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.532+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.534+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:50:54.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.536+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.536+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:50:54.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12526892907004068075', time=2024-09-12T19:50:31.371513+0000, chain.objs.size()=5 2024-09-12T17:50:54.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~qTAFH5qpz2LvbE1DgNLQQvVyi1FvxWr.1 2024-09-12T17:50:54.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~qTAFH5qpz2LvbE1DgNLQQvVyi1FvxWr.2 2024-09-12T17:50:54.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~qTAFH5qpz2LvbE1DgNLQQvVyi1FvxWr.3 2024-09-12T17:50:54.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~qTAFH5qpz2LvbE1DgNLQQvVyi1FvxWr.4 2024-09-12T17:50:54.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~qTAFH5qpz2LvbE1DgNLQQvVyi1FvxWr.5 2024-09-12T17:50:54.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2122022000945478696', time=2024-09-12T19:50:33.052416+0000, chain.objs.size()=4 2024-09-12T17:50:54.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.94__shadow_._knm04elyA4VmlOi8dwcwR3s7TpF5my_0 2024-09-12T17:50:54.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.94__shadow_._knm04elyA4VmlOi8dwcwR3s7TpF5my_1 2024-09-12T17:50:54.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.94__shadow_._knm04elyA4VmlOi8dwcwR3s7TpF5my_2 2024-09-12T17:50:54.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.94__shadow_._knm04elyA4VmlOi8dwcwR3s7TpF5my_3 2024-09-12T17:50:54.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6795671780550048227', time=2024-09-12T19:50:44.737067+0000, chain.objs.size()=1 2024-09-12T17:50:54.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.114__shadow_.hcHcet_jMPytoM3SNIPj99X87Rnn2dp_0 2024-09-12T17:50:54.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11599086345225528688', time=2024-09-12T19:50:45.024579+0000, chain.objs.size()=1 2024-09-12T17:50:54.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.115__shadow_._WGTTWo7zAo8R2PQz2BEEQL0quz6YDH_0 2024-09-12T17:50:54.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.741416577101998706', time=2024-09-12T19:50:49.115893+0000, chain.objs.size()=1 2024-09-12T17:50:54.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.537+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.129__shadow_.NljBRlY20GCBKtEwK9_FNYSXTBbyp10_0 2024-09-12T17:50:54.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.540+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15513402871990111362', time=2024-09-12T19:50:52.139359+0000, chain.objs.size()=1 2024-09-12T17:50:54.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.540+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.140__shadow_.BDf3-pYmewix8ZmSxSkehuhoCip-uhR_0 2024-09-12T17:50:54.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.543+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.545+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:50:54.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.547+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.547+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.547+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:50:54.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.547+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14765670601282992121', time=2024-09-12T19:50:44.741790+0000, chain.objs.size()=1 2024-09-12T17:50:54.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.547+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.114__shadow_.mkMv4SlC034KuGye1HTgtS-bwiBL1lm_0 2024-09-12T17:50:54.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.547+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12453235037336958517', time=2024-09-12T19:50:45.321093+0000, chain.objs.size()=1 2024-09-12T17:50:54.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.547+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.116__shadow_.OKfUXkpuLGAJOLjusP3bdsuSMM19Ena_0 2024-09-12T17:50:54.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.549+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.551+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:50:54.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.552+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.552+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:50:54.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='2~CEZZpCM3fxn6U5rhOEKRZ0ikeKKuKJl', time=2024-09-12T19:50:24.425085+0000, chain.objs.size()=5 2024-09-12T17:50:54.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.80__multipart_key1.2~CEZZpCM3fxn6U5rhOEKRZ0ikeKKuKJl.1 2024-09-12T17:50:54.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.80__multipart_key1.2~CEZZpCM3fxn6U5rhOEKRZ0ikeKKuKJl.2 2024-09-12T17:50:54.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.80__multipart_key1.2~CEZZpCM3fxn6U5rhOEKRZ0ikeKKuKJl.3 2024-09-12T17:50:54.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.80__multipart_key1.2~CEZZpCM3fxn6U5rhOEKRZ0ikeKKuKJl.4 2024-09-12T17:50:54.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.80__multipart_key1.2~CEZZpCM3fxn6U5rhOEKRZ0ikeKKuKJl.5 2024-09-12T17:50:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10760359695688210571', time=2024-09-12T19:50:38.069588+0000, chain.objs.size()=5 2024-09-12T17:50:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~wq_PUV-bHnmYLK6zvkofhhAzPa2KJVh.1 2024-09-12T17:50:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~wq_PUV-bHnmYLK6zvkofhhAzPa2KJVh.2 2024-09-12T17:50:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~wq_PUV-bHnmYLK6zvkofhhAzPa2KJVh.3 2024-09-12T17:50:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~wq_PUV-bHnmYLK6zvkofhhAzPa2KJVh.4 2024-09-12T17:50:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~wq_PUV-bHnmYLK6zvkofhhAzPa2KJVh.5 2024-09-12T17:50:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17426869773719597470', time=2024-09-12T19:50:44.435164+0000, chain.objs.size()=1 2024-09-12T17:50:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.113__shadow_.r9kvk4tcgDbbt4g52H3rp-vWI7T-dIq_0 2024-09-12T17:50:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13919836846241043514', time=2024-09-12T19:50:45.019250+0000, chain.objs.size()=1 2024-09-12T17:50:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.553+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.115__shadow_.LDqRTLQaOwPc5GC2mZWy92wJXslk1Fa_0 2024-09-12T17:50:54.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.557+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17839196449252229886', time=2024-09-12T19:50:47.948628+0000, chain.objs.size()=1 2024-09-12T17:50:54.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.557+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.125__shadow_.6JnA9zhwFoovcIXEl5MU7eCUupmL1bk_0 2024-09-12T17:50:54.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.557+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9667550623793443932', time=2024-09-12T19:50:51.214772+0000, chain.objs.size()=1 2024-09-12T17:50:54.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.557+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.137__shadow_.TPERWsDRnE_oOUnzRgnvLCrOTTJ96rQ_0 2024-09-12T17:50:54.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.558+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.560+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:50:54.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.562+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.562+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.562+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:50:54.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.562+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6531139825000206112', time=2024-09-12T19:50:44.732161+0000, chain.objs.size()=1 2024-09-12T17:50:54.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.562+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.114__shadow_.aoeMDWn293MfCFvPgSfBKTf4Nw3jF83_0 2024-09-12T17:50:54.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.562+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11517456397673761623', time=2024-09-12T19:50:47.076733+0000, chain.objs.size()=1 2024-09-12T17:50:54.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.562+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.122__shadow_.9jUC7Cz-pNUqpJWiFlCs_GvX3BH4JAr_0 2024-09-12T17:50:54.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.564+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.566+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:50:54.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.572+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.573+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.573+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:50:54.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.573+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5961748241263714683', time=2024-09-12T19:50:36.070437+0000, chain.objs.size()=1 2024-09-12T17:50:54.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.573+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.101__shadow_.rabQCZ3gm35IUcH2YgEiBghd8Fcz5J3_0 2024-09-12T17:50:54.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.573+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12013757054010269559', time=2024-09-12T19:50:44.726865+0000, chain.objs.size()=1 2024-09-12T17:50:54.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.573+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.114__shadow_.t0vtn8V2O_S3xmdwz4x-LZAz8w5fSMd_0 2024-09-12T17:50:54.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.573+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14639380459060250951', time=2024-09-12T19:50:49.688563+0000, chain.objs.size()=1 2024-09-12T17:50:54.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.573+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.131__shadow_.kmgLMAhqumHtRJkNIv351cyc8Q5wbIb_0 2024-09-12T17:50:54.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.575+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.577+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:50:54.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.578+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.578+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:50:54.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12149588027493669672', time=2024-09-12T19:50:25.764483+0000, chain.objs.size()=2 2024-09-12T17:50:54.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.84__shadow_.K826Sr19-CIN2LqUlyle0oX3KbbC0I3_0 2024-09-12T17:50:54.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.84__shadow_.K826Sr19-CIN2LqUlyle0oX3KbbC0I3_1 2024-09-12T17:50:54.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7464611933211705290', time=2024-09-12T19:50:36.075809+0000, chain.objs.size()=1 2024-09-12T17:50:54.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.101__shadow_.ZIA0lo_11Fzb1tpRgrpmlR8T_U4_RWz_0 2024-09-12T17:50:54.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5081385367605975676', time=2024-09-12T19:50:47.071048+0000, chain.objs.size()=1 2024-09-12T17:50:54.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.122__shadow_.5gRlZjSCDH7vuRbrXCn0ExgxUOGpkeB_0 2024-09-12T17:50:54.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11462308489399823232', time=2024-09-12T19:50:49.101033+0000, chain.objs.size()=1 2024-09-12T17:50:54.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.129__shadow_.IYvmHvJF-j8Q0AlWgO2lwblWgWYASE8_0 2024-09-12T17:50:54.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18402713384436652914', time=2024-09-12T19:50:49.106186+0000, chain.objs.size()=1 2024-09-12T17:50:54.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.129__shadow_.4iP_Au5WaSTMVVkUSN6cYtlr4SC3qg0_0 2024-09-12T17:50:54.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5423854141163310070', time=2024-09-12T19:50:53.970325+0000, chain.objs.size()=5 2024-09-12T17:50:54.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.145__multipart_key1/data/file.mpg.2~9oFZcaiE9KkROqOiS_oxKArShgWYLqu.1 2024-09-12T17:50:54.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.145__multipart_key1/data/file.mpg.2~9oFZcaiE9KkROqOiS_oxKArShgWYLqu.2 2024-09-12T17:50:54.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.145__multipart_key1/data/file.mpg.2~9oFZcaiE9KkROqOiS_oxKArShgWYLqu.3 2024-09-12T17:50:54.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.145__multipart_key1/data/file.mpg.2~9oFZcaiE9KkROqOiS_oxKArShgWYLqu.4 2024-09-12T17:50:54.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.579+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.145__multipart_key1/data/file.mpg.2~9oFZcaiE9KkROqOiS_oxKArShgWYLqu.5 2024-09-12T17:50:54.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.582+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.585+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:50:54.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.586+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.586+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:50:54.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1831953103887236807', time=2024-09-12T19:50:36.059874+0000, chain.objs.size()=1 2024-09-12T17:50:54.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.101__shadow_.GffX-m_Ur9qRPHwNHGISI89e16eJO97_0 2024-09-12T17:50:54.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4255155753355574848', time=2024-09-12T19:50:40.592881+0000, chain.objs.size()=1 2024-09-12T17:50:54.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.104__shadow_.r7xHzkAx2-xF7IfKGWXlp1a4SBfDjkr_0 2024-09-12T17:50:54.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8302472308983721872', time=2024-09-12T19:50:44.440596+0000, chain.objs.size()=1 2024-09-12T17:50:54.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.113__shadow_.1kDh6VDkXFCqNVQKXS7b4F50Pfq7WpD_0 2024-09-12T17:50:54.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4716786644829140862', time=2024-09-12T19:50:48.233669+0000, chain.objs.size()=1 2024-09-12T17:50:54.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.126__shadow_.rEwa_78-jHRj71CaqagXGLblGkPuRT0_0 2024-09-12T17:50:54.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16409938163535282047', time=2024-09-12T19:50:48.816169+0000, chain.objs.size()=1 2024-09-12T17:50:54.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.128__shadow_.8v9Tvw3SCr1Q-y5EanBFIJ_XWWBm4Ux_0 2024-09-12T17:50:54.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2948316136846973102', time=2024-09-12T19:50:53.431355+0000, chain.objs.size()=5 2024-09-12T17:50:54.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.144__multipart_key1.2~dDZbBiXoHX0aGwxBjxAVINnnACks8k1.1 2024-09-12T17:50:54.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.144__multipart_key1.2~dDZbBiXoHX0aGwxBjxAVINnnACks8k1.2 2024-09-12T17:50:54.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.144__multipart_key1.2~dDZbBiXoHX0aGwxBjxAVINnnACks8k1.3 2024-09-12T17:50:54.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.144__multipart_key1.2~dDZbBiXoHX0aGwxBjxAVINnnACks8k1.4 2024-09-12T17:50:54.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.587+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.144__multipart_key1.2~dDZbBiXoHX0aGwxBjxAVINnnACks8k1.5 2024-09-12T17:50:54.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.591+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.593+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:50:54.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.595+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.596+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.596+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:50:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.596+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11465341309799760066', time=2024-09-12T19:50:34.324326+0000, chain.objs.size()=5 2024-09-12T17:50:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.596+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.99__multipart_key1.2~kEqpSkdP7aPGuHHqn2LbNHvNBvJQ3KJ.1 2024-09-12T17:50:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.597+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.99__multipart_key1.2~kEqpSkdP7aPGuHHqn2LbNHvNBvJQ3KJ.2 2024-09-12T17:50:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.597+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.99__multipart_key1.2~kEqpSkdP7aPGuHHqn2LbNHvNBvJQ3KJ.3 2024-09-12T17:50:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.597+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.99__multipart_key1.2~kEqpSkdP7aPGuHHqn2LbNHvNBvJQ3KJ.4 2024-09-12T17:50:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.597+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.99__multipart_key1.2~kEqpSkdP7aPGuHHqn2LbNHvNBvJQ3KJ.5 2024-09-12T17:50:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.597+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT', time=2024-09-12T19:50:42.588570+0000, chain.objs.size()=128 2024-09-12T17:50:54.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.597+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.1 2024-09-12T17:50:54.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.597+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.2 2024-09-12T17:50:54.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.597+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.3 2024-09-12T17:50:54.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.597+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.4 2024-09-12T17:50:54.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.597+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.5 2024-09-12T17:50:54.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.597+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.6 2024-09-12T17:50:54.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.597+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.7 2024-09-12T17:50:54.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.600+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.8 2024-09-12T17:50:54.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.600+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.9 2024-09-12T17:50:54.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.600+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.10 2024-09-12T17:50:54.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.600+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.11 2024-09-12T17:50:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.600+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.12 2024-09-12T17:50:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.600+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.13 2024-09-12T17:50:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.600+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.14 2024-09-12T17:50:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.600+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.15 2024-09-12T17:50:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.600+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.16 2024-09-12T17:50:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.600+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.17 2024-09-12T17:50:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.600+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.18 2024-09-12T17:50:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.602+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.19 2024-09-12T17:50:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.602+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.20 2024-09-12T17:50:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.602+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.21 2024-09-12T17:50:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.602+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.22 2024-09-12T17:50:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.602+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.23 2024-09-12T17:50:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.602+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.24 2024-09-12T17:50:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.603+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.25 2024-09-12T17:50:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.603+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.26 2024-09-12T17:50:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.603+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.27 2024-09-12T17:50:54.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.603+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.28 2024-09-12T17:50:54.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.603+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.29 2024-09-12T17:50:54.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.603+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.30 2024-09-12T17:50:54.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.604+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.31 2024-09-12T17:50:54.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.605+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.32 2024-09-12T17:50:54.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.605+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.33 2024-09-12T17:50:54.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.605+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.34 2024-09-12T17:50:54.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.605+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.35 2024-09-12T17:50:54.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.605+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.36 2024-09-12T17:50:54.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.605+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.37 2024-09-12T17:50:54.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.605+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.38 2024-09-12T17:50:54.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.605+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.39 2024-09-12T17:50:54.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.606+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.40 2024-09-12T17:50:54.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.606+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.41 2024-09-12T17:50:54.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.606+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.42 2024-09-12T17:50:54.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.606+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.43 2024-09-12T17:50:54.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.606+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.44 2024-09-12T17:50:54.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.607+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.45 2024-09-12T17:50:54.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.608+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.46 2024-09-12T17:50:54.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.608+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.47 2024-09-12T17:50:54.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.608+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.48 2024-09-12T17:50:54.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.608+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.49 2024-09-12T17:50:54.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.609+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.50 2024-09-12T17:50:54.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.609+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.51 2024-09-12T17:50:54.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.609+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.52 2024-09-12T17:50:54.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.609+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.53 2024-09-12T17:50:54.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.609+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.54 2024-09-12T17:50:54.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.610+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.55 2024-09-12T17:50:54.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.610+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.56 2024-09-12T17:50:54.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.610+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.57 2024-09-12T17:50:54.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.610+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.58 2024-09-12T17:50:54.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.610+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.59 2024-09-12T17:50:54.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.610+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.60 2024-09-12T17:50:54.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.611+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.61 2024-09-12T17:50:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.612+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.62 2024-09-12T17:50:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.612+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.63 2024-09-12T17:50:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.612+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.64 2024-09-12T17:50:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.612+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.65 2024-09-12T17:50:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.612+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.66 2024-09-12T17:50:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.612+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.67 2024-09-12T17:50:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.612+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.68 2024-09-12T17:50:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.612+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.69 2024-09-12T17:50:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.612+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.70 2024-09-12T17:50:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.612+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.71 2024-09-12T17:50:54.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.613+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.72 2024-09-12T17:50:54.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.613+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.73 2024-09-12T17:50:54.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.614+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.74 2024-09-12T17:50:54.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.614+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.75 2024-09-12T17:50:54.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.614+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.76 2024-09-12T17:50:54.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.614+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.77 2024-09-12T17:50:54.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.614+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.78 2024-09-12T17:50:54.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.614+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.79 2024-09-12T17:50:54.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.614+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.80 2024-09-12T17:50:54.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.615+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.81 2024-09-12T17:50:54.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.615+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.82 2024-09-12T17:50:54.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.616+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.83 2024-09-12T17:50:54.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.616+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.84 2024-09-12T17:50:54.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.616+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.85 2024-09-12T17:50:54.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.616+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.86 2024-09-12T17:50:54.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.616+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.87 2024-09-12T17:50:54.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.616+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.88 2024-09-12T17:50:54.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.616+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.89 2024-09-12T17:50:54.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.616+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.90 2024-09-12T17:50:54.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.617+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.91 2024-09-12T17:50:54.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.617+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.92 2024-09-12T17:50:54.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.618+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.93 2024-09-12T17:50:54.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.618+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.94 2024-09-12T17:50:54.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.618+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.95 2024-09-12T17:50:54.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.618+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.96 2024-09-12T17:50:54.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.618+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.97 2024-09-12T17:50:54.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.618+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.98 2024-09-12T17:50:54.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.618+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.99 2024-09-12T17:50:54.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.618+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.100 2024-09-12T17:50:54.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.619+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.101 2024-09-12T17:50:54.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.619+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.102 2024-09-12T17:50:54.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.619+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.103 2024-09-12T17:50:54.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.620+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.104 2024-09-12T17:50:54.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.620+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.105 2024-09-12T17:50:54.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.620+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.106 2024-09-12T17:50:54.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.620+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.107 2024-09-12T17:50:54.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.620+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.108 2024-09-12T17:50:54.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.620+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.109 2024-09-12T17:50:54.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.620+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.110 2024-09-12T17:50:54.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.621+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.111 2024-09-12T17:50:54.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.621+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.112 2024-09-12T17:50:54.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.621+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.113 2024-09-12T17:50:54.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.621+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.114 2024-09-12T17:50:54.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.623+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.115 2024-09-12T17:50:54.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.623+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.116 2024-09-12T17:50:54.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.623+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.117 2024-09-12T17:50:54.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.623+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.118 2024-09-12T17:50:54.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.623+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.119 2024-09-12T17:50:54.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.623+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.120 2024-09-12T17:50:54.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.623+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.121 2024-09-12T17:50:54.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.623+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.122 2024-09-12T17:50:54.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.624+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.123 2024-09-12T17:50:54.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.624+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.124 2024-09-12T17:50:54.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.624+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.125 2024-09-12T17:50:54.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.625+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.126 2024-09-12T17:50:54.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.625+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.127 2024-09-12T17:50:54.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.625+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.106__multipart_key1.2~O6XeoR9Tyae5pGU59P2CXHe_idFVTnT.128 2024-09-12T17:50:54.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.625+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16803165109625319100', time=2024-09-12T19:50:46.500047+0000, chain.objs.size()=1 2024-09-12T17:50:54.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.625+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.120__shadow_.LhkKpkaigwQz_6vXBbkBsCSZxSgO4Sv_0 2024-09-12T17:50:54.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.625+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2031343665461980536', time=2024-09-12T19:50:48.223123+0000, chain.objs.size()=1 2024-09-12T17:50:54.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.625+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.126__shadow_.q4WAybd92tJjclpD2R6_KPO3DQ6E8gw_0 2024-09-12T17:50:54.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.625+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17490870804151577025', time=2024-09-12T19:50:48.239092+0000, chain.objs.size()=1 2024-09-12T17:50:54.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.625+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.126__shadow_.KNbDz1IX3bwsKDpS8VNO2P3FarIuDox_0 2024-09-12T17:50:54.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.627+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.629+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:50:54.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.630+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.631+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.631+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:50:54.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.631+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4589313143956677735', time=2024-09-12T19:50:30.417447+0000, chain.objs.size()=5 2024-09-12T17:50:54.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.631+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~KH8OeuYm5POq3NrQJ_g7iXIg26c_5bw.1 2024-09-12T17:50:54.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.631+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~KH8OeuYm5POq3NrQJ_g7iXIg26c_5bw.2 2024-09-12T17:50:54.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.631+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~KH8OeuYm5POq3NrQJ_g7iXIg26c_5bw.3 2024-09-12T17:50:54.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.631+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~KH8OeuYm5POq3NrQJ_g7iXIg26c_5bw.4 2024-09-12T17:50:54.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.631+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~KH8OeuYm5POq3NrQJ_g7iXIg26c_5bw.5 2024-09-12T17:50:54.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.631+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15668753200799674362', time=2024-09-12T19:50:30.946732+0000, chain.objs.size()=5 2024-09-12T17:50:54.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.631+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~ACiyHLinwEZRAZABoBAy9urwyxrEToF.1 2024-09-12T17:50:54.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.631+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~ACiyHLinwEZRAZABoBAy9urwyxrEToF.2 2024-09-12T17:50:54.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.631+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~ACiyHLinwEZRAZABoBAy9urwyxrEToF.3 2024-09-12T17:50:54.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.631+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~ACiyHLinwEZRAZABoBAy9urwyxrEToF.4 2024-09-12T17:50:54.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.631+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~ACiyHLinwEZRAZABoBAy9urwyxrEToF.5 2024-09-12T17:50:54.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.631+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4227086365495322211', time=2024-09-12T19:50:46.793036+0000, chain.objs.size()=1 2024-09-12T17:50:54.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.631+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.121__shadow_.33Wiw_WqUeP6-8W9Oe75dS2Fadia_rG_0 2024-09-12T17:50:54.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.632+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13195160464671295573', time=2024-09-12T19:50:48.532812+0000, chain.objs.size()=1 2024-09-12T17:50:54.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.632+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.127__shadow_.pv1tzi6vfDYDfXvcEJVzuR0Xe4Pjr0b_0 2024-09-12T17:50:54.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.634+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4710739807543216856', time=2024-09-12T19:50:48.820794+0000, chain.objs.size()=1 2024-09-12T17:50:54.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.634+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.128__shadow_.hOHpi1o3L8W6m_jKPmXe6JFBjwDTcD0_0 2024-09-12T17:50:54.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.636+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.639+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:50:54.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.640+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.640+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.641+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:50:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.641+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12137524374978188212', time=2024-09-12T19:50:47.081703+0000, chain.objs.size()=1 2024-09-12T17:50:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.641+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.122__shadow_.jSMzLwFloGSL7nCBzXHk8HYP5IuL7fi_0 2024-09-12T17:50:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.641+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5829738506464113071', time=2024-09-12T19:50:47.364935+0000, chain.objs.size()=1 2024-09-12T17:50:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.641+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.123__shadow_.hLHdbGJRbxWtNXQYUax4guNub9XT1Vm_0 2024-09-12T17:50:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.641+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2913218078788652153', time=2024-09-12T19:50:48.527880+0000, chain.objs.size()=1 2024-09-12T17:50:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.641+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.127__shadow_.1QwxPUR-aS1uZRlMJzz2AYgNIa6hMm7_0 2024-09-12T17:50:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.641+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.394712496708487457', time=2024-09-12T19:50:49.406971+0000, chain.objs.size()=1 2024-09-12T17:50:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.641+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.130__shadow_.bRpldLECjhtbgDTuywLcUYQUoLdzlaX_0 2024-09-12T17:50:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.642+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.644+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:50:54.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.646+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.646+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.647+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.648+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:50:54.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.649+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.650+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.650+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:54.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.650+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5030413402813191861', time=2024-09-12T19:50:25.083289+0000, chain.objs.size()=1 2024-09-12T17:50:54.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.650+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.82__shadow_.tf5X8-fNxdp-wMHsFf4W2LyVKzdZ9dX_0 2024-09-12T17:50:54.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.651+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.653+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:50:54.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.655+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.655+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.656+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:54.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.656+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6437589130350619278', time=2024-09-12T19:50:49.684056+0000, chain.objs.size()=1 2024-09-12T17:50:54.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.656+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.131__shadow_.JU6w-JygwtYzby8s7Q3lZDzyttQEUeG_0 2024-09-12T17:50:54.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.657+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.659+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:50:54.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.660+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.660+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T17:50:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4956077339617971767', time=2024-09-12T19:50:23.089228+0000, chain.objs.size()=1 2024-09-12T17:50:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.78__shadow_.vrmD3o1fktRu-JTOWrihNaXWE6Cfm_a_0 2024-09-12T17:50:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7853295870010624224', time=2024-09-12T19:50:36.065094+0000, chain.objs.size()=5 2024-09-12T17:50:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.101__multipart_file2.mpg.2~w45hFk95a4IV0w41ToiD_pjBAcIpNkX.1 2024-09-12T17:50:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.101__multipart_file2.mpg.2~w45hFk95a4IV0w41ToiD_pjBAcIpNkX.2 2024-09-12T17:50:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.101__multipart_file2.mpg.2~w45hFk95a4IV0w41ToiD_pjBAcIpNkX.3 2024-09-12T17:50:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.101__multipart_file2.mpg.2~w45hFk95a4IV0w41ToiD_pjBAcIpNkX.4 2024-09-12T17:50:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.101__multipart_file2.mpg.2~w45hFk95a4IV0w41ToiD_pjBAcIpNkX.5 2024-09-12T17:50:54.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='2~4l5UdI0oX_JpaSFVtKpGVtNgNMHS9ru', time=2024-09-12T19:50:37.281725+0000, chain.objs.size()=5 2024-09-12T17:50:54.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.102__multipart_key1.2~4l5UdI0oX_JpaSFVtKpGVtNgNMHS9ru.7 2024-09-12T17:50:54.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.102__multipart_key1.2~4l5UdI0oX_JpaSFVtKpGVtNgNMHS9ru.8 2024-09-12T17:50:54.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.102__multipart_key1.2~4l5UdI0oX_JpaSFVtKpGVtNgNMHS9ru.9 2024-09-12T17:50:54.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.102__multipart_key1.2~4l5UdI0oX_JpaSFVtKpGVtNgNMHS9ru.10 2024-09-12T17:50:54.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.102__multipart_key1.2~4l5UdI0oX_JpaSFVtKpGVtNgNMHS9ru.11 2024-09-12T17:50:54.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17343654979423417381', time=2024-09-12T19:50:39.304050+0000, chain.objs.size()=5 2024-09-12T17:50:54.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.661+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~gs1c_PU_VMAPsuSsdME31WOXwjFgv-R.1 2024-09-12T17:50:54.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.663+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~gs1c_PU_VMAPsuSsdME31WOXwjFgv-R.2 2024-09-12T17:50:54.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.663+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~gs1c_PU_VMAPsuSsdME31WOXwjFgv-R.3 2024-09-12T17:50:54.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.665+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~gs1c_PU_VMAPsuSsdME31WOXwjFgv-R.4 2024-09-12T17:50:54.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.665+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~gs1c_PU_VMAPsuSsdME31WOXwjFgv-R.5 2024-09-12T17:50:54.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.666+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15844314470276335693', time=2024-09-12T19:50:46.782211+0000, chain.objs.size()=1 2024-09-12T17:50:54.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.666+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.121__shadow_.bVWZv3PiynshLmM6umL7401owRCfaus_0 2024-09-12T17:50:54.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.666+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10379818747744984796', time=2024-09-12T19:50:47.376289+0000, chain.objs.size()=1 2024-09-12T17:50:54.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.666+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.123__shadow_.i2UtYYYbLoKel6q62v4XiqGG-ZHtive_0 2024-09-12T17:50:54.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.666+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15587867596232488398', time=2024-09-12T19:50:48.522785+0000, chain.objs.size()=1 2024-09-12T17:50:54.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.666+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.127__shadow_.uyR93tm0mUDPAgcRfZh_RIFCN4wj3jX_0 2024-09-12T17:50:54.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.666+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9250782620968659300', time=2024-09-12T19:50:48.810744+0000, chain.objs.size()=1 2024-09-12T17:50:54.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.666+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.128__shadow_.GuSRAYXGyBB8nk0FbFzvxnks9Au4Zpj_0 2024-09-12T17:50:54.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.666+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17450033819569800469', time=2024-09-12T19:50:50.250883+0000, chain.objs.size()=1 2024-09-12T17:50:54.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.666+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.133__shadow_.AJwCbmPvkMsM5z9-u6MeDKrxPZu1MrB_0 2024-09-12T17:50:54.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.668+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.671+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:50:54.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.672+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.672+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.673+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:54.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.673+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.364929489386641298', time=2024-09-12T19:50:41.134865+0000, chain.objs.size()=5 2024-09-12T17:50:54.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.673+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.104__multipart_key1.2~MCPSj563zr4oECErHi1qFXGeOdxf3NJ.1 2024-09-12T17:50:54.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.673+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.104__multipart_key1.2~MCPSj563zr4oECErHi1qFXGeOdxf3NJ.2 2024-09-12T17:50:54.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.673+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.104__multipart_key1.2~MCPSj563zr4oECErHi1qFXGeOdxf3NJ.3 2024-09-12T17:50:54.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.673+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.104__multipart_key1.2~MCPSj563zr4oECErHi1qFXGeOdxf3NJ.4 2024-09-12T17:50:54.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.673+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.104__multipart_key1.2~MCPSj563zr4oECErHi1qFXGeOdxf3NJ.5 2024-09-12T17:50:54.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.676+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.678+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:50:54.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.679+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.679+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.680+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:50:54.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.680+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8335575450791128541', time=2024-09-12T19:50:27.397922+0000, chain.objs.size()=1 2024-09-12T17:50:54.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.680+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.91__shadow_.TcfV-ePE22BsaHoHsR5zhhWBo8U0ojo_0 2024-09-12T17:50:54.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.680+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3898149683788310177', time=2024-09-12T19:50:44.445572+0000, chain.objs.size()=1 2024-09-12T17:50:54.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.680+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.113__shadow_.sx24khp3S8MIXPupt0MTdOT5TeViWp-_0 2024-09-12T17:50:54.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.680+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13125883706383619305', time=2024-09-12T19:50:48.825717+0000, chain.objs.size()=1 2024-09-12T17:50:54.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.680+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.128__shadow_.kejdlbtxNVvzB7cBo6ku5sjlueyiJkj_0 2024-09-12T17:50:54.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.680+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.239409711411453424', time=2024-09-12T19:50:49.397006+0000, chain.objs.size()=1 2024-09-12T17:50:54.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.680+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.130__shadow_.1ooXoHod_lP9kDIrutm8mUKlBtxveaA_0 2024-09-12T17:50:54.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.681+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.683+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:50:54.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.684+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:50:54.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11112922080007842438', time=2024-09-12T19:50:36.054249+0000, chain.objs.size()=5 2024-09-12T17:50:54.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.101__multipart_file.mpg.2~fJ2yLwjnGcJvwjNJawl5anPs4Dx78FJ.1 2024-09-12T17:50:54.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.101__multipart_file.mpg.2~fJ2yLwjnGcJvwjNJawl5anPs4Dx78FJ.2 2024-09-12T17:50:54.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.101__multipart_file.mpg.2~fJ2yLwjnGcJvwjNJawl5anPs4Dx78FJ.3 2024-09-12T17:50:54.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.101__multipart_file.mpg.2~fJ2yLwjnGcJvwjNJawl5anPs4Dx78FJ.4 2024-09-12T17:50:54.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.101__multipart_file.mpg.2~fJ2yLwjnGcJvwjNJawl5anPs4Dx78FJ.5 2024-09-12T17:50:54.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3745504185486980062', time=2024-09-12T19:50:40.052384+0000, chain.objs.size()=5 2024-09-12T17:50:54.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~pz1ttM6ToK0MuNH5kJNMq94TQ8WzQNa.1 2024-09-12T17:50:54.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__shadow_key1.2~pz1ttM6ToK0MuNH5kJNMq94TQ8WzQNa.1_1 2024-09-12T17:50:54.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~pz1ttM6ToK0MuNH5kJNMq94TQ8WzQNa.2 2024-09-12T17:50:54.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__shadow_key1.2~pz1ttM6ToK0MuNH5kJNMq94TQ8WzQNa.2_1 2024-09-12T17:50:54.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~pz1ttM6ToK0MuNH5kJNMq94TQ8WzQNa.3 2024-09-12T17:50:54.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11481442862319760003', time=2024-09-12T19:50:46.195860+0000, chain.objs.size()=1 2024-09-12T17:50:54.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.119__shadow_.lRtiYaYXKZT6-D3QbVoZytbyQIKFmIY_0 2024-09-12T17:50:54.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15508184171008944064', time=2024-09-12T19:50:49.678699+0000, chain.objs.size()=1 2024-09-12T17:50:54.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.685+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.131__shadow_.k0Pru_IYR0-Jw7hCEN5T-iTYe_ro4AK_0 2024-09-12T17:50:54.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.687+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16915112862979261079', time=2024-09-12T19:50:51.622728+0000, chain.objs.size()=1 2024-09-12T17:50:54.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.687+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.139__shadow_.aeYTUYFcd2i4OsBY_0Q9hG2Ub7-Aduv_0 2024-09-12T17:50:54.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.690+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.692+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:50:54.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.694+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.694+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.694+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:50:54.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.694+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1290011053480210483', time=2024-09-12T19:50:45.035316+0000, chain.objs.size()=1 2024-09-12T17:50:54.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.694+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.115__shadow_.CrNwMrIwTLshN8djMJw1PdJZmZWITBP_0 2024-09-12T17:50:54.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.694+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7504439811625550828', time=2024-09-12T19:50:46.494967+0000, chain.objs.size()=1 2024-09-12T17:50:54.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.694+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.120__shadow_.5QFAMCVtBCfSauQ1axYKRLqVRoYOw7j_0 2024-09-12T17:50:54.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.694+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2776704086343623613', time=2024-09-12T19:50:49.110824+0000, chain.objs.size()=1 2024-09-12T17:50:54.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.694+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.129__shadow_.pucFac-VCGzkPWHmRaS_vQKF-J7mqnp_0 2024-09-12T17:50:54.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.694+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15068682081989670181', time=2024-09-12T19:50:49.964182+0000, chain.objs.size()=1 2024-09-12T17:50:54.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.694+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.132__shadow_.7v3edrUyU-Ym9UPtsaqZzcjTBaOjodM_0 2024-09-12T17:50:54.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.696+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.698+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:50:54.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.699+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.700+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.700+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:50:54.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.700+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5017845319621270713', time=2024-09-12T19:50:44.450773+0000, chain.objs.size()=1 2024-09-12T17:50:54.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.700+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.113__shadow_.fc7glZBT4B7IhT11c7bBxH6dMalVMZX_0 2024-09-12T17:50:54.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.700+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17818121667937876881', time=2024-09-12T19:50:45.910182+0000, chain.objs.size()=1 2024-09-12T17:50:54.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.700+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.118__shadow_.MusPYz-J1GdQYPvyIoxA8gWWFnBWF6u_0 2024-09-12T17:50:54.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.700+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13021638272644897626', time=2024-09-12T19:50:48.228270+0000, chain.objs.size()=1 2024-09-12T17:50:54.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.700+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.126__shadow_.hTL4Tvwomlxng-MaVisUgCSytiiXsiT_0 2024-09-12T17:50:54.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.700+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13032916798994711868', time=2024-09-12T19:50:50.245959+0000, chain.objs.size()=1 2024-09-12T17:50:54.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.700+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.133__shadow_.nbFvOIE_zeX86O10GEyL70QrMpAlZU1_0 2024-09-12T17:50:54.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.701+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.703+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:50:54.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.705+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.705+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.706+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:50:54.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.706+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11135916202737201359', time=2024-09-12T19:50:45.029931+0000, chain.objs.size()=1 2024-09-12T17:50:54.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.706+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.115__shadow_.WkWlEIJWQQD2dKTLQ02OcDrFwFCBTEn_0 2024-09-12T17:50:54.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.706+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10651114243086967843', time=2024-09-12T19:50:47.665854+0000, chain.objs.size()=1 2024-09-12T17:50:54.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.706+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.124__shadow_._tf_mzl_GMxHuLtYLOHa72GV4rLhYcu_0 2024-09-12T17:50:54.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.706+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10839814459358503565', time=2024-09-12T19:50:49.391938+0000, chain.objs.size()=1 2024-09-12T17:50:54.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.706+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.130__shadow_.P1ryrx4KAVx307qBlTf9N-Gm5XQQ6xz_0 2024-09-12T17:50:54.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.706+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1170128023956890864', time=2024-09-12T19:50:50.240879+0000, chain.objs.size()=1 2024-09-12T17:50:54.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.706+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.133__shadow_.UguTJpCJ_e8RVFWBzaSPqlRE-vnpFPX_0 2024-09-12T17:50:54.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.707+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.709+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:50:54.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.710+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.710+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.711+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:50:54.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.711+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17928547373903152915', time=2024-09-12T19:50:47.937822+0000, chain.objs.size()=1 2024-09-12T17:50:54.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.711+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.125__shadow_.mq76JIierGJjNAkyC6QSiR-AURmp986_0 2024-09-12T17:50:54.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.711+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15836217517387853495', time=2024-09-12T19:50:50.529247+0000, chain.objs.size()=1 2024-09-12T17:50:54.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.711+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.134__shadow_.NOEMbNv7IMBdbdSzqtDTfuzxS7VokZk_0 2024-09-12T17:50:54.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.711+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9140936634898187874', time=2024-09-12T19:50:50.534008+0000, chain.objs.size()=1 2024-09-12T17:50:54.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.711+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.134__shadow_.7ggFVrGBRsLDJU-MMqBT-TUsnpXmWiI_0 2024-09-12T17:50:54.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.712+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.714+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:50:54.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.716+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.717+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.717+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:50:54.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.717+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2772053001944724622', time=2024-09-12T19:50:45.311573+0000, chain.objs.size()=1 2024-09-12T17:50:54.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.717+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.116__shadow_.9QVzTLr-ftME-svao5YWqL4H4K6wxoN_0 2024-09-12T17:50:54.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.717+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11828424292396776202', time=2024-09-12T19:50:45.325854+0000, chain.objs.size()=1 2024-09-12T17:50:54.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.717+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.116__shadow_.qyl3C0t653-tlxKMEmWpB2kIKCy7vO9_0 2024-09-12T17:50:54.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.718+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.721+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:50:54.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.722+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.722+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:50:54.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3716198711398399766', time=2024-09-12T19:50:32.927008+0000, chain.objs.size()=5 2024-09-12T17:50:54.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~UNeXCt31mkdCGhQw8hpHqj7Tbr1M4fw.1 2024-09-12T17:50:54.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__shadow_key1.2~UNeXCt31mkdCGhQw8hpHqj7Tbr1M4fw.1_1 2024-09-12T17:50:54.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~UNeXCt31mkdCGhQw8hpHqj7Tbr1M4fw.2 2024-09-12T17:50:54.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__shadow_key1.2~UNeXCt31mkdCGhQw8hpHqj7Tbr1M4fw.2_1 2024-09-12T17:50:54.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~UNeXCt31mkdCGhQw8hpHqj7Tbr1M4fw.3 2024-09-12T17:50:54.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.774756032006753948', time=2024-09-12T19:50:41.763504+0000, chain.objs.size()=5 2024-09-12T17:50:54.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.105__multipart_key1.2~3Mlpsda0Ir4kciroH0gFFOYLvYDRl8M.1 2024-09-12T17:50:54.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.105__multipart_key1.2~3Mlpsda0Ir4kciroH0gFFOYLvYDRl8M.2 2024-09-12T17:50:54.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.105__multipart_key1.2~3Mlpsda0Ir4kciroH0gFFOYLvYDRl8M.3 2024-09-12T17:50:54.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.105__multipart_key1.2~3Mlpsda0Ir4kciroH0gFFOYLvYDRl8M.4 2024-09-12T17:50:54.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.105__multipart_key1.2~3Mlpsda0Ir4kciroH0gFFOYLvYDRl8M.5 2024-09-12T17:50:54.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12139875346804260310', time=2024-09-12T19:50:47.086730+0000, chain.objs.size()=1 2024-09-12T17:50:54.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.122__shadow_.6x7bC4Aii6Xn83J8rsV6SYhDeJUMQK9_0 2024-09-12T17:50:54.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5046428333754902784', time=2024-09-12T19:50:47.943461+0000, chain.objs.size()=1 2024-09-12T17:50:54.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.723+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.125__shadow_.KhVh_j1pUqGRosUNgnUiJ076Hdm2tMn_0 2024-09-12T17:50:54.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.727+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17521563243555311854', time=2024-09-12T19:50:51.396008+0000, chain.objs.size()=1 2024-09-12T17:50:54.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.727+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.138__shadow_.yCYdvkKpnhnsgq5T5RgShURM6f5ka3p_0 2024-09-12T17:50:54.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.728+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.730+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:50:54.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.731+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T17:50:54.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16683377143504552432', time=2024-09-12T19:50:25.991476+0000, chain.objs.size()=1 2024-09-12T17:50:54.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.85__shadow_.KErZzREnTuaZiLKpRzqmollIarX49gn_0 2024-09-12T17:50:54.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12918900598974328083', time=2024-09-12T19:50:26.221820+0000, chain.objs.size()=1 2024-09-12T17:50:54.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.86__shadow_.AclSZuPDDadA0VbmYaLfO8gWfNZayON_0 2024-09-12T17:50:54.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18013351808164740318', time=2024-09-12T19:50:28.316113+0000, chain.objs.size()=5 2024-09-12T17:50:54.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.92__multipart_key1.2~TQIlXogkID0cse3Qg-AGBHjWw-HXApk.1 2024-09-12T17:50:54.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.92__multipart_key1.2~TQIlXogkID0cse3Qg-AGBHjWw-HXApk.2 2024-09-12T17:50:54.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.92__multipart_key1.2~TQIlXogkID0cse3Qg-AGBHjWw-HXApk.3 2024-09-12T17:50:54.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.92__multipart_key1.2~TQIlXogkID0cse3Qg-AGBHjWw-HXApk.4 2024-09-12T17:50:54.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.92__multipart_key1.2~TQIlXogkID0cse3Qg-AGBHjWw-HXApk.5 2024-09-12T17:50:54.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.942422787020136032', time=2024-09-12T19:50:31.796517+0000, chain.objs.size()=5 2024-09-12T17:50:54.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~K4GGaJV8eDr4f6ubJ7bCtycvvEQ7d15.1 2024-09-12T17:50:54.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__shadow_key1.2~K4GGaJV8eDr4f6ubJ7bCtycvvEQ7d15.1_1 2024-09-12T17:50:54.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~K4GGaJV8eDr4f6ubJ7bCtycvvEQ7d15.2 2024-09-12T17:50:54.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__shadow_key1.2~K4GGaJV8eDr4f6ubJ7bCtycvvEQ7d15.2_1 2024-09-12T17:50:54.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.732+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.95__multipart_key1.2~K4GGaJV8eDr4f6ubJ7bCtycvvEQ7d15.3 2024-09-12T17:50:54.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.735+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9840408271804627417', time=2024-09-12T19:50:39.914292+0000, chain.objs.size()=5 2024-09-12T17:50:54.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.735+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~29l__nx-LDe3-dq8NviToWZUATZx4hH.1 2024-09-12T17:50:54.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.735+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__shadow_key1.2~29l__nx-LDe3-dq8NviToWZUATZx4hH.1_1 2024-09-12T17:50:54.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.736+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~29l__nx-LDe3-dq8NviToWZUATZx4hH.2 2024-09-12T17:50:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.736+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__shadow_key1.2~29l__nx-LDe3-dq8NviToWZUATZx4hH.2_1 2024-09-12T17:50:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.736+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~29l__nx-LDe3-dq8NviToWZUATZx4hH.3 2024-09-12T17:50:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.736+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7140963507878032771', time=2024-09-12T19:50:46.489971+0000, chain.objs.size()=1 2024-09-12T17:50:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.736+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.120__shadow_.CxK9emJFrYYeGpdZqtFE5yXznEbzsi6_0 2024-09-12T17:50:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.736+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6731152098693629218', time=2024-09-12T19:50:47.655856+0000, chain.objs.size()=1 2024-09-12T17:50:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.736+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.124__shadow_.iLCSvI9ZN6hSvsoz0laZSU14xTxzGGD_0 2024-09-12T17:50:54.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.739+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.741+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:50:54.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.742+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.743+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.743+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:50:54.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.743+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15145977737966880262', time=2024-09-12T19:50:45.905571+0000, chain.objs.size()=1 2024-09-12T17:50:54.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.743+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.118__shadow_.r9kzq_7-YVCmAi68VVCB0eemZqQrUaP_0 2024-09-12T17:50:54.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.743+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16695940714798021827', time=2024-09-12T19:50:47.660985+0000, chain.objs.size()=1 2024-09-12T17:50:54.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.743+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.124__shadow_.-nBD_8aZrYVjKsSSQgV-c0-2eUM5pdE_0 2024-09-12T17:50:54.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.744+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.746+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:50:54.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:50:54.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6949647792822124864', time=2024-09-12T19:50:35.319733+0000, chain.objs.size()=5 2024-09-12T17:50:54.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.100__multipart_key1.2~sxwMblFcouXc4gDGWxb41A2E8bqZJ2K.1 2024-09-12T17:50:54.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.100__multipart_key1.2~sxwMblFcouXc4gDGWxb41A2E8bqZJ2K.2 2024-09-12T17:50:54.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.100__multipart_key1.2~sxwMblFcouXc4gDGWxb41A2E8bqZJ2K.3 2024-09-12T17:50:54.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.100__multipart_key1.2~sxwMblFcouXc4gDGWxb41A2E8bqZJ2K.4 2024-09-12T17:50:54.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.100__multipart_key1.2~sxwMblFcouXc4gDGWxb41A2E8bqZJ2K.5 2024-09-12T17:50:54.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14728108239209675646', time=2024-09-12T19:50:45.611545+0000, chain.objs.size()=1 2024-09-12T17:50:54.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.117__shadow_.puO0opODBjWWhztmurETxEyjcW-79Gy_0 2024-09-12T17:50:54.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2439699786604317361', time=2024-09-12T19:50:45.900753+0000, chain.objs.size()=1 2024-09-12T17:50:54.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.118__shadow_._0G_xdyOlAoqopeB2b6Z-aRKRiDEzzm_0 2024-09-12T17:50:54.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14374264535859691387', time=2024-09-12T19:50:46.201071+0000, chain.objs.size()=1 2024-09-12T17:50:54.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.119__shadow_.vja4qYfi02LZkAUfHKL6Pj3TPDSuaxr_0 2024-09-12T17:50:54.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5914609292047196815', time=2024-09-12T19:50:49.402075+0000, chain.objs.size()=1 2024-09-12T17:50:54.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.130__shadow_.N9KQXtcUASP3-Om2mchmbVlLf1gyOWW_0 2024-09-12T17:50:54.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2905740589585858235', time=2024-09-12T19:50:51.574998+0000, chain.objs.size()=1 2024-09-12T17:50:54.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.748+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.139__shadow_.Xx4b8-kXDS8HdT9W692YGC7Qok2ymrt_0 2024-09-12T17:50:54.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.752+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.754+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:50:54.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.756+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.756+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.756+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:50:54.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.756+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4045380830932201976', time=2024-09-12T19:50:45.606156+0000, chain.objs.size()=1 2024-09-12T17:50:54.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.756+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.117__shadow_.r3ZfNQkpZEZEdr709EqXQrbR_rdoDFe_0 2024-09-12T17:50:54.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.756+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12598001057973181291', time=2024-09-12T19:50:45.616394+0000, chain.objs.size()=1 2024-09-12T17:50:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.756+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.117__shadow_.wf25dWKUk-io172hu6hLacfmp2qpaeA_0 2024-09-12T17:50:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.756+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3708181941881831682', time=2024-09-12T19:50:46.485012+0000, chain.objs.size()=1 2024-09-12T17:50:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.756+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.120__shadow_.yg4Q6UKBwfPNPDES20dt77IRg7JDskK_0 2024-09-12T17:50:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.756+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17030977347919645110', time=2024-09-12T19:50:46.776819+0000, chain.objs.size()=1 2024-09-12T17:50:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.756+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.121__shadow_.rudub7dmdBeWwwasBcx7ozF6VpUqymU_0 2024-09-12T17:50:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.756+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6649955076495718300', time=2024-09-12T19:50:49.959470+0000, chain.objs.size()=1 2024-09-12T17:50:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.756+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.132__shadow_.gCQn2fqlKmW2TY2-MnyPn_4a3hOdoU0_0 2024-09-12T17:50:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.756+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5070919178400068615', time=2024-09-12T19:50:49.968971+0000, chain.objs.size()=1 2024-09-12T17:50:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.756+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.132__shadow_._eVZvISE8FRP1_GtnNiXGHA-awINagY_0 2024-09-12T17:50:54.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.758+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.760+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:50:54.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.761+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.762+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.762+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:50:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.762+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12970357694856980475', time=2024-09-12T19:50:38.984127+0000, chain.objs.size()=5 2024-09-12T17:50:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.762+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~S9tIc_JxWW-s4-St9FXurp01ODLO5BD.1 2024-09-12T17:50:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.762+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~S9tIc_JxWW-s4-St9FXurp01ODLO5BD.2 2024-09-12T17:50:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.762+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~S9tIc_JxWW-s4-St9FXurp01ODLO5BD.3 2024-09-12T17:50:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.762+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~S9tIc_JxWW-s4-St9FXurp01ODLO5BD.4 2024-09-12T17:50:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.762+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~S9tIc_JxWW-s4-St9FXurp01ODLO5BD.5 2024-09-12T17:50:54.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.765+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.767+0000 7f3f89b24800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:50:54.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.768+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:54.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.769+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:54.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.769+0000 7f3f89b24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:50:54.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.769+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.706306864558702520', time=2024-09-12T19:50:39.609328+0000, chain.objs.size()=5 2024-09-12T17:50:54.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.769+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~EHPPz0RGDaEWN-f9eTqTPaDgXJ9m5hn.1 2024-09-12T17:50:54.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.769+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__shadow_key1.2~EHPPz0RGDaEWN-f9eTqTPaDgXJ9m5hn.1_1 2024-09-12T17:50:54.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.769+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~EHPPz0RGDaEWN-f9eTqTPaDgXJ9m5hn.2 2024-09-12T17:50:54.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.769+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__shadow_key1.2~EHPPz0RGDaEWN-f9eTqTPaDgXJ9m5hn.2_1 2024-09-12T17:50:54.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.769+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.103__multipart_key1.2~EHPPz0RGDaEWN-f9eTqTPaDgXJ9m5hn.3 2024-09-12T17:50:54.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.769+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11951671570359978663', time=2024-09-12T19:50:46.205925+0000, chain.objs.size()=1 2024-09-12T17:50:54.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.769+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.119__shadow_.tyxT6uTLUukP8cxVzhIcsb5-1ifuw2x_0 2024-09-12T17:50:54.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.769+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9929934310085006231', time=2024-09-12T19:50:47.381789+0000, chain.objs.size()=1 2024-09-12T17:50:54.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.769+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.123__shadow_.1fzFzMfJZHwOA2SPkB_Q77pMQkoaylV_0 2024-09-12T17:50:54.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.769+0000 7f3f89b24800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18019839608898699244', time=2024-09-12T19:50:52.402424+0000, chain.objs.size()=1 2024-09-12T17:50:54.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.769+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.141__shadow_.36d3X1NAHNGU2XgaKNozZVyAWFK3KCj_0 2024-09-12T17:50:54.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.773+0000 7f3f89b24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:50:54.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.776+0000 7f3e3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:54.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.779+0000 7f3f89b24800 20 remove_watcher() i=0 2024-09-12T17:50:54.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.779+0000 7f3f89b24800 2 removed watcher, disabling cache 2024-09-12T17:50:54.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.780+0000 7f3f89b24800 20 remove_watcher() i=1 2024-09-12T17:50:54.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.781+0000 7f3f89b24800 20 remove_watcher() i=2 2024-09-12T17:50:54.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.782+0000 7f3f89b24800 20 remove_watcher() i=3 2024-09-12T17:50:54.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.783+0000 7f3f89b24800 20 remove_watcher() i=4 2024-09-12T17:50:54.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.784+0000 7f3f89b24800 20 remove_watcher() i=5 2024-09-12T17:50:54.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.785+0000 7f3f89b24800 20 remove_watcher() i=6 2024-09-12T17:50:54.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.786+0000 7f3f89b24800 20 remove_watcher() i=7 2024-09-12T17:50:54.799 DEBUG:teuthology.orchestra.run.smithi044:> radosgw-admin gc process --include-all 2024-09-12T17:50:54.852 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:54.852 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:54.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.889+0000 7f2588b15800 20 rados->read ofs=0 len=0 2024-09-12T17:50:54.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.891+0000 7f2588b15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:54.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.891+0000 7f2588b15800 20 realm 2024-09-12T17:50:54.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.891+0000 7f2588b15800 20 rados->read ofs=0 len=0 2024-09-12T17:50:54.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.891+0000 7f2588b15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:54.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.891+0000 7f2588b15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:54.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.891+0000 7f2588b15800 20 rados->read ofs=0 len=0 2024-09-12T17:50:54.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.891+0000 7f2588b15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:54.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.891+0000 7f2588b15800 20 rados->read ofs=0 len=0 2024-09-12T17:50:54.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.892+0000 7f2588b15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:54.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.892+0000 7f2588b15800 20 rados->read ofs=0 len=0 2024-09-12T17:50:54.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.892+0000 7f2588b15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:54.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.892+0000 7f2588b15800 20 searching for the correct realm 2024-09-12T17:50:54.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.895+0000 7f257ddfe640 0 -- 172.21.15.44:0/37819582 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f2578036060 msgr2=0x7f257809eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:54.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:54.899+0000 7f25865ff640 0 -- 172.21.15.44:0/37819582 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f257002b910 msgr2=0x7f257001e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:55.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.105+0000 7f2588b15800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:50:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.105+0000 7f2588b15800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:50:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.105+0000 7f2588b15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.105+0000 7f2588b15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.105+0000 7f2588b15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.105+0000 7f2588b15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.105+0000 7f2588b15800 20 rados->read ofs=0 len=0 2024-09-12T17:50:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.106+0000 7f2588b15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.106+0000 7f2588b15800 20 rados->read ofs=0 len=0 2024-09-12T17:50:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.106+0000 7f2588b15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:55.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.106+0000 7f2588b15800 20 rados->read ofs=0 len=0 2024-09-12T17:50:55.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.106+0000 7f2588b15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:55.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.106+0000 7f2588b15800 20 zone default found 2024-09-12T17:50:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.106+0000 7f2588b15800 4 Realm: () 2024-09-12T17:50:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.106+0000 7f2588b15800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:50:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.106+0000 7f2588b15800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:50:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.106+0000 7f2588b15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.106+0000 7f2588b15800 20 zonegroup default 2024-09-12T17:50:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.106+0000 7f2588b15800 20 rados->read ofs=0 len=0 2024-09-12T17:50:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.107+0000 7f2588b15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.107+0000 7f2588b15800 20 rados->read ofs=0 len=0 2024-09-12T17:50:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.107+0000 7f2588b15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.107+0000 7f2588b15800 20 rados->read ofs=0 len=0 2024-09-12T17:50:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.107+0000 7f2588b15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.107+0000 7f2588b15800 20 started sync module instance, tier type = 2024-09-12T17:50:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.107+0000 7f2588b15800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:50:55.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.117+0000 7f2588b15800 20 add_watcher() i=0 2024-09-12T17:50:55.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.117+0000 7f2588b15800 20 add_watcher() i=1 2024-09-12T17:50:55.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.117+0000 7f2588b15800 20 add_watcher() i=2 2024-09-12T17:50:55.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.117+0000 7f2588b15800 20 add_watcher() i=3 2024-09-12T17:50:55.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.117+0000 7f2588b15800 20 add_watcher() i=4 2024-09-12T17:50:55.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.117+0000 7f2588b15800 20 add_watcher() i=5 2024-09-12T17:50:55.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.117+0000 7f2588b15800 20 add_watcher() i=6 2024-09-12T17:50:55.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.118+0000 7f2588b15800 20 add_watcher() i=7 2024-09-12T17:50:55.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.118+0000 7f2588b15800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:55.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.119+0000 7f243d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:55.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.120+0000 7f2588b15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:55.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.120+0000 7f2588b15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:55.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.155+0000 7f24377fe640 20 reqs_thread_entry: start 2024-09-12T17:50:55.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.155+0000 7f2588b15800 20 init_complete bucket index max shards: 11 2024-09-12T17:50:55.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.155+0000 7f2588b15800 20 Filter name: none 2024-09-12T17:50:55.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.155+0000 7f24357fa640 20 reqs_thread_entry: start 2024-09-12T17:50:55.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.155+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:50:55.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.156+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.157+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.157+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.158+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:50:55.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.159+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.160+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.160+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.161+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:50:55.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.162+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.163+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.163+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.164+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:50:55.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.165+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.165+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.166+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.167+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:50:55.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.168+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.168+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.169+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.169+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:50:55.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.171+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.171+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.172+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.173+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:50:55.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.174+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.174+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.175+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.176+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:50:55.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.177+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.178+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.178+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.179+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:50:55.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.180+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.181+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.181+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.182+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:50:55.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.183+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.184+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.184+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.185+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:50:55.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.186+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.187+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.187+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.188+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:50:55.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.189+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.189+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.190+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.191+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:50:55.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.192+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.193+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.193+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.194+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:50:55.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.195+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.195+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.196+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.197+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:50:55.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.198+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.198+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.199+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.200+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:50:55.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.201+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.201+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.202+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.203+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:50:55.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.204+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.204+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.205+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.206+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:50:55.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.207+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.207+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.208+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.208+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:50:55.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.210+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.211+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.211+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.212+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:50:55.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.213+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.214+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.214+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.215+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:50:55.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.216+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.217+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.217+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.218+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:50:55.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.219+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.219+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.220+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.221+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:50:55.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.222+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.222+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.223+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.224+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:50:55.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.225+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.225+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.226+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.227+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:50:55.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.228+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.228+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.229+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.230+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:50:55.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.231+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.231+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.232+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.233+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:50:55.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.234+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.234+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.234+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.235+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:50:55.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.237+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.238+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.238+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.239+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:50:55.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.240+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.241+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.241+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.242+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:50:55.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.244+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.244+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.244+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.246+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:50:55.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.247+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.248+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.248+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.249+0000 7f2588b15800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:50:55.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.251+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.251+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:50:55.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.251+0000 7f2588b15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:50:55.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.253+0000 7f243d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:55.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.255+0000 7f2588b15800 20 remove_watcher() i=0 2024-09-12T17:50:55.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.255+0000 7f2588b15800 2 removed watcher, disabling cache 2024-09-12T17:50:55.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.256+0000 7f2588b15800 20 remove_watcher() i=1 2024-09-12T17:50:55.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.257+0000 7f2588b15800 20 remove_watcher() i=2 2024-09-12T17:50:55.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.258+0000 7f2588b15800 20 remove_watcher() i=3 2024-09-12T17:50:55.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.260+0000 7f2588b15800 20 remove_watcher() i=4 2024-09-12T17:50:55.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.261+0000 7f2588b15800 20 remove_watcher() i=5 2024-09-12T17:50:55.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.262+0000 7f2588b15800 20 remove_watcher() i=6 2024-09-12T17:50:55.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:55.263+0000 7f2588b15800 20 remove_watcher() i=7 2024-09-12T17:50:55.276 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T17:50:55.298 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T17:50:55.298 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T17:50:55.298 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T17:50:55.299 DEBUG:teuthology.orchestra.run.smithi044:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T17:50:55.328 INFO:teuthology.orchestra.run.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T17:50:56.142 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T17:50:56.142 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-12T17:50:56.245 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:56.245 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:56.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.280+0000 7fa281f40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.281+0000 7fa281f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.281+0000 7fa281f40800 20 realm 2024-09-12T17:50:56.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.281+0000 7fa281f40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.282+0000 7fa281f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.282+0000 7fa281f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:56.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.282+0000 7fa281f40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.282+0000 7fa281f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.282+0000 7fa281f40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.283+0000 7fa281f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:56.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.283+0000 7fa281f40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.283+0000 7fa281f40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:56.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.283+0000 7fa281f40800 20 searching for the correct realm 2024-09-12T17:50:56.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.286+0000 7fa27d4bf640 0 -- 172.21.15.44:0/1951515873 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fa27006d1f0 msgr2=0x7fa27006bc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:56.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.290+0000 7fa27dcc0640 0 -- 172.21.15.44:0/1951515873 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fa274001c20 msgr2=0x7fa2740a20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:56.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.497+0000 7fa281f40800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:50:56.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.497+0000 7fa281f40800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:50:56.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.497+0000 7fa281f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:56.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.497+0000 7fa281f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:56.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.497+0000 7fa281f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:56.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.497+0000 7fa281f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:56.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.497+0000 7fa281f40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.497+0000 7fa281f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.497+0000 7fa281f40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.497+0000 7fa281f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:56.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.497+0000 7fa281f40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.498+0000 7fa281f40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:56.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.498+0000 7fa281f40800 20 zone default found 2024-09-12T17:50:56.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.498+0000 7fa281f40800 4 Realm: () 2024-09-12T17:50:56.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.498+0000 7fa281f40800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:50:56.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.498+0000 7fa281f40800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:50:56.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.498+0000 7fa281f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:56.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.498+0000 7fa281f40800 20 zonegroup default 2024-09-12T17:50:56.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.498+0000 7fa281f40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.498+0000 7fa281f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.498+0000 7fa281f40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.498+0000 7fa281f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.498+0000 7fa281f40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.499+0000 7fa281f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.499+0000 7fa281f40800 20 started sync module instance, tier type = 2024-09-12T17:50:56.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.499+0000 7fa281f40800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:50:56.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.509+0000 7fa281f40800 20 add_watcher() i=0 2024-09-12T17:50:56.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.509+0000 7fa281f40800 20 add_watcher() i=1 2024-09-12T17:50:56.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.509+0000 7fa281f40800 20 add_watcher() i=2 2024-09-12T17:50:56.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.509+0000 7fa281f40800 20 add_watcher() i=3 2024-09-12T17:50:56.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.509+0000 7fa281f40800 20 add_watcher() i=4 2024-09-12T17:50:56.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.509+0000 7fa281f40800 20 add_watcher() i=5 2024-09-12T17:50:56.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.509+0000 7fa281f40800 20 add_watcher() i=6 2024-09-12T17:50:56.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.510+0000 7fa281f40800 20 add_watcher() i=7 2024-09-12T17:50:56.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.510+0000 7fa281f40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:56.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.512+0000 7fa12f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:56.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.512+0000 7fa281f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:56.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.512+0000 7fa281f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:56.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.512+0000 7fa281f40800 5 note: GC not initialized 2024-09-12T17:50:56.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.512+0000 7fa12e7fc640 20 reqs_thread_entry: start 2024-09-12T17:50:56.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.512+0000 7fa281f40800 20 init_complete bucket index max shards: 11 2024-09-12T17:50:56.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.512+0000 7fa281f40800 20 Filter name: none 2024-09-12T17:50:56.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.512+0000 7fa0a3fff640 20 reqs_thread_entry: start 2024-09-12T17:50:56.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.512+0000 7fa281f40800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-12T17:50:56.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.512+0000 7fa281f40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.513+0000 7fa281f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.513+0000 7fa281f40800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-12T17:50:56.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.513+0000 7fa281f40800 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T17:50:56.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.513+0000 7fa281f40800 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-12T17:50:56.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.513+0000 7fa281f40800 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-12T17:50:56.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.513+0000 7fa281f40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.513+0000 7fa281f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.513+0000 7fa281f40800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-12T17:50:56.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.513+0000 7fa281f40800 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T17:50:56.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.513+0000 7fa281f40800 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-12T17:50:56.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.514+0000 7fa281f40800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T17:50:56.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.514+0000 7fa281f40800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T17:50:56.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.514+0000 7fa281f40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-12T17:50:56.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.515+0000 7fa1617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562527 cookie 94153256617120 notifier 8492 bl.length()=384 2024-09-12T17:50:56.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.515+0000 7fa1617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T17:50:56.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.515+0000 7fa1617fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T17:50:56.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.517+0000 7fa281f40800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T17:50:56.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.517+0000 7fa281f40800 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T17:50:56.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.517+0000 7fa281f40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-12T17:50:56.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.517+0000 7fa160ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562589 cookie 94153256631200 notifier 8492 bl.length()=225 2024-09-12T17:50:56.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.517+0000 7fa160ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T17:50:56.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.517+0000 7fa160ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T17:50:56.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.519+0000 7fa281f40800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T17:50:56.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.519+0000 7fa281f40800 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T17:50:56.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.519+0000 7fa281f40800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-12T17:50:56.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.519+0000 7fa160ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562489 cookie 94153256628384 notifier 8492 bl.length()=234 2024-09-12T17:50:56.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.519+0000 7fa160ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T17:50:56.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.519+0000 7fa160ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T17:50:56.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.520+0000 7fa12f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:56.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.523+0000 7fa281f40800 20 remove_watcher() i=0 2024-09-12T17:50:56.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.523+0000 7fa281f40800 2 removed watcher, disabling cache 2024-09-12T17:50:56.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.524+0000 7fa281f40800 20 remove_watcher() i=1 2024-09-12T17:50:56.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.525+0000 7fa281f40800 20 remove_watcher() i=2 2024-09-12T17:50:56.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.526+0000 7fa281f40800 20 remove_watcher() i=3 2024-09-12T17:50:56.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.527+0000 7fa281f40800 20 remove_watcher() i=4 2024-09-12T17:50:56.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.528+0000 7fa281f40800 20 remove_watcher() i=5 2024-09-12T17:50:56.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.529+0000 7fa281f40800 20 remove_watcher() i=6 2024-09-12T17:50:56.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.530+0000 7fa281f40800 20 remove_watcher() i=7 2024-09-12T17:50:56.541 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T17:50:56.541 INFO:teuthology.orchestra.run.smithi044.stdout: "id": "RGW11111111111111111", 2024-09-12T17:50:56.541 INFO:teuthology.orchestra.run.smithi044.stdout: "tenant": "", 2024-09-12T17:50:56.541 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "Mr.RGW11111111111111111", 2024-09-12T17:50:56.541 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-12T17:50:56.541 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-09-12T17:50:56.541 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:50:56.542 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:50:56.542 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:50:56.542 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:50:56.542 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:50:56.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:50:56.542 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2024-09-12T17:50:56.542 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:50:56.542 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:50:56.542 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:50:56.542 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:50:56.542 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:50:56.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:50:56.542 INFO:teuthology.orchestra.run.smithi044.stdout: "max_users": 1000, 2024-09-12T17:50:56.543 INFO:teuthology.orchestra.run.smithi044.stdout: "max_roles": 1000, 2024-09-12T17:50:56.543 INFO:teuthology.orchestra.run.smithi044.stdout: "max_groups": 1000, 2024-09-12T17:50:56.543 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2024-09-12T17:50:56.543 INFO:teuthology.orchestra.run.smithi044.stdout: "max_access_keys": 4 2024-09-12T17:50:56.543 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T17:50:56.544 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-12T17:50:56.544 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key MPSFKAFXAJIXMZSBZDVT --secret OGd91UJmrzqgnoSch8Dnshz1+DBDEI22+aeEW5T5xr0w/nqcPkhxPg== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-12T17:50:56.613 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:56.614 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:56.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.647+0000 7f80b3744800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.649+0000 7f80b3744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.649+0000 7f80b3744800 20 realm 2024-09-12T17:50:56.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.649+0000 7f80b3744800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.649+0000 7f80b3744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.649+0000 7f80b3744800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:56.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.649+0000 7f80b3744800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.650+0000 7f80b3744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.650+0000 7f80b3744800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.651+0000 7f80b3744800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:56.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.651+0000 7f80b3744800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.651+0000 7f80b3744800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:56.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.651+0000 7f80b3744800 20 searching for the correct realm 2024-09-12T17:50:56.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.654+0000 7f80aecf3640 0 -- 172.21.15.44:0/4267618019 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f80a0087050 msgr2=0x7f80a0088940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:56.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.658+0000 7f80af4f4640 0 -- 172.21.15.44:0/4267618019 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f80a406d280 msgr2=0x7f80a402f810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:56.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.864+0000 7f80b3744800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:50:56.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.864+0000 7f80b3744800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:50:56.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.864+0000 7f80b3744800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:56.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.864+0000 7f80b3744800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:56.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.864+0000 7f80b3744800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:56.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.864+0000 7f80b3744800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:56.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.864+0000 7f80b3744800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.864+0000 7f80b3744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.864+0000 7f80b3744800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.865+0000 7f80b3744800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:56.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.865+0000 7f80b3744800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.865+0000 7f80b3744800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:56.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.865+0000 7f80b3744800 20 zone default found 2024-09-12T17:50:56.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.865+0000 7f80b3744800 4 Realm: () 2024-09-12T17:50:56.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.865+0000 7f80b3744800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:50:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.865+0000 7f80b3744800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:50:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.865+0000 7f80b3744800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.865+0000 7f80b3744800 20 zonegroup default 2024-09-12T17:50:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.865+0000 7f80b3744800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.866+0000 7f80b3744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.866+0000 7f80b3744800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.866+0000 7f80b3744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.866+0000 7f80b3744800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.866+0000 7f80b3744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.866+0000 7f80b3744800 20 started sync module instance, tier type = 2024-09-12T17:50:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.866+0000 7f80b3744800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:50:56.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.877+0000 7f80b3744800 20 add_watcher() i=0 2024-09-12T17:50:56.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.877+0000 7f80b3744800 20 add_watcher() i=1 2024-09-12T17:50:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.877+0000 7f80b3744800 20 add_watcher() i=2 2024-09-12T17:50:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.877+0000 7f80b3744800 20 add_watcher() i=3 2024-09-12T17:50:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.877+0000 7f80b3744800 20 add_watcher() i=4 2024-09-12T17:50:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.877+0000 7f80b3744800 20 add_watcher() i=5 2024-09-12T17:50:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.877+0000 7f80b3744800 20 add_watcher() i=6 2024-09-12T17:50:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.878+0000 7f80b3744800 20 add_watcher() i=7 2024-09-12T17:50:56.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.878+0000 7f80b3744800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:56.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.880+0000 7f7f65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:56.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.880+0000 7f80b3744800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:56.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.880+0000 7f80b3744800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:56.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.880+0000 7f80b3744800 5 note: GC not initialized 2024-09-12T17:50:56.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.880+0000 7f7f64fe1640 20 reqs_thread_entry: start 2024-09-12T17:50:56.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.880+0000 7f80b3744800 20 init_complete bucket index max shards: 11 2024-09-12T17:50:56.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.880+0000 7f80b3744800 20 Filter name: none 2024-09-12T17:50:56.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f7ede7fc640 20 reqs_thread_entry: start 2024-09-12T17:50:56.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T17:50:56.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T17:50:56.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:50:56.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T17:50:56.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T17:50:56.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:50:56.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 10 cache get: name=default.rgw.meta+users.keys+MPSFKAFXAJIXMZSBZDVT : miss 2024-09-12T17:50:56.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:56.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 10 cache put: name=default.rgw.meta+users.keys+MPSFKAFXAJIXMZSBZDVT info.flags=0x0 2024-09-12T17:50:56.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 10 adding default.rgw.meta+users.keys+MPSFKAFXAJIXMZSBZDVT to cache LRU end 2024-09-12T17:50:56.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-12T17:50:56.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.881+0000 7f80b3744800 20 rados->read ofs=0 len=0 2024-09-12T17:50:56.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.882+0000 7f80b3744800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:50:56.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.882+0000 7f80b3744800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T17:50:56.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.882+0000 7f80b3744800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T17:50:56.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.882+0000 7f80b3744800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:50:56.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.882+0000 7f80b3744800 10 cache get: name=default.rgw.meta+users.keys+MPSFKAFXAJIXMZSBZDVT : hit (negative entry) 2024-09-12T17:50:56.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.882+0000 7f80b3744800 10 cache get: name=default.rgw.meta+users.keys+MPSFKAFXAJIXMZSBZDVT : hit (negative entry) 2024-09-12T17:50:56.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.883+0000 7f80b3744800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:50:56.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.883+0000 7f80b3744800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:50:56.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.883+0000 7f80b3744800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T17:50:56.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.884+0000 7f7f92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562590 cookie 94345919587616 notifier 8510 bl.length()=673 2024-09-12T17:50:56.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.884+0000 7f7f92ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:50:56.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.884+0000 7f7f92ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:50:56.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.885+0000 7f80b3744800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T17:50:56.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.885+0000 7f80b3744800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:50:56.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.885+0000 7f80b3744800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T17:50:56.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.886+0000 7f7f927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562591 cookie 94345919599520 notifier 8510 bl.length()=185 2024-09-12T17:50:56.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.886+0000 7f7f927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T17:50:56.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.886+0000 7f7f927fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:50:56.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.887+0000 7f80b3744800 10 cache put: name=default.rgw.meta+users.keys+MPSFKAFXAJIXMZSBZDVT info.flags=0x7 2024-09-12T17:50:56.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.887+0000 7f80b3744800 10 moving default.rgw.meta+users.keys+MPSFKAFXAJIXMZSBZDVT to cache LRU end 2024-09-12T17:50:56.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.887+0000 7f80b3744800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:MPSFKAFXAJIXMZSBZDVT, ofs0, ns] 2024-09-12T17:50:56.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.888+0000 7f7f92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562592 cookie 94345919587616 notifier 8510 bl.length()=186 2024-09-12T17:50:56.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.888+0000 7f7f92ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MPSFKAFXAJIXMZSBZDVT info.flags=0x7 2024-09-12T17:50:56.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.888+0000 7f7f92ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MPSFKAFXAJIXMZSBZDVT to cache LRU end 2024-09-12T17:50:56.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.889+0000 7f80b3744800 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-12T17:50:56.891 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T17:50:56.891 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "foo.client.0", 2024-09-12T17:50:56.891 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-12T17:50:56.891 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "foo+test@test.test", 2024-09-12T17:50:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2024-09-12T17:50:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2024-09-12T17:50:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2024-09-12T17:50:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2024-09-12T17:50:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-12T17:50:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "foo.client.0", 2024-09-12T17:50:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "MPSFKAFXAJIXMZSBZDVT", 2024-09-12T17:50:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "OGd91UJmrzqgnoSch8Dnshz1+DBDEI22+aeEW5T5xr0w/nqcPkhxPg==", 2024-09-12T17:50:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: "active": true, 2024-09-12T17:50:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:50:56.883995Z" 2024-09-12T17:50:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T17:50:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-12T17:50:56.892 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2024-09-12T17:50:56.893 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [], 2024-09-12T17:50:56.893 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2024-09-12T17:50:56.893 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2024-09-12T17:50:56.893 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2024-09-12T17:50:56.893 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2024-09-12T17:50:56.893 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2024-09-12T17:50:56.893 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:50:56.893 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:50:56.893 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:50:56.894 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:50:56.894 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:50:56.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:50:56.894 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2024-09-12T17:50:56.894 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:50:56.894 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:50:56.894 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:50:56.894 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:50:56.894 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:50:56.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:50:56.894 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2024-09-12T17:50:56.894 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "root", 2024-09-12T17:50:56.894 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [], 2024-09-12T17:50:56.895 INFO:teuthology.orchestra.run.smithi044.stdout: "account_id": "RGW11111111111111111", 2024-09-12T17:50:56.895 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-12T17:50:56.895 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:50:56.883983Z", 2024-09-12T17:50:56.895 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-09-12T17:50:56.895 INFO:teuthology.orchestra.run.smithi044.stdout: "group_ids": [] 2024-09-12T17:50:56.895 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T17:50:56.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:56.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.890+0000 7f7f65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:56.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.893+0000 7f80b3744800 20 remove_watcher() i=0 2024-09-12T17:50:56.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.893+0000 7f80b3744800 2 removed watcher, disabling cache 2024-09-12T17:50:56.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.894+0000 7f80b3744800 20 remove_watcher() i=1 2024-09-12T17:50:56.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.895+0000 7f80b3744800 20 remove_watcher() i=2 2024-09-12T17:50:56.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.896+0000 7f80b3744800 20 remove_watcher() i=3 2024-09-12T17:50:56.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.897+0000 7f80b3744800 20 remove_watcher() i=4 2024-09-12T17:50:56.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.899+0000 7f80b3744800 20 remove_watcher() i=5 2024-09-12T17:50:56.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.899+0000 7f80b3744800 20 remove_watcher() i=6 2024-09-12T17:50:56.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:56.900+0000 7f80b3744800 20 remove_watcher() i=7 2024-09-12T17:50:56.913 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 5206197091 --totp-seed JJGDH3WPLNBGTTCLQ25CC6H6V7QS5N3I6EQ3BRQBO3AZZRHRBFX4XM3O7YY4GEBF --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:50:56.981 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:56.981 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:57.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.015+0000 7f83bb211800 20 rados->read ofs=0 len=0 2024-09-12T17:50:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.017+0000 7f83bb211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.017+0000 7f83bb211800 20 realm 2024-09-12T17:50:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.017+0000 7f83bb211800 20 rados->read ofs=0 len=0 2024-09-12T17:50:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.017+0000 7f83bb211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.017+0000 7f83bb211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.017+0000 7f83bb211800 20 rados->read ofs=0 len=0 2024-09-12T17:50:57.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.017+0000 7f83bb211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:57.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.017+0000 7f83bb211800 20 rados->read ofs=0 len=0 2024-09-12T17:50:57.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.018+0000 7f83bb211800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:57.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.018+0000 7f83bb211800 20 rados->read ofs=0 len=0 2024-09-12T17:50:57.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.019+0000 7f83bb211800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:57.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.019+0000 7f83bb211800 20 searching for the correct realm 2024-09-12T17:50:57.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.022+0000 7f83b6121640 0 -- 172.21.15.44:0/3209526383 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55667c8de750 msgr2=0x55667c8e0be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:57.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.026+0000 7f83b6922640 0 -- 172.21.15.44:0/3209526383 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f83ac0a2d10 msgr2=0x7f83ac0ab860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:50:57.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.030+0000 7f83bb211800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:50:57.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.030+0000 7f83bb211800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:50:57.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.030+0000 7f83bb211800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:57.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.030+0000 7f83bb211800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:57.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.030+0000 7f83bb211800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:57.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.030+0000 7f83bb211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:57.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.030+0000 7f83bb211800 20 rados->read ofs=0 len=0 2024-09-12T17:50:57.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.031+0000 7f83bb211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:57.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.031+0000 7f83bb211800 20 rados->read ofs=0 len=0 2024-09-12T17:50:57.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.031+0000 7f83bb211800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:57.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.031+0000 7f83bb211800 20 rados->read ofs=0 len=0 2024-09-12T17:50:57.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.031+0000 7f83bb211800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:57.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.031+0000 7f83bb211800 20 zone default found 2024-09-12T17:50:57.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.031+0000 7f83bb211800 4 Realm: () 2024-09-12T17:50:57.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.031+0000 7f83bb211800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:50:57.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.031+0000 7f83bb211800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:50:57.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.031+0000 7f83bb211800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:57.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.031+0000 7f83bb211800 20 zonegroup default 2024-09-12T17:50:57.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.031+0000 7f83bb211800 20 rados->read ofs=0 len=0 2024-09-12T17:50:57.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.032+0000 7f83bb211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:57.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.032+0000 7f83bb211800 20 rados->read ofs=0 len=0 2024-09-12T17:50:57.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.032+0000 7f83bb211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:57.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.032+0000 7f83bb211800 20 rados->read ofs=0 len=0 2024-09-12T17:50:57.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.032+0000 7f83bb211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:57.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.032+0000 7f83bb211800 20 started sync module instance, tier type = 2024-09-12T17:50:57.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.032+0000 7f83bb211800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:50:57.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.041+0000 7f83bb211800 20 add_watcher() i=0 2024-09-12T17:50:57.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.041+0000 7f83bb211800 20 add_watcher() i=1 2024-09-12T17:50:57.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.041+0000 7f83bb211800 20 add_watcher() i=2 2024-09-12T17:50:57.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.041+0000 7f83bb211800 20 add_watcher() i=3 2024-09-12T17:50:57.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.041+0000 7f83bb211800 20 add_watcher() i=4 2024-09-12T17:50:57.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.041+0000 7f83bb211800 20 add_watcher() i=5 2024-09-12T17:50:57.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.041+0000 7f83bb211800 20 add_watcher() i=6 2024-09-12T17:50:57.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.042+0000 7f83bb211800 20 add_watcher() i=7 2024-09-12T17:50:57.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.042+0000 7f83bb211800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:57.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.044+0000 7f826d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:57.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.044+0000 7f83bb211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:57.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.044+0000 7f83bb211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:57.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.044+0000 7f83bb211800 5 note: GC not initialized 2024-09-12T17:50:57.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.044+0000 7f81e7fff640 20 reqs_thread_entry: start 2024-09-12T17:50:57.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.044+0000 7f83bb211800 20 init_complete bucket index max shards: 11 2024-09-12T17:50:57.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.044+0000 7f83bb211800 20 Filter name: none 2024-09-12T17:50:57.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.045+0000 7f81e5ffb640 20 reqs_thread_entry: start 2024-09-12T17:50:57.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.045+0000 7f83bb211800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T17:50:57.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.045+0000 7f83bb211800 20 rados->read ofs=0 len=0 2024-09-12T17:50:57.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.045+0000 7f83bb211800 20 rados_obj.operate() r=0 bl.length=488 2024-09-12T17:50:57.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.045+0000 7f83bb211800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T17:50:57.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.045+0000 7f83bb211800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:50:57.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:57.045+0000 7f83bb211800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:50:58.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.430+0000 7f83bb211800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:50:58.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.430+0000 7f83bb211800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:50:58.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.430+0000 7f83bb211800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T17:50:58.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.431+0000 7f8299ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497185 cookie 93898664708032 notifier 9138 bl.length()=687 2024-09-12T17:50:58.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.431+0000 7f8299ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:50:58.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.431+0000 7f8299ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:50:58.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.433+0000 7f826d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:58.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.435+0000 7f83bb211800 20 remove_watcher() i=0 2024-09-12T17:50:58.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.435+0000 7f83bb211800 2 removed watcher, disabling cache 2024-09-12T17:50:58.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.437+0000 7f83bb211800 20 remove_watcher() i=1 2024-09-12T17:50:58.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.438+0000 7f83bb211800 20 remove_watcher() i=2 2024-09-12T17:50:58.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.439+0000 7f83bb211800 20 remove_watcher() i=3 2024-09-12T17:50:58.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.441+0000 7f83bb211800 20 remove_watcher() i=4 2024-09-12T17:50:58.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.442+0000 7f83bb211800 20 remove_watcher() i=5 2024-09-12T17:50:58.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.443+0000 7f83bb211800 20 remove_watcher() i=6 2024-09-12T17:50:58.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.444+0000 7f83bb211800 20 remove_watcher() i=7 2024-09-12T17:50:58.460 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T17:50:58.460 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key TPLFHWQPIYYCCPSTTXKI --secret TprANxrzbRz/8teXNI4plmcQbifSAqDlKD9lJAZuHSjMkHvBEBmO7w== --cluster ceph 2024-09-12T17:50:58.530 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:58.530 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:58.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.565+0000 7f4ec7935800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.566+0000 7f4ec7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.566+0000 7f4ec7935800 20 realm 2024-09-12T17:50:58.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.567+0000 7f4ec7935800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.567+0000 7f4ec7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.567+0000 7f4ec7935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:58.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.567+0000 7f4ec7935800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.567+0000 7f4ec7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.567+0000 7f4ec7935800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.568+0000 7f4ec7935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:58.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.568+0000 7f4ec7935800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.568+0000 7f4ec7935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:58.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.568+0000 7f4ec7935800 20 searching for the correct realm 2024-09-12T17:50:58.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.572+0000 7f4ec2ee3640 0 -- 172.21.15.44:0/2541328892 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x563f6add8ef0 msgr2=0x563f6addb380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:58.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.575+0000 7f4ec36e4640 0 -- 172.21.15.44:0/2541328892 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f4eb80c1bc0 msgr2=0x7f4eb80aa710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:58.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.579+0000 7f4ec7935800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:50:58.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.579+0000 7f4ec7935800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:50:58.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.579+0000 7f4ec7935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:58.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.579+0000 7f4ec7935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:58.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.579+0000 7f4ec7935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:58.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.579+0000 7f4ec7935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:58.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.579+0000 7f4ec7935800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.580+0000 7f4ec7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.580+0000 7f4ec7935800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.580+0000 7f4ec7935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:58.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.580+0000 7f4ec7935800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.580+0000 7f4ec7935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:58.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.580+0000 7f4ec7935800 20 zone default found 2024-09-12T17:50:58.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.580+0000 7f4ec7935800 4 Realm: () 2024-09-12T17:50:58.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.580+0000 7f4ec7935800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:50:58.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.580+0000 7f4ec7935800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:50:58.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.580+0000 7f4ec7935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:58.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.580+0000 7f4ec7935800 20 zonegroup default 2024-09-12T17:50:58.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.580+0000 7f4ec7935800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.581+0000 7f4ec7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.581+0000 7f4ec7935800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.581+0000 7f4ec7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.581+0000 7f4ec7935800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.581+0000 7f4ec7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.581+0000 7f4ec7935800 20 started sync module instance, tier type = 2024-09-12T17:50:58.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.581+0000 7f4ec7935800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:50:58.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.591+0000 7f4ec7935800 20 add_watcher() i=0 2024-09-12T17:50:58.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.591+0000 7f4ec7935800 20 add_watcher() i=1 2024-09-12T17:50:58.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.591+0000 7f4ec7935800 20 add_watcher() i=2 2024-09-12T17:50:58.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.591+0000 7f4ec7935800 20 add_watcher() i=3 2024-09-12T17:50:58.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.591+0000 7f4ec7935800 20 add_watcher() i=4 2024-09-12T17:50:58.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.591+0000 7f4ec7935800 20 add_watcher() i=5 2024-09-12T17:50:58.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.591+0000 7f4ec7935800 20 add_watcher() i=6 2024-09-12T17:50:58.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.592+0000 7f4ec7935800 20 add_watcher() i=7 2024-09-12T17:50:58.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.592+0000 7f4ec7935800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:58.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.593+0000 7f4d79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:58.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.594+0000 7f4ec7935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:58.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.594+0000 7f4ec7935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:58.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.594+0000 7f4ec7935800 5 note: GC not initialized 2024-09-12T17:50:58.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.594+0000 7f4d78fe1640 20 reqs_thread_entry: start 2024-09-12T17:50:58.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.594+0000 7f4ec7935800 20 init_complete bucket index max shards: 11 2024-09-12T17:50:58.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.594+0000 7f4ec7935800 20 Filter name: none 2024-09-12T17:50:58.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.594+0000 7f4cf27fc640 20 reqs_thread_entry: start 2024-09-12T17:50:58.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.594+0000 7f4ec7935800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T17:50:58.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.594+0000 7f4ec7935800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.595+0000 7f4ec7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.595+0000 7f4ec7935800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T17:50:58.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.595+0000 7f4ec7935800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:50:58.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.595+0000 7f4ec7935800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T17:50:58.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.595+0000 7f4ec7935800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.595+0000 7f4ec7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.595+0000 7f4ec7935800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T17:50:58.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.595+0000 7f4ec7935800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:50:58.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.595+0000 7f4ec7935800 10 cache get: name=default.rgw.meta+users.keys+TPLFHWQPIYYCCPSTTXKI : miss 2024-09-12T17:50:58.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.595+0000 7f4ec7935800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.595+0000 7f4ec7935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.595+0000 7f4ec7935800 10 cache put: name=default.rgw.meta+users.keys+TPLFHWQPIYYCCPSTTXKI info.flags=0x0 2024-09-12T17:50:58.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.595+0000 7f4ec7935800 10 adding default.rgw.meta+users.keys+TPLFHWQPIYYCCPSTTXKI to cache LRU end 2024-09-12T17:50:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.595+0000 7f4ec7935800 10 cache get: name=default.rgw.meta+users.keys+TPLFHWQPIYYCCPSTTXKI : hit (negative entry) 2024-09-12T17:50:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.595+0000 7f4ec7935800 10 cache get: name=default.rgw.meta+users.keys+TPLFHWQPIYYCCPSTTXKI : hit (negative entry) 2024-09-12T17:50:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.596+0000 7f4ec7935800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:50:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.596+0000 7f4ec7935800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:50:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.596+0000 7f4ec7935800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T17:50:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.597+0000 7f4da6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497120 cookie 94830375838048 notifier 8543 bl.length()=645 2024-09-12T17:50:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.597+0000 7f4da6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:50:58.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.597+0000 7f4da6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:50:58.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.598+0000 7f4ec7935800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T17:50:58.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.598+0000 7f4ec7935800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:50:58.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.598+0000 7f4ec7935800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T17:50:58.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.599+0000 7f4da6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497143 cookie 94830375859088 notifier 8543 bl.length()=185 2024-09-12T17:50:58.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.599+0000 7f4da6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T17:50:58.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.599+0000 7f4da6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:50:58.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.600+0000 7f4ec7935800 10 cache put: name=default.rgw.meta+users.keys+TPLFHWQPIYYCCPSTTXKI info.flags=0x7 2024-09-12T17:50:58.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.600+0000 7f4ec7935800 10 moving default.rgw.meta+users.keys+TPLFHWQPIYYCCPSTTXKI to cache LRU end 2024-09-12T17:50:58.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.600+0000 7f4ec7935800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:TPLFHWQPIYYCCPSTTXKI, ofs0, ns] 2024-09-12T17:50:58.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.601+0000 7f4da6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497019 cookie 94830375864064 notifier 8543 bl.length()=186 2024-09-12T17:50:58.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.601+0000 7f4da6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TPLFHWQPIYYCCPSTTXKI info.flags=0x7 2024-09-12T17:50:58.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.601+0000 7f4da6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TPLFHWQPIYYCCPSTTXKI to cache LRU end 2024-09-12T17:50:58.603 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T17:50:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "bar.client.0", 2024-09-12T17:50:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T17:50:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "bar+test@test.test", 2024-09-12T17:50:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2024-09-12T17:50:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2024-09-12T17:50:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2024-09-12T17:50:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2024-09-12T17:50:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-12T17:50:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "bar.client.0", 2024-09-12T17:50:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "TPLFHWQPIYYCCPSTTXKI", 2024-09-12T17:50:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "TprANxrzbRz/8teXNI4plmcQbifSAqDlKD9lJAZuHSjMkHvBEBmO7w==", 2024-09-12T17:50:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "active": true, 2024-09-12T17:50:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:50:58.597105Z" 2024-09-12T17:50:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T17:50:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-12T17:50:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2024-09-12T17:50:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [], 2024-09-12T17:50:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2024-09-12T17:50:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2024-09-12T17:50:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2024-09-12T17:50:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2024-09-12T17:50:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2024-09-12T17:50:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:50:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:50:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:50:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:50:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:50:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:50:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2024-09-12T17:50:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:50:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:50:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:50:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:50:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:50:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:50:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2024-09-12T17:50:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "rgw", 2024-09-12T17:50:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [], 2024-09-12T17:50:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "account_id": "", 2024-09-12T17:50:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-12T17:50:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:50:58.597090Z", 2024-09-12T17:50:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-09-12T17:50:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "group_ids": [] 2024-09-12T17:50:58.606 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T17:50:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:58.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.602+0000 7f4d79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:58.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.604+0000 7f4ec7935800 20 remove_watcher() i=0 2024-09-12T17:50:58.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.604+0000 7f4ec7935800 2 removed watcher, disabling cache 2024-09-12T17:50:58.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.605+0000 7f4ec7935800 20 remove_watcher() i=1 2024-09-12T17:50:58.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.606+0000 7f4ec7935800 20 remove_watcher() i=2 2024-09-12T17:50:58.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.607+0000 7f4ec7935800 20 remove_watcher() i=3 2024-09-12T17:50:58.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.608+0000 7f4ec7935800 20 remove_watcher() i=4 2024-09-12T17:50:58.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.609+0000 7f4ec7935800 20 remove_watcher() i=5 2024-09-12T17:50:58.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.610+0000 7f4ec7935800 20 remove_watcher() i=6 2024-09-12T17:50:58.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.611+0000 7f4ec7935800 20 remove_watcher() i=7 2024-09-12T17:50:58.625 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 0252189336 --totp-seed VUM2XLTQSB2TSCYXEVLVEXVF4DSXZNZS3BO3RNSNIG4NGYDPMCCYNUCGUW6NKBGS --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:50:58.692 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:58.693 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:58.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.727+0000 7fcfbeb21800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.729+0000 7fcfbeb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.729+0000 7fcfbeb21800 20 realm 2024-09-12T17:50:58.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.729+0000 7fcfbeb21800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.729+0000 7fcfbeb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.729+0000 7fcfbeb21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:58.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.729+0000 7fcfbeb21800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.729+0000 7fcfbeb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.729+0000 7fcfbeb21800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.730+0000 7fcfbeb21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:58.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.730+0000 7fcfbeb21800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.730+0000 7fcfbeb21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:58.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.730+0000 7fcfbeb21800 20 searching for the correct realm 2024-09-12T17:50:58.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.734+0000 7fcfbb00d640 0 -- 172.21.15.44:0/2235250465 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7fcfb006b020 msgr2=0x7fcfb0058740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:58.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.737+0000 7fcfba80c640 0 -- 172.21.15.44:0/2235250465 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fcfb00e4bb0 msgr2=0x7fcfb00be990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:58.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.945+0000 7fcfbeb21800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:50:58.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.945+0000 7fcfbeb21800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:50:58.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.945+0000 7fcfbeb21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:58.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.945+0000 7fcfbeb21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:58.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.945+0000 7fcfbeb21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:58.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.945+0000 7fcfbeb21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:58.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.945+0000 7fcfbeb21800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.945+0000 7fcfbeb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.945+0000 7fcfbeb21800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.945+0000 7fcfbeb21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.945+0000 7fcfbeb21800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.946+0000 7fcfbeb21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.946+0000 7fcfbeb21800 20 zone default found 2024-09-12T17:50:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.946+0000 7fcfbeb21800 4 Realm: () 2024-09-12T17:50:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.946+0000 7fcfbeb21800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:50:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.946+0000 7fcfbeb21800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:50:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.946+0000 7fcfbeb21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.946+0000 7fcfbeb21800 20 zonegroup default 2024-09-12T17:50:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.946+0000 7fcfbeb21800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.946+0000 7fcfbeb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.946+0000 7fcfbeb21800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.946+0000 7fcfbeb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.946+0000 7fcfbeb21800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.947+0000 7fcfbeb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.947+0000 7fcfbeb21800 20 started sync module instance, tier type = 2024-09-12T17:50:58.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.947+0000 7fcfbeb21800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:50:58.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.956+0000 7fcfbeb21800 20 add_watcher() i=0 2024-09-12T17:50:58.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.956+0000 7fcfbeb21800 20 add_watcher() i=1 2024-09-12T17:50:58.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.956+0000 7fcfbeb21800 20 add_watcher() i=2 2024-09-12T17:50:58.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.956+0000 7fcfbeb21800 20 add_watcher() i=3 2024-09-12T17:50:58.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.956+0000 7fcfbeb21800 20 add_watcher() i=4 2024-09-12T17:50:58.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.956+0000 7fcfbeb21800 20 add_watcher() i=5 2024-09-12T17:50:58.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.956+0000 7fcfbeb21800 20 add_watcher() i=6 2024-09-12T17:50:58.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.957+0000 7fcfbeb21800 20 add_watcher() i=7 2024-09-12T17:50:58.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.957+0000 7fcfbeb21800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:58.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.959+0000 7fce717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:58.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.959+0000 7fcfbeb21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:58.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.959+0000 7fcfbeb21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:58.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.959+0000 7fcfbeb21800 5 note: GC not initialized 2024-09-12T17:50:58.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.960+0000 7fcdebfff640 20 reqs_thread_entry: start 2024-09-12T17:50:58.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.960+0000 7fcfbeb21800 20 init_complete bucket index max shards: 11 2024-09-12T17:50:58.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.960+0000 7fcfbeb21800 20 Filter name: none 2024-09-12T17:50:58.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.960+0000 7fcde9ffb640 20 reqs_thread_entry: start 2024-09-12T17:50:58.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.960+0000 7fcfbeb21800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T17:50:58.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.960+0000 7fcfbeb21800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.961+0000 7fcfbeb21800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:50:58.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.961+0000 7fcfbeb21800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T17:50:58.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.961+0000 7fcfbeb21800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:50:58.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.961+0000 7fcfbeb21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:50:58.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.963+0000 7fcfbeb21800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:50:58.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.963+0000 7fcfbeb21800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:50:58.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.963+0000 7fcfbeb21800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T17:50:58.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.964+0000 7fce9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497121 cookie 93835012187904 notifier 9177 bl.length()=659 2024-09-12T17:50:58.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.964+0000 7fce9e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:50:58.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.964+0000 7fce9e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:50:58.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.965+0000 7fce717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:58.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.967+0000 7fcfbeb21800 20 remove_watcher() i=0 2024-09-12T17:50:58.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.967+0000 7fcfbeb21800 2 removed watcher, disabling cache 2024-09-12T17:50:58.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.968+0000 7fcfbeb21800 20 remove_watcher() i=1 2024-09-12T17:50:58.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.970+0000 7fcfbeb21800 20 remove_watcher() i=2 2024-09-12T17:50:58.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.971+0000 7fcfbeb21800 20 remove_watcher() i=3 2024-09-12T17:50:58.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.972+0000 7fcfbeb21800 20 remove_watcher() i=4 2024-09-12T17:50:58.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.973+0000 7fcfbeb21800 20 remove_watcher() i=5 2024-09-12T17:50:58.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.974+0000 7fcfbeb21800 20 remove_watcher() i=6 2024-09-12T17:50:58.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:58.975+0000 7fcfbeb21800 20 remove_watcher() i=7 2024-09-12T17:50:58.988 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-12T17:50:58.988 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key PXWJCESIVQJTHKNNTWGW --secret FDEJE4YqxrA1o+w1IxK2U1P8GVYVhUT/G+5LiZ9y2VyAJ8NJMD4Oiw== --cluster ceph 2024-09-12T17:50:59.054 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:59.054 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:59.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.089+0000 7fc85253b800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.090+0000 7fc85253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.090+0000 7fc85253b800 20 realm 2024-09-12T17:50:59.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.090+0000 7fc85253b800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.090+0000 7fc85253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.090+0000 7fc85253b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:59.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.090+0000 7fc85253b800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.091+0000 7fc85253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.091+0000 7fc85253b800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.091+0000 7fc85253b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:59.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.091+0000 7fc85253b800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.092+0000 7fc85253b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:59.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.092+0000 7fc85253b800 20 searching for the correct realm 2024-09-12T17:50:59.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.095+0000 7fc84daba640 0 -- 172.21.15.44:0/1849285273 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fc84006dbc0 msgr2=0x7fc84006c630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:50:59.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.302+0000 7fc84e2bb640 0 -- 172.21.15.44:0/1849285273 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fc8440a3450 msgr2=0x7fc8440a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:59.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.524+0000 7fc85253b800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:50:59.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.524+0000 7fc85253b800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:50:59.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.524+0000 7fc85253b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:59.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.524+0000 7fc85253b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:59.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.524+0000 7fc85253b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:59.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.524+0000 7fc85253b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:59.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.524+0000 7fc85253b800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.524+0000 7fc85253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.524+0000 7fc85253b800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.525+0000 7fc85253b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.525+0000 7fc85253b800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.525+0000 7fc85253b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.525+0000 7fc85253b800 20 zone default found 2024-09-12T17:50:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.525+0000 7fc85253b800 4 Realm: () 2024-09-12T17:50:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.525+0000 7fc85253b800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:50:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.525+0000 7fc85253b800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:50:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.525+0000 7fc85253b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.525+0000 7fc85253b800 20 zonegroup default 2024-09-12T17:50:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.525+0000 7fc85253b800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.526+0000 7fc85253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.526+0000 7fc85253b800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.526+0000 7fc85253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.526+0000 7fc85253b800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.526+0000 7fc85253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.526+0000 7fc85253b800 20 started sync module instance, tier type = 2024-09-12T17:50:59.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.526+0000 7fc85253b800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:50:59.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.537+0000 7fc85253b800 20 add_watcher() i=0 2024-09-12T17:50:59.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.537+0000 7fc85253b800 20 add_watcher() i=1 2024-09-12T17:50:59.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.537+0000 7fc85253b800 20 add_watcher() i=2 2024-09-12T17:50:59.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.537+0000 7fc85253b800 20 add_watcher() i=3 2024-09-12T17:50:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.537+0000 7fc85253b800 20 add_watcher() i=4 2024-09-12T17:50:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.537+0000 7fc85253b800 20 add_watcher() i=5 2024-09-12T17:50:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.537+0000 7fc85253b800 20 add_watcher() i=6 2024-09-12T17:50:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.538+0000 7fc85253b800 20 add_watcher() i=7 2024-09-12T17:50:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.538+0000 7fc85253b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:59.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.539+0000 7fc704fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:59.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.540+0000 7fc85253b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:59.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.540+0000 7fc85253b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:59.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.540+0000 7fc85253b800 5 note: GC not initialized 2024-09-12T17:50:59.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.540+0000 7fc67f7fe640 20 reqs_thread_entry: start 2024-09-12T17:50:59.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.540+0000 7fc85253b800 20 init_complete bucket index max shards: 11 2024-09-12T17:50:59.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.540+0000 7fc85253b800 20 Filter name: none 2024-09-12T17:50:59.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.540+0000 7fc67d7fa640 20 reqs_thread_entry: start 2024-09-12T17:50:59.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.540+0000 7fc85253b800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T17:50:59.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.540+0000 7fc85253b800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.541+0000 7fc85253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.541+0000 7fc85253b800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T17:50:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.541+0000 7fc85253b800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:50:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.541+0000 7fc85253b800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T17:50:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.541+0000 7fc85253b800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.541+0000 7fc85253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.541+0000 7fc85253b800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T17:50:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.541+0000 7fc85253b800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:50:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.541+0000 7fc85253b800 10 cache get: name=default.rgw.meta+users.keys+PXWJCESIVQJTHKNNTWGW : miss 2024-09-12T17:50:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.541+0000 7fc85253b800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.541+0000 7fc85253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.541+0000 7fc85253b800 10 cache put: name=default.rgw.meta+users.keys+PXWJCESIVQJTHKNNTWGW info.flags=0x0 2024-09-12T17:50:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.541+0000 7fc85253b800 10 adding default.rgw.meta+users.keys+PXWJCESIVQJTHKNNTWGW to cache LRU end 2024-09-12T17:50:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.541+0000 7fc85253b800 10 cache get: name=default.rgw.meta+users.keys+PXWJCESIVQJTHKNNTWGW : hit (negative entry) 2024-09-12T17:50:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.541+0000 7fc85253b800 10 cache get: name=default.rgw.meta+users.keys+PXWJCESIVQJTHKNNTWGW : hit (negative entry) 2024-09-12T17:50:59.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.542+0000 7fc85253b800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:50:59.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.542+0000 7fc85253b800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:50:59.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.542+0000 7fc85253b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T17:50:59.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.543+0000 7fc731ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464440 cookie 94581017431136 notifier 8579 bl.length()=719 2024-09-12T17:50:59.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.543+0000 7fc731ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:50:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.543+0000 7fc731ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:50:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.545+0000 7fc85253b800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T17:50:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.545+0000 7fc85253b800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:50:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.545+0000 7fc85253b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T17:50:59.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.545+0000 7fc731ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464316 cookie 94581017437408 notifier 8579 bl.length()=215 2024-09-12T17:50:59.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.545+0000 7fc731ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T17:50:59.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.545+0000 7fc731ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:50:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.547+0000 7fc85253b800 10 cache put: name=default.rgw.meta+users.keys+PXWJCESIVQJTHKNNTWGW info.flags=0x7 2024-09-12T17:50:59.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.547+0000 7fc85253b800 10 moving default.rgw.meta+users.keys+PXWJCESIVQJTHKNNTWGW to cache LRU end 2024-09-12T17:50:59.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.547+0000 7fc85253b800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:PXWJCESIVQJTHKNNTWGW, ofs0, ns] 2024-09-12T17:50:59.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.547+0000 7fc731ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464418 cookie 94581017419648 notifier 8579 bl.length()=201 2024-09-12T17:50:59.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.547+0000 7fc731ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PXWJCESIVQJTHKNNTWGW info.flags=0x7 2024-09-12T17:50:59.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.547+0000 7fc731ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PXWJCESIVQJTHKNNTWGW to cache LRU end 2024-09-12T17:50:59.549 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T17:50:59.549 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T17:50:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-12T17:50:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T17:50:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2024-09-12T17:50:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2024-09-12T17:50:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2024-09-12T17:50:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2024-09-12T17:50:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-12T17:50:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T17:50:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "PXWJCESIVQJTHKNNTWGW", 2024-09-12T17:50:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "FDEJE4YqxrA1o+w1IxK2U1P8GVYVhUT/G+5LiZ9y2VyAJ8NJMD4Oiw==", 2024-09-12T17:50:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "active": true, 2024-09-12T17:50:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:50:59.543280Z" 2024-09-12T17:50:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T17:50:59.551 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-12T17:50:59.551 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2024-09-12T17:50:59.551 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [], 2024-09-12T17:50:59.551 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2024-09-12T17:50:59.551 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2024-09-12T17:50:59.551 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2024-09-12T17:50:59.551 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2024-09-12T17:50:59.551 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2024-09-12T17:50:59.551 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:50:59.551 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:50:59.551 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:50:59.551 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:50:59.551 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:50:59.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:50:59.551 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2024-09-12T17:50:59.552 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:50:59.552 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:50:59.552 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:50:59.552 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:50:59.552 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:50:59.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:50:59.552 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2024-09-12T17:50:59.552 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "rgw", 2024-09-12T17:50:59.552 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [], 2024-09-12T17:50:59.552 INFO:teuthology.orchestra.run.smithi044.stdout: "account_id": "", 2024-09-12T17:50:59.552 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-12T17:50:59.552 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:50:59.543259Z", 2024-09-12T17:50:59.552 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-09-12T17:50:59.553 INFO:teuthology.orchestra.run.smithi044.stdout: "group_ids": [] 2024-09-12T17:50:59.553 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T17:50:59.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:50:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.549+0000 7fc704fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.551+0000 7fc85253b800 20 remove_watcher() i=0 2024-09-12T17:50:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.551+0000 7fc85253b800 2 removed watcher, disabling cache 2024-09-12T17:50:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.552+0000 7fc85253b800 20 remove_watcher() i=1 2024-09-12T17:50:59.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.553+0000 7fc85253b800 20 remove_watcher() i=2 2024-09-12T17:50:59.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.554+0000 7fc85253b800 20 remove_watcher() i=3 2024-09-12T17:50:59.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.555+0000 7fc85253b800 20 remove_watcher() i=4 2024-09-12T17:50:59.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.556+0000 7fc85253b800 20 remove_watcher() i=5 2024-09-12T17:50:59.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.557+0000 7fc85253b800 20 remove_watcher() i=6 2024-09-12T17:50:59.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.558+0000 7fc85253b800 20 remove_watcher() i=7 2024-09-12T17:50:59.572 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 3762389175 --totp-seed XUKLUF5BMG2RS3C6PXBB5DACCLWSL6YGD77N4H7FK3I46JITYTXOM2EAHR6NCHSR --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:50:59.641 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:59.641 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:59.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.878+0000 7f8d2092e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.880+0000 7f8d2092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.880+0000 7f8d2092e800 20 realm 2024-09-12T17:50:59.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.880+0000 7f8d2092e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.880+0000 7f8d2092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.880+0000 7f8d2092e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:59.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.880+0000 7f8d2092e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.881+0000 7f8d2092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.881+0000 7f8d2092e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.882+0000 7f8d2092e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:59.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.882+0000 7f8d2092e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.882+0000 7f8d2092e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:59.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.882+0000 7f8d2092e800 20 searching for the correct realm 2024-09-12T17:50:59.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:50:59.885+0000 7f8d1bd6a640 0 -- 172.21.15.44:0/410750003 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f8d0c03e040 msgr2=0x7f8d0c052920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:51:00.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.092+0000 7f8d1c56b640 0 -- 172.21.15.44:0/410750003 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f8d10061010 msgr2=0x7f8d10068860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:51:00.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.299+0000 7f8d2092e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:51:00.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.299+0000 7f8d2092e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:51:00.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.299+0000 7f8d2092e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:00.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.299+0000 7f8d2092e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:00.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.299+0000 7f8d2092e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:00.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.299+0000 7f8d2092e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:00.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.299+0000 7f8d2092e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.300+0000 7f8d2092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.300+0000 7f8d2092e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.300+0000 7f8d2092e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:00.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.300+0000 7f8d2092e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.300+0000 7f8d2092e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:00.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.300+0000 7f8d2092e800 20 zone default found 2024-09-12T17:51:00.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.300+0000 7f8d2092e800 4 Realm: () 2024-09-12T17:51:00.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.300+0000 7f8d2092e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:51:00.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.300+0000 7f8d2092e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:51:00.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.300+0000 7f8d2092e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:00.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.300+0000 7f8d2092e800 20 zonegroup default 2024-09-12T17:51:00.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.300+0000 7f8d2092e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.301+0000 7f8d2092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.301+0000 7f8d2092e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.301+0000 7f8d2092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.301+0000 7f8d2092e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.302+0000 7f8d2092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.302+0000 7f8d2092e800 20 started sync module instance, tier type = 2024-09-12T17:51:00.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.302+0000 7f8d2092e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:51:00.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.313+0000 7f8d2092e800 20 add_watcher() i=0 2024-09-12T17:51:00.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.313+0000 7f8d2092e800 20 add_watcher() i=1 2024-09-12T17:51:00.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.313+0000 7f8d2092e800 20 add_watcher() i=2 2024-09-12T17:51:00.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.313+0000 7f8d2092e800 20 add_watcher() i=3 2024-09-12T17:51:00.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.313+0000 7f8d2092e800 20 add_watcher() i=4 2024-09-12T17:51:00.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.313+0000 7f8d2092e800 20 add_watcher() i=5 2024-09-12T17:51:00.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.313+0000 7f8d2092e800 20 add_watcher() i=6 2024-09-12T17:51:00.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.315+0000 7f8d2092e800 20 add_watcher() i=7 2024-09-12T17:51:00.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.315+0000 7f8d2092e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:00.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.317+0000 7f8bd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:00.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.317+0000 7f8d2092e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:00.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.317+0000 7f8d2092e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:00.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.317+0000 7f8d2092e800 5 note: GC not initialized 2024-09-12T17:51:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.317+0000 7f8bd1fdb640 20 reqs_thread_entry: start 2024-09-12T17:51:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.317+0000 7f8d2092e800 20 init_complete bucket index max shards: 11 2024-09-12T17:51:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.318+0000 7f8d2092e800 20 Filter name: none 2024-09-12T17:51:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.318+0000 7f8b437fe640 20 reqs_thread_entry: start 2024-09-12T17:51:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.318+0000 7f8d2092e800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T17:51:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.318+0000 7f8d2092e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.319+0000 7f8d2092e800 20 rados_obj.operate() r=0 bl.length=519 2024-09-12T17:51:00.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.319+0000 7f8d2092e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T17:51:00.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.319+0000 7f8d2092e800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:51:00.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.319+0000 7f8d2092e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:00.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.322+0000 7f8d2092e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:51:00.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.322+0000 7f8d2092e800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:51:00.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.322+0000 7f8d2092e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T17:51:00.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.322+0000 7f8bf37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464441 cookie 93895682990256 notifier 9219 bl.length()=733 2024-09-12T17:51:00.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.322+0000 7f8bf37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:51:00.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.322+0000 7f8bf37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:51:00.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.324+0000 7f8bd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:00.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.327+0000 7f8d2092e800 20 remove_watcher() i=0 2024-09-12T17:51:00.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.327+0000 7f8d2092e800 2 removed watcher, disabling cache 2024-09-12T17:51:00.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.328+0000 7f8d2092e800 20 remove_watcher() i=1 2024-09-12T17:51:00.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.330+0000 7f8d2092e800 20 remove_watcher() i=2 2024-09-12T17:51:00.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.331+0000 7f8d2092e800 20 remove_watcher() i=3 2024-09-12T17:51:00.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.333+0000 7f8d2092e800 20 remove_watcher() i=4 2024-09-12T17:51:00.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.334+0000 7f8d2092e800 20 remove_watcher() i=5 2024-09-12T17:51:00.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.335+0000 7f8d2092e800 20 remove_watcher() i=6 2024-09-12T17:51:00.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.336+0000 7f8d2092e800 20 remove_watcher() i=7 2024-09-12T17:51:00.351 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T17:51:00.351 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key FVKLEHJAYEIRMNSZQDLZ --secret SML9zIkpSKHW6CREWUpBdRnv59VlKyOIfxMsKG2rgiHuWZKubqdUog== --cluster ceph 2024-09-12T17:51:00.423 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:00.423 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:00.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.457+0000 7f369532c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.459+0000 7f369532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.459+0000 7f369532c800 20 realm 2024-09-12T17:51:00.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.459+0000 7f369532c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.459+0000 7f369532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.459+0000 7f369532c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:00.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.459+0000 7f369532c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.459+0000 7f369532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.459+0000 7f369532c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.460+0000 7f369532c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:00.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.460+0000 7f369532c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.460+0000 7f369532c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:00.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.460+0000 7f369532c800 20 searching for the correct realm 2024-09-12T17:51:00.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.464+0000 7f36918ae640 0 -- 172.21.15.44:0/2219582199 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f368808a030 msgr2=0x7f368808a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:00.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.468+0000 7f36910ad640 0 -- 172.21.15.44:0/2219582199 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f3688064950 msgr2=0x7f368807b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.674+0000 7f369532c800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:51:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.674+0000 7f369532c800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:51:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.674+0000 7f369532c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.674+0000 7f369532c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.674+0000 7f369532c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.674+0000 7f369532c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.674+0000 7f369532c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.674+0000 7f369532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.674+0000 7f369532c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.675+0000 7f369532c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:00.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.675+0000 7f369532c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.675+0000 7f369532c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:00.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.675+0000 7f369532c800 20 zone default found 2024-09-12T17:51:00.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.675+0000 7f369532c800 4 Realm: () 2024-09-12T17:51:00.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.675+0000 7f369532c800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:51:00.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.675+0000 7f369532c800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:51:00.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.675+0000 7f369532c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:00.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.675+0000 7f369532c800 20 zonegroup default 2024-09-12T17:51:00.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.675+0000 7f369532c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.675+0000 7f369532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.675+0000 7f369532c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.676+0000 7f369532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.676+0000 7f369532c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.676+0000 7f369532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.676+0000 7f369532c800 20 started sync module instance, tier type = 2024-09-12T17:51:00.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.676+0000 7f369532c800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:51:00.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.686+0000 7f369532c800 20 add_watcher() i=0 2024-09-12T17:51:00.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.686+0000 7f369532c800 20 add_watcher() i=1 2024-09-12T17:51:00.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.686+0000 7f369532c800 20 add_watcher() i=2 2024-09-12T17:51:00.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.686+0000 7f369532c800 20 add_watcher() i=3 2024-09-12T17:51:00.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.686+0000 7f369532c800 20 add_watcher() i=4 2024-09-12T17:51:00.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.686+0000 7f369532c800 20 add_watcher() i=5 2024-09-12T17:51:00.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.686+0000 7f369532c800 20 add_watcher() i=6 2024-09-12T17:51:00.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.687+0000 7f369532c800 20 add_watcher() i=7 2024-09-12T17:51:00.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.687+0000 7f369532c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:00.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.689+0000 7f35477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:00.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.689+0000 7f369532c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:00.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.689+0000 7f369532c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:00.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.689+0000 7f369532c800 5 note: GC not initialized 2024-09-12T17:51:00.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.690+0000 7f35467e4640 20 reqs_thread_entry: start 2024-09-12T17:51:00.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.690+0000 7f369532c800 20 init_complete bucket index max shards: 11 2024-09-12T17:51:00.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.690+0000 7f369532c800 20 Filter name: none 2024-09-12T17:51:00.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.690+0000 7f34b7fff640 20 reqs_thread_entry: start 2024-09-12T17:51:00.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.690+0000 7f369532c800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:51:00.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.690+0000 7f369532c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.690+0000 7f369532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.690+0000 7f369532c800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T17:51:00.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.690+0000 7f369532c800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:51:00.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.690+0000 7f369532c800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T17:51:00.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.690+0000 7f369532c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.691+0000 7f369532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.691+0000 7f369532c800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T17:51:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.691+0000 7f369532c800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:51:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.691+0000 7f369532c800 10 cache get: name=default.rgw.meta+users.keys+FVKLEHJAYEIRMNSZQDLZ : miss 2024-09-12T17:51:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.691+0000 7f369532c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.691+0000 7f369532c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.691+0000 7f369532c800 10 cache put: name=default.rgw.meta+users.keys+FVKLEHJAYEIRMNSZQDLZ info.flags=0x0 2024-09-12T17:51:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.691+0000 7f369532c800 10 adding default.rgw.meta+users.keys+FVKLEHJAYEIRMNSZQDLZ to cache LRU end 2024-09-12T17:51:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.691+0000 7f369532c800 10 cache get: name=default.rgw.meta+users.keys+FVKLEHJAYEIRMNSZQDLZ : hit (negative entry) 2024-09-12T17:51:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.691+0000 7f369532c800 10 cache get: name=default.rgw.meta+users.keys+FVKLEHJAYEIRMNSZQDLZ : hit (negative entry) 2024-09-12T17:51:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.692+0000 7f369532c800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:51:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.692+0000 7f369532c800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:51:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.692+0000 7f369532c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:51:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.693+0000 7f3574ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464317 cookie 94103795881888 notifier 9240 bl.length()=660 2024-09-12T17:51:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.693+0000 7f3574ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:51:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.693+0000 7f3574ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:51:00.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.694+0000 7f369532c800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T17:51:00.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.694+0000 7f369532c800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:51:00.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.694+0000 7f369532c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T17:51:00.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.695+0000 7f3574ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464419 cookie 94103795859120 notifier 9240 bl.length()=191 2024-09-12T17:51:00.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.695+0000 7f3574ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T17:51:00.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.695+0000 7f3574ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:51:00.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.697+0000 7f369532c800 10 cache put: name=default.rgw.meta+users.keys+FVKLEHJAYEIRMNSZQDLZ info.flags=0x7 2024-09-12T17:51:00.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.697+0000 7f369532c800 10 moving default.rgw.meta+users.keys+FVKLEHJAYEIRMNSZQDLZ to cache LRU end 2024-09-12T17:51:00.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.697+0000 7f369532c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:FVKLEHJAYEIRMNSZQDLZ, ofs0, ns] 2024-09-12T17:51:00.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.698+0000 7f3563fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464482 cookie 94103795874368 notifier 9240 bl.length()=189 2024-09-12T17:51:00.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.698+0000 7f3563fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FVKLEHJAYEIRMNSZQDLZ info.flags=0x7 2024-09-12T17:51:00.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.698+0000 7f3563fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FVKLEHJAYEIRMNSZQDLZ to cache LRU end 2024-09-12T17:51:00.700 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T17:51:00.700 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "foobar.client.0", 2024-09-12T17:51:00.700 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T17:51:00.700 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "foobar+test@test.test", 2024-09-12T17:51:00.700 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2024-09-12T17:51:00.700 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2024-09-12T17:51:00.700 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2024-09-12T17:51:00.700 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2024-09-12T17:51:00.700 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-12T17:51:00.700 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "foobar.client.0", 2024-09-12T17:51:00.700 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "FVKLEHJAYEIRMNSZQDLZ", 2024-09-12T17:51:00.701 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "SML9zIkpSKHW6CREWUpBdRnv59VlKyOIfxMsKG2rgiHuWZKubqdUog==", 2024-09-12T17:51:00.701 INFO:teuthology.orchestra.run.smithi044.stdout: "active": true, 2024-09-12T17:51:00.701 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:51:00.693137Z" 2024-09-12T17:51:00.701 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T17:51:00.701 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-12T17:51:00.701 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2024-09-12T17:51:00.701 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [], 2024-09-12T17:51:00.701 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2024-09-12T17:51:00.701 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2024-09-12T17:51:00.701 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2024-09-12T17:51:00.701 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2024-09-12T17:51:00.701 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2024-09-12T17:51:00.701 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:51:00.701 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:51:00.702 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:51:00.702 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:51:00.702 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:51:00.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:51:00.702 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2024-09-12T17:51:00.702 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:51:00.702 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:51:00.702 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:51:00.702 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:51:00.702 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:51:00.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:51:00.702 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2024-09-12T17:51:00.702 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "rgw", 2024-09-12T17:51:00.702 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [], 2024-09-12T17:51:00.702 INFO:teuthology.orchestra.run.smithi044.stdout: "account_id": "", 2024-09-12T17:51:00.703 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-12T17:51:00.703 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:51:00.693121Z", 2024-09-12T17:51:00.703 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-09-12T17:51:00.703 INFO:teuthology.orchestra.run.smithi044.stdout: "group_ids": [] 2024-09-12T17:51:00.703 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T17:51:00.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:51:00.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.699+0000 7f35477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:00.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.701+0000 7f369532c800 20 remove_watcher() i=0 2024-09-12T17:51:00.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.701+0000 7f369532c800 2 removed watcher, disabling cache 2024-09-12T17:51:00.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.703+0000 7f369532c800 20 remove_watcher() i=1 2024-09-12T17:51:00.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.704+0000 7f369532c800 20 remove_watcher() i=2 2024-09-12T17:51:00.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.705+0000 7f369532c800 20 remove_watcher() i=3 2024-09-12T17:51:00.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.706+0000 7f369532c800 20 remove_watcher() i=4 2024-09-12T17:51:00.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.707+0000 7f369532c800 20 remove_watcher() i=5 2024-09-12T17:51:00.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.708+0000 7f369532c800 20 remove_watcher() i=6 2024-09-12T17:51:00.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.709+0000 7f369532c800 20 remove_watcher() i=7 2024-09-12T17:51:00.722 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 4339774493 --totp-seed 7MPMURU6HXQYFXUGWSJZYTWLBFSK5O4WGR274ULHH4HVVN6TI2SC5PJLUTGRJPE7 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:51:00.791 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:00.792 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:00.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.826+0000 7fd52b346800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.828+0000 7fd52b346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.828+0000 7fd52b346800 20 realm 2024-09-12T17:51:00.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.828+0000 7fd52b346800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.828+0000 7fd52b346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.828+0000 7fd52b346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:00.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.828+0000 7fd52b346800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.828+0000 7fd52b346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.828+0000 7fd52b346800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.829+0000 7fd52b346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:00.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.829+0000 7fd52b346800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.830+0000 7fd52b346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:00.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.830+0000 7fd52b346800 20 searching for the correct realm 2024-09-12T17:51:00.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:00.833+0000 7fd52862f640 0 -- 172.21.15.44:0/1205181558 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fd51807e070 msgr2=0x7fd51809e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.038+0000 7fd528e30640 0 -- 172.21.15.44:0/1205181558 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fd51c08bc00 msgr2=0x7fd51c0604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:01.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.446+0000 7fd52b346800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:51:01.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.446+0000 7fd52b346800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:51:01.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.446+0000 7fd52b346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:01.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.446+0000 7fd52b346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:01.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.446+0000 7fd52b346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:01.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.446+0000 7fd52b346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:01.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.446+0000 7fd52b346800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.447+0000 7fd52b346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.447+0000 7fd52b346800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.447+0000 7fd52b346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:01.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.447+0000 7fd52b346800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.448+0000 7fd52b346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:01.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.448+0000 7fd52b346800 20 zone default found 2024-09-12T17:51:01.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.448+0000 7fd52b346800 4 Realm: () 2024-09-12T17:51:01.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.448+0000 7fd52b346800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:51:01.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.448+0000 7fd52b346800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:51:01.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.448+0000 7fd52b346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:01.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.448+0000 7fd52b346800 20 zonegroup default 2024-09-12T17:51:01.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.448+0000 7fd52b346800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.448+0000 7fd52b346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.448+0000 7fd52b346800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.449+0000 7fd52b346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.449+0000 7fd52b346800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.449+0000 7fd52b346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.449+0000 7fd52b346800 20 started sync module instance, tier type = 2024-09-12T17:51:01.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.449+0000 7fd52b346800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:51:01.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.460+0000 7fd52b346800 20 add_watcher() i=0 2024-09-12T17:51:01.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.460+0000 7fd52b346800 20 add_watcher() i=1 2024-09-12T17:51:01.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.460+0000 7fd52b346800 20 add_watcher() i=2 2024-09-12T17:51:01.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.460+0000 7fd52b346800 20 add_watcher() i=3 2024-09-12T17:51:01.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.460+0000 7fd52b346800 20 add_watcher() i=4 2024-09-12T17:51:01.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.460+0000 7fd52b346800 20 add_watcher() i=5 2024-09-12T17:51:01.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.461+0000 7fd52b346800 20 add_watcher() i=6 2024-09-12T17:51:01.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.462+0000 7fd52b346800 20 add_watcher() i=7 2024-09-12T17:51:01.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.462+0000 7fd52b346800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:01.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.463+0000 7fd3defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:01.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.464+0000 7fd52b346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:01.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.464+0000 7fd52b346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:01.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.464+0000 7fd52b346800 5 note: GC not initialized 2024-09-12T17:51:01.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.464+0000 7fd3ddfe3640 20 reqs_thread_entry: start 2024-09-12T17:51:01.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.464+0000 7fd52b346800 20 init_complete bucket index max shards: 11 2024-09-12T17:51:01.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.464+0000 7fd52b346800 20 Filter name: none 2024-09-12T17:51:01.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.464+0000 7fd34f7fe640 20 reqs_thread_entry: start 2024-09-12T17:51:01.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.464+0000 7fd52b346800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:51:01.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.464+0000 7fd52b346800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.465+0000 7fd52b346800 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T17:51:01.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.465+0000 7fd52b346800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T17:51:01.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.465+0000 7fd52b346800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:51:01.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.465+0000 7fd52b346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.468+0000 7fd52b346800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:51:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.468+0000 7fd52b346800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:51:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.468+0000 7fd52b346800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:51:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.468+0000 7fd3fffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464318 cookie 93979649342352 notifier 9258 bl.length()=674 2024-09-12T17:51:01.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.468+0000 7fd3fffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:51:01.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.468+0000 7fd3fffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:51:01.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.470+0000 7fd3defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:01.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.473+0000 7fd52b346800 20 remove_watcher() i=0 2024-09-12T17:51:01.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.473+0000 7fd52b346800 2 removed watcher, disabling cache 2024-09-12T17:51:01.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.474+0000 7fd52b346800 20 remove_watcher() i=1 2024-09-12T17:51:01.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.475+0000 7fd52b346800 20 remove_watcher() i=2 2024-09-12T17:51:01.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.477+0000 7fd52b346800 20 remove_watcher() i=3 2024-09-12T17:51:01.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.478+0000 7fd52b346800 20 remove_watcher() i=4 2024-09-12T17:51:01.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.479+0000 7fd52b346800 20 remove_watcher() i=5 2024-09-12T17:51:01.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.480+0000 7fd52b346800 20 remove_watcher() i=6 2024-09-12T17:51:01.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.481+0000 7fd52b346800 20 remove_watcher() i=7 2024-09-12T17:51:01.496 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T17:51:01.559 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:01.559 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:01.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.594+0000 7f9b3c60f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.596+0000 7f9b3c60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.596+0000 7f9b3c60f800 20 realm 2024-09-12T17:51:01.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.596+0000 7f9b3c60f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.596+0000 7f9b3c60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.596+0000 7f9b3c60f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:01.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.596+0000 7f9b3c60f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.597+0000 7f9b3c60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.597+0000 7f9b3c60f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.598+0000 7f9b3c60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:01.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.598+0000 7f9b3c60f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.598+0000 7f9b3c60f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:01.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.598+0000 7f9b3c60f800 20 searching for the correct realm 2024-09-12T17:51:01.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.602+0000 7f9b38549640 0 -- 172.21.15.44:0/807257433 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f9b2c04c040 msgr2=0x7f9b2c04c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:01.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.606+0000 7f9b37d48640 0 -- 172.21.15.44:0/807257433 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f9b2c008930 msgr2=0x7f9b2c021410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:01.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.814+0000 7f9b3c60f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:51:01.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.814+0000 7f9b3c60f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:51:01.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.814+0000 7f9b3c60f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:01.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.814+0000 7f9b3c60f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:01.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.814+0000 7f9b3c60f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:01.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.814+0000 7f9b3c60f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:01.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.814+0000 7f9b3c60f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.814+0000 7f9b3c60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.814+0000 7f9b3c60f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.814+0000 7f9b3c60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:01.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.814+0000 7f9b3c60f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.815+0000 7f9b3c60f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:01.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.815+0000 7f9b3c60f800 20 zone default found 2024-09-12T17:51:01.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.815+0000 7f9b3c60f800 4 Realm: () 2024-09-12T17:51:01.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.815+0000 7f9b3c60f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:51:01.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.815+0000 7f9b3c60f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:51:01.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.815+0000 7f9b3c60f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:01.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.815+0000 7f9b3c60f800 20 zonegroup default 2024-09-12T17:51:01.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.815+0000 7f9b3c60f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.815+0000 7f9b3c60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.815+0000 7f9b3c60f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.815+0000 7f9b3c60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.815+0000 7f9b3c60f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.816+0000 7f9b3c60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.816+0000 7f9b3c60f800 20 started sync module instance, tier type = 2024-09-12T17:51:01.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.816+0000 7f9b3c60f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:51:01.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.826+0000 7f9b3c60f800 20 add_watcher() i=0 2024-09-12T17:51:01.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.826+0000 7f9b3c60f800 20 add_watcher() i=1 2024-09-12T17:51:01.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.826+0000 7f9b3c60f800 20 add_watcher() i=2 2024-09-12T17:51:01.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.826+0000 7f9b3c60f800 20 add_watcher() i=3 2024-09-12T17:51:01.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.826+0000 7f9b3c60f800 20 add_watcher() i=4 2024-09-12T17:51:01.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.826+0000 7f9b3c60f800 20 add_watcher() i=5 2024-09-12T17:51:01.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.826+0000 7f9b3c60f800 20 add_watcher() i=6 2024-09-12T17:51:01.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.827+0000 7f9b3c60f800 20 add_watcher() i=7 2024-09-12T17:51:01.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.827+0000 7f9b3c60f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:01.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.828+0000 7f99edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:01.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.828+0000 7f9b3c60f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:01.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.828+0000 7f9b3c60f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:01.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.829+0000 7f9b3c60f800 5 note: GC not initialized 2024-09-12T17:51:01.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.829+0000 7f99ecfe1640 20 reqs_thread_entry: start 2024-09-12T17:51:01.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.829+0000 7f9b3c60f800 20 init_complete bucket index max shards: 11 2024-09-12T17:51:01.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.829+0000 7f9b3c60f800 20 Filter name: none 2024-09-12T17:51:01.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.829+0000 7f99667fc640 20 reqs_thread_entry: start 2024-09-12T17:51:01.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.829+0000 7f9b3c60f800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:51:01.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.829+0000 7f9b3c60f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.830+0000 7f9b3c60f800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:51:01.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.830+0000 7f9b3c60f800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T17:51:01.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.830+0000 7f9b3c60f800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:51:01.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.830+0000 7f9b3c60f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:01.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.831+0000 7f9b3c60f800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:51:01.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.831+0000 7f9b3c60f800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:51:01.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.831+0000 7f9b3c60f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:51:01.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.831+0000 7f9a16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464319 cookie 94399511664496 notifier 9276 bl.length()=727 2024-09-12T17:51:01.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.831+0000 7f9a16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:51:01.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.831+0000 7f9a16ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "foobar.client.0", 2024-09-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "foobar+test@test.test", 2024-09-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2024-09-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2024-09-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2024-09-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2024-09-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "foobar.client.0", 2024-09-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "FVKLEHJAYEIRMNSZQDLZ", 2024-09-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "SML9zIkpSKHW6CREWUpBdRnv59VlKyOIfxMsKG2rgiHuWZKubqdUog==", 2024-09-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi044.stdout: "active": true, 2024-09-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:51:00.693137Z" 2024-09-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2024-09-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [ 2024-09-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "oidc-provider", 2024-09-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi044.stdout: "perm": "*" 2024-09-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "roles", 2024-09-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi044.stdout: "perm": "*" 2024-09-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "user-policy", 2024-09-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi044.stdout: "perm": "*" 2024-09-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2024-09-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2024-09-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2024-09-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2024-09-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2024-09-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2024-09-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2024-09-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "rgw", 2024-09-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [ 2024-09-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi044.stdout: "4339774493" 2024-09-12T17:51:01.838 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-12T17:51:01.838 INFO:teuthology.orchestra.run.smithi044.stdout: "account_id": "", 2024-09-12T17:51:01.838 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-12T17:51:01.838 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:51:00.693121Z", 2024-09-12T17:51:01.838 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-09-12T17:51:01.838 INFO:teuthology.orchestra.run.smithi044.stdout: "group_ids": [] 2024-09-12T17:51:01.838 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T17:51:01.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:51:01.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.832+0000 7f99edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:01.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.835+0000 7f9b3c60f800 20 remove_watcher() i=0 2024-09-12T17:51:01.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.835+0000 7f9b3c60f800 2 removed watcher, disabling cache 2024-09-12T17:51:01.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.837+0000 7f9b3c60f800 20 remove_watcher() i=1 2024-09-12T17:51:01.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.838+0000 7f9b3c60f800 20 remove_watcher() i=2 2024-09-12T17:51:01.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.839+0000 7f9b3c60f800 20 remove_watcher() i=3 2024-09-12T17:51:01.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.840+0000 7f9b3c60f800 20 remove_watcher() i=4 2024-09-12T17:51:01.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.841+0000 7f9b3c60f800 20 remove_watcher() i=5 2024-09-12T17:51:01.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.842+0000 7f9b3c60f800 20 remove_watcher() i=6 2024-09-12T17:51:01.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.843+0000 7f9b3c60f800 20 remove_watcher() i=7 2024-09-12T17:51:01.857 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T17:51:01.919 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:01.919 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:01.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.954+0000 7fbb93814800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.956+0000 7fbb93814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.956+0000 7fbb93814800 20 realm 2024-09-12T17:51:01.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.956+0000 7fbb93814800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.956+0000 7fbb93814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.956+0000 7fbb93814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:01.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.956+0000 7fbb93814800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.957+0000 7fbb93814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.957+0000 7fbb93814800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.958+0000 7fbb93814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:01.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.958+0000 7fbb93814800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.958+0000 7fbb93814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:01.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.958+0000 7fbb93814800 20 searching for the correct realm 2024-09-12T17:51:01.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.962+0000 7fbb8e6ca640 0 -- 172.21.15.44:0/2411268143 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55f6171f1fc0 msgr2=0x55f6171f4450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:01.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.965+0000 7fbb8eecb640 0 -- 172.21.15.44:0/2411268143 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fbb84071120 msgr2=0x7fbb8406b4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:51:01.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.970+0000 7fbb93814800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:51:01.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.970+0000 7fbb93814800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:51:01.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.970+0000 7fbb93814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:01.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.970+0000 7fbb93814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:01.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.970+0000 7fbb93814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:01.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.970+0000 7fbb93814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:01.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.970+0000 7fbb93814800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.970+0000 7fbb93814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.970+0000 7fbb93814800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.971+0000 7fbb93814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:01.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.971+0000 7fbb93814800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.971+0000 7fbb93814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:01.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.971+0000 7fbb93814800 20 zone default found 2024-09-12T17:51:01.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.971+0000 7fbb93814800 4 Realm: () 2024-09-12T17:51:01.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.971+0000 7fbb93814800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:51:01.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.971+0000 7fbb93814800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:51:01.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.971+0000 7fbb93814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:01.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.971+0000 7fbb93814800 20 zonegroup default 2024-09-12T17:51:01.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.971+0000 7fbb93814800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.971+0000 7fbb93814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.971+0000 7fbb93814800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.972+0000 7fbb93814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.972+0000 7fbb93814800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.972+0000 7fbb93814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.972+0000 7fbb93814800 20 started sync module instance, tier type = 2024-09-12T17:51:01.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.972+0000 7fbb93814800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:51:01.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.982+0000 7fbb93814800 20 add_watcher() i=0 2024-09-12T17:51:01.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.982+0000 7fbb93814800 20 add_watcher() i=1 2024-09-12T17:51:01.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.982+0000 7fbb93814800 20 add_watcher() i=2 2024-09-12T17:51:01.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.982+0000 7fbb93814800 20 add_watcher() i=3 2024-09-12T17:51:01.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.982+0000 7fbb93814800 20 add_watcher() i=4 2024-09-12T17:51:01.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.982+0000 7fbb93814800 20 add_watcher() i=5 2024-09-12T17:51:01.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.982+0000 7fbb93814800 20 add_watcher() i=6 2024-09-12T17:51:01.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.983+0000 7fbb93814800 20 add_watcher() i=7 2024-09-12T17:51:01.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.983+0000 7fbb93814800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:01.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.984+0000 7fba457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:01.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.984+0000 7fbb93814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:01.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.984+0000 7fbb93814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:01.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.985+0000 7fbb93814800 5 note: GC not initialized 2024-09-12T17:51:01.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.985+0000 7fb9bffff640 20 reqs_thread_entry: start 2024-09-12T17:51:01.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.985+0000 7fbb93814800 20 init_complete bucket index max shards: 11 2024-09-12T17:51:01.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.985+0000 7fbb93814800 20 Filter name: none 2024-09-12T17:51:01.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.985+0000 7fb9bdffb640 20 reqs_thread_entry: start 2024-09-12T17:51:01.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.985+0000 7fbb93814800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T17:51:01.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.985+0000 7fbb93814800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.985+0000 7fbb93814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.985+0000 7fbb93814800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T17:51:01.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.985+0000 7fbb93814800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:51:01.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.985+0000 7fbb93814800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T17:51:01.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.985+0000 7fbb93814800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T17:51:01.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.985+0000 7fbb93814800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.986+0000 7fbb93814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.986+0000 7fbb93814800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T17:51:01.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.986+0000 7fbb93814800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:51:01.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.986+0000 7fbb93814800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T17:51:01.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.987+0000 7fbb93814800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:51:01.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.987+0000 7fbb93814800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:51:01.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.987+0000 7fbb93814800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T17:51:01.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.987+0000 7fba727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464420 cookie 94515438237584 notifier 9297 bl.length()=384 2024-09-12T17:51:01.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.987+0000 7fba727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:51:01.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.987+0000 7fba727fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:51:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.989+0000 7fbb93814800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T17:51:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.989+0000 7fbb93814800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:51:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.989+0000 7fbb93814800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T17:51:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.990+0000 7fba71ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464483 cookie 94515438255200 notifier 9297 bl.length()=225 2024-09-12T17:51:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.990+0000 7fba71ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T17:51:01.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.990+0000 7fba71ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:51:01.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.991+0000 7fbb93814800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T17:51:01.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.992+0000 7fbb93814800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:51:01.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.992+0000 7fbb93814800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T17:51:01.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.992+0000 7fba71ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464378 cookie 94515438252992 notifier 9297 bl.length()=234 2024-09-12T17:51:01.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.992+0000 7fba71ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T17:51:01.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.992+0000 7fba71ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:51:01.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.993+0000 7fba457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:01.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.995+0000 7fbb93814800 20 remove_watcher() i=0 2024-09-12T17:51:01.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.995+0000 7fbb93814800 2 removed watcher, disabling cache 2024-09-12T17:51:01.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.997+0000 7fbb93814800 20 remove_watcher() i=1 2024-09-12T17:51:01.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.998+0000 7fbb93814800 20 remove_watcher() i=2 2024-09-12T17:51:02.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:01.999+0000 7fbb93814800 20 remove_watcher() i=3 2024-09-12T17:51:02.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.000+0000 7fbb93814800 20 remove_watcher() i=4 2024-09-12T17:51:02.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.001+0000 7fbb93814800 20 remove_watcher() i=5 2024-09-12T17:51:02.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.002+0000 7fbb93814800 20 remove_watcher() i=6 2024-09-12T17:51:02.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.003+0000 7fbb93814800 20 remove_watcher() i=7 2024-09-12T17:51:02.014 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T17:51:02.014 INFO:teuthology.orchestra.run.smithi044.stdout: "id": "RGW88888888888888888", 2024-09-12T17:51:02.014 INFO:teuthology.orchestra.run.smithi044.stdout: "tenant": "", 2024-09-12T17:51:02.014 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T17:51:02.014 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T17:51:02.014 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-09-12T17:51:02.014 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:51:02.014 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:51:02.014 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:51:02.014 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:51:02.015 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:51:02.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:51:02.015 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2024-09-12T17:51:02.015 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:51:02.015 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:51:02.015 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:51:02.015 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:51:02.015 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:51:02.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:51:02.015 INFO:teuthology.orchestra.run.smithi044.stdout: "max_users": 1000, 2024-09-12T17:51:02.015 INFO:teuthology.orchestra.run.smithi044.stdout: "max_roles": 1000, 2024-09-12T17:51:02.015 INFO:teuthology.orchestra.run.smithi044.stdout: "max_groups": 1000, 2024-09-12T17:51:02.015 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2024-09-12T17:51:02.016 INFO:teuthology.orchestra.run.smithi044.stdout: "max_access_keys": 4 2024-09-12T17:51:02.016 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T17:51:02.017 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T17:51:02.017 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key EWRSTGGWCDBFUNZQROWK --secret CQX3fxSdiux5WjoovPFq/SwDs2KXz5yKjkbMKq8ff9+M99FEXNSq4w== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T17:51:02.086 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:02.086 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:02.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.121+0000 7f46c312e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.123+0000 7f46c312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.123+0000 7f46c312e800 20 realm 2024-09-12T17:51:02.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.123+0000 7f46c312e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.123+0000 7f46c312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.123+0000 7f46c312e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:02.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.123+0000 7f46c312e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.123+0000 7f46c312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.123+0000 7f46c312e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.124+0000 7f46c312e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:02.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.124+0000 7f46c312e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.124+0000 7f46c312e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:02.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.124+0000 7f46c312e800 20 searching for the correct realm 2024-09-12T17:51:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.126+0000 7f46bed64640 0 -- 172.21.15.44:0/2225379691 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7f46a8003c90 msgr2=0x7f46b801f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:02.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.332+0000 7f46bf565640 0 -- 172.21.15.44:0/2225379691 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f46b406d040 msgr2=0x7f46b4076920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:02.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.338+0000 7f46c312e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:51:02.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.338+0000 7f46c312e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:51:02.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.338+0000 7f46c312e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:02.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.338+0000 7f46c312e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:02.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.338+0000 7f46c312e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:02.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.338+0000 7f46c312e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:02.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.338+0000 7f46c312e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.339+0000 7f46c312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.339+0000 7f46c312e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.339+0000 7f46c312e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:02.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.339+0000 7f46c312e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.339+0000 7f46c312e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:02.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.339+0000 7f46c312e800 20 zone default found 2024-09-12T17:51:02.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.339+0000 7f46c312e800 4 Realm: () 2024-09-12T17:51:02.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.339+0000 7f46c312e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:51:02.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.339+0000 7f46c312e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:51:02.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.339+0000 7f46c312e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:02.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.339+0000 7f46c312e800 20 zonegroup default 2024-09-12T17:51:02.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.339+0000 7f46c312e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.340+0000 7f46c312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.340+0000 7f46c312e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.340+0000 7f46c312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.340+0000 7f46c312e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.340+0000 7f46c312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.340+0000 7f46c312e800 20 started sync module instance, tier type = 2024-09-12T17:51:02.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.340+0000 7f46c312e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:51:02.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.350+0000 7f46c312e800 20 add_watcher() i=0 2024-09-12T17:51:02.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.350+0000 7f46c312e800 20 add_watcher() i=1 2024-09-12T17:51:02.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.350+0000 7f46c312e800 20 add_watcher() i=2 2024-09-12T17:51:02.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.350+0000 7f46c312e800 20 add_watcher() i=3 2024-09-12T17:51:02.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.350+0000 7f46c312e800 20 add_watcher() i=4 2024-09-12T17:51:02.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.350+0000 7f46c312e800 20 add_watcher() i=5 2024-09-12T17:51:02.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.350+0000 7f46c312e800 20 add_watcher() i=6 2024-09-12T17:51:02.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.351+0000 7f46c312e800 20 add_watcher() i=7 2024-09-12T17:51:02.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.351+0000 7f46c312e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:02.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.353+0000 7f45757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:02.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.353+0000 7f46c312e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:02.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.353+0000 7f46c312e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:02.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.353+0000 7f46c312e800 5 note: GC not initialized 2024-09-12T17:51:02.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.353+0000 7f44effff640 20 reqs_thread_entry: start 2024-09-12T17:51:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.353+0000 7f46c312e800 20 init_complete bucket index max shards: 11 2024-09-12T17:51:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 20 Filter name: none 2024-09-12T17:51:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f44edffb640 20 reqs_thread_entry: start 2024-09-12T17:51:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T17:51:02.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T17:51:02.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:51:02.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T17:51:02.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T17:51:02.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:51:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 10 cache get: name=default.rgw.meta+users.keys+EWRSTGGWCDBFUNZQROWK : miss 2024-09-12T17:51:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 10 cache put: name=default.rgw.meta+users.keys+EWRSTGGWCDBFUNZQROWK info.flags=0x0 2024-09-12T17:51:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 10 adding default.rgw.meta+users.keys+EWRSTGGWCDBFUNZQROWK to cache LRU end 2024-09-12T17:51:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.354+0000 7f46c312e800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T17:51:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.355+0000 7f46c312e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.355+0000 7f46c312e800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:51:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.355+0000 7f46c312e800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:51:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.355+0000 7f46c312e800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:51:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.355+0000 7f46c312e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.356+0000 7f46c312e800 10 cache get: name=default.rgw.meta+users.keys+EWRSTGGWCDBFUNZQROWK : hit (negative entry) 2024-09-12T17:51:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.356+0000 7f46c312e800 10 cache get: name=default.rgw.meta+users.keys+EWRSTGGWCDBFUNZQROWK : hit (negative entry) 2024-09-12T17:51:02.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.357+0000 7f46c312e800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:51:02.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.357+0000 7f46c312e800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:51:02.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.357+0000 7f46c312e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T17:51:02.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.358+0000 7f45a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464421 cookie 94124222263664 notifier 8675 bl.length()=681 2024-09-12T17:51:02.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.358+0000 7f45a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:51:02.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.358+0000 7f45a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:51:02.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.359+0000 7f46c312e800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T17:51:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.359+0000 7f46c312e800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:51:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.359+0000 7f46c312e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T17:51:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.359+0000 7f45a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464442 cookie 94124222273904 notifier 8675 bl.length()=189 2024-09-12T17:51:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.359+0000 7f45a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T17:51:02.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.359+0000 7f45a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:51:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.361+0000 7f46c312e800 10 cache put: name=default.rgw.meta+users.keys+EWRSTGGWCDBFUNZQROWK info.flags=0x7 2024-09-12T17:51:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.361+0000 7f46c312e800 10 moving default.rgw.meta+users.keys+EWRSTGGWCDBFUNZQROWK to cache LRU end 2024-09-12T17:51:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.361+0000 7f46c312e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:EWRSTGGWCDBFUNZQROWK, ofs0, ns] 2024-09-12T17:51:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.361+0000 7f45a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464320 cookie 94124222281520 notifier 8675 bl.length()=188 2024-09-12T17:51:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.361+0000 7f45a1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+EWRSTGGWCDBFUNZQROWK info.flags=0x7 2024-09-12T17:51:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.361+0000 7f45a1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+EWRSTGGWCDBFUNZQROWK to cache LRU end 2024-09-12T17:51:02.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.363+0000 7f46c312e800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T17:51:02.365 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T17:51:02.365 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "root1.client.0", 2024-09-12T17:51:02.365 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T17:51:02.365 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "root1+test@test.test", 2024-09-12T17:51:02.366 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2024-09-12T17:51:02.366 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2024-09-12T17:51:02.366 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2024-09-12T17:51:02.366 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2024-09-12T17:51:02.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-12T17:51:02.366 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "root1.client.0", 2024-09-12T17:51:02.366 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "EWRSTGGWCDBFUNZQROWK", 2024-09-12T17:51:02.366 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "CQX3fxSdiux5WjoovPFq/SwDs2KXz5yKjkbMKq8ff9+M99FEXNSq4w==", 2024-09-12T17:51:02.366 INFO:teuthology.orchestra.run.smithi044.stdout: "active": true, 2024-09-12T17:51:02.366 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:51:02.357539Z" 2024-09-12T17:51:02.366 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T17:51:02.366 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-12T17:51:02.366 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2024-09-12T17:51:02.366 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [], 2024-09-12T17:51:02.367 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2024-09-12T17:51:02.367 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2024-09-12T17:51:02.367 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2024-09-12T17:51:02.367 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2024-09-12T17:51:02.367 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2024-09-12T17:51:02.367 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:51:02.367 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:51:02.367 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:51:02.367 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:51:02.367 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:51:02.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:51:02.367 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2024-09-12T17:51:02.367 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:51:02.367 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:51:02.368 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:51:02.368 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:51:02.368 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:51:02.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:51:02.368 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2024-09-12T17:51:02.368 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "root", 2024-09-12T17:51:02.368 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [], 2024-09-12T17:51:02.368 INFO:teuthology.orchestra.run.smithi044.stdout: "account_id": "RGW88888888888888888", 2024-09-12T17:51:02.368 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-12T17:51:02.368 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:51:02.357524Z", 2024-09-12T17:51:02.368 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-09-12T17:51:02.368 INFO:teuthology.orchestra.run.smithi044.stdout: "group_ids": [] 2024-09-12T17:51:02.368 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T17:51:02.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:51:02.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.364+0000 7f45757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:02.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.367+0000 7f46c312e800 20 remove_watcher() i=0 2024-09-12T17:51:02.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.367+0000 7f46c312e800 2 removed watcher, disabling cache 2024-09-12T17:51:02.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.368+0000 7f46c312e800 20 remove_watcher() i=1 2024-09-12T17:51:02.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.369+0000 7f46c312e800 20 remove_watcher() i=2 2024-09-12T17:51:02.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.370+0000 7f46c312e800 20 remove_watcher() i=3 2024-09-12T17:51:02.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.371+0000 7f46c312e800 20 remove_watcher() i=4 2024-09-12T17:51:02.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.372+0000 7f46c312e800 20 remove_watcher() i=5 2024-09-12T17:51:02.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.373+0000 7f46c312e800 20 remove_watcher() i=6 2024-09-12T17:51:02.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.374+0000 7f46c312e800 20 remove_watcher() i=7 2024-09-12T17:51:02.387 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 7394323162 --totp-seed HHNKUZ5TF2AH6JA4JEM3PZIBJLMQNDM5NMSNP72MCOOM2OWQTLMDGSI2KVCT4Y3M --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:51:02.456 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:02.457 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:02.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.491+0000 7f9b04925800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.492+0000 7f9b04925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.492+0000 7f9b04925800 20 realm 2024-09-12T17:51:02.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.492+0000 7f9b04925800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.493+0000 7f9b04925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.493+0000 7f9b04925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:02.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.493+0000 7f9b04925800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.493+0000 7f9b04925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.493+0000 7f9b04925800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.494+0000 7f9b04925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:02.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.494+0000 7f9b04925800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.494+0000 7f9b04925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:02.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.494+0000 7f9b04925800 20 searching for the correct realm 2024-09-12T17:51:02.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.498+0000 7f9affd32640 0 -- 172.21.15.44:0/545484028 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x5654f5b4abc0 msgr2=0x5654f5b4d050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:02.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.501+0000 7f9b00533640 0 -- 172.21.15.44:0/545484028 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f9af403a410 msgr2=0x7f9af403a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:02.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.506+0000 7f9b04925800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:51:02.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.506+0000 7f9b04925800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:51:02.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.506+0000 7f9b04925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:02.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.506+0000 7f9b04925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:02.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.506+0000 7f9b04925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:02.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.506+0000 7f9b04925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:02.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.506+0000 7f9b04925800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.506+0000 7f9b04925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.506+0000 7f9b04925800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.506+0000 7f9b04925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:02.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.506+0000 7f9b04925800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.507+0000 7f9b04925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:02.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.507+0000 7f9b04925800 20 zone default found 2024-09-12T17:51:02.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.507+0000 7f9b04925800 4 Realm: () 2024-09-12T17:51:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.507+0000 7f9b04925800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:51:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.507+0000 7f9b04925800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:51:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.507+0000 7f9b04925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.507+0000 7f9b04925800 20 zonegroup default 2024-09-12T17:51:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.507+0000 7f9b04925800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.507+0000 7f9b04925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.507+0000 7f9b04925800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.507+0000 7f9b04925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.507+0000 7f9b04925800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.507+0000 7f9b04925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.507+0000 7f9b04925800 20 started sync module instance, tier type = 2024-09-12T17:51:02.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.507+0000 7f9b04925800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:51:02.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.518+0000 7f9b04925800 20 add_watcher() i=0 2024-09-12T17:51:02.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.518+0000 7f9b04925800 20 add_watcher() i=1 2024-09-12T17:51:02.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.518+0000 7f9b04925800 20 add_watcher() i=2 2024-09-12T17:51:02.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.518+0000 7f9b04925800 20 add_watcher() i=3 2024-09-12T17:51:02.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.518+0000 7f9b04925800 20 add_watcher() i=4 2024-09-12T17:51:02.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.518+0000 7f9b04925800 20 add_watcher() i=5 2024-09-12T17:51:02.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.518+0000 7f9b04925800 20 add_watcher() i=6 2024-09-12T17:51:02.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.519+0000 7f9b04925800 20 add_watcher() i=7 2024-09-12T17:51:02.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.519+0000 7f9b04925800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:02.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.520+0000 7f99b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:02.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.520+0000 7f9b04925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:02.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.520+0000 7f9b04925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:02.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.521+0000 7f9b04925800 5 note: GC not initialized 2024-09-12T17:51:02.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.521+0000 7f99b57e2640 20 reqs_thread_entry: start 2024-09-12T17:51:02.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.521+0000 7f9b04925800 20 init_complete bucket index max shards: 11 2024-09-12T17:51:02.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.521+0000 7f9b04925800 20 Filter name: none 2024-09-12T17:51:02.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.521+0000 7f9926ffd640 20 reqs_thread_entry: start 2024-09-12T17:51:02.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.521+0000 7f9b04925800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T17:51:02.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.521+0000 7f9b04925800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.522+0000 7f9b04925800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T17:51:02.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.522+0000 7f9b04925800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T17:51:02.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.522+0000 7f9b04925800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:51:02.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.522+0000 7f9b04925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:02.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.524+0000 7f9b04925800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:51:02.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.524+0000 7f9b04925800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:51:02.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.524+0000 7f9b04925800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T17:51:02.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.525+0000 7f99d77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464422 cookie 94922899508208 notifier 9336 bl.length()=695 2024-09-12T17:51:02.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.525+0000 7f99d77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:51:02.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.525+0000 7f99d77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:51:02.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.526+0000 7f99b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:02.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.528+0000 7f9b04925800 20 remove_watcher() i=0 2024-09-12T17:51:02.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.528+0000 7f9b04925800 2 removed watcher, disabling cache 2024-09-12T17:51:02.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.529+0000 7f9b04925800 20 remove_watcher() i=1 2024-09-12T17:51:02.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.530+0000 7f9b04925800 20 remove_watcher() i=2 2024-09-12T17:51:02.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.531+0000 7f9b04925800 20 remove_watcher() i=3 2024-09-12T17:51:02.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.533+0000 7f9b04925800 20 remove_watcher() i=4 2024-09-12T17:51:02.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.535+0000 7f9b04925800 20 remove_watcher() i=5 2024-09-12T17:51:02.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.536+0000 7f9b04925800 20 remove_watcher() i=6 2024-09-12T17:51:02.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.537+0000 7f9b04925800 20 remove_watcher() i=7 2024-09-12T17:51:02.550 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T17:51:02.611 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:02.611 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:02.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.646+0000 7fd97c52c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.648+0000 7fd97c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.648+0000 7fd97c52c800 20 realm 2024-09-12T17:51:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.648+0000 7fd97c52c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.648+0000 7fd97c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.648+0000 7fd97c52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.648+0000 7fd97c52c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.648+0000 7fd97c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.648+0000 7fd97c52c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.649+0000 7fd97c52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.649+0000 7fd97c52c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.650+0000 7fd97c52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.650+0000 7fd97c52c800 20 searching for the correct realm 2024-09-12T17:51:02.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.653+0000 7fd97893f640 0 -- 172.21.15.44:0/3902303156 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x55b4672162f0 msgr2=0x55b467218780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:02.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.657+0000 7fd97793d640 0 -- 172.21.15.44:0/3902303156 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7fd96808f020 msgr2=0x7fd968008740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:02.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.661+0000 7fd97c52c800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:51:02.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.661+0000 7fd97c52c800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:51:02.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.661+0000 7fd97c52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:02.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.661+0000 7fd97c52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:02.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.661+0000 7fd97c52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:02.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.661+0000 7fd97c52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:02.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.661+0000 7fd97c52c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.661+0000 7fd97c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.661+0000 7fd97c52c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.662+0000 7fd97c52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:02.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.662+0000 7fd97c52c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.662+0000 7fd97c52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.662+0000 7fd97c52c800 20 zone default found 2024-09-12T17:51:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.662+0000 7fd97c52c800 4 Realm: () 2024-09-12T17:51:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.662+0000 7fd97c52c800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:51:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.662+0000 7fd97c52c800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:51:02.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.662+0000 7fd97c52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:02.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.662+0000 7fd97c52c800 20 zonegroup default 2024-09-12T17:51:02.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.662+0000 7fd97c52c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.662+0000 7fd97c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.662+0000 7fd97c52c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.663+0000 7fd97c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.663+0000 7fd97c52c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.663+0000 7fd97c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.663+0000 7fd97c52c800 20 started sync module instance, tier type = 2024-09-12T17:51:02.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.663+0000 7fd97c52c800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:51:02.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.674+0000 7fd97c52c800 20 add_watcher() i=0 2024-09-12T17:51:02.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.674+0000 7fd97c52c800 20 add_watcher() i=1 2024-09-12T17:51:02.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.674+0000 7fd97c52c800 20 add_watcher() i=2 2024-09-12T17:51:02.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.674+0000 7fd97c52c800 20 add_watcher() i=3 2024-09-12T17:51:02.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.674+0000 7fd97c52c800 20 add_watcher() i=4 2024-09-12T17:51:02.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.674+0000 7fd97c52c800 20 add_watcher() i=5 2024-09-12T17:51:02.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.674+0000 7fd97c52c800 20 add_watcher() i=6 2024-09-12T17:51:02.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.675+0000 7fd97c52c800 20 add_watcher() i=7 2024-09-12T17:51:02.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.675+0000 7fd97c52c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:02.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.676+0000 7fd82e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:02.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.676+0000 7fd97c52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:02.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.676+0000 7fd97c52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:02.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.676+0000 7fd97c52c800 5 note: GC not initialized 2024-09-12T17:51:02.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.677+0000 7fd82d7e2640 20 reqs_thread_entry: start 2024-09-12T17:51:02.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.677+0000 7fd97c52c800 20 init_complete bucket index max shards: 11 2024-09-12T17:51:02.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.677+0000 7fd97c52c800 20 Filter name: none 2024-09-12T17:51:02.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.677+0000 7fd79effd640 20 reqs_thread_entry: start 2024-09-12T17:51:02.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.677+0000 7fd97c52c800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T17:51:02.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.677+0000 7fd97c52c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.677+0000 7fd97c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.677+0000 7fd97c52c800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T17:51:02.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.677+0000 7fd97c52c800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:51:02.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.677+0000 7fd97c52c800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T17:51:02.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.677+0000 7fd97c52c800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T17:51:02.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.677+0000 7fd97c52c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.678+0000 7fd97c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.678+0000 7fd97c52c800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T17:51:02.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.678+0000 7fd97c52c800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:51:02.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.678+0000 7fd97c52c800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T17:51:02.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.679+0000 7fd97c52c800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:51:02.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.679+0000 7fd97c52c800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:51:02.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.679+0000 7fd97c52c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T17:51:02.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.680+0000 7fd84f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464423 cookie 94233312721296 notifier 8708 bl.length()=384 2024-09-12T17:51:02.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.680+0000 7fd84f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:51:02.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.680+0000 7fd84f7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:51:02.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.681+0000 7fd97c52c800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T17:51:02.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.681+0000 7fd97c52c800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:51:02.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.681+0000 7fd97c52c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T17:51:02.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.682+0000 7fd84f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464484 cookie 94233312776288 notifier 8708 bl.length()=225 2024-09-12T17:51:02.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.682+0000 7fd84f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T17:51:02.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.682+0000 7fd84f7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:51:02.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.684+0000 7fd97c52c800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T17:51:02.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.684+0000 7fd97c52c800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:51:02.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.684+0000 7fd97c52c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T17:51:02.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.684+0000 7fd84effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464379 cookie 94233312773504 notifier 8708 bl.length()=234 2024-09-12T17:51:02.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.684+0000 7fd84effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T17:51:02.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.684+0000 7fd84effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:51:02.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.685+0000 7fd82e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:02.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.687+0000 7fd97c52c800 20 remove_watcher() i=0 2024-09-12T17:51:02.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.687+0000 7fd97c52c800 2 removed watcher, disabling cache 2024-09-12T17:51:02.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.689+0000 7fd97c52c800 20 remove_watcher() i=1 2024-09-12T17:51:02.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.690+0000 7fd97c52c800 20 remove_watcher() i=2 2024-09-12T17:51:02.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.691+0000 7fd97c52c800 20 remove_watcher() i=3 2024-09-12T17:51:02.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.692+0000 7fd97c52c800 20 remove_watcher() i=4 2024-09-12T17:51:02.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.693+0000 7fd97c52c800 20 remove_watcher() i=5 2024-09-12T17:51:02.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.694+0000 7fd97c52c800 20 remove_watcher() i=6 2024-09-12T17:51:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.695+0000 7fd97c52c800 20 remove_watcher() i=7 2024-09-12T17:51:02.706 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T17:51:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "id": "RGW99999999999999999", 2024-09-12T17:51:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "tenant": "", 2024-09-12T17:51:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T17:51:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T17:51:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-09-12T17:51:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:51:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:51:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:51:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:51:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:51:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:51:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2024-09-12T17:51:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:51:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:51:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:51:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:51:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:51:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:51:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "max_users": 1000, 2024-09-12T17:51:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "max_roles": 1000, 2024-09-12T17:51:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "max_groups": 1000, 2024-09-12T17:51:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2024-09-12T17:51:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "max_access_keys": 4 2024-09-12T17:51:02.707 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T17:51:02.708 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T17:51:02.709 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key UHDXZVJBQTTYKTDMJJRN --secret 9fho1a9bRnmuEKxVlQ3WdjNoE5OYYZVGx+57kLDCzYlnikf6Wad29A== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T17:51:02.778 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:02.778 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:02.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.813+0000 7f33111af800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.815+0000 7f33111af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.815+0000 7f33111af800 20 realm 2024-09-12T17:51:02.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.815+0000 7f33111af800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.815+0000 7f33111af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.815+0000 7f33111af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:02.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.815+0000 7f33111af800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.815+0000 7f33111af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.815+0000 7f33111af800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.816+0000 7f33111af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:02.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.816+0000 7f33111af800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.816+0000 7f33111af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:02.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.816+0000 7f33111af800 20 searching for the correct realm 2024-09-12T17:51:02.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.820+0000 7f330e49f640 0 -- 172.21.15.44:0/1426745790 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x558ee5f78e00 msgr2=0x558ee5f7b2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:02.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.823+0000 7f330eca0640 0 -- 172.21.15.44:0/1426745790 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f33040d4390 msgr2=0x7f33040a40b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:02.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.828+0000 7f33111af800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:51:02.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.828+0000 7f33111af800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:51:02.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.828+0000 7f33111af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:02.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.828+0000 7f33111af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:02.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.828+0000 7f33111af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:02.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.828+0000 7f33111af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:02.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.828+0000 7f33111af800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.828+0000 7f33111af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.828+0000 7f33111af800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.829+0000 7f33111af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.829+0000 7f33111af800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.829+0000 7f33111af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.829+0000 7f33111af800 20 zone default found 2024-09-12T17:51:02.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.829+0000 7f33111af800 4 Realm: () 2024-09-12T17:51:02.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.829+0000 7f33111af800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:51:02.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.829+0000 7f33111af800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:51:02.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.829+0000 7f33111af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:02.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.829+0000 7f33111af800 20 zonegroup default 2024-09-12T17:51:02.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.829+0000 7f33111af800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.830+0000 7f33111af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.830+0000 7f33111af800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.830+0000 7f33111af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.830+0000 7f33111af800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.830+0000 7f33111af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.830+0000 7f33111af800 20 started sync module instance, tier type = 2024-09-12T17:51:02.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.830+0000 7f33111af800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:51:02.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.840+0000 7f33111af800 20 add_watcher() i=0 2024-09-12T17:51:02.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.840+0000 7f33111af800 20 add_watcher() i=1 2024-09-12T17:51:02.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.840+0000 7f33111af800 20 add_watcher() i=2 2024-09-12T17:51:02.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.840+0000 7f33111af800 20 add_watcher() i=3 2024-09-12T17:51:02.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.840+0000 7f33111af800 20 add_watcher() i=4 2024-09-12T17:51:02.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.840+0000 7f33111af800 20 add_watcher() i=5 2024-09-12T17:51:02.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.840+0000 7f33111af800 20 add_watcher() i=6 2024-09-12T17:51:02.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.841+0000 7f33111af800 20 add_watcher() i=7 2024-09-12T17:51:02.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.841+0000 7f33111af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:02.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.842+0000 7f31c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:02.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.842+0000 7f33111af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:02.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.842+0000 7f33111af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.842+0000 7f33111af800 5 note: GC not initialized 2024-09-12T17:51:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.843+0000 7f313ffff640 20 reqs_thread_entry: start 2024-09-12T17:51:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.843+0000 7f33111af800 20 init_complete bucket index max shards: 11 2024-09-12T17:51:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.843+0000 7f33111af800 20 Filter name: none 2024-09-12T17:51:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.843+0000 7f313dffb640 20 reqs_thread_entry: start 2024-09-12T17:51:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.843+0000 7f33111af800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T17:51:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.843+0000 7f33111af800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.843+0000 7f33111af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.843+0000 7f33111af800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T17:51:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.843+0000 7f33111af800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:51:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.843+0000 7f33111af800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T17:51:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.843+0000 7f33111af800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.843+0000 7f33111af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.843+0000 7f33111af800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T17:51:02.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.843+0000 7f33111af800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:51:02.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.843+0000 7f33111af800 10 cache get: name=default.rgw.meta+users.keys+UHDXZVJBQTTYKTDMJJRN : miss 2024-09-12T17:51:02.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.843+0000 7f33111af800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.844+0000 7f33111af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.844+0000 7f33111af800 10 cache put: name=default.rgw.meta+users.keys+UHDXZVJBQTTYKTDMJJRN info.flags=0x0 2024-09-12T17:51:02.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.844+0000 7f33111af800 10 adding default.rgw.meta+users.keys+UHDXZVJBQTTYKTDMJJRN to cache LRU end 2024-09-12T17:51:02.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.844+0000 7f33111af800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T17:51:02.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.844+0000 7f33111af800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.844+0000 7f33111af800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:51:02.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.844+0000 7f33111af800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:51:02.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.844+0000 7f33111af800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:51:02.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.844+0000 7f33111af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:02.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.844+0000 7f33111af800 10 cache get: name=default.rgw.meta+users.keys+UHDXZVJBQTTYKTDMJJRN : hit (negative entry) 2024-09-12T17:51:02.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.844+0000 7f33111af800 10 cache get: name=default.rgw.meta+users.keys+UHDXZVJBQTTYKTDMJJRN : hit (negative entry) 2024-09-12T17:51:02.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.846+0000 7f33111af800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:51:02.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.846+0000 7f33111af800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:51:02.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.846+0000 7f33111af800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T17:51:02.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.846+0000 7f31f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464424 cookie 94072231929152 notifier 8723 bl.length()=681 2024-09-12T17:51:02.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.846+0000 7f31f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:51:02.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.846+0000 7f31f27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:51:02.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.848+0000 7f33111af800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T17:51:02.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.848+0000 7f33111af800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:51:02.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.848+0000 7f33111af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T17:51:02.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.848+0000 7f31f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464443 cookie 94072231948128 notifier 8723 bl.length()=189 2024-09-12T17:51:02.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.848+0000 7f31f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T17:51:02.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.848+0000 7f31f27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:51:02.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.850+0000 7f33111af800 10 cache put: name=default.rgw.meta+users.keys+UHDXZVJBQTTYKTDMJJRN info.flags=0x7 2024-09-12T17:51:02.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.850+0000 7f33111af800 10 moving default.rgw.meta+users.keys+UHDXZVJBQTTYKTDMJJRN to cache LRU end 2024-09-12T17:51:02.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.850+0000 7f33111af800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:UHDXZVJBQTTYKTDMJJRN, ofs0, ns] 2024-09-12T17:51:02.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.850+0000 7f31f1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464425 cookie 94072231929152 notifier 8723 bl.length()=188 2024-09-12T17:51:02.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.850+0000 7f31f1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+UHDXZVJBQTTYKTDMJJRN info.flags=0x7 2024-09-12T17:51:02.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.850+0000 7f31f1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+UHDXZVJBQTTYKTDMJJRN to cache LRU end 2024-09-12T17:51:02.854 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T17:51:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "user_id": "root2.client.0", 2024-09-12T17:51:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T17:51:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "email": "root2+test@test.test", 2024-09-12T17:51:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "suspended": 0, 2024-09-12T17:51:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "max_buckets": 1000, 2024-09-12T17:51:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "subusers": [], 2024-09-12T17:51:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "keys": [ 2024-09-12T17:51:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-12T17:51:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "user": "root2.client.0", 2024-09-12T17:51:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "access_key": "UHDXZVJBQTTYKTDMJJRN", 2024-09-12T17:51:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "secret_key": "9fho1a9bRnmuEKxVlQ3WdjNoE5OYYZVGx+57kLDCzYlnikf6Wad29A==", 2024-09-12T17:51:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "active": true, 2024-09-12T17:51:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:51:02.846347Z" 2024-09-12T17:51:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T17:51:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-12T17:51:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "swift_keys": [], 2024-09-12T17:51:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": [], 2024-09-12T17:51:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "op_mask": "read, write, delete", 2024-09-12T17:51:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "default_placement": "", 2024-09-12T17:51:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "default_storage_class": "", 2024-09-12T17:51:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "placement_tags": [], 2024-09-12T17:51:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "bucket_quota": { 2024-09-12T17:51:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:51:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:51:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:51:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:51:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:51:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:51:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "user_quota": { 2024-09-12T17:51:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": false, 2024-09-12T17:51:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "check_on_raw": false, 2024-09-12T17:51:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size": -1, 2024-09-12T17:51:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_kb": 0, 2024-09-12T17:51:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "max_objects": -1 2024-09-12T17:51:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T17:51:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: "temp_url_keys": [], 2024-09-12T17:51:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "root", 2024-09-12T17:51:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: "mfa_ids": [], 2024-09-12T17:51:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: "account_id": "RGW99999999999999999", 2024-09-12T17:51:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-12T17:51:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: "create_date": "2024-09-12T17:51:02.846335Z", 2024-09-12T17:51:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-09-12T17:51:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: "group_ids": [] 2024-09-12T17:51:02.857 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T17:51:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:51:02.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.852+0000 7f33111af800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T17:51:02.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.853+0000 7f31c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:02.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.855+0000 7f33111af800 20 remove_watcher() i=0 2024-09-12T17:51:02.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.855+0000 7f33111af800 2 removed watcher, disabling cache 2024-09-12T17:51:02.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.856+0000 7f33111af800 20 remove_watcher() i=1 2024-09-12T17:51:02.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.857+0000 7f33111af800 20 remove_watcher() i=2 2024-09-12T17:51:02.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.859+0000 7f33111af800 20 remove_watcher() i=3 2024-09-12T17:51:02.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.860+0000 7f33111af800 20 remove_watcher() i=4 2024-09-12T17:51:02.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.860+0000 7f33111af800 20 remove_watcher() i=5 2024-09-12T17:51:02.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.862+0000 7f33111af800 20 remove_watcher() i=6 2024-09-12T17:51:02.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.863+0000 7f33111af800 20 remove_watcher() i=7 2024-09-12T17:51:02.875 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 1905391531 --totp-seed LWITEBWDKH536YPFHLFKY4XFQIEBOTNLAHBPHZOJVJHAX2MDIKQGMXBR47TNAPT4 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:51:02.943 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:02.943 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:02.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.977+0000 7fc014f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.978+0000 7fc014f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.978+0000 7fc014f2d800 20 realm 2024-09-12T17:51:02.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.978+0000 7fc014f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.978+0000 7fc014f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.978+0000 7fc014f2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:02.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.978+0000 7fc014f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.979+0000 7fc014f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.979+0000 7fc014f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.980+0000 7fc014f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:02.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.980+0000 7fc014f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.980+0000 7fc014f2d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:02.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.980+0000 7fc014f2d800 20 searching for the correct realm 2024-09-12T17:51:02.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.984+0000 7fc010475640 0 -- 172.21.15.44:0/1152301030 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55632eb7cca0 msgr2=0x55632eb7f160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:02.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.988+0000 7fc010c76640 0 -- 172.21.15.44:0/1152301030 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fc0040383c0 msgr2=0x7fc004038800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:02.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.992+0000 7fc014f2d800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T17:51:02.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.992+0000 7fc014f2d800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T17:51:02.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.992+0000 7fc014f2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:02.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.992+0000 7fc014f2d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:02.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.992+0000 7fc014f2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:02.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.992+0000 7fc014f2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:02.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.992+0000 7fc014f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.993+0000 7fc014f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.993+0000 7fc014f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.993+0000 7fc014f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:02.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.993+0000 7fc014f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.993+0000 7fc014f2d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:02.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.993+0000 7fc014f2d800 20 zone default found 2024-09-12T17:51:02.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.993+0000 7fc014f2d800 4 Realm: () 2024-09-12T17:51:02.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.993+0000 7fc014f2d800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T17:51:02.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.993+0000 7fc014f2d800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T17:51:02.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.993+0000 7fc014f2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:02.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.993+0000 7fc014f2d800 20 zonegroup default 2024-09-12T17:51:02.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.993+0000 7fc014f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.994+0000 7fc014f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.994+0000 7fc014f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.994+0000 7fc014f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.994+0000 7fc014f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:51:02.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.994+0000 7fc014f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:02.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.994+0000 7fc014f2d800 20 started sync module instance, tier type = 2024-09-12T17:51:02.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:02.994+0000 7fc014f2d800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T17:51:03.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.003+0000 7fc014f2d800 20 add_watcher() i=0 2024-09-12T17:51:03.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.003+0000 7fc014f2d800 20 add_watcher() i=1 2024-09-12T17:51:03.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.003+0000 7fc014f2d800 20 add_watcher() i=2 2024-09-12T17:51:03.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.003+0000 7fc014f2d800 20 add_watcher() i=3 2024-09-12T17:51:03.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.003+0000 7fc014f2d800 20 add_watcher() i=4 2024-09-12T17:51:03.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.003+0000 7fc014f2d800 20 add_watcher() i=5 2024-09-12T17:51:03.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.003+0000 7fc014f2d800 20 add_watcher() i=6 2024-09-12T17:51:03.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.004+0000 7fc014f2d800 20 add_watcher() i=7 2024-09-12T17:51:03.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.004+0000 7fc014f2d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:03.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.006+0000 7fbec6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:03.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.006+0000 7fc014f2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:03.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.006+0000 7fc014f2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:03.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.006+0000 7fc014f2d800 5 note: GC not initialized 2024-09-12T17:51:03.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.006+0000 7fbec5fe3640 20 reqs_thread_entry: start 2024-09-12T17:51:03.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.007+0000 7fc014f2d800 20 init_complete bucket index max shards: 11 2024-09-12T17:51:03.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.007+0000 7fc014f2d800 20 Filter name: none 2024-09-12T17:51:03.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.007+0000 7fbe377fe640 20 reqs_thread_entry: start 2024-09-12T17:51:03.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.007+0000 7fc014f2d800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T17:51:03.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.007+0000 7fc014f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:51:03.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.008+0000 7fc014f2d800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T17:51:03.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.008+0000 7fc014f2d800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T17:51:03.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.008+0000 7fc014f2d800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:51:03.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.008+0000 7fc014f2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:03.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.010+0000 7fc014f2d800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:51:03.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.010+0000 7fc014f2d800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:51:03.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.010+0000 7fc014f2d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T17:51:03.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.011+0000 7fbee7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464426 cookie 93884473925440 notifier 9396 bl.length()=695 2024-09-12T17:51:03.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.011+0000 7fbee7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:51:03.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.011+0000 7fbee7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:51:03.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.012+0000 7fbec6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.016+0000 7fc014f2d800 20 remove_watcher() i=0 2024-09-12T17:51:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.016+0000 7fc014f2d800 2 removed watcher, disabling cache 2024-09-12T17:51:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.017+0000 7fc014f2d800 20 remove_watcher() i=1 2024-09-12T17:51:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.018+0000 7fc014f2d800 20 remove_watcher() i=2 2024-09-12T17:51:03.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.019+0000 7fc014f2d800 20 remove_watcher() i=3 2024-09-12T17:51:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.020+0000 7fc014f2d800 20 remove_watcher() i=4 2024-09-12T17:51:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.021+0000 7fc014f2d800 20 remove_watcher() i=5 2024-09-12T17:51:03.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.022+0000 7fc014f2d800 20 remove_watcher() i=6 2024-09-12T17:51:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T17:51:03.023+0000 7fc014f2d800 20 remove_watcher() i=7 2024-09-12T17:51:03.036 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T17:51:03.036 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:51:03.037 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T17:51:03.066 INFO:tasks.s3tests:Configuring boto... 2024-09-12T17:51:03.066 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T17:51:03.066 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T17:51:03.137 DEBUG:teuthology.orchestra.run.smithi044:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T17:51:03.321 INFO:teuthology.orchestra.run.smithi044.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T17:51:03.509 INFO:teuthology.orchestra.run.smithi044.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T17:51:03.789 INFO:teuthology.orchestra.run.smithi044.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:52:45.905 INFO:teuthology.orchestra.run.smithi044.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T17:52:47.376 INFO:teuthology.orchestra.run.smithi044.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=b8810240591868494949a486008e4ec1cab49cac96c5f9aa4747d7a36944b4c0,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T17:52:47.376 INFO:teuthology.orchestra.run.smithi044.stdout:py run-test-pre: PYTHONHASHSEED='450813844' 2024-09-12T17:52:47.376 INFO:teuthology.orchestra.run.smithi044.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T17:52:47.515 INFO:teuthology.orchestra.run.smithi044.stdout:============================= test session starts ============================== 2024-09-12T17:52:47.515 INFO:teuthology.orchestra.run.smithi044.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T17:52:47.515 INFO:teuthology.orchestra.run.smithi044.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:52:47.516 INFO:teuthology.orchestra.run.smithi044.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T17:52:47.516 INFO:teuthology.orchestra.run.smithi044.stdout:configfile: pytest.ini 2024-09-12T17:52:49.359 INFO:teuthology.orchestra.run.smithi044.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T17:52:49.359 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T17:52:49.498 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T17:52:49.627 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T17:52:49.799 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T17:52:49.971 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T17:52:50.094 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T17:52:50.217 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T17:52:50.591 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T17:52:50.715 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T17:52:50.803 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T17:52:50.890 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T17:52:51.018 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T17:52:51.149 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T17:52:51.269 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T17:52:51.394 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T17:52:51.480 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T17:52:51.569 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T17:52:51.614 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T17:52:51.660 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T17:52:51.706 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T17:52:51.752 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T17:52:51.798 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T17:52:51.843 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T17:52:51.888 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T17:52:51.934 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T17:52:51.981 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T17:52:52.027 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T17:52:52.072 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T17:52:52.120 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T17:52:52.170 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T17:52:52.213 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T17:52:52.261 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T17:52:52.308 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T17:52:52.355 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T17:52:52.403 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T17:52:52.450 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T17:52:52.497 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T17:52:52.544 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T17:52:52.591 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T17:52:52.638 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:52:52.685 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T17:52:52.731 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T17:52:52.778 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:52:52.825 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:52:52.872 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T17:52:52.919 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T17:52:52.967 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T17:52:53.013 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T17:52:53.060 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T17:52:53.107 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T17:52:53.154 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T17:52:53.202 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T17:52:53.248 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T17:52:53.296 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T17:52:53.579 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T17:52:54.100 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T17:52:55.100 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T17:52:55.931 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T17:52:57.506 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T17:52:57.947 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T17:52:58.539 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T17:52:58.765 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T17:52:58.850 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T17:52:59.008 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T17:52:59.167 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T17:52:59.350 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T17:52:59.490 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T17:52:59.576 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T17:52:59.577 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T17:52:59.578 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T17:52:59.579 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T17:52:59.580 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T17:52:59.580 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T17:52:59.582 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T17:52:59.582 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T17:52:59.583 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:52:59.584 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:52:59.586 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:52:59.586 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:52:59.586 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T17:52:59.587 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:52:59.588 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:52:59.589 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:52:59.590 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:52:59.591 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:52:59.591 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:52:59.592 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:52:59.593 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T17:52:59.594 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T17:52:59.595 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T17:52:59.596 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T17:52:59.596 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T17:52:59.597 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T17:52:59.598 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T17:52:59.599 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T17:52:59.688 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T17:52:59.699 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T17:52:59.924 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T17:53:03.784 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T17:53:03.917 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T17:53:04.107 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T17:53:04.294 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T17:53:04.479 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T17:53:04.665 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T17:53:04.793 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T17:53:05.013 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T17:53:05.187 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T17:53:05.361 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T17:53:05.489 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T17:53:05.609 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T17:53:05.730 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T17:53:05.770 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T17:53:05.896 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T17:53:06.077 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T17:53:06.290 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T17:53:06.417 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T17:53:06.549 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T17:53:06.677 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T17:53:06.803 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T17:53:06.933 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T17:53:07.053 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T17:53:07.174 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T17:53:07.214 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T17:53:07.288 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T17:53:07.327 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T17:53:07.366 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T17:53:07.405 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T17:53:07.516 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T17:53:07.556 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:53:07.603 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T17:53:07.746 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T17:53:07.882 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T17:53:07.957 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:53:08.093 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T17:53:08.232 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:53:08.463 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T17:53:08.557 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T17:53:08.696 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T17:53:08.835 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T17:53:09.165 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T17:53:09.324 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T17:53:09.540 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T17:53:09.702 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:53:10.023 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:53:10.241 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:53:10.536 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:53:10.743 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:53:11.025 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:53:11.247 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T17:53:11.527 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T17:53:11.670 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T17:53:12.393 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T17:53:12.844 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T17:53:13.446 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T17:53:14.891 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T17:53:16.892 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T17:53:17.936 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T17:53:18.850 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T17:53:19.457 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T17:53:19.790 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T17:53:20.574 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T17:53:21.080 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T17:53:21.818 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T17:53:22.278 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T17:53:23.332 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T17:53:23.946 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T17:53:25.076 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T17:53:26.176 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T17:53:26.843 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T17:53:27.438 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T17:53:27.905 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T17:53:29.316 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T17:53:30.298 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T17:53:31.446 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T17:53:32.523 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T17:53:33.467 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T17:53:34.416 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T17:53:35.116 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T17:53:35.585 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T17:53:36.148 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T17:53:37.390 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T17:53:39.102 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T17:53:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T17:53:40.741 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T17:53:41.771 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T17:53:42.626 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T17:53:43.468 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T17:53:44.392 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T17:53:45.277 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T17:53:46.107 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T17:53:46.671 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T17:53:47.121 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T17:53:47.573 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T17:53:48.078 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T17:53:48.843 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T17:53:49.607 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T17:53:50.376 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T17:53:51.148 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T17:53:51.915 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T17:53:52.723 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T17:53:53.485 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T17:53:54.243 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T17:53:54.995 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T17:53:55.738 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T17:53:56.542 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T17:53:57.295 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T17:53:57.671 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T17:53:58.048 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T17:53:58.380 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T17:53:58.754 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T17:53:58.949 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T17:53:59.258 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T17:53:59.498 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T17:53:59.738 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T17:53:59.972 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T17:54:00.173 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T17:54:00.416 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T17:54:00.620 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T17:54:00.824 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T17:54:01.082 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T17:54:01.336 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T17:54:01.518 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T17:54:01.734 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T17:54:01.939 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T17:54:02.142 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T17:54:02.397 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T17:54:02.654 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T17:54:02.893 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T17:54:03.102 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T17:54:03.305 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T17:54:03.505 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T17:54:03.707 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T17:54:03.908 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T17:54:04.114 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T17:54:04.356 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T17:54:04.558 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T17:54:04.764 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T17:54:04.969 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T17:54:05.170 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T17:54:05.367 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T17:54:05.564 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T17:54:05.798 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T17:54:06.000 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T17:54:06.201 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T17:54:15.010 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T17:54:15.207 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T17:54:15.402 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T17:54:15.598 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T17:54:15.795 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T17:54:16.029 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T17:54:16.228 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T17:54:16.423 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T17:54:16.622 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T17:54:16.817 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T17:54:17.014 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T17:54:17.210 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T17:54:17.445 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T17:54:17.649 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T17:54:17.858 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T17:54:18.067 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T17:54:18.272 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T17:54:18.488 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T17:54:18.692 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T17:54:18.938 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:54:19.146 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:54:19.349 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:54:19.552 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:54:19.799 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T17:54:20.045 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T17:54:20.285 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T17:54:20.485 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T17:54:20.688 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T17:54:20.892 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T17:54:20.934 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T17:54:21.113 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T17:54:21.703 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T17:54:22.247 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T17:54:22.512 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T17:54:22.717 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T17:54:22.921 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T17:54:23.125 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T17:54:23.409 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T17:54:23.656 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T17:54:23.859 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T17:54:24.061 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T17:54:24.263 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T17:54:24.466 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T17:54:24.668 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T17:54:24.908 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T17:54:25.282 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T17:54:25.742 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T17:54:25.877 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T17:54:26.012 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T17:54:26.136 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T17:54:26.267 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T17:54:26.348 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T17:54:26.389 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T17:54:26.431 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T17:54:26.618 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T17:54:26.827 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T17:54:26.870 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T17:54:27.047 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T17:54:27.171 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T17:54:27.300 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T17:54:27.465 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T17:54:27.827 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T17:54:28.154 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T17:54:28.481 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T17:54:37.030 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T17:54:45.805 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T17:54:45.986 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T17:54:46.163 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T17:54:46.345 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T17:54:46.525 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T17:54:46.759 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T17:54:46.938 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T17:54:47.116 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T17:54:47.352 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T17:54:47.542 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T17:54:47.765 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T17:54:47.982 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T17:54:48.166 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T17:54:48.386 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T17:54:48.524 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T17:54:48.695 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T17:54:48.868 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T17:54:49.109 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T17:54:49.293 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T17:54:49.468 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T17:54:49.644 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T17:54:49.824 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T17:54:50.041 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T17:54:50.169 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T17:54:50.300 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T17:54:50.425 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T17:54:50.590 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T17:54:50.716 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T17:54:50.844 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T17:54:51.022 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T17:54:51.148 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T17:54:51.278 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T17:54:51.404 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T17:54:51.535 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T17:54:51.748 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T17:54:51.911 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T17:54:52.039 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T17:54:52.167 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T17:54:52.294 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T17:54:52.422 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T17:54:52.548 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T17:54:52.678 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T17:54:52.879 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T17:54:53.007 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T17:54:53.263 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T17:54:53.486 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T17:54:53.666 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T17:54:53.889 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T17:54:54.112 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T17:54:55.314 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T17:54:55.546 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T17:54:55.775 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T17:54:56.088 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T17:54:56.401 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T17:54:56.679 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T17:54:56.899 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T17:54:57.173 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T17:54:57.492 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T17:54:57.712 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T17:54:58.022 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T17:54:58.200 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T17:54:58.337 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T17:54:58.439 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T17:54:58.581 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T17:54:58.709 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T17:54:58.750 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T17:54:58.965 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T17:54:59.146 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T17:54:59.364 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T17:55:01.809 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T17:55:02.000 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T17:55:02.186 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T17:55:02.364 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T17:55:02.543 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T17:55:02.680 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T17:55:02.864 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T17:55:03.081 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T17:55:03.262 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T17:55:03.437 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T17:55:03.617 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T17:55:03.796 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T17:55:03.980 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T17:55:04.165 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T17:55:04.343 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T17:55:04.520 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T17:55:04.696 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T17:55:04.910 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T17:55:04.954 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T17:55:04.996 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T17:55:05.037 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T17:55:05.161 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T17:55:05.284 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T17:55:05.408 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T17:55:05.532 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T17:55:05.701 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T17:55:05.743 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T17:55:05.785 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T17:55:05.908 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T17:55:05.988 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T17:55:06.029 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T17:55:06.070 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T17:55:06.112 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T17:55:06.248 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T17:55:06.417 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T17:55:06.548 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T17:55:06.714 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T17:55:06.880 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T17:55:07.047 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T17:55:07.213 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T17:55:07.428 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T17:55:07.593 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T17:55:07.758 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T17:55:07.977 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T17:55:08.195 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T17:55:08.463 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T17:55:08.684 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T17:55:08.905 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T17:55:09.214 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T17:55:09.481 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T17:55:09.709 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T17:55:09.903 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T17:55:10.034 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T17:55:10.304 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T17:55:10.573 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T17:55:10.843 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T17:55:11.113 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T17:55:11.422 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T17:55:11.680 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T17:55:11.888 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T17:55:12.094 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T17:55:12.345 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T17:55:12.550 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T17:55:12.726 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T17:55:12.946 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T17:55:13.169 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T17:55:13.346 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T17:55:13.482 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T17:55:13.751 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T17:55:14.094 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T17:55:14.479 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T17:55:14.823 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T17:55:15.176 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T17:55:15.519 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T17:55:15.863 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T17:55:16.425 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T17:55:16.770 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T17:55:17.119 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T17:55:17.439 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T17:55:17.754 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T17:55:18.068 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T17:55:18.603 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T17:55:19.302 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T17:55:19.340 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T17:55:19.382 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T17:55:19.423 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T17:55:19.592 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T17:55:19.727 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T17:55:19.850 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T17:55:19.976 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T17:55:20.231 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T17:55:21.039 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T17:55:21.259 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T17:55:21.500 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T17:55:21.911 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T17:55:22.179 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T17:55:22.456 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T17:55:22.717 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T17:55:22.949 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T17:55:23.351 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T17:55:23.622 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T17:55:23.878 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T17:55:24.163 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T17:55:24.674 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T17:55:25.110 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T17:55:25.241 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T17:55:25.376 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T17:55:26.322 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T17:55:26.612 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T17:55:27.956 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T17:55:28.098 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T17:55:28.308 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T17:55:28.828 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T17:55:29.068 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T17:55:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T17:55:30.778 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T17:55:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T17:55:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T17:55:37.701 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T17:55:38.634 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T17:55:40.305 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T17:55:40.544 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T17:55:41.019 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T17:55:41.538 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T17:55:41.851 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T17:55:42.072 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T17:55:42.503 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T17:55:42.751 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T17:55:42.945 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T17:55:43.139 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T17:55:56.995 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T17:55:58.795 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T17:55:59.066 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T17:55:59.198 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T17:55:59.425 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T17:56:02.642 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T17:56:05.804 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T17:56:08.966 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T17:56:09.158 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T17:56:09.344 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T17:56:09.568 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T17:56:09.752 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T17:56:09.933 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T17:56:10.117 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T17:56:10.345 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T17:56:10.649 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T17:56:10.970 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T17:56:11.406 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T17:56:11.890 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T17:56:12.271 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T17:56:12.716 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T17:56:13.040 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T17:56:13.505 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T17:56:14.136 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T17:56:14.560 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T17:56:14.879 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T17:56:15.288 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T17:56:15.511 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T17:56:19.825 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T17:56:20.087 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T17:56:20.306 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T17:56:20.530 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T17:56:20.751 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T17:56:21.082 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T17:56:27.366 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T17:56:27.690 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T17:56:28.028 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T17:56:28.435 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T17:56:28.875 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T17:56:31.385 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T17:56:31.747 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T17:56:35.035 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T17:56:47.574 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T17:56:49.185 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T17:56:50.077 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T17:56:51.125 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T17:56:51.502 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T17:56:51.889 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T17:56:52.163 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T17:56:52.569 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T17:56:52.885 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T17:56:53.324 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T17:56:53.465 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T17:56:53.647 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T17:56:53.827 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T17:56:53.955 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T17:56:54.086 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T17:56:54.304 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T17:56:54.444 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T17:56:54.575 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T17:56:54.772 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T17:56:55.114 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T17:56:55.254 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T17:56:55.391 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T17:56:55.531 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T17:56:55.668 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T17:56:55.889 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T17:56:56.115 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T17:56:56.355 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T17:56:56.576 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T17:56:56.765 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T17:56:56.987 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T17:56:57.209 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T17:56:57.380 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T17:56:57.552 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T17:56:57.723 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T17:56:57.934 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T17:56:59.328 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T17:57:00.612 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T17:57:01.417 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T17:57:01.605 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T17:58:02.141 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T17:59:03.249 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T17:59:03.446 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T17:59:03.711 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T17:59:03.885 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T17:59:04.018 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T17:59:05.176 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T17:59:05.846 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T17:59:06.506 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T17:59:06.687 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T17:59:06.908 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T17:59:07.173 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T17:59:07.368 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T17:59:07.592 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T17:59:07.816 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T17:59:08.006 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T17:59:08.197 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T17:59:08.396 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T17:59:08.639 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T17:59:08.829 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T17:59:09.015 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T17:59:09.394 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T17:59:09.772 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T17:59:10.111 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T17:59:10.378 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T17:59:10.732 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T17:59:11.039 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T17:59:11.342 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T17:59:11.648 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T17:59:11.962 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T17:59:12.314 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T17:59:12.673 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T17:59:12.934 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T17:59:13.158 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T17:59:13.422 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T17:59:13.697 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T17:59:14.008 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T17:59:14.327 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T17:59:14.930 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T17:59:16.978 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T17:59:17.250 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T17:59:17.601 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T17:59:17.911 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T17:59:18.434 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T17:59:18.867 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T17:59:19.149 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T17:59:19.571 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T17:59:19.702 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T17:59:19.832 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T17:59:19.962 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T17:59:20.099 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T17:59:20.332 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T17:59:20.509 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T17:59:20.905 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T17:59:21.082 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T17:59:21.255 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T17:59:21.424 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T17:59:21.594 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T17:59:21.766 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T17:59:21.980 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T17:59:22.152 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T17:59:22.326 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T17:59:22.545 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T17:59:22.713 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T17:59:22.913 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T17:59:23.133 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T17:59:23.414 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T17:59:23.613 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T17:59:23.778 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T17:59:23.996 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T17:59:24.253 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T17:59:24.460 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T17:59:24.717 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T17:59:24.920 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T17:59:25.125 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T17:59:25.337 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T17:59:25.641 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T17:59:25.907 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T17:59:26.156 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T17:59:26.353 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T17:59:26.578 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T17:59:26.842 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T17:59:27.122 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T17:59:27.341 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T17:59:27.592 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T17:59:27.940 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T17:59:28.105 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T17:59:28.285 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T17:59:28.447 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T17:59:38.579 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T17:59:38.886 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T17:59:48.117 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T17:59:48.398 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T17:59:48.673 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T17:59:48.804 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T17:59:48.982 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T17:59:49.159 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T17:59:49.339 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T17:59:49.516 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T17:59:49.732 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T17:59:49.868 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T17:59:50.044 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T17:59:50.273 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T17:59:50.451 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T17:59:50.760 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T17:59:51.025 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T17:59:51.203 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T17:59:51.347 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T17:59:51.680 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T17:59:52.612 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T17:59:52.747 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T17:59:52.924 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T17:59:53.108 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T17:59:53.333 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T17:59:53.595 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T17:59:53.833 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T17:59:54.294 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T17:59:54.755 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T17:59:54.974 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T17:59:55.792 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T17:59:56.608 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T17:59:56.699 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T17:59:56.830 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T17:59:57.550 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T17:59:58.277 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T17:59:58.671 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T17:59:58.916 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T17:59:59.195 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T17:59:59.416 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T17:59:59.500 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T17:59:59.799 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T18:00:00.128 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T18:00:01.458 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T18:00:01.740 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T18:00:01.993 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T18:00:02.210 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T18:00:02.393 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T18:00:02.648 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T18:00:02.900 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T18:00:03.024 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T18:00:03.295 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T18:00:03.565 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T18:00:03.878 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T18:00:04.135 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T18:00:04.401 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T18:00:04.436 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T18:00:04.761 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T18:00:05.089 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T18:00:05.392 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T18:00:05.674 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T18:00:05.915 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T18:00:16.979 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T18:00:17.015 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T18:00:17.549 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T18:00:17.991 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T18:00:18.349 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T18:00:18.805 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T18:00:18.822 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T18:00:18.822 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.822 INFO:teuthology.orchestra.run.smithi044.stdout:=============================== warnings summary =============================== 2024-09-12T18:00:18.822 INFO:teuthology.orchestra.run.smithi044.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T18:00:18.822 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T18:00:18.822 INFO:teuthology.orchestra.run.smithi044.stdout: import imp 2024-09-12T18:00:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.823 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py:120 2024-09-12T18:00:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:00:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: if boto_type is 'S3Connection': 2024-09-12T18:00:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.823 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_headers.py:124 2024-09-12T18:00:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:00:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T18:00:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.823 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3.py:359 2024-09-12T18:00:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-12T18:00:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T18:00:18.823 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.824 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T18:00:18.824 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:00:18.824 INFO:teuthology.orchestra.run.smithi044.stdout: if k is 'BucketName': 2024-09-12T18:00:18.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.824 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T18:00:18.824 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T18:00:18.824 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.timeout(10) 2024-09-12T18:00:18.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.824 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T18:00:18.824 INFO:teuthology.orchestra.run.smithi044.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T18:00:18.824 INFO:teuthology.orchestra.run.smithi044.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T18:00:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.825 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T18:00:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:00:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:00:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.825 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T18:00:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:00:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:00:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.825 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T18:00:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:00:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T18:00:18.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.826 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T18:00:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:00:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:00:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.826 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T18:00:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:00:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:00:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.826 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T18:00:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:00:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:00:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.826 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T18:00:18.826 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:00:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T18:00:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.827 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T18:00:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:00:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:00:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.827 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T18:00:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:00:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:00:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.827 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T18:00:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:00:18.827 INFO:teuthology.orchestra.run.smithi044.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:00:18.828 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.828 INFO:teuthology.orchestra.run.smithi044.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T18:00:18.828 INFO:teuthology.orchestra.run.smithi044.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:00:18.828 INFO:teuthology.orchestra.run.smithi044.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:00:18.828 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:00:18.828 INFO:teuthology.orchestra.run.smithi044.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T18:00:18.828 INFO:teuthology.orchestra.run.smithi044.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 451.31s (0:07:31) = 2024-09-12T18:00:18.948 INFO:teuthology.orchestra.run.smithi044.stdout:___________________________________ summary ____________________________________ 2024-09-12T18:00:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: py: commands succeeded 2024-09-12T18:00:18.948 INFO:teuthology.orchestra.run.smithi044.stdout: congratulations :) 2024-09-12T18:00:18.966 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T18:00:18.966 DEBUG:teuthology.orchestra.run.smithi044:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T18:00:19.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:00:19.074 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T18:00:19.074 DEBUG:teuthology.orchestra.run.smithi044:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T18:00:19.104 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T18:00:19.105 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:00:19.310 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T18:00:19.321 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:00:19.321 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T18:00:19.322 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:00:19.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:00:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T18:00:19.353 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:00:19.423 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T18:00:19.423 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T18:00:19.494 INFO:tasks.workunit:timeout=3h 2024-09-12T18:00:19.494 INFO:tasks.workunit:cleanup=True 2024-09-12T18:00:19.495 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:00:19.565 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T18:01:23.511 INFO:tasks.workunit.client.0.smithi044.stderr:Updating files: 88% (11248/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T18:01:24.246 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T18:01:24.246 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T18:01:24.246 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T18:01:24.246 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T18:01:24.246 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T18:01:24.246 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T18:01:24.246 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T18:01:24.247 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T18:01:24.247 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T18:01:24.247 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2024-09-12T18:01:24.247 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T18:01:24.247 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2024-09-12T18:01:24.247 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T18:01:24.247 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2024-09-12T18:01:24.247 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T18:01:24.247 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T18:01:24.247 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T18:01:24.247 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T18:01:24.252 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T18:01:24.322 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T18:01:24.325 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:01:24.325 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T18:01:24.375 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T18:01:24.426 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T18:01:24.466 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:01:24.468 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:01:24.468 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T18:01:24.507 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:01:24.511 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T18:01:24.511 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T18:01:24.582 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T18:01:24.583 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T18:01:24.583 DEBUG:teuthology.orchestra.run.smithi044:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T18:01:24.656 INFO:tasks.workunit.client.0.smithi044.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T18:01:24.657 INFO:tasks.workunit.client.0.smithi044.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:01:24.657 INFO:tasks.workunit.client.0.smithi044.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:01:27.087 INFO:tasks.workunit.client.0.smithi044.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T18:01:27.088 INFO:tasks.workunit.client.0.smithi044.stderr:++ deactivate nondestructive 2024-09-12T18:01:27.088 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2024-09-12T18:01:27.088 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2024-09-12T18:01:27.088 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:01:27.088 INFO:tasks.workunit.client.0.smithi044.stderr:++ hash -r 2024-09-12T18:01:27.088 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2024-09-12T18:01:27.088 INFO:tasks.workunit.client.0.smithi044.stderr:++ unset VIRTUAL_ENV 2024-09-12T18:01:27.088 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T18:01:27.088 INFO:tasks.workunit.client.0.smithi044.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:01:27.088 INFO:tasks.workunit.client.0.smithi044.stderr:++ export VIRTUAL_ENV 2024-09-12T18:01:27.088 INFO:tasks.workunit.client.0.smithi044.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:01:27.089 INFO:tasks.workunit.client.0.smithi044.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:01:27.089 INFO:tasks.workunit.client.0.smithi044.stderr:++ export PATH 2024-09-12T18:01:27.089 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n '' ']' 2024-09-12T18:01:27.090 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -z '' ']' 2024-09-12T18:01:27.090 INFO:tasks.workunit.client.0.smithi044.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T18:01:27.090 INFO:tasks.workunit.client.0.smithi044.stderr:++ PS1='(rgw) ' 2024-09-12T18:01:27.090 INFO:tasks.workunit.client.0.smithi044.stderr:++ export PS1 2024-09-12T18:01:27.090 INFO:tasks.workunit.client.0.smithi044.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:01:27.090 INFO:tasks.workunit.client.0.smithi044.stderr:++ hash -r 2024-09-12T18:01:27.090 INFO:tasks.workunit.client.0.smithi044.stderr:+ pip install pip --upgrade 2024-09-12T18:01:27.325 INFO:tasks.workunit.client.0.smithi044.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T18:01:27.511 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting pip 2024-09-12T18:01:27.517 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T18:01:27.563 INFO:tasks.workunit.client.0.smithi044.stdout:Installing collected packages: pip 2024-09-12T18:01:27.564 INFO:tasks.workunit.client.0.smithi044.stdout: Attempting uninstall: pip 2024-09-12T18:01:27.564 INFO:tasks.workunit.client.0.smithi044.stdout: Found existing installation: pip 21.3.1 2024-09-12T18:01:27.728 INFO:tasks.workunit.client.0.smithi044.stdout: Uninstalling pip-21.3.1: 2024-09-12T18:01:27.734 INFO:tasks.workunit.client.0.smithi044.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T18:01:28.508 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully installed pip-24.2 2024-09-12T18:01:28.557 INFO:tasks.workunit.client.0.smithi044.stderr:+ pip install boto3 2024-09-12T18:01:29.365 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting boto3 2024-09-12T18:01:29.366 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T18:01:29.976 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T18:01:29.977 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T18:01:30.036 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T18:01:30.037 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T18:01:30.082 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T18:01:30.083 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T18:01:30.125 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:01:30.126 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T18:01:30.204 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:01:30.204 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T18:01:30.406 INFO:tasks.workunit.client.0.smithi044.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:01:30.407 INFO:tasks.workunit.client.0.smithi044.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T18:01:30.412 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T18:01:30.413 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T18:01:30.422 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T18:01:30.423 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T18:01:30.425 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T18:01:30.426 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T18:01:30.428 INFO:tasks.workunit.client.0.smithi044.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T18:01:30.504 INFO:tasks.workunit.client.0.smithi044.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T18:01:31.582 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T18:01:31.703 INFO:tasks.workunit.client.0.smithi044.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T18:01:31.830 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T18:01:31.865 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:31.865 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:31.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:31.904+0000 7fa7c5daf800 20 rados->read ofs=0 len=0 2024-09-12T18:01:31.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:31.906+0000 7fa7c5daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:31.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:31.906+0000 7fa7c5daf800 20 realm 2024-09-12T18:01:31.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:31.906+0000 7fa7c5daf800 20 rados->read ofs=0 len=0 2024-09-12T18:01:31.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:31.906+0000 7fa7c5daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:31.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:31.906+0000 7fa7c5daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:31.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:31.906+0000 7fa7c5daf800 20 rados->read ofs=0 len=0 2024-09-12T18:01:31.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:31.906+0000 7fa7c5daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:31.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:31.906+0000 7fa7c5daf800 20 rados->read ofs=0 len=0 2024-09-12T18:01:31.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:31.907+0000 7fa7c5daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:31.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:31.907+0000 7fa7c5daf800 20 rados->read ofs=0 len=0 2024-09-12T18:01:31.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:31.908+0000 7fa7c5daf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:31.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:31.908+0000 7fa7c5daf800 20 searching for the correct realm 2024-09-12T18:01:31.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:31.911+0000 7fa7c409a640 0 -- 172.21.15.44:0/2348268114 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7fa7b8021030 msgr2=0x7fa7b80880c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:31.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:31.915+0000 7fa7c3899640 0 -- 172.21.15.44:0/2348268114 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fa7b807dbd0 msgr2=0x7fa7b800faf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:32.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.121+0000 7fa7c5daf800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T18:01:32.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.121+0000 7fa7c5daf800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T18:01:32.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.121+0000 7fa7c5daf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:32.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.121+0000 7fa7c5daf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:32.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.121+0000 7fa7c5daf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:32.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.121+0000 7fa7c5daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:32.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.121+0000 7fa7c5daf800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.122+0000 7fa7c5daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.123 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.122+0000 7fa7c5daf800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.122+0000 7fa7c5daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:32.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.122+0000 7fa7c5daf800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.122+0000 7fa7c5daf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:32.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.123+0000 7fa7c5daf800 20 zone default found 2024-09-12T18:01:32.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.123+0000 7fa7c5daf800 4 Realm: () 2024-09-12T18:01:32.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.123+0000 7fa7c5daf800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T18:01:32.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.123+0000 7fa7c5daf800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T18:01:32.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.123+0000 7fa7c5daf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:32.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.123+0000 7fa7c5daf800 20 zonegroup default 2024-09-12T18:01:32.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.123+0000 7fa7c5daf800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.123+0000 7fa7c5daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.123+0000 7fa7c5daf800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.123+0000 7fa7c5daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.123+0000 7fa7c5daf800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.123+0000 7fa7c5daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.124+0000 7fa7c5daf800 20 started sync module instance, tier type = 2024-09-12T18:01:32.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.124+0000 7fa7c5daf800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T18:01:32.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.133+0000 7fa7c5daf800 20 add_watcher() i=0 2024-09-12T18:01:32.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.133+0000 7fa7c5daf800 20 add_watcher() i=1 2024-09-12T18:01:32.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.133+0000 7fa7c5daf800 20 add_watcher() i=2 2024-09-12T18:01:32.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.133+0000 7fa7c5daf800 20 add_watcher() i=3 2024-09-12T18:01:32.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.133+0000 7fa7c5daf800 20 add_watcher() i=4 2024-09-12T18:01:32.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.133+0000 7fa7c5daf800 20 add_watcher() i=5 2024-09-12T18:01:32.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.133+0000 7fa7c5daf800 20 add_watcher() i=6 2024-09-12T18:01:32.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.134+0000 7fa7c5daf800 20 add_watcher() i=7 2024-09-12T18:01:32.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.134+0000 7fa7c5daf800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:32.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.136+0000 7fa679fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:32.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.136+0000 7fa7c5daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:32.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.136+0000 7fa7c5daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:32.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.136+0000 7fa7c5daf800 5 note: GC not initialized 2024-09-12T18:01:32.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.137+0000 7fa678fe1640 20 reqs_thread_entry: start 2024-09-12T18:01:32.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.137+0000 7fa7c5daf800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:32.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.137+0000 7fa7c5daf800 20 Filter name: none 2024-09-12T18:01:32.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.137+0000 7fa5f27fc640 20 reqs_thread_entry: start 2024-09-12T18:01:32.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.137+0000 7fa7c5daf800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T18:01:32.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.137+0000 7fa7c5daf800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.137+0000 7fa7c5daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.137+0000 7fa7c5daf800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T18:01:32.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.137+0000 7fa7c5daf800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:01:32.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.138+0000 7fa7c5daf800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T18:01:32.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.138+0000 7fa7c5daf800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.138+0000 7fa7c5daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.138+0000 7fa7c5daf800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T18:01:32.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.138+0000 7fa7c5daf800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:01:32.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.138+0000 7fa7c5daf800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T18:01:32.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.138+0000 7fa7c5daf800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T18:01:32.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.140+0000 7fa7c5daf800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T18:01:32.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.140+0000 7fa7c5daf800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:01:32.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.140+0000 7fa7c5daf800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T18:01:32.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.140+0000 7fa6a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464611 cookie 94153057942896 notifier 8756 bl.length()=613 2024-09-12T18:01:32.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.140+0000 7fa6a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T18:01:32.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.140+0000 7fa6a2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:01:32.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.142+0000 7fa7c5daf800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T18:01:32.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.142+0000 7fa7c5daf800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:01:32.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.142+0000 7fa7c5daf800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T18:01:32.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.142+0000 7fa6a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986466871 cookie 94153057936208 notifier 8756 bl.length()=191 2024-09-12T18:01:32.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.142+0000 7fa6a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T18:01:32.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.142+0000 7fa6a2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:01:32.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.144+0000 7fa679fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:32.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.146+0000 7fa7c5daf800 20 remove_watcher() i=0 2024-09-12T18:01:32.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.146+0000 7fa7c5daf800 2 removed watcher, disabling cache 2024-09-12T18:01:32.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.147+0000 7fa7c5daf800 20 remove_watcher() i=1 2024-09-12T18:01:32.149 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.148+0000 7fa7c5daf800 20 remove_watcher() i=2 2024-09-12T18:01:32.150 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.149+0000 7fa7c5daf800 20 remove_watcher() i=3 2024-09-12T18:01:32.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.150+0000 7fa7c5daf800 20 remove_watcher() i=4 2024-09-12T18:01:32.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.151+0000 7fa7c5daf800 20 remove_watcher() i=5 2024-09-12T18:01:32.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.152+0000 7fa7c5daf800 20 remove_watcher() i=6 2024-09-12T18:01:32.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.153+0000 7fa7c5daf800 20 remove_watcher() i=7 2024-09-12T18:01:32.359 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T18:01:32.359 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T18:01:32.389 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T18:01:32.419 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:32.419 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:32.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.457+0000 7f54dcf2e800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.459+0000 7f54dcf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.459+0000 7f54dcf2e800 20 realm 2024-09-12T18:01:32.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.459+0000 7f54dcf2e800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.459+0000 7f54dcf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.459+0000 7f54dcf2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:32.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.459+0000 7f54dcf2e800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.459+0000 7f54dcf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.460 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.459+0000 7f54dcf2e800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.460+0000 7f54dcf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:32.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.460+0000 7f54dcf2e800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.460+0000 7f54dcf2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:32.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.460+0000 7f54dcf2e800 20 searching for the correct realm 2024-09-12T18:01:32.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.464+0000 7f54d94de640 0 -- 172.21.15.44:0/2006767668 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x5605cae3cdb0 msgr2=0x5605cae3f220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:32.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.468+0000 7f54d3fff640 0 -- 172.21.15.44:0/2006767668 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f54cc017070 msgr2=0x7f54cc001c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:32.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.473+0000 7f54dcf2e800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T18:01:32.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.473+0000 7f54dcf2e800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T18:01:32.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.473+0000 7f54dcf2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:32.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.473+0000 7f54dcf2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:32.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.473+0000 7f54dcf2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:32.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.473+0000 7f54dcf2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:32.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.473+0000 7f54dcf2e800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.473+0000 7f54dcf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.473+0000 7f54dcf2e800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.475 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.473+0000 7f54dcf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:32.475 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.473+0000 7f54dcf2e800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.474+0000 7f54dcf2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:32.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.474+0000 7f54dcf2e800 20 zone default found 2024-09-12T18:01:32.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.474+0000 7f54dcf2e800 4 Realm: () 2024-09-12T18:01:32.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.474+0000 7f54dcf2e800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T18:01:32.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.474+0000 7f54dcf2e800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T18:01:32.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.474+0000 7f54dcf2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:32.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.474+0000 7f54dcf2e800 20 zonegroup default 2024-09-12T18:01:32.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.474+0000 7f54dcf2e800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.474+0000 7f54dcf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.474+0000 7f54dcf2e800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.474+0000 7f54dcf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.474+0000 7f54dcf2e800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.474+0000 7f54dcf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:32.476 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.474+0000 7f54dcf2e800 20 started sync module instance, tier type = 2024-09-12T18:01:32.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.474+0000 7f54dcf2e800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T18:01:32.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.484+0000 7f54dcf2e800 20 add_watcher() i=0 2024-09-12T18:01:32.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.484+0000 7f54dcf2e800 20 add_watcher() i=1 2024-09-12T18:01:32.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.484+0000 7f54dcf2e800 20 add_watcher() i=2 2024-09-12T18:01:32.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.484+0000 7f54dcf2e800 20 add_watcher() i=3 2024-09-12T18:01:32.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.484+0000 7f54dcf2e800 20 add_watcher() i=4 2024-09-12T18:01:32.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.484+0000 7f54dcf2e800 20 add_watcher() i=5 2024-09-12T18:01:32.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.484+0000 7f54dcf2e800 20 add_watcher() i=6 2024-09-12T18:01:32.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.485+0000 7f54dcf2e800 20 add_watcher() i=7 2024-09-12T18:01:32.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.485+0000 7f54dcf2e800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:32.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.487+0000 7f538efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:32.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.488+0000 7f54dcf2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:32.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.488+0000 7f54dcf2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:32.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.488+0000 7f54dcf2e800 5 note: GC not initialized 2024-09-12T18:01:32.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.488+0000 7f538dfe3640 20 reqs_thread_entry: start 2024-09-12T18:01:32.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.488+0000 7f54dcf2e800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:32.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.488+0000 7f54dcf2e800 20 Filter name: none 2024-09-12T18:01:32.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.488+0000 7f52ff7fe640 20 reqs_thread_entry: start 2024-09-12T18:01:32.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.488+0000 7f54dcf2e800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.489+0000 7f54dcf2e800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:01:32.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.489+0000 7f54dcf2e800 20 rados->read ofs=0 len=0 2024-09-12T18:01:32.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.489+0000 7f54dcf2e800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:01:32.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.489+0000 7f54dcf2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:32.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.489+0000 7f54dcf2e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:01:32.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.489+0000 7f54dcf2e800 20 INFO: main: starting shard=0 2024-09-12T18:01:32.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.489+0000 7f54dcf2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.0 2024-09-12T18:01:32.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.490+0000 7f54dcf2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:32.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.490+0000 7f54dcf2e800 20 INFO: main: starting shard=1 2024-09-12T18:01:32.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.490+0000 7f54dcf2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.1 2024-09-12T18:01:32.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.490+0000 7f54dcf2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:32.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.490+0000 7f54dcf2e800 20 INFO: main: starting shard=2 2024-09-12T18:01:32.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.490+0000 7f54dcf2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.2 2024-09-12T18:01:32.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.491+0000 7f54dcf2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:32.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.491+0000 7f54dcf2e800 20 INFO: main: starting shard=3 2024-09-12T18:01:32.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.491+0000 7f54dcf2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.3 2024-09-12T18:01:32.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.491+0000 7f54dcf2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:32.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.491+0000 7f54dcf2e800 20 INFO: main: starting shard=4 2024-09-12T18:01:32.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.491+0000 7f54dcf2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.4 2024-09-12T18:01:32.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.492+0000 7f54dcf2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:32.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.492+0000 7f54dcf2e800 20 INFO: main: starting shard=5 2024-09-12T18:01:32.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.492+0000 7f54dcf2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.5 2024-09-12T18:01:32.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.492+0000 7f54dcf2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:32.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.492+0000 7f54dcf2e800 20 INFO: main: starting shard=6 2024-09-12T18:01:32.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.492+0000 7f54dcf2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.6 2024-09-12T18:01:32.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.493+0000 7f54dcf2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:32.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.493+0000 7f54dcf2e800 20 INFO: main: starting shard=7 2024-09-12T18:01:32.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.493+0000 7f54dcf2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.7 2024-09-12T18:01:32.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.493+0000 7f54dcf2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:32.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.493+0000 7f54dcf2e800 20 INFO: main: starting shard=8 2024-09-12T18:01:32.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.493+0000 7f54dcf2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.8 2024-09-12T18:01:32.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.494+0000 7f54dcf2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:32.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.494+0000 7f54dcf2e800 20 INFO: main: starting shard=9 2024-09-12T18:01:32.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.494+0000 7f54dcf2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.9 2024-09-12T18:01:32.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.494+0000 7f54dcf2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:32.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.494+0000 7f54dcf2e800 20 INFO: main: starting shard=10 2024-09-12T18:01:32.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.494+0000 7f54dcf2e800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.10 2024-09-12T18:01:32.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.494+0000 7f54dcf2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:32.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.494+0000 7f54dcf2e800 20 INFO: main: done 2024-09-12T18:01:32.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.495+0000 7f538efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:32.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.498+0000 7f54dcf2e800 20 remove_watcher() i=0 2024-09-12T18:01:32.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.498+0000 7f54dcf2e800 2 removed watcher, disabling cache 2024-09-12T18:01:32.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.499+0000 7f54dcf2e800 20 remove_watcher() i=1 2024-09-12T18:01:32.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.500+0000 7f54dcf2e800 20 remove_watcher() i=2 2024-09-12T18:01:32.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.501+0000 7f54dcf2e800 20 remove_watcher() i=3 2024-09-12T18:01:32.503 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.502+0000 7f54dcf2e800 20 remove_watcher() i=4 2024-09-12T18:01:32.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.503+0000 7f54dcf2e800 20 remove_watcher() i=5 2024-09-12T18:01:32.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.504+0000 7f54dcf2e800 20 remove_watcher() i=6 2024-09-12T18:01:32.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.505+0000 7f54dcf2e800 20 remove_watcher() i=7 2024-09-12T18:01:32.519 INFO:tasks.workunit.client.0.smithi044.stderr:rados -p default.rgw.buckets.data ls | grep 473e1e41-d391-4a71-8b5f-5ff4568efb5d 2024-09-12T18:01:32.541 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:32.542 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:32.621 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:32.620+0000 7f12e387a640 0 -- 172.21.15.44:0/2950293454 >> [v2:172.21.15.44:6816/2388684615,v1:172.21.15.44:6817/2388684615] conn(0x560e5017d250 msgr2=0x560e500e4780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:32.631 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T18:01:32.631 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T18:01:32.633 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:01:34.065 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:01:34.492 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T18:01:34.521 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:34.521 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:34.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.560+0000 7ff9266bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.562 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.562+0000 7ff9266bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.562+0000 7ff9266bb800 20 realm 2024-09-12T18:01:34.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.562+0000 7ff9266bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.562+0000 7ff9266bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.562+0000 7ff9266bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:34.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.562+0000 7ff9266bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.562+0000 7ff9266bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.562+0000 7ff9266bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.563+0000 7ff9266bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:34.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.563+0000 7ff9266bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.563+0000 7ff9266bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:34.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.563+0000 7ff9266bb800 20 searching for the correct realm 2024-09-12T18:01:34.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.565+0000 7ff9241a5640 0 -- 172.21.15.44:0/2228585286 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7ff90c003b00 msgr2=0x7ff91c07fbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:34.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.770+0000 7ff9249a6640 0 -- 172.21.15.44:0/2228585286 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7ff918069ed0 msgr2=0x7ff9180705d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:34.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.777+0000 7ff9266bb800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T18:01:34.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.777+0000 7ff9266bb800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T18:01:34.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.777+0000 7ff9266bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:34.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.777+0000 7ff9266bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:34.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.777+0000 7ff9266bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:34.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.777+0000 7ff9266bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:34.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.777+0000 7ff9266bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.777+0000 7ff9266bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.777+0000 7ff9266bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.777+0000 7ff9266bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:34.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.777+0000 7ff9266bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.778+0000 7ff9266bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:34.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.778+0000 7ff9266bb800 20 zone default found 2024-09-12T18:01:34.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.778+0000 7ff9266bb800 4 Realm: () 2024-09-12T18:01:34.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.778+0000 7ff9266bb800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T18:01:34.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.778+0000 7ff9266bb800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T18:01:34.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.778+0000 7ff9266bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:34.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.778+0000 7ff9266bb800 20 zonegroup default 2024-09-12T18:01:34.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.778+0000 7ff9266bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.778+0000 7ff9266bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.778+0000 7ff9266bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.778+0000 7ff9266bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.778+0000 7ff9266bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.779+0000 7ff9266bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.779+0000 7ff9266bb800 20 started sync module instance, tier type = 2024-09-12T18:01:34.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.779+0000 7ff9266bb800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T18:01:34.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.789+0000 7ff9266bb800 20 add_watcher() i=0 2024-09-12T18:01:34.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.789+0000 7ff9266bb800 20 add_watcher() i=1 2024-09-12T18:01:34.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.789+0000 7ff9266bb800 20 add_watcher() i=2 2024-09-12T18:01:34.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.789+0000 7ff9266bb800 20 add_watcher() i=3 2024-09-12T18:01:34.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.789+0000 7ff9266bb800 20 add_watcher() i=4 2024-09-12T18:01:34.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.789+0000 7ff9266bb800 20 add_watcher() i=5 2024-09-12T18:01:34.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.789+0000 7ff9266bb800 20 add_watcher() i=6 2024-09-12T18:01:34.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.789+0000 7ff9266bb800 20 add_watcher() i=7 2024-09-12T18:01:34.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.789+0000 7ff9266bb800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:34.792 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.791+0000 7ff7da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:34.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.792+0000 7ff9266bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:34.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.792+0000 7ff9266bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:34.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.792+0000 7ff9266bb800 5 note: GC not initialized 2024-09-12T18:01:34.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.792+0000 7ff7d97e2640 20 reqs_thread_entry: start 2024-09-12T18:01:34.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.792+0000 7ff9266bb800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:34.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.792+0000 7ff9266bb800 20 Filter name: none 2024-09-12T18:01:34.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.792+0000 7ff74affd640 20 reqs_thread_entry: start 2024-09-12T18:01:34.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.792+0000 7ff9266bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.793+0000 7ff9266bb800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:01:34.794 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.793+0000 7ff9266bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.793+0000 7ff9266bb800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:01:34.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.793+0000 7ff9266bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:34.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.793+0000 7ff9266bb800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:01:34.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.793+0000 7ff9266bb800 20 INFO: main: starting shard=0 2024-09-12T18:01:34.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.793+0000 7ff9266bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.0 2024-09-12T18:01:34.795 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.793+0000 7ff9266bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:34.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.794+0000 7ff9266bb800 20 INFO: main: starting shard=1 2024-09-12T18:01:34.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.794+0000 7ff9266bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.1 2024-09-12T18:01:34.796 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.794+0000 7ff9266bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:34.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.794+0000 7ff9266bb800 20 INFO: main: starting shard=2 2024-09-12T18:01:34.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.794+0000 7ff9266bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.2 2024-09-12T18:01:34.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.794+0000 7ff9266bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:34.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.794+0000 7ff9266bb800 20 INFO: main: starting shard=3 2024-09-12T18:01:34.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.794+0000 7ff9266bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.3 2024-09-12T18:01:34.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.795+0000 7ff9266bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:34.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.795+0000 7ff9266bb800 20 INFO: main: starting shard=4 2024-09-12T18:01:34.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.795+0000 7ff9266bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.4 2024-09-12T18:01:34.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.795+0000 7ff9266bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:34.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.795+0000 7ff9266bb800 20 INFO: main: starting shard=5 2024-09-12T18:01:34.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.795+0000 7ff9266bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.5 2024-09-12T18:01:34.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.796+0000 7ff9266bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:34.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.796+0000 7ff9266bb800 20 INFO: main: starting shard=6 2024-09-12T18:01:34.798 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.796+0000 7ff9266bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.6 2024-09-12T18:01:34.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.796+0000 7ff9266bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:34.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.796+0000 7ff9266bb800 20 INFO: main: starting shard=7 2024-09-12T18:01:34.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.796+0000 7ff9266bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.7 2024-09-12T18:01:34.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.797+0000 7ff9266bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:34.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.797+0000 7ff9266bb800 20 INFO: main: starting shard=8 2024-09-12T18:01:34.799 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.797+0000 7ff9266bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.8 2024-09-12T18:01:34.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.798+0000 7ff9266bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:34.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.798+0000 7ff9266bb800 20 INFO: main: starting shard=9 2024-09-12T18:01:34.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.798+0000 7ff9266bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.9 2024-09-12T18:01:34.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.798+0000 7ff9266bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:34.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.798+0000 7ff9266bb800 20 INFO: main: starting shard=10 2024-09-12T18:01:34.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.798+0000 7ff9266bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.10 2024-09-12T18:01:34.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.798+0000 7ff9266bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:01:34.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.798+0000 7ff9266bb800 20 INFO: main: done 2024-09-12T18:01:34.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.799+0000 7ff7da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:34.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.802+0000 7ff9266bb800 20 remove_watcher() i=0 2024-09-12T18:01:34.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.802+0000 7ff9266bb800 2 removed watcher, disabling cache 2024-09-12T18:01:34.804 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.803+0000 7ff9266bb800 20 remove_watcher() i=1 2024-09-12T18:01:34.805 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.805+0000 7ff9266bb800 20 remove_watcher() i=2 2024-09-12T18:01:34.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.806+0000 7ff9266bb800 20 remove_watcher() i=3 2024-09-12T18:01:34.808 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.807+0000 7ff9266bb800 20 remove_watcher() i=4 2024-09-12T18:01:34.809 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.808+0000 7ff9266bb800 20 remove_watcher() i=5 2024-09-12T18:01:34.809 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.809+0000 7ff9266bb800 20 remove_watcher() i=6 2024-09-12T18:01:34.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.810+0000 7ff9266bb800 20 remove_watcher() i=7 2024-09-12T18:01:34.823 INFO:tasks.workunit.client.0.smithi044.stderr:rados -p default.rgw.buckets.data ls | grep bbb27018-35d9-4c25-a506-4c6155361148 2024-09-12T18:01:34.846 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:34.846 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:34.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:34.925+0000 7f8edf776640 0 -- 172.21.15.44:0/1875842432 >> [v2:172.21.15.181:6802/1372247348,v1:172.21.15.181:6803/1372247348] conn(0x7f8ed006b6b0 msgr2=0x7f8ed005d1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:34.939 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T18:01:34.939 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T18:01:34.977 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:01:36.452 INFO:tasks.workunit.client.0.smithi044.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:01:36.454 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:01:36.888 INFO:tasks.workunit.client.0.smithi044.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T18:01:36.888 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-12T18:01:36.988 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T18:01:40.418 INFO:tasks.workunit.client.0.smithi044.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T18:01:40.836 INFO:tasks.workunit.client.0.smithi044.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T18:01:40.867 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:40.867 INFO:tasks.workunit.client.0.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:40.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:40.906+0000 7f155c0bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:40.908+0000 7f155c0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:40.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:40.908+0000 7f155c0bb800 20 realm 2024-09-12T18:01:40.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:40.908+0000 7f155c0bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:40.908+0000 7f155c0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:40.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:40.908+0000 7f155c0bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:40.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:40.908+0000 7f155c0bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:40.908+0000 7f155c0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:40.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:40.908+0000 7f155c0bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:40.909+0000 7f155c0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:40.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:40.909+0000 7f155c0bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:40.909+0000 7f155c0bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:40.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:40.909+0000 7f155c0bb800 20 searching for the correct realm 2024-09-12T18:01:40.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:40.914+0000 7f15593a4640 0 -- 172.21.15.44:0/3187385710 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f154c088920 msgr2=0x7f154c061820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:41.119 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.119+0000 7f1559ba5640 0 -- 172.21.15.44:0/3187385710 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f15500aa5c0 msgr2=0x7f15500b5620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:41.328 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.327+0000 7f155c0bb800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T18:01:41.328 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.327+0000 7f155c0bb800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T18:01:41.328 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.327+0000 7f155c0bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:41.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.327+0000 7f155c0bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:41.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.327+0000 7f155c0bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:41.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.327+0000 7f155c0bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:41.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.327+0000 7f155c0bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.328+0000 7f155c0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.329 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.328+0000 7f155c0bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.330 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.328+0000 7f155c0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:41.330 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.328+0000 7f155c0bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.330 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.328+0000 7f155c0bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:41.330 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.329+0000 7f155c0bb800 20 zone default found 2024-09-12T18:01:41.330 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.329+0000 7f155c0bb800 4 Realm: () 2024-09-12T18:01:41.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.329+0000 7f155c0bb800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T18:01:41.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.329+0000 7f155c0bb800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T18:01:41.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.329+0000 7f155c0bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:41.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.329+0000 7f155c0bb800 20 zonegroup default 2024-09-12T18:01:41.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.329+0000 7f155c0bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.329+0000 7f155c0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.329+0000 7f155c0bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.329+0000 7f155c0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.329+0000 7f155c0bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.330+0000 7f155c0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:41.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.330+0000 7f155c0bb800 20 started sync module instance, tier type = 2024-09-12T18:01:41.331 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.330+0000 7f155c0bb800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T18:01:41.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.340+0000 7f155c0bb800 20 add_watcher() i=0 2024-09-12T18:01:41.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.340+0000 7f155c0bb800 20 add_watcher() i=1 2024-09-12T18:01:41.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.340+0000 7f155c0bb800 20 add_watcher() i=2 2024-09-12T18:01:41.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.340+0000 7f155c0bb800 20 add_watcher() i=3 2024-09-12T18:01:41.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.340+0000 7f155c0bb800 20 add_watcher() i=4 2024-09-12T18:01:41.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.340+0000 7f155c0bb800 20 add_watcher() i=5 2024-09-12T18:01:41.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.340+0000 7f155c0bb800 20 add_watcher() i=6 2024-09-12T18:01:41.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.341+0000 7f155c0bb800 20 add_watcher() i=7 2024-09-12T18:01:41.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.341+0000 7f155c0bb800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:41.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.343+0000 7f140b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:41.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.344+0000 7f155c0bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:41.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.344+0000 7f155c0bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:41.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.344+0000 7f155c0bb800 5 note: GC not initialized 2024-09-12T18:01:41.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.344+0000 7f140a7fc640 20 reqs_thread_entry: start 2024-09-12T18:01:41.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.344+0000 7f155c0bb800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:41.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.344+0000 7f155c0bb800 20 Filter name: none 2024-09-12T18:01:41.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.344+0000 7f137bfff640 20 reqs_thread_entry: start 2024-09-12T18:01:41.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.344+0000 7f155c0bb800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T18:01:41.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.344+0000 7f155c0bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.345+0000 7f155c0bb800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:01:41.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.345+0000 7f155c0bb800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T18:01:41.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.345+0000 7f155c0bb800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T18:01:41.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.345+0000 7f155c0bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783 : miss 2024-09-12T18:01:41.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.345+0000 7f155c0bb800 20 rados->read ofs=0 len=0 2024-09-12T18:01:41.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.345+0000 7f155c0bb800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:01:41.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.345+0000 7f155c0bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783 info.flags=0x17 2024-09-12T18:01:41.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.345+0000 7f155c0bb800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783 to cache LRU end 2024-09-12T18:01:41.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.345+0000 7f155c0bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:41.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.345+0000 7f155c0bb800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:01:41.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.345+0000 7f155c0bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783 2024-09-12T18:01:41.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.345+0000 7f155c0bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.0 2024-09-12T18:01:41.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.346+0000 7f155c0bb800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T18:01:41.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.346+0000 7f155c0bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.1 2024-09-12T18:01:41.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.346+0000 7f155c0bb800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T18:01:41.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.346+0000 7f155c0bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.2 2024-09-12T18:01:41.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.347+0000 7f155c0bb800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T18:01:41.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.347+0000 7f155c0bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.3 2024-09-12T18:01:41.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.347+0000 7f155c0bb800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T18:01:41.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.347+0000 7f155c0bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.4 2024-09-12T18:01:41.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.348+0000 7f155c0bb800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T18:01:41.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.348+0000 7f155c0bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.5 2024-09-12T18:01:41.350 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.348+0000 7f155c0bb800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T18:01:41.350 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.348+0000 7f155c0bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.6 2024-09-12T18:01:41.350 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.349+0000 7f155c0bb800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T18:01:41.350 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.349+0000 7f155c0bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.7 2024-09-12T18:01:41.350 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.349+0000 7f155c0bb800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T18:01:41.350 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.349+0000 7f155c0bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.8 2024-09-12T18:01:41.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.350+0000 7f155c0bb800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T18:01:41.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.350+0000 7f155c0bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.9 2024-09-12T18:01:41.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.350+0000 7f155c0bb800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T18:01:41.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.350+0000 7f155c0bb800 20 bucket index object: :.dir.fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783.10 2024-09-12T18:01:41.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.350+0000 7f155c0bb800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T18:01:41.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.350+0000 7f155c0bb800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T18:01:41.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.351+0000 7f140b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:41.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.354+0000 7f155c0bb800 20 remove_watcher() i=0 2024-09-12T18:01:41.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.354+0000 7f155c0bb800 2 removed watcher, disabling cache 2024-09-12T18:01:41.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.355+0000 7f155c0bb800 20 remove_watcher() i=1 2024-09-12T18:01:41.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.356+0000 7f155c0bb800 20 remove_watcher() i=2 2024-09-12T18:01:41.358 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.357+0000 7f155c0bb800 20 remove_watcher() i=3 2024-09-12T18:01:41.359 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.358+0000 7f155c0bb800 20 remove_watcher() i=4 2024-09-12T18:01:41.360 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.359+0000 7f155c0bb800 20 remove_watcher() i=5 2024-09-12T18:01:41.361 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.360+0000 7f155c0bb800 20 remove_watcher() i=6 2024-09-12T18:01:41.362 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-12T18:01:41.362+0000 7f155c0bb800 20 remove_watcher() i=7 2024-09-12T18:01:41.374 INFO:tasks.workunit.client.0.smithi044.stderr:Deleting bucket versioning-bucket 2024-09-12T18:01:41.414 INFO:tasks.workunit.client.0.smithi044.stderr:Completed bucket versioning tests 2024-09-12T18:01:41.414 INFO:tasks.workunit.client.0.smithi044.stdout:connected to http://localhost:80 2024-09-12T18:01:41.474 INFO:tasks.workunit.client.0.smithi044.stderr:+ deactivate 2024-09-12T18:01:41.474 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T18:01:41.475 INFO:tasks.workunit.client.0.smithi044.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:01:41.475 INFO:tasks.workunit.client.0.smithi044.stderr:+ export PATH 2024-09-12T18:01:41.475 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T18:01:41.475 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n '' ']' 2024-09-12T18:01:41.475 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:01:41.475 INFO:tasks.workunit.client.0.smithi044.stderr:+ hash -r 2024-09-12T18:01:41.475 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -n '' ']' 2024-09-12T18:01:41.475 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset VIRTUAL_ENV 2024-09-12T18:01:41.475 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T18:01:41.475 INFO:tasks.workunit.client.0.smithi044.stderr:+ unset -f deactivate 2024-09-12T18:01:41.475 INFO:tasks.workunit.client.0.smithi044.stderr:+ echo OK. 2024-09-12T18:01:41.476 INFO:tasks.workunit.client.0.smithi044.stdout:OK. 2024-09-12T18:01:41.476 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:01:41.477 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:01:41.558 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T18:01:41.558 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:01:41.939 DEBUG:teuthology.parallel:result is None 2024-09-12T18:01:41.940 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:01:41.980 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:01:41.980 DEBUG:teuthology.orchestra.run.smithi044:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:01:42.049 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:01:42.049 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T18:01:42.060 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T18:01:42.206 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T18:01:42.206 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T18:01:42.207 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T18:01:42.273 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T18:01:42.273 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T18:01:42.331 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:42.331 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:42.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.366+0000 7fa9a3f1f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.368+0000 7fa9a3f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:42.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.368+0000 7fa9a3f1f800 20 realm 2024-09-12T18:01:42.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.368+0000 7fa9a3f1f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.368+0000 7fa9a3f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:42.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.368+0000 7fa9a3f1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:42.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.368+0000 7fa9a3f1f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.368+0000 7fa9a3f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:42.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.368+0000 7fa9a3f1f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.369+0000 7fa9a3f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:42.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.369+0000 7fa9a3f1f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.369+0000 7fa9a3f1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:42.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.369+0000 7fa9a3f1f800 20 searching for the correct realm 2024-09-12T18:01:42.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.373+0000 7fa997fff640 0 -- 172.21.15.44:0/460633878 >> [v2:172.21.15.44:6800/4250907931,v1:172.21.15.44:6801/4250907931] conn(0x55900a30c1a0 msgr2=0x55900a30e660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:42.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.377+0000 7fa99fca9640 0 -- 172.21.15.44:0/460633878 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7fa98802cb90 msgr2=0x7fa9880662e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:42.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.381+0000 7fa9a3f1f800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T18:01:42.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.381+0000 7fa9a3f1f800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T18:01:42.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.381+0000 7fa9a3f1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:42.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.381+0000 7fa9a3f1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:42.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.381+0000 7fa9a3f1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:42.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.381+0000 7fa9a3f1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:42.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.381+0000 7fa9a3f1f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.382+0000 7fa9a3f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:42.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.382+0000 7fa9a3f1f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.382+0000 7fa9a3f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:42.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.382+0000 7fa9a3f1f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.382+0000 7fa9a3f1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:42.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.382+0000 7fa9a3f1f800 20 zone default found 2024-09-12T18:01:42.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.382+0000 7fa9a3f1f800 4 Realm: () 2024-09-12T18:01:42.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.382+0000 7fa9a3f1f800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T18:01:42.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.382+0000 7fa9a3f1f800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T18:01:42.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.382+0000 7fa9a3f1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:42.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.382+0000 7fa9a3f1f800 20 zonegroup default 2024-09-12T18:01:42.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.382+0000 7fa9a3f1f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.383+0000 7fa9a3f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:42.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.383+0000 7fa9a3f1f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.383+0000 7fa9a3f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:42.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.383+0000 7fa9a3f1f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.383+0000 7fa9a3f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:42.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.383+0000 7fa9a3f1f800 20 started sync module instance, tier type = 2024-09-12T18:01:42.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.383+0000 7fa9a3f1f800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T18:01:42.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.393+0000 7fa9a3f1f800 20 add_watcher() i=0 2024-09-12T18:01:42.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.393+0000 7fa9a3f1f800 20 add_watcher() i=1 2024-09-12T18:01:42.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.393+0000 7fa9a3f1f800 20 add_watcher() i=2 2024-09-12T18:01:42.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.393+0000 7fa9a3f1f800 20 add_watcher() i=3 2024-09-12T18:01:42.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.393+0000 7fa9a3f1f800 20 add_watcher() i=4 2024-09-12T18:01:42.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.393+0000 7fa9a3f1f800 20 add_watcher() i=5 2024-09-12T18:01:42.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.393+0000 7fa9a3f1f800 20 add_watcher() i=6 2024-09-12T18:01:42.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.394+0000 7fa9a3f1f800 20 add_watcher() i=7 2024-09-12T18:01:42.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.394+0000 7fa9a3f1f800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:42.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.396+0000 7fa8567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:42.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.396+0000 7fa9a3f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:42.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.396+0000 7fa9a3f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:42.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.437+0000 7fa8557e2640 20 reqs_thread_entry: start 2024-09-12T18:01:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.437+0000 7fa9a3f1f800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.437+0000 7fa9a3f1f800 20 Filter name: none 2024-09-12T18:01:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.438+0000 7fa84e7fc640 20 reqs_thread_entry: start 2024-09-12T18:01:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.438+0000 7fa9a3f1f800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T18:01:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.438+0000 7fa9a3f1f800 20 rados->read ofs=0 len=0 2024-09-12T18:01:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.438+0000 7fa9a3f1f800 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T18:01:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.438+0000 7fa9a3f1f800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T18:01:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.438+0000 7fa9a3f1f800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:01:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.438+0000 7fa9a3f1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.439+0000 7fa9a3f1f800 10 removing key index: UJCCIXRVKGAPYZVXAOIA 2024-09-12T18:01:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.440+0000 7fa9a3f1f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:UJCCIXRVKGAPYZVXAOIA, ofs0, ns] 2024-09-12T18:01:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.440+0000 7fa87effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464771 cookie 94077134627392 notifier 9537 bl.length()=170 2024-09-12T18:01:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.441+0000 7fa9a3f1f800 10 removing email index: tester.client.0_test@test.test 2024-09-12T18:01:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.442+0000 7fa9a3f1f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T18:01:42.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.442+0000 7fa87e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464450 cookie 94077134638688 notifier 9537 bl.length()=181 2024-09-12T18:01:42.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.442+0000 7fa9a3f1f800 10 removing user buckets index 2024-09-12T18:01:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.443+0000 7fa9a3f1f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T18:01:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.444+0000 7fa87effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464612 cookie 94077134650304 notifier 9537 bl.length()=172 2024-09-12T18:01:42.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.444+0000 7fa9a3f1f800 10 removing user index: tester.client.0 2024-09-12T18:01:42.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.445+0000 7fa9a3f1f800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T18:01:42.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.445+0000 7fa9a3f1f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T18:01:42.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.446+0000 7fa87e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986466879 cookie 94077134646272 notifier 9537 bl.length()=164 2024-09-12T18:01:42.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.447+0000 7fa8567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:42.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.449+0000 7fa9a3f1f800 20 remove_watcher() i=0 2024-09-12T18:01:42.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.449+0000 7fa9a3f1f800 2 removed watcher, disabling cache 2024-09-12T18:01:42.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.451+0000 7fa9a3f1f800 20 remove_watcher() i=1 2024-09-12T18:01:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.452+0000 7fa9a3f1f800 20 remove_watcher() i=2 2024-09-12T18:01:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.453+0000 7fa9a3f1f800 20 remove_watcher() i=3 2024-09-12T18:01:42.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.454+0000 7fa9a3f1f800 20 remove_watcher() i=4 2024-09-12T18:01:42.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.455+0000 7fa9a3f1f800 20 remove_watcher() i=5 2024-09-12T18:01:42.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.456+0000 7fa9a3f1f800 20 remove_watcher() i=6 2024-09-12T18:01:42.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:42.457+0000 7fa9a3f1f800 20 remove_watcher() i=7 2024-09-12T18:01:42.469 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T18:01:42.479 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T18:01:42.516 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T18:01:42.575 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T18:01:42.585 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T18:01:42.585 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:01:42.586 INFO:tasks.rgw.client.0.smithi044.stdout:2024-09-12T18:01:42.585+0000 7fef1ada1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 45175) UID: 0 2024-09-12T18:01:42.586 INFO:tasks.rgw.client.0.smithi044.stdout:2024-09-12T18:01:42.585+0000 7fef20520880 -1 shutting down 2024-09-12T18:01:48.687 INFO:tasks.rgw.client.0:Stopped 2024-09-12T18:01:48.687 DEBUG:teuthology.orchestra.run.smithi044:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T18:01:48.723 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T18:01:48.810 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T18:01:48.851 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T18:01:48.851 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T18:01:48.851 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T18:01:48.952 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:48.952 INFO:teuthology.orchestra.run.smithi044.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:48.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:48.988+0000 7f7bf0213800 20 rados->read ofs=0 len=0 2024-09-12T18:01:48.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:48.989+0000 7f7bf0213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:48.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:48.989+0000 7f7bf0213800 20 realm 2024-09-12T18:01:48.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:48.989+0000 7f7bf0213800 20 rados->read ofs=0 len=0 2024-09-12T18:01:48.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:48.990+0000 7f7bf0213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:48.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:48.990+0000 7f7bf0213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:48.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:48.990+0000 7f7bf0213800 20 rados->read ofs=0 len=0 2024-09-12T18:01:48.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:48.990+0000 7f7bf0213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:48.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:48.990+0000 7f7bf0213800 20 rados->read ofs=0 len=0 2024-09-12T18:01:48.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:48.991+0000 7f7bf0213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:48.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:48.991+0000 7f7bf0213800 20 rados->read ofs=0 len=0 2024-09-12T18:01:48.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:48.991+0000 7f7bf0213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:48.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:48.991+0000 7f7bf0213800 20 searching for the correct realm 2024-09-12T18:01:48.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:48.994+0000 7f7beb121640 0 -- 172.21.15.44:0/3019346837 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f7ab4086ff0 msgr2=0x7f7ab4089420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:49.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.200+0000 7f7beb922640 0 -- 172.21.15.44:0/3019346837 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x7f7be0068f10 msgr2=0x7f7be0082130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:49.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.407+0000 7f7bf0213800 20 RGWRados::pool_iterate: got zonegroup_info.143eb2b4-bc00-4aa1-810e-65d175e63c70 2024-09-12T18:01:49.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.407+0000 7f7bf0213800 20 RGWRados::pool_iterate: got zone_info.fe33886c-9948-4f8e-85ed-a04bdce9353e 2024-09-12T18:01:49.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.407+0000 7f7bf0213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:49.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.407+0000 7f7bf0213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:49.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.407+0000 7f7bf0213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:49.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.407+0000 7f7bf0213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:49.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.407+0000 7f7bf0213800 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.408+0000 7f7bf0213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.408+0000 7f7bf0213800 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.408+0000 7f7bf0213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.408+0000 7f7bf0213800 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.408+0000 7f7bf0213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.408+0000 7f7bf0213800 20 zone default found 2024-09-12T18:01:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.408+0000 7f7bf0213800 4 Realm: () 2024-09-12T18:01:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.408+0000 7f7bf0213800 4 ZoneGroup: default (143eb2b4-bc00-4aa1-810e-65d175e63c70) 2024-09-12T18:01:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.408+0000 7f7bf0213800 4 Zone: default (fe33886c-9948-4f8e-85ed-a04bdce9353e) 2024-09-12T18:01:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.408+0000 7f7bf0213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.408+0000 7f7bf0213800 20 zonegroup default 2024-09-12T18:01:49.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.408+0000 7f7bf0213800 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.409+0000 7f7bf0213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.409+0000 7f7bf0213800 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.409+0000 7f7bf0213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.409+0000 7f7bf0213800 20 rados->read ofs=0 len=0 2024-09-12T18:01:49.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.409+0000 7f7bf0213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:49.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.409+0000 7f7bf0213800 20 started sync module instance, tier type = 2024-09-12T18:01:49.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.409+0000 7f7bf0213800 20 started zone id=fe33886c-9948-4f8e-85ed-a04bdce9353e (name=default) with tier type = 2024-09-12T18:01:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.420+0000 7f7bf0213800 20 add_watcher() i=0 2024-09-12T18:01:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.420+0000 7f7bf0213800 20 add_watcher() i=1 2024-09-12T18:01:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.420+0000 7f7bf0213800 20 add_watcher() i=2 2024-09-12T18:01:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.420+0000 7f7bf0213800 20 add_watcher() i=3 2024-09-12T18:01:49.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.420+0000 7f7bf0213800 20 add_watcher() i=4 2024-09-12T18:01:49.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.420+0000 7f7bf0213800 20 add_watcher() i=5 2024-09-12T18:01:49.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.420+0000 7f7bf0213800 20 add_watcher() i=6 2024-09-12T18:01:49.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.421+0000 7f7bf0213800 20 add_watcher() i=7 2024-09-12T18:01:49.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.421+0000 7f7bf0213800 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:49.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.423+0000 7f7aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:49.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.423+0000 7f7bf0213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:49.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.423+0000 7f7bf0213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.463+0000 7f7aa0fe1640 20 reqs_thread_entry: start 2024-09-12T18:01:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.463+0000 7f7bf0213800 20 init_complete bucket index max shards: 11 2024-09-12T18:01:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.463+0000 7f7bf0213800 20 Filter name: none 2024-09-12T18:01:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.463+0000 7f7a1a7fc640 20 reqs_thread_entry: start 2024-09-12T18:01:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.463+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:01:49.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.464+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:49.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.465+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:49.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46816' 2024-09-12T18:01:49.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18195993541255412221', time=2024-09-12T19:52:55.221117+0000, chain.objs.size()=1 2024-09-12T18:01:49.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.161__shadow_.CqokP_qJT27SofiQo7rth_Vd9ZyeV99_0 2024-09-12T18:01:49.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14462123907628381071', time=2024-09-12T19:54:00.082771+0000, chain.objs.size()=1 2024-09-12T18:01:49.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.234__shadow_.MC1ip4RQcNxsoOOERBEaqdojAeq-BPk_0 2024-09-12T18:01:49.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17230438237986724136', time=2024-09-12T19:54:03.216179+0000, chain.objs.size()=1 2024-09-12T18:01:49.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.248__shadow_.Sy6O-tyR3GXovcOVAnArSSFypVt5m71_0 2024-09-12T18:01:49.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7772334896767522966', time=2024-09-12T19:54:13.490262+0000, chain.objs.size()=1 2024-09-12T18:01:49.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.XqZpqZsXxT__KEQVDtvZ7ENtxf_KbaW_0 2024-09-12T18:01:49.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14902854566624380307', time=2024-09-12T19:54:13.501920+0000, chain.objs.size()=1 2024-09-12T18:01:49.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.TYcASl4DiQwcrqZ3zoFD-JT_wyyoWER_0 2024-09-12T18:01:49.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4179846911110103490', time=2024-09-12T19:54:13.516357+0000, chain.objs.size()=1 2024-09-12T18:01:49.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.d_VF8lMeVLaFSXRVpsfBEa_-RbweIYn_0 2024-09-12T18:01:49.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17143146899415390641', time=2024-09-12T19:54:13.521059+0000, chain.objs.size()=1 2024-09-12T18:01:49.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.UqDBf9cH_e-EHQlFLsEAF1QhvPA64Hl_0 2024-09-12T18:01:49.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12677457616953852993', time=2024-09-12T19:54:13.524988+0000, chain.objs.size()=1 2024-09-12T18:01:49.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.QADFfCe1uhaVAGAF9qXciWCgM6kmSUt_0 2024-09-12T18:01:49.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.454860453909953239', time=2024-09-12T19:54:13.540230+0000, chain.objs.size()=1 2024-09-12T18:01:49.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.kpU6MZ5k5wIZqP3SYMqgz2bXdU9fvQI_0 2024-09-12T18:01:49.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16487470555667446748', time=2024-09-12T19:54:13.545176+0000, chain.objs.size()=1 2024-09-12T18:01:49.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.gRsktAJ-JpmdV3gext6XyP6HG94EvAZ_0 2024-09-12T18:01:49.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15188379490163834292', time=2024-09-12T19:54:13.685937+0000, chain.objs.size()=1 2024-09-12T18:01:49.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.32INEIDBOR8Cy-pQ3kyQcSwlQaKgNG__0 2024-09-12T18:01:49.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2858406445463165385', time=2024-09-12T19:54:13.846509+0000, chain.objs.size()=1 2024-09-12T18:01:49.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.PIeNKJsiZaJSPNEn8SZiC5RPTcMCVeI_0 2024-09-12T18:01:49.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.468+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8257885646875758940', time=2024-09-12T19:54:13.865106+0000, chain.objs.size()=1 2024-09-12T18:01:49.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.468+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.q4aJKd07jjzItwTISWcoh9pk2GNFTYz_0 2024-09-12T18:01:49.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.469+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2275599439280962180', time=2024-09-12T19:54:13.902170+0000, chain.objs.size()=1 2024-09-12T18:01:49.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.469+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.uhElJA3MfVbAi_uiS6yLMtQCBGwzz73_0 2024-09-12T18:01:49.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.469+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.747070780437548945', time=2024-09-12T19:54:14.006841+0000, chain.objs.size()=1 2024-09-12T18:01:49.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.469+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.MNc9woUP4eLgQwzc0z45HLrOJvB-MKe_0 2024-09-12T18:01:49.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.469+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6391197002334188467', time=2024-09-12T19:54:14.010124+0000, chain.objs.size()=1 2024-09-12T18:01:49.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.469+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.V4EuYlHNI0dgJ2kF7vdYe3ijjzld1bt_0 2024-09-12T18:01:49.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.469+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.618541040057245969', time=2024-09-12T19:54:14.033784+0000, chain.objs.size()=1 2024-09-12T18:01:49.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.469+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.5q_euouzwcUuqSbC9ibqEWmQ1Glb3Ey_0 2024-09-12T18:01:49.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.469+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8364670957317900862', time=2024-09-12T19:54:14.050117+0000, chain.objs.size()=1 2024-09-12T18:01:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.469+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.uQtVVRKUsn4AfHlBYfHFmCGHY-TLAxX_0 2024-09-12T18:01:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.469+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12589875728013713151', time=2024-09-12T19:54:14.294322+0000, chain.objs.size()=1 2024-09-12T18:01:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.469+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2ORJrLzbnSyketlNkZ_3RmZl2vT4L2o_0 2024-09-12T18:01:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.469+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17395816932199804757', time=2024-09-12T19:54:14.372156+0000, chain.objs.size()=1 2024-09-12T18:01:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.469+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.kNWJAZTlU5gXGBWn8Ko3mj_7cr7EQ64_0 2024-09-12T18:01:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.469+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16362371138020947712', time=2024-09-12T19:54:14.428862+0000, chain.objs.size()=1 2024-09-12T18:01:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.469+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.TwzTJFU2FuPWfhTO_CfNobRGnYfwU4e_0 2024-09-12T18:01:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.470+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5327672726246140187', time=2024-09-12T19:54:14.447525+0000, chain.objs.size()=1 2024-09-12T18:01:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.470+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.MbGxwbLCiV8ZhfC4akXUUKRQj378Hen_0 2024-09-12T18:01:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.470+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2558072113983864234', time=2024-09-12T19:54:14.464352+0000, chain.objs.size()=1 2024-09-12T18:01:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.470+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.pf9lc_H9imlfH-fmodLbJfWJvUWIiIz_0 2024-09-12T18:01:49.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.471+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.222616723875566559', time=2024-09-12T19:54:14.586539+0000, chain.objs.size()=1 2024-09-12T18:01:49.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.471+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.4wRNNvup-kXb91xPjkUcRQAKyWqaojr_0 2024-09-12T18:01:49.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10551002483577967535', time=2024-09-12T19:54:14.709817+0000, chain.objs.size()=1 2024-09-12T18:01:49.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ZIMa-h6Mh4SAXupn4d8CfhwkgnFfgf0_0 2024-09-12T18:01:49.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8631200762604292861', time=2024-09-12T19:54:14.714484+0000, chain.objs.size()=1 2024-09-12T18:01:49.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.9pYPQNjIS-vnaklsl7oAlJjQKrGd3Tm_0 2024-09-12T18:01:49.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1446120669729990205', time=2024-09-12T19:54:14.766688+0000, chain.objs.size()=1 2024-09-12T18:01:49.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.hEFWBmXc7CA1vFgi0n8z8P32K2loU1O_0 2024-09-12T18:01:49.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9765059202580670463', time=2024-09-12T19:54:14.880797+0000, chain.objs.size()=1 2024-09-12T18:01:49.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.eX8liHizf6i15C1TxKBYu3Zx4pW4AvK_0 2024-09-12T18:01:49.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6954689958528536491', time=2024-09-12T19:54:14.928386+0000, chain.objs.size()=1 2024-09-12T18:01:49.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.7At0X3CnedR2VlV7ExgQcGJgZKoOTRl_0 2024-09-12T18:01:49.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3965660962625970232', time=2024-09-12T19:54:15.939216+0000, chain.objs.size()=1 2024-09-12T18:01:49.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.268__shadow_.-m9eqDDcpXsDO57O0EPEiJOMTGAeX5h_0 2024-09-12T18:01:49.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8373649663154949819', time=2024-09-12T19:54:19.058651+0000, chain.objs.size()=1 2024-09-12T18:01:49.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.283__shadow_.In2rQNLp493dAq3BIHpuh4h8JAH_BJe_0 2024-09-12T18:01:49.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11423730728982265255', time=2024-09-12T19:54:19.708866+0000, chain.objs.size()=1 2024-09-12T18:01:49.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.286__shadow_.TBy6KlRutukcon7gKCYwageHtPl32uW_0 2024-09-12T18:01:49.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4645110007540059068', time=2024-09-12T19:54:21.578319+0000, chain.objs.size()=1 2024-09-12T18:01:49.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.a7qdy0a4_JonJAi9omkVa7VYBK9YfH-_0 2024-09-12T18:01:49.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4381082051019048781', time=2024-09-12T19:54:22.161943+0000, chain.objs.size()=1 2024-09-12T18:01:49.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.v-Sbsqq8Tuc3V4DqHIag_hwknVeBYhG_0 2024-09-12T18:01:49.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.590029170466121335', time=2024-09-12T19:54:22.627444+0000, chain.objs.size()=1 2024-09-12T18:01:49.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.472+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.296__shadow_.g920LT8CoNYNR72p5og4Ul16Qo_iOqc_0 2024-09-12T18:01:49.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.474+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9224592972467542000', time=2024-09-12T19:54:23.323284+0000, chain.objs.size()=1 2024-09-12T18:01:49.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.474+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.299__shadow_.ChZ6JlD3qo2F0V1i-a-TKV9XW32v0wl_0 2024-09-12T18:01:49.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.474+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14241109640000942136', time=2024-09-12T19:54:23.771120+0000, chain.objs.size()=1 2024-09-12T18:01:49.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.474+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.301__shadow_.tR7hxtZTMD0IP8GQeXUncI4qxPdqBrP_0 2024-09-12T18:01:49.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.474+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4803051022913777097', time=2024-09-12T19:54:35.788190+0000, chain.objs.size()=1 2024-09-12T18:01:49.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.474+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.dEvdUBwmF4Wn4fHdnTn7HkNIQU4GLIz_0 2024-09-12T18:01:49.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.474+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9225210988737941764', time=2024-09-12T19:54:35.819551+0000, chain.objs.size()=1 2024-09-12T18:01:49.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.474+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.X4peND-r3hf_vFaDvZmegWtGT-PSPnY_0 2024-09-12T18:01:49.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.474+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9968364981754036879', time=2024-09-12T19:54:35.822002+0000, chain.objs.size()=1 2024-09-12T18:01:49.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.474+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.b_yTfV6SIe26s6XYGUpJnUdkCGSwLat_0 2024-09-12T18:01:49.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.475+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1066627764285408791', time=2024-09-12T19:54:35.836728+0000, chain.objs.size()=1 2024-09-12T18:01:49.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.475+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.v8fwL2PPE31mWwsEoA2YwnN8TZ1HdNg_0 2024-09-12T18:01:49.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.475+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7789549900354964738', time=2024-09-12T19:54:35.920273+0000, chain.objs.size()=1 2024-09-12T18:01:49.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.475+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.an3sxNS-bxCr1sAQiyDi6TKO3HlwaWo_0 2024-09-12T18:01:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.475+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7828081919012873815', time=2024-09-12T19:54:35.948166+0000, chain.objs.size()=1 2024-09-12T18:01:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.475+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.A1d980SLpLb0066CwAq0l59TfdPFHXB_0 2024-09-12T18:01:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.476+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13165932130946504296', time=2024-09-12T19:54:35.963814+0000, chain.objs.size()=1 2024-09-12T18:01:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.476+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.2oZf0M7fz9Ia2mqJm_uo2kIJ_3kxLb2_0 2024-09-12T18:01:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.476+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2253707274196620638', time=2024-09-12T19:54:36.088399+0000, chain.objs.size()=1 2024-09-12T18:01:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.476+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.xFYTn1gn7OsldFhZbNOzRwcOQZ45Yst_0 2024-09-12T18:01:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.476+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1852633425875864607', time=2024-09-12T19:54:36.114172+0000, chain.objs.size()=1 2024-09-12T18:01:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.476+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.DcPrVjlsrLYVMyPrO4in4kmG84baDkh_0 2024-09-12T18:01:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.476+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9795746707028347492', time=2024-09-12T19:54:36.251633+0000, chain.objs.size()=1 2024-09-12T18:01:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.476+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9x25zLzDAykIirY5ygV9PVNsILKYw9Q_0 2024-09-12T18:01:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.476+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.411918817951597750', time=2024-09-12T19:54:36.262985+0000, chain.objs.size()=1 2024-09-12T18:01:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.476+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.5nSxkcXdB-piXRVmYtj74OL1jshtL8z_0 2024-09-12T18:01:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.476+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4262057182004302457', time=2024-09-12T19:54:36.454254+0000, chain.objs.size()=1 2024-09-12T18:01:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.476+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ghE-RvFj9dvZPlvR-zI6asNshcm2f-M_0 2024-09-12T18:01:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.476+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5177894377274782962', time=2024-09-12T19:54:36.493134+0000, chain.objs.size()=1 2024-09-12T18:01:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.476+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.tRFdhQZvLjNAB0kv-iaiVlCY9laGeD-_0 2024-09-12T18:01:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.477+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6775858552671878202', time=2024-09-12T19:54:36.495615+0000, chain.objs.size()=1 2024-09-12T18:01:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.477+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.LicRdO49znkSpuv_Yq11f5rECuFvlUD_0 2024-09-12T18:01:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.477+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9312090724487433755', time=2024-09-12T19:54:36.584513+0000, chain.objs.size()=1 2024-09-12T18:01:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.477+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.TQuR-swtQb766qH7xlyNRONP3hC7JOp_0 2024-09-12T18:01:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.477+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3496635232799595330', time=2024-09-12T19:54:36.624210+0000, chain.objs.size()=1 2024-09-12T18:01:49.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.477+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.bbgE5KjjZxJdELMl_NstfKzdU-Ff2oK_0 2024-09-12T18:01:49.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.479+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8642893425826499953', time=2024-09-12T19:54:36.653100+0000, chain.objs.size()=1 2024-09-12T18:01:49.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.479+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ePPY3b768S3WwV0YwqAPKlJX2UUkMyS_0 2024-09-12T18:01:49.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.479+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7833478196806516489', time=2024-09-12T19:54:36.657297+0000, chain.objs.size()=1 2024-09-12T18:01:49.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.479+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4PaKGOks9ud_nfwyWcNIKcO1LZLFcU0_0 2024-09-12T18:01:49.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.479+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5034638244879644441', time=2024-09-12T19:54:36.785656+0000, chain.objs.size()=1 2024-09-12T18:01:49.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.479+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.EscpkoNHZl7LYVz2OkPwUfEEH4rxSVk_0 2024-09-12T18:01:49.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.479+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16214298705427042292', time=2024-09-12T19:54:36.792222+0000, chain.objs.size()=1 2024-09-12T18:01:49.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.479+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.XwmOAddNGxczF1hixVWsrnUJCeq0uPb_0 2024-09-12T18:01:49.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.479+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6184088356343398965', time=2024-09-12T19:54:36.796643+0000, chain.objs.size()=1 2024-09-12T18:01:49.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.479+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.UXIOZ_8H2gX-tTzHtBBdNCR6ingRKrP_0 2024-09-12T18:01:49.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.479+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15267295695080471716', time=2024-09-12T19:54:36.953672+0000, chain.objs.size()=1 2024-09-12T18:01:49.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.479+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.O68iOUoiKhhVZXrGokDt-EsouW7O83Z_0 2024-09-12T18:01:49.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10919923534204335670', time=2024-09-12T19:54:44.455197+0000, chain.objs.size()=1 2024-09-12T18:01:49.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.mZbcWj2NTlRBU0jFKaHLLPaKIcQWfAH_0 2024-09-12T18:01:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.76173245537878330', time=2024-09-12T19:54:44.482022+0000, chain.objs.size()=1 2024-09-12T18:01:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.4zccqPff3sTn9K4TN2rxT8i3jtoqnJL_0 2024-09-12T18:01:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9473203172825327956', time=2024-09-12T19:54:44.488115+0000, chain.objs.size()=1 2024-09-12T18:01:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.YlNZKEx1lARRb9XvEkzJYIN1lyJiyQK_0 2024-09-12T18:01:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11792697317355739255', time=2024-09-12T19:54:44.490986+0000, chain.objs.size()=1 2024-09-12T18:01:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ua9Pedn7GciP5vsqPJoKvyIVN3_9rIh_0 2024-09-12T18:01:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13864037360559625875', time=2024-09-12T19:54:44.496970+0000, chain.objs.size()=1 2024-09-12T18:01:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.xJ6lfeTXiMiyhLzhZOsAwA_oR3OxdxO_0 2024-09-12T18:01:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4656531943970141456', time=2024-09-12T19:54:44.497987+0000, chain.objs.size()=1 2024-09-12T18:01:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.MVTLnlvbWSVAvbS3b7T85kT7Fei6Ak0_0 2024-09-12T18:01:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8520724495888351395', time=2024-09-12T19:54:44.527614+0000, chain.objs.size()=1 2024-09-12T18:01:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.e4FCfm1Fhu87TFEazYuTlsKUylAo6M6_0 2024-09-12T18:01:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12765303206064635323', time=2024-09-12T19:54:44.538806+0000, chain.objs.size()=1 2024-09-12T18:01:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.C_WQh2i_KD1Eq3Pw5fICXDYFbQneEKM_0 2024-09-12T18:01:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17918076919761346196', time=2024-09-12T19:54:44.540647+0000, chain.objs.size()=1 2024-09-12T18:01:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.480+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.HcHaVbmdGXQeqUHx2EwI5wdPz6ulErL_0 2024-09-12T18:01:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.482+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2784447229942455443', time=2024-09-12T19:54:44.548807+0000, chain.objs.size()=1 2024-09-12T18:01:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.482+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.SwnzQxllfn7pIFjTiJr2x2vFxfifvAe_0 2024-09-12T18:01:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6174968439466562540', time=2024-09-12T19:54:44.661795+0000, chain.objs.size()=1 2024-09-12T18:01:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.xLKJq8D4PzRXTDPbXJcQ20LUd3VSXI__0 2024-09-12T18:01:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12578946673002634217', time=2024-09-12T19:54:44.693177+0000, chain.objs.size()=1 2024-09-12T18:01:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.07k3l68poWiYoPeZSDdDaU-LuCsK7xm_0 2024-09-12T18:01:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7450892029561748556', time=2024-09-12T19:54:44.834761+0000, chain.objs.size()=1 2024-09-12T18:01:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Y8FbhAJ0fACBBOYzsAjg3klKIqCrJ_Q_0 2024-09-12T18:01:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3121889385696657930', time=2024-09-12T19:54:44.859992+0000, chain.objs.size()=1 2024-09-12T18:01:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.qoJPzFPPtHgt2n1yggFHvuVF_wc4HT1_0 2024-09-12T18:01:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16596552654351731125', time=2024-09-12T19:54:44.888798+0000, chain.objs.size()=1 2024-09-12T18:01:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.DEZbjRbcIcgT75hjIEMZIJmmlhDFHQ4_0 2024-09-12T18:01:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13707307537588967522', time=2024-09-12T19:54:44.978138+0000, chain.objs.size()=1 2024-09-12T18:01:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.SyKbz3FEywdLiI2-1WexUXbAjlfnDNs_0 2024-09-12T18:01:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12775081982522987119', time=2024-09-12T19:54:45.016097+0000, chain.objs.size()=1 2024-09-12T18:01:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.39q4YeZu7xtdBq1RP65hvvF2VrqKnB4_0 2024-09-12T18:01:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12961181238588217466', time=2024-09-12T19:54:45.025656+0000, chain.objs.size()=1 2024-09-12T18:01:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.lox4VPheRbmuq3_L1bXzN5-knvTNXue_0 2024-09-12T18:01:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5237599315870280303', time=2024-09-12T19:54:45.187257+0000, chain.objs.size()=1 2024-09-12T18:01:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.484+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.JXoWhCuumke4B-_E9mcBBf8IP-0DwD4_0 2024-09-12T18:01:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.487+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6515547842125229892', time=2024-09-12T19:54:45.247194+0000, chain.objs.size()=1 2024-09-12T18:01:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.487+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.YYOchzVPyWBSbqG4DEHG9uQNWiUxL77_0 2024-09-12T18:01:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.487+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3451685449840001016', time=2024-09-12T19:54:45.260675+0000, chain.objs.size()=1 2024-09-12T18:01:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.487+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.xxdIfX0xM5prv6tYuYVDRCae9t1zLkY_0 2024-09-12T18:01:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.487+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4639705743192248493', time=2024-09-12T19:54:45.356673+0000, chain.objs.size()=1 2024-09-12T18:01:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.487+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.SFKocEiyEtcBvqogcZzUeWNrKjCEJ75_0 2024-09-12T18:01:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.487+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13542581187441027870', time=2024-09-12T19:54:45.386051+0000, chain.objs.size()=1 2024-09-12T18:01:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.487+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jTlHR9J0XDy_XdsAuTp5F2NjwmSkUTg_0 2024-09-12T18:01:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.487+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1457992743730042729', time=2024-09-12T19:54:45.420531+0000, chain.objs.size()=1 2024-09-12T18:01:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.487+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.knwiLBM-4-oKC3jgHHsqwnXJgN9KLtq_0 2024-09-12T18:01:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.488+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16759376703500776222', time=2024-09-12T19:54:45.509061+0000, chain.objs.size()=1 2024-09-12T18:01:49.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.488+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.XVWS6dJQOQjPEDOV3w0Xxal2sitWhBZ_0 2024-09-12T18:01:49.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.488+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7787635382225993066', time=2024-09-12T19:54:45.518324+0000, chain.objs.size()=1 2024-09-12T18:01:49.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.488+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.1lefyisioIbs9joavlJvTtNIO-MV37B_0 2024-09-12T18:01:49.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.488+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2497325321986044884', time=2024-09-12T19:54:45.529885+0000, chain.objs.size()=1 2024-09-12T18:01:49.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.488+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-BqkIbbFR5lHaEmTxhUoJ4NOOOrGXU9_0 2024-09-12T18:01:49.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.488+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10431753471350922983', time=2024-09-12T19:54:45.545199+0000, chain.objs.size()=1 2024-09-12T18:01:49.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.488+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.fCNrU3_XvSucsF4OsQoU3q6vXJBgmED_0 2024-09-12T18:01:49.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.488+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9579011297546289058', time=2024-09-12T19:54:45.565186+0000, chain.objs.size()=1 2024-09-12T18:01:49.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.488+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.F9LmKs3lQTY2lN7mYbDEZGppt2VsNdA_0 2024-09-12T18:01:49.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.488+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6473007939076633919', time=2024-09-12T19:54:45.576087+0000, chain.objs.size()=1 2024-09-12T18:01:49.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.488+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.pKEF7id_N6Hs0AJk2Oto_7wgw80-9lu_0 2024-09-12T18:01:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.489+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14370794357664963414', time=2024-09-12T19:54:45.591113+0000, chain.objs.size()=1 2024-09-12T18:01:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Mwj84nRoWQVC9SyPbW72NX_tILK6Mc6_0 2024-09-12T18:01:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7045601516856264969', time=2024-09-12T19:54:45.689955+0000, chain.objs.size()=1 2024-09-12T18:01:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TW7w3C7dNnaLkYUBA5zfbQPNwzPqcXG_0 2024-09-12T18:01:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18039298267272058539', time=2024-09-12T19:54:45.700151+0000, chain.objs.size()=1 2024-09-12T18:01:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.L9K_jicYe_bZUJFt3bQOeuTPjf7GVs-_0 2024-09-12T18:01:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4700938022765011618', time=2024-09-12T19:54:45.701130+0000, chain.objs.size()=1 2024-09-12T18:01:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.j7Zth6TknCuWo-NMVK5mxzzGgswZ2hS_0 2024-09-12T18:01:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15183963819059610873', time=2024-09-12T19:54:45.746942+0000, chain.objs.size()=1 2024-09-12T18:01:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-AKPXWVSQrxJaZwjgWTbFY_JFV_2fqH_0 2024-09-12T18:01:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9322722204655724579', time=2024-09-12T19:54:46.850255+0000, chain.objs.size()=1 2024-09-12T18:01:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.331__shadow_.h6zW8w3GeY3jcSyVtxo05fapxUmjwXp_0 2024-09-12T18:01:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4071674792120323298', time=2024-09-12T19:54:55.682549+0000, chain.objs.size()=1 2024-09-12T18:01:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.377__shadow_.YxQHWLyGDldLW938IQ5ra8cpITEEtjm_0 2024-09-12T18:01:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6655296605912795386', time=2024-09-12T19:55:11.590630+0000, chain.objs.size()=1 2024-09-12T18:01:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.445__shadow_.ao1ylOMbVyTTx5xvM5ZqsMtvo6-YT58_0 2024-09-12T18:01:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4776396391172041266', time=2024-09-12T19:55:17.028706+0000, chain.objs.size()=1 2024-09-12T18:01:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.464__shadow_.JNzYdCi4x4-06SkbZyw2zPErHyq0rQX_0 2024-09-12T18:01:49.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15382321649813923325', time=2024-09-12T19:55:28.739594+0000, chain.objs.size()=1 2024-09-12T18:01:49.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.514__multipart_mymultipart.2~dcb3g76cEE2PaTlGWhfQbm_oWFp7Lw4.1 2024-09-12T18:01:49.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1743027249033512851', time=2024-09-12T19:56:14.970348+0000, chain.objs.size()=1 2024-09-12T18:01:49.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.562__multipart_mymultipart.2~nX3slx-LTpeoR2C76aeikqdaJ-Uv_0N.1 2024-09-12T18:01:49.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.498+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/46816 2024-09-12T18:01:49.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T18:01:49.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15357170375764410980', time=2024-09-12T19:56:21.722173+0000, chain.objs.size()=1 2024-09-12T18:01:49.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:3bb2xWHkVZ0BFvOjR-Kzp1kp97jgv5K_.NweMDuilUMLs69SPHj05xQVRcgCKM-h_0 2024-09-12T18:01:49.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9279992980114675773', time=2024-09-12T19:56:30.636440+0000, chain.objs.size()=1 2024-09-12T18:01:49.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.575__shadow:IZg7UvTAqavYKg8foDynNabw0oulX3C_.L-tc9AypscC8ebIb5RAs6RM-TZNP1B6_0 2024-09-12T18:01:49.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6189403424259894185', time=2024-09-12T19:56:40.410477+0000, chain.objs.size()=1 2024-09-12T18:01:49.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:SadgaC6FjJuxLmaWJ5kZCeXVPrYXSrh_.nyXtA72ypwau2ZNwKZOv7p83IDupmKX_0 2024-09-12T18:01:49.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16332123267718525196', time=2024-09-12T19:56:56.487907+0000, chain.objs.size()=1 2024-09-12T18:01:49.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.606__shadow_.FhKQIdPRCEQTr9Vee7XdNpA3komq4G0_0 2024-09-12T18:01:49.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2274925216481189241', time=2024-09-12T19:59:03.351424+0000, chain.objs.size()=1 2024-09-12T18:01:49.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.620__shadow_.yGcja51Gc_7Mh4KKlgwHGBsOSy_k6JT_0 2024-09-12T18:01:49.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~qA4tqIWny_JUl8zqpDhMx1X6uoyGLGe', time=2024-09-12T19:59:05.803388+0000, chain.objs.size()=6 2024-09-12T18:01:49.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.625__multipart_multipart_enc.2~qA4tqIWny_JUl8zqpDhMx1X6uoyGLGe.1 2024-09-12T18:01:49.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.625__multipart_multipart_enc.2~qA4tqIWny_JUl8zqpDhMx1X6uoyGLGe.2 2024-09-12T18:01:49.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.625__multipart_multipart_enc.2~qA4tqIWny_JUl8zqpDhMx1X6uoyGLGe.3 2024-09-12T18:01:49.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.625__multipart_multipart_enc.2~qA4tqIWny_JUl8zqpDhMx1X6uoyGLGe.4 2024-09-12T18:01:49.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.625__multipart_multipart_enc.2~qA4tqIWny_JUl8zqpDhMx1X6uoyGLGe.5 2024-09-12T18:01:49.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.625__multipart_multipart_enc.2~qA4tqIWny_JUl8zqpDhMx1X6uoyGLGe.6 2024-09-12T18:01:49.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4148399547987072435', time=2024-09-12T19:59:17.821795+0000, chain.objs.size()=1 2024-09-12T18:01:49.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.500+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.666__shadow_.20MioiCdAjLS6-TIv5gYrIyQj1fLYCA_0 2024-09-12T18:01:49.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.502+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9521414250905571033', time=2024-09-12T19:59:19.476532+0000, chain.objs.size()=1 2024-09-12T18:01:49.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.502+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.673__shadow_.paaLewoJ2aBRwiCWnJgFriGi-slU_dD_0 2024-09-12T18:01:49.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.502+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6012844496940233585', time=2024-09-12T19:59:27.252569+0000, chain.objs.size()=1 2024-09-12T18:01:49.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.502+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.710__shadow_.A9zjeUhNyvXb4tUJ2VBjEvgsAcagvld_0 2024-09-12T18:01:49.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.503+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11017404436005723937', time=2024-09-12T19:59:48.025616+0000, chain.objs.size()=1 2024-09-12T18:01:49.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.503+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.718__shadow:nfHht6HjjcqBq29g2Q6iX-NfrDPaHrq_.KI0PtZBBTW7LHnUrjjrRKH2NrGl90wY_0 2024-09-12T18:01:49.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.503+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16355716704136838704', time=2024-09-12T19:59:56.777178+0000, chain.objs.size()=1 2024-09-12T18:01:49.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.503+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.746__shadow_.4HXOmJPMaPx5ichs04H8syJcnzNnxmV_0 2024-09-12T18:01:49.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.508+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.510+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:01:49.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.512+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:49.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.512+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:49.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50407' 2024-09-12T18:01:49.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15294036512457904602', time=2024-09-12T19:53:10.954260+0000, chain.objs.size()=1 2024-09-12T18:01:49.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.205__shadow_.hpC6WMxtvZGIOY3X1aZ3RbHoFHI-Lmx_0 2024-09-12T18:01:49.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8805063234667504082', time=2024-09-12T19:54:01.847785+0000, chain.objs.size()=1 2024-09-12T18:01:49.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.242__shadow_.Rs068S3cQqM5i42df-NYMizh509w-v1_0 2024-09-12T18:01:49.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8165875506773742005', time=2024-09-12T19:54:02.565834+0000, chain.objs.size()=1 2024-09-12T18:01:49.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.245__shadow_.zZw6Wkj8VO77W64jF27I-FbwGbERSIS_0 2024-09-12T18:01:49.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15005465129743136780', time=2024-09-12T19:54:04.471132+0000, chain.objs.size()=1 2024-09-12T18:01:49.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.254__shadow_.dzLd3-6a8hUzRSmB0wsxRqau1TtlUfh_0 2024-09-12T18:01:49.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8491482525535666762', time=2024-09-12T19:54:13.486312+0000, chain.objs.size()=1 2024-09-12T18:01:49.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.F6Y7MCpQKIKdfOmfBjL5fpVHBidAHa5_0 2024-09-12T18:01:49.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16991953839423026123', time=2024-09-12T19:54:13.497160+0000, chain.objs.size()=1 2024-09-12T18:01:49.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.OpKO-RW78ZmYW8yBGjdp2lalxG-HzZG_0 2024-09-12T18:01:49.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14934679919892162510', time=2024-09-12T19:54:13.532438+0000, chain.objs.size()=1 2024-09-12T18:01:49.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.YIYI2QPxCHN5PlUfB-d2axm_aiUx_1j_0 2024-09-12T18:01:49.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17966993385167919342', time=2024-09-12T19:54:13.562578+0000, chain.objs.size()=1 2024-09-12T18:01:49.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.s0FCAkuaPywJgJWMtD_ZsZmTTRMB1Q0_0 2024-09-12T18:01:49.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9556369158731195455', time=2024-09-12T19:54:13.679562+0000, chain.objs.size()=1 2024-09-12T18:01:49.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.TiycqzbMtviJv3XyZlKVu8C5SqYxBjG_0 2024-09-12T18:01:49.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11322902700762122721', time=2024-09-12T19:54:13.695755+0000, chain.objs.size()=1 2024-09-12T18:01:49.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.mFSzvu2JFB099lit9EBFmPUNjvYSzCY_0 2024-09-12T18:01:49.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8628424008010888100', time=2024-09-12T19:54:13.705055+0000, chain.objs.size()=1 2024-09-12T18:01:49.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.fuwtMEIDwNnYgypiAya9ljNX0M_33Qv_0 2024-09-12T18:01:49.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7929934339309171821', time=2024-09-12T19:54:13.720620+0000, chain.objs.size()=1 2024-09-12T18:01:49.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.513+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.59OEkdr-mTN1xevKfvym-8dIx2T2GGu_0 2024-09-12T18:01:49.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.515+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7926675524551546273', time=2024-09-12T19:54:13.723841+0000, chain.objs.size()=1 2024-09-12T18:01:49.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.515+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.YFXkmhRigNyRXtk3U4hZ7GphyrKUU4H_0 2024-09-12T18:01:49.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.515+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6422887011533403992', time=2024-09-12T19:54:13.748204+0000, chain.objs.size()=1 2024-09-12T18:01:49.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.515+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.BIk7psuNlfn0GiE277kAq-xx_tONcXJ_0 2024-09-12T18:01:49.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.515+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2878874293756956559', time=2024-09-12T19:54:13.752777+0000, chain.objs.size()=1 2024-09-12T18:01:49.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.515+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.za13tjZ2Oy1JwFg-UeXMS_2YRPVRT94_0 2024-09-12T18:01:49.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.515+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6232159153251533917', time=2024-09-12T19:54:13.833545+0000, chain.objs.size()=1 2024-09-12T18:01:49.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.515+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.GJpdvfa3-erlCabWtyjNo_C78_J7ADz_0 2024-09-12T18:01:49.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.515+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3165573167746614295', time=2024-09-12T19:54:13.834428+0000, chain.objs.size()=1 2024-09-12T18:01:49.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.515+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.jBkNfGWWKKlG_QcO3B9SLKkypT6MZYM_0 2024-09-12T18:01:49.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.516+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9292909830265183645', time=2024-09-12T19:54:13.849350+0000, chain.objs.size()=1 2024-09-12T18:01:49.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.516+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.hKzVvbMawSEh2m0Y-KzGP9Bz8QYt6K1_0 2024-09-12T18:01:49.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.516+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17877312894359959862', time=2024-09-12T19:54:13.855245+0000, chain.objs.size()=1 2024-09-12T18:01:49.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.516+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ZS6tr-G-HW5sLrUpVr4tc61KZHVSPVr_0 2024-09-12T18:01:49.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.516+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5340434365801390678', time=2024-09-12T19:54:13.857451+0000, chain.objs.size()=1 2024-09-12T18:01:49.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.516+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.rqr5FjKFwYrR3-CkzX-Yvg4y7a5FpOs_0 2024-09-12T18:01:49.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.516+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11269869099026816757', time=2024-09-12T19:54:13.874225+0000, chain.objs.size()=1 2024-09-12T18:01:49.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.516+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.sdx-8P4MhbObhWl04W5JYni9655owEf_0 2024-09-12T18:01:49.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.517+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14424316900155941577', time=2024-09-12T19:54:13.879944+0000, chain.objs.size()=1 2024-09-12T18:01:49.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.517+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.IPQdC5aDdD03QE7-aeBZa5KCZoey1gu_0 2024-09-12T18:01:49.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16335201950138136298', time=2024-09-12T19:54:13.895473+0000, chain.objs.size()=1 2024-09-12T18:01:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.RYCcR-TtNZRPhdu5QQnniFlL7WYy7zo_0 2024-09-12T18:01:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15361723476160124134', time=2024-09-12T19:54:13.910301+0000, chain.objs.size()=1 2024-09-12T18:01:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ZbPWNcysHyf9iDrYkohVBHIANFvpX0v_0 2024-09-12T18:01:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11376322176116359602', time=2024-09-12T19:54:14.005831+0000, chain.objs.size()=1 2024-09-12T18:01:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.feTUlI1_p6PiUhGOO6m_Im9FPaREs1B_0 2024-09-12T18:01:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14669753612391601034', time=2024-09-12T19:54:14.018730+0000, chain.objs.size()=1 2024-09-12T18:01:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.BRkJdzHErWytuj8VbxtHwSzRksVFkF2_0 2024-09-12T18:01:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8554807716100049075', time=2024-09-12T19:54:14.021837+0000, chain.objs.size()=1 2024-09-12T18:01:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.FFE7paxgaNL2sHjomujXeiOGpYWFwXo_0 2024-09-12T18:01:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.548790807312160008', time=2024-09-12T19:54:14.027639+0000, chain.objs.size()=1 2024-09-12T18:01:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.U9i8LqfLQhzceO6JXCWhJCVPsVUVLaN_0 2024-09-12T18:01:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12588957839075023761', time=2024-09-12T19:54:14.046378+0000, chain.objs.size()=1 2024-09-12T18:01:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.fXkHReHRXKIvxgC4yPnxSjQmuSOHksF_0 2024-09-12T18:01:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9155572204823848337', time=2024-09-12T19:54:14.048166+0000, chain.objs.size()=1 2024-09-12T18:01:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ur9gMTxu25Py5xIpFK35g9k0HwJaq7S_0 2024-09-12T18:01:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4030422322035886214', time=2024-09-12T19:54:14.058022+0000, chain.objs.size()=1 2024-09-12T18:01:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.520+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.6HsNkMKv4ntFg4l1c4noT-YDOZK3sN6_0 2024-09-12T18:01:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.521+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12367683326605188021', time=2024-09-12T19:54:14.084375+0000, chain.objs.size()=1 2024-09-12T18:01:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.521+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.I0LsfyXlIMsV6dmxX8l0hQ3GzIxpImd_0 2024-09-12T18:01:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.521+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12788034936451127633', time=2024-09-12T19:54:14.395871+0000, chain.objs.size()=1 2024-09-12T18:01:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.521+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.lebJypDoQ0ayzrFJvEgKgwujtrr-7N1_0 2024-09-12T18:01:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.522+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6685888658260354277', time=2024-09-12T19:54:14.590639+0000, chain.objs.size()=1 2024-09-12T18:01:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.522+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Nz9-Lhp5D_t39ynKzlLp6x7KFrIowsH_0 2024-09-12T18:01:49.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.890216164086825803', time=2024-09-12T19:54:14.596600+0000, chain.objs.size()=1 2024-09-12T18:01:49.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.wqfSaoUYrKBKX_Au_DwzfBz54bhYPpL_0 2024-09-12T18:01:49.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.746236289678968616', time=2024-09-12T19:54:14.602995+0000, chain.objs.size()=1 2024-09-12T18:01:49.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.HDnTe2P37yFbr1cYkiFdVH_H2gXEGmn_0 2024-09-12T18:01:49.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18221186101001133491', time=2024-09-12T19:54:14.607251+0000, chain.objs.size()=1 2024-09-12T18:01:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.trDj3jmnH_w8_1xxMb3OBjMcbv-VFpG_0 2024-09-12T18:01:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9195905549009351909', time=2024-09-12T19:54:14.623199+0000, chain.objs.size()=1 2024-09-12T18:01:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.M5UjZQmux5rP4Rtfysz-AGH6vxB0wVm_0 2024-09-12T18:01:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18391435942574567437', time=2024-09-12T19:54:14.630615+0000, chain.objs.size()=1 2024-09-12T18:01:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.nZ1XyJIJ7HYTrjKRm0pJSx3_T8aldjM_0 2024-09-12T18:01:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13694712960683957713', time=2024-09-12T19:54:14.744216+0000, chain.objs.size()=1 2024-09-12T18:01:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.a2ghpY2ljmvtMNx_wtQ-ZdQD_WtNbv4_0 2024-09-12T18:01:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7210578052954496380', time=2024-09-12T19:54:14.764973+0000, chain.objs.size()=1 2024-09-12T18:01:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.dgFav-jhU3Pw17L9xtXWGFDvudsLOee_0 2024-09-12T18:01:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10806052803717137652', time=2024-09-12T19:54:14.789086+0000, chain.objs.size()=1 2024-09-12T18:01:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.tEiotlHQwDuty3HpMt7xUbRqDNPg75X_0 2024-09-12T18:01:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8336096520301078073', time=2024-09-12T19:54:14.918597+0000, chain.objs.size()=1 2024-09-12T18:01:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.V9rCmqxZBSgFhB3igFNiZzrLORRD8QY_0 2024-09-12T18:01:49.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11468687645938347629', time=2024-09-12T19:54:14.922021+0000, chain.objs.size()=1 2024-09-12T18:01:49.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.525+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.JBPpvx6MfWeg0qYgOxBsGlhRxw00A3x_0 2024-09-12T18:01:49.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.528+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12419513007373968166', time=2024-09-12T19:54:14.927350+0000, chain.objs.size()=1 2024-09-12T18:01:49.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.528+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.7zjIxqurgnjITfrKgVteqbgwQioUuER_0 2024-09-12T18:01:49.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.528+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3693535009531257590', time=2024-09-12T19:54:15.312663+0000, chain.objs.size()=1 2024-09-12T18:01:49.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.528+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.265__shadow_.ZQgcd-wOdCWteLS3w37g8k0P0tI1hOr_0 2024-09-12T18:01:49.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.528+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12674915685092482423', time=2024-09-12T19:54:15.939580+0000, chain.objs.size()=1 2024-09-12T18:01:49.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.528+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.268__shadow_.nYugKcKOhPRWqaxRZqdrLrQsLImRHSM_0 2024-09-12T18:01:49.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.311644591443309374', time=2024-09-12T19:54:19.956175+0000, chain.objs.size()=1 2024-09-12T18:01:49.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.287__shadow_._jEwcZ1undKtpppvGEUeKMbPYz6fKAC_0 2024-09-12T18:01:49.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7158001969748217513', time=2024-09-12T19:54:22.161468+0000, chain.objs.size()=1 2024-09-12T18:01:49.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.yUGetKBx4lVwBr2NX5Wis1ShNUTGTi6_0 2024-09-12T18:01:49.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16949367784442177921', time=2024-09-12T19:54:24.177621+0000, chain.objs.size()=1 2024-09-12T18:01:49.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.303__shadow_.-KAdnCHotyX_Tr3pPhWxVxbkT-AbzNN_0 2024-09-12T18:01:49.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12988066166131049370', time=2024-09-12T19:54:35.765745+0000, chain.objs.size()=1 2024-09-12T18:01:49.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Sdb4van7eWJr72EXN7f1SGbUNOnG691_0 2024-09-12T18:01:49.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4346970747943927220', time=2024-09-12T19:54:35.777452+0000, chain.objs.size()=1 2024-09-12T18:01:49.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.nD0yx-tVutwCZMBY87WxoFe2msSC5_Y_0 2024-09-12T18:01:49.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13578745522424339603', time=2024-09-12T19:54:35.794784+0000, chain.objs.size()=1 2024-09-12T18:01:49.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.trEiKdK--CB-D3bn55aRstIGTTiowiZ_0 2024-09-12T18:01:49.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6531667757921603432', time=2024-09-12T19:54:35.827800+0000, chain.objs.size()=1 2024-09-12T18:01:49.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1hy6fLzhjvl_aiaYIaWoxnQmWVhgGVB_0 2024-09-12T18:01:49.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2123956946098759304', time=2024-09-12T19:54:35.921694+0000, chain.objs.size()=1 2024-09-12T18:01:49.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ufS95q7yZ5FWFGdBqxArVOikaPmHqzB_0 2024-09-12T18:01:49.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9668032533632633009', time=2024-09-12T19:54:35.945925+0000, chain.objs.size()=1 2024-09-12T18:01:49.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.OvUjoOwFZoJgUM1GKCDY3s9pWjtitEN_0 2024-09-12T18:01:49.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17930882881578446154', time=2024-09-12T19:54:35.946752+0000, chain.objs.size()=1 2024-09-12T18:01:49.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.LBuhGRvgtwGlmRuy28lKvptT_S1qfte_0 2024-09-12T18:01:49.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3805259272513055859', time=2024-09-12T19:54:35.980074+0000, chain.objs.size()=1 2024-09-12T18:01:49.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.530+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.eW73fDUnC6uJXVPytZaHwbalaB_-XYD_0 2024-09-12T18:01:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.532+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10374609678303349203', time=2024-09-12T19:54:35.991624+0000, chain.objs.size()=1 2024-09-12T18:01:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.532+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Ihduj9Hf-ZQLpKvpTEgLeYeB-CJ-_yl_0 2024-09-12T18:01:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.532+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6487625218740936181', time=2024-09-12T19:54:36.084817+0000, chain.objs.size()=1 2024-09-12T18:01:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.532+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9kGYJx8hiMSgNVpFif4Rq7qIzO4XuJS_0 2024-09-12T18:01:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9198932341375517172', time=2024-09-12T19:54:36.167100+0000, chain.objs.size()=1 2024-09-12T18:01:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.bNGUZ5n_Vza0aVnNDbpdciUykcsx-ji_0 2024-09-12T18:01:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12514351759910328906', time=2024-09-12T19:54:36.275139+0000, chain.objs.size()=1 2024-09-12T18:01:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.CjChFXV58VFbWhdMfla9Z-HTBMYosmZ_0 2024-09-12T18:01:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2267148080097686874', time=2024-09-12T19:54:36.303931+0000, chain.objs.size()=1 2024-09-12T18:01:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Al11m28keYRDxnpau_gSthrw30ja8bl_0 2024-09-12T18:01:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.934169899828743792', time=2024-09-12T19:54:36.311419+0000, chain.objs.size()=1 2024-09-12T18:01:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.BA2hJZ_vpPCgi6zpY7Q9FugQ7DEq2hc_0 2024-09-12T18:01:49.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1212739926253174568', time=2024-09-12T19:54:36.325746+0000, chain.objs.size()=1 2024-09-12T18:01:49.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.w0OiXEM6O-WLDaSKOJjAylCzxrw2nCE_0 2024-09-12T18:01:49.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14594155884090174404', time=2024-09-12T19:54:36.333431+0000, chain.objs.size()=1 2024-09-12T18:01:49.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.p7KGPRY7abdwG3WxxJjnVkNbM7ZWsHQ_0 2024-09-12T18:01:49.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13767680834160483853', time=2024-09-12T19:54:36.429958+0000, chain.objs.size()=1 2024-09-12T18:01:49.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.MFeFRCSByNQvlFVf4YUpIpJi6fpgjxT_0 2024-09-12T18:01:49.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1295809034118606331', time=2024-09-12T19:54:36.451687+0000, chain.objs.size()=1 2024-09-12T18:01:49.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ZRBIpARp81VN97MN3pzNgpSO_SHg54X_0 2024-09-12T18:01:49.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1339244006766061310', time=2024-09-12T19:54:36.578802+0000, chain.objs.size()=1 2024-09-12T18:01:49.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QJXDFn90-NIhszs1tOAApDqBaksyQUp_0 2024-09-12T18:01:49.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8599520951884728633', time=2024-09-12T19:54:36.631374+0000, chain.objs.size()=1 2024-09-12T18:01:49.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.533+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.EL5XLT-CNREI9lnnkWF-wrRJDafjqbr_0 2024-09-12T18:01:49.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.534+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8386102556570055694', time=2024-09-12T19:54:36.778064+0000, chain.objs.size()=1 2024-09-12T18:01:49.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.534+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.w-NGUjkdYQQp5FhPPS7NZQ5PKmvtMlb_0 2024-09-12T18:01:49.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.534+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13389437780422117022', time=2024-09-12T19:54:36.780885+0000, chain.objs.size()=1 2024-09-12T18:01:49.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.534+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.BR8p_Ep_o3ny11O8YL2i1MfiOFlt45a_0 2024-09-12T18:01:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.535+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6946915764220654734', time=2024-09-12T19:54:36.918243+0000, chain.objs.size()=1 2024-09-12T18:01:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.535+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.3zxJPXxf3DUiFrFpsE1Av9e79Wolri2_0 2024-09-12T18:01:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.535+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14094767738434697613', time=2024-09-12T19:54:36.926961+0000, chain.objs.size()=1 2024-09-12T18:01:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.535+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.nnW55Cs0_-oWQXL7D7-tFCCWvFv0POS_0 2024-09-12T18:01:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.536+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5426645107914729591', time=2024-09-12T19:54:36.937524+0000, chain.objs.size()=1 2024-09-12T18:01:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.536+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.KyTzYeUEb3Pa8qI7c7x6pjEB2Bg4N4J_0 2024-09-12T18:01:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.536+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5886556648247976219', time=2024-09-12T19:54:36.963469+0000, chain.objs.size()=1 2024-09-12T18:01:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.536+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.cqkNRR6iDcjkWE9qGbQAg3sz9K8KONh_0 2024-09-12T18:01:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.536+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16739221303637910636', time=2024-09-12T19:54:44.455549+0000, chain.objs.size()=1 2024-09-12T18:01:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.536+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.WEiUV4KK_lBvuoUE0AjzYcMiEQXXFXi_0 2024-09-12T18:01:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.536+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11614279857243916693', time=2024-09-12T19:54:44.456436+0000, chain.objs.size()=1 2024-09-12T18:01:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.536+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.os2XtnOns3Q9UvEvaWYOQ4wqx5-ZtSY_0 2024-09-12T18:01:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.536+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8956733417720547940', time=2024-09-12T19:54:44.489962+0000, chain.objs.size()=1 2024-09-12T18:01:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.536+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-52Ve7oR0nxY99V06y2kIjodnnWIkbI_0 2024-09-12T18:01:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.536+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11616106293494308117', time=2024-09-12T19:54:44.515310+0000, chain.objs.size()=1 2024-09-12T18:01:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.536+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.bDJpwrJ2p1cxvlxPpM08vkIrm8yTnJm_0 2024-09-12T18:01:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.536+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8406203598901454944', time=2024-09-12T19:54:44.538196+0000, chain.objs.size()=1 2024-09-12T18:01:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.536+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.APb76FUJfHd0oPmCUd7mabIP8jF-Ulz_0 2024-09-12T18:01:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.537+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14814009189350132526', time=2024-09-12T19:54:44.539517+0000, chain.objs.size()=1 2024-09-12T18:01:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.537+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.V7INnMGLGRxneDVSM2pO0iWAo3dt31O_0 2024-09-12T18:01:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.537+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2818890379820111347', time=2024-09-12T19:54:44.545889+0000, chain.objs.size()=1 2024-09-12T18:01:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.537+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.bng8bOsAN9nfYOyY0c-vngi8qvbCUhV_0 2024-09-12T18:01:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.537+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2477501096758055046', time=2024-09-12T19:54:44.639412+0000, chain.objs.size()=1 2024-09-12T18:01:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.537+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.SJ86gmVbR1uXqi9yr9n0sY1jDp9MDwV_0 2024-09-12T18:01:49.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.537+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.452857460909818420', time=2024-09-12T19:54:44.667558+0000, chain.objs.size()=1 2024-09-12T18:01:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.537+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.oWj2457zbc2rV2Mm3JVdrzAcMH8lO6p_0 2024-09-12T18:01:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.538+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7059679606401795285', time=2024-09-12T19:54:44.677697+0000, chain.objs.size()=1 2024-09-12T18:01:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.538+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.EXWfP-_tUwPTnCOOcbNGKeBBN1h9ito_0 2024-09-12T18:01:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.538+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8899282987378257584', time=2024-09-12T19:54:44.856186+0000, chain.objs.size()=1 2024-09-12T18:01:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.538+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jlGIQc7IHy-xmhzclVpX5jVnTtMSrkO_0 2024-09-12T18:01:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.538+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13796434331912595041', time=2024-09-12T19:54:44.861653+0000, chain.objs.size()=1 2024-09-12T18:01:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.538+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.1rYP0wiDHlci_1xTTNiuEk2Ua889s_x_0 2024-09-12T18:01:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.538+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16754558539271616119', time=2024-09-12T19:54:44.876339+0000, chain.objs.size()=1 2024-09-12T18:01:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.538+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.SIA5x1RWSRJQQdti4GuLu2vXxFuisFo_0 2024-09-12T18:01:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.538+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.951080123709377639', time=2024-09-12T19:54:44.877623+0000, chain.objs.size()=1 2024-09-12T18:01:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.538+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ijreB-MGtKSj_DRyNAGRVLrLIzhLYY8_0 2024-09-12T18:01:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.538+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9591482088230170235', time=2024-09-12T19:54:44.884244+0000, chain.objs.size()=1 2024-09-12T18:01:49.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.539+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.rMO69Rhiw0VRd553Iu62mBkNRYC4mFP_0 2024-09-12T18:01:49.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.539+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1829646993345644685', time=2024-09-12T19:54:44.965900+0000, chain.objs.size()=1 2024-09-12T18:01:49.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.539+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_._6IaeD_PvGZZndhQL_-3ZBjhI9itxbH_0 2024-09-12T18:01:49.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.539+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3020324184995980474', time=2024-09-12T19:54:45.007515+0000, chain.objs.size()=1 2024-09-12T18:01:49.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.539+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ycF2G2HHwkrbKXJ3IpnKGVC9hDvUEwB_0 2024-09-12T18:01:49.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.539+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6057977569063491449', time=2024-09-12T19:54:45.044424+0000, chain.objs.size()=1 2024-09-12T18:01:49.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.540+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.N9jWsgVN61Vi9fIubMfaCZA3u6heAs__0 2024-09-12T18:01:49.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.540+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3595361491588750051', time=2024-09-12T19:54:45.046549+0000, chain.objs.size()=1 2024-09-12T18:01:49.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.540+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.WXkP7DMH7iNNumjAJ-mSkDGXNlYZoUZ_0 2024-09-12T18:01:49.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.540+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2620641403716244206', time=2024-09-12T19:54:45.054870+0000, chain.objs.size()=1 2024-09-12T18:01:49.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.540+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.N_O6dLyXFwwaV9n74Pee6sbaP04lCWm_0 2024-09-12T18:01:49.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.540+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.19837481748303013', time=2024-09-12T19:54:45.172997+0000, chain.objs.size()=1 2024-09-12T18:01:49.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.540+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.sVIslHmamKhKHjDuaFfbfahg8wJeB3f_0 2024-09-12T18:01:49.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.540+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10933593519206262419', time=2024-09-12T19:54:45.185578+0000, chain.objs.size()=1 2024-09-12T18:01:49.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.540+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.98NstUiDajuts7gCV3dQmG8jqDnCHGp_0 2024-09-12T18:01:49.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.540+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2505415873175676689', time=2024-09-12T19:54:45.193218+0000, chain.objs.size()=1 2024-09-12T18:01:49.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.540+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.CWe27F37WkURdj-GXa_MmSsZHtDJxpq_0 2024-09-12T18:01:49.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.540+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.250275108066604079', time=2024-09-12T19:54:45.261010+0000, chain.objs.size()=1 2024-09-12T18:01:49.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.540+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.KnI_XeB28K0eXmpUKt7Z0HLtGLq6GNL_0 2024-09-12T18:01:49.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.542+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/50407 2024-09-12T18:01:49.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T18:01:49.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18221805641996871691', time=2024-09-12T19:54:45.263457+0000, chain.objs.size()=1 2024-09-12T18:01:49.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ef39eAS43wAWqlSP5LkMQyZwAJnOniw_0 2024-09-12T18:01:49.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18180765808817288855', time=2024-09-12T19:54:45.350119+0000, chain.objs.size()=1 2024-09-12T18:01:49.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.X0Ldpj1WYMcdcTfjZMYRGUbBweMXER5_0 2024-09-12T18:01:49.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1988331988776333646', time=2024-09-12T19:54:45.402754+0000, chain.objs.size()=1 2024-09-12T18:01:49.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.n9didoqSDdib6hbYSJq3mfVfcnrBB47_0 2024-09-12T18:01:49.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2854247705608156598', time=2024-09-12T19:54:45.432493+0000, chain.objs.size()=1 2024-09-12T18:01:49.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.U27FHJEMdX074kF9PHWI4MWEGBaRyic_0 2024-09-12T18:01:49.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9282141846378098329', time=2024-09-12T19:54:45.434762+0000, chain.objs.size()=1 2024-09-12T18:01:49.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.0SwQiuRubZ78gHqKEaN7B5ZjKNfhPdy_0 2024-09-12T18:01:49.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4308360785757059702', time=2024-09-12T19:54:45.507688+0000, chain.objs.size()=1 2024-09-12T18:01:49.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.PGa8VWTjURoofSZdy5-U15s-Gka3Dr0_0 2024-09-12T18:01:49.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9185334061413732899', time=2024-09-12T19:54:45.514488+0000, chain.objs.size()=1 2024-09-12T18:01:49.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ME2JYj4O5r8eYNnG8IEZI3Nd8si1hGi_0 2024-09-12T18:01:49.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.334879019473375801', time=2024-09-12T19:54:45.541563+0000, chain.objs.size()=1 2024-09-12T18:01:49.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.10YxfO4GPzkSVy3VXGwSz-mG2a0Ens7_0 2024-09-12T18:01:49.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15276207544933417877', time=2024-09-12T19:54:45.558938+0000, chain.objs.size()=1 2024-09-12T18:01:49.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.544+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Fp5XvzD5nPFQJ0jHmNe5dKtv6WMn9bi_0 2024-09-12T18:01:49.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.545+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12819341251744388842', time=2024-09-12T19:54:45.688035+0000, chain.objs.size()=1 2024-09-12T18:01:49.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.545+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.KcBda-Z5v_4s8CCd27KyN0XfpQNWwH9_0 2024-09-12T18:01:49.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.545+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10296405069136851471', time=2024-09-12T19:54:45.739155+0000, chain.objs.size()=1 2024-09-12T18:01:49.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.545+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.IZgGru7Vfn93UjVRz2w7Ovd7drAfD7V_0 2024-09-12T18:01:49.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.545+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14277537292899832529', time=2024-09-12T19:54:45.744168+0000, chain.objs.size()=1 2024-09-12T18:01:49.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.545+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_._jxrJuhLjR7D3MrNWW0o50-Jh_LS6BD_0 2024-09-12T18:01:49.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.546+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13452609592209145169', time=2024-09-12T19:54:45.747576+0000, chain.objs.size()=1 2024-09-12T18:01:49.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.546+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.t3boQDBaZ3rU-5LIIGeAjcVQd7Zb_Dk_0 2024-09-12T18:01:49.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.546+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18226080359761345196', time=2024-09-12T19:55:09.620879+0000, chain.objs.size()=1 2024-09-12T18:01:49.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.546+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.437__shadow_.wjA910QqFBMRn2GO9AxQvctho6158Mf_0 2024-09-12T18:01:49.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.546+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5612514974424038225', time=2024-09-12T19:55:23.147914+0000, chain.objs.size()=1 2024-09-12T18:01:49.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.546+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.492__shadow_.y56noR3R-A3pQgaKknC8iUSLobUVVt7_0 2024-09-12T18:01:49.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.546+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4855552645836832289', time=2024-09-12T19:55:23.788730+0000, chain.objs.size()=1 2024-09-12T18:01:49.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.546+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.496__shadow_.1x4V4RMARpWlf0__NXVp-srg0XD3TRj_0 2024-09-12T18:01:49.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.546+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~TzYF8utmeyWzepw0ZBdAsmu1n3pIAyy', time=2024-09-12T19:55:33.893229+0000, chain.objs.size()=1 2024-09-12T18:01:49.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.546+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~TzYF8utmeyWzepw0ZBdAsmu1n3pIAyy.1 2024-09-12T18:01:49.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.546+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~M-2xuXqE870cASLR4CmO5fbzZMFEG9s', time=2024-09-12T19:55:34.618352+0000, chain.objs.size()=1 2024-09-12T18:01:49.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.546+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~M-2xuXqE870cASLR4CmO5fbzZMFEG9s.2 2024-09-12T18:01:49.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.546+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6732596982096001161', time=2024-09-12T19:56:15.420952+0000, chain.objs.size()=1 2024-09-12T18:01:49.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.547+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.563__shadow_.cZEC6JCHoSrjFgxcSZ2YK1rxTccYryh_0 2024-09-12T18:01:49.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.547+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10243808470858745095', time=2024-09-12T19:56:49.982197+0000, chain.objs.size()=1 2024-09-12T18:01:49.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.547+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.580__shadow:w1nKRAwTrefcQ.3tomVWQ-o1EDruWbl_.o3bdxcPNamGJq33k--eTa4HDTVXIXGA_0 2024-09-12T18:01:49.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.547+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13657597287294900662', time=2024-09-12T19:56:50.924267+0000, chain.objs.size()=1 2024-09-12T18:01:49.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.547+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.581__shadow:PsApgqwqjkbnkxy08UM7ac24chJ8ng4_.28GyzXAibbB1MoeEJC895bpzvX4U1yq_0 2024-09-12T18:01:49.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.547+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10191193444879268332', time=2024-09-12T19:56:50.925173+0000, chain.objs.size()=1 2024-09-12T18:01:49.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.547+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.581__shadow:mAGypR.mbp03xAP5p1yBMLel0ghiUBd_._gjce9pn2ddn2JlbfWOP3PIm8ugmk3A_0 2024-09-12T18:01:49.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.547+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5319397747717587936', time=2024-09-12T19:56:54.680155+0000, chain.objs.size()=1 2024-09-12T18:01:49.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.547+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.597__shadow_.lK3m2_BlJp9_2GSsu2bb0FHmpsR6T-I_0 2024-09-12T18:01:49.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.548+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7467226996053485516', time=2024-09-12T19:59:12.224488+0000, chain.objs.size()=1 2024-09-12T18:01:49.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.548+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.650__shadow_.ZN6cNl15EOsX3M6b-Yk4xD9FsMSLmfM_0 2024-09-12T18:01:49.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.548+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10962418236663396899', time=2024-09-12T19:59:23.322527+0000, chain.objs.size()=1 2024-09-12T18:01:49.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.548+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.693__shadow:mnJR.nEXTZ-Gvu0XsO0Db0Ik3G4Ld2N_.eYYrXrFRyxxG7CfZgE6wiHoWZ9wRMul_0 2024-09-12T18:01:49.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.549+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:49.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.552+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:01:49.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.554+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:49.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.554+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:49.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52562' 2024-09-12T18:01:49.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15691411241855622430', time=2024-09-12T19:53:59.094203+0000, chain.objs.size()=1 2024-09-12T18:01:49.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.229__shadow_.xQuVhZ97F01B1oaWYco6OjYBQcnkgMr_0 2024-09-12T18:01:49.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2686295474769538606', time=2024-09-12T19:54:03.216389+0000, chain.objs.size()=1 2024-09-12T18:01:49.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.248__shadow_.fsD7ZhPVD_GZy1HGKncZdTXrDAb60LG_0 2024-09-12T18:01:49.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.492286522719519616', time=2024-09-12T19:54:03.617931+0000, chain.objs.size()=1 2024-09-12T18:01:49.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.250__shadow_.iiOyiNjljPrt_vJ1t-LKUpXaAgU-KJ7_0 2024-09-12T18:01:49.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12823386401710436647', time=2024-09-12T19:54:03.820356+0000, chain.objs.size()=1 2024-09-12T18:01:49.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.251__shadow_.NYBU8RP1QZ5XKuxPZnrJ7_pEWgROqI4_0 2024-09-12T18:01:49.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6656252589362020543', time=2024-09-12T19:54:04.023559+0000, chain.objs.size()=1 2024-09-12T18:01:49.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.252__shadow_.ierv-zJj5gCgJelr2aZvH3iAzaU-tD2_0 2024-09-12T18:01:49.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.117384586693639558', time=2024-09-12T19:54:05.084460+0000, chain.objs.size()=1 2024-09-12T18:01:49.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.257__shadow_.NF3M77WBhmzpcmiy7hbZA26-bOymiUo_0 2024-09-12T18:01:49.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14338747960028036662', time=2024-09-12T19:54:13.487289+0000, chain.objs.size()=1 2024-09-12T18:01:49.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.KjPHLZvknECpmgmPSY5I6bk5JRv6hv9_0 2024-09-12T18:01:49.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14751675351567436280', time=2024-09-12T19:54:13.500233+0000, chain.objs.size()=1 2024-09-12T18:01:49.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.emjikySKd5bRUPMXsY_zpOl10sCJD3N_0 2024-09-12T18:01:49.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1685389047694113534', time=2024-09-12T19:54:13.540394+0000, chain.objs.size()=1 2024-09-12T18:01:49.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.aQ3DWuVMlmlmNZgX1zgJbuJJ0ux2TAG_0 2024-09-12T18:01:49.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13442134039901263028', time=2024-09-12T19:54:13.712367+0000, chain.objs.size()=1 2024-09-12T18:01:49.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.cT30fTyngc4O23KWrMRfK4VNQfEDJ-m_0 2024-09-12T18:01:49.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10399577306704122800', time=2024-09-12T19:54:13.731535+0000, chain.objs.size()=1 2024-09-12T18:01:49.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.jwSXqaOss9h0hSC7aPcRhM275vVSRGU_0 2024-09-12T18:01:49.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18252764706466865994', time=2024-09-12T19:54:13.748053+0000, chain.objs.size()=1 2024-09-12T18:01:49.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.555+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.9GBDITZPqqBReaEeDMiMfDt7T_g_tci_0 2024-09-12T18:01:49.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.557+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16532235741635584829', time=2024-09-12T19:54:13.835552+0000, chain.objs.size()=1 2024-09-12T18:01:49.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.557+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.q6u1N_wS_QZ6MFbRSquV0W2Nq-8r1mV_0 2024-09-12T18:01:49.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.557+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14003212892051238467', time=2024-09-12T19:54:13.837035+0000, chain.objs.size()=1 2024-09-12T18:01:49.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.557+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.6gqrob5W_YMOx-FBVkOwO4-Cq6PK7Dv_0 2024-09-12T18:01:49.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.557+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7034040993631948679', time=2024-09-12T19:54:13.889158+0000, chain.objs.size()=1 2024-09-12T18:01:49.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.557+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.mmxqRcYb0jd5nmY4DbjVQl1OSIlW4Js_0 2024-09-12T18:01:49.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.557+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8080323877646988723', time=2024-09-12T19:54:13.920670+0000, chain.objs.size()=1 2024-09-12T18:01:49.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.557+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.6skwnfGR6idOPZufVuxtJd2KgfU2Lf__0 2024-09-12T18:01:49.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.557+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12409891425801275517', time=2024-09-12T19:54:13.928263+0000, chain.objs.size()=1 2024-09-12T18:01:49.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.557+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.7eCVdxwhW9aKnRUBJMKq2TNLAQmeTTH_0 2024-09-12T18:01:49.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.557+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8671677100254976697', time=2024-09-12T19:54:14.005038+0000, chain.objs.size()=1 2024-09-12T18:01:49.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.557+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.h1mTj1V7wG-NRlwRt8XZZD1MzhFtuP0_0 2024-09-12T18:01:49.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.557+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18019953329785187859', time=2024-09-12T19:54:14.005905+0000, chain.objs.size()=1 2024-09-12T18:01:49.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.557+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.MQdxeT1NDGP89tG3UMgk___Rs0CURrd_0 2024-09-12T18:01:49.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.558+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4385619807524042056', time=2024-09-12T19:54:14.007502+0000, chain.objs.size()=1 2024-09-12T18:01:49.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.558+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ldbs4mjPO44IFE_j9pQDIOr_vDyFa1c_0 2024-09-12T18:01:49.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.558+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6609834173792544559', time=2024-09-12T19:54:14.020634+0000, chain.objs.size()=1 2024-09-12T18:01:49.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.558+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.8q0bhzHp9gfPVESkcfbVx9-364sR6IS_0 2024-09-12T18:01:49.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.558+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15023289353439122828', time=2024-09-12T19:54:14.044476+0000, chain.objs.size()=1 2024-09-12T18:01:49.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.558+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.uH7wTD_xiD50lfaoevrJFop5_z8fNhP_0 2024-09-12T18:01:49.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.558+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12535794566967347945', time=2024-09-12T19:54:14.050123+0000, chain.objs.size()=1 2024-09-12T18:01:49.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.558+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.C-EcByM2qKIDxKN0IjrsczVcdndEoWZ_0 2024-09-12T18:01:49.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.559+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1801638049033125380', time=2024-09-12T19:54:14.057922+0000, chain.objs.size()=1 2024-09-12T18:01:49.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.559+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.laImB90WVGy_WNyv8hf8HP-AfGNTLp__0 2024-09-12T18:01:49.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.559+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10331556578481464396', time=2024-09-12T19:54:14.381350+0000, chain.objs.size()=1 2024-09-12T18:01:49.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.559+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.xzFZOhv0juMOg4-4w9WWypxuTIr2oFT_0 2024-09-12T18:01:49.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.559+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18259349683743823623', time=2024-09-12T19:54:14.450569+0000, chain.objs.size()=1 2024-09-12T18:01:49.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.559+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.kjMmm6gMmcMWUJ9soxDp7cuDsGxYVtZ_0 2024-09-12T18:01:49.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.559+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14222351204215340251', time=2024-09-12T19:54:14.457085+0000, chain.objs.size()=1 2024-09-12T18:01:49.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.559+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.o-vo-ypLjOn6cjoPvCBuKJ7M8uOfdPE_0 2024-09-12T18:01:49.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.559+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4168820748276040349', time=2024-09-12T19:54:14.551373+0000, chain.objs.size()=1 2024-09-12T18:01:49.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.559+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.NbDdVUT-y6oWS9objo6_Erbjji13L4e_0 2024-09-12T18:01:49.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.560+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1790206006465927980', time=2024-09-12T19:54:14.552953+0000, chain.objs.size()=1 2024-09-12T18:01:49.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.560+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Rde8uoP9eyk7RyWRDLdn315AWNIGDoN_0 2024-09-12T18:01:49.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.560+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17151710059619749580', time=2024-09-12T19:54:14.602291+0000, chain.objs.size()=1 2024-09-12T18:01:49.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.560+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-1ZK_AO8lrVlxIyNNP0vhdDXvOO9m2W_0 2024-09-12T18:01:49.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.561+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1919838239218861132', time=2024-09-12T19:54:14.610264+0000, chain.objs.size()=1 2024-09-12T18:01:49.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.561+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ZV1lS9uVGP2FBjHw8VjBPtIK6Cr340d_0 2024-09-12T18:01:49.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.561+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9706445531372935467', time=2024-09-12T19:54:14.622804+0000, chain.objs.size()=1 2024-09-12T18:01:49.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.561+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.9waFEvROIVCrg10yO_b4mThmfXwqK2y_0 2024-09-12T18:01:49.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.561+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15390973269856959046', time=2024-09-12T19:54:14.713680+0000, chain.objs.size()=1 2024-09-12T18:01:49.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.561+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.hMPGeNuBpsBC2DMeVcbyvBdAeSicbX5_0 2024-09-12T18:01:49.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.561+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.927544160845687770', time=2024-09-12T19:54:14.718801+0000, chain.objs.size()=1 2024-09-12T18:01:49.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.561+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.NrcdigwY6-rsxvckLgswlSiT1rn6ngN_0 2024-09-12T18:01:49.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.561+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3591325717609680044', time=2024-09-12T19:54:14.791817+0000, chain.objs.size()=1 2024-09-12T18:01:49.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.561+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.t-vB8tVExcyPQysJDJBd6YgW-LaqQpd_0 2024-09-12T18:01:49.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.562+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9491782912950735258', time=2024-09-12T19:54:14.801603+0000, chain.objs.size()=1 2024-09-12T18:01:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.562+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2O_jrcnvbdtFROb7VCJoKOyeKSCOAyF_0 2024-09-12T18:01:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.562+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5237982210906066103', time=2024-09-12T19:54:14.892362+0000, chain.objs.size()=1 2024-09-12T18:01:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.562+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.zIs1R0RrmTnVhEa3D8-AVxrltDqllnK_0 2024-09-12T18:01:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.562+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9545015592273052034', time=2024-09-12T19:54:14.897074+0000, chain.objs.size()=1 2024-09-12T18:01:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.562+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.eZouMyYTiN_pgcI-TCZNqYw-jBr4qsM_0 2024-09-12T18:01:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.562+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9543908940192044397', time=2024-09-12T19:54:14.937929+0000, chain.objs.size()=1 2024-09-12T18:01:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.562+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.VW60-5d6TGb1CVArqm7kErjSZZNznzq_0 2024-09-12T18:01:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.562+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10531373378093636824', time=2024-09-12T19:54:14.938866+0000, chain.objs.size()=1 2024-09-12T18:01:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.562+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.aEZc97MobT5C9Aum_fT3IO7k2cgssUa_0 2024-09-12T18:01:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.562+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4425230756179610993', time=2024-09-12T19:54:14.953058+0000, chain.objs.size()=1 2024-09-12T18:01:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.562+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.wEd_fFcrSNjbPdYBaS_AwAzxiv3g05Q_0 2024-09-12T18:01:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.563+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13127327610525784680', time=2024-09-12T19:54:17.977480+0000, chain.objs.size()=1 2024-09-12T18:01:49.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.563+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.278__shadow_.cSSEXUcKwp6kzlDb1eGAsN6gH_osUGf_0 2024-09-12T18:01:49.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.563+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15008731866629933445', time=2024-09-12T19:54:19.260178+0000, chain.objs.size()=1 2024-09-12T18:01:49.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.563+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.284__shadow_.jiNXPeqZKdvJScGI11a7RvEroTbkHgf_0 2024-09-12T18:01:49.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.563+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6582927758360179937', time=2024-09-12T19:54:19.709436+0000, chain.objs.size()=1 2024-09-12T18:01:49.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.563+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.286__shadow_.PTT7fQGq4oLUpaPkSC_QcLB7bbYOKKU_0 2024-09-12T18:01:49.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.563+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11666115776501512803', time=2024-09-12T19:54:22.833273+0000, chain.objs.size()=1 2024-09-12T18:01:49.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.563+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.297__shadow_.a2JPghXuDl7gPm0ZQRia4-drqNWZpJL_0 2024-09-12T18:01:49.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.563+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2681426462024652369', time=2024-09-12T19:54:35.754231+0000, chain.objs.size()=1 2024-09-12T18:01:49.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.563+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ZQOMi-YMnFwAF7_ozYcZqcWVMTn8SJw_0 2024-09-12T18:01:49.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.563+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5670421271867507321', time=2024-09-12T19:54:35.762354+0000, chain.objs.size()=1 2024-09-12T18:01:49.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.563+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.wCqCfhNz_qLhod0rjzU43YAbMX6AC26_0 2024-09-12T18:01:49.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.564+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13027565251488021537', time=2024-09-12T19:54:35.784552+0000, chain.objs.size()=1 2024-09-12T18:01:49.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.564+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ZjSXd_4niQQ4YBBnps0kgbSgavTb-UV_0 2024-09-12T18:01:49.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.564+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2803017845338437948', time=2024-09-12T19:54:35.793050+0000, chain.objs.size()=1 2024-09-12T18:01:49.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.564+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.wnd7uXagxshRrpm7EaazHyaEX3UPl4L_0 2024-09-12T18:01:49.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.564+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16287288253625640561', time=2024-09-12T19:54:35.830573+0000, chain.objs.size()=1 2024-09-12T18:01:49.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.564+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.CNK3YrbEugbIwVzRMILMOHdlZ8wO9TK_0 2024-09-12T18:01:49.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.565+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2619519766377075535', time=2024-09-12T19:54:35.942178+0000, chain.objs.size()=1 2024-09-12T18:01:49.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.565+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.uuZwYozG5HtNN5CuLS_3NSnbuYDw9z6_0 2024-09-12T18:01:49.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.565+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3890291885140275871', time=2024-09-12T19:54:36.121128+0000, chain.objs.size()=1 2024-09-12T18:01:49.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.565+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.dENALBWEtp-pijquoTIpJZklLsZQI27_0 2024-09-12T18:01:49.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.565+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14359779802070848738', time=2024-09-12T19:54:36.130567+0000, chain.objs.size()=1 2024-09-12T18:01:49.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.565+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.K8cyBqWXkShAbgyneChLIkGY2pUQr7b_0 2024-09-12T18:01:49.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.565+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8130809504454666181', time=2024-09-12T19:54:36.148532+0000, chain.objs.size()=1 2024-09-12T18:01:49.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.565+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rauSQsFOOZfX97d1pYG8xVm_HIE4xxU_0 2024-09-12T18:01:49.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.565+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12806105276584047005', time=2024-09-12T19:54:36.269281+0000, chain.objs.size()=1 2024-09-12T18:01:49.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.565+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.VqkN4gqJpPCQkm49T7-Nf9GfVyT6CQt_0 2024-09-12T18:01:49.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.565+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5643587261560416047', time=2024-09-12T19:54:36.292495+0000, chain.objs.size()=1 2024-09-12T18:01:49.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.565+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ww90flPcW4BhVZSWL2MHQ1RauvjuRQt_0 2024-09-12T18:01:49.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.566+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14739247006230008648', time=2024-09-12T19:54:36.341737+0000, chain.objs.size()=1 2024-09-12T18:01:49.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.566+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.8_Alx_TNIi4xJIlispeR5TWWgWMaKa3_0 2024-09-12T18:01:49.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.566+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15253267530625472744', time=2024-09-12T19:54:36.482789+0000, chain.objs.size()=1 2024-09-12T18:01:49.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.566+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.sDBtMcLV63txVYTRXDkIGc4YHS4ju21_0 2024-09-12T18:01:49.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.566+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8635050028316503465', time=2024-09-12T19:54:36.486146+0000, chain.objs.size()=1 2024-09-12T18:01:49.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.566+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.UVyp-9PgFHUXk9_P0HSHjAY7xjfOdso_0 2024-09-12T18:01:49.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.567+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.540851609806955190', time=2024-09-12T19:54:36.578902+0000, chain.objs.size()=1 2024-09-12T18:01:49.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.567+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ef9L3Od_NX4VjJrfrleGem42HV6EYLe_0 2024-09-12T18:01:49.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.567+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13966058694651555049', time=2024-09-12T19:54:36.603959+0000, chain.objs.size()=1 2024-09-12T18:01:49.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.567+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.jvFc1dZE_LoH8qzD6qHV2SMf7Wzg536_0 2024-09-12T18:01:49.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.567+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6063347890019158712', time=2024-09-12T19:54:36.611597+0000, chain.objs.size()=1 2024-09-12T18:01:49.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.567+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.027X2M_JA9l0hBzo_NcJsecfj4wPe9M_0 2024-09-12T18:01:49.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.567+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18268205075809843608', time=2024-09-12T19:54:36.617087+0000, chain.objs.size()=1 2024-09-12T18:01:49.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.567+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.FFsfCxv21F8hoz55AWbJIa7I0AExREK_0 2024-09-12T18:01:49.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.568+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9610766343796723688', time=2024-09-12T19:54:36.647905+0000, chain.objs.size()=1 2024-09-12T18:01:49.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.568+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1kNWYbJ_Q9OOdu-_3bPcs24BmYrG4Tm_0 2024-09-12T18:01:49.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.568+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7109289830419762311', time=2024-09-12T19:54:36.657546+0000, chain.objs.size()=1 2024-09-12T18:01:49.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.568+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.H_k5sh3OjULrMbjn9z8d9qehr3TYGBx_0 2024-09-12T18:01:49.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.568+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8099812171526599418', time=2024-09-12T19:54:36.764358+0000, chain.objs.size()=1 2024-09-12T18:01:49.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.568+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.SspPgiYCG0fy3ATdcVu4OyvQ4WG5g4b_0 2024-09-12T18:01:49.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.568+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15003175451875011014', time=2024-09-12T19:54:36.799857+0000, chain.objs.size()=1 2024-09-12T18:01:49.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.568+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.If3WKKLdxbEwLOuXxqp7TDe1mZb0w_p_0 2024-09-12T18:01:49.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.568+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15354403220498031129', time=2024-09-12T19:54:36.812635+0000, chain.objs.size()=1 2024-09-12T18:01:49.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.568+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_._dapA6HChzMPDRdx68CRPQm8MrWs0ty_0 2024-09-12T18:01:49.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.569+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5179837944642382365', time=2024-09-12T19:54:36.817812+0000, chain.objs.size()=1 2024-09-12T18:01:49.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.569+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.f6fqGzZ44MnkT2YxGdPOeD_Mo6jkG9Y_0 2024-09-12T18:01:49.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.569+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15914137778166853144', time=2024-09-12T19:54:36.826532+0000, chain.objs.size()=1 2024-09-12T18:01:49.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.569+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.OY9bccDyZSHTMDpLrUCJPYa-WlWnwcI_0 2024-09-12T18:01:49.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8118145447320000010', time=2024-09-12T19:54:36.903576+0000, chain.objs.size()=1 2024-09-12T18:01:49.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.JYsP1CZUoG2kTO3U8ax46SJzo7sUYsm_0 2024-09-12T18:01:49.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4888618492003871707', time=2024-09-12T19:54:36.912577+0000, chain.objs.size()=1 2024-09-12T18:01:49.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rqaWanbC35xCp6Vbfgir9iLnLNOmlht_0 2024-09-12T18:01:49.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.814155920022801139', time=2024-09-12T19:54:36.914494+0000, chain.objs.size()=1 2024-09-12T18:01:49.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.298yo9-1dSTXSqq22TsaVKSQTkDrx6-_0 2024-09-12T18:01:49.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16943759361521284736', time=2024-09-12T19:54:44.469758+0000, chain.objs.size()=1 2024-09-12T18:01:49.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.LFwX-JRcBrOxcTfaXRYmovJ0AOZMzWt_0 2024-09-12T18:01:49.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5289075462229451258', time=2024-09-12T19:54:44.483372+0000, chain.objs.size()=1 2024-09-12T18:01:49.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.4bpp9IEVBXNNqjGJHgcwyjOVcOePe8j_0 2024-09-12T18:01:49.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15349893628461478949', time=2024-09-12T19:54:44.526270+0000, chain.objs.size()=1 2024-09-12T18:01:49.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.l2ini04hbYYn9vptjgp0pYBPUKIzrdf_0 2024-09-12T18:01:49.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15444091766580189812', time=2024-09-12T19:54:44.536214+0000, chain.objs.size()=1 2024-09-12T18:01:49.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TeBVeP8MgdEGRAYn9VhovfU8iNna9Rt_0 2024-09-12T18:01:49.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14400274786467949167', time=2024-09-12T19:54:44.636894+0000, chain.objs.size()=1 2024-09-12T18:01:49.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Vjj6SssGgdas8GO9Muw-89HT4gw2Kqm_0 2024-09-12T18:01:49.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.571+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10395768106907863817', time=2024-09-12T19:54:44.645124+0000, chain.objs.size()=1 2024-09-12T18:01:49.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.571+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.xtK2U2RxSj014Qm5zsnmgb9rPPWtWdD_0 2024-09-12T18:01:49.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8348093864445072252', time=2024-09-12T19:54:44.648674+0000, chain.objs.size()=1 2024-09-12T18:01:49.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jL97b7ICZkrrTc15kRuvVPzqSq3BI_C_0 2024-09-12T18:01:49.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12161614869703886259', time=2024-09-12T19:54:44.670387+0000, chain.objs.size()=1 2024-09-12T18:01:49.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Mls7ikfQWGt4Tb2w-coZZ40Wi8xnA65_0 2024-09-12T18:01:49.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7955478311734054717', time=2024-09-12T19:54:44.683445+0000, chain.objs.size()=1 2024-09-12T18:01:49.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.F41_RnJcybjVKXpcv7TgusS9AgI6zW-_0 2024-09-12T18:01:49.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6711893589510006782', time=2024-09-12T19:54:44.695200+0000, chain.objs.size()=1 2024-09-12T18:01:49.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.3uq1jJ4h3bpKI2zslsOatdmqIKzYxoU_0 2024-09-12T18:01:49.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14195271494086403535', time=2024-09-12T19:54:44.717524+0000, chain.objs.size()=1 2024-09-12T18:01:49.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.4XzqOciydJebIDbMt7ap38CauyyKt0R_0 2024-09-12T18:01:49.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4705882294663273240', time=2024-09-12T19:54:44.857669+0000, chain.objs.size()=1 2024-09-12T18:01:49.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.oTDpyPJg70dTRg5TrE-m7nSiU5fDG2S_0 2024-09-12T18:01:49.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9610175113299474193', time=2024-09-12T19:54:44.858285+0000, chain.objs.size()=1 2024-09-12T18:01:49.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Zjo-FlNcj71B-0XGViP4DLCafxRvDMT_0 2024-09-12T18:01:49.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9092947659904812675', time=2024-09-12T19:54:44.873094+0000, chain.objs.size()=1 2024-09-12T18:01:49.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Y5D4HHH-eK2DfkkUVatIl2g5EyX5Q0K_0 2024-09-12T18:01:49.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5025056042022758453', time=2024-09-12T19:54:44.881150+0000, chain.objs.size()=1 2024-09-12T18:01:49.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.572+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.JGFXyCbdJ_xr4dlkItLvj9Tm4BOvCnb_0 2024-09-12T18:01:49.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.573+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.769090878566377056', time=2024-09-12T19:54:44.969334+0000, chain.objs.size()=1 2024-09-12T18:01:49.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.573+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.pds7JVDTmC7DePnGC8CSSbPEFK5doH5_0 2024-09-12T18:01:49.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.573+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14030419407786923927', time=2024-09-12T19:54:44.995705+0000, chain.objs.size()=1 2024-09-12T18:01:49.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.573+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.GwseKxMlLXSl9js497CBRKDNyATxqNW_0 2024-09-12T18:01:49.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.573+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17447862301471599669', time=2024-09-12T19:54:45.043603+0000, chain.objs.size()=1 2024-09-12T18:01:49.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.573+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.iotOEuLc1NIZMIfIZvjilgaM1L2q8RZ_0 2024-09-12T18:01:49.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8088295004188928745', time=2024-09-12T19:54:45.044856+0000, chain.objs.size()=1 2024-09-12T18:01:49.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.AtPhceFaIxQD6LixYoVmLra55huMfpw_0 2024-09-12T18:01:49.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8092732985675358381', time=2024-09-12T19:54:45.181677+0000, chain.objs.size()=1 2024-09-12T18:01:49.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Jw2srYSGRqv7hE5rfTSfoBVGfUpn0QH_0 2024-09-12T18:01:49.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3200988110971813536', time=2024-09-12T19:54:45.189369+0000, chain.objs.size()=1 2024-09-12T18:01:49.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.95xVcXyqWz5gVEjlseIWItVVY6joxcw_0 2024-09-12T18:01:49.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14391837325907622483', time=2024-09-12T19:54:45.193064+0000, chain.objs.size()=1 2024-09-12T18:01:49.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-w9msByW2_90l0F-SmhNVtCoCCY5HhG_0 2024-09-12T18:01:49.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16868343507180723129', time=2024-09-12T19:54:45.234697+0000, chain.objs.size()=1 2024-09-12T18:01:49.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.gZTYhBG911exoYT-hLDq7r4sDe6xMwA_0 2024-09-12T18:01:49.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8270601948401445695', time=2024-09-12T19:54:45.247601+0000, chain.objs.size()=1 2024-09-12T18:01:49.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9bAlD50DUBndN2qPnYGV1lQZ4mQsCAS_0 2024-09-12T18:01:49.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15026504563200050211', time=2024-09-12T19:54:45.256184+0000, chain.objs.size()=1 2024-09-12T18:01:49.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TBL9kMlGit4Y1zay0fVxVkrPjXZCtnl_0 2024-09-12T18:01:49.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10157687558689388784', time=2024-09-12T19:54:45.342669+0000, chain.objs.size()=1 2024-09-12T18:01:49.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.HULN1FAo15iMVHC_Exd0xPsme7MAEWU_0 2024-09-12T18:01:49.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1367722669557681205', time=2024-09-12T19:54:45.395352+0000, chain.objs.size()=1 2024-09-12T18:01:49.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.579+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.M-qxUnMp8dU0Mnq860N_pkWVvww08Dv_0 2024-09-12T18:01:49.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.583+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/52562 2024-09-12T18:01:49.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T18:01:49.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14075691463992016304', time=2024-09-12T19:54:45.404261+0000, chain.objs.size()=1 2024-09-12T18:01:49.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.RSAwBz4jBqa5mfOBu-04SSpBxdS4ntZ_0 2024-09-12T18:01:49.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14884973279546357143', time=2024-09-12T19:54:45.418030+0000, chain.objs.size()=1 2024-09-12T18:01:49.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.l-esqvouY-Sv7LqtfAc17i1th53k07n_0 2024-09-12T18:01:49.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2013715210054790421', time=2024-09-12T19:54:45.420069+0000, chain.objs.size()=1 2024-09-12T18:01:49.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.0tdGGAkAKrFdR-lGH1j8LBpsjAS7O1u_0 2024-09-12T18:01:49.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7746952392754217493', time=2024-09-12T19:54:45.547431+0000, chain.objs.size()=1 2024-09-12T18:01:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.QEpISYgsEBwu3Ctbr9jDQwdoMcal_MB_0 2024-09-12T18:01:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17030867456026447388', time=2024-09-12T19:54:45.567034+0000, chain.objs.size()=1 2024-09-12T18:01:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.RnlbjvWCOGvfuF02kpNd2v4yqrKGosJ_0 2024-09-12T18:01:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15793737563961903470', time=2024-09-12T19:54:47.156007+0000, chain.objs.size()=1 2024-09-12T18:01:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.333__shadow_.0fHW-qpFXUegUpYAseafrOAR26Y_wTI_0 2024-09-12T18:01:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9247335268556263070', time=2024-09-12T19:55:17.029180+0000, chain.objs.size()=1 2024-09-12T18:01:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.464__shadow_.RXJ4Q53DvMmt1MRWRCrJz0HA-XhebES_0 2024-09-12T18:01:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6926436192721873827', time=2024-09-12T19:55:17.549535+0000, chain.objs.size()=1 2024-09-12T18:01:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.466__shadow_.-HMdGpCP-pv4CDi_p6Oacf1fXQIGR-D_0 2024-09-12T18:01:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16314109018149937731', time=2024-09-12T19:55:17.664655+0000, chain.objs.size()=1 2024-09-12T18:01:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.466__shadow_.lzUwUSdiozczVfqlwfFxZ2BMqeIx3vX_0 2024-09-12T18:01:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2560852042582938529', time=2024-09-12T19:55:17.864652+0000, chain.objs.size()=1 2024-09-12T18:01:49.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.467__shadow_.KLx4Uvk56gmhQWP1P9gPg40ejvK1R20_0 2024-09-12T18:01:49.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14346331166383130864', time=2024-09-12T19:55:26.007144+0000, chain.objs.size()=1 2024-09-12T18:01:49.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.504__shadow:LJGtw8qWDf3ub4lz88.3QWvXWYCll8k_.Bp6VPQ_fUJ9KipRh0aA-NF-t-jfxgdd_0 2024-09-12T18:01:49.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11212469233730209545', time=2024-09-12T19:55:27.599210+0000, chain.objs.size()=6 2024-09-12T18:01:49.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.586+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.1 2024-09-12T18:01:49.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.589+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.2 2024-09-12T18:01:49.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.589+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.3 2024-09-12T18:01:49.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.589+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.4 2024-09-12T18:01:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.5 2024-09-12T18:01:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.6 2024-09-12T18:01:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.592+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17249552059327308891', time=2024-09-12T19:55:27.825695+0000, chain.objs.size()=6 2024-09-12T18:01:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.1 2024-09-12T18:01:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.2 2024-09-12T18:01:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.3 2024-09-12T18:01:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.4 2024-09-12T18:01:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.5 2024-09-12T18:01:49.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.6 2024-09-12T18:01:49.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.592+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1418542930623464194', time=2024-09-12T19:55:32.737000+0000, chain.objs.size()=3 2024-09-12T18:01:49.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.522__multipart_mymultipart.2~-yl0Ioaqtua42LTJM_mMjYc7Unv6vqj.1 2024-09-12T18:01:49.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.522__multipart_mymultipart.2~-yl0Ioaqtua42LTJM_mMjYc7Unv6vqj.2 2024-09-12T18:01:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.594+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.522__multipart_mymultipart.2~-yl0Ioaqtua42LTJM_mMjYc7Unv6vqj.3 2024-09-12T18:01:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.594+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13599077794719531981', time=2024-09-12T19:55:33.120584+0000, chain.objs.size()=1 2024-09-12T18:01:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.594+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.521__shadow:CnEYVm8byFHI03Gwx.6acoa45xdkM7n_.zE7ZOsG6EbVvMNE9jw_6pEeKz0uZoNW_0 2024-09-12T18:01:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.594+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9990483658743659502', time=2024-09-12T19:56:12.625095+0000, chain.objs.size()=1 2024-09-12T18:01:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.594+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.556__shadow_.17rW2k7ESQT3iPC0yJLvtMR_AaGp23l_0 2024-09-12T18:01:49.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.597+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6595124549461246038', time=2024-09-12T19:56:27.464561+0000, chain.objs.size()=1 2024-09-12T18:01:49.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.597+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.571__shadow:nUxUAxTqGEWcAUEGcPatF8H7CtIWnMd_.Vnt5BsUmYGRGfnM8_SOUt9a5vA7X3AM_0 2024-09-12T18:01:49.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.597+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11011448109421409328', time=2024-09-12T19:56:31.213836+0000, chain.objs.size()=1 2024-09-12T18:01:49.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.597+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.575__shadow:zfVdnAd25BmeL8RW6xHeJgccxF3rrDP_.spu--yRPsNPNpv_T78iCGtVBASHVRoS_0 2024-09-12T18:01:49.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.597+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9971325143623630105', time=2024-09-12T19:56:34.757584+0000, chain.objs.size()=1 2024-09-12T18:01:49.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.597+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.577__shadow:oRh0zQ8xmM6HNLUcbYzV1B3qIHKvdUf_.lbIvkxB_fc01_AcC6pSPxN2tSum6l5d_0 2024-09-12T18:01:49.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.597+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2977487922589852789', time=2024-09-12T19:56:39.307551+0000, chain.objs.size()=1 2024-09-12T18:01:49.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.597+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:DeqcfkcmRFY5QxwdIIUXQj6T2y5jsNW_.hFfcI7LVxRYeweY8PoS44VRKQon1tyk_0 2024-09-12T18:01:49.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.597+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1320456210354266009', time=2024-09-12T19:56:39.717319+0000, chain.objs.size()=1 2024-09-12T18:01:49.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.597+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:4CI5qi7mfxYwieffQWRBGr-prkaKz2T_.7Gr5qNxdZjp1HiECa45E4Zbhz98W3S-_0 2024-09-12T18:01:49.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.597+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12868317890113655048', time=2024-09-12T19:56:44.021531+0000, chain.objs.size()=1 2024-09-12T18:01:49.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.597+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:uj5i55UgTIkujmsC3rzGUhIiXw2j.D6_.kHf96Ff-nC4fU0iBZmPjWjIDzm5PCQh_0 2024-09-12T18:01:49.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.597+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12432546894151664085', time=2024-09-12T19:56:47.300062+0000, chain.objs.size()=1 2024-09-12T18:01:49.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.597+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:0Wj7s4bVUmnMsSmUPqxEamJz1ucm6Xy_.ebQ3U2rdPZuIwrQzthJ1satwgrCStmD_0 2024-09-12T18:01:49.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.597+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4018501388105527034', time=2024-09-12T19:56:51.036354+0000, chain.objs.size()=1 2024-09-12T18:01:49.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.597+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.581__shadow:PsApgqwqjkbnkxy08UM7ac24chJ8ng4_.28GyzXAibbB1MoeEJC895bpzvX4U1yq_0 2024-09-12T18:01:49.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.600+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10232755840081598729', time=2024-09-12T19:59:08.507728+0000, chain.objs.size()=1 2024-09-12T18:01:49.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.600+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.636__shadow_.916PYJOPtwrxls82Vi13LtgBVGeKctG_0 2024-09-12T18:01:49.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.600+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10083245443331780932', time=2024-09-12T19:59:17.512041+0000, chain.objs.size()=1 2024-09-12T18:01:49.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.600+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.665__shadow_.5oFN9vOs5RsWJHrdHEQY2TM39TLj_dd_0 2024-09-12T18:01:49.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.600+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6327036751923605780', time=2024-09-12T19:59:20.813538+0000, chain.objs.size()=1 2024-09-12T18:01:49.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.600+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.680__shadow_._is6fw3A2S1bf7xr8TBmvyVWgArrQgr_0 2024-09-12T18:01:49.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.602+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4361975387297457069', time=2024-09-12T19:59:26.266886+0000, chain.objs.size()=1 2024-09-12T18:01:49.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.602+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.706__shadow:HfhwVBxwIkXeP9nRKeENfUJ-9tFCzPG_.mk5cH_Uf-X3iwbXpigleN4jnmCspgZr_0 2024-09-12T18:01:49.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.602+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.689308627519502921', time=2024-09-12T19:59:38.481496+0000, chain.objs.size()=1 2024-09-12T18:01:49.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.602+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.716__shadow:09O07AGsiAUraPuhp30wrq5tk5Vi-qX_.d_f7-ku7QMqvdvnY9vi2TSr9_10ujDl_0 2024-09-12T18:01:49.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.605+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:49.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.609+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:01:49.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.610+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:49.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.611+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:49.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47631' 2024-09-12T18:01:49.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9818881452382386565', time=2024-09-12T19:52:54.068692+0000, chain.objs.size()=2 2024-09-12T18:01:49.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.159__shadow_.gYJV2WwzBcMwKG_92IiQrfuT-xran3Y_0 2024-09-12T18:01:49.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.159__shadow_.gYJV2WwzBcMwKG_92IiQrfuT-xran3Y_1 2024-09-12T18:01:49.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6757527246136393011', time=2024-09-12T19:54:00.531876+0000, chain.objs.size()=1 2024-09-12T18:01:49.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.236__shadow_.v0ohgJZPNmE6BTprB_ipZ55avS5V0YT_0 2024-09-12T18:01:49.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11122796510431388566', time=2024-09-12T19:54:01.248948+0000, chain.objs.size()=1 2024-09-12T18:01:49.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.239__shadow_.fJllzM6l-gP6Jg2f2wvdbrddueVpyQO_0 2024-09-12T18:01:49.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16903180903781559391', time=2024-09-12T19:54:01.250311+0000, chain.objs.size()=1 2024-09-12T18:01:49.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.239__shadow_.KWpHa8hUNj5ertti4FrK4-tHsvm3RzE_0 2024-09-12T18:01:49.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16984860858028875014', time=2024-09-12T19:54:02.770597+0000, chain.objs.size()=1 2024-09-12T18:01:49.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.246__shadow_.pG1pEPiV4fYmp1Eiu66inj1DATzeiW-_0 2024-09-12T18:01:49.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15572367784076954938', time=2024-09-12T19:54:06.112038+0000, chain.objs.size()=1 2024-09-12T18:01:49.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.262__shadow_.dVz6PfpdKRW87F4A_h862qJlwNvUEoe_0 2024-09-12T18:01:49.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12687376468424269426', time=2024-09-12T19:54:13.555695+0000, chain.objs.size()=1 2024-09-12T18:01:49.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.RlZBfNNe-emYUlqr5xskMe2Qan_ofB0_0 2024-09-12T18:01:49.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11816235829302466835', time=2024-09-12T19:54:13.721710+0000, chain.objs.size()=1 2024-09-12T18:01:49.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.6lJhQ-U81N3Uwn3er5qosSyj4_Hgn-K_0 2024-09-12T18:01:49.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16688912096139947581', time=2024-09-12T19:54:13.733712+0000, chain.objs.size()=1 2024-09-12T18:01:49.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.fRzUhPTjFRZXnxDJXJv4_T0oIa3tjFZ_0 2024-09-12T18:01:49.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16722407921290204824', time=2024-09-12T19:54:13.752827+0000, chain.objs.size()=1 2024-09-12T18:01:49.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.aR7WtDpjKbHFmFwwX-fVbeiXf-QT5Lx_0 2024-09-12T18:01:49.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12521886984662801729', time=2024-09-12T19:54:13.832358+0000, chain.objs.size()=1 2024-09-12T18:01:49.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.612+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.WCGT7CiimdZoT6T7O8mN1N9UJO4J-K-_0 2024-09-12T18:01:49.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.615+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10858668338654238582', time=2024-09-12T19:54:13.919898+0000, chain.objs.size()=1 2024-09-12T18:01:49.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.615+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-KBTHvvOgeDiMvs2G5_Nyg3iz96tB-D_0 2024-09-12T18:01:49.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.615+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11585284688380809891', time=2024-09-12T19:54:13.921032+0000, chain.objs.size()=1 2024-09-12T18:01:49.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.615+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.IKH-jDMvGcnAKsS9gdm8h62ArqvRMx5_0 2024-09-12T18:01:49.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16009924710135792839', time=2024-09-12T19:54:13.926328+0000, chain.objs.size()=1 2024-09-12T18:01:49.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.OCzSe1G_fn-Y98w6SN55JaPoQVI2X3s_0 2024-09-12T18:01:49.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18161786983650180586', time=2024-09-12T19:54:14.022099+0000, chain.objs.size()=1 2024-09-12T18:01:49.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.0O6Hur22Ba-lx8t2t59IbZSM8JHPz79_0 2024-09-12T18:01:49.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8424899046351286692', time=2024-09-12T19:54:14.034353+0000, chain.objs.size()=1 2024-09-12T18:01:49.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.KqmCWdqCfUk24P34Ech5WGnk_1D0WcQ_0 2024-09-12T18:01:49.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16482022200987818824', time=2024-09-12T19:54:14.072677+0000, chain.objs.size()=1 2024-09-12T18:01:49.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.SasTInb4zjBfklOJjUXXYk7l-zVlhiQ_0 2024-09-12T18:01:49.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2396535865021555489', time=2024-09-12T19:54:14.079127+0000, chain.objs.size()=1 2024-09-12T18:01:49.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Yg1jU-aBiPRLQpinib4-NXCngfeNm0p_0 2024-09-12T18:01:49.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10602440112369013482', time=2024-09-12T19:54:14.416782+0000, chain.objs.size()=1 2024-09-12T18:01:49.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Lw42um8sPfGKhvK8uNbXBwwPLREA0kY_0 2024-09-12T18:01:49.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11783222044988926302', time=2024-09-12T19:54:14.425229+0000, chain.objs.size()=1 2024-09-12T18:01:49.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.nS9qyiLSWJKu4VU7oETGQ8_Q5uggZAp_0 2024-09-12T18:01:49.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13757532485759139863', time=2024-09-12T19:54:14.567965+0000, chain.objs.size()=1 2024-09-12T18:01:49.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.BaR3Bmf7uVASsw3sGWaIeHKxBRmjSdz_0 2024-09-12T18:01:49.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18063971164120643798', time=2024-09-12T19:54:14.723345+0000, chain.objs.size()=1 2024-09-12T18:01:49.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.616+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.VxK87Ilv9JN5wyEJlHmrMCgJQILMPZy_0 2024-09-12T18:01:49.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.617+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9945519551956043678', time=2024-09-12T19:54:14.755596+0000, chain.objs.size()=1 2024-09-12T18:01:49.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.617+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-BfmxdcaKl9VfVZjM6OB2UPFidHRTdE_0 2024-09-12T18:01:49.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.617+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6325010321103526919', time=2024-09-12T19:54:14.886147+0000, chain.objs.size()=1 2024-09-12T18:01:49.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.617+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.CgGE4BkUGtjLdiDu1qJ-tOhiKOEN65w_0 2024-09-12T18:01:49.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.617+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8512292573731676192', time=2024-09-12T19:54:15.313162+0000, chain.objs.size()=1 2024-09-12T18:01:49.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.617+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.265__shadow_.m_P0KgZg0LvpadO0M1nPeBeCdmw2JXC_0 2024-09-12T18:01:49.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.619+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5193082696637075613', time=2024-09-12T19:54:16.728144+0000, chain.objs.size()=1 2024-09-12T18:01:49.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.619+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.272__shadow_.lWO1urHJR2A1zzgcnlenDtiVyaMxVyn_0 2024-09-12T18:01:49.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.619+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8369228249634515078', time=2024-09-12T19:54:17.560989+0000, chain.objs.size()=1 2024-09-12T18:01:49.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.619+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.276__shadow_.S2uR-A7vfeaSflZFm29Mg6NHsyORzCz_0 2024-09-12T18:01:49.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.619+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6445604029394292799', time=2024-09-12T19:54:17.768223+0000, chain.objs.size()=1 2024-09-12T18:01:49.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.619+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.277__shadow_.uX5-mC-eV3lDDxeKY0A6EV_7DEQD8qo_0 2024-09-12T18:01:49.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1319510631544735637', time=2024-09-12T19:54:18.184499+0000, chain.objs.size()=1 2024-09-12T18:01:49.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.279__shadow_.FVzkjrXQ3kLIWi7NBG6fn2cuyJ5K4gF_0 2024-09-12T18:01:49.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6892113451047133986', time=2024-09-12T19:54:18.185287+0000, chain.objs.size()=1 2024-09-12T18:01:49.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.279__shadow_.j8zSY8VAQQhjN4PG-Wbxe5_zXOewKJ0_0 2024-09-12T18:01:49.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6186980332926125794', time=2024-09-12T19:54:21.589742+0000, chain.objs.size()=1 2024-09-12T18:01:49.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.1ydlP__GaT4XSnct6effAT7ZlW9et43_0 2024-09-12T18:01:49.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8908026067318086122', time=2024-09-12T19:54:22.165388+0000, chain.objs.size()=1 2024-09-12T18:01:49.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.Wz6mxV6s1rVBrvgSXhfjvdKxpTUTb-H_0 2024-09-12T18:01:49.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17082639025432969353', time=2024-09-12T19:54:23.321301+0000, chain.objs.size()=1 2024-09-12T18:01:49.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.299__shadow_.cUYq5q9RjGaT0T68SZT-DqOVmeys4Hr_0 2024-09-12T18:01:49.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10189832941064695665', time=2024-09-12T19:54:24.176579+0000, chain.objs.size()=1 2024-09-12T18:01:49.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.303__shadow_.geVFKPs3WSh5NIr7rgyC04IQABZ-9xZ_0 2024-09-12T18:01:49.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10287459108386709858', time=2024-09-12T19:54:28.204747+0000, chain.objs.size()=1 2024-09-12T18:01:49.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.323__shadow_.PpPxHWI5hYfM6UK_zTDQJ1T04fW_m4V_0 2024-09-12T18:01:49.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.257290064326779533', time=2024-09-12T19:54:35.793987+0000, chain.objs.size()=1 2024-09-12T18:01:49.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.6EqfoTsLFqjpSgoKxDWa7rS53V4GW20_0 2024-09-12T18:01:49.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16939465296925213348', time=2024-09-12T19:54:35.798661+0000, chain.objs.size()=1 2024-09-12T18:01:49.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.622+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.H7IjZbrNRQToZHf09vT0iOnpwZsFqzP_0 2024-09-12T18:01:49.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.624+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13012732785835810510', time=2024-09-12T19:54:35.803124+0000, chain.objs.size()=1 2024-09-12T18:01:49.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.624+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.V6idYoRaCqvW7BuTEGejBfzeZ36x8PA_0 2024-09-12T18:01:49.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.625+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16948701095074010912', time=2024-09-12T19:54:35.991570+0000, chain.objs.size()=1 2024-09-12T18:01:49.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.625+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.e1KPHnxECzdTPbaVTrqKz8cNyJE7aSQ_0 2024-09-12T18:01:49.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.625+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11681586498615893119', time=2024-09-12T19:54:36.114204+0000, chain.objs.size()=1 2024-09-12T18:01:49.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.625+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.R_n9ms0qH1RKa0e8YqPPCHZDTXWi0X3_0 2024-09-12T18:01:49.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7224913466741824227', time=2024-09-12T19:54:36.167925+0000, chain.objs.size()=1 2024-09-12T18:01:49.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Cb54vYd8si0NB5NU8KF-7bUK2MX_jXw_0 2024-09-12T18:01:49.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8746700859667795046', time=2024-09-12T19:54:36.251081+0000, chain.objs.size()=1 2024-09-12T18:01:49.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.VwuXAQHNnFnhUd_TtZtzNPVAACKLtNT_0 2024-09-12T18:01:49.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17374945474080841339', time=2024-09-12T19:54:36.278271+0000, chain.objs.size()=1 2024-09-12T18:01:49.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.geissP70aAzXOs-n46UaUJniKHlTrGe_0 2024-09-12T18:01:49.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13677069940928712158', time=2024-09-12T19:54:36.283864+0000, chain.objs.size()=1 2024-09-12T18:01:49.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_._kQm_j24fOwe0tRqBPG198WnNH-LxfT_0 2024-09-12T18:01:49.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7659515399964642467', time=2024-09-12T19:54:36.292996+0000, chain.objs.size()=1 2024-09-12T18:01:49.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.BJ-jXgCZ7yYXwfsS4wfryEc6kI-p2v-_0 2024-09-12T18:01:49.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14587774977338780812', time=2024-09-12T19:54:36.293857+0000, chain.objs.size()=1 2024-09-12T18:01:49.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rCQ2KukCaoxF9OsJQX9fU3JOSA5hLe2_0 2024-09-12T18:01:49.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.336087486698360621', time=2024-09-12T19:54:36.326310+0000, chain.objs.size()=1 2024-09-12T18:01:49.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.bC3QmeUCwCaZCJCx6nkJytBZXYN406o_0 2024-09-12T18:01:49.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11162922599348156302', time=2024-09-12T19:54:36.327253+0000, chain.objs.size()=1 2024-09-12T18:01:49.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-vt14BLlLdKOES0YoljmDzZRrfZN18A_0 2024-09-12T18:01:49.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1624447698597736937', time=2024-09-12T19:54:36.461793+0000, chain.objs.size()=1 2024-09-12T18:01:49.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.627+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.N0XBFsvRDIewMIbaZWryh1Lm6MxJzF7_0 2024-09-12T18:01:49.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.630+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17909841113788557118', time=2024-09-12T19:54:36.468018+0000, chain.objs.size()=1 2024-09-12T18:01:49.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.630+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.X0GmIMYSLnNlnY8zhK8pCXkvC01IMTV_0 2024-09-12T18:01:49.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.630+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18236881374352914911', time=2024-09-12T19:54:36.597666+0000, chain.objs.size()=1 2024-09-12T18:01:49.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.630+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.buGyCsV0QhK5YJ0loTZ0PON9GGsatfj_0 2024-09-12T18:01:49.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7059341001415352157', time=2024-09-12T19:54:36.599848+0000, chain.objs.size()=1 2024-09-12T18:01:49.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.pmyemEW_vZvyci5IR35ZydRSd_HecT9_0 2024-09-12T18:01:49.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13137251716929809604', time=2024-09-12T19:54:36.617378+0000, chain.objs.size()=1 2024-09-12T18:01:49.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-_y9Uj7Vr2PxZUFz7zeAPYVlHfXLbw6_0 2024-09-12T18:01:49.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14709951580296047939', time=2024-09-12T19:54:36.649194+0000, chain.objs.size()=1 2024-09-12T18:01:49.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ovzcvtFuIFTBjxU-8oUbGMO1t5Sk2Kt_0 2024-09-12T18:01:49.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14163633935438252082', time=2024-09-12T19:54:36.667641+0000, chain.objs.size()=1 2024-09-12T18:01:49.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.46KUjeQNGmLCMLflWbIWLjtm70X6vei_0 2024-09-12T18:01:49.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14591230595480420639', time=2024-09-12T19:54:36.768269+0000, chain.objs.size()=1 2024-09-12T18:01:49.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ApDsuh5IlA177tQ9WjDEwTVWl15Jcn6_0 2024-09-12T18:01:49.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3591015244879171216', time=2024-09-12T19:54:36.782223+0000, chain.objs.size()=1 2024-09-12T18:01:49.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.NMsNMGniz56zztj1Uz6ynTW7szgsUg__0 2024-09-12T18:01:49.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2608008221195590816', time=2024-09-12T19:54:36.793096+0000, chain.objs.size()=1 2024-09-12T18:01:49.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.EdA-m7QMHCELFCSi-eJf4LTldWO9FzP_0 2024-09-12T18:01:49.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1107437149191346585', time=2024-09-12T19:54:36.800639+0000, chain.objs.size()=1 2024-09-12T18:01:49.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.yXchsnZG6nZVGDxD7YjlRpi_WWIhsb4_0 2024-09-12T18:01:49.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1874859812898224704', time=2024-09-12T19:54:36.801862+0000, chain.objs.size()=1 2024-09-12T18:01:49.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.632+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.xcoQG4NyVI6x0O57AfjO-BRHFKZIhww_0 2024-09-12T18:01:49.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.635+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17403762724678900738', time=2024-09-12T19:54:36.802837+0000, chain.objs.size()=1 2024-09-12T18:01:49.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.635+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rW5TkXtDLo-NHD9XDzjLcO_g_szfOOx_0 2024-09-12T18:01:49.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.635+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15278144379887097125', time=2024-09-12T19:54:36.823257+0000, chain.objs.size()=1 2024-09-12T18:01:49.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.635+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.7f4bFzU4OFjfek0EoJWDAlZTuynTLFh_0 2024-09-12T18:01:49.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.635+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6484376709837984580', time=2024-09-12T19:54:36.825959+0000, chain.objs.size()=1 2024-09-12T18:01:49.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.635+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4-AVXpVjXMr-8_5RDKHgzBrulZls5so_0 2024-09-12T18:01:49.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.637+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16896388346963297523', time=2024-09-12T19:54:36.833288+0000, chain.objs.size()=1 2024-09-12T18:01:49.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.637+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.EAiefcwqZUzK3wxY5ZJ1HHdtrDyQmKx_0 2024-09-12T18:01:49.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.637+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2361353401605396216', time=2024-09-12T19:54:36.931361+0000, chain.objs.size()=1 2024-09-12T18:01:49.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.637+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.FPOJCxnV_t7qeBycj_AU8Yd2J_lSUvg_0 2024-09-12T18:01:49.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.637+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3676107218713929860', time=2024-09-12T19:54:36.967637+0000, chain.objs.size()=1 2024-09-12T18:01:49.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.637+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.pgEg4U3Ysjq7S-EFS3_lotxs12KpE3p_0 2024-09-12T18:01:49.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.638+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10165916988733332905', time=2024-09-12T19:54:36.973763+0000, chain.objs.size()=1 2024-09-12T18:01:49.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.638+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.IXDuWwqqUjnTGD5WYW3HuAtb3DD--t0_0 2024-09-12T18:01:49.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.638+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2914096535324006751', time=2024-09-12T19:54:44.470564+0000, chain.objs.size()=1 2024-09-12T18:01:49.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.638+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.YkGLumUL7X3irAh2AFp3Qps9EWSUHDQ_0 2024-09-12T18:01:49.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.638+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2001777607225915055', time=2024-09-12T19:54:44.477046+0000, chain.objs.size()=1 2024-09-12T18:01:49.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.638+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.WRpvcC760eDuGWnL3a_7J6DBeJl1VBg_0 2024-09-12T18:01:49.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.638+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8859710431735787381', time=2024-09-12T19:54:44.501009+0000, chain.objs.size()=1 2024-09-12T18:01:49.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.638+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Huyq5FiU7kiGmiGKI5X-tADNlu4CEoF_0 2024-09-12T18:01:49.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.638+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4840340252994461508', time=2024-09-12T19:54:44.525268+0000, chain.objs.size()=1 2024-09-12T18:01:49.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.638+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.BUIBatVliFrqeN8wv54P3BNFWv4LAoD_0 2024-09-12T18:01:49.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.638+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12050798595683689050', time=2024-09-12T19:54:44.630029+0000, chain.objs.size()=1 2024-09-12T18:01:49.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.638+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9boOWRHCC_TLs9befbXI8mtdHcOfpDk_0 2024-09-12T18:01:49.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.638+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2201903009095701748', time=2024-09-12T19:54:44.631693+0000, chain.objs.size()=1 2024-09-12T18:01:49.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.638+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Tp_Q4JNdKWnEzk06LOTCypF7xiI2klm_0 2024-09-12T18:01:49.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.638+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2431320203328682674', time=2024-09-12T19:54:44.642503+0000, chain.objs.size()=1 2024-09-12T18:01:49.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.638+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-9W3luZ3MGTIxEkR0HsT7-kZsbriO0z_0 2024-09-12T18:01:49.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.640+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15837083917855664951', time=2024-09-12T19:54:44.657816+0000, chain.objs.size()=1 2024-09-12T18:01:49.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.640+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.HMOvw2wHDWUGghLqYwnr9tkNWl8cbAt_0 2024-09-12T18:01:49.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.640+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12837125692994483065', time=2024-09-12T19:54:44.682038+0000, chain.objs.size()=1 2024-09-12T18:01:49.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.640+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ahD4ZNMbJ1CbLbO67mlvmQujUb-XMtp_0 2024-09-12T18:01:49.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.640+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4847854535322499869', time=2024-09-12T19:54:44.706613+0000, chain.objs.size()=1 2024-09-12T18:01:49.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.640+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.fqjqrPunDyK01lUzsz83Yi1dpHL9WLE_0 2024-09-12T18:01:49.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.640+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17502143538692669526', time=2024-09-12T19:54:44.710066+0000, chain.objs.size()=1 2024-09-12T18:01:49.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.640+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.OO7vdkn0p5nF1CAs49pSV9qUbA_wI8Q_0 2024-09-12T18:01:49.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.640+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9180881161241656272', time=2024-09-12T19:54:44.710764+0000, chain.objs.size()=1 2024-09-12T18:01:49.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.640+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.kWTbtsYGgxpFTtn3QWXwamg4VKB5xMG_0 2024-09-12T18:01:49.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15775706220289710125', time=2024-09-12T19:54:44.811719+0000, chain.objs.size()=1 2024-09-12T18:01:49.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.WCirpSC95LUZRXpWA9o-2BKjoTIrCeM_0 2024-09-12T18:01:49.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13720803985226770988', time=2024-09-12T19:54:44.812509+0000, chain.objs.size()=1 2024-09-12T18:01:49.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.1vYEzAnMzZNphce7NHx7yLRG-kv3AFI_0 2024-09-12T18:01:49.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9150151089039983071', time=2024-09-12T19:54:44.813139+0000, chain.objs.size()=1 2024-09-12T18:01:49.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.bxtXrRFnGsn46pZZYqqJn-_3J1drsjE_0 2024-09-12T18:01:49.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8984787221170013156', time=2024-09-12T19:54:44.836719+0000, chain.objs.size()=1 2024-09-12T18:01:49.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-TxN62mIJ4M5SCDnIqoSZnaIlCxsjOt_0 2024-09-12T18:01:49.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.939101542276841321', time=2024-09-12T19:54:44.848649+0000, chain.objs.size()=1 2024-09-12T18:01:49.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.QY1r9cikpAg_h3eGcZ3VRUItHEQBNZU_0 2024-09-12T18:01:49.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3579314279420212826', time=2024-09-12T19:54:44.869732+0000, chain.objs.size()=1 2024-09-12T18:01:49.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.gPB01dRnMenvKbBEcC2oqEbb5ohnGh1_0 2024-09-12T18:01:49.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16757832794557498737', time=2024-09-12T19:54:44.871813+0000, chain.objs.size()=1 2024-09-12T18:01:49.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.8iiVL5sbiWyodCES6_EdT0jCnuXN1yh_0 2024-09-12T18:01:49.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3206925399964612300', time=2024-09-12T19:54:45.009863+0000, chain.objs.size()=1 2024-09-12T18:01:49.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.oYw-V-b3N4R6EhAEQJw9k5KZG-7Ll4R_0 2024-09-12T18:01:49.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7349888260642034767', time=2024-09-12T19:54:45.011559+0000, chain.objs.size()=1 2024-09-12T18:01:49.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.643+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.dZmoP-8BTh_UF5uZ5MgMj5lY9kgA_-r_0 2024-09-12T18:01:49.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.645+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7389012250684849624', time=2024-09-12T19:54:45.058991+0000, chain.objs.size()=1 2024-09-12T18:01:49.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.645+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.tHCYk2uhfrwlVnbDYaL0DWBfeWRr1O9_0 2024-09-12T18:01:49.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.645+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16434838837166932010', time=2024-09-12T19:54:45.175284+0000, chain.objs.size()=1 2024-09-12T18:01:49.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.645+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.yL8VZN-xAIVhYtq3D3AWcKMccnFlXPn_0 2024-09-12T18:01:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12638889900395896891', time=2024-09-12T19:54:45.230494+0000, chain.objs.size()=1 2024-09-12T18:01:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Jn5egnm-jpH_mGSqXh5SvNWh-sU6WBV_0 2024-09-12T18:01:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3696673059600908683', time=2024-09-12T19:54:45.233820+0000, chain.objs.size()=1 2024-09-12T18:01:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.F2IMxdw1baf4AFHqKX03rxHxcljirWO_0 2024-09-12T18:01:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7108737804690782784', time=2024-09-12T19:54:45.236454+0000, chain.objs.size()=1 2024-09-12T18:01:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.viiYRoXNmDVc-4myqsBtc6yPYT3-rKk_0 2024-09-12T18:01:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16718005882518857049', time=2024-09-12T19:54:45.246644+0000, chain.objs.size()=1 2024-09-12T18:01:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.WLQaVtqnX8urjVy-XYTXhhDPsN_R_1i_0 2024-09-12T18:01:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4781866506473759439', time=2024-09-12T19:54:45.252078+0000, chain.objs.size()=1 2024-09-12T18:01:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.IXqvAmL7rky8Cq6L47vyzmXdTVvwsyK_0 2024-09-12T18:01:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12365187989061162998', time=2024-09-12T19:54:45.357968+0000, chain.objs.size()=1 2024-09-12T18:01:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.8IoxxCzasB7mUXMyS7STkxy8ARpSEYm_0 2024-09-12T18:01:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9878733492611413953', time=2024-09-12T19:54:45.386166+0000, chain.objs.size()=1 2024-09-12T18:01:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ErGaDLO41DmFUH_Lmd4_ibapkkiSeZ1_0 2024-09-12T18:01:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15837891698003610866', time=2024-09-12T19:54:45.510024+0000, chain.objs.size()=1 2024-09-12T18:01:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.yqpKJaW-QZhEnKAc_ggrWHmaiXV3bDp_0 2024-09-12T18:01:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6127603165177286196', time=2024-09-12T19:54:45.543319+0000, chain.objs.size()=1 2024-09-12T18:01:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Z59YB050S2BpuRV1fjleNttCZjYNPMR_0 2024-09-12T18:01:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8170206888485168368', time=2024-09-12T19:54:45.576040+0000, chain.objs.size()=1 2024-09-12T18:01:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.648+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.nybDOx5mFHJk-21-56JYfw6gB78LbRv_0 2024-09-12T18:01:49.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.655+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/47631 2024-09-12T18:01:49.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T18:01:49.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.43913575335963242', time=2024-09-12T19:54:45.601102+0000, chain.objs.size()=1 2024-09-12T18:01:49.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.1Xx7zyegKpQa-DzdQja7-1NwBFXIOR1_0 2024-09-12T18:01:49.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6805543580285539430', time=2024-09-12T19:54:45.603403+0000, chain.objs.size()=1 2024-09-12T18:01:49.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Pf7QI5rFVxEjzI_58g8oGG-CVkhR4Ex_0 2024-09-12T18:01:49.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4145467133970815616', time=2024-09-12T19:54:45.711945+0000, chain.objs.size()=1 2024-09-12T18:01:49.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.b8cou3x20Yjjak6AKXHPUqTNBjA3Pln_0 2024-09-12T18:01:49.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10501518352196615663', time=2024-09-12T19:54:45.713712+0000, chain.objs.size()=1 2024-09-12T18:01:49.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.N_m99c37e-c42Q6yH59bi7-yhIR7VRK_0 2024-09-12T18:01:49.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6787502843446364663', time=2024-09-12T19:54:45.726573+0000, chain.objs.size()=1 2024-09-12T18:01:49.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jK4iSjNRWFr6Bb1KpiXP0pYaQuh1_Sn_0 2024-09-12T18:01:49.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5148169547887725832', time=2024-09-12T19:54:45.727370+0000, chain.objs.size()=1 2024-09-12T18:01:49.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TQgyv3znUC9UEgxSjbwwch9-r6byYdW_0 2024-09-12T18:01:49.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13236498265686249418', time=2024-09-12T19:54:45.729917+0000, chain.objs.size()=1 2024-09-12T18:01:49.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.uO0Y_aJsu6q1UVYzbhfeF-MYVARQk9p_0 2024-09-12T18:01:49.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1489466020741040135', time=2024-09-12T19:54:49.378747+0000, chain.objs.size()=1 2024-09-12T18:01:49.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.344__shadow_.2sXvv1--p7zjkpudGrzGXpsu2IkfbKk_0 2024-09-12T18:01:49.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.994804585860415183', time=2024-09-12T19:55:15.430766+0000, chain.objs.size()=1 2024-09-12T18:01:49.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.460__shadow_.9gMpElTIhFsRc0gqYQ7NlCSI7wYf8Sx_0 2024-09-12T18:01:49.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5568391684931337268', time=2024-09-12T19:55:16.681028+0000, chain.objs.size()=1 2024-09-12T18:01:49.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.463__shadow_.zjIUy0AWARgOEXNKOk6SfozNobrxnT4_0 2024-09-12T18:01:49.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14378017591404090332', time=2024-09-12T19:55:17.345616+0000, chain.objs.size()=1 2024-09-12T18:01:49.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.465__shadow_.tsenOIb1GfG3jD9LYZrJSNylpQpjluO_0 2024-09-12T18:01:49.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.791732306558820716', time=2024-09-12T19:55:17.664884+0000, chain.objs.size()=1 2024-09-12T18:01:49.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.466__shadow_.NWT0J06mAgwfqx9DoBxYjWDZoWfKIcN_0 2024-09-12T18:01:49.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.659+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4582252759471902713', time=2024-09-12T19:55:17.979747+0000, chain.objs.size()=1 2024-09-12T18:01:49.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.659+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.467__shadow_.JNuDFxmC1yzWenco9eG_xoSqBVlN0N5_0 2024-09-12T18:01:49.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11012427668130607519', time=2024-09-12T19:55:20.954265+0000, chain.objs.size()=1 2024-09-12T18:01:49.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.484__shadow_.cWiux9XWnQ49g0tKz1io2VG0uaRJdQ1_0 2024-09-12T18:01:49.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4070231804960851354', time=2024-09-12T19:55:21.169018+0000, chain.objs.size()=1 2024-09-12T18:01:49.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.485__shadow_.A74bP8n5cdaGCf5F-of3wpjY4OQsicT_0 2024-09-12T18:01:49.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2048031642373199348', time=2024-09-12T19:55:24.075056+0000, chain.objs.size()=1 2024-09-12T18:01:49.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.497__shadow_.S_i107bzqPo0YSMrQ9zULa2k3hDS2ZP_0 2024-09-12T18:01:49.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17498337779192136249', time=2024-09-12T19:55:26.122033+0000, chain.objs.size()=1 2024-09-12T18:01:49.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.504__shadow:LJGtw8qWDf3ub4lz88.3QWvXWYCll8k_.Bp6VPQ_fUJ9KipRh0aA-NF-t-jfxgdd_0 2024-09-12T18:01:49.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6614422299920646143', time=2024-09-12T19:55:30.574424+0000, chain.objs.size()=2 2024-09-12T18:01:49.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.518__shadow_.aFJUgZNQqxkIbXntC3olWzKbBR1ccTC_0 2024-09-12T18:01:49.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.518__shadow_.aFJUgZNQqxkIbXntC3olWzKbBR1ccTC_1 2024-09-12T18:01:49.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18424165341993102186', time=2024-09-12T19:56:11.801751+0000, chain.objs.size()=1 2024-09-12T18:01:49.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.554__shadow_.gq0DW5yfANaJuN2KPsDjfW8ASVt8i1j_0 2024-09-12T18:01:49.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2344585821147368794', time=2024-09-12T19:56:12.180897+0000, chain.objs.size()=1 2024-09-12T18:01:49.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.555__shadow_.VixzN3Zg5Nfb2aPnZ2wWmJugReHudKh_0 2024-09-12T18:01:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10742061903044794898', time=2024-09-12T19:56:27.046171+0000, chain.objs.size()=1 2024-09-12T18:01:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:sQJcffbOMg0TJonXsijautUl133R4HN_.HmFiG_DbVNedEkS4dTxPCNyZ7GyfJjT_0 2024-09-12T18:01:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2776330878682381296', time=2024-09-12T19:56:29.091156+0000, chain.objs.size()=1 2024-09-12T18:01:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.660+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.575__shadow_.SF-OxJxq_Dc28aIfEXQmQ0iSteTlCRm_0 2024-09-12T18:01:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.662+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9157387139061813493', time=2024-09-12T19:56:36.639612+0000, chain.objs.size()=1 2024-09-12T18:01:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.662+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:49zXHIjkoM-hjHexu6SNshj7iLtcki-_.zarwnPAEF_5S2ILqxjdinPqqCgzpMhJ_0 2024-09-12T18:01:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.662+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12269338206196448546', time=2024-09-12T19:56:47.106234+0000, chain.objs.size()=1 2024-09-12T18:01:49.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.662+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:Qc3gKFKL9AE4x7ZRbxvyl-o-3qy9N5S_.p9o3rdZRVbQTIhLShq9RyTAjyvXF6_-_0 2024-09-12T18:01:49.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.662+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7136547748726290779', time=2024-09-12T19:56:52.488513+0000, chain.objs.size()=1 2024-09-12T18:01:49.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.662+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.586__shadow:lOlPMSOFAEVcxHOnBz6YOvg42OXfOFG_.qDBL9NvAWwv1Jo074SWHnso751INvG__0 2024-09-12T18:01:49.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15213047963161469565', time=2024-09-12T19:56:53.050228+0000, chain.objs.size()=1 2024-09-12T18:01:49.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.588__shadow:iUJGVw5SH9GJR6GT1dNXFBDQF-HrQLa_._eYUdNFWLI9wbOMo6vViXzd6lfJ2HNU_0 2024-09-12T18:01:49.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6873652491319299373', time=2024-09-12T19:59:08.737247+0000, chain.objs.size()=1 2024-09-12T18:01:49.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.637__shadow_.EpPB7yXoVj7xvsu1IdkW2w9NTs7M3Kf_0 2024-09-12T18:01:49.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4936522821119374652', time=2024-09-12T19:59:12.845040+0000, chain.objs.size()=1 2024-09-12T18:01:49.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.652__shadow_.UFFZkuzzefqOZQCKI2s8DTHfPpLZ1c7_0 2024-09-12T18:01:49.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15562379128104313740', time=2024-09-12T19:59:17.821117+0000, chain.objs.size()=1 2024-09-12T18:01:49.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.666__shadow_.A9kxIm_PGSvISnH8kr2VFtrDCeBlWJd_0 2024-09-12T18:01:49.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8634127036916754553', time=2024-09-12T19:59:20.813322+0000, chain.objs.size()=1 2024-09-12T18:01:49.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.680__shadow_.CGpVVVD6Zi5YI3LpDcvrulkaxcQjLPa_0 2024-09-12T18:01:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6485841549962083058', time=2024-09-12T19:59:23.908012+0000, chain.objs.size()=1 2024-09-12T18:01:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.696__shadow_.mviQVMD0Luw27CQIy4Y9g2O9mjoe27p_0 2024-09-12T18:01:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6946898023719412501', time=2024-09-12T19:59:24.599700+0000, chain.objs.size()=1 2024-09-12T18:01:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.699__shadow:.YIB7QQ0EcBMtlwsO282hFom-qzNajb_.n2FpTF7u_KcJ3hRuWxdIk2VWkRP5Nnh_0 2024-09-12T18:01:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16127508058733859812', time=2024-09-12T19:59:52.521221+0000, chain.objs.size()=10 2024-09-12T18:01:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.736__multipart_foo.2~eEuP7oP5_RgQx1yPk9otez5O-YF_6kf.1 2024-09-12T18:01:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.663+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.736__multipart_foo.2~eEuP7oP5_RgQx1yPk9otez5O-YF_6kf.2 2024-09-12T18:01:49.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.664+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.736__multipart_foo.2~eEuP7oP5_RgQx1yPk9otez5O-YF_6kf.3 2024-09-12T18:01:49.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.664+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.736__multipart_foo.2~eEuP7oP5_RgQx1yPk9otez5O-YF_6kf.4 2024-09-12T18:01:49.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.665+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.736__multipart_foo.2~eEuP7oP5_RgQx1yPk9otez5O-YF_6kf.5 2024-09-12T18:01:49.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.665+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.736__multipart_foo.2~eEuP7oP5_RgQx1yPk9otez5O-YF_6kf.6 2024-09-12T18:01:49.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.666+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.736__multipart_foo.2~eEuP7oP5_RgQx1yPk9otez5O-YF_6kf.7 2024-09-12T18:01:49.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.666+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.736__multipart_foo.2~eEuP7oP5_RgQx1yPk9otez5O-YF_6kf.8 2024-09-12T18:01:49.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.666+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.736__multipart_foo.2~eEuP7oP5_RgQx1yPk9otez5O-YF_6kf.9 2024-09-12T18:01:49.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.666+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.736__multipart_foo.2~eEuP7oP5_RgQx1yPk9otez5O-YF_6kf.10 2024-09-12T18:01:49.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.668+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:49.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.670+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:01:49.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.671+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:49.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.672+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:49.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/80053' 2024-09-12T18:01:49.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9301432415595983602', time=2024-09-12T19:52:55.697079+0000, chain.objs.size()=2 2024-09-12T18:01:49.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.161__shadow_.9shqk8ewBTRJ0PPlNYLA6k9RLYYiLzK_0 2024-09-12T18:01:49.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.161__shadow_.9shqk8ewBTRJ0PPlNYLA6k9RLYYiLzK_1 2024-09-12T18:01:49.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11217147765332398329', time=2024-09-12T19:53:59.650436+0000, chain.objs.size()=1 2024-09-12T18:01:49.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.232__shadow_.gPOBCx1kEub4QI7qkFjpZGjmIJzaIYR_0 2024-09-12T18:01:49.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6839881968648579829', time=2024-09-12T19:54:00.531183+0000, chain.objs.size()=1 2024-09-12T18:01:49.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.236__shadow_.PLPRCAh1tlWA2LLr12L8vV7E3HwBSUu_0 2024-09-12T18:01:49.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12018798813839095569', time=2024-09-12T19:54:03.007974+0000, chain.objs.size()=1 2024-09-12T18:01:49.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.247__shadow_.WJ6Dl_RnadTygZuM0RY71teojNPv-Gt_0 2024-09-12T18:01:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13052194788154943467', time=2024-09-12T19:54:04.024736+0000, chain.objs.size()=1 2024-09-12T18:01:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.252__shadow_.o8Sd5abfriDhdCONRsBQP5f7FY-jd1D_0 2024-09-12T18:01:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9181387365753453332', time=2024-09-12T19:54:13.556011+0000, chain.objs.size()=1 2024-09-12T18:01:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.j23LSQe_Z87o2ZtNc64KghRELpyc1jE_0 2024-09-12T18:01:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8175259574796316048', time=2024-09-12T19:54:13.565474+0000, chain.objs.size()=1 2024-09-12T18:01:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.4JhW4gdkF0zgGzeH0v4UncF8Qy_XVJ-_0 2024-09-12T18:01:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5094024067055292823', time=2024-09-12T19:54:13.576968+0000, chain.objs.size()=1 2024-09-12T18:01:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.F-yjk0p6jdU3EKrH44DJuXA6t71tBZS_0 2024-09-12T18:01:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1118324450351117840', time=2024-09-12T19:54:13.672953+0000, chain.objs.size()=1 2024-09-12T18:01:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.19VPMFHaTl-lIvNAcZI6jUVPa4LRCNu_0 2024-09-12T18:01:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2006055597781078932', time=2024-09-12T19:54:13.714181+0000, chain.objs.size()=1 2024-09-12T18:01:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.vduBqXbX2oRFokxV1AwofJI6lOJwGt2_0 2024-09-12T18:01:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11758279505835945104', time=2024-09-12T19:54:13.736043+0000, chain.objs.size()=1 2024-09-12T18:01:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.IVeKU6-GxwXc2MEo28iqyr0LKoyfxiZ_0 2024-09-12T18:01:49.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.676+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13945565314724861352', time=2024-09-12T19:54:13.738808+0000, chain.objs.size()=1 2024-09-12T18:01:49.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.676+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.g7CiiasCCG5X0hArpBOtbBV-wAk3yom_0 2024-09-12T18:01:49.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.676+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11188244606126200312', time=2024-09-12T19:54:13.834414+0000, chain.objs.size()=1 2024-09-12T18:01:49.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.676+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.BWhezsKgRADXo2tf8cqoiW0lbvcSWpj_0 2024-09-12T18:01:49.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.676+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4396651568891786168', time=2024-09-12T19:54:13.911355+0000, chain.objs.size()=1 2024-09-12T18:01:49.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.676+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.pZ-yn83sV-Dm69nxuTWnWvWEVq1md1U_0 2024-09-12T18:01:49.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.676+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5855599117093305358', time=2024-09-12T19:54:14.004663+0000, chain.objs.size()=1 2024-09-12T18:01:49.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.676+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.T4RhEsrq57orQxwTrnv6pWAADqurehl_0 2024-09-12T18:01:49.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.677+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12946516159858815524', time=2024-09-12T19:54:14.025416+0000, chain.objs.size()=1 2024-09-12T18:01:49.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.677+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Td549BwYZfaf7wMN6FuiVHLRCNzzQN0_0 2024-09-12T18:01:49.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.677+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4508924767349395291', time=2024-09-12T19:54:14.036776+0000, chain.objs.size()=1 2024-09-12T18:01:49.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.677+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.NO50fkCdF8T_FWvoQ9cN1Pi634HDAfP_0 2024-09-12T18:01:49.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.677+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17932116068681162263', time=2024-09-12T19:54:14.055298+0000, chain.objs.size()=1 2024-09-12T18:01:49.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.677+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.wvR76loDgDYo5cC63SWoLB_W_QRWUKb_0 2024-09-12T18:01:49.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.677+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1270501907371201158', time=2024-09-12T19:54:14.062122+0000, chain.objs.size()=1 2024-09-12T18:01:49.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.677+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Bs0KbzmC-HNTmWyn2BujsBQi7bC5dY6_0 2024-09-12T18:01:49.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.677+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16817524006330100502', time=2024-09-12T19:54:14.074803+0000, chain.objs.size()=1 2024-09-12T18:01:49.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.677+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.CkFLN9eJCFnppbZkWsh0mlx5_KHUkbc_0 2024-09-12T18:01:49.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.677+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15742467758036258567', time=2024-09-12T19:54:14.374171+0000, chain.objs.size()=1 2024-09-12T18:01:49.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.677+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.N_GQ6WNm9dcYLCDCMNvwM1zKbR9Krig_0 2024-09-12T18:01:49.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.677+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12169236449744575118', time=2024-09-12T19:54:14.375426+0000, chain.objs.size()=1 2024-09-12T18:01:49.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.677+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Iy6IscMbTjgQnLGwZGmkgKotn-zwRlC_0 2024-09-12T18:01:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14379807859451852330', time=2024-09-12T19:54:14.377301+0000, chain.objs.size()=1 2024-09-12T18:01:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.DbdmP5S3m24orjsnv50AbtmXd_6L0al_0 2024-09-12T18:01:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.971139399304466492', time=2024-09-12T19:54:14.408722+0000, chain.objs.size()=1 2024-09-12T18:01:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.DIOV9-9bT4gMw-pYFviyYXZ0r60kWm7_0 2024-09-12T18:01:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12872115583602486857', time=2024-09-12T19:54:14.437226+0000, chain.objs.size()=1 2024-09-12T18:01:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.6XYZ58Jk2vxS4GV48XNGioQ9reTYvxI_0 2024-09-12T18:01:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7805985189477880852', time=2024-09-12T19:54:14.443538+0000, chain.objs.size()=1 2024-09-12T18:01:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.7O5ayAp52v5ZKkybGQ2EWfWRZHz3jc8_0 2024-09-12T18:01:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18343592873056986770', time=2024-09-12T19:54:14.549587+0000, chain.objs.size()=1 2024-09-12T18:01:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.nT5y7qqFHGsswnfPDgzRXwP3h8QNS7p_0 2024-09-12T18:01:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6373393585770091536', time=2024-09-12T19:54:14.554468+0000, chain.objs.size()=1 2024-09-12T18:01:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.znSJtzH-iDJw3Kib2idUNVLjcLvKg70_0 2024-09-12T18:01:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9277347313243923038', time=2024-09-12T19:54:14.587142+0000, chain.objs.size()=1 2024-09-12T18:01:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.MIzYHQNQnrarUkYEinsJ6LM4AiU3fGw_0 2024-09-12T18:01:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.204407036733236117', time=2024-09-12T19:54:14.632036+0000, chain.objs.size()=1 2024-09-12T18:01:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2UobtTtC2nwdAWAtRdMkGOOnz01_nbe_0 2024-09-12T18:01:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17869830528183653987', time=2024-09-12T19:54:14.635581+0000, chain.objs.size()=1 2024-09-12T18:01:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.3X3xYTAZdCVEBqHLsIt_609u5bOeqTs_0 2024-09-12T18:01:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16383186385315553855', time=2024-09-12T19:54:14.766066+0000, chain.objs.size()=1 2024-09-12T18:01:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.XgNm3tcpc_GNPiSt3LuR0mwjvtEll-I_0 2024-09-12T18:01:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15171035999476772271', time=2024-09-12T19:54:14.787971+0000, chain.objs.size()=1 2024-09-12T18:01:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.dZUP0t5UWkQg0SEGOG775pGW9budu-E_0 2024-09-12T18:01:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.680+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4988706588205380408', time=2024-09-12T19:54:14.792995+0000, chain.objs.size()=1 2024-09-12T18:01:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.680+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.FokKJ03EKwhU4M8Fi1mDXumvWw3vttj_0 2024-09-12T18:01:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.680+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10293829771560959446', time=2024-09-12T19:54:14.875765+0000, chain.objs.size()=1 2024-09-12T18:01:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.680+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.qJf4mdW9YwF40jmSmXH1qsJoj7WfQsc_0 2024-09-12T18:01:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.680+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16337849062276693902', time=2024-09-12T19:54:14.919797+0000, chain.objs.size()=1 2024-09-12T18:01:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.680+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ZEJthpPX4w3D72CnNjGwS1j5MbHO1rL_0 2024-09-12T18:01:49.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.681+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3993090023833616888', time=2024-09-12T19:54:14.932818+0000, chain.objs.size()=1 2024-09-12T18:01:49.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.681+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.U4t7ZZO1rxiAf1E_WOHvC6KwPYJUY6o_0 2024-09-12T18:01:49.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.681+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9907460634090465472', time=2024-09-12T19:54:14.944459+0000, chain.objs.size()=1 2024-09-12T18:01:49.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.681+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.06wNikqzqyO7xkSGbR76kuxFukqD87b_0 2024-09-12T18:01:49.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.681+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15488099853411072778', time=2024-09-12T19:54:20.397564+0000, chain.objs.size()=1 2024-09-12T18:01:49.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.681+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.289__shadow_.TWHVnd_y4YxoKlH15AXb2gwboR7uRok_0 2024-09-12T18:01:49.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.681+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.156944804946007276', time=2024-09-12T19:54:20.398286+0000, chain.objs.size()=1 2024-09-12T18:01:49.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.681+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.289__shadow_.YYrDBPkJqewJKIZxEcgyNeib6dYRypo_0 2024-09-12T18:01:49.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.682+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7343009803805652899', time=2024-09-12T19:54:20.600212+0000, chain.objs.size()=1 2024-09-12T18:01:49.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.682+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.290__shadow_.qM4n4C2wVDVCScRMr7KzlQWDTEtvrxY_0 2024-09-12T18:01:49.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.682+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3068677764763783272', time=2024-09-12T19:54:21.576474+0000, chain.objs.size()=1 2024-09-12T18:01:49.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.682+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.fQPtPfIW9lmsDneaG9eciV52zS7-qZh_0 2024-09-12T18:01:49.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.682+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.643761543078878481', time=2024-09-12T19:54:22.162140+0000, chain.objs.size()=1 2024-09-12T18:01:49.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.682+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.NckJztRpsPrJQYMfoa90y5ptYtUx4VS_0 2024-09-12T18:01:49.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.682+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10690687415062068057', time=2024-09-12T19:54:22.168875+0000, chain.objs.size()=1 2024-09-12T18:01:49.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.682+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.y9_tBUdS2eeYNWaA4JWo792liASTM6U_0 2024-09-12T18:01:49.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.682+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14429973014766911792', time=2024-09-12T19:54:22.170728+0000, chain.objs.size()=1 2024-09-12T18:01:49.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.682+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.4LjVdAD9iZB5fJUxOTEcKUDV_OZD-17_0 2024-09-12T18:01:49.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.682+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5719871642394237580', time=2024-09-12T19:54:26.530906+0000, chain.objs.size()=1 2024-09-12T18:01:49.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.682+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.314__shadow_.LNpag7nEBJQz4jvpghXmJaACdwWKT83_0 2024-09-12T18:01:49.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.683+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1945393146716050704', time=2024-09-12T19:54:35.749203+0000, chain.objs.size()=1 2024-09-12T18:01:49.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.683+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ff3TzaAg2Dom3-xlCyTBv4eJrkJiluv_0 2024-09-12T18:01:49.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.683+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13747732249328744432', time=2024-09-12T19:54:35.749968+0000, chain.objs.size()=1 2024-09-12T18:01:49.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.683+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.wM77ZmyxmV3NK4P7NzFWfqsV-eq0pJS_0 2024-09-12T18:01:49.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.683+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3061920104827882654', time=2024-09-12T19:54:35.767026+0000, chain.objs.size()=1 2024-09-12T18:01:49.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.683+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QrxGwYC944QhtyMnNuFcmlNzn5efdWN_0 2024-09-12T18:01:49.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.683+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13941805146658962071', time=2024-09-12T19:54:35.771376+0000, chain.objs.size()=1 2024-09-12T18:01:49.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.683+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.GBuumOFXW-T0N_kQOuTSl8g2IWDHkCj_0 2024-09-12T18:01:49.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.683+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8820061495944705327', time=2024-09-12T19:54:35.789366+0000, chain.objs.size()=1 2024-09-12T18:01:49.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.683+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.RBZbRNIqPCaM6_u3wSTxLMyLYgE8oQu_0 2024-09-12T18:01:49.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.684+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12157451766127956976', time=2024-09-12T19:54:35.800326+0000, chain.objs.size()=1 2024-09-12T18:01:49.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.684+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ytXs77sbXiDlPadfWJqPeNH-h98rW5a_0 2024-09-12T18:01:49.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.684+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10971166217199259183', time=2024-09-12T19:54:35.813858+0000, chain.objs.size()=1 2024-09-12T18:01:49.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.684+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.WKUe-d3X8poCMf7KTLlE7e3aIR-2JFn_0 2024-09-12T18:01:49.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.684+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1982419054586172355', time=2024-09-12T19:54:35.839301+0000, chain.objs.size()=1 2024-09-12T18:01:49.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.684+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.m3SY266rr_QIAKph1Qpfi2T4RXY8UHp_0 2024-09-12T18:01:49.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.684+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11189362721564626063', time=2024-09-12T19:54:35.920089+0000, chain.objs.size()=1 2024-09-12T18:01:49.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.684+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.OdUSiaD7nHZqJpuHcyCV7yJQ7sBd5ct_0 2024-09-12T18:01:49.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.685+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2587766274916952071', time=2024-09-12T19:54:35.934953+0000, chain.objs.size()=1 2024-09-12T18:01:49.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.685+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.bEuWW1AeTuSfb3N5quy1fk28wRkEug2_0 2024-09-12T18:01:49.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.685+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17481667295819590769', time=2024-09-12T19:54:35.954273+0000, chain.objs.size()=1 2024-09-12T18:01:49.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.685+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.AoIZTm52m2iGUHJDr_k7hxQiwt8ScaW_0 2024-09-12T18:01:49.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5415959974595121015', time=2024-09-12T19:54:35.997491+0000, chain.objs.size()=1 2024-09-12T18:01:49.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.r3xEi-xhO-ViErm0Bu0Q833Af7Xk6PY_0 2024-09-12T18:01:49.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14503779119947807387', time=2024-09-12T19:54:36.099227+0000, chain.objs.size()=1 2024-09-12T18:01:49.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.kDjZ3LQuqaETgVYTzWS4ThcThDHZBPg_0 2024-09-12T18:01:49.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7856998618209427997', time=2024-09-12T19:54:36.107365+0000, chain.objs.size()=1 2024-09-12T18:01:49.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.GjBschYPu_ba9XwaSGlfH6qMv7M0dP9_0 2024-09-12T18:01:49.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3351395608855918877', time=2024-09-12T19:54:36.111194+0000, chain.objs.size()=1 2024-09-12T18:01:49.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4Pl5Ohp1sFmmwbQ1iAtxtyGPrIueGxa_0 2024-09-12T18:01:49.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11760645465067661883', time=2024-09-12T19:54:36.113613+0000, chain.objs.size()=1 2024-09-12T18:01:49.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.vE5ZsoZ4_Iap3-QD3D-zA7KzWRWFB3s_0 2024-09-12T18:01:49.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1765549997560905113', time=2024-09-12T19:54:36.120408+0000, chain.objs.size()=1 2024-09-12T18:01:49.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9ui0_l1WAUIfbend88Ke6hIwi7pHuej_0 2024-09-12T18:01:49.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9290066531075241773', time=2024-09-12T19:54:36.127547+0000, chain.objs.size()=1 2024-09-12T18:01:49.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.aIwh9RX-mwG43KKmrizCdDoIqbmuxf9_0 2024-09-12T18:01:49.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15513735330830258004', time=2024-09-12T19:54:36.152509+0000, chain.objs.size()=1 2024-09-12T18:01:49.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.233fI7IxWMaTJtQoZRaflCUH1MuRpFE_0 2024-09-12T18:01:49.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14169311643166277212', time=2024-09-12T19:54:36.162358+0000, chain.objs.size()=1 2024-09-12T18:01:49.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.sQbye209cGVGwpCjiECsCVF7UAILOUk_0 2024-09-12T18:01:49.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3329146056746172269', time=2024-09-12T19:54:36.163977+0000, chain.objs.size()=1 2024-09-12T18:01:49.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.KFt1QoJWICH-tNswXXftiSH8ZOiDw5J_0 2024-09-12T18:01:49.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9953438470614470817', time=2024-09-12T19:54:36.256009+0000, chain.objs.size()=1 2024-09-12T18:01:49.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.686+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.tGOvECJMTAPez72QkEdkbnloDDmZ3uI_0 2024-09-12T18:01:49.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.688+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13311760891574471763', time=2024-09-12T19:54:36.300944+0000, chain.objs.size()=1 2024-09-12T18:01:49.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.688+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rtNiVC4p4FXoSLmWE3uFLDLaR2xUnjL_0 2024-09-12T18:01:49.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.688+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7982712324065540389', time=2024-09-12T19:54:36.334820+0000, chain.objs.size()=1 2024-09-12T18:01:49.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.688+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0IAU_C3MgoRZBg9Paar1BR9ZTXaTTVX_0 2024-09-12T18:01:49.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.688+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.573416566525785111', time=2024-09-12T19:54:36.337158+0000, chain.objs.size()=1 2024-09-12T18:01:49.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.688+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_._XV-UurRXdiAhALdsY5Q7Y3egCzaQ_l_0 2024-09-12T18:01:49.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.688+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10077037706721933160', time=2024-09-12T19:54:36.338653+0000, chain.objs.size()=1 2024-09-12T18:01:49.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.688+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.3cw2i6imt0Lk6OV8NTGS3qn-1Ndv3s6_0 2024-09-12T18:01:49.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.688+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6803213011861271285', time=2024-09-12T19:54:36.340451+0000, chain.objs.size()=1 2024-09-12T18:01:49.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.689+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.EnBq_Ob4QM_H1p07qpx4wLBHUozVh71_0 2024-09-12T18:01:49.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.689+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6263532049648856744', time=2024-09-12T19:54:36.427375+0000, chain.objs.size()=1 2024-09-12T18:01:49.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.689+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.KLxTToaqS2tjoJ_Rv9RiMXJ-HmE_rJr_0 2024-09-12T18:01:49.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.689+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14972517172760982056', time=2024-09-12T19:54:36.441100+0000, chain.objs.size()=1 2024-09-12T18:01:49.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.689+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.pQArv5qlZ1IzUXZUxQ1wZht975ydsj__0 2024-09-12T18:01:49.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.689+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15400642744984754501', time=2024-09-12T19:54:36.445287+0000, chain.objs.size()=1 2024-09-12T18:01:49.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.689+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.LGPJV5WYmsM-_4xGw-rmuMsTXO8_DdN_0 2024-09-12T18:01:49.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.689+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5179041410954308811', time=2024-09-12T19:54:36.456336+0000, chain.objs.size()=1 2024-09-12T18:01:49.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.689+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9d40gzmta7sFTfVN9JDOIyIIdiEYqeA_0 2024-09-12T18:01:49.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.689+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3286583158262725572', time=2024-09-12T19:54:36.464289+0000, chain.objs.size()=1 2024-09-12T18:01:49.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.689+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4FOCF_0GSe8lTAL_cOcLOb2-ktzT238_0 2024-09-12T18:01:49.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.689+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16210769728669927985', time=2024-09-12T19:54:36.470248+0000, chain.objs.size()=1 2024-09-12T18:01:49.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.689+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4M3bZ0h3pO0UFXA9r9xW776-hxsMQ7x_0 2024-09-12T18:01:49.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.690+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3339508150162621061', time=2024-09-12T19:54:36.493139+0000, chain.objs.size()=1 2024-09-12T18:01:49.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.690+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-8F9tzg4DP9QRchryHva9y-ERIUC25z_0 2024-09-12T18:01:49.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.690+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14141561236433328189', time=2024-09-12T19:54:36.502706+0000, chain.objs.size()=1 2024-09-12T18:01:49.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.690+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ZW-0xG08azw8sow-jYpcZfycr2DCD9o_0 2024-09-12T18:01:49.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8301975411738888114', time=2024-09-12T19:54:36.503724+0000, chain.objs.size()=1 2024-09-12T18:01:49.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.x1uft35-V1O-Ejcuk1LksBP4Du6vOFN_0 2024-09-12T18:01:49.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2817435437525600746', time=2024-09-12T19:54:36.580913+0000, chain.objs.size()=1 2024-09-12T18:01:49.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.g-NQr75zWNsOxTUoB-3aE94rTf6WNAV_0 2024-09-12T18:01:49.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17415621194263600313', time=2024-09-12T19:54:36.639547+0000, chain.objs.size()=1 2024-09-12T18:01:49.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.c8xfPlsglgQ82TAjwStf3U6GL25Jw94_0 2024-09-12T18:01:49.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13632643527452052539', time=2024-09-12T19:54:36.642456+0000, chain.objs.size()=1 2024-09-12T18:01:49.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.fZ3TEso0iCU8tfnmsjqaMOKettTE8w9_0 2024-09-12T18:01:49.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2704275677865927403', time=2024-09-12T19:54:36.662364+0000, chain.objs.size()=1 2024-09-12T18:01:49.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Gy2pHQMSK1wTRuVvG24CjeuCZo5EZkH_0 2024-09-12T18:01:49.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7887731832204263937', time=2024-09-12T19:54:36.666380+0000, chain.objs.size()=1 2024-09-12T18:01:49.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rVI81oujafXfaSCEOunyLPzp7bLq0WY_0 2024-09-12T18:01:49.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1839932558435933563', time=2024-09-12T19:54:36.754001+0000, chain.objs.size()=1 2024-09-12T18:01:49.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.sj_FRB_hONUm3JuSqMqeCYcCXl8g7vF_0 2024-09-12T18:01:49.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12936059265034869047', time=2024-09-12T19:54:36.781344+0000, chain.objs.size()=1 2024-09-12T18:01:49.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Zr65XChhwopC-9nv2uXWPmNOdyCXMTA_0 2024-09-12T18:01:49.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11152459047272805525', time=2024-09-12T19:54:36.822137+0000, chain.objs.size()=1 2024-09-12T18:01:49.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0TiFF5o8gP6tE-H7NiR3kFZu2Q0VlmE_0 2024-09-12T18:01:49.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.692+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16223150131059742392', time=2024-09-12T19:54:36.912105+0000, chain.objs.size()=1 2024-09-12T18:01:49.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.692+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.60bAY9hk2xkQ0n5cnoJaX-GUFuz9IMY_0 2024-09-12T18:01:49.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.693+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11141396080575978870', time=2024-09-12T19:54:36.931838+0000, chain.objs.size()=1 2024-09-12T18:01:49.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.693+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.RBTm2N-yP3viVxwh9a13ZbVANSy8oBS_0 2024-09-12T18:01:49.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.693+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2292274947804567680', time=2024-09-12T19:54:36.947041+0000, chain.objs.size()=1 2024-09-12T18:01:49.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.693+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.OJqsDVe8nCo0ZR-Ai5e81lMYgyDFjkD_0 2024-09-12T18:01:49.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.693+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10812544263791868490', time=2024-09-12T19:54:44.510662+0000, chain.objs.size()=1 2024-09-12T18:01:49.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.693+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.y0Bq32V_Vxx7SZzTokcEqk-9Z2kNHVn_0 2024-09-12T18:01:49.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.694+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7685976831828124153', time=2024-09-12T19:54:44.516671+0000, chain.objs.size()=1 2024-09-12T18:01:49.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.694+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ed1fzS55J6tbHwNTHoFHc-RV4d4H3pF_0 2024-09-12T18:01:49.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.694+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11942329866078840951', time=2024-09-12T19:54:44.532134+0000, chain.objs.size()=1 2024-09-12T18:01:49.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.694+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.HjSsk7QKrRSR01pwRMa8j9qLIzBIuX7_0 2024-09-12T18:01:49.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.694+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9369864714427976715', time=2024-09-12T19:54:44.551212+0000, chain.objs.size()=1 2024-09-12T18:01:49.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.694+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.y5qYrM2sdulh5UMHoA7T6M4shbtnsYr_0 2024-09-12T18:01:49.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.694+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7142664038324348452', time=2024-09-12T19:54:44.633791+0000, chain.objs.size()=1 2024-09-12T18:01:49.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.694+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.qc0VeV8EsORMbV-zwePIjrRn598o184_0 2024-09-12T18:01:49.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.694+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5512434701566679803', time=2024-09-12T19:54:44.641542+0000, chain.objs.size()=1 2024-09-12T18:01:49.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.694+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.o4Ytl1HCTzb60oDlVtEbOV3QH0HIhYI_0 2024-09-12T18:01:49.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.694+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6405945481391183117', time=2024-09-12T19:54:44.826148+0000, chain.objs.size()=1 2024-09-12T18:01:49.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.694+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.HrfGb2W3udFsqsXEwcBLQc6x4tmhvde_0 2024-09-12T18:01:49.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.696+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/80053 2024-09-12T18:01:49.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-12T18:01:49.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7027044467220644065', time=2024-09-12T19:54:44.837223+0000, chain.objs.size()=1 2024-09-12T18:01:49.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.tJLn23ft_hOhB7ioPZCJFWedI73ANLW_0 2024-09-12T18:01:49.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2101795351312566670', time=2024-09-12T19:54:45.006523+0000, chain.objs.size()=1 2024-09-12T18:01:49.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.gs_kpNA5wBg7-bNEs_LmS6WjKqFBFc8_0 2024-09-12T18:01:49.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6491802903844941334', time=2024-09-12T19:54:45.011618+0000, chain.objs.size()=1 2024-09-12T18:01:49.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_._jOmXnqXo33B3UjRgLfcHo6x6GhXPvo_0 2024-09-12T18:01:49.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7504680411133820395', time=2024-09-12T19:54:45.025888+0000, chain.objs.size()=1 2024-09-12T18:01:49.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.297x_wEvW9y4sASHSgmzw_k_tn_YMYR_0 2024-09-12T18:01:49.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4481664244124817334', time=2024-09-12T19:54:45.032136+0000, chain.objs.size()=1 2024-09-12T18:01:49.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.hj09Ah-_heDIHN0iDZzp_o8tfRFw_yN_0 2024-09-12T18:01:49.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17982484252984066057', time=2024-09-12T19:54:45.056997+0000, chain.objs.size()=1 2024-09-12T18:01:49.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.k5ZckUBCw6cj7XWU8o13rMHjTukz24M_0 2024-09-12T18:01:49.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9200164506268017653', time=2024-09-12T19:54:45.058607+0000, chain.objs.size()=1 2024-09-12T18:01:49.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.eCqIE0_3jh5kUg_pyO_5SF0A3l_s0_F_0 2024-09-12T18:01:49.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17372324454072804491', time=2024-09-12T19:54:45.196925+0000, chain.objs.size()=1 2024-09-12T18:01:49.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.RPHXnR-yk35PnvAUi1hvdl8u27SlJmY_0 2024-09-12T18:01:49.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17785682408715545150', time=2024-09-12T19:54:45.205890+0000, chain.objs.size()=1 2024-09-12T18:01:49.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.utnugA4Tw-0lGAzMM_cfIoOrfou86Tt_0 2024-09-12T18:01:49.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10012759947234045960', time=2024-09-12T19:54:45.210293+0000, chain.objs.size()=1 2024-09-12T18:01:49.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.vp-MFtxCZrQOL-uObCQq4LtYM7ejjzs_0 2024-09-12T18:01:49.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9137952268550972079', time=2024-09-12T19:54:45.227259+0000, chain.objs.size()=1 2024-09-12T18:01:49.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.3MU-qO7gvZufChGHkIhyowO4DgtMk7f_0 2024-09-12T18:01:49.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13712696241148512465', time=2024-09-12T19:54:45.243771+0000, chain.objs.size()=1 2024-09-12T18:01:49.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.698+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.kQZx0O03cGRuNiLjil0EYWqcCc0yBeu_0 2024-09-12T18:01:49.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.700+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17988859786689326243', time=2024-09-12T19:54:45.375722+0000, chain.objs.size()=1 2024-09-12T18:01:49.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.700+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TueTnp9N9Dj2wGZ0VISHsbuJEGs6I-q_0 2024-09-12T18:01:49.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.700+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.782382942143567153', time=2024-09-12T19:54:45.411912+0000, chain.objs.size()=1 2024-09-12T18:01:49.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.700+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.VKeL-BHwrK7CV6L8Sq2Gnohz33iy2Jh_0 2024-09-12T18:01:49.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7796131044343613762', time=2024-09-12T19:54:45.424796+0000, chain.objs.size()=1 2024-09-12T18:01:49.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jJAfNpvZmFMH23qc_dIrbCGpC3UAfHC_0 2024-09-12T18:01:49.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4067803709951010667', time=2024-09-12T19:54:45.552657+0000, chain.objs.size()=1 2024-09-12T18:01:49.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.f4tQm2-9t3Os7MqgFtf5VQyV3am6vQg_0 2024-09-12T18:01:49.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6776644645212749270', time=2024-09-12T19:54:45.673804+0000, chain.objs.size()=1 2024-09-12T18:01:49.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.UAng1vpQy_1KPtwxPz5YyZBI_K5G9HT_0 2024-09-12T18:01:49.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8755051258412273463', time=2024-09-12T19:55:11.024268+0000, chain.objs.size()=1 2024-09-12T18:01:49.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.443__shadow_.iN3mmXBF1l034biQoK-AHdhZ4TIIcq7_0 2024-09-12T18:01:49.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14660832734446767267', time=2024-09-12T19:55:16.680889+0000, chain.objs.size()=1 2024-09-12T18:01:49.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.463__shadow_.NqFqbimZPrHsKPAlMVQ_qYbw2Y3bidL_0 2024-09-12T18:01:49.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1563536556242732238', time=2024-09-12T19:55:17.176215+0000, chain.objs.size()=1 2024-09-12T18:01:49.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.465__shadow_.otd7fw67xhnQIuqHNGdrnBfcYJoo-7l_0 2024-09-12T18:01:49.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10563703580800447050', time=2024-09-12T19:55:17.979631+0000, chain.objs.size()=1 2024-09-12T18:01:49.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.467__shadow_.ovzEIUYUd09G2bNeQSa8m6aYDRZW770_0 2024-09-12T18:01:49.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17508706516974986623', time=2024-09-12T19:55:30.574328+0000, chain.objs.size()=1 2024-09-12T18:01:49.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.518__shadow_.G1Zh4QKV6dEKi6Im7vPlrcrKafHzWlc_0 2024-09-12T18:01:49.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.626721528565866220', time=2024-09-12T19:55:40.100793+0000, chain.objs.size()=2 2024-09-12T18:01:49.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.525__shadow_._u2EeFQoVaJ4X5OOlfxdPTCeImRX4WK_0 2024-09-12T18:01:49.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.701+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.525__shadow_._u2EeFQoVaJ4X5OOlfxdPTCeImRX4WK_1 2024-09-12T18:01:49.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.702+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14586371386075119153', time=2024-09-12T19:56:11.176044+0000, chain.objs.size()=1 2024-09-12T18:01:49.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.702+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.553__shadow_.knSHWPCK0zSnyfUXfGD3Lh8g6phj9PL_0 2024-09-12T18:01:49.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.702+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3633234869710189963', time=2024-09-12T19:56:12.100913+0000, chain.objs.size()=1 2024-09-12T18:01:49.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.702+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.555__shadow_.G8vZMX65-A9FHwEjcnx_IzdaHfZ56du_0 2024-09-12T18:01:49.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.703+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15523217644851073150', time=2024-09-12T19:56:12.539484+0000, chain.objs.size()=2 2024-09-12T18:01:49.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.703+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.556__shadow_.aydIyPI_-yVfolNOa0TFZn9YOp9HQG0_0 2024-09-12T18:01:49.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.704+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.556__shadow_.aydIyPI_-yVfolNOa0TFZn9YOp9HQG0_1 2024-09-12T18:01:49.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.704+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3975918979580448026', time=2024-09-12T19:56:12.813632+0000, chain.objs.size()=1 2024-09-12T18:01:49.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.704+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.557__shadow_.zlPgARmvOQCTT1E1lsKb0eZUj-SmMPA_0 2024-09-12T18:01:49.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.704+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5991684721852934940', time=2024-09-12T19:56:42.400379+0000, chain.objs.size()=1 2024-09-12T18:01:49.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.704+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:0Fpo4mlPFKz.K661EAgATHtjvT6NMDE_.IK6bNw3aAXye0aNi0oTzkWRNCDhpESh_0 2024-09-12T18:01:49.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.704+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9010567261877209789', time=2024-09-12T19:59:22.799121+0000, chain.objs.size()=1 2024-09-12T18:01:49.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.704+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.691__shadow:2wsrhkyP.ttKQQ03n3YF2LMqsfeudV1_.MfgCzkdvIdxUl-CT-dm8dBQiTd-2uMX_0 2024-09-12T18:01:49.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.704+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12273581366441782022', time=2024-09-12T19:59:23.499505+0000, chain.objs.size()=1 2024-09-12T18:01:49.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.704+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.694__shadow:0W7akcfnhgV9pxUrfBobyL6PPKYDLrJ_.-36ndrLPbDPdCtGYjybGA0VyiK02184_0 2024-09-12T18:01:49.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.704+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13115432216818313029', time=2024-09-12T19:59:26.758693+0000, chain.objs.size()=1 2024-09-12T18:01:49.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.704+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.708__shadow:uGP8gk1ktOPIANvqIMXzmlOPyDq9L7T_.1RODzTl_2jEUtVQVehETez8_qfDa5HL_0 2024-09-12T18:01:49.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.704+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18203225053608785454', time=2024-09-12T19:59:27.035433+0000, chain.objs.size()=1 2024-09-12T18:01:49.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.704+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.709__shadow:yd-.wIGqTJnP-V3Nxfkmh3ddfzuCSpu_.2zp8NpKz9FFKtSpNmc9XRPpCuSRA28v_0 2024-09-12T18:01:49.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.705+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17104122613523590862', time=2024-09-12T19:59:28.170481+0000, chain.objs.size()=1 2024-09-12T18:01:49.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.705+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.714__shadow:DHMP7TOg8lC8E5eYCZ4RsU.MNJif8On_.KNutAgk6IGU87X7I6sCM074tqnUC6-Y_0 2024-09-12T18:01:49.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.706+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~PKBU0Unt9Z6kcbmjTDBDzmzu4GMOk6c', time=2024-09-12T19:59:54.250056+0000, chain.objs.size()=1 2024-09-12T18:01:49.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.706+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.743__multipart_mymultipart2.2~PKBU0Unt9Z6kcbmjTDBDzmzu4GMOk6c.1 2024-09-12T18:01:49.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.708+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:49.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.713+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:01:49.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.715+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:49.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.715+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:49.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53816' 2024-09-12T18:01:49.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17167196333932410522', time=2024-09-12T19:52:53.538234+0000, chain.objs.size()=1 2024-09-12T18:01:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.158__shadow:TO8NVb9vq-ADdSoEE7H88ahDxhl9GLz_.tmQx365qnQvSwZixk4O4MHE4wblovVH_0 2024-09-12T18:01:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3370224420378882831', time=2024-09-12T19:52:55.064360+0000, chain.objs.size()=3 2024-09-12T18:01:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.160__multipart_mymultipart-LUKEWARM.2~KZTIgOPFMoUj-V5wcISCKECBroT24vZ.1 2024-09-12T18:01:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.160__multipart_mymultipart-LUKEWARM.2~KZTIgOPFMoUj-V5wcISCKECBroT24vZ.2 2024-09-12T18:01:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.160__multipart_mymultipart-LUKEWARM.2~KZTIgOPFMoUj-V5wcISCKECBroT24vZ.3 2024-09-12T18:01:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14247431003007275397', time=2024-09-12T19:54:04.267393+0000, chain.objs.size()=1 2024-09-12T18:01:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.253__shadow_.cCkrgtoO-SfNDJNmlEvvEem0StXtsAC_0 2024-09-12T18:01:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2560502571244203221', time=2024-09-12T19:54:05.912455+0000, chain.objs.size()=1 2024-09-12T18:01:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.261__shadow_.P6VHOXcRQ8DAUTulLUaTbFXQqIEbEme_0 2024-09-12T18:01:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18129592685509555271', time=2024-09-12T19:54:13.496723+0000, chain.objs.size()=1 2024-09-12T18:01:49.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.yhsH67KY2zBJQIDHoRlaac50qPH2Rx-_0 2024-09-12T18:01:49.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15431872336529331379', time=2024-09-12T19:54:13.506682+0000, chain.objs.size()=1 2024-09-12T18:01:49.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.3hGOQ1sjoDrt2PFEBd7Yv7XTvMIuN4F_0 2024-09-12T18:01:49.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13892761160527972526', time=2024-09-12T19:54:13.547397+0000, chain.objs.size()=1 2024-09-12T18:01:49.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.uAvKAbamreHllcA_rIW5w63BLv6wf1w_0 2024-09-12T18:01:49.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16276401042660905138', time=2024-09-12T19:54:13.575658+0000, chain.objs.size()=1 2024-09-12T18:01:49.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.OYvAzq4tr32f1XXswZ2rumXk1RBDPf__0 2024-09-12T18:01:49.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9809605669922654594', time=2024-09-12T19:54:13.657898+0000, chain.objs.size()=1 2024-09-12T18:01:49.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-_1XndpW3YCKXXYILjBaVE1WaJj8I9__0 2024-09-12T18:01:49.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15681575092775151480', time=2024-09-12T19:54:13.659675+0000, chain.objs.size()=1 2024-09-12T18:01:49.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.716+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.EVN-Q0kFksc3rBFdIksU-xA5kn7GBP8_0 2024-09-12T18:01:49.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16296941051264934824', time=2024-09-12T19:54:13.676775+0000, chain.objs.size()=1 2024-09-12T18:01:49.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Pi_kMd6t1maul4zhjC22gbZIQwlLaVU_0 2024-09-12T18:01:49.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16314184904373462198', time=2024-09-12T19:54:13.698384+0000, chain.objs.size()=1 2024-09-12T18:01:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.GihZqDaMYuCVyQ9_rY7nDfdtFWPren5_0 2024-09-12T18:01:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18155171853319362384', time=2024-09-12T19:54:13.834371+0000, chain.objs.size()=1 2024-09-12T18:01:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_._GiZLVQw2nmRkQ8pFkuU7TdWwHHt10D_0 2024-09-12T18:01:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10623817272484684764', time=2024-09-12T19:54:13.848862+0000, chain.objs.size()=1 2024-09-12T18:01:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ZwOuufiMHJ6RkYfbS2K2nLX0UFPt_np_0 2024-09-12T18:01:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5238578758614437226', time=2024-09-12T19:54:13.888748+0000, chain.objs.size()=1 2024-09-12T18:01:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.QUHmTmyVpcVy9o7XR21PST5O0J3_LCI_0 2024-09-12T18:01:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11236600346279475634', time=2024-09-12T19:54:14.022589+0000, chain.objs.size()=1 2024-09-12T18:01:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.8oRgXLidz6YNVPCHXuid2ns7n2qPss9_0 2024-09-12T18:01:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4419894842476218502', time=2024-09-12T19:54:14.025887+0000, chain.objs.size()=1 2024-09-12T18:01:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.EWRmpGAfKkffi7EursDBYqXXK1IIaX1_0 2024-09-12T18:01:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12920251808406940166', time=2024-09-12T19:54:14.040253+0000, chain.objs.size()=1 2024-09-12T18:01:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.UPkRAkPvIp3eVeAHlrOm_Oet80l1JvJ_0 2024-09-12T18:01:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4274228505897513237', time=2024-09-12T19:54:14.080122+0000, chain.objs.size()=1 2024-09-12T18:01:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.gi8wpBvIIc2aS43E4MH6tEvCwXJhtXl_0 2024-09-12T18:01:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7034134661159207180', time=2024-09-12T19:54:14.088269+0000, chain.objs.size()=1 2024-09-12T18:01:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.kUBgAaAfEycaZqUFGyRgun0ZYXp0Cd5_0 2024-09-12T18:01:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1184349978852785362', time=2024-09-12T19:54:14.092494+0000, chain.objs.size()=1 2024-09-12T18:01:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.719+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.XWEugUOvwNmbC-R9p3kHYt22R3BwkaG_0 2024-09-12T18:01:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.721+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.296051953580694989', time=2024-09-12T19:54:14.402692+0000, chain.objs.size()=1 2024-09-12T18:01:49.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.721+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.6VdrJS8QQTAYQXbWkvZtem1jlWcgqA6_0 2024-09-12T18:01:49.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.825080102355335410', time=2024-09-12T19:54:14.426138+0000, chain.objs.size()=1 2024-09-12T18:01:49.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.YLskBvXHWLpob0_u9gjn5j28A2S6fCI_0 2024-09-12T18:01:49.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7580016533077546212', time=2024-09-12T19:54:14.435822+0000, chain.objs.size()=1 2024-09-12T18:01:49.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.pBODzCA5JyefDD_yZUyGo3i8s-k2gFl_0 2024-09-12T18:01:49.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7348347892927004279', time=2024-09-12T19:54:14.466301+0000, chain.objs.size()=1 2024-09-12T18:01:49.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.8Glh1_A9GIpuJsStbJ1EvIKxZA5oJ10_0 2024-09-12T18:01:49.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9741307793881517016', time=2024-09-12T19:54:14.542928+0000, chain.objs.size()=1 2024-09-12T18:01:49.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.T0uG36nrsaVz1HmkH6q2EBbcPS36eQ__0 2024-09-12T18:01:49.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3617963070562771037', time=2024-09-12T19:54:14.543575+0000, chain.objs.size()=1 2024-09-12T18:01:49.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.wj1VYuvFH-RgQfMus2GtpgfadjQjx4W_0 2024-09-12T18:01:49.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3925083864254031636', time=2024-09-12T19:54:14.544240+0000, chain.objs.size()=1 2024-09-12T18:01:49.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.YxZ7Xu9-43QFxo3PuoXHhSGNQKF4Vq-_0 2024-09-12T18:01:49.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3753696723620642096', time=2024-09-12T19:54:14.569567+0000, chain.objs.size()=1 2024-09-12T18:01:49.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.nm6K_uPlDFMIcuuLSa_xd-Ks09B9cC2_0 2024-09-12T18:01:49.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18017458971501369404', time=2024-09-12T19:54:14.609490+0000, chain.objs.size()=1 2024-09-12T18:01:49.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.b0rUIiDRviVhVYvZzeN2jvq0SazmXfK_0 2024-09-12T18:01:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2428265439769117086', time=2024-09-12T19:54:14.614671+0000, chain.objs.size()=1 2024-09-12T18:01:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.54za5FlJhJrHqfj8Y8NR8ihNoTRmpGI_0 2024-09-12T18:01:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.538122093781015070', time=2024-09-12T19:54:14.625519+0000, chain.objs.size()=1 2024-09-12T18:01:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.QMZQWG1e11fSIQDpHeiovxwe4B8c8SW_0 2024-09-12T18:01:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13923099799232041993', time=2024-09-12T19:54:14.745899+0000, chain.objs.size()=1 2024-09-12T18:01:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.726+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.NqvcbFZ-li76cXQJmCBVoXgif3fGVp6_0 2024-09-12T18:01:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.727+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9321199272496871998', time=2024-09-12T19:54:14.795495+0000, chain.objs.size()=1 2024-09-12T18:01:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.727+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.PAcXrhONHm6SptgPE9npBhactNinhOu_0 2024-09-12T18:01:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.727+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6136667279254851416', time=2024-09-12T19:54:14.902973+0000, chain.objs.size()=1 2024-09-12T18:01:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.727+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.HYhGDjCKfzc8mETR0Ll0maiLT8fR9ka_0 2024-09-12T18:01:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.728+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17024760847360431839', time=2024-09-12T19:54:14.918619+0000, chain.objs.size()=1 2024-09-12T18:01:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.728+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.MDLmLPbOs2vvARJJLDkW83ewdDSSIeQ_0 2024-09-12T18:01:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.728+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18118108948311436449', time=2024-09-12T19:54:14.942530+0000, chain.objs.size()=1 2024-09-12T18:01:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.728+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.AT5YvRqaPpnePnQI8K84ukRtZ6UhW3V_0 2024-09-12T18:01:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.728+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14127379938016009887', time=2024-09-12T19:54:15.118489+0000, chain.objs.size()=1 2024-09-12T18:01:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.728+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.264__shadow_.EzMF99LY1pZ_qCIjLEjvk1cpp_FL7Ao_0 2024-09-12T18:01:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.728+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17809994819695571664', time=2024-09-12T19:54:17.560753+0000, chain.objs.size()=1 2024-09-12T18:01:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.728+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.276__shadow_.RrcHsOGI7dDWgJeAdVol3nUXVmyjSHk_0 2024-09-12T18:01:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.728+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15053521233453172306', time=2024-09-12T19:54:20.804612+0000, chain.objs.size()=1 2024-09-12T18:01:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.728+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.291__shadow_.CNX0yeH5KBTKq7rkAz387m3h2TszeX-_0 2024-09-12T18:01:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.728+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2158129032026719383', time=2024-09-12T19:54:21.025225+0000, chain.objs.size()=1 2024-09-12T18:01:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.728+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.292__shadow_.45DtvwBU9BWcEipJ9STOFIgRMgohW3J_0 2024-09-12T18:01:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.729+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5772706619665145121', time=2024-09-12T19:54:23.035589+0000, chain.objs.size()=1 2024-09-12T18:01:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.729+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.298__shadow_.lJnG34Qbc3Pjffk-xLkOPDgJLXCrWTY_0 2024-09-12T18:01:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.729+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8813585931668327595', time=2024-09-12T19:54:23.567496+0000, chain.objs.size()=1 2024-09-12T18:01:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.729+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.300__shadow_.xpDe5bVHGVLMwP9hhgxAYcOAoByshLI_0 2024-09-12T18:01:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.731+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2349253488544765851', time=2024-09-12T19:54:35.752140+0000, chain.objs.size()=1 2024-09-12T18:01:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.731+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.wWePGm-F11JPKh4qnrHQn7Uoy_i88m0_0 2024-09-12T18:01:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.731+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11626116168918925408', time=2024-09-12T19:54:35.774775+0000, chain.objs.size()=1 2024-09-12T18:01:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.731+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Hk6uP86H2RsYtCX7t4Hqu42_CObAfVi_0 2024-09-12T18:01:49.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.731+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10423652335131558341', time=2024-09-12T19:54:35.830795+0000, chain.objs.size()=1 2024-09-12T18:01:49.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.731+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.zwcNPUfa3Awwnw9ByM93DeFEKy5ZTgv_0 2024-09-12T18:01:49.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.731+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5946227402931245900', time=2024-09-12T19:54:35.917207+0000, chain.objs.size()=1 2024-09-12T18:01:49.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.731+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.E8Ux4CSFnJf8rHWO5zAMQ-ldNs5waGk_0 2024-09-12T18:01:49.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.734+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7194050492179616215', time=2024-09-12T19:54:35.921221+0000, chain.objs.size()=1 2024-09-12T18:01:49.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.734+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.kb5FgmB_PB3SbXC8b4Nzig4ytkAc6YY_0 2024-09-12T18:01:49.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.734+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13481051584283012830', time=2024-09-12T19:54:35.934359+0000, chain.objs.size()=1 2024-09-12T18:01:49.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.734+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.MvJzxwS4bxmcDxUv1sdXsQ0WbIVAgqa_0 2024-09-12T18:01:49.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.734+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17362656138595253656', time=2024-09-12T19:54:36.101608+0000, chain.objs.size()=1 2024-09-12T18:01:49.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.734+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ysGEjCpFu5S8HkJ4amP8FwwJFa5rZgQ_0 2024-09-12T18:01:49.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.734+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18167172014983950899', time=2024-09-12T19:54:36.109527+0000, chain.objs.size()=1 2024-09-12T18:01:49.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.734+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.AkM724de6R6HG6U-jbXOs3Hr2XLoHih_0 2024-09-12T18:01:49.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.734+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11974638920201173227', time=2024-09-12T19:54:36.141094+0000, chain.objs.size()=1 2024-09-12T18:01:49.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.734+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.G3ZCrX_hJ4c9qcdlT431v38JWYACuBN_0 2024-09-12T18:01:49.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.734+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4507595382963887047', time=2024-09-12T19:54:36.172677+0000, chain.objs.size()=1 2024-09-12T18:01:49.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.734+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.dPfWlhwP69PttUkluGWVhXiuFr2kmZs_0 2024-09-12T18:01:49.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.734+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10942895569891535486', time=2024-09-12T19:54:36.251588+0000, chain.objs.size()=1 2024-09-12T18:01:49.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.734+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.WeKANxrHJtJluZgy0bvPee2SSfXAJ7P_0 2024-09-12T18:01:49.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.736+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10313606165511359615', time=2024-09-12T19:54:36.252749+0000, chain.objs.size()=1 2024-09-12T18:01:49.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.736+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Z7mEjDd2N6P-5WPbpBoR2-NtminT841_0 2024-09-12T18:01:49.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.736+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14621373495960700515', time=2024-09-12T19:54:36.264287+0000, chain.objs.size()=1 2024-09-12T18:01:49.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.736+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rkbsdhyO-BWILcvwKtUxEPRk4A-kjFQ_0 2024-09-12T18:01:49.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.736+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.643167522978523733', time=2024-09-12T19:54:36.306252+0000, chain.objs.size()=1 2024-09-12T18:01:49.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.736+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ywjCS-rqd6GwW5FjHHFO3DHsqsoZ64i_0 2024-09-12T18:01:49.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.736+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.842738884763922791', time=2024-09-12T19:54:36.417736+0000, chain.objs.size()=1 2024-09-12T18:01:49.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.736+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ecBtoZgRwIJi0NqjlLREShk7P_G3YAE_0 2024-09-12T18:01:49.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.739+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12845530157210349404', time=2024-09-12T19:54:36.419658+0000, chain.objs.size()=1 2024-09-12T18:01:49.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.739+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.oJ24uNWLd9IG_0cAlu1tVGC9A9ivy7X_0 2024-09-12T18:01:49.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.739+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12141546054911785180', time=2024-09-12T19:54:36.432130+0000, chain.objs.size()=1 2024-09-12T18:01:49.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.739+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-Sd89wDfz83lGSRypsgliIq9hxZKw5r_0 2024-09-12T18:01:49.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.739+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3038588543204826584', time=2024-09-12T19:54:36.438126+0000, chain.objs.size()=1 2024-09-12T18:01:49.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.739+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QfTEJtAy6MZGYSrIjaGu6NYYX45162D_0 2024-09-12T18:01:49.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.739+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1524427779093109627', time=2024-09-12T19:54:36.450136+0000, chain.objs.size()=1 2024-09-12T18:01:49.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.739+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.7CjFzaXUyJJ2R_EvGW13wBU5GQLNMEW_0 2024-09-12T18:01:49.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.739+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15565835774898670554', time=2024-09-12T19:54:36.451583+0000, chain.objs.size()=1 2024-09-12T18:01:49.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.739+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4WX4h_cj3glia_wXiCIJ_UxWe9te5Hi_0 2024-09-12T18:01:49.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.739+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4133761995918493853', time=2024-09-12T19:54:36.578080+0000, chain.objs.size()=1 2024-09-12T18:01:49.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.739+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.PO94cwhVvUjgXFReBIU4b068QSNAzQO_0 2024-09-12T18:01:49.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.739+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11989767171828295015', time=2024-09-12T19:54:36.579775+0000, chain.objs.size()=1 2024-09-12T18:01:49.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.739+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.kSRMWHqnFCWQmX5wnSvGv9Rns5epF2Y_0 2024-09-12T18:01:49.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15899157046935849738', time=2024-09-12T19:54:36.584211+0000, chain.objs.size()=1 2024-09-12T18:01:49.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.gqEvzDx-Vp2bLiLTpNmn6Vrv2WR_V0r_0 2024-09-12T18:01:49.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5686403152777246574', time=2024-09-12T19:54:36.594198+0000, chain.objs.size()=1 2024-09-12T18:01:49.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Ku_dc4u1jbMl1Q9i_qQtayxAVIouW7v_0 2024-09-12T18:01:49.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13862871688723668439', time=2024-09-12T19:54:36.631849+0000, chain.objs.size()=1 2024-09-12T18:01:49.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.shAWm08__D7sYoy6BbpZWCG8fAjKBxN_0 2024-09-12T18:01:49.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14090740129252349912', time=2024-09-12T19:54:36.805290+0000, chain.objs.size()=1 2024-09-12T18:01:49.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.8EHC3-bblNyErtj8_lLv40UFOHgZTDK_0 2024-09-12T18:01:49.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1843979284667313870', time=2024-09-12T19:54:36.810661+0000, chain.objs.size()=1 2024-09-12T18:01:49.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.3TeTaQxWWwNh9JeIHSo9tWodIWoUadn_0 2024-09-12T18:01:49.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.332897638917799974', time=2024-09-12T19:54:36.832829+0000, chain.objs.size()=1 2024-09-12T18:01:49.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.zO5blYcnzu-i1YgsuFS7vY287LMMWhE_0 2024-09-12T18:01:49.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7109875848933412375', time=2024-09-12T19:54:36.921326+0000, chain.objs.size()=1 2024-09-12T18:01:49.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.KReJdqvP_tO0Xexqx58dnym991i8Vvm_0 2024-09-12T18:01:49.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14812118764028743061', time=2024-09-12T19:54:36.961827+0000, chain.objs.size()=1 2024-09-12T18:01:49.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.xuqOjXCFKePeCR1uFPWQLD_psoCIz9X_0 2024-09-12T18:01:49.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5607592501802875006', time=2024-09-12T19:54:44.497533+0000, chain.objs.size()=1 2024-09-12T18:01:49.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.cekidk8Pl3EzBFr8fYkbEXYVnsY_mSH_0 2024-09-12T18:01:49.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10382661093444725536', time=2024-09-12T19:54:44.549752+0000, chain.objs.size()=1 2024-09-12T18:01:49.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ySPkxBj_olxhcm0VelmyTPmqEBCa1tC_0 2024-09-12T18:01:49.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11741206988903576688', time=2024-09-12T19:54:44.657015+0000, chain.objs.size()=1 2024-09-12T18:01:49.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.742+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.mLF7qanPx54K41Nx9Au0jfBfSc8gBim_0 2024-09-12T18:01:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.744+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5437409713783602338', time=2024-09-12T19:54:44.696570+0000, chain.objs.size()=1 2024-09-12T18:01:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.744+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.VRPEkUxwofA6Y9ONS-E5itorWwui-TS_0 2024-09-12T18:01:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.744+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13683383804863463543', time=2024-09-12T19:54:44.704188+0000, chain.objs.size()=1 2024-09-12T18:01:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.744+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.GdiKxm7Hj_9EFXclG7yVN_3EVJFcp6z_0 2024-09-12T18:01:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.744+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18370750509534861497', time=2024-09-12T19:54:44.798051+0000, chain.objs.size()=1 2024-09-12T18:01:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.744+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.vtdU0C8ehHjRJUbIBfbE_8EYHDIjO8o_0 2024-09-12T18:01:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.744+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5756465788855765416', time=2024-09-12T19:54:44.821755+0000, chain.objs.size()=1 2024-09-12T18:01:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.744+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.nA4M0Mvw98ySqfvVXLh4y5QtV0bLB68_0 2024-09-12T18:01:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.744+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3894896965784470696', time=2024-09-12T19:54:44.824852+0000, chain.objs.size()=1 2024-09-12T18:01:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.744+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.RwV_5cBhz4AD90kJ1NzQdGIC_PmLU4-_0 2024-09-12T18:01:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.744+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12272114849119829751', time=2024-09-12T19:54:44.828070+0000, chain.objs.size()=1 2024-09-12T18:01:49.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.744+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.xuLQadzJjzlSmSG0hVESjvbzxvpMkJ2_0 2024-09-12T18:01:49.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.574181259224642034', time=2024-09-12T19:54:44.830687+0000, chain.objs.size()=1 2024-09-12T18:01:49.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.LBQ8osv52DidNJqBHwgfNCDXqXxzZrt_0 2024-09-12T18:01:49.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12219692194083432275', time=2024-09-12T19:54:44.851512+0000, chain.objs.size()=1 2024-09-12T18:01:49.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.fdwch5HbZSFIK1flCUEv5C1fl_gAW0b_0 2024-09-12T18:01:49.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4826072491913904520', time=2024-09-12T19:54:44.865158+0000, chain.objs.size()=1 2024-09-12T18:01:49.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.m4ADealw4B1aqa2i4GYWdFrE87Rfqg-_0 2024-09-12T18:01:49.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2673684078640980901', time=2024-09-12T19:54:44.871630+0000, chain.objs.size()=1 2024-09-12T18:01:49.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.UPttkj-DclfhnR-X9n2vwqXZKJzvl40_0 2024-09-12T18:01:49.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7978688075721401633', time=2024-09-12T19:54:44.879091+0000, chain.objs.size()=1 2024-09-12T18:01:49.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.epwc3eg3dsQ7ntGF9T7RMvcTaUgzOqK_0 2024-09-12T18:01:49.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9151500771599773071', time=2024-09-12T19:54:44.978647+0000, chain.objs.size()=1 2024-09-12T18:01:49.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.1t7If35zHm12TG1ux3VH5niGCISC3ZW_0 2024-09-12T18:01:49.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14948161805329394183', time=2024-09-12T19:54:44.989861+0000, chain.objs.size()=1 2024-09-12T18:01:49.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.sicFxBGdz0wQ8pNFiSepUCQT6EH7fnW_0 2024-09-12T18:01:49.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9770554808712765746', time=2024-09-12T19:54:45.002059+0000, chain.objs.size()=1 2024-09-12T18:01:49.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.6KClhBUY06obgdTIcKohhcnggK2FN4-_0 2024-09-12T18:01:49.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17571242642857870916', time=2024-09-12T19:54:45.014256+0000, chain.objs.size()=1 2024-09-12T18:01:49.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.YEMnJWJqthvFJj1VDL9-wS0RYRF2fsD_0 2024-09-12T18:01:49.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7232179025567396128', time=2024-09-12T19:54:45.055945+0000, chain.objs.size()=1 2024-09-12T18:01:49.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.747+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TDcMNwoAsuaFv5sZsQ9IUdlWZPjRVM9_0 2024-09-12T18:01:49.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.749+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18234320523012553411', time=2024-09-12T19:54:45.181031+0000, chain.objs.size()=1 2024-09-12T18:01:49.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.749+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.4Wyr66J8fnbb5n-DWCVJndjTXcSh83r_0 2024-09-12T18:01:49.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.750+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8208556502749600531', time=2024-09-12T19:54:45.184336+0000, chain.objs.size()=1 2024-09-12T18:01:49.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.750+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.KlYb2j9Bcdqg6-I8EazP2vNGPHRIBPY_0 2024-09-12T18:01:49.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.750+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7270888408435235734', time=2024-09-12T19:54:45.224088+0000, chain.objs.size()=1 2024-09-12T18:01:49.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.750+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.BWFe4pAd3oZKOVtMALub956-0MZtpeC_0 2024-09-12T18:01:49.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.750+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8464789717678377950', time=2024-09-12T19:54:45.250391+0000, chain.objs.size()=1 2024-09-12T18:01:49.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.750+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.rfMU9blRs1CwdIuFWsQjKiIk50E8HPl_0 2024-09-12T18:01:49.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.750+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3121407501627474289', time=2024-09-12T19:54:45.376697+0000, chain.objs.size()=1 2024-09-12T18:01:49.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.750+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ITFElIqllcdyoELfbMgFR_TJsZLUgTM_0 2024-09-12T18:01:49.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.750+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10027045049380760923', time=2024-09-12T19:54:45.386951+0000, chain.objs.size()=1 2024-09-12T18:01:49.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.750+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.W88mBfFD5J9Z9d1zK3JD4HVM4j5T_q9_0 2024-09-12T18:01:49.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.750+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3024273294446752407', time=2024-09-12T19:54:45.396358+0000, chain.objs.size()=1 2024-09-12T18:01:49.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.750+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.E0E76i7FL4rA_JPfjMa1jutSHZva98R_0 2024-09-12T18:01:49.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.750+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14254729300477253283', time=2024-09-12T19:54:45.567698+0000, chain.objs.size()=1 2024-09-12T18:01:49.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.750+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ysko6xmMk8KvWHuEw3fJ8RKGvOOnzQj_0 2024-09-12T18:01:49.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.752+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/53816 2024-09-12T18:01:49.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:01:49.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.999326379994524503', time=2024-09-12T19:54:45.579252+0000, chain.objs.size()=1 2024-09-12T18:01:49.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.LcUJfbrCbJaUbBcxHo1959PPGABBjUl_0 2024-09-12T18:01:49.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4164060594476617135', time=2024-09-12T19:54:45.588634+0000, chain.objs.size()=1 2024-09-12T18:01:49.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.CSjW0sJ8ndKlDJVZaHQM-8aW4XvVCvv_0 2024-09-12T18:01:49.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2357312531607768046', time=2024-09-12T19:54:45.603869+0000, chain.objs.size()=1 2024-09-12T18:01:49.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.hlo8_tt_VFNNe3cV1JdVgN-MNdAI-fv_0 2024-09-12T18:01:49.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15078785597024056890', time=2024-09-12T19:54:45.675976+0000, chain.objs.size()=1 2024-09-12T18:01:49.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.0LyzqAAfQMggyS6y8i4oMdI6c3xhIEx_0 2024-09-12T18:01:49.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6077305083879186940', time=2024-09-12T19:54:45.689343+0000, chain.objs.size()=1 2024-09-12T18:01:49.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.XbJPdFyAJIhUvvTCNfJvqRSAmo1Cdhc_0 2024-09-12T18:01:49.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11754078838182091945', time=2024-09-12T19:54:45.713492+0000, chain.objs.size()=1 2024-09-12T18:01:49.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9ej1p2-tj7Q-8ILqmH2EtpawRHw2hPe_0 2024-09-12T18:01:49.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16306489843309756232', time=2024-09-12T19:54:45.714350+0000, chain.objs.size()=1 2024-09-12T18:01:49.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.8Aa-bCwr91tNpABzojWJn5h5w4oiW-F_0 2024-09-12T18:01:49.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7928783841711398477', time=2024-09-12T19:54:45.717376+0000, chain.objs.size()=1 2024-09-12T18:01:49.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.PQNCbhQ6b7poC0PN20bTi2fPgkjySp-_0 2024-09-12T18:01:49.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15838968688808361667', time=2024-09-12T19:54:45.727044+0000, chain.objs.size()=1 2024-09-12T18:01:49.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jzg_j7jbyPjZp2zbNjacpK5m0MEqxC8_0 2024-09-12T18:01:49.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.755+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3092425215619601840', time=2024-09-12T19:54:45.735344+0000, chain.objs.size()=1 2024-09-12T18:01:49.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.755+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.PlaF5ZYRDYQovGl3MwWlu5fCmPN6dPt_0 2024-09-12T18:01:49.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.755+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9017064880983239831', time=2024-09-12T19:54:47.262019+0000, chain.objs.size()=1 2024-09-12T18:01:49.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.755+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.333__shadow_.Ebc6bZ66ZMsMdg7DKuexxVY2Wx6Ed9c_0 2024-09-12T18:01:49.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.755+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14156835393536227703', time=2024-09-12T19:55:20.951132+0000, chain.objs.size()=1 2024-09-12T18:01:49.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.755+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.484__shadow_.Q4AsqrU-8eVAYA2ah4bXpC4xx6Wkino_0 2024-09-12T18:01:49.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.756+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12477995069016424251', time=2024-09-12T19:55:24.473927+0000, chain.objs.size()=1 2024-09-12T18:01:49.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.756+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.498__shadow_.M6cYShNQ77PxRpb-njtEM3Q8sdE2TE7_0 2024-09-12T18:01:49.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.757+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9149664772529864438', time=2024-09-12T19:55:35.351609+0000, chain.objs.size()=6 2024-09-12T18:01:49.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.757+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~M-2xuXqE870cASLR4CmO5fbzZMFEG9s.1 2024-09-12T18:01:49.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.758+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.NcxkYUtoOqkwgygtq_kP1XjKPCQN5O1Y.2 2024-09-12T18:01:49.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.758+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~M-2xuXqE870cASLR4CmO5fbzZMFEG9s.3 2024-09-12T18:01:49.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.758+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~M-2xuXqE870cASLR4CmO5fbzZMFEG9s.4 2024-09-12T18:01:49.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.758+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~M-2xuXqE870cASLR4CmO5fbzZMFEG9s.5 2024-09-12T18:01:49.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.758+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~M-2xuXqE870cASLR4CmO5fbzZMFEG9s.6 2024-09-12T18:01:49.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.761+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10879344488049503009', time=2024-09-12T19:56:11.270955+0000, chain.objs.size()=2 2024-09-12T18:01:49.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.761+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.553__shadow_.kUnpCYyennpjHylGx67znKC6L4BeT-5_0 2024-09-12T18:01:49.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.761+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.553__shadow_.kUnpCYyennpjHylGx67znKC6L4BeT-5_1 2024-09-12T18:01:49.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.761+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15941079857139240737', time=2024-09-12T19:56:27.589666+0000, chain.objs.size()=1 2024-09-12T18:01:49.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.761+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.571__shadow:kcLWQiXjhKMPkneEd017tyHHUFhQGpx_.kAEh603kDH4TNpz8VBL5XHg_-KVNmq2_0 2024-09-12T18:01:49.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.761+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1127149092358151318', time=2024-09-12T19:56:38.862238+0000, chain.objs.size()=1 2024-09-12T18:01:49.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.761+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:5Z0B67FPVER23R0pm2jHBkbz-Q0rRyl_.wgcwgXFUApI77g7cN7COst3TQJzFVLT_0 2024-09-12T18:01:49.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.761+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13799653432944326454', time=2024-09-12T19:59:17.821564+0000, chain.objs.size()=1 2024-09-12T18:01:49.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.761+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.666__shadow_.WXiBT2CjFzr0OA7ac5SyJdWkbAvXlKB_0 2024-09-12T18:01:49.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.766+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:49.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.768+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:01:49.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.769+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:49.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.770+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:49.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46277' 2024-09-12T18:01:49.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='_zfxh_UJJ9P6QGo6TjUaynM0g4f_fhee', time=2024-09-12T19:52:57.477128+0000, chain.objs.size()=1 2024-09-12T18:01:49.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__shadow_.eBpOA6UXb2FXSXtxUK6Zc6Ms8nUBIrF_0 2024-09-12T18:01:49.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6411273021990309361', time=2024-09-12T19:54:00.326536+0000, chain.objs.size()=1 2024-09-12T18:01:49.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.235__shadow_.0PVDSMXAQ66h_xY9soo7EG7na_7V099_0 2024-09-12T18:01:49.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15143867397861584526', time=2024-09-12T19:54:02.565894+0000, chain.objs.size()=1 2024-09-12T18:01:49.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.245__shadow_.p9v2eJhyJaZxkZmSujySxxz7OB6ASBH_0 2024-09-12T18:01:49.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8206821949453607971', time=2024-09-12T19:54:13.485708+0000, chain.objs.size()=1 2024-09-12T18:01:49.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ihnam8ega7h7NkiPR9B6t43VBqf9RtS_0 2024-09-12T18:01:49.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7991096827264712899', time=2024-09-12T19:54:13.504656+0000, chain.objs.size()=1 2024-09-12T18:01:49.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.EFSPmSNMrEXYy6gYw-zvFodibmtBnS7_0 2024-09-12T18:01:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12314141248302588917', time=2024-09-12T19:54:13.505865+0000, chain.objs.size()=1 2024-09-12T18:01:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.19GfvtzT_G-l0c1iqF2kMuvxzoFu1pm_0 2024-09-12T18:01:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17855861995521233919', time=2024-09-12T19:54:13.520888+0000, chain.objs.size()=1 2024-09-12T18:01:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.SrqvNJg9GmvpWm1CymxaQyNjJ1HSpqj_0 2024-09-12T18:01:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7791328393657742937', time=2024-09-12T19:54:13.551188+0000, chain.objs.size()=1 2024-09-12T18:01:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.DiJrdZKeQEnMEZoywWBiyW1awwTPbWT_0 2024-09-12T18:01:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3567752770493188609', time=2024-09-12T19:54:13.559777+0000, chain.objs.size()=1 2024-09-12T18:01:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.4nNfQDcTYAUGbosPZ6M70gaWl1-FAYH_0 2024-09-12T18:01:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10633952280613214718', time=2024-09-12T19:54:13.698158+0000, chain.objs.size()=1 2024-09-12T18:01:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.CnWcG6JfLl95PKqRAGvuKWKhdtirKY7_0 2024-09-12T18:01:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2989376908155972688', time=2024-09-12T19:54:13.746508+0000, chain.objs.size()=1 2024-09-12T18:01:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.N2z84O8cOkQFFkN4wGCgHA0SSwfddo0_0 2024-09-12T18:01:49.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15712611018433859106', time=2024-09-12T19:54:13.844123+0000, chain.objs.size()=1 2024-09-12T18:01:49.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.771+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.IO7prpY7gVlvdZ8zf-lVfiMTXZqjPt5_0 2024-09-12T18:01:49.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.774+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3023526185481621454', time=2024-09-12T19:54:13.847926+0000, chain.objs.size()=1 2024-09-12T18:01:49.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.774+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ZBu6tn1SbUFOpd-BVmAD6dXJbGPbnE3_0 2024-09-12T18:01:49.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12771309539344498490', time=2024-09-12T19:54:13.858265+0000, chain.objs.size()=1 2024-09-12T18:01:49.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.yo08u_R7X22EByblKg4n9as-DwZn1S5_0 2024-09-12T18:01:49.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16016793148882561462', time=2024-09-12T19:54:13.901875+0000, chain.objs.size()=1 2024-09-12T18:01:49.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Vh3P7BncOsGLY3VNvlhY-JJHvXSPquZ_0 2024-09-12T18:01:49.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16500926589494225207', time=2024-09-12T19:54:13.924715+0000, chain.objs.size()=1 2024-09-12T18:01:49.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.nwN3i9dNuO0YPQrKmI-BscHXwlLbxRf_0 2024-09-12T18:01:49.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14908342598522377859', time=2024-09-12T19:54:13.926868+0000, chain.objs.size()=1 2024-09-12T18:01:49.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.WFuj9misWd-bILPJ87kG45-uukJs6l4_0 2024-09-12T18:01:49.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7043720828301929406', time=2024-09-12T19:54:14.059443+0000, chain.objs.size()=1 2024-09-12T18:01:49.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.CbZPMUKk3vn9cp9bDGEpkrvhzayASZv_0 2024-09-12T18:01:49.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17019518895391859910', time=2024-09-12T19:54:14.436128+0000, chain.objs.size()=1 2024-09-12T18:01:49.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.KFm6dIOv6bUfbCUluB408B5BmsNPBLv_0 2024-09-12T18:01:49.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5012983507445403385', time=2024-09-12T19:54:14.466686+0000, chain.objs.size()=1 2024-09-12T18:01:49.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.NRGZXPZUIO2lIoAl_uggdbqCeL7GcsC_0 2024-09-12T18:01:49.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11329974056826712120', time=2024-09-12T19:54:14.557189+0000, chain.objs.size()=1 2024-09-12T18:01:49.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.JtcJUleOYjyC-wzMJZu9N_wAv2ju5n0_0 2024-09-12T18:01:49.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14924617196628880536', time=2024-09-12T19:54:14.564634+0000, chain.objs.size()=1 2024-09-12T18:01:49.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.H_8eIJqComvEVWIJaR8OcnN-Fqkizqz_0 2024-09-12T18:01:49.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14522676997232823468', time=2024-09-12T19:54:14.596694+0000, chain.objs.size()=1 2024-09-12T18:01:49.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.776+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.8JvLAZUuVWF4jiN28l4McF4aSWppYfO_0 2024-09-12T18:01:49.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.778+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.202118413287832774', time=2024-09-12T19:54:14.629462+0000, chain.objs.size()=1 2024-09-12T18:01:49.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.779+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.60lTEh2SXZohyX685GzO2wIOhaitOhy_0 2024-09-12T18:01:49.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.779+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10035971274601739466', time=2024-09-12T19:54:14.736879+0000, chain.objs.size()=1 2024-09-12T18:01:49.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.779+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.SW1KggZoizuGrA17L85J-GFAlcN_1A__0 2024-09-12T18:01:49.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.781+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.891480328883559631', time=2024-09-12T19:54:14.759501+0000, chain.objs.size()=1 2024-09-12T18:01:49.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.781+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.onhCGoGADe0g49oZOfsU6qOSVrvWWy8_0 2024-09-12T18:01:49.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.781+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3400295708161556516', time=2024-09-12T19:54:14.768892+0000, chain.objs.size()=1 2024-09-12T18:01:49.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.781+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.7P1RHXMbDv659kr9SKNRYy7NpTLObUx_0 2024-09-12T18:01:49.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.781+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2956526926586985183', time=2024-09-12T19:54:14.909530+0000, chain.objs.size()=1 2024-09-12T18:01:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.781+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.UpAFSqjcu5wAI-zBG3r2O1szJ7fXm3a_0 2024-09-12T18:01:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.781+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3737245227311807191', time=2024-09-12T19:54:14.929582+0000, chain.objs.size()=1 2024-09-12T18:01:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.781+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.JARhFCdHYhwBctOmF4aW99uDIHUG2GP_0 2024-09-12T18:01:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.781+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18060362725551733973', time=2024-09-12T19:54:14.934077+0000, chain.objs.size()=1 2024-09-12T18:01:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.781+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.H-nHNnQhpL_tIQHZgq_ut3WurIzIYRp_0 2024-09-12T18:01:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.781+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2347561204500189690', time=2024-09-12T19:54:19.464291+0000, chain.objs.size()=1 2024-09-12T18:01:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.781+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.285__shadow_.uMmjZoD97BpnC6e-Ysr6nDrTl8feUjI_0 2024-09-12T18:01:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.781+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17012722404352768146', time=2024-09-12T19:54:20.397507+0000, chain.objs.size()=1 2024-09-12T18:01:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.781+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.289__shadow_.VjYhcDe8RDzDA6Aem_R_wpE-Nv_bAFE_0 2024-09-12T18:01:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.781+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11735881039602269311', time=2024-09-12T19:54:20.804536+0000, chain.objs.size()=1 2024-09-12T18:01:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.781+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.291__shadow_.coQ3H0mhGxsY33b61JP6__pPfliEI3y_0 2024-09-12T18:01:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.782+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15883912321326641783', time=2024-09-12T19:54:21.588350+0000, chain.objs.size()=1 2024-09-12T18:01:49.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.782+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.gkLyEcnGAxiUUOijdzhqHsMovgPKGiK_0 2024-09-12T18:01:49.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.782+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9030004196135986536', time=2024-09-12T19:54:21.589160+0000, chain.objs.size()=1 2024-09-12T18:01:49.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.782+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.xhqwJqMkFc3pzhiFiHk1gzZqFV10o9R_0 2024-09-12T18:01:49.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.782+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12387662569153394470', time=2024-09-12T19:54:22.170788+0000, chain.objs.size()=1 2024-09-12T18:01:49.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.782+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.nEWX3Hk6jrPADJ_oXdkSWJEOno5ilrh_0 2024-09-12T18:01:49.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.784+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7154037151331631885', time=2024-09-12T19:54:23.035470+0000, chain.objs.size()=1 2024-09-12T18:01:49.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.784+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.298__shadow_.DB4PQve6P99KKXU1l1w0jdTLgRxwBiY_0 2024-09-12T18:01:49.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.784+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4193524738783684595', time=2024-09-12T19:54:23.036385+0000, chain.objs.size()=1 2024-09-12T18:01:49.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.784+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.298__shadow_.Wu_oRlaAvTX1B8coyQo3VkY5q1wWvLB_0 2024-09-12T18:01:49.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.784+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12432042051155137421', time=2024-09-12T19:54:23.568249+0000, chain.objs.size()=1 2024-09-12T18:01:49.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.784+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.300__shadow_.NljqZUWW-2YnhlePoeMLwj71C4z8Fp0_0 2024-09-12T18:01:49.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14713353178063792551', time=2024-09-12T19:54:23.974796+0000, chain.objs.size()=1 2024-09-12T18:01:49.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.302__shadow_.zFbIOjCZUxrLRNZFYGcsdO4Ir1j1mlw_0 2024-09-12T18:01:49.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15678603132538052666', time=2024-09-12T19:54:24.580894+0000, chain.objs.size()=1 2024-09-12T18:01:49.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.305__shadow_.TWL7V0ja9HLcp6ZmDI8bCQywku6GB1y_0 2024-09-12T18:01:49.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10609871428164567447', time=2024-09-12T19:54:25.191864+0000, chain.objs.size()=1 2024-09-12T18:01:49.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.307__shadow_.ESOhLAVeTn8QmbPOTYY_ddZWfGIMb7e_0 2024-09-12T18:01:49.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2785728572595329624', time=2024-09-12T19:54:28.204740+0000, chain.objs.size()=1 2024-09-12T18:01:49.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.323__shadow_.kqW587WxqkJAQmzu-M544RbxAOhUEcg_0 2024-09-12T18:01:49.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11359235913033591533', time=2024-09-12T19:54:35.836467+0000, chain.objs.size()=1 2024-09-12T18:01:49.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-ZxJ5tidz6JhBEVlY3RC62TFIzs7aNv_0 2024-09-12T18:01:49.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6969099787501578500', time=2024-09-12T19:54:35.935799+0000, chain.objs.size()=1 2024-09-12T18:01:49.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.OfDE_i8UK46NgL_ujfksRFydH6mg7-T_0 2024-09-12T18:01:49.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1251490257659651978', time=2024-09-12T19:54:35.953810+0000, chain.objs.size()=1 2024-09-12T18:01:49.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1GgC8dh2mtWTapP3TUO6d8ZwMw3ObmZ_0 2024-09-12T18:01:49.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2210529327288400223', time=2024-09-12T19:54:35.982898+0000, chain.objs.size()=1 2024-09-12T18:01:49.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.2e5_DoQ436nmiJK_jWUDSrdfFjKg-Ia_0 2024-09-12T18:01:49.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11299225932736231001', time=2024-09-12T19:54:36.086033+0000, chain.objs.size()=1 2024-09-12T18:01:49.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.786+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.GEytKgA9ClhCggk0bDX3ek9mwW9sCzd_0 2024-09-12T18:01:49.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.789+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5396917860442145577', time=2024-09-12T19:54:36.087308+0000, chain.objs.size()=1 2024-09-12T18:01:49.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.789+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.uJmaKvp9proKTSBXFp9HXsWUJE72CYH_0 2024-09-12T18:01:49.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.789+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17291818817498270082', time=2024-09-12T19:54:36.098231+0000, chain.objs.size()=1 2024-09-12T18:01:49.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.789+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QeOXWjvk9Zf7VfQuCcnPF4XLcsrMdfX_0 2024-09-12T18:01:49.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16757947125334132810', time=2024-09-12T19:54:36.110155+0000, chain.objs.size()=1 2024-09-12T18:01:49.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.791+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.mi7vRT3uLnqNCkuXvj5_5S25596tZ8c_0 2024-09-12T18:01:49.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8999708784468518700', time=2024-09-12T19:54:36.113589+0000, chain.objs.size()=1 2024-09-12T18:01:49.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.791+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ddtFhDrSa0JblU_CvBF6s_yaBVA4rn2_0 2024-09-12T18:01:49.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10446466374915413235', time=2024-09-12T19:54:36.118798+0000, chain.objs.size()=1 2024-09-12T18:01:49.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.791+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Bsg3ZLpR8Vh_RXelgr6yGA6h_yNhlIo_0 2024-09-12T18:01:49.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.269512797233334680', time=2024-09-12T19:54:36.263020+0000, chain.objs.size()=1 2024-09-12T18:01:49.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.791+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.vU3AEkx09xz23QUMh3xL_HO9mhdOof5_0 2024-09-12T18:01:49.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6073393781173890072', time=2024-09-12T19:54:36.276905+0000, chain.objs.size()=1 2024-09-12T18:01:49.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.791+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.G0X4yIPLXuhTcyzsq7LzFHqZxoflcH8_0 2024-09-12T18:01:49.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2060144644449107554', time=2024-09-12T19:54:36.281757+0000, chain.objs.size()=1 2024-09-12T18:01:49.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.791+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.mQ7RDqhwQcFjZrj2UDtLgyk7xgK-Ls7_0 2024-09-12T18:01:49.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5698232057723192892', time=2024-09-12T19:54:36.304134+0000, chain.objs.size()=1 2024-09-12T18:01:49.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.791+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.6kVWpvQdosx3P3cjmRkKHEUnzUal-qr_0 2024-09-12T18:01:49.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11409590241663555765', time=2024-09-12T19:54:36.318200+0000, chain.objs.size()=1 2024-09-12T18:01:49.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.792+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.m7JUp_VSVSS5ClEcdrvAE7wsz_Niy5l_0 2024-09-12T18:01:49.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.792+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9128471678973037498', time=2024-09-12T19:54:36.417327+0000, chain.objs.size()=1 2024-09-12T18:01:49.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.792+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.TLFandbARN4X4dKmF1dcO14uFYdMIk__0 2024-09-12T18:01:49.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.792+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7540113451345337067', time=2024-09-12T19:54:36.440396+0000, chain.objs.size()=1 2024-09-12T18:01:49.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.792+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.w7E7rKhd-uza3DE8YM6Tgfx08jXOQ3b_0 2024-09-12T18:01:49.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.792+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.410023829191745660', time=2024-09-12T19:54:36.462436+0000, chain.objs.size()=1 2024-09-12T18:01:49.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.792+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rTfasdk10SLVRe4jz0NpjzhGub78YUs_0 2024-09-12T18:01:49.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15160086504556381683', time=2024-09-12T19:54:36.613723+0000, chain.objs.size()=1 2024-09-12T18:01:49.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.uWJSieyWeM4JhkV55vrMMOJ3RrOnMjQ_0 2024-09-12T18:01:49.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18174843178662599075', time=2024-09-12T19:54:36.618615+0000, chain.objs.size()=1 2024-09-12T18:01:49.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.RZn754ANAVmrMFUZ1RzuakMzxCqDV35_0 2024-09-12T18:01:49.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16550243490720301063', time=2024-09-12T19:54:36.790420+0000, chain.objs.size()=1 2024-09-12T18:01:49.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.SgLLkxIfDLygfVN-GrE6neyqNqi3JGp_0 2024-09-12T18:01:49.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4725583292020269032', time=2024-09-12T19:54:36.825966+0000, chain.objs.size()=1 2024-09-12T18:01:49.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1VCXs3eCRjaMOROl0AAKzyBXxMOaoxH_0 2024-09-12T18:01:49.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14652841580315602567', time=2024-09-12T19:54:36.829684+0000, chain.objs.size()=1 2024-09-12T18:01:49.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.6REla1uOzbGwFJNXXtyppW6cwSGQKlM_0 2024-09-12T18:01:49.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6779013746237628788', time=2024-09-12T19:54:36.914914+0000, chain.objs.size()=1 2024-09-12T18:01:49.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.HDTNP8QIZWZJGeRGc-PgGYKpRBF797__0 2024-09-12T18:01:49.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17388508870045283886', time=2024-09-12T19:54:36.941765+0000, chain.objs.size()=1 2024-09-12T18:01:49.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.FDlNvEwAMqDvgtY4mv6DpxG6jLIWJow_0 2024-09-12T18:01:49.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9631330101608263101', time=2024-09-12T19:54:36.962262+0000, chain.objs.size()=1 2024-09-12T18:01:49.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.dcte_Vxqz7sv0VaLYAl-aOcSB3tqwNR_0 2024-09-12T18:01:49.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10582051487514433931', time=2024-09-12T19:54:36.967801+0000, chain.objs.size()=1 2024-09-12T18:01:49.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.3FdDsW3XiqhtrIUraOsG99r4AM3tm5V_0 2024-09-12T18:01:49.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9509209520495313385', time=2024-09-12T19:54:44.456973+0000, chain.objs.size()=1 2024-09-12T18:01:49.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.P1-RV6Lxc6cA3K5rK6RtCJZBQc0XwZj_0 2024-09-12T18:01:49.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1040530960818876493', time=2024-09-12T19:54:44.482700+0000, chain.objs.size()=1 2024-09-12T18:01:49.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.794+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.pbigIqxUVBcAATf7pkbEKI-bUEB5xFf_0 2024-09-12T18:01:49.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10966437560788996926', time=2024-09-12T19:54:44.534494+0000, chain.objs.size()=1 2024-09-12T18:01:49.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9x9yjXetKOVzgxAjii9lL272QhGPBOu_0 2024-09-12T18:01:49.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6684872843301008087', time=2024-09-12T19:54:44.547398+0000, chain.objs.size()=1 2024-09-12T18:01:49.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.2V9ukX-HvaO5LGSxu201IUyQukhjNE2_0 2024-09-12T18:01:49.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6953243423698316191', time=2024-09-12T19:54:44.551128+0000, chain.objs.size()=1 2024-09-12T18:01:49.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.cKpLxgyB6fpwJnN-CRnmCKQYfHYCWz4_0 2024-09-12T18:01:49.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5011687222484377230', time=2024-09-12T19:54:44.632177+0000, chain.objs.size()=1 2024-09-12T18:01:49.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.UoEniwVRZHuZjEtBwWLgP8oycitHMk6_0 2024-09-12T18:01:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2488431519726905735', time=2024-09-12T19:54:44.673141+0000, chain.objs.size()=1 2024-09-12T18:01:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.eCQHHJWHiolKJRDN67zp4sHrCR9vVbm_0 2024-09-12T18:01:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8722363636467551376', time=2024-09-12T19:54:44.685853+0000, chain.objs.size()=1 2024-09-12T18:01:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.I1kBS-9eP-Ou3Dr5YJ-lM23ZNSAgG0G_0 2024-09-12T18:01:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2232064648664934502', time=2024-09-12T19:54:44.694131+0000, chain.objs.size()=1 2024-09-12T18:01:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.48DvTtR0LQe5wWOdaEG7OSsDxj20--T_0 2024-09-12T18:01:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5462357583032707882', time=2024-09-12T19:54:44.701190+0000, chain.objs.size()=1 2024-09-12T18:01:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.QaICCjVKbUB-qKSvETnk7RuS6zB59Bj_0 2024-09-12T18:01:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12865867504049112221', time=2024-09-12T19:54:44.800774+0000, chain.objs.size()=1 2024-09-12T18:01:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.dEH_FCWu4DPWq2B7oaShrNP5bcG0FyP_0 2024-09-12T18:01:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3078933389402756424', time=2024-09-12T19:54:44.825501+0000, chain.objs.size()=1 2024-09-12T18:01:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.XNtSMtiAd7w8KbVWloApf9KsfyStrTi_0 2024-09-12T18:01:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.537279474733220136', time=2024-09-12T19:54:45.018593+0000, chain.objs.size()=1 2024-09-12T18:01:49.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9V7BM8WWsAmltUlmcapu5utVPXf6j2a_0 2024-09-12T18:01:49.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.798+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13095583293187613238', time=2024-09-12T19:54:45.207235+0000, chain.objs.size()=1 2024-09-12T18:01:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.798+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ke8y3R2TYOl2ZmJcMCs-xnCSPQ97SHt_0 2024-09-12T18:01:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.798+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2650851166623128237', time=2024-09-12T19:54:45.210490+0000, chain.objs.size()=1 2024-09-12T18:01:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.798+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.h50PYGo8WpyA2_yrYZgWXKXM0xZaf9W_0 2024-09-12T18:01:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2229769185430588354', time=2024-09-12T19:54:45.240267+0000, chain.objs.size()=1 2024-09-12T18:01:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.DVzWmnzWDZ2kO4HQuO-tl_fqxw3YLXK_0 2024-09-12T18:01:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17158539918520880058', time=2024-09-12T19:54:45.257431+0000, chain.objs.size()=1 2024-09-12T18:01:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.P9v2Ujf_1yS_jdYFeBXXrd6GK6iT_N8_0 2024-09-12T18:01:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17718670936985849474', time=2024-09-12T19:54:45.336587+0000, chain.objs.size()=1 2024-09-12T18:01:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.klOGO1B3aVZatuxXl2csGMpzOTJZHFa_0 2024-09-12T18:01:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.93283676590744461', time=2024-09-12T19:54:45.337349+0000, chain.objs.size()=1 2024-09-12T18:01:49.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.UTSHJTxePydZc-SJx6dl_4BhlUysaPt_0 2024-09-12T18:01:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4674917526432075769', time=2024-09-12T19:54:45.360929+0000, chain.objs.size()=1 2024-09-12T18:01:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9xZtPutk5__wsr_ig9hf7OLBi_8bpM8_0 2024-09-12T18:01:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14600374684622372838', time=2024-09-12T19:54:45.508800+0000, chain.objs.size()=1 2024-09-12T18:01:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.JienKpyYKUyfwsYhulVkgtJ9254YpGA_0 2024-09-12T18:01:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13899490011745279343', time=2024-09-12T19:54:45.512925+0000, chain.objs.size()=1 2024-09-12T18:01:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Z3ZE_oFOKn0vcKfYfVerdwq5dG5xIAh_0 2024-09-12T18:01:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.332150738260196156', time=2024-09-12T19:54:45.547101+0000, chain.objs.size()=1 2024-09-12T18:01:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.XeHx4kUGb5IHiREV_AAEHJfpnj7Bngj_0 2024-09-12T18:01:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2014644038360787393', time=2024-09-12T19:54:45.554679+0000, chain.objs.size()=1 2024-09-12T18:01:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.799+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jU6IYC3rps_8kPY4QdUIZe-o3_vcCpY_0 2024-09-12T18:01:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.800+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6708353351260500137', time=2024-09-12T19:54:45.556924+0000, chain.objs.size()=1 2024-09-12T18:01:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.800+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.X20uoUk2w7CQ43sG9gPS4-5dIGhzt2J_0 2024-09-12T18:01:49.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.800+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3805055745305106431', time=2024-09-12T19:54:45.569446+0000, chain.objs.size()=1 2024-09-12T18:01:49.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.800+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.yVQX6II_3BkS8Fpxu5yriR1byG3HxaV_0 2024-09-12T18:01:49.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.801+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5430507868519786847', time=2024-09-12T19:54:45.585918+0000, chain.objs.size()=1 2024-09-12T18:01:49.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.801+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.AMvQZkEkRjEDuRXTH3x-wm0KSjBvbe1_0 2024-09-12T18:01:49.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.801+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6670802851979686034', time=2024-09-12T19:54:45.726358+0000, chain.objs.size()=1 2024-09-12T18:01:49.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.801+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.AqruYPoJQ66oOFDRpOxnf_JWOHp2PWG_0 2024-09-12T18:01:49.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.801+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17931312720974151340', time=2024-09-12T19:54:45.730470+0000, chain.objs.size()=1 2024-09-12T18:01:49.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.801+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.H2gUU3AMA_hbBZURfYNqjM3m41tkZ8K_0 2024-09-12T18:01:49.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.801+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11428711935740818024', time=2024-09-12T19:54:48.607648+0000, chain.objs.size()=1 2024-09-12T18:01:49.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.801+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.340__shadow_.C6zryvWsXWxGU-NRKWL8Vmm_yFBguLI_0 2024-09-12T18:01:49.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.803+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/46277 2024-09-12T18:01:49.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:01:49.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5273196775158980014', time=2024-09-12T19:54:54.022664+0000, chain.objs.size()=1 2024-09-12T18:01:49.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.374__shadow_.8B1unMbil1m6h5dv82OMXeqPwGYTDGE_0 2024-09-12T18:01:49.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3035052404533701522', time=2024-09-12T19:55:07.888992+0000, chain.objs.size()=1 2024-09-12T18:01:49.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.430__shadow_.-IIAZrsJvTeFqYVNxTZd3WectjjPN4Y_0 2024-09-12T18:01:49.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17408629411680796376', time=2024-09-12T19:55:15.085232+0000, chain.objs.size()=1 2024-09-12T18:01:49.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.459__shadow_.j5zL8F7UBevz-LyOkdWM3yBYTV7bTWL_0 2024-09-12T18:01:49.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9962571285379027960', time=2024-09-12T19:55:22.092615+0000, chain.objs.size()=1 2024-09-12T18:01:49.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.488__shadow_.-rMaeyptmnqhbEZHnwBFrQ_bDe0tMTw_0 2024-09-12T18:01:49.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14747145222984068867', time=2024-09-12T19:55:28.975169+0000, chain.objs.size()=1 2024-09-12T18:01:49.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.515__shadow_.ewkcCXF_EiZZkyu3txeVSG9VeY02XhT_0 2024-09-12T18:01:49.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9803987323402168096', time=2024-09-12T19:55:40.215749+0000, chain.objs.size()=2 2024-09-12T18:01:49.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.526__multipart_mymultipart.2~FCYj_LuHRaAGAn9VJMC1DYJEQHy6sbP.1 2024-09-12T18:01:49.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.526__multipart_mymultipart.2~FCYj_LuHRaAGAn9VJMC1DYJEQHy6sbP.2 2024-09-12T18:01:49.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16419004450883322509', time=2024-09-12T19:56:26.346541+0000, chain.objs.size()=1 2024-09-12T18:01:49.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:v.OebWjoS6wzHCFTEgFdZOezDy1waKv_.czBZcTNO8PD8xMaqvZQnQOxpupH38XH_0 2024-09-12T18:01:49.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12938552807268515362', time=2024-09-12T19:56:28.233485+0000, chain.objs.size()=1 2024-09-12T18:01:49.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.573__shadow_.XfprcTYZQKMZKxbMOXKJX0w7rjPLJJC_0 2024-09-12T18:01:49.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.261404831962512692', time=2024-09-12T19:56:35.284792+0000, chain.objs.size()=1 2024-09-12T18:01:49.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:Otc5dRHgeKOoh9Y-B7rBJZ98ae2XWH-_.9vPYWgTzcp1u1LDzV23n-jRUrDMlTG-_0 2024-09-12T18:01:49.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16036610061871508835', time=2024-09-12T19:56:53.071054+0000, chain.objs.size()=1 2024-09-12T18:01:49.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.588__shadow:imUNb87MlfxIT9o0Kp1qWmh2ZTvlvqo_.mJyPDsEaiby2hgDUn7zInfVUk90lezg_0 2024-09-12T18:01:49.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2060498198186204015', time=2024-09-12T19:59:07.726121+0000, chain.objs.size()=1 2024-09-12T18:01:49.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.805+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.632__shadow_.qtwMKWInxK1MVFXtxpJvd3axkY_C8dK_0 2024-09-12T18:01:49.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.807+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12284365228947216820', time=2024-09-12T19:59:09.567350+0000, chain.objs.size()=1 2024-09-12T18:01:49.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.807+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.641__shadow_.v8X9M2MVHaCLmMr5J7q4iEkxju_SGN__0 2024-09-12T18:01:49.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.807+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12863280618560775808', time=2024-09-12T19:59:16.891340+0000, chain.objs.size()=6 2024-09-12T18:01:49.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.807+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.663__multipart_foo.2~XXOideCV_9ntHRnpWBshlsyGPmaL_sz.1 2024-09-12T18:01:49.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.663__multipart_foo.2~XXOideCV_9ntHRnpWBshlsyGPmaL_sz.2 2024-09-12T18:01:49.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.663__multipart_foo.2~XXOideCV_9ntHRnpWBshlsyGPmaL_sz.3 2024-09-12T18:01:49.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.663__multipart_foo.2~XXOideCV_9ntHRnpWBshlsyGPmaL_sz.4 2024-09-12T18:01:49.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.663__multipart_foo.2~XXOideCV_9ntHRnpWBshlsyGPmaL_sz.5 2024-09-12T18:01:49.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.663__multipart_foo.2~XXOideCV_9ntHRnpWBshlsyGPmaL_sz.6 2024-09-12T18:01:49.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.808+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9994653009398406562', time=2024-09-12T19:59:19.054148+0000, chain.objs.size()=1 2024-09-12T18:01:49.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.671__shadow_.oB9oIjuQ-95zpt31SGicmT1kgOB3IJv_0 2024-09-12T18:01:49.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.808+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1884669599263134626', time=2024-09-12T19:59:20.813735+0000, chain.objs.size()=1 2024-09-12T18:01:49.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.680__shadow_.lvyXcAS-Q0z4Qp-y3cbNoyMSPrs6obs_0 2024-09-12T18:01:49.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.808+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10083673051474515451', time=2024-09-12T19:59:25.789989+0000, chain.objs.size()=1 2024-09-12T18:01:49.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.704__shadow:HIaa952bLzjjbUS.apJkrBT5-7noEqJ_.LhlQISln8EDE4ktMzMKj_hEjzn3A4OG_0 2024-09-12T18:01:49.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.808+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10721183656676899547', time=2024-09-12T19:59:51.587786+0000, chain.objs.size()=1 2024-09-12T18:01:49.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.735__shadow_.qOG41AX0N-zBKUgpYRQpRyPTielcogM_0 2024-09-12T18:01:49.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.808+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1919052932663155862', time=2024-09-12T19:59:54.663911+0000, chain.objs.size()=3 2024-09-12T18:01:49.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.744__multipart_mymultipart3.2~iiVd9nvi53OL2YdXAA_olDwFCQvEcSF.1 2024-09-12T18:01:49.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.744__multipart_mymultipart3.2~iiVd9nvi53OL2YdXAA_olDwFCQvEcSF.2 2024-09-12T18:01:49.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.810+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.744__multipart_mymultipart3.2~iiVd9nvi53OL2YdXAA_olDwFCQvEcSF.3 2024-09-12T18:01:49.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.811+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:49.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.813+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:01:49.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.815+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:49.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.815+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:49.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42945' 2024-09-12T18:01:49.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15778275152674259458', time=2024-09-12T19:53:59.650043+0000, chain.objs.size()=1 2024-09-12T18:01:49.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.232__shadow_.ZNeIoqsK1WvafLbtkz1AElbdaYEm05A_0 2024-09-12T18:01:49.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5380343198539829763', time=2024-09-12T19:54:00.993128+0000, chain.objs.size()=1 2024-09-12T18:01:49.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.238__shadow_.PBIFKtKuldQVGZv5e0jVv41Y6fGB5_t_0 2024-09-12T18:01:49.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4269317017741167113', time=2024-09-12T19:54:03.820516+0000, chain.objs.size()=1 2024-09-12T18:01:49.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.251__shadow_.rJSfET0EV_cTbRCAeZ4t75RP-gwtdD8_0 2024-09-12T18:01:49.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11913526174798641794', time=2024-09-12T19:54:04.672488+0000, chain.objs.size()=1 2024-09-12T18:01:49.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.255__shadow_.tyiS80AuN08XVm6GkRzxNBMBElg-0GH_0 2024-09-12T18:01:49.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.585885959186888191', time=2024-09-12T19:54:13.490676+0000, chain.objs.size()=1 2024-09-12T18:01:49.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Yf4x-OT0lPH2X1yP1bt8Kti4lcInHk8_0 2024-09-12T18:01:49.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14063480671187996643', time=2024-09-12T19:54:13.499292+0000, chain.objs.size()=1 2024-09-12T18:01:49.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.SleCXPsdsq9W-eRzWzQJ3iD5mURIMOd_0 2024-09-12T18:01:49.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9555038657645451651', time=2024-09-12T19:54:13.514383+0000, chain.objs.size()=1 2024-09-12T18:01:49.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ucaz9ls8PNJj_kyn2slYDfGcF_OYmmX_0 2024-09-12T18:01:49.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4632240290729493640', time=2024-09-12T19:54:13.658077+0000, chain.objs.size()=1 2024-09-12T18:01:49.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.dBRjbaxOFoqcfvuL3jAOTbZlAOblU-6_0 2024-09-12T18:01:49.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8672781495313008231', time=2024-09-12T19:54:13.676092+0000, chain.objs.size()=1 2024-09-12T18:01:49.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_._4qTvp1aRZNkFPi0_POFOfddXgjQVGc_0 2024-09-12T18:01:49.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14906119140978220801', time=2024-09-12T19:54:13.722049+0000, chain.objs.size()=1 2024-09-12T18:01:49.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.GgVw_b6tomFSjR_5Cm1VFouCf79jjg6_0 2024-09-12T18:01:49.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3036762465587027617', time=2024-09-12T19:54:13.836685+0000, chain.objs.size()=1 2024-09-12T18:01:49.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.6NoHyBV8UGo2DNWMBNrMkepqfpMBPQ-_0 2024-09-12T18:01:49.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4685407958770596747', time=2024-09-12T19:54:13.849506+0000, chain.objs.size()=1 2024-09-12T18:01:49.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.816+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ll9FSdwvhTtI_H4998chqjn6qKQMFGq_0 2024-09-12T18:01:49.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.818+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17373161369359396257', time=2024-09-12T19:54:13.884827+0000, chain.objs.size()=1 2024-09-12T18:01:49.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.818+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.HGgXktWPlojH0Vy33WJb6RC8Sb8ooSU_0 2024-09-12T18:01:49.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.818+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13129364587720605030', time=2024-09-12T19:54:13.900913+0000, chain.objs.size()=1 2024-09-12T18:01:49.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.818+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.M2RQTKpUthBaN2Q_svzVs4c4Mw8MzwK_0 2024-09-12T18:01:49.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.818+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2349936294903849431', time=2024-09-12T19:54:13.910616+0000, chain.objs.size()=1 2024-09-12T18:01:49.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.818+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Zkt5XktTGgKufBj4k-1evD9iYvgk_H-_0 2024-09-12T18:01:49.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.818+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3017894612505828123', time=2024-09-12T19:54:13.912479+0000, chain.objs.size()=1 2024-09-12T18:01:49.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.818+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.C7uVa9my8qdgOz65vPFgXCNT3FtQ5rU_0 2024-09-12T18:01:49.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6180992581967682436', time=2024-09-12T19:54:14.005660+0000, chain.objs.size()=1 2024-09-12T18:01:49.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.nNZAHz_vb7wJ0rCnxtjWpDoAIxvv3fJ_0 2024-09-12T18:01:49.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16230685190454663528', time=2024-09-12T19:54:14.020965+0000, chain.objs.size()=1 2024-09-12T18:01:49.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.KDqOPBTKTFLhLhpW6x8eeRvGWEM4q5J_0 2024-09-12T18:01:49.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2180189400084042150', time=2024-09-12T19:54:14.026413+0000, chain.objs.size()=1 2024-09-12T18:01:49.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.UP3WYOtnR_KiSNuEsmgUIIFKow7AiYP_0 2024-09-12T18:01:49.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7360122921381585733', time=2024-09-12T19:54:14.059711+0000, chain.objs.size()=1 2024-09-12T18:01:49.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.YrI9pQF-yMLTUlHosLFXCYGF_-W-hXL_0 2024-09-12T18:01:49.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16259528516003223253', time=2024-09-12T19:54:14.060457+0000, chain.objs.size()=1 2024-09-12T18:01:49.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.FcQT1sNUDoExJxcXYjM3HK-uoZuvOmG_0 2024-09-12T18:01:49.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14428162860864955014', time=2024-09-12T19:54:14.288849+0000, chain.objs.size()=1 2024-09-12T18:01:49.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.igpw3cufHVbb6vQM75XEzc-SshqWDDg_0 2024-09-12T18:01:49.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6608865560893155309', time=2024-09-12T19:54:14.289658+0000, chain.objs.size()=1 2024-09-12T18:01:49.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ukgsfH4dpQPCJnnDekz3QLuR8bonPRY_0 2024-09-12T18:01:49.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15597782988079675048', time=2024-09-12T19:54:14.373857+0000, chain.objs.size()=1 2024-09-12T18:01:49.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.0jdRWEfRnS15pLnr3KGHFu3p5yTqGD2_0 2024-09-12T18:01:49.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.928914787977395879', time=2024-09-12T19:54:14.402487+0000, chain.objs.size()=1 2024-09-12T18:01:49.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.819+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.yHjuLGsSwi5rk61Yjn1n7uwaqpoxIT7_0 2024-09-12T18:01:49.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.820+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8323506450999519111', time=2024-09-12T19:54:14.445664+0000, chain.objs.size()=1 2024-09-12T18:01:49.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.820+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.V8fWirtyRw1cbJ6D0Ntp0QNd6HusvBq_0 2024-09-12T18:01:49.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.821+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13270722271732661678', time=2024-09-12T19:54:14.459307+0000, chain.objs.size()=1 2024-09-12T18:01:49.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.821+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.q_ikeCGsZVpmE2mQ3eOleA9wciNMn9a_0 2024-09-12T18:01:49.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.821+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1506207618591086710', time=2024-09-12T19:54:14.461233+0000, chain.objs.size()=1 2024-09-12T18:01:49.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.821+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.OX6peLekKJ_9k9FP8c7e5yc-gcVuwyt_0 2024-09-12T18:01:49.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.821+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12454797088364046140', time=2024-09-12T19:54:14.626733+0000, chain.objs.size()=1 2024-09-12T18:01:49.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.821+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.5oSdPVHNDZx07lgyoQed8SAimeefndT_0 2024-09-12T18:01:49.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.821+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2583259884803592120', time=2024-09-12T19:54:14.633406+0000, chain.objs.size()=1 2024-09-12T18:01:49.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.821+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.zA0zTzlyiGp_SnHBoG21gsv1Pq9k2ey_0 2024-09-12T18:01:49.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.821+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10740785993568083613', time=2024-09-12T19:54:14.733913+0000, chain.objs.size()=1 2024-09-12T18:01:49.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.821+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.yMOJiyA7HYOzQT02KDWIkJZDvTpyDlc_0 2024-09-12T18:01:49.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.821+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13319699315979513501', time=2024-09-12T19:54:14.892072+0000, chain.objs.size()=1 2024-09-12T18:01:49.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.821+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.yhSuPTtFIKxy-piBbBLQx5PG1lniZk1_0 2024-09-12T18:01:49.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.822+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2662049097280941389', time=2024-09-12T19:54:14.916592+0000, chain.objs.size()=1 2024-09-12T18:01:49.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.822+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.jy6eaOjsaADsaXq1EiU8b9UvuJ0dPz2_0 2024-09-12T18:01:49.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.822+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9942358946689151532', time=2024-09-12T19:54:18.602094+0000, chain.objs.size()=1 2024-09-12T18:01:49.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.822+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.281__shadow_.3-RqWXCenPHF4-ixMDGEhA0joDMggy9_0 2024-09-12T18:01:49.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.822+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7978917317099775283', time=2024-09-12T19:54:19.709140+0000, chain.objs.size()=1 2024-09-12T18:01:49.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.822+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.286__shadow_.vnXQWm9A3COz5wRbzD8LXcLxHwhkrlV_0 2024-09-12T18:01:49.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.822+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13487344726985893218', time=2024-09-12T19:54:24.176001+0000, chain.objs.size()=1 2024-09-12T18:01:49.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.822+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.303__shadow_.5iRdSGDvMZd-g5Qk1iuI1tQSCDoaNG0_0 2024-09-12T18:01:49.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.822+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10302853796100068062', time=2024-09-12T19:54:24.580872+0000, chain.objs.size()=1 2024-09-12T18:01:49.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.822+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.305__shadow_.A84HvKRDBksPGdAy2ooS4IZ4Br4Jp-s_0 2024-09-12T18:01:49.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.822+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11061849176251249458', time=2024-09-12T19:54:27.876791+0000, chain.objs.size()=1 2024-09-12T18:01:49.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.822+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.322__shadow_.xH4_zGrP-c0MEnYmv1YuPWDr37DN3Ia_0 2024-09-12T18:01:49.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.823+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13605180473459735346', time=2024-09-12T19:54:35.763387+0000, chain.objs.size()=1 2024-09-12T18:01:49.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.823+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Va_N0OlrDAvtGv51DcprlOBCDZcWw1S_0 2024-09-12T18:01:49.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.823+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14071653087242414067', time=2024-09-12T19:54:35.787313+0000, chain.objs.size()=1 2024-09-12T18:01:49.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.823+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.tdsSV9lJfsNvJHKac5in2GmJo6L5ju3_0 2024-09-12T18:01:49.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.823+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17826440114023098305', time=2024-09-12T19:54:35.807551+0000, chain.objs.size()=1 2024-09-12T18:01:49.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.823+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.BrXs3UksF4O4rAmkmRJDIkCUvbmruHq_0 2024-09-12T18:01:49.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.823+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8420368477530309608', time=2024-09-12T19:54:35.812568+0000, chain.objs.size()=1 2024-09-12T18:01:49.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.823+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.v_Hb92J1kzPcl5h2Y2CQlPYUg82o72U_0 2024-09-12T18:01:49.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.824+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.585373672953791429', time=2024-09-12T19:54:35.945305+0000, chain.objs.size()=1 2024-09-12T18:01:49.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.824+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.npoXqFxibJ1mtpFsekXPLuec50IwAsN_0 2024-09-12T18:01:49.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.824+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15663203512016170727', time=2024-09-12T19:54:35.948485+0000, chain.objs.size()=1 2024-09-12T18:01:49.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.824+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.yJmz-jI6Hv3vhoDBBi_4cQABEjx94kD_0 2024-09-12T18:01:49.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.824+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8423300081938895646', time=2024-09-12T19:54:35.963606+0000, chain.objs.size()=1 2024-09-12T18:01:49.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.824+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Rqx7BEIWsFxwGlo4OS5Gd1j7wl240V2_0 2024-09-12T18:01:49.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.826+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17214295094825450948', time=2024-09-12T19:54:35.967588+0000, chain.objs.size()=1 2024-09-12T18:01:49.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.826+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Fm_uwXLl79PZd-8IgcrRlm8gQX-v4ac_0 2024-09-12T18:01:49.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.826+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10757288413555160507', time=2024-09-12T19:54:35.993074+0000, chain.objs.size()=1 2024-09-12T18:01:49.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.826+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.J-h43l_U-zGJ0znfDBKhL-9nWrr7SZd_0 2024-09-12T18:01:49.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.826+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17653891942302213456', time=2024-09-12T19:54:36.005289+0000, chain.objs.size()=1 2024-09-12T18:01:49.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.826+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ckAzpr8ubVN7if201uPzu-DegYJ6VAe_0 2024-09-12T18:01:49.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.828+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3532725629342310273', time=2024-09-12T19:54:36.087971+0000, chain.objs.size()=1 2024-09-12T18:01:49.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.828+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.OwRPlK9Pm7OLE4Onk1WaeKi4hMEMqOz_0 2024-09-12T18:01:49.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.828+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3627620358625495717', time=2024-09-12T19:54:36.112262+0000, chain.objs.size()=1 2024-09-12T18:01:49.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.828+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1yqFnDkWeGRCGUOfJzE-KBpsilgkQa1_0 2024-09-12T18:01:49.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.828+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8616698361329240187', time=2024-09-12T19:54:36.140175+0000, chain.objs.size()=1 2024-09-12T18:01:49.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.828+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.HVuorjEeptZDQcpjykVKVzX3hfjMy_i_0 2024-09-12T18:01:49.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.829+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8653942292035352210', time=2024-09-12T19:54:36.140926+0000, chain.objs.size()=1 2024-09-12T18:01:49.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.829+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ggcRJ262dPoXqrt9ksA8DAAu-rGPuLf_0 2024-09-12T18:01:49.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.829+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12845941171617083592', time=2024-09-12T19:54:36.168024+0000, chain.objs.size()=1 2024-09-12T18:01:49.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.829+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.92ROiJf8L0bRm5xCmQW_LRQjTTE3J9M_0 2024-09-12T18:01:49.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.829+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8755626217298590577', time=2024-09-12T19:54:36.252843+0000, chain.objs.size()=1 2024-09-12T18:01:49.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.829+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.7APnApUURda-35nCx8Yv9rJI2qp017W_0 2024-09-12T18:01:49.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.829+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13363635953322824704', time=2024-09-12T19:54:36.264759+0000, chain.objs.size()=1 2024-09-12T18:01:49.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.829+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.TCc7aA7v0Vb1reUnMNl_lWvQLQ8qT_4_0 2024-09-12T18:01:49.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.829+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10956021152791090858', time=2024-09-12T19:54:36.428377+0000, chain.objs.size()=1 2024-09-12T18:01:49.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.829+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ho4G-xiWYrBnZGgPxMbm38r8nWNEBDg_0 2024-09-12T18:01:49.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.831+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14438143624773431437', time=2024-09-12T19:54:36.429395+0000, chain.objs.size()=1 2024-09-12T18:01:49.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.831+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.pWcfzds-TxzvC0EB7vxaFd4B3NdRa0g_0 2024-09-12T18:01:49.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.831+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1720580017359550334', time=2024-09-12T19:54:36.451362+0000, chain.objs.size()=1 2024-09-12T18:01:49.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.831+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.RRrymHzlz2B5dSqVHMY2eIPjxar__CE_0 2024-09-12T18:01:49.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.831+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8335698852609659280', time=2024-09-12T19:54:36.452125+0000, chain.objs.size()=1 2024-09-12T18:01:49.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.831+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-cseYNU4F7SIw6xNtjLEirFiN3JAl41_0 2024-09-12T18:01:49.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.834+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13800321827427869951', time=2024-09-12T19:54:36.453834+0000, chain.objs.size()=1 2024-09-12T18:01:49.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.834+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.OPILX57veI1HeWwkBetkilkZMdoca-3_0 2024-09-12T18:01:49.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.834+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8995957779787052370', time=2024-09-12T19:54:36.465021+0000, chain.objs.size()=1 2024-09-12T18:01:49.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.834+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-5RhEJdozHlY7RIFqtaQYcvsbXxFK-o_0 2024-09-12T18:01:49.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.834+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4925042068946902306', time=2024-09-12T19:54:36.467965+0000, chain.objs.size()=1 2024-09-12T18:01:49.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.834+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.UdViE2ZbK5-nXmveSp8HjL7gd2vUWSM_0 2024-09-12T18:01:49.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.834+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15240556664423432532', time=2024-09-12T19:54:36.493839+0000, chain.objs.size()=1 2024-09-12T18:01:49.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.834+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_._5nu66aAXzhLn-_fUwCGqH6Gw7J3Koo_0 2024-09-12T18:01:49.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.834+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6768132638469180791', time=2024-09-12T19:54:36.503074+0000, chain.objs.size()=1 2024-09-12T18:01:49.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.834+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.6g4KMJCZdiEFZS_CFo1Q4vMPDRJM5ow_0 2024-09-12T18:01:49.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.834+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14285806505389668475', time=2024-09-12T19:54:36.589248+0000, chain.objs.size()=1 2024-09-12T18:01:49.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.834+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.AadPCOMhBlbQ1RQ9K0Bd6vFBIQF6VeH_0 2024-09-12T18:01:49.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.834+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2448936155988218617', time=2024-09-12T19:54:36.595535+0000, chain.objs.size()=1 2024-09-12T18:01:49.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.834+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.mIvsWVGj5P2GX2QPsaivzOZOHENltif_0 2024-09-12T18:01:49.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.834+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2906487254018412223', time=2024-09-12T19:54:36.633118+0000, chain.objs.size()=1 2024-09-12T18:01:49.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.834+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.RF1jsFmQrqm-hBtJ5-TM9sjg1tEuuzr_0 2024-09-12T18:01:49.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.836+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6673574345196980945', time=2024-09-12T19:54:36.643948+0000, chain.objs.size()=1 2024-09-12T18:01:49.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.836+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0dADlXfgBAx_LpdI93Vh8Js9ep-CgUK_0 2024-09-12T18:01:49.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.836+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13932248756757521143', time=2024-09-12T19:54:36.648126+0000, chain.objs.size()=1 2024-09-12T18:01:49.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.836+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.p3g8TSjeYx6FAveCMcgmUXX2mnDiJog_0 2024-09-12T18:01:49.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.836+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17407171263168126252', time=2024-09-12T19:54:36.744241+0000, chain.objs.size()=1 2024-09-12T18:01:49.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.836+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.vH_MtHnjARv2hhVmjvKIcZktYBFg7sn_0 2024-09-12T18:01:49.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.836+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8369972111578961095', time=2024-09-12T19:54:36.756242+0000, chain.objs.size()=1 2024-09-12T18:01:49.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.836+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.cO-Z1RLq0jPPbnEb2wtlXFwVaNCY8jU_0 2024-09-12T18:01:49.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.837+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508078826584252129', time=2024-09-12T19:54:36.766135+0000, chain.objs.size()=1 2024-09-12T18:01:49.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.837+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ofC7hwe6k75P-jbRs9Mzdi0UiPQpwOH_0 2024-09-12T18:01:49.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.837+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10411009248338815715', time=2024-09-12T19:54:36.930491+0000, chain.objs.size()=1 2024-09-12T18:01:49.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.837+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-eGLOn68LqEnNbP1U07gez2OKbQyQqf_0 2024-09-12T18:01:49.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.837+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8998242507666633971', time=2024-09-12T19:54:44.473546+0000, chain.objs.size()=1 2024-09-12T18:01:49.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.837+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.GiRJ7hc8h5AA8WEEmRmVvf938as9sov_0 2024-09-12T18:01:49.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.837+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2031180045254949207', time=2024-09-12T19:54:44.495758+0000, chain.objs.size()=1 2024-09-12T18:01:49.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.837+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.hn8SMlNiBAlcVOSY08tpYvoz1TJG5cT_0 2024-09-12T18:01:49.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.839+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15399045674667763001', time=2024-09-12T19:54:44.542795+0000, chain.objs.size()=1 2024-09-12T18:01:49.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.839+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.1oH7auv91XAS5m1lXk7PDfqhIJlfi6t_0 2024-09-12T18:01:49.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.839+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11377926058304788018', time=2024-09-12T19:54:44.708459+0000, chain.objs.size()=1 2024-09-12T18:01:49.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.839+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.hSOu1KYlHZNHHAIMbAxMZXsmTQudb38_0 2024-09-12T18:01:49.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.839+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2369013780536769426', time=2024-09-12T19:54:44.710410+0000, chain.objs.size()=1 2024-09-12T18:01:49.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.839+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.GjedvHoh4PPBJC4PcJZ6Z3GObZuEap5_0 2024-09-12T18:01:49.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.841+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13541081257159527372', time=2024-09-12T19:54:44.718906+0000, chain.objs.size()=1 2024-09-12T18:01:49.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.842+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.pkk5cgiD-peKKSDJDXDxNOMbomjxOFQ_0 2024-09-12T18:01:49.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.842+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4120020621559008025', time=2024-09-12T19:54:44.833342+0000, chain.objs.size()=1 2024-09-12T18:01:49.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.842+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.xI6yfpW-67MYC-QJznbFkJ6fCk0KCh2_0 2024-09-12T18:01:49.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.842+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6275388421125596932', time=2024-09-12T19:54:45.029313+0000, chain.objs.size()=1 2024-09-12T18:01:49.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.842+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.3JazkQiB2Z6nhLUYPoeNcmjc4lYx8-s_0 2024-09-12T18:01:49.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.842+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4056054966901990739', time=2024-09-12T19:54:45.198649+0000, chain.objs.size()=1 2024-09-12T18:01:49.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.842+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.xfqpy4ZP4n185kFBKiEJBx_KMQdXt4r_0 2024-09-12T18:01:49.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.842+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6053410705337375018', time=2024-09-12T19:54:45.220036+0000, chain.objs.size()=1 2024-09-12T18:01:49.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.842+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.nmXA3LX5q6tTAyOXocVmcQYeEW1Bdcl_0 2024-09-12T18:01:49.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.842+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17190782408719171146', time=2024-09-12T19:54:45.414827+0000, chain.objs.size()=1 2024-09-12T18:01:49.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.842+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.HCIodAKbkS_64XHcLm4l84lvuTL2wKj_0 2024-09-12T18:01:49.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.842+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10520797913327178858', time=2024-09-12T19:54:45.416611+0000, chain.objs.size()=1 2024-09-12T18:01:49.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.842+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.4jO4x_y_Tnx4kkJMnBQsi--jQwn0EZO_0 2024-09-12T18:01:49.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.842+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16550388616653414350', time=2024-09-12T19:54:45.434822+0000, chain.objs.size()=1 2024-09-12T18:01:49.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.842+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.w7Nbl34Y5p4Z26VaQg3RlSjK1InxCV6_0 2024-09-12T18:01:49.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.844+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1438502654540053326', time=2024-09-12T19:54:45.513580+0000, chain.objs.size()=1 2024-09-12T18:01:49.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.844+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.DqmOWRY1ua0iAkoP2pOmzNaBDb1dypq_0 2024-09-12T18:01:49.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.844+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9869156226858069412', time=2024-09-12T19:54:45.550174+0000, chain.objs.size()=1 2024-09-12T18:01:49.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.844+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jAr9tVduiFD3Bi5b8RnYc_N023B-Je0_0 2024-09-12T18:01:49.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.844+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4994408691538534812', time=2024-09-12T19:54:45.553160+0000, chain.objs.size()=1 2024-09-12T18:01:49.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.844+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.LeGhS4zbebMHM4dHfWtWter1IlgPD3l_0 2024-09-12T18:01:49.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.847+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12186556921374264626', time=2024-09-12T19:54:45.556558+0000, chain.objs.size()=1 2024-09-12T18:01:49.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.847+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.01A5YGvQocegpi70JWRJm9kjnjTJ69e_0 2024-09-12T18:01:49.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.847+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9384585248061576476', time=2024-09-12T19:54:45.566638+0000, chain.objs.size()=1 2024-09-12T18:01:49.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.847+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.l8cVGAxAekR2pcRTl6IFYXIrCZWszGV_0 2024-09-12T18:01:49.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.847+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13061032519177254786', time=2024-09-12T19:54:45.599490+0000, chain.objs.size()=1 2024-09-12T18:01:49.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.847+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.tlMOfAeX80n6JRD1moYCnFt9An0kQzW_0 2024-09-12T18:01:49.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.847+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12124713123867455709', time=2024-09-12T19:54:45.674382+0000, chain.objs.size()=1 2024-09-12T18:01:49.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.847+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ucasoRGrHHj4tRWXhwtz-1x2BSkM3Mq_0 2024-09-12T18:01:49.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.847+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.854788778244001880', time=2024-09-12T19:54:45.702398+0000, chain.objs.size()=1 2024-09-12T18:01:49.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.847+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.0uo0IArPFHeGehzDPDRjvcpDZhS7ZWN_0 2024-09-12T18:01:49.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.847+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.300237421226358620', time=2024-09-12T19:54:45.705904+0000, chain.objs.size()=1 2024-09-12T18:01:49.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.847+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.0XZiqBtbH4QKO3spoiHI0ofO_bGpeY5_0 2024-09-12T18:01:49.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.847+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4474351259899241381', time=2024-09-12T19:54:45.712342+0000, chain.objs.size()=1 2024-09-12T18:01:49.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.847+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Q9hjr2Fi5SrJ1zbH1S4KwOQDhiy8VJt_0 2024-09-12T18:01:49.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.847+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10518590358023876265', time=2024-09-12T19:54:45.726858+0000, chain.objs.size()=1 2024-09-12T18:01:49.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.847+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.5Lfmr-CppizB02WjW7-IvbVJ5sG8i2D_0 2024-09-12T18:01:49.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.850+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12459615364263229799', time=2024-09-12T19:54:45.736773+0000, chain.objs.size()=1 2024-09-12T18:01:49.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.850+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TOD9qbw3_cGoke39ZdUiejrfcb-T_9n_0 2024-09-12T18:01:49.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.850+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5130213813411481711', time=2024-09-12T19:54:45.739376+0000, chain.objs.size()=1 2024-09-12T18:01:49.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.850+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.6ohVi1JUIOpkBOcW7OhN8XPmk2IV6np_0 2024-09-12T18:01:49.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.850+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12885552350055201000', time=2024-09-12T19:54:47.451682+0000, chain.objs.size()=1 2024-09-12T18:01:49.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.850+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.334__shadow_.p7Nq1FTnTgueUA-Naciw7gFfPeqL9NX_0 2024-09-12T18:01:49.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.855+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/42945 2024-09-12T18:01:49.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.857+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T18:01:49.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.857+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3016323904904397651', time=2024-09-12T19:55:13.081079+0000, chain.objs.size()=1 2024-09-12T18:01:49.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.857+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.452__shadow_.zZ89ZYBs4MKJIBsn_H_hRNcbZABtj3p_0 2024-09-12T18:01:49.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15816692284352933941', time=2024-09-12T19:55:17.228763+0000, chain.objs.size()=1 2024-09-12T18:01:49.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.465__shadow_.pEqXnoZz11USet2VDsENDjf6T3FpTrN_0 2024-09-12T18:01:49.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14146930943203849088', time=2024-09-12T19:55:30.405222+0000, chain.objs.size()=1 2024-09-12T18:01:49.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.519__multipart_mymultipart.2~Rav5xhI14arm6UDmmPQuDEqOx8NAzcA.1 2024-09-12T18:01:49.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17095206797237324816', time=2024-09-12T19:56:13.902978+0000, chain.objs.size()=1 2024-09-12T18:01:49.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.559__shadow_.WO9BHisB5nw9O0-EwcBJis26ya6egZL_0 2024-09-12T18:01:49.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7651103724442238148', time=2024-09-12T19:56:23.070965+0000, chain.objs.size()=1 2024-09-12T18:01:49.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:2zkDytlMgYZ9nGGi5I3A2Ezy.0dCLkH_.HEuZnJp-Zs0agNVBmPfD0StL8Uajz9K_0 2024-09-12T18:01:49.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3715477492698713375', time=2024-09-12T19:56:32.934799+0000, chain.objs.size()=1 2024-09-12T18:01:49.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.577__shadow:a6d4bPkwXksaxKYgVdrah6fG-7JV9Xp_.8JeK_Zj8XbLpf6qLopyCTaOS3SPUTYC_0 2024-09-12T18:01:49.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8541425801103905458', time=2024-09-12T19:56:38.372922+0000, chain.objs.size()=1 2024-09-12T18:01:49.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:ll91EeA1H6u2GPfy3iFOxnuCQm0ORMX_.AcGOiGvKvRjdbp5gQ2yNqagFfKY-iSA_0 2024-09-12T18:01:49.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8988094421260345247', time=2024-09-12T19:56:41.113715+0000, chain.objs.size()=1 2024-09-12T18:01:49.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:fQExGiE2KpvjWD5XxP6yTpcb4ZlTN79_.jo2KV6RIg0FyRs6LPWkzDx7JK0hAyx3_0 2024-09-12T18:01:49.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2868853017252434291', time=2024-09-12T19:56:52.811916+0000, chain.objs.size()=1 2024-09-12T18:01:49.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.587__shadow:tKCw6KH2cv9A9yaLmxzYtDS3A9bVSp6_.JBlHcFEb233K7MP9717ZRxGk0YD7M0u_0 2024-09-12T18:01:49.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9516873814320012414', time=2024-09-12T19:59:03.620241+0000, chain.objs.size()=1 2024-09-12T18:01:49.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.621__shadow_.9IikbVSBsjOzMNFQz2rrFth0rvhgP5j_0 2024-09-12T18:01:49.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13026956158081987182', time=2024-09-12T19:59:17.159793+0000, chain.objs.size()=1 2024-09-12T18:01:49.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.664__shadow_.-DUGeW-mRH1ZRWvI6kmyZBoQCg9uCVF_0 2024-09-12T18:01:49.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14959399275765547971', time=2024-09-12T19:59:18.346474+0000, chain.objs.size()=1 2024-09-12T18:01:49.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.858+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.667__shadow_.PWKhJJmsSikCn16QzVu-PLK5aP2YZmv_0 2024-09-12T18:01:49.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.861+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:49.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.867+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:01:49.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.868+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:49.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.868+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:49.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42355' 2024-09-12T18:01:49.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9172607007353261167', time=2024-09-12T19:52:49.940101+0000, chain.objs.size()=1 2024-09-12T18:01:49.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.149__shadow_.QCJxixnI1zhpnuWDe32bA6AmewW2DGt_0 2024-09-12T18:01:49.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='_xyQcqBTT19wGTcDiLyY3qOI9H_YRR4H', time=2024-09-12T19:52:57.466392+0000, chain.objs.size()=2 2024-09-12T18:01:49.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__shadow_.8rFRW2axzRlGWRoINyEzvxyI2tbqTGb_0 2024-09-12T18:01:49.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__shadow_.8rFRW2axzRlGWRoINyEzvxyI2tbqTGb_1 2024-09-12T18:01:49.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15789584701815634544', time=2024-09-12T19:54:00.326677+0000, chain.objs.size()=1 2024-09-12T18:01:49.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.235__shadow_.M3Jq9dGIc9zpm6DyvNjri_qbI0wzaVB_0 2024-09-12T18:01:49.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16013443262925708284', time=2024-09-12T19:54:03.216208+0000, chain.objs.size()=1 2024-09-12T18:01:49.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.248__shadow_.BK0vjDq3TMKSeVSGk3-6O56okz2ORgH_0 2024-09-12T18:01:49.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10044579534463111858', time=2024-09-12T19:54:03.618018+0000, chain.objs.size()=1 2024-09-12T18:01:49.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.250__shadow_.iBN-ghM4Y40RRyMKYiyyOD6EW_I9zrz_0 2024-09-12T18:01:49.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5418145107846193835', time=2024-09-12T19:54:05.709220+0000, chain.objs.size()=1 2024-09-12T18:01:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.260__shadow_.NLOhljAuYb2mnbfUtB8weYsrfKnamqd_0 2024-09-12T18:01:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11170887367141254991', time=2024-09-12T19:54:13.484722+0000, chain.objs.size()=1 2024-09-12T18:01:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_._DjXj0BT87Q8CFITBLVSDiP0qsDWkWl_0 2024-09-12T18:01:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13206237972093706297', time=2024-09-12T19:54:13.485723+0000, chain.objs.size()=1 2024-09-12T18:01:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.xSxhavJ0NHlmZ4EZW1kdlRcarQLvVTu_0 2024-09-12T18:01:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12823120805296894160', time=2024-09-12T19:54:13.565979+0000, chain.objs.size()=1 2024-09-12T18:01:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.1UoFrVuVrjxlOw_DoYCrd4negi-naUm_0 2024-09-12T18:01:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17112707515022552779', time=2024-09-12T19:54:13.567834+0000, chain.objs.size()=1 2024-09-12T18:01:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.DmETmb4k4QGt3fV1bEFjRIcdCvljT4r_0 2024-09-12T18:01:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1188870974116726166', time=2024-09-12T19:54:13.659897+0000, chain.objs.size()=1 2024-09-12T18:01:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.869+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.JoVhhIiGpLNUQdxVi2hippZq-QebEPB_0 2024-09-12T18:01:49.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.872+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4741021816660357519', time=2024-09-12T19:54:13.663586+0000, chain.objs.size()=1 2024-09-12T18:01:49.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.872+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_._NJjURvASOk3Ae-XuJN2uqCWltwAlJ5_0 2024-09-12T18:01:49.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.300024206643865709', time=2024-09-12T19:54:13.689615+0000, chain.objs.size()=1 2024-09-12T18:01:49.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.hxHQvVDq6kDgnaA7il3UAyEeszTsbbH_0 2024-09-12T18:01:49.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12990154167936616194', time=2024-09-12T19:54:13.693457+0000, chain.objs.size()=1 2024-09-12T18:01:49.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.9Fg0j0LXSvLfSWSFispBgZw_ftKQPlx_0 2024-09-12T18:01:49.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6697937860245287500', time=2024-09-12T19:54:13.833644+0000, chain.objs.size()=1 2024-09-12T18:01:49.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.QbOYTjCdfjQHoKHusr0t3kFgjZkwmqF_0 2024-09-12T18:01:49.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.943023653351918138', time=2024-09-12T19:54:13.868191+0000, chain.objs.size()=1 2024-09-12T18:01:49.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.NJFShrK1ZyF6DTYzK_j5bmdVT9xTQj5_0 2024-09-12T18:01:49.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.602940529457970886', time=2024-09-12T19:54:13.881855+0000, chain.objs.size()=1 2024-09-12T18:01:49.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.SVivXnVGfYlOZ1mAyyqc9vnWdZZNLid_0 2024-09-12T18:01:49.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9926289971751023605', time=2024-09-12T19:54:13.892399+0000, chain.objs.size()=1 2024-09-12T18:01:49.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.mxEwn5zmO7RwYchNrG17-VnGkIS6bcz_0 2024-09-12T18:01:49.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13852900972969811603', time=2024-09-12T19:54:14.060049+0000, chain.objs.size()=1 2024-09-12T18:01:49.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.MbpLUXn3Zb__MzWgXIBq0eXBSDCKdfn_0 2024-09-12T18:01:49.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2512856217063118260', time=2024-09-12T19:54:14.291668+0000, chain.objs.size()=1 2024-09-12T18:01:49.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.k_qbPnKBDei6bb9wiQYvOIeM2Q6Gl5a_0 2024-09-12T18:01:49.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4580353314648610648', time=2024-09-12T19:54:14.295300+0000, chain.objs.size()=1 2024-09-12T18:01:49.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.dH1d6WFYl2wqcqXvy4VeuA9P06XUrgA_0 2024-09-12T18:01:49.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2636707397923743369', time=2024-09-12T19:54:14.391793+0000, chain.objs.size()=1 2024-09-12T18:01:49.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.874+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.xGxF2cYfX--6vWq_4Q8aDmeHxWK_E2r_0 2024-09-12T18:01:49.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.876+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6291688291017430513', time=2024-09-12T19:54:14.425809+0000, chain.objs.size()=1 2024-09-12T18:01:49.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.876+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.eOiomgbTMFQnYgDEMHr6HBEtHtyYEAa_0 2024-09-12T18:01:49.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9174508846639558327', time=2024-09-12T19:54:14.426768+0000, chain.objs.size()=1 2024-09-12T18:01:49.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.LNlwn09_sFqzA7MPwz-u0FauLxjaDrz_0 2024-09-12T18:01:49.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15919563064396598136', time=2024-09-12T19:54:14.552924+0000, chain.objs.size()=1 2024-09-12T18:01:49.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.DIkZo_aJaGikOHp0W7dpSH5YYAabRGL_0 2024-09-12T18:01:49.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12225180213096427109', time=2024-09-12T19:54:14.596856+0000, chain.objs.size()=1 2024-09-12T18:01:49.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.3l5_loWctnpVCuamDqYfJBU15CS8ALw_0 2024-09-12T18:01:49.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16568535450752469582', time=2024-09-12T19:54:14.636546+0000, chain.objs.size()=1 2024-09-12T18:01:49.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ER6OLflKEbT0Mj4NfgErKxVIE1_PVoo_0 2024-09-12T18:01:49.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9329001691403207534', time=2024-09-12T19:54:14.713054+0000, chain.objs.size()=1 2024-09-12T18:01:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.cOKi-4z3xbDpX_y-xTK79OZQcWQ2g3n_0 2024-09-12T18:01:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12859574666291296159', time=2024-09-12T19:54:14.777637+0000, chain.objs.size()=1 2024-09-12T18:01:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.RT1yyQ67Gmv3bYUdENjrRy6bGk_plCl_0 2024-09-12T18:01:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9570109671942999630', time=2024-09-12T19:54:14.880279+0000, chain.objs.size()=1 2024-09-12T18:01:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.oT9o4lniOSvOqk_FjHaDY3mVgSKdKzA_0 2024-09-12T18:01:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7958576517080284042', time=2024-09-12T19:54:14.893824+0000, chain.objs.size()=1 2024-09-12T18:01:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.HgLfnIx80qwk_QmcKONwsQPGdaAf93Z_0 2024-09-12T18:01:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12762740999651504786', time=2024-09-12T19:54:14.899807+0000, chain.objs.size()=1 2024-09-12T18:01:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.s31fvk6Fx5Q5kYNdqb0iq0EKFq5PziP_0 2024-09-12T18:01:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9636638029085768902', time=2024-09-12T19:54:14.901268+0000, chain.objs.size()=1 2024-09-12T18:01:49.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.I6c2lwfVeH0tmTwlJDxM9kWo24fMinC_0 2024-09-12T18:01:49.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2354947098513645446', time=2024-09-12T19:54:14.911395+0000, chain.objs.size()=1 2024-09-12T18:01:49.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.879+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2J0SMXpxTcqmZ5I1JZ6vqjTLcTqckGW_0 2024-09-12T18:01:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7128177943020235407', time=2024-09-12T19:54:14.939683+0000, chain.objs.size()=1 2024-09-12T18:01:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.S-SUnpxrf9_vdWg3q2_MTxnzCIMaBL__0 2024-09-12T18:01:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7362693006973878327', time=2024-09-12T19:54:18.848581+0000, chain.objs.size()=1 2024-09-12T18:01:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.282__shadow_.Kd_DwwTf0umtfQHLF_OwfIVzLG16twS_0 2024-09-12T18:01:49.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14502564796489070430', time=2024-09-12T19:54:19.259969+0000, chain.objs.size()=1 2024-09-12T18:01:49.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.284__shadow_.5UICQtM6N0ID66DkoPpatjGt7a6CW6Q_0 2024-09-12T18:01:49.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6491996189623230405', time=2024-09-12T19:54:20.197322+0000, chain.objs.size()=1 2024-09-12T18:01:49.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.288__shadow_.Ky_Vm-H0lEkoK4-LthInLCmnhWrx-Su_0 2024-09-12T18:01:49.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17951353309020298187', time=2024-09-12T19:54:20.198177+0000, chain.objs.size()=1 2024-09-12T18:01:49.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.288__shadow_.2eeqDCd-zeyBbueTblhd9CGD0qEjQfw_0 2024-09-12T18:01:49.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5493620293329270926', time=2024-09-12T19:54:21.577726+0000, chain.objs.size()=1 2024-09-12T18:01:49.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.Op0AAW5A9pmjrZI2encccSEgipLbJZb_0 2024-09-12T18:01:49.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17938662957890085484', time=2024-09-12T19:54:22.422067+0000, chain.objs.size()=1 2024-09-12T18:01:49.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.295__shadow_.tIlJov3GRaq9dzNPBCCBQ4PqMkP3l0F_0 2024-09-12T18:01:49.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8170008676340856921', time=2024-09-12T19:54:22.626850+0000, chain.objs.size()=1 2024-09-12T18:01:49.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.296__shadow_.bcPiYfLAp2uiUm1_VqietkzB8H7-gH0_0 2024-09-12T18:01:49.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5923088858648922276', time=2024-09-12T19:54:35.767069+0000, chain.objs.size()=1 2024-09-12T18:01:49.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.dAXB2I2nhljyC7c0nCJtRY-PPxxqY2c_0 2024-09-12T18:01:49.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7330758202050508073', time=2024-09-12T19:54:35.824057+0000, chain.objs.size()=1 2024-09-12T18:01:49.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.I-Y-ZZJm5eN9bMovh5u-ZVdADRWyBMo_0 2024-09-12T18:01:49.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5554710709022092065', time=2024-09-12T19:54:35.920074+0000, chain.objs.size()=1 2024-09-12T18:01:49.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.884+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.oymU9rLcR6nDwj8txYdUrk1t4vEm199_0 2024-09-12T18:01:49.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.886+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1797142312669512762', time=2024-09-12T19:54:35.929012+0000, chain.objs.size()=1 2024-09-12T18:01:49.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.886+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.67O2HeKTzlv6Wt-Dz0XEYsuzKRYv2pW_0 2024-09-12T18:01:49.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.886+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14857120312486756940', time=2024-09-12T19:54:35.939439+0000, chain.objs.size()=1 2024-09-12T18:01:49.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.886+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.yE71hOxtQeJPrt3P9Sy2V7mfIk-FknV_0 2024-09-12T18:01:49.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.886+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13822746213992013454', time=2024-09-12T19:54:35.956511+0000, chain.objs.size()=1 2024-09-12T18:01:49.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.886+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.MvIK0-aAu9nlh2IN6owTNmSrSj6PPgY_0 2024-09-12T18:01:49.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.886+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14538865059661072057', time=2024-09-12T19:54:35.969382+0000, chain.objs.size()=1 2024-09-12T18:01:49.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.886+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.U99lL3JOrlrDp9uJzmhok5_phLOjIZG_0 2024-09-12T18:01:49.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.887+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5017115510919772322', time=2024-09-12T19:54:36.007373+0000, chain.objs.size()=1 2024-09-12T18:01:49.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.887+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Ql3h7zJGT56yT4xmBst-QJa_SgDZqVr_0 2024-09-12T18:01:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.889+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17139959903515414772', time=2024-09-12T19:54:36.107208+0000, chain.objs.size()=1 2024-09-12T18:01:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.889+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.MsaEso1Fs1rgWsNjmNPt2c91lYgy0zG_0 2024-09-12T18:01:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.889+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7509371634463686409', time=2024-09-12T19:54:36.118588+0000, chain.objs.size()=1 2024-09-12T18:01:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.889+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.LX0Ch7_B58WuP-q-GZyXePDdqEFTgJ5_0 2024-09-12T18:01:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.889+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16094178278318645335', time=2024-09-12T19:54:36.120386+0000, chain.objs.size()=1 2024-09-12T18:01:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.889+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.KPvXWqchOZS9ntWLRznoUTu99epKt3-_0 2024-09-12T18:01:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.889+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17878979363301590510', time=2024-09-12T19:54:36.158037+0000, chain.objs.size()=1 2024-09-12T18:01:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.889+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.BaTRLtWBuxwDvsL5Jpd0BwUapAmLRsw_0 2024-09-12T18:01:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.889+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5432603910567049703', time=2024-09-12T19:54:36.274523+0000, chain.objs.size()=1 2024-09-12T18:01:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.889+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-UpeCNPkHIjQsabjjAr245xBkm1-WBN_0 2024-09-12T18:01:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.889+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10891682782250434992', time=2024-09-12T19:54:36.281632+0000, chain.objs.size()=1 2024-09-12T18:01:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.889+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.e4MyeHrVxq94E05l-GJ09FgAfamxtwk_0 2024-09-12T18:01:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.889+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2932515000312877400', time=2024-09-12T19:54:36.294065+0000, chain.objs.size()=1 2024-09-12T18:01:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.889+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.SYwgnrJeeh-vwh0dLMIxcAWnFBj7zFr_0 2024-09-12T18:01:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.889+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4739854074633963391', time=2024-09-12T19:54:36.294600+0000, chain.objs.size()=1 2024-09-12T18:01:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.889+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.t8ja0y9NgA5-s7SXQxJtfMcsrRwDPBJ_0 2024-09-12T18:01:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.890+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2888524329710668264', time=2024-09-12T19:54:36.326429+0000, chain.objs.size()=1 2024-09-12T18:01:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.890+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.vW55AI0IN84akoG4Fmioi9DLuSyc7rD_0 2024-09-12T18:01:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.890+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1791065749682335136', time=2024-09-12T19:54:36.416632+0000, chain.objs.size()=1 2024-09-12T18:01:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.890+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.oodTpPTGYfY2VwY9x2Mewk-eQlmxzYj_0 2024-09-12T18:01:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.890+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3482707998718386905', time=2024-09-12T19:54:36.439038+0000, chain.objs.size()=1 2024-09-12T18:01:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.890+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.MgrmTRlBmoxDfoqyIjE4Hb8s3JfSmDG_0 2024-09-12T18:01:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.891+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12125862395242453584', time=2024-09-12T19:54:36.637861+0000, chain.objs.size()=1 2024-09-12T18:01:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.891+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.GaRZoTRveZag8IsKNdXucpGsGiu4ysb_0 2024-09-12T18:01:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.891+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12666865453223855693', time=2024-09-12T19:54:36.655502+0000, chain.objs.size()=1 2024-09-12T18:01:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.891+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.AJ6j5zaGXGZn4mjSdrKuQyyNuGWIk0w_0 2024-09-12T18:01:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.891+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15448750015040583205', time=2024-09-12T19:54:36.669445+0000, chain.objs.size()=1 2024-09-12T18:01:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.891+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.lhpVcJPbnmVJogsLwZ5RvC4BlZJgBQT_0 2024-09-12T18:01:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.891+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1716499852398616364', time=2024-09-12T19:54:36.755271+0000, chain.objs.size()=1 2024-09-12T18:01:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.891+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ueH7fErzbSgTOSjh2c0wkNw2Oz97qt3_0 2024-09-12T18:01:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.891+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5238422510776477852', time=2024-09-12T19:54:36.797462+0000, chain.objs.size()=1 2024-09-12T18:01:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.891+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.adlabUGmqB214t9BtXyO8wLgryET0aw_0 2024-09-12T18:01:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.892+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2508006864684896044', time=2024-09-12T19:54:36.798942+0000, chain.objs.size()=1 2024-09-12T18:01:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.892+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_._0usEiaibLIoKGdoiiTnxef5OhfhIP2_0 2024-09-12T18:01:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.892+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1270327072916804263', time=2024-09-12T19:54:36.917720+0000, chain.objs.size()=1 2024-09-12T18:01:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.892+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QV_Cw2yub5jFRUFQkevvgMDnjVyC32i_0 2024-09-12T18:01:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.892+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8681532879637088520', time=2024-09-12T19:54:36.967543+0000, chain.objs.size()=1 2024-09-12T18:01:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.892+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.jKVQI1W08NVNt9xd9K_4YVojS1Ytptn_0 2024-09-12T18:01:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.892+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17194023214537997836', time=2024-09-12T19:54:44.466034+0000, chain.objs.size()=1 2024-09-12T18:01:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.892+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.DZ1x3A1ISXURkWa_Qdc7P3IpZJ_8aZD_0 2024-09-12T18:01:49.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8023019238962968890', time=2024-09-12T19:54:44.541102+0000, chain.objs.size()=1 2024-09-12T18:01:49.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.UPOMhybuoa7Q8kGFBMMUJUndSacG9ce_0 2024-09-12T18:01:49.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4110895258621005986', time=2024-09-12T19:54:44.652648+0000, chain.objs.size()=1 2024-09-12T18:01:49.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.IJmKY7qLqcAySF4J3zWokqEtXig8qxb_0 2024-09-12T18:01:49.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.565383976373379776', time=2024-09-12T19:54:44.654425+0000, chain.objs.size()=1 2024-09-12T18:01:49.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.XfjKYdL4O81ioTq14sh4bwrnyjVgXT9_0 2024-09-12T18:01:49.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8211480719756628249', time=2024-09-12T19:54:44.677455+0000, chain.objs.size()=1 2024-09-12T18:01:49.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Htm6aJn-Zxe5B-l3SB9ggPS-cWGVKdh_0 2024-09-12T18:01:49.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2285535507262510314', time=2024-09-12T19:54:44.693191+0000, chain.objs.size()=1 2024-09-12T18:01:49.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.e-6Y_wopAl2DVA8uL0mOy48ZvSoRdv4_0 2024-09-12T18:01:49.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13752552713530889698', time=2024-09-12T19:54:44.694212+0000, chain.objs.size()=1 2024-09-12T18:01:49.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.vBxVUCXE3Ko54m0Ml6uhRHKUrmInZCq_0 2024-09-12T18:01:49.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9055289006058684133', time=2024-09-12T19:54:44.700702+0000, chain.objs.size()=1 2024-09-12T18:01:49.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.V721orb4rQ9Qzx7cE3pfInWLZoIc1Ed_0 2024-09-12T18:01:49.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9430557932732011880', time=2024-09-12T19:54:44.857554+0000, chain.objs.size()=1 2024-09-12T18:01:49.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Ux1l8hUz8QHetObZ1y3PfO8lfirbn77_0 2024-09-12T18:01:49.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15672171813213524899', time=2024-09-12T19:54:44.887840+0000, chain.objs.size()=1 2024-09-12T18:01:49.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.umMxN25oHDxJotG6LiNw_RwZWBAPZpc_0 2024-09-12T18:01:49.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4086109282988567559', time=2024-09-12T19:54:44.991599+0000, chain.objs.size()=1 2024-09-12T18:01:49.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.CalR-hPTlVAiD7NOg6jqZfSRYFcr1Iz_0 2024-09-12T18:01:49.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.190683935455104866', time=2024-09-12T19:54:45.014399+0000, chain.objs.size()=1 2024-09-12T18:01:49.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.894+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.p_Z3tGW5zelkuuPX12U4M5SZPYVcD_4_0 2024-09-12T18:01:49.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.895+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1204745716228865249', time=2024-09-12T19:54:45.193831+0000, chain.objs.size()=1 2024-09-12T18:01:49.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.895+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.AL84zZI5nzJPDwHk1CFwtj7NTdH4NpT_0 2024-09-12T18:01:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9400158405947581698', time=2024-09-12T19:54:45.198659+0000, chain.objs.size()=1 2024-09-12T18:01:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.6zditu0OFJgKt9BNKQmJEb9ee0Prv-m_0 2024-09-12T18:01:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6460584449237730520', time=2024-09-12T19:54:45.199526+0000, chain.objs.size()=1 2024-09-12T18:01:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.zZMAUyvJyArechLA-OW2ZqxLf8Hjben_0 2024-09-12T18:01:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9507473601389032717', time=2024-09-12T19:54:45.348055+0000, chain.objs.size()=1 2024-09-12T18:01:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.L7NMl3z1e92jEj9NNVIvpER1QwCJRzV_0 2024-09-12T18:01:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.505633177905708620', time=2024-09-12T19:54:45.382426+0000, chain.objs.size()=1 2024-09-12T18:01:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.PwViKzrj0bnZu4UToFlCo3v6s3syOpI_0 2024-09-12T18:01:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12199949805802705361', time=2024-09-12T19:54:45.393613+0000, chain.objs.size()=1 2024-09-12T18:01:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.HHLhZYKCbFGTaW20zBwjcYnYWT-9DM5_0 2024-09-12T18:01:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8719070025760085869', time=2024-09-12T19:54:45.411090+0000, chain.objs.size()=1 2024-09-12T18:01:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.GwlWUqkn28WhOuSbgv1k00LaGRWdea4_0 2024-09-12T18:01:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10945849242014776552', time=2024-09-12T19:54:45.508122+0000, chain.objs.size()=1 2024-09-12T18:01:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.CjVUJXWzB4tWbf4Iu4h85f0voGGQLwU_0 2024-09-12T18:01:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11036113313923371941', time=2024-09-12T19:54:45.521796+0000, chain.objs.size()=1 2024-09-12T18:01:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.VGTckvv3W0N_wqFT8U3IIDci01MVGPg_0 2024-09-12T18:01:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13861608056507030149', time=2024-09-12T19:54:45.526387+0000, chain.objs.size()=1 2024-09-12T18:01:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.PEM3mLsCrSAgyeU1OvXs3cksBk8nQLZ_0 2024-09-12T18:01:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16375750591981572191', time=2024-09-12T19:54:45.551320+0000, chain.objs.size()=1 2024-09-12T18:01:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.qvBso1eqFVb6lznIlj4RsJD7vAeFL2X_0 2024-09-12T18:01:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5414434274308184517', time=2024-09-12T19:54:45.565392+0000, chain.objs.size()=1 2024-09-12T18:01:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.rLjRH2RHBlyitW8uPpZoE52WRJ4Peaq_0 2024-09-12T18:01:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.901+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17527233604684270465', time=2024-09-12T19:54:45.580394+0000, chain.objs.size()=1 2024-09-12T18:01:49.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.901+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Ebg4wEhM6O4Vkbsg7aA7iHfawJOiTcr_0 2024-09-12T18:01:49.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.901+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15082324875340861044', time=2024-09-12T19:54:58.876771+0000, chain.objs.size()=1 2024-09-12T18:01:49.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.901+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.391__shadow_.GBJxhqATnbDo5tevgnsfhZJWmqEa__s_0 2024-09-12T18:01:49.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.901+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11159120492745893578', time=2024-09-12T19:55:15.085248+0000, chain.objs.size()=1 2024-09-12T18:01:49.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.901+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.459__shadow_.FgHlGSxvKpiHVaqYh732WujgZAHtVcb_0 2024-09-12T18:01:49.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15338814448136232144', time=2024-09-12T19:55:22.092677+0000, chain.objs.size()=1 2024-09-12T18:01:49.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.488__shadow_.-rMaeyptmnqhbEZHnwBFrQ_bDe0tMTw_0 2024-09-12T18:01:49.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~sau2Ft38ToxHdoFOJjTSoH7CtdIsbsf', time=2024-09-12T19:55:41.695341+0000, chain.objs.size()=2 2024-09-12T18:01:49.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.530__multipart_mymultipart.2~sau2Ft38ToxHdoFOJjTSoH7CtdIsbsf.1 2024-09-12T18:01:49.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.530__multipart_mymultipart.2~sau2Ft38ToxHdoFOJjTSoH7CtdIsbsf.2 2024-09-12T18:01:49.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4470944875352987032', time=2024-09-12T19:55:58.971793+0000, chain.objs.size()=1 2024-09-12T18:01:49.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.538__shadow_.hKVsdLkswrsSqLbwYkDg4D7SQsUqK9S_0 2024-09-12T18:01:49.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11759805676425464003', time=2024-09-12T19:56:14.468230+0000, chain.objs.size()=1 2024-09-12T18:01:49.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.560__shadow_.1QTRwR1vWTZPy2hA-wpo9gxeKjdGnQI_0 2024-09-12T18:01:49.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.909+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/42355 2024-09-12T18:01:49.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.911+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:01:49.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.911+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3776712920507140598', time=2024-09-12T19:56:32.478888+0000, chain.objs.size()=1 2024-09-12T18:01:49.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.911+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.577__shadow:DHI30d0fgCVwL3HK0cr0GB2dfOEB5ED_.f1OISVqfbUNCP7EQz5akYUxdef72afn_0 2024-09-12T18:01:49.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.911+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16934043925588794175', time=2024-09-12T19:56:41.261372+0000, chain.objs.size()=1 2024-09-12T18:01:49.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.911+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:4YUXnzSRWTIhJVAxVn--4gGEFP8ctMh_.fv-AfIJqFTGFbgfTdWBdN6Ne3sitsJf_0 2024-09-12T18:01:49.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.911+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10359568548622105172', time=2024-09-12T19:56:47.446523+0000, chain.objs.size()=1 2024-09-12T18:01:49.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.911+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:VfdhLBbHnxe0XkISEvPqh-7PigNaSwR_.pLLWqj6txVPhPrDi5O3ggDQTGi9M6eO_0 2024-09-12T18:01:49.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.911+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14193101633858552451', time=2024-09-12T19:56:50.007815+0000, chain.objs.size()=1 2024-09-12T18:01:49.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.911+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.580__shadow:wCRmQs6klPR8X903LN052RmlcvZ1cra_.ueTFE3yq7wx6NgcoI9T3C6TB7yps_y3_0 2024-09-12T18:01:49.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.911+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14299839020680585225', time=2024-09-12T19:59:06.598918+0000, chain.objs.size()=1 2024-09-12T18:01:49.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.911+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.627__shadow_.T_LtbpIh2o75X5qiVWn61sz2suwmFWt_0 2024-09-12T18:01:49.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.913+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:49.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.915+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:01:49.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.917+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:49.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.917+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:49.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.918+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43163' 2024-09-12T18:01:49.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.918+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11368413423725076965', time=2024-09-12T19:52:54.058075+0000, chain.objs.size()=2 2024-09-12T18:01:49.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.918+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.159__shadow_.0RHEe3UwpYVK4rsl72mJYxqLSBdKz_p_0 2024-09-12T18:01:49.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.918+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.159__shadow_.0RHEe3UwpYVK4rsl72mJYxqLSBdKz_p_1 2024-09-12T18:01:49.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='_SLln4GBatwUaNfBTiDqMNEuhDDmj2p4', time=2024-09-12T19:52:58.503761+0000, chain.objs.size()=1 2024-09-12T18:01:49.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.166__shadow_.O9NyqOoulIkXf9MAzyJNrJidEyFT-6H_0 2024-09-12T18:01:49.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7027238244776536873', time=2024-09-12T19:52:58.586591+0000, chain.objs.size()=1 2024-09-12T18:01:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.167__shadow_.hS_YiIxPdFScZ4sIXfFCHqzCubluHdl_0 2024-09-12T18:01:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4954268643868822576', time=2024-09-12T19:53:04.390547+0000, chain.objs.size()=1 2024-09-12T18:01:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.179__shadow_.M3PljKWQhQG36TSG_I7gsC997g4Qih7_0 2024-09-12T18:01:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17346254878764515780', time=2024-09-12T19:53:05.099528+0000, chain.objs.size()=1 2024-09-12T18:01:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.183__shadow_.8zntECs6vKOmgoYlwjOlwmSEdRS1U7r_0 2024-09-12T18:01:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12712969101061916849', time=2024-09-12T19:53:05.988932+0000, chain.objs.size()=1 2024-09-12T18:01:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.189__shadow_.HdMsZWCcH5CTIRZ-p1q2ctVc3-lRc1k_0 2024-09-12T18:01:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16576264291998301238', time=2024-09-12T19:54:03.007837+0000, chain.objs.size()=1 2024-09-12T18:01:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.247__shadow_.YJMwa1dPQDLIT96ib-zoubUAs7YYdMW_0 2024-09-12T18:01:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5335117721619562956', time=2024-09-12T19:54:06.112309+0000, chain.objs.size()=1 2024-09-12T18:01:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.262__shadow_.ZB2uV2m1VLKbrUodu1sBpig7sQL4G5n_0 2024-09-12T18:01:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14170807143154326365', time=2024-09-12T19:54:13.535654+0000, chain.objs.size()=1 2024-09-12T18:01:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.LgUNqhNtjGL9cTjxkKRz77XchjTnE0-_0 2024-09-12T18:01:49.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15969267129889360356', time=2024-09-12T19:54:13.559097+0000, chain.objs.size()=1 2024-09-12T18:01:49.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2eP9aYjo-OANPXJqha4JzJwUcQLI4oF_0 2024-09-12T18:01:49.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15687753387153805428', time=2024-09-12T19:54:13.565855+0000, chain.objs.size()=1 2024-09-12T18:01:49.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.919+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.F9y5X1R35gwiYWVzAz7q4AMdq7wCfnA_0 2024-09-12T18:01:49.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4671880024481151395', time=2024-09-12T19:54:13.712729+0000, chain.objs.size()=1 2024-09-12T18:01:49.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.V9KCr9ilXN8oyMJxM7geTnJvERXdxw-_0 2024-09-12T18:01:49.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16897784681822928495', time=2024-09-12T19:54:13.714478+0000, chain.objs.size()=1 2024-09-12T18:01:49.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.zOLSk9cxdR-tYwnIh6fOwpMlo1JPNPL_0 2024-09-12T18:01:49.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8745310759001979133', time=2024-09-12T19:54:13.724621+0000, chain.objs.size()=1 2024-09-12T18:01:49.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.XSpwMehpJEcAfTeIN3MRGJ_5cSJpaXE_0 2024-09-12T18:01:49.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3956560630953265167', time=2024-09-12T19:54:13.738672+0000, chain.objs.size()=1 2024-09-12T18:01:49.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.HrEbw_fM8dXUgesp6uMtfqvToZCiq8C_0 2024-09-12T18:01:49.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2814786557994187129', time=2024-09-12T19:54:13.837209+0000, chain.objs.size()=1 2024-09-12T18:01:49.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.A5unNpWF1JGtLRRblvoP4DhD71A5SaQ_0 2024-09-12T18:01:49.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1247445885088784965', time=2024-09-12T19:54:13.861155+0000, chain.objs.size()=1 2024-09-12T18:01:49.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.mhQQrJ3vHtvX3vJAek0-WurniTUc5Ow_0 2024-09-12T18:01:49.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9778758636256309201', time=2024-09-12T19:54:13.887884+0000, chain.objs.size()=1 2024-09-12T18:01:49.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.waNy0hK07qhpg39b7Xw73PI9vX9OuI7_0 2024-09-12T18:01:49.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5933210975332232871', time=2024-09-12T19:54:13.912174+0000, chain.objs.size()=1 2024-09-12T18:01:49.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ZSEi7kn-om6_ldDW_9HI4gxD_iBldq0_0 2024-09-12T18:01:49.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9155691391099006643', time=2024-09-12T19:54:14.046688+0000, chain.objs.size()=1 2024-09-12T18:01:49.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.9NWWFfhZyr5G1Tsq1H4muISB621nK69_0 2024-09-12T18:01:49.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4385525873706710577', time=2024-09-12T19:54:14.069589+0000, chain.objs.size()=1 2024-09-12T18:01:49.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.edqc3WIst46BG-6q6UG88qtJdvQ8anl_0 2024-09-12T18:01:49.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9600668360723520713', time=2024-09-12T19:54:14.077539+0000, chain.objs.size()=1 2024-09-12T18:01:49.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.922+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.lZ2drbs0lOy-luEGzkYmVtzylO8vyrH_0 2024-09-12T18:01:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.923+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.681898928463525660', time=2024-09-12T19:54:14.376902+0000, chain.objs.size()=1 2024-09-12T18:01:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.923+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.aBraYJNQgULPMpaI_c-FofAOBQeFMa5_0 2024-09-12T18:01:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.924+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.768544792823650527', time=2024-09-12T19:54:14.387888+0000, chain.objs.size()=1 2024-09-12T18:01:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.924+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.k7hGO-AG1zBOveB67r68fxB19pTN-0R_0 2024-09-12T18:01:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.924+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18135632300751439032', time=2024-09-12T19:54:14.453165+0000, chain.objs.size()=1 2024-09-12T18:01:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.924+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.c8WUfTUkzQUSg88OqAiJIZdOM2kZC4P_0 2024-09-12T18:01:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.180324788409294396', time=2024-09-12T19:54:14.455167+0000, chain.objs.size()=1 2024-09-12T18:01:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.lDqkGvP58lZqG4iYSsdVJMiSJkUPbvh_0 2024-09-12T18:01:49.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3712120760510432839', time=2024-09-12T19:54:14.539650+0000, chain.objs.size()=1 2024-09-12T18:01:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.rm5R9fPDEp-EWcIgO9pFDw6TlwdR72s_0 2024-09-12T18:01:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7378135680584858816', time=2024-09-12T19:54:14.552351+0000, chain.objs.size()=1 2024-09-12T18:01:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.pXJR11Fadz-tbi9Ec2LAb5cJuxgaDNk_0 2024-09-12T18:01:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13679617834251323450', time=2024-09-12T19:54:14.563791+0000, chain.objs.size()=1 2024-09-12T18:01:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Nmu0zXwpFZNRI6FDEM2IUTYIcDOHrDw_0 2024-09-12T18:01:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6001956341075282036', time=2024-09-12T19:54:14.571621+0000, chain.objs.size()=1 2024-09-12T18:01:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.JAUHt_cFsuf9AMwAFhPp1LDgCFM1tnf_0 2024-09-12T18:01:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11776116116314544056', time=2024-09-12T19:54:14.584969+0000, chain.objs.size()=1 2024-09-12T18:01:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.NjzdW9jaAsnm90CyW-d96bUIkz-TwX1_0 2024-09-12T18:01:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.954099784226538489', time=2024-09-12T19:54:14.721088+0000, chain.objs.size()=1 2024-09-12T18:01:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.VV5B6iMn7LqxskOXBP2PDwZ8GIR2-WC_0 2024-09-12T18:01:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7175856284220550997', time=2024-09-12T19:54:14.727315+0000, chain.objs.size()=1 2024-09-12T18:01:49.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.8RLDKf5P2crTl64vBCEUBw7yCf-Omj-_0 2024-09-12T18:01:49.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17115538826864966005', time=2024-09-12T19:54:14.748754+0000, chain.objs.size()=1 2024-09-12T18:01:49.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.925+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.E6XaVvxOk4NzuKZU5ZcBV_qaZ2XzKwF_0 2024-09-12T18:01:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10536348610505946153', time=2024-09-12T19:54:14.754978+0000, chain.objs.size()=1 2024-09-12T18:01:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.sH-UtNj-hatdRSVeaTNp-lSgyKx4tLs_0 2024-09-12T18:01:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7931151052935896161', time=2024-09-12T19:54:14.879847+0000, chain.objs.size()=1 2024-09-12T18:01:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Z13ARrbWgZqeQw_SWXZiYFCnnfvBzmT_0 2024-09-12T18:01:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2542558697412977825', time=2024-09-12T19:54:14.892928+0000, chain.objs.size()=1 2024-09-12T18:01:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.cWSB9cUX7pdWP9AqcoQOg4HgxaWyEjk_0 2024-09-12T18:01:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11368434050466928030', time=2024-09-12T19:54:14.904724+0000, chain.objs.size()=1 2024-09-12T18:01:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.BuKe842Rrc-gjpcg8_XzT2dG_rNNdCc_0 2024-09-12T18:01:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4473123381417661894', time=2024-09-12T19:54:14.918306+0000, chain.objs.size()=1 2024-09-12T18:01:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.fq8D48pYmpot6-VuxIMoQtrDZTJGxbg_0 2024-09-12T18:01:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12907270316345279735', time=2024-09-12T19:54:14.933687+0000, chain.objs.size()=1 2024-09-12T18:01:49.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.YnL4BaQ4l8IwceQXy4tea4bgqL5_j_u_0 2024-09-12T18:01:49.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5942197394990892198', time=2024-09-12T19:54:14.937673+0000, chain.objs.size()=1 2024-09-12T18:01:49.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_._b9UWOU6-V8zIRnb27PqFA9Bx0UKn_r_0 2024-09-12T18:01:49.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13736060056080872142', time=2024-09-12T19:54:14.940906+0000, chain.objs.size()=1 2024-09-12T18:01:49.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.gjvG17VUcepxP5WoQixtkG7C9kfQiKT_0 2024-09-12T18:01:49.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7388531174075853117', time=2024-09-12T19:54:15.509421+0000, chain.objs.size()=1 2024-09-12T18:01:49.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.266__shadow_.3DVozgUQ9KUDmviID0LNwbmD0hkXlpc_0 2024-09-12T18:01:49.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12411142548827758276', time=2024-09-12T19:54:16.136100+0000, chain.objs.size()=1 2024-09-12T18:01:49.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.927+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.269__shadow_.nXtparZLCy7nYUTrdTWgAWBCjaelIBC_0 2024-09-12T18:01:49.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.928+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10358403755113833013', time=2024-09-12T19:54:18.184865+0000, chain.objs.size()=1 2024-09-12T18:01:49.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.928+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.279__shadow_.Pnyq14E1D2EWBRgsTdpFeLtGAHR0pgJ_0 2024-09-12T18:01:49.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.928+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10798825848359725685', time=2024-09-12T19:54:18.849071+0000, chain.objs.size()=1 2024-09-12T18:01:49.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.928+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.282__shadow_.hTX9xD_LGj4Am_Njsk7fyva2MgoctWn_0 2024-09-12T18:01:49.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.929+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12227698264752760319', time=2024-09-12T19:54:21.576016+0000, chain.objs.size()=1 2024-09-12T18:01:49.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.929+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.DGd46-1B004Zuf7tDul_rWzRovu4AwG_0 2024-09-12T18:01:49.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.929+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.741117058771283825', time=2024-09-12T19:54:21.588784+0000, chain.objs.size()=1 2024-09-12T18:01:49.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.929+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.T3GQ93tLS9WNDZ00PldKh3LNfybNT8V_0 2024-09-12T18:01:49.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.929+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7748803707797356922', time=2024-09-12T19:54:23.974175+0000, chain.objs.size()=1 2024-09-12T18:01:49.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.929+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.302__shadow_.Bn96vUEbfeT4XZ_aPlDsRbfY4BQ81jf_0 2024-09-12T18:01:49.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.929+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18152792693402344208', time=2024-09-12T19:54:35.761381+0000, chain.objs.size()=1 2024-09-12T18:01:49.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.929+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.6ikxG1ws4tuibaapcuigv1Ax_tRBtLd_0 2024-09-12T18:01:49.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.930+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14668619925427390580', time=2024-09-12T19:54:35.776278+0000, chain.objs.size()=1 2024-09-12T18:01:49.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.930+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.5kT54ezCGRWYVxoEUCzqT1-8MtBsQZu_0 2024-09-12T18:01:49.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.930+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15867354963982976243', time=2024-09-12T19:54:35.799616+0000, chain.objs.size()=1 2024-09-12T18:01:49.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.930+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4_0ynN9i4BmFVp3ULwW_OIcrBupeXBj_0 2024-09-12T18:01:49.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.930+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9787068112232138444', time=2024-09-12T19:54:35.825721+0000, chain.objs.size()=1 2024-09-12T18:01:49.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.930+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.fJV5vAlXvDc03dK3KtPG8zlo--54gYn_0 2024-09-12T18:01:49.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.930+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3663156313501238314', time=2024-09-12T19:54:35.924146+0000, chain.objs.size()=1 2024-09-12T18:01:49.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.930+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.i2tKG0bSYj4QfWmvJB-vVBDxlcwWSlW_0 2024-09-12T18:01:49.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.930+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15257866003410773688', time=2024-09-12T19:54:35.930713+0000, chain.objs.size()=1 2024-09-12T18:01:49.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.930+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.JHpMXZU3wN7dLYdwDC-dp1DcEmVKYi__0 2024-09-12T18:01:49.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.930+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2805071729804307961', time=2024-09-12T19:54:35.937527+0000, chain.objs.size()=1 2024-09-12T18:01:49.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.930+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.iHFYG-0HOfTFhfIHHuzR26XHFumi2r__0 2024-09-12T18:01:49.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.930+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1132868809490038034', time=2024-09-12T19:54:35.954276+0000, chain.objs.size()=1 2024-09-12T18:01:49.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.930+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.14-sfzBGkJKEV17Ii9dKfnIDVWZZfgk_0 2024-09-12T18:01:49.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.931+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16253058148677958587', time=2024-09-12T19:54:36.004829+0000, chain.objs.size()=1 2024-09-12T18:01:49.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.931+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4869IO3CsqqpD7K73lYS_VmVMzmRd8I_0 2024-09-12T18:01:49.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.931+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.467590306168473', time=2024-09-12T19:54:36.083409+0000, chain.objs.size()=1 2024-09-12T18:01:49.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.931+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QfCU7omzR3SH53a6yTqyBxMBo6QOJYw_0 2024-09-12T18:01:49.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.931+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12803726303499568240', time=2024-09-12T19:54:36.087838+0000, chain.objs.size()=1 2024-09-12T18:01:49.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.931+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Jj_3y7CKF_IaQ8UbDdoNfe-nG-Q1aso_0 2024-09-12T18:01:49.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.931+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6827945083084855765', time=2024-09-12T19:54:36.092922+0000, chain.objs.size()=1 2024-09-12T18:01:49.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.931+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.nTTR5RI26CxckfsoLTJYOk1p_i5izx6_0 2024-09-12T18:01:49.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.931+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1699052512884664975', time=2024-09-12T19:54:36.099184+0000, chain.objs.size()=1 2024-09-12T18:01:49.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.931+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.vim3bRbUBoY7Ksxm51EvHJ3dXmizpBo_0 2024-09-12T18:01:49.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6048123615056781482', time=2024-09-12T19:54:36.123962+0000, chain.objs.size()=1 2024-09-12T18:01:49.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.sISa5JJwbzgY4vRHAC4eJQh2Zn4g6G4_0 2024-09-12T18:01:49.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9090132050585711785', time=2024-09-12T19:54:36.145706+0000, chain.objs.size()=1 2024-09-12T18:01:49.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0PD_Ai6EFRGthfdcGn6Jpy3FHNwPjLp_0 2024-09-12T18:01:49.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17537002567065568857', time=2024-09-12T19:54:36.151190+0000, chain.objs.size()=1 2024-09-12T18:01:49.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.BdseNtRAAoy7rhxg2utxr-5UDY2KPgO_0 2024-09-12T18:01:49.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14457849011621353161', time=2024-09-12T19:54:36.155809+0000, chain.objs.size()=1 2024-09-12T18:01:49.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.qWZgOkK3IghNTDR38H7KzPwfONlp2lw_0 2024-09-12T18:01:49.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4026674429082559475', time=2024-09-12T19:54:36.290207+0000, chain.objs.size()=1 2024-09-12T18:01:49.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.NlZWT30UuPkcNi2tUx1ujbLEHcoRmqK_0 2024-09-12T18:01:49.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12851456886943420767', time=2024-09-12T19:54:36.301492+0000, chain.objs.size()=1 2024-09-12T18:01:49.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.LeEYVOSWBb9imUhnarn_fBXR6tKcIfF_0 2024-09-12T18:01:49.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7526384221100912954', time=2024-09-12T19:54:36.304968+0000, chain.objs.size()=1 2024-09-12T18:01:49.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.JBSgyRot2PTmRa4MdY9RyYuQrpbv0tY_0 2024-09-12T18:01:49.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.744048656737368504', time=2024-09-12T19:54:36.331707+0000, chain.objs.size()=1 2024-09-12T18:01:49.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.SkJXRtBIKxI1s60bLcxCobELLXq6q_7_0 2024-09-12T18:01:49.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3941614921159649285', time=2024-09-12T19:54:36.473383+0000, chain.objs.size()=1 2024-09-12T18:01:49.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.TgNIi2mnnYT6qSECNE2vu4oTiTHWDDr_0 2024-09-12T18:01:49.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.934+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10935781214425375668', time=2024-09-12T19:54:36.609844+0000, chain.objs.size()=1 2024-09-12T18:01:49.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.934+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.BjIjb8PAQPlY37PpdWrAJoEPB-tzPqd_0 2024-09-12T18:01:49.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.934+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8597625228679721617', time=2024-09-12T19:54:36.745276+0000, chain.objs.size()=1 2024-09-12T18:01:49.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.934+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.VXnn74Y9XDEq47M8IUpqXAsll8ZiLsC_0 2024-09-12T18:01:49.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.934+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9715467131384032646', time=2024-09-12T19:54:36.760335+0000, chain.objs.size()=1 2024-09-12T18:01:49.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.934+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4sY0Zce8GqfbR6g0m2_WCUpAcF_tW6T_0 2024-09-12T18:01:49.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.934+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4015001819219599303', time=2024-09-12T19:54:36.791495+0000, chain.objs.size()=1 2024-09-12T18:01:49.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.934+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.q_I84TYZGAUAaEfta1d8o4dv0fI2MfK_0 2024-09-12T18:01:49.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.934+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7316419715190031983', time=2024-09-12T19:54:36.812516+0000, chain.objs.size()=1 2024-09-12T18:01:49.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.934+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4tgc00FhIX9_rQawyFDHz_6FVUasZNI_0 2024-09-12T18:01:49.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.934+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.638906158371866982', time=2024-09-12T19:54:36.912465+0000, chain.objs.size()=1 2024-09-12T18:01:49.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.934+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.HxbZ6t5JgPFYpNYnHcv9uKz-BqpkG4H_0 2024-09-12T18:01:49.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.935+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16210385420578827305', time=2024-09-12T19:54:36.954203+0000, chain.objs.size()=1 2024-09-12T18:01:49.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.935+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.LOVM4jx4wJ3XpzrsScRQaWCPNYOipmi_0 2024-09-12T18:01:49.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.935+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18334441445905986670', time=2024-09-12T19:54:36.956860+0000, chain.objs.size()=1 2024-09-12T18:01:49.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.935+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.sH1FlALvXK_NpxkBegqA7t0eHiFpbPk_0 2024-09-12T18:01:49.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6058163355770198644', time=2024-09-12T19:54:44.468114+0000, chain.objs.size()=1 2024-09-12T18:01:49.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Obw8fu6a8jOHr60zso5K_I8v4NGQUyz_0 2024-09-12T18:01:49.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14117987692311710820', time=2024-09-12T19:54:44.539538+0000, chain.objs.size()=1 2024-09-12T18:01:49.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.IAzzt7-lCIrq3_ao8ZnNn_z5X0-_WnR_0 2024-09-12T18:01:49.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9871133119137698469', time=2024-09-12T19:54:44.665795+0000, chain.objs.size()=1 2024-09-12T18:01:49.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.K1y2vCyNuYlKyKTybHU1PQeyC91jbUk_0 2024-09-12T18:01:49.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8203170983933227387', time=2024-09-12T19:54:44.672250+0000, chain.objs.size()=1 2024-09-12T18:01:49.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ipuvH5mbbt1PvmtI3RYtOGpEtpHlTYs_0 2024-09-12T18:01:49.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11430094979720145379', time=2024-09-12T19:54:44.687820+0000, chain.objs.size()=1 2024-09-12T18:01:49.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.vNW-eA8fUNVNUw8TJsLVU-Q4btOXuHT_0 2024-09-12T18:01:49.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3459719480965210314', time=2024-09-12T19:54:44.715582+0000, chain.objs.size()=1 2024-09-12T18:01:49.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.DlcgIeqFAqRZbJxwbl8zUnb7nyKK0Uy_0 2024-09-12T18:01:49.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.937+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6182863744210008491', time=2024-09-12T19:54:44.825443+0000, chain.objs.size()=1 2024-09-12T18:01:49.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.937+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Gr6U1NKs2SxZnVfvZv6pbGr_g-AgNJr_0 2024-09-12T18:01:49.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.937+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8579121505775366415', time=2024-09-12T19:54:44.862505+0000, chain.objs.size()=1 2024-09-12T18:01:49.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.937+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.QmCEmq5KFebKpoDwas-bju4q9WdqBpv_0 2024-09-12T18:01:49.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.937+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5339440829011760716', time=2024-09-12T19:54:44.975277+0000, chain.objs.size()=1 2024-09-12T18:01:49.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.937+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.QwpScFuEmTQ0HcfKzoVVmE_4vgfFRxF_0 2024-09-12T18:01:49.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.937+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10698512472918195925', time=2024-09-12T19:54:45.002811+0000, chain.objs.size()=1 2024-09-12T18:01:49.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.937+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Py31WAK-iTZFSDf_bWmre2ouzlBW9hK_0 2024-09-12T18:01:49.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.937+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10146585958459395853', time=2024-09-12T19:54:45.031342+0000, chain.objs.size()=1 2024-09-12T18:01:49.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.937+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jzR2vPzpLvy8lpRywADu7_eiW9w2gMD_0 2024-09-12T18:01:49.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16496040042408140225', time=2024-09-12T19:54:45.033218+0000, chain.objs.size()=1 2024-09-12T18:01:49.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.wTQUh7ZylVmM4xZq5l1NTyvy5zHOIS5_0 2024-09-12T18:01:49.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8194207162421834979', time=2024-09-12T19:54:45.034114+0000, chain.objs.size()=1 2024-09-12T18:01:49.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.hm3yKihpu_uj02-O8t8aQKtybEnuEfc_0 2024-09-12T18:01:49.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10305511701575885638', time=2024-09-12T19:54:45.035415+0000, chain.objs.size()=1 2024-09-12T18:01:49.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.pShhziM48oktVm08da084QvtY2GNeaN_0 2024-09-12T18:01:49.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4099288443876924828', time=2024-09-12T19:54:45.219594+0000, chain.objs.size()=1 2024-09-12T18:01:49.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.S2hOmzg7hMgaQjaGd17ghTHt7pcFXZQ_0 2024-09-12T18:01:49.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9191076305825371585', time=2024-09-12T19:54:45.239430+0000, chain.objs.size()=1 2024-09-12T18:01:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.RxLzCULIw8lPR3F2tq1I09JhhaUZw3G_0 2024-09-12T18:01:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5991415073106037642', time=2024-09-12T19:54:45.242510+0000, chain.objs.size()=1 2024-09-12T18:01:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.APZrT9CIaMOhPftfSVlWyKnXWs52TMj_0 2024-09-12T18:01:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11988267183564299092', time=2024-09-12T19:54:45.336124+0000, chain.objs.size()=1 2024-09-12T18:01:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.d3fBihDhmysYnqHkg9OPIqGLlVbqPoc_0 2024-09-12T18:01:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12991695265801800702', time=2024-09-12T19:54:45.387057+0000, chain.objs.size()=1 2024-09-12T18:01:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.lWC7cRk6JKVW0T0KMZDr97C3VJGAPBF_0 2024-09-12T18:01:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11362880826897678757', time=2024-09-12T19:54:45.389078+0000, chain.objs.size()=1 2024-09-12T18:01:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.940+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.IpyBKGuycp3iC2-d7UTU_pgOMJ0SCvy_0 2024-09-12T18:01:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.940+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3907905561449348440', time=2024-09-12T19:54:45.408997+0000, chain.objs.size()=1 2024-09-12T18:01:49.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.940+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-65sr79D_Y82dIkfhqZ3ifDvRC46T0Z_0 2024-09-12T18:01:49.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.942+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/43163 2024-09-12T18:01:49.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:01:49.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14875793638534405529', time=2024-09-12T19:54:45.410893+0000, chain.objs.size()=1 2024-09-12T18:01:49.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.CI1oblMr8IqpvW3Mxu0Lq5QdsX8ACey_0 2024-09-12T18:01:49.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8216912723367807031', time=2024-09-12T19:54:45.554333+0000, chain.objs.size()=1 2024-09-12T18:01:49.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-JEw-oIV8SD8L3ITjEuDhEnQq3vw2EF_0 2024-09-12T18:01:49.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14736166921492601737', time=2024-09-12T19:54:45.705786+0000, chain.objs.size()=1 2024-09-12T18:01:49.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.NRQMx1Sox05Evk6OteB6mKjyMdqoBLx_0 2024-09-12T18:01:49.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14563984091138799866', time=2024-09-12T19:54:49.734936+0000, chain.objs.size()=1 2024-09-12T18:01:49.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.346__shadow_.Cl7jCt-a1TelXySlUpvLqVqphpNAjPD_0 2024-09-12T18:01:49.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2560049150146023642', time=2024-09-12T19:54:55.998802+0000, chain.objs.size()=1 2024-09-12T18:01:49.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.378__shadow_.bmLVANvnmyrHhQgZFcEhoX7Zo9JSgqx_0 2024-09-12T18:01:49.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17617088156846463760', time=2024-09-12T19:55:14.733853+0000, chain.objs.size()=1 2024-09-12T18:01:49.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.458__shadow_.gfQkjQwE68s9qRvk1_Pb8frSDKcwvJX_0 2024-09-12T18:01:49.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3030599201564044216', time=2024-09-12T19:55:16.334507+0000, chain.objs.size()=1 2024-09-12T18:01:49.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.462__shadow_.qYWCfGVVlgAwTE9K30RkwvkAQX1MEVR_0 2024-09-12T18:01:49.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.254624380604304385', time=2024-09-12T19:55:24.909343+0000, chain.objs.size()=1 2024-09-12T18:01:49.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.500__shadow_.CkWWF2PkBdbvbmLDPG6ZasFk0SUD3Ag_0 2024-09-12T18:01:49.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17943317364472185266', time=2024-09-12T19:55:38.333552+0000, chain.objs.size()=3 2024-09-12T18:01:49.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.524__multipart_mymultipart.2~cUyxWVUIievkszuavm-KMTnDVCcV_Fn.1 2024-09-12T18:01:49.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.524__multipart_mymultipart.2~cUyxWVUIievkszuavm-KMTnDVCcV_Fn.2 2024-09-12T18:01:49.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.524__multipart_mymultipart.2~cUyxWVUIievkszuavm-KMTnDVCcV_Fn.3 2024-09-12T18:01:49.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5369837158168016381', time=2024-09-12T19:56:12.829618+0000, chain.objs.size()=1 2024-09-12T18:01:49.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.944+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.557__shadow_.2p7VcsFDSuRDn9rulVkch98Zus9AjNY_0 2024-09-12T18:01:49.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.945+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6290040024289639493', time=2024-09-12T19:56:21.492636+0000, chain.objs.size()=1 2024-09-12T18:01:49.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.945+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:pTE1tHqa3IatxYcYLuznVslfjo6r38g_.LQxCG26Bp0bdH-jj8x8AJAn-4hTbzE0_0 2024-09-12T18:01:49.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.946+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15654105512528957620', time=2024-09-12T19:56:22.495744+0000, chain.objs.size()=1 2024-09-12T18:01:49.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.946+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:o9Zg7dgFlduTgnYDN9-jIRi8dOEVYRh_.HRnuG3cxL4Wt5QFca79T6NBWl1I43Wo_0 2024-09-12T18:01:49.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.946+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3357520797695870588', time=2024-09-12T19:56:34.564729+0000, chain.objs.size()=1 2024-09-12T18:01:49.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.946+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.577__shadow:K2ItI0lsSPx65xuq1f6hsj-qdl6OuO7_.Y_HrBEu5DsAbtXhLSbGbi6vtuLSVOaf_0 2024-09-12T18:01:49.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.946+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6963042176205898599', time=2024-09-12T19:56:44.211349+0000, chain.objs.size()=1 2024-09-12T18:01:49.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.946+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:gWT7dn7xtcnqfQoir5N9JRpjSOnOg52_.qg70HXwkHlEu8e06mIL6jwcs37gVACx_0 2024-09-12T18:01:49.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.946+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4218280449692238893', time=2024-09-12T19:56:45.905708+0000, chain.objs.size()=1 2024-09-12T18:01:49.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.946+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:3KVSeJPrTRBdtKm.WfPJVHT0YqkR70y_.tmWplTrZiAimOnSvBr1b_2YWAL3mmdj_0 2024-09-12T18:01:49.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.946+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8200079442280903721', time=2024-09-12T19:59:17.512065+0000, chain.objs.size()=1 2024-09-12T18:01:49.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.946+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.665__shadow_.O3bmSFzgikDDJcbYiBQcr76hgWkTYqo_0 2024-09-12T18:01:49.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.946+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.427665197519142858', time=2024-09-12T19:59:25.215890+0000, chain.objs.size()=1 2024-09-12T18:01:49.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.946+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.702__shadow:evitTSTzPrOH2-5oS8CR1MGkmx59y6p_.dgxp93ObfG7MhMtgVjugo1sqlyVeWXZ_0 2024-09-12T18:01:49.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.948+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:49.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.950+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:01:49.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.952+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:49.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.952+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:49.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53381' 2024-09-12T18:01:49.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13896300694397330587', time=2024-09-12T19:53:04.576920+0000, chain.objs.size()=1 2024-09-12T18:01:49.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.180__shadow_.LGe75zBeohmrpbn2KbpoZ-jT5rWBMUz_0 2024-09-12T18:01:49.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16549462983828108248', time=2024-09-12T19:54:02.310914+0000, chain.objs.size()=1 2024-09-12T18:01:49.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.244__shadow_.gXoIKhxqxtCjbsFH3bjYKBGb7x7MT4W_0 2024-09-12T18:01:49.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5597439678010586964', time=2024-09-12T19:54:04.880116+0000, chain.objs.size()=1 2024-09-12T18:01:49.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.256__shadow_.QWF0jArJePQEYctm5QRmKOIYEmOvnyK_0 2024-09-12T18:01:49.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17531040654832575995', time=2024-09-12T19:54:05.084415+0000, chain.objs.size()=1 2024-09-12T18:01:49.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.257__shadow_.vbsA8Uubo9Zm6WSPSt7bI_mdG00XiB5_0 2024-09-12T18:01:49.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8269458979940277375', time=2024-09-12T19:54:05.277072+0000, chain.objs.size()=1 2024-09-12T18:01:49.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.258__shadow_.uJqFa_ZwCDUaLPHiALwc-UXhNqClgQP_0 2024-09-12T18:01:49.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4962130144807637854', time=2024-09-12T19:54:13.495172+0000, chain.objs.size()=1 2024-09-12T18:01:49.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.dIAcpZcT4Fugzz-jqwW-NhJ25G2dC8n_0 2024-09-12T18:01:49.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8173481523878631167', time=2024-09-12T19:54:13.508867+0000, chain.objs.size()=1 2024-09-12T18:01:49.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.S_t4s9t05fTQMnE_JA_vTqfjsu71uK3_0 2024-09-12T18:01:49.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16998549706674780915', time=2024-09-12T19:54:13.551240+0000, chain.objs.size()=1 2024-09-12T18:01:49.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.FiwtqBs4VnDzx54rBdrpLwY8rStuSZh_0 2024-09-12T18:01:49.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5822514177499738317', time=2024-09-12T19:54:13.555440+0000, chain.objs.size()=1 2024-09-12T18:01:49.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.LLo3_t2qmqG1KpLMyQiJb9gSY5jXprg_0 2024-09-12T18:01:49.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11604888434032291125', time=2024-09-12T19:54:13.578649+0000, chain.objs.size()=1 2024-09-12T18:01:49.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-dYHLMpHF1OqHrlQXaLu-DLyOjToKB7_0 2024-09-12T18:01:49.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17955557953844990302', time=2024-09-12T19:54:13.695186+0000, chain.objs.size()=1 2024-09-12T18:01:49.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.gMobVjbtGhCStYObqHjZBpnVPCn53wL_0 2024-09-12T18:01:49.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8078050029004685214', time=2024-09-12T19:54:13.727739+0000, chain.objs.size()=1 2024-09-12T18:01:49.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.JsxkQmKLZCAiFs5xWkfHoBsCLcqKrQ9_0 2024-09-12T18:01:49.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.955+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10861477876989558841', time=2024-09-12T19:54:13.844158+0000, chain.objs.size()=1 2024-09-12T18:01:49.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.955+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.lTsBO1PPLpmgQd8WdCeJeLmABNzM_e5_0 2024-09-12T18:01:49.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.955+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12453157156085513213', time=2024-09-12T19:54:13.857487+0000, chain.objs.size()=1 2024-09-12T18:01:49.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.955+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ShpnWnJ-nuQhgagAWuZyG93_Bg538s4_0 2024-09-12T18:01:49.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17957441584474946475', time=2024-09-12T19:54:13.859731+0000, chain.objs.size()=1 2024-09-12T18:01:49.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.mPflaisqdxOVtIGanlx1uT1q3RzticX_0 2024-09-12T18:01:49.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3996463669735465252', time=2024-09-12T19:54:13.866646+0000, chain.objs.size()=1 2024-09-12T18:01:49.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.KfWj9cqTbWr9A5IJyHfvIlCHEkauQX2_0 2024-09-12T18:01:49.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7257267588308679967', time=2024-09-12T19:54:13.875704+0000, chain.objs.size()=1 2024-09-12T18:01:49.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Dj3JZxkprOT0OWnrOJjGGTipPnvQcJW_0 2024-09-12T18:01:49.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7893685203827955218', time=2024-09-12T19:54:13.896179+0000, chain.objs.size()=1 2024-09-12T18:01:49.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.hG3pqMYkGc93MkxugzTRr5MgNYuPvPy_0 2024-09-12T18:01:49.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16074338919654946400', time=2024-09-12T19:54:13.898216+0000, chain.objs.size()=1 2024-09-12T18:01:49.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.uQ4QBlYlKsV3lK8xu1UFjn-SMG9RfJV_0 2024-09-12T18:01:49.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9458982620247229267', time=2024-09-12T19:54:14.044107+0000, chain.objs.size()=1 2024-09-12T18:01:49.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.QemZB-43kNJx7HMc5MGkmgFHSiBSBc3_0 2024-09-12T18:01:49.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10851701177164145096', time=2024-09-12T19:54:14.066269+0000, chain.objs.size()=1 2024-09-12T18:01:49.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.kPfXUd66dXUq2pV_KbKVivao45gLgk8_0 2024-09-12T18:01:49.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4180027009088093882', time=2024-09-12T19:54:14.088619+0000, chain.objs.size()=1 2024-09-12T18:01:49.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.RgBOl5Cp41vTv081olwXNQMwUbW5LlV_0 2024-09-12T18:01:49.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16623380166322434815', time=2024-09-12T19:54:14.094120+0000, chain.objs.size()=1 2024-09-12T18:01:49.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.956+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.zPHXHgdiMEVff_V8sZdYd9GBqRybPxy_0 2024-09-12T18:01:49.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.957+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9348100213950581923', time=2024-09-12T19:54:14.449051+0000, chain.objs.size()=1 2024-09-12T18:01:49.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.957+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.3iKj3GsWa2qv3E6atvHFnZAWMXHjnnK_0 2024-09-12T18:01:49.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.957+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6557186091338577961', time=2024-09-12T19:54:14.563864+0000, chain.objs.size()=1 2024-09-12T18:01:49.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.957+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_._SKKiScxhDwf1mGJ-uzksoygmUnIlsf_0 2024-09-12T18:01:49.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5190736859484603444', time=2024-09-12T19:54:14.570118+0000, chain.objs.size()=1 2024-09-12T18:01:49.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.VF9UyUEnSi2i8ef38OOCUVsclpMa1aQ_0 2024-09-12T18:01:49.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11348295021000015663', time=2024-09-12T19:54:14.578935+0000, chain.objs.size()=1 2024-09-12T18:01:49.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ZAKQLxaRTtQ-BZ3gaYXszE0m2iQ5QdD_0 2024-09-12T18:01:49.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14024026363362969979', time=2024-09-12T19:54:14.619976+0000, chain.objs.size()=1 2024-09-12T18:01:49.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.BN5WqlFFOCW6BY1ZPPhI8ydDKWvhTms_0 2024-09-12T18:01:49.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6966965472701225472', time=2024-09-12T19:54:14.620754+0000, chain.objs.size()=1 2024-09-12T18:01:49.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ECtYQZgcXFN0eyACAiYzOqDdI51JFOz_0 2024-09-12T18:01:49.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7006727878121259946', time=2024-09-12T19:54:14.723025+0000, chain.objs.size()=1 2024-09-12T18:01:49.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.4Km3DVqI2YIxv-7mazNacDoJC12YNfd_0 2024-09-12T18:01:49.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2457433712201238859', time=2024-09-12T19:54:14.728467+0000, chain.objs.size()=1 2024-09-12T18:01:49.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.vbIPkkdX2UK5ATPYVECbdMCvrYE8OBb_0 2024-09-12T18:01:49.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13244669204260355178', time=2024-09-12T19:54:14.750704+0000, chain.objs.size()=1 2024-09-12T18:01:49.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.4AGIATI-HiI_jz1twJzw3-huRFpwSzC_0 2024-09-12T18:01:49.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9395420193160303591', time=2024-09-12T19:54:14.761009+0000, chain.objs.size()=1 2024-09-12T18:01:49.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.sJvr-g4J1E69RaQFpF7RQVyu1pIh9xQ_0 2024-09-12T18:01:49.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16790281011004219931', time=2024-09-12T19:54:14.766519+0000, chain.objs.size()=1 2024-09-12T18:01:49.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.cki_7t39psD6gt9ffR_ZtWZB4E-ds_4_0 2024-09-12T18:01:49.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18108885429570229139', time=2024-09-12T19:54:14.775140+0000, chain.objs.size()=1 2024-09-12T18:01:49.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.958+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.SEMdrO5OOMgokAwgrulaql8HbmHLbe7_0 2024-09-12T18:01:49.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.959+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14644374312448971437', time=2024-09-12T19:54:14.949169+0000, chain.objs.size()=1 2024-09-12T18:01:49.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.959+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.oPed7LI-t9JSlq--kn6JyDNxa3KFRVh_0 2024-09-12T18:01:49.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.959+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5248238402485158847', time=2024-09-12T19:54:17.768910+0000, chain.objs.size()=1 2024-09-12T18:01:49.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.959+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.277__shadow_.sZT3gr2JkdFpu7Q7LKvNNiPstPvLjXm_0 2024-09-12T18:01:49.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.960+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17591830456969484835', time=2024-09-12T19:54:19.260081+0000, chain.objs.size()=1 2024-09-12T18:01:49.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.960+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.284__shadow_.Yu1pJF0nnfnrrJzn0Z_fEVbQkZCdz4U_0 2024-09-12T18:01:49.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.960+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17797868196024306885', time=2024-09-12T19:54:21.580664+0000, chain.objs.size()=1 2024-09-12T18:01:49.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.960+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.Lnz4GwTLIqNDfULAEYmROrzWVlxUm47_0 2024-09-12T18:01:49.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.960+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15920458855555626156', time=2024-09-12T19:54:22.172564+0000, chain.objs.size()=1 2024-09-12T18:01:49.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.960+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.T9a-M33zyg9GLyEo2I4NCZi3kzXVX-K_0 2024-09-12T18:01:49.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.960+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11606925574437129097', time=2024-09-12T19:54:24.377330+0000, chain.objs.size()=1 2024-09-12T18:01:49.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.960+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.304__shadow_.ieA1ToKaeuGpHLwgZYroQjImTv46nVo_0 2024-09-12T18:01:49.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.962+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10398116883988472949', time=2024-09-12T19:54:27.876476+0000, chain.objs.size()=1 2024-09-12T18:01:49.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.962+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.322__shadow_.S_RRP_mEXohsbTQqvrbvxHv-TeVmS8I_0 2024-09-12T18:01:49.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.962+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17421177284745954341', time=2024-09-12T19:54:35.777519+0000, chain.objs.size()=1 2024-09-12T18:01:49.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.962+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9JOVHGsWjSj2yuUgp9cIdBkugwy4AfF_0 2024-09-12T18:01:49.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3588733910050288549', time=2024-09-12T19:54:35.970722+0000, chain.objs.size()=1 2024-09-12T18:01:49.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.NsSX94DwW-yRH8yGHe9csUsEpqebKoK_0 2024-09-12T18:01:49.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5067953937691887238', time=2024-09-12T19:54:36.008759+0000, chain.objs.size()=1 2024-09-12T18:01:49.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.EJ3FiNp4cgbg-NLzWRbj6YfhmrBxzr3_0 2024-09-12T18:01:49.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9790584805286678397', time=2024-09-12T19:54:36.257609+0000, chain.objs.size()=1 2024-09-12T18:01:49.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.vV35eae-L6QC3ahY8P8-Lo19euFe84K_0 2024-09-12T18:01:49.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17263994124429650883', time=2024-09-12T19:54:36.276007+0000, chain.objs.size()=1 2024-09-12T18:01:49.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Pfx7VB8i3u6voXFX7axk7Wqnpu8zb0b_0 2024-09-12T18:01:49.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15581440475271329440', time=2024-09-12T19:54:36.278208+0000, chain.objs.size()=1 2024-09-12T18:01:49.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.cSzB6gqBJJXqfyJ1wZSnlDYFZxrZH3g_0 2024-09-12T18:01:49.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10774229587212322990', time=2024-09-12T19:54:36.287842+0000, chain.objs.size()=1 2024-09-12T18:01:49.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4IVgUypbH4mPCCGG1DBl_wTVEMNZhCz_0 2024-09-12T18:01:49.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14420119767287834056', time=2024-09-12T19:54:36.301564+0000, chain.objs.size()=1 2024-09-12T18:01:49.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.XccNYT7bfxxJqQf712P4e-6Jgsqq3Ea_0 2024-09-12T18:01:49.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18432669649947546660', time=2024-09-12T19:54:36.323634+0000, chain.objs.size()=1 2024-09-12T18:01:49.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Yt0rEhAiJuWGtWtpIK66d0vPQJgI61o_0 2024-09-12T18:01:49.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5145376367063356074', time=2024-09-12T19:54:36.426984+0000, chain.objs.size()=1 2024-09-12T18:01:49.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.2F590DmlvpcA3-lT1I8q_8Sx_NnVblI_0 2024-09-12T18:01:49.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8863132922535456036', time=2024-09-12T19:54:36.434524+0000, chain.objs.size()=1 2024-09-12T18:01:49.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Pae7o7uVrz6cfxkzAbBww6wOkrcY9ZK_0 2024-09-12T18:01:49.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15278627792976586496', time=2024-09-12T19:54:36.435663+0000, chain.objs.size()=1 2024-09-12T18:01:49.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.963+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.w1DMhiZvQgVusLnP8alSsRtu5lxsB1A_0 2024-09-12T18:01:49.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6469928502884363814', time=2024-09-12T19:54:36.445709+0000, chain.objs.size()=1 2024-09-12T18:01:49.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.CXLalYo0dkMIH5ZPCdu6PPNC27r-R9A_0 2024-09-12T18:01:49.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17092938338821175143', time=2024-09-12T19:54:36.467085+0000, chain.objs.size()=1 2024-09-12T18:01:49.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.J5AiGwy_wzkAdxO7ZQ-wxZsc_qJpRW7_0 2024-09-12T18:01:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9772154477505305376', time=2024-09-12T19:54:36.577464+0000, chain.objs.size()=1 2024-09-12T18:01:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_._eWV7moboKkv1ZwXQMlyiLPM2lQ1OlX_0 2024-09-12T18:01:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14736025188610187384', time=2024-09-12T19:54:36.616406+0000, chain.objs.size()=1 2024-09-12T18:01:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.lni_HNRFQgzjL3DJ5w5nEVMfmJC2RlD_0 2024-09-12T18:01:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11641684776251470723', time=2024-09-12T19:54:36.663843+0000, chain.objs.size()=1 2024-09-12T18:01:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.tIhHxYOEk5UCms5rG6wOBHLtCnSqdXL_0 2024-09-12T18:01:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4138977915886574516', time=2024-09-12T19:54:36.759851+0000, chain.objs.size()=1 2024-09-12T18:01:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QyM3SNG8Fn10MmM76fFszuhhP6yCEbc_0 2024-09-12T18:01:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10811697261695648983', time=2024-09-12T19:54:36.768166+0000, chain.objs.size()=1 2024-09-12T18:01:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.y-7nlfr7ZKllFQFnHphylNqCsqRJoH3_0 2024-09-12T18:01:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16972692875646369102', time=2024-09-12T19:54:36.788101+0000, chain.objs.size()=1 2024-09-12T18:01:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9JZTzPHrKQbKI4DjF_cf9mXCZETNoH6_0 2024-09-12T18:01:49.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12120820042703502546', time=2024-09-12T19:54:36.790135+0000, chain.objs.size()=1 2024-09-12T18:01:49.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.sepbKAG1ZcqAeQvEorvhgVsP2QYioSy_0 2024-09-12T18:01:49.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15505341088716547945', time=2024-09-12T19:54:36.802641+0000, chain.objs.size()=1 2024-09-12T18:01:49.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.dYwYGaZQ01Q_gAxTWQ6NUjjTTioROAt_0 2024-09-12T18:01:49.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17612163010587236556', time=2024-09-12T19:54:36.902722+0000, chain.objs.size()=1 2024-09-12T18:01:49.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.965+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.K-ZxgmVSMvdCqpF7Yt7WNbgXzp6-X5R_0 2024-09-12T18:01:49.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.966+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11302372828360231195', time=2024-09-12T19:54:36.922309+0000, chain.objs.size()=1 2024-09-12T18:01:49.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.966+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.c9jIxUthuTaTx5cBMe7lvVPPdALRmpk_0 2024-09-12T18:01:49.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.967+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10462718321187137668', time=2024-09-12T19:54:36.941401+0000, chain.objs.size()=1 2024-09-12T18:01:49.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.967+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.sGBCo46fMg5eN5g36KpfS86aSzRcLAi_0 2024-09-12T18:01:49.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.967+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1024689008891154267', time=2024-09-12T19:54:36.960686+0000, chain.objs.size()=1 2024-09-12T18:01:49.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.967+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.PNt-IOhPqBz1nn0vlwAQTuJ28luxaLr_0 2024-09-12T18:01:49.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.967+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5663703935547629490', time=2024-09-12T19:54:36.964470+0000, chain.objs.size()=1 2024-09-12T18:01:49.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.967+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.KnMEKlb86NpuU9vCoJhFl1YHkBLxyQn_0 2024-09-12T18:01:49.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.967+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12275392606978951212', time=2024-09-12T19:54:44.459644+0000, chain.objs.size()=1 2024-09-12T18:01:49.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.967+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.t28cv__ioHRx0F7yhE2KmjSkDgE_Pbd_0 2024-09-12T18:01:49.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9037028521940638429', time=2024-09-12T19:54:44.477911+0000, chain.objs.size()=1 2024-09-12T18:01:49.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.XczGsCNAkQYjPKPjL9Itb1xtVeQ9K-P_0 2024-09-12T18:01:49.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8769305634122506902', time=2024-09-12T19:54:44.482548+0000, chain.objs.size()=1 2024-09-12T18:01:49.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.DKKc0BUSlJ1mD_efDo4RXX3e_wCVnSw_0 2024-09-12T18:01:49.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5561706458038232693', time=2024-09-12T19:54:44.490814+0000, chain.objs.size()=1 2024-09-12T18:01:49.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.uHPdZ8sr5nRpypnEvYVhGLIlEJ-EUeL_0 2024-09-12T18:01:49.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17350299792505513755', time=2024-09-12T19:54:44.507850+0000, chain.objs.size()=1 2024-09-12T18:01:49.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.QWL1o8H-ljI2AGBF0nIgrVOys9NkN2R_0 2024-09-12T18:01:49.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18151651625479076793', time=2024-09-12T19:54:44.532492+0000, chain.objs.size()=1 2024-09-12T18:01:49.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.NlgchKJUecvGd00Lt9Oq1SPblWGnLV1_0 2024-09-12T18:01:49.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15613508790297879510', time=2024-09-12T19:54:44.667402+0000, chain.objs.size()=1 2024-09-12T18:01:49.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.t6gEjIGtagx5K7HsrBjrlIZGSI2QXoS_0 2024-09-12T18:01:49.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2339369813131769558', time=2024-09-12T19:54:44.683028+0000, chain.objs.size()=1 2024-09-12T18:01:49.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.2dZkpxJlzBdBjGw611nGETc8XxkAh5o_0 2024-09-12T18:01:49.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.969+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2455734554007712645', time=2024-09-12T19:54:44.689416+0000, chain.objs.size()=1 2024-09-12T18:01:49.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.969+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.FXLeV04K2-hewHSCzL7jwC_nXtp7DTg_0 2024-09-12T18:01:49.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.969+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17321303582104687248', time=2024-09-12T19:54:44.705356+0000, chain.objs.size()=1 2024-09-12T18:01:49.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.969+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.kVZK9TQtro1uotzz1LnhKrHZpw8E5Bb_0 2024-09-12T18:01:49.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.969+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13602971515838636944', time=2024-09-12T19:54:44.797969+0000, chain.objs.size()=1 2024-09-12T18:01:49.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.969+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.1E2AlQ0vi_T5YrFIJxendk-n4ymX9r8_0 2024-09-12T18:01:49.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.969+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18446589217452137875', time=2024-09-12T19:54:44.811975+0000, chain.objs.size()=1 2024-09-12T18:01:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.969+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.rEaNRf7PAHno4XHOwG4gDFrtn7cp2N3_0 2024-09-12T18:01:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.970+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17121739137418264109', time=2024-09-12T19:54:44.818087+0000, chain.objs.size()=1 2024-09-12T18:01:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.970+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.LJIq2I3oCeK-mgTQ8R-OVwFj2WNJFGV_0 2024-09-12T18:01:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.970+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9523170983586242177', time=2024-09-12T19:54:44.819984+0000, chain.objs.size()=1 2024-09-12T18:01:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.970+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.FCmp7PJflVLWX8nz-fZtNqSW4XJ2mNd_0 2024-09-12T18:01:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.970+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13934828323564313732', time=2024-09-12T19:54:44.824775+0000, chain.objs.size()=1 2024-09-12T18:01:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.970+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.XWuz7yEaFdXioEHmtg8-WmEAL50OfFU_0 2024-09-12T18:01:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.970+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.144221977166443854', time=2024-09-12T19:54:44.837103+0000, chain.objs.size()=1 2024-09-12T18:01:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.970+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.fa7GrknxNpXmsOm-6xskDOTEHYvKhKc_0 2024-09-12T18:01:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15977947212903400139', time=2024-09-12T19:54:44.847974+0000, chain.objs.size()=1 2024-09-12T18:01:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.LMXrPndulWrJdWOBskM9YrkkjbkIQ-8_0 2024-09-12T18:01:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1907616706765076018', time=2024-09-12T19:54:44.848697+0000, chain.objs.size()=1 2024-09-12T18:01:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.FcZPqKwp7rPL30UkLrAry9-9blqG1cw_0 2024-09-12T18:01:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11858177470937330191', time=2024-09-12T19:54:44.851580+0000, chain.objs.size()=1 2024-09-12T18:01:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.F4ph-pZ9amowDU_fUgE2ZsWaTZofl3C_0 2024-09-12T18:01:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12623815246085081077', time=2024-09-12T19:54:44.872046+0000, chain.objs.size()=1 2024-09-12T18:01:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.VCMDtu-ZBacN_nGKfk1IJqWDea-Nigj_0 2024-09-12T18:01:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6011490931699624561', time=2024-09-12T19:54:44.883892+0000, chain.objs.size()=1 2024-09-12T18:01:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.8mey1nceFb-ySH_rWqOQq1IjfPEkUDc_0 2024-09-12T18:01:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8900379876922205883', time=2024-09-12T19:54:44.966889+0000, chain.objs.size()=1 2024-09-12T18:01:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.uUhOp6M_3EUtvUCk1xRJgMGOuZyjE79_0 2024-09-12T18:01:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.199960409409982703', time=2024-09-12T19:54:44.990129+0000, chain.objs.size()=1 2024-09-12T18:01:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.lfICnGOJQRh0iJXnpC20SZYCmyPYsm8_0 2024-09-12T18:01:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.972+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9283328550833492447', time=2024-09-12T19:54:44.994060+0000, chain.objs.size()=1 2024-09-12T18:01:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.972+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ciSOlWSrgQccka0n1jeLi4dmNAVU_Gn_0 2024-09-12T18:01:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.972+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15024410685833227173', time=2024-09-12T19:54:45.020327+0000, chain.objs.size()=1 2024-09-12T18:01:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.972+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.3RP5JBjpB_tuRrtUcwxZPDII-5TObmd_0 2024-09-12T18:01:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.972+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10272509213114727885', time=2024-09-12T19:54:45.027741+0000, chain.objs.size()=1 2024-09-12T18:01:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.972+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.EIZ1x6tTszSPfE2_7E2jduv85rvIQwB_0 2024-09-12T18:01:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.973+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10263305872287776963', time=2024-09-12T19:54:45.032248+0000, chain.objs.size()=1 2024-09-12T18:01:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.973+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_._ogypOS7pkjxWKGXcpvxs-3agP32REl_0 2024-09-12T18:01:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.973+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12967489342926753905', time=2024-09-12T19:54:45.172967+0000, chain.objs.size()=1 2024-09-12T18:01:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.973+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.MEQ02p2f21VpVnu6c36Wc-2iQs00NKB_0 2024-09-12T18:01:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.973+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9451819666845818059', time=2024-09-12T19:54:45.205365+0000, chain.objs.size()=1 2024-09-12T18:01:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.973+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.OE1mAis78aT6eojJCVEl8EhTRfEEfYC_0 2024-09-12T18:01:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.974+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2534484718484325015', time=2024-09-12T19:54:45.238030+0000, chain.objs.size()=1 2024-09-12T18:01:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.974+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9qKrbN54hhaf_0WWaoNRi2s3K-0ojB5_0 2024-09-12T18:01:49.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.974+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17799062884886385257', time=2024-09-12T19:54:45.240790+0000, chain.objs.size()=1 2024-09-12T18:01:49.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.974+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Nv8_oV1YxaGjiQKXvW8KlLqMI_7gxGX_0 2024-09-12T18:01:49.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.975+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/53381 2024-09-12T18:01:49.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T18:01:49.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.369175568085090401', time=2024-09-12T19:54:45.338768+0000, chain.objs.size()=1 2024-09-12T18:01:49.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.imLGYsU_CbqQOiyj5XV_g2BiJX6lpe1_0 2024-09-12T18:01:49.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14453510955478502068', time=2024-09-12T19:54:45.364832+0000, chain.objs.size()=1 2024-09-12T18:01:49.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.LbW6d6oPktC66EGASrxzixeajTnSvd1_0 2024-09-12T18:01:49.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15142972639650291205', time=2024-09-12T19:54:45.394696+0000, chain.objs.size()=1 2024-09-12T18:01:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ltz6OuBKzvlhtfq2zfc0gzt6UAtrJZ3_0 2024-09-12T18:01:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7057995115636363061', time=2024-09-12T19:54:45.416843+0000, chain.objs.size()=1 2024-09-12T18:01:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.fQ2HGUvmRzmRo9mDe-BXQyS7NGzPN6h_0 2024-09-12T18:01:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17620806583946058080', time=2024-09-12T19:54:45.567675+0000, chain.objs.size()=1 2024-09-12T18:01:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jqP_ME7Th_cTiJqOY27rLFMiwPWlYs0_0 2024-09-12T18:01:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7792522348074666383', time=2024-09-12T19:54:45.569963+0000, chain.objs.size()=1 2024-09-12T18:01:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.IXwNMt7AT2rFLwXkuywf4NGcsvCNbLs_0 2024-09-12T18:01:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13009945560030180115', time=2024-09-12T19:54:45.590278+0000, chain.objs.size()=1 2024-09-12T18:01:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.oAG1U-fBdsptQSD9OCUh0nLetdsYfn0_0 2024-09-12T18:01:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4039958171095494197', time=2024-09-12T19:54:45.603900+0000, chain.objs.size()=1 2024-09-12T18:01:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.PoDVurIFMa3VakXSb8zIJJgF3HBOHI0_0 2024-09-12T18:01:49.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1266072234564024179', time=2024-09-12T19:54:45.676486+0000, chain.objs.size()=1 2024-09-12T18:01:49.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.dn3B17m_p7askF3LamPWwKjiCDIkOla_0 2024-09-12T18:01:49.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13429233156416606405', time=2024-09-12T19:54:45.706036+0000, chain.objs.size()=1 2024-09-12T18:01:49.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.am2VzITnJcvIELBkFMVPqNUjWbPmqsK_0 2024-09-12T18:01:49.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9010389223352137018', time=2024-09-12T19:54:45.724543+0000, chain.objs.size()=1 2024-09-12T18:01:49.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.4NdKa41mP4XsW8kVRfEcEGdGLC1C8tR_0 2024-09-12T18:01:49.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14473367013105723531', time=2024-09-12T19:55:14.005394+0000, chain.objs.size()=1 2024-09-12T18:01:49.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.456__shadow_.g8he_RKL18ERj-2dVlAnH86g21t0SH7_0 2024-09-12T18:01:49.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.981+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3337344055973486282', time=2024-09-12T19:55:15.776338+0000, chain.objs.size()=1 2024-09-12T18:01:49.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.981+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.461__shadow_.lUJ-apCrHqTdnZJceKykQDioxFkLwpO_0 2024-09-12T18:01:49.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15256312619695497567', time=2024-09-12T19:55:16.334263+0000, chain.objs.size()=1 2024-09-12T18:01:49.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.462__shadow_.-Ju8OH25alvgvEit9yZgniuw0EI2Yw3_0 2024-09-12T18:01:49.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.412950286041729051', time=2024-09-12T19:55:20.954606+0000, chain.objs.size()=1 2024-09-12T18:01:49.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.484__shadow_.pGO8Vzi5mrsRkMikSlecGJO7sBn_vhS_0 2024-09-12T18:01:49.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5308438509587642087', time=2024-09-12T19:55:23.261822+0000, chain.objs.size()=1 2024-09-12T18:01:49.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.492__shadow_.y56noR3R-A3pQgaKknC8iUSLobUVVt7_0 2024-09-12T18:01:49.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12538823030088865642', time=2024-09-12T19:55:26.006643+0000, chain.objs.size()=1 2024-09-12T18:01:49.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.504__shadow:LJGtw8qWDf3ub4lz88.3QWvXWYCll8k_.Bp6VPQ_fUJ9KipRh0aA-NF-t-jfxgdd_0 2024-09-12T18:01:49.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7583068176318970397', time=2024-09-12T19:55:30.185288+0000, chain.objs.size()=1 2024-09-12T18:01:49.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.519__multipart_mymultipart.2~XPTdu8l6Yd2n_HlF_OpiJUrGQU7zuvA.1 2024-09-12T18:01:49.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1556206473618549499', time=2024-09-12T19:56:24.106229+0000, chain.objs.size()=1 2024-09-12T18:01:49.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:BcB5A4SqKvf8bI76CAdfvSxZxeN59SN_.2Jowe66Ayd76GSD0B9v73cZkY6A1JCb_0 2024-09-12T18:01:49.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4576470045414227242', time=2024-09-12T19:56:27.193403+0000, chain.objs.size()=1 2024-09-12T18:01:49.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:swRXib50exH0YOyiubM60aEgnj70CpU_.n2hpQEtX4dmPaX6UhZOJvVYvnxIVelv_0 2024-09-12T18:01:49.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3301945332819208550', time=2024-09-12T19:56:33.349052+0000, chain.objs.size()=1 2024-09-12T18:01:49.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.577__shadow:K4F1350ZI8ftA8fRrlJQURko1535hjG_.7gUeUJXef6iNrg84uzxJuPTPC4A7xRf_0 2024-09-12T18:01:49.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4621386256499256614', time=2024-09-12T19:56:40.922825+0000, chain.objs.size()=1 2024-09-12T18:01:49.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:1pJ-JxAUNkngFhQ0DYzr8liyrcLWoom_.bKeaL0CeDdJIW3HbfO9B-2IcwVW4kv3_0 2024-09-12T18:01:49.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7135288372855567141', time=2024-09-12T19:56:44.553609+0000, chain.objs.size()=1 2024-09-12T18:01:49.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:k4zLCVnCfLdMAtPy7gHGb0lXSURU9Zo_.2kjfWvi8T8qdyanvg0yMVCS38cf_KPr_0 2024-09-12T18:01:49.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18320810644197342165', time=2024-09-12T19:56:52.807310+0000, chain.objs.size()=1 2024-09-12T18:01:49.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.984+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.587__shadow:QabSj9n22onzrgRkTnoKg7LZazqVWcL_.BB8ZOb-OI95rLq-Q9uPwAHNdlUHVB4m_0 2024-09-12T18:01:49.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.986+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2807148901765107112', time=2024-09-12T19:57:00.523555+0000, chain.objs.size()=6 2024-09-12T18:01:49.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.986+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.615__multipart_multipart_enc.2~TdjjrF6XWXmS1yVOpLLiHCSg7kEuSJa.1 2024-09-12T18:01:49.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.987+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.615__multipart_multipart_enc.2~TdjjrF6XWXmS1yVOpLLiHCSg7kEuSJa.2 2024-09-12T18:01:49.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.987+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.615__multipart_multipart_enc.2~TdjjrF6XWXmS1yVOpLLiHCSg7kEuSJa.3 2024-09-12T18:01:49.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.989+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.615__multipart_multipart_enc.2~TdjjrF6XWXmS1yVOpLLiHCSg7kEuSJa.4 2024-09-12T18:01:49.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.990+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.615__multipart_multipart_enc.2~TdjjrF6XWXmS1yVOpLLiHCSg7kEuSJa.5 2024-09-12T18:01:49.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.990+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.615__multipart_multipart_enc.2~TdjjrF6XWXmS1yVOpLLiHCSg7kEuSJa.6 2024-09-12T18:01:49.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.990+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10544293698604893550', time=2024-09-12T19:59:19.361860+0000, chain.objs.size()=1 2024-09-12T18:01:49.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.990+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.672__shadow_.O2fU2ttL74SEOI2OWw7VMdaGB8_yX3D_0 2024-09-12T18:01:49.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.995+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:49.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.997+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:01:49.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.999+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:49.999+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44199' 2024-09-12T18:01:50.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='_Qqdrb-aZdYZdXe1KMcsG6qQksQREABE', time=2024-09-12T19:52:55.261123+0000, chain.objs.size()=1 2024-09-12T18:01:50.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.161__shadow_.Aaw8hy1SO32JErB_UHIOdUmLY2fW58s_0 2024-09-12T18:01:50.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='_qNONc3hMxY084gxD0tLCP8TyOv0tAPt', time=2024-09-12T19:52:55.762164+0000, chain.objs.size()=2 2024-09-12T18:01:50.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.161__shadow_.mw9yayGfIKxEErMuq9352BFexdA5mJz_0 2024-09-12T18:01:50.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.161__shadow_.mw9yayGfIKxEErMuq9352BFexdA5mJz_1 2024-09-12T18:01:50.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2787020536785444343', time=2024-09-12T19:54:03.618684+0000, chain.objs.size()=1 2024-09-12T18:01:50.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.250__shadow_.hIQFmIxyjm22Ml7_pkqLXm918wmT5pJ_0 2024-09-12T18:01:50.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3354171751411711339', time=2024-09-12T19:54:05.710293+0000, chain.objs.size()=1 2024-09-12T18:01:50.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.260__shadow_.U-W_uLOeJXPrvgZPowNBuwfNb_VQvJN_0 2024-09-12T18:01:50.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12875324827607155806', time=2024-09-12T19:54:13.488708+0000, chain.objs.size()=1 2024-09-12T18:01:50.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Wd9FQqmyHB8W2_cfpTkqWumFkzIVTWi_0 2024-09-12T18:01:50.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2759548581403749465', time=2024-09-12T19:54:13.548827+0000, chain.objs.size()=1 2024-09-12T18:01:50.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.LenUO9CN33SZetAktnmMlrHl-TelX7d_0 2024-09-12T18:01:50.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8618566839195983186', time=2024-09-12T19:54:13.550504+0000, chain.objs.size()=1 2024-09-12T18:01:50.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.mp6pAPjJEUU9y2K43WVHaV-IANWO5re_0 2024-09-12T18:01:50.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5464461441981619658', time=2024-09-12T19:54:13.676229+0000, chain.objs.size()=1 2024-09-12T18:01:50.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.JI_ANIx1P-7E8qzhW83DSejWPXDxPC4_0 2024-09-12T18:01:50.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13947057428104712930', time=2024-09-12T19:54:13.700081+0000, chain.objs.size()=1 2024-09-12T18:01:50.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.1v8lLqiH77hHq0JcbT_g9JgJ5WQyfx8_0 2024-09-12T18:01:50.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.520605892517520977', time=2024-09-12T19:54:13.743964+0000, chain.objs.size()=1 2024-09-12T18:01:50.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ZS2ZITwX-w-WexohVzsv-rpgVNEeCWB_0 2024-09-12T18:01:50.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14106055133961382745', time=2024-09-12T19:54:13.745188+0000, chain.objs.size()=1 2024-09-12T18:01:50.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.001+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ww0FBnQCOfKRO09g3ysGktrYnjmnZcp_0 2024-09-12T18:01:50.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.003+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15995940399787544580', time=2024-09-12T19:54:13.749607+0000, chain.objs.size()=1 2024-09-12T18:01:50.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.003+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.iJDux3KQtlwWjeq4a8spUNbLzHLVeK8_0 2024-09-12T18:01:50.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1837168669517742725', time=2024-09-12T19:54:13.842722+0000, chain.objs.size()=1 2024-09-12T18:01:50.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.GqeAxGGYZklam36F0icoFggfqhrGoL4_0 2024-09-12T18:01:50.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11631718991158653975', time=2024-09-12T19:54:13.863775+0000, chain.objs.size()=1 2024-09-12T18:01:50.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.JkBgLLGEYTfUR7vy6I1gnJSihBj1Fy7_0 2024-09-12T18:01:50.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11453294757830385845', time=2024-09-12T19:54:13.930489+0000, chain.objs.size()=1 2024-09-12T18:01:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.uJDO541GzKrNUZWZxsd0DWiSTi9QCEL_0 2024-09-12T18:01:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4510455050402298491', time=2024-09-12T19:54:14.030970+0000, chain.objs.size()=1 2024-09-12T18:01:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.R14Hwf1XiAtqTA8VrRcWkq_H0pZDupM_0 2024-09-12T18:01:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10243800860117139663', time=2024-09-12T19:54:14.371452+0000, chain.objs.size()=1 2024-09-12T18:01:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.vYBKjP0TWo-CBAlBsV9Zpp1bHmsxdVu_0 2024-09-12T18:01:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9175672639412636194', time=2024-09-12T19:54:14.385257+0000, chain.objs.size()=1 2024-09-12T18:01:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.KG8GvENbjLKdMidhxunMpGggtlMy_uY_0 2024-09-12T18:01:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13772933502156316252', time=2024-09-12T19:54:14.432505+0000, chain.objs.size()=1 2024-09-12T18:01:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.bj6ALjIkGqdNxbYNatb_BdUEBnF1Hju_0 2024-09-12T18:01:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.241436666221642817', time=2024-09-12T19:54:14.460887+0000, chain.objs.size()=1 2024-09-12T18:01:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.pm21NfhCFsd9rkSGi5IxfsQnwucEhhK_0 2024-09-12T18:01:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.848620066012369218', time=2024-09-12T19:54:14.463005+0000, chain.objs.size()=1 2024-09-12T18:01:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.iCHGndyf9mqDxppnVvRHtYkZoiYnJYX_0 2024-09-12T18:01:50.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9870605598536388125', time=2024-09-12T19:54:14.539990+0000, chain.objs.size()=1 2024-09-12T18:01:50.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.004+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.v9NHGuWeBksK0j_qZPTBVH1-d4Vbmvi_0 2024-09-12T18:01:50.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.006+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12912951621136563640', time=2024-09-12T19:54:14.544132+0000, chain.objs.size()=1 2024-09-12T18:01:50.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.006+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.4GQ_LHuw2X19A73zeX8_oifduKjtZvY_0 2024-09-12T18:01:50.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.006+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10393016834554834354', time=2024-09-12T19:54:14.571048+0000, chain.objs.size()=1 2024-09-12T18:01:50.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.006+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Cw2gmNB_SCxlr3Ins9ZQJJxeYwIPAX0_0 2024-09-12T18:01:50.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11925943623718770904', time=2024-09-12T19:54:14.573494+0000, chain.objs.size()=1 2024-09-12T18:01:50.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Xjxh4OekZJLIhq6TvQJ5-OXIGzOybat_0 2024-09-12T18:01:50.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15022785650765336707', time=2024-09-12T19:54:14.576540+0000, chain.objs.size()=1 2024-09-12T18:01:50.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.43HO1F57tHPSJF2ZasKtDx9bNHUXxP4_0 2024-09-12T18:01:50.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16357711201625181455', time=2024-09-12T19:54:14.588276+0000, chain.objs.size()=1 2024-09-12T18:01:50.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.twtPVEpi0OOMFCkb1VdlrNLgY-Lu8ls_0 2024-09-12T18:01:50.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10080317964271581913', time=2024-09-12T19:54:14.593282+0000, chain.objs.size()=1 2024-09-12T18:01:50.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.VmIZmmSSaCUwUPRYyLlAJZPcPaax_-E_0 2024-09-12T18:01:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5399779441303460644', time=2024-09-12T19:54:14.599253+0000, chain.objs.size()=1 2024-09-12T18:01:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.rFa0xV_jjfUP4GmR_nB3IyLyb02UoPE_0 2024-09-12T18:01:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5803712398712493533', time=2024-09-12T19:54:14.714763+0000, chain.objs.size()=1 2024-09-12T18:01:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.s0PZJ84xHN1kn9AyDbF_t9TovNWHvwC_0 2024-09-12T18:01:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7421613223133793614', time=2024-09-12T19:54:14.726839+0000, chain.objs.size()=1 2024-09-12T18:01:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.5uCJkivo503OkSvNYNHVWmbSHHePrPo_0 2024-09-12T18:01:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4718865283532732606', time=2024-09-12T19:54:14.734069+0000, chain.objs.size()=1 2024-09-12T18:01:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ODSpk2vIzxAdZ4-1YMvtLUYkwiDjygn_0 2024-09-12T18:01:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17261663472252881877', time=2024-09-12T19:54:14.743574+0000, chain.objs.size()=1 2024-09-12T18:01:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.dYwduqc7cHCz1vEkzcbUKRf7v-Jc805_0 2024-09-12T18:01:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.841567951551855505', time=2024-09-12T19:54:14.775929+0000, chain.objs.size()=1 2024-09-12T18:01:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ikeyetcU1FzQPGlTW9yhGOMkkuMUy-N_0 2024-09-12T18:01:50.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4386141849851696797', time=2024-09-12T19:54:14.777438+0000, chain.objs.size()=1 2024-09-12T18:01:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.009+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Ee8MuRPQjpFy5y-W6bMvWWoqS-rS0An_0 2024-09-12T18:01:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.011+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.524280871387950201', time=2024-09-12T19:54:14.879875+0000, chain.objs.size()=1 2024-09-12T18:01:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.011+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.bkBFR9jZdLCHVfd_3o_hjp3_NUd68Q__0 2024-09-12T18:01:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.011+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4500471688018257132', time=2024-09-12T19:54:14.893132+0000, chain.objs.size()=1 2024-09-12T18:01:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.011+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.qTi-Zuph1nB6hwz2GO_cTXDgAr0_56B_0 2024-09-12T18:01:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.011+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2890847033988260717', time=2024-09-12T19:54:14.903556+0000, chain.objs.size()=1 2024-09-12T18:01:50.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.011+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Jr_LSXSgWm_5i3kNT9PN7uG-2RgRDuB_0 2024-09-12T18:01:50.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.011+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2999120929467009938', time=2024-09-12T19:54:14.907781+0000, chain.objs.size()=1 2024-09-12T18:01:50.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.011+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.CP-DzjMpAVgXZhO5rr6IZlJEYK6rmaN_0 2024-09-12T18:01:50.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.014+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14963899103117523554', time=2024-09-12T19:54:14.913673+0000, chain.objs.size()=1 2024-09-12T18:01:50.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.014+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2Nix9p_FI9Qy5SegC5lrgzN_M3kbOLy_0 2024-09-12T18:01:50.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.014+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7427496996415303618', time=2024-09-12T19:54:15.509637+0000, chain.objs.size()=1 2024-09-12T18:01:50.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.014+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.266__shadow_.E063S7SS6E-DwVNVVklTK0-wQQP-pIa_0 2024-09-12T18:01:50.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.014+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9721633775572712263', time=2024-09-12T19:54:16.729049+0000, chain.objs.size()=1 2024-09-12T18:01:50.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.014+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.272__shadow_._NEiPhs917qwMcsR9r5y6i4IFbtX_UY_0 2024-09-12T18:01:50.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8433453573603824571', time=2024-09-12T19:54:16.924120+0000, chain.objs.size()=1 2024-09-12T18:01:50.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.273__shadow_.Nk1uDgE4I2Uf8WG_NpH1ZVOyVsbKJ_f_0 2024-09-12T18:01:50.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2089395799661212862', time=2024-09-12T19:54:23.321321+0000, chain.objs.size()=1 2024-09-12T18:01:50.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.299__shadow_.ZhNvseraSnn9ANzJinSwG_2ftrm--hh_0 2024-09-12T18:01:50.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9550480858518747333', time=2024-09-12T19:54:25.656682+0000, chain.objs.size()=1 2024-09-12T18:01:50.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.308__shadow:XIjBW3bmBtfYov45HGcTuXvaYeuV79S_.UXyXIs7BICVEq7pAagwISKkPaIjSvnP_0 2024-09-12T18:01:50.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15699831936879929349', time=2024-09-12T19:54:35.924242+0000, chain.objs.size()=1 2024-09-12T18:01:50.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Hap2V_ho74pQlokZ7L5oyfUDHfXiqlP_0 2024-09-12T18:01:50.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12419277463081764961', time=2024-09-12T19:54:35.940906+0000, chain.objs.size()=1 2024-09-12T18:01:50.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.dGn_doywO9Id59orE_o5umb8EcVh_52_0 2024-09-12T18:01:50.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5808906888773553709', time=2024-09-12T19:54:35.974801+0000, chain.objs.size()=1 2024-09-12T18:01:50.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.kDjLwG4HdV4DhaxX74-FaLbZlv9ohk7_0 2024-09-12T18:01:50.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16027482508483061542', time=2024-09-12T19:54:35.981853+0000, chain.objs.size()=1 2024-09-12T18:01:50.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.5yCSeeze4Ns-zC5OZfExvgOB8-6s-0f_0 2024-09-12T18:01:50.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14722466940204347484', time=2024-09-12T19:54:35.983117+0000, chain.objs.size()=1 2024-09-12T18:01:50.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.AEVr-EVz_JrXvdBPPtyZMbH2VOUNpJ-_0 2024-09-12T18:01:50.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.019+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10668784173170389941', time=2024-09-12T19:54:35.985888+0000, chain.objs.size()=1 2024-09-12T18:01:50.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.019+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ZWDnBWpwoXFEe9-YZ7bY9fdRi8S3f16_0 2024-09-12T18:01:50.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.019+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7631638449619999966', time=2024-09-12T19:54:35.994411+0000, chain.objs.size()=1 2024-09-12T18:01:50.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.019+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.wu5QbYICvInU4nLvM1iFXNmFct4gwuL_0 2024-09-12T18:01:50.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.019+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3756577979881090743', time=2024-09-12T19:54:36.140268+0000, chain.objs.size()=1 2024-09-12T18:01:50.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.019+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-16slJWJnuVitxqsyYv_aS1HzVtFGOj_0 2024-09-12T18:01:50.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.019+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14087541012859834117', time=2024-09-12T19:54:36.150577+0000, chain.objs.size()=1 2024-09-12T18:01:50.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.019+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.NxborOXd0IiSmqL77d3VcvqL-h4mR8h_0 2024-09-12T18:01:50.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6960590112943501979', time=2024-09-12T19:54:36.159443+0000, chain.objs.size()=1 2024-09-12T18:01:50.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.efOSi3sgK1k0nsFagnpFB-wSb3TPnxT_0 2024-09-12T18:01:50.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4238851214797756445', time=2024-09-12T19:54:36.280576+0000, chain.objs.size()=1 2024-09-12T18:01:50.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.jfyA7oKLVEdjsEji52JRnoWII23ZlzX_0 2024-09-12T18:01:50.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2147507189840461623', time=2024-09-12T19:54:36.290154+0000, chain.objs.size()=1 2024-09-12T18:01:50.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.JSv5nGXSxwesSdJr2TbLHU2dWGkgSgc_0 2024-09-12T18:01:50.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12494555037720640639', time=2024-09-12T19:54:36.417239+0000, chain.objs.size()=1 2024-09-12T18:01:50.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.I8puVmZZA7uUdYBrkS-OEpx6z8MIf2S_0 2024-09-12T18:01:50.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3477159263425084402', time=2024-09-12T19:54:36.429197+0000, chain.objs.size()=1 2024-09-12T18:01:50.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.G9zV9nziXpnbuuc-KtQ1b6iV9JZluVY_0 2024-09-12T18:01:50.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10893030920757382479', time=2024-09-12T19:54:36.432963+0000, chain.objs.size()=1 2024-09-12T18:01:50.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.RRC66P-XH-exIUmriwQ6hgezyNgwYe5_0 2024-09-12T18:01:50.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5649257021389264624', time=2024-09-12T19:54:36.438392+0000, chain.objs.size()=1 2024-09-12T18:01:50.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.I0h63CAKxaU706_v03xTSECjpUiCUVT_0 2024-09-12T18:01:50.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13800050284585573107', time=2024-09-12T19:54:36.467829+0000, chain.objs.size()=1 2024-09-12T18:01:50.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.wevmFb8-cSYx1zC4AgEGcYLX5jPtpF7_0 2024-09-12T18:01:50.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11637214129135650504', time=2024-09-12T19:54:36.483523+0000, chain.objs.size()=1 2024-09-12T18:01:50.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.dmcAFECY7HSmGFif-TdGFBDB5gLt2_y_0 2024-09-12T18:01:50.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8984287721154613556', time=2024-09-12T19:54:36.496229+0000, chain.objs.size()=1 2024-09-12T18:01:50.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.xdzYSnKCCfmizAJp3sqZCqq_9rNfH5O_0 2024-09-12T18:01:50.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3082354288904589406', time=2024-09-12T19:54:36.630808+0000, chain.objs.size()=1 2024-09-12T18:01:50.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.022+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.NZ5rmbDObmag45o4rKRErlSEJZUbcDr_0 2024-09-12T18:01:50.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.024+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8592328287814550170', time=2024-09-12T19:54:36.640715+0000, chain.objs.size()=1 2024-09-12T18:01:50.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.024+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Jf-VVGxcyEf4KllwOJA0v6C9v0bOeFr_0 2024-09-12T18:01:50.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16133675948472818975', time=2024-09-12T19:54:36.756540+0000, chain.objs.size()=1 2024-09-12T18:01:50.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.q6WALafz9DXeIDCrCEjqXhCdQalp95i_0 2024-09-12T18:01:50.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6369505422382175743', time=2024-09-12T19:54:36.814559+0000, chain.objs.size()=1 2024-09-12T18:01:50.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.EvXJPWI9l30LDB0axIiTpyk0LhXZyKd_0 2024-09-12T18:01:50.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2374760407996832685', time=2024-09-12T19:54:36.902869+0000, chain.objs.size()=1 2024-09-12T18:01:50.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.TIKmNzqINOOi_Hh3GFLMbYrnToBmG3q_0 2024-09-12T18:01:50.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9674915259699915441', time=2024-09-12T19:54:36.904642+0000, chain.objs.size()=1 2024-09-12T18:01:50.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Zlfhi-jEdpPOsh3yPwDkiROnL8JeD24_0 2024-09-12T18:01:50.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12518211814664815382', time=2024-09-12T19:54:36.920162+0000, chain.objs.size()=1 2024-09-12T18:01:50.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.syHj1g0yZZw4mlOgCcX_-0QuT0mf0ti_0 2024-09-12T18:01:50.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16708571459905661062', time=2024-09-12T19:54:36.935192+0000, chain.objs.size()=1 2024-09-12T18:01:50.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-ENP7V2pa6FIb-s6_gRVAfleJrCS_rV_0 2024-09-12T18:01:50.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14420548056188195370', time=2024-09-12T19:54:36.936076+0000, chain.objs.size()=1 2024-09-12T18:01:50.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.PNQWhVbag3_YN7RQeOj9gQKc5UiHrcK_0 2024-09-12T18:01:50.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1031062809563548882', time=2024-09-12T19:54:36.951358+0000, chain.objs.size()=1 2024-09-12T18:01:50.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.2ZspUgnQI9JKf46FdYCDtVxbXLHsKvy_0 2024-09-12T18:01:50.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10188355520882943513', time=2024-09-12T19:54:36.963667+0000, chain.objs.size()=1 2024-09-12T18:01:50.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.XWfHTpjdbrmatEJCcwrr9MoNYkCGau7_0 2024-09-12T18:01:50.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4456417060557556750', time=2024-09-12T19:54:36.968623+0000, chain.objs.size()=1 2024-09-12T18:01:50.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.027+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.RkzGPj8PqHWD4_kQ1Z9dSM2_EVA6aX1_0 2024-09-12T18:01:50.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.030+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.516514201921655756', time=2024-09-12T19:54:36.970946+0000, chain.objs.size()=1 2024-09-12T18:01:50.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.030+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.b0CGFZ8QeP3FTbs-dMD6UwqmuQAa0Y1_0 2024-09-12T18:01:50.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.032+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1154124363097557285', time=2024-09-12T19:54:36.973445+0000, chain.objs.size()=1 2024-09-12T18:01:50.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.032+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.zDUW0g1UDbD1sVjzmTo9qRcMOdQ5mW3_0 2024-09-12T18:01:50.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.032+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6067843327880208363', time=2024-09-12T19:54:44.533193+0000, chain.objs.size()=1 2024-09-12T18:01:50.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.032+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.h4nzLNyv3A1wBh_CCylzG367mRxCWi8_0 2024-09-12T18:01:50.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18220096323978685528', time=2024-09-12T19:54:44.636165+0000, chain.objs.size()=1 2024-09-12T18:01:50.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ung6xUPVFsxP4Zb2PxRBeiwHO02Ob77_0 2024-09-12T18:01:50.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16680492047513293821', time=2024-09-12T19:54:44.641377+0000, chain.objs.size()=1 2024-09-12T18:01:50.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.CnrCRNiWEZPOpYUhCE_9LA5w6mMUC2v_0 2024-09-12T18:01:50.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5246748032875691911', time=2024-09-12T19:54:44.687427+0000, chain.objs.size()=1 2024-09-12T18:01:50.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.CahNN6OG_HWPnlpD9E3NG1GBLqGweHh_0 2024-09-12T18:01:50.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11413995254723030945', time=2024-09-12T19:54:44.707667+0000, chain.objs.size()=1 2024-09-12T18:01:50.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.K3G2iyk54pjOIStvK7cGYdETs3yXyE3_0 2024-09-12T18:01:50.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1714384126362184504', time=2024-09-12T19:54:44.721094+0000, chain.objs.size()=1 2024-09-12T18:01:50.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Sc8v1cUwINS4Yi9NmrVH_7_S6TOcxhy_0 2024-09-12T18:01:50.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14538337137477193808', time=2024-09-12T19:54:44.808339+0000, chain.objs.size()=1 2024-09-12T18:01:50.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.CXsZKsiqk6aShiPvgak45LxWIrGU9m5_0 2024-09-12T18:01:50.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7188757251457708481', time=2024-09-12T19:54:44.815801+0000, chain.objs.size()=1 2024-09-12T18:01:50.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.96QUEjl_sEHYaJTp6qyC7IzQKJeydpp_0 2024-09-12T18:01:50.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9504663738781144055', time=2024-09-12T19:54:44.823085+0000, chain.objs.size()=1 2024-09-12T18:01:50.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Ogms-mDKl_XsrktfubNsMOY-NJx16HN_0 2024-09-12T18:01:50.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18227072554363208839', time=2024-09-12T19:54:44.834851+0000, chain.objs.size()=1 2024-09-12T18:01:50.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.033+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.S4slqUm61FVsHG5IjHJMzTc9U5CEDPR_0 2024-09-12T18:01:50.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.034+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4907836376921424742', time=2024-09-12T19:54:44.836789+0000, chain.objs.size()=1 2024-09-12T18:01:50.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.034+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.NDaqVNz-XnRnhr-QgWPa-5qEQaPun54_0 2024-09-12T18:01:50.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.034+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13083921169569348259', time=2024-09-12T19:54:44.837523+0000, chain.objs.size()=1 2024-09-12T18:01:50.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.034+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.trzjlEjiIKkNW4qhknKbKcsghSxhIRE_0 2024-09-12T18:01:50.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.037+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12744241792940585437', time=2024-09-12T19:54:44.967421+0000, chain.objs.size()=1 2024-09-12T18:01:50.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.037+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.BCJmMFRE-XskjtCOLInUPkrCL_HhrD4_0 2024-09-12T18:01:50.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.037+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8843413317087034999', time=2024-09-12T19:54:44.988027+0000, chain.objs.size()=1 2024-09-12T18:01:50.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.037+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.GVb9guBYxM1vvoh0_aUw4LO7ZtyjJig_0 2024-09-12T18:01:50.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6515054947821223720', time=2024-09-12T19:54:44.990075+0000, chain.objs.size()=1 2024-09-12T18:01:50.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.8CBn8gzyTXT9iWsgUcHy4EsDzDUTgUl_0 2024-09-12T18:01:50.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5942417135827261776', time=2024-09-12T19:54:44.991729+0000, chain.objs.size()=1 2024-09-12T18:01:50.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.xyg3MkMMVH5ajo_ZRWZRizYB5uego4Y_0 2024-09-12T18:01:50.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11342948275304321434', time=2024-09-12T19:54:45.002357+0000, chain.objs.size()=1 2024-09-12T18:01:50.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Ivm0NJYdh7fA3JKOCT5_u6ocmXR8zTz_0 2024-09-12T18:01:50.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13608996637599963408', time=2024-09-12T19:54:45.045727+0000, chain.objs.size()=1 2024-09-12T18:01:50.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.p6FQH2w0B-yZtCaE-8HasDyNXnNPIav_0 2024-09-12T18:01:50.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16531373324781113688', time=2024-09-12T19:54:45.186259+0000, chain.objs.size()=1 2024-09-12T18:01:50.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.DUYHNHTqR6nM2UfHfrZ4-ZRnzP0gTPG_0 2024-09-12T18:01:50.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18119441306985072098', time=2024-09-12T19:54:45.206841+0000, chain.objs.size()=1 2024-09-12T18:01:50.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.oUZcjXn6v1U6JxQRiTgkM9uNJG3NKZ-_0 2024-09-12T18:01:50.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16757502655017841335', time=2024-09-12T19:54:45.347199+0000, chain.objs.size()=1 2024-09-12T18:01:50.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.zmFcCfDi9Jf4tatGxXmEunApHIGACr6_0 2024-09-12T18:01:50.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1011137574504251736', time=2024-09-12T19:54:45.372446+0000, chain.objs.size()=1 2024-09-12T18:01:50.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.tAmmoCaDlCsnS3KCB502EhxZ3nzY_M0_0 2024-09-12T18:01:50.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.040+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/44199 2024-09-12T18:01:50.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T18:01:50.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12022434381781228143', time=2024-09-12T19:54:45.406401+0000, chain.objs.size()=1 2024-09-12T18:01:50.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.bTBLlFu_TAw5agK__ZMalTy3fuKKG54_0 2024-09-12T18:01:50.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15560696926574347608', time=2024-09-12T19:54:45.530848+0000, chain.objs.size()=1 2024-09-12T18:01:50.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.zOSCtf6d5hPeFeHD9gil7l34aWhFxwB_0 2024-09-12T18:01:50.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7288805676883348913', time=2024-09-12T19:54:45.541338+0000, chain.objs.size()=1 2024-09-12T18:01:50.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.I3iow9e0QJ55OdNDsXwMX_wFcaEVloF_0 2024-09-12T18:01:50.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10039534439566082339', time=2024-09-12T19:54:45.572381+0000, chain.objs.size()=1 2024-09-12T18:01:50.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.7y725Fjb5qjIWMtlloiaoWGe3vQ-Wre_0 2024-09-12T18:01:50.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13853838825072695275', time=2024-09-12T19:54:45.574116+0000, chain.objs.size()=1 2024-09-12T18:01:50.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Hj7yN40eat4rBg_Zsz7yMlktdefeaJi_0 2024-09-12T18:01:50.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12247069442547649400', time=2024-09-12T19:54:45.590902+0000, chain.objs.size()=1 2024-09-12T18:01:50.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.BajzSoddxvMF3zZ-s9Xl2yU1TzGdnSz_0 2024-09-12T18:01:50.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1446285045857164184', time=2024-09-12T19:54:45.602162+0000, chain.objs.size()=1 2024-09-12T18:01:50.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Lxtz4KIAkiL1fR-q1uXRbQKNHuY4xX1_0 2024-09-12T18:01:50.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14533395564987001607', time=2024-09-12T19:54:45.602782+0000, chain.objs.size()=1 2024-09-12T18:01:50.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.6vd7a_R1SN1c8dUfSJEhZ2KbBIRRLIB_0 2024-09-12T18:01:50.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5263461341702271117', time=2024-09-12T19:54:45.689921+0000, chain.objs.size()=1 2024-09-12T18:01:50.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_._oXt0gwl_Yz8aHv_ZCJ3sGhZ4VYukjs_0 2024-09-12T18:01:50.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5818894440930962065', time=2024-09-12T19:54:52.790199+0000, chain.objs.size()=1 2024-09-12T18:01:50.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.368__shadow_.DoYXm0ujU_tcXCnU5B4IsPzuXnhetvc_0 2024-09-12T18:01:50.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17384050996262158111', time=2024-09-12T19:54:53.798867+0000, chain.objs.size()=1 2024-09-12T18:01:50.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.373__shadow_.SPeseHAHsnAiWZhDzi3-HzWoObuhAUL_0 2024-09-12T18:01:50.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12479590144305494914', time=2024-09-12T19:55:14.389935+0000, chain.objs.size()=1 2024-09-12T18:01:50.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.044+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.457__shadow_.zbE2gd1oBS2bq6ASCm9VUPbAo75KPSJ_0 2024-09-12T18:01:50.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.045+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2949048924131599804', time=2024-09-12T19:55:17.345773+0000, chain.objs.size()=1 2024-09-12T18:01:50.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.045+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.465__shadow_.4VvG_OeTTF472kzwTCmd2g-1YjnthJb_0 2024-09-12T18:01:50.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.045+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9665013345565571819', time=2024-09-12T19:55:24.587604+0000, chain.objs.size()=1 2024-09-12T18:01:50.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.045+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.499__shadow_.zXYWkklsUY-pfFHItk-p38oiqovlFjP_0 2024-09-12T18:01:50.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.045+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14499973940272396420', time=2024-09-12T19:55:58.664663+0000, chain.objs.size()=1 2024-09-12T18:01:50.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.045+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.537__multipart_mymultipart.2~E6mwlEvy3LKX8IaWKKhWvGrZ0H0vT--.1 2024-09-12T18:01:50.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.045+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9616659192415148070', time=2024-09-12T19:56:19.734214+0000, chain.objs.size()=2 2024-09-12T18:01:50.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.045+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.564__shadow_.clZr6Mvbcz3uypqjyWYjAu7amPEhGqz_0 2024-09-12T18:01:50.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.046+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.564__shadow_.clZr6Mvbcz3uypqjyWYjAu7amPEhGqz_1 2024-09-12T18:01:50.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.046+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13380012364425820917', time=2024-09-12T19:56:27.782767+0000, chain.objs.size()=1 2024-09-12T18:01:50.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.046+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.572__shadow_.V9OFjWQBPqM0mHwv0N_ILAgLdYUwMyZ_0 2024-09-12T18:01:50.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.046+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16753986073633324938', time=2024-09-12T19:56:56.673740+0000, chain.objs.size()=1 2024-09-12T18:01:50.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.046+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.607__shadow_.9COSbdJuAtn4lRtmXL3HhOX2CWxyVFx_0 2024-09-12T18:01:50.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.046+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13625856798950020113', time=2024-09-12T19:59:07.916533+0000, chain.objs.size()=1 2024-09-12T18:01:50.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.046+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.633__shadow_.YjdycQ1lOjggawA3CV-xi8HpJB_3uHF_0 2024-09-12T18:01:50.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.046+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5626146946520446421', time=2024-09-12T19:59:09.187794+0000, chain.objs.size()=1 2024-09-12T18:01:50.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.046+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.639__shadow_.WD-fPkabNSpDeLEDod03oCOa_qhz_TN_0 2024-09-12T18:01:50.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.046+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13749804451973495341', time=2024-09-12T19:59:18.230393+0000, chain.objs.size()=1 2024-09-12T18:01:50.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.046+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.667__shadow_.yOLSdQqu4t83EdGRHFhT0wDPSnZW9nH_0 2024-09-12T18:01:50.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.048+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.051+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:01:50.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.052+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.053+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47289' 2024-09-12T18:01:50.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15284398231921689425', time=2024-09-12T19:52:49.766863+0000, chain.objs.size()=1 2024-09-12T18:01:50.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.148__shadow_.YjXxqoptWoabNFySAwcmNlRZWrq-z7H_0 2024-09-12T18:01:50.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13058496684069670283', time=2024-09-12T19:52:59.460815+0000, chain.objs.size()=1 2024-09-12T18:01:50.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.172__shadow_.Ov4N_yvWUvaZ5mekc5vjjwgooulsXTx_0 2024-09-12T18:01:50.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11060597020277032000', time=2024-09-12T19:54:00.082765+0000, chain.objs.size()=1 2024-09-12T18:01:50.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.234__shadow_.lVAvYKQZjTTgdVvJ3XAAOCh13su3Lp__0 2024-09-12T18:01:50.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.660570160123062280', time=2024-09-12T19:54:03.419129+0000, chain.objs.size()=1 2024-09-12T18:01:50.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.249__shadow_.kmuRk9Xiqg3cUf7MlG8ncasGG3lLf7L_0 2024-09-12T18:01:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.473376312339385150', time=2024-09-12T19:54:03.820391+0000, chain.objs.size()=1 2024-09-12T18:01:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.251__shadow_.b4Lh0UicsOI2BF3ribdEGIlGC7sVCHx_0 2024-09-12T18:01:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4570861347613276073', time=2024-09-12T19:54:04.880529+0000, chain.objs.size()=1 2024-09-12T18:01:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.256__shadow_.hnIlr-xfTREtuN6hvlFEddYB8t4diEs_0 2024-09-12T18:01:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13741432934709562122', time=2024-09-12T19:54:13.499345+0000, chain.objs.size()=1 2024-09-12T18:01:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.FyVl36B4JvGynuRElYVrFZz13QYEvvI_0 2024-09-12T18:01:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12795244928702461353', time=2024-09-12T19:54:13.540379+0000, chain.objs.size()=1 2024-09-12T18:01:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.vkwfwHL0EcMFVUsHSSQzNN5YazNG1kG_0 2024-09-12T18:01:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14566379939281838305', time=2024-09-12T19:54:13.570699+0000, chain.objs.size()=1 2024-09-12T18:01:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ML7u0Wnaq8RN53pIHVW3X1yL-vsHACq_0 2024-09-12T18:01:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8470139637379724907', time=2024-09-12T19:54:13.836597+0000, chain.objs.size()=1 2024-09-12T18:01:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.bgs22QSaNYc6uWbKXszIoDPLo7NmcV3_0 2024-09-12T18:01:50.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11761788568821375548', time=2024-09-12T19:54:13.867789+0000, chain.objs.size()=1 2024-09-12T18:01:50.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.tjSh4fHnRYxb1_RMHz732a1WeRF_f3A_0 2024-09-12T18:01:50.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17430881588036096550', time=2024-09-12T19:54:13.877694+0000, chain.objs.size()=1 2024-09-12T18:01:50.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.054+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.F_WQ7vi7HBr63CBGQ0zcll1WYX7iatx_0 2024-09-12T18:01:50.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17398449065522702686', time=2024-09-12T19:54:13.883201+0000, chain.objs.size()=1 2024-09-12T18:01:50.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.KFyxhl7Gqp_DTCcnsduCghzKyGjiS_F_0 2024-09-12T18:01:50.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9503958759479883250', time=2024-09-12T19:54:13.889050+0000, chain.objs.size()=1 2024-09-12T18:01:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.WArJ34Mne4SSBBWq_V9UwW-_VQxG2sq_0 2024-09-12T18:01:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10135471239149152351', time=2024-09-12T19:54:13.902818+0000, chain.objs.size()=1 2024-09-12T18:01:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.3AtKkQn3HlrIDAmWd76PhMTtmP2k6ND_0 2024-09-12T18:01:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10377725630593322120', time=2024-09-12T19:54:13.925371+0000, chain.objs.size()=1 2024-09-12T18:01:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.CJIXdjSMImkoBeBZOEIPRy5TyRGBT1h_0 2024-09-12T18:01:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2580026210833769843', time=2024-09-12T19:54:14.005518+0000, chain.objs.size()=1 2024-09-12T18:01:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_._hOjQA9v7cU4ZKfgPEUBtnWOzvFWuFY_0 2024-09-12T18:01:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13732987476857548466', time=2024-09-12T19:54:14.416879+0000, chain.objs.size()=1 2024-09-12T18:01:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.eJAH-2ax7oJdiXxpEmCfDdxUIis43QF_0 2024-09-12T18:01:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11752658468497374191', time=2024-09-12T19:54:14.435546+0000, chain.objs.size()=1 2024-09-12T18:01:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.CC81w3yW8TJTzbaCoYBDcIVpJoO1dyl_0 2024-09-12T18:01:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8841734847912872987', time=2024-09-12T19:54:14.447656+0000, chain.objs.size()=1 2024-09-12T18:01:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.x57haGSUtFhvt_Z2rmp0Vsct62qU6m0_0 2024-09-12T18:01:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13786069820410636171', time=2024-09-12T19:54:14.451239+0000, chain.objs.size()=1 2024-09-12T18:01:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.hX99nWymp3TpCb_7o89l0JIuYMxi-lA_0 2024-09-12T18:01:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15178880182971934557', time=2024-09-12T19:54:14.543856+0000, chain.objs.size()=1 2024-09-12T18:01:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.1tpHOnGl1gmjcY3aH6f4sod0fld3Idj_0 2024-09-12T18:01:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1189407198537372519', time=2024-09-12T19:54:14.565172+0000, chain.objs.size()=1 2024-09-12T18:01:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.056+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.zIAseb8PMlHrJb9DrhfmWh0BpoUJPy4_0 2024-09-12T18:01:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2390112839343760402', time=2024-09-12T19:54:14.566677+0000, chain.objs.size()=1 2024-09-12T18:01:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Go2qQaFHp3ItXSanq9mVrIM-RQwFEtF_0 2024-09-12T18:01:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15098507627000489364', time=2024-09-12T19:54:14.580093+0000, chain.objs.size()=1 2024-09-12T18:01:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.iKbJwKLCB9U61iBbrvJR3Wvz1Fib3da_0 2024-09-12T18:01:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16275760606485759248', time=2024-09-12T19:54:14.601538+0000, chain.objs.size()=1 2024-09-12T18:01:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.KsIx61ODiDqZJ4lYeekzds_ffYW6HWY_0 2024-09-12T18:01:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18409375645959913107', time=2024-09-12T19:54:14.608526+0000, chain.objs.size()=1 2024-09-12T18:01:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.HJP1ct0AHNtMf04yIb63BLpP69x0Lm6_0 2024-09-12T18:01:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8811837838381978870', time=2024-09-12T19:54:14.618637+0000, chain.objs.size()=1 2024-09-12T18:01:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.pSFZMg95wt5zDsbOFI4oed8dTd0God__0 2024-09-12T18:01:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4059147655319556307', time=2024-09-12T19:54:14.903563+0000, chain.objs.size()=1 2024-09-12T18:01:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.U-CQzl8iG1ng2fxAGj6z6Z6gkkOKU-9_0 2024-09-12T18:01:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16219018202747889310', time=2024-09-12T19:54:14.923306+0000, chain.objs.size()=1 2024-09-12T18:01:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.hFU4CmluQh7Dicw-OwuW4M1grQoKFqA_0 2024-09-12T18:01:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8811186007569429362', time=2024-09-12T19:54:16.136879+0000, chain.objs.size()=1 2024-09-12T18:01:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.269__shadow_._FP4jXPsU_CoUBJmO_pNe3UhKdmYZ94_0 2024-09-12T18:01:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15441948230412891602', time=2024-09-12T19:54:16.334597+0000, chain.objs.size()=1 2024-09-12T18:01:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.270__shadow_.L1HeHoHaAsS6JB2WOvwhaGezcjWUPbD_0 2024-09-12T18:01:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16535029976882677010', time=2024-09-12T19:54:19.464791+0000, chain.objs.size()=1 2024-09-12T18:01:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.285__shadow_.46y-J8fRoyh8wriMF8XWs3hhbhMEJ-p_0 2024-09-12T18:01:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2878084604152826716', time=2024-09-12T19:54:21.577829+0000, chain.objs.size()=1 2024-09-12T18:01:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.058+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.DWZ7heSyCJIrmoer2J34GfZqiZr40J-_0 2024-09-12T18:01:50.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.060+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10293199271870409587', time=2024-09-12T19:54:22.159527+0000, chain.objs.size()=1 2024-09-12T18:01:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.060+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.fmLsSg7n1j_zqA61GcDL0IHnz2boVCF_0 2024-09-12T18:01:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.060+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1139127205635588882', time=2024-09-12T19:54:22.626922+0000, chain.objs.size()=1 2024-09-12T18:01:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.060+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.296__shadow_.CwsoKn-VCLMQwhwhV7Yi9oup6s30sr2_0 2024-09-12T18:01:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.060+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9908875265653956004', time=2024-09-12T19:54:35.752339+0000, chain.objs.size()=1 2024-09-12T18:01:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.060+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.b-FyMXNgAgNTK7uE8nGw-1qBSfoqJX0_0 2024-09-12T18:01:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.060+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18274706459484167759', time=2024-09-12T19:54:35.791889+0000, chain.objs.size()=1 2024-09-12T18:01:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.060+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.UoHQQrbybBdkEZddanGNkB2wDC84KNZ_0 2024-09-12T18:01:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.060+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10058814449524240211', time=2024-09-12T19:54:35.804737+0000, chain.objs.size()=1 2024-09-12T18:01:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.060+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.XLZn0NDo1fmujUf9qNO2yW-IELv2cml_0 2024-09-12T18:01:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.061+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10034781713970742858', time=2024-09-12T19:54:35.806135+0000, chain.objs.size()=1 2024-09-12T18:01:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.061+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.FoJ65R7G8HtImLe47vYA1F6c_z1hu1-_0 2024-09-12T18:01:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.061+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11354436163620815905', time=2024-09-12T19:54:35.824783+0000, chain.objs.size()=1 2024-09-12T18:01:50.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.061+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.K4qh4jq6rzaQAZ4n93cJtyKJLZkq6wb_0 2024-09-12T18:01:50.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.061+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8391382953091737229', time=2024-09-12T19:54:35.944034+0000, chain.objs.size()=1 2024-09-12T18:01:50.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.061+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4nhzjZnwDGK9Bve9sub1Clf0qnnfKmY_0 2024-09-12T18:01:50.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.061+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5725645710615089273', time=2024-09-12T19:54:35.967684+0000, chain.objs.size()=1 2024-09-12T18:01:50.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.061+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Gk5Ig07wOWw-09rZhaZDzn9H9aVDqjo_0 2024-09-12T18:01:50.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.061+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16937943371944090030', time=2024-09-12T19:54:35.980747+0000, chain.objs.size()=1 2024-09-12T18:01:50.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.061+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.NcYD2UcpMoUUDav0gYtYDHRRnWtbRyr_0 2024-09-12T18:01:50.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.061+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17940333610162598576', time=2024-09-12T19:54:35.983615+0000, chain.objs.size()=1 2024-09-12T18:01:50.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.061+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ZZgm1zSWSsGJtWKENkUI1xDgKbRHISg_0 2024-09-12T18:01:50.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.061+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2098714837075069159', time=2024-09-12T19:54:35.993574+0000, chain.objs.size()=1 2024-09-12T18:01:50.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.061+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.CbWNqbCRzU2u-h3rPqBl94ZnjR19JfP_0 2024-09-12T18:01:50.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.063+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1286537016227168469', time=2024-09-12T19:54:36.003696+0000, chain.objs.size()=1 2024-09-12T18:01:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.063+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.U1nBNicdxN_Y8X4GiLeMPmtslXcSwU6_0 2024-09-12T18:01:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.063+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7968242146034768174', time=2024-09-12T19:54:36.004462+0000, chain.objs.size()=1 2024-09-12T18:01:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.063+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.vSscscFeutVAin2Bhgudb6hjJZPYPLK_0 2024-09-12T18:01:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.063+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14166258058584460321', time=2024-09-12T19:54:36.085830+0000, chain.objs.size()=1 2024-09-12T18:01:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.063+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.GCfPmUw8zuujFYjtP3HyvUvkAIbplZp_0 2024-09-12T18:01:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.063+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10037799106727425340', time=2024-09-12T19:54:36.135246+0000, chain.objs.size()=1 2024-09-12T18:01:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.063+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-YCbVjVB9AoLwnjD3QcFfYbC3WJVDUD_0 2024-09-12T18:01:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.063+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16205249600230159895', time=2024-09-12T19:54:36.137773+0000, chain.objs.size()=1 2024-09-12T18:01:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.063+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.JnKS75wr3QcF9f9ZNL0_7nRVb9h-O6k_0 2024-09-12T18:01:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.063+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12789298227215177090', time=2024-09-12T19:54:36.164858+0000, chain.objs.size()=1 2024-09-12T18:01:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.063+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.VXEx-lFAAcjKaHtQDjJC8wq9jqxax9T_0 2024-09-12T18:01:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.063+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6404183918981976370', time=2024-09-12T19:54:36.308175+0000, chain.objs.size()=1 2024-09-12T18:01:50.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.063+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.lEERPkPdIW_-k8u8iG1Hz_kVs5Pv12X_0 2024-09-12T18:01:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.064+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17016807300257200075', time=2024-09-12T19:54:36.321915+0000, chain.objs.size()=1 2024-09-12T18:01:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.064+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Uj-SgqPs0Ud5xCE85ACyu-Mft7XR15D_0 2024-09-12T18:01:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.064+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11732743835647813506', time=2024-09-12T19:54:36.340157+0000, chain.objs.size()=1 2024-09-12T18:01:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.064+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.NpMz6su8ud4rOYU7uI8vT8hv5Abds_5_0 2024-09-12T18:01:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.064+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7279044293031165964', time=2024-09-12T19:54:36.484103+0000, chain.objs.size()=1 2024-09-12T18:01:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.064+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1X6AqpldxJ4gr8icjGEBtEbN32kFyZ-_0 2024-09-12T18:01:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.064+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5295712061122298101', time=2024-09-12T19:54:36.487772+0000, chain.objs.size()=1 2024-09-12T18:01:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.064+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.To4S3C0TXks9JhcOX_VKFp2CKEoANhl_0 2024-09-12T18:01:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.064+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7127480325350527486', time=2024-09-12T19:54:36.496234+0000, chain.objs.size()=1 2024-09-12T18:01:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.064+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.8fLm7J4P3xMKH8FUSu0ERDrw4UvXjtT_0 2024-09-12T18:01:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.064+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13062222122758260454', time=2024-09-12T19:54:36.587733+0000, chain.objs.size()=1 2024-09-12T18:01:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.064+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.gz54sEKnAmdgLmAoavpDmHcwSf3FUMl_0 2024-09-12T18:01:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.064+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3141178846804309455', time=2024-09-12T19:54:36.605923+0000, chain.objs.size()=1 2024-09-12T18:01:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.064+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Ll4S3VfLhmP1vWWA-RCqoBt5tVKTcI__0 2024-09-12T18:01:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.065+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14415562898028809081', time=2024-09-12T19:54:36.609648+0000, chain.objs.size()=1 2024-09-12T18:01:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.065+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.qj4_1hIohhKrszvaEZUTeBgDpFBac6Y_0 2024-09-12T18:01:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.065+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12507613758193591856', time=2024-09-12T19:54:36.657898+0000, chain.objs.size()=1 2024-09-12T18:01:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.065+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Oq8P1fXX92e1TPznDQbsIVYUdPWkYDC_0 2024-09-12T18:01:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.066+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5147398578045044790', time=2024-09-12T19:54:36.746002+0000, chain.objs.size()=1 2024-09-12T18:01:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.066+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Nbep95uNxBTC_3COCwAx7bmz_nKNGUa_0 2024-09-12T18:01:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.066+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6725364247814870171', time=2024-09-12T19:54:36.759109+0000, chain.objs.size()=1 2024-09-12T18:01:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.066+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.P7UexvUG8A5BMBI9fkfAjf69n7d4HES_0 2024-09-12T18:01:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.066+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14393773587478680780', time=2024-09-12T19:54:36.961157+0000, chain.objs.size()=1 2024-09-12T18:01:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.066+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.hmYcVjDAkiAx9aKoW_mBrfqL4BXDRLu_0 2024-09-12T18:01:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.066+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4929534109462235311', time=2024-09-12T19:54:44.481658+0000, chain.objs.size()=1 2024-09-12T18:01:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.067+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.yMZc8mlRIKmLvCSVGEfEbil0A-G2esa_0 2024-09-12T18:01:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.067+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6962872628897616990', time=2024-09-12T19:54:44.501043+0000, chain.objs.size()=1 2024-09-12T18:01:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.067+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ctrY-qbUEFPd1GxT1Kv7fJBDq0oYYuA_0 2024-09-12T18:01:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.067+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10019274546626157873', time=2024-09-12T19:54:44.551217+0000, chain.objs.size()=1 2024-09-12T18:01:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.067+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.LrfLqyJb37h6C1KYJa5n74AGkWx6Ugq_0 2024-09-12T18:01:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.067+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6655461422277579036', time=2024-09-12T19:54:44.633019+0000, chain.objs.size()=1 2024-09-12T18:01:50.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.067+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.t0GfN0EcxARtyTagaqAuFQ9hfSMJFjV_0 2024-09-12T18:01:50.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.067+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3970174538275862727', time=2024-09-12T19:54:44.662048+0000, chain.objs.size()=1 2024-09-12T18:01:50.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.067+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ci5PFLL3rgRMX90MGOnoAgZQyBpzsPy_0 2024-09-12T18:01:50.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.067+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14883841686395088364', time=2024-09-12T19:54:44.663686+0000, chain.objs.size()=1 2024-09-12T18:01:50.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.067+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.yfr2hBrBFEzCN5LZ19Yy0rlI8UYpioL_0 2024-09-12T18:01:50.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.067+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6833559321436975674', time=2024-09-12T19:54:44.721083+0000, chain.objs.size()=1 2024-09-12T18:01:50.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.067+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.pYVNnwhqWiTWEgHe7t-0Z3zvxcRgiwn_0 2024-09-12T18:01:50.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.067+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.987490536474614542', time=2024-09-12T19:54:44.862489+0000, chain.objs.size()=1 2024-09-12T18:01:50.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.067+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ioEFFBlHCSXRUQ60i7yKXFCc9ShMV2u_0 2024-09-12T18:01:50.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.068+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10516233426884047092', time=2024-09-12T19:54:44.872132+0000, chain.objs.size()=1 2024-09-12T18:01:50.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.068+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ne2u-mw-WB5_7Ts4VhvmkjvsLhpqexq_0 2024-09-12T18:01:50.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.068+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7724465556876900750', time=2024-09-12T19:54:44.888069+0000, chain.objs.size()=1 2024-09-12T18:01:50.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.068+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.rtRLFygen4mkAygn8tIhCYCwUFmPRCR_0 2024-09-12T18:01:50.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.068+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9545017761248509564', time=2024-09-12T19:54:44.967397+0000, chain.objs.size()=1 2024-09-12T18:01:50.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.068+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.2k7lIozhryYbvrKefphUoYcVRxBfYQa_0 2024-09-12T18:01:50.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.069+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7334659705711237902', time=2024-09-12T19:54:44.977472+0000, chain.objs.size()=1 2024-09-12T18:01:50.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.069+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.oVApzM3Pip2Lg8UMAAQF4cMZLyMQAta_0 2024-09-12T18:01:50.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.069+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12803849692433096261', time=2024-09-12T19:54:44.979581+0000, chain.objs.size()=1 2024-09-12T18:01:50.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.069+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.2X6JUA606TjkDtb3b-oXtIT6-CVZqDZ_0 2024-09-12T18:01:50.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.069+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18139933293183954992', time=2024-09-12T19:54:44.981335+0000, chain.objs.size()=1 2024-09-12T18:01:50.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.069+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.AK2D95SgfxSrpOmH_nJ7DQurxSlYV6O_0 2024-09-12T18:01:50.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.069+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16232094652984563689', time=2024-09-12T19:54:44.991182+0000, chain.objs.size()=1 2024-09-12T18:01:50.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.069+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.faVKujBkKpIjpPkPxcN7D2-QTIGv2i4_0 2024-09-12T18:01:50.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.069+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16943692947922275258', time=2024-09-12T19:54:44.992018+0000, chain.objs.size()=1 2024-09-12T18:01:50.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.069+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.BrH6fJqwkPejjqE1iYcNxZIM0a0p-UV_0 2024-09-12T18:01:50.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.069+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8153838803241445242', time=2024-09-12T19:54:45.005568+0000, chain.objs.size()=1 2024-09-12T18:01:50.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.069+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.L8JAxVDjKkwOLPL_hT0StGjvkwDDxhQ_0 2024-09-12T18:01:50.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.069+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6002178164987091024', time=2024-09-12T19:54:45.017906+0000, chain.objs.size()=1 2024-09-12T18:01:50.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.069+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.2fLezVawnj_WrGh67eJROh47sB_-DQy_0 2024-09-12T18:01:50.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.069+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16521815706509413644', time=2024-09-12T19:54:45.030080+0000, chain.objs.size()=1 2024-09-12T18:01:50.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.069+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.59uae9Dp2hd7ITmrw01-zjXPtoAIbVG_0 2024-09-12T18:01:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.070+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16849409938438161382', time=2024-09-12T19:54:45.042587+0000, chain.objs.size()=1 2024-09-12T18:01:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.070+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-CYMHwHfNYMRiffS7Wmk-_CbYA-2P5L_0 2024-09-12T18:01:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.070+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3827941522341593790', time=2024-09-12T19:54:45.046514+0000, chain.objs.size()=1 2024-09-12T18:01:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.070+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.e-i-m17kfRaZRtlty85Xe-eqw9Lm-_Q_0 2024-09-12T18:01:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.070+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6328496545421622902', time=2024-09-12T19:54:45.182213+0000, chain.objs.size()=1 2024-09-12T18:01:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.070+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.LbVBE8M_MaajrPXvUiXJUKsMGYJu2dM_0 2024-09-12T18:01:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.070+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9833546421589248598', time=2024-09-12T19:54:45.228090+0000, chain.objs.size()=1 2024-09-12T18:01:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.070+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.eIcEOq1djyFBPpd2570Z2WLpDhBEeBK_0 2024-09-12T18:01:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.070+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16208839632572670251', time=2024-09-12T19:54:45.259520+0000, chain.objs.size()=1 2024-09-12T18:01:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.070+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.C4M9qXkE-EsoiK5Ljn0gOQ6pTqxHj9e_0 2024-09-12T18:01:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.070+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6419425958068117622', time=2024-09-12T19:54:45.340417+0000, chain.objs.size()=1 2024-09-12T18:01:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.070+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.dT4GmiFa-xhi1ox04m4nmwxSJG6rzjY_0 2024-09-12T18:01:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.070+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2102323415231491623', time=2024-09-12T19:54:45.341354+0000, chain.objs.size()=1 2024-09-12T18:01:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.070+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.yMX8pV0E9hjgW4uoJrE2T8aJTIGgLGv_0 2024-09-12T18:01:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.071+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18110076832756631227', time=2024-09-12T19:54:45.346740+0000, chain.objs.size()=1 2024-09-12T18:01:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.071+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Zpiydv3bS7lbJ3W0n2aLB71zvGWA8qD_0 2024-09-12T18:01:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.071+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15287728433889373599', time=2024-09-12T19:54:45.350243+0000, chain.objs.size()=1 2024-09-12T18:01:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.071+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.4a2U7RAej0BmEh4Ps2l_KdXDrUsGmB-_0 2024-09-12T18:01:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.071+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14078934861843889765', time=2024-09-12T19:54:45.358631+0000, chain.objs.size()=1 2024-09-12T18:01:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.071+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.NKNmIpiDIctS-qtytg4P1dbtUTQ2u-s_0 2024-09-12T18:01:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.071+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17430335004073264925', time=2024-09-12T19:54:45.360377+0000, chain.objs.size()=1 2024-09-12T18:01:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.071+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.bxKon13DTd0NUfYXE3kqHS8lN92PUuj_0 2024-09-12T18:01:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.072+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9558058736925200836', time=2024-09-12T19:54:45.369951+0000, chain.objs.size()=1 2024-09-12T18:01:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.072+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.qd5OqcSLfSDSnZoW7X1HHu9m_1OClpU_0 2024-09-12T18:01:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.072+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9163269898723092875', time=2024-09-12T19:54:45.396988+0000, chain.objs.size()=1 2024-09-12T18:01:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.072+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ccl9Zx6ylfTLA1JLE-WYjikKz00o9Z__0 2024-09-12T18:01:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.072+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4180980024691692993', time=2024-09-12T19:54:45.398627+0000, chain.objs.size()=1 2024-09-12T18:01:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.072+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.0bFW8EJI7N1f4C7W8WuwmG4V57YLqwC_0 2024-09-12T18:01:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.072+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.880099826327234231', time=2024-09-12T19:54:45.399679+0000, chain.objs.size()=1 2024-09-12T18:01:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.072+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.0U1Oe46M-J9RsFKXf62jwY9XDRrhQLY_0 2024-09-12T18:01:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.072+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7281920487633046890', time=2024-09-12T19:54:45.408269+0000, chain.objs.size()=1 2024-09-12T18:01:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.072+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.U3INwWm95TCOtZkdJc1fBQU3c_3tvdk_0 2024-09-12T18:01:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.074+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/47289 2024-09-12T18:01:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.076+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T18:01:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.076+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.360626377371178227', time=2024-09-12T19:54:45.431699+0000, chain.objs.size()=1 2024-09-12T18:01:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.076+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.SLtwC-Dt0FkmPrWvAa648xB34jIHB6v_0 2024-09-12T18:01:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.076+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12840935506975854800', time=2024-09-12T19:54:45.523154+0000, chain.objs.size()=1 2024-09-12T18:01:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.076+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.wTx3uuifYKrI36xEsX0K9puB8X9fr-w_0 2024-09-12T18:01:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.076+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8612676973455704827', time=2024-09-12T19:54:45.566726+0000, chain.objs.size()=1 2024-09-12T18:01:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.076+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Vz9AmQgF5RgsX_dFNjLvK5QmQN0yAEV_0 2024-09-12T18:01:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.076+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.871482482538945649', time=2024-09-12T19:54:45.596592+0000, chain.objs.size()=1 2024-09-12T18:01:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.076+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.e6i7FJBcpC9X9Yon9GjKW7I2DNzSrnj_0 2024-09-12T18:01:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.076+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8023507282063451735', time=2024-09-12T19:54:45.714667+0000, chain.objs.size()=1 2024-09-12T18:01:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.076+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.mrOXx-IpWbNV4mUVsm51I1wTADiaHQr_0 2024-09-12T18:01:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.077+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7524029042321453429', time=2024-09-12T19:54:45.719961+0000, chain.objs.size()=1 2024-09-12T18:01:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.077+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.NBoB0wovxz8P2ZtkceEZq5CVkNQxCYr_0 2024-09-12T18:01:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.077+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2208525949885667511', time=2024-09-12T19:54:45.726513+0000, chain.objs.size()=1 2024-09-12T18:01:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.077+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.W7vdkwbVkXWStlwW2Jet9vg6ffatLoB_0 2024-09-12T18:01:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.077+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13076276312771249333', time=2024-09-12T19:54:45.727506+0000, chain.objs.size()=1 2024-09-12T18:01:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.077+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ONHCcAqGnzgQAlugaK1_dLvcCEg2hF-_0 2024-09-12T18:01:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.077+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7644984623766087498', time=2024-09-12T19:54:45.748869+0000, chain.objs.size()=1 2024-09-12T18:01:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.077+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.PQJCou6CxSH5k1x4dMck3IhquW3kHmG_0 2024-09-12T18:01:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.077+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14017134199031196612', time=2024-09-12T19:54:56.975235+0000, chain.objs.size()=1 2024-09-12T18:01:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.077+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.382__shadow_.u1zm8MZTFBDhTTco_XFSDrx6XHzOfMZ_0 2024-09-12T18:01:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.077+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11057656881701645740', time=2024-09-12T19:55:17.496135+0000, chain.objs.size()=1 2024-09-12T18:01:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.077+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.466__shadow_.WEkUeU80fHwLVAcE5Ly2SMEJ9Cd1u-X_0 2024-09-12T18:01:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.077+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10998193451007126391', time=2024-09-12T19:55:20.141687+0000, chain.objs.size()=1 2024-09-12T18:01:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.077+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.482__shadow_.Vc1VqNKZzPoAprGSNRcaUqNV2Vxxoe4_0 2024-09-12T18:01:50.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.078+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.620565271836860958', time=2024-09-12T19:55:33.124973+0000, chain.objs.size()=1 2024-09-12T18:01:50.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.078+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.521__shadow:1vSbUZW1cUdbfwzc17dMoZ0DRjZqmvk_.KeXyu7NUkmF1JokMQwNoDwcl-JXcRkE_0 2024-09-12T18:01:50.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~WidWhIq-T5XTkw9yAItXy1_3pyXa1ZM', time=2024-09-12T19:55:42.388370+0000, chain.objs.size()=1 2024-09-12T18:01:50.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.532__multipart_mymultipart2.2~WidWhIq-T5XTkw9yAItXy1_3pyXa1ZM.1 2024-09-12T18:01:50.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7418512344149500304', time=2024-09-12T19:56:13.191974+0000, chain.objs.size()=1 2024-09-12T18:01:50.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.558__shadow_.UlhufhWKHyV_LwaITkul3P33DRVpCPb_0 2024-09-12T18:01:50.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12508367711242666520', time=2024-09-12T19:56:14.045993+0000, chain.objs.size()=1 2024-09-12T18:01:50.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.559__shadow_.SATJqZC2jxJaoyLkCTdxC9JrO4hICmL_0 2024-09-12T18:01:50.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16929064653728132753', time=2024-09-12T19:56:14.788092+0000, chain.objs.size()=1 2024-09-12T18:01:50.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.561__shadow_.XeJc2BPF8zMjM5iMAtAQ-mN60jFUxHP_0 2024-09-12T18:01:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16283756036290342677', time=2024-09-12T19:56:34.327358+0000, chain.objs.size()=1 2024-09-12T18:01:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.577__shadow:uoYwhM0YuCLrrnJpoO2cZrV6UFqvhyZ_.1QMOs3dqODHCM3pbIn2u5_0zLZMa25x_0 2024-09-12T18:01:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10909122566857792727', time=2024-09-12T19:56:37.327195+0000, chain.objs.size()=1 2024-09-12T18:01:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:Xj2jRVbC5nUAjenwM9STkBb0Vs4Qn0M_.JRrUSgEaVyfTpCIfsNZr6ZSFlWxg_et_0 2024-09-12T18:01:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5100871043682534164', time=2024-09-12T19:56:51.035178+0000, chain.objs.size()=1 2024-09-12T18:01:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.581__shadow:PsApgqwqjkbnkxy08UM7ac24chJ8ng4_.28GyzXAibbB1MoeEJC895bpzvX4U1yq_0 2024-09-12T18:01:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8476517786740553653', time=2024-09-12T19:56:53.039750+0000, chain.objs.size()=1 2024-09-12T18:01:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.588__shadow:R5vVeaUHJGNgYYk8RV.R-cS.AjXs8NV_.LwKFBTLyElloU3lcZJWuQqLbrEqPqkj_0 2024-09-12T18:01:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8229703648386735083', time=2024-09-12T19:56:57.119262+0000, chain.objs.size()=1 2024-09-12T18:01:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.609__shadow_.sLheDpYEks-FBi9Kmu5HZzzOpWu84FI_0 2024-09-12T18:01:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1569941787731756961', time=2024-09-12T19:59:13.332916+0000, chain.objs.size()=1 2024-09-12T18:01:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.079+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.654__shadow_.UyW9DTflCNLsO1uM_INmgj-akZIFybN_0 2024-09-12T18:01:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.080+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4647447471588281796', time=2024-09-12T19:59:25.968683+0000, chain.objs.size()=1 2024-09-12T18:01:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.080+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.705__shadow:FI.RDnYgsoKq-CzZW5dVwzhFTKWmorC_.fAx0gEoa9RTPTveoDXl7zSmkcH4CdLk_0 2024-09-12T18:01:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.082+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.085+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:01:50.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.086+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46983' 2024-09-12T18:01:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6801508179971548245', time=2024-09-12T19:54:01.249749+0000, chain.objs.size()=1 2024-09-12T18:01:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.239__shadow_._sD-ltABG3u7liZFNNeG8m15WePgXyC_0 2024-09-12T18:01:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9554452183861705551', time=2024-09-12T19:54:02.566579+0000, chain.objs.size()=1 2024-09-12T18:01:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.245__shadow_.V7SqfaU5YM_IkT-SZpZ5fAkmLLFT0g9_0 2024-09-12T18:01:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1635434358160967143', time=2024-09-12T19:54:04.267097+0000, chain.objs.size()=1 2024-09-12T18:01:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.253__shadow_.gYPHWAUZ1LgANhOI7DV2lXy4czZp47c_0 2024-09-12T18:01:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15366067291899190173', time=2024-09-12T19:54:13.539288+0000, chain.objs.size()=1 2024-09-12T18:01:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.R1dh-GM0aod4ZsQZJQkNuYwhZ3Aj-wk_0 2024-09-12T18:01:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16637702650009551955', time=2024-09-12T19:54:13.541389+0000, chain.objs.size()=1 2024-09-12T18:01:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ctjf8BeSb9PA_MEoN5mGpzPM2leLsS3_0 2024-09-12T18:01:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5628898586096053347', time=2024-09-12T19:54:13.551181+0000, chain.objs.size()=1 2024-09-12T18:01:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.WBEid1L-juC9iPIFbhPa3n1zI5AKfMu_0 2024-09-12T18:01:50.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1432343964693051621', time=2024-09-12T19:54:13.688127+0000, chain.objs.size()=1 2024-09-12T18:01:50.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2VA7wh48uxtKHSiijY3mh_KSBnmegsK_0 2024-09-12T18:01:50.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.746831177369489570', time=2024-09-12T19:54:13.698106+0000, chain.objs.size()=1 2024-09-12T18:01:50.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.QuaYpgICnkT2Wk2o3YeoMKcb0GEvLer_0 2024-09-12T18:01:50.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.764149774231283609', time=2024-09-12T19:54:13.709104+0000, chain.objs.size()=1 2024-09-12T18:01:50.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.C3PHlsxL29RG9bCmfInesGit-5OqKNO_0 2024-09-12T18:01:50.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15409562012304265324', time=2024-09-12T19:54:13.716018+0000, chain.objs.size()=1 2024-09-12T18:01:50.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.RN4vXPovjZeKbGD79q2V2W8JAla_z_C_0 2024-09-12T18:01:50.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1055416381684758047', time=2024-09-12T19:54:13.832132+0000, chain.objs.size()=1 2024-09-12T18:01:50.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.k_bIeoXva53HQ1z4iZEo_F_2fcyEHUE_0 2024-09-12T18:01:50.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17684007500806725736', time=2024-09-12T19:54:13.862416+0000, chain.objs.size()=1 2024-09-12T18:01:50.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.087+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.8DmflZgsj2T3cklelhozYPnm8E_YMKR_0 2024-09-12T18:01:50.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.089+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9661723007648796684', time=2024-09-12T19:54:13.872762+0000, chain.objs.size()=1 2024-09-12T18:01:50.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.089+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.1dieq8NminM9EpSlsaGJGsG2cwZLBg__0 2024-09-12T18:01:50.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.089+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10418470936233259653', time=2024-09-12T19:54:13.880176+0000, chain.objs.size()=1 2024-09-12T18:01:50.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.089+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.8GHFOHqQIzJyhSyGy6lALvSZAg4Ues3_0 2024-09-12T18:01:50.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1209628168031586360', time=2024-09-12T19:54:13.881892+0000, chain.objs.size()=1 2024-09-12T18:01:50.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.FHbAiv6kAJKjJ17PaPc6aHzfjIrscgV_0 2024-09-12T18:01:50.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.806395061692715706', time=2024-09-12T19:54:13.904323+0000, chain.objs.size()=1 2024-09-12T18:01:50.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.b7b5fXC4YQqc3UzUQuFH3Mmc1Hdem5P_0 2024-09-12T18:01:50.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.252171810531817663', time=2024-09-12T19:54:13.906683+0000, chain.objs.size()=1 2024-09-12T18:01:50.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ICCuttAs6LS89feTLB9U1XD28JDMRhQ_0 2024-09-12T18:01:50.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10932265524253547266', time=2024-09-12T19:54:14.069947+0000, chain.objs.size()=1 2024-09-12T18:01:50.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.fXX3qEoasCL-KSfzEa2ZZ9AfPOZWpwD_0 2024-09-12T18:01:50.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5685454803692148638', time=2024-09-12T19:54:14.373730+0000, chain.objs.size()=1 2024-09-12T18:01:50.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.BW-vu8PNPGx9sonn59QpgoGhPP5e0ST_0 2024-09-12T18:01:50.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8069887416289852541', time=2024-09-12T19:54:14.393934+0000, chain.objs.size()=1 2024-09-12T18:01:50.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.dGc-9TL_G_6YQOvuTq4S6d06XNXymZO_0 2024-09-12T18:01:50.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8634645669013689930', time=2024-09-12T19:54:14.419789+0000, chain.objs.size()=1 2024-09-12T18:01:50.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.W3KMcr2MiF3s5zbp_R9oV3MfyFy68Vl_0 2024-09-12T18:01:50.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16009641665281069727', time=2024-09-12T19:54:14.463179+0000, chain.objs.size()=1 2024-09-12T18:01:50.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.rB1b7KH-8z5dHspGPV86czKH0GGnKsJ_0 2024-09-12T18:01:50.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10540444018425078711', time=2024-09-12T19:54:14.574180+0000, chain.objs.size()=1 2024-09-12T18:01:50.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.090+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.GqubYt_ZB2VXSJmLiSpLtC9DOOphn1v_0 2024-09-12T18:01:50.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.092+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17696829102869624893', time=2024-09-12T19:54:14.629795+0000, chain.objs.size()=1 2024-09-12T18:01:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.092+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.8jVqoIwQDtoIIhaNbsOo-zbjIzPUrWF_0 2024-09-12T18:01:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.092+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6031986598714300703', time=2024-09-12T19:54:14.755155+0000, chain.objs.size()=1 2024-09-12T18:01:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.092+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-yGHfP6EqOPjZgg54WSYC8yvAqPTgED_0 2024-09-12T18:01:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.094+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13129147451802284941', time=2024-09-12T19:54:14.775049+0000, chain.objs.size()=1 2024-09-12T18:01:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.094+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.0JhYcKoYoc9zQmwjl6U3AyzjW8w_ElH_0 2024-09-12T18:01:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.095+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3418179415472590211', time=2024-09-12T19:54:14.798246+0000, chain.objs.size()=1 2024-09-12T18:01:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.095+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ItO_Nq97MDYz5d6lFI3rcHlrwTmb_x__0 2024-09-12T18:01:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.095+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6932800608817305638', time=2024-09-12T19:54:14.803017+0000, chain.objs.size()=1 2024-09-12T18:01:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.095+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.P8UhQnqhFkOC4_hPC6HC7f2EKt36XZW_0 2024-09-12T18:01:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.095+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16386535339257193625', time=2024-09-12T19:54:14.876078+0000, chain.objs.size()=1 2024-09-12T18:01:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.095+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.beGuMZZFDxEinEU8ukdr4Zufe6PVBbT_0 2024-09-12T18:01:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.095+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5690181445746985981', time=2024-09-12T19:54:14.878652+0000, chain.objs.size()=1 2024-09-12T18:01:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.095+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.D_MPDvTSMwZnSYnJ0Y7uVwTv6aIvI3y_0 2024-09-12T18:01:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.095+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14947155323407016731', time=2024-09-12T19:54:14.889533+0000, chain.objs.size()=1 2024-09-12T18:01:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.095+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.zD4tIIfKfBa5ktCjOekyTSh2ueDpMhe_0 2024-09-12T18:01:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.095+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2283576076309064600', time=2024-09-12T19:54:14.901492+0000, chain.objs.size()=1 2024-09-12T18:01:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.095+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.1lX-VK40bsUXwyb2KC3zBjVm9bMnTtk_0 2024-09-12T18:01:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.095+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17642702395486168816', time=2024-09-12T19:54:14.927687+0000, chain.objs.size()=1 2024-09-12T18:01:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.095+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.wnkDvm30KjTaD2Z_rBz0PiiuQE0o7b__0 2024-09-12T18:01:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.095+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8958198659427214323', time=2024-09-12T19:54:14.928411+0000, chain.objs.size()=1 2024-09-12T18:01:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.095+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.EvhROjrpNEN56vp8KjuvLnY-0Rd8G8a_0 2024-09-12T18:01:50.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.097+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6555738873603196801', time=2024-09-12T19:54:14.935313+0000, chain.objs.size()=1 2024-09-12T18:01:50.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.097+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Dfx2lDuHycelcBD-si_a0BwSJLgkDPT_0 2024-09-12T18:01:50.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.097+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14696429886642919005', time=2024-09-12T19:54:14.943795+0000, chain.objs.size()=1 2024-09-12T18:01:50.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.097+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.CKCTclVrSqd05FXWqOILEQ2CuQAxXOO_0 2024-09-12T18:01:50.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.097+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.839286734835497753', time=2024-09-12T19:54:14.946225+0000, chain.objs.size()=1 2024-09-12T18:01:50.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.097+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ZWV9MpiDek5Ni7f_nFk7jlNuoW13f_C_0 2024-09-12T18:01:50.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.097+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15980648796390948088', time=2024-09-12T19:54:15.509733+0000, chain.objs.size()=1 2024-09-12T18:01:50.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.097+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.266__shadow_.LPQGHrw6Ioa33vL3TTHv3eITwwocFjL_0 2024-09-12T18:01:50.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.097+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7213955948759741231', time=2024-09-12T19:54:16.334283+0000, chain.objs.size()=1 2024-09-12T18:01:50.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.097+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.270__shadow_.uy5vsyuEmQJsEp4mgrUfy1xOtN2EWhG_0 2024-09-12T18:01:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.100+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.528782479017818127', time=2024-09-12T19:54:18.848760+0000, chain.objs.size()=1 2024-09-12T18:01:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.100+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.282__shadow_.5mB67KKI_Dj_WLacaak_RUIIlEijykw_0 2024-09-12T18:01:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.100+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12842374016596899045', time=2024-09-12T19:54:19.956207+0000, chain.objs.size()=1 2024-09-12T18:01:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.100+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.287__shadow_.Nx08Y7iVqdVFBYTUPD1qvAy6OvLXM1v_0 2024-09-12T18:01:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.100+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7430350038814800751', time=2024-09-12T19:54:21.578783+0000, chain.objs.size()=1 2024-09-12T18:01:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.100+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.Ec4YDllh0f4lTKai1A1ddvfV6q_pk1O_0 2024-09-12T18:01:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.100+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6199184678933785549', time=2024-09-12T19:54:25.656392+0000, chain.objs.size()=1 2024-09-12T18:01:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.100+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.308__shadow:.p5ZHlP3bTjExld2bkjEQHbDv78Fftk_.tN-unfcQ3KYpOWRMeQGImXg4pIZzeLd_0 2024-09-12T18:01:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.100+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5215180079012223094', time=2024-09-12T19:54:27.877101+0000, chain.objs.size()=1 2024-09-12T18:01:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.100+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.322__shadow_.gTipBaxRqgIaLRgVRTTL6P0lC_NrgUd_0 2024-09-12T18:01:50.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.100+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17661853237587079644', time=2024-09-12T19:54:35.754121+0000, chain.objs.size()=1 2024-09-12T18:01:50.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.100+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_._ko45nNLCbM9ffArWNwXqQxsqxn01Cp_0 2024-09-12T18:01:50.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.102+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12032341576619185692', time=2024-09-12T19:54:35.762602+0000, chain.objs.size()=1 2024-09-12T18:01:50.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.102+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.G1vUDEGodsb7pRj2KYeMrWSAKJj7RCm_0 2024-09-12T18:01:50.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.103+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8421291642877595213', time=2024-09-12T19:54:35.763581+0000, chain.objs.size()=1 2024-09-12T18:01:50.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.103+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.MhBPplQpyRXnJoLvZqBF9an6chTDiU__0 2024-09-12T18:01:50.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.103+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17803703983408177798', time=2024-09-12T19:54:35.776377+0000, chain.objs.size()=1 2024-09-12T18:01:50.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.103+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.FtfWuzo1JwGHnGL7a6JT1YKa1hK-d8F_0 2024-09-12T18:01:50.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.103+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4630543151186393246', time=2024-09-12T19:54:35.800243+0000, chain.objs.size()=1 2024-09-12T18:01:50.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.103+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Z1whIhEYMO0P9yXuC7TQpBEyLsi5__6_0 2024-09-12T18:01:50.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.103+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3082390014722125514', time=2024-09-12T19:54:35.812870+0000, chain.objs.size()=1 2024-09-12T18:01:50.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.103+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.gr_X8vvnv9kItqRSyoHHkUM-Jo0Fngm_0 2024-09-12T18:01:50.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.103+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.860636578745406875', time=2024-09-12T19:54:35.827136+0000, chain.objs.size()=1 2024-09-12T18:01:50.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.103+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ayDjULbdthKvT4DULhJwXAWCeWUmKbj_0 2024-09-12T18:01:50.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.105+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1253693204426999239', time=2024-09-12T19:54:35.932259+0000, chain.objs.size()=1 2024-09-12T18:01:50.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.105+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.TF0ksn3yYbxD-IStraUW6O3IsiJdoro_0 2024-09-12T18:01:50.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.105+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15924772962773408587', time=2024-09-12T19:54:35.967486+0000, chain.objs.size()=1 2024-09-12T18:01:50.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.105+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.fhSB-KN8dS6U10pKgSwaTyNXXflU3l5_0 2024-09-12T18:01:50.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.105+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7438996412514212987', time=2024-09-12T19:54:35.972844+0000, chain.objs.size()=1 2024-09-12T18:01:50.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.105+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.izfsCOfOFwe-rJeaWgUBVdBGr93OlQy_0 2024-09-12T18:01:50.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.105+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8284359716779389725', time=2024-09-12T19:54:35.994577+0000, chain.objs.size()=1 2024-09-12T18:01:50.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.105+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_._qFFKLhYlrvn-9vgOY8RKaBK58_kLXE_0 2024-09-12T18:01:50.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.105+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17413473202032862128', time=2024-09-12T19:54:36.002288+0000, chain.objs.size()=1 2024-09-12T18:01:50.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.105+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Q-hdfzSJs5po_gGJNsLsFBhYwKk4yAR_0 2024-09-12T18:01:50.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.105+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3654439907664536489', time=2024-09-12T19:54:36.085638+0000, chain.objs.size()=1 2024-09-12T18:01:50.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.105+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ODELBv54ylAitpHcIflBkA2Z2d7jk2X_0 2024-09-12T18:01:50.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.108+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17492260032932209020', time=2024-09-12T19:54:36.096066+0000, chain.objs.size()=1 2024-09-12T18:01:50.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.108+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1QLbT41vFDdWCk7GOeLi-BRXeSHX8Bl_0 2024-09-12T18:01:50.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.108+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16881630977254444259', time=2024-09-12T19:54:36.116999+0000, chain.objs.size()=1 2024-09-12T18:01:50.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.108+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.LuUF1AgNFtKPpogNeZdZiyqH5tH_xYF_0 2024-09-12T18:01:50.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.108+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7996824681275799226', time=2024-09-12T19:54:36.141437+0000, chain.objs.size()=1 2024-09-12T18:01:50.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.108+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.kJ1aeIBxpLgB5WiGf7QUhwDY4vFLFHQ_0 2024-09-12T18:01:50.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.108+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13439336055118363103', time=2024-09-12T19:54:36.150390+0000, chain.objs.size()=1 2024-09-12T18:01:50.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.108+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.HSqjxQmYNh6CDL2uP6xiLDeyg0mBSuD_0 2024-09-12T18:01:50.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.108+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.452879322464429960', time=2024-09-12T19:54:36.151363+0000, chain.objs.size()=1 2024-09-12T18:01:50.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.108+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.n6EDw7cVJchjEZNWuxm3-QqwNn9xKlj_0 2024-09-12T18:01:50.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.108+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8779418157921293946', time=2024-09-12T19:54:36.252396+0000, chain.objs.size()=1 2024-09-12T18:01:50.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.108+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.v81gTZ3LYcpHT3cveku4A6MJXXmgYLV_0 2024-09-12T18:01:50.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.108+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17473202871243559411', time=2024-09-12T19:54:36.266983+0000, chain.objs.size()=1 2024-09-12T18:01:50.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.108+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-OIOs6iORmEz6j-MuPqUFwiGKMS57el_0 2024-09-12T18:01:50.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.108+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15559518107740616906', time=2024-09-12T19:54:36.426127+0000, chain.objs.size()=1 2024-09-12T18:01:50.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.108+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.wdziW4zUNHjg4_8Ia5FCH1L-WXmqtvb_0 2024-09-12T18:01:50.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.110+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4380756324592822294', time=2024-09-12T19:54:36.462350+0000, chain.objs.size()=1 2024-09-12T18:01:50.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.110+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.NCor2BbJyAMpphjy9J-cxfQoYw52_4c_0 2024-09-12T18:01:50.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.110+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5732671161709995344', time=2024-09-12T19:54:36.481639+0000, chain.objs.size()=1 2024-09-12T18:01:50.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.110+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.TfoXvak_nNvXBr5k4LRk9QF5E1Kve_S_0 2024-09-12T18:01:50.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.110+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14046790589726317085', time=2024-09-12T19:54:36.501410+0000, chain.objs.size()=1 2024-09-12T18:01:50.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.110+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9LVI_1iq6YNVi9OG4NXa4L7LW1XUP05_0 2024-09-12T18:01:50.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.111+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4093305855509570482', time=2024-09-12T19:54:36.603196+0000, chain.objs.size()=1 2024-09-12T18:01:50.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.111+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Gb5B4nkdjrF2U6NQXC-AigrfiAhR8I2_0 2024-09-12T18:01:50.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.113+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6413222735504205250', time=2024-09-12T19:54:36.605315+0000, chain.objs.size()=1 2024-09-12T18:01:50.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.113+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.DhPaIlwaNNRXruFr0cwWJYnDBDBoIQH_0 2024-09-12T18:01:50.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.113+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4345174943639997388', time=2024-09-12T19:54:36.644130+0000, chain.objs.size()=1 2024-09-12T18:01:50.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.113+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.mnu0fq2Yes1Tlo14_Yw2_lhmiNftlau_0 2024-09-12T18:01:50.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.113+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14847627952458839466', time=2024-09-12T19:54:36.659464+0000, chain.objs.size()=1 2024-09-12T18:01:50.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.113+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.iOMw3x97QqpjTKEg35KQ6UWDZKn4kop_0 2024-09-12T18:01:50.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.113+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9792022694280074919', time=2024-09-12T19:54:36.662259+0000, chain.objs.size()=1 2024-09-12T18:01:50.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.113+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.huwuUZL9I_kgqubSoCS89AZb1XbQeQZ_0 2024-09-12T18:01:50.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.113+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7584698081917871461', time=2024-09-12T19:54:36.773187+0000, chain.objs.size()=1 2024-09-12T18:01:50.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.113+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.gWpGYDHbKuyrk0IS3ccy7qvv-HHy8Fb_0 2024-09-12T18:01:50.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.113+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16649348922926956535', time=2024-09-12T19:54:36.815059+0000, chain.objs.size()=1 2024-09-12T18:01:50.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.113+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QfcCLT52MhlhmIUPxxRg-8Sth5thEPy_0 2024-09-12T18:01:50.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.113+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9357115642045377180', time=2024-09-12T19:54:36.833211+0000, chain.objs.size()=1 2024-09-12T18:01:50.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.113+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.hBA1hXfxvFxyDkyniGLvB9Q3Bk8hadV_0 2024-09-12T18:01:50.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.115+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14852975329519650071', time=2024-09-12T19:54:36.903416+0000, chain.objs.size()=1 2024-09-12T18:01:50.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.115+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.UNJzaHay0HSGrXxk4ewnc5aurTFHi1D_0 2024-09-12T18:01:50.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12144966340228471798', time=2024-09-12T19:54:36.906665+0000, chain.objs.size()=1 2024-09-12T18:01:50.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.bnSY1vujTJ0h_RPWAu01-vDCGNXnFdv_0 2024-09-12T18:01:50.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17974683324443028097', time=2024-09-12T19:54:36.939800+0000, chain.objs.size()=1 2024-09-12T18:01:50.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.AFGM2YX2kHnXVG4ZdoXYntrm1VcdyAr_0 2024-09-12T18:01:50.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12825207011792082276', time=2024-09-12T19:54:36.948169+0000, chain.objs.size()=1 2024-09-12T18:01:50.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ZxhFS2AJkZ42uNPRHg_aBr_aw6cSbtW_0 2024-09-12T18:01:50.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.177278958451613288', time=2024-09-12T19:54:36.948936+0000, chain.objs.size()=1 2024-09-12T18:01:50.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.dHg4PJxv9A53JzKEO_VZb_8cHkO5kvl_0 2024-09-12T18:01:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2703229873062755068', time=2024-09-12T19:54:36.962980+0000, chain.objs.size()=1 2024-09-12T18:01:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.JjoGR9Zlxn3rLX7fTyz9r6mxpAiH9yw_0 2024-09-12T18:01:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13131714968984035747', time=2024-09-12T19:54:44.488895+0000, chain.objs.size()=1 2024-09-12T18:01:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.x93tFaM6AnSQbasR65fxoS3BGa_0vzs_0 2024-09-12T18:01:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2365285528622602631', time=2024-09-12T19:54:44.501917+0000, chain.objs.size()=1 2024-09-12T18:01:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TBT7Gd5ATUZtTaSh-L8kaVS2mVX-pm1_0 2024-09-12T18:01:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13032057341395864961', time=2024-09-12T19:54:44.515629+0000, chain.objs.size()=1 2024-09-12T18:01:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.h1D1ycoKU2S3gGK5A58yesnVfe8HApW_0 2024-09-12T18:01:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3469559469776491228', time=2024-09-12T19:54:44.534569+0000, chain.objs.size()=1 2024-09-12T18:01:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ZNIFqpApznMxT78TKXLic7Ukv3FERJJ_0 2024-09-12T18:01:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14374009380593351386', time=2024-09-12T19:54:44.676001+0000, chain.objs.size()=1 2024-09-12T18:01:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.116+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.8sxztaglHpMwcwdOZXPB0P0I2_CdHtw_0 2024-09-12T18:01:50.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.117+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10384625386339213648', time=2024-09-12T19:54:44.678017+0000, chain.objs.size()=1 2024-09-12T18:01:50.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.117+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Hm-ObqgKIqQtC_u0fbcFRTLPg6Uyywu_0 2024-09-12T18:01:50.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11980462307917445324', time=2024-09-12T19:54:44.808870+0000, chain.objs.size()=1 2024-09-12T18:01:50.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.OHaJ69tK9mLCUaMGSBY-aLs70y2NphU_0 2024-09-12T18:01:50.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6162409369334042633', time=2024-09-12T19:54:44.810344+0000, chain.objs.size()=1 2024-09-12T18:01:50.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.uTjDhtHWWiTzod5j7i6X7QvhEkt-6vN_0 2024-09-12T18:01:50.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3958889101269573925', time=2024-09-12T19:54:44.823524+0000, chain.objs.size()=1 2024-09-12T18:01:50.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.PLgObs_rWkFMcZQgQfNi_7mk5jlI7bE_0 2024-09-12T18:01:50.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17090363412762844681', time=2024-09-12T19:54:44.848756+0000, chain.objs.size()=1 2024-09-12T18:01:50.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.2PFJMI3ZNjL_DLc66kzG8BGDqsiYGpp_0 2024-09-12T18:01:50.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15641753317557593368', time=2024-09-12T19:54:45.037063+0000, chain.objs.size()=1 2024-09-12T18:01:50.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_._3qL_XJbjTvfvAarwUWVzVaHIKMPrEc_0 2024-09-12T18:01:50.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1486776263538486857', time=2024-09-12T19:54:45.048270+0000, chain.objs.size()=1 2024-09-12T18:01:50.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.dB2D6SAMAZOT_MO3CYFNHuBslsIRXW8_0 2024-09-12T18:01:50.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10344616389884645737', time=2024-09-12T19:54:45.057279+0000, chain.objs.size()=1 2024-09-12T18:01:50.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.65NQaobX5xwXvqnWiSG6eAW5wYF0Jpy_0 2024-09-12T18:01:50.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7682056567603420110', time=2024-09-12T19:54:45.168920+0000, chain.objs.size()=1 2024-09-12T18:01:50.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.z8YZFFnwvton4XKxxsAq3n2c8yPlwqp_0 2024-09-12T18:01:50.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7866086071321916421', time=2024-09-12T19:54:45.171450+0000, chain.objs.size()=1 2024-09-12T18:01:50.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_._jj00kI9IuPgnuGekqHcRcTm2Gdy7x1_0 2024-09-12T18:01:50.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8637140452502598079', time=2024-09-12T19:54:45.172346+0000, chain.objs.size()=1 2024-09-12T18:01:50.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.FPHNDoCETd7dmAp_aJDnO-I8WBeUz3A_0 2024-09-12T18:01:50.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6579126536528103849', time=2024-09-12T19:54:45.175305+0000, chain.objs.size()=1 2024-09-12T18:01:50.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.121+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.awVBzKCUCmWZ7ggNCAN_mNWFRrtpghf_0 2024-09-12T18:01:50.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.123+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1364359241462988215', time=2024-09-12T19:54:45.209671+0000, chain.objs.size()=1 2024-09-12T18:01:50.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.123+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.EqJVqAxvFUVgcLfJVwVRdbgX2TfGsqO_0 2024-09-12T18:01:50.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.126+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/46983 2024-09-12T18:01:50.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T18:01:50.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5622763928935125', time=2024-09-12T19:54:45.218859+0000, chain.objs.size()=1 2024-09-12T18:01:50.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.fOgmfBVEszT7i9nrh9fN-pIRFJT0rm3_0 2024-09-12T18:01:50.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14845506172618630599', time=2024-09-12T19:54:45.222280+0000, chain.objs.size()=1 2024-09-12T18:01:50.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.dJSpR15PCLjyMZUXo9WX5z3b9emEX6q_0 2024-09-12T18:01:50.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13733424774522310115', time=2024-09-12T19:54:45.232216+0000, chain.objs.size()=1 2024-09-12T18:01:50.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Dbegsn_u7PHZOxMgAkdovGmk0EC3_Jx_0 2024-09-12T18:01:50.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4096793754878036611', time=2024-09-12T19:54:45.246586+0000, chain.objs.size()=1 2024-09-12T18:01:50.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Bo1OIzzQzi6Vkrug7XgGcefvrg4GybC_0 2024-09-12T18:01:50.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1423622570212797477', time=2024-09-12T19:54:45.250203+0000, chain.objs.size()=1 2024-09-12T18:01:50.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.2bC9ER95TKfUZxZu4dStHQyJSTbBSkj_0 2024-09-12T18:01:50.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10761880100239013165', time=2024-09-12T19:54:45.338975+0000, chain.objs.size()=1 2024-09-12T18:01:50.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9OZTvNZLw88uXChw6GN3n4OC8vQ3oO8_0 2024-09-12T18:01:50.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15457464900446964306', time=2024-09-12T19:54:45.342093+0000, chain.objs.size()=1 2024-09-12T18:01:50.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.wg3uZj6qjSTATcrwUs6wmUNhGlE_HRL_0 2024-09-12T18:01:50.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14284259839055826144', time=2024-09-12T19:54:45.352133+0000, chain.objs.size()=1 2024-09-12T18:01:50.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.PPw1SjyO983aDG7T0m7KEva7HtRK4TS_0 2024-09-12T18:01:50.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11041664336304656889', time=2024-09-12T19:54:45.531384+0000, chain.objs.size()=1 2024-09-12T18:01:50.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jKdIByYLTcFk7qSaw9KFzAlVb9C9zqv_0 2024-09-12T18:01:50.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2623376748058413768', time=2024-09-12T19:54:45.534456+0000, chain.objs.size()=1 2024-09-12T18:01:50.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9n5yeBd7yhrqeQPuUeb-ZUPzJZQ9Goh_0 2024-09-12T18:01:50.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13186909909665395291', time=2024-09-12T19:54:45.557150+0000, chain.objs.size()=1 2024-09-12T18:01:50.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.IpQblQ2JHrP4RdzP45G2wROhfHSkySA_0 2024-09-12T18:01:50.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11052767265837430227', time=2024-09-12T19:54:45.563453+0000, chain.objs.size()=1 2024-09-12T18:01:50.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.128+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.sjjUtidovwkIMKEIOYXlMfo7Nzn_yIw_0 2024-09-12T18:01:50.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.130+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17531101495667909938', time=2024-09-12T19:54:45.571695+0000, chain.objs.size()=1 2024-09-12T18:01:50.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.130+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Y9PoExH6kiMhiLFPCE6K-NofNsPqIta_0 2024-09-12T18:01:50.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7457590783560206578', time=2024-09-12T19:54:45.593941+0000, chain.objs.size()=1 2024-09-12T18:01:50.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.3iHj5rsf-X60oUtfh3xsFVVIG_b7X1R_0 2024-09-12T18:01:50.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8514577776208857906', time=2024-09-12T19:54:45.597172+0000, chain.objs.size()=1 2024-09-12T18:01:50.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.2mX0XGE3XeLma_SYpte7J08OvP5Vt8V_0 2024-09-12T18:01:50.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16935318954590319730', time=2024-09-12T19:54:45.675015+0000, chain.objs.size()=1 2024-09-12T18:01:50.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.6IcqMI0AcI8izgiGzBS3pVgBoZ9fdos_0 2024-09-12T18:01:50.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14148497978579504930', time=2024-09-12T19:54:45.747095+0000, chain.objs.size()=1 2024-09-12T18:01:50.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.XtynKFU0gRnRPzTye7s5LTdMBHGgYWn_0 2024-09-12T18:01:50.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11136383071483200818', time=2024-09-12T19:54:47.384596+0000, chain.objs.size()=1 2024-09-12T18:01:50.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.334__shadow_.UnAdwM4ZbRZnpkuXgs-90d_3BsyMdzx_0 2024-09-12T18:01:50.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5745369037681795359', time=2024-09-12T19:54:55.215923+0000, chain.objs.size()=1 2024-09-12T18:01:50.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.375__shadow_.y9109kHuDDF5oGEzmX4abb3ZAJXiqui_0 2024-09-12T18:01:50.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6426385072874013717', time=2024-09-12T19:54:56.587751+0000, chain.objs.size()=1 2024-09-12T18:01:50.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.380__shadow_.v6LGWfJUBTkeBepS0zcGXusdkOlXAYe_0 2024-09-12T18:01:50.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.284210910962188315', time=2024-09-12T19:54:58.876592+0000, chain.objs.size()=1 2024-09-12T18:01:50.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.391__shadow_.RR5_tMQwJ6erU0EUHN9GqN4PUrnezFH_0 2024-09-12T18:01:50.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6572424767438993009', time=2024-09-12T19:55:17.664743+0000, chain.objs.size()=1 2024-09-12T18:01:50.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.466__shadow_.KW13RB28wBT_SBoQeBtsr1NE_whYZNj_0 2024-09-12T18:01:50.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15867292795992362346', time=2024-09-12T19:55:26.234401+0000, chain.objs.size()=1 2024-09-12T18:01:50.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.504__shadow:LJGtw8qWDf3ub4lz88.3QWvXWYCll8k_.Bp6VPQ_fUJ9KipRh0aA-NF-t-jfxgdd_0 2024-09-12T18:01:50.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8843803724079405393', time=2024-09-12T19:55:40.930588+0000, chain.objs.size()=4 2024-09-12T18:01:50.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.135+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.528__multipart_mymultipart.2~kseJ3UlfnfxS82oSuxdUDPktCP5uN_r.1 2024-09-12T18:01:50.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.137+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.528__multipart_mymultipart.2~kseJ3UlfnfxS82oSuxdUDPktCP5uN_r.2 2024-09-12T18:01:50.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.137+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.528__multipart_mymultipart.2~kseJ3UlfnfxS82oSuxdUDPktCP5uN_r.3 2024-09-12T18:01:50.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.137+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.528__multipart_mymultipart.2~kseJ3UlfnfxS82oSuxdUDPktCP5uN_r.4 2024-09-12T18:01:50.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.137+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1979592585357280644', time=2024-09-12T19:56:10.797703+0000, chain.objs.size()=1 2024-09-12T18:01:50.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.137+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.552__shadow_.ViRLyqN0N7-3DNlwU-VZXaITQ1QDPAv_0 2024-09-12T18:01:50.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.137+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.245266046079658641', time=2024-09-12T19:56:24.286952+0000, chain.objs.size()=1 2024-09-12T18:01:50.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.137+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:z1Tr.WFNzpYToj657PMZzZmK7OeDE7H_.4SB05Fo7-r17ZZU73zW8fLfx_NOC4is_0 2024-09-12T18:01:50.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.137+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7249738544062527684', time=2024-09-12T19:56:25.600518+0000, chain.objs.size()=1 2024-09-12T18:01:50.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.137+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:So2Hg5.pU-d84ESXCgBz1MsbKSA.OUP_.gTkjeR_SWrql4tt7Rsyo2naGut8J-r3_0 2024-09-12T18:01:50.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.138+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4207469492173571788', time=2024-09-12T19:59:03.149864+0000, chain.objs.size()=1 2024-09-12T18:01:50.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.138+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.619__shadow_.Yfrvfc1Ktm4l1s-2X22LFMXLtgiXEzE_0 2024-09-12T18:01:50.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.138+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7006242409873820248', time=2024-09-12T19:59:08.929948+0000, chain.objs.size()=1 2024-09-12T18:01:50.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.138+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.638__shadow_.PIjCKVEQFgK1FKeo3cNJGjjUTRVHMfV_0 2024-09-12T18:01:50.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.138+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16570868027089661282', time=2024-09-12T19:59:11.253265+0000, chain.objs.size()=1 2024-09-12T18:01:50.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.138+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.647__shadow_.Y6LFrZ5PsGcuYNcCFSIU83DLSZWQvMv_0 2024-09-12T18:01:50.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.138+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5393505791462192137', time=2024-09-12T19:59:25.524335+0000, chain.objs.size()=1 2024-09-12T18:01:50.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.138+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.703__multipart_file1.2~nSrg7M7dxXooqHOLLgFSl8I8oEDdJkz.1 2024-09-12T18:01:50.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.138+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5217174649515581247', time=2024-09-12T19:59:48.306914+0000, chain.objs.size()=1 2024-09-12T18:01:50.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.138+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.719__shadow_.iHM6n-o2LDvBRgzkVhVrYmxTIeH9d2h_0 2024-09-12T18:01:50.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.139+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7057686107501163179', time=2024-09-12T19:59:54.878672+0000, chain.objs.size()=1 2024-09-12T18:01:50.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.139+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.745__shadow_.VLEezqgxgy_FGAEnDPNLxHAwmTfcWTh_0 2024-09-12T18:01:50.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.141+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.143+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:01:50.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.145+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.146+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46086' 2024-09-12T18:01:50.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='_h8EdhYjkrIs4eesMCKRPZhOhf428lQn', time=2024-09-12T19:52:55.890292+0000, chain.objs.size()=2 2024-09-12T18:01:50.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.161__shadow_.EYSXBv2VIRk62a_p3rVtFijdQssTEcF_0 2024-09-12T18:01:50.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.161__shadow_.EYSXBv2VIRk62a_p3rVtFijdQssTEcF_1 2024-09-12T18:01:50.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17366257597787674425', time=2024-09-12T19:52:58.429672+0000, chain.objs.size()=2 2024-09-12T18:01:50.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.165__multipart_foo.2~NObICzfZydytPjUQ0qd0Y_QTMqUaRzX.1 2024-09-12T18:01:50.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.165__multipart_foo.2~NObICzfZydytPjUQ0qd0Y_QTMqUaRzX.2 2024-09-12T18:01:50.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1336817120798975662', time=2024-09-12T19:54:00.993241+0000, chain.objs.size()=1 2024-09-12T18:01:50.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.238__shadow_.jOEC8gkm4mee6Yf1mWOBLiPw23e3yxf_0 2024-09-12T18:01:50.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14035575865614961473', time=2024-09-12T19:54:00.994328+0000, chain.objs.size()=1 2024-09-12T18:01:50.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.238__shadow_.109AKUnL-XjvNeNnKWUWT82UmLjuHVz_0 2024-09-12T18:01:50.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4151652695491002516', time=2024-09-12T19:54:02.770076+0000, chain.objs.size()=1 2024-09-12T18:01:50.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.246__shadow_.XjuxMCCaU3gm8x02x1bm8FxjTeT47MI_0 2024-09-12T18:01:50.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18087126869079087345', time=2024-09-12T19:54:13.526771+0000, chain.objs.size()=1 2024-09-12T18:01:50.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ggwXsFHzRY-D7BnKkDhiV8QM4TfqxsY_0 2024-09-12T18:01:50.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10150353318504329037', time=2024-09-12T19:54:13.565939+0000, chain.objs.size()=1 2024-09-12T18:01:50.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.CcYV_DhRq7axVGUtdxfxUy8oe024sx8_0 2024-09-12T18:01:50.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17731011194002195499', time=2024-09-12T19:54:13.578561+0000, chain.objs.size()=1 2024-09-12T18:01:50.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.kr1iu28YViymrAsHVzF__dGAeglCLQL_0 2024-09-12T18:01:50.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17598355684341338645', time=2024-09-12T19:54:13.658702+0000, chain.objs.size()=1 2024-09-12T18:01:50.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.IdrFD00kfnUsdWAgKHQehvVjQnvlCMf_0 2024-09-12T18:01:50.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2382758133479383565', time=2024-09-12T19:54:13.672104+0000, chain.objs.size()=1 2024-09-12T18:01:50.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.147+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.NHMdydVPD_VJ05bL5EZncRzZ-cANEM8_0 2024-09-12T18:01:50.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3696070601971290904', time=2024-09-12T19:54:13.703673+0000, chain.objs.size()=1 2024-09-12T18:01:50.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.qhTmq8BVhNSDKgygkx1-fNsaEbb0POO_0 2024-09-12T18:01:50.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3657700822677605071', time=2024-09-12T19:54:13.726380+0000, chain.objs.size()=1 2024-09-12T18:01:50.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.8zOLkfG8RRo7PMCf7Ep14Y2t5EzoASI_0 2024-09-12T18:01:50.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.96351097517996837', time=2024-09-12T19:54:13.735703+0000, chain.objs.size()=1 2024-09-12T18:01:50.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-aRR5gb7xX3cMB3yXqt0z8rLy1S-KWX_0 2024-09-12T18:01:50.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7197760187542368637', time=2024-09-12T19:54:13.851858+0000, chain.objs.size()=1 2024-09-12T18:01:50.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.eevcejeQWPWfWooJbF77pJPe3MQdZ5l_0 2024-09-12T18:01:50.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15002665023229806097', time=2024-09-12T19:54:13.874832+0000, chain.objs.size()=1 2024-09-12T18:01:50.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.pcZS5a_fMEdQOfrgMCXOsvRxnJY-eeX_0 2024-09-12T18:01:50.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1476984237002323245', time=2024-09-12T19:54:13.896774+0000, chain.objs.size()=1 2024-09-12T18:01:50.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.w3Yf1NGaI05t9rtWj3z2p-OYBZ2h4Bt_0 2024-09-12T18:01:50.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17922657585472874058', time=2024-09-12T19:54:14.019539+0000, chain.objs.size()=1 2024-09-12T18:01:50.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.WaPMlXWc2wBPF7MxPLmuXjxZVmgjZs1_0 2024-09-12T18:01:50.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5204513266018979061', time=2024-09-12T19:54:14.030927+0000, chain.objs.size()=1 2024-09-12T18:01:50.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.zE2pBl7yPc8PbNcjv0Y2YCrFeXKPn5Z_0 2024-09-12T18:01:50.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8697834433169277253', time=2024-09-12T19:54:14.036219+0000, chain.objs.size()=1 2024-09-12T18:01:50.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.dzXq10yBhB_J8pZJ2iXiDiOtccfPKl5_0 2024-09-12T18:01:50.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12107956160651667919', time=2024-09-12T19:54:14.069537+0000, chain.objs.size()=1 2024-09-12T18:01:50.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.BzEkRTpHudq5CsgD9YTO3ejdIRPKrV4_0 2024-09-12T18:01:50.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13364227834512728264', time=2024-09-12T19:54:14.075223+0000, chain.objs.size()=1 2024-09-12T18:01:50.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.149+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.xLcculSQHggDLK4EWI6t_6gZlJCmiCV_0 2024-09-12T18:01:50.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.151+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.249021337172045965', time=2024-09-12T19:54:14.086789+0000, chain.objs.size()=1 2024-09-12T18:01:50.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.151+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.1H0AkYUQLMT7nDTqYusiGPuo1gzMiGI_0 2024-09-12T18:01:50.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.151+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6052476222662685297', time=2024-09-12T19:54:14.372796+0000, chain.objs.size()=1 2024-09-12T18:01:50.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.151+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.TCqZb96jbkM2F3HGnyz-IEeW7EMMjS9_0 2024-09-12T18:01:50.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4577571410349119593', time=2024-09-12T19:54:14.393622+0000, chain.objs.size()=1 2024-09-12T18:01:50.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.yBSrlc0cuVYrLwBgijt9yvwfqgxH6wH_0 2024-09-12T18:01:50.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6247060854318366470', time=2024-09-12T19:54:14.407053+0000, chain.objs.size()=1 2024-09-12T18:01:50.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.EvPDlS0t3A6l1WwTQG_m_FankjRs731_0 2024-09-12T18:01:50.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15015337870083826397', time=2024-09-12T19:54:14.409815+0000, chain.objs.size()=1 2024-09-12T18:01:50.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.6qzG-Uf7m3SHrHq78A2W2HB-0X2y-r__0 2024-09-12T18:01:50.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17598113800627798184', time=2024-09-12T19:54:14.558159+0000, chain.objs.size()=1 2024-09-12T18:01:50.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.KXtvAtmuz2lu34_MGRxfzyV3hj4-fc8_0 2024-09-12T18:01:50.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.936945900649489550', time=2024-09-12T19:54:14.589833+0000, chain.objs.size()=1 2024-09-12T18:01:50.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.UzcfFFzxQPPZBWCVvGOiqvHSh0C5543_0 2024-09-12T18:01:50.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2490119523803095873', time=2024-09-12T19:54:14.596810+0000, chain.objs.size()=1 2024-09-12T18:01:50.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Ro5jNpbZeL0i08qLf4RWZjFoSyTkFUI_0 2024-09-12T18:01:50.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15721679277187298616', time=2024-09-12T19:54:14.709765+0000, chain.objs.size()=1 2024-09-12T18:01:50.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.6NMu0OG68xTVP7qB1VXdxqikSexOYkj_0 2024-09-12T18:01:50.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12290644788709731983', time=2024-09-12T19:54:14.758956+0000, chain.objs.size()=1 2024-09-12T18:01:50.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.j3zTZc5PfReLrHVxPeK8CA4cPjeCBVb_0 2024-09-12T18:01:50.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9161833942480104053', time=2024-09-12T19:54:14.791200+0000, chain.objs.size()=1 2024-09-12T18:01:50.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.yo4HS3wWbu8YGecIN4Z030FW8Vw6l5R_0 2024-09-12T18:01:50.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1318239822381600227', time=2024-09-12T19:54:14.877133+0000, chain.objs.size()=1 2024-09-12T18:01:50.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.t9oforPS64rb6TOgAevOWcOIAC3FGkC_0 2024-09-12T18:01:50.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9794643402900546082', time=2024-09-12T19:54:14.944918+0000, chain.objs.size()=1 2024-09-12T18:01:50.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.152+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.fXHjOykfCnOWw7vcnnepAPiVWygfviE_0 2024-09-12T18:01:50.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.154+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18156905597007684163', time=2024-09-12T19:54:14.950805+0000, chain.objs.size()=1 2024-09-12T18:01:50.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.154+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.nXLU1_1OgZgtOlOLJGxC9ezRlvQY9Fq_0 2024-09-12T18:01:50.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.154+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7704535111981487820', time=2024-09-12T19:54:25.656401+0000, chain.objs.size()=1 2024-09-12T18:01:50.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.154+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.308__shadow:XL8QL0S7O7fZ6PySRf1E8SpMy706dpm_.xuaDYAU3V58pJlXAAw6fmBKfv1eFE51_0 2024-09-12T18:01:50.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.154+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13074649832435553998', time=2024-09-12T19:54:35.750354+0000, chain.objs.size()=1 2024-09-12T18:01:50.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.154+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.TU2CB8ZYor1pQKtEs2w4HWASgilbedm_0 2024-09-12T18:01:50.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.155+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11371956859602758127', time=2024-09-12T19:54:35.766329+0000, chain.objs.size()=1 2024-09-12T18:01:50.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.155+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.22761R-Cj6YOCnYqi-g-tQSatf2MsbF_0 2024-09-12T18:01:50.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.155+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14352752162672981060', time=2024-09-12T19:54:35.810677+0000, chain.objs.size()=1 2024-09-12T18:01:50.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.155+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.UROf9hOb8SIyyT4CTY_BPfOmDch1YAM_0 2024-09-12T18:01:50.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.155+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14294278154157223725', time=2024-09-12T19:54:35.828788+0000, chain.objs.size()=1 2024-09-12T18:01:50.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.155+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.7_uy4phMwGEbvmQsGWuJNX34jux_3sn_0 2024-09-12T18:01:50.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.155+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15625573769968640924', time=2024-09-12T19:54:35.934708+0000, chain.objs.size()=1 2024-09-12T18:01:50.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.155+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.vJfhbkO0yYFCcAfnqwhZ6GrYptTYvF5_0 2024-09-12T18:01:50.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.155+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7401693154960586386', time=2024-09-12T19:54:35.946478+0000, chain.objs.size()=1 2024-09-12T18:01:50.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.155+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9lU6PbfNub7zs1OCQOLPlVg2r3mF-t5_0 2024-09-12T18:01:50.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.155+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13480420384507332099', time=2024-09-12T19:54:35.947405+0000, chain.objs.size()=1 2024-09-12T18:01:50.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.155+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.6h-71jxg_v09OJH_R3OzBn-3kcw8z3X_0 2024-09-12T18:01:50.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.155+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9806409965908341810', time=2024-09-12T19:54:35.980267+0000, chain.objs.size()=1 2024-09-12T18:01:50.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.155+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.d8XMzTr-yXFeCp5wyg2HiJXzSC3p15d_0 2024-09-12T18:01:50.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.155+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17875689824254983891', time=2024-09-12T19:54:36.004150+0000, chain.objs.size()=1 2024-09-12T18:01:50.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.155+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.g9QXzKM6xuXWhFCS9-ua2YegggrRD5s_0 2024-09-12T18:01:50.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.156+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4445277559092068822', time=2024-09-12T19:54:36.006511+0000, chain.objs.size()=1 2024-09-12T18:01:50.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.156+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.oS-bkAWpXFhIwGLcS2INiFKBqE2_Aop_0 2024-09-12T18:01:50.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.156+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10747033403101300107', time=2024-09-12T19:54:36.096959+0000, chain.objs.size()=1 2024-09-12T18:01:50.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.156+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.5KfZkJoRTpYxK0MtipJP2qcyfckrrKR_0 2024-09-12T18:01:50.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.156+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6839616378677538701', time=2024-09-12T19:54:36.105733+0000, chain.objs.size()=1 2024-09-12T18:01:50.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.156+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.nBHLxNiYMQJzxBJPsmx3iSHGsBYPIDO_0 2024-09-12T18:01:50.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.157+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2101736187675086520', time=2024-09-12T19:54:36.116629+0000, chain.objs.size()=1 2024-09-12T18:01:50.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.157+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.C4Dr-blD_5crVjvXcnx6GlH0KXhmWis_0 2024-09-12T18:01:50.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.157+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17018152026385944551', time=2024-09-12T19:54:36.294484+0000, chain.objs.size()=1 2024-09-12T18:01:50.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.157+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.WtUZ7uNzpme_jYMdfcoKLdKXwtG0NTL_0 2024-09-12T18:01:50.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.157+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4838520972215579480', time=2024-09-12T19:54:36.296410+0000, chain.objs.size()=1 2024-09-12T18:01:50.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.157+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1hKTSyqsho3K6V3nEq4wNdiTDw7oie5_0 2024-09-12T18:01:50.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.157+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9321299023892913848', time=2024-09-12T19:54:36.320033+0000, chain.objs.size()=1 2024-09-12T18:01:50.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.157+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9TtNA8F2H8CZWqOxh--zqOAkWuYqX68_0 2024-09-12T18:01:50.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.158+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5949449980766227526', time=2024-09-12T19:54:36.422815+0000, chain.objs.size()=1 2024-09-12T18:01:50.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.158+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.oW_l9y2Aa-sIQ6ldWoiS9DkVVdwjNiW_0 2024-09-12T18:01:50.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.158+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10051139639389822841', time=2024-09-12T19:54:36.447569+0000, chain.objs.size()=1 2024-09-12T18:01:50.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.158+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.FR1CJZG6T6XBCS2k4eb0E22moEX5AAp_0 2024-09-12T18:01:50.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.158+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15458938506667911930', time=2024-09-12T19:54:36.459425+0000, chain.objs.size()=1 2024-09-12T18:01:50.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.158+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.HKXNw6Dfs7NttIeza1lfpawfNRlV0Xb_0 2024-09-12T18:01:50.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.158+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3071688175996493051', time=2024-09-12T19:54:36.461098+0000, chain.objs.size()=1 2024-09-12T18:01:50.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.158+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.JuYHKld9NMzalEgltKyTjdfMCweGheY_0 2024-09-12T18:01:50.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.159+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5193257019986364694', time=2024-09-12T19:54:36.498717+0000, chain.objs.size()=1 2024-09-12T18:01:50.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.159+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.HcgL_NX9ikQ7uLk6dI-hgcwIunP3hZ2_0 2024-09-12T18:01:50.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.159+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11406485198675884088', time=2024-09-12T19:54:36.597653+0000, chain.objs.size()=1 2024-09-12T18:01:50.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.159+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9BNOLwkJ1tEebpepua_auHXceXSvcJA_0 2024-09-12T18:01:50.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.159+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11616954298473239175', time=2024-09-12T19:54:36.609454+0000, chain.objs.size()=1 2024-09-12T18:01:50.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.159+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ukzZaBiXwuB_p4WzZJ-zfC6FlDHTGA__0 2024-09-12T18:01:50.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.159+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3631071741896259034', time=2024-09-12T19:54:36.654905+0000, chain.objs.size()=1 2024-09-12T18:01:50.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.159+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.AP8oXP57tocaNiXex4t7qFTEwlO8ghM_0 2024-09-12T18:01:50.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15518474108410172056', time=2024-09-12T19:54:36.742087+0000, chain.objs.size()=1 2024-09-12T18:01:50.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.nCnQ_rxDd1jX7U9HB0YsRo7O5E-gOFe_0 2024-09-12T18:01:50.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12796074521012508389', time=2024-09-12T19:54:36.747714+0000, chain.objs.size()=1 2024-09-12T18:01:50.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Tew_JGHbqq-blR6dxIkD8pfYy8-UZzD_0 2024-09-12T18:01:50.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15064037311242103010', time=2024-09-12T19:54:36.765045+0000, chain.objs.size()=1 2024-09-12T18:01:50.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.U5-mfb3xEINJkxlDysvFzIJeuuXAZRf_0 2024-09-12T18:01:50.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14540122034626306047', time=2024-09-12T19:54:36.771362+0000, chain.objs.size()=1 2024-09-12T18:01:50.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.efgQ_cHF4mAohV8cXWKZIIZPONtYM8m_0 2024-09-12T18:01:50.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2118092957738939595', time=2024-09-12T19:54:36.801010+0000, chain.objs.size()=1 2024-09-12T18:01:50.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4CkLlrKNCqoSnQtr_EiPYM90HJUxgXP_0 2024-09-12T18:01:50.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16048250407687663135', time=2024-09-12T19:54:36.821547+0000, chain.objs.size()=1 2024-09-12T18:01:50.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1XjPK3rxp19MvdW87mOc9oRLOavgR5u_0 2024-09-12T18:01:50.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5601823128018013571', time=2024-09-12T19:54:36.917981+0000, chain.objs.size()=1 2024-09-12T18:01:50.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.d7o1rQAOJPAXnIP4Y2hMckwDfPWsLzo_0 2024-09-12T18:01:50.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14543715202319477783', time=2024-09-12T19:54:36.937731+0000, chain.objs.size()=1 2024-09-12T18:01:50.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.50gS7g-Jf7UHkUsdJWDtKETqvmf0swA_0 2024-09-12T18:01:50.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.160+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14719626048362396619', time=2024-09-12T19:54:36.944726+0000, chain.objs.size()=1 2024-09-12T18:01:50.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.161+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Pc9vTuN7sysRwg6iuBTeLazKn2Od0jU_0 2024-09-12T18:01:50.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.161+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5803424174086677785', time=2024-09-12T19:54:44.456805+0000, chain.objs.size()=1 2024-09-12T18:01:50.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.161+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.C-_NldGYIrFmJsVXYvlqxbaHsws6ozf_0 2024-09-12T18:01:50.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.161+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.795470462745093553', time=2024-09-12T19:54:44.457670+0000, chain.objs.size()=1 2024-09-12T18:01:50.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.161+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.EBTQ8KEASF-eM5CR8bAM6SgznbIHVOW_0 2024-09-12T18:01:50.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.162+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12078187631777892692', time=2024-09-12T19:54:44.482729+0000, chain.objs.size()=1 2024-09-12T18:01:50.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.162+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.J6apggjD0G_PZRg6zce0kUMYBeq23-F_0 2024-09-12T18:01:50.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.163+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1093477958155913873', time=2024-09-12T19:54:44.545685+0000, chain.objs.size()=1 2024-09-12T18:01:50.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.163+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.cvdW84GRRSjzQhI0-hYr2190CaITtnf_0 2024-09-12T18:01:50.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.163+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13988108746116701604', time=2024-09-12T19:54:44.633104+0000, chain.objs.size()=1 2024-09-12T18:01:50.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.163+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ZXRkkarDlWvsNh3l67qYKr-X_tW3H-2_0 2024-09-12T18:01:50.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.163+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2262906725900251177', time=2024-09-12T19:54:44.633939+0000, chain.objs.size()=1 2024-09-12T18:01:50.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.163+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_._BkqkEJrg1kkuleO0SS0zW48wpMev6m_0 2024-09-12T18:01:50.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.163+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11710591797238636722', time=2024-09-12T19:54:44.708960+0000, chain.objs.size()=1 2024-09-12T18:01:50.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.163+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.hk7bvyuLwoKtTPokaU7r_vCYK3xEYpm_0 2024-09-12T18:01:50.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.163+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17628540443900448397', time=2024-09-12T19:54:44.714256+0000, chain.objs.size()=1 2024-09-12T18:01:50.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.163+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.bg-bXfPv29_f6yAfv00ZQJR8fokJai3_0 2024-09-12T18:01:50.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14837380185524007035', time=2024-09-12T19:54:44.721197+0000, chain.objs.size()=1 2024-09-12T18:01:50.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jmDpWmWwqtvOXZNJCy70lxWTHSbqy4q_0 2024-09-12T18:01:50.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10125625333974123422', time=2024-09-12T19:54:44.797915+0000, chain.objs.size()=1 2024-09-12T18:01:50.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.7iWKmNia2rI-96DqN0fL7erb3XOtqXj_0 2024-09-12T18:01:50.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18064350756300732884', time=2024-09-12T19:54:44.810490+0000, chain.objs.size()=1 2024-09-12T18:01:50.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Cs9uRisBg6qsZU6ZVfXJvYx0sbdov0G_0 2024-09-12T18:01:50.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16832399333943852956', time=2024-09-12T19:54:44.811535+0000, chain.objs.size()=1 2024-09-12T18:01:50.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.JHwBjJ3w0zM1sk5nj3Dw7jtabwz5O1L_0 2024-09-12T18:01:50.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13259792636896460434', time=2024-09-12T19:54:44.816232+0000, chain.objs.size()=1 2024-09-12T18:01:50.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.b8S4THlAl_2hZktqJgRilksL8UaHk7a_0 2024-09-12T18:01:50.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14059098786708400273', time=2024-09-12T19:54:44.841143+0000, chain.objs.size()=1 2024-09-12T18:01:50.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.mHntTpvb5squMN1B7a6Be36xl_3fCBC_0 2024-09-12T18:01:50.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12000366198969740103', time=2024-09-12T19:54:44.848132+0000, chain.objs.size()=1 2024-09-12T18:01:50.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9dePvRkOnhHWEL_VOmj1wUoN49-gtIc_0 2024-09-12T18:01:50.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16490841096283640074', time=2024-09-12T19:54:44.854046+0000, chain.objs.size()=1 2024-09-12T18:01:50.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.qAlmCuuEJlRqykL4lgyqW0PZ3pnleiw_0 2024-09-12T18:01:50.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13636837587247011817', time=2024-09-12T19:54:45.007666+0000, chain.objs.size()=1 2024-09-12T18:01:50.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.bM8KWOjKp0r9F-0ZQPaNnMG47xNojW3_0 2024-09-12T18:01:50.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17337067060070839142', time=2024-09-12T19:54:45.028273+0000, chain.objs.size()=1 2024-09-12T18:01:50.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.164+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.5BlOCZazRIfLHDoBOV_AavIz-tRja2y_0 2024-09-12T18:01:50.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.165+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17775411418710830783', time=2024-09-12T19:54:45.040000+0000, chain.objs.size()=1 2024-09-12T18:01:50.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.165+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.S8SCrJb0hJLDCgEA2m2kc-ZR3ZZsV_s_0 2024-09-12T18:01:50.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.166+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.674224927936779071', time=2024-09-12T19:54:45.042809+0000, chain.objs.size()=1 2024-09-12T18:01:50.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.166+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.m-crvS3RVIXJQMFqE275qwjxYADPQOS_0 2024-09-12T18:01:50.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.166+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13613660089453971226', time=2024-09-12T19:54:45.048884+0000, chain.objs.size()=1 2024-09-12T18:01:50.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.166+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.qyscVH0W2Db1ADAD2WufSea6VrAjjTe_0 2024-09-12T18:01:50.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.166+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2200003888544978086', time=2024-09-12T19:54:45.171932+0000, chain.objs.size()=1 2024-09-12T18:01:50.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.166+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.qDesX8X9qcT2RrYRUDi1wraGcN_q7aX_0 2024-09-12T18:01:50.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.166+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13393807041894050658', time=2024-09-12T19:54:45.173286+0000, chain.objs.size()=1 2024-09-12T18:01:50.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.166+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-_XGZqpu8eKQmIyThOTQXCnSXHUm793_0 2024-09-12T18:01:50.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.166+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6420729531645664453', time=2024-09-12T19:54:45.182350+0000, chain.objs.size()=1 2024-09-12T18:01:50.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.166+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.valUp013RREr0wU3QReYXydFa-q3VDj_0 2024-09-12T18:01:50.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.166+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6237745151972713682', time=2024-09-12T19:54:45.185372+0000, chain.objs.size()=1 2024-09-12T18:01:50.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.166+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.eILYv_K2U2tHbMG78dDpbjgwr2rOXN2_0 2024-09-12T18:01:50.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.166+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14420689683843087526', time=2024-09-12T19:54:45.188021+0000, chain.objs.size()=1 2024-09-12T18:01:50.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.166+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.yUekzDJuYrMM_GfIScTZ5c9hBBnpsBB_0 2024-09-12T18:01:50.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.166+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1476882664525897251', time=2024-09-12T19:54:45.189653+0000, chain.objs.size()=1 2024-09-12T18:01:50.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.166+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Q-4EtCwqf0Ye52KcipX4eok8fU5nmz6_0 2024-09-12T18:01:50.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.169+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11443376673017631133', time=2024-09-12T19:54:45.209242+0000, chain.objs.size()=1 2024-09-12T18:01:50.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.169+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jzxArTACvD5WE9BB2kScwDS4uheyLMf_0 2024-09-12T18:01:50.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.169+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8949399263435506313', time=2024-09-12T19:54:45.224027+0000, chain.objs.size()=1 2024-09-12T18:01:50.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.169+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.i1J4Srl0nxAq0kNSFJIpphTA6W80HBS_0 2024-09-12T18:01:50.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.169+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9896066183518681031', time=2024-09-12T19:54:45.250061+0000, chain.objs.size()=1 2024-09-12T18:01:50.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.169+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.LGYJTUA9TTcTCNJewitfdKqOoB1slst_0 2024-09-12T18:01:50.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.172+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12346820366145517124', time=2024-09-12T19:54:45.251120+0000, chain.objs.size()=1 2024-09-12T18:01:50.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.172+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.nwFWJQ3FntqY2ZchRXChl8fvwJdlZCe_0 2024-09-12T18:01:50.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.177+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/46086 2024-09-12T18:01:50.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T18:01:50.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.505174136798860346', time=2024-09-12T19:54:45.373533+0000, chain.objs.size()=1 2024-09-12T18:01:50.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.5LnYdg_o3zZQX66Tlu5IdHkNkCZuu2A_0 2024-09-12T18:01:50.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.868400754963675387', time=2024-09-12T19:54:45.407656+0000, chain.objs.size()=1 2024-09-12T18:01:50.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Gyu62xGU6cpr-tPaxHIQYDgQs3LiOXW_0 2024-09-12T18:01:50.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9505445922871190663', time=2024-09-12T19:54:45.424985+0000, chain.objs.size()=1 2024-09-12T18:01:50.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.gs4FXLx2XNqY0qevBX05QH7dSSpSv2z_0 2024-09-12T18:01:50.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9847068306369934655', time=2024-09-12T19:54:45.430118+0000, chain.objs.size()=1 2024-09-12T18:01:50.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Qdr0JPtkTNfjXQgyVv_q1-HSVGzZGoG_0 2024-09-12T18:01:50.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16051398100034348198', time=2024-09-12T19:54:45.524883+0000, chain.objs.size()=1 2024-09-12T18:01:50.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.6tzyrsy9ZYcV0IxBfhcbqsL3ivfuuiM_0 2024-09-12T18:01:50.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16818858989249289717', time=2024-09-12T19:54:45.525892+0000, chain.objs.size()=1 2024-09-12T18:01:50.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.WyjTAgfkdpO4vPE1H3tgFrSTmRRJdbM_0 2024-09-12T18:01:50.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8712471714652815563', time=2024-09-12T19:54:45.545143+0000, chain.objs.size()=1 2024-09-12T18:01:50.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.YASDytHgEbtr3DIdKGQD9W9MMT0DMb2_0 2024-09-12T18:01:50.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10972211891004903885', time=2024-09-12T19:54:45.596528+0000, chain.objs.size()=1 2024-09-12T18:01:50.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.cercIorgkyfv26c-ha1pcKYRaF0_bim_0 2024-09-12T18:01:50.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15950058558681271982', time=2024-09-12T19:54:45.678423+0000, chain.objs.size()=1 2024-09-12T18:01:50.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.M8NfPu2nh-U5XS5SaE5VHMHAGLnFM0A_0 2024-09-12T18:01:50.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9281435226386491432', time=2024-09-12T19:54:45.685001+0000, chain.objs.size()=1 2024-09-12T18:01:50.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.hWVeEtwD3MAjKeP518_iXDtLVGQ6bc-_0 2024-09-12T18:01:50.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10891241984159918147', time=2024-09-12T19:54:45.689847+0000, chain.objs.size()=1 2024-09-12T18:01:50.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.dBPvEMtmqu3CEA6Q0p8Lo1NGVCOCotk_0 2024-09-12T18:01:50.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17622408273536523983', time=2024-09-12T19:54:45.717978+0000, chain.objs.size()=1 2024-09-12T18:01:50.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.179+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.LUSqqWYt_vdktT833IZ3krw9NfMjY9F_0 2024-09-12T18:01:50.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9614250639659429683', time=2024-09-12T19:54:45.736795+0000, chain.objs.size()=1 2024-09-12T18:01:50.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.XlTwdHe7fajIGKzeBIALblL76QEv_Ns_0 2024-09-12T18:01:50.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11682225974858336518', time=2024-09-12T19:54:45.740052+0000, chain.objs.size()=1 2024-09-12T18:01:50.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.lTF2_8FY6ms4x0leThOcQQiGJ8Skz_X_0 2024-09-12T18:01:50.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5519466105532841590', time=2024-09-12T19:54:49.020897+0000, chain.objs.size()=1 2024-09-12T18:01:50.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.342__shadow_.kQkuhoIS8Udh43FfX1PkAumtXdgeuh__0 2024-09-12T18:01:50.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5169756520945155667', time=2024-09-12T19:54:55.852597+0000, chain.objs.size()=1 2024-09-12T18:01:50.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.378__shadow_.UQAt9MklU5WOxs90es6ZDPAlH7zgz4C_0 2024-09-12T18:01:50.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16560635616930585060', time=2024-09-12T19:55:14.005041+0000, chain.objs.size()=1 2024-09-12T18:01:50.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.456__shadow_.Wo1mj_anyuYIuXXFtdex7AsLpExBdDa_0 2024-09-12T18:01:50.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4123382578615890710', time=2024-09-12T19:55:24.587706+0000, chain.objs.size()=1 2024-09-12T18:01:50.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.499__shadow_.zXYWkklsUY-pfFHItk-p38oiqovlFjP_0 2024-09-12T18:01:50.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12119632185040365167', time=2024-09-12T19:55:26.008529+0000, chain.objs.size()=1 2024-09-12T18:01:50.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.504__shadow:LJGtw8qWDf3ub4lz88.3QWvXWYCll8k_.Bp6VPQ_fUJ9KipRh0aA-NF-t-jfxgdd_0 2024-09-12T18:01:50.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11442900211387091317', time=2024-09-12T19:55:30.574498+0000, chain.objs.size()=1 2024-09-12T18:01:50.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.518__shadow_.K6aIO05KxUXiteu7Mddhr-mXViBACMw_0 2024-09-12T18:01:50.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1376892904517631873', time=2024-09-12T19:55:41.279934+0000, chain.objs.size()=1 2024-09-12T18:01:50.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.529__shadow_.RtPpALaSLp5Xs-Jek4k0vmmgmtNGByc_0 2024-09-12T18:01:50.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.816052042662892413', time=2024-09-12T19:56:13.291009+0000, chain.objs.size()=1 2024-09-12T18:01:50.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.558__shadow_.Z4Rw9RymLA7Cd_N1vc-u2uuTdCGzvQX_0 2024-09-12T18:01:50.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9768600868917978353', time=2024-09-12T19:56:13.413763+0000, chain.objs.size()=1 2024-09-12T18:01:50.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.183+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.558__shadow_.thnQdB9cAGI6Nk3e-Nmp53BskoxOg4W_0 2024-09-12T18:01:50.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15925506617648218301', time=2024-09-12T19:56:14.348984+0000, chain.objs.size()=1 2024-09-12T18:01:50.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.560__shadow_.0Bz2kqK3HRWD5aGtTn0DcOOHdEkjIRz_0 2024-09-12T18:01:50.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8386661190157929102', time=2024-09-12T19:56:19.996401+0000, chain.objs.size()=1 2024-09-12T18:01:50.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.565__shadow_.4W3wiaGBZd7Cp4hmS38MPqlyFPFnK1k_0 2024-09-12T18:01:50.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18013932634022295028', time=2024-09-12T19:56:52.803241+0000, chain.objs.size()=1 2024-09-12T18:01:50.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.587__shadow:8l.hXPUmIkxHK-WHwrdi5B.ZviBE8.F_.hSuMdLLxNIsZv29MlQH6-6dlTIhI63__0 2024-09-12T18:01:50.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1508359607320167928', time=2024-09-12T19:56:56.897985+0000, chain.objs.size()=1 2024-09-12T18:01:50.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.608__shadow_.X1Rzta7ewyXY-CWR9NMzlhUQjm_FzE5_0 2024-09-12T18:01:50.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6166028762302746405', time=2024-09-12T19:56:59.240422+0000, chain.objs.size()=6 2024-09-12T18:01:50.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.614__multipart_multipart_enc.2~xedf0Wxjei7-0AGSiP55BdDrAgVKSuj.1 2024-09-12T18:01:50.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.614__multipart_multipart_enc.2~xedf0Wxjei7-0AGSiP55BdDrAgVKSuj.2 2024-09-12T18:01:50.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.614__multipart_multipart_enc.2~xedf0Wxjei7-0AGSiP55BdDrAgVKSuj.3 2024-09-12T18:01:50.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.614__multipart_multipart_enc.2~xedf0Wxjei7-0AGSiP55BdDrAgVKSuj.4 2024-09-12T18:01:50.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.614__multipart_multipart_enc.2~xedf0Wxjei7-0AGSiP55BdDrAgVKSuj.5 2024-09-12T18:01:50.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.614__multipart_multipart_enc.2~xedf0Wxjei7-0AGSiP55BdDrAgVKSuj.6 2024-09-12T18:01:50.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11309437284505865105', time=2024-09-12T19:58:02.042733+0000, chain.objs.size()=1 2024-09-12T18:01:50.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.189+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.618__shadow_.wFR1iFEIeqf3pMah22LkzvI-dK7aCSQ_0 2024-09-12T18:01:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10420094113713258274', time=2024-09-12T19:59:06.819204+0000, chain.objs.size()=1 2024-09-12T18:01:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.628__shadow_.UBVQArHYUeCsWo2GN-TLszXxMsiln5A_0 2024-09-12T18:01:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18307935322410594407', time=2024-09-12T19:59:10.287682+0000, chain.objs.size()=1 2024-09-12T18:01:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.644__shadow_.T3izUHif5JICRDiNP1gofXgQzw3KpDd_0 2024-09-12T18:01:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3850877321106149684', time=2024-09-12T19:59:14.236434+0000, chain.objs.size()=1 2024-09-12T18:01:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.657__shadow_.BlMm_e_lT1EZ_2YlQoPhJjpa-gF8Z4w_0 2024-09-12T18:01:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1856760679079231508', time=2024-09-12T19:59:16.773155+0000, chain.objs.size()=6 2024-09-12T18:01:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.662__multipart_baz.2~uw4WHZMERr-db4WnIcinfU-kKviBgcB.1 2024-09-12T18:01:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.662__multipart_baz.2~uw4WHZMERr-db4WnIcinfU-kKviBgcB.2 2024-09-12T18:01:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.662__multipart_baz.2~uw4WHZMERr-db4WnIcinfU-kKviBgcB.3 2024-09-12T18:01:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.662__multipart_baz.2~uw4WHZMERr-db4WnIcinfU-kKviBgcB.4 2024-09-12T18:01:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.662__multipart_baz.2~uw4WHZMERr-db4WnIcinfU-kKviBgcB.5 2024-09-12T18:01:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.662__multipart_baz.2~uw4WHZMERr-db4WnIcinfU-kKviBgcB.6 2024-09-12T18:01:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16217250281589841230', time=2024-09-12T19:59:53.501295+0000, chain.objs.size()=1 2024-09-12T18:01:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.741__shadow_.PPgaJw9csBH13xrt2xzYrRE9W7a579o_0 2024-09-12T18:01:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2949808617449402143', time=2024-09-12T20:01:36.944341+0000, chain.objs.size()=1 2024-09-12T18:01:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.194+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.783__shadow_.vHfY_YCtdRZWDma2xHgk13S938NykPk_0 2024-09-12T18:01:50.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.202+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.205+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:01:50.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.207+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.207+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47653' 2024-09-12T18:01:50.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='_Wgj8CH0AdBcAj6sZvPgfQYiNnySvOv5', time=2024-09-12T19:52:57.333253+0000, chain.objs.size()=2 2024-09-12T18:01:50.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__shadow_.9Zw_tgN1KJ6wE1Jp4OVhNFn5tqEULKc_0 2024-09-12T18:01:50.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__shadow_.9Zw_tgN1KJ6wE1Jp4OVhNFn5tqEULKc_1 2024-09-12T18:01:50.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='_UUXoqklePhlsoUD_NtgnCLninN2DjOb', time=2024-09-12T19:52:57.911756+0000, chain.objs.size()=1 2024-09-12T18:01:50.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.164__shadow_.VI7vzXKj7lRcVdZoOa-r2GzwNMe_-Lc_0 2024-09-12T18:01:50.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5913513250765927451', time=2024-09-12T19:54:00.531178+0000, chain.objs.size()=1 2024-09-12T18:01:50.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.236__shadow_.5oNM8ijNENtIBvwNfnP4WncB-DOGq1X_0 2024-09-12T18:01:50.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3052458982341554518', time=2024-09-12T19:54:01.847713+0000, chain.objs.size()=1 2024-09-12T18:01:50.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.242__shadow_.YxrXXPN3D1Gfmy_iYH-9aCuSQQJDlMC_0 2024-09-12T18:01:50.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8764079446954760446', time=2024-09-12T19:54:03.419310+0000, chain.objs.size()=1 2024-09-12T18:01:50.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.249__shadow_.AEeHhENJW0tpJh-91JLria3z_HE4SPE_0 2024-09-12T18:01:50.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4840155213617911957', time=2024-09-12T19:54:05.912392+0000, chain.objs.size()=1 2024-09-12T18:01:50.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.261__shadow_.bOKKbMbS1oJA4eZn6_Tar0BklV9yy0B_0 2024-09-12T18:01:50.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1868096689721188460', time=2024-09-12T19:54:13.483313+0000, chain.objs.size()=1 2024-09-12T18:01:50.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.FhjIh08K_dzurkAlcRNSzuRVlqIjcy0_0 2024-09-12T18:01:50.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17345458619956500210', time=2024-09-12T19:54:13.509534+0000, chain.objs.size()=1 2024-09-12T18:01:50.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.sp6of2b2vw7WT5loASdTG3QnkbitPEi_0 2024-09-12T18:01:50.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12837998770041202898', time=2024-09-12T19:54:13.516543+0000, chain.objs.size()=1 2024-09-12T18:01:50.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.SBoHIng1DxZ7MXjEhwcABB7g3AlqxOj_0 2024-09-12T18:01:50.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3214595852820610533', time=2024-09-12T19:54:13.573244+0000, chain.objs.size()=1 2024-09-12T18:01:50.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.208+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.LrSVu1Gz3Z30hqjLBm8hbBNeWrmDumH_0 2024-09-12T18:01:50.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.209+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16788411893182325132', time=2024-09-12T19:54:13.657169+0000, chain.objs.size()=1 2024-09-12T18:01:50.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.209+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.n0pN_TPHiUu0oOVdA9Qatos2YctBMib_0 2024-09-12T18:01:50.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16329866042877245166', time=2024-09-12T19:54:13.710660+0000, chain.objs.size()=1 2024-09-12T18:01:50.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.xjKItFWs-fRUvPSXoTLQ9mfQ7iJ-_TU_0 2024-09-12T18:01:50.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.941298387995384803', time=2024-09-12T19:54:13.712020+0000, chain.objs.size()=1 2024-09-12T18:01:50.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.7nRPBETmyUslkHjsT4XczFyg-H32F2T_0 2024-09-12T18:01:50.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11015436513835487061', time=2024-09-12T19:54:13.833563+0000, chain.objs.size()=1 2024-09-12T18:01:50.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.6X8iS4bkFt3IpOh2CfkdSAVNXQwGMzC_0 2024-09-12T18:01:50.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1838890967028650014', time=2024-09-12T19:54:13.845171+0000, chain.objs.size()=1 2024-09-12T18:01:50.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.QDMtTt7_lakskocw82-8LNT42TJbIoQ_0 2024-09-12T18:01:50.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9160804482302879501', time=2024-09-12T19:54:13.928142+0000, chain.objs.size()=1 2024-09-12T18:01:50.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-P4_kcrCiEVizxAileMhgrXFzhEYzsm_0 2024-09-12T18:01:50.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8806833395668507835', time=2024-09-12T19:54:14.037415+0000, chain.objs.size()=1 2024-09-12T18:01:50.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.1Ed3l2hpVs18J64S2C2hACEHScY4os0_0 2024-09-12T18:01:50.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7953644346347075075', time=2024-09-12T19:54:14.041874+0000, chain.objs.size()=1 2024-09-12T18:01:50.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.DGf07aQVlkvfrMSSQzEDBKsnqy4YW8k_0 2024-09-12T18:01:50.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1257267160581118437', time=2024-09-12T19:54:14.072721+0000, chain.objs.size()=1 2024-09-12T18:01:50.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2XqjDZfIL5G9fp_oDFHt8nnqqEQlYY1_0 2024-09-12T18:01:50.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17026459994816455788', time=2024-09-12T19:54:14.403653+0000, chain.objs.size()=1 2024-09-12T18:01:50.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.OjtLVtsbA7h0OuRDpQHb7d9P1-veRRO_0 2024-09-12T18:01:50.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12798719090510529641', time=2024-09-12T19:54:14.410621+0000, chain.objs.size()=1 2024-09-12T18:01:50.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.uXkhzTh1f8L04pa_DNHwtokGeyMOYqI_0 2024-09-12T18:01:50.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4523768666294018090', time=2024-09-12T19:54:14.411347+0000, chain.objs.size()=1 2024-09-12T18:01:50.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.213+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.NZO3-IhQsqu0Qejd3ysnwkmip1Yx1fO_0 2024-09-12T18:01:50.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.215+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5609057775722048184', time=2024-09-12T19:54:14.413509+0000, chain.objs.size()=1 2024-09-12T18:01:50.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.215+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.WjwqF6otrQx_bf5IuYOAMSVOJIpwEox_0 2024-09-12T18:01:50.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.215+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15360231042802721865', time=2024-09-12T19:54:14.426243+0000, chain.objs.size()=1 2024-09-12T18:01:50.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.215+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.uKhAsRfEDmaFG0EZ-zhRR_cXEfqiSXM_0 2024-09-12T18:01:50.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.215+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1951119652096869353', time=2024-09-12T19:54:14.434886+0000, chain.objs.size()=1 2024-09-12T18:01:50.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.215+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.0OAV8hJ1TB5z39D3SNnZQBHon7kQSl8_0 2024-09-12T18:01:50.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.217+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15438595464657930951', time=2024-09-12T19:54:14.579461+0000, chain.objs.size()=1 2024-09-12T18:01:50.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.217+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ZcNMpNiV4zEywRApRVbHqQGjrazeRqG_0 2024-09-12T18:01:50.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.217+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2515720273992455636', time=2024-09-12T19:54:14.595851+0000, chain.objs.size()=1 2024-09-12T18:01:50.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.217+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.iSQ4cKkUtFpQ2DjMAD12NrcGYgZft_3_0 2024-09-12T18:01:50.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.217+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16181949855973815473', time=2024-09-12T19:54:14.628752+0000, chain.objs.size()=1 2024-09-12T18:01:50.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.217+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.lk2VaJm5qySo3fThlvQauV1kxp-pdjS_0 2024-09-12T18:01:50.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.217+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11585218642004377876', time=2024-09-12T19:54:14.633116+0000, chain.objs.size()=1 2024-09-12T18:01:50.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.217+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.v4nJoQ3JJVyz6n5Ys_F-H_EGVmkBQQE_0 2024-09-12T18:01:50.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.217+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6827466488986366120', time=2024-09-12T19:54:14.710407+0000, chain.objs.size()=1 2024-09-12T18:01:50.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.217+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.JTeXJLZgqkdZ50-O3wD7BrypbnlN5Tz_0 2024-09-12T18:01:50.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.220+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11193559528012681534', time=2024-09-12T19:54:14.746047+0000, chain.objs.size()=1 2024-09-12T18:01:50.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.220+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.V4KrDmCO-ozE5WRiWu4c772gc5DNAEh_0 2024-09-12T18:01:50.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.220+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17231087790301276205', time=2024-09-12T19:54:14.770813+0000, chain.objs.size()=1 2024-09-12T18:01:50.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.220+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.amolnAdriXrwWlKCVWKveprdZaEe3t6_0 2024-09-12T18:01:50.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.220+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13667297954866775942', time=2024-09-12T19:54:14.905036+0000, chain.objs.size()=1 2024-09-12T18:01:50.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.220+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.fkx08kXvUxei3QmYppFezKKkKAadvgT_0 2024-09-12T18:01:50.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.220+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4764328237495610318', time=2024-09-12T19:54:14.914133+0000, chain.objs.size()=1 2024-09-12T18:01:50.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.220+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.hi84u1DMAGvyyPfvvJzB8BPuqbIfgVX_0 2024-09-12T18:01:50.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.220+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13976137113995648000', time=2024-09-12T19:54:17.354532+0000, chain.objs.size()=1 2024-09-12T18:01:50.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.220+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.275__shadow_.CNpAn_6Ec1owZFSKXbHW1UdS04wcIjx_0 2024-09-12T18:01:50.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.220+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2452795723260119068', time=2024-09-12T19:54:19.464630+0000, chain.objs.size()=1 2024-09-12T18:01:50.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.220+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.285__shadow_.Ek5_D9mj0qxbtxEOuwsBSeQe7e2e6zD_0 2024-09-12T18:01:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.222+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17336252710719007500', time=2024-09-12T19:54:21.586940+0000, chain.objs.size()=1 2024-09-12T18:01:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.222+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.wxy1Xs2m1WHseBacJFtNbM-vFPIDaA8_0 2024-09-12T18:01:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.222+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15630584105423338185', time=2024-09-12T19:54:22.158894+0000, chain.objs.size()=1 2024-09-12T18:01:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.222+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.NjXXMCaL4hlA1As93dW_W0_2ptqH-ZC_0 2024-09-12T18:01:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.222+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.129501761362911137', time=2024-09-12T19:54:22.161222+0000, chain.objs.size()=1 2024-09-12T18:01:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.222+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.TT6LblTyHOnAG4VGIhQnvAT-bWhjBF9_0 2024-09-12T18:01:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.222+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3163244454762754348', time=2024-09-12T19:54:35.805364+0000, chain.objs.size()=1 2024-09-12T18:01:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.222+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.sJs4-YYvOKZ5zuwjW9EjoPuZERc_fw3_0 2024-09-12T18:01:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.222+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.420223399773894606', time=2024-09-12T19:54:35.936290+0000, chain.objs.size()=1 2024-09-12T18:01:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.222+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1JalHG6OMXrvfsuj6U8FDjFBXAjRj1B_0 2024-09-12T18:01:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.222+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9656724122666514819', time=2024-09-12T19:54:35.943198+0000, chain.objs.size()=1 2024-09-12T18:01:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.222+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.bxXZdM1xQL8n4TS8nZLkRBQi-349v_Z_0 2024-09-12T18:01:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.222+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17459841810624331683', time=2024-09-12T19:54:35.958796+0000, chain.objs.size()=1 2024-09-12T18:01:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.222+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.guHtLdhSvdV-TsfZf1ogQzpEye70e3m_0 2024-09-12T18:01:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.222+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10049443030279334338', time=2024-09-12T19:54:35.991884+0000, chain.objs.size()=1 2024-09-12T18:01:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.222+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.FRrJzmFnKHjiYq-Mumt0jY--CMtt-C5_0 2024-09-12T18:01:50.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.223+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5954373338157577381', time=2024-09-12T19:54:36.126559+0000, chain.objs.size()=1 2024-09-12T18:01:50.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.223+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.6gRGGTf3ORX_gm5d4AfTNIZTJVnU99B_0 2024-09-12T18:01:50.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.223+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7846170225134582985', time=2024-09-12T19:54:36.130646+0000, chain.objs.size()=1 2024-09-12T18:01:50.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.223+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-pb43j09yVmyU7x7ugEwnvNToRD-2SC_0 2024-09-12T18:01:50.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.223+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13602825281795273103', time=2024-09-12T19:54:36.134943+0000, chain.objs.size()=1 2024-09-12T18:01:50.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.223+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.mdPGOapx7Bl6NF2JoCs1idjDJxVxBtF_0 2024-09-12T18:01:50.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12836234851823999210', time=2024-09-12T19:54:36.259975+0000, chain.objs.size()=1 2024-09-12T18:01:50.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.7WRX3BdyRym5LoeUgzKtrjDisUNdBNQ_0 2024-09-12T18:01:50.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11773121907972752162', time=2024-09-12T19:54:36.274355+0000, chain.objs.size()=1 2024-09-12T18:01:50.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.8ZnJxEf5KV52GauijfjFUCbZ4722buR_0 2024-09-12T18:01:50.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3163648869900579661', time=2024-09-12T19:54:36.302982+0000, chain.objs.size()=1 2024-09-12T18:01:50.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.fTqPjZgZ508bj5ByVL8TCSo1DmKzlVr_0 2024-09-12T18:01:50.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12232142100325424833', time=2024-09-12T19:54:36.330271+0000, chain.objs.size()=1 2024-09-12T18:01:50.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4OA0elYxmbf0To66JO-f-kHvrfLFUPI_0 2024-09-12T18:01:50.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13496944047568890069', time=2024-09-12T19:54:36.415027+0000, chain.objs.size()=1 2024-09-12T18:01:50.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.MXvobp7bMYwMq8p5gc_fHHZvvtEN1xV_0 2024-09-12T18:01:50.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16986849950258577564', time=2024-09-12T19:54:36.426760+0000, chain.objs.size()=1 2024-09-12T18:01:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.IRB-ALzDdxwyvLz148PpcHr7Y5wO3fm_0 2024-09-12T18:01:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6290399979725586347', time=2024-09-12T19:54:36.439019+0000, chain.objs.size()=1 2024-09-12T18:01:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.nzjEwu52PVa68L2tzbFzOzVEuIXOe47_0 2024-09-12T18:01:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8758657517268206687', time=2024-09-12T19:54:36.476818+0000, chain.objs.size()=1 2024-09-12T18:01:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.zWvkauDVxEqjF-kk5pJQFkgHRJJq7E0_0 2024-09-12T18:01:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6187003646191043562', time=2024-09-12T19:54:36.484110+0000, chain.objs.size()=1 2024-09-12T18:01:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.gb-Nfw0IkY2Ki83TTm5E9wZ0o-c1ggJ_0 2024-09-12T18:01:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.831723100799548999', time=2024-09-12T19:54:36.623530+0000, chain.objs.size()=1 2024-09-12T18:01:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.BzxqrWbedMN9pThgAytWvDfI97aZ0lV_0 2024-09-12T18:01:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1400266286564526471', time=2024-09-12T19:54:36.642896+0000, chain.objs.size()=1 2024-09-12T18:01:50.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.228+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.nLv2tWP_YGwQOOAKCQTo3Tvfjs-hGem_0 2024-09-12T18:01:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.229+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15500121702682736140', time=2024-09-12T19:54:36.744078+0000, chain.objs.size()=1 2024-09-12T18:01:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.229+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.dx2lBWnKOS-tKf1_fQW6HcRxkFjFnia_0 2024-09-12T18:01:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.230+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13050335368445111222', time=2024-09-12T19:54:36.769123+0000, chain.objs.size()=1 2024-09-12T18:01:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.230+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.fxIT-KGpNTVrXiCRIMg7A0i66saBOA2_0 2024-09-12T18:01:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.230+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12411348601496240432', time=2024-09-12T19:54:36.782761+0000, chain.objs.size()=1 2024-09-12T18:01:50.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.230+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.C3yFHm7NF196RFEipsahQxB9KMqBQg4_0 2024-09-12T18:01:50.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10248203665546149159', time=2024-09-12T19:54:36.787914+0000, chain.objs.size()=1 2024-09-12T18:01:50.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.PmYDy1twESwPEXv1uNavj3PqwzQnx1Z_0 2024-09-12T18:01:50.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11594967164476364614', time=2024-09-12T19:54:36.805393+0000, chain.objs.size()=1 2024-09-12T18:01:50.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.5vuJGVBrBTTt4alcTM-DFVyvQn-ARuL_0 2024-09-12T18:01:50.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7487012521175811841', time=2024-09-12T19:54:36.806570+0000, chain.objs.size()=1 2024-09-12T18:01:50.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.EWOeMNtM2Lwlj-fGFdNF9P5qf-2dUqn_0 2024-09-12T18:01:50.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16756515850642131528', time=2024-09-12T19:54:36.828962+0000, chain.objs.size()=1 2024-09-12T18:01:50.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.gkxPrA-vwNXfJewpvmsLeXQaxiZ_iJn_0 2024-09-12T18:01:50.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2158292922818790984', time=2024-09-12T19:54:36.829718+0000, chain.objs.size()=1 2024-09-12T18:01:50.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Cnlf0FIKyeLZAqjNAIN3S5rnrHgR17E_0 2024-09-12T18:01:50.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12914971502080260851', time=2024-09-12T19:54:36.902789+0000, chain.objs.size()=1 2024-09-12T18:01:50.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0pzu6ZnTHQH2DC52VgiZW7P9bWZ0-cu_0 2024-09-12T18:01:50.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1654906127024592003', time=2024-09-12T19:54:36.903595+0000, chain.objs.size()=1 2024-09-12T18:01:50.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.dwq7akkDNQxH1BIZrvzJ8sPmrlqvQVK_0 2024-09-12T18:01:50.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11044498920937760487', time=2024-09-12T19:54:36.940720+0000, chain.objs.size()=1 2024-09-12T18:01:50.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.FEf3EGcsfLEzvSP_axbAaWQprPazsA__0 2024-09-12T18:01:50.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15278827742448781226', time=2024-09-12T19:54:36.943714+0000, chain.objs.size()=1 2024-09-12T18:01:50.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.231+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rcjk4Xn9QGrRIz6I0FibgRzJagCDVZs_0 2024-09-12T18:01:50.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.233+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14371440967903894873', time=2024-09-12T19:54:36.949840+0000, chain.objs.size()=1 2024-09-12T18:01:50.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.233+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_._Z0nXco6PE17lFwyh2es1Ne1tS7GQge_0 2024-09-12T18:01:50.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.233+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12816701724577431234', time=2024-09-12T19:54:44.491770+0000, chain.objs.size()=1 2024-09-12T18:01:50.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.233+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9cZrW9evKv4p4pDD8Ra5Cg6eA70DFz8_0 2024-09-12T18:01:50.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8677788789907064044', time=2024-09-12T19:54:44.502204+0000, chain.objs.size()=1 2024-09-12T18:01:50.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ct7k_gLSn2LWtc52qHFvgnTLC_LqefS_0 2024-09-12T18:01:50.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7686039916801431481', time=2024-09-12T19:54:44.509693+0000, chain.objs.size()=1 2024-09-12T18:01:50.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.xvAtcGeT5x9zsYGnFJ02t8Wb9Ix6n43_0 2024-09-12T18:01:50.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1482929310684264134', time=2024-09-12T19:54:44.651109+0000, chain.objs.size()=1 2024-09-12T18:01:50.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.cweyfFp_wavrvEID9OR60-QTgu6KkES_0 2024-09-12T18:01:50.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12399745252817890416', time=2024-09-12T19:54:44.652245+0000, chain.objs.size()=1 2024-09-12T18:01:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.o-vkp7o5CrT11bXp7z0UQkvktHRQa68_0 2024-09-12T18:01:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10309975758012832406', time=2024-09-12T19:54:44.825065+0000, chain.objs.size()=1 2024-09-12T18:01:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.WDC8ncsXywmPSviQShXmD-f7umzJnua_0 2024-09-12T18:01:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16862555594024450945', time=2024-09-12T19:54:44.844110+0000, chain.objs.size()=1 2024-09-12T18:01:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.1fVDdnE_cCnhcRJZ8E5YGCkiPfw1YIV_0 2024-09-12T18:01:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2409334907592195881', time=2024-09-12T19:54:44.989646+0000, chain.objs.size()=1 2024-09-12T18:01:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.d8DSjvr3mLbGSi-wERajocRRwDHzspZ_0 2024-09-12T18:01:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12742794485010202057', time=2024-09-12T19:54:45.014042+0000, chain.objs.size()=1 2024-09-12T18:01:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.tL_zIqX8sLvHy2VcRIoDuKVJfZ33EXK_0 2024-09-12T18:01:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1005973454394597886', time=2024-09-12T19:54:45.018322+0000, chain.objs.size()=1 2024-09-12T18:01:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.i82e4G12V717tp0bMps2hI-EAKD6hEo_0 2024-09-12T18:01:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15942335530719183403', time=2024-09-12T19:54:45.021369+0000, chain.objs.size()=1 2024-09-12T18:01:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.236+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_._GlimxFkIHL8pI0urEoXUSJNmWPc_BC_0 2024-09-12T18:01:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.238+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12904246796769804844', time=2024-09-12T19:54:45.057787+0000, chain.objs.size()=1 2024-09-12T18:01:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.238+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.JHru3phacw-xgciV9ddl3tn25g5yER7_0 2024-09-12T18:01:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.238+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3715993625105121460', time=2024-09-12T19:54:45.171871+0000, chain.objs.size()=1 2024-09-12T18:01:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.238+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.mHBsP80N9boQE2ESAYZqxxotdXvsB8s_0 2024-09-12T18:01:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.238+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8893488384758074305', time=2024-09-12T19:54:45.176183+0000, chain.objs.size()=1 2024-09-12T18:01:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.238+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.kcJne78QZ5wmie8fdK-kOC_gq0BySV__0 2024-09-12T18:01:50.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7959100174328279439', time=2024-09-12T19:54:45.213311+0000, chain.objs.size()=1 2024-09-12T18:01:50.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.n4ptONtwtpqK_1GF1tCxx39yvHxxr-E_0 2024-09-12T18:01:50.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15989387158272281385', time=2024-09-12T19:54:45.228451+0000, chain.objs.size()=1 2024-09-12T18:01:50.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.HwXdvgiLgZ3cTB4-LoPp5pUMGZ3pshc_0 2024-09-12T18:01:50.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16889058822689249370', time=2024-09-12T19:54:45.259813+0000, chain.objs.size()=1 2024-09-12T18:01:50.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.b_4ku2Zw7DAR9RhXVXtn_Zsd3mnzE7k_0 2024-09-12T18:01:50.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13809654454224592832', time=2024-09-12T19:54:45.359520+0000, chain.objs.size()=1 2024-09-12T18:01:50.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.AHde31zeO4w7pgwrPgiyfxdZkQMcQqI_0 2024-09-12T18:01:50.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6705378872005369954', time=2024-09-12T19:54:45.388345+0000, chain.objs.size()=1 2024-09-12T18:01:50.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Fq8HuPqX1wyecO0atAsAzeFlaCmWQ-I_0 2024-09-12T18:01:50.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11455539559381545270', time=2024-09-12T19:54:45.418142+0000, chain.objs.size()=1 2024-09-12T18:01:50.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.4DzxX8Al9JI2dnGyzQm4PrFYehMxGfs_0 2024-09-12T18:01:50.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.730382973178849114', time=2024-09-12T19:54:45.530861+0000, chain.objs.size()=1 2024-09-12T18:01:50.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.05waOHKL1mojFWHsxQW3BcSdXZthdjE_0 2024-09-12T18:01:50.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2401635618100114764', time=2024-09-12T19:54:45.553176+0000, chain.objs.size()=1 2024-09-12T18:01:50.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.GKAsuVo0jUxWp9_nmiu1JavXzZEESlG_0 2024-09-12T18:01:50.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7721608402014019316', time=2024-09-12T19:54:45.559983+0000, chain.objs.size()=1 2024-09-12T18:01:50.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.241+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.l3wwXa25hPY7ulCR0J6BpIh6quzODBc_0 2024-09-12T18:01:50.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.243+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9340173091840424324', time=2024-09-12T19:54:45.573527+0000, chain.objs.size()=1 2024-09-12T18:01:50.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.243+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.JhJRI76GpGLA9efDgCE1Tspd-EQcxBF_0 2024-09-12T18:01:50.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.243+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3691154943369065054', time=2024-09-12T19:54:45.586660+0000, chain.objs.size()=1 2024-09-12T18:01:50.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.243+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.vLu6dAE8U0_pSwiMhkuPPd9LtNabrtZ_0 2024-09-12T18:01:50.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.244+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13468217415047462717', time=2024-09-12T19:54:45.692788+0000, chain.objs.size()=1 2024-09-12T18:01:50.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.244+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TBGcMfvi4SIHhx7bNfMyW4lo7b9KTcJ_0 2024-09-12T18:01:50.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.244+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13980842169375931787', time=2024-09-12T19:54:45.728943+0000, chain.objs.size()=1 2024-09-12T18:01:50.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.244+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.M6UsXnQKpVDopdWTkAUnxqtjrdBKkyy_0 2024-09-12T18:01:50.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.244+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6709682125755879729', time=2024-09-12T19:55:09.286738+0000, chain.objs.size()=1 2024-09-12T18:01:50.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.244+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.436__shadow_.TABwrtcARVMPVlyNWtfiE33M9FJd3nB_0 2024-09-12T18:01:50.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.244+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2543194299564587206', time=2024-09-12T19:55:13.661794+0000, chain.objs.size()=1 2024-09-12T18:01:50.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.244+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.455__shadow_.lkeHWSM6Cz5Hrmk4eV0gMLP3Va7PwQw_0 2024-09-12T18:01:50.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.245+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/47653 2024-09-12T18:01:50.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:01:50.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7589573552196619869', time=2024-09-12T19:55:23.788945+0000, chain.objs.size()=1 2024-09-12T18:01:50.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.496__shadow_.1x4V4RMARpWlf0__NXVp-srg0XD3TRj_0 2024-09-12T18:01:50.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14173328594303859868', time=2024-09-12T19:55:25.023397+0000, chain.objs.size()=1 2024-09-12T18:01:50.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.501__shadow_.Io6_gFUC3FpvRwdtvANHVtUjKXEu3Lj_0 2024-09-12T18:01:50.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1150397908641252845', time=2024-09-12T19:55:33.006891+0000, chain.objs.size()=3 2024-09-12T18:01:50.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.522__multipart_mymultipart.2~whFuDSaItX_R41l7EbUAcQcwzv1fgP8.1 2024-09-12T18:01:50.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.522__multipart_mymultipart.2~whFuDSaItX_R41l7EbUAcQcwzv1fgP8.2 2024-09-12T18:01:50.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.522__multipart_mymultipart.2~whFuDSaItX_R41l7EbUAcQcwzv1fgP8.3 2024-09-12T18:01:50.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~TRN6N4xdNmL9VuiEE1iWnvlAb1RL1Y1', time=2024-09-12T19:55:35.345429+0000, chain.objs.size()=1 2024-09-12T18:01:50.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~TRN6N4xdNmL9VuiEE1iWnvlAb1RL1Y1.3 2024-09-12T18:01:50.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4927489515083308170', time=2024-09-12T19:55:40.000434+0000, chain.objs.size()=3 2024-09-12T18:01:50.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.526__multipart_mymultipart.2~ovISoZCe8o87jkyRmfruINojnBtM4VM.1 2024-09-12T18:01:50.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.526__multipart_mymultipart.2~ovISoZCe8o87jkyRmfruINojnBtM4VM.2 2024-09-12T18:01:50.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.526__multipart_mymultipart.2~ovISoZCe8o87jkyRmfruINojnBtM4VM.3 2024-09-12T18:01:50.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7114157539631873577', time=2024-09-12T19:56:10.879481+0000, chain.objs.size()=1 2024-09-12T18:01:50.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.552__shadow_.RYodk60nrDY_gYZGkEmM8AIccJSf411_0 2024-09-12T18:01:50.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8833992535396699662', time=2024-09-12T19:56:22.218374+0000, chain.objs.size()=1 2024-09-12T18:01:50.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:q3fBSHfbecssxdVOT5Epe.khqtTqeP7_.B73wY_DtG7DN8ZwncixZbheLClmlFSH_0 2024-09-12T18:01:50.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10470091347377879048', time=2024-09-12T19:56:27.576957+0000, chain.objs.size()=1 2024-09-12T18:01:50.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.248+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.571__shadow:QRmvQaxUVQDpnd2Wm7fGI2YKP0FBPdz_.N4YqHoiNEtcuTMvkxkt7U5rtkKXDrlp_0 2024-09-12T18:01:50.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.249+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3945741916662978632', time=2024-09-12T19:56:48.964602+0000, chain.objs.size()=4 2024-09-12T18:01:50.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.249+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.579__multipart_testobj.2~UxbTGMTCPIL1_GmuZPFSm8aPQEviTBH.1 2024-09-12T18:01:50.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.254+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.579__multipart_testobj.2~UxbTGMTCPIL1_GmuZPFSm8aPQEviTBH.2 2024-09-12T18:01:50.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.254+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.579__multipart_testobj.2~UxbTGMTCPIL1_GmuZPFSm8aPQEviTBH.3 2024-09-12T18:01:50.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.254+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.579__multipart_testobj.2~UxbTGMTCPIL1_GmuZPFSm8aPQEviTBH.4 2024-09-12T18:01:50.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.254+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16437066514549479213', time=2024-09-12T19:56:53.080071+0000, chain.objs.size()=1 2024-09-12T18:01:50.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.254+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.588__shadow:MjLjEEwY5oLuwudaBdl.YSGCXcWBKJ6_.b5_5MkuTqchsVMUWI1TCEOjSGGZspwG_0 2024-09-12T18:01:50.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.254+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6533084932125630316', time=2024-09-12T19:56:53.168252+0000, chain.objs.size()=1 2024-09-12T18:01:50.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.254+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.588__shadow:mzLLajfApzS63goZC9srycqGKljhMjR_.fVb57YkHJqZrRV3jjSQ2ld4Pm8c-8TT_0 2024-09-12T18:01:50.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.255+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15952802299750212774', time=2024-09-12T19:59:07.502634+0000, chain.objs.size()=1 2024-09-12T18:01:50.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.255+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.631__shadow_.Gm-5Y8BQsKOwH9FY4UNK3ILYsr79YQF_0 2024-09-12T18:01:50.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.255+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10666155097888153890', time=2024-09-12T19:59:18.775084+0000, chain.objs.size()=1 2024-09-12T18:01:50.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.255+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.669__shadow_.pDpWAnDheoF01vjF-5iekCizad368Bt_0 2024-09-12T18:01:50.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.255+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17431669344889818693', time=2024-09-12T19:59:48.581549+0000, chain.objs.size()=1 2024-09-12T18:01:50.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.255+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.720__shadow_.foepoiJxjbXK1nlDBrVSGMSZ1CydhAP_0 2024-09-12T18:01:50.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.259+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.262+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:01:50.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.263+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.263+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46658' 2024-09-12T18:01:50.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16357627077589936086', time=2024-09-12T19:53:09.210034+0000, chain.objs.size()=1 2024-09-12T18:01:50.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.198__shadow_.2MYx9-CCEUNrA84Ql0XxBRuVUS89w5d_0 2024-09-12T18:01:50.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~kN7AACTguQwcZjZ-nEVrH6k7l33feAW', time=2024-09-12T19:53:10.164969+0000, chain.objs.size()=1 2024-09-12T18:01:50.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.202__multipart_mymultipart.2~kN7AACTguQwcZjZ-nEVrH6k7l33feAW.1 2024-09-12T18:01:50.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9744787777563313387', time=2024-09-12T19:54:00.326385+0000, chain.objs.size()=1 2024-09-12T18:01:50.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.235__shadow_.sqPRYpxEqIgnAAxzFsN83q4gwfFckM8_0 2024-09-12T18:01:50.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1137981855596418185', time=2024-09-12T19:54:02.053472+0000, chain.objs.size()=1 2024-09-12T18:01:50.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.243__shadow_.nn5VrSRiXcv3GcXf1yGo77G0uPTBrpP_0 2024-09-12T18:01:50.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9089427494342040221', time=2024-09-12T19:54:02.311333+0000, chain.objs.size()=1 2024-09-12T18:01:50.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.244__shadow_.bO1NHy2FR64lCT0lHyhrV40HSTvG0-X_0 2024-09-12T18:01:50.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15373971998399619358', time=2024-09-12T19:54:04.879299+0000, chain.objs.size()=1 2024-09-12T18:01:50.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.256__shadow_.mxrgz14W34GjwdCKZ9gKykIjsiwpBbu_0 2024-09-12T18:01:50.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9229863475454636564', time=2024-09-12T19:54:13.501021+0000, chain.objs.size()=1 2024-09-12T18:01:50.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.L9B0WEtQEEYeJUqZTcQ5kFSivTZ9Tv4_0 2024-09-12T18:01:50.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2705778045560442056', time=2024-09-12T19:54:13.518996+0000, chain.objs.size()=1 2024-09-12T18:01:50.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.lECXWo1vLSM0kGHvIlA9KhYcBVKjrxY_0 2024-09-12T18:01:50.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.283253104285095367', time=2024-09-12T19:54:13.537537+0000, chain.objs.size()=1 2024-09-12T18:01:50.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Oct_7xYqA1GirPMmPJceSe3xzXFtiRj_0 2024-09-12T18:01:50.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12262216718881284315', time=2024-09-12T19:54:13.569050+0000, chain.objs.size()=1 2024-09-12T18:01:50.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.zuldnMabLKLE8eRzqkz3Y6mgQPNyEOP_0 2024-09-12T18:01:50.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7662079801123235970', time=2024-09-12T19:54:13.574340+0000, chain.objs.size()=1 2024-09-12T18:01:50.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.nhmKI0dwkw9Y84jZkcad09yy1PUQufJ_0 2024-09-12T18:01:50.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2403035137702917535', time=2024-09-12T19:54:13.671472+0000, chain.objs.size()=1 2024-09-12T18:01:50.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.264+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.odkrxBpviht_Bl-VHFAvsLWjOriMQ5W_0 2024-09-12T18:01:50.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17932296250411687128', time=2024-09-12T19:54:13.723597+0000, chain.objs.size()=1 2024-09-12T18:01:50.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Lb_zwh9GyoRfHBgZKs1-9fs--F5y7ph_0 2024-09-12T18:01:50.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6143239682916656730', time=2024-09-12T19:54:13.724598+0000, chain.objs.size()=1 2024-09-12T18:01:50.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.k3X1DsD-4w0bj3icMxs-w2NaIVP6nld_0 2024-09-12T18:01:50.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6387456982117522426', time=2024-09-12T19:54:13.752086+0000, chain.objs.size()=1 2024-09-12T18:01:50.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.dYyE_hVwdf5KQTKLGwsZuNGIY9PwZyn_0 2024-09-12T18:01:50.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13724381879896720988', time=2024-09-12T19:54:14.005604+0000, chain.objs.size()=1 2024-09-12T18:01:50.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.UButYwchfZWmVFfTPWrbpUD7GJj9-M4_0 2024-09-12T18:01:50.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2803061705887690020', time=2024-09-12T19:54:14.019868+0000, chain.objs.size()=1 2024-09-12T18:01:50.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.7h6Elig2H9xTT2EEGi4CiTeL9F1kVD5_0 2024-09-12T18:01:50.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12358081594379182451', time=2024-09-12T19:54:14.048987+0000, chain.objs.size()=1 2024-09-12T18:01:50.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.lQ7ILGp4Y0r2E-Nf8geI0SOrgc8OTvI_0 2024-09-12T18:01:50.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11437484962574463647', time=2024-09-12T19:54:14.069427+0000, chain.objs.size()=1 2024-09-12T18:01:50.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.0S03INAGu6zcLHLcJXIHFoXm8G2zTkh_0 2024-09-12T18:01:50.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1592546364616410335', time=2024-09-12T19:54:14.075654+0000, chain.objs.size()=1 2024-09-12T18:01:50.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.BuAwVITJqVLX4rv9Vx734CgeLfzKq2H_0 2024-09-12T18:01:50.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8437881513378135979', time=2024-09-12T19:54:14.087869+0000, chain.objs.size()=1 2024-09-12T18:01:50.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.leRDuJvCUeiXwVR4MD1vtJkcw-T3K03_0 2024-09-12T18:01:50.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11697329921075331252', time=2024-09-12T19:54:14.374506+0000, chain.objs.size()=1 2024-09-12T18:01:50.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.de4HJ1h8-Pd2Dk1QvsabpwSfvO0bMaR_0 2024-09-12T18:01:50.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1046412105559815219', time=2024-09-12T19:54:14.390740+0000, chain.objs.size()=1 2024-09-12T18:01:50.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.266+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.vWEfokrWmhv5q4_7vVMcHo2JdxOg9_q_0 2024-09-12T18:01:50.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.268+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14074347352048418192', time=2024-09-12T19:54:14.421758+0000, chain.objs.size()=1 2024-09-12T18:01:50.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.268+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.xrRbkRwWJRVv8dFXddMmxEGj308wRil_0 2024-09-12T18:01:50.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.268+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6630910007382119534', time=2024-09-12T19:54:14.441477+0000, chain.objs.size()=1 2024-09-12T18:01:50.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.268+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.VKVcil_uGJXzIFgAW97niwZA5t62qAM_0 2024-09-12T18:01:50.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.269+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7085454186015339939', time=2024-09-12T19:54:14.773774+0000, chain.objs.size()=1 2024-09-12T18:01:50.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.269+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.KZzROTMTVOe3QpNrE50DRNVAJzXupYz_0 2024-09-12T18:01:50.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.271+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9599683023090603499', time=2024-09-12T19:54:14.775343+0000, chain.objs.size()=1 2024-09-12T18:01:50.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.271+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.FHvtSeZulMXOk77ZlPZ_1DwQj894bdC_0 2024-09-12T18:01:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.271+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14225526094655262559', time=2024-09-12T19:54:14.785225+0000, chain.objs.size()=1 2024-09-12T18:01:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.271+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.JnQdiF4WRDMjP9TIHvwNOySXewavJmk_0 2024-09-12T18:01:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.271+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2966898838375505091', time=2024-09-12T19:54:14.792101+0000, chain.objs.size()=1 2024-09-12T18:01:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.271+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ze6dJCJ5z3AuJqjG7UUBfHVF6l3Ae7X_0 2024-09-12T18:01:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.271+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16471642248957602884', time=2024-09-12T19:54:14.799544+0000, chain.objs.size()=1 2024-09-12T18:01:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.271+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.MkDirt8Lg_MEqXd1scTo4IjsB7iM6nL_0 2024-09-12T18:01:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.271+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11463066630074798052', time=2024-09-12T19:54:14.880266+0000, chain.objs.size()=1 2024-09-12T18:01:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.271+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.iVLlG808A07Xrk5Cr0hQc-fWOBtmQGi_0 2024-09-12T18:01:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.271+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10230620028473429960', time=2024-09-12T19:54:14.947380+0000, chain.objs.size()=1 2024-09-12T18:01:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.271+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.KrJlk_As4zEpPFwXbNiF_XATlmZIt87_0 2024-09-12T18:01:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.272+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16525942025550083490', time=2024-09-12T19:54:21.576296+0000, chain.objs.size()=1 2024-09-12T18:01:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.272+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.yLXi-gYU9x75L_jWtGyILauEXKH-hUq_0 2024-09-12T18:01:50.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.272+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3129715871640587043', time=2024-09-12T19:54:21.586752+0000, chain.objs.size()=1 2024-09-12T18:01:50.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.272+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.IHG98mMrPe0CIyvMF1N8STVw8zcgNpD_0 2024-09-12T18:01:50.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.274+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8460069432224881487', time=2024-09-12T19:54:22.159448+0000, chain.objs.size()=1 2024-09-12T18:01:50.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.274+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.D6V6yYx98OLk6JTFu3aHiDaj5aEVyN1_0 2024-09-12T18:01:50.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.274+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17702288259476531407', time=2024-09-12T19:54:22.162225+0000, chain.objs.size()=1 2024-09-12T18:01:50.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.274+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.MTD8rLinqLKmF74avt7MFfG2Hkw7t6R_0 2024-09-12T18:01:50.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.274+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12594943096785441186', time=2024-09-12T19:54:25.192702+0000, chain.objs.size()=1 2024-09-12T18:01:50.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.274+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.307__shadow_.-l49e9EH0xs_Qk8qdRKTXPFkmHXSE7Z_0 2024-09-12T18:01:50.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.274+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17344133672306927864', time=2024-09-12T19:54:35.773004+0000, chain.objs.size()=1 2024-09-12T18:01:50.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.274+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.OuZjWcPNB1F_ud5DOUa76L2pa9z0fEJ_0 2024-09-12T18:01:50.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1736366252388019475', time=2024-09-12T19:54:35.789094+0000, chain.objs.size()=1 2024-09-12T18:01:50.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.UQJk5yhijF87LeeT3hLfjWfJGKFllEd_0 2024-09-12T18:01:50.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17837406595672072123', time=2024-09-12T19:54:35.810938+0000, chain.objs.size()=1 2024-09-12T18:01:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.pwV2ar-eMeieha7eSXuVLWbIWE9HsZb_0 2024-09-12T18:01:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16331474950216733602', time=2024-09-12T19:54:35.838316+0000, chain.objs.size()=1 2024-09-12T18:01:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.nId_cXEHyvbEmXa7bWMcp3HwEGStKFm_0 2024-09-12T18:01:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17010168607551411557', time=2024-09-12T19:54:35.947690+0000, chain.objs.size()=1 2024-09-12T18:01:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.v3EMXJ_LJ3ZceZqMrP5MyoAByWJw0Vs_0 2024-09-12T18:01:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7813651534165512496', time=2024-09-12T19:54:36.003726+0000, chain.objs.size()=1 2024-09-12T18:01:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Mhs0IVdpdPL4EeNEPP_SEfOxiJMux5T_0 2024-09-12T18:01:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9604445279292953394', time=2024-09-12T19:54:36.115960+0000, chain.objs.size()=1 2024-09-12T18:01:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Q7rVnJH9xSKyY7Dk1OvOK4TNzAbiBKt_0 2024-09-12T18:01:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6612753747903576085', time=2024-09-12T19:54:36.131018+0000, chain.objs.size()=1 2024-09-12T18:01:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.iGC6-uuRjhH1xKfQ6PEBH5GLM5UoPsl_0 2024-09-12T18:01:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6698314926964843858', time=2024-09-12T19:54:36.148853+0000, chain.objs.size()=1 2024-09-12T18:01:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ci6cACOHiFhdWQ7SI4bHiz_r2fk2vzw_0 2024-09-12T18:01:50.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9665558389770578643', time=2024-09-12T19:54:36.255188+0000, chain.objs.size()=1 2024-09-12T18:01:50.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.276+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ZOQr5qgqJlCteWyjYsarwG1k191d3qD_0 2024-09-12T18:01:50.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.279+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5205592359226673349', time=2024-09-12T19:54:36.304922+0000, chain.objs.size()=1 2024-09-12T18:01:50.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.279+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9qbv4HK6whJ4B2Yhb_fQ_CjU4sW0b7H_0 2024-09-12T18:01:50.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.279+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8983006644791812353', time=2024-09-12T19:54:36.307340+0000, chain.objs.size()=1 2024-09-12T18:01:50.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.279+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ZLAfn6xLwFktZ836CWEdGmiqfHzf8Bk_0 2024-09-12T18:01:50.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.279+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6857432068206724527', time=2024-09-12T19:54:36.313865+0000, chain.objs.size()=1 2024-09-12T18:01:50.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.279+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.i6OycWARS1hsad1c70dnKlBb3Z8W1sR_0 2024-09-12T18:01:50.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.279+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4339444604970870134', time=2024-09-12T19:54:36.317453+0000, chain.objs.size()=1 2024-09-12T18:01:50.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.279+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.AHYBG5p8JliefGEaJ9VoO2juFT9gDHd_0 2024-09-12T18:01:50.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.279+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15887527629749500755', time=2024-09-12T19:54:36.333765+0000, chain.objs.size()=1 2024-09-12T18:01:50.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.279+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.7afRxWbKOktvLc3p_7fslmjSIPoOPfs_0 2024-09-12T18:01:50.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.279+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8580014917503875705', time=2024-09-12T19:54:36.434211+0000, chain.objs.size()=1 2024-09-12T18:01:50.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.279+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-cxzFY7VzizvOS6FBin1mC2ZUHp4Bew_0 2024-09-12T18:01:50.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.279+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7959405834510273094', time=2024-09-12T19:54:36.449596+0000, chain.objs.size()=1 2024-09-12T18:01:50.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.279+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1pnEuaWk3_sTvQezBXPnoNvnm8D4-dt_0 2024-09-12T18:01:50.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.281+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6461741393631846964', time=2024-09-12T19:54:36.472507+0000, chain.objs.size()=1 2024-09-12T18:01:50.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.281+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0Q_kAgEg3v0KJIonXWZignnTyUDVJg9_0 2024-09-12T18:01:50.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.281+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12121659676725667810', time=2024-09-12T19:54:36.496629+0000, chain.objs.size()=1 2024-09-12T18:01:50.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.281+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.vAZyUm0wwkkkkpD_lgRkGg_cTKK0uhJ_0 2024-09-12T18:01:50.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.281+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9376636264396807337', time=2024-09-12T19:54:36.595591+0000, chain.objs.size()=1 2024-09-12T18:01:50.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.281+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.bAUxxH5-qTyO5MHDgyi6qvfbuVpwcoX_0 2024-09-12T18:01:50.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.281+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.710108324763312085', time=2024-09-12T19:54:36.610177+0000, chain.objs.size()=1 2024-09-12T18:01:50.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.281+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-mLm4fMAisLBWhn2tyP08nVAAP2yCz-_0 2024-09-12T18:01:50.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.284+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16853569844385916148', time=2024-09-12T19:54:36.620633+0000, chain.objs.size()=1 2024-09-12T18:01:50.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.284+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.lYX6UQUBrIpvpKGjXSed9Twoo1HfCyI_0 2024-09-12T18:01:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.284+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7052044499255752979', time=2024-09-12T19:54:36.650009+0000, chain.objs.size()=1 2024-09-12T18:01:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.284+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.MfWQFxq9YTi0zVulPPrhLPBISkBxlXO_0 2024-09-12T18:01:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.284+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12972518784692981507', time=2024-09-12T19:54:36.667911+0000, chain.objs.size()=1 2024-09-12T18:01:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.284+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1QVSyQvUev5na37u00VoaDyijM8Zf3r_0 2024-09-12T18:01:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.284+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5661151100826459039', time=2024-09-12T19:54:36.778574+0000, chain.objs.size()=1 2024-09-12T18:01:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.284+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.NXBUCcb6597DinJUiE_I0jGPid5PN2__0 2024-09-12T18:01:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.284+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9715246061244882661', time=2024-09-12T19:54:36.818572+0000, chain.objs.size()=1 2024-09-12T18:01:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.284+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.z76v91S32skv_FiB2ZMtXzgVBFB4T_a_0 2024-09-12T18:01:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.284+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.768160171197500515', time=2024-09-12T19:54:36.917511+0000, chain.objs.size()=1 2024-09-12T18:01:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.284+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.qPDiYWzMfCrMmWPnnsB6IcWs1FT33oZ_0 2024-09-12T18:01:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.284+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7998095108183870808', time=2024-09-12T19:54:36.925801+0000, chain.objs.size()=1 2024-09-12T18:01:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.284+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.fktYRCLd8Wwhc_kupIongdR-mCF6FyL_0 2024-09-12T18:01:50.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.286+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5243841811922460333', time=2024-09-12T19:54:36.933175+0000, chain.objs.size()=1 2024-09-12T18:01:50.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.286+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1-u0iT1Y5hEshaq9liUJ_2089CYHI1y_0 2024-09-12T18:01:50.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.286+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6336720016151809948', time=2024-09-12T19:54:36.936554+0000, chain.objs.size()=1 2024-09-12T18:01:50.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.286+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.7unth3BSop5z-aNSB01smUY1ImJZZP-_0 2024-09-12T18:01:50.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.286+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2224588939740032927', time=2024-09-12T19:54:36.948267+0000, chain.objs.size()=1 2024-09-12T18:01:50.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.286+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ujToDcJMYHtdzMCEdWDIc4VwCbYYTaM_0 2024-09-12T18:01:50.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.286+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1903079431300184215', time=2024-09-12T19:54:36.950429+0000, chain.objs.size()=1 2024-09-12T18:01:50.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.286+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.PUyN3h6KkRuQfBVK7IlaqUZ2nvz6hjh_0 2024-09-12T18:01:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.289+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9866857840875606731', time=2024-09-12T19:54:36.958703+0000, chain.objs.size()=1 2024-09-12T18:01:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.289+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.kI_j36MxqkrDS05sx_yqzLqEf87T3mK_0 2024-09-12T18:01:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.289+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2747364933005438918', time=2024-09-12T19:54:36.973259+0000, chain.objs.size()=1 2024-09-12T18:01:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.289+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.IihCHy4icEmQTMYUkvSxkpuHeOiIOPe_0 2024-09-12T18:01:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.289+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14236123247028795372', time=2024-09-12T19:54:44.469788+0000, chain.objs.size()=1 2024-09-12T18:01:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.289+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.dsSp9UHOINdIs_hzIp-4Z6Sin1WCeqm_0 2024-09-12T18:01:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.289+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10135987030102971603', time=2024-09-12T19:54:44.512211+0000, chain.objs.size()=1 2024-09-12T18:01:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.289+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.8V2aGJh4TbwMftq2rQndNz5eTR_jYJ2_0 2024-09-12T18:01:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.289+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13354565263598872398', time=2024-09-12T19:54:44.533304+0000, chain.objs.size()=1 2024-09-12T18:01:50.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.289+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.hoKaKmBd_hPF1Ex6VMXAZ8MnMuNPF1s_0 2024-09-12T18:01:50.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.289+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12830286090883797326', time=2024-09-12T19:54:44.552006+0000, chain.objs.size()=1 2024-09-12T18:01:50.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.289+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.0g7ITyZFA4F5Tlq4nd-kgYsqoOiRV1o_0 2024-09-12T18:01:50.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.289+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6362639365213409497', time=2024-09-12T19:54:44.653663+0000, chain.objs.size()=1 2024-09-12T18:01:50.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.289+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.SvuoG3b2gR4hi8508NrFN9JcchaIlAm_0 2024-09-12T18:01:50.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.289+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10296157400057090628', time=2024-09-12T19:54:44.670391+0000, chain.objs.size()=1 2024-09-12T18:01:50.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.289+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.VD7KizFdRdBn1lsCN83BT8DvCUzQxmF_0 2024-09-12T18:01:50.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.291+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10499448486032357618', time=2024-09-12T19:54:44.674477+0000, chain.objs.size()=1 2024-09-12T18:01:50.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.291+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_._f36vIK1WnR7xV1oHfcTlSVUZFRGszf_0 2024-09-12T18:01:50.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.291+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2124220130869293072', time=2024-09-12T19:54:44.690212+0000, chain.objs.size()=1 2024-09-12T18:01:50.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.291+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.R_0s53iJYk_ZK_j_3qNT6wgeR-tOSyu_0 2024-09-12T18:01:50.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.291+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16731154604735793496', time=2024-09-12T19:54:44.691290+0000, chain.objs.size()=1 2024-09-12T18:01:50.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.291+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.0XTlPvPiu4XXrSbWdbcdFyi865qII9H_0 2024-09-12T18:01:50.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.291+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.195121770911520504', time=2024-09-12T19:54:44.860037+0000, chain.objs.size()=1 2024-09-12T18:01:50.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.291+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.6Lo0b3FvtqvCVipUglWE2L6FEPoTOM3_0 2024-09-12T18:01:50.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.291+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11803759148024843079', time=2024-09-12T19:54:44.872774+0000, chain.objs.size()=1 2024-09-12T18:01:50.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.291+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.LGhqfD33_-JrsFzDgduP4Sk5bBPQG0L_0 2024-09-12T18:01:50.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.294+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11995699074889957655', time=2024-09-12T19:54:44.882242+0000, chain.objs.size()=1 2024-09-12T18:01:50.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.294+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.2bmcj84HX6Q_VvzDIC3N1eWB7nXiTdX_0 2024-09-12T18:01:50.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.294+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11465856744268520926', time=2024-09-12T19:54:44.884419+0000, chain.objs.size()=1 2024-09-12T18:01:50.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.294+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.qmvM-NoAbXLf8Lkn9ykU7qhyti8lRQU_0 2024-09-12T18:01:50.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.294+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13415558468388704392', time=2024-09-12T19:54:44.980753+0000, chain.objs.size()=1 2024-09-12T18:01:50.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.294+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.abc6S19c1YKIxHfB0LDyUysuAURIMAr_0 2024-09-12T18:01:50.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.294+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5506907759107974344', time=2024-09-12T19:54:45.020615+0000, chain.objs.size()=1 2024-09-12T18:01:50.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.294+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.OXkxC7FKSmwr0pSKOO3hPUioLFNwLj7_0 2024-09-12T18:01:50.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.294+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11441884701372826259', time=2024-09-12T19:54:45.052691+0000, chain.objs.size()=1 2024-09-12T18:01:50.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.294+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.VBvEhFEfUVuaq5oVJHZJ0ay0h1BuoNy_0 2024-09-12T18:01:50.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.294+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8642174762652352632', time=2024-09-12T19:54:45.186004+0000, chain.objs.size()=1 2024-09-12T18:01:50.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.294+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.phq_l4S_5bQHe5sESd7GBryWs42s2tM_0 2024-09-12T18:01:50.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.294+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9475232715373563214', time=2024-09-12T19:54:45.215174+0000, chain.objs.size()=1 2024-09-12T18:01:50.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.294+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.wz2hxT1GQ8k46lBOf1wPhJM8MhMrCVh_0 2024-09-12T18:01:50.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.295+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16156994818368197815', time=2024-09-12T19:54:45.247119+0000, chain.objs.size()=1 2024-09-12T18:01:50.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.295+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.QpPvcYW09wLHo1pyQcOmNYpxJHV5xoa_0 2024-09-12T18:01:50.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.295+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15771639371979085208', time=2024-09-12T19:54:45.336061+0000, chain.objs.size()=1 2024-09-12T18:01:50.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.295+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.edi92hsm2CQMJj60vXekAn4Hy5aJWMi_0 2024-09-12T18:01:50.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.295+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16381818582146941441', time=2024-09-12T19:54:45.365419+0000, chain.objs.size()=1 2024-09-12T18:01:50.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.295+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.oOfQ00p1XFykjU1WosdfDHy7O0ZkMDd_0 2024-09-12T18:01:50.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.295+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16742888809206763420', time=2024-09-12T19:54:45.523734+0000, chain.objs.size()=1 2024-09-12T18:01:50.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.295+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.NkAlhUrU3QO1-KiNVqVt6eP4fHRjePf_0 2024-09-12T18:01:50.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.296+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10877855267352761622', time=2024-09-12T19:54:45.587700+0000, chain.objs.size()=1 2024-09-12T18:01:50.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.296+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.GzxqnT3upQvS8XrmYxdSiqN129E-0NX_0 2024-09-12T18:01:50.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.297+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5144099532013932740', time=2024-09-12T19:54:45.687861+0000, chain.objs.size()=1 2024-09-12T18:01:50.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.297+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.dCq7XzJHDXZsgTrc79A8F67LO8lbF2D_0 2024-09-12T18:01:50.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.297+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3853550703617748837', time=2024-09-12T19:54:45.708156+0000, chain.objs.size()=1 2024-09-12T18:01:50.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.297+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Q_hNjWFPujI2JNgs2yUiOvJaIVa7euD_0 2024-09-12T18:01:50.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.297+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18133431733414610501', time=2024-09-12T19:54:48.077277+0000, chain.objs.size()=1 2024-09-12T18:01:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.297+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.337__shadow_.o0kRmWOzTwEuZgovU7q8-zobB69jz4K_0 2024-09-12T18:01:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.297+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13161210318620185750', time=2024-09-12T19:55:20.955182+0000, chain.objs.size()=1 2024-09-12T18:01:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.297+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.484__shadow_.n3SgmtFZTVwDYHyib8EJkNeimd8SBPt_0 2024-09-12T18:01:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.297+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.738889561778774674', time=2024-09-12T19:55:21.169223+0000, chain.objs.size()=1 2024-09-12T18:01:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.297+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.485__shadow_.mXYPqNwdP-EdPCdd8n3wgJEse58Vul2_0 2024-09-12T18:01:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.297+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12864178250127675243', time=2024-09-12T19:55:21.822187+0000, chain.objs.size()=3 2024-09-12T18:01:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.297+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.487__shadow_.Icpxj_e126e0FtmrDvgpqBSzpwRyPwn_0 2024-09-12T18:01:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.297+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.487__shadow_.Icpxj_e126e0FtmrDvgpqBSzpwRyPwn_1 2024-09-12T18:01:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.297+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.487__shadow_.Icpxj_e126e0FtmrDvgpqBSzpwRyPwn_2 2024-09-12T18:01:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.299+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/46658 2024-09-12T18:01:50.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T18:01:50.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17135797822149701117', time=2024-09-12T19:55:22.748992+0000, chain.objs.size()=1 2024-09-12T18:01:50.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.491__shadow_.rhCX13e51LoEGR6ZFAySSyzAvt6IOXf_0 2024-09-12T18:01:50.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17135797822149701117', time=2024-09-12T19:55:22.860847+0000, chain.objs.size()=1 2024-09-12T18:01:50.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.491__shadow_.rhCX13e51LoEGR6ZFAySSyzAvt6IOXf_0 2024-09-12T18:01:50.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13389135491815834577', time=2024-09-12T19:55:33.230146+0000, chain.objs.size()=3 2024-09-12T18:01:50.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.522__multipart_mymultipart.2~6HkzdH_KU6cgnm9RMU_rWmZJOpJroeI.1 2024-09-12T18:01:50.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.522__multipart_mymultipart.2~6HkzdH_KU6cgnm9RMU_rWmZJOpJroeI.2 2024-09-12T18:01:50.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.522__multipart_mymultipart.2~6HkzdH_KU6cgnm9RMU_rWmZJOpJroeI.3 2024-09-12T18:01:50.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~XmHvmkNqvqFoSYFcHK59OJBhy-pgpYe', time=2024-09-12T19:55:42.381686+0000, chain.objs.size()=2 2024-09-12T18:01:50.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.532__multipart_mymultipart.2~XmHvmkNqvqFoSYFcHK59OJBhy-pgpYe.1 2024-09-12T18:01:50.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.532__multipart_mymultipart.2~XmHvmkNqvqFoSYFcHK59OJBhy-pgpYe.2 2024-09-12T18:01:50.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1914386201575956313', time=2024-09-12T19:56:11.684128+0000, chain.objs.size()=1 2024-09-12T18:01:50.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.554__shadow_.xa6RYs6WjXK3QQuY4dRsbTIFDpdUDpk_0 2024-09-12T18:01:50.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13031057529609894527', time=2024-09-12T19:56:29.270810+0000, chain.objs.size()=1 2024-09-12T18:01:50.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.575__shadow:VQWYxRUEugTl8jOoQd6ct37sHwQBB2Y_.7CUU3apPKaDIvsl2x47UbwrN9iaLbO8_0 2024-09-12T18:01:50.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9737183757633828709', time=2024-09-12T19:56:46.871832+0000, chain.objs.size()=1 2024-09-12T18:01:50.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:ph2g7Mq9NHv8r9Vkyho7UGdFqgA6.zF_.pv6P6xHxc-UubTDlCW0gzQbz0viQ287_0 2024-09-12T18:01:50.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6909619316390947790', time=2024-09-12T19:59:07.081470+0000, chain.objs.size()=1 2024-09-12T18:01:50.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.629__shadow_.mbOcMAKnSB7tfQRnqpyTm1M2-UVCOek_0 2024-09-12T18:01:50.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12165874177005109036', time=2024-09-12T19:59:07.278953+0000, chain.objs.size()=1 2024-09-12T18:01:50.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.301+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.630__shadow_.FDRp4Y2ciCoisUe5n3U7kN_IYZJCtbw_0 2024-09-12T18:01:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.303+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10091502120861472717', time=2024-09-12T19:59:08.308533+0000, chain.objs.size()=1 2024-09-12T18:01:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.303+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.635__shadow_.gXzDTRMgNtd9cJUAuWEF4vs6j8ZRI34_0 2024-09-12T18:01:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.303+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12421577657259609068', time=2024-09-12T19:59:16.661313+0000, chain.objs.size()=6 2024-09-12T18:01:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.303+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.661__multipart_bar.2~aLkcxooD04hxKjjA6X-Ryretp-b1lZl.1 2024-09-12T18:01:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.304+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.661__multipart_bar.2~aLkcxooD04hxKjjA6X-Ryretp-b1lZl.2 2024-09-12T18:01:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.304+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.661__multipart_bar.2~aLkcxooD04hxKjjA6X-Ryretp-b1lZl.3 2024-09-12T18:01:50.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.304+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.661__multipart_bar.2~aLkcxooD04hxKjjA6X-Ryretp-b1lZl.4 2024-09-12T18:01:50.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.304+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.661__multipart_bar.2~aLkcxooD04hxKjjA6X-Ryretp-b1lZl.5 2024-09-12T18:01:50.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.304+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.661__multipart_bar.2~aLkcxooD04hxKjjA6X-Ryretp-b1lZl.6 2024-09-12T18:01:50.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.308+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.310+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:01:50.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.311+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.311+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44039' 2024-09-12T18:01:50.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8620449441173222372', time=2024-09-12T19:52:50.359681+0000, chain.objs.size()=1 2024-09-12T18:01:50.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.152__shadow_.smzSS2KfbWD0_VhPq7m5tXC2L10aepp_0 2024-09-12T18:01:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.768023970276269896', time=2024-09-12T19:53:04.205597+0000, chain.objs.size()=1 2024-09-12T18:01:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.178__shadow_.Tr47An0NHmJFzdW1yuLuycfFx_GnR-s_0 2024-09-12T18:01:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3083320928251045543', time=2024-09-12T19:53:59.409290+0000, chain.objs.size()=1 2024-09-12T18:01:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.231__shadow_.NTdmKGXg70v3tdjxaOC8eFf6zyqCsLj_0 2024-09-12T18:01:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9690702437481083449', time=2024-09-12T19:53:59.410016+0000, chain.objs.size()=1 2024-09-12T18:01:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.231__shadow_.G7BpwnQ3VrKfTjgLnMsJfldMWfWQhhg_0 2024-09-12T18:01:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8088189843239228982', time=2024-09-12T19:54:01.249716+0000, chain.objs.size()=1 2024-09-12T18:01:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.239__shadow_.tz4xfeYEVD-J_EWv5UrDWyHTQkq-gCo_0 2024-09-12T18:01:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3838360047774946516', time=2024-09-12T19:54:04.672764+0000, chain.objs.size()=1 2024-09-12T18:01:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.255__shadow_.F-E5J2M_lK4gtqdlzJ3jE4b7_cktrsE_0 2024-09-12T18:01:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12787521110460206070', time=2024-09-12T19:54:13.499224+0000, chain.objs.size()=1 2024-09-12T18:01:50.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.oNTLwwJH_l9rhPXFoY7jgEsfLNxxAqv_0 2024-09-12T18:01:50.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9183130470396266544', time=2024-09-12T19:54:13.505115+0000, chain.objs.size()=1 2024-09-12T18:01:50.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2FfLUZRKI3EsI1w8DXtFFIUa5KP5gTY_0 2024-09-12T18:01:50.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18356515096253628048', time=2024-09-12T19:54:13.516259+0000, chain.objs.size()=1 2024-09-12T18:01:50.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.RgqdrYYg2qk603cfZG67bK0U-av4Zlk_0 2024-09-12T18:01:50.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11261500343448466096', time=2024-09-12T19:54:13.563287+0000, chain.objs.size()=1 2024-09-12T18:01:50.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Qw6LBjZNGsBpmKCnGRc30GRJU5hi-jY_0 2024-09-12T18:01:50.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16167021817961427328', time=2024-09-12T19:54:13.565487+0000, chain.objs.size()=1 2024-09-12T18:01:50.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.q8NzV3BIFZ8fNSrAuwbfmNS8NM_em31_0 2024-09-12T18:01:50.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6458684355869301649', time=2024-09-12T19:54:13.657520+0000, chain.objs.size()=1 2024-09-12T18:01:50.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.312+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.8-xGv2RCLINfXIBCrPzAY-Z2hkEzZtK_0 2024-09-12T18:01:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.314+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17655692539827154384', time=2024-09-12T19:54:13.658729+0000, chain.objs.size()=1 2024-09-12T18:01:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.314+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.U49q7kx4pTIT-DrfdCSRVZb-nN-EzaR_0 2024-09-12T18:01:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.314+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12610477979770872589', time=2024-09-12T19:54:13.674836+0000, chain.objs.size()=1 2024-09-12T18:01:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.314+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.1R5tI51A7i1FRAZm4Ao-Tr9D9yZ9TSL_0 2024-09-12T18:01:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.314+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3506207250061832739', time=2024-09-12T19:54:13.745911+0000, chain.objs.size()=1 2024-09-12T18:01:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.314+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ATOntS_8zpZUjy_1zcL0qKK5Neor1ev_0 2024-09-12T18:01:50.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.314+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16838785059686263080', time=2024-09-12T19:54:13.751279+0000, chain.objs.size()=1 2024-09-12T18:01:50.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.314+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.sZ3ZPlfY8mPqKo6tyCVzf4dc6nO1Q_0_0 2024-09-12T18:01:50.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.314+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16615321406729509222', time=2024-09-12T19:54:13.755452+0000, chain.objs.size()=1 2024-09-12T18:01:50.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.314+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.0ClzMWnJP-GUOmNf3DEI3butOo7UJI1_0 2024-09-12T18:01:50.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.315+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14428181187633820916', time=2024-09-12T19:54:13.899014+0000, chain.objs.size()=1 2024-09-12T18:01:50.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.315+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.RUYerkoHnHGsuFwVO0JU1Af0eAu1RF8_0 2024-09-12T18:01:50.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.315+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11326948417668290118', time=2024-09-12T19:54:14.011468+0000, chain.objs.size()=1 2024-09-12T18:01:50.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.315+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.udw4zxL_INJiyrpVKO3_nDCpxA_oxA9_0 2024-09-12T18:01:50.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.315+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13065627016939200421', time=2024-09-12T19:54:14.029130+0000, chain.objs.size()=1 2024-09-12T18:01:50.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.315+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Ymo1IAave-p1U38yL-NVqsS5jN8I-b__0 2024-09-12T18:01:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.315+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7125117576631987942', time=2024-09-12T19:54:14.032796+0000, chain.objs.size()=1 2024-09-12T18:01:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.315+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.62IfG8QK0s5vbhjfEYidzSDs3Gz1Ang_0 2024-09-12T18:01:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.315+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7075886395033994034', time=2024-09-12T19:54:14.036502+0000, chain.objs.size()=1 2024-09-12T18:01:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.315+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.dZzx5tHb59C-pPr3mimXGtrFKadztec_0 2024-09-12T18:01:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.315+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3812012684693043637', time=2024-09-12T19:54:14.064264+0000, chain.objs.size()=1 2024-09-12T18:01:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.315+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.4vX1L1nfoAHD1mdi5hOY871rlB_Bce4_0 2024-09-12T18:01:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.316+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13632645758705023206', time=2024-09-12T19:54:14.082049+0000, chain.objs.size()=1 2024-09-12T18:01:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.316+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.64oytVwzIzxuGHu8QR6A5_xCWP8iEJ1_0 2024-09-12T18:01:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.316+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5839584145349069022', time=2024-09-12T19:54:14.089482+0000, chain.objs.size()=1 2024-09-12T18:01:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.316+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.4b6KpSwzqVCG-m0f-IxZ6uD1tVZsUti_0 2024-09-12T18:01:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.316+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8393247464525160343', time=2024-09-12T19:54:14.292744+0000, chain.objs.size()=1 2024-09-12T18:01:50.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.316+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.N_QjTFn6Hd4Ny1V5YX_Mx4eaRq8A9F3_0 2024-09-12T18:01:50.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.316+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17363069946900060391', time=2024-09-12T19:54:14.371393+0000, chain.objs.size()=1 2024-09-12T18:01:50.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.316+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.qQtu3MKjXrR9wMQ-j7R4820SlfyRzif_0 2024-09-12T18:01:50.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.316+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16656248038717696263', time=2024-09-12T19:54:14.381987+0000, chain.objs.size()=1 2024-09-12T18:01:50.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.316+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.L8Xle8yr0lExTEideYONEXkza94fWi9_0 2024-09-12T18:01:50.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.316+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7404920223218998429', time=2024-09-12T19:54:14.417937+0000, chain.objs.size()=1 2024-09-12T18:01:50.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.316+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.7Vq3ndyWBYipwwkGUbo9qTkE_WnUqBR_0 2024-09-12T18:01:50.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.317+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15461708853119964939', time=2024-09-12T19:54:14.423933+0000, chain.objs.size()=1 2024-09-12T18:01:50.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.317+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.he0k0v9L72x96-JuGrISNxmNqdYEh3b_0 2024-09-12T18:01:50.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.317+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16503307445936601253', time=2024-09-12T19:54:14.425628+0000, chain.objs.size()=1 2024-09-12T18:01:50.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.317+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.nD40UlNK2Hm-cKPu4QRHcTNG6MktM_T_0 2024-09-12T18:01:50.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.317+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13439647144181501942', time=2024-09-12T19:54:14.445003+0000, chain.objs.size()=1 2024-09-12T18:01:50.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.317+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.rRq5RqQpUBIiBl4rdj3mkHnnAAvcwJd_0 2024-09-12T18:01:50.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.317+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1792437411909261591', time=2024-09-12T19:54:14.447621+0000, chain.objs.size()=1 2024-09-12T18:01:50.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.317+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.nhIhXaxYLbu8y4Uc42cDhe2jMfSxCKW_0 2024-09-12T18:01:50.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.317+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.861670608803595411', time=2024-09-12T19:54:14.542388+0000, chain.objs.size()=1 2024-09-12T18:01:50.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.317+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.XDDaKoyzesgtZz69xhwlVH4e_4VgK1R_0 2024-09-12T18:01:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.318+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.399862877110243013', time=2024-09-12T19:54:14.543165+0000, chain.objs.size()=1 2024-09-12T18:01:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.318+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.JJMGKeo9rnFx_22sCAyH0IveQEEocI7_0 2024-09-12T18:01:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.318+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4948146289729485631', time=2024-09-12T19:54:14.544644+0000, chain.objs.size()=1 2024-09-12T18:01:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.318+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.LRjU7ezDsRR58lP_0upbjoF-5BxC0r__0 2024-09-12T18:01:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.319+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2215195210112920837', time=2024-09-12T19:54:14.575425+0000, chain.objs.size()=1 2024-09-12T18:01:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.319+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.WPN2rKkQbeh7kNpFkp8PN5vAMGzEgxG_0 2024-09-12T18:01:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.319+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2083374536958200439', time=2024-09-12T19:54:14.586002+0000, chain.objs.size()=1 2024-09-12T18:01:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.319+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Ea_XcZorFv49tNYxgUYrFcQZdWtQkQc_0 2024-09-12T18:01:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.319+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9061047309478710353', time=2024-09-12T19:54:14.624232+0000, chain.objs.size()=1 2024-09-12T18:01:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.319+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.JeFQmzn4tc9XjF5pWgWg_6xqI8FBcBv_0 2024-09-12T18:01:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.319+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2840886833968951928', time=2024-09-12T19:54:14.712080+0000, chain.objs.size()=1 2024-09-12T18:01:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.319+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.PMrkzutIPnwFfhhYziD1R4HX16BAgT7_0 2024-09-12T18:01:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.320+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7706831745603597659', time=2024-09-12T19:54:14.723087+0000, chain.objs.size()=1 2024-09-12T18:01:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.320+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.3ZEfRHiJuFynbW2MEEUWx34Br_A0SrU_0 2024-09-12T18:01:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.320+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1051671282629520661', time=2024-09-12T19:54:14.738187+0000, chain.objs.size()=1 2024-09-12T18:01:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.320+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.n--BsztuTwOFdTpo-DB22VviOrfogrn_0 2024-09-12T18:01:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.320+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4854207857430574676', time=2024-09-12T19:54:14.763810+0000, chain.objs.size()=1 2024-09-12T18:01:50.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.320+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.yM2-iDe7IoRsxa9KbHR4Go1cIFtIKnX_0 2024-09-12T18:01:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.320+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5733931087340834950', time=2024-09-12T19:54:14.780783+0000, chain.objs.size()=1 2024-09-12T18:01:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.320+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.DYw7shbG5epWPtAJ1oz_IR2VgjKkVVZ_0 2024-09-12T18:01:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.320+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2964246361780832699', time=2024-09-12T19:54:14.790483+0000, chain.objs.size()=1 2024-09-12T18:01:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.320+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.AozrwEoT_Et_2cgHHqq2yv6ZxM3MGPE_0 2024-09-12T18:01:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.321+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6737683435704271813', time=2024-09-12T19:54:14.805013+0000, chain.objs.size()=1 2024-09-12T18:01:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.321+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.bhmxZ0JsjKBbSfRE8EDVIynuRNYq8yB_0 2024-09-12T18:01:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.321+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7027270822358408883', time=2024-09-12T19:54:14.877811+0000, chain.objs.size()=1 2024-09-12T18:01:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.321+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.6ePQxK4IhZTCh51G4DuDXm3XVbNpo2f_0 2024-09-12T18:01:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.321+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6128911113213272594', time=2024-09-12T19:54:14.889253+0000, chain.objs.size()=1 2024-09-12T18:01:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.321+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.NIJ69rYZoUhgYSHvTopFoAL-JL8F8p-_0 2024-09-12T18:01:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.321+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3299384036946270085', time=2024-09-12T19:54:14.890505+0000, chain.objs.size()=1 2024-09-12T18:01:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.321+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.HXdz3WubdOUko5tb06Fqu2USBp4Gupo_0 2024-09-12T18:01:50.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.321+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14513574988362264610', time=2024-09-12T19:54:14.945089+0000, chain.objs.size()=1 2024-09-12T18:01:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.321+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.v_3E9N_Sg8RGL4h3psjl2rOTR3W30vx_0 2024-09-12T18:01:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.321+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15799759711435102529', time=2024-09-12T19:54:14.953193+0000, chain.objs.size()=1 2024-09-12T18:01:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.321+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.y6EDUMvU6PuN01VR9rpPPthlt39Sq_y_0 2024-09-12T18:01:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.321+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2990398482711533824', time=2024-09-12T19:54:20.601109+0000, chain.objs.size()=1 2024-09-12T18:01:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.321+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.290__shadow_.XZwJI0rUgyiUeOz2XXLODFK5JPNJCvH_0 2024-09-12T18:01:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.322+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2269897046035229815', time=2024-09-12T19:54:20.803996+0000, chain.objs.size()=1 2024-09-12T18:01:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.322+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.291__shadow_.TGPlk9yQWVuJBFRK25KaInIMS1EVhgE_0 2024-09-12T18:01:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.322+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13259860341143242165', time=2024-09-12T19:54:22.160400+0000, chain.objs.size()=1 2024-09-12T18:01:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.322+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.eAwIQwsqYdQto_J72kGJcABXJGfB0Xk_0 2024-09-12T18:01:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.322+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17814149421317207520', time=2024-09-12T19:54:35.747074+0000, chain.objs.size()=1 2024-09-12T18:01:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.322+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.RNwVXCvOReEfkQ6guuPnbDstXOk1Cn-_0 2024-09-12T18:01:50.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.322+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8359379801818949797', time=2024-09-12T19:54:35.754807+0000, chain.objs.size()=1 2024-09-12T18:01:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.322+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.uDwDuyRVMLsMZ2D6lOiXJ_j9qlTWGg3_0 2024-09-12T18:01:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.323+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16905587822289433045', time=2024-09-12T19:54:35.761211+0000, chain.objs.size()=1 2024-09-12T18:01:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.323+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ba0gv6pFkf8KqWMUY9Wm2zsTXmus1EM_0 2024-09-12T18:01:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.323+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3302595020426305964', time=2024-09-12T19:54:35.948057+0000, chain.objs.size()=1 2024-09-12T18:01:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.323+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.GMR3eVXifm3G_DEy2IKBahMK4NDE-jV_0 2024-09-12T18:01:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.323+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16899603681279251180', time=2024-09-12T19:54:35.972893+0000, chain.objs.size()=1 2024-09-12T18:01:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.323+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.WRnkdB5XrCfxlnDDguohIzjC7XOkOWc_0 2024-09-12T18:01:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.324+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2142864633165861495', time=2024-09-12T19:54:35.993752+0000, chain.objs.size()=1 2024-09-12T18:01:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.324+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.cU1uw1HEnVo5UXWmAvLdmQLMsLaWcap_0 2024-09-12T18:01:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.324+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8665456779292457539', time=2024-09-12T19:54:35.997082+0000, chain.objs.size()=1 2024-09-12T18:01:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.324+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ITuALVo_3ntCUz3UgfryrN9nZGDmakp_0 2024-09-12T18:01:50.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.324+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3944190066263025953', time=2024-09-12T19:54:35.998169+0000, chain.objs.size()=1 2024-09-12T18:01:50.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.324+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.60Pp2H-o0qIYSB1--THlkXgAkrhRdQe_0 2024-09-12T18:01:50.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.324+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2546467998647852497', time=2024-09-12T19:54:36.083550+0000, chain.objs.size()=1 2024-09-12T18:01:50.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.324+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.zD_wZJqeFUkrEVmPij1TFlVaQdV24JZ_0 2024-09-12T18:01:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.326+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10365058624940533980', time=2024-09-12T19:54:36.086148+0000, chain.objs.size()=1 2024-09-12T18:01:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.326+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.EyiPLXOG-KelVyujwYziQDd1VlEGyxH_0 2024-09-12T18:01:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.326+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14934191402194079552', time=2024-09-12T19:54:36.087034+0000, chain.objs.size()=1 2024-09-12T18:01:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.326+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.vLzccHLtTCeoT-eBGQ5mq-WGSkIcrOa_0 2024-09-12T18:01:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.326+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2631505372283593616', time=2024-09-12T19:54:36.129393+0000, chain.objs.size()=1 2024-09-12T18:01:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.326+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.jerFdt2w9Q0sed6Sfi_tZCQmtfortql_0 2024-09-12T18:01:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.326+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11845678331099952155', time=2024-09-12T19:54:36.144461+0000, chain.objs.size()=1 2024-09-12T18:01:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.326+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.787wGTP_H_sits-Sy0cvy3TPJodF64__0 2024-09-12T18:01:50.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.326+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2404719529683328921', time=2024-09-12T19:54:36.166425+0000, chain.objs.size()=1 2024-09-12T18:01:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.326+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.hogHF1pJ2lJKkhD8THVFgE7D6lkq7lO_0 2024-09-12T18:01:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.326+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4128264925191089624', time=2024-09-12T19:54:36.171972+0000, chain.objs.size()=1 2024-09-12T18:01:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.326+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rsW-9wC8_hHld7N5QwxtrrLgUWJwbdo_0 2024-09-12T18:01:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.326+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10679857130039340758', time=2024-09-12T19:54:36.267079+0000, chain.objs.size()=1 2024-09-12T18:01:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.326+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.p3zd7q45u4dtJdra32Ng1R3yk3JuD48_0 2024-09-12T18:01:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.329+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17073741119300481327', time=2024-09-12T19:54:36.284177+0000, chain.objs.size()=1 2024-09-12T18:01:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.329+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0VsAT2clu6eZvEMUJc6YbQR6ldI8nAH_0 2024-09-12T18:01:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.329+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8179266744069335289', time=2024-09-12T19:54:36.286565+0000, chain.objs.size()=1 2024-09-12T18:01:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.329+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.IKFLI3376NWHaNsWMcqYeAYQhKQU3m1_0 2024-09-12T18:01:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.329+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16587766555682828091', time=2024-09-12T19:54:36.308396+0000, chain.objs.size()=1 2024-09-12T18:01:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.329+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.KiOe8TOPxj0NsySoUZdbx6F4ITw-VrZ_0 2024-09-12T18:01:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.329+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9986269938582053009', time=2024-09-12T19:54:36.338084+0000, chain.objs.size()=1 2024-09-12T18:01:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.329+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.B8Ns16oTVZrSCvceCufoAVfXSjHpno3_0 2024-09-12T18:01:50.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.331+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2963562919761615031', time=2024-09-12T19:54:36.436704+0000, chain.objs.size()=1 2024-09-12T18:01:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.331+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.LUBrpOsKyfKMutE2SsdqgpKPHT7YViM_0 2024-09-12T18:01:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.331+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3988732307324118580', time=2024-09-12T19:54:36.438812+0000, chain.objs.size()=1 2024-09-12T18:01:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.331+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_._oUvuhU9bfKbVldq3YvI71suzqWGW3F_0 2024-09-12T18:01:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.331+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1958121459211787894', time=2024-09-12T19:54:36.441689+0000, chain.objs.size()=1 2024-09-12T18:01:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.331+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.OYbplfqSanDIj02kckwSdZZZ3E-LR3-_0 2024-09-12T18:01:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.331+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10171251399186408296', time=2024-09-12T19:54:36.579900+0000, chain.objs.size()=1 2024-09-12T18:01:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.331+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.X75TgbEfKQmPKmPhh2FBhX5h8Rgn3h1_0 2024-09-12T18:01:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.331+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13303909393692783365', time=2024-09-12T19:54:36.589529+0000, chain.objs.size()=1 2024-09-12T18:01:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.331+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.x7k7rTmzKvZBwX87ufWeR7njkwMQajP_0 2024-09-12T18:01:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.331+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3320911036758548989', time=2024-09-12T19:54:36.623165+0000, chain.objs.size()=1 2024-09-12T18:01:50.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.331+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.KkCyxM5CnK7evZXu7B-5sF4xDrQx2nC_0 2024-09-12T18:01:50.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.332+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16549743329274761939', time=2024-09-12T19:54:36.626459+0000, chain.objs.size()=1 2024-09-12T18:01:50.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.332+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.S19BXXMnACSLIn8a8RnCPgqivCjZet7_0 2024-09-12T18:01:50.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.334+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1274955866261001114', time=2024-09-12T19:54:36.635958+0000, chain.objs.size()=1 2024-09-12T18:01:50.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.334+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.pcleXEyUvgFOfGJ0Rvr9j7RI0K7q8Bt_0 2024-09-12T18:01:50.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.334+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15320587187997694803', time=2024-09-12T19:54:36.744306+0000, chain.objs.size()=1 2024-09-12T18:01:50.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.334+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.cn7hRv_NRpo5jHSwbfmCBeME-i7G44v_0 2024-09-12T18:01:50.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.334+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2112320989773530936', time=2024-09-12T19:54:36.745126+0000, chain.objs.size()=1 2024-09-12T18:01:50.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.334+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.713wDtIqtOlqk7rGaaz5KxMrs4sUG9U_0 2024-09-12T18:01:50.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.334+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12353022300209140890', time=2024-09-12T19:54:36.755214+0000, chain.objs.size()=1 2024-09-12T18:01:50.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.334+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.WSEac50-yR7DehU-U9N7ovp4FfhkYJt_0 2024-09-12T18:01:50.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3920457744547898770', time=2024-09-12T19:54:36.903669+0000, chain.objs.size()=1 2024-09-12T18:01:50.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0lwFs4ci-yrBi3N7tw5iDYcslPP-k-w_0 2024-09-12T18:01:50.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6765819666663624528', time=2024-09-12T19:54:36.911964+0000, chain.objs.size()=1 2024-09-12T18:01:50.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.NE68QeukvXboc-ik1fy_vjFNpdRs4HK_0 2024-09-12T18:01:50.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17237965068159909376', time=2024-09-12T19:54:36.938584+0000, chain.objs.size()=1 2024-09-12T18:01:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QKcaGnIo9qEG_Kk8C0hcIpkzBeApaSn_0 2024-09-12T18:01:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1128220480334220242', time=2024-09-12T19:54:44.470265+0000, chain.objs.size()=1 2024-09-12T18:01:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.CttCdRm_-BlZE8nOLhoVV0TjLDMXp0n_0 2024-09-12T18:01:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9750099117419022199', time=2024-09-12T19:54:44.477407+0000, chain.objs.size()=1 2024-09-12T18:01:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.bDBOj_7r2m66_DEKwxHBZBD3ccLr-ot_0 2024-09-12T18:01:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10303760230271324344', time=2024-09-12T19:54:44.493917+0000, chain.objs.size()=1 2024-09-12T18:01:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.AYgc-46AAqdcm7ua0d6ANY4jYuzH9Bq_0 2024-09-12T18:01:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4085270995449186326', time=2024-09-12T19:54:44.506174+0000, chain.objs.size()=1 2024-09-12T18:01:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.gtkNeKKzj07svNM2Q8ix1uwJGwoSk5N_0 2024-09-12T18:01:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16674648917825357295', time=2024-09-12T19:54:44.644099+0000, chain.objs.size()=1 2024-09-12T18:01:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.2fOvedl2WDXqwsnlhGW3x8qdfPmd24w_0 2024-09-12T18:01:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16937039763883413090', time=2024-09-12T19:54:44.696620+0000, chain.objs.size()=1 2024-09-12T18:01:50.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.tT6LxoPu6ELr-dR3necz0rpMAPFifZ1_0 2024-09-12T18:01:50.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16635668095201444', time=2024-09-12T19:54:44.704222+0000, chain.objs.size()=1 2024-09-12T18:01:50.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.FQi7W82Ee12SyRPRlwoTwWMgU4h5TsB_0 2024-09-12T18:01:50.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9274979994644419510', time=2024-09-12T19:54:44.801056+0000, chain.objs.size()=1 2024-09-12T18:01:50.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.337+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.FBOJIli_fpo14mPphavvtSr2jbprRAP_0 2024-09-12T18:01:50.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.339+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10654998796526622143', time=2024-09-12T19:54:44.810706+0000, chain.objs.size()=1 2024-09-12T18:01:50.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.339+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.8x9v3UJhqfw86sfLP8rOLRJ6PsZnrzf_0 2024-09-12T18:01:50.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.339+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10478168742979752581', time=2024-09-12T19:54:44.850119+0000, chain.objs.size()=1 2024-09-12T18:01:50.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.339+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.JlOrSxWEbnWQF2U6P5TLjBOdmcuaQ89_0 2024-09-12T18:01:50.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.339+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10233701936438738274', time=2024-09-12T19:54:44.886276+0000, chain.objs.size()=1 2024-09-12T18:01:50.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.339+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.KMW6n63ZDyqGBaAt_fBeYh3H7yRR0xi_0 2024-09-12T18:01:50.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.339+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.815193005974117488', time=2024-09-12T19:54:44.967921+0000, chain.objs.size()=1 2024-09-12T18:01:50.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.339+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.xUMcigqjjRgPatc3Q7LGR0-MsvDBwGU_0 2024-09-12T18:01:50.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.344+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/44039 2024-09-12T18:01:50.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=39, truncated=0, next_marker='' 2024-09-12T18:01:50.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4788353123934951956', time=2024-09-12T19:54:44.976939+0000, chain.objs.size()=1 2024-09-12T18:01:50.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.q16NekntNVCyBcI3eNaDhDnvFf-c6vq_0 2024-09-12T18:01:50.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5618552021255380198', time=2024-09-12T19:54:44.978969+0000, chain.objs.size()=1 2024-09-12T18:01:50.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.F_7BYDO7P441_akzwSFRmxPukO9Cs9f_0 2024-09-12T18:01:50.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12044318083566267606', time=2024-09-12T19:54:45.002845+0000, chain.objs.size()=1 2024-09-12T18:01:50.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.biDmw1G6_OraDrfe7qlTkJy1xMC3TWI_0 2024-09-12T18:01:50.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10202904810682903795', time=2024-09-12T19:54:45.206964+0000, chain.objs.size()=1 2024-09-12T18:01:50.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.F2xDnBqndfs50qcqIOswJY7q70wOB96_0 2024-09-12T18:01:50.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5618917886612573708', time=2024-09-12T19:54:45.234606+0000, chain.objs.size()=1 2024-09-12T18:01:50.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.hauPHEF-r3WUv7xsHVrEhEwK1lt0U4h_0 2024-09-12T18:01:50.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2178677755187587343', time=2024-09-12T19:54:45.254741+0000, chain.objs.size()=1 2024-09-12T18:01:50.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.qWaAFznj6LtJLJOcqem7Yt8jHVKiavu_0 2024-09-12T18:01:50.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1409663924642463021', time=2024-09-12T19:54:45.399910+0000, chain.objs.size()=1 2024-09-12T18:01:50.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jewoRR1lnTn3ltHGpUxvHyKnpu067iI_0 2024-09-12T18:01:50.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13387469478144299965', time=2024-09-12T19:54:45.420387+0000, chain.objs.size()=1 2024-09-12T18:01:50.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.k7YPum1q2jOyl0mG994Zm4vp5ZLmfxo_0 2024-09-12T18:01:50.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1205761760970759910', time=2024-09-12T19:54:45.508499+0000, chain.objs.size()=1 2024-09-12T18:01:50.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.nG7AvJ4QDzmmdPDKNodisJGwIXX1uEN_0 2024-09-12T18:01:50.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9709808572917546917', time=2024-09-12T19:54:45.518981+0000, chain.objs.size()=1 2024-09-12T18:01:50.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.xLnUqmP1CGczwLf8hSyOSmC-91567lk_0 2024-09-12T18:01:50.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16987938112360684871', time=2024-09-12T19:54:45.524513+0000, chain.objs.size()=1 2024-09-12T18:01:50.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.vbXpSeGUN6qPH3DgNx8I-iACKvJPWo7_0 2024-09-12T18:01:50.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9140287082583635805', time=2024-09-12T19:54:45.535444+0000, chain.objs.size()=1 2024-09-12T18:01:50.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.347+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.SqBhVWmZOFjdE492mYeGo3mPEgUpJjC_0 2024-09-12T18:01:50.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.349+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2514820421910087799', time=2024-09-12T19:54:45.538438+0000, chain.objs.size()=1 2024-09-12T18:01:50.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.349+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Fik9fYgBWSrvqDkhlPEFlB50k040kG__0 2024-09-12T18:01:50.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4610165077001522477', time=2024-09-12T19:54:45.577355+0000, chain.objs.size()=1 2024-09-12T18:01:50.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.fl_xNgbxYg1zklEKbuaFh-yaPqafO05_0 2024-09-12T18:01:50.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6960519037121009038', time=2024-09-12T19:54:45.696380+0000, chain.objs.size()=1 2024-09-12T18:01:50.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.70dZK9DLY5znUdLx1vjLXJDVoDznzvI_0 2024-09-12T18:01:50.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3969151879232572826', time=2024-09-12T19:54:46.648662+0000, chain.objs.size()=1 2024-09-12T18:01:50.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.330__shadow_.n3w_2Mogcgt1uHME6fo9BWBsl8kI9Qo_0 2024-09-12T18:01:50.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18196337233670428506', time=2024-09-12T19:54:55.452027+0000, chain.objs.size()=1 2024-09-12T18:01:50.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.376__shadow_.C-TQkt-CiP1l-Gq3zjZdPKCC7QszWao_0 2024-09-12T18:01:50.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3061224978258717019', time=2024-09-12T19:55:10.753011+0000, chain.objs.size()=1 2024-09-12T18:01:50.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.442__shadow_.qmwfLAhNXbbBFYw8e5ZAP0kvMqi5-I0_0 2024-09-12T18:01:50.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10652870795377600935', time=2024-09-12T19:55:14.733794+0000, chain.objs.size()=1 2024-09-12T18:01:50.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.458__shadow_.uODHdyZJqJBQt7Pm6m9ZBFjLowLtqlf_0 2024-09-12T18:01:50.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3795122295126610504', time=2024-09-12T19:55:20.951572+0000, chain.objs.size()=1 2024-09-12T18:01:50.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.484__shadow_.Od66xvk9WpdFJtjz6pA5jtyNxtJmaPb_0 2024-09-12T18:01:50.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15258907549720547724', time=2024-09-12T19:55:20.954766+0000, chain.objs.size()=1 2024-09-12T18:01:50.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.484__shadow_.ttRPn8LO5PpPRqEGq7-oeLvtS0K3eLd_0 2024-09-12T18:01:50.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5277203332394386956', time=2024-09-12T19:55:21.169181+0000, chain.objs.size()=1 2024-09-12T18:01:50.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.485__shadow_.UTeArG3Gt-dg_5xnEC5Is5M30_49N6a_0 2024-09-12T18:01:50.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15383879715080186986', time=2024-09-12T19:55:31.558679+0000, chain.objs.size()=6 2024-09-12T18:01:50.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.350+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.520__multipart_mymultipart.2~xty7kcQRPnr6XWLqhmMRSiHmjefFLAM.1 2024-09-12T18:01:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.357+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.520__multipart_mymultipart.2~xty7kcQRPnr6XWLqhmMRSiHmjefFLAM.2 2024-09-12T18:01:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.357+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.520__multipart_mymultipart.2~xty7kcQRPnr6XWLqhmMRSiHmjefFLAM.3 2024-09-12T18:01:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.357+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.520__multipart_mymultipart.2~xty7kcQRPnr6XWLqhmMRSiHmjefFLAM.4 2024-09-12T18:01:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.357+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.520__multipart_mymultipart.2~xty7kcQRPnr6XWLqhmMRSiHmjefFLAM.5 2024-09-12T18:01:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.357+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.520__multipart_mymultipart.2~xty7kcQRPnr6XWLqhmMRSiHmjefFLAM.6 2024-09-12T18:01:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.357+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6081974039776855797', time=2024-09-12T19:55:39.274598+0000, chain.objs.size()=2 2024-09-12T18:01:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.357+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.526__multipart_mymultipart.2~nm0itfZJEQgDgkWEVB3pSyT9JQyl0ay.1 2024-09-12T18:01:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.357+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.526__multipart_mymultipart.2~nm0itfZJEQgDgkWEVB3pSyT9JQyl0ay.2 2024-09-12T18:01:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.357+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.776708550156241455', time=2024-09-12T19:56:13.250350+0000, chain.objs.size()=1 2024-09-12T18:01:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.357+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.558__shadow_.BZVaos0M2UmnHiTGfm5Dy0BYbfN2SRz_0 2024-09-12T18:01:50.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.357+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16768700615740660829', time=2024-09-12T19:56:13.949222+0000, chain.objs.size()=1 2024-09-12T18:01:50.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.357+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.559__shadow_.w_52pea39vgB8f5JvWm-lOiYvKMQJ83_0 2024-09-12T18:01:50.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.357+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9474065340569746549', time=2024-09-12T19:56:15.201679+0000, chain.objs.size()=1 2024-09-12T18:01:50.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.357+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.562__multipart_mymultipart.eslTID8I2f-zt9spudIGILHZIzkAbew5.1 2024-09-12T18:01:50.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.357+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17808196230083554291', time=2024-09-12T19:56:22.921629+0000, chain.objs.size()=1 2024-09-12T18:01:50.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.357+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:d.uxIe-DgUwCEoSavIj3tVyT3iX8uq7_.LFV6VHgPbMl758qQDR90GO4azjrQJU3_0 2024-09-12T18:01:50.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6926765095301287107', time=2024-09-12T19:56:23.248680+0000, chain.objs.size()=1 2024-09-12T18:01:50.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:vRVHxa8MWeW2Og8o6gVv0zL2kRGnKFt_.m_EspXD7-9tfNdYQzaKvNVM1kBkCfJH_0 2024-09-12T18:01:50.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11806883902919172843', time=2024-09-12T19:56:31.669803+0000, chain.objs.size()=1 2024-09-12T18:01:50.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.576__shadow:1AJzpGu-LlGeeWZY8aQsk3PHbF32-MP_.MROVKds_mikm5lIsBq1JKyKjXyYAxoT_0 2024-09-12T18:01:50.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8208515734601000779', time=2024-09-12T19:56:37.608671+0000, chain.objs.size()=1 2024-09-12T18:01:50.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:1CCMKwGr8yMcdyIInZWI9V1f50j8u37_.lkiuI_8qP4lLUVCYiIb0fYhpv-9zVZx_0 2024-09-12T18:01:50.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3207363219472000834', time=2024-09-12T19:56:50.016887+0000, chain.objs.size()=1 2024-09-12T18:01:50.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.580__shadow:KLqt57MZ.hOAJE7CU4X7SY1FnqqZv0W_.ur8e8e2cF4Ah-jh4Io3Cj7-9cNx8rPx_0 2024-09-12T18:01:50.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5420008212666803428', time=2024-09-12T19:56:51.227946+0000, chain.objs.size()=1 2024-09-12T18:01:50.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.583__shadow:0MVsMV8bEA2DcVuQFF7VOK8olN3o-3m_.ORhx0gOzmWvDy7iy-yXfnnPzpMH60Uk_0 2024-09-12T18:01:50.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1534809191423633607', time=2024-09-12T19:57:01.327568+0000, chain.objs.size()=6 2024-09-12T18:01:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.616__multipart_multipart_enc.2~KeSrjKY4e6t2NfW5muyYsNujnB8sRyQ.1 2024-09-12T18:01:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.616__multipart_multipart_enc.2~KeSrjKY4e6t2NfW5muyYsNujnB8sRyQ.2 2024-09-12T18:01:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.616__multipart_multipart_enc.2~KeSrjKY4e6t2NfW5muyYsNujnB8sRyQ.3 2024-09-12T18:01:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.616__multipart_multipart_enc.2~KeSrjKY4e6t2NfW5muyYsNujnB8sRyQ.4 2024-09-12T18:01:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.616__multipart_multipart_enc.2~KeSrjKY4e6t2NfW5muyYsNujnB8sRyQ.5 2024-09-12T18:01:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.362+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.616__multipart_multipart_enc.2~KeSrjKY4e6t2NfW5muyYsNujnB8sRyQ.6 2024-09-12T18:01:50.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.364+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17498539605579726901', time=2024-09-12T19:59:12.584273+0000, chain.objs.size()=2 2024-09-12T18:01:50.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.364+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.651__shadow_.Tl5deQ_Yic8bh9jytCI1squ_a2NyXoU_0 2024-09-12T18:01:50.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.364+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.651__shadow_.Tl5deQ_Yic8bh9jytCI1squ_a2NyXoU_1 2024-09-12T18:01:50.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.365+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12308368140014439715', time=2024-09-12T19:59:24.167820+0000, chain.objs.size()=1 2024-09-12T18:01:50.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.365+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.697__shadow:AV8FBXu0aXjCuNTE.8k5uSJeA2wSUcI_.RpJe2Y8JDumirpP_zwsUDMEp8c2KD8j_0 2024-09-12T18:01:50.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.367+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10798702190988641039', time=2024-09-12T19:59:27.502736+0000, chain.objs.size()=1 2024-09-12T18:01:50.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.367+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.711__shadow:Ol0TXfl5uWcYTLrnbfzg0ykASrP3B3p_.2a8nnqGXsA3ry4wC3kUEKsQLIYaok2I_0 2024-09-12T18:01:50.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.367+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18437157157089440188', time=2024-09-12T19:59:53.737883+0000, chain.objs.size()=1 2024-09-12T18:01:50.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.367+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.742__shadow_.no6twzx0oKaj-kP6CfVAYzRm7-xzgh2_0 2024-09-12T18:01:50.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.367+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~ZbU4HlX-5g5FuPwaVulC_9DLfEHFtGD', time=2024-09-12T19:59:54.245008+0000, chain.objs.size()=1 2024-09-12T18:01:50.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.367+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.743__multipart_mymultipart.2~ZbU4HlX-5g5FuPwaVulC_9DLfEHFtGD.1 2024-09-12T18:01:50.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.372+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.375+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:01:50.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.377+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.377+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46657' 2024-09-12T18:01:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15391762429028476998', time=2024-09-12T19:53:09.624267+0000, chain.objs.size()=1 2024-09-12T18:01:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.200__shadow_.768geepazEbhN0ndRu-G2SR6ZDu4uiV_0 2024-09-12T18:01:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17457902095872544962', time=2024-09-12T19:53:59.651193+0000, chain.objs.size()=1 2024-09-12T18:01:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.232__shadow_.N8Jed0Kvo1jcnr-glso96DdMALkCCpe_0 2024-09-12T18:01:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8721710439844713760', time=2024-09-12T19:54:00.736308+0000, chain.objs.size()=1 2024-09-12T18:01:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.237__shadow_.vCPmGMBMYIyej-b8o1Xwfuxn9CrkiFl_0 2024-09-12T18:01:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1638203495570265113', time=2024-09-12T19:54:00.736871+0000, chain.objs.size()=1 2024-09-12T18:01:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.237__shadow_.ulRSdStGj0g-4VscJMWuaBIwzEPkvQq_0 2024-09-12T18:01:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3356393606920530459', time=2024-09-12T19:54:00.994140+0000, chain.objs.size()=1 2024-09-12T18:01:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.238__shadow_.-KfJ3eYrbR30fFTxjZyUQxYYupLeWbO_0 2024-09-12T18:01:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17150857671592393949', time=2024-09-12T19:54:02.054398+0000, chain.objs.size()=1 2024-09-12T18:01:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.243__shadow_.4-Aa2nCjAO0aAQ71zR37cUyuVaLx-yF_0 2024-09-12T18:01:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7649407714484376032', time=2024-09-12T19:54:05.083809+0000, chain.objs.size()=1 2024-09-12T18:01:50.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.257__shadow_.yIHfSlRk3xiWBObDuVH_gPSGt4EqS3X_0 2024-09-12T18:01:50.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6817402756397871236', time=2024-09-12T19:54:13.483973+0000, chain.objs.size()=1 2024-09-12T18:01:50.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.PGLwjtgBHH-ecgLvvGGb1rF_mlS8Jkf_0 2024-09-12T18:01:50.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1607886284625698874', time=2024-09-12T19:54:13.572608+0000, chain.objs.size()=1 2024-09-12T18:01:50.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.jqRxLLqEdVTVyATMyjpybaCS4viP9Dj_0 2024-09-12T18:01:50.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2782366435148408887', time=2024-09-12T19:54:13.669793+0000, chain.objs.size()=1 2024-09-12T18:01:50.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Mmxp-q6Wh8KqqAOct4VBFAJOJgUgGPv_0 2024-09-12T18:01:50.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14060887016778232374', time=2024-09-12T19:54:13.678428+0000, chain.objs.size()=1 2024-09-12T18:01:50.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.RToqqy9f7IkY4OUsXb6KFVZSXr-guSI_0 2024-09-12T18:01:50.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7264501441437563776', time=2024-09-12T19:54:13.709325+0000, chain.objs.size()=1 2024-09-12T18:01:50.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.378+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.VaTOvlHjV5Pq4twRW5tJ1LN_dtr2V2L_0 2024-09-12T18:01:50.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15802094029395144806', time=2024-09-12T19:54:13.710690+0000, chain.objs.size()=1 2024-09-12T18:01:50.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.bKX4p9cWmSYCFwyvkt4vwhNv0NYy1wr_0 2024-09-12T18:01:50.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1464067099086754671', time=2024-09-12T19:54:13.734342+0000, chain.objs.size()=1 2024-09-12T18:01:50.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.f2_ZwbCvgY-1gElZri0BJUTziG8EG1W_0 2024-09-12T18:01:50.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9582446731331171138', time=2024-09-12T19:54:13.846970+0000, chain.objs.size()=1 2024-09-12T18:01:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.AmL7NF4NNHy4ae7Nn9qw1yaf3Roxx-t_0 2024-09-12T18:01:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14363175700372391088', time=2024-09-12T19:54:13.860614+0000, chain.objs.size()=1 2024-09-12T18:01:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ISMy4tY7rl2JEYXebwYz0dlcICU4SXj_0 2024-09-12T18:01:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13890985186243225696', time=2024-09-12T19:54:13.876818+0000, chain.objs.size()=1 2024-09-12T18:01:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.kDNCUgU2sNaZD3NURGWwQbzEp3eqUMt_0 2024-09-12T18:01:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.634893373385146340', time=2024-09-12T19:54:13.897124+0000, chain.objs.size()=1 2024-09-12T18:01:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.lpToSBVQpcdHHEM9Ns8FLAa5NWgGUyd_0 2024-09-12T18:01:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4371901804411986227', time=2024-09-12T19:54:13.920586+0000, chain.objs.size()=1 2024-09-12T18:01:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.lpIrLuKzgL0uNC9TzlKHr6YQVg2a1O4_0 2024-09-12T18:01:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16679352010390227040', time=2024-09-12T19:54:14.097307+0000, chain.objs.size()=1 2024-09-12T18:01:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.wHNAoOws8crfTrko79qgSYWlT0nUqOH_0 2024-09-12T18:01:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15207523614883311330', time=2024-09-12T19:54:14.373801+0000, chain.objs.size()=1 2024-09-12T18:01:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.URZivl6HiOX0JJW4r_CmliErK_J24_z_0 2024-09-12T18:01:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2179279270064506255', time=2024-09-12T19:54:14.388458+0000, chain.objs.size()=1 2024-09-12T18:01:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.iwggFLVkZdhiwQ4P9DIdDomtEq3LtyW_0 2024-09-12T18:01:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18171086639872448558', time=2024-09-12T19:54:14.413503+0000, chain.objs.size()=1 2024-09-12T18:01:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.380+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.GxH0amDIOvbu7plYH_U8DT50Qnk9Mda_0 2024-09-12T18:01:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.382+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1721033494292741691', time=2024-09-12T19:54:14.422604+0000, chain.objs.size()=1 2024-09-12T18:01:50.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.382+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.XPmWUStTLR4ugQ6so7gluhlq7ze9lgi_0 2024-09-12T18:01:50.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.382+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12810106817258378933', time=2024-09-12T19:54:14.453345+0000, chain.objs.size()=1 2024-09-12T18:01:50.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.382+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.VHUbt5fReMtR1tALKNIkFzmxrJxzfZY_0 2024-09-12T18:01:50.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7198912250667955412', time=2024-09-12T19:54:14.457284+0000, chain.objs.size()=1 2024-09-12T18:01:50.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.QK_Oh6ytYEhKFh-vx7FCKYgBLWbWj7n_0 2024-09-12T18:01:50.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18444106391245752030', time=2024-09-12T19:54:14.560183+0000, chain.objs.size()=1 2024-09-12T18:01:50.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.QPITXeB3cRLymJzMRNciTqpNmtrZOBb_0 2024-09-12T18:01:50.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12608726989506395961', time=2024-09-12T19:54:14.576624+0000, chain.objs.size()=1 2024-09-12T18:01:50.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.sCfK8IiZCu3IwcccaPiHDsiSEoYH9gh_0 2024-09-12T18:01:50.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2101645599663477621', time=2024-09-12T19:54:14.578931+0000, chain.objs.size()=1 2024-09-12T18:01:50.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2CIpXcSMmV7apu6sB5Jav6SrfhrHQsa_0 2024-09-12T18:01:50.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7271839830593481913', time=2024-09-12T19:54:14.614647+0000, chain.objs.size()=1 2024-09-12T18:01:50.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.d11X3BNKs0q-YfMVQzPlcYxg5T_aBkj_0 2024-09-12T18:01:50.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8559655964663055255', time=2024-09-12T19:54:14.712202+0000, chain.objs.size()=1 2024-09-12T18:01:50.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.wssiODY6Hk9uroeOF6vYuTmLuGTEscL_0 2024-09-12T18:01:50.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2360803233464308534', time=2024-09-12T19:54:14.744702+0000, chain.objs.size()=1 2024-09-12T18:01:50.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.6RK5KQJyCIhk433zQcFiOkSLrqz4dcL_0 2024-09-12T18:01:50.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11043863389653666055', time=2024-09-12T19:54:14.750758+0000, chain.objs.size()=1 2024-09-12T18:01:50.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.c2xeK8xT7w0yQKlEhj0SfExnyC8R3sG_0 2024-09-12T18:01:50.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10366574395185375806', time=2024-09-12T19:54:14.764792+0000, chain.objs.size()=1 2024-09-12T18:01:50.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.3epNk0qxMzqjXVAThaX2iih6_25-Atr_0 2024-09-12T18:01:50.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9991550109616186979', time=2024-09-12T19:54:14.770304+0000, chain.objs.size()=1 2024-09-12T18:01:50.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.0Tvg-XMELW4IiEWA8tuv-sgw8MEzaa7_0 2024-09-12T18:01:50.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3629824054870484269', time=2024-09-12T19:54:14.794904+0000, chain.objs.size()=1 2024-09-12T18:01:50.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.385+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.AJHVhMLjSHHTj0fCTEh4kwApmcKoKZc_0 2024-09-12T18:01:50.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.387+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3777938365870723642', time=2024-09-12T19:54:14.898061+0000, chain.objs.size()=1 2024-09-12T18:01:50.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.387+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.yTgvp7hgTBQi9GWa0ub7pqubp08xNzu_0 2024-09-12T18:01:50.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.387+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16856766596380449996', time=2024-09-12T19:54:14.927164+0000, chain.objs.size()=1 2024-09-12T18:01:50.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.387+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-L4pbgTFIj1d4A1EttyVJbpTlacdtuy_0 2024-09-12T18:01:50.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.388+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5699083679092886802', time=2024-09-12T19:54:15.705653+0000, chain.objs.size()=1 2024-09-12T18:01:50.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.388+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.267__shadow_.AmGmcDbR8TfT333fUPXBGwj-ewfQGN-_0 2024-09-12T18:01:50.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.388+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.45201721270255721', time=2024-09-12T19:54:17.561036+0000, chain.objs.size()=1 2024-09-12T18:01:50.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.388+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.276__shadow_.3tIKFfBFbmNBuR25i0cuHzwhwVkfDsg_0 2024-09-12T18:01:50.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.388+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11968406996293723316', time=2024-09-12T19:54:19.058819+0000, chain.objs.size()=1 2024-09-12T18:01:50.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.388+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.283__shadow_.HWYwiByEgWd4QTnWZ0e8NiRO_D_Nb-h_0 2024-09-12T18:01:50.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.388+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14610400288340307901', time=2024-09-12T19:54:20.197529+0000, chain.objs.size()=1 2024-09-12T18:01:50.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.388+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.288__shadow_.2trlqwrITDikswtNLMBkbqXyETy0bwL_0 2024-09-12T18:01:50.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.388+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3003996489940760566', time=2024-09-12T19:54:21.577351+0000, chain.objs.size()=1 2024-09-12T18:01:50.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.388+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.2Z6PIInhUBwgjlYBTxiAnUvAalCm4sF_0 2024-09-12T18:01:50.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.390+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.891280302101365399', time=2024-09-12T19:54:21.578055+0000, chain.objs.size()=1 2024-09-12T18:01:50.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.390+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.h6PjUKZZrzvUJ1V9ADQNL6-_kXt11ts_0 2024-09-12T18:01:50.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.390+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10311202899901756514', time=2024-09-12T19:54:21.590223+0000, chain.objs.size()=1 2024-09-12T18:01:50.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.390+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.8FSSIQnqdt6XJG8rm09BGH-zdrv3XcQ_0 2024-09-12T18:01:50.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.390+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8299175412600563275', time=2024-09-12T19:54:22.421682+0000, chain.objs.size()=1 2024-09-12T18:01:50.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.390+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.295__shadow_.8a-16o-TDYcHpH9eV4oFbTIAXfvSF4k_0 2024-09-12T18:01:50.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.390+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10048271903792226282', time=2024-09-12T19:54:22.833032+0000, chain.objs.size()=1 2024-09-12T18:01:50.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.390+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.297__shadow_.rK2o-h4IviqL1M6up1PUeDB1ETrQyxU_0 2024-09-12T18:01:50.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.390+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2446051614052076880', time=2024-09-12T19:54:23.772839+0000, chain.objs.size()=1 2024-09-12T18:01:50.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.390+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.301__shadow_.asbczZE9lV8p7pD2LGvf66D8EJ9JOm8_0 2024-09-12T18:01:50.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.390+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14443364844772630104', time=2024-09-12T19:54:24.580596+0000, chain.objs.size()=1 2024-09-12T18:01:50.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.390+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.305__shadow_.hwkK6vqZe7aA1yOrBMXIt4aQSEaFBWp_0 2024-09-12T18:01:50.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.390+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17285705744855891', time=2024-09-12T19:54:35.786942+0000, chain.objs.size()=1 2024-09-12T18:01:50.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.390+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.73Xdjv5e5SDkRP0ERB-4jk5A0DIKsoq_0 2024-09-12T18:01:50.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.390+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2667566893535217521', time=2024-09-12T19:54:35.829620+0000, chain.objs.size()=1 2024-09-12T18:01:50.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.390+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.qsKirTxu4iGIkX1y7-0ZchiPZxaSfIn_0 2024-09-12T18:01:50.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.391+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4678738228240761020', time=2024-09-12T19:54:35.964953+0000, chain.objs.size()=1 2024-09-12T18:01:50.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.391+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.wF7I0eIRRttVqCL_2FYpyREAtBQIwTA_0 2024-09-12T18:01:50.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.391+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17558715308487045443', time=2024-09-12T19:54:35.985857+0000, chain.objs.size()=1 2024-09-12T18:01:50.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.391+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.HThTNroLXTBSLcFz3I6KLN0brAgHotl_0 2024-09-12T18:01:50.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.391+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10075097425030026847', time=2024-09-12T19:54:35.993011+0000, chain.objs.size()=1 2024-09-12T18:01:50.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.391+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.doWr4OnrLTSLKFyR3CiKcelMOL2eUuc_0 2024-09-12T18:01:50.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.391+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9232785087543614793', time=2024-09-12T19:54:36.102348+0000, chain.objs.size()=1 2024-09-12T18:01:50.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.392+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.xk-Hrvecr9nbBfyQNphSpl89YwKrwcV_0 2024-09-12T18:01:50.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.392+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15691102970313077927', time=2024-09-12T19:54:36.128769+0000, chain.objs.size()=1 2024-09-12T18:01:50.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.392+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.3aVKNBZ_eWP-LUcGndb2DX84O5NojpQ_0 2024-09-12T18:01:50.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.392+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18031473602408513570', time=2024-09-12T19:54:36.135217+0000, chain.objs.size()=1 2024-09-12T18:01:50.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.392+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.mbNRrzVafE2ed6Sv821JntWpAXPdHfG_0 2024-09-12T18:01:50.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.392+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3962752508272284340', time=2024-09-12T19:54:36.139137+0000, chain.objs.size()=1 2024-09-12T18:01:50.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.392+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.LpnDHgSgOCU4FhUVse1CJMNEWWUkoDr_0 2024-09-12T18:01:50.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.392+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17584253877800788591', time=2024-09-12T19:54:36.273868+0000, chain.objs.size()=1 2024-09-12T18:01:50.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.392+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.a58dsXlz-UwuBwZ5TorNAYs9OWQH87Z_0 2024-09-12T18:01:50.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.392+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2205677507432140704', time=2024-09-12T19:54:36.281000+0000, chain.objs.size()=1 2024-09-12T18:01:50.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.392+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.DeyJuKkwnlYzC0aJAVOVgMdqTPMM1kT_0 2024-09-12T18:01:50.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.394+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7110653538305010854', time=2024-09-12T19:54:36.342682+0000, chain.objs.size()=1 2024-09-12T18:01:50.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.394+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.uhRX904vjWZNxp8q_NJ6tROj0xoOck4_0 2024-09-12T18:01:50.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.394+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17558538524102237224', time=2024-09-12T19:54:36.455383+0000, chain.objs.size()=1 2024-09-12T18:01:50.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.394+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1d6nAU9hknu-bCiNgX6OEOUcEyTyPP4_0 2024-09-12T18:01:50.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.394+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17361374235444761242', time=2024-09-12T19:54:36.462216+0000, chain.objs.size()=1 2024-09-12T18:01:50.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.394+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.gH_LvkmCBGAwwB4OjwCawlZLVML-0z-_0 2024-09-12T18:01:50.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.394+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4247072265294932960', time=2024-09-12T19:54:36.504305+0000, chain.objs.size()=1 2024-09-12T18:01:50.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.394+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0pLgL5k2WinBVwyEO16x5kLDwpVL9WI_0 2024-09-12T18:01:50.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.394+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14786347326208361146', time=2024-09-12T19:54:36.584220+0000, chain.objs.size()=1 2024-09-12T18:01:50.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.394+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.HtzejBFdFCM-YQiCJIFIRPQtc92_kij_0 2024-09-12T18:01:50.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.397+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11429460447023744786', time=2024-09-12T19:54:36.585804+0000, chain.objs.size()=1 2024-09-12T18:01:50.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.397+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QWmwhyfrQ4R5F2bmDHm2O8wRB03YRuF_0 2024-09-12T18:01:50.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.397+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17922641496399480182', time=2024-09-12T19:54:36.604575+0000, chain.objs.size()=1 2024-09-12T18:01:50.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.397+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.AbQ8ZOU2ZuzA8Fe5p53V4vEKDjHNK_b_0 2024-09-12T18:01:50.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.397+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10196705320474795543', time=2024-09-12T19:54:36.621642+0000, chain.objs.size()=1 2024-09-12T18:01:50.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.397+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ENTerPltuML_Es-A-85DR4ddWbMP-Gx_0 2024-09-12T18:01:50.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.397+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2620771198643640332', time=2024-09-12T19:54:36.627835+0000, chain.objs.size()=1 2024-09-12T18:01:50.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.397+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0JcybGWoXaO4mirULWFmrhamfgoeAGW_0 2024-09-12T18:01:50.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.397+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5966416524993741751', time=2024-09-12T19:54:36.645145+0000, chain.objs.size()=1 2024-09-12T18:01:50.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.397+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.SZH08iNh8bV3VJRoEAVW7cAmCykBDr-_0 2024-09-12T18:01:50.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.398+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2444908383595853294', time=2024-09-12T19:54:36.650971+0000, chain.objs.size()=1 2024-09-12T18:01:50.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.398+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1RCB8U0B3l4BfAW48XCrlbZxWdqKoYD_0 2024-09-12T18:01:50.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.398+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3979656362666557783', time=2024-09-12T19:54:36.903059+0000, chain.objs.size()=1 2024-09-12T18:01:50.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.398+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.UZMCT9jKzGVDHCgDt_0_oqEYK0Mt1Y4_0 2024-09-12T18:01:50.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.398+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6567801042195865238', time=2024-09-12T19:54:36.920899+0000, chain.objs.size()=1 2024-09-12T18:01:50.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.398+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.uz8HkvJbNRlekYP_O63poBYvflNIY9J_0 2024-09-12T18:01:50.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.398+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16537354117838089326', time=2024-09-12T19:54:44.455674+0000, chain.objs.size()=1 2024-09-12T18:01:50.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.398+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9uNgVh5DSGYIT1gcALRyGpW82KNyNK3_0 2024-09-12T18:01:50.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.398+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7754613295675701235', time=2024-09-12T19:54:44.690294+0000, chain.objs.size()=1 2024-09-12T18:01:50.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.398+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.QkrJdmMjbAkeJGZ0duhfnKu0lqpIOy7_0 2024-09-12T18:01:50.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.398+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11080654532774248940', time=2024-09-12T19:54:44.704396+0000, chain.objs.size()=1 2024-09-12T18:01:50.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.398+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ZKh0iO-f0y5vw6vhoTeH0vsgRn8T9O__0 2024-09-12T18:01:50.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.399+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14163246307311467870', time=2024-09-12T19:54:44.706681+0000, chain.objs.size()=1 2024-09-12T18:01:50.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.399+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ZsieICVNbSmEIti1-sO_4WTAHWsxEsb_0 2024-09-12T18:01:50.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.399+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16704364564500494203', time=2024-09-12T19:54:44.802699+0000, chain.objs.size()=1 2024-09-12T18:01:50.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.399+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.w4j_-95UQmxSQFhWt1zXq-wHzSUuv75_0 2024-09-12T18:01:50.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.400+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7651093689172621279', time=2024-09-12T19:54:44.836298+0000, chain.objs.size()=1 2024-09-12T18:01:50.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.400+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.mNftgThAXAY1dufZ60dflebkio40W40_0 2024-09-12T18:01:50.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.400+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5765709382431190564', time=2024-09-12T19:54:44.837719+0000, chain.objs.size()=1 2024-09-12T18:01:50.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.400+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Ok4AUTq34loeWeuz7kXB7DI9VJxY8Tk_0 2024-09-12T18:01:50.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.400+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6272214235065823208', time=2024-09-12T19:54:44.874508+0000, chain.objs.size()=1 2024-09-12T18:01:50.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.400+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.WaAxIG55_4smzcEqmhn9EViRXjVjNfX_0 2024-09-12T18:01:50.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5638775297165080561', time=2024-09-12T19:54:44.964186+0000, chain.objs.size()=1 2024-09-12T18:01:50.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.qWNPQmG9cHVWF778Yw71L35JjDjp0Gl_0 2024-09-12T18:01:50.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11503114088262479193', time=2024-09-12T19:54:44.991467+0000, chain.objs.size()=1 2024-09-12T18:01:50.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.94KAmw0n2roVxTNyZbspQcZEmmuUXrf_0 2024-09-12T18:01:50.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6905272371743721730', time=2024-09-12T19:54:44.997881+0000, chain.objs.size()=1 2024-09-12T18:01:50.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.MllNkF4okPZe-Yx26LJ9WVA5JbGhIYT_0 2024-09-12T18:01:50.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6405209176500814401', time=2024-09-12T19:54:45.018165+0000, chain.objs.size()=1 2024-09-12T18:01:50.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.1LZCdzO2_ZIbutN4SlAX5KhedEHjtGo_0 2024-09-12T18:01:50.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15644723626366843825', time=2024-09-12T19:54:45.042402+0000, chain.objs.size()=1 2024-09-12T18:01:50.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.GBor9kwhC3RjF8FXrBF9I2BOmg4ACGq_0 2024-09-12T18:01:50.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6660660063457014861', time=2024-09-12T19:54:45.054616+0000, chain.objs.size()=1 2024-09-12T18:01:50.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Iz0SrtSs3kUjuBOD5ZKIzhkan1Jspis_0 2024-09-12T18:01:50.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10245744302929712792', time=2024-09-12T19:54:45.203107+0000, chain.objs.size()=1 2024-09-12T18:01:50.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.fw4R5rdW7VM_Ai5RaLroJgomoewHgCf_0 2024-09-12T18:01:50.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1175181266470639065', time=2024-09-12T19:54:45.259916+0000, chain.objs.size()=1 2024-09-12T18:01:50.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ZBPO7O6hOI1Fe8eHf7JMbP-BpvkSK_r_0 2024-09-12T18:01:50.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4193890728695904379', time=2024-09-12T19:54:45.340080+0000, chain.objs.size()=1 2024-09-12T18:01:50.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.401+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.lYS3gxLXN16RNlUApWT9m2S1CANb3o6_0 2024-09-12T18:01:50.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.402+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15073153903788254997', time=2024-09-12T19:54:45.364404+0000, chain.objs.size()=1 2024-09-12T18:01:50.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.402+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.xU3qGcSCupuKQ0xpWXpzRSU2yF2ufq1_0 2024-09-12T18:01:50.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.402+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1979130243542219303', time=2024-09-12T19:54:45.371332+0000, chain.objs.size()=1 2024-09-12T18:01:50.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.402+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.RNufr-RvX-rlK4mTtjPSwutUS2m5VA4_0 2024-09-12T18:01:50.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.403+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16432641598455805629', time=2024-09-12T19:54:45.381149+0000, chain.objs.size()=1 2024-09-12T18:01:50.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.403+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.p9YlsJ9yZA8k_reZiTzqykzC2YZ3Nsf_0 2024-09-12T18:01:50.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.404+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16960004605444095356', time=2024-09-12T19:54:45.385981+0000, chain.objs.size()=1 2024-09-12T18:01:50.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.404+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.r6Q-8KJdwvGks-ZpMUdcTnXAOoYECDv_0 2024-09-12T18:01:50.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.404+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18337574457939575025', time=2024-09-12T19:54:45.388693+0000, chain.objs.size()=1 2024-09-12T18:01:50.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.404+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.3gGcZBAEonrQ40UqXRr0qNRhpyl8h7f_0 2024-09-12T18:01:50.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.404+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12424748433088663428', time=2024-09-12T19:54:45.426502+0000, chain.objs.size()=1 2024-09-12T18:01:50.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.404+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Wx56V8hA56JxcmIe6E38GAtELVd5637_0 2024-09-12T18:01:50.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.404+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8822302775595121832', time=2024-09-12T19:54:45.583929+0000, chain.objs.size()=1 2024-09-12T18:01:50.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.404+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.WnMUy56U6vniMzCuOqGPXmiRWfEIQi3_0 2024-09-12T18:01:50.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.404+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14651750394532857436', time=2024-09-12T19:54:45.700124+0000, chain.objs.size()=1 2024-09-12T18:01:50.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.404+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TAa42Dzz_HyGpAwbdZftWjBNlg-Z5qw_0 2024-09-12T18:01:50.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.404+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14491002140796804311', time=2024-09-12T19:54:45.711642+0000, chain.objs.size()=1 2024-09-12T18:01:50.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.404+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.79DxuObVsvAG-erI9iVALbC0xC_F4mj_0 2024-09-12T18:01:50.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.404+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15342768874798125705', time=2024-09-12T19:54:45.721769+0000, chain.objs.size()=1 2024-09-12T18:01:50.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.404+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.rArFinGtMcv04O_QkzDv9fHWnRpuak8_0 2024-09-12T18:01:50.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.406+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/46657 2024-09-12T18:01:50.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:01:50.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10401744549128921677', time=2024-09-12T19:54:45.732089+0000, chain.objs.size()=1 2024-09-12T18:01:50.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TGGYQOw-y_qgZ3i3Q0I2-Zol6A_VT08_0 2024-09-12T18:01:50.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12051523050666558112', time=2024-09-12T19:54:45.738246+0000, chain.objs.size()=1 2024-09-12T18:01:50.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Tn45kBd9_B_qW9_A8Cw1cVKPBXvuqoe_0 2024-09-12T18:01:50.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15739281024131337964', time=2024-09-12T19:54:56.308699+0000, chain.objs.size()=1 2024-09-12T18:01:50.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.379__shadow_.GTnNX320DAkjbtuHnKgN_KLbqWrx3XU_0 2024-09-12T18:01:50.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14456478751712222515', time=2024-09-12T19:55:09.813767+0000, chain.objs.size()=1 2024-09-12T18:01:50.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.438__shadow_.3ovFNPIC7WxiBYbn7kSigKqSCLK5LfY_0 2024-09-12T18:01:50.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15807865391765425719', time=2024-09-12T19:55:20.954372+0000, chain.objs.size()=1 2024-09-12T18:01:50.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.484__shadow_.qDRsejjsmPcP9cFAgOInAICc7CDt5mF_0 2024-09-12T18:01:50.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12723572603594305989', time=2024-09-12T19:55:30.690478+0000, chain.objs.size()=1 2024-09-12T18:01:50.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.519__multipart_mymultipart.2~iNZmTdA2ZFfMYaT1bmi4wRHY9R6LAa5.1 2024-09-12T18:01:50.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15055132603975680333', time=2024-09-12T19:55:33.129915+0000, chain.objs.size()=1 2024-09-12T18:01:50.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.521__shadow:MmP0C47XY881RT-opeES.D0xJbJjtoC_.N30Aw8Q1w6ogbYOBG4fKh-PR5CyDQJo_0 2024-09-12T18:01:50.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4138749054615781047', time=2024-09-12T19:55:37.916518+0000, chain.objs.size()=1 2024-09-12T18:01:50.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.524__multipart_mymultipart.2~wdWBEghsLBPo2t2lY8y-N4iBYw7BdkL.1 2024-09-12T18:01:50.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10121372928739339781', time=2024-09-12T19:55:41.407641+0000, chain.objs.size()=2 2024-09-12T18:01:50.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.529__multipart_mymultipart.2~SzJ2bZ3MEBgqnTQLTzkcmjYEqOv_aub.1 2024-09-12T18:01:50.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.529__multipart_mymultipart.2~SzJ2bZ3MEBgqnTQLTzkcmjYEqOv_aub.2 2024-09-12T18:01:50.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.525345713782638381', time=2024-09-12T19:56:28.674819+0000, chain.objs.size()=1 2024-09-12T18:01:50.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.408+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.574__shadow_.fdjgfl2eWTT4oVESExBLDD4ZC1atLu9_0 2024-09-12T18:01:50.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.409+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16285245377247092626', time=2024-09-12T19:56:31.987323+0000, chain.objs.size()=1 2024-09-12T18:01:50.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.409+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.577__shadow:NfY05dal-V0Xr2zgDp7NTF4xbiHlDoG_.qdOST_fCAzuD_yFEZLUaKqU8oHL7dxe_0 2024-09-12T18:01:50.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.410+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11567308125297688929', time=2024-09-12T19:56:41.454682+0000, chain.objs.size()=1 2024-09-12T18:01:50.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.410+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:bsa0O115CUKsIbbR.2i17h8HpYH8Bs6_.k3vWUZBpjkn3FlYvmyIuspvKDX7HRUh_0 2024-09-12T18:01:50.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.411+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17253472156046977600', time=2024-09-12T19:56:51.621876+0000, chain.objs.size()=1 2024-09-12T18:01:50.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.411+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.584__shadow:2fXEEcl.1MH3o2GixNephSjclMXC0H4_.SEWZV44LtFNqgCxWSyNmM9SzWvgQBaa_0 2024-09-12T18:01:50.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.411+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2109383245661149771', time=2024-09-12T19:59:26.010824+0000, chain.objs.size()=1 2024-09-12T18:01:50.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.411+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.705__shadow:tcqye1J.8-E.5hlMP.XDeIgGwX42R2D_.YP9utWM0UBvkbH2SWFKgLO6jUQMBmsj_0 2024-09-12T18:01:50.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.413+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.415+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:01:50.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.417+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.417+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54054' 2024-09-12T18:01:50.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4147368230221956038', time=2024-09-12T19:52:55.059128+0000, chain.objs.size()=3 2024-09-12T18:01:50.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.160__multipart_mymultipart-FROZEN.2~xcCO074bjoledoCRDjGuOQCbR_Ha9Hj.1 2024-09-12T18:01:50.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.160__multipart_mymultipart-FROZEN.2~xcCO074bjoledoCRDjGuOQCbR_Ha9Hj.2 2024-09-12T18:01:50.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.160__multipart_mymultipart-FROZEN.2~xcCO074bjoledoCRDjGuOQCbR_Ha9Hj.3 2024-09-12T18:01:50.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4278686117685583746', time=2024-09-12T19:53:10.673542+0000, chain.objs.size()=1 2024-09-12T18:01:50.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.204__shadow_.nSO9Y2i-KXp1E1763lZw_A0qF0gYchA_0 2024-09-12T18:01:50.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16721376378037557668', time=2024-09-12T19:54:01.847932+0000, chain.objs.size()=1 2024-09-12T18:01:50.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.242__shadow_.7R2RF-EsvBty6tQFgf44YDuoOD70PUB_0 2024-09-12T18:01:50.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13405794649270990935', time=2024-09-12T19:54:02.770105+0000, chain.objs.size()=1 2024-09-12T18:01:50.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.246__shadow_.AzgdYxqCsuPfYxY8J-Mkx3xeepCoK9g_0 2024-09-12T18:01:50.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9210897762925277506', time=2024-09-12T19:54:03.216342+0000, chain.objs.size()=1 2024-09-12T18:01:50.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.248__shadow_.DetE24MiNEmrrbKT1RC8rj2MV9mUoXm_0 2024-09-12T18:01:50.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4400417520176422184', time=2024-09-12T19:54:04.023716+0000, chain.objs.size()=1 2024-09-12T18:01:50.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.252__shadow_.KDuwgwNQHo82lvSxUR57qrac-pF1mrd_0 2024-09-12T18:01:50.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11073541865243445180', time=2024-09-12T19:54:04.671721+0000, chain.objs.size()=1 2024-09-12T18:01:50.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.255__shadow_.DEqURa45YhE74EyJcm6Y0G2VpNNDC_2_0 2024-09-12T18:01:50.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2061685164636653399', time=2024-09-12T19:54:05.277565+0000, chain.objs.size()=1 2024-09-12T18:01:50.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.258__shadow_.u5p8n-YGrGQ7ejz9-4xGC0V3NL0XMzZ_0 2024-09-12T18:01:50.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7292756263814432510', time=2024-09-12T19:54:05.912228+0000, chain.objs.size()=1 2024-09-12T18:01:50.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.261__shadow_.CdL8lGPO6XoSOOBJcBmO6lEoMuwsdAg_0 2024-09-12T18:01:50.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5656083620384707448', time=2024-09-12T19:54:13.506650+0000, chain.objs.size()=1 2024-09-12T18:01:50.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.418+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.s_hlkHn3Rghm1dVeWViomnFRk5YnULv_0 2024-09-12T18:01:50.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.420+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15729372832853170223', time=2024-09-12T19:54:13.510855+0000, chain.objs.size()=1 2024-09-12T18:01:50.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.420+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.gG2pidL_dv2tbhQwHA0jys4FDSa2mbK_0 2024-09-12T18:01:50.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15514196693385112777', time=2024-09-12T19:54:13.513504+0000, chain.objs.size()=1 2024-09-12T18:01:50.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.UzmXD5nutZhzgpXETrZCzIjwexLhb8s_0 2024-09-12T18:01:50.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9928129816994243561', time=2024-09-12T19:54:13.521156+0000, chain.objs.size()=1 2024-09-12T18:01:50.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.7PC69oubmp4fNT1mYnaXQ-yUIPW4u9O_0 2024-09-12T18:01:50.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16480388627458127230', time=2024-09-12T19:54:13.544731+0000, chain.objs.size()=1 2024-09-12T18:01:50.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.rr4VDROAUWcFXRP61SxTFW6nqgz_uWe_0 2024-09-12T18:01:50.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4578199625099170654', time=2024-09-12T19:54:13.545425+0000, chain.objs.size()=1 2024-09-12T18:01:50.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.xYs3ZzAtE6KWzkeq4yfasA7Z2LOlIJT_0 2024-09-12T18:01:50.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.774970724069558523', time=2024-09-12T19:54:13.661359+0000, chain.objs.size()=1 2024-09-12T18:01:50.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.3a3n6MDrdCtux3FLBv39T_2NiFemwkk_0 2024-09-12T18:01:50.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6404088312261808810', time=2024-09-12T19:54:13.672054+0000, chain.objs.size()=1 2024-09-12T18:01:50.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-LI6Jo7JfVNF8rWSSNpvaDj2ncQSZAm_0 2024-09-12T18:01:50.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4836045726685792725', time=2024-09-12T19:54:13.687062+0000, chain.objs.size()=1 2024-09-12T18:01:50.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.cxP0zLAcl50B4_cs_LvC3lXR6nIkWR1_0 2024-09-12T18:01:50.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3892871557174607463', time=2024-09-12T19:54:13.687786+0000, chain.objs.size()=1 2024-09-12T18:01:50.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_._EaJYDwJXTNme5yKBbLWvcLr3HL49SC_0 2024-09-12T18:01:50.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2753837690498724579', time=2024-09-12T19:54:13.738850+0000, chain.objs.size()=1 2024-09-12T18:01:50.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.mikQXhyQZzQ44YTji47OLLzfrMBFETs_0 2024-09-12T18:01:50.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3315642771466926451', time=2024-09-12T19:54:13.755824+0000, chain.objs.size()=1 2024-09-12T18:01:50.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.421+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.75sidm9iqbfnIwbczEDKAdI3UXl2Vbd_0 2024-09-12T18:01:50.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.422+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15650145165208298332', time=2024-09-12T19:54:13.848210+0000, chain.objs.size()=1 2024-09-12T18:01:50.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.422+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.k6nD68muiEWHVG-y89S826kPB_S-S19_0 2024-09-12T18:01:50.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.423+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.383109665577746614', time=2024-09-12T19:54:13.865129+0000, chain.objs.size()=1 2024-09-12T18:01:50.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.423+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.5vDg_eNEwRCkYP6mAK6BXK4F724PnBF_0 2024-09-12T18:01:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2036344375819647451', time=2024-09-12T19:54:13.916019+0000, chain.objs.size()=1 2024-09-12T18:01:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.1l2u-9nC2VE9WrJPRUElRIsqIY70ViL_0 2024-09-12T18:01:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8023255474750317961', time=2024-09-12T19:54:13.921994+0000, chain.objs.size()=1 2024-09-12T18:01:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.vnG86Cm-WlWmYRY_ppUQDqlZJx24A3U_0 2024-09-12T18:01:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11861195018314045289', time=2024-09-12T19:54:14.019117+0000, chain.objs.size()=1 2024-09-12T18:01:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.IzwrmghOcm0f5i1_qk96bScvD-fpV3Z_0 2024-09-12T18:01:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6819021494994433506', time=2024-09-12T19:54:14.024172+0000, chain.objs.size()=1 2024-09-12T18:01:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.L43jMIsMesnitrH3ate2CZAGz5Dmqk9_0 2024-09-12T18:01:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14799227273711084666', time=2024-09-12T19:54:14.047441+0000, chain.objs.size()=1 2024-09-12T18:01:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.LXMpBZ0DOkPTaJGH6RrG2dtPXDSEoKp_0 2024-09-12T18:01:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18266223652304258721', time=2024-09-12T19:54:14.084392+0000, chain.objs.size()=1 2024-09-12T18:01:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.N41OQwJ3bDjkD6oxSn68b00buJghOlu_0 2024-09-12T18:01:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16099018686357480806', time=2024-09-12T19:54:14.294276+0000, chain.objs.size()=1 2024-09-12T18:01:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.EnGcpOW3vBz6koAdoEd3YKtgzC4PCwo_0 2024-09-12T18:01:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8530123549169086472', time=2024-09-12T19:54:14.384326+0000, chain.objs.size()=1 2024-09-12T18:01:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.H-tui5HXavz5mFqI8VHVSctlw-sNDmb_0 2024-09-12T18:01:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8144695674032195534', time=2024-09-12T19:54:14.419831+0000, chain.objs.size()=1 2024-09-12T18:01:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.424+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.vg6J7BY3FLCFqokJtAXYhcYB3xtTID4_0 2024-09-12T18:01:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.425+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7804887539718772191', time=2024-09-12T19:54:14.432808+0000, chain.objs.size()=1 2024-09-12T18:01:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.425+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.CMloY_eDiV8veSaESct2NKNU_nPxPY4_0 2024-09-12T18:01:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.425+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7088554461552005956', time=2024-09-12T19:54:14.439972+0000, chain.objs.size()=1 2024-09-12T18:01:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.425+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.xstAt6VUBqxuX1dmSrTXVSafBRHcuBa_0 2024-09-12T18:01:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.426+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17701304036396366106', time=2024-09-12T19:54:14.440672+0000, chain.objs.size()=1 2024-09-12T18:01:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.426+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.FAY9PhFvCjj2qlVBXNTXGZhyntBV0LU_0 2024-09-12T18:01:50.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.426+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8044690439135682644', time=2024-09-12T19:54:14.443781+0000, chain.objs.size()=1 2024-09-12T18:01:50.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.426+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.P8YtMJhu_QNngpaMN7FUL_ce6E6v1Sq_0 2024-09-12T18:01:50.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.426+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11069062198625722361', time=2024-09-12T19:54:14.562513+0000, chain.objs.size()=1 2024-09-12T18:01:50.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.426+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.gBvd-746ejfsa3mIAStZcPPBZ3E9AI-_0 2024-09-12T18:01:50.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.426+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11653510640336775593', time=2024-09-12T19:54:14.606647+0000, chain.objs.size()=1 2024-09-12T18:01:50.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.426+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.n0pGwJkjry2CF8YSo3BChr_piVLjQin_0 2024-09-12T18:01:50.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.427+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15003025932155954083', time=2024-09-12T19:54:14.613209+0000, chain.objs.size()=1 2024-09-12T18:01:50.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.427+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.frSmFpF9JfzAYS8wK-sGhPScL0f3cEu_0 2024-09-12T18:01:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.427+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12515354962599514627', time=2024-09-12T19:54:14.616514+0000, chain.objs.size()=1 2024-09-12T18:01:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.427+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.GNLkP5F_igCGpn328StLAUNFr_HEQbn_0 2024-09-12T18:01:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.427+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8562475613430508238', time=2024-09-12T19:54:14.617258+0000, chain.objs.size()=1 2024-09-12T18:01:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.427+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.8DeGuR4UiUPYheAidI_DgpnhfToBTHD_0 2024-09-12T18:01:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.427+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8061520020079288629', time=2024-09-12T19:54:14.712815+0000, chain.objs.size()=1 2024-09-12T18:01:50.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.427+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.xnWnP0sp7x9cEbcxD54uybtCAXqKnEg_0 2024-09-12T18:01:50.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.427+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1917388626254481385', time=2024-09-12T19:54:14.722195+0000, chain.objs.size()=1 2024-09-12T18:01:50.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.427+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.bPtKe2I8SAW7dOfI7mPK_VN5bva-ja9_0 2024-09-12T18:01:50.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.427+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1867594982075323176', time=2024-09-12T19:54:14.761841+0000, chain.objs.size()=1 2024-09-12T18:01:50.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.427+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Bmm7Q_lNYOh-KMbdpz4OA55mCodpTlV_0 2024-09-12T18:01:50.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.428+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3906227384335248036', time=2024-09-12T19:54:14.774697+0000, chain.objs.size()=1 2024-09-12T18:01:50.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.428+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.tX1XY7xy7K7CoFmzsSh107LTyL3EzOG_0 2024-09-12T18:01:50.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.428+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10615157047407350678', time=2024-09-12T19:54:14.891332+0000, chain.objs.size()=1 2024-09-12T18:01:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.428+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.5CoXgJSToCPw3PNz-cJzbYmgoQZAHpc_0 2024-09-12T18:01:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17344131821161537378', time=2024-09-12T19:54:14.913902+0000, chain.objs.size()=1 2024-09-12T18:01:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.vHWnASL6A9FlLZxYna-o7yYHkC-S3xj_0 2024-09-12T18:01:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17194297705898416649', time=2024-09-12T19:54:14.914714+0000, chain.objs.size()=1 2024-09-12T18:01:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.o7wVPxKYYzSm6SC_A9RkCvPgweTV022_0 2024-09-12T18:01:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1029493566557427356', time=2024-09-12T19:54:16.136294+0000, chain.objs.size()=1 2024-09-12T18:01:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.269__shadow_.9NA-S1knYXiqyuRNwmOdzHiau_bOkhZ_0 2024-09-12T18:01:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9010016307750956309', time=2024-09-12T19:54:17.978984+0000, chain.objs.size()=1 2024-09-12T18:01:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.278__shadow_.olGcjaLK-_HsWCprUgBHaOPS2oh_kyW_0 2024-09-12T18:01:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11504889953024686114', time=2024-09-12T19:54:18.603117+0000, chain.objs.size()=1 2024-09-12T18:01:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.281__shadow_.QOBVlV2EGtenz_FDXIWQpSa2O36GapI_0 2024-09-12T18:01:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14553598553459905673', time=2024-09-12T19:54:21.576592+0000, chain.objs.size()=1 2024-09-12T18:01:50.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_._e-Xyi4yCMJrV4Xb5jukrl4M361YC-s_0 2024-09-12T18:01:50.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9215778894015220022', time=2024-09-12T19:54:22.421550+0000, chain.objs.size()=1 2024-09-12T18:01:50.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.295__shadow_.gbjGzUeMIuEBxrUEKaun8QpZJQiKqQF_0 2024-09-12T18:01:50.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9723942813157438630', time=2024-09-12T19:54:23.320981+0000, chain.objs.size()=1 2024-09-12T18:01:50.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.299__shadow_.3MospI7NzqCE67nN4qk_MctHJYWJeYD_0 2024-09-12T18:01:50.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3280381542029168850', time=2024-09-12T19:54:23.973427+0000, chain.objs.size()=1 2024-09-12T18:01:50.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.302__shadow_.9Ct77yaFDElnbznGsK-dfKTN1rL9k7P_0 2024-09-12T18:01:50.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4180933041676782259', time=2024-09-12T19:54:35.783133+0000, chain.objs.size()=1 2024-09-12T18:01:50.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.429+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.nASyU2bNuq6aiFtrBq6bGEHjZKdbZGz_0 2024-09-12T18:01:50.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.431+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13271440786729260936', time=2024-09-12T19:54:35.816784+0000, chain.objs.size()=1 2024-09-12T18:01:50.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.431+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.w-oUxz-vTTjyEIFppdwf2tW2W4WqVbD_0 2024-09-12T18:01:50.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.431+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3786113337450680136', time=2024-09-12T19:54:35.817674+0000, chain.objs.size()=1 2024-09-12T18:01:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.431+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.NogTuR234SbjPCrFsw8MCCtFfK2R4cT_0 2024-09-12T18:01:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.431+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17557609019333614363', time=2024-09-12T19:54:35.822983+0000, chain.objs.size()=1 2024-09-12T18:01:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.431+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QHLgoy38UxutiUc4B5PLfM3zHYC4f_3_0 2024-09-12T18:01:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.432+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10226827781045763765', time=2024-09-12T19:54:35.840761+0000, chain.objs.size()=1 2024-09-12T18:01:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.432+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.L7w88TfHk4bufOgFUvU9sGhBvhaf_3a_0 2024-09-12T18:01:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.432+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15594438668443996046', time=2024-09-12T19:54:35.954107+0000, chain.objs.size()=1 2024-09-12T18:01:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.432+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.D7rXQG1xXC2PzZlkQ3eWBe1YjRfTFsg_0 2024-09-12T18:01:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.432+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11356350033204650771', time=2024-09-12T19:54:35.957198+0000, chain.objs.size()=1 2024-09-12T18:01:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.432+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.z4tS9xb5RC3vetW5DM_YbEwLy_ENJ2g_0 2024-09-12T18:01:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.432+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17855508005841545499', time=2024-09-12T19:54:35.968369+0000, chain.objs.size()=1 2024-09-12T18:01:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.432+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.L_PgDadqh5kjnLqpQZpkD1G_UA4Y3Ne_0 2024-09-12T18:01:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.432+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11462594240105117124', time=2024-09-12T19:54:35.972347+0000, chain.objs.size()=1 2024-09-12T18:01:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.432+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.3KnIW207U09HufB1EQl5OZEZOCgGC4i_0 2024-09-12T18:01:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.432+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14233013316330092667', time=2024-09-12T19:54:36.263255+0000, chain.objs.size()=1 2024-09-12T18:01:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.432+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_._MT7EPZH1t-Fvp922Ty07cVsPrN0oPM_0 2024-09-12T18:01:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.432+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.921159276923455222', time=2024-09-12T19:54:36.300529+0000, chain.objs.size()=1 2024-09-12T18:01:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.432+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.18pNGjjN87TkWNQc_QqBY5L5m2GHatE_0 2024-09-12T18:01:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.432+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11555479218204242158', time=2024-09-12T19:54:36.339901+0000, chain.objs.size()=1 2024-09-12T18:01:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.432+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.eI8bUQ-a24RDWqNti91W_lOWbZf7NLX_0 2024-09-12T18:01:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.433+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10086764730566868109', time=2024-09-12T19:54:36.443336+0000, chain.objs.size()=1 2024-09-12T18:01:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.433+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.yaEM1x_supqDb2btEG0ljdWWW8ocLYT_0 2024-09-12T18:01:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.433+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5187128923430816427', time=2024-09-12T19:54:36.497592+0000, chain.objs.size()=1 2024-09-12T18:01:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.433+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.CAYHe2YrugX4ZKectMx2majpL3efpib_0 2024-09-12T18:01:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.433+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16174354544158667710', time=2024-09-12T19:54:36.634394+0000, chain.objs.size()=1 2024-09-12T18:01:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.433+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_._NLBejBd0tUTldP8EiFZYIRbioVTzIt_0 2024-09-12T18:01:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.433+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11064189732700107700', time=2024-09-12T19:54:36.662936+0000, chain.objs.size()=1 2024-09-12T18:01:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.433+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.7yDUn4kF6V5jNtwb6bhZcQ7XomzOKhh_0 2024-09-12T18:01:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.434+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4321332186714074680', time=2024-09-12T19:54:36.745709+0000, chain.objs.size()=1 2024-09-12T18:01:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.434+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0oHz236SwMHL03uXD51mrH3cwEMGEzy_0 2024-09-12T18:01:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.434+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7511693303646060516', time=2024-09-12T19:54:36.755389+0000, chain.objs.size()=1 2024-09-12T18:01:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.434+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.DovLMdqDHayVtIz_NLe1TzkgfUBSEKI_0 2024-09-12T18:01:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.434+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16075449024916682461', time=2024-09-12T19:54:36.759638+0000, chain.objs.size()=1 2024-09-12T18:01:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.434+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.nWzntDD2cv32WGPcfDfhcgs7YX-raxG_0 2024-09-12T18:01:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.434+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11870726840810303897', time=2024-09-12T19:54:36.782865+0000, chain.objs.size()=1 2024-09-12T18:01:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.434+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.yuD7d1ixyn7abMcDEe7z6ncD2dZLARr_0 2024-09-12T18:01:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.434+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16062960025576460297', time=2024-09-12T19:54:36.928925+0000, chain.objs.size()=1 2024-09-12T18:01:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.434+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ZHl9uEfPzFc1q05ffFyvg6bnyem0qI2_0 2024-09-12T18:01:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.434+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15453221020788995881', time=2024-09-12T19:54:36.929707+0000, chain.objs.size()=1 2024-09-12T18:01:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.434+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.YHUsaBo-rXO2pD22LpMQexiuG6qM7oN_0 2024-09-12T18:01:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.434+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1145080845696836788', time=2024-09-12T19:54:36.939905+0000, chain.objs.size()=1 2024-09-12T18:01:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.434+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.3ADid6iWpHqLCLQh7L5mPyFHILD92jp_0 2024-09-12T18:01:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.434+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9187812261904142982', time=2024-09-12T19:54:36.956854+0000, chain.objs.size()=1 2024-09-12T18:01:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.435+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.RZDpg-t4A4jvfYP3cSe6zJpLdNWVZmm_0 2024-09-12T18:01:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.435+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4849877049101769264', time=2024-09-12T19:54:36.963284+0000, chain.objs.size()=1 2024-09-12T18:01:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.435+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.OdW22u3UqHZRFKRzAJdXPz5259LeQcC_0 2024-09-12T18:01:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.435+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12225072533128712783', time=2024-09-12T19:54:44.470379+0000, chain.objs.size()=1 2024-09-12T18:01:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.435+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.4vCQkJPiDtdgC__zHHLYQjJCv_FZdiL_0 2024-09-12T18:01:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.435+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14990889165840049785', time=2024-09-12T19:54:44.521086+0000, chain.objs.size()=1 2024-09-12T18:01:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.435+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.sbqaec3A23h0Sr-bfi7_xlnOFbFiZbR_0 2024-09-12T18:01:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.435+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6388712305654908059', time=2024-09-12T19:54:44.522996+0000, chain.objs.size()=1 2024-09-12T18:01:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.435+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.frxDacwpxHMFL39x4KxGD3uc8y2BoYp_0 2024-09-12T18:01:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.436+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9320566526520865107', time=2024-09-12T19:54:44.526157+0000, chain.objs.size()=1 2024-09-12T18:01:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.436+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.RPfEEgUQ40kiUxrqiB9Kgupiiblktel_0 2024-09-12T18:01:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.437+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4395960103810876092', time=2024-09-12T19:54:44.550909+0000, chain.objs.size()=1 2024-09-12T18:01:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.437+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.dtJl-RxTNGXkDdqwttv4jynLMBsUTmO_0 2024-09-12T18:01:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.437+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13536379854677514138', time=2024-09-12T19:54:44.681402+0000, chain.objs.size()=1 2024-09-12T18:01:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.437+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.zph_rDRnAIfA-GyZEH14UHACnp7fDIH_0 2024-09-12T18:01:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.437+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4642203698539325723', time=2024-09-12T19:54:44.719693+0000, chain.objs.size()=1 2024-09-12T18:01:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.437+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.vP_2yVx2t6chKEMz6AmzfAX5hFiRWZY_0 2024-09-12T18:01:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.437+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15615816489989806852', time=2024-09-12T19:54:44.965022+0000, chain.objs.size()=1 2024-09-12T18:01:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.437+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.BJGce6aFRqcdoplIcn4OGOcwKSIjLH5_0 2024-09-12T18:01:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.437+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16706438951153189007', time=2024-09-12T19:54:44.977894+0000, chain.objs.size()=1 2024-09-12T18:01:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.437+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.piwXUYRZIC1AB2vMuoBk5q_2F9ECtqu_0 2024-09-12T18:01:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.437+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16695840821666933273', time=2024-09-12T19:54:45.038105+0000, chain.objs.size()=1 2024-09-12T18:01:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.437+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.bilWTKV6Ia1I7nSdkMZM4ePOCX7tpJZ_0 2024-09-12T18:01:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.437+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15122735997697771370', time=2024-09-12T19:54:45.054749+0000, chain.objs.size()=1 2024-09-12T18:01:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.437+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.m_P5U3F6xQogpsZ5CYx3pU6lle6Xdvj_0 2024-09-12T18:01:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.437+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3125714320228736044', time=2024-09-12T19:54:45.195386+0000, chain.objs.size()=1 2024-09-12T18:01:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.437+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.0e3iLOQ9g6QljNGgFBvfAlTB0YO0Ovl_0 2024-09-12T18:01:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.438+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9696933712843396554', time=2024-09-12T19:54:45.233677+0000, chain.objs.size()=1 2024-09-12T18:01:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.438+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Pu0r5U0f69W9rRCcd35Ia4VhUawyRot_0 2024-09-12T18:01:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.438+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9885669281267389562', time=2024-09-12T19:54:45.353517+0000, chain.objs.size()=1 2024-09-12T18:01:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.438+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ya8Rkf2TOzB0PWfsK4RWqhbrE_1y8d__0 2024-09-12T18:01:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.439+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6953359448852807681', time=2024-09-12T19:54:45.364281+0000, chain.objs.size()=1 2024-09-12T18:01:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.439+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_._fLgKe7a11XlhtskAIpJI7jyJT3841y_0 2024-09-12T18:01:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.439+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9406839868272392164', time=2024-09-12T19:54:45.365152+0000, chain.objs.size()=1 2024-09-12T18:01:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.439+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.3ogLM-079V-3mAiXZ0np-nUbT0TOCms_0 2024-09-12T18:01:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.439+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2263413815182234873', time=2024-09-12T19:54:45.375022+0000, chain.objs.size()=1 2024-09-12T18:01:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.439+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.DmrnogJ7TDMEZTRRRg4K4RoVcoSflhU_0 2024-09-12T18:01:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.439+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6125628965863225201', time=2024-09-12T19:54:45.408809+0000, chain.objs.size()=1 2024-09-12T18:01:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.439+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.JD3mkvgehw7_BlUxODk34mplVdhmKUB_0 2024-09-12T18:01:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.439+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4032071692578910076', time=2024-09-12T19:54:45.409631+0000, chain.objs.size()=1 2024-09-12T18:01:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.439+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Ccv-LaqfLvjCQ24pQ63-6eLG2JmdO9l_0 2024-09-12T18:01:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.439+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8939190492961416715', time=2024-09-12T19:54:45.587734+0000, chain.objs.size()=1 2024-09-12T18:01:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.439+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.tNc4mBgHXa882Z9sVU8I38YkwTGfmSG_0 2024-09-12T18:01:50.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.442+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/54054 2024-09-12T18:01:50.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T18:01:50.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8255217263745214371', time=2024-09-12T19:54:45.589970+0000, chain.objs.size()=1 2024-09-12T18:01:50.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.RxUNglyjRG-IMihR7BFGZDc8EQ7vWKK_0 2024-09-12T18:01:50.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.24445534533124790', time=2024-09-12T19:54:45.675502+0000, chain.objs.size()=1 2024-09-12T18:01:50.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.McWzK5wKYMkYwZ1hI8q_nFJC4ytyEBg_0 2024-09-12T18:01:50.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14611420615198105844', time=2024-09-12T19:54:45.680695+0000, chain.objs.size()=1 2024-09-12T18:01:50.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.tQ0dOXnj_PcApu1KaejkFA8DwfFMkjP_0 2024-09-12T18:01:50.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3726561689585035194', time=2024-09-12T19:54:45.690045+0000, chain.objs.size()=1 2024-09-12T18:01:50.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.CjHq9PIf2UTo8WAN2RJHgI_QJET6NxB_0 2024-09-12T18:01:50.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12966228066518112556', time=2024-09-12T19:54:45.697664+0000, chain.objs.size()=1 2024-09-12T18:01:50.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.wfZj3hue2mr0zvdB-hqLuKI6MwoP_F7_0 2024-09-12T18:01:50.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13686038693101144654', time=2024-09-12T19:55:04.253294+0000, chain.objs.size()=1 2024-09-12T18:01:50.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.409__shadow_.FnRPOGKCetfxWKbz2O67vypFrR1x4Wu_0 2024-09-12T18:01:50.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5088122325637509374', time=2024-09-12T19:55:08.374262+0000, chain.objs.size()=1 2024-09-12T18:01:50.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.432__shadow_.iq8F5yM7wWuHRQOjyBKOy4VXLN_Dgyv_0 2024-09-12T18:01:50.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18285619683121890371', time=2024-09-12T19:55:20.141888+0000, chain.objs.size()=1 2024-09-12T18:01:50.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.482__shadow_.IgS_HkH9NS_u5wXWuWtCtIYD83xnMpl_0 2024-09-12T18:01:50.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.555541258089023099', time=2024-09-12T19:55:37.611920+0000, chain.objs.size()=6 2024-09-12T18:01:50.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.N2aX8eFNjcR1qDL30K_eMrzcNSkFHStP.1 2024-09-12T18:01:50.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.rOQC78G-iVVnePbTFji_0RWDRM3x_-6F.2 2024-09-12T18:01:50.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.Eu4mnqycmDuXiq3OkjG5JbYWD9txSHt5.3 2024-09-12T18:01:50.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.444+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.FzI1wV8tGFqhCJkjcu5vpVCE1DAdoDOd.4 2024-09-12T18:01:50.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.446+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.N_MbEPbG31r2PM_nebjNwLrwrbc5sjbV.5 2024-09-12T18:01:50.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.446+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.myf68745gXy7wdnsokP3Jnr-KkvRsTxM.6 2024-09-12T18:01:50.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.446+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16272129949877179491', time=2024-09-12T19:55:39.513805+0000, chain.objs.size()=2 2024-09-12T18:01:50.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.446+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.526__multipart_mymultipart.2~GciHTiA_Lcm_YfIGuukfFNYmT5BLOOD.1 2024-09-12T18:01:50.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.446+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.526__multipart_mymultipart.2~GciHTiA_Lcm_YfIGuukfFNYmT5BLOOD.2 2024-09-12T18:01:50.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.448+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18407154104001504', time=2024-09-12T19:56:12.948873+0000, chain.objs.size()=1 2024-09-12T18:01:50.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.448+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.557__shadow_.O1C7_cCy65jZlm22yoh-9SvmMFjU_0-_0 2024-09-12T18:01:50.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.449+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8148885492513776943', time=2024-09-12T19:56:23.766250+0000, chain.objs.size()=1 2024-09-12T18:01:50.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.449+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:8eSIBR2gPZyA6KLmvj3hkD819guM2Fw_.0TgoxgfKC3O0UxORDmtULePd4b98uq6_0 2024-09-12T18:01:50.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.449+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.516678706898873721', time=2024-09-12T19:56:24.565976+0000, chain.objs.size()=1 2024-09-12T18:01:50.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.449+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:6dzrwqCNNv9GQ4bXm0s4D3iJUXq4zTO_.sFvmtVPddLkRzalayehPJxDyfaoX-Iq_0 2024-09-12T18:01:50.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.449+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7295758059275324853', time=2024-09-12T19:56:46.595051+0000, chain.objs.size()=1 2024-09-12T18:01:50.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.449+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:6.yUqW8LS2.DSE8cnCy4iD6XJ8ZJS2X_.uDwurrXu8tzvZrYLuGHePky8mNVEc0j_0 2024-09-12T18:01:50.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.449+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13385178123078320406', time=2024-09-12T19:56:49.985255+0000, chain.objs.size()=1 2024-09-12T18:01:50.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.449+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.580__shadow:YUNsqYeU-XMO-vVwJyFEb.mw7mOOvlm_.UDj4S_fcN9-nK8U-d_F9NO5a6ZEqp2y_0 2024-09-12T18:01:50.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.449+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11998841450025521090', time=2024-09-12T19:56:50.936010+0000, chain.objs.size()=1 2024-09-12T18:01:50.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.449+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.581__shadow:PF-KeIufMmcRSBsxU57Szy9Erz28K3B_.EUeJeC5DuGXhK9A2xnvrWvRnMo0q1ER_0 2024-09-12T18:01:50.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.449+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2306335507303900157', time=2024-09-12T19:59:27.855029+0000, chain.objs.size()=1 2024-09-12T18:01:50.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.449+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.712__multipart_file1.2~cqbHM75q2dkiWizSIv4mbobFHXfZwqS.1 2024-09-12T18:01:50.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.449+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5304537536359524149', time=2024-09-12T19:59:48.582354+0000, chain.objs.size()=1 2024-09-12T18:01:50.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.449+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.720__shadow_.foepoiJxjbXK1nlDBrVSGMSZ1CydhAP_0 2024-09-12T18:01:50.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.449+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10783510482870616748', time=2024-09-12T19:59:54.193942+0000, chain.objs.size()=1 2024-09-12T18:01:50.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.449+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.743__multipart_mymultipart3.2~T8Z0QkcCh9wh99bqm9gRfzy3F57tLah.1 2024-09-12T18:01:50.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.454+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.457+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:01:50.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.458+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54539' 2024-09-12T18:01:50.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12289216007265756634', time=2024-09-12T19:52:59.320982+0000, chain.objs.size()=1 2024-09-12T18:01:50.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.171__shadow_.2meHMNtBpGzYWBSUCZhaExc5CxJYv7o_0 2024-09-12T18:01:50.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6821727485152911011', time=2024-09-12T19:53:04.926402+0000, chain.objs.size()=1 2024-09-12T18:01:50.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.182__shadow_.c_-udCn0ZN-SQZHsqwSxtM6oKSOzHxj_0 2024-09-12T18:01:50.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7429815324086972857', time=2024-09-12T19:54:02.311764+0000, chain.objs.size()=1 2024-09-12T18:01:50.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.244__shadow_.8xwIEsf1yZSf_-XzJIKLm-3mAPTwucS_0 2024-09-12T18:01:50.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.354104940337623962', time=2024-09-12T19:54:03.418895+0000, chain.objs.size()=1 2024-09-12T18:01:50.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.249__shadow_.wVKidmFFysAG911lEKCza184CTp14tO_0 2024-09-12T18:01:50.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12812944425572120355', time=2024-09-12T19:54:04.267076+0000, chain.objs.size()=1 2024-09-12T18:01:50.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.253__shadow_.mnCatNU6P1JUTSR8LV03BXMGK54SHKI_0 2024-09-12T18:01:50.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7896101264245240487', time=2024-09-12T19:54:05.475145+0000, chain.objs.size()=1 2024-09-12T18:01:50.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.259__shadow_.8-o_UjHssXlmiecTAmBXzCF0OREeoDE_0 2024-09-12T18:01:50.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16975751251301713442', time=2024-09-12T19:54:13.486730+0000, chain.objs.size()=1 2024-09-12T18:01:50.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.OUG891eOFhL9-v3-qalSUnkh9ytYyGK_0 2024-09-12T18:01:50.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6725387786567335504', time=2024-09-12T19:54:13.535395+0000, chain.objs.size()=1 2024-09-12T18:01:50.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.vGIPpexy-QoBkDTYKABycUhSMuv8oGC_0 2024-09-12T18:01:50.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15585517272951553106', time=2024-09-12T19:54:13.659995+0000, chain.objs.size()=1 2024-09-12T18:01:50.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.TBJrUGVpr_WU-RTd2vFSOiHRmdD--Yi_0 2024-09-12T18:01:50.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7910402953685454422', time=2024-09-12T19:54:13.700082+0000, chain.objs.size()=1 2024-09-12T18:01:50.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.459+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.SbUpbjnxPtsYNgXlvNDuUeR_K7-x0rs_0 2024-09-12T18:01:50.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.460+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11990024833227663667', time=2024-09-12T19:54:13.726586+0000, chain.objs.size()=1 2024-09-12T18:01:50.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.460+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.k8pRK3XmjpECQYtmVdrERQB1lz8eWWd_0 2024-09-12T18:01:50.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.460+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13181227387241371341', time=2024-09-12T19:54:13.737906+0000, chain.objs.size()=1 2024-09-12T18:01:50.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.460+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.RuWPtLJPwezjnk1wSQm59566v0Ej14t_0 2024-09-12T18:01:50.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.461+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17970091272684081623', time=2024-09-12T19:54:13.859735+0000, chain.objs.size()=1 2024-09-12T18:01:50.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.461+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ZmBBIzmzG2ufPNPwdiv-FZqMTqaxjT-_0 2024-09-12T18:01:50.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.461+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12836093995121786487', time=2024-09-12T19:54:13.871753+0000, chain.objs.size()=1 2024-09-12T18:01:50.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.461+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.UVXY4M3GjettbK1CPj3P3_q6DmATzRT_0 2024-09-12T18:01:50.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17606479586213005540', time=2024-09-12T19:54:13.874507+0000, chain.objs.size()=1 2024-09-12T18:01:50.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Rm6baX8EK3z_y4GjRi7VlsvUiB3hGIw_0 2024-09-12T18:01:50.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3221993547349055524', time=2024-09-12T19:54:13.897835+0000, chain.objs.size()=1 2024-09-12T18:01:50.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Cl9h16ottbTCIXwm8-t1EsPIMOEVHDM_0 2024-09-12T18:01:50.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12294774124988538294', time=2024-09-12T19:54:13.914261+0000, chain.objs.size()=1 2024-09-12T18:01:50.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.SBslj2xOtm-v2h-ZloX_Ar6PfC68_r7_0 2024-09-12T18:01:50.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2955981845874470658', time=2024-09-12T19:54:14.034389+0000, chain.objs.size()=1 2024-09-12T18:01:50.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.l5n0zHI_tHUDakhHHh0Gfb2zD2axyeP_0 2024-09-12T18:01:50.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5125322709329435463', time=2024-09-12T19:54:14.061284+0000, chain.objs.size()=1 2024-09-12T18:01:50.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.QNYeGLFSI9GWWBRBXHFpBY_aztWe6wH_0 2024-09-12T18:01:50.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16389274772440225699', time=2024-09-12T19:54:14.074665+0000, chain.objs.size()=1 2024-09-12T18:01:50.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.BHt85aL-nL0EZscJk2dXPH9FjNvnZzS_0 2024-09-12T18:01:50.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15009907730503040819', time=2024-09-12T19:54:14.390175+0000, chain.objs.size()=1 2024-09-12T18:01:50.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.CbZoQqJkmpp6VbHdU-734XAlKrnthdq_0 2024-09-12T18:01:50.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17002055711619549481', time=2024-09-12T19:54:14.390960+0000, chain.objs.size()=1 2024-09-12T18:01:50.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.z5HykmB-89Ife9IKMd0ACa-AD5GjglY_0 2024-09-12T18:01:50.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5282529084125635851', time=2024-09-12T19:54:14.423021+0000, chain.objs.size()=1 2024-09-12T18:01:50.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.W6udrPJf_h2bPiDjn1ei3f7Ie9CUWX2_0 2024-09-12T18:01:50.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4859776214435533046', time=2024-09-12T19:54:14.584575+0000, chain.objs.size()=1 2024-09-12T18:01:50.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.gw74qUT73pHb7ChiLsSnFDjMBZTuP2n_0 2024-09-12T18:01:50.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14262161142410401427', time=2024-09-12T19:54:14.586905+0000, chain.objs.size()=1 2024-09-12T18:01:50.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.466+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.gO-b5UJct3Xs-BED33LTkX_uX0fcO_M_0 2024-09-12T18:01:50.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.468+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1499053884409120231', time=2024-09-12T19:54:14.595633+0000, chain.objs.size()=1 2024-09-12T18:01:50.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.468+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.1G7dveCL7mpxbQvOQ2AnHsi4ScwlU0x_0 2024-09-12T18:01:50.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.468+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7578613708471546274', time=2024-09-12T19:54:14.622524+0000, chain.objs.size()=1 2024-09-12T18:01:50.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.468+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.37MZYGX7FUIQihaKI8mO15xm32juhVu_0 2024-09-12T18:01:50.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.468+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10535950362989405050', time=2024-09-12T19:54:14.765074+0000, chain.objs.size()=1 2024-09-12T18:01:50.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.468+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.XIsXxURgB4VsBCS_nEfGKbE9HnjI7Rs_0 2024-09-12T18:01:50.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.471+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8735609698437520954', time=2024-09-12T19:54:14.771087+0000, chain.objs.size()=1 2024-09-12T18:01:50.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.471+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.iVRRyd8U2nP9tgNb7LE_pztSDiRmd94_0 2024-09-12T18:01:50.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.471+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1411648197881149039', time=2024-09-12T19:54:14.938805+0000, chain.objs.size()=1 2024-09-12T18:01:50.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.471+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.tO4w1sU5BpkRAB1XovldNS0LkcfbPZF_0 2024-09-12T18:01:50.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.471+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18440328813393663472', time=2024-09-12T19:54:20.398306+0000, chain.objs.size()=1 2024-09-12T18:01:50.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.471+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.289__shadow_.gQiowvYM3DgJexSRs9hh8dzhnviC18W_0 2024-09-12T18:01:50.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.471+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5422772206812516463', time=2024-09-12T19:54:35.778719+0000, chain.objs.size()=1 2024-09-12T18:01:50.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.471+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.cVsZVERL-SuPKHmzHOP4SMvQLNdMFAT_0 2024-09-12T18:01:50.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.471+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11239973530468726603', time=2024-09-12T19:54:35.782495+0000, chain.objs.size()=1 2024-09-12T18:01:50.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.471+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.IcecZtKI61nFNGriJVLHjjmrhY2qRsA_0 2024-09-12T18:01:50.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.471+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14580794471280855578', time=2024-09-12T19:54:35.921714+0000, chain.objs.size()=1 2024-09-12T18:01:50.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.471+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.miOCk1hsZsY1OlVlzLgEga1EFhKQ7S__0 2024-09-12T18:01:50.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.471+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16652357850236853291', time=2024-09-12T19:54:35.923752+0000, chain.objs.size()=1 2024-09-12T18:01:50.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.471+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.6sB4qK0rGnRuQ2Af4uDYZGdF-iaxLi7_0 2024-09-12T18:01:50.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.471+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4802132627164997605', time=2024-09-12T19:54:35.933373+0000, chain.objs.size()=1 2024-09-12T18:01:50.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.471+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.WtCHYdpkR3LlNaEMLm12bN13AzsWnc5_0 2024-09-12T18:01:50.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.474+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10864574533987978359', time=2024-09-12T19:54:35.960611+0000, chain.objs.size()=1 2024-09-12T18:01:50.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.474+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rUrDI_ngXuoUSqiF9uXFVBQDZ-dDqhI_0 2024-09-12T18:01:50.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.474+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10209904747324927773', time=2024-09-12T19:54:35.961491+0000, chain.objs.size()=1 2024-09-12T18:01:50.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.474+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9XN-uUigXyy_rhSpGGN9LlSjwVwjAId_0 2024-09-12T18:01:50.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.474+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2902436986558784919', time=2024-09-12T19:54:35.990676+0000, chain.objs.size()=1 2024-09-12T18:01:50.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.474+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.VQXPlXD5BL_Ea7c6pZ3rq-PKSWYgt5w_0 2024-09-12T18:01:50.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.474+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11034076834948656687', time=2024-09-12T19:54:35.993878+0000, chain.objs.size()=1 2024-09-12T18:01:50.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.474+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.lbR_HnhD9belxL2Z_M5-SGZiFwQqiuj_0 2024-09-12T18:01:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.477+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10417054616734413063', time=2024-09-12T19:54:36.083627+0000, chain.objs.size()=1 2024-09-12T18:01:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.477+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.vtOJaBe15GCoLByo3nVwJdtVWmhIjYx_0 2024-09-12T18:01:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.477+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7175952262458313732', time=2024-09-12T19:54:36.093784+0000, chain.objs.size()=1 2024-09-12T18:01:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.477+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0FGwkz_A2juk_pofVwecn5mvn_inbGm_0 2024-09-12T18:01:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.477+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10565958263001190728', time=2024-09-12T19:54:36.125975+0000, chain.objs.size()=1 2024-09-12T18:01:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.477+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.uR2Zw8_ltHv2_7YTWWE69rPcCr--CN2_0 2024-09-12T18:01:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.477+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6394682938887240554', time=2024-09-12T19:54:36.156212+0000, chain.objs.size()=1 2024-09-12T18:01:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.477+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.I4W1uvxF1u_U__WfpnivDy9BOjLxG8S_0 2024-09-12T18:01:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.477+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16669668847094544163', time=2024-09-12T19:54:36.167886+0000, chain.objs.size()=1 2024-09-12T18:01:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.477+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.3xIeYQSJUZc36LInmwNMbeyNPIIgnB8_0 2024-09-12T18:01:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.477+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7748067160239437017', time=2024-09-12T19:54:36.252800+0000, chain.objs.size()=1 2024-09-12T18:01:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.477+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.7HMIpr5M_LXR0_LXW_XqjRJy6Vnc6a9_0 2024-09-12T18:01:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.477+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11960867562440362613', time=2024-09-12T19:54:36.340077+0000, chain.objs.size()=1 2024-09-12T18:01:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.477+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.tRA-jCoKaSAnc0myQM7M-5kEIgrJrzW_0 2024-09-12T18:01:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.479+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15250347864171904933', time=2024-09-12T19:54:36.416270+0000, chain.objs.size()=1 2024-09-12T18:01:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.479+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.j44DlQ8TLBdQf9dAVM4HURQ883Ch6fG_0 2024-09-12T18:01:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.479+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15934668468766400457', time=2024-09-12T19:54:36.465331+0000, chain.objs.size()=1 2024-09-12T18:01:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.479+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.vpn56Ztl4G4IpMWz4JxySEaIyChdChS_0 2024-09-12T18:01:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.479+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9181057337883819486', time=2024-09-12T19:54:36.496069+0000, chain.objs.size()=1 2024-09-12T18:01:50.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.479+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Z5ACarK4KaC49dC64vGePSk8cB0u0Lw_0 2024-09-12T18:01:50.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.479+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15216291878560952199', time=2024-09-12T19:54:36.592267+0000, chain.objs.size()=1 2024-09-12T18:01:50.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.479+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.f7pau3SRINBX4j5r26ugMFO9ClVXoAp_0 2024-09-12T18:01:50.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.479+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17766489078318171717', time=2024-09-12T19:54:36.613293+0000, chain.objs.size()=1 2024-09-12T18:01:50.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.479+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.sdnoVYFlyLmleZ8Zq-V5t0O1CRl-_ob_0 2024-09-12T18:01:50.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.482+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7991622616980641319', time=2024-09-12T19:54:36.626314+0000, chain.objs.size()=1 2024-09-12T18:01:50.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.482+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4dRKh3AhlZT2HlhkwbIAbbaFSDrQ_NO_0 2024-09-12T18:01:50.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.482+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.540146162350595631', time=2024-09-12T19:54:36.634985+0000, chain.objs.size()=1 2024-09-12T18:01:50.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.482+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.5UHLr1JdvUAmVnvumZnkv6T3MOEBjL3_0 2024-09-12T18:01:50.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.482+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15541087655404217611', time=2024-09-12T19:54:36.669698+0000, chain.objs.size()=1 2024-09-12T18:01:50.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.482+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.fvogcJuJwa4Gj9WqgAqcwxxeUklYyE1_0 2024-09-12T18:01:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.482+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16678050749670668090', time=2024-09-12T19:54:36.754891+0000, chain.objs.size()=1 2024-09-12T18:01:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.482+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.hnatCtDS94WSIi2x3Uw-D9-UCa9S3km_0 2024-09-12T18:01:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.482+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6492111834670141714', time=2024-09-12T19:54:36.788238+0000, chain.objs.size()=1 2024-09-12T18:01:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.482+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.7C3qmVhgj_LYGdc2Cr7A0RMfsr5Osth_0 2024-09-12T18:01:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.482+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18386014841823188536', time=2024-09-12T19:54:36.811975+0000, chain.objs.size()=1 2024-09-12T18:01:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.482+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.zaXqRXyGN8nODFt2-o-3kGLDbxGJ0i6_0 2024-09-12T18:01:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.482+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16250474289017743645', time=2024-09-12T19:54:36.825453+0000, chain.objs.size()=1 2024-09-12T18:01:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.482+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.vkzn5QlcSZeLObuoeXs1vZ5cMr0MeGl_0 2024-09-12T18:01:50.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.485+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12424712919873672167', time=2024-09-12T19:54:36.926576+0000, chain.objs.size()=1 2024-09-12T18:01:50.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.485+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.6cs1JpS37z1W7BEJa-Cuel9tQbdp3lb_0 2024-09-12T18:01:50.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.485+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1917587497681448709', time=2024-09-12T19:54:36.969526+0000, chain.objs.size()=1 2024-09-12T18:01:50.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.485+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.PHekNhwfvBgiwo0mqWdsiHnsydtdnos_0 2024-09-12T18:01:50.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.485+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5137571579464004073', time=2024-09-12T19:54:44.457763+0000, chain.objs.size()=1 2024-09-12T18:01:50.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.485+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.syxy_DT_LQorCmN_GtyOEA9yCXGO9Y6_0 2024-09-12T18:01:50.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.485+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3628305913785159137', time=2024-09-12T19:54:44.460499+0000, chain.objs.size()=1 2024-09-12T18:01:50.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.485+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.MO-XreOJGm2q7htH7SqIi6CHAQxxgl4_0 2024-09-12T18:01:50.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.485+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9219713398315411102', time=2024-09-12T19:54:44.470180+0000, chain.objs.size()=1 2024-09-12T18:01:50.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.485+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.rTUHGFE_v2B08VaDzJSqhjutdxTt_uf_0 2024-09-12T18:01:50.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.485+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17186996416960307734', time=2024-09-12T19:54:44.487128+0000, chain.objs.size()=1 2024-09-12T18:01:50.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.485+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.UpQUsbYVSr2slUO_gUOE3eankdUfddk_0 2024-09-12T18:01:50.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.487+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.131397566172935367', time=2024-09-12T19:54:44.504478+0000, chain.objs.size()=1 2024-09-12T18:01:50.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.487+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.z4yNk9QK8x7YQbvGd8THZjpyrHiCYVh_0 2024-09-12T18:01:50.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.487+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3871578407276657541', time=2024-09-12T19:54:44.540214+0000, chain.objs.size()=1 2024-09-12T18:01:50.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.487+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.xVfXjcuZ1Zej_5H8HxcpNYkD8Hv2mtJ_0 2024-09-12T18:01:50.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.487+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16251995513913736091', time=2024-09-12T19:54:44.543757+0000, chain.objs.size()=1 2024-09-12T18:01:50.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.487+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jch0F5lvd45Buhdn0B0EseVfPJgDU31_0 2024-09-12T18:01:50.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.487+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5977529448993606545', time=2024-09-12T19:54:44.654113+0000, chain.objs.size()=1 2024-09-12T18:01:50.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.487+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.uI3oQHblQRrrLnABJPFauVrio9lyUQR_0 2024-09-12T18:01:50.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.487+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2846117515855146513', time=2024-09-12T19:54:44.717656+0000, chain.objs.size()=1 2024-09-12T18:01:50.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.487+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.33o0DqGwIstbT8tHgo9EfS2bfRu-lbI_0 2024-09-12T18:01:50.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.490+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15773151607438181396', time=2024-09-12T19:54:44.808894+0000, chain.objs.size()=1 2024-09-12T18:01:50.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.kWOmr9iB8tp5LyXN60N0l-yA1TZnYwy_0 2024-09-12T18:01:50.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.490+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1850112672663978329', time=2024-09-12T19:54:44.845873+0000, chain.objs.size()=1 2024-09-12T18:01:50.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.u5gaAU605jQrj5Rq_UXuFnyW0RpkiIp_0 2024-09-12T18:01:50.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.490+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12371553798884372000', time=2024-09-12T19:54:44.875989+0000, chain.objs.size()=1 2024-09-12T18:01:50.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.b7RTdQr9QXwAERlCDZM1Ok7Gfh26YwA_0 2024-09-12T18:01:50.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.490+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1535822903980036310', time=2024-09-12T19:54:44.989470+0000, chain.objs.size()=1 2024-09-12T18:01:50.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.AtYOA_DMiI1BYOh9rt1fY5vFcdpjfWU_0 2024-09-12T18:01:50.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.490+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11165603998478946504', time=2024-09-12T19:54:44.991622+0000, chain.objs.size()=1 2024-09-12T18:01:50.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-Wn8ebYDtOUpfKQNi5o3yO8frkgiNpq_0 2024-09-12T18:01:50.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.490+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4868794292545887305', time=2024-09-12T19:54:45.020045+0000, chain.objs.size()=1 2024-09-12T18:01:50.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.490+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.kpcRQA5Kwrl8msaEktbZXuqf1MDPUiZ_0 2024-09-12T18:01:50.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.491+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8332809573287518225', time=2024-09-12T19:54:45.034805+0000, chain.objs.size()=1 2024-09-12T18:01:50.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.491+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ToiVUa9aho70wtpZ0VtleaZPm8PPz3T_0 2024-09-12T18:01:50.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.491+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11396701162988906089', time=2024-09-12T19:54:45.052367+0000, chain.objs.size()=1 2024-09-12T18:01:50.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.491+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.VpEy7d-fFK4Ej5tXf4IlJx6NDv67SRC_0 2024-09-12T18:01:50.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.491+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2918930067066391716', time=2024-09-12T19:54:45.053277+0000, chain.objs.size()=1 2024-09-12T18:01:50.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.491+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.knUQ5HfEqVEVuF1axjzsTGnmwzEJxLC_0 2024-09-12T18:01:50.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.492+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11738717791063346792', time=2024-09-12T19:54:45.200545+0000, chain.objs.size()=1 2024-09-12T18:01:50.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.492+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.xLqaaTqUnR_UNjPgRff_luu2b3WaAXJ_0 2024-09-12T18:01:50.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.492+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9151636104930820678', time=2024-09-12T19:54:45.213320+0000, chain.objs.size()=1 2024-09-12T18:01:50.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.492+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.kL40jlUu9qQKsoUGlPz7yBrY5pTWUdH_0 2024-09-12T18:01:50.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.492+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17846578290932330831', time=2024-09-12T19:54:45.222562+0000, chain.objs.size()=1 2024-09-12T18:01:50.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.492+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9wOvuj4BscSTXYK22nchqLYgaAyhG0j_0 2024-09-12T18:01:50.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.492+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6479954336384847348', time=2024-09-12T19:54:45.224880+0000, chain.objs.size()=1 2024-09-12T18:01:50.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.492+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TBc_QnmDgyO0_nO4-cGQZLgA_RMOEaE_0 2024-09-12T18:01:50.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.493+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16490828578503499537', time=2024-09-12T19:54:45.337205+0000, chain.objs.size()=1 2024-09-12T18:01:50.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.493+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.SxpHnrDaGOJxY4BAFyNueXA-gpZqzql_0 2024-09-12T18:01:50.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.493+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15150692326101674916', time=2024-09-12T19:54:45.358773+0000, chain.objs.size()=1 2024-09-12T18:01:50.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.493+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.tK3F68kcjZSOANdFdw0qYXEal83NIlD_0 2024-09-12T18:01:50.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.495+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10946225971576761789', time=2024-09-12T19:54:45.508329+0000, chain.objs.size()=1 2024-09-12T18:01:50.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.495+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Z5SeMPCnsI19EMszo41YzahCA6RmEc5_0 2024-09-12T18:01:50.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.495+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9197570117413081652', time=2024-09-12T19:54:45.535526+0000, chain.objs.size()=1 2024-09-12T18:01:50.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.495+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.8U_F1g_Vbq7HRARX6milBwmRs_ihJ3C_0 2024-09-12T18:01:50.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.495+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13765620973200836335', time=2024-09-12T19:54:45.568405+0000, chain.objs.size()=1 2024-09-12T18:01:50.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.495+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.G21fD4DhQgVtCUX9-SpJE9RzcdsFSmP_0 2024-09-12T18:01:50.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.495+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16475231059372355483', time=2024-09-12T19:54:45.597689+0000, chain.objs.size()=1 2024-09-12T18:01:50.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.495+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.RJQcM2GlBz8FhTAzvXegMn2bZiCikGU_0 2024-09-12T18:01:50.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.495+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2113818615787028559', time=2024-09-12T19:54:45.685527+0000, chain.objs.size()=1 2024-09-12T18:01:50.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.495+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.e9CPzR3D4HFO8gXsARkFybLb62CYcGi_0 2024-09-12T18:01:50.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.495+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12677289645910903886', time=2024-09-12T19:54:45.700340+0000, chain.objs.size()=1 2024-09-12T18:01:50.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.495+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.XYSSkoHSXcQ3NoT1FyFfa3RK8Qa9WK4_0 2024-09-12T18:01:50.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.498+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5829358654436452366', time=2024-09-12T19:54:45.716559+0000, chain.objs.size()=1 2024-09-12T18:01:50.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.498+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.rvyFm2F6zOU9UaRblm07DWGlV4mVau5_0 2024-09-12T18:01:50.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.498+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2575719813142613682', time=2024-09-12T19:54:45.726202+0000, chain.objs.size()=1 2024-09-12T18:01:50.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.498+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Fyd7uHSDfGcXiAp3TLmINqiddC3oEgN_0 2024-09-12T18:01:50.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.498+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11744532378322745689', time=2024-09-12T19:54:45.729727+0000, chain.objs.size()=1 2024-09-12T18:01:50.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.498+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.njxKO2gtE42m2cNEAHRyl5c56Vsc2lM_0 2024-09-12T18:01:50.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.498+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10845571223020704984', time=2024-09-12T19:54:48.778553+0000, chain.objs.size()=1 2024-09-12T18:01:50.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.498+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.341__shadow_.QFTLh1UdCr2f3ic1sGAMjS4FLTfcFAl_0 2024-09-12T18:01:50.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.498+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16718568997940175868', time=2024-09-12T19:55:08.979074+0000, chain.objs.size()=1 2024-09-12T18:01:50.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.498+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.435__shadow_.7JRefXJybgBPFuv1DgeCbqNKTEKXO7h_0 2024-09-12T18:01:50.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.501+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18234026414235496443', time=2024-09-12T19:55:27.599507+0000, chain.objs.size()=6 2024-09-12T18:01:50.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.501+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.1 2024-09-12T18:01:50.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.501+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.2 2024-09-12T18:01:50.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.501+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.3 2024-09-12T18:01:50.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.501+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.4 2024-09-12T18:01:50.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.501+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.5 2024-09-12T18:01:50.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.501+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.6 2024-09-12T18:01:50.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.501+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15596725788639099095', time=2024-09-12T19:55:38.477799+0000, chain.objs.size()=3 2024-09-12T18:01:50.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.501+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.524__multipart_mymultipart.2~BGvwZ9hhvXmqlwePVKOiMezS26aqAJ1.1 2024-09-12T18:01:50.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.501+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.524__multipart_mymultipart.2~BGvwZ9hhvXmqlwePVKOiMezS26aqAJ1.2 2024-09-12T18:01:50.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.501+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.524__multipart_mymultipart.2~BGvwZ9hhvXmqlwePVKOiMezS26aqAJ1.3 2024-09-12T18:01:50.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.501+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7576281218034389500', time=2024-09-12T19:56:50.924470+0000, chain.objs.size()=1 2024-09-12T18:01:50.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.501+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.581__shadow:PF-KeIufMmcRSBsxU57Szy9Erz28K3B_.EUeJeC5DuGXhK9A2xnvrWvRnMo0q1ER_0 2024-09-12T18:01:50.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.502+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5656146954468067324', time=2024-09-12T19:56:53.157075+0000, chain.objs.size()=1 2024-09-12T18:01:50.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.502+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.588__shadow:qb9wgjWgj4q9JxvHnkYo8lq5JVDxndb_.uQMRcFs8ur_DOnVIPKTXFQSJIXmhMKm_0 2024-09-12T18:01:50.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.505+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/54539 2024-09-12T18:01:50.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.506+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:01:50.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.506+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6150935706060548834', time=2024-09-12T19:59:10.946367+0000, chain.objs.size()=1 2024-09-12T18:01:50.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.506+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.646__shadow_.j6IEmnAfxbcy40c3koOwUjfXPzB2DER_0 2024-09-12T18:01:50.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.506+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11574068299956603204', time=2024-09-12T19:59:13.067252+0000, chain.objs.size()=1 2024-09-12T18:01:50.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.506+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.653__shadow_.qpa3vG2Fb640Hjl7zuhgc5ivUCo8c5g_0 2024-09-12T18:01:50.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.508+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.510+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:01:50.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.512+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.513+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48173' 2024-09-12T18:01:50.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5142194918157050304', time=2024-09-12T19:52:55.069646+0000, chain.objs.size()=3 2024-09-12T18:01:50.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.160__multipart_mymultipart-STANDARD.2~VvknPb_QzwWoAhre-Gj4aQrWPdoLp5V.1 2024-09-12T18:01:50.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.160__multipart_mymultipart-STANDARD.2~VvknPb_QzwWoAhre-Gj4aQrWPdoLp5V.2 2024-09-12T18:01:50.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.160__multipart_mymultipart-STANDARD.2~VvknPb_QzwWoAhre-Gj4aQrWPdoLp5V.3 2024-09-12T18:01:50.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17466815169800732527', time=2024-09-12T19:52:56.331392+0000, chain.objs.size()=3 2024-09-12T18:01:50.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__multipart_foo-STANDARD.2~q4Zd_RktMmYdW3sWaRr4vNAcYT7OrHl.1 2024-09-12T18:01:50.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__multipart_foo-STANDARD.2~q4Zd_RktMmYdW3sWaRr4vNAcYT7OrHl.2 2024-09-12T18:01:50.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__multipart_foo-STANDARD.2~q4Zd_RktMmYdW3sWaRr4vNAcYT7OrHl.3 2024-09-12T18:01:50.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14172748066948868125', time=2024-09-12T19:53:09.937789+0000, chain.objs.size()=1 2024-09-12T18:01:50.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.201__shadow_.94MuAxSKFoY8l9QBT35bqGKQCQ_0wE8_0 2024-09-12T18:01:50.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5906794501390734740', time=2024-09-12T19:54:02.565915+0000, chain.objs.size()=1 2024-09-12T18:01:50.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.245__shadow_.ceVK1CkuUTY_eVfBCv3KCrq0p8IQzWX_0 2024-09-12T18:01:50.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10321757763696368851', time=2024-09-12T19:54:04.023243+0000, chain.objs.size()=1 2024-09-12T18:01:50.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.252__shadow_.02-UZ1_IlD8ixZttbGvFWF1KzIwVq37_0 2024-09-12T18:01:50.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5287101892133022992', time=2024-09-12T19:54:06.112696+0000, chain.objs.size()=1 2024-09-12T18:01:50.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.262__shadow_.Z3l0hLUI77iXmH9s1yI6F8VJ6uBkvHN_0 2024-09-12T18:01:50.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12222558993370848132', time=2024-09-12T19:54:13.486922+0000, chain.objs.size()=1 2024-09-12T18:01:50.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.GrKBtCirNTIf5maSoTMWO6muR_DEKXu_0 2024-09-12T18:01:50.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15040003061700786292', time=2024-09-12T19:54:13.678462+0000, chain.objs.size()=1 2024-09-12T18:01:50.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.514+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.8qR6t4jy8CgojjkflUuttUxnpS4WlQA_0 2024-09-12T18:01:50.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.516+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1306204233402038571', time=2024-09-12T19:54:13.683259+0000, chain.objs.size()=1 2024-09-12T18:01:50.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.516+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.7P45RkuRsjDbz71R6ME5tE4cgW0Umm0_0 2024-09-12T18:01:50.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.516+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15616293898668046441', time=2024-09-12T19:54:13.684117+0000, chain.objs.size()=1 2024-09-12T18:01:50.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.516+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.uHCH3mS9wQzf2xCW7VDPrE9l0SzYu_2_0 2024-09-12T18:01:50.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.516+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13271795878076698551', time=2024-09-12T19:54:13.691124+0000, chain.objs.size()=1 2024-09-12T18:01:50.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.516+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.rW2kkMFGCyeql_Pg09_y9YpJ34Y5tK1_0 2024-09-12T18:01:50.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.516+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.448542569854353838', time=2024-09-12T19:54:13.700794+0000, chain.objs.size()=1 2024-09-12T18:01:50.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.516+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.znquTiSSPvelyHZrKrIQEpjwY5oqvdh_0 2024-09-12T18:01:50.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9664297257244467645', time=2024-09-12T19:54:13.707949+0000, chain.objs.size()=1 2024-09-12T18:01:50.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.qAPGmTM9vu1TeLKUj3PFEHXjSjqGek-_0 2024-09-12T18:01:50.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7183000618793034695', time=2024-09-12T19:54:13.850148+0000, chain.objs.size()=1 2024-09-12T18:01:50.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.lUCVFDhy851yEWV5pQ8yx6cdW9RsjW7_0 2024-09-12T18:01:50.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12378335190847778721', time=2024-09-12T19:54:13.908582+0000, chain.objs.size()=1 2024-09-12T18:01:50.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.rvFlSwnBt47h7hpI6S7Q6QlyYY4kGwe_0 2024-09-12T18:01:50.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5084615045077454920', time=2024-09-12T19:54:13.917762+0000, chain.objs.size()=1 2024-09-12T18:01:50.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.mnSMrarTsJX77janpicBTrqT6EbJ7G0_0 2024-09-12T18:01:50.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10282570583452724469', time=2024-09-12T19:54:14.057986+0000, chain.objs.size()=1 2024-09-12T18:01:50.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.hGK1g9u-3Vb2Wi9HZw0ovPVAFHfstWT_0 2024-09-12T18:01:50.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9254394693108335601', time=2024-09-12T19:54:14.077315+0000, chain.objs.size()=1 2024-09-12T18:01:50.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.gZxRSaYoa4MgjnohhLTiT6ctV-5s_xZ_0 2024-09-12T18:01:50.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9646939663921947579', time=2024-09-12T19:54:14.295918+0000, chain.objs.size()=1 2024-09-12T18:01:50.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.I3XZdetGa2eEcSvfxvIUwFl-N693VQi_0 2024-09-12T18:01:50.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1276494314110626620', time=2024-09-12T19:54:14.397760+0000, chain.objs.size()=1 2024-09-12T18:01:50.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.6fAKdTcj_R-EekCvaxOLAzn0xziWBEX_0 2024-09-12T18:01:50.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15324320836580516793', time=2024-09-12T19:54:14.400579+0000, chain.objs.size()=1 2024-09-12T18:01:50.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Im6PzcgFpIiMMuTlAiRxjaItRZ-zocG_0 2024-09-12T18:01:50.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15609248349116400743', time=2024-09-12T19:54:14.408786+0000, chain.objs.size()=1 2024-09-12T18:01:50.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.dP9FmsBHZVzSAVX6AnfZMjd_Ol3BAIv_0 2024-09-12T18:01:50.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15756524585179803730', time=2024-09-12T19:54:14.437150+0000, chain.objs.size()=1 2024-09-12T18:01:50.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.519+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.80RFI21Bw6INs_CCwAL7iOJozANvBFm_0 2024-09-12T18:01:50.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.521+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4456222615129023059', time=2024-09-12T19:54:14.463962+0000, chain.objs.size()=1 2024-09-12T18:01:50.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.521+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.MdNiDQ7wWRtCMFLcmGsVj3d0aYsWqkz_0 2024-09-12T18:01:50.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.521+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16968179029411436335', time=2024-09-12T19:54:14.468113+0000, chain.objs.size()=1 2024-09-12T18:01:50.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.521+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.XsHTSkSXzPOKrwBuNuAVtzSU7c7hc8b_0 2024-09-12T18:01:50.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.521+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11989712919524350876', time=2024-09-12T19:54:14.541027+0000, chain.objs.size()=1 2024-09-12T18:01:50.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.521+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ow8GTyKdoKg4ADOmhTcRuNyOKwmrHPA_0 2024-09-12T18:01:50.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.521+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18081398987150478323', time=2024-09-12T19:54:14.569131+0000, chain.objs.size()=1 2024-09-12T18:01:50.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.521+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.DmVqP9iKNOxGhxDHQahO4zSuYD6p-9__0 2024-09-12T18:01:50.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.521+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3358860930321146097', time=2024-09-12T19:54:14.593460+0000, chain.objs.size()=1 2024-09-12T18:01:50.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.521+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.wdKACXhLXISpzQLrNOpDwqnuP4bFycq_0 2024-09-12T18:01:50.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.521+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10115055667458871750', time=2024-09-12T19:54:14.610023+0000, chain.objs.size()=1 2024-09-12T18:01:50.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.521+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.CAKshlcYOwm6R8yS3zzbGFoesVJLlsk_0 2024-09-12T18:01:50.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.521+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5922841402171706280', time=2024-09-12T19:54:14.743999+0000, chain.objs.size()=1 2024-09-12T18:01:50.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.521+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.38AWGorN-aJZe6xCBPD90c3no7uRTos_0 2024-09-12T18:01:50.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.521+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7070624295216172059', time=2024-09-12T19:54:14.756196+0000, chain.objs.size()=1 2024-09-12T18:01:50.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.521+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2K95ssreudIkU2shuhXUJ3jL4vqEgFV_0 2024-09-12T18:01:50.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.523+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12485924828257138134', time=2024-09-12T19:54:14.778523+0000, chain.objs.size()=1 2024-09-12T18:01:50.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.523+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.R12SNuaq5wTWMJYLUnBktxIF4oBcp7F_0 2024-09-12T18:01:50.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.523+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12901930270851015672', time=2024-09-12T19:54:14.795552+0000, chain.objs.size()=1 2024-09-12T18:01:50.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.523+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.FbMdY5dvx4lYEgvC0n0BwRVaX9J34K3_0 2024-09-12T18:01:50.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.523+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11185615131408880003', time=2024-09-12T19:54:14.888896+0000, chain.objs.size()=1 2024-09-12T18:01:50.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.524+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.q4Av44Zluz1w5UKADEglrfHNxxXB3DG_0 2024-09-12T18:01:50.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.524+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.880758997296315287', time=2024-09-12T19:54:14.901541+0000, chain.objs.size()=1 2024-09-12T18:01:50.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.524+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.aQywZ5IehDiW36i7Q_CdYZ74sL36a4m_0 2024-09-12T18:01:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.526+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15164729379061048855', time=2024-09-12T19:54:14.952072+0000, chain.objs.size()=1 2024-09-12T18:01:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.526+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.iow69luPzj-o7CSCmHiDlK17F8HHYpF_0 2024-09-12T18:01:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.526+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8209562767774432230', time=2024-09-12T19:54:16.728466+0000, chain.objs.size()=1 2024-09-12T18:01:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.526+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.272__shadow_.i7MHaG8ND0mCFYSOMtTCdT-93x4OQUL_0 2024-09-12T18:01:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.526+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7808119356100702623', time=2024-09-12T19:54:17.120780+0000, chain.objs.size()=1 2024-09-12T18:01:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.526+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.274__shadow_.neo-h2ZoDNZZX32Qh-136jNkWCDJ9sX_0 2024-09-12T18:01:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.526+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8013230203894936307', time=2024-09-12T19:54:17.354394+0000, chain.objs.size()=1 2024-09-12T18:01:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.526+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.275__shadow_.X7XSymArJEygPLcZ2yehL6QDBGp5HcN_0 2024-09-12T18:01:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.526+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9489157462649247065', time=2024-09-12T19:54:17.560397+0000, chain.objs.size()=1 2024-09-12T18:01:50.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.526+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.276__shadow_.RlQPXwGfdTJH2ONvRQWXnqrSzO-H_fr_0 2024-09-12T18:01:50.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.526+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2127937366106152783', time=2024-09-12T19:54:18.398091+0000, chain.objs.size()=1 2024-09-12T18:01:50.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.526+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.280__shadow_.FfA7m_wEpn_gKW7DFUICSJKm0BOcCkl_0 2024-09-12T18:01:50.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.526+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.389046651772964699', time=2024-09-12T19:54:20.601122+0000, chain.objs.size()=1 2024-09-12T18:01:50.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.526+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.290__shadow_.u5WE_gkB9X2SW-9U66O9aL8J-CuyeuR_0 2024-09-12T18:01:50.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.526+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2337497635121729234', time=2024-09-12T19:54:22.170410+0000, chain.objs.size()=1 2024-09-12T18:01:50.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.526+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.HujTSmPXEPibrzb91sexR79911gTcSN_0 2024-09-12T18:01:50.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10176708292343114', time=2024-09-12T19:54:24.376645+0000, chain.objs.size()=1 2024-09-12T18:01:50.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.304__shadow_.UCDnm0fUF-XbDVP8_7aKgL_bor024Z9_0 2024-09-12T18:01:50.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17488583520746456354', time=2024-09-12T19:54:35.752518+0000, chain.objs.size()=1 2024-09-12T18:01:50.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.k15LxevMHetBZQgf812BW_LwVFR1HvH_0 2024-09-12T18:01:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6447376108113217887', time=2024-09-12T19:54:35.787096+0000, chain.objs.size()=1 2024-09-12T18:01:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ptOTEaNvDZP6P-rzLb4Sm1laVFMBBUm_0 2024-09-12T18:01:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17667491268096735146', time=2024-09-12T19:54:35.798562+0000, chain.objs.size()=1 2024-09-12T18:01:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-JubMFaRmtqdqNN0430vTPrrBs4E7R2_0 2024-09-12T18:01:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4989064063278304047', time=2024-09-12T19:54:35.810290+0000, chain.objs.size()=1 2024-09-12T18:01:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.PpkiuShvg33VVwSHTlHFMoXL4Dz-HCv_0 2024-09-12T18:01:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16333615651683417046', time=2024-09-12T19:54:35.932459+0000, chain.objs.size()=1 2024-09-12T18:01:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.TIOcxC9JJvXvwC6Uj-TC08PRF4FF2Sv_0 2024-09-12T18:01:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7613767736834190568', time=2024-09-12T19:54:35.941600+0000, chain.objs.size()=1 2024-09-12T18:01:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.AKe-WUF_MvkanIB4l-QTVRxZKw863jQ_0 2024-09-12T18:01:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14384519754621078922', time=2024-09-12T19:54:35.960128+0000, chain.objs.size()=1 2024-09-12T18:01:50.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.lhS7Tbihe6f9jhJ5CHzbKwpJj-_E6CQ_0 2024-09-12T18:01:50.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9697011040039724984', time=2024-09-12T19:54:35.981103+0000, chain.objs.size()=1 2024-09-12T18:01:50.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.vEFK0OkSQaxDI1oTYQrN9hKBf4LxiaI_0 2024-09-12T18:01:50.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.528+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3516282473925234820', time=2024-09-12T19:54:35.986753+0000, chain.objs.size()=1 2024-09-12T18:01:50.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.529+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QZLRP-0y9Kj_c2U90Dhqv7yoreAbpAE_0 2024-09-12T18:01:50.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.529+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11684641416795491323', time=2024-09-12T19:54:36.003792+0000, chain.objs.size()=1 2024-09-12T18:01:50.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.529+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.oIW0510UOOD1JXH50-4sTSlhsnwakDh_0 2024-09-12T18:01:50.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11481525289829647502', time=2024-09-12T19:54:36.084880+0000, chain.objs.size()=1 2024-09-12T18:01:50.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.dubL2lTykxkyapYT0NwmBpCyxfH53XC_0 2024-09-12T18:01:50.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14194866063180863953', time=2024-09-12T19:54:36.095651+0000, chain.objs.size()=1 2024-09-12T18:01:50.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.qldhX77-hmLr7Dwk5bLSh1zc54rB1Wf_0 2024-09-12T18:01:50.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17413751870281662026', time=2024-09-12T19:54:36.096388+0000, chain.objs.size()=1 2024-09-12T18:01:50.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.40VIbBYDxouo3CAwXZ3cRl5abGJ7e80_0 2024-09-12T18:01:50.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12225991439982600089', time=2024-09-12T19:54:36.129246+0000, chain.objs.size()=1 2024-09-12T18:01:50.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.GapW6KSXpQVTeY2j2qoj-Oq3J7SD_Ru_0 2024-09-12T18:01:50.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8852974281164440817', time=2024-09-12T19:54:36.136376+0000, chain.objs.size()=1 2024-09-12T18:01:50.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.moBp5tv97XW7qs3Xukdnj3xpeOcG2bG_0 2024-09-12T18:01:50.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17672877824155810283', time=2024-09-12T19:54:36.161929+0000, chain.objs.size()=1 2024-09-12T18:01:50.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.plWZkTn3tEEei-duOir-GM1VqEcE4Oz_0 2024-09-12T18:01:50.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.851748284824946477', time=2024-09-12T19:54:36.163526+0000, chain.objs.size()=1 2024-09-12T18:01:50.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.pXyWGiniUAOmu9cagdMvlKCpc1zBFGY_0 2024-09-12T18:01:50.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17089198114591966067', time=2024-09-12T19:54:36.290174+0000, chain.objs.size()=1 2024-09-12T18:01:50.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.tan4jsj1bZiJcjJ9zqyIE83P_V-Q2ew_0 2024-09-12T18:01:50.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6067109222030320325', time=2024-09-12T19:54:36.307573+0000, chain.objs.size()=1 2024-09-12T18:01:50.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.3Dd6seMGNMedrQTVQu0D7QQH8fZm0OC_0 2024-09-12T18:01:50.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13809461761156428789', time=2024-09-12T19:54:36.318527+0000, chain.objs.size()=1 2024-09-12T18:01:50.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ywLufXiH5KmlRaPV7PZCDfZXdmRRk6o_0 2024-09-12T18:01:50.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4208064135049057906', time=2024-09-12T19:54:36.319138+0000, chain.objs.size()=1 2024-09-12T18:01:50.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.531+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.wyfJd9Xt-Qn6ZVPwPe4BtD1TtVv8tiy_0 2024-09-12T18:01:50.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.533+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18173360297387194944', time=2024-09-12T19:54:36.329041+0000, chain.objs.size()=1 2024-09-12T18:01:50.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.533+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.pEtJgOR8Usy4b9pSzZsyLl0D1mVPBmj_0 2024-09-12T18:01:50.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.533+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13853579961073072943', time=2024-09-12T19:54:36.447369+0000, chain.objs.size()=1 2024-09-12T18:01:50.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.533+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Wc3wc7noXzNMAxjEokiJ6UYskBYN3zb_0 2024-09-12T18:01:50.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.533+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1739725821424398424', time=2024-09-12T19:54:36.479977+0000, chain.objs.size()=1 2024-09-12T18:01:50.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.533+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Ko7XU6Q0OKhfam7h9nrCzzj7280s0JE_0 2024-09-12T18:01:50.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.533+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4738966532024175344', time=2024-09-12T19:54:36.493991+0000, chain.objs.size()=1 2024-09-12T18:01:50.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.533+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.bzfN222SipXQwinwIny1TpoVP9K2Lpx_0 2024-09-12T18:01:50.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.533+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13564524063601066554', time=2024-09-12T19:54:36.634339+0000, chain.objs.size()=1 2024-09-12T18:01:50.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.533+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.8bYmflaL-pl-M5v20ZVLSdL22cwfbQI_0 2024-09-12T18:01:50.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.536+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14979230763840069855', time=2024-09-12T19:54:36.635722+0000, chain.objs.size()=1 2024-09-12T18:01:50.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.536+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4_gwfrToUzN0QtZ3AOZQhyIhpfjAGgT_0 2024-09-12T18:01:50.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.536+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5783840245569376835', time=2024-09-12T19:54:36.754243+0000, chain.objs.size()=1 2024-09-12T18:01:50.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.536+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rBmck8L-mMEglUCm5aCquNNqOCFnjby_0 2024-09-12T18:01:50.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.536+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9618629882713468863', time=2024-09-12T19:54:36.789203+0000, chain.objs.size()=1 2024-09-12T18:01:50.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.536+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.i0tM0zPfqYUXBcjvF8h8kJQr2PD4VSB_0 2024-09-12T18:01:50.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.536+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5322006599988058086', time=2024-09-12T19:54:36.801109+0000, chain.objs.size()=1 2024-09-12T18:01:50.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.536+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.90vBV9FUkISTop9NljcsJKwVo1Ax4qS_0 2024-09-12T18:01:50.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.536+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1701165636150530993', time=2024-09-12T19:54:36.814702+0000, chain.objs.size()=1 2024-09-12T18:01:50.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.536+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.qFR1kmQwgD1CrvpQy2yfnNOZv3HVMuA_0 2024-09-12T18:01:50.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.536+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9108780710443157216', time=2024-09-12T19:54:36.816592+0000, chain.objs.size()=1 2024-09-12T18:01:50.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.536+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-_9DXtIXRMfpxcqdFvIuoq5D1QUnM6r_0 2024-09-12T18:01:50.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.536+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.804405477685409419', time=2024-09-12T19:54:36.904963+0000, chain.objs.size()=1 2024-09-12T18:01:50.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.536+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.PnwXwtgA1inR-2M4C3nrFO_l6s8U3ic_0 2024-09-12T18:01:50.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.538+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.637752716550989381', time=2024-09-12T19:54:36.906436+0000, chain.objs.size()=1 2024-09-12T18:01:50.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.538+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.8_rr2axFN6-T4P40SOw5CNP2kF59voI_0 2024-09-12T18:01:50.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.538+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.897139329735138678', time=2024-09-12T19:54:36.954121+0000, chain.objs.size()=1 2024-09-12T18:01:50.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.538+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Fc6GyZlcScjePbz55kuWJovPqauGPpY_0 2024-09-12T18:01:50.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.538+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.377625492738063103', time=2024-09-12T19:54:36.972646+0000, chain.objs.size()=1 2024-09-12T18:01:50.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.538+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.t0cSf4etE8sUOMFGgmnBFZeDkZKlglj_0 2024-09-12T18:01:50.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.538+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15644345464422039631', time=2024-09-12T19:54:44.457032+0000, chain.objs.size()=1 2024-09-12T18:01:50.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.538+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.D6_cwhkKHjkk7PjXZjzF1eKsdqZUILr_0 2024-09-12T18:01:50.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.538+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6608559838433648517', time=2024-09-12T19:54:44.491829+0000, chain.objs.size()=1 2024-09-12T18:01:50.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.538+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.QiG5ceuS75XjR5zyCkS0WcD5hV7UUMp_0 2024-09-12T18:01:50.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.540+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9165905616224246861', time=2024-09-12T19:54:44.508566+0000, chain.objs.size()=1 2024-09-12T18:01:50.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.540+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Z8U6t87U11jfxivHg3R7Sv37ctzCWCJ_0 2024-09-12T18:01:50.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.540+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18155542786777624974', time=2024-09-12T19:54:44.665432+0000, chain.objs.size()=1 2024-09-12T18:01:50.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.540+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.mR2vcAcGOiOjjulcP8EFLDVb2kdaJ0P_0 2024-09-12T18:01:50.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.540+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11338470872152076077', time=2024-09-12T19:54:44.673406+0000, chain.objs.size()=1 2024-09-12T18:01:50.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.540+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.dZfjAwrHVHbmD63epkJUsdlIXqncLyK_0 2024-09-12T18:01:50.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.541+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3647279091026076016', time=2024-09-12T19:54:44.690898+0000, chain.objs.size()=1 2024-09-12T18:01:50.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.541+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.W74DNxAU8N4De-Du1CjIXyF5WETwW48_0 2024-09-12T18:01:50.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.541+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1849831554117161558', time=2024-09-12T19:54:44.711441+0000, chain.objs.size()=1 2024-09-12T18:01:50.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.541+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.cMZbuN6QN1xlU3RFgJ-WmUM_R_GzYXe_0 2024-09-12T18:01:50.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.541+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5301162939114958300', time=2024-09-12T19:54:44.806591+0000, chain.objs.size()=1 2024-09-12T18:01:50.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.541+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.fIVH1T11l2C60j3ROabBQHoFfnBGhBK_0 2024-09-12T18:01:50.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.543+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14470054888796852711', time=2024-09-12T19:54:44.844651+0000, chain.objs.size()=1 2024-09-12T18:01:50.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.543+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.KYv5mrLZZd8dA8eqhHxmu15Yt6dI9RO_0 2024-09-12T18:01:50.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.543+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6515834838380786524', time=2024-09-12T19:54:44.845433+0000, chain.objs.size()=1 2024-09-12T18:01:50.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.543+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.tV5_qOHWX5g6aQMYibbm1zvTlCpLVHv_0 2024-09-12T18:01:50.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.543+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16182618793774956773', time=2024-09-12T19:54:44.872912+0000, chain.objs.size()=1 2024-09-12T18:01:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.543+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.NNpklBZhUE1i6eSEdPBfSdVocDFu67P_0 2024-09-12T18:01:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.543+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6310227482039284269', time=2024-09-12T19:54:45.004708+0000, chain.objs.size()=1 2024-09-12T18:01:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.543+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.mQNvM7p33v8xXeIsbuZHwO1gDFJOj8r_0 2024-09-12T18:01:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13053505111326430883', time=2024-09-12T19:54:45.052689+0000, chain.objs.size()=1 2024-09-12T18:01:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.544+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TX7IUYXpm_tekxxe72hHVNF6jGJ8TMo_0 2024-09-12T18:01:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13508623819345877802', time=2024-09-12T19:54:45.218687+0000, chain.objs.size()=1 2024-09-12T18:01:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.544+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.W9YBFeVeY1j_fJnjiCM3xYqoL1ZPdDF_0 2024-09-12T18:01:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6416109070603242048', time=2024-09-12T19:54:45.337944+0000, chain.objs.size()=1 2024-09-12T18:01:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.544+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.meqyvyQCkJMXpsYfHyAraAVN78vYyAD_0 2024-09-12T18:01:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15979361326919281498', time=2024-09-12T19:54:45.347353+0000, chain.objs.size()=1 2024-09-12T18:01:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.544+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.iEgIzS3O5EYLWC6xaU5e9AjwawOHY4m_0 2024-09-12T18:01:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2111963192575522541', time=2024-09-12T19:54:45.382137+0000, chain.objs.size()=1 2024-09-12T18:01:50.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.544+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.io83UXSxspd4QK3MRzeJOTE-B20kzlB_0 2024-09-12T18:01:50.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12793366778493661236', time=2024-09-12T19:54:45.399257+0000, chain.objs.size()=1 2024-09-12T18:01:50.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.544+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.fAVEtUXL57LIJTzBl36YsBWQGOz0uKB_0 2024-09-12T18:01:50.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.544+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17258765592191409751', time=2024-09-12T19:54:45.411848+0000, chain.objs.size()=1 2024-09-12T18:01:50.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.544+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.wwNAijhNVZF5zRfP0VBbYi3hwewSMNr_0 2024-09-12T18:01:50.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.545+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1130255786773688158', time=2024-09-12T19:54:45.423121+0000, chain.objs.size()=1 2024-09-12T18:01:50.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.545+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.33o36l87Fk15xENUiQOfSZpl3-c8lwo_0 2024-09-12T18:01:50.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.550+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/48173 2024-09-12T18:01:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.552+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T18:01:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11535493013459567083', time=2024-09-12T19:54:45.427218+0000, chain.objs.size()=1 2024-09-12T18:01:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9MIVKFh53mHZOAV7dX5JSFoxb9sNFsP_0 2024-09-12T18:01:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2877211196391037121', time=2024-09-12T19:54:45.509629+0000, chain.objs.size()=1 2024-09-12T18:01:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ZV4SMyVvgZgLOrqVcAcvImOGYD0FiA1_0 2024-09-12T18:01:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17455137584179222754', time=2024-09-12T19:54:45.530073+0000, chain.objs.size()=1 2024-09-12T18:01:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.pqJYjgeeXfyN3BGJZALKlmW1oUUbymM_0 2024-09-12T18:01:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12410536090404796558', time=2024-09-12T19:54:45.575694+0000, chain.objs.size()=1 2024-09-12T18:01:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.wQDBvVhQjOyeVIssjgPv9Nf_-ikDQJT_0 2024-09-12T18:01:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12912696566802744930', time=2024-09-12T19:54:45.674670+0000, chain.objs.size()=1 2024-09-12T18:01:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.2GSWpXkfze59rwbCbE_WNo_tHbDLPHk_0 2024-09-12T18:01:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18005298054395370668', time=2024-09-12T19:54:45.691928+0000, chain.objs.size()=1 2024-09-12T18:01:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.MugV5u4snuJlc_6WMkc8SrxNJ-x_KtF_0 2024-09-12T18:01:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17267626677281130639', time=2024-09-12T19:54:45.739792+0000, chain.objs.size()=1 2024-09-12T18:01:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.x7FsUmGDhwsGTTXZkwMQfeB48kgxAOz_0 2024-09-12T18:01:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7097836688660597380', time=2024-09-12T19:55:01.715116+0000, chain.objs.size()=1 2024-09-12T18:01:50.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.395__shadow:WykZUwAWirGydpyRFR-fLymJPfui427_.WfyYngbDijHMLmlwlCM7z05dfYEygC5_0 2024-09-12T18:01:50.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15041841603411231277', time=2024-09-12T19:55:10.484071+0000, chain.objs.size()=1 2024-09-12T18:01:50.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.441__shadow_.JwOjJKm5Llm7ouTIfUAC_HS2_oVrfNu_0 2024-09-12T18:01:50.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7316643901352339271', time=2024-09-12T19:55:30.574768+0000, chain.objs.size()=1 2024-09-12T18:01:50.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.518__shadow_.w3fZN8-ZT5o9d-gpu8iDjCt7EtfU-Ed_0 2024-09-12T18:01:50.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11441903670244327608', time=2024-09-12T19:55:38.015288+0000, chain.objs.size()=2 2024-09-12T18:01:50.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.524__multipart_mymultipart.2~_KdRAGhiywgMCStr2FQrwTMwh9WOX3v.1 2024-09-12T18:01:50.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.553+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.524__multipart_mymultipart.2~_KdRAGhiywgMCStr2FQrwTMwh9WOX3v.2 2024-09-12T18:01:50.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.554+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6474394111964121295', time=2024-09-12T19:56:25.834933+0000, chain.objs.size()=1 2024-09-12T18:01:50.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.554+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:5v1cqbavsmjQG7mgkGvYb9z0LQz7MA4_.5ER34WCIowPM13gZDSPmLTdVUInPrgw_0 2024-09-12T18:01:50.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.555+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11876638443550167522', time=2024-09-12T19:56:29.675949+0000, chain.objs.size()=1 2024-09-12T18:01:50.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.555+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.575__shadow:30qyBkZx50P8Rt86pRR2WEq5sX6dQuF_.SCYVJFgVc6F85omrl4kdkzpdYpDp8v5_0 2024-09-12T18:01:50.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.555+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3627266618055859845', time=2024-09-12T19:56:33.717954+0000, chain.objs.size()=1 2024-09-12T18:01:50.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.555+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.577__shadow:hFb44fFkRiONpxwkaDHT9C3Bs1EDZZ8_.U0iUD5QI2nKEDFZ078x96DZG_j1_BSA_0 2024-09-12T18:01:50.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.555+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17750505902465659305', time=2024-09-12T19:56:36.227673+0000, chain.objs.size()=1 2024-09-12T18:01:50.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.555+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:3lR-6CqQD84aRBKor2snYqv8QEIRFHk_.FLTSJBrbthpyBUiaxM8p-xUB_5O6w4d_0 2024-09-12T18:01:50.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.556+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12922309725878660913', time=2024-09-12T19:56:49.995713+0000, chain.objs.size()=1 2024-09-12T18:01:50.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.556+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.580__shadow:p-jXIOA4a-Wy7QlI1nz49NRedNRYi3O_.mG_z2joYCoCW2q-dP1_lAFYAv0KisfL_0 2024-09-12T18:01:50.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.556+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11792626484200797503', time=2024-09-12T19:56:51.035431+0000, chain.objs.size()=1 2024-09-12T18:01:50.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.556+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.581__shadow:mAGypR.mbp03xAP5p1yBMLel0ghiUBd_._gjce9pn2ddn2JlbfWOP3PIm8ugmk3A_0 2024-09-12T18:01:50.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.556+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~A_AnqvYhy6ApsjeXQXpZ2AeWVGbE8wh', time=2024-09-12T19:59:06.461905+0000, chain.objs.size()=6 2024-09-12T18:01:50.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.556+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.626__multipart_multipart_enc.2~A_AnqvYhy6ApsjeXQXpZ2AeWVGbE8wh.1 2024-09-12T18:01:50.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.556+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.626__multipart_multipart_enc.2~A_AnqvYhy6ApsjeXQXpZ2AeWVGbE8wh.2 2024-09-12T18:01:50.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.556+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.626__multipart_multipart_enc.2~A_AnqvYhy6ApsjeXQXpZ2AeWVGbE8wh.3 2024-09-12T18:01:50.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.556+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.626__multipart_multipart_enc.2~A_AnqvYhy6ApsjeXQXpZ2AeWVGbE8wh.4 2024-09-12T18:01:50.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.556+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.626__multipart_multipart_enc.2~A_AnqvYhy6ApsjeXQXpZ2AeWVGbE8wh.5 2024-09-12T18:01:50.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.556+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.626__multipart_multipart_enc.2~A_AnqvYhy6ApsjeXQXpZ2AeWVGbE8wh.6 2024-09-12T18:01:50.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.556+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10249205659192579841', time=2024-09-12T19:59:11.556105+0000, chain.objs.size()=1 2024-09-12T18:01:50.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.556+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.648__shadow_.keik2wgsTnhKsDWiUD_rOKJJBQoWShl_0 2024-09-12T18:01:50.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.556+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10247869323348105236', time=2024-09-12T19:59:11.867960+0000, chain.objs.size()=2 2024-09-12T18:01:50.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.556+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.649__shadow_.MU0pwhQ6G0vQsZI2myD9WlHKPaJmz_2_0 2024-09-12T18:01:50.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.556+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.649__shadow_.MU0pwhQ6G0vQsZI2myD9WlHKPaJmz_2_1 2024-09-12T18:01:50.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.559+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6661162756805588072', time=2024-09-12T19:59:24.808335+0000, chain.objs.size()=1 2024-09-12T18:01:50.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.559+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.700__shadow:qvkNiBj1LuZ9o.ZkaIdcAPTEKi5ieAR_.znSoZiL4Z2V5mJ2qIhQ1cmIn0sgJ5_z_0 2024-09-12T18:01:50.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.562+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.564+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:01:50.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.565+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.566+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46832' 2024-09-12T18:01:50.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='_PpLkvkoED4E0ERK1xUXh0AhuNTteh8j', time=2024-09-12T19:52:55.510772+0000, chain.objs.size()=2 2024-09-12T18:01:50.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.161__shadow_.vz85cYDwSCLrWd1X3Oc-nBbnL3rNd5I_0 2024-09-12T18:01:50.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.161__shadow_.vz85cYDwSCLrWd1X3Oc-nBbnL3rNd5I_1 2024-09-12T18:01:50.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10976052053462694222', time=2024-09-12T19:53:04.017967+0000, chain.objs.size()=1 2024-09-12T18:01:50.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.177__shadow_.lJGrU_QeU9xnQhfbLRZFPpHLMtycGhH_0 2024-09-12T18:01:50.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1908446902522750347', time=2024-09-12T19:53:06.205810+0000, chain.objs.size()=1 2024-09-12T18:01:50.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.190__shadow_.3FblSXBtmC6iShR8EwQ9_xj3PriOxuK_0 2024-09-12T18:01:50.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15801893609620367675', time=2024-09-12T19:53:59.409731+0000, chain.objs.size()=1 2024-09-12T18:01:50.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.231__shadow_.ri2KpM9e5tT_dxfySnR4Wad9_QvVHlk_0 2024-09-12T18:01:50.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13738396779241421779', time=2024-09-12T19:54:00.735696+0000, chain.objs.size()=1 2024-09-12T18:01:50.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.237__shadow_._Gm_Wp28kpTopfaXWqyElhFjuVlNv67_0 2024-09-12T18:01:50.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15952479397287081982', time=2024-09-12T19:54:02.053182+0000, chain.objs.size()=1 2024-09-12T18:01:50.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.243__shadow_.IX2OhF7EqkSxphglPvcTQeIdweS4XX3_0 2024-09-12T18:01:50.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17301640080105600836', time=2024-09-12T19:54:02.312502+0000, chain.objs.size()=1 2024-09-12T18:01:50.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.244__shadow_.XfHG1cGGFsPIBeWjHt3s6wtG4_88lzQ_0 2024-09-12T18:01:50.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9555708523166805453', time=2024-09-12T19:54:03.008001+0000, chain.objs.size()=1 2024-09-12T18:01:50.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.247__shadow_.kpcPpP4A0KKvsJjlZ9j1Ytmy2-l5o4U_0 2024-09-12T18:01:50.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10910455174641480924', time=2024-09-12T19:54:03.618017+0000, chain.objs.size()=1 2024-09-12T18:01:50.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.250__shadow_.dWUKcPBwir2J2HTZn1z5-MvEMASW38f_0 2024-09-12T18:01:50.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9773385242227493695', time=2024-09-12T19:54:04.267202+0000, chain.objs.size()=1 2024-09-12T18:01:50.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.253__shadow_.8Rut6DjYdvsEirNfSJd8P69R32JsWIx_0 2024-09-12T18:01:50.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12183474820133915542', time=2024-09-12T19:54:05.912385+0000, chain.objs.size()=1 2024-09-12T18:01:50.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.567+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.261__shadow_.KfYRBmUPN3yiOlkPtLuG1hG4gBdp3W-_0 2024-09-12T18:01:50.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12080637251184773798', time=2024-09-12T19:54:13.499448+0000, chain.objs.size()=1 2024-09-12T18:01:50.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.cho9dFV4iitnJgeGkXeqgBmeg7oqNdv_0 2024-09-12T18:01:50.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7762533928039489868', time=2024-09-12T19:54:13.509631+0000, chain.objs.size()=1 2024-09-12T18:01:50.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.hnsyum_AsmX2KEeAKr3JGoZa1No3-5L_0 2024-09-12T18:01:50.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14345081621769464254', time=2024-09-12T19:54:13.530789+0000, chain.objs.size()=1 2024-09-12T18:01:50.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2RSHvZjVKIDk2HViVuzjwczicsNZEuQ_0 2024-09-12T18:01:50.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13039723567970971690', time=2024-09-12T19:54:13.532578+0000, chain.objs.size()=1 2024-09-12T18:01:50.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ztceBZ9SDo88WgHjZ_Ls4oT8DFVPLZQ_0 2024-09-12T18:01:50.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17914889369806253453', time=2024-09-12T19:54:13.558462+0000, chain.objs.size()=1 2024-09-12T18:01:50.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.D8N6Lg-bukvBhMR5lBa31fDaMsqcOVS_0 2024-09-12T18:01:50.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2186993059479646028', time=2024-09-12T19:54:13.578577+0000, chain.objs.size()=1 2024-09-12T18:01:50.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.EjsTqXET5YQcFPQRzGtbWbJSTaEFInj_0 2024-09-12T18:01:50.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7181862361947860257', time=2024-09-12T19:54:13.658187+0000, chain.objs.size()=1 2024-09-12T18:01:50.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.XyOTg3zGNC58NS88Xn009fbb7DI34Pu_0 2024-09-12T18:01:50.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8700567614978490644', time=2024-09-12T19:54:13.736011+0000, chain.objs.size()=1 2024-09-12T18:01:50.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.vwr8fq6AsmTtdU08loMxscBOLU45brf_0 2024-09-12T18:01:50.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7290442935523817855', time=2024-09-12T19:54:13.738312+0000, chain.objs.size()=1 2024-09-12T18:01:50.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.3HaazwtUOQmsqMn3hXnOKZ-PL85QTIT_0 2024-09-12T18:01:50.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4205784732970582939', time=2024-09-12T19:54:13.854902+0000, chain.objs.size()=1 2024-09-12T18:01:50.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.F_BRX6cVtnGp9kedMMGqies-5qeSh4j_0 2024-09-12T18:01:50.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7840498736567886549', time=2024-09-12T19:54:13.859651+0000, chain.objs.size()=1 2024-09-12T18:01:50.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.570+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.TDRUUqKT36vaachWTnIpSFtG8ugCPE0_0 2024-09-12T18:01:50.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.572+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12729678950265266272', time=2024-09-12T19:54:13.866322+0000, chain.objs.size()=1 2024-09-12T18:01:50.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.572+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.kBE9RSGXRFqUz1fVqTV12VjKwFlfwnS_0 2024-09-12T18:01:50.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.572+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9159384041750663604', time=2024-09-12T19:54:13.887067+0000, chain.objs.size()=1 2024-09-12T18:01:50.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.572+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.LFiMyPYVz1dTUI5clju6Ut_A98SQzPR_0 2024-09-12T18:01:50.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8420690901100839381', time=2024-09-12T19:54:13.910773+0000, chain.objs.size()=1 2024-09-12T18:01:50.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.mRIvCedrxNg1Qwz1U4tYf978fwJBl3L_0 2024-09-12T18:01:50.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3720800325976863449', time=2024-09-12T19:54:14.006280+0000, chain.objs.size()=1 2024-09-12T18:01:50.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.tTVAc1j_PClo_WRVcWRdQyof4tc8yCE_0 2024-09-12T18:01:50.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8916594027185957516', time=2024-09-12T19:54:14.035356+0000, chain.objs.size()=1 2024-09-12T18:01:50.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.KHPnfevpgc_llUrwSY9I_Ayv-zpny_E_0 2024-09-12T18:01:50.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6552477763167603802', time=2024-09-12T19:54:14.053229+0000, chain.objs.size()=1 2024-09-12T18:01:50.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Vbt5hrDuK7IoWl7R323p5xFA-fDyH7b_0 2024-09-12T18:01:50.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4380997353601182461', time=2024-09-12T19:54:14.064831+0000, chain.objs.size()=1 2024-09-12T18:01:50.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.oJv4WlB35UgiBPyA2obM5bNYbylYrYE_0 2024-09-12T18:01:50.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2643393168134462553', time=2024-09-12T19:54:14.088476+0000, chain.objs.size()=1 2024-09-12T18:01:50.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.86aYgQpuayR4U1shsCKRAINPNcLOAgU_0 2024-09-12T18:01:50.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13823213731283149719', time=2024-09-12T19:54:14.293760+0000, chain.objs.size()=1 2024-09-12T18:01:50.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.9Vh6tCpDTu8zm8-DDrH6U8oSoD5Myls_0 2024-09-12T18:01:50.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16053708492691843602', time=2024-09-12T19:54:14.375433+0000, chain.objs.size()=1 2024-09-12T18:01:50.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.RSAvyAVIHDPrL3LaUHv7N5CxkTIMaha_0 2024-09-12T18:01:50.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3415759959857071943', time=2024-09-12T19:54:14.399599+0000, chain.objs.size()=1 2024-09-12T18:01:50.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.573+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.qaz3YrhNbY2Ei2loJxWUUNPKBPzaC1l_0 2024-09-12T18:01:50.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.574+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15964919160884435021', time=2024-09-12T19:54:14.414585+0000, chain.objs.size()=1 2024-09-12T18:01:50.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.574+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.tVV3FNNwv2xnI7T7xHUQQkwbFAJq6Gl_0 2024-09-12T18:01:50.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.575+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5195581506689333137', time=2024-09-12T19:54:14.429247+0000, chain.objs.size()=1 2024-09-12T18:01:50.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.575+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.x2awpICUshD5FQU_SmP5QYMWHHD9c_t_0 2024-09-12T18:01:50.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18349186665057293666', time=2024-09-12T19:54:14.431932+0000, chain.objs.size()=1 2024-09-12T18:01:50.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.0ylf6VOmozebYV0h4ZlZh4nAJGrMHSo_0 2024-09-12T18:01:50.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9048928165551523373', time=2024-09-12T19:54:14.455791+0000, chain.objs.size()=1 2024-09-12T18:01:50.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.z71UGKzILwn6ALyi-qAdfdz3gnYLsYB_0 2024-09-12T18:01:50.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8718912253196788059', time=2024-09-12T19:54:14.542981+0000, chain.objs.size()=1 2024-09-12T18:01:50.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.v8ElldQatVbzIK1aiXDSKk9RRQrm_kS_0 2024-09-12T18:01:50.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3695077964984333943', time=2024-09-12T19:54:14.575421+0000, chain.objs.size()=1 2024-09-12T18:01:50.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.wutzxjz7XgGq4lg8y6FuU7DwLE3qp5f_0 2024-09-12T18:01:50.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17316221560937351588', time=2024-09-12T19:54:14.585706+0000, chain.objs.size()=1 2024-09-12T18:01:50.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.yd1VAErYXp_cDew0xieeh91h5OxNn6L_0 2024-09-12T18:01:50.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14463333115741022176', time=2024-09-12T19:54:14.596107+0000, chain.objs.size()=1 2024-09-12T18:01:50.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.xvrwx99w2RkD9G-5_0aFmgk0ZiJngKs_0 2024-09-12T18:01:50.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.93778776377715864', time=2024-09-12T19:54:14.710571+0000, chain.objs.size()=1 2024-09-12T18:01:50.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.LWO1ETdRAwu_iwRY-zq8kMjQj9NYW07_0 2024-09-12T18:01:50.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5012864918175387819', time=2024-09-12T19:54:14.711640+0000, chain.objs.size()=1 2024-09-12T18:01:50.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.rYH66NdWp-rQQr6HfZ9QBSJcvKmBJG-_0 2024-09-12T18:01:50.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1662259114888589634', time=2024-09-12T19:54:14.723539+0000, chain.objs.size()=1 2024-09-12T18:01:50.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.x3efykrIGq5JPa6AQJyklQ4hXri_asm_0 2024-09-12T18:01:50.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5774977833324375993', time=2024-09-12T19:54:14.724262+0000, chain.objs.size()=1 2024-09-12T18:01:50.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.7hYbUviuA-hN3qbG1ieae-yChn3rxZ3_0 2024-09-12T18:01:50.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14715532008401035816', time=2024-09-12T19:54:14.731500+0000, chain.objs.size()=1 2024-09-12T18:01:50.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.576+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.e9RMZ0wqWhe0hAv7gWbcLslZnbHja_u_0 2024-09-12T18:01:50.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16070736064587231181', time=2024-09-12T19:54:14.755755+0000, chain.objs.size()=1 2024-09-12T18:01:50.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.TQHMSZ40zizNqUgdLjYsMW9--05ZiIV_0 2024-09-12T18:01:50.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6204781406567211696', time=2024-09-12T19:54:14.768681+0000, chain.objs.size()=1 2024-09-12T18:01:50.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.HvHVW_dXxEmkNqoqFWTPO0bqkgXPibQ_0 2024-09-12T18:01:50.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15203841304446335564', time=2024-09-12T19:54:14.878764+0000, chain.objs.size()=1 2024-09-12T18:01:50.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.8wDBdDLosxOgq-stFWQLxvb3ZReEek4_0 2024-09-12T18:01:50.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14868021334026922412', time=2024-09-12T19:54:14.897609+0000, chain.objs.size()=1 2024-09-12T18:01:50.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.z3BmFT286fLeAbexjdv_1F1HYdyXVpW_0 2024-09-12T18:01:50.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14356011649598248397', time=2024-09-12T19:54:14.912219+0000, chain.objs.size()=1 2024-09-12T18:01:50.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.FaE9_GAfwM_PstmJ6xj4ecb8DWlEChO_0 2024-09-12T18:01:50.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18273529680775850601', time=2024-09-12T19:54:14.913268+0000, chain.objs.size()=1 2024-09-12T18:01:50.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.5ceEjX2YiT2JaEA9laqJ0rQw-o3eEnp_0 2024-09-12T18:01:50.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9235901862326261209', time=2024-09-12T19:54:14.953992+0000, chain.objs.size()=1 2024-09-12T18:01:50.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.MYXl2h32gq3bq4MmIBWLW3Yl-rPqomK_0 2024-09-12T18:01:50.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15744175800439158842', time=2024-09-12T19:54:15.705678+0000, chain.objs.size()=1 2024-09-12T18:01:50.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.267__shadow_.YPCLiofIMMDKgdIS99ozyIZvdUxeI_V_0 2024-09-12T18:01:50.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8468046206693012899', time=2024-09-12T19:54:16.924254+0000, chain.objs.size()=1 2024-09-12T18:01:50.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.273__shadow_.LoKw-UNCsoEgCMdSi_pq3_tBlRLmyMu_0 2024-09-12T18:01:50.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14493354521383173577', time=2024-09-12T19:54:18.397146+0000, chain.objs.size()=1 2024-09-12T18:01:50.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.578+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.280__shadow_.am49Oqko-vbUMhf13dxMpak2Z6pdgyL_0 2024-09-12T18:01:50.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.579+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1456122266540361181', time=2024-09-12T19:54:20.600482+0000, chain.objs.size()=1 2024-09-12T18:01:50.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.579+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.290__shadow_.m6yQVdrefqAzoE260BLPF8AFciSLyty_0 2024-09-12T18:01:50.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.580+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.126594204664414599', time=2024-09-12T19:54:21.577879+0000, chain.objs.size()=1 2024-09-12T18:01:50.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.580+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.i5TNXL3FYfNKomND-HkQDzRZmrCUbID_0 2024-09-12T18:01:50.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.580+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7863509109433173321', time=2024-09-12T19:54:22.832555+0000, chain.objs.size()=1 2024-09-12T18:01:50.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.580+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.297__shadow_.zN426h-OKP64ig9-Pc6cgwp1K2w_LrS_0 2024-09-12T18:01:50.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.580+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8522360021495954766', time=2024-09-12T19:54:23.035432+0000, chain.objs.size()=1 2024-09-12T18:01:50.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.580+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.298__shadow_.nzxZBBMIoZhluXu2H99xKHpedGK4J4h_0 2024-09-12T18:01:50.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.580+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4035365440726404575', time=2024-09-12T19:54:24.581366+0000, chain.objs.size()=1 2024-09-12T18:01:50.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.580+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.305__shadow_.akdt6lPpw_qwOk-so8m26PeoHklh_eg_0 2024-09-12T18:01:50.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.580+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12929630838393451471', time=2024-09-12T19:54:27.636543+0000, chain.objs.size()=1 2024-09-12T18:01:50.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.580+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.320__shadow:r3lINV1oYYhz6S6r53D6r8z-n1EkzhK_.1pP5mNA8wApTV6HV3QHeFEzsZIZfHN3_0 2024-09-12T18:01:50.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.580+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11225381782437310058', time=2024-09-12T19:54:35.786919+0000, chain.objs.size()=1 2024-09-12T18:01:50.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.580+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_._YXLcCYpiKJTFyJMhSxpEAds5K_-qof_0 2024-09-12T18:01:50.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.580+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4447122309226323430', time=2024-09-12T19:54:35.809470+0000, chain.objs.size()=1 2024-09-12T18:01:50.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.580+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.d-h6TnW4an-Gc-cA3AyXXRgKe61oks7_0 2024-09-12T18:01:50.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.581+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10040221755676100413', time=2024-09-12T19:54:36.005124+0000, chain.objs.size()=1 2024-09-12T18:01:50.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.581+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.n_KaXZviVAB7w6d46MdibIRPBZtNF_d_0 2024-09-12T18:01:50.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.581+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2899381731221615594', time=2024-09-12T19:54:36.084994+0000, chain.objs.size()=1 2024-09-12T18:01:50.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.581+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1KxL2r794-amQEnFSlfHeNOGXkUB0tX_0 2024-09-12T18:01:50.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.581+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17246279120459203962', time=2024-09-12T19:54:36.098110+0000, chain.objs.size()=1 2024-09-12T18:01:50.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.581+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.n5bYeapz9ROFwLAmaCyXCZdEQ2JmX33_0 2024-09-12T18:01:50.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.581+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3197249978408062488', time=2024-09-12T19:54:36.130591+0000, chain.objs.size()=1 2024-09-12T18:01:50.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.581+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.6M7i5OhS2fJgiW4UqUD-Gl8NCR-iIRn_0 2024-09-12T18:01:50.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.581+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12243328617018330290', time=2024-09-12T19:54:36.147836+0000, chain.objs.size()=1 2024-09-12T18:01:50.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.581+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4IRQJb2D8J-FBH00-hTZA24G8Z8MbD8_0 2024-09-12T18:01:50.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.581+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4537491855619667914', time=2024-09-12T19:54:36.310801+0000, chain.objs.size()=1 2024-09-12T18:01:50.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.581+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.3hyn0A9L6VDLKO2mAOZpLA_JwSxSrL0_0 2024-09-12T18:01:50.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.581+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13881843414254279090', time=2024-09-12T19:54:36.314009+0000, chain.objs.size()=1 2024-09-12T18:01:50.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.581+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.K6mlm0UMsHOOZc8wLCsRhNlAV_A-Oe8_0 2024-09-12T18:01:50.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.582+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12646904114386925905', time=2024-09-12T19:54:36.415372+0000, chain.objs.size()=1 2024-09-12T18:01:50.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.582+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.tkGQibW7nPgpiyu552LuYjNAzJw6p2o_0 2024-09-12T18:01:50.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.582+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9656359880819646971', time=2024-09-12T19:54:36.421001+0000, chain.objs.size()=1 2024-09-12T18:01:50.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.582+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.EVjPfhKjZDzYcdn5db8oGq7EtzE32Yy_0 2024-09-12T18:01:50.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.583+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11991258462715473094', time=2024-09-12T19:54:36.441323+0000, chain.objs.size()=1 2024-09-12T18:01:50.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.583+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.T2VHEFzl7jtKMmdJj0-hagtM7sM03hL_0 2024-09-12T18:01:50.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.583+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5308324528853581853', time=2024-09-12T19:54:36.473864+0000, chain.objs.size()=1 2024-09-12T18:01:50.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.583+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.zOqiHUzx0Pqn-Fi4SdshUHn6avfMEBF_0 2024-09-12T18:01:50.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.583+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1463743374130950380', time=2024-09-12T19:54:36.503894+0000, chain.objs.size()=1 2024-09-12T18:01:50.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.583+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.SDNKwPhX1ZG7mDjpyG5xLoJ4Igx8T-k_0 2024-09-12T18:01:50.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.584+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14374776169252633631', time=2024-09-12T19:54:36.587851+0000, chain.objs.size()=1 2024-09-12T18:01:50.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.584+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.bTcF9_46CFHxNnerxzfUyp0N-tB7xK7_0 2024-09-12T18:01:50.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.584+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4857149136328701479', time=2024-09-12T19:54:36.611970+0000, chain.objs.size()=1 2024-09-12T18:01:50.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.584+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.t25HXmNM7HEJBnwCfpK1gi5YMImdbB8_0 2024-09-12T18:01:50.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.584+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1939380379524830349', time=2024-09-12T19:54:36.636163+0000, chain.objs.size()=1 2024-09-12T18:01:50.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.584+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.djb8lp9almrPtAjlwMk9_8Q3XA3DyuE_0 2024-09-12T18:01:50.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.584+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14071537498030514536', time=2024-09-12T19:54:36.637267+0000, chain.objs.size()=1 2024-09-12T18:01:50.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.584+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.JAU6o3zhv5dxf0n1A8qKh902cfu1p9M_0 2024-09-12T18:01:50.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.584+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.524375702860471034', time=2024-09-12T19:54:36.648812+0000, chain.objs.size()=1 2024-09-12T18:01:50.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.584+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.CMVASimo3kp_l9VcDlgGc8_pCmVwva7_0 2024-09-12T18:01:50.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.584+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16978902880016712048', time=2024-09-12T19:54:36.778107+0000, chain.objs.size()=1 2024-09-12T18:01:50.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.584+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QQJr4cGOaNiZbAsd7BNxvn_4bmnPHzI_0 2024-09-12T18:01:50.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.584+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10870131990280620495', time=2024-09-12T19:54:36.805485+0000, chain.objs.size()=1 2024-09-12T18:01:50.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.584+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.cYjRbMdif3d8fYS-m8VfKOrQtMaW43l_0 2024-09-12T18:01:50.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.585+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14206515890211518248', time=2024-09-12T19:54:36.824387+0000, chain.objs.size()=1 2024-09-12T18:01:50.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.585+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.MepR1mrTbMe-rif4bDNeF33g_wW6syl_0 2024-09-12T18:01:50.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.585+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9498602549749709456', time=2024-09-12T19:54:36.832785+0000, chain.objs.size()=1 2024-09-12T18:01:50.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.585+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.8Vc63ROPQOwS2zyv3mZZVmD-xPZsUF9_0 2024-09-12T18:01:50.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.585+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9107493702684088021', time=2024-09-12T19:54:36.904564+0000, chain.objs.size()=1 2024-09-12T18:01:50.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.585+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.GrdedXNAt9Y0ZZbf9_wL4QelNighvAU_0 2024-09-12T18:01:50.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.585+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3234457124578915074', time=2024-09-12T19:54:36.971800+0000, chain.objs.size()=1 2024-09-12T18:01:50.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.585+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.aSzANgG4780BqmfFdrgFvNuCPBWRpKt_0 2024-09-12T18:01:50.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.585+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17590244233677281438', time=2024-09-12T19:54:44.470697+0000, chain.objs.size()=1 2024-09-12T18:01:50.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.585+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.52Jv5j3Sjr5XpCQuNP65q_d7vtxJ9dB_0 2024-09-12T18:01:50.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.585+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.481097650218617218', time=2024-09-12T19:54:44.473647+0000, chain.objs.size()=1 2024-09-12T18:01:50.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.585+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.UacAABx60aQRlMculAuSY_RFdQ53g2P_0 2024-09-12T18:01:50.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.586+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4591220968326737406', time=2024-09-12T19:54:44.480913+0000, chain.objs.size()=1 2024-09-12T18:01:50.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.586+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.OSZpa0s7_-RPKaJuPu1eZxqb7c6RBq2_0 2024-09-12T18:01:50.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.587+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5176406432193327463', time=2024-09-12T19:54:44.496502+0000, chain.objs.size()=1 2024-09-12T18:01:50.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.587+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.mBdEfeGLuRBJYGe3dDHgL2_tCTBiSvF_0 2024-09-12T18:01:50.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.587+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12720632166516356762', time=2024-09-12T19:54:44.502683+0000, chain.objs.size()=1 2024-09-12T18:01:50.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.587+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.8jG6y3nbloDLxfAjrVNggW-UvPpGFBG_0 2024-09-12T18:01:50.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.587+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1310907126249366187', time=2024-09-12T19:54:44.516044+0000, chain.objs.size()=1 2024-09-12T18:01:50.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.587+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.agv80wHTq-9KIOplDhrHgyJAlZ6yo4v_0 2024-09-12T18:01:50.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.587+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5399197868115748290', time=2024-09-12T19:54:44.519444+0000, chain.objs.size()=1 2024-09-12T18:01:50.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.587+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.gOhXQVVfx3PlgSDyp4b2-vENJ2_2Cko_0 2024-09-12T18:01:50.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.587+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4478948497871781850', time=2024-09-12T19:54:44.522355+0000, chain.objs.size()=1 2024-09-12T18:01:50.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.587+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_._IuaYj8W2Z3_koDfSrKq3Tq2oGEUfs0_0 2024-09-12T18:01:50.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.587+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1841887376558406233', time=2024-09-12T19:54:44.630729+0000, chain.objs.size()=1 2024-09-12T18:01:50.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.587+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-ROsuzUkHxsm7WHJZr9uGzTcIvfHG8e_0 2024-09-12T18:01:50.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.588+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.40600181854307893', time=2024-09-12T19:54:44.633755+0000, chain.objs.size()=1 2024-09-12T18:01:50.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.588+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.MpOt-Ilis4fztbB59dqtifdv22yscvw_0 2024-09-12T18:01:50.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.588+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2915773907125437280', time=2024-09-12T19:54:44.664708+0000, chain.objs.size()=1 2024-09-12T18:01:50.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.588+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.PtliKVLR07CgqTTk8awSkDNEMfcKoFO_0 2024-09-12T18:01:50.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.588+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.966487790915456969', time=2024-09-12T19:54:44.667458+0000, chain.objs.size()=1 2024-09-12T18:01:50.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.588+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.KjVi5WBVHivpFNvmpJhM6LxoHsNI0B1_0 2024-09-12T18:01:50.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.588+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16303360026756858747', time=2024-09-12T19:54:44.686988+0000, chain.objs.size()=1 2024-09-12T18:01:50.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.588+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.GHZdcCYfPfwkmNZpSrA62DWMX-BmH1D_0 2024-09-12T18:01:50.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.588+0000 7f7beb922640 0 -- 172.21.15.44:0/3019346837 >> [v2:172.21.15.44:6824/2872503546,v1:172.21.15.44:6825/2872503546] conn(0x5645a58d8b50 msgr2=0x7f7ab4091990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:50.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.590+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/46832 2024-09-12T18:01:50.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T18:01:50.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4884944213218573355', time=2024-09-12T19:54:44.797070+0000, chain.objs.size()=1 2024-09-12T18:01:50.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.lx7BBlN5LLOD49WbxlhKhO4-unFtqhv_0 2024-09-12T18:01:50.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10778521583765441333', time=2024-09-12T19:54:44.802447+0000, chain.objs.size()=1 2024-09-12T18:01:50.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Wf4KE3beCyjP2tYISLxYeBfcJvK81Xg_0 2024-09-12T18:01:50.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4445263252444050936', time=2024-09-12T19:54:44.851493+0000, chain.objs.size()=1 2024-09-12T18:01:50.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Jo6vLMptTtpxg03Kn3VUybIT4RxiEtm_0 2024-09-12T18:01:50.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14127713612341412927', time=2024-09-12T19:54:44.867073+0000, chain.objs.size()=1 2024-09-12T18:01:50.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.nR2ZSmEiseLNcV-30tC-1OH6T-qVaPb_0 2024-09-12T18:01:50.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3057436143209253835', time=2024-09-12T19:54:44.885983+0000, chain.objs.size()=1 2024-09-12T18:01:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.yg6gpb0HXjQgO8K8Dq5Jl2Sgs89KqrS_0 2024-09-12T18:01:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13495478861697235464', time=2024-09-12T19:54:44.981376+0000, chain.objs.size()=1 2024-09-12T18:01:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.0YN8U9m0ZsrG72R9qfn1wk4owUDwQBv_0 2024-09-12T18:01:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6400917880032826930', time=2024-09-12T19:54:44.982830+0000, chain.objs.size()=1 2024-09-12T18:01:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.eOWAMZpud2qTXS8EW0nQJyIHCHTNY7r_0 2024-09-12T18:01:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10372116179019711948', time=2024-09-12T19:54:45.004413+0000, chain.objs.size()=1 2024-09-12T18:01:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.X5MKyxstbMutgtVPn1W1JEc0lh3oEym_0 2024-09-12T18:01:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5921056382615051414', time=2024-09-12T19:54:45.005775+0000, chain.objs.size()=1 2024-09-12T18:01:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.4R1cebClhpGa3b8dQ-zC0AvsEahUdtx_0 2024-09-12T18:01:50.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4649135179309392614', time=2024-09-12T19:54:45.008078+0000, chain.objs.size()=1 2024-09-12T18:01:50.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.2Ss8X6B_qMCr-Ge8tLd19coYRro3rae_0 2024-09-12T18:01:50.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9369379319195569225', time=2024-09-12T19:54:45.202279+0000, chain.objs.size()=1 2024-09-12T18:01:50.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Ug1gpZv4eNgOW2MtE6CIWwx40pO1X0R_0 2024-09-12T18:01:50.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.991203775213131220', time=2024-09-12T19:54:45.226099+0000, chain.objs.size()=1 2024-09-12T18:01:50.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.592+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.il82z3-HrilVtMswXoJ6fJXbOfDx69T_0 2024-09-12T18:01:50.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.594+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16441011988282001023', time=2024-09-12T19:54:45.234192+0000, chain.objs.size()=1 2024-09-12T18:01:50.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.594+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.poth9sjPcVxj9Y2vXTHgyVnttMchJ_9_0 2024-09-12T18:01:50.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2691595780767919904', time=2024-09-12T19:54:45.350887+0000, chain.objs.size()=1 2024-09-12T18:01:50.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.DMg9vSEY525uTgYHwi-3n7oftxvDgtv_0 2024-09-12T18:01:50.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2067708789590164122', time=2024-09-12T19:54:45.360161+0000, chain.objs.size()=1 2024-09-12T18:01:50.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.sqwAZIvaFDd04EKebwiaJnEQ9nLDwec_0 2024-09-12T18:01:50.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14049837497729225599', time=2024-09-12T19:54:45.377216+0000, chain.objs.size()=1 2024-09-12T18:01:50.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Hf0idAMq1jC3vh2nw6ZQyhyTkSD8Gvq_0 2024-09-12T18:01:50.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7479735765282894804', time=2024-09-12T19:54:45.383685+0000, chain.objs.size()=1 2024-09-12T18:01:50.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.eqXJCtHBFc-fw7UMJHzQ234UkiSvrIi_0 2024-09-12T18:01:50.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3623391008955592290', time=2024-09-12T19:54:45.397004+0000, chain.objs.size()=1 2024-09-12T18:01:50.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.PYnfGkMeP8uB-JFe927uzj5Ye-Dqh09_0 2024-09-12T18:01:50.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16345711332020654548', time=2024-09-12T19:54:45.407178+0000, chain.objs.size()=1 2024-09-12T18:01:50.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.i2AllFpauqhWgKCaouv9Nq8KTXyMQ2G_0 2024-09-12T18:01:50.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16021385022398953531', time=2024-09-12T19:54:45.411107+0000, chain.objs.size()=1 2024-09-12T18:01:50.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.n_UZ0g6OrxMVns1u5EDcmAikh47wnfk_0 2024-09-12T18:01:50.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.692797334348122572', time=2024-09-12T19:54:45.511937+0000, chain.objs.size()=1 2024-09-12T18:01:50.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TgNOFnjY5gKOSMp7wZKBv_ceGkv4M9__0 2024-09-12T18:01:50.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6715500028755978058', time=2024-09-12T19:54:45.560060+0000, chain.objs.size()=1 2024-09-12T18:01:50.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.LKf7Mf_Oe0Gg7m7jcD5G9sUP5_A0VFx_0 2024-09-12T18:01:50.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7345146285433946198', time=2024-09-12T19:54:45.744183+0000, chain.objs.size()=1 2024-09-12T18:01:50.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.pLQGz11an-KICzt05xaYzLnLeZhLZzg_0 2024-09-12T18:01:50.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5793701709385187749', time=2024-09-12T19:54:48.295198+0000, chain.objs.size()=1 2024-09-12T18:01:50.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.600+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.338__shadow_.W57Gip7aRY1TyO1vuvVEDU18_97FxvN_0 2024-09-12T18:01:50.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.602+0000 7f7beb922640 0 -- 172.21.15.44:0/3019346837 >> [v2:172.21.15.44:6808/1676130713,v1:172.21.15.44:6809/1676130713] conn(0x7f7be40c2c50 msgr2=0x7f7be40c16c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:50.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.602+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5320298377195119759', time=2024-09-12T19:54:57.623513+0000, chain.objs.size()=1 2024-09-12T18:01:50.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.602+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.384__shadow_.LqoeQRLVu0nYSKdbIYmLeDAV2SvxLcf_0 2024-09-12T18:01:50.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.602+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11470586429331500170', time=2024-09-12T19:55:20.954626+0000, chain.objs.size()=1 2024-09-12T18:01:50.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.602+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.484__shadow_.DwaW_-NUUTGzJ_KdrkVGrUJGIzEJWzK_0 2024-09-12T18:01:50.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.602+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6906535417692736351', time=2024-09-12T19:55:21.170050+0000, chain.objs.size()=1 2024-09-12T18:01:50.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.602+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.485__shadow_.vWtMCAEM-8XA9Wdbid8oFmTDwflNveA_0 2024-09-12T18:01:50.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.605+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.842874074212440047', time=2024-09-12T19:55:24.909488+0000, chain.objs.size()=1 2024-09-12T18:01:50.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.605+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.500__shadow_.CkWWF2PkBdbvbmLDPG6ZasFk0SUD3Ag_0 2024-09-12T18:01:50.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.605+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~pT3Ra-up7LH8f5dxonGCTN_8LjvJoKE', time=2024-09-12T19:55:43.538663+0000, chain.objs.size()=1 2024-09-12T18:01:50.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.605+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.536__multipart_mymultipart.2~pT3Ra-up7LH8f5dxonGCTN_8LjvJoKE.3 2024-09-12T18:01:50.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.605+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1514362027854188923', time=2024-09-12T19:56:37.004446+0000, chain.objs.size()=1 2024-09-12T18:01:50.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.605+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:j0RG6ajYwFGGvuMcqw5U7qwb03ot4H9_.3o3PkRWocFidleSOiVPa_IkiC-pvQuf_0 2024-09-12T18:01:50.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.605+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13729437652166019629', time=2024-09-12T19:56:41.948138+0000, chain.objs.size()=1 2024-09-12T18:01:50.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.605+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:IgzQBZ1nzNCB9BzPLtGmpx.A3VJriJe_.1YsBBgMz0lIj9Z1HbLWy2xqI6r01OC2_0 2024-09-12T18:01:50.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.605+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12965755221278335592', time=2024-09-12T19:57:01.513535+0000, chain.objs.size()=1 2024-09-12T18:01:50.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.605+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.617__shadow_.cOFmlnmNi-TTebmPuKVINQv1aLcxup8_0 2024-09-12T18:01:50.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.605+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13240828711087495079', time=2024-09-12T19:59:09.680725+0000, chain.objs.size()=1 2024-09-12T18:01:50.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.605+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.642__shadow_.Pjiq6pR1j2sOzEigKbyKZB6hm7B_MA4_0 2024-09-12T18:01:50.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.605+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8290866965277451019', time=2024-09-12T19:59:17.159381+0000, chain.objs.size()=1 2024-09-12T18:01:50.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.605+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.664__shadow_.EvsJJiMbprJAil1Xrc-4bf-HwOWVhLZ_0 2024-09-12T18:01:50.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.605+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15086483945910939593', time=2024-09-12T19:59:23.662190+0000, chain.objs.size()=1 2024-09-12T18:01:50.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.605+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.695__shadow:U360jmdpimDkB4WcuaoH.b-Dct0bGaY_._6SZaDNDOHxqLL_UR9uLjwlig-XVtmy_0 2024-09-12T18:01:50.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.607+0000 7f7beb121640 0 -- 172.21.15.44:0/3019346837 >> [v2:172.21.15.181:6818/2591499742,v1:172.21.15.181:6819/2591499742] conn(0x7f7ab4086ff0 msgr2=0x7f7ab4089420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:50.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.610+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.613+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:01:50.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.614+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.614+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47278' 2024-09-12T18:01:50.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14389313851812645448', time=2024-09-12T19:52:54.063324+0000, chain.objs.size()=2 2024-09-12T18:01:50.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.159__shadow_.d5voKboYprB-DwsYJtxpAj7ThKzWbPt_0 2024-09-12T18:01:50.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.159__shadow_.d5voKboYprB-DwsYJtxpAj7ThKzWbPt_1 2024-09-12T18:01:50.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13298243299647208059', time=2024-09-12T19:52:57.255064+0000, chain.objs.size()=3 2024-09-12T18:01:50.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__multipart_foo-FROZEN.2~vMJq-PMyM7gIXVsAMQh8Cp5MGvchY4Q.1 2024-09-12T18:01:50.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__multipart_foo-FROZEN.2~vMJq-PMyM7gIXVsAMQh8Cp5MGvchY4Q.2 2024-09-12T18:01:50.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__multipart_foo-FROZEN.2~vMJq-PMyM7gIXVsAMQh8Cp5MGvchY4Q.3 2024-09-12T18:01:50.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2405244763196656820', time=2024-09-12T19:54:03.007188+0000, chain.objs.size()=1 2024-09-12T18:01:50.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.247__shadow_.LrKLK9glI2oeknxWfHlRZbC9WR3WI0Y_0 2024-09-12T18:01:50.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7886554441458334480', time=2024-09-12T19:54:13.486391+0000, chain.objs.size()=1 2024-09-12T18:01:50.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.5RD0oQcsXZlGKPkYonY4IOALMaxtJGD_0 2024-09-12T18:01:50.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7512299966081582075', time=2024-09-12T19:54:13.513923+0000, chain.objs.size()=1 2024-09-12T18:01:50.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.NwiCpOSbMkiWevcdZgVQq3YV-Y5mT5b_0 2024-09-12T18:01:50.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7229747264774282170', time=2024-09-12T19:54:13.534427+0000, chain.objs.size()=1 2024-09-12T18:01:50.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.LAlamtxYO3yXx6cu-dC54RniMJ7An7e_0 2024-09-12T18:01:50.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4950464617401154870', time=2024-09-12T19:54:13.543778+0000, chain.objs.size()=1 2024-09-12T18:01:50.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.uK8haUBXGglNhCHZdbYouETlj-l7gBQ_0 2024-09-12T18:01:50.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14242402501846246209', time=2024-09-12T19:54:13.688358+0000, chain.objs.size()=1 2024-09-12T18:01:50.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.sVbUdODdjD0zXSXgvoHCkLdXx-RL8Uw_0 2024-09-12T18:01:50.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14976713470251413360', time=2024-09-12T19:54:13.732618+0000, chain.objs.size()=1 2024-09-12T18:01:50.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.615+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2coVRo7OXHx61DU_sBSCIhwSVfvNMDV_0 2024-09-12T18:01:50.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.622+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3083164162865476996', time=2024-09-12T19:54:13.854237+0000, chain.objs.size()=1 2024-09-12T18:01:50.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.622+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_._s2XqcxMq4e_L_ONBreQYOfCiKdBcni_0 2024-09-12T18:01:50.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13956075250662513282', time=2024-09-12T19:54:13.898977+0000, chain.objs.size()=1 2024-09-12T18:01:50.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.wWv-gx6Cenk-EcDh4c-FNhSKdrOQxfA_0 2024-09-12T18:01:50.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9780398188427261947', time=2024-09-12T19:54:13.904266+0000, chain.objs.size()=1 2024-09-12T18:01:50.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.kGv3CClnt-SjDBku7guxzdgUGcvOSfF_0 2024-09-12T18:01:50.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7794816389663712645', time=2024-09-12T19:54:13.913536+0000, chain.objs.size()=1 2024-09-12T18:01:50.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.l5Y8YNts6eeKPsxis44b5wGMUNKFjmh_0 2024-09-12T18:01:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4418483586783423280', time=2024-09-12T19:54:13.922453+0000, chain.objs.size()=1 2024-09-12T18:01:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.t7YZ4vFexJVYt2gfLHWSUVx6ppS96FK_0 2024-09-12T18:01:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14002470346524570139', time=2024-09-12T19:54:13.923130+0000, chain.objs.size()=1 2024-09-12T18:01:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.u16Ps8Gnr5ijkxmXGMqVmaKgydz25cc_0 2024-09-12T18:01:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2071464306170099011', time=2024-09-12T19:54:14.005645+0000, chain.objs.size()=1 2024-09-12T18:01:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Ut9D2DXAjXx3rr_JOtyqv4TQA1Syyye_0 2024-09-12T18:01:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6795107524805988865', time=2024-09-12T19:54:14.014091+0000, chain.objs.size()=1 2024-09-12T18:01:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.A8zmW8M8O39nUgGXW5kT7QR9gOJqZcs_0 2024-09-12T18:01:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7593019667648771977', time=2024-09-12T19:54:14.037623+0000, chain.objs.size()=1 2024-09-12T18:01:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-V4VoELnINzKSl4dc1i1g_M7VaVD_QO_0 2024-09-12T18:01:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16207082060219305178', time=2024-09-12T19:54:14.094279+0000, chain.objs.size()=1 2024-09-12T18:01:50.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.En3xfyPEeZoBvXwqxa9ocZQy4QAuB6M_0 2024-09-12T18:01:50.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11401819352358871175', time=2024-09-12T19:54:14.457523+0000, chain.objs.size()=1 2024-09-12T18:01:50.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.177r8agFLWzpuCHNtdxd2F8eS2mkKoe_0 2024-09-12T18:01:50.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11690983056501118616', time=2024-09-12T19:54:14.578657+0000, chain.objs.size()=1 2024-09-12T18:01:50.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.624+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.BcArhSzUyRiu2je3gRbDDEiAyF_4CXk_0 2024-09-12T18:01:50.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16584575065064404093', time=2024-09-12T19:54:14.625155+0000, chain.objs.size()=1 2024-09-12T18:01:50.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.cthfpdTOQ9d5VN2d_zKO9y6mU5VV7R3_0 2024-09-12T18:01:50.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9594971484406452105', time=2024-09-12T19:54:14.633886+0000, chain.objs.size()=1 2024-09-12T18:01:50.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.RVdTHRFap-1IaVg_2b4lEUqVO4PSUY6_0 2024-09-12T18:01:50.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.429457503544834753', time=2024-09-12T19:54:14.711867+0000, chain.objs.size()=1 2024-09-12T18:01:50.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.gIeS5KM1_1hvLpJwfr0E_SCRJP_j2qZ_0 2024-09-12T18:01:50.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15533026733278335847', time=2024-09-12T19:54:14.768473+0000, chain.objs.size()=1 2024-09-12T18:01:50.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.XjP728NdILyhGZHZEBYE5--iLS2bvoe_0 2024-09-12T18:01:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2023313695260111055', time=2024-09-12T19:54:14.780493+0000, chain.objs.size()=1 2024-09-12T18:01:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.PFtb1SylZUKjxAK6jwTFVWDRqrQYXMX_0 2024-09-12T18:01:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9719159726200677829', time=2024-09-12T19:54:14.781190+0000, chain.objs.size()=1 2024-09-12T18:01:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-rHgW6qk19YDXS42o_pvKrhacf9DKAa_0 2024-09-12T18:01:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7218091237909803258', time=2024-09-12T19:54:14.790433+0000, chain.objs.size()=1 2024-09-12T18:01:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.h8fvXOOH-aCxRZGTt2BYkmjycIR2FgY_0 2024-09-12T18:01:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8804375504089881773', time=2024-09-12T19:54:14.794041+0000, chain.objs.size()=1 2024-09-12T18:01:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Uz3Ob0ajfGbPObot2JHpQSF3qys6ALA_0 2024-09-12T18:01:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6660579661040054541', time=2024-09-12T19:54:14.887294+0000, chain.objs.size()=1 2024-09-12T18:01:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2wEIbn0hCvk6zlzAFzN_YinYkIP4VRL_0 2024-09-12T18:01:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17835752126962972839', time=2024-09-12T19:54:14.890236+0000, chain.objs.size()=1 2024-09-12T18:01:50.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.nRJou5ns1LnNQ0dHYxYe9tKdGOygr5h_0 2024-09-12T18:01:50.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3371572868125912356', time=2024-09-12T19:54:14.913283+0000, chain.objs.size()=1 2024-09-12T18:01:50.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.630+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.3_IyCKqvOfb390ZpzhxyggPytx0WASo_0 2024-09-12T18:01:50.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13724317261608090218', time=2024-09-12T19:54:14.915413+0000, chain.objs.size()=1 2024-09-12T18:01:50.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.xRUE6FeYJ5-zAvadNRYLRQ6sMz_zYyY_0 2024-09-12T18:01:50.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14901477125473734829', time=2024-09-12T19:54:14.916369+0000, chain.objs.size()=1 2024-09-12T18:01:50.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.slN2bd8sroQbatIwbbzflYDHqXT00FN_0 2024-09-12T18:01:50.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.572900659606924591', time=2024-09-12T19:54:14.946790+0000, chain.objs.size()=1 2024-09-12T18:01:50.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.bmVrKLcWsgZFsE_TCbM4q9u1HjzaNv9_0 2024-09-12T18:01:50.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1894906547090668037', time=2024-09-12T19:54:16.532787+0000, chain.objs.size()=1 2024-09-12T18:01:50.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.271__shadow_.QoJkLaOrRoVrCFDgkqOLLrdjwUOcKwX_0 2024-09-12T18:01:50.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9499895987125118127', time=2024-09-12T19:54:17.121008+0000, chain.objs.size()=1 2024-09-12T18:01:50.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.274__shadow_.OB3iPWLVCIP2NLLs4BsBhgKaL4KaJZP_0 2024-09-12T18:01:50.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.813784202726856398', time=2024-09-12T19:54:20.803823+0000, chain.objs.size()=1 2024-09-12T18:01:50.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.291__shadow_.DBN-ob6NO1NH4ZFKdAra4AsQ3c6jzRd_0 2024-09-12T18:01:50.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1036995560887890457', time=2024-09-12T19:54:21.580762+0000, chain.objs.size()=1 2024-09-12T18:01:50.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.ocMW__aLflyB7rQjnc-xFtTmcxc3p2o_0 2024-09-12T18:01:50.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8575287090028788306', time=2024-09-12T19:54:27.637113+0000, chain.objs.size()=1 2024-09-12T18:01:50.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.320__shadow:6OQqPMUI8y-12ZCRB4XuKzeofQbI0Ni_.PwRSI87cePPUwt471ba8AGW9iCVpLgs_0 2024-09-12T18:01:50.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2262359991612387842', time=2024-09-12T19:54:35.752153+0000, chain.objs.size()=1 2024-09-12T18:01:50.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.eATgzSxfzV1Blyo9XqtuW_A_hb9gFTf_0 2024-09-12T18:01:50.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11977462108049389560', time=2024-09-12T19:54:35.976386+0000, chain.objs.size()=1 2024-09-12T18:01:50.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.GIyWkiT1Hjd4PyRsPIFB0-1lXesiRNR_0 2024-09-12T18:01:50.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14559827795139306593', time=2024-09-12T19:54:35.980136+0000, chain.objs.size()=1 2024-09-12T18:01:50.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.635+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.jETOCVQ221SUbRlukWcwbkm-yHywjpf_0 2024-09-12T18:01:50.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.637+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9233081253626105735', time=2024-09-12T19:54:35.980959+0000, chain.objs.size()=1 2024-09-12T18:01:50.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.637+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.CQDr98HT-wO4i6dDBp7yJpqHKzDnS3t_0 2024-09-12T18:01:50.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8038585022332418510', time=2024-09-12T19:54:36.144429+0000, chain.objs.size()=1 2024-09-12T18:01:50.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.265hYWzK5kC3RSmNblwKObVnYCk9MZZ_0 2024-09-12T18:01:50.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7565147407445102022', time=2024-09-12T19:54:36.153244+0000, chain.objs.size()=1 2024-09-12T18:01:50.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.W7EEtOD2FULFsXq3N1QMjiBAAQ_NwsQ_0 2024-09-12T18:01:50.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10660091271726163007', time=2024-09-12T19:54:36.255051+0000, chain.objs.size()=1 2024-09-12T18:01:50.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.r18RVQrDFnhlyrqIVNyF84VybaTLpiC_0 2024-09-12T18:01:50.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4871428148164131734', time=2024-09-12T19:54:36.264797+0000, chain.objs.size()=1 2024-09-12T18:01:50.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.nqOKzxyaf1fhnZEICjDA3z1fx6YIDH7_0 2024-09-12T18:01:50.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12482750586362352632', time=2024-09-12T19:54:36.279311+0000, chain.objs.size()=1 2024-09-12T18:01:50.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.RvLmvkjty0Tb4dhbXsC62EU9B2RHcWr_0 2024-09-12T18:01:50.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14281993981262708248', time=2024-09-12T19:54:36.291109+0000, chain.objs.size()=1 2024-09-12T18:01:50.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0ZEQ4lnALmPTrwLspTEw_wo-x7CHMyY_0 2024-09-12T18:01:50.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11553814600408001996', time=2024-09-12T19:54:36.319847+0000, chain.objs.size()=1 2024-09-12T18:01:50.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.uwEPLoy2cRrH8uoQTjB-ptCLPTsdtL5_0 2024-09-12T18:01:50.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16592710234870964685', time=2024-09-12T19:54:36.418841+0000, chain.objs.size()=1 2024-09-12T18:01:50.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.J2nwtvv_3OhVecRV2x5rtMV49deaeO5_0 2024-09-12T18:01:50.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15163946157728300254', time=2024-09-12T19:54:36.459191+0000, chain.objs.size()=1 2024-09-12T18:01:50.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.U2PyxpGOMQIZICrHX7MxGXJ2r6z03PI_0 2024-09-12T18:01:50.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.803703811977364399', time=2024-09-12T19:54:36.473846+0000, chain.objs.size()=1 2024-09-12T18:01:50.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.eiHIAXb5Sf-TW3xBtw6wVWNEizGGTit_0 2024-09-12T18:01:50.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13453222795931029760', time=2024-09-12T19:54:36.478644+0000, chain.objs.size()=1 2024-09-12T18:01:50.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.641+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.XVSx25ITbL4Ttsik6JD3L5bURJmO24X_0 2024-09-12T18:01:50.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.642+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3570742902879120709', time=2024-09-12T19:54:36.479900+0000, chain.objs.size()=1 2024-09-12T18:01:50.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.642+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.KCzGq07vcPmpThsMUE8n6qCz2aiE2pf_0 2024-09-12T18:01:50.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.642+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4204409168735333383', time=2024-09-12T19:54:36.482287+0000, chain.objs.size()=1 2024-09-12T18:01:50.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.642+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.8nY8cxNf95zxvrTelfjCz0yQHfVyATQ_0 2024-09-12T18:01:50.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8874088170609560211', time=2024-09-12T19:54:36.483066+0000, chain.objs.size()=1 2024-09-12T18:01:50.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.5yECJR2m8PRCqQya52mtfs50GrkskwI_0 2024-09-12T18:01:50.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2357163611041337502', time=2024-09-12T19:54:36.486960+0000, chain.objs.size()=1 2024-09-12T18:01:50.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.OVVBhX1QmvoPCmcn_QMOliTe2mNQDsy_0 2024-09-12T18:01:50.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13802327756061124021', time=2024-09-12T19:54:36.579522+0000, chain.objs.size()=1 2024-09-12T18:01:50.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.f0IFGcz7GuZ5WWSlsh3pnNXE_dOMeRz_0 2024-09-12T18:01:50.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.631333930039088516', time=2024-09-12T19:54:36.591923+0000, chain.objs.size()=1 2024-09-12T18:01:50.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.J9t5KEi0TTrncTeVNAKypIZ6o_y8Twa_0 2024-09-12T18:01:50.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11252363843573131605', time=2024-09-12T19:54:36.593194+0000, chain.objs.size()=1 2024-09-12T18:01:50.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.EZCwXxgn5DdyMWSNxv-5MOZGk0naw-I_0 2024-09-12T18:01:50.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4258963963154124998', time=2024-09-12T19:54:36.623856+0000, chain.objs.size()=1 2024-09-12T18:01:50.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.JXZj7o6OzICtQA_dWa4MuAlrkFNI5SM_0 2024-09-12T18:01:50.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8825425453856513545', time=2024-09-12T19:54:36.641164+0000, chain.objs.size()=1 2024-09-12T18:01:50.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.pyO4jQp2VFPgecW5GiY18WglI4w16fS_0 2024-09-12T18:01:50.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4250147773708874528', time=2024-09-12T19:54:36.651410+0000, chain.objs.size()=1 2024-09-12T18:01:50.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.LWxvXhjZhV8PauwrepeksfineEkrO5L_0 2024-09-12T18:01:50.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4603689158387570000', time=2024-09-12T19:54:36.662376+0000, chain.objs.size()=1 2024-09-12T18:01:50.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Gc-lrie1BZ6uR6-tIzUnuyUqhsMXuKa_0 2024-09-12T18:01:50.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2963033584522421902', time=2024-09-12T19:54:36.745650+0000, chain.objs.size()=1 2024-09-12T18:01:50.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.JbEE92zbq_v-rHwW30B0-3kfkR7sNz7_0 2024-09-12T18:01:50.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3788452871689322750', time=2024-09-12T19:54:36.753861+0000, chain.objs.size()=1 2024-09-12T18:01:50.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.646+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.c-LFdp8p8h3eIqQexl_vPmDQGnnwtbR_0 2024-09-12T18:01:50.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.648+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9991720960457243559', time=2024-09-12T19:54:36.775438+0000, chain.objs.size()=1 2024-09-12T18:01:50.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.648+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.As6deQjy0VQAZONCos6DUtSboMHuvSc_0 2024-09-12T18:01:50.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.648+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2766334008520490567', time=2024-09-12T19:54:36.823290+0000, chain.objs.size()=1 2024-09-12T18:01:50.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.648+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0NM4-Tkhuy3trj-oFXTMPpoAEFwWfqu_0 2024-09-12T18:01:50.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12902824910949784078', time=2024-09-12T19:54:36.924893+0000, chain.objs.size()=1 2024-09-12T18:01:50.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.pMOLjJ3NhZIKDAJ_EoSTAjpryRD4If__0 2024-09-12T18:01:50.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4438164200066119196', time=2024-09-12T19:54:36.928921+0000, chain.objs.size()=1 2024-09-12T18:01:50.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.b_nZ8J184XuLrNV3Su6E6iKvfsrDkxz_0 2024-09-12T18:01:50.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.614001894119459603', time=2024-09-12T19:54:44.518376+0000, chain.objs.size()=1 2024-09-12T18:01:50.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ZTs1SPB_mfLJ1P4KpgfP1e__xo1LMI-_0 2024-09-12T18:01:50.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16980761923913981824', time=2024-09-12T19:54:44.527324+0000, chain.objs.size()=1 2024-09-12T18:01:50.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.A52qzan5ZdQRWpslzLWIT0hQ-nGbfAq_0 2024-09-12T18:01:50.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18009681560237809053', time=2024-09-12T19:54:44.553257+0000, chain.objs.size()=1 2024-09-12T18:01:50.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9Z69Hiiatyv6HpQK43j-rlo23BMrOSP_0 2024-09-12T18:01:50.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3605554149366940790', time=2024-09-12T19:54:44.645505+0000, chain.objs.size()=1 2024-09-12T18:01:50.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.HkbmXabGS2xgYSzd7NWoUwOzxkCtJS8_0 2024-09-12T18:01:50.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3391597105103610061', time=2024-09-12T19:54:44.657183+0000, chain.objs.size()=1 2024-09-12T18:01:50.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.CcadBgAIQ_zTtas0Q9LomBfzYaKRoAJ_0 2024-09-12T18:01:50.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13660624154823581780', time=2024-09-12T19:54:44.692027+0000, chain.objs.size()=1 2024-09-12T18:01:50.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.yKUv3hVSbD5Hz_YT_XqLaYw_pHFE7zN_0 2024-09-12T18:01:50.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16757576187580852508', time=2024-09-12T19:54:44.705328+0000, chain.objs.size()=1 2024-09-12T18:01:50.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.R7ggIfSBiUc2ezyEFbP4PCiZsgU1gAn_0 2024-09-12T18:01:50.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14757975999784399903', time=2024-09-12T19:54:44.720804+0000, chain.objs.size()=1 2024-09-12T18:01:50.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.649+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.rMqml9nGXpyKefbu4LIjBVX4GXhdpVV_0 2024-09-12T18:01:50.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.650+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2261003396248639635', time=2024-09-12T19:54:44.848750+0000, chain.objs.size()=1 2024-09-12T18:01:50.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.650+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.LmUIX5lVIRNUG81P4AGJfhd_863lCZY_0 2024-09-12T18:01:50.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17465626277042376802', time=2024-09-12T19:54:44.883124+0000, chain.objs.size()=1 2024-09-12T18:01:50.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.r8EADr-yqq4ba5ZTVUsKgZwebWNhwdR_0 2024-09-12T18:01:50.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9963535010567386182', time=2024-09-12T19:54:45.047740+0000, chain.objs.size()=1 2024-09-12T18:01:50.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.mGiQdHWnlTBoM45IxWFL2aOqo1ui28E_0 2024-09-12T18:01:50.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6513280511146818044', time=2024-09-12T19:54:45.211679+0000, chain.objs.size()=1 2024-09-12T18:01:50.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.S3TOCkatbC2R8N4UEzQM8BeYcc6KY6r_0 2024-09-12T18:01:50.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14099728385023913360', time=2024-09-12T19:54:45.217003+0000, chain.objs.size()=1 2024-09-12T18:01:50.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.fPzm2WLuUsOz3QHbwSRhVVtT1yzGMpn_0 2024-09-12T18:01:50.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13260284689380289030', time=2024-09-12T19:54:45.235252+0000, chain.objs.size()=1 2024-09-12T18:01:50.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ZKDYOjuj9nJl5fTO4pSNyK73nOOVGTG_0 2024-09-12T18:01:50.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16041548194065975330', time=2024-09-12T19:54:45.237466+0000, chain.objs.size()=1 2024-09-12T18:01:50.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.i-V_fjjZ9GhTqp-wsZ4QhP8fsWq6eP__0 2024-09-12T18:01:50.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7607750382582002605', time=2024-09-12T19:54:45.249395+0000, chain.objs.size()=1 2024-09-12T18:01:50.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ifGflSXaJW1xpX73W-O-KeWZz1NZWKG_0 2024-09-12T18:01:50.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13629947168833106739', time=2024-09-12T19:54:45.259067+0000, chain.objs.size()=1 2024-09-12T18:01:50.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.10K60pNbiQ3DQcm239cLlgIlsjgDryt_0 2024-09-12T18:01:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6872736245218473334', time=2024-09-12T19:54:45.261628+0000, chain.objs.size()=1 2024-09-12T18:01:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.RvA_NCq51Whe6myfXonOSKK8IExsoYk_0 2024-09-12T18:01:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.258977359727803375', time=2024-09-12T19:54:45.340064+0000, chain.objs.size()=1 2024-09-12T18:01:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.EIPwHNB720IVgHWbxjJ8OXXLU7XWLLp_0 2024-09-12T18:01:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15827856739773685729', time=2024-09-12T19:54:45.388358+0000, chain.objs.size()=1 2024-09-12T18:01:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.651+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.mw9pInzcX8AtIZWce7kWIUQhkpxRmFX_0 2024-09-12T18:01:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.653+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10059276031124141190', time=2024-09-12T19:54:45.392915+0000, chain.objs.size()=1 2024-09-12T18:01:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.653+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.6wU6AdzfeA428crDKK7sNZyt0WMrfqf_0 2024-09-12T18:01:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.653+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7315804855745281323', time=2024-09-12T19:54:45.434450+0000, chain.objs.size()=1 2024-09-12T18:01:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.653+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.zsubf-ySHKpOskJN7ky7bHEKn6fQ4Il_0 2024-09-12T18:01:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.653+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17002915272298434938', time=2024-09-12T19:54:45.518668+0000, chain.objs.size()=1 2024-09-12T18:01:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.653+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Vl44qQop4ZLaW0xThykKX_gq_HxtddJ_0 2024-09-12T18:01:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.654+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1978506418283094174', time=2024-09-12T19:54:45.533149+0000, chain.objs.size()=1 2024-09-12T18:01:50.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.654+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.PPLU7ke5scznNG0-eDI2Eh87hLf1vtQ_0 2024-09-12T18:01:50.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.654+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15039679772687573960', time=2024-09-12T19:54:45.595914+0000, chain.objs.size()=1 2024-09-12T18:01:50.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.654+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TErCuwtr6CeGEnNnGbQziRch1prZe8I_0 2024-09-12T18:01:50.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.654+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7067099018602321465', time=2024-09-12T19:54:45.597882+0000, chain.objs.size()=1 2024-09-12T18:01:50.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.654+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.oBCjRg96ooLx4gt43IkohTk6pJTID4v_0 2024-09-12T18:01:50.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.654+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6820675117588354308', time=2024-09-12T19:54:45.680834+0000, chain.objs.size()=1 2024-09-12T18:01:50.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.654+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.bgbHoDgE6SOKaksLnyc8ll18TIroUlT_0 2024-09-12T18:01:50.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.654+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18343412757898975948', time=2024-09-12T19:54:45.700214+0000, chain.objs.size()=1 2024-09-12T18:01:50.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.654+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.xNFYBKLou_ARfUK1qwqW3JMgxu_MeU7_0 2024-09-12T18:01:50.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.656+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/47278 2024-09-12T18:01:50.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T18:01:50.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1190027819725821772', time=2024-09-12T19:54:45.715997+0000, chain.objs.size()=1 2024-09-12T18:01:50.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.NYn9PLAqgnAbznx4cFnu-DumYo0vTOC_0 2024-09-12T18:01:50.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7780154076914910973', time=2024-09-12T19:54:45.717861+0000, chain.objs.size()=1 2024-09-12T18:01:50.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.L0JFc_NHwZwI8z8OcP8W9LCWpLKfqmg_0 2024-09-12T18:01:50.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4426405149014908062', time=2024-09-12T19:54:50.934970+0000, chain.objs.size()=1 2024-09-12T18:01:50.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.354__shadow_.YOU7n2jQns2SJhkcCIYn0QsTs7Av7AL_0 2024-09-12T18:01:50.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3321148288313612329', time=2024-09-12T19:54:53.397236+0000, chain.objs.size()=1 2024-09-12T18:01:50.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.371__shadow_.njzZKjZL8vGy2Bl5Sq1wOS9TudLw3NR_0 2024-09-12T18:01:50.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4960919860797252990', time=2024-09-12T19:55:14.389825+0000, chain.objs.size()=1 2024-09-12T18:01:50.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.457__shadow_.D5XB0xOgJziowv6Yi5bR5vBTbALMMWZ_0 2024-09-12T18:01:50.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9723296093395967262', time=2024-09-12T19:55:17.811961+0000, chain.objs.size()=1 2024-09-12T18:01:50.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.467__shadow_.LYRSNxXedhVdzp29MqMqSw6NZxKkyl4_0 2024-09-12T18:01:50.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4519141674702701306', time=2024-09-12T19:55:20.950338+0000, chain.objs.size()=1 2024-09-12T18:01:50.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.484__shadow_.1pXSeVYGxx86dNkBscQ3Jm7oxs54Y5M_0 2024-09-12T18:01:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12566509827858396805', time=2024-09-12T19:55:22.363471+0000, chain.objs.size()=1 2024-09-12T18:01:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.489__shadow_.FfddJOecbvo1GpsPGY0sZgzxrGEkZmo_0 2024-09-12T18:01:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9331184269128741284', time=2024-09-12T19:55:29.457897+0000, chain.objs.size()=1 2024-09-12T18:01:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.517__multipart_mymultipartcopy.2~zwoyU4uFGlOzBXhaU0lqRMelAzsIvlN.1 2024-09-12T18:01:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10563290663708328310', time=2024-09-12T19:55:29.965972+0000, chain.objs.size()=1 2024-09-12T18:01:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.519__multipart_mymultipart.2~aNvEm_hYAbnWSaCGbaUCRdislGIN7NS.1 2024-09-12T18:01:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~1j-xoH8wS_2VzgDnnEatV7UerDlhLQY', time=2024-09-12T19:55:40.501262+0000, chain.objs.size()=10 2024-09-12T18:01:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.527__multipart_mymultipart.2~1j-xoH8wS_2VzgDnnEatV7UerDlhLQY.1 2024-09-12T18:01:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.658+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.527__multipart_mymultipart.2~1j-xoH8wS_2VzgDnnEatV7UerDlhLQY.2 2024-09-12T18:01:50.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.660+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.527__multipart_mymultipart.2~1j-xoH8wS_2VzgDnnEatV7UerDlhLQY.3 2024-09-12T18:01:50.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.660+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.527__multipart_mymultipart.2~1j-xoH8wS_2VzgDnnEatV7UerDlhLQY.4 2024-09-12T18:01:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.660+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.527__multipart_mymultipart.2~1j-xoH8wS_2VzgDnnEatV7UerDlhLQY.5 2024-09-12T18:01:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.660+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.527__multipart_mymultipart.2~1j-xoH8wS_2VzgDnnEatV7UerDlhLQY.6 2024-09-12T18:01:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.661+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.527__multipart_mymultipart.2~1j-xoH8wS_2VzgDnnEatV7UerDlhLQY.7 2024-09-12T18:01:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.661+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.527__multipart_mymultipart.2~1j-xoH8wS_2VzgDnnEatV7UerDlhLQY.8 2024-09-12T18:01:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.661+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.527__multipart_mymultipart.2~1j-xoH8wS_2VzgDnnEatV7UerDlhLQY.9 2024-09-12T18:01:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.661+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.527__multipart_mymultipart.2~1j-xoH8wS_2VzgDnnEatV7UerDlhLQY.10 2024-09-12T18:01:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.661+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~PyPBtZFwkVdy3kbvKMA7mS95m6UGQ2l', time=2024-09-12T19:55:43.096691+0000, chain.objs.size()=1 2024-09-12T18:01:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.661+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.535__multipart_mymultipart.2~PyPBtZFwkVdy3kbvKMA7mS95m6UGQ2l.1 2024-09-12T18:01:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.661+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~NBcm_X5NIpqcjBr25THKCtJdbhTDkQS', time=2024-09-12T19:56:15.037268+0000, chain.objs.size()=1 2024-09-12T18:01:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.661+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.562__multipart_mymultipart.2~NBcm_X5NIpqcjBr25THKCtJdbhTDkQS.1 2024-09-12T18:01:50.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.661+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4101112848591887714', time=2024-09-12T19:56:20.217702+0000, chain.objs.size()=1 2024-09-12T18:01:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.661+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.566__shadow_.qYX5Z4ReULnk9OKkFRq164PVIfbRqkB_0 2024-09-12T18:01:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.662+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15020698449977422046', time=2024-09-12T19:56:26.173243+0000, chain.objs.size()=1 2024-09-12T18:01:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.662+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:.dcYRDzfXsis6hmO0s1m8j-yQO8e1zH_.-ZRs6-EaXIyikR9cIXmL_DLIMZwYS98_0 2024-09-12T18:01:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.662+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15752068699982097433', time=2024-09-12T19:56:26.856646+0000, chain.objs.size()=1 2024-09-12T18:01:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.662+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:6l06MkzA.B2E36ZkTSQGcxArghsUgpB_.1QdshJJ7I-Dtp-UiCJUY9ifs3c8F0KQ_0 2024-09-12T18:01:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.662+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12646462571113768675', time=2024-09-12T19:56:30.037206+0000, chain.objs.size()=1 2024-09-12T18:01:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.662+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.575__shadow:zkAd73FnvdXFCZeOY3u5RFg.aqPXR9L_.op0QU80dm7_hdu98e7S6tAW1TBH7OcG_0 2024-09-12T18:01:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.662+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13152779854616318134', time=2024-09-12T19:56:38.181640+0000, chain.objs.size()=1 2024-09-12T18:01:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.662+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:dCZuYR3BgR8GFML5JeBF8LfImQ2Y4az_.Mw0bWomtaly8MoYsm55HmUgXQUu9jkp_0 2024-09-12T18:01:50.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.663+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14777143996118929295', time=2024-09-12T19:56:45.043536+0000, chain.objs.size()=1 2024-09-12T18:01:50.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.663+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:whuN9Oww2QSjtkwN3qCZ9wPcSWu.gON_.9iZhqZOgP3ltiCme0geken3G-1Sj0W8_0 2024-09-12T18:01:50.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.663+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.498403467305215454', time=2024-09-12T19:56:56.025272+0000, chain.objs.size()=1 2024-09-12T18:01:50.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.663+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.604__shadow_.-uEyuEsWvso8y5ofzjzvyCWgM7yehuJ_0 2024-09-12T18:01:50.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.663+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2955216957753089318', time=2024-09-12T19:56:56.266072+0000, chain.objs.size()=1 2024-09-12T18:01:50.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.663+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.605__shadow_.94hsNCKCZJ6bfeJ-TInnu0O0eTkQgka_0 2024-09-12T18:01:50.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.663+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5764428542293439191', time=2024-09-12T19:59:17.159236+0000, chain.objs.size()=1 2024-09-12T18:01:50.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.664+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.664__shadow_.Pr_whHVI8KXyDlZ9B26y7UqY3inn3uX_0 2024-09-12T18:01:50.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.664+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14361407946719395148', time=2024-09-12T19:59:18.347060+0000, chain.objs.size()=1 2024-09-12T18:01:50.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.664+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.667__shadow_.yOLSdQqu4t83EdGRHFhT0wDPSnZW9nH_0 2024-09-12T18:01:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.667+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.670+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:01:50.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.671+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.672+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/65380' 2024-09-12T18:01:50.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17413348649154071775', time=2024-09-12T19:54:00.082794+0000, chain.objs.size()=1 2024-09-12T18:01:50.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.234__shadow_.J3TU9GuyuoQ0IGki90kvhQKVK3I2o1L_0 2024-09-12T18:01:50.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12758923196968431085', time=2024-09-12T19:54:00.531504+0000, chain.objs.size()=1 2024-09-12T18:01:50.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.236__shadow_.tawI1nDIMPC0UNSXFIXG6FSFTgqMSTm_0 2024-09-12T18:01:50.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9637683511763856481', time=2024-09-12T19:54:04.471812+0000, chain.objs.size()=1 2024-09-12T18:01:50.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.254__shadow_.d3OnN9HLvb0mwzYIspCkfmt-9MfFhfZ_0 2024-09-12T18:01:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3105234306344861819', time=2024-09-12T19:54:04.672585+0000, chain.objs.size()=1 2024-09-12T18:01:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.255__shadow_.SPMvUUYVsNN83OwbSC4ojcKd-MgvG-t_0 2024-09-12T18:01:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3735632080806424533', time=2024-09-12T19:54:13.504536+0000, chain.objs.size()=1 2024-09-12T18:01:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Kzfhq_83joMK5VPc0lNwT1wDf9OPTh6_0 2024-09-12T18:01:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7903712147586172953', time=2024-09-12T19:54:13.518797+0000, chain.objs.size()=1 2024-09-12T18:01:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.GSqQ8zyrkuLwU9vRowRvLJCu3Cme4G1_0 2024-09-12T18:01:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9482578294361014801', time=2024-09-12T19:54:13.525757+0000, chain.objs.size()=1 2024-09-12T18:01:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.YazMk6HS2yew0mQyBN9TJeniEyKX2wd_0 2024-09-12T18:01:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11077744843607802573', time=2024-09-12T19:54:13.538364+0000, chain.objs.size()=1 2024-09-12T18:01:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.3byB_x22AoOkcdVIzU60raK5JaRrqDB_0 2024-09-12T18:01:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16475550070564682245', time=2024-09-12T19:54:13.555919+0000, chain.objs.size()=1 2024-09-12T18:01:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.rYe9vxgyf3ttjzHpzo__ht9p_ouY5_W_0 2024-09-12T18:01:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16701121795866253471', time=2024-09-12T19:54:13.657978+0000, chain.objs.size()=1 2024-09-12T18:01:50.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Qqt6zb1Pm8c7GxTvM0ExyzBp9wiOU9c_0 2024-09-12T18:01:50.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14461281855520705729', time=2024-09-12T19:54:13.675368+0000, chain.objs.size()=1 2024-09-12T18:01:50.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.lC12nT2ICA22dJcKv5ychPfkJfQTLUu_0 2024-09-12T18:01:50.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7107980168678414419', time=2024-09-12T19:54:13.716755+0000, chain.objs.size()=1 2024-09-12T18:01:50.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.673+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.b_mSK14lzHk0AVjkmGfeMtSv29Pa3ug_0 2024-09-12T18:01:50.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.675+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10813452012233402008', time=2024-09-12T19:54:13.730832+0000, chain.objs.size()=1 2024-09-12T18:01:50.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.675+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.9aBKlVcdOGrYM8MQ04Ix2EzmiFHUDQL_0 2024-09-12T18:01:50.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7026326955106756358', time=2024-09-12T19:54:13.836042+0000, chain.objs.size()=1 2024-09-12T18:01:50.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.UIJzWrQCKRJwa7RvrVPN5c5b0o5covX_0 2024-09-12T18:01:50.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6485609284903071584', time=2024-09-12T19:54:14.048230+0000, chain.objs.size()=1 2024-09-12T18:01:50.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.KVAgF1lwi-P89G3gEzX5SxY_ZxCLuAY_0 2024-09-12T18:01:50.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16798580556937954502', time=2024-09-12T19:54:14.054161+0000, chain.objs.size()=1 2024-09-12T18:01:50.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-qqWBQNSRkSiA3Los_kPBUvA5vfwZRJ_0 2024-09-12T18:01:50.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3656887482650986339', time=2024-09-12T19:54:14.385121+0000, chain.objs.size()=1 2024-09-12T18:01:50.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Q5qvaidsRb4qE1B2bmcCyKLqHnpKV9m_0 2024-09-12T18:01:50.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5311242442946780016', time=2024-09-12T19:54:14.387563+0000, chain.objs.size()=1 2024-09-12T18:01:50.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.trk9WbgBqik5etE4ssYg00zxFX-dWO7_0 2024-09-12T18:01:50.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12731215478249486796', time=2024-09-12T19:54:14.412312+0000, chain.objs.size()=1 2024-09-12T18:01:50.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.021iYdNa0wPNsTlJ60wNYph8taW04qA_0 2024-09-12T18:01:50.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7451394248312721654', time=2024-09-12T19:54:14.467586+0000, chain.objs.size()=1 2024-09-12T18:01:50.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.LG2TJfFoWXO1W2M1FZB3SUtEDAhyqSj_0 2024-09-12T18:01:50.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16039831437106236781', time=2024-09-12T19:54:14.468163+0000, chain.objs.size()=1 2024-09-12T18:01:50.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Tq2DkpOv6E-4mZTNufL_y4ucATU6YIT_0 2024-09-12T18:01:50.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12227295391520243454', time=2024-09-12T19:54:14.606597+0000, chain.objs.size()=1 2024-09-12T18:01:50.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.sctnHDTvM1ppatfaSvR0LWmMAXAgUta_0 2024-09-12T18:01:50.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2691699702609841480', time=2024-09-12T19:54:14.616930+0000, chain.objs.size()=1 2024-09-12T18:01:50.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ZbJnstoD8IAwXoO839BqZNprV_EJWW__0 2024-09-12T18:01:50.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5438544092242958658', time=2024-09-12T19:54:14.632433+0000, chain.objs.size()=1 2024-09-12T18:01:50.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.676+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.gsjbtG_oe9mHEC-_BLzJEayjAolxej3_0 2024-09-12T18:01:50.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.678+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15016278339989762276', time=2024-09-12T19:54:14.746542+0000, chain.objs.size()=1 2024-09-12T18:01:50.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.678+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Mst-jIqI95SNrblVXRywUzCI2rfJueE_0 2024-09-12T18:01:50.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.678+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15603505462602126610', time=2024-09-12T19:54:14.759282+0000, chain.objs.size()=1 2024-09-12T18:01:50.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.678+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Adrb67kIlq_1YY9gzEfafnNGyYR63AM_0 2024-09-12T18:01:50.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.678+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14340638653786982752', time=2024-09-12T19:54:14.788835+0000, chain.objs.size()=1 2024-09-12T18:01:50.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.678+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-Hy2ITCWknRN24HK65azM788w4rkT9e_0 2024-09-12T18:01:50.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.316641419120157265', time=2024-09-12T19:54:14.800490+0000, chain.objs.size()=1 2024-09-12T18:01:50.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.VQRYIqt0gr7raxdahbRPBwqrE-7DStu_0 2024-09-12T18:01:50.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10040144737719854021', time=2024-09-12T19:54:14.877262+0000, chain.objs.size()=1 2024-09-12T18:01:50.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.0ctNrOMumblehvCVsN5RDp6og6X47uc_0 2024-09-12T18:01:50.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1389020531071625009', time=2024-09-12T19:54:14.931186+0000, chain.objs.size()=1 2024-09-12T18:01:50.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-wDDTa6Px927I592gFd4s2Mzl4vLxSl_0 2024-09-12T18:01:50.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12983192448212670610', time=2024-09-12T19:54:14.946807+0000, chain.objs.size()=1 2024-09-12T18:01:50.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Ac1Wt2Ml-ZF9C8KJ4k7OkE2Zyh26Mpf_0 2024-09-12T18:01:50.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15769539631936042286', time=2024-09-12T19:54:15.118679+0000, chain.objs.size()=1 2024-09-12T18:01:50.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.264__shadow_.blk7Q8ojluCtGYxW6P2Mc4MlpoU_SVI_0 2024-09-12T18:01:50.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13937638068059677479', time=2024-09-12T19:54:18.848942+0000, chain.objs.size()=1 2024-09-12T18:01:50.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.282__shadow_.RAK_FQ5cyBd7PtsDmUm654de0PM2iLd_0 2024-09-12T18:01:50.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17449179337729503163', time=2024-09-12T19:54:19.709567+0000, chain.objs.size()=1 2024-09-12T18:01:50.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.286__shadow_.YFwP6l5Z_t9kbtXyBzkM361SUuD1i0W_0 2024-09-12T18:01:50.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10271021703975864345', time=2024-09-12T19:54:19.955757+0000, chain.objs.size()=1 2024-09-12T18:01:50.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.287__shadow_.w3Dmq9InanVipwh9QbatrTrW0YgreCP_0 2024-09-12T18:01:50.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.744145652890329155', time=2024-09-12T19:54:22.158206+0000, chain.objs.size()=1 2024-09-12T18:01:50.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.IwolfvGBUCjSlUTFtk0lhtx9TaB6xkA_0 2024-09-12T18:01:50.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11832286694369274613', time=2024-09-12T19:54:22.170281+0000, chain.objs.size()=1 2024-09-12T18:01:50.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.679+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.z0FeY51SuJbAlz07z_2eOSv-5om4iWy_0 2024-09-12T18:01:50.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.680+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7482191756323619961', time=2024-09-12T19:54:24.377255+0000, chain.objs.size()=1 2024-09-12T18:01:50.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.680+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.304__shadow_.fGQ2uTgYJFqrJ5KUOKJ9T4U2gCIwHTL_0 2024-09-12T18:01:50.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.681+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13292145162870479595', time=2024-09-12T19:54:35.776335+0000, chain.objs.size()=1 2024-09-12T18:01:50.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.681+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.mFYsynx0jp3NiXb2x4cWta4s1Whu2mN_0 2024-09-12T18:01:50.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.681+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17494123253717859881', time=2024-09-12T19:54:35.806759+0000, chain.objs.size()=1 2024-09-12T18:01:50.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.681+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.tLGfrbbdRKmaYPIRkbGSaq_Zg90XzVW_0 2024-09-12T18:01:50.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.681+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7545107723496645888', time=2024-09-12T19:54:35.816312+0000, chain.objs.size()=1 2024-09-12T18:01:50.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.681+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.pN-Y_T8gaRNq08FPnlxgnrtK5I6YoZn_0 2024-09-12T18:01:50.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.681+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14759296931608125139', time=2024-09-12T19:54:35.836879+0000, chain.objs.size()=1 2024-09-12T18:01:50.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.681+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.NWJPLylS8J_hmUKCbZ5FR9hw8Px_ZbO_0 2024-09-12T18:01:50.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.681+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11531291241990481082', time=2024-09-12T19:54:35.840186+0000, chain.objs.size()=1 2024-09-12T18:01:50.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.681+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9STSx0KjziH1m9VN7slfoejobwUr0cV_0 2024-09-12T18:01:50.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.681+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17558056661508074919', time=2024-09-12T19:54:35.926707+0000, chain.objs.size()=1 2024-09-12T18:01:50.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.681+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.5i-Nf7qCMzVmWqpB7YZlACS6niwSG_O_0 2024-09-12T18:01:50.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.681+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15247728040321620406', time=2024-09-12T19:54:35.953879+0000, chain.objs.size()=1 2024-09-12T18:01:50.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.681+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.wUEuixPP87ZwE4izCL5E_bP6EG3THTI_0 2024-09-12T18:01:50.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.682+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4427169118006112324', time=2024-09-12T19:54:35.972601+0000, chain.objs.size()=1 2024-09-12T18:01:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.682+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.UmRgrjJTtT9CgRJF_xKmz8aQEscKGMv_0 2024-09-12T18:01:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.682+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12011307608550925146', time=2024-09-12T19:54:35.982318+0000, chain.objs.size()=1 2024-09-12T18:01:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.682+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.s68fMr8qxHPUBgN1oO9a8Wzvlgl1gqp_0 2024-09-12T18:01:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.682+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18198993653075949412', time=2024-09-12T19:54:35.990296+0000, chain.objs.size()=1 2024-09-12T18:01:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.682+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.amA7C3jYAyQITEtRB9bNyYuWIc4WG2H_0 2024-09-12T18:01:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.683+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14512060008397606294', time=2024-09-12T19:54:36.002324+0000, chain.objs.size()=1 2024-09-12T18:01:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.683+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.j6Nm8QJYL-KxYp_3FzpUtmbe9jCdWtw_0 2024-09-12T18:01:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.683+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16905905246478908234', time=2024-09-12T19:54:36.003451+0000, chain.objs.size()=1 2024-09-12T18:01:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.683+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.esnAVDEQyNs9G5yqHkwqC6IOqEuJ9Om_0 2024-09-12T18:01:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.683+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14535897042234821757', time=2024-09-12T19:54:36.128057+0000, chain.objs.size()=1 2024-09-12T18:01:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.683+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4KIdANniyRTfWRifxNzcCk0ImFT0QMh_0 2024-09-12T18:01:50.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.683+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9143461376018415373', time=2024-09-12T19:54:36.153185+0000, chain.objs.size()=1 2024-09-12T18:01:50.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.683+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.dl_lXZDAl5OSyTV1yif2S5NtC_11467_0 2024-09-12T18:01:50.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.683+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16404458620706592010', time=2024-09-12T19:54:36.155384+0000, chain.objs.size()=1 2024-09-12T18:01:50.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.683+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.bv3xGo4UjS9wJxA-mdzB3ABn8Ynz4Hj_0 2024-09-12T18:01:50.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.683+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7758120234783166856', time=2024-09-12T19:54:36.173523+0000, chain.objs.size()=1 2024-09-12T18:01:50.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.683+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QfAOkEg0ELUaoz2bSjZxJVK1iUzSMS__0 2024-09-12T18:01:50.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.684+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5476022162775994430', time=2024-09-12T19:54:36.266201+0000, chain.objs.size()=1 2024-09-12T18:01:50.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.684+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.TgGWAYH23A0urpno7qEUZ6ViSv382GK_0 2024-09-12T18:01:50.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.684+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11324472566543375617', time=2024-09-12T19:54:36.268991+0000, chain.objs.size()=1 2024-09-12T18:01:50.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.684+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.jtp7fkJRJYWyob9eBSqc1YVA0KO56ip_0 2024-09-12T18:01:50.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.684+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7499043995544505549', time=2024-09-12T19:54:36.329892+0000, chain.objs.size()=1 2024-09-12T18:01:50.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.684+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.VF708tTNUo1w9MTEB5vPnbNdBkPAW39_0 2024-09-12T18:01:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.684+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8252526346892416473', time=2024-09-12T19:54:36.486405+0000, chain.objs.size()=1 2024-09-12T18:01:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.684+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.DcWr_w7jy4p-K-zEjH2ZmINHKt2mHTc_0 2024-09-12T18:01:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.684+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2690535183981627305', time=2024-09-12T19:54:36.493598+0000, chain.objs.size()=1 2024-09-12T18:01:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.684+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Uo50BKfNkVPjBho3nvlae3H9p2BDNrF_0 2024-09-12T18:01:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.684+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8750648639815803378', time=2024-09-12T19:54:36.494302+0000, chain.objs.size()=1 2024-09-12T18:01:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.684+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.VZpDHe2Zef1dq5FmIVeM1GrjhWbopzf_0 2024-09-12T18:01:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.685+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1649284516303400139', time=2024-09-12T19:54:36.505897+0000, chain.objs.size()=1 2024-09-12T18:01:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.685+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.CU2zXs1OdhkdCNsylBM2Uhi6CWLgT3r_0 2024-09-12T18:01:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.685+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8005801372757423269', time=2024-09-12T19:54:36.581890+0000, chain.objs.size()=1 2024-09-12T18:01:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.685+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.v-JsuvgcnrWFs7tw1eM9LgH4OkfQQEv_0 2024-09-12T18:01:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.685+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5194130752020722692', time=2024-09-12T19:54:36.605342+0000, chain.objs.size()=1 2024-09-12T18:01:50.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.685+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.zwpbvVlJbDa28k3BuZKrapEO0e9UqNH_0 2024-09-12T18:01:50.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.686+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12863072652469390029', time=2024-09-12T19:54:36.617752+0000, chain.objs.size()=1 2024-09-12T18:01:50.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.686+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.7hdyN4Dg2y8EHc-bz-gtF5trwY4UilV_0 2024-09-12T18:01:50.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.686+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12937389124017977404', time=2024-09-12T19:54:36.756721+0000, chain.objs.size()=1 2024-09-12T18:01:50.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.686+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.8mOXtWYQr3PDW-EFYTaKAM4U4YRffp2_0 2024-09-12T18:01:50.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.686+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5526443297997551039', time=2024-09-12T19:54:36.926047+0000, chain.objs.size()=1 2024-09-12T18:01:50.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.686+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.jz0WoGHmUqqSReHI2sXPQZJygvvHxVD_0 2024-09-12T18:01:50.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.686+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17882344348334128731', time=2024-09-12T19:54:36.936603+0000, chain.objs.size()=1 2024-09-12T18:01:50.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.686+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rWIJmiNdCmRsQzuzptYw19LBoVn20Gz_0 2024-09-12T18:01:50.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.686+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11739024492783060152', time=2024-09-12T19:54:44.454672+0000, chain.objs.size()=1 2024-09-12T18:01:50.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.686+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.bEmLoIiflBilsOzWBq9mZYGmXYtJ_jO_0 2024-09-12T18:01:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.688+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5332871560700616782', time=2024-09-12T19:54:44.464743+0000, chain.objs.size()=1 2024-09-12T18:01:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.688+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.wT6T4bqx5132auV3C1N8CpKnlfy02YZ_0 2024-09-12T18:01:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.688+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7542514049759377542', time=2024-09-12T19:54:44.470069+0000, chain.objs.size()=1 2024-09-12T18:01:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.688+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jNAuUwjI5QAW7Xh5nsNKre2LanJ0XdF_0 2024-09-12T18:01:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.689+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14289041519399773424', time=2024-09-12T19:54:44.516411+0000, chain.objs.size()=1 2024-09-12T18:01:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.689+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.3gSxowRsZQJ9t4Xt4khZDxOMvRCEu4B_0 2024-09-12T18:01:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.689+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15715747758528233869', time=2024-09-12T19:54:44.517600+0000, chain.objs.size()=1 2024-09-12T18:01:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.689+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.oNbhZFA1IYaYEYX88GpmEPButeHJIMH_0 2024-09-12T18:01:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.689+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5321046476157976351', time=2024-09-12T19:54:44.630482+0000, chain.objs.size()=1 2024-09-12T18:01:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.689+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.YrCNeSzBnXOkYf9ygTgMvTb4_23RXvO_0 2024-09-12T18:01:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.689+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10272266519793516643', time=2024-09-12T19:54:44.677000+0000, chain.objs.size()=1 2024-09-12T18:01:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.689+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.lVR82LVbX9f5YZ1u6iR7sfVecwxlqnO_0 2024-09-12T18:01:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2857071599984005162', time=2024-09-12T19:54:44.698993+0000, chain.objs.size()=1 2024-09-12T18:01:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.7Gsemmhy4heIaJB9VqQwg7xf2mOk3hD_0 2024-09-12T18:01:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1931298356059497407', time=2024-09-12T19:54:44.799727+0000, chain.objs.size()=1 2024-09-12T18:01:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_._Fe5pmWbRXvpa2M7PrZUX4RJS8F9ZZr_0 2024-09-12T18:01:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6272353363030188072', time=2024-09-12T19:54:44.821290+0000, chain.objs.size()=1 2024-09-12T18:01:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.3KGrSwwKTx0ZPdLgmM7R59T-Il3dm2x_0 2024-09-12T18:01:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13526070342809657051', time=2024-09-12T19:54:44.883875+0000, chain.objs.size()=1 2024-09-12T18:01:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.uX1xSlbh9XpYvS28wWwC8Q4i0pjksBi_0 2024-09-12T18:01:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8729748302110748016', time=2024-09-12T19:54:45.017241+0000, chain.objs.size()=1 2024-09-12T18:01:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.UcFp9l-FgkDCKgLg6tHaQ8SkOu6W5Hi_0 2024-09-12T18:01:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2433980176847453295', time=2024-09-12T19:54:45.172525+0000, chain.objs.size()=1 2024-09-12T18:01:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9rA5DWaK5ObldRss-q7omBLLRPLWOKL_0 2024-09-12T18:01:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17454911128108936645', time=2024-09-12T19:54:45.173542+0000, chain.objs.size()=1 2024-09-12T18:01:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.JgMr7-Boy1yR2PygFicrY720W5tZbFB_0 2024-09-12T18:01:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12839631022858115897', time=2024-09-12T19:54:45.183963+0000, chain.objs.size()=1 2024-09-12T18:01:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.4mmbi4tAAcRbsjDSBAOWArhhOwMufSm_0 2024-09-12T18:01:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8409975722102392882', time=2024-09-12T19:54:45.196498+0000, chain.objs.size()=1 2024-09-12T18:01:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.MQ13ABkand6uRi7jF3dVVpod3_ZFIrS_0 2024-09-12T18:01:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9284160971401636084', time=2024-09-12T19:54:45.219645+0000, chain.objs.size()=1 2024-09-12T18:01:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.691+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.SGfxv81H9A9d85dpKbtnwvYrB1YI1SH_0 2024-09-12T18:01:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.694+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10899222690701379002', time=2024-09-12T19:54:45.348844+0000, chain.objs.size()=1 2024-09-12T18:01:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.694+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.BZbZZvy-_riBH6w_4QGNfzSt5_scfw2_0 2024-09-12T18:01:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.694+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15513727775923664350', time=2024-09-12T19:54:45.372223+0000, chain.objs.size()=1 2024-09-12T18:01:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.694+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.luMPlLqZIy_SQxJvLHnyuiX7tRkv4_8_0 2024-09-12T18:01:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2194061709693664647', time=2024-09-12T19:54:45.385071+0000, chain.objs.size()=1 2024-09-12T18:01:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.KK7rA3bI7Qv9G6HQKCvU7fSs55VqjD9_0 2024-09-12T18:01:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5280823891455836707', time=2024-09-12T19:54:45.400047+0000, chain.objs.size()=1 2024-09-12T18:01:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.SeT6_Ze7tnzieFy30zAVud9s9aAtRvl_0 2024-09-12T18:01:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15435788232738097214', time=2024-09-12T19:54:45.425293+0000, chain.objs.size()=1 2024-09-12T18:01:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.WzmIzYxK7MjtTy4RTqgwtq-U-FHCs-S_0 2024-09-12T18:01:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10484956171566915879', time=2024-09-12T19:54:45.430210+0000, chain.objs.size()=1 2024-09-12T18:01:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ThB_B2mnuB-TRmJbSMCCgyPpegVnGn__0 2024-09-12T18:01:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.884287989085949571', time=2024-09-12T19:54:45.512881+0000, chain.objs.size()=1 2024-09-12T18:01:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.LBEzzlmHwy8goqd7B-K55wfELVIzLFe_0 2024-09-12T18:01:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.574692841077590212', time=2024-09-12T19:54:45.519906+0000, chain.objs.size()=1 2024-09-12T18:01:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.7hDzwDLP7mS-ahFH5VV_WAxB3fWO2D8_0 2024-09-12T18:01:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5287565144488276405', time=2024-09-12T19:54:45.600268+0000, chain.objs.size()=1 2024-09-12T18:01:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.8MGcLIkRkmwHobyprGsBe8NdaEpE3pt_0 2024-09-12T18:01:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10507925016068442537', time=2024-09-12T19:54:45.691851+0000, chain.objs.size()=1 2024-09-12T18:01:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.EmYsv6bgbgPY7eAQW-HyayW_cjBkd4l_0 2024-09-12T18:01:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9055592827980290020', time=2024-09-12T19:54:45.739117+0000, chain.objs.size()=1 2024-09-12T18:01:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.697+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Su7Pu_5XYkFYwdybd8zQ5C5Vf4RwpZV_0 2024-09-12T18:01:50.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.699+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15794915777200506426', time=2024-09-12T19:54:46.074907+0000, chain.objs.size()=1 2024-09-12T18:01:50.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.699+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.327__shadow_.QHtmoWctiwVpD8jUXL00Wfcs9p6v-LN_0 2024-09-12T18:01:50.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.699+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18411614556917329953', time=2024-09-12T19:54:47.027929+0000, chain.objs.size()=1 2024-09-12T18:01:50.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.699+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.332__shadow_.zrnAMmzrJ7lg0zXEuqtkDnOcFMTZStI_0 2024-09-12T18:01:50.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.702+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11740400898838487284', time=2024-09-12T19:54:49.200070+0000, chain.objs.size()=1 2024-09-12T18:01:50.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.702+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.343__shadow_.uR5RDWbxvMETYwBLWwLlKX0pPVehFb3_0 2024-09-12T18:01:50.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.702+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14401699588593601913', time=2024-09-12T19:55:04.614293+0000, chain.objs.size()=1 2024-09-12T18:01:50.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.702+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.411__shadow_.SQoRYgZ2TQWNYOW0bt5WSJfKHIae3Ew_0 2024-09-12T18:01:50.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.702+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6544899650683584116', time=2024-09-12T19:55:15.430898+0000, chain.objs.size()=1 2024-09-12T18:01:50.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.702+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.460__shadow_.Gw60VZ6Ai1AcqthLzM_gmBozhnRmFj2_0 2024-09-12T18:01:50.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.704+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/65380 2024-09-12T18:01:50.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:01:50.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.923804129891519464', time=2024-09-12T19:55:21.169123+0000, chain.objs.size()=1 2024-09-12T18:01:50.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.485__shadow_.hw2cPe1htmo691AFIdQvGmF_Eff3Fog_0 2024-09-12T18:01:50.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16363538100504677401', time=2024-09-12T19:55:22.363382+0000, chain.objs.size()=1 2024-09-12T18:01:50.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.489__shadow_.FfddJOecbvo1GpsPGY0sZgzxrGEkZmo_0 2024-09-12T18:01:50.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~j8m17L9-G9JP6hGejPl1lNApt3G0vuX', time=2024-09-12T19:55:36.262462+0000, chain.objs.size()=1 2024-09-12T18:01:50.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~j8m17L9-G9JP6hGejPl1lNApt3G0vuX.2 2024-09-12T18:01:50.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~j8m17L9-G9JP6hGejPl1lNApt3G0vuX', time=2024-09-12T19:55:36.263838+0000, chain.objs.size()=1 2024-09-12T18:01:50.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~j8m17L9-G9JP6hGejPl1lNApt3G0vuX.3 2024-09-12T18:01:50.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16411383661122800354', time=2024-09-12T19:56:10.416885+0000, chain.objs.size()=1 2024-09-12T18:01:50.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.551__shadow_.5T2cSuKw7d14fWxrcTsDlVADPuSW_nK_0 2024-09-12T18:01:50.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9927773626126590816', time=2024-09-12T19:56:21.909238+0000, chain.objs.size()=1 2024-09-12T18:01:50.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:7DNcufoxf-Sw7ui03YDbLZKG9WVWsmu_.8gJ6nx9-YTnAEaM4Y3tq3USpAhq9I4A_0 2024-09-12T18:01:50.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6773533007251169624', time=2024-09-12T19:56:25.319769+0000, chain.objs.size()=1 2024-09-12T18:01:50.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:yaO0AL0v7kR5RmWUtIff2Vu2GzOZHvn_.pzGdctXzgd0_elPDZ1sM147DJ3JPpoF_0 2024-09-12T18:01:50.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2170090311048089074', time=2024-09-12T19:56:34.906995+0000, chain.objs.size()=1 2024-09-12T18:01:50.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.577__shadow:mpd3WmYprA.TclZJ-6m2l-g7UOtTKW-_.uq0D2HMT-dgAKRLjvqXQU6dwcCd376G_0 2024-09-12T18:01:50.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.596180911001657132', time=2024-09-12T19:56:37.843710+0000, chain.objs.size()=1 2024-09-12T18:01:50.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:3sZCZFGwCB0aQIguW.QN4gpuwWmBcaL_.KzXD3mufO2VbcxaVOJufBXWw9TPXb8a_0 2024-09-12T18:01:50.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4176911984518316661', time=2024-09-12T19:56:43.505169+0000, chain.objs.size()=1 2024-09-12T18:01:50.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:JT5atWxE9PKBe-nQtLrvfj15YSJZeLV_.WB3rSCzhB3PUYfWc2NTFjV3T11OAsPj_0 2024-09-12T18:01:50.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14767351078370077688', time=2024-09-12T19:56:49.992160+0000, chain.objs.size()=1 2024-09-12T18:01:50.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.580__shadow:fb9EzAwifsykdd9jBEMxtWCOHClMWgu_.fiSzTmCtuHKtLh1gt5rtg8qI3ZKnHSh_0 2024-09-12T18:01:50.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5743874645803979954', time=2024-09-12T19:56:51.035738+0000, chain.objs.size()=1 2024-09-12T18:01:50.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.706+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.581__shadow:PF-KeIufMmcRSBsxU57Szy9Erz28K3B_.EUeJeC5DuGXhK9A2xnvrWvRnMo0q1ER_0 2024-09-12T18:01:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.710+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4686700346018300707', time=2024-09-12T19:56:53.161235+0000, chain.objs.size()=1 2024-09-12T18:01:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.710+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.588__shadow:8rGZs.CEvYcbC8lZ055.pN3y1k-hve-_.DXRAQxJQIq_clRGpIv2YjRLtsyRUbhF_0 2024-09-12T18:01:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.710+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7814085110211989096', time=2024-09-12T19:56:55.800156+0000, chain.objs.size()=1 2024-09-12T18:01:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.710+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.603__shadow_.4uuFGmV5iabLWI40QhHFDHk1wXWaxUX_0 2024-09-12T18:01:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.710+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16531981247799384352', time=2024-09-12T19:59:10.021188+0000, chain.objs.size()=1 2024-09-12T18:01:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.710+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.643__shadow_.txRXb2w61YlxuGJU0TjuUKZBRCyFzyS_0 2024-09-12T18:01:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.710+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12188248226158634219', time=2024-09-12T19:59:24.095818+0000, chain.objs.size()=1 2024-09-12T18:01:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.710+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.697__shadow:Or48RC9J8HZI4m7wl.RKTjJ171qrnqn_.etGA8CNxk0iCdNQbZNEhU2XNrnmMCAv_0 2024-09-12T18:01:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.710+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.813507716338516748', time=2024-09-12T19:59:25.011859+0000, chain.objs.size()=1 2024-09-12T18:01:50.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.710+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.701__shadow:4WLEVld2I7fE4pjbMSw12G9w6WnLKr._.Atf-NpRySUnL9Wq8x1eWpuh9fo0Shn6_0 2024-09-12T18:01:50.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.713+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10245619591135905723', time=2024-09-12T19:59:38.747347+0000, chain.objs.size()=1 2024-09-12T18:01:50.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.713+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.717__shadow:MDc5JoWmg1CFkz54Hr9k.uaoIPXneDn_.i_-X07g7qLJ8aYe2rfHvZPH19fOTpEy_0 2024-09-12T18:01:50.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.718+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.721+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:01:50.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.722+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.722+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45198' 2024-09-12T18:01:50.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='_2pYNW3BVdhOh_xtWMy2rum6-nZ75as3', time=2024-09-12T19:52:55.900297+0000, chain.objs.size()=1 2024-09-12T18:01:50.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.161__shadow_.GEdEPIgNBctDt-mOuEZflHSyK9V2mUs_0 2024-09-12T18:01:50.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9967109995374222367', time=2024-09-12T19:52:58.735771+0000, chain.objs.size()=1 2024-09-12T18:01:50.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.167__shadow_.PoYs1jXyVoEfGPvIdXCDE9kIIk2L6Om_0 2024-09-12T18:01:50.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.215923276350711094', time=2024-09-12T19:54:02.770840+0000, chain.objs.size()=1 2024-09-12T18:01:50.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.246__shadow_.4MzL0fDFA9DvyClw7H8fE2fLlcg7Rih_0 2024-09-12T18:01:50.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17527454642610913655', time=2024-09-12T19:54:05.277401+0000, chain.objs.size()=1 2024-09-12T18:01:50.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.258__shadow_.AG6bs2kE3oe5QwdXdmKuXEZVoD30vzJ_0 2024-09-12T18:01:50.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8159500954476172034', time=2024-09-12T19:54:13.496749+0000, chain.objs.size()=1 2024-09-12T18:01:50.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.obtLD8-XNbvlylivGph0uA7HAR9BE4E_0 2024-09-12T18:01:50.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6248107926146789269', time=2024-09-12T19:54:13.522754+0000, chain.objs.size()=1 2024-09-12T18:01:50.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2nArGQqx9_EEksa3gloCXfOKkd--7bX_0 2024-09-12T18:01:50.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8128516762103377178', time=2024-09-12T19:54:13.559492+0000, chain.objs.size()=1 2024-09-12T18:01:50.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ytfG9QwJqYU_kixbo79qYgDx26WSZSw_0 2024-09-12T18:01:50.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11583678785394455202', time=2024-09-12T19:54:13.665906+0000, chain.objs.size()=1 2024-09-12T18:01:50.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.3aHAt49xy8-WQlc-HKJ-jorJwWXE1YI_0 2024-09-12T18:01:50.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16011343673207697072', time=2024-09-12T19:54:13.671590+0000, chain.objs.size()=1 2024-09-12T18:01:50.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.eh4vhIJ4BNlA4zPfyOPsb1ahIfOMW8V_0 2024-09-12T18:01:50.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14200478407437584316', time=2024-09-12T19:54:13.695160+0000, chain.objs.size()=1 2024-09-12T18:01:50.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Q41za7Z7pTVlRi0hcDMpuxUTXojfQjy_0 2024-09-12T18:01:50.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8326428928531179899', time=2024-09-12T19:54:13.701147+0000, chain.objs.size()=1 2024-09-12T18:01:50.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.h_GundlNd1Bpk8OLE1PvQktU_9Z___O_0 2024-09-12T18:01:50.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13833628636030738687', time=2024-09-12T19:54:13.709723+0000, chain.objs.size()=1 2024-09-12T18:01:50.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.723+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.b9mjKVetEsE6zw3Osrk5gkBj83MYJKN_0 2024-09-12T18:01:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.725+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7183379472232984755', time=2024-09-12T19:54:13.721375+0000, chain.objs.size()=1 2024-09-12T18:01:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.725+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Hu2OzpmF5sJUHsaFcKn6I50fn5Ge-mA_0 2024-09-12T18:01:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.726+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6673712053663529570', time=2024-09-12T19:54:13.854012+0000, chain.objs.size()=1 2024-09-12T18:01:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.726+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.iCAQPXzdUPyJlxsxx0UZWAl63Vxluct_0 2024-09-12T18:01:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.726+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15806887862444172419', time=2024-09-12T19:54:13.869684+0000, chain.objs.size()=1 2024-09-12T18:01:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.726+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2wBrMdgYZT1SNfjzJ-7g35P1S7Ws-Dc_0 2024-09-12T18:01:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.726+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11762467818919692154', time=2024-09-12T19:54:13.876475+0000, chain.objs.size()=1 2024-09-12T18:01:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.726+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.7ROalV3GGgVwXk2sKqI7x2Lu7cvyY19_0 2024-09-12T18:01:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.726+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1905667311081247173', time=2024-09-12T19:54:13.888401+0000, chain.objs.size()=1 2024-09-12T18:01:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.726+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.O10-WEc5z6t2Afm69jUDWWMPTuK420Y_0 2024-09-12T18:01:50.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.727+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5057779855792614949', time=2024-09-12T19:54:13.919592+0000, chain.objs.size()=1 2024-09-12T18:01:50.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.727+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.lLDgCDYrtfPpLjwf28bGQ_HObTHlnsz_0 2024-09-12T18:01:50.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.727+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10904271844374264691', time=2024-09-12T19:54:13.928285+0000, chain.objs.size()=1 2024-09-12T18:01:50.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.727+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.6xX942G4V7We1FNuPJA5yqN-ZyW_Ex8_0 2024-09-12T18:01:50.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.727+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11595099834906850501', time=2024-09-12T19:54:14.063253+0000, chain.objs.size()=1 2024-09-12T18:01:50.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.727+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ov3yFTwR96keGEs8G7fMICfbohAnZwx_0 2024-09-12T18:01:50.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.727+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11592909092384594445', time=2024-09-12T19:54:14.386523+0000, chain.objs.size()=1 2024-09-12T18:01:50.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.727+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.yYZt6fts_QqYhm1-ICxf8ro27uE-guj_0 2024-09-12T18:01:50.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.727+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13909658301835829891', time=2024-09-12T19:54:14.406319+0000, chain.objs.size()=1 2024-09-12T18:01:50.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.727+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.y79fn16Mg5wzNGQx_N5rzPjNcALVu-u_0 2024-09-12T18:01:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.727+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.301720802869351494', time=2024-09-12T19:54:14.422765+0000, chain.objs.size()=1 2024-09-12T18:01:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.727+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.vGxHNwGA_gNkX1cGqSbrSzsxJGppFfW_0 2024-09-12T18:01:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.727+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7325159646894196423', time=2024-09-12T19:54:14.441698+0000, chain.objs.size()=1 2024-09-12T18:01:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.727+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.5gFvYxgQgSqT55aLMdfetgVJPIFKkPT_0 2024-09-12T18:01:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.727+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9727826039441812976', time=2024-09-12T19:54:14.461199+0000, chain.objs.size()=1 2024-09-12T18:01:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.727+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.0HtfmSTTlKedO7k5n-xsc5XsMW9pcDL_0 2024-09-12T18:01:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.728+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12403724751547572752', time=2024-09-12T19:54:14.554832+0000, chain.objs.size()=1 2024-09-12T18:01:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.728+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.xIeAD47zh0rKr4eNy1giF47b67r9jwn_0 2024-09-12T18:01:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.730+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11383998650563628047', time=2024-09-12T19:54:14.556924+0000, chain.objs.size()=1 2024-09-12T18:01:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.730+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.CfuRz8CrhMI5dfGAaEj-gXCXAP3_7_E_0 2024-09-12T18:01:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.730+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7322202366970194317', time=2024-09-12T19:54:14.561328+0000, chain.objs.size()=1 2024-09-12T18:01:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.730+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.nXic0LZ-VH4EDjRU_evRlebQtIW0scK_0 2024-09-12T18:01:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.730+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7053636282426629193', time=2024-09-12T19:54:14.592484+0000, chain.objs.size()=1 2024-09-12T18:01:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.730+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.mj-lJqBhOdPRUvFx63T5SwOcvloHzBJ_0 2024-09-12T18:01:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.730+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4853227005926120585', time=2024-09-12T19:54:14.593671+0000, chain.objs.size()=1 2024-09-12T18:01:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.730+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.rO8I-3VCA2riux5-3uefstyQ8ZGoP7h_0 2024-09-12T18:01:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.730+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6891983441369709366', time=2024-09-12T19:54:14.608177+0000, chain.objs.size()=1 2024-09-12T18:01:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.730+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.om9WRZRb59V-dm3qY8tG0hgyDEJIX4s_0 2024-09-12T18:01:50.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.730+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11706326195613569396', time=2024-09-12T19:54:14.621355+0000, chain.objs.size()=1 2024-09-12T18:01:50.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.730+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.80-Qn29Nj9gQWBg0MXPstTlGDaqagxT_0 2024-09-12T18:01:50.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.730+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17789791086039993601', time=2024-09-12T19:54:14.738989+0000, chain.objs.size()=1 2024-09-12T18:01:50.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.730+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.OFq1u5vFQtRH2ektURaVCtsingkIak1_0 2024-09-12T18:01:50.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.732+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5314866929786558304', time=2024-09-12T19:54:14.746252+0000, chain.objs.size()=1 2024-09-12T18:01:50.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.732+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.dkSy6YYmc8iUL2AVgVhi822MUOcjH7l_0 2024-09-12T18:01:50.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.732+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17276455345851513492', time=2024-09-12T19:54:14.776647+0000, chain.objs.size()=1 2024-09-12T18:01:50.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.732+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Y8MVfFDX9U1k-6h933XA-JkC4CnAA11_0 2024-09-12T18:01:50.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.732+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.785248309048164053', time=2024-09-12T19:54:14.786367+0000, chain.objs.size()=1 2024-09-12T18:01:50.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.732+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.TprC9l7OZk9F9OoGzxj_VuQbQeY5jhm_0 2024-09-12T18:01:50.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.732+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10606362863399242099', time=2024-09-12T19:54:14.799733+0000, chain.objs.size()=1 2024-09-12T18:01:50.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.732+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.DEhcgTA9Miaauj1eWVBoYIsQiXFdFyS_0 2024-09-12T18:01:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.735+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6517921616111111944', time=2024-09-12T19:54:14.800688+0000, chain.objs.size()=1 2024-09-12T18:01:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.735+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.q4_x-R0nH1DNOcHn18Ei4Wbo_rVeX8o_0 2024-09-12T18:01:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.735+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7143242729566469686', time=2024-09-12T19:54:14.880944+0000, chain.objs.size()=1 2024-09-12T18:01:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.735+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.mi-mUK8MFCTOaWUQAUs_HzDvZ38HDPi_0 2024-09-12T18:01:50.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.735+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4538039704460266356', time=2024-09-12T19:54:15.313237+0000, chain.objs.size()=1 2024-09-12T18:01:50.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.735+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.265__shadow_._tsL2eSRXM-tNQr4aMPgeiu2q5vnV7d_0 2024-09-12T18:01:50.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.735+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12617989169698258630', time=2024-09-12T19:54:16.532782+0000, chain.objs.size()=1 2024-09-12T18:01:50.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.735+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.271__shadow_.5Kc8AAyzjdJCuYL9aKrnUJvBuecLvIt_0 2024-09-12T18:01:50.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.735+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6661166216428817855', time=2024-09-12T19:54:17.120789+0000, chain.objs.size()=1 2024-09-12T18:01:50.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.735+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.274__shadow_.e-pjazyoMSE35vgW5otSj9iQfkjpTVw_0 2024-09-12T18:01:50.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.735+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18206476530357363101', time=2024-09-12T19:54:17.354038+0000, chain.objs.size()=1 2024-09-12T18:01:50.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.735+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.275__shadow_.3lyTfEWb8iVZDGi-GYuS4XOAhgJgB_5_0 2024-09-12T18:01:50.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.735+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12696124734577691959', time=2024-09-12T19:54:17.768537+0000, chain.objs.size()=1 2024-09-12T18:01:50.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.735+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.277__shadow_.yQKUdN9Hw7-NWGy2LXErof-vjWjakKd_0 2024-09-12T18:01:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.738+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17568953733794890518', time=2024-09-12T19:54:17.977985+0000, chain.objs.size()=1 2024-09-12T18:01:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.738+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.278__shadow_.qY3j4WcCzzuRSeRd_B2ezG83hSZKtbl_0 2024-09-12T18:01:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.738+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16605241859947678446', time=2024-09-12T19:54:18.397389+0000, chain.objs.size()=1 2024-09-12T18:01:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.738+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.280__shadow_.VEE5q8n9_a0QPoQ2a2TkPhgtWQodePE_0 2024-09-12T18:01:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.738+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7280846239186374570', time=2024-09-12T19:54:19.058899+0000, chain.objs.size()=1 2024-09-12T18:01:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.738+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.283__shadow_.uWE5nApODjvbBJ4PtOzyB-P0fGDErCh_0 2024-09-12T18:01:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.738+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8976761930371647568', time=2024-09-12T19:54:21.577078+0000, chain.objs.size()=1 2024-09-12T18:01:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.738+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.cx5QZ-2sB7-Up0a4U08Z3wEiLrL6TU2_0 2024-09-12T18:01:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.738+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.624945292286064124', time=2024-09-12T19:54:21.578461+0000, chain.objs.size()=1 2024-09-12T18:01:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.738+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.k4jMa1wjHl4g58oqGXS35zFlzUeOdOe_0 2024-09-12T18:01:50.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12919374655404343733', time=2024-09-12T19:54:22.158612+0000, chain.objs.size()=1 2024-09-12T18:01:50.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.IYrDOs6AEbytfri2P7Hm-DTqolri8zt_0 2024-09-12T18:01:50.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16317527836723831756', time=2024-09-12T19:54:22.164492+0000, chain.objs.size()=1 2024-09-12T18:01:50.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.l7q3bzsVZwBz5bPzBIopyFoXe1TTELc_0 2024-09-12T18:01:50.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10229962652814727612', time=2024-09-12T19:54:22.171780+0000, chain.objs.size()=1 2024-09-12T18:01:50.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_._TAtUgbBohRWvaS7_86ywl7cmBDtqst_0 2024-09-12T18:01:50.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.274443411028715222', time=2024-09-12T19:54:22.422182+0000, chain.objs.size()=1 2024-09-12T18:01:50.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.295__shadow_.EPFdQZ0VorfXalCd_LwhdUVWhavlwBU_0 2024-09-12T18:01:50.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5218874213586693078', time=2024-09-12T19:54:23.772290+0000, chain.objs.size()=1 2024-09-12T18:01:50.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.301__shadow_.3r4nCqUFRHwnfCWZasqM4xiTdwT9u1I_0 2024-09-12T18:01:50.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1732706149253211376', time=2024-09-12T19:54:23.973320+0000, chain.objs.size()=1 2024-09-12T18:01:50.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.302__shadow_.66Qqvz0nWXtU4h02DGh_MaVJ-Egd6bf_0 2024-09-12T18:01:50.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17512266460688649996', time=2024-09-12T19:54:25.191805+0000, chain.objs.size()=1 2024-09-12T18:01:50.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.307__shadow_.xsxdLzlw-rxttllHw7PbviG25XKONJY_0 2024-09-12T18:01:50.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7beb922640 0 -- 172.21.15.44:0/3019346837 >> [v2:172.21.15.181:6826/1273321942,v1:172.21.15.181:6827/1273321942] conn(0x7f7ab4091ed0 msgr2=0x7f7ab40942c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:50.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3927179405933705749', time=2024-09-12T19:54:35.752077+0000, chain.objs.size()=1 2024-09-12T18:01:50.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.oB8a5QZeQ3up72ytHaoY-cd_xqyDpGC_0 2024-09-12T18:01:50.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7367989520486476433', time=2024-09-12T19:54:35.779319+0000, chain.objs.size()=1 2024-09-12T18:01:50.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.741+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ytdT_sk0C3M8Wj-gvt-s6fm9PbXPLsd_0 2024-09-12T18:01:50.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.743+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9262945417137571217', time=2024-09-12T19:54:35.829862+0000, chain.objs.size()=1 2024-09-12T18:01:50.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.743+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.jHU8sV22x1vtJfndxptaSqnv_ifwx9g_0 2024-09-12T18:01:50.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.743+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13024016423236702892', time=2024-09-12T19:54:35.970806+0000, chain.objs.size()=1 2024-09-12T18:01:50.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.743+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ztAm7L2NO6Gf5Z8KaBiQMSvS5xj44Ed_0 2024-09-12T18:01:50.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.743+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8761997138172877719', time=2024-09-12T19:54:36.091657+0000, chain.objs.size()=1 2024-09-12T18:01:50.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.743+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_._L9cgXBs8heLOGmSbx2_HS4Z-KTInDr_0 2024-09-12T18:01:50.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.743+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11788494729836481114', time=2024-09-12T19:54:36.098560+0000, chain.objs.size()=1 2024-09-12T18:01:50.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.743+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.baGDp69zbv0tTVtRi_9HicGYbLWdigv_0 2024-09-12T18:01:50.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3516622092531908570', time=2024-09-12T19:54:36.150210+0000, chain.objs.size()=1 2024-09-12T18:01:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.PIZ9BS9Akof5gC7KNNHd878cRMK2QhB_0 2024-09-12T18:01:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6842650008685146316', time=2024-09-12T19:54:36.171237+0000, chain.objs.size()=1 2024-09-12T18:01:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Uz6e_8wb1zYoLODRhGBLL4HzyilZkrW_0 2024-09-12T18:01:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2376583945121612559', time=2024-09-12T19:54:36.329974+0000, chain.objs.size()=1 2024-09-12T18:01:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.76_3pGQCgq6oMosilECAlWq1XxU084G_0 2024-09-12T18:01:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10926303822475615604', time=2024-09-12T19:54:36.331016+0000, chain.objs.size()=1 2024-09-12T18:01:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.xpb1HQAFD6MfobiuLeofnDwJlctfPQ3_0 2024-09-12T18:01:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2572105546257474415', time=2024-09-12T19:54:36.449790+0000, chain.objs.size()=1 2024-09-12T18:01:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0T81QRuC_0GnSLUcpGOll9OuhTmEqHT_0 2024-09-12T18:01:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11660712117748813168', time=2024-09-12T19:54:36.578012+0000, chain.objs.size()=1 2024-09-12T18:01:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.d4CNksyVtmgl4iZIhBjQtpY6klavhJU_0 2024-09-12T18:01:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5866936295975491936', time=2024-09-12T19:54:36.599199+0000, chain.objs.size()=1 2024-09-12T18:01:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.maUgpdy9LY5mbAeCfLUsLibtQ9Pbz2B_0 2024-09-12T18:01:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17351270582970345541', time=2024-09-12T19:54:36.603005+0000, chain.objs.size()=1 2024-09-12T18:01:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9eJsyo_BNGeNh8iioGur_s2Hfgs61Vc_0 2024-09-12T18:01:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15875644118162018747', time=2024-09-12T19:54:36.661559+0000, chain.objs.size()=1 2024-09-12T18:01:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Hlf1HOyR5EACGsWVsfFGesftDpmFeKB_0 2024-09-12T18:01:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16672144167786846773', time=2024-09-12T19:54:36.663005+0000, chain.objs.size()=1 2024-09-12T18:01:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.yz39XalZMJfyXuS3R7r1w9UEv1KOQJT_0 2024-09-12T18:01:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8980157611775644165', time=2024-09-12T19:54:36.665054+0000, chain.objs.size()=1 2024-09-12T18:01:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.746+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.S7dx-rOvHkbYJjw-uTHwqJkOCdIVsNL_0 2024-09-12T18:01:50.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.748+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2343995022297710352', time=2024-09-12T19:54:36.766431+0000, chain.objs.size()=1 2024-09-12T18:01:50.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.748+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.FFlc3yjRkKLntG4GSjccgXqUWzj8aGM_0 2024-09-12T18:01:50.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.748+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.437739489367365143', time=2024-09-12T19:54:36.804948+0000, chain.objs.size()=1 2024-09-12T18:01:50.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.748+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Lt0IF-JOfUHuPNJQDS-yNdbS1b95qhy_0 2024-09-12T18:01:50.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.748+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4157813717523496179', time=2024-09-12T19:54:36.812761+0000, chain.objs.size()=1 2024-09-12T18:01:50.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.748+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.A1mpCJQJ-ycHp9hrCXzFySSvWsOyRGt_0 2024-09-12T18:01:50.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.748+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10103229884978584094', time=2024-09-12T19:54:36.819945+0000, chain.objs.size()=1 2024-09-12T18:01:50.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.748+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.L1zO6tQEw5st_-49qCNlbIb4XFrWajU_0 2024-09-12T18:01:50.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.748+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15391805061207469954', time=2024-09-12T19:54:36.827076+0000, chain.objs.size()=1 2024-09-12T18:01:50.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.748+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.mxHrUTrFUy_fx-iambeEYxQQfEezAKq_0 2024-09-12T18:01:50.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.749+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5058061897764626510', time=2024-09-12T19:54:36.935694+0000, chain.objs.size()=1 2024-09-12T18:01:50.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.749+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.UtgFrE6hrq0pO6xITHMM9yOZNyeaqNf_0 2024-09-12T18:01:50.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.749+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16761848659059868981', time=2024-09-12T19:54:36.946808+0000, chain.objs.size()=1 2024-09-12T18:01:50.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.749+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.mIbcErOuVuhNODoBlEPwNUZy3RvNx5V_0 2024-09-12T18:01:50.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.749+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6750074983621437290', time=2024-09-12T19:54:44.456729+0000, chain.objs.size()=1 2024-09-12T18:01:50.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.749+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.BbHgCzZCR-D_V_Vq97_m10IO1At6Rwf_0 2024-09-12T18:01:50.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.749+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.438886310444346145', time=2024-09-12T19:54:44.524401+0000, chain.objs.size()=1 2024-09-12T18:01:50.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.749+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ZjbvMxbIoeybGf1sEibqRahkKFWcMxS_0 2024-09-12T18:01:50.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.749+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6502612053168227013', time=2024-09-12T19:54:44.664621+0000, chain.objs.size()=1 2024-09-12T18:01:50.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.749+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.LoXDWf8pg-P2eHx0d8Gk5tlbK1q9dtT_0 2024-09-12T18:01:50.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.749+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5577579559460025684', time=2024-09-12T19:54:44.678880+0000, chain.objs.size()=1 2024-09-12T18:01:50.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.749+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Hry616JVDNa5edGh2ovCErAZ_SyUxfe_0 2024-09-12T18:01:50.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.749+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12996885759364517845', time=2024-09-12T19:54:44.797423+0000, chain.objs.size()=1 2024-09-12T18:01:50.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.749+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.CAI4ycCJpelGmAwy5Dl6bRN8FfpVy21_0 2024-09-12T18:01:50.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.751+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3996465757105905568', time=2024-09-12T19:54:44.834669+0000, chain.objs.size()=1 2024-09-12T18:01:50.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.751+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jZnqMmNPLz2KDbR82jCxVM4b31Xukr1_0 2024-09-12T18:01:50.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12288233487153433756', time=2024-09-12T19:54:44.874059+0000, chain.objs.size()=1 2024-09-12T18:01:50.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Ex5ti0B8W2drgUe5O5I1rrMarZiq-5s_0 2024-09-12T18:01:50.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12453020358159156660', time=2024-09-12T19:54:44.966286+0000, chain.objs.size()=1 2024-09-12T18:01:50.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.P2Oht7cB0EXwmVvbjVgqRYhaVUpApqj_0 2024-09-12T18:01:50.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5523958227653191809', time=2024-09-12T19:54:44.967135+0000, chain.objs.size()=1 2024-09-12T18:01:50.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.iZmSiN92rl0gZWcP79Txb2gU-TZB5Oe_0 2024-09-12T18:01:50.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1204365812661210478', time=2024-09-12T19:54:44.994097+0000, chain.objs.size()=1 2024-09-12T18:01:50.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.BHyp2BkjxLAT4GrW_3Na6Jz6mwlAcF1_0 2024-09-12T18:01:50.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16411076916453077934', time=2024-09-12T19:54:45.241219+0000, chain.objs.size()=1 2024-09-12T18:01:50.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.cK091FVZjWQ0rrwnQMs-3MEj2y_nq-2_0 2024-09-12T18:01:50.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16387826442299626691', time=2024-09-12T19:54:45.257967+0000, chain.objs.size()=1 2024-09-12T18:01:50.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.2wj9TJCkHWZM9_MfHl5j_mrkrYi9-HP_0 2024-09-12T18:01:50.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18374371884646483388', time=2024-09-12T19:54:45.261441+0000, chain.objs.size()=1 2024-09-12T18:01:50.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-LGmEMiVAef36As1YWcTWgwww6qXvjO_0 2024-09-12T18:01:50.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1019912147538223519', time=2024-09-12T19:54:45.371558+0000, chain.objs.size()=1 2024-09-12T18:01:50.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.d0B2gIozYDGvXvqRSDo5r0MxYD70fUu_0 2024-09-12T18:01:50.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12552609370960353643', time=2024-09-12T19:54:45.372305+0000, chain.objs.size()=1 2024-09-12T18:01:50.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.vMl34VSnuyMa3nDjwng8VoYuLLP_-H7_0 2024-09-12T18:01:50.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8708913113126935315', time=2024-09-12T19:54:45.400027+0000, chain.objs.size()=1 2024-09-12T18:01:50.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.D9G_qnq7BB3NQ1-dkF6n3hpdhx_Ww4X_0 2024-09-12T18:01:50.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3969472425887706677', time=2024-09-12T19:54:45.428223+0000, chain.objs.size()=1 2024-09-12T18:01:50.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.754+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.YDsbfRCG8sznQAW66YZYbL8oCftdNZZ_0 2024-09-12T18:01:50.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.759+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10842202099754793832', time=2024-09-12T19:54:45.711398+0000, chain.objs.size()=1 2024-09-12T18:01:50.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.759+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ldldZ7XcOJV4SRVtLxCZt7AfDsMQFws_0 2024-09-12T18:01:50.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.759+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3330362312955316926', time=2024-09-12T19:54:45.732648+0000, chain.objs.size()=1 2024-09-12T18:01:50.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.759+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ZsZWTzYccfmDXTVQeO6iELpbGB-VSiU_0 2024-09-12T18:01:50.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.759+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17495133989838617920', time=2024-09-12T19:54:45.749965+0000, chain.objs.size()=1 2024-09-12T18:01:50.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.759+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.XONFaL7afTQjMc9lHT18fQTb1jx1LrH_0 2024-09-12T18:01:50.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.764+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/45198 2024-09-12T18:01:50.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T18:01:50.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17084218896418832776', time=2024-09-12T19:54:46.436756+0000, chain.objs.size()=1 2024-09-12T18:01:50.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.329__shadow_.IPTvgUDj6ayGM3gSpFLopE_WDgMrpiZ_0 2024-09-12T18:01:50.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6206162313783588316', time=2024-09-12T19:54:47.676004+0000, chain.objs.size()=1 2024-09-12T18:01:50.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.335__shadow_.j9bRtHKMlhZ4pq-KmdpRjeGutpcGG9v_0 2024-09-12T18:01:50.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8891397110161817109', time=2024-09-12T19:54:53.176903+0000, chain.objs.size()=1 2024-09-12T18:01:50.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.370__shadow_.5rmhNMy7qaR-mEJsJrPjYRspUaqofYp_0 2024-09-12T18:01:50.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8639737336753043660', time=2024-09-12T19:54:53.576575+0000, chain.objs.size()=1 2024-09-12T18:01:50.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.372__shadow_.e3fUGjyM3H-V0t-J_bafIfAFTX7iJiq_0 2024-09-12T18:01:50.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14796349955966466821', time=2024-09-12T19:54:57.400374+0000, chain.objs.size()=1 2024-09-12T18:01:50.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.383__shadow_.XXwvAxcqdGM5GpWCWhkU4FA18sJkHtD_0 2024-09-12T18:01:50.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5025501036329160460', time=2024-09-12T19:54:58.876196+0000, chain.objs.size()=1 2024-09-12T18:01:50.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.391__shadow_.HxoNbJeBxDNyfmyHpTsnxlchAZgo6AH_0 2024-09-12T18:01:50.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1825838603157056483', time=2024-09-12T19:55:08.815031+0000, chain.objs.size()=1 2024-09-12T18:01:50.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.434__shadow_.J5Crz12xAyrFbSnxduiPhR4IbM6eW5b_0 2024-09-12T18:01:50.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7068471876987000241', time=2024-09-12T19:55:21.821898+0000, chain.objs.size()=3 2024-09-12T18:01:50.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.487__shadow_.Icpxj_e126e0FtmrDvgpqBSzpwRyPwn_0 2024-09-12T18:01:50.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.487__shadow_.Icpxj_e126e0FtmrDvgpqBSzpwRyPwn_1 2024-09-12T18:01:50.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.487__shadow_.Icpxj_e126e0FtmrDvgpqBSzpwRyPwn_2 2024-09-12T18:01:50.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13290502531183877247', time=2024-09-12T19:55:23.455410+0000, chain.objs.size()=1 2024-09-12T18:01:50.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.494__shadow_.0_OKgnTh09iKcja9CyhjdTHdS_U-PoM_0 2024-09-12T18:01:50.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.233800197560330115', time=2024-09-12T19:55:28.215540+0000, chain.objs.size()=1 2024-09-12T18:01:50.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.767+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.512__multipart_mymultipart.2~UxZltc24BBsexReufzdo5yof-E8wdUb.1 2024-09-12T18:01:50.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.769+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~ylzgf-KZuqlxJ9Du_X0Uuk_dZfV9_s6', time=2024-09-12T19:55:37.307837+0000, chain.objs.size()=1 2024-09-12T18:01:50.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.769+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~ylzgf-KZuqlxJ9Du_X0Uuk_dZfV9_s6.1 2024-09-12T18:01:50.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~ylzgf-KZuqlxJ9Du_X0Uuk_dZfV9_s6', time=2024-09-12T19:55:37.309283+0000, chain.objs.size()=1 2024-09-12T18:01:50.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~ylzgf-KZuqlxJ9Du_X0Uuk_dZfV9_s6.2 2024-09-12T18:01:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~ylzgf-KZuqlxJ9Du_X0Uuk_dZfV9_s6', time=2024-09-12T19:55:37.310586+0000, chain.objs.size()=1 2024-09-12T18:01:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~ylzgf-KZuqlxJ9Du_X0Uuk_dZfV9_s6.3 2024-09-12T18:01:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~ylzgf-KZuqlxJ9Du_X0Uuk_dZfV9_s6', time=2024-09-12T19:55:37.311868+0000, chain.objs.size()=1 2024-09-12T18:01:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~ylzgf-KZuqlxJ9Du_X0Uuk_dZfV9_s6.4 2024-09-12T18:01:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~ylzgf-KZuqlxJ9Du_X0Uuk_dZfV9_s6', time=2024-09-12T19:55:37.313212+0000, chain.objs.size()=1 2024-09-12T18:01:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~ylzgf-KZuqlxJ9Du_X0Uuk_dZfV9_s6.5 2024-09-12T18:01:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~ylzgf-KZuqlxJ9Du_X0Uuk_dZfV9_s6', time=2024-09-12T19:55:37.314588+0000, chain.objs.size()=1 2024-09-12T18:01:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~ylzgf-KZuqlxJ9Du_X0Uuk_dZfV9_s6.6 2024-09-12T18:01:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16661560093691072730', time=2024-09-12T19:55:56.898087+0000, chain.objs.size()=4 2024-09-12T18:01:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.536__multipart_mymultipart.2~pT3Ra-up7LH8f5dxonGCTN_8LjvJoKE.1 2024-09-12T18:01:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.536__multipart_mymultipart.2~pT3Ra-up7LH8f5dxonGCTN_8LjvJoKE.2 2024-09-12T18:01:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.536__multipart_mymultipart.nBDBqLcOeMkQX77rV6zI14bYL_yxfmTZ.3 2024-09-12T18:01:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.536__multipart_mymultipart.2~pT3Ra-up7LH8f5dxonGCTN_8LjvJoKE.4 2024-09-12T18:01:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5639931893664123619', time=2024-09-12T19:56:21.220110+0000, chain.objs.size()=1 2024-09-12T18:01:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:i0KdFIPJn5El3NZ75U9b1B2kfwYIwFY_.p7dY1SfAO8huDbvgkDDIvCTFmiEFaGM_0 2024-09-12T18:01:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12346902046325246979', time=2024-09-12T19:56:40.689698+0000, chain.objs.size()=1 2024-09-12T18:01:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.774+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:aodpiOItZ3XeDY6UFdxIOIKXWPrPWAk_.p8L3nbnQDZE7PBYitD797yq5vCo-EnK_0 2024-09-12T18:01:50.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.777+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12301351826533961159', time=2024-09-12T19:56:42.810862+0000, chain.objs.size()=1 2024-09-12T18:01:50.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.777+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:lNHQ5QMsGHExNOTMh7cHzbJZcmAxmQ-_.v6Bsr3xTaS7GQUR70URIdmz2pXsGKKh_0 2024-09-12T18:01:50.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.777+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7392848667901849929', time=2024-09-12T19:56:43.785657+0000, chain.objs.size()=1 2024-09-12T18:01:50.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.777+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:zs7aQilOCvN.PzOis7cuBAk5x63uuAo_.tGx9dgZpIL5qYFkCMsUfonj9oLOfVt2_0 2024-09-12T18:01:50.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.777+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4350308019483102670', time=2024-09-12T19:56:51.616149+0000, chain.objs.size()=1 2024-09-12T18:01:50.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.777+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.584__shadow:SgDjjjtVm7U.I8.q-hfY-GGrI-C7DVk_.Wn3kmv22lG85fv7-w6ZPLsrGO_6Mkgv_0 2024-09-12T18:01:50.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.777+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10112086730902410760', time=2024-09-12T19:56:54.678843+0000, chain.objs.size()=1 2024-09-12T18:01:50.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.777+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.597__shadow_.Y0yOfNiR2YwvfL-EAfg148flyKm4xvU_0 2024-09-12T18:01:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.780+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15920280948028081018', time=2024-09-12T19:59:13.918818+0000, chain.objs.size()=1 2024-09-12T18:01:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.780+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.656__shadow_.IhI4duP2KNYHy4Pi2cyei6YrfHSAq-i_0 2024-09-12T18:01:50.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.780+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2263231741503827721', time=2024-09-12T19:59:26.487053+0000, chain.objs.size()=1 2024-09-12T18:01:50.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.780+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.707__shadow_.ZuQbqCF36VwzFnhssxhYmF5EXzyMcUW_0 2024-09-12T18:01:50.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.780+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15585975775035804483', time=2024-09-12T19:59:27.986698+0000, chain.objs.size()=1 2024-09-12T18:01:50.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.780+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.713__shadow:1rVtbe.VeO207IgRsqwpc1fVWFLrbfv_.z4ATc1BMDDeCJB9H9KmquPjEYQph5v9_0 2024-09-12T18:01:50.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.781+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.784+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:01:50.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.785+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.786+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47455' 2024-09-12T18:01:50.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1147674781429160400', time=2024-09-12T19:53:05.273392+0000, chain.objs.size()=1 2024-09-12T18:01:50.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.184__shadow_.5XaXQhpAygnJ9y_Ap09OUVsjy1gQcnh_0 2024-09-12T18:01:50.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~0Y6m7a1gaCsRPepquosMHfWtrrVIYxQ', time=2024-09-12T19:53:10.474693+0000, chain.objs.size()=1 2024-09-12T18:01:50.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.203__multipart_mymultipart.2~0Y6m7a1gaCsRPepquosMHfWtrrVIYxQ.1 2024-09-12T18:01:50.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2750336201747391866', time=2024-09-12T19:54:00.327219+0000, chain.objs.size()=1 2024-09-12T18:01:50.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.235__shadow_.DkROXuVazIyu6-YFS8GdcdigFSJGnbz_0 2024-09-12T18:01:50.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6192828713252653099', time=2024-09-12T19:54:01.249820+0000, chain.objs.size()=1 2024-09-12T18:01:50.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.239__shadow_.hZnGQNEXlwg6Bv2RNeNnFoVPqQLtRn2_0 2024-09-12T18:01:50.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12491375613907278854', time=2024-09-12T19:54:01.847558+0000, chain.objs.size()=1 2024-09-12T18:01:50.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.242__shadow_.BU1EiCUUxgWpDeLYdIYVx8K-c_e9aA3_0 2024-09-12T18:01:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2403844968713796065', time=2024-09-12T19:54:02.311588+0000, chain.objs.size()=1 2024-09-12T18:01:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.244__shadow_.F_ZJV-_Y3MTx_S_oOlrHdJOJY85dEPc_0 2024-09-12T18:01:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1409815733596986044', time=2024-09-12T19:54:03.418921+0000, chain.objs.size()=1 2024-09-12T18:01:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.249__shadow_.nVnncQRGXY-iR52g0fDSmCKwY9IbeAh_0 2024-09-12T18:01:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17717715337939222210', time=2024-09-12T19:54:04.471028+0000, chain.objs.size()=1 2024-09-12T18:01:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.254__shadow_.OEh9wbrNZ1dqakApB3oG2upkVgEKbEY_0 2024-09-12T18:01:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17741169459560631443', time=2024-09-12T19:54:05.474796+0000, chain.objs.size()=1 2024-09-12T18:01:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.259__shadow_.Z9nU-82EFLBPeGMu_peonBDy7zcoEWr_0 2024-09-12T18:01:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6176680931490401431', time=2024-09-12T19:54:05.475707+0000, chain.objs.size()=1 2024-09-12T18:01:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.259__shadow_.PoFRuECOp8u4mWtDmeO6OI9k6pr_tE9_0 2024-09-12T18:01:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2759913972163342862', time=2024-09-12T19:54:13.511953+0000, chain.objs.size()=1 2024-09-12T18:01:50.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.XU0BCBAo4IcNkSEJehHvxvaS7RROyOG_0 2024-09-12T18:01:50.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13368778815325494307', time=2024-09-12T19:54:13.548308+0000, chain.objs.size()=1 2024-09-12T18:01:50.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.787+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.CFlA4LRscDPDjTXUtYhmHNrYRjzUMKs_0 2024-09-12T18:01:50.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.789+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4948421616467580661', time=2024-09-12T19:54:13.553227+0000, chain.objs.size()=1 2024-09-12T18:01:50.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.789+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.pusktjRyDptR_DNGS2TOwtgUSc3mGus_0 2024-09-12T18:01:50.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9594735671676692275', time=2024-09-12T19:54:13.569616+0000, chain.objs.size()=1 2024-09-12T18:01:50.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.RO8bcWr_8E2UdteONdkpPcUNK4ujlA9_0 2024-09-12T18:01:50.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.741579681908904509', time=2024-09-12T19:54:13.687424+0000, chain.objs.size()=1 2024-09-12T18:01:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Ji5hBaS-pbXAwyZM_-FFffyOQW0ascE_0 2024-09-12T18:01:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10744517544042946216', time=2024-09-12T19:54:13.694344+0000, chain.objs.size()=1 2024-09-12T18:01:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.I69010OKWtg-ntEYd5m05pG8usXn_Oy_0 2024-09-12T18:01:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15710965700224190055', time=2024-09-12T19:54:13.725784+0000, chain.objs.size()=1 2024-09-12T18:01:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.t4GZLzDoz8ZWhOJWF_UUilG55QzLJH0_0 2024-09-12T18:01:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16240457238794112881', time=2024-09-12T19:54:13.743079+0000, chain.objs.size()=1 2024-09-12T18:01:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.h9JKtDtrbm5dNnVv5Rs42x4BKeEI9li_0 2024-09-12T18:01:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8942405945389895287', time=2024-09-12T19:54:13.748793+0000, chain.objs.size()=1 2024-09-12T18:01:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_._ks5HGu1Lz2NaVXpvm6Pbrb6S-mFPRD_0 2024-09-12T18:01:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4644017543994544402', time=2024-09-12T19:54:13.834095+0000, chain.objs.size()=1 2024-09-12T18:01:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.j01hj1DC5x4b4mWDs8BjnUKG3Ot3gWs_0 2024-09-12T18:01:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13086138717192258661', time=2024-09-12T19:54:13.848584+0000, chain.objs.size()=1 2024-09-12T18:01:50.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.SqtgmQjeYYZ3XNFW0tY62NiR8yaGfK2_0 2024-09-12T18:01:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4028066672953844288', time=2024-09-12T19:54:13.862468+0000, chain.objs.size()=1 2024-09-12T18:01:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.791+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.r3wYk9GcQ3wJpDU7KfK371RkMAAT3sf_0 2024-09-12T18:01:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.792+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6651056516593126506', time=2024-09-12T19:54:13.870130+0000, chain.objs.size()=1 2024-09-12T18:01:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.792+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.OYBS5jyI7VZY7rPmo2OMErVe-_pR8Ij_0 2024-09-12T18:01:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.792+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1202387623291307809', time=2024-09-12T19:54:13.910812+0000, chain.objs.size()=1 2024-09-12T18:01:50.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.792+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.PJbMH6k5Y4W0N8_IK_BVT8zie5Li6ir_0 2024-09-12T18:01:50.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.794+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15707918543111228993', time=2024-09-12T19:54:13.924278+0000, chain.objs.size()=1 2024-09-12T18:01:50.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.794+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.l86eD6grUyyW0wHfTZcQbKi7U1qPxsP_0 2024-09-12T18:01:50.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.794+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10891427322039030665', time=2024-09-12T19:54:14.008473+0000, chain.objs.size()=1 2024-09-12T18:01:50.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.794+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.i0Q5UBMu0nQUkynqvwlJLLv26J-_Wd1_0 2024-09-12T18:01:50.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.794+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6560726610910643949', time=2024-09-12T19:54:14.018867+0000, chain.objs.size()=1 2024-09-12T18:01:50.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.794+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.SPSnnwnm8kAP3Jw3J2M3EYCR1oNCQ7i_0 2024-09-12T18:01:50.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8712420632059523246', time=2024-09-12T19:54:14.048474+0000, chain.objs.size()=1 2024-09-12T18:01:50.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.SvPoZVQyyMjEyW585fcD5-mkR3k_hMO_0 2024-09-12T18:01:50.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2526865154946578329', time=2024-09-12T19:54:14.057345+0000, chain.objs.size()=1 2024-09-12T18:01:50.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-KJuUhkWdAJJHFj0-WYeKRu6GNaaQ5U_0 2024-09-12T18:01:50.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5060203743849068209', time=2024-09-12T19:54:14.075177+0000, chain.objs.size()=1 2024-09-12T18:01:50.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.sL1vwy_12-_jS3jETQtYVBca2FhIfk7_0 2024-09-12T18:01:50.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4286900281148807490', time=2024-09-12T19:54:14.399677+0000, chain.objs.size()=1 2024-09-12T18:01:50.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.wG5KCUGCexr3ybIbmz94tBSXJpOe2rd_0 2024-09-12T18:01:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16733534301527924922', time=2024-09-12T19:54:14.404243+0000, chain.objs.size()=1 2024-09-12T18:01:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.zZFALtZLU64fhFqEaWH6H5Gs5jRf95o_0 2024-09-12T18:01:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14167220377160005022', time=2024-09-12T19:54:14.408622+0000, chain.objs.size()=1 2024-09-12T18:01:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.RzMRAsS_QnJjGAmKR-hGa_u0B2jUcQu_0 2024-09-12T18:01:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12667228413012936294', time=2024-09-12T19:54:14.438028+0000, chain.objs.size()=1 2024-09-12T18:01:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.4pKm_URXRtcTdFSA8c-a4SpqQhBRr-m_0 2024-09-12T18:01:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18380194494967574693', time=2024-09-12T19:54:14.545297+0000, chain.objs.size()=1 2024-09-12T18:01:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.lmJTJ5l1OoQSrbPDwgA26KYGY5h8wD-_0 2024-09-12T18:01:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12156817014386510177', time=2024-09-12T19:54:14.563791+0000, chain.objs.size()=1 2024-09-12T18:01:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.34ufAHNyXVz-XyPeO26Vk1PhPZhgypJ_0 2024-09-12T18:01:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1977625124899641163', time=2024-09-12T19:54:14.623477+0000, chain.objs.size()=1 2024-09-12T18:01:50.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.796+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Fe76nIKu-4t16JXR76vSJwm9Wvsmk3Z_0 2024-09-12T18:01:50.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.797+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5210449214971495153', time=2024-09-12T19:54:14.746514+0000, chain.objs.size()=1 2024-09-12T18:01:50.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.797+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.BOc4jhOk9KgyP-F9dSj9NmjxHbsBpgR_0 2024-09-12T18:01:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6703736826586391275', time=2024-09-12T19:54:14.755880+0000, chain.objs.size()=1 2024-09-12T18:01:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.f8LgvmRS-RF90liPbLoXqP8aj48v3MS_0 2024-09-12T18:01:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15284900296052613101', time=2024-09-12T19:54:14.759406+0000, chain.objs.size()=1 2024-09-12T18:01:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.q0xwrCDxSjO-ew2SX1gokmuZJLjhtGD_0 2024-09-12T18:01:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7269478346752709186', time=2024-09-12T19:54:14.803291+0000, chain.objs.size()=1 2024-09-12T18:01:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.U_u9fkgkvDKUUEZsUHgWibewsmQOdWp_0 2024-09-12T18:01:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13161305263910213786', time=2024-09-12T19:54:14.874515+0000, chain.objs.size()=1 2024-09-12T18:01:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.x_BGpXxODP3QNqPPBd-1LNltjJRCd_4_0 2024-09-12T18:01:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5573009880360798564', time=2024-09-12T19:54:14.904099+0000, chain.objs.size()=1 2024-09-12T18:01:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.P1YruAM9MiO2LYIt17VkkBQEN0NKHCY_0 2024-09-12T18:01:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.499402594038541381', time=2024-09-12T19:54:14.904907+0000, chain.objs.size()=1 2024-09-12T18:01:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.N7aVnODR4GONelnQUyP0qhx1oiJdZKg_0 2024-09-12T18:01:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4192817296299404199', time=2024-09-12T19:54:14.937110+0000, chain.objs.size()=1 2024-09-12T18:01:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.SNWehECBe4lvUxk6IOStasRsvTBlk_M_0 2024-09-12T18:01:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8552027957153510567', time=2024-09-12T19:54:14.951022+0000, chain.objs.size()=1 2024-09-12T18:01:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.VhrIsuDXKioTwXPwuEmzPqOwv--y2t4_0 2024-09-12T18:01:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7278900159243245157', time=2024-09-12T19:54:16.334674+0000, chain.objs.size()=1 2024-09-12T18:01:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.798+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.270__shadow_.2yYpA7sa55SATKr12vHUF4xpzVbJ46r_0 2024-09-12T18:01:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.799+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17725573679904854319', time=2024-09-12T19:54:17.977801+0000, chain.objs.size()=1 2024-09-12T18:01:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.799+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.278__shadow_.mmE4GXQnw5kOIQOC8K7Y2T3FVcT7V_J_0 2024-09-12T18:01:50.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.799+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8799978913527183259', time=2024-09-12T19:54:21.576248+0000, chain.objs.size()=1 2024-09-12T18:01:50.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.799+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.oiMBk4q-tM5zFGyca444h1XEEV8NPjz_0 2024-09-12T18:01:50.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16567558638696367584', time=2024-09-12T19:54:21.588042+0000, chain.objs.size()=1 2024-09-12T18:01:50.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.f3ds08R0dxlsRLaFij0hP94wBHy-k5H_0 2024-09-12T18:01:50.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8874616505113525436', time=2024-09-12T19:54:22.164345+0000, chain.objs.size()=1 2024-09-12T18:01:50.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.FIchhR-T4XMVRHRwidfDT-BGhTfD-m7_0 2024-09-12T18:01:50.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11992253150565362670', time=2024-09-12T19:54:23.568019+0000, chain.objs.size()=1 2024-09-12T18:01:50.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.300__shadow_.m1Ze_4TbovdSd2RWCbcu_W0AT8EzHEQ_0 2024-09-12T18:01:50.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9377470561880346896', time=2024-09-12T19:54:26.957964+0000, chain.objs.size()=1 2024-09-12T18:01:50.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.316__shadow_.hZvA1QjyHFPCtw39awIqI9aFdyeqHtY_0 2024-09-12T18:01:50.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1153447060782134744', time=2024-09-12T19:54:27.638435+0000, chain.objs.size()=1 2024-09-12T18:01:50.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.320__shadow:3iYcbSbrL.47YjOzu8yJhiDa53sj-z5_.nWSsEhpOoPVE31Y9vpXdy-i3-U4pHHP_0 2024-09-12T18:01:50.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13377770137727704639', time=2024-09-12T19:54:35.766741+0000, chain.objs.size()=1 2024-09-12T18:01:50.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ZzMvzOLJfI6JWmiOT_U_RiiQlPYD9IO_0 2024-09-12T18:01:50.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16862974537002857609', time=2024-09-12T19:54:35.767638+0000, chain.objs.size()=1 2024-09-12T18:01:50.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ke6-fM9EAQL0Yr6LLNQACgo7EBCo9le_0 2024-09-12T18:01:50.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3796601718926268499', time=2024-09-12T19:54:35.774807+0000, chain.objs.size()=1 2024-09-12T18:01:50.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.yp8T7GasBa1qRWlE-q_ExJXnSAdn7dv_0 2024-09-12T18:01:50.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6815124187549588839', time=2024-09-12T19:54:35.778943+0000, chain.objs.size()=1 2024-09-12T18:01:50.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.3G_Fz8dfEewpcQEZmh_Sp_at-4gj6Ah_0 2024-09-12T18:01:50.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13251061806299215808', time=2024-09-12T19:54:35.782278+0000, chain.objs.size()=1 2024-09-12T18:01:50.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.5ppeYKI1GyyUlZ6GyPl-Sv9ep6kVN3H_0 2024-09-12T18:01:50.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14128223385998979679', time=2024-09-12T19:54:35.798175+0000, chain.objs.size()=1 2024-09-12T18:01:50.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.803+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.dZRQL4Plqq0RcFjuS4umIIiX-bSruIL_0 2024-09-12T18:01:50.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.805+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294503852716550054', time=2024-09-12T19:54:35.801480+0000, chain.objs.size()=1 2024-09-12T18:01:50.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.805+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.k2W-xBuSNrPmbQncvXbtwd_g-sQJ6vR_0 2024-09-12T18:01:50.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.805+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11797908139157744496', time=2024-09-12T19:54:35.811575+0000, chain.objs.size()=1 2024-09-12T18:01:50.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.805+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.8fKAoBSDgZkP1P07gvwu4KuY4QQgY-7_0 2024-09-12T18:01:50.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.805+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.997512059941705711', time=2024-09-12T19:54:35.835270+0000, chain.objs.size()=1 2024-09-12T18:01:50.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.805+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ys0UPwFa_n5fhPPWieFF6CTSLDEjpWM_0 2024-09-12T18:01:50.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.807+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17591333617707146502', time=2024-09-12T19:54:35.836565+0000, chain.objs.size()=1 2024-09-12T18:01:50.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.807+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.nih7e3iBnjvV9TM5QNOMRyYOiEVTe_D_0 2024-09-12T18:01:50.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5596437527596623213', time=2024-09-12T19:54:35.931813+0000, chain.objs.size()=1 2024-09-12T18:01:50.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Wnity8koFjod3jEkRDOE0aHEdFqvula_0 2024-09-12T18:01:50.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14931493503817308951', time=2024-09-12T19:54:35.938306+0000, chain.objs.size()=1 2024-09-12T18:01:50.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Nz7TsmKE-7M39ui4s1_5T5r07Wz50zA_0 2024-09-12T18:01:50.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6625294690984772219', time=2024-09-12T19:54:35.943929+0000, chain.objs.size()=1 2024-09-12T18:01:50.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.jlx26QVPrxvaKm2x2sm9BE2DI3c9XjJ_0 2024-09-12T18:01:50.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16028448387614357317', time=2024-09-12T19:54:36.008174+0000, chain.objs.size()=1 2024-09-12T18:01:50.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.TTkXNFC05XFQq3MBVVdIrV5o1G9JtVo_0 2024-09-12T18:01:50.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6395485820586636370', time=2024-09-12T19:54:36.085796+0000, chain.objs.size()=1 2024-09-12T18:01:50.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.u2cWmS9kU5qgOP9ncGoFHuKjr77-LId_0 2024-09-12T18:01:50.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8875656717825518159', time=2024-09-12T19:54:36.100067+0000, chain.objs.size()=1 2024-09-12T18:01:50.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.fMCcuuGGVhxgQRVvZzCNbIMDSeMPwEV_0 2024-09-12T18:01:50.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3339100799391676497', time=2024-09-12T19:54:36.121354+0000, chain.objs.size()=1 2024-09-12T18:01:50.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.d8aeN_U5B5J25Sza8l2RybOrxjNndkt_0 2024-09-12T18:01:50.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12635335424218386856', time=2024-09-12T19:54:36.122906+0000, chain.objs.size()=1 2024-09-12T18:01:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_._79Z9cj9xTwAJdF2iMD-qFE1WoaddzR_0 2024-09-12T18:01:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16592820964289322271', time=2024-09-12T19:54:36.172522+0000, chain.objs.size()=1 2024-09-12T18:01:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.808+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.N_ks9Yc_kEM0OEDp4VnDt3biV994qrE_0 2024-09-12T18:01:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14651206628090620147', time=2024-09-12T19:54:36.268630+0000, chain.objs.size()=1 2024-09-12T18:01:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.YW5Q9N4Mt8KjoRXbv4cjdlyAkothbre_0 2024-09-12T18:01:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12280794925691368175', time=2024-09-12T19:54:36.281014+0000, chain.objs.size()=1 2024-09-12T18:01:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.RAdBDhIhfEiauGizzmStSarksUcSln7_0 2024-09-12T18:01:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17103719819748607564', time=2024-09-12T19:54:36.282820+0000, chain.objs.size()=1 2024-09-12T18:01:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.wN1-ch6afELBO_xioQ08F4qv-tSiwAY_0 2024-09-12T18:01:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3129946087984149549', time=2024-09-12T19:54:36.340348+0000, chain.objs.size()=1 2024-09-12T18:01:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0gLqXAszeyJB3ikPRWkbAUJy8zqPesh_0 2024-09-12T18:01:50.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6225111763292016804', time=2024-09-12T19:54:36.439575+0000, chain.objs.size()=1 2024-09-12T18:01:50.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Hs2kO7FD7LTy2iPmvxAf9qK5tbOx9Lt_0 2024-09-12T18:01:50.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12652330693411960409', time=2024-09-12T19:54:36.451105+0000, chain.objs.size()=1 2024-09-12T18:01:50.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Sc3nYro4IBlSAXuMRMXaw4YU2wn4Iz7_0 2024-09-12T18:01:50.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17987199320011461730', time=2024-09-12T19:54:36.472166+0000, chain.objs.size()=1 2024-09-12T18:01:50.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.MQCqZnjOG-NzkG703pOmQebq3azTS1P_0 2024-09-12T18:01:50.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4861747203236416806', time=2024-09-12T19:54:36.584654+0000, chain.objs.size()=1 2024-09-12T18:01:50.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.z5drbJRttyqO_sL4m3X_1gjFlM_qpE4_0 2024-09-12T18:01:50.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14250416054407135699', time=2024-09-12T19:54:36.589823+0000, chain.objs.size()=1 2024-09-12T18:01:50.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.eDHCXhTb6a93_5K0k61lqsSYyLSyUvf_0 2024-09-12T18:01:50.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5459590146443768688', time=2024-09-12T19:54:36.603591+0000, chain.objs.size()=1 2024-09-12T18:01:50.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1wzA9bTT9M0fxzbFPdhWmo_uVm3Tc1D_0 2024-09-12T18:01:50.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13071997922781001198', time=2024-09-12T19:54:36.626349+0000, chain.objs.size()=1 2024-09-12T18:01:50.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.810+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.I-BG-9vEUoiWtel2KT9t-vfsoS2ZjGL_0 2024-09-12T18:01:50.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.812+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17350490492693240608', time=2024-09-12T19:54:36.651962+0000, chain.objs.size()=1 2024-09-12T18:01:50.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.812+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.dVAM_xGdoO6PCiLRGUCQe_-L0Z7_uWr_0 2024-09-12T18:01:50.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.812+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10960781944398131807', time=2024-09-12T19:54:36.741987+0000, chain.objs.size()=1 2024-09-12T18:01:50.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.812+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.NPCyW3fkdFwk_3eLgQ6q130Vs83AdEW_0 2024-09-12T18:01:50.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6232755819072429955', time=2024-09-12T19:54:36.744731+0000, chain.objs.size()=1 2024-09-12T18:01:50.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.P-kbHYbI8dgKOocJkEx5kJVriUS9arx_0 2024-09-12T18:01:50.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2188456256765881155', time=2024-09-12T19:54:36.746025+0000, chain.objs.size()=1 2024-09-12T18:01:50.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.nLftKnvrcB5C4Ruf6VAWiuWnzYKCRhO_0 2024-09-12T18:01:50.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12544711727588914375', time=2024-09-12T19:54:36.755023+0000, chain.objs.size()=1 2024-09-12T18:01:50.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.E0e2hdKXgvNRUiGIB5b4debQ080ULRU_0 2024-09-12T18:01:50.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9776848892020844548', time=2024-09-12T19:54:36.773055+0000, chain.objs.size()=1 2024-09-12T18:01:50.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.HO0pDg7TB8ATpPkwJlWkX-IWj5epu-B_0 2024-09-12T18:01:50.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6172409557384116441', time=2024-09-12T19:54:36.776100+0000, chain.objs.size()=1 2024-09-12T18:01:50.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.tpSfNuCTQo_eMcd7JiGO2NoY__1wDzj_0 2024-09-12T18:01:50.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7517719061067521068', time=2024-09-12T19:54:36.779702+0000, chain.objs.size()=1 2024-09-12T18:01:50.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.D2gdTuMXRKEe_oYzPlD68VnWkmH2xsp_0 2024-09-12T18:01:50.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13072056650475889389', time=2024-09-12T19:54:36.793197+0000, chain.objs.size()=1 2024-09-12T18:01:50.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.VQZ0oW7gY4Mdn7zWUjYK5t_OE7-Rp5-_0 2024-09-12T18:01:50.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1578692953010791044', time=2024-09-12T19:54:36.794690+0000, chain.objs.size()=1 2024-09-12T18:01:50.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.BixcJx5T8vJV0UbDXP7VEh7q00V2cUP_0 2024-09-12T18:01:50.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12444913202496005453', time=2024-09-12T19:54:36.815828+0000, chain.objs.size()=1 2024-09-12T18:01:50.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Kl9WsddqRREFteAfx4lqryr_7T8YP9R_0 2024-09-12T18:01:50.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.799599891366419343', time=2024-09-12T19:54:36.826979+0000, chain.objs.size()=1 2024-09-12T18:01:50.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.813+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.wr6oKIDeuxTng0S8b7vWREDGbqm-b_D_0 2024-09-12T18:01:50.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.815+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11848666281625424007', time=2024-09-12T19:54:36.913465+0000, chain.objs.size()=1 2024-09-12T18:01:50.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.815+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.jy0HmnYvLEB9iIcVTSAOoofDJWtjYmc_0 2024-09-12T18:01:50.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.815+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8558188972743502871', time=2024-09-12T19:54:44.513213+0000, chain.objs.size()=1 2024-09-12T18:01:50.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.815+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.oB7liGHudrQKJ4w00rkd20fMiqxFh2e_0 2024-09-12T18:01:50.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.815+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6353940493717906417', time=2024-09-12T19:54:44.548832+0000, chain.objs.size()=1 2024-09-12T18:01:50.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.815+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.qyydtTzYYasLdIOo_Nm3yroPk1fL9Bv_0 2024-09-12T18:01:50.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.815+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15127614347774627251', time=2024-09-12T19:54:44.641831+0000, chain.objs.size()=1 2024-09-12T18:01:50.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.816+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.hTXuflKBb4tLnMbhiQoNElzN672cqNP_0 2024-09-12T18:01:50.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.817+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/47455 2024-09-12T18:01:50.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T18:01:50.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6647336987825782991', time=2024-09-12T19:54:44.660427+0000, chain.objs.size()=1 2024-09-12T18:01:50.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.a-iGG4iYGXF6Sx_0XEz8k3aKDubAQwv_0 2024-09-12T18:01:50.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15277928017068940116', time=2024-09-12T19:54:44.702265+0000, chain.objs.size()=1 2024-09-12T18:01:50.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.m_6HPWkZcxlroARqN3tkHRymLdjO9CX_0 2024-09-12T18:01:50.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3741294000111102401', time=2024-09-12T19:54:44.716377+0000, chain.objs.size()=1 2024-09-12T18:01:50.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.p_ZoumGpsp6IMzDQfbRWZYEjMPdTq1a_0 2024-09-12T18:01:50.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.680409639046769777', time=2024-09-12T19:54:44.799513+0000, chain.objs.size()=1 2024-09-12T18:01:50.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.UaLEClWnehWSr-2aDUnJPREC6EnqdWR_0 2024-09-12T18:01:50.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15943040479955437866', time=2024-09-12T19:54:44.834495+0000, chain.objs.size()=1 2024-09-12T18:01:50.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.zLuT-leCOSvoTS9oX7JvTJECdc1VQpH_0 2024-09-12T18:01:50.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8046603554946858507', time=2024-09-12T19:54:44.835330+0000, chain.objs.size()=1 2024-09-12T18:01:50.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.scjSb9Y8crS8gkD2eOGuNLLClEB_z7m_0 2024-09-12T18:01:50.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11719227959573394943', time=2024-09-12T19:54:44.842068+0000, chain.objs.size()=1 2024-09-12T18:01:50.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.qw3ymmwonMJ4MKFCMSCBjrpQVD0A8Uf_0 2024-09-12T18:01:50.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12914798821568835121', time=2024-09-12T19:54:44.850203+0000, chain.objs.size()=1 2024-09-12T18:01:50.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.u38LC2WucaZvrcM5_H58itSTlB4xvGX_0 2024-09-12T18:01:50.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9679352611968712348', time=2024-09-12T19:54:44.863409+0000, chain.objs.size()=1 2024-09-12T18:01:50.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.QfhwZTEfpXXISaBarNkb1RsnV3J7DLs_0 2024-09-12T18:01:50.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2834358396083920883', time=2024-09-12T19:54:44.968014+0000, chain.objs.size()=1 2024-09-12T18:01:50.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.2DLSjRnxZumRXk9nd5V50M2p0PNa6s3_0 2024-09-12T18:01:50.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.85838064884691681', time=2024-09-12T19:54:44.969155+0000, chain.objs.size()=1 2024-09-12T18:01:50.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.dh-TFzXEz1q9IF2sC4e8TwbpCYDhhLD_0 2024-09-12T18:01:50.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1274043760541048459', time=2024-09-12T19:54:44.969828+0000, chain.objs.size()=1 2024-09-12T18:01:50.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.820+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.2kdj0EMfpIhLl8ontsuNlqX9Xhyzwdi_0 2024-09-12T18:01:50.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.821+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4774742014805461461', time=2024-09-12T19:54:45.001795+0000, chain.objs.size()=1 2024-09-12T18:01:50.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.821+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.pS3ffcr0ldUFORrAMeX26vUmeBEU13__0 2024-09-12T18:01:50.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.821+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13370445926369760402', time=2024-09-12T19:54:45.172502+0000, chain.objs.size()=1 2024-09-12T18:01:50.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.821+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.5oRMin5kZZkhjtoWYX6HNy4vu2IcK9I_0 2024-09-12T18:01:50.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8952997387559723573', time=2024-09-12T19:54:45.228557+0000, chain.objs.size()=1 2024-09-12T18:01:50.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.itM-L_VuVEwpBMqypr7SwqpsdVahiUX_0 2024-09-12T18:01:50.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16593919069318526968', time=2024-09-12T19:54:45.230836+0000, chain.objs.size()=1 2024-09-12T18:01:50.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.FzRsNOaUmVVJH1sL0VP34MZb_l19tFu_0 2024-09-12T18:01:50.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9808606418634302393', time=2024-09-12T19:54:45.252489+0000, chain.objs.size()=1 2024-09-12T18:01:50.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Xj-WuW4UC-eW5AM62yhIJtn8GzeB-PQ_0 2024-09-12T18:01:50.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2685787801367414888', time=2024-09-12T19:54:45.386964+0000, chain.objs.size()=1 2024-09-12T18:01:50.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.eRga5MY6gWmzyl6_Ml9iDVFw8SYpJV__0 2024-09-12T18:01:50.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13860626300904885345', time=2024-09-12T19:54:45.520589+0000, chain.objs.size()=1 2024-09-12T18:01:50.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.7_bGU15TCRAjdYPdwAGanCrSMzDezu7_0 2024-09-12T18:01:50.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15005622172156280570', time=2024-09-12T19:54:45.525503+0000, chain.objs.size()=1 2024-09-12T18:01:50.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.dM9XSO7jPrF4Jfp2zxc0JPMWLgtabh2_0 2024-09-12T18:01:50.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10765607370745489745', time=2024-09-12T19:54:45.684903+0000, chain.objs.size()=1 2024-09-12T18:01:50.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-EJf8w3euSqQS17k3eHmmzie7AvgvHj_0 2024-09-12T18:01:50.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11984172220177743499', time=2024-09-12T19:54:45.721967+0000, chain.objs.size()=1 2024-09-12T18:01:50.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.vbgkJJ326TtD7Bm3ll5zqsg8qsblO_9_0 2024-09-12T18:01:50.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5029626412617131439', time=2024-09-12T19:54:45.741986+0000, chain.objs.size()=1 2024-09-12T18:01:50.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.822+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.JhhR-nRG895WTg0882R3iDv5KdMP0pJ_0 2024-09-12T18:01:50.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.823+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9300019791945416625', time=2024-09-12T19:55:08.108365+0000, chain.objs.size()=1 2024-09-12T18:01:50.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.823+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.431__shadow_.Yeksn8XX_bs6jxykjKQuv0NFaSdLsBp_0 2024-09-12T18:01:50.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.823+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14345537879715742246', time=2024-09-12T19:55:12.856693+0000, chain.objs.size()=1 2024-09-12T18:01:50.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.823+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.451__shadow_.0544CihRjfTX3Iavsz-AfJqhqdurQXB_0 2024-09-12T18:01:50.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.824+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11057006270669370342', time=2024-09-12T19:55:20.953003+0000, chain.objs.size()=1 2024-09-12T18:01:50.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.824+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.484__shadow_.tij8aiV4svpWeEBUsAgl40QY34UtVwM_0 2024-09-12T18:01:50.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.824+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1818982345032857276', time=2024-09-12T19:55:38.169859+0000, chain.objs.size()=2 2024-09-12T18:01:50.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.824+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.524__multipart_mymultipart.2~lXR99q0QEFRwTbaSqyTMeoEQozn7zHP.1 2024-09-12T18:01:50.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.824+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.524__multipart_mymultipart.2~lXR99q0QEFRwTbaSqyTMeoEQozn7zHP.2 2024-09-12T18:01:50.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.824+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17546053626487880290', time=2024-09-12T19:55:38.545753+0000, chain.objs.size()=2 2024-09-12T18:01:50.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.824+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.524__multipart_mymultipart.2~9g2tPxo4pjtC72VuwvCOfXwIZ_m_MKe.1 2024-09-12T18:01:50.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.824+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.524__multipart_mymultipart.2~9g2tPxo4pjtC72VuwvCOfXwIZ_m_MKe.2 2024-09-12T18:01:50.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.824+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4844300744197634341', time=2024-09-12T19:56:24.802312+0000, chain.objs.size()=1 2024-09-12T18:01:50.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.824+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:eY0bKQVAKHIebUbKbZUOJQf.1ohZEMC_.NaOPxqo5R3JIhAu1WIpMAWOhxU0m9ab_0 2024-09-12T18:01:50.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.824+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13267259431546981606', time=2024-09-12T19:56:24.994992+0000, chain.objs.size()=1 2024-09-12T18:01:50.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.824+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:xjUaXH.q4Fl3rrBK7X9kRVlMv06c7NQ_.fsmh_8h26lBmdW94knYU4Fnuo2Aopz1_0 2024-09-12T18:01:50.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.824+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16010425852989022178', time=2024-09-12T19:56:25.143074+0000, chain.objs.size()=1 2024-09-12T18:01:50.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.824+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:mMPXOUd9TfY1-dBx6DTb3ZCzUqXJ8L._.XAuxJdmVQKqfQHGFDNTqBUCeWWiNtcj_0 2024-09-12T18:01:50.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.825+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1004508938543067811', time=2024-09-12T19:56:43.180043+0000, chain.objs.size()=1 2024-09-12T18:01:50.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.825+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:ExCIvXKlTGOG1kkL6Oqk8oRbLfusuO8_.goOvXzLHShrsdU6WaOTFqpAW_RF58F9_0 2024-09-12T18:01:50.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.825+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8790976479957645911', time=2024-09-12T19:56:46.271838+0000, chain.objs.size()=1 2024-09-12T18:01:50.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.825+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:Rs3kGl7NQw-b7uqkTVgE1wlfsg70rrB_.FAxf8g8zkWaKMDnNTL32nhepP1LKSZX_0 2024-09-12T18:01:50.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.825+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.117910462309602904', time=2024-09-12T19:56:49.061368+0000, chain.objs.size()=4 2024-09-12T18:01:50.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.825+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.579__multipart_testobj.2~cw_jyNpJyliQcRvhc6bmU74an1fGduv.1 2024-09-12T18:01:50.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.826+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.579__multipart_testobj.2~cw_jyNpJyliQcRvhc6bmU74an1fGduv.2 2024-09-12T18:01:50.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.826+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.579__multipart_testobj.2~cw_jyNpJyliQcRvhc6bmU74an1fGduv.3 2024-09-12T18:01:50.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.827+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.579__multipart_testobj.2~cw_jyNpJyliQcRvhc6bmU74an1fGduv.4 2024-09-12T18:01:50.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.827+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1551052403811015689', time=2024-09-12T19:59:17.512160+0000, chain.objs.size()=1 2024-09-12T18:01:50.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.827+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.665__shadow_.abQpqcgcAL_pGpwAhopFcFFUM12wnto_0 2024-09-12T18:01:50.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.828+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.830+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:01:50.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.832+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.832+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43942' 2024-09-12T18:01:50.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16784089097177693057', time=2024-09-12T19:52:57.836107+0000, chain.objs.size()=1 2024-09-12T18:01:50.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.163__shadow_.mcxmd8Hwy84dSNEWiAnRJ4Q7GzQQzYw_0 2024-09-12T18:01:50.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10542246080545328585', time=2024-09-12T19:54:03.821107+0000, chain.objs.size()=1 2024-09-12T18:01:50.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.251__shadow_.PP0gNaJA3sh6sA3Yv8Bvscfq0LMfO0k_0 2024-09-12T18:01:50.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13165125510448803001', time=2024-09-12T19:54:04.879752+0000, chain.objs.size()=1 2024-09-12T18:01:50.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.256__shadow_.0RslF5AZArZF0RMNfiVvNDxCS6YulnY_0 2024-09-12T18:01:50.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4039789177842329462', time=2024-09-12T19:54:13.525385+0000, chain.objs.size()=1 2024-09-12T18:01:50.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Kgb2IPikNTgBIkpt7L919Nos44V6UC3_0 2024-09-12T18:01:50.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1876835225550058450', time=2024-09-12T19:54:13.527033+0000, chain.objs.size()=1 2024-09-12T18:01:50.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.9-TTi3PMBtui0FpGLohSauwLiH6xHnz_0 2024-09-12T18:01:50.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11603727823854901410', time=2024-09-12T19:54:13.537592+0000, chain.objs.size()=1 2024-09-12T18:01:50.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_._TAbyDTJsUkcQrQ_GoXsnz-VOEdf_uM_0 2024-09-12T18:01:50.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14438845170221467895', time=2024-09-12T19:54:13.549775+0000, chain.objs.size()=1 2024-09-12T18:01:50.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.xBf9MTlVe2xs8N1dtAYcPGk6mweSomI_0 2024-09-12T18:01:50.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16658565859579275400', time=2024-09-12T19:54:13.550530+0000, chain.objs.size()=1 2024-09-12T18:01:50.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.G28N5FOVpVwf7Gxuvz0nmanTU_uEoV3_0 2024-09-12T18:01:50.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1600401719408929127', time=2024-09-12T19:54:13.742369+0000, chain.objs.size()=1 2024-09-12T18:01:50.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.5FMQJ2wyGO680YDANI_IFxx6xHlhUGK_0 2024-09-12T18:01:50.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.810720619382930339', time=2024-09-12T19:54:13.872704+0000, chain.objs.size()=1 2024-09-12T18:01:50.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.0gVlSQdY5GYvrvmPpp13k1JRxbgrmqh_0 2024-09-12T18:01:50.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16748830966583089135', time=2024-09-12T19:54:13.884442+0000, chain.objs.size()=1 2024-09-12T18:01:50.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.J0XiCZdA1-j2lpxRwPrAJCXhnmRDfKx_0 2024-09-12T18:01:50.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4313231649647336425', time=2024-09-12T19:54:13.886351+0000, chain.objs.size()=1 2024-09-12T18:01:50.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.833+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.EUnOMvM-Tl2K9hBghPEIWZE9Cx0YRDe_0 2024-09-12T18:01:50.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8840038863724999501', time=2024-09-12T19:54:13.922377+0000, chain.objs.size()=1 2024-09-12T18:01:50.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-7RJhsronawDyW7kdsGQsd33M3Spww1_0 2024-09-12T18:01:50.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8798904974320592977', time=2024-09-12T19:54:14.033951+0000, chain.objs.size()=1 2024-09-12T18:01:50.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.v-DF4wMeiHJbaI6eyF7MNVs9EyKQ_Ci_0 2024-09-12T18:01:50.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1495068690508219733', time=2024-09-12T19:54:14.045019+0000, chain.objs.size()=1 2024-09-12T18:01:50.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-kzdMHRCtI0jY1RwFcN7bEmHMypEFpp_0 2024-09-12T18:01:50.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2536655033982272135', time=2024-09-12T19:54:14.082411+0000, chain.objs.size()=1 2024-09-12T18:01:50.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.zf8oE3jOuXwbjxWWccVvWuEuqLpO9pT_0 2024-09-12T18:01:50.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7904295011421657560', time=2024-09-12T19:54:14.288366+0000, chain.objs.size()=1 2024-09-12T18:01:50.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.35rPGCHF9X3SX5PBvPj5EO_7hI_p188_0 2024-09-12T18:01:50.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4946005347742734645', time=2024-09-12T19:54:14.370765+0000, chain.objs.size()=1 2024-09-12T18:01:50.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.vwl3Tf38ZzbMHTaDXFTmUFE4YsNzlez_0 2024-09-12T18:01:50.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10455557946933770513', time=2024-09-12T19:54:14.380857+0000, chain.objs.size()=1 2024-09-12T18:01:50.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.D-e2YjpCUitx-RvTGOu8sh8PakhtG4f_0 2024-09-12T18:01:50.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6161587413535606465', time=2024-09-12T19:54:14.399231+0000, chain.objs.size()=1 2024-09-12T18:01:50.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.97iRIjUPyzseAk6MzkIt-WrJQijmSh2_0 2024-09-12T18:01:50.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4450988093512018510', time=2024-09-12T19:54:14.412827+0000, chain.objs.size()=1 2024-09-12T18:01:50.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.LbbDUNLnHDi5MWo82EzWbElxcH120GG_0 2024-09-12T18:01:50.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5937712640944596222', time=2024-09-12T19:54:14.450528+0000, chain.objs.size()=1 2024-09-12T18:01:50.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.CxAEiGqTxl0al6SYo5DMYHQTcLEEHTt_0 2024-09-12T18:01:50.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1686610567426851688', time=2024-09-12T19:54:14.464506+0000, chain.objs.size()=1 2024-09-12T18:01:50.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.835+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.4xrth57YPBGThuf_F-8QN0mocRT6uPQ_0 2024-09-12T18:01:50.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1243196215769578446', time=2024-09-12T19:54:14.594123+0000, chain.objs.size()=1 2024-09-12T18:01:50.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.2cao8RsrvJroDFrZ_L2Ol8yQpvpQ6dy_0 2024-09-12T18:01:50.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1940949747085978149', time=2024-09-12T19:54:14.725887+0000, chain.objs.size()=1 2024-09-12T18:01:50.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.7eIONEwHNMz6psyQ_L_Gu3t3D7aBrIW_0 2024-09-12T18:01:50.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3473939896103280011', time=2024-09-12T19:54:14.739589+0000, chain.objs.size()=1 2024-09-12T18:01:50.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.r6C2ojdVfP5NCmexYCrcD9loGceAAAd_0 2024-09-12T18:01:50.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10880374860914403280', time=2024-09-12T19:54:14.783687+0000, chain.objs.size()=1 2024-09-12T18:01:50.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.IRZdC_rtzrZQsTg1e1ZzuAQnzWM2koj_0 2024-09-12T18:01:50.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9072097161390270537', time=2024-09-12T19:54:15.705675+0000, chain.objs.size()=1 2024-09-12T18:01:50.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.267__shadow_.B4SZy64eNo9_CicgEbTeUloYB8PYAUl_0 2024-09-12T18:01:50.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5848542310344285034', time=2024-09-12T19:54:18.184052+0000, chain.objs.size()=1 2024-09-12T18:01:50.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.279__shadow_.q86bC2N8GfK0c75ZWhat81Xd27vWnda_0 2024-09-12T18:01:50.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11909217167894418432', time=2024-09-12T19:54:18.601888+0000, chain.objs.size()=1 2024-09-12T18:01:50.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.281__shadow_.K0YnWam-JWKLDVKFYYj_Cd7dnDq-hsU_0 2024-09-12T18:01:50.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4570425306236262623', time=2024-09-12T19:54:19.956618+0000, chain.objs.size()=1 2024-09-12T18:01:50.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.287__shadow_.UjEQkYpSjdr-jiIn8q5S4ipzYgZPZHA_0 2024-09-12T18:01:50.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4620496609339041433', time=2024-09-12T19:54:22.172684+0000, chain.objs.size()=1 2024-09-12T18:01:50.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.RFh5gm-b7S1-QqY6SZ2kpze8-XXUMj2_0 2024-09-12T18:01:50.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3597214921919818879', time=2024-09-12T19:54:22.628577+0000, chain.objs.size()=1 2024-09-12T18:01:50.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.296__shadow_.3gi0WnzjBPwNUKh4S-StHGoBwRjg_5t_0 2024-09-12T18:01:50.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16482421913099668873', time=2024-09-12T19:54:23.771317+0000, chain.objs.size()=1 2024-09-12T18:01:50.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.837+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.301__shadow_.PMzAPAux9oGJtDOOm54Gs3GVIF_CZik_0 2024-09-12T18:01:50.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.839+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7041371409118684827', time=2024-09-12T19:54:24.820687+0000, chain.objs.size()=1 2024-09-12T18:01:50.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.839+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.306__shadow_.De89WvIBrIBn5mQc9o97FIok1lRM7Sp_0 2024-09-12T18:01:50.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.839+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10842842492979930662', time=2024-09-12T19:54:27.641297+0000, chain.objs.size()=1 2024-09-12T18:01:50.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.839+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.320__shadow:dKuHULC9cEV8-hYijNJCdXPtVp7edqB_.OhKGe8WOMGfoaC1T-RqfWVxCIORifjA_0 2024-09-12T18:01:50.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.839+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4063026449162995661', time=2024-09-12T19:54:28.204736+0000, chain.objs.size()=1 2024-09-12T18:01:50.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.839+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.323__shadow_.XysTMIPT3mYMy8QQhc57lZL0knNNgAg_0 2024-09-12T18:01:50.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6007897931511488159', time=2024-09-12T19:54:35.815416+0000, chain.objs.size()=1 2024-09-12T18:01:50.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.BZ1l_PwgmozhGvPWVz0ztN2YT4-6taz_0 2024-09-12T18:01:50.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14242412438330842240', time=2024-09-12T19:54:35.816861+0000, chain.objs.size()=1 2024-09-12T18:01:50.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Is091LuX5YDfTujaby_7Dv2GQFWbusU_0 2024-09-12T18:01:50.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13222689861395124101', time=2024-09-12T19:54:35.818398+0000, chain.objs.size()=1 2024-09-12T18:01:50.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.FCPhpqc93Gr31uDwtQzWINZIpjzt-uq_0 2024-09-12T18:01:50.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5412632592295514824', time=2024-09-12T19:54:35.825548+0000, chain.objs.size()=1 2024-09-12T18:01:50.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.eZBC0TpAmI_WBvFlevFSs3wdCrfZ1RC_0 2024-09-12T18:01:50.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8109721790892568404', time=2024-09-12T19:54:35.835715+0000, chain.objs.size()=1 2024-09-12T18:01:50.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.kDBapGv48tzjZ7cYBaiEOIv2oVkP-Qz_0 2024-09-12T18:01:50.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1635458526131065205', time=2024-09-12T19:54:35.921087+0000, chain.objs.size()=1 2024-09-12T18:01:50.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.G_H_Wm3sRKi7kg6FqPgPv5GAr74AEK7_0 2024-09-12T18:01:50.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16358112447052354946', time=2024-09-12T19:54:35.955847+0000, chain.objs.size()=1 2024-09-12T18:01:50.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_._TNupzL9PNhObN8-tZllEkwJq8jqM_T_0 2024-09-12T18:01:50.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1966205202824983689', time=2024-09-12T19:54:35.970798+0000, chain.objs.size()=1 2024-09-12T18:01:50.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.M9YMStTurP4DVfp5sTGwUQ5GEG-skAL_0 2024-09-12T18:01:50.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4402068735422335173', time=2024-09-12T19:54:36.106683+0000, chain.objs.size()=1 2024-09-12T18:01:50.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ELWPYnjTjCp0k-qcA4hh92my7dXDeNy_0 2024-09-12T18:01:50.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17449543817948904488', time=2024-09-12T19:54:36.108919+0000, chain.objs.size()=1 2024-09-12T18:01:50.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.83RTSyVJvwshIt4SPSgly4inOat3MhK_0 2024-09-12T18:01:50.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.975767108160934578', time=2024-09-12T19:54:36.120137+0000, chain.objs.size()=1 2024-09-12T18:01:50.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.840+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.uSQBBqyO8lszp6LuRhvAmEuAaJbjV7A_0 2024-09-12T18:01:50.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.842+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7814079019900704388', time=2024-09-12T19:54:36.139126+0000, chain.objs.size()=1 2024-09-12T18:01:50.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.842+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rHOgin7og2hicfQS0AlKefVNImHvV6O_0 2024-09-12T18:01:50.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.842+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13060302392645689351', time=2024-09-12T19:54:36.161887+0000, chain.objs.size()=1 2024-09-12T18:01:50.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.842+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.d5hnUOUxbrRteuCwhNQNjWfCzjPJLro_0 2024-09-12T18:01:50.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.843+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4921870874355259611', time=2024-09-12T19:54:36.162734+0000, chain.objs.size()=1 2024-09-12T18:01:50.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.843+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Tnj5jR3ZfpnQeqMP5BsBUG0DNGSn7PS_0 2024-09-12T18:01:50.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.843+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10916729286195346826', time=2024-09-12T19:54:36.254732+0000, chain.objs.size()=1 2024-09-12T18:01:50.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.843+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.pO-b6i9GHANb41uug8NnQmx1v_fKVtb_0 2024-09-12T18:01:50.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.843+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12157521426747651390', time=2024-09-12T19:54:36.320357+0000, chain.objs.size()=1 2024-09-12T18:01:50.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.843+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.T_5y8s65MPX1OPOowYv9NQQrNTZO5mY_0 2024-09-12T18:01:50.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.843+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14388451913850775326', time=2024-09-12T19:54:36.416672+0000, chain.objs.size()=1 2024-09-12T18:01:50.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.843+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.R0iWgkGHTt133hRiyVmnxeKAlyO8vwB_0 2024-09-12T18:01:50.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.843+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11476967864368022006', time=2024-09-12T19:54:36.418047+0000, chain.objs.size()=1 2024-09-12T18:01:50.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.843+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Cd1xLbBJuZH0Krro1wwerpt3L6GLRI__0 2024-09-12T18:01:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.844+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1225036784432865916', time=2024-09-12T19:54:36.472977+0000, chain.objs.size()=1 2024-09-12T18:01:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.844+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.8AGl_-Qe6vwT3GxgiGRFiQ4E6tZeF6T_0 2024-09-12T18:01:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.844+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.563954316601719150', time=2024-09-12T19:54:36.486355+0000, chain.objs.size()=1 2024-09-12T18:01:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.844+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.yW3UlkE1Yde9_MWxcCzhtT6G_TY9rq-_0 2024-09-12T18:01:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.844+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9015502993166169830', time=2024-09-12T19:54:36.593049+0000, chain.objs.size()=1 2024-09-12T18:01:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.844+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.UARu8JW8Ei69ygXklmMIqpAWa_A1HGh_0 2024-09-12T18:01:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.844+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12028292249764756802', time=2024-09-12T19:54:36.600390+0000, chain.objs.size()=1 2024-09-12T18:01:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.844+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ohb9i9dLHRLHprbDEk7BTLhhpp1zOfR_0 2024-09-12T18:01:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.844+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13499192721063366253', time=2024-09-12T19:54:36.617430+0000, chain.objs.size()=1 2024-09-12T18:01:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.844+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.y4sBTm2lP3tlU4r1WrGMoytKo40AcRn_0 2024-09-12T18:01:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.845+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1337270754499700088', time=2024-09-12T19:54:36.620032+0000, chain.objs.size()=1 2024-09-12T18:01:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.845+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.V9MqI1oj2C-D15ZMu72PQkFoKBsiHP2_0 2024-09-12T18:01:50.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8973914007613213581', time=2024-09-12T19:54:36.621134+0000, chain.objs.size()=1 2024-09-12T18:01:50.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rHFAb-hp_8od2wqGoQ833gIMR-lfcJ8_0 2024-09-12T18:01:50.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1152396232975402842', time=2024-09-12T19:54:36.630945+0000, chain.objs.size()=1 2024-09-12T18:01:50.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.FZTF_jqvBSbx7i2eL3AiEQTOZVLdu8m_0 2024-09-12T18:01:50.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2071810734500692418', time=2024-09-12T19:54:36.643925+0000, chain.objs.size()=1 2024-09-12T18:01:50.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.wMsCLxAEPet9JlxhZpYPYfL9yo9B5un_0 2024-09-12T18:01:50.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14659095108077626464', time=2024-09-12T19:54:36.645382+0000, chain.objs.size()=1 2024-09-12T18:01:50.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.bmdCRxgjaxiqqoDbjojOdCCrp4lC-La_0 2024-09-12T18:01:50.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16416905030817830278', time=2024-09-12T19:54:36.761014+0000, chain.objs.size()=1 2024-09-12T18:01:50.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.8Vurc2p9xG90MIxbHp63fIcERp5Ejb8_0 2024-09-12T18:01:50.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7623768047291807003', time=2024-09-12T19:54:36.831860+0000, chain.objs.size()=1 2024-09-12T18:01:50.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.el-0voC6tKre-26EBvsGXEwOfFSN1qO_0 2024-09-12T18:01:50.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6208160754082779581', time=2024-09-12T19:54:36.901521+0000, chain.objs.size()=1 2024-09-12T18:01:50.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.yU9YowJ2umPMe25czrGSbefiEcrDTIM_0 2024-09-12T18:01:50.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6906325525293444231', time=2024-09-12T19:54:36.928720+0000, chain.objs.size()=1 2024-09-12T18:01:50.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.O1KrRRShejW33Qj4nK_ZLvq_rUtQ32A_0 2024-09-12T18:01:50.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15455838645598816536', time=2024-09-12T19:54:36.964106+0000, chain.objs.size()=1 2024-09-12T18:01:50.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.DKBAQAmwRWohTy59IgrZJU5NjnVKAqz_0 2024-09-12T18:01:50.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1729870473689877654', time=2024-09-12T19:54:44.474447+0000, chain.objs.size()=1 2024-09-12T18:01:50.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.846+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.aUPomLaxgFsYUsczSs7rCCX_weiUIMP_0 2024-09-12T18:01:50.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.847+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4270764961331684581', time=2024-09-12T19:54:44.493428+0000, chain.objs.size()=1 2024-09-12T18:01:50.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.847+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.cRwAU66Yj-ebAt_E78jHZSiSGCfzj6q_0 2024-09-12T18:01:50.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.848+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8576315603158296279', time=2024-09-12T19:54:44.536020+0000, chain.objs.size()=1 2024-09-12T18:01:50.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.848+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.kAIJgzOTVFL4TyIMggkHVxyjs7pMVp2_0 2024-09-12T18:01:50.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.848+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7516808737772944403', time=2024-09-12T19:54:44.656752+0000, chain.objs.size()=1 2024-09-12T18:01:50.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.848+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.d6I_UKRzJ66h1YdUCXzefdSBpErd67S_0 2024-09-12T18:01:50.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.848+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16247667574645519081', time=2024-09-12T19:54:44.659435+0000, chain.objs.size()=1 2024-09-12T18:01:50.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.848+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.gc201lJRdMTp70oEltSwb1CqEY5d5Dc_0 2024-09-12T18:01:50.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1659047762038492645', time=2024-09-12T19:54:44.802257+0000, chain.objs.size()=1 2024-09-12T18:01:50.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-AkgL_ojtFxnzwpDEF3I0paBKg4X4Oz_0 2024-09-12T18:01:50.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9918316321896051308', time=2024-09-12T19:54:44.823572+0000, chain.objs.size()=1 2024-09-12T18:01:50.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.6KHoD5VdMBPHZ5N4eTmuiZnB6m_SkPK_0 2024-09-12T18:01:50.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5638263354532056279', time=2024-09-12T19:54:44.869947+0000, chain.objs.size()=1 2024-09-12T18:01:50.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.aXhQ9HuWvIJErcAR_B6ccGQEFriPv5e_0 2024-09-12T18:01:50.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16291830223526522622', time=2024-09-12T19:54:44.976362+0000, chain.objs.size()=1 2024-09-12T18:01:50.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.f7Ox1xINWfJK8eAl14cf23R-rlPAenb_0 2024-09-12T18:01:50.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5905297560429881624', time=2024-09-12T19:54:45.003753+0000, chain.objs.size()=1 2024-09-12T18:01:50.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ZuyTj6NJvazxF_1c42-vQ0cF2Qy-Len_0 2024-09-12T18:01:50.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1323019389585101755', time=2024-09-12T19:54:45.019383+0000, chain.objs.size()=1 2024-09-12T18:01:50.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.XdhobssIAUQcU-fJMBdDXDJvU31UTDK_0 2024-09-12T18:01:50.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11741977948008738659', time=2024-09-12T19:54:45.033073+0000, chain.objs.size()=1 2024-09-12T18:01:50.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.fDUAefM9Kes0H66LdTF8OFolU2LAOpt_0 2024-09-12T18:01:50.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16932845311095870913', time=2024-09-12T19:54:45.050423+0000, chain.objs.size()=1 2024-09-12T18:01:50.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.VHqAjed9yrAJdCBzvIezad1xt56T1bb_0 2024-09-12T18:01:50.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12187888279312672371', time=2024-09-12T19:54:45.176588+0000, chain.objs.size()=1 2024-09-12T18:01:50.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.V1kiANvpQuFSNMtJ4h3K-JCnyIlqGhX_0 2024-09-12T18:01:50.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2502725383675485744', time=2024-09-12T19:54:45.183179+0000, chain.objs.size()=1 2024-09-12T18:01:50.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.849+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.QsfGS5GnHOLzyttd3lDd4Y5_BfQzwc5_0 2024-09-12T18:01:50.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.850+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18267225018880540321', time=2024-09-12T19:54:45.195413+0000, chain.objs.size()=1 2024-09-12T18:01:50.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.850+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Q6nmvLAKQfIAvOYjsu460uLj24w2w0J_0 2024-09-12T18:01:50.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.850+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8268599479391421408', time=2024-09-12T19:54:45.243278+0000, chain.objs.size()=1 2024-09-12T18:01:50.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.850+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.zqqw9LJOTYF18fghnofeJ9p4WXACRfo_0 2024-09-12T18:01:50.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.850+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7351771118171827860', time=2024-09-12T19:54:45.260883+0000, chain.objs.size()=1 2024-09-12T18:01:50.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.850+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.wyHAFHTSECbTNM9bhf5YHWvd_6jTOG9_0 2024-09-12T18:01:50.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.851+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1644577440125190079', time=2024-09-12T19:54:45.337618+0000, chain.objs.size()=1 2024-09-12T18:01:50.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.851+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.WPjzI2gSbc-BMbIKrglphLZMDSVNOe3_0 2024-09-12T18:01:50.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.851+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12081088374457451861', time=2024-09-12T19:54:45.345283+0000, chain.objs.size()=1 2024-09-12T18:01:50.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.851+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.V3gVaFT3F4YYKwcGSuQ9ZGeuDTQb6VC_0 2024-09-12T18:01:50.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.851+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8533173175907568484', time=2024-09-12T19:54:45.362941+0000, chain.objs.size()=1 2024-09-12T18:01:50.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.851+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.AYZtj92lgIez8aXdcIYnKfk3U7RXcL-_0 2024-09-12T18:01:50.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.851+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5404205336657340796', time=2024-09-12T19:54:45.364758+0000, chain.objs.size()=1 2024-09-12T18:01:50.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.852+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ODm8pGdKZCsq_jVFpW0l7qz3RYPJTTX_0 2024-09-12T18:01:50.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.852+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10800882511691198686', time=2024-09-12T19:54:45.536907+0000, chain.objs.size()=1 2024-09-12T18:01:50.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.852+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.sqlxoQ1vJwPP7wMlHNZtF2GBDbl_sMy_0 2024-09-12T18:01:50.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.852+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6282480217099497985', time=2024-09-12T19:54:45.545773+0000, chain.objs.size()=1 2024-09-12T18:01:50.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.852+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.PnPvrl_w0v_qKBlG7cavFq30a91P0YR_0 2024-09-12T18:01:50.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.852+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4483061208202081035', time=2024-09-12T19:54:45.552478+0000, chain.objs.size()=1 2024-09-12T18:01:50.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.852+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.GFJLY8DAXxaGiMqJ-1GV-t0DRPC6akL_0 2024-09-12T18:01:50.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.852+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9361366410884798829', time=2024-09-12T19:54:45.555105+0000, chain.objs.size()=1 2024-09-12T18:01:50.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.852+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.qlppheHVHKqiRPQ9zRP_Wy8P4Y21S61_0 2024-09-12T18:01:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.852+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5254351479422555638', time=2024-09-12T19:54:45.579285+0000, chain.objs.size()=1 2024-09-12T18:01:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.852+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.4DVjyvyPzv3qlxYIiOX2yStrzDAGgeK_0 2024-09-12T18:01:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.856+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.277450890923306656', time=2024-09-12T19:54:45.580276+0000, chain.objs.size()=1 2024-09-12T18:01:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.856+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.HETkkwXj3RA0Q9gzERawiOBYPjiSrmS_0 2024-09-12T18:01:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.856+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7732597406647744198', time=2024-09-12T19:54:45.581814+0000, chain.objs.size()=1 2024-09-12T18:01:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.856+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.cY6gzSOGXaBMh2kglsZUy2DA81KB_Yq_0 2024-09-12T18:01:50.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.856+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14780099238065001504', time=2024-09-12T19:54:45.586762+0000, chain.objs.size()=1 2024-09-12T18:01:50.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.856+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.qKoCl-to-HwTnOB8PHXgfCxEiVUUy_T_0 2024-09-12T18:01:50.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.862+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/43942 2024-09-12T18:01:50.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T18:01:50.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15602171680135707428', time=2024-09-12T19:54:45.675146+0000, chain.objs.size()=1 2024-09-12T18:01:50.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.I5IcxMCuV0L0sYzM7kfHhr76KL3DgmX_0 2024-09-12T18:01:50.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8563414717526156009', time=2024-09-12T19:54:45.694606+0000, chain.objs.size()=1 2024-09-12T18:01:50.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TpyBS6L-AAP-RbpdQ2bcStN33yJItkb_0 2024-09-12T18:01:50.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11276466332088859657', time=2024-09-12T19:54:45.701434+0000, chain.objs.size()=1 2024-09-12T18:01:50.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ju5KR6EH3g9eFLYvWR6jLEHX2z7hwf9_0 2024-09-12T18:01:50.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10056085431718405187', time=2024-09-12T19:54:45.712343+0000, chain.objs.size()=1 2024-09-12T18:01:50.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jSBXSji-HjJrH4nPLQcJ-__pVf3swdu_0 2024-09-12T18:01:50.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1865274032305584018', time=2024-09-12T19:54:45.718945+0000, chain.objs.size()=1 2024-09-12T18:01:50.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.odwmLTQCWieTzIraKS5_7Rc991qgDHB_0 2024-09-12T18:01:50.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12616697411668187399', time=2024-09-12T19:54:46.254947+0000, chain.objs.size()=1 2024-09-12T18:01:50.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.328__shadow_.-w3PiDrdFvW8yMpllhKKbklb7Itl9oo_0 2024-09-12T18:01:50.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9336022306327093449', time=2024-09-12T19:55:08.594959+0000, chain.objs.size()=1 2024-09-12T18:01:50.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.433__shadow_.J5nm_11ZwDQPa6YUCxmq0QhtidS8e46_0 2024-09-12T18:01:50.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5809940646099167908', time=2024-09-12T19:55:10.213827+0000, chain.objs.size()=1 2024-09-12T18:01:50.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.440__shadow_.klWHgx0Qtowc2WVhYEUqaEtuwRrUlna_0 2024-09-12T18:01:50.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1145541744391576907', time=2024-09-12T19:55:21.292413+0000, chain.objs.size()=1 2024-09-12T18:01:50.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.486__shadow_.FOQkQYWEYWoWVQ8bEZiN_Nhy2mGhYgS_0 2024-09-12T18:01:50.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8338025476075595264', time=2024-09-12T19:55:22.628043+0000, chain.objs.size()=1 2024-09-12T18:01:50.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.490__shadow_.D5_2eANMz4kFNt3O8dev1ia31LRVQuP_0 2024-09-12T18:01:50.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13505407724814763783', time=2024-09-12T19:55:26.007533+0000, chain.objs.size()=1 2024-09-12T18:01:50.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.504__shadow:LJGtw8qWDf3ub4lz88.3QWvXWYCll8k_.Bp6VPQ_fUJ9KipRh0aA-NF-t-jfxgdd_0 2024-09-12T18:01:50.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~9aCLA8KmB8EsIa6MZ0n66FZLEF9N3Lt', time=2024-09-12T19:55:42.901384+0000, chain.objs.size()=1 2024-09-12T18:01:50.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.865+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.534__multipart_mymultipart.2~9aCLA8KmB8EsIa6MZ0n66FZLEF9N3Lt.1 2024-09-12T18:01:50.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.867+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4074586723277259403', time=2024-09-12T19:56:12.784751+0000, chain.objs.size()=1 2024-09-12T18:01:50.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.867+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.557__shadow_.f9f9O7_1n_F8zz0KYpIbe_Ax9Gj8l_Y_0 2024-09-12T18:01:50.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.867+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11169538627334163858', time=2024-09-12T19:56:23.958121+0000, chain.objs.size()=1 2024-09-12T18:01:50.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.867+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:NyJd4gDWZF4kTGReU3bUKCAsNycwhRv_.4LbKE_MPldeCs-2ky6_ncw807QDCSxB_0 2024-09-12T18:01:50.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.867+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17913752921156460441', time=2024-09-12T19:56:26.622347+0000, chain.objs.size()=1 2024-09-12T18:01:50.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.867+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:KFPsp5FkZ.8V9LlfSXU.tFTmDNnuZgp_.rEFIZgmeXlD1Jyn6iyy0lVYVzHykDZk_0 2024-09-12T18:01:50.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.867+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14859798537611877608', time=2024-09-12T19:56:40.084070+0000, chain.objs.size()=1 2024-09-12T18:01:50.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.867+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:NtGS8WBYVrP-CRhG0lKURhN736Cc5DU_.dGIi74tV-PBGu_tCex_WR7MUee1rzqd_0 2024-09-12T18:01:50.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.868+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10185991986179238171', time=2024-09-12T19:56:44.359596+0000, chain.objs.size()=1 2024-09-12T18:01:50.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.868+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:rUg6we48bA2.tL5I8tpnBFgpmcvThaj_.1CnmOiNdHi1po4NgCY_Mz2GsAGBh9Ic_0 2024-09-12T18:01:50.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.868+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12373432423690772230', time=2024-09-12T19:56:52.499573+0000, chain.objs.size()=1 2024-09-12T18:01:50.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.868+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.586__shadow:80ZWOJ.yT2pHeSB.DQjB9d7Gnh64GGt_.3yFhXagE3RmB4cDwuYl63_L0QAKVl14_0 2024-09-12T18:01:50.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.868+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4922123025268465865', time=2024-09-12T19:58:01.973338+0000, chain.objs.size()=1 2024-09-12T18:01:50.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.868+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.618__shadow_.EEj-HZH4-o9Zi9585_QCPuqZDPHYfXK_0 2024-09-12T18:01:50.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.870+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7093130080637486074', time=2024-09-12T19:59:53.244892+0000, chain.objs.size()=1 2024-09-12T18:01:50.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.870+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.740__shadow_.DuYo4Iq3RLWtinHENUc4uS2PJAX4YuN_0 2024-09-12T18:01:50.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.873+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.878+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:01:50.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.879+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44921' 2024-09-12T18:01:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='_cUHzMgwMJOtAlEo0Ack2HYfLd241Yyj', time=2024-09-12T19:52:56.381037+0000, chain.objs.size()=1 2024-09-12T18:01:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__shadow_.OGOX0lx-262B61iGpY1gsKrUQ5CaX5M_0 2024-09-12T18:01:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='_OfhsTu0VU6gpdehFWQYIWG6jQL_rp2T', time=2024-09-12T19:52:57.916884+0000, chain.objs.size()=1 2024-09-12T18:01:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.164__shadow_.uJZfe_f4Rx8Big87cz7sINLkcGVsXp7_0 2024-09-12T18:01:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='_7FAnyHq7IkIe84X-WD3XLskhfOPaPeU', time=2024-09-12T19:52:58.508587+0000, chain.objs.size()=1 2024-09-12T18:01:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.166__shadow_.6aH97FxUypN2MhPkGndJCnqG-c42jBw_0 2024-09-12T18:01:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17987569349372033607', time=2024-09-12T19:54:00.083208+0000, chain.objs.size()=1 2024-09-12T18:01:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.234__shadow_.xkwCEHkfCs1WT8hIyEHIsDr6JJNw1vp_0 2024-09-12T18:01:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17646798580800482166', time=2024-09-12T19:54:01.429151+0000, chain.objs.size()=1 2024-09-12T18:01:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.240__shadow_.m1FKPIrejxyyb6UtMn2H4CPH4XXRsAR_0 2024-09-12T18:01:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12696511583161811732', time=2024-09-12T19:54:02.566849+0000, chain.objs.size()=1 2024-09-12T18:01:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.245__shadow_.GH6T9VMxVzi7u1T9Z8rjrUyY_UNDbtd_0 2024-09-12T18:01:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.187351719131995778', time=2024-09-12T19:54:06.113530+0000, chain.objs.size()=1 2024-09-12T18:01:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.262__shadow_.iDIvAy0YDEL7TVQAVipXKzxCkq73QGs_0 2024-09-12T18:01:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13905329531484954376', time=2024-09-12T19:54:13.484503+0000, chain.objs.size()=1 2024-09-12T18:01:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.NT_NqaVamTCSPxcKtoUIRI4DzeZCvYv_0 2024-09-12T18:01:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6708451356738673698', time=2024-09-12T19:54:13.489161+0000, chain.objs.size()=1 2024-09-12T18:01:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.880+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Y2Jn5bkFLez3jB4Sew9bfvvhk57mbIo_0 2024-09-12T18:01:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.881+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2326217880401655876', time=2024-09-12T19:54:13.523249+0000, chain.objs.size()=1 2024-09-12T18:01:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.881+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.D8Gm9BgepXoP53k-nAWDYIqAuzN2kTO_0 2024-09-12T18:01:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.881+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5235681767618169448', time=2024-09-12T19:54:13.529197+0000, chain.objs.size()=1 2024-09-12T18:01:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.881+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.YKSIJ_fJXdIsyuWQ0PKNu1yFx4mbKRd_0 2024-09-12T18:01:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.881+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8389022852241256234', time=2024-09-12T19:54:13.533702+0000, chain.objs.size()=1 2024-09-12T18:01:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.881+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.KzSDC2IB3nlrl6ruTXOUABW2dxxS6-7_0 2024-09-12T18:01:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.882+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13470667309334401807', time=2024-09-12T19:54:13.577838+0000, chain.objs.size()=1 2024-09-12T18:01:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.882+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.m2NxfRS5zrhWTpuowTrc5686NdNeTjh_0 2024-09-12T18:01:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.882+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10289882970673157682', time=2024-09-12T19:54:13.675806+0000, chain.objs.size()=1 2024-09-12T18:01:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.882+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.p2up-4yDgK68faoLHQtUv1FVfSO4_Om_0 2024-09-12T18:01:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.883+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16425429037793930121', time=2024-09-12T19:54:13.706175+0000, chain.objs.size()=1 2024-09-12T18:01:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.883+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ObBmz7p5V35kVq_oHFM0_F6FFosb1JP_0 2024-09-12T18:01:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.883+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18116502278667420039', time=2024-09-12T19:54:13.717620+0000, chain.objs.size()=1 2024-09-12T18:01:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.883+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.0BmAWbmMSiYQGlcQyllQzz5xIFfkAdp_0 2024-09-12T18:01:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.883+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3683078651582424363', time=2024-09-12T19:54:13.752068+0000, chain.objs.size()=1 2024-09-12T18:01:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.883+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.t2nCWP0Mk23W_P1NEy-zfJQv9odUzVj_0 2024-09-12T18:01:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.883+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9865302655407450543', time=2024-09-12T19:54:13.893098+0000, chain.objs.size()=1 2024-09-12T18:01:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.883+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.YV_mTNFeNeJZ6cqri75Qoz2eskrszqj_0 2024-09-12T18:01:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.883+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10341605306484294169', time=2024-09-12T19:54:14.010519+0000, chain.objs.size()=1 2024-09-12T18:01:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.883+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.m2B4EZrfhG2gKdwEA_44xRiu-ftHso7_0 2024-09-12T18:01:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.884+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11627080218379852033', time=2024-09-12T19:54:14.024588+0000, chain.objs.size()=1 2024-09-12T18:01:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.884+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.sWqLqiKPEjmVLlM8QNRjODw5JtD8Ngi_0 2024-09-12T18:01:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.884+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6642505736728879112', time=2024-09-12T19:54:14.049440+0000, chain.objs.size()=1 2024-09-12T18:01:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.884+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.GQL0KUqDZgUN1vt9Nwx1DUasEvIKGti_0 2024-09-12T18:01:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.884+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8466106348058695827', time=2024-09-12T19:54:14.098078+0000, chain.objs.size()=1 2024-09-12T18:01:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.884+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.lXqczay7ULWKf1QeTTBV2jU4xhTbo1G_0 2024-09-12T18:01:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.884+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4516558055562553906', time=2024-09-12T19:54:14.372551+0000, chain.objs.size()=1 2024-09-12T18:01:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.884+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.4nR3XH3ywdpqnyGMK6LqY3RnHRdLrm3_0 2024-09-12T18:01:50.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.885+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4376685673058895114', time=2024-09-12T19:54:14.433903+0000, chain.objs.size()=1 2024-09-12T18:01:50.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.885+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.EhFplOsDVIWjRmxDAIN08hfqEk0ybX5_0 2024-09-12T18:01:50.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.885+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17737829881605969471', time=2024-09-12T19:54:14.446158+0000, chain.objs.size()=1 2024-09-12T18:01:50.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.885+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.R6XZn2yTCUfmEBPT8cPBDw9q2xKf_nB_0 2024-09-12T18:01:50.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.885+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11493069393265500154', time=2024-09-12T19:54:14.459693+0000, chain.objs.size()=1 2024-09-12T18:01:50.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.885+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.x8L6TApkDS8dB-KN_r7BMCUj4_L_Di6_0 2024-09-12T18:01:50.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.885+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16498145172677336983', time=2024-09-12T19:54:14.543862+0000, chain.objs.size()=1 2024-09-12T18:01:50.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.885+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.yqtVNYKUx8mdxfRmdy9dOCj9k8x1dpK_0 2024-09-12T18:01:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.885+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14329955446775280517', time=2024-09-12T19:54:14.552771+0000, chain.objs.size()=1 2024-09-12T18:01:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.885+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Bziqbjz41X9rMKtzJztbE7NZZHr2Kbo_0 2024-09-12T18:01:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.885+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8440533914810292516', time=2024-09-12T19:54:14.554879+0000, chain.objs.size()=1 2024-09-12T18:01:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.885+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.AmpbcpfQYJS1jV2C4uSbkszR44KQoSQ_0 2024-09-12T18:01:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.885+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11622633698431604463', time=2024-09-12T19:54:14.597902+0000, chain.objs.size()=1 2024-09-12T18:01:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.885+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.k1n_oKUiqmn39KUWdN3-63DazMcFdEp_0 2024-09-12T18:01:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.886+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6879910881022348862', time=2024-09-12T19:54:14.605354+0000, chain.objs.size()=1 2024-09-12T18:01:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.886+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.b7Pp97Wj_2PzKwFXcDI2Z-IOecdf-ga_0 2024-09-12T18:01:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.886+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2598637568608346664', time=2024-09-12T19:54:14.611022+0000, chain.objs.size()=1 2024-09-12T18:01:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.886+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.yoPFxuD23YIe_ya8bnka2frapx52Z5q_0 2024-09-12T18:01:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.886+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18386790450266848058', time=2024-09-12T19:54:14.712919+0000, chain.objs.size()=1 2024-09-12T18:01:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.886+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.TpkwQtaE0HztlbTqqIZacTM-ayHGBB9_0 2024-09-12T18:01:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.886+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8842428310169187547', time=2024-09-12T19:54:14.724274+0000, chain.objs.size()=1 2024-09-12T18:01:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.886+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.08IbkGQbcGd39UP-_OqhbVU-8cCdoxL_0 2024-09-12T18:01:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.887+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10844133037672229142', time=2024-09-12T19:54:14.725476+0000, chain.objs.size()=1 2024-09-12T18:01:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.887+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.VJXEiy_IUbZDAEjlK5oHWZnGzTZ_jVd_0 2024-09-12T18:01:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3138238512806398778', time=2024-09-12T19:54:14.733809+0000, chain.objs.size()=1 2024-09-12T18:01:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.1Qd7xaGVr4FdPEovwRTzq8m8kA3y4S5_0 2024-09-12T18:01:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4944723139647177905', time=2024-09-12T19:54:14.737502+0000, chain.objs.size()=1 2024-09-12T18:01:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.AMBqSiUdMPEehr52a-19S7ZfLbhFRQ3_0 2024-09-12T18:01:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4802256982473729476', time=2024-09-12T19:54:14.751435+0000, chain.objs.size()=1 2024-09-12T18:01:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.m3oftZ_b8-UBQClC0zBAENHfW5YVjrn_0 2024-09-12T18:01:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13089988294292034950', time=2024-09-12T19:54:14.755738+0000, chain.objs.size()=1 2024-09-12T18:01:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.l0gha52OKa0vLxMJPIv85UzV3P9v-TE_0 2024-09-12T18:01:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17014383064305673429', time=2024-09-12T19:54:14.782443+0000, chain.objs.size()=1 2024-09-12T18:01:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.sR1TxzTnXBN0Fy4EVnLDNya5wgArx5o_0 2024-09-12T18:01:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.272027198138880984', time=2024-09-12T19:54:14.884772+0000, chain.objs.size()=1 2024-09-12T18:01:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Z9s4ygW4qkcbdqmr5XWFBiexGphcwES_0 2024-09-12T18:01:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3689738535822699891', time=2024-09-12T19:54:14.924704+0000, chain.objs.size()=1 2024-09-12T18:01:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.9DTilnKDbsVwGySUMMmEsFm_sDvdall_0 2024-09-12T18:01:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18254023708672510810', time=2024-09-12T19:54:14.926239+0000, chain.objs.size()=1 2024-09-12T18:01:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.sVsZQc_zsI2lMSoNy2IDgNeHRN-mWLx_0 2024-09-12T18:01:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10821519789180746554', time=2024-09-12T19:54:15.118650+0000, chain.objs.size()=1 2024-09-12T18:01:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.264__shadow_.jU1VOgbrQoOw9O4suE2Ryg30zYKsMhT_0 2024-09-12T18:01:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11422153924627048716', time=2024-09-12T19:54:16.923838+0000, chain.objs.size()=1 2024-09-12T18:01:50.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.888+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.273__shadow_.JogwC0FyLm25MsBFWEKJ7__zDkPFIEt_0 2024-09-12T18:01:50.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.889+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16315201019982855002', time=2024-09-12T19:54:19.260044+0000, chain.objs.size()=1 2024-09-12T18:01:50.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.889+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.284__shadow_.8_cor2yuaJ9TcqEdIWGXPABFGGwgTmR_0 2024-09-12T18:01:50.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15516999836464084002', time=2024-09-12T19:54:21.588992+0000, chain.objs.size()=1 2024-09-12T18:01:50.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.EuUxyDw3pPlzxvRp2VwIJ9t4uvfYO4t_0 2024-09-12T18:01:50.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2029858464886087165', time=2024-09-12T19:54:22.832953+0000, chain.objs.size()=1 2024-09-12T18:01:50.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.297__shadow_.QR2kJjprM6rC5of0xvIbDOT49rqG9ZQ_0 2024-09-12T18:01:50.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10972216802338439896', time=2024-09-12T19:54:24.176877+0000, chain.objs.size()=1 2024-09-12T18:01:50.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.303__shadow_.pHltBWFQBmCCOpR0CQaJ6hBWpefLEw__0 2024-09-12T18:01:50.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.316864533679738506', time=2024-09-12T19:54:24.821520+0000, chain.objs.size()=1 2024-09-12T18:01:50.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.306__shadow_.-XGnu0hWl-HMlqNlTRJYB604CaKphQr_0 2024-09-12T18:01:50.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15607403452952132137', time=2024-09-12T19:54:35.747919+0000, chain.objs.size()=1 2024-09-12T18:01:50.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.UOZfsURAJbNw3eTAnJ6zIpxct5KEOy9_0 2024-09-12T18:01:50.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6012183150553193640', time=2024-09-12T19:54:35.757722+0000, chain.objs.size()=1 2024-09-12T18:01:50.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.i2B7Hc96tCBKO_c-eOAAewhkSJ2dLwc_0 2024-09-12T18:01:50.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4272956053896514476', time=2024-09-12T19:54:35.776616+0000, chain.objs.size()=1 2024-09-12T18:01:50.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.XiuYmElVlQr65mXzJ2hp2AzJ4WOGfh6_0 2024-09-12T18:01:50.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14937613031846066554', time=2024-09-12T19:54:35.800777+0000, chain.objs.size()=1 2024-09-12T18:01:50.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.DY56gPhyuXHtOx9kx3tjCrIrFRpR9ov_0 2024-09-12T18:01:50.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14846046954035238218', time=2024-09-12T19:54:35.815065+0000, chain.objs.size()=1 2024-09-12T18:01:50.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.890+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.fzQBG9cENNPh3Hr_wcMTsQECBv_uBGr_0 2024-09-12T18:01:50.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.891+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15657235902464476056', time=2024-09-12T19:54:35.833845+0000, chain.objs.size()=1 2024-09-12T18:01:50.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.891+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.zYfpzFxIK7iscmoeNOPNfCi3sTHnydZ_0 2024-09-12T18:01:50.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.891+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15930515308117568564', time=2024-09-12T19:54:35.838940+0000, chain.objs.size()=1 2024-09-12T18:01:50.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.891+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.6f35jOd23ce_I7SmdqQSl1ol4C-RlLZ_0 2024-09-12T18:01:50.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.892+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12464165490370815548', time=2024-09-12T19:54:35.995335+0000, chain.objs.size()=1 2024-09-12T18:01:50.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.892+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.VCAZsbyM8q0lxGf-e9MPJ-eWrPWL37C_0 2024-09-12T18:01:50.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.892+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.638444209549388540', time=2024-09-12T19:54:36.095915+0000, chain.objs.size()=1 2024-09-12T18:01:50.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.892+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.vSNdKQa2kf_gVxg4uUXQiEMnmGM95n4_0 2024-09-12T18:01:50.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.892+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9910604357856296585', time=2024-09-12T19:54:36.111580+0000, chain.objs.size()=1 2024-09-12T18:01:50.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.892+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.gDOyO-Q4tNoMumDZlRRqVNcjBNZxZP5_0 2024-09-12T18:01:50.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.892+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6022444640015903935', time=2024-09-12T19:54:36.127902+0000, chain.objs.size()=1 2024-09-12T18:01:50.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.892+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QnWENO4dWG3vGXpBR3StnXIUcywKr___0 2024-09-12T18:01:50.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.892+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1017922028803287629', time=2024-09-12T19:54:36.152574+0000, chain.objs.size()=1 2024-09-12T18:01:50.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.892+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QYgHbS3gir0VtC9cZ4SvEG8X7Tx3XoH_0 2024-09-12T18:01:50.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.892+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8356457448842315283', time=2024-09-12T19:54:36.165756+0000, chain.objs.size()=1 2024-09-12T18:01:50.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.892+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9NDr6NGA0VK_jJUFQY9rIasRdD5lKlY_0 2024-09-12T18:01:50.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.892+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5261132817698434228', time=2024-09-12T19:54:36.172865+0000, chain.objs.size()=1 2024-09-12T18:01:50.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.892+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.s2uRK2Lp_KRw25uYrt-n3MzS372WWSM_0 2024-09-12T18:01:50.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.892+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11041240348847702934', time=2024-09-12T19:54:36.251987+0000, chain.objs.size()=1 2024-09-12T18:01:50.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.892+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.wAXRfuRxyrEijEe0KEvLkcvscSnD2uV_0 2024-09-12T18:01:50.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.893+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17412466133842861007', time=2024-09-12T19:54:36.266071+0000, chain.objs.size()=1 2024-09-12T18:01:50.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.893+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.GiuxuWNghzY4dwOcsJvIdqM7TzVySg3_0 2024-09-12T18:01:50.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.893+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11217019883827905826', time=2024-09-12T19:54:36.314191+0000, chain.objs.size()=1 2024-09-12T18:01:50.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.893+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.shIsLlvCQfQVhTpOkcdjYyRzMUV8PAX_0 2024-09-12T18:01:50.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.894+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15650330496644909491', time=2024-09-12T19:54:36.318253+0000, chain.objs.size()=1 2024-09-12T18:01:50.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.894+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.HFGSvga8T3EX4xivZJM_ksFajrKMUxl_0 2024-09-12T18:01:50.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.894+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.965088700812744798', time=2024-09-12T19:54:36.336742+0000, chain.objs.size()=1 2024-09-12T18:01:50.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.894+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.uVzdh-jpcv3ja3NqHVvPfLBvvulNOpc_0 2024-09-12T18:01:50.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.894+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2449479473602861229', time=2024-09-12T19:54:36.427706+0000, chain.objs.size()=1 2024-09-12T18:01:50.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.894+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.XxTRczvTD8xtvPmGHEyiNTTyz9xCPcD_0 2024-09-12T18:01:50.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.894+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11946901797906026462', time=2024-09-12T19:54:36.454910+0000, chain.objs.size()=1 2024-09-12T18:01:50.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.894+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.X9nmdCmFhL6A_YaCoJVHLHVFWpMcPxT_0 2024-09-12T18:01:50.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.894+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8681902266895024950', time=2024-09-12T19:54:36.504834+0000, chain.objs.size()=1 2024-09-12T18:01:50.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.894+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.6zekuc3Ig3Hl6uJr3TdR67Ei5KcxFee_0 2024-09-12T18:01:50.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.895+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17808618357805132754', time=2024-09-12T19:54:36.606672+0000, chain.objs.size()=1 2024-09-12T18:01:50.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.895+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.OixGLGujuohFQpI_i-_4M3sS70-Z_jX_0 2024-09-12T18:01:50.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.895+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13558630697435032999', time=2024-09-12T19:54:36.615555+0000, chain.objs.size()=1 2024-09-12T18:01:50.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.895+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.GlGVSwU8n9MA9h9vvITOUf8jUyx-ZbM_0 2024-09-12T18:01:50.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.895+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13331483065433434588', time=2024-09-12T19:54:36.667434+0000, chain.objs.size()=1 2024-09-12T18:01:50.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.895+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.KB0L8yAGV4YsUI7if7GBem4HCCWNnva_0 2024-09-12T18:01:50.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.895+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7798606646358475715', time=2024-09-12T19:54:36.766182+0000, chain.objs.size()=1 2024-09-12T18:01:50.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.895+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Xd_p_tmXGVKiZ0uAcYzAub1GBkkgqyn_0 2024-09-12T18:01:50.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.895+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9655777085704176860', time=2024-09-12T19:54:36.772274+0000, chain.objs.size()=1 2024-09-12T18:01:50.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.895+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.zBWRNBhzW1X-9VTmFLSStsXBox2J967_0 2024-09-12T18:01:50.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.896+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4624018018304559368', time=2024-09-12T19:54:36.790603+0000, chain.objs.size()=1 2024-09-12T18:01:50.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.896+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ViIXD2pNJwSYIAtoc8UmgSF9Gij6oR-_0 2024-09-12T18:01:50.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.896+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7460770866656224240', time=2024-09-12T19:54:36.824298+0000, chain.objs.size()=1 2024-09-12T18:01:50.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.896+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Oe82467dnYedb90ZZHzeCv94Y7fMIsO_0 2024-09-12T18:01:50.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.896+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12446729944929352035', time=2024-09-12T19:54:36.945584+0000, chain.objs.size()=1 2024-09-12T18:01:50.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.896+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.GSiYa611AMVvKGwOHO4WUixPIsAMD9C_0 2024-09-12T18:01:50.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.896+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14248154652677474584', time=2024-09-12T19:54:36.957641+0000, chain.objs.size()=1 2024-09-12T18:01:50.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.896+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rRm1w2UaRfqNGrtlcM9bq378fQv9luU_0 2024-09-12T18:01:50.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.896+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14248835783986188018', time=2024-09-12T19:54:36.969163+0000, chain.objs.size()=1 2024-09-12T18:01:50.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.896+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.F8SJB5-_uF9__Ot0EUTv9yZX-CvV4j5_0 2024-09-12T18:01:50.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.896+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17675219780774980687', time=2024-09-12T19:54:44.467217+0000, chain.objs.size()=1 2024-09-12T18:01:50.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.896+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.NvkFU7GL53EnnOm720UFQJ5ntZ00Xej_0 2024-09-12T18:01:50.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.897+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14655508790910899798', time=2024-09-12T19:54:44.480407+0000, chain.objs.size()=1 2024-09-12T18:01:50.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.897+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TlNIovt_8NgsaV0D6clZXgtHKM2DnHM_0 2024-09-12T18:01:50.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.897+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14179712833975973322', time=2024-09-12T19:54:44.507454+0000, chain.objs.size()=1 2024-09-12T18:01:50.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.897+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.KiRT45FgzPsDoxovXfulFB3MuzlDrgB_0 2024-09-12T18:01:50.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.897+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1502795407876086566', time=2024-09-12T19:54:44.634019+0000, chain.objs.size()=1 2024-09-12T18:01:50.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.897+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.iifEI7JohNmIbFLnfLf_g7UflfBzurm_0 2024-09-12T18:01:50.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.897+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17004811171598462294', time=2024-09-12T19:54:44.645342+0000, chain.objs.size()=1 2024-09-12T18:01:50.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.897+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.IQ2n5m6AmbBBmPPBe1wn9oujDn3zw67_0 2024-09-12T18:01:50.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.897+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6457036200811534185', time=2024-09-12T19:54:44.648184+0000, chain.objs.size()=1 2024-09-12T18:01:50.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.897+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9ucwV-AT0PNi2Dpbuz250nLpUEciHIG_0 2024-09-12T18:01:50.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.898+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.141451031561764458', time=2024-09-12T19:54:44.649605+0000, chain.objs.size()=1 2024-09-12T18:01:50.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.898+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.QzgscBLP6EFX2cRRvXJq3Ts_LT_9TQ1_0 2024-09-12T18:01:50.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9817528597964427484', time=2024-09-12T19:54:44.660767+0000, chain.objs.size()=1 2024-09-12T18:01:50.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.0g_yMxPLgeCfKtHr13JALhw4cMAHtFJ_0 2024-09-12T18:01:50.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.465739515110486333', time=2024-09-12T19:54:44.675145+0000, chain.objs.size()=1 2024-09-12T18:01:50.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.nZR0RiHW6-qPpq7BvVowJrYNd390pel_0 2024-09-12T18:01:50.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15365049458289418163', time=2024-09-12T19:54:44.715679+0000, chain.objs.size()=1 2024-09-12T18:01:50.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.6EAS_r0bMhvsA09-eM7PqU_kpUT9zQ8_0 2024-09-12T18:01:50.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13804673777898651954', time=2024-09-12T19:54:44.812035+0000, chain.objs.size()=1 2024-09-12T18:01:50.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ykD-W4011sh6meGwXMyagHdkduS4Qcp_0 2024-09-12T18:01:50.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15935025817136814175', time=2024-09-12T19:54:44.863942+0000, chain.objs.size()=1 2024-09-12T18:01:50.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ycZx3CFNtHNAgG6QBJxa-IGN3K7V5Dq_0 2024-09-12T18:01:50.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7988338188985112840', time=2024-09-12T19:54:44.882096+0000, chain.objs.size()=1 2024-09-12T18:01:50.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.V5a7bZfFhywtP6pdzKnPofN6cvZmnTq_0 2024-09-12T18:01:50.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16878119201975941676', time=2024-09-12T19:54:44.885154+0000, chain.objs.size()=1 2024-09-12T18:01:50.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.NBVcIsIlVp2Iq6s9BC2fJu6lf93vQAN_0 2024-09-12T18:01:50.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13378215112706602569', time=2024-09-12T19:54:44.964627+0000, chain.objs.size()=1 2024-09-12T18:01:50.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.pCuyco_bOM2V67S1OfhL7FOIrjvzX1w_0 2024-09-12T18:01:50.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17537614922524774513', time=2024-09-12T19:54:44.980309+0000, chain.objs.size()=1 2024-09-12T18:01:50.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-hOBUt6HrU2OQSSB5MygfIIxvmwc8sM_0 2024-09-12T18:01:50.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2421473731213534153', time=2024-09-12T19:54:44.982988+0000, chain.objs.size()=1 2024-09-12T18:01:50.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.899+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ilXldepJg9qCHWzq7oslLDHl-8lSqMn_0 2024-09-12T18:01:50.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.901+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2747217474886833673', time=2024-09-12T19:54:44.987849+0000, chain.objs.size()=1 2024-09-12T18:01:50.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.901+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.rGbyau9GIobYTwEZt_WWh1bLEG50E5h_0 2024-09-12T18:01:50.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.902+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/44921 2024-09-12T18:01:50.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-12T18:01:50.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16515231976930219208', time=2024-09-12T19:54:45.043314+0000, chain.objs.size()=1 2024-09-12T18:01:50.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.I5bcLH4-uBw7HvhmMdquwo_Yt6UDMvS_0 2024-09-12T18:01:50.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2091131194777382998', time=2024-09-12T19:54:45.192385+0000, chain.objs.size()=1 2024-09-12T18:01:50.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.BU4DgJ-0K_0DjhBpm0qelR6AWNJVvrD_0 2024-09-12T18:01:50.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16673872836931598113', time=2024-09-12T19:54:45.194018+0000, chain.objs.size()=1 2024-09-12T18:01:50.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.zzLg_ydhF6kGEH-2nl9MHGVnJAyVR8k_0 2024-09-12T18:01:50.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18430938874104850927', time=2024-09-12T19:54:45.201207+0000, chain.objs.size()=1 2024-09-12T18:01:50.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.aEVDkKVWaJKzISw0bH5og84OA4L2-e__0 2024-09-12T18:01:50.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13811998826781756055', time=2024-09-12T19:54:45.212419+0000, chain.objs.size()=1 2024-09-12T18:01:50.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Ymoy1OyNbdz9f7XDe5NKr9G1UDKogNW_0 2024-09-12T18:01:50.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8539434071743646624', time=2024-09-12T19:54:45.214112+0000, chain.objs.size()=1 2024-09-12T18:01:50.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ir2hgBHSylhbahXag78pMVyECVk859E_0 2024-09-12T18:01:50.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2612211704222554664', time=2024-09-12T19:54:45.228037+0000, chain.objs.size()=1 2024-09-12T18:01:50.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.7Lemi9hrgXS_BThdgZhSC-UFoJzs6nN_0 2024-09-12T18:01:50.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7240399957952047728', time=2024-09-12T19:54:45.239915+0000, chain.objs.size()=1 2024-09-12T18:01:50.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.NCts2nFuxz4Ydwh7XeulY6IkeJrBlie_0 2024-09-12T18:01:50.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18419442657781599722', time=2024-09-12T19:54:45.418708+0000, chain.objs.size()=1 2024-09-12T18:01:50.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.3CEZSui6xqSSpcD1zw079sh59uos-xD_0 2024-09-12T18:01:50.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18218228662162114669', time=2024-09-12T19:54:45.431750+0000, chain.objs.size()=1 2024-09-12T18:01:50.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.-dx9fwFubjfFAb6-KEr0wQXTLjB1D4s_0 2024-09-12T18:01:50.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2318797907703511463', time=2024-09-12T19:54:45.433812+0000, chain.objs.size()=1 2024-09-12T18:01:50.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.hE5Wkqs7RegUfWLAQjqosctia4oxTIU_0 2024-09-12T18:01:50.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13864483888181351324', time=2024-09-12T19:54:45.511972+0000, chain.objs.size()=1 2024-09-12T18:01:50.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.904+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.YOvNRDhKYxCun7dkx9ojqWOd0BJ9g6P_0 2024-09-12T18:01:50.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.906+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16547325943849680363', time=2024-09-12T19:54:45.582437+0000, chain.objs.size()=1 2024-09-12T18:01:50.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.906+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.eXH9gi-8d8RKn92ZtCHesk-Kd4pIQzM_0 2024-09-12T18:01:50.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.906+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1695732354776582676', time=2024-09-12T19:54:45.586794+0000, chain.objs.size()=1 2024-09-12T18:01:50.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.906+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.j9OfATjtH4w8V8lupn5Cdx381ow_wMH_0 2024-09-12T18:01:50.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.906+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15667217368605617416', time=2024-09-12T19:54:45.685461+0000, chain.objs.size()=1 2024-09-12T18:01:50.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.906+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.qL-y8Bm4gy-ZemkC8b2NeZo7JOFdies_0 2024-09-12T18:01:50.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.906+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13465974037289086825', time=2024-09-12T19:54:45.700478+0000, chain.objs.size()=1 2024-09-12T18:01:50.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.906+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.OKHyUKaJL0YPznR4Nm97tUR-sX3rsiP_0 2024-09-12T18:01:50.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.906+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11574586906283533145', time=2024-09-12T19:54:45.709231+0000, chain.objs.size()=1 2024-09-12T18:01:50.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.906+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.rggHhKOgCC9TOXggzm2jzPdZ592sqyZ_0 2024-09-12T18:01:50.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.906+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16411457966785974607', time=2024-09-12T19:54:45.740878+0000, chain.objs.size()=1 2024-09-12T18:01:50.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.906+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.hfh0WLMehtl6sszAFhuWuHqnQ5R58fa_0 2024-09-12T18:01:50.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.907+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5546135063250099384', time=2024-09-12T19:54:45.745905+0000, chain.objs.size()=1 2024-09-12T18:01:50.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.907+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.l_j6yNzg1COdsyvx7h_8HtSJG93KYCK_0 2024-09-12T18:01:50.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.907+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4021332843830470611', time=2024-09-12T19:54:45.748738+0000, chain.objs.size()=1 2024-09-12T18:01:50.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.907+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ppkgP9mZHEEU61Yv6PLh4POqJJiXqyj_0 2024-09-12T18:01:50.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.907+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11900418701770406571', time=2024-09-12T19:54:46.599508+0000, chain.objs.size()=1 2024-09-12T18:01:50.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.907+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.330__shadow_.UcRkpr_7t-xZ1otkxQdF0uiWyuBUYFk_0 2024-09-12T18:01:50.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.907+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7671419718684013592', time=2024-09-12T19:54:49.953954+0000, chain.objs.size()=1 2024-09-12T18:01:50.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.907+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.347__shadow_.T0fMg4W9k_gjdZa5LRfLF_Smr83rGtI_0 2024-09-12T18:01:50.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.907+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12419808007363713129', time=2024-09-12T19:54:57.084512+0000, chain.objs.size()=1 2024-09-12T18:01:50.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.907+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.382__shadow_.yQiLHOIVUZAsOS3MUQs0xQM_sd9mSFP_0 2024-09-12T18:01:50.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.908+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14914249796738829187', time=2024-09-12T19:55:11.331933+0000, chain.objs.size()=1 2024-09-12T18:01:50.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.908+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.444__shadow_.ZTHXlv4_N9zeGaBhOGj3FYHICVP5eKW_0 2024-09-12T18:01:50.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.908+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11898889591252750709', time=2024-09-12T19:55:17.979993+0000, chain.objs.size()=1 2024-09-12T18:01:50.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.908+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.467__shadow_.Dy-QIepDzma1snM6UbfUMKfFLRkXA9b_0 2024-09-12T18:01:50.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.908+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7631129298737564584', time=2024-09-12T19:55:23.965008+0000, chain.objs.size()=1 2024-09-12T18:01:50.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.908+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.497__shadow_.S_i107bzqPo0YSMrQ9zULa2k3hDS2ZP_0 2024-09-12T18:01:50.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.909+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17666370674442769827', time=2024-09-12T19:55:24.074803+0000, chain.objs.size()=1 2024-09-12T18:01:50.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.909+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.497__shadow_.S_i107bzqPo0YSMrQ9zULa2k3hDS2ZP_0 2024-09-12T18:01:50.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.909+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2648407624642529121', time=2024-09-12T19:55:27.825430+0000, chain.objs.size()=6 2024-09-12T18:01:50.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.909+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.1 2024-09-12T18:01:50.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.909+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.2 2024-09-12T18:01:50.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.909+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.3 2024-09-12T18:01:50.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.909+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.4 2024-09-12T18:01:50.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.909+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.5 2024-09-12T18:01:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.909+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.6 2024-09-12T18:01:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.909+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1448049350624449412', time=2024-09-12T19:55:28.622870+0000, chain.objs.size()=1 2024-09-12T18:01:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.909+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.513__shadow_.04UG6s6VzwbkNMwqV_q1sreLBayafis_0 2024-09-12T18:01:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.909+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7526173824039014379', time=2024-09-12T19:56:10.557006+0000, chain.objs.size()=1 2024-09-12T18:01:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.909+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.551__shadow_.678x7p6wf8hElOdxRKzPbCsukmGUMT7_0 2024-09-12T18:01:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.909+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15323999585545234358', time=2024-09-12T19:56:29.107235+0000, chain.objs.size()=1 2024-09-12T18:01:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.909+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.575__shadow_.bC138GAnsAqO_siyTf_SQGQnHSQr-q4_0 2024-09-12T18:01:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.910+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14340698783799666752', time=2024-09-12T19:56:30.871872+0000, chain.objs.size()=1 2024-09-12T18:01:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.910+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.575__shadow:FE3YGDMpx17G2xaiM97.pSWfbuZpPpF_.ye4xkP4rAELsA8TVQIM-1dYdTAaM8oc_0 2024-09-12T18:01:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.911+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2600526834279491509', time=2024-09-12T19:56:31.649162+0000, chain.objs.size()=1 2024-09-12T18:01:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.911+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.576__shadow_.6D2vlJHhsNJJo3nJ1zwRwrzjY5X8YjI_0 2024-09-12T18:01:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.911+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11657990437952026045', time=2024-09-12T19:56:34.044159+0000, chain.objs.size()=1 2024-09-12T18:01:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.911+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.577__shadow:OtWjIaTCXlG8OJqo9KAK58r1GlLaJSx_.eyEsXBYub74X-JAO1KgztEYx5m_uw7l_0 2024-09-12T18:01:50.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.911+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11671234932246681739', time=2024-09-12T19:56:38.034097+0000, chain.objs.size()=1 2024-09-12T18:01:50.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.911+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:64jFlZT5x6dwDEcMGKpiksqq-JDJHV7_.a_hyhxuYtGzeKxGcHazmbmZ2USFOjno_0 2024-09-12T18:01:50.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.911+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14294217837312000314', time=2024-09-12T19:56:53.090959+0000, chain.objs.size()=1 2024-09-12T18:01:50.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.911+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.588__shadow:rNBGNWK-jMT2ArIX6m92FRWdOFQt6BN_.byODRxnta0nSynghoyHne9vml0mxrld_0 2024-09-12T18:01:50.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.911+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7550736122466769685', time=2024-09-12T19:59:03.079021+0000, chain.objs.size()=1 2024-09-12T18:01:50.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.911+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.619__shadow_._yiwk7KT_wsA9K9YZEUZ5NcOP-F1O4G_0 2024-09-12T18:01:50.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.911+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13047460758698547804', time=2024-09-12T19:59:18.230155+0000, chain.objs.size()=1 2024-09-12T18:01:50.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.911+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.667__shadow_.PWKhJJmsSikCn16QzVu-PLK5aP2YZmv_0 2024-09-12T18:01:50.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.915+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.918+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:01:50.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.920+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.920+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48741' 2024-09-12T18:01:50.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3530077460633546599', time=2024-09-12T19:52:55.436610+0000, chain.objs.size()=2 2024-09-12T18:01:50.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.161__shadow_.uuIvhmv-EzVMFYYIHnai1GHJse1P34G_0 2024-09-12T18:01:50.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.161__shadow_.uuIvhmv-EzVMFYYIHnai1GHJse1P34G_1 2024-09-12T18:01:50.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12908119624856985764', time=2024-09-12T19:54:04.472301+0000, chain.objs.size()=1 2024-09-12T18:01:50.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.254__shadow_.dLR57Xhge_rIU8Xnmp37WUeZokAISIo_0 2024-09-12T18:01:50.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10859748185634591873', time=2024-09-12T19:54:05.709461+0000, chain.objs.size()=1 2024-09-12T18:01:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.260__shadow_.JXxrcxSPKO6WLocsCxMKNDizK54Ju4E_0 2024-09-12T18:01:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7198435793332433308', time=2024-09-12T19:54:13.539277+0000, chain.objs.size()=1 2024-09-12T18:01:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.AqLtSLgRcFpgZEdXbTk-TBua5cCoJVK_0 2024-09-12T18:01:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7705423973156537203', time=2024-09-12T19:54:13.564079+0000, chain.objs.size()=1 2024-09-12T18:01:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.NeZRiOk18I2fkL7AP8wss_ga7FwrSak_0 2024-09-12T18:01:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15325162914458197571', time=2024-09-12T19:54:13.698884+0000, chain.objs.size()=1 2024-09-12T18:01:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.TjmWMMLXapRyt5Qpm1fS8XHtF9sBdZS_0 2024-09-12T18:01:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8166650069384664110', time=2024-09-12T19:54:13.699317+0000, chain.objs.size()=1 2024-09-12T18:01:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.g8Do3TgLWd74g_IwqJ2YfloLUtDb2_e_0 2024-09-12T18:01:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1340188065145270958', time=2024-09-12T19:54:13.710593+0000, chain.objs.size()=1 2024-09-12T18:01:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.xlj1-O6a65bimkxJMyEAsxqQocmi-Yf_0 2024-09-12T18:01:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4665615849411881524', time=2024-09-12T19:54:13.713168+0000, chain.objs.size()=1 2024-09-12T18:01:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.j6ASFcxv7eJkE5MiITOiW2B0FgbCCvi_0 2024-09-12T18:01:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14136390167012208431', time=2024-09-12T19:54:13.724105+0000, chain.objs.size()=1 2024-09-12T18:01:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.AWrPkiLCsL652TeUrU-rWTD8zi5Fm8K_0 2024-09-12T18:01:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.888003897167529328', time=2024-09-12T19:54:13.864832+0000, chain.objs.size()=1 2024-09-12T18:01:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.921+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.bHRz3NYZba1Yb_V2qTnqXEAb9FtpLda_0 2024-09-12T18:01:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.924+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.660085668988328697', time=2024-09-12T19:54:13.890355+0000, chain.objs.size()=1 2024-09-12T18:01:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.924+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.mlD9c7dS5FOeEs3nHaml7SGhTcmaq-8_0 2024-09-12T18:01:50.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13737369595414677407', time=2024-09-12T19:54:13.891242+0000, chain.objs.size()=1 2024-09-12T18:01:50.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.jQvqcZ7WdDHytr5ajp2nQBwMh8dGR_E_0 2024-09-12T18:01:50.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16059553909467762573', time=2024-09-12T19:54:13.909942+0000, chain.objs.size()=1 2024-09-12T18:01:50.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.rz_g86AA0-LmEAVlJqirBxrmQW5jTg5_0 2024-09-12T18:01:50.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17755150572280705185', time=2024-09-12T19:54:14.006820+0000, chain.objs.size()=1 2024-09-12T18:01:50.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.8A2WHNxzyDq_QRYzn1DTghC-56EOg5-_0 2024-09-12T18:01:50.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15936256581859002494', time=2024-09-12T19:54:14.062633+0000, chain.objs.size()=1 2024-09-12T18:01:50.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.CTAgClqZY8yeiTEyZFUUfUdBw32Hqo3_0 2024-09-12T18:01:50.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4800499676410437381', time=2024-09-12T19:54:14.071230+0000, chain.objs.size()=1 2024-09-12T18:01:50.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.HHHDmluCP_l3HHlSQfuK3UOl0Waog1u_0 2024-09-12T18:01:50.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17952700914947150136', time=2024-09-12T19:54:14.072939+0000, chain.objs.size()=1 2024-09-12T18:01:50.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.3SqsXzjgWx8JVnn5n-uRp0TiK4qxLUz_0 2024-09-12T18:01:50.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8325069908639420255', time=2024-09-12T19:54:14.090532+0000, chain.objs.size()=1 2024-09-12T18:01:50.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.OxdhMsySVFcn1PDADmyu1WVC1VHdSaJ_0 2024-09-12T18:01:50.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5821124817721578689', time=2024-09-12T19:54:14.384415+0000, chain.objs.size()=1 2024-09-12T18:01:50.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.mL2uLrI7-X1rJIcThe8lONLwGbX0V1y_0 2024-09-12T18:01:50.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18020993031392072768', time=2024-09-12T19:54:14.387661+0000, chain.objs.size()=1 2024-09-12T18:01:50.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.T0TWoKsGI2DCflUojMvVsFJBb08oVpm_0 2024-09-12T18:01:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10954958655466897354', time=2024-09-12T19:54:14.542992+0000, chain.objs.size()=1 2024-09-12T18:01:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.71dwcQF9roOaOSO451b2hm3d5-aDOKB_0 2024-09-12T18:01:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16148320282347828131', time=2024-09-12T19:54:14.625202+0000, chain.objs.size()=1 2024-09-12T18:01:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.926+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.GwNdr3t6x3spbGhsPCD4BxnK8rH2PtD_0 2024-09-12T18:01:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8939158370649640741', time=2024-09-12T19:54:14.637215+0000, chain.objs.size()=1 2024-09-12T18:01:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.cfaSPhhRbvV8CqVXi0L2Y_fmAol_s3D_0 2024-09-12T18:01:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6402119112328802399', time=2024-09-12T19:54:14.712167+0000, chain.objs.size()=1 2024-09-12T18:01:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.tawqTagK-5j1el-KWr4PtlLj-S21A-r_0 2024-09-12T18:01:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18060652352495345530', time=2024-09-12T19:54:14.734936+0000, chain.objs.size()=1 2024-09-12T18:01:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.kXtUjvgufq_yaoQ1z8QUoWch9oi8nN9_0 2024-09-12T18:01:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18028961196530888103', time=2024-09-12T19:54:14.799562+0000, chain.objs.size()=1 2024-09-12T18:01:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.GjQV0bosHPv9CH1QH-VOCKzJbrvEBPk_0 2024-09-12T18:01:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14681969146876637725', time=2024-09-12T19:54:14.803064+0000, chain.objs.size()=1 2024-09-12T18:01:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.jDEGA-vFzmGWkpFn4r972_oftVG0AWD_0 2024-09-12T18:01:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9685158890548858588', time=2024-09-12T19:54:14.928286+0000, chain.objs.size()=1 2024-09-12T18:01:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-ix0Hy7S7Q23VJ4g58SuAm26sHSYuab_0 2024-09-12T18:01:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3003779925257577781', time=2024-09-12T19:54:14.947906+0000, chain.objs.size()=1 2024-09-12T18:01:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.5QWeyIy6u17n2ccACtCNm1OhdUyGl55_0 2024-09-12T18:01:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12469184707887403223', time=2024-09-12T19:54:14.950512+0000, chain.objs.size()=1 2024-09-12T18:01:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.XpaCIZjGlhfPqM0sYAm2R79x72-Kf3c_0 2024-09-12T18:01:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12024425256436306683', time=2024-09-12T19:54:15.939862+0000, chain.objs.size()=1 2024-09-12T18:01:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.268__shadow_.rIi_kDL0Vmp6nLOcZoGU0u19F9qkMZy_0 2024-09-12T18:01:50.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16868096424368585955', time=2024-09-12T19:54:16.533268+0000, chain.objs.size()=1 2024-09-12T18:01:50.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.271__shadow_.lMJmhI55jDUEwiEtLKBF8DMBmGA75nf_0 2024-09-12T18:01:50.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11989315842395573464', time=2024-09-12T19:54:19.464524+0000, chain.objs.size()=1 2024-09-12T18:01:50.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.928+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.285__shadow_.1xQWEyaaVAj7xPyMoVd6KWcF0C1frVS_0 2024-09-12T18:01:50.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.930+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15832240183338610977', time=2024-09-12T19:54:22.158739+0000, chain.objs.size()=1 2024-09-12T18:01:50.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.930+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.XEud7FS3uk6rjWD2nZU0DGCkbg4T0lc_0 2024-09-12T18:01:50.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.930+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10156084043723537831', time=2024-09-12T19:54:35.761392+0000, chain.objs.size()=1 2024-09-12T18:01:50.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.930+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.E-5EgkRPp_ashEJO0UpFbcz9f9cb0Bq_0 2024-09-12T18:01:50.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.930+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11586532280916564724', time=2024-09-12T19:54:35.771157+0000, chain.objs.size()=1 2024-09-12T18:01:50.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.930+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.8fN6pYY1y5q8PttylTuyXcCXCSFPnlh_0 2024-09-12T18:01:50.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.930+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13409942256483651370', time=2024-09-12T19:54:35.777572+0000, chain.objs.size()=1 2024-09-12T18:01:50.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.930+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.sXqHFbJkxL1ZRLUGWYdzSt6njogpiUo_0 2024-09-12T18:01:50.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.930+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18191585742887849500', time=2024-09-12T19:54:35.787429+0000, chain.objs.size()=1 2024-09-12T18:01:50.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.930+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.KTW8GdCwgX-c3eCmxUfzuXvkFHSmf79_0 2024-09-12T18:01:50.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.931+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.963021241996494566', time=2024-09-12T19:54:35.791913+0000, chain.objs.size()=1 2024-09-12T18:01:50.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.931+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-TGZ2zsYgWpl6709Y8K3PqWZ4Nc7tMZ_0 2024-09-12T18:01:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.931+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10681907393819447013', time=2024-09-12T19:54:35.797616+0000, chain.objs.size()=1 2024-09-12T18:01:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.931+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.G4zyiaVRC5IDeWbxjDorD9cwG9TNzYU_0 2024-09-12T18:01:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.931+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3925557862701551861', time=2024-09-12T19:54:35.826829+0000, chain.objs.size()=1 2024-09-12T18:01:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.931+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.IGajwe1wvvpDYGvBykgXOLsGP-hsVOZ_0 2024-09-12T18:01:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.931+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13927570673982927036', time=2024-09-12T19:54:35.835974+0000, chain.objs.size()=1 2024-09-12T18:01:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.931+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.00hcXGq1gpKIAIueucvnoPyFpgnHqar_0 2024-09-12T18:01:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14137614268040491091', time=2024-09-12T19:54:35.920147+0000, chain.objs.size()=1 2024-09-12T18:01:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.SftXPFhNHs_ZvxlfOxA8fSG-5ChiGe6_0 2024-09-12T18:01:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4639582579746251231', time=2024-09-12T19:54:35.920820+0000, chain.objs.size()=1 2024-09-12T18:01:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.XpW2EIsIa68LYIhbhWEtFVqmMRnTjfi_0 2024-09-12T18:01:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10443118393791478674', time=2024-09-12T19:54:35.921478+0000, chain.objs.size()=1 2024-09-12T18:01:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ggWVn9TaiPuvZ8CriYl_ZoZLpg4wRhR_0 2024-09-12T18:01:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9125366419087803262', time=2024-09-12T19:54:35.981129+0000, chain.objs.size()=1 2024-09-12T18:01:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.hBbftUJfp1cYspDayso0OUmAKuSP1BX_0 2024-09-12T18:01:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16854417488584771102', time=2024-09-12T19:54:36.139576+0000, chain.objs.size()=1 2024-09-12T18:01:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.V5P0YrLreBJQUR7ie11LSpMwjJmKzJE_0 2024-09-12T18:01:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3577462620777000917', time=2024-09-12T19:54:36.141664+0000, chain.objs.size()=1 2024-09-12T18:01:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.2CBMYqX3o7vpNO6Xx0PMIbbBYPZ1L7h_0 2024-09-12T18:01:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7461909913781565382', time=2024-09-12T19:54:36.158395+0000, chain.objs.size()=1 2024-09-12T18:01:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ejZWeP5-C8BIUtQz2t-Z9TP_2ObQOWl_0 2024-09-12T18:01:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5450883153101552362', time=2024-09-12T19:54:36.166855+0000, chain.objs.size()=1 2024-09-12T18:01:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1E-bQw50vO7YYsjcCyU6D1_Rdfyg6oe_0 2024-09-12T18:01:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13876609807472467519', time=2024-09-12T19:54:36.251414+0000, chain.objs.size()=1 2024-09-12T18:01:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Q9P_TFhYGqrKmnYP6p1Dq_G2-j3R0T3_0 2024-09-12T18:01:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3753454466242022813', time=2024-09-12T19:54:36.265766+0000, chain.objs.size()=1 2024-09-12T18:01:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.o8y5tULYTDjCEEMxzoLyT5r1QTnepAT_0 2024-09-12T18:01:50.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13208982587195331460', time=2024-09-12T19:54:36.266996+0000, chain.objs.size()=1 2024-09-12T18:01:50.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.933+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Dgkv4bxW4Kwvg0uVn6Vn5Fc2bhOg6v2_0 2024-09-12T18:01:50.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.935+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6460556952641930308', time=2024-09-12T19:54:36.289331+0000, chain.objs.size()=1 2024-09-12T18:01:50.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.935+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.CgO85cUGUE5y7OiBx44UyiW-6PRtElV_0 2024-09-12T18:01:50.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.935+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16860302114423960947', time=2024-09-12T19:54:36.290914+0000, chain.objs.size()=1 2024-09-12T18:01:50.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.935+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9XoMxJXvMs5fFdQOW4p1iy9QnBSkW_b_0 2024-09-12T18:01:50.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.935+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.322301523786969154', time=2024-09-12T19:54:36.304974+0000, chain.objs.size()=1 2024-09-12T18:01:50.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.935+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.A4JPXZ1iX-X7l0jiZRKFHokfvWhmpT5_0 2024-09-12T18:01:50.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8217899160520939375', time=2024-09-12T19:54:36.310095+0000, chain.objs.size()=1 2024-09-12T18:01:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.npZxBVitqlvRUCSGKW-qWNwF9uN-ybI_0 2024-09-12T18:01:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12293434572188385095', time=2024-09-12T19:54:36.317209+0000, chain.objs.size()=1 2024-09-12T18:01:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.z3VE6lxM_hJcYhv4UnAMBPkMFI2SpWE_0 2024-09-12T18:01:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5763384122628059041', time=2024-09-12T19:54:36.337692+0000, chain.objs.size()=1 2024-09-12T18:01:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.vbV8LA2qr5naR35ecG0jxxBxR8ln2uT_0 2024-09-12T18:01:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15425507941908920904', time=2024-09-12T19:54:36.422567+0000, chain.objs.size()=1 2024-09-12T18:01:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.SLM1uZICuOX4rjgRqUs3Gn44ndepNyT_0 2024-09-12T18:01:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8457468723276112307', time=2024-09-12T19:54:36.463037+0000, chain.objs.size()=1 2024-09-12T18:01:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.3w0nfKRiheEBI7IxbzkYF-A1Hf8WTay_0 2024-09-12T18:01:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7505832817859479650', time=2024-09-12T19:54:36.608828+0000, chain.objs.size()=1 2024-09-12T18:01:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.I1S90ZI2hvZDuGNyf2oYOsOA_Ws62Ky_0 2024-09-12T18:01:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7733439544655454466', time=2024-09-12T19:54:36.655029+0000, chain.objs.size()=1 2024-09-12T18:01:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Nwg-faTPPVMwVddutvOSJHI5FAnSIOF_0 2024-09-12T18:01:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3995182717927690323', time=2024-09-12T19:54:36.656017+0000, chain.objs.size()=1 2024-09-12T18:01:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.96Tqm0bi8_lYGNFaD9kLkGQ8x59ci38_0 2024-09-12T18:01:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14173801557656161747', time=2024-09-12T19:54:44.452676+0000, chain.objs.size()=1 2024-09-12T18:01:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.VKNZFnAIuUjK8qMpBu_LNGfdMJ_yaqr_0 2024-09-12T18:01:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14766623256106515128', time=2024-09-12T19:54:44.454413+0000, chain.objs.size()=1 2024-09-12T18:01:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.NRq5BEDW5fO7JLXf0HZ3niMsRwY0XWl_0 2024-09-12T18:01:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14010305716677856507', time=2024-09-12T19:54:44.472821+0000, chain.objs.size()=1 2024-09-12T18:01:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.936+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.2UNfkW8x4T8T1_AmdJlGafph9D3Xfc8_0 2024-09-12T18:01:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.937+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10680941278463101408', time=2024-09-12T19:54:44.481970+0000, chain.objs.size()=1 2024-09-12T18:01:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.937+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.8O00tqIRwkGQW--OMln9hYPFaobneVO_0 2024-09-12T18:01:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.937+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11094077772121609636', time=2024-09-12T19:54:44.646072+0000, chain.objs.size()=1 2024-09-12T18:01:50.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.937+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.QBFV9arEH-2wPHmt1Wg_kDiQ4NxUtyd_0 2024-09-12T18:01:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5528493658415194485', time=2024-09-12T19:54:44.649772+0000, chain.objs.size()=1 2024-09-12T18:01:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.jc1K0P4VQpuTZbEPTH-tLyZsrjW0Huk_0 2024-09-12T18:01:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18021079691625353130', time=2024-09-12T19:54:44.677093+0000, chain.objs.size()=1 2024-09-12T18:01:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.FzxuJnxp9qS63LL-cEPkzUbvpLqUBpT_0 2024-09-12T18:01:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15579683953045702690', time=2024-09-12T19:54:44.678862+0000, chain.objs.size()=1 2024-09-12T18:01:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.SpZ7zWK9dmX34DcDtApIDoRKdD6gs1h_0 2024-09-12T18:01:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3872119867303408308', time=2024-09-12T19:54:44.699351+0000, chain.objs.size()=1 2024-09-12T18:01:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.lbX9NOiiEszLDNyZDj0XK6R2JbcTH4v_0 2024-09-12T18:01:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2308985172820479572', time=2024-09-12T19:54:44.799010+0000, chain.objs.size()=1 2024-09-12T18:01:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.wnhmK2Jo127GLbMqgeLdmSYNjKzLfy7_0 2024-09-12T18:01:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6777392589555556440', time=2024-09-12T19:54:44.814414+0000, chain.objs.size()=1 2024-09-12T18:01:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.gFPT_iq8RUQ92K5NNG0twds3tae9kfu_0 2024-09-12T18:01:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12038148976194568398', time=2024-09-12T19:54:44.825025+0000, chain.objs.size()=1 2024-09-12T18:01:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.NCn5L9C58dX8EyOIozjKDLsw5smrD-H_0 2024-09-12T18:01:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7144739414974768895', time=2024-09-12T19:54:44.827889+0000, chain.objs.size()=1 2024-09-12T18:01:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.vZKpn0oPBPd_w3PTS3dx3Zs738hvygS_0 2024-09-12T18:01:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15303208574940740773', time=2024-09-12T19:54:44.860506+0000, chain.objs.size()=1 2024-09-12T18:01:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.R_v4R6Xl1Tr5ysbzG3MaqQWmZ_QZJQK_0 2024-09-12T18:01:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11447759736474976200', time=2024-09-12T19:54:44.878942+0000, chain.objs.size()=1 2024-09-12T18:01:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.939+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.53dApRyl5q2gDEQc0WtZ9wR2wXgAqCi_0 2024-09-12T18:01:50.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.940+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13791245539170236674', time=2024-09-12T19:54:44.968627+0000, chain.objs.size()=1 2024-09-12T18:01:50.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.940+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.xTInyNrF1SdiyxSCaY8ne7jJuZw4obe_0 2024-09-12T18:01:50.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.940+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.613414217735459823', time=2024-09-12T19:54:44.978123+0000, chain.objs.size()=1 2024-09-12T18:01:50.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.940+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.lsqBhH-XgnJ8veNH37YXYoL--i8h2vE_0 2024-09-12T18:01:50.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.941+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13117749752062315111', time=2024-09-12T19:54:45.185519+0000, chain.objs.size()=1 2024-09-12T18:01:50.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.941+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.AJ4Nag72QhA3vVjYSb5Ghzk8pj7feoj_0 2024-09-12T18:01:50.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7831142377743657565', time=2024-09-12T19:54:45.377810+0000, chain.objs.size()=1 2024-09-12T18:01:50.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.J2RXs34Y-kPOYdCs6T_zPhhmALOFdkM_0 2024-09-12T18:01:50.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9104440167494781549', time=2024-09-12T19:54:45.398981+0000, chain.objs.size()=1 2024-09-12T18:01:50.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.QVjUQh0QWtxGLunvFvGg88VMkEibAdx_0 2024-09-12T18:01:50.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9970461049571305171', time=2024-09-12T19:54:45.409803+0000, chain.objs.size()=1 2024-09-12T18:01:50.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.rG5qNwRbGoZ1aCb2FcoBcOu7bKn2Hd1_0 2024-09-12T18:01:50.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5523390810788465631', time=2024-09-12T19:54:45.424202+0000, chain.objs.size()=1 2024-09-12T18:01:50.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.40DSUBsE8gf92AKuSlZt6cGJXvwy8io_0 2024-09-12T18:01:50.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6682647934046544801', time=2024-09-12T19:54:45.510778+0000, chain.objs.size()=1 2024-09-12T18:01:50.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.C-vRREs1-mvuEWIVDDbXO-TnCkW_8pF_0 2024-09-12T18:01:50.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17334347854194573875', time=2024-09-12T19:54:45.523585+0000, chain.objs.size()=1 2024-09-12T18:01:50.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.x0giBuWDKuZFq9Ru_h6sBg9qa6i7Cq7_0 2024-09-12T18:01:50.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.159640098404728388', time=2024-09-12T19:54:45.529216+0000, chain.objs.size()=1 2024-09-12T18:01:50.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.gZDtYnyR-BNTa9DCtFVEQq3fTrTTjgD_0 2024-09-12T18:01:50.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7649805025690719627', time=2024-09-12T19:54:45.539140+0000, chain.objs.size()=1 2024-09-12T18:01:50.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.YJ70Cqjd7BIgDUQPvotwL9tgygcYoY6_0 2024-09-12T18:01:50.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6345288016822206755', time=2024-09-12T19:54:45.568374+0000, chain.objs.size()=1 2024-09-12T18:01:50.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.o6MULQ2q8_ae4EoYQmauS-EAYv4vf2x_0 2024-09-12T18:01:50.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18414544159855493795', time=2024-09-12T19:54:45.681619+0000, chain.objs.size()=1 2024-09-12T18:01:50.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.QFXiyXBrnAFFJPQx8nvqEjzESw-b55K_0 2024-09-12T18:01:50.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3778418772459595619', time=2024-09-12T19:54:45.706371+0000, chain.objs.size()=1 2024-09-12T18:01:50.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.943+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.oaPHbKywCkEH4gXE7KnhjmQNCQGM2K0_0 2024-09-12T18:01:50.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.945+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17194349589509361129', time=2024-09-12T19:54:45.748495+0000, chain.objs.size()=1 2024-09-12T18:01:50.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.945+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.z7TAtyYbEuPZYrYIkIfzm4sLxr5SmDu_0 2024-09-12T18:01:50.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.945+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17312034974443968750', time=2024-09-12T19:54:49.555405+0000, chain.objs.size()=1 2024-09-12T18:01:50.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.945+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.345__shadow_.oza-XebpIzmp-LdD0n-iyI5IVMxhXFB_0 2024-09-12T18:01:50.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.945+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13962032595162025807', time=2024-09-12T19:54:56.480329+0000, chain.objs.size()=1 2024-09-12T18:01:50.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.945+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.380__shadow_.sE4pbXSYiudOWX3SsWRx7pCSsl_WZo3_0 2024-09-12T18:01:50.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.946+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2576384943425451813', time=2024-09-12T19:55:04.432027+0000, chain.objs.size()=1 2024-09-12T18:01:50.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.946+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.410__shadow_.Aq9aFU4lU_R6kaN6-Uze3p4eGc8GtFv_0 2024-09-12T18:01:50.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.948+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10918183700204729183', time=2024-09-12T19:55:15.775154+0000, chain.objs.size()=1 2024-09-12T18:01:50.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.948+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.461__shadow_.lp3JcWEEL72daYnl3SBXhuEcvhbwbPt_0 2024-09-12T18:01:50.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.948+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10455316993087926201', time=2024-09-12T19:55:20.952679+0000, chain.objs.size()=1 2024-09-12T18:01:50.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.948+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.484__shadow_.TU3rDd6PlpBJpZQ84G8ZOWOWO-cDPzY_0 2024-09-12T18:01:50.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.951+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/48741 2024-09-12T18:01:50.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:01:50.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7469760275635530949', time=2024-09-12T19:55:24.473672+0000, chain.objs.size()=1 2024-09-12T18:01:50.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.498__shadow_.M6cYShNQ77PxRpb-njtEM3Q8sdE2TE7_0 2024-09-12T18:01:50.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7740299275287886174', time=2024-09-12T19:55:37.320258+0000, chain.objs.size()=6 2024-09-12T18:01:50.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~j8m17L9-G9JP6hGejPl1lNApt3G0vuX.1 2024-09-12T18:01:50.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.re8jX5bri1GgsG5gTqBsY4V2IPLi8q-w.2 2024-09-12T18:01:50.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.s1vMRVenGJAAGcSP10IJ1_6E3BLn0jtN.3 2024-09-12T18:01:50.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~j8m17L9-G9JP6hGejPl1lNApt3G0vuX.4 2024-09-12T18:01:50.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~j8m17L9-G9JP6hGejPl1lNApt3G0vuX.5 2024-09-12T18:01:50.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~j8m17L9-G9JP6hGejPl1lNApt3G0vuX.6 2024-09-12T18:01:50.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17734770488035427215', time=2024-09-12T19:56:23.528138+0000, chain.objs.size()=1 2024-09-12T18:01:50.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:.8OXCON5PfRKvbFuFgOg5qptcgywlAz_.xq8YfuEnOR2UWWFNqd0or7s-7jXiUND_0 2024-09-12T18:01:50.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17592453764681000791', time=2024-09-12T19:56:28.176344+0000, chain.objs.size()=1 2024-09-12T18:01:50.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.573__shadow:sbNvoTTJwMHkCl.sL27YaAiOlvk878U_.86uDpdEB6g06XPIocMk8Ny6b04YtQGU_0 2024-09-12T18:01:50.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18044694124155595619', time=2024-09-12T19:56:29.130757+0000, chain.objs.size()=1 2024-09-12T18:01:50.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.575__shadow_.qA5bmIbfr8u77oo2CKlxsYLjA--hjux_0 2024-09-12T18:01:50.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5934777153855191160', time=2024-09-12T19:56:30.358441+0000, chain.objs.size()=1 2024-09-12T18:01:50.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.575__shadow:apnXajAfgqfabQKBFHq8-Xca-wx6ad0_.brHNoTHQobGVMId5eWyuhf5RHJPDzeO_0 2024-09-12T18:01:50.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6316198864749258055', time=2024-09-12T19:56:31.593942+0000, chain.objs.size()=1 2024-09-12T18:01:50.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.953+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.576__shadow_.6D2vlJHhsNJJo3nJ1zwRwrzjY5X8YjI_0 2024-09-12T18:01:50.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.955+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4518485252534200090', time=2024-09-12T19:56:35.777656+0000, chain.objs.size()=1 2024-09-12T18:01:50.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.955+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:cGDh0DY-wYBsu9hQVbF.m-cfzSWG22._.GUevstl44rnytIDxAq5FG66rqDKn41p_0 2024-09-12T18:01:50.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12658193678889068567', time=2024-09-12T19:56:45.495312+0000, chain.objs.size()=1 2024-09-12T18:01:50.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.578__shadow:hQRGm2iza6lblG5bLbq2Qa5DKCn8TJ9_.5JMH1hXrKuv5axFor1-9wGFzd-n9_9t_0 2024-09-12T18:01:50.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15203357238516691675', time=2024-09-12T19:56:49.972549+0000, chain.objs.size()=1 2024-09-12T18:01:50.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.580__shadow:mKHcA4a6oDD4KVhtFP.sUus11hMhNq4_.PRAiUqMYbxGfVm_rGUoCwPfPN3Ipr0Q_0 2024-09-12T18:01:50.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6177917758606385375', time=2024-09-12T19:56:50.014348+0000, chain.objs.size()=1 2024-09-12T18:01:50.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.580__shadow:Av9lbljwPMSlMvB82o0PdZ6ejpGN8hJ_.y1Elvk7nHN8Yz_pCx9C_Iz4T9Jdccj9_0 2024-09-12T18:01:50.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5340837687861502220', time=2024-09-12T19:56:50.930507+0000, chain.objs.size()=1 2024-09-12T18:01:50.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.581__shadow:PsApgqwqjkbnkxy08UM7ac24chJ8ng4_.28GyzXAibbB1MoeEJC895bpzvX4U1yq_0 2024-09-12T18:01:50.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2503585251446919174', time=2024-09-12T19:56:52.483622+0000, chain.objs.size()=1 2024-09-12T18:01:50.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.586__shadow:a7VM7Y-QMdiXJJztpldBvduA6h2pEAq_.QHYF-SvMCjqAOInUC6EgT-x6HbRkZQp_0 2024-09-12T18:01:50.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3315992652978248282', time=2024-09-12T19:59:08.108266+0000, chain.objs.size()=1 2024-09-12T18:01:50.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.634__shadow_.mFLFiGUzGQjLTOnGiBbIbY-ZX4F7qel_0 2024-09-12T18:01:50.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18247020634532341805', time=2024-09-12T19:59:13.604979+0000, chain.objs.size()=1 2024-09-12T18:01:50.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.655__shadow_.kFb-NL78mznBzJXFw5HP2dQKYa9JMlO_0 2024-09-12T18:01:50.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6739611392891078359', time=2024-09-12T19:59:18.229824+0000, chain.objs.size()=1 2024-09-12T18:01:50.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.667__shadow_.Tla5RDXu6LPOMKafwtdamdWaZb9jHln_0 2024-09-12T18:01:50.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15109387504251194598', time=2024-09-12T19:59:23.043241+0000, chain.objs.size()=1 2024-09-12T18:01:50.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.692__shadow_.OW0x82-2heXPk7Eyb82jFkfPJEsB2sy_0 2024-09-12T18:01:50.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3569227800506919766', time=2024-09-12T19:59:48.306320+0000, chain.objs.size()=1 2024-09-12T18:01:50.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.957+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.719__shadow_.iHM6n-o2LDvBRgzkVhVrYmxTIeH9d2h_0 2024-09-12T18:01:50.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.962+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:50.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.964+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:01:50.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.966+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:50.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.966+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:50.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43407' 2024-09-12T18:01:50.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='_aHpbEY4qOilO3ESFHCKDRc4vGVyG2uJ', time=2024-09-12T19:52:56.860447+0000, chain.objs.size()=2 2024-09-12T18:01:50.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__shadow_.AmB9hvM-fXv95EBhAf7QeSJcCgHxczE_0 2024-09-12T18:01:50.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__shadow_.AmB9hvM-fXv95EBhAf7QeSJcCgHxczE_1 2024-09-12T18:01:50.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='_f_Y6sWBgC9i0tiOGNJK7oqo3EKtWzFc', time=2024-09-12T19:52:57.471686+0000, chain.objs.size()=2 2024-09-12T18:01:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__shadow_.LfPJtbpg60z3bGnrXy-O6o0infRb9nI_0 2024-09-12T18:01:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__shadow_.LfPJtbpg60z3bGnrXy-O6o0infRb9nI_1 2024-09-12T18:01:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16975651489168152521', time=2024-09-12T19:54:00.735696+0000, chain.objs.size()=1 2024-09-12T18:01:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.237__shadow_.P96Y3l4gxcXEKI7mETgCfmAFOsYLLrG_0 2024-09-12T18:01:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.20590977379797994', time=2024-09-12T19:54:00.993029+0000, chain.objs.size()=1 2024-09-12T18:01:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.238__shadow_.BgV-mgDuB8kHxB6h9D9LRIFr4dJ1AmN_0 2024-09-12T18:01:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10600278715440464477', time=2024-09-12T19:54:13.502004+0000, chain.objs.size()=1 2024-09-12T18:01:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.IfIY7_SynrhX8LNovFRlEE66FLUPxKF_0 2024-09-12T18:01:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3557934806446553663', time=2024-09-12T19:54:13.511299+0000, chain.objs.size()=1 2024-09-12T18:01:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.dBfAMoEJ7x2yMcNm7YAlE8JQiHyOyo__0 2024-09-12T18:01:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14323870070446243779', time=2024-09-12T19:54:13.514273+0000, chain.objs.size()=1 2024-09-12T18:01:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.St-RsLSkEUvlMYhtX_R-QFKQBpcnHKy_0 2024-09-12T18:01:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10253336079959114917', time=2024-09-12T19:54:13.528843+0000, chain.objs.size()=1 2024-09-12T18:01:50.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.QXJh-vGou78n2k-z_IX8Yzr7YjpiLeU_0 2024-09-12T18:01:50.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4135600720166460537', time=2024-09-12T19:54:13.575519+0000, chain.objs.size()=1 2024-09-12T18:01:50.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.TCAdGcd7qrXdZgTnl9wq_hGw3L5cAB9_0 2024-09-12T18:01:50.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9729392851477421706', time=2024-09-12T19:54:13.576569+0000, chain.objs.size()=1 2024-09-12T18:01:50.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.968+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.0_UNx81-ttBgoI3HES-5TG_-np2r4Hb_0 2024-09-12T18:01:50.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3875427572056346854', time=2024-09-12T19:54:13.655291+0000, chain.objs.size()=1 2024-09-12T18:01:50.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.H4BYeJX06iV_J17SLxfDn-shV28hSyb_0 2024-09-12T18:01:50.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13300232759099488072', time=2024-09-12T19:54:13.656101+0000, chain.objs.size()=1 2024-09-12T18:01:50.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.tIN1JcElXJ8R6ZzEV6ObOeGDrRvMljX_0 2024-09-12T18:01:50.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3095550842399115522', time=2024-09-12T19:54:13.670648+0000, chain.objs.size()=1 2024-09-12T18:01:50.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.pBWzqXKdI3xplWyqluvGxcW2g786-ZY_0 2024-09-12T18:01:50.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17336213806600800952', time=2024-09-12T19:54:13.684120+0000, chain.objs.size()=1 2024-09-12T18:01:50.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.YI_J9W3NNMBhUV-goamONbTVkHCbqbC_0 2024-09-12T18:01:50.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9344113173199308651', time=2024-09-12T19:54:13.685540+0000, chain.objs.size()=1 2024-09-12T18:01:50.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.zeglfqFh-yeh-G4ReBcAfqexT0UtfyT_0 2024-09-12T18:01:50.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1730602326811807301', time=2024-09-12T19:54:13.730127+0000, chain.objs.size()=1 2024-09-12T18:01:50.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.OvsEVkNb9McDtwoXwdxjBiFwd2pe2bZ_0 2024-09-12T18:01:50.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4705960820164837638', time=2024-09-12T19:54:13.735780+0000, chain.objs.size()=1 2024-09-12T18:01:50.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.yL2NF8uXZGJ-OdS3ZSM0q5XEPve6bwN_0 2024-09-12T18:01:50.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14885354110834207610', time=2024-09-12T19:54:13.754560+0000, chain.objs.size()=1 2024-09-12T18:01:50.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Szly5N0aTfMUbjV_awqR1iELlIdmJF-_0 2024-09-12T18:01:50.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13319301901693164968', time=2024-09-12T19:54:14.083697+0000, chain.objs.size()=1 2024-09-12T18:01:50.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.wjw0-Eu4MzH6Qx5ywmEvlVz7UKiMCxq_0 2024-09-12T18:01:50.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15225360075036878572', time=2024-09-12T19:54:14.371858+0000, chain.objs.size()=1 2024-09-12T18:01:50.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.5OTgbfeoCTpk9XEAD-jO1EGR68pWF6v_0 2024-09-12T18:01:50.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14783902336812473514', time=2024-09-12T19:54:14.397422+0000, chain.objs.size()=1 2024-09-12T18:01:50.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.971+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.JReJhid2aAQqd6J5FYq80s5PJp-2Qum_0 2024-09-12T18:01:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.973+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11685987620404547463', time=2024-09-12T19:54:14.582938+0000, chain.objs.size()=1 2024-09-12T18:01:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.973+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.pronrxOVwd3YaMNPATjMheCMtnElXgh_0 2024-09-12T18:01:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.973+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5755752399942730663', time=2024-09-12T19:54:14.605900+0000, chain.objs.size()=1 2024-09-12T18:01:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.973+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.KwCUUVQJyAmIczh9kPvIimZ9UyJSAKc_0 2024-09-12T18:01:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.974+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16691563050156815602', time=2024-09-12T19:54:14.618300+0000, chain.objs.size()=1 2024-09-12T18:01:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.974+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.YBg7rnDp6yETMKZvxGcQBSI5ITmP0Tz_0 2024-09-12T18:01:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.974+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7215910481264653652', time=2024-09-12T19:54:14.723551+0000, chain.objs.size()=1 2024-09-12T18:01:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.974+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.VFQChFc59iM8H9MDTbgXMaDYP3D08Cl_0 2024-09-12T18:01:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10933641786426444047', time=2024-09-12T19:54:14.734574+0000, chain.objs.size()=1 2024-09-12T18:01:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.6m_QzbGlkSVUcryV1k2K45hqcriflfD_0 2024-09-12T18:01:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7406150032303501969', time=2024-09-12T19:54:14.737756+0000, chain.objs.size()=1 2024-09-12T18:01:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.DXO_MUYyQtgTbN7HzYPZ2ZHXpBrx6Si_0 2024-09-12T18:01:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5320089195618477582', time=2024-09-12T19:54:14.748026+0000, chain.objs.size()=1 2024-09-12T18:01:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Tf3sc8cNSTxYGNABd6xKduCl22IH6CT_0 2024-09-12T18:01:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4769892157764615984', time=2024-09-12T19:54:14.751465+0000, chain.objs.size()=1 2024-09-12T18:01:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.EyK9ACILU9xn4LX2dHrThW-CrvX6-95_0 2024-09-12T18:01:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17990015240718128305', time=2024-09-12T19:54:14.794080+0000, chain.objs.size()=1 2024-09-12T18:01:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.cWj8ssWjXl7g72IyVAK7WT7Neh_VnKa_0 2024-09-12T18:01:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16848586213099351942', time=2024-09-12T19:54:14.875412+0000, chain.objs.size()=1 2024-09-12T18:01:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ukLB8NKcWgy7NCPm7iJZApsuYSJDu0w_0 2024-09-12T18:01:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5116227134370233793', time=2024-09-12T19:54:14.899354+0000, chain.objs.size()=1 2024-09-12T18:01:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.v4mNt9czWzaz7tOgGIl1vTl7Bv-b3DA_0 2024-09-12T18:01:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3389950240693614850', time=2024-09-12T19:54:14.917216+0000, chain.objs.size()=1 2024-09-12T18:01:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.ahda3F2pHPNNw78Fyw-Ttbrk9ipCFoY_0 2024-09-12T18:01:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2673969286028660184', time=2024-09-12T19:54:14.923722+0000, chain.objs.size()=1 2024-09-12T18:01:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.NzhYeNUvGfpl2lzUS7mZSRq0eZA9TWG_0 2024-09-12T18:01:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12256513082232806469', time=2024-09-12T19:54:14.924913+0000, chain.objs.size()=1 2024-09-12T18:01:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.wZ5Q6O2zXolpAyeGMIeYyJE53YnUIls_0 2024-09-12T18:01:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8848243140096137633', time=2024-09-12T19:54:14.932315+0000, chain.objs.size()=1 2024-09-12T18:01:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.976+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.7nl4aca0CL72gqnNN3VJ95Nc9tXWXIT_0 2024-09-12T18:01:50.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8804608454201537754', time=2024-09-12T19:54:17.768354+0000, chain.objs.size()=1 2024-09-12T18:01:50.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.277__shadow_.4hO3JyHMxEbKpn6c5kDZf8Ox2zV6Qsq_0 2024-09-12T18:01:50.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13739954863835189517', time=2024-09-12T19:54:18.602100+0000, chain.objs.size()=1 2024-09-12T18:01:50.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.281__shadow_.fNvEW_v0s1IX_PiXdoO-83kE5aLkXBa_0 2024-09-12T18:01:50.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5066509060732016654', time=2024-09-12T19:54:19.059599+0000, chain.objs.size()=1 2024-09-12T18:01:50.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.283__shadow_.kzdpJ7bTgnKw0iudenv93BbW9py_snS_0 2024-09-12T18:01:50.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14877136264407706971', time=2024-09-12T19:54:21.589193+0000, chain.objs.size()=1 2024-09-12T18:01:50.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.293__shadow_.uPCGRlHgdZixTjrepnMg6oJj-YgnudX_0 2024-09-12T18:01:50.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7005264150402412928', time=2024-09-12T19:54:22.165133+0000, chain.objs.size()=1 2024-09-12T18:01:50.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.NErmrdjktGTVG2AXetBdmKP6a8dyn1i_0 2024-09-12T18:01:50.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14353680417596357081', time=2024-09-12T19:54:22.171029+0000, chain.objs.size()=1 2024-09-12T18:01:50.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.p_yrHbU4F2COstV2UUaaRqW-j_rVeSm_0 2024-09-12T18:01:50.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.978+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.57315230156254029', time=2024-09-12T19:54:23.567261+0000, chain.objs.size()=1 2024-09-12T18:01:50.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.978+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.300__shadow_.bEzGd686p0KZpBovmYQqW8ldnoGIGle_0 2024-09-12T18:01:50.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.979+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11046447367426405912', time=2024-09-12T19:54:24.377993+0000, chain.objs.size()=1 2024-09-12T18:01:50.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.979+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.304__shadow_.vN_TZcvCtIsydndmKEgsGwwnlcc3GAL_0 2024-09-12T18:01:50.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.979+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6212439511295605179', time=2024-09-12T19:54:27.640199+0000, chain.objs.size()=1 2024-09-12T18:01:50.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.979+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.320__shadow:1dzm1GruIjG0yEYzXgLtvjcwL46MSwI_.BiaIvSqKwuLcCRLR_-jQ6iZyg-7uul4_0 2024-09-12T18:01:50.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.979+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3994123405346668618', time=2024-09-12T19:54:35.808578+0000, chain.objs.size()=1 2024-09-12T18:01:50.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.979+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.VLVkfVKT0-hyMl-9p83623VXT3YQW0f_0 2024-09-12T18:01:50.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.979+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4131046548168021336', time=2024-09-12T19:54:35.919352+0000, chain.objs.size()=1 2024-09-12T18:01:50.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.979+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.EOkRWVgBc8BfUab6J2n9VG7uw6M-146_0 2024-09-12T18:01:50.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.980+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11571754316678350384', time=2024-09-12T19:54:35.956905+0000, chain.objs.size()=1 2024-09-12T18:01:50.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.980+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QUWii2oHai_78nt4JuYgLhe5lUMdKrC_0 2024-09-12T18:01:50.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6259535409570541756', time=2024-09-12T19:54:36.119032+0000, chain.objs.size()=1 2024-09-12T18:01:50.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.IoTZKYKF9abHtIph22kn7CpEbwvCHX__0 2024-09-12T18:01:50.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17699274702155657983', time=2024-09-12T19:54:36.169986+0000, chain.objs.size()=1 2024-09-12T18:01:50.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.cr52-8jmbctNPFgTe6GDQiwkzXTwtTR_0 2024-09-12T18:01:50.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7117071006251616771', time=2024-09-12T19:54:36.250998+0000, chain.objs.size()=1 2024-09-12T18:01:50.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.QIbsSiWQ3MusfMGVz1MWz2MH-poNKG0_0 2024-09-12T18:01:50.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18129402479246915802', time=2024-09-12T19:54:36.298536+0000, chain.objs.size()=1 2024-09-12T18:01:50.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.uRrQhd32p9mxtXTH3Y156wHKio6uPfo_0 2024-09-12T18:01:50.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16075754620673679332', time=2024-09-12T19:54:36.315929+0000, chain.objs.size()=1 2024-09-12T18:01:50.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.j3lSYjbopc2PUJsKjBCpxGjgXayhQBm_0 2024-09-12T18:01:50.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9343928526815341999', time=2024-09-12T19:54:36.330777+0000, chain.objs.size()=1 2024-09-12T18:01:50.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.TeP1OkN5ERVJwNKBsJn3k2T8yHiLTaf_0 2024-09-12T18:01:50.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9761434612660853625', time=2024-09-12T19:54:36.417753+0000, chain.objs.size()=1 2024-09-12T18:01:50.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.j0_r4hvUeVrmqcNVl8uez3jrbIyjp9l_0 2024-09-12T18:01:50.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14865837416261105990', time=2024-09-12T19:54:36.429104+0000, chain.objs.size()=1 2024-09-12T18:01:50.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9AlvqbJrVu-F1q9XAJAMtvQE5qsf6Mt_0 2024-09-12T18:01:50.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8573172596657616468', time=2024-09-12T19:54:36.474608+0000, chain.objs.size()=1 2024-09-12T18:01:50.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.JapjXJw3GEwuRRSa-DYUTcHvjX2no___0 2024-09-12T18:01:50.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1416797087917590213', time=2024-09-12T19:54:36.481854+0000, chain.objs.size()=1 2024-09-12T18:01:50.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.5jp31H2Rp55wo-66z3gkmjNtph7q_Ja_0 2024-09-12T18:01:50.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17365158058228167124', time=2024-09-12T19:54:36.492436+0000, chain.objs.size()=1 2024-09-12T18:01:50.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.983+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0cpGemMfDjnbLHg-zJSRwqxMCO8D35z_0 2024-09-12T18:01:50.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2789575624234573185', time=2024-09-12T19:54:36.496530+0000, chain.objs.size()=1 2024-09-12T18:01:50.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.HgYPo2duOlO-VIF9uy3K8-LMlQ1-IJb_0 2024-09-12T18:01:50.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12579347448127191695', time=2024-09-12T19:54:36.595049+0000, chain.objs.size()=1 2024-09-12T18:01:50.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.gZga7AbReGeT8aPBIR7qVVpukqaY9YR_0 2024-09-12T18:01:50.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18319159098236359414', time=2024-09-12T19:54:36.662368+0000, chain.objs.size()=1 2024-09-12T18:01:50.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.u0ncF1p6zKdsb0JZjqAAOg8Q-sYQKgQ_0 2024-09-12T18:01:50.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4147178172136864632', time=2024-09-12T19:54:36.667275+0000, chain.objs.size()=1 2024-09-12T18:01:50.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.PUTarrUlZmVb-Co4SZpuy_t0cO_jjny_0 2024-09-12T18:01:50.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15677819421575183975', time=2024-09-12T19:54:36.744766+0000, chain.objs.size()=1 2024-09-12T18:01:50.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.qKaYCklGBGZ5Z2LOvCAnNXWJyZnL7fk_0 2024-09-12T18:01:50.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9879351178166743955', time=2024-09-12T19:54:36.780033+0000, chain.objs.size()=1 2024-09-12T18:01:50.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.sATD6Gd4TuRlFu67EPhKYUbssqXe36e_0 2024-09-12T18:01:50.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8555784869608739906', time=2024-09-12T19:54:36.789012+0000, chain.objs.size()=1 2024-09-12T18:01:50.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.PFi0jXCYeRe68HN7h77YvKC9HXpcthc_0 2024-09-12T18:01:50.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11614321473655195380', time=2024-09-12T19:54:36.789820+0000, chain.objs.size()=1 2024-09-12T18:01:50.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.aEWM9gL5mbRdVpSEu8n3FF_WQ3lCOk0_0 2024-09-12T18:01:50.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.558094393460240164', time=2024-09-12T19:54:36.802914+0000, chain.objs.size()=1 2024-09-12T18:01:50.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.4QoBwL61mJqxbF18HhAPV3teU2Fs5mC_0 2024-09-12T18:01:50.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17176643340898277895', time=2024-09-12T19:54:36.805344+0000, chain.objs.size()=1 2024-09-12T18:01:50.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.1aHUqZcDHzTmwe_1WY6yuB01lc8H9Dd_0 2024-09-12T18:01:50.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2031461793019398707', time=2024-09-12T19:54:36.814371+0000, chain.objs.size()=1 2024-09-12T18:01:50.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.985+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.lPyG5vDTrj2h8HYzF_EOf3y3W9h_dco_0 2024-09-12T18:01:50.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12128386262330013518', time=2024-09-12T19:54:36.832829+0000, chain.objs.size()=1 2024-09-12T18:01:50.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.roYY662m1Wg4AIEr6DiQEwixnMl16eu_0 2024-09-12T18:01:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9895230477274844304', time=2024-09-12T19:54:36.901651+0000, chain.objs.size()=1 2024-09-12T18:01:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.FbGdFS3t_sgbJrKU4gkgsEXrg9g63QS_0 2024-09-12T18:01:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5133678854785126108', time=2024-09-12T19:54:36.909317+0000, chain.objs.size()=1 2024-09-12T18:01:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.K-WOD4ZKPHMyQ6GdsdPiubRupi0orq1_0 2024-09-12T18:01:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17518662571743250828', time=2024-09-12T19:54:36.915607+0000, chain.objs.size()=1 2024-09-12T18:01:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.L4fgAqXTNoMXgZPf2Yi03EUc8ApGA5v_0 2024-09-12T18:01:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1936120110909414926', time=2024-09-12T19:54:36.916402+0000, chain.objs.size()=1 2024-09-12T18:01:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.3llQC48NGtz2C4sJnM7jIL9WJiO7xYZ_0 2024-09-12T18:01:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1271212667743664633', time=2024-09-12T19:54:36.951699+0000, chain.objs.size()=1 2024-09-12T18:01:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.yAc9_I3eW61CZHPXOPGor90ZpxTzgLP_0 2024-09-12T18:01:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15155251607003708610', time=2024-09-12T19:54:36.972121+0000, chain.objs.size()=1 2024-09-12T18:01:50.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.zltRvZ4D1zK4ddXLMXDNdBCQC8jOEZA_0 2024-09-12T18:01:50.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7789060137106619040', time=2024-09-12T19:54:44.529077+0000, chain.objs.size()=1 2024-09-12T18:01:50.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.r5ybm3L5A-HKkeIoLi0smOP2VL12dzF_0 2024-09-12T18:01:50.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4860778753547061984', time=2024-09-12T19:54:44.537170+0000, chain.objs.size()=1 2024-09-12T18:01:50.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.hP9IiRjD074MqiY8dnbRDtPo4_juE00_0 2024-09-12T18:01:50.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4548859526860803445', time=2024-09-12T19:54:44.542080+0000, chain.objs.size()=1 2024-09-12T18:01:50.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.987+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.g11Qkd3st_G5-BmRoikQp6x8h_Z2G0V_0 2024-09-12T18:01:50.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.988+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8755350373012886374', time=2024-09-12T19:54:44.631819+0000, chain.objs.size()=1 2024-09-12T18:01:50.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.988+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.T5OohVVL9S6qLcaEVD7h9ZZTxQ4sTDM_0 2024-09-12T18:01:50.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.764153457194560504', time=2024-09-12T19:54:44.644368+0000, chain.objs.size()=1 2024-09-12T18:01:50.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.sQVsK1NUtorZi5IRHRVQpQcLRvdXUN4_0 2024-09-12T18:01:50.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5821107208217864089', time=2024-09-12T19:54:44.658396+0000, chain.objs.size()=1 2024-09-12T18:01:50.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.z8GHtiR-uwbmt8IyFc2cfD_WBcie8cQ_0 2024-09-12T18:01:50.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17376484065812997196', time=2024-09-12T19:54:44.670177+0000, chain.objs.size()=1 2024-09-12T18:01:50.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.q5DC_tRBrIgGejeiKrlhdusPpvJDXOS_0 2024-09-12T18:01:50.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9580283154689645532', time=2024-09-12T19:54:44.696168+0000, chain.objs.size()=1 2024-09-12T18:01:50.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.1kGrS1hk8Go9uZuQgOU_J2ioB5YswRq_0 2024-09-12T18:01:50.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6534806551026394457', time=2024-09-12T19:54:44.716233+0000, chain.objs.size()=1 2024-09-12T18:01:50.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.FgrvGu-81rXNW5AzWxIade7OObBUlv8_0 2024-09-12T18:01:50.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8391219068742166987', time=2024-09-12T19:54:44.719867+0000, chain.objs.size()=1 2024-09-12T18:01:50.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.9xuvb5OQs5qg46Kp0dDGkZTfdI0RxKe_0 2024-09-12T18:01:50.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14293315953694203939', time=2024-09-12T19:54:44.797546+0000, chain.objs.size()=1 2024-09-12T18:01:50.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.HnRoQqwNf0ogwoMs-S3K9hNETnUWXza_0 2024-09-12T18:01:50.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9891351346273833829', time=2024-09-12T19:54:44.798392+0000, chain.objs.size()=1 2024-09-12T18:01:50.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.F4Cr9M8vZybeqnIIhp721kaIKoU02Si_0 2024-09-12T18:01:50.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9223590523551015282', time=2024-09-12T19:54:44.800829+0000, chain.objs.size()=1 2024-09-12T18:01:50.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.gIfPbCJU8Pf4B7Gr_fMqDLZ1MwlOrxs_0 2024-09-12T18:01:50.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3417292218610391903', time=2024-09-12T19:54:44.887625+0000, chain.objs.size()=1 2024-09-12T18:01:50.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.uNpYW9y8LWcOoFaW6L3pyHuusBO-RA__0 2024-09-12T18:01:50.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2091842303044936665', time=2024-09-12T19:54:45.032303+0000, chain.objs.size()=1 2024-09-12T18:01:50.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.990+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.gs5m2RP0PuAkRsfffssjkm2s7s63K87_0 2024-09-12T18:01:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.993+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2685871594687590495', time=2024-09-12T19:54:45.038885+0000, chain.objs.size()=1 2024-09-12T18:01:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.993+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ETOPpXcFzfgGWvBcylrBol5UNPt9jrH_0 2024-09-12T18:01:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.993+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.46962317304258618', time=2024-09-12T19:54:45.043263+0000, chain.objs.size()=1 2024-09-12T18:01:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.993+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.vF8kFdjfki9xDm4GspVOavGp300RH65_0 2024-09-12T18:01:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.993+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17967916612792718084', time=2024-09-12T19:54:45.170620+0000, chain.objs.size()=1 2024-09-12T18:01:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.993+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.tG8QAL1otAP88M2CAPPQed2fqTOlwFP_0 2024-09-12T18:01:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.993+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5394149116025430506', time=2024-09-12T19:54:45.213068+0000, chain.objs.size()=1 2024-09-12T18:01:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.993+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.tNT7YBwvOXeCRId4qkGO7rjh6Rzsl5w_0 2024-09-12T18:01:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.993+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5512659248509063195', time=2024-09-12T19:54:45.368915+0000, chain.objs.size()=1 2024-09-12T18:01:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.993+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.rKjVvwpF1PSRoR7CXkZs2qrpwKk92NI_0 2024-09-12T18:01:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.993+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13398635604320404187', time=2024-09-12T19:54:45.376368+0000, chain.objs.size()=1 2024-09-12T18:01:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.993+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.3N1VkyUdo8v3TW3nMgNtfuDXdK6pRgG_0 2024-09-12T18:01:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.993+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6950413894281278955', time=2024-09-12T19:54:45.386650+0000, chain.objs.size()=1 2024-09-12T18:01:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.993+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.59sfVG0ZAHwa_DmK066oG5lHGS8tMuE_0 2024-09-12T18:01:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.993+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4462809967541481706', time=2024-09-12T19:54:45.541025+0000, chain.objs.size()=1 2024-09-12T18:01:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.993+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.5oS8YojlaPei4RWCM4r2m3zlooDoSHR_0 2024-09-12T18:01:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.995+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/43407 2024-09-12T18:01:50.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T18:01:50.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15229933669029431511', time=2024-09-12T19:54:45.546801+0000, chain.objs.size()=1 2024-09-12T18:01:50.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.zHg4qIdbgM9kzQEZv0EMm19ysS4sf3h_0 2024-09-12T18:01:50.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4926497960436596327', time=2024-09-12T19:54:45.561319+0000, chain.objs.size()=1 2024-09-12T18:01:51.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.tnchKSYv2mXQARGTe-bXtqaRFWhGBO8_0 2024-09-12T18:01:51.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3891287614527885152', time=2024-09-12T19:54:45.578197+0000, chain.objs.size()=1 2024-09-12T18:01:51.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.WKA_tT2i-sOdwUMszwS8iidwQdI9CrP_0 2024-09-12T18:01:51.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1534181874328771900', time=2024-09-12T19:54:45.585849+0000, chain.objs.size()=1 2024-09-12T18:01:51.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.dCQEVAbaElFLEz386Jo_cvAKo4uUSi9_0 2024-09-12T18:01:51.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17928958925184983547', time=2024-09-12T19:54:45.592990+0000, chain.objs.size()=1 2024-09-12T18:01:51.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.IDyZiEJ_PAUckYJnHxjg4pzdloNW-AH_0 2024-09-12T18:01:51.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17124664902773101634', time=2024-09-12T19:54:45.599457+0000, chain.objs.size()=1 2024-09-12T18:01:51.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.TY-hJieIydmfOMmyd2McbP5PaeQ2_vb_0 2024-09-12T18:01:51.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16683898101344478408', time=2024-09-12T19:54:45.675975+0000, chain.objs.size()=1 2024-09-12T18:01:51.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.N3CAmETsxaV3ji48go4ZhP2xefxwmRO_0 2024-09-12T18:01:51.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5050625430115502604', time=2024-09-12T19:54:45.705057+0000, chain.objs.size()=1 2024-09-12T18:01:51.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.nFiDs8wrGXDNkI3cUQBAAMEywRtsmZF_0 2024-09-12T18:01:51.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11326026532231257695', time=2024-09-12T19:54:45.741980+0000, chain.objs.size()=1 2024-09-12T18:01:51.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.mw5Kzh5TfazS8nd69VmwVkcBeSmSZHa_0 2024-09-12T18:01:51.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3592128285774026528', time=2024-09-12T19:54:47.892742+0000, chain.objs.size()=1 2024-09-12T18:01:51.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.336__shadow_.8OnBpD7GNbzg_dNBOTv9LRJrJQeoD_G_0 2024-09-12T18:01:51.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4040001975809734491', time=2024-09-12T19:54:57.933785+0000, chain.objs.size()=1 2024-09-12T18:01:51.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.385__shadow_.d1QfckKqjey47QWMIksT1Ld19vedZ7A_0 2024-09-12T18:01:51.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10287118108937261635', time=2024-09-12T19:55:27.713008+0000, chain.objs.size()=6 2024-09-12T18:01:51.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:50.998+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.1 2024-09-12T18:01:51.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.000+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.2 2024-09-12T18:01:51.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.000+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.3 2024-09-12T18:01:51.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.000+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.4 2024-09-12T18:01:51.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.000+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.5 2024-09-12T18:01:51.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.000+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.6 2024-09-12T18:01:51.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.000+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3497122547897424608', time=2024-09-12T19:55:36.269488+0000, chain.objs.size()=6 2024-09-12T18:01:51.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.000+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~TRN6N4xdNmL9VuiEE1iWnvlAb1RL1Y1.1 2024-09-12T18:01:51.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.000+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~TRN6N4xdNmL9VuiEE1iWnvlAb1RL1Y1.2 2024-09-12T18:01:51.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.000+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.RERhLIFVWlH9JtYfjBvZbm7-J_8CVX37.3 2024-09-12T18:01:51.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.000+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~TRN6N4xdNmL9VuiEE1iWnvlAb1RL1Y1.4 2024-09-12T18:01:51.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.001+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~TRN6N4xdNmL9VuiEE1iWnvlAb1RL1Y1.5 2024-09-12T18:01:51.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.001+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~TRN6N4xdNmL9VuiEE1iWnvlAb1RL1Y1.6 2024-09-12T18:01:51.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.002+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='2~7BQfuEgVPwBnOLzniFKGYipojvPUh-T', time=2024-09-12T19:55:42.375142+0000, chain.objs.size()=1 2024-09-12T18:01:51.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.002+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.532__multipart_mymultipart.2~7BQfuEgVPwBnOLzniFKGYipojvPUh-T.1 2024-09-12T18:01:51.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.002+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7824388027105955020', time=2024-09-12T19:56:13.731549+0000, chain.objs.size()=1 2024-09-12T18:01:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.002+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.559__shadow_.q21PZImoxn66YeTKGyEi9n4HTHTS9ab_0 2024-09-12T18:01:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.002+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8436775771837320414', time=2024-09-12T19:56:20.440768+0000, chain.objs.size()=1 2024-09-12T18:01:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.002+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.567__shadow_.ihKMw0RzYuKS8n80ZL4m2M4TKT3y0d1_0 2024-09-12T18:01:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.002+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4877128441154421065', time=2024-09-12T19:56:22.729940+0000, chain.objs.size()=1 2024-09-12T18:01:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.002+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:tT4V2FphWtoiKlCh-afdYFA2SzzZUr7_.nRyQ_NIMqmC7uTzbMRg1RndTJ02-SaP_0 2024-09-12T18:01:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.002+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10378889504971417201', time=2024-09-12T19:56:28.576535+0000, chain.objs.size()=1 2024-09-12T18:01:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.002+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.574__shadow_.2zTiyO6YrOUkK2bCB_p91s7a5URYFDE_0 2024-09-12T18:01:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.002+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13123772498688140557', time=2024-09-12T19:56:31.064425+0000, chain.objs.size()=1 2024-09-12T18:01:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.002+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.575__shadow:S-4bCc8osn2yAg0jl.eImQ0DfM7LPZq_.bvh2KF1kCBgNrU9bdV6ZjojH7oO1dKa_0 2024-09-12T18:01:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.002+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5153519798304142551', time=2024-09-12T19:56:48.830807+0000, chain.objs.size()=4 2024-09-12T18:01:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.002+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.579__multipart_testobj.2~w_AvyakLW0V70KKrosfvwvW9rqlyqHl.1 2024-09-12T18:01:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.003+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.579__multipart_testobj.2~w_AvyakLW0V70KKrosfvwvW9rqlyqHl.2 2024-09-12T18:01:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.004+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.579__multipart_testobj.2~w_AvyakLW0V70KKrosfvwvW9rqlyqHl.3 2024-09-12T18:01:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.004+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.579__multipart_testobj.2~w_AvyakLW0V70KKrosfvwvW9rqlyqHl.4 2024-09-12T18:01:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.004+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6099421293390789066', time=2024-09-12T19:56:51.233251+0000, chain.objs.size()=1 2024-09-12T18:01:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.004+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.583__shadow:EZ0EL5LA8n9LnLjf8YeYw.rG7ZAGY.T_.AYlvu2eQBG2NLXR4cAJDyMtmWtHLhlj_0 2024-09-12T18:01:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.004+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3490713803097641971', time=2024-09-12T19:56:53.064892+0000, chain.objs.size()=1 2024-09-12T18:01:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.004+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.588__shadow:7LPMFM.3j2JYfMV3FA8GRS3OeDl34KX_.ao7cPsjy9BrDGWS-TwV0OiHpBWsn8is_0 2024-09-12T18:01:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.005+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16238027735023975026', time=2024-09-12T19:59:09.302387+0000, chain.objs.size()=1 2024-09-12T18:01:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.005+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.640__shadow_.LMHB2bgUWZxW6X614nXwASucU5P_Edf_0 2024-09-12T18:01:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.005+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9589343976649016303', time=2024-09-12T19:59:18.657399+0000, chain.objs.size()=1 2024-09-12T18:01:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.005+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.669__shadow_.pDpWAnDheoF01vjF-5iekCizad368Bt_0 2024-09-12T18:01:51.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.007+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5309279077772504406', time=2024-09-12T19:59:24.345006+0000, chain.objs.size()=1 2024-09-12T18:01:51.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.007+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.698__shadow:TSTKJh1o7r4odjM28ntcJ7IUYd-SY-._.a3vhZUVGnSLkqPvdzZccggR7PnIDdU1_0 2024-09-12T18:01:51.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.007+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17060921645410514287', time=2024-09-12T19:59:28.334812+0000, chain.objs.size()=1 2024-09-12T18:01:51.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.007+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.715__shadow:AZzxzpzjU6NdizMtnN2nLmHxifZJc9P_.LjkhbTwQAVOLq---nAal9XKRWTN6uhf_0 2024-09-12T18:01:51.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.008+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:51.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.011+0000 7f7bf0213800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:01:51.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.012+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:01:51.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.012+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:01:51.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49853' 2024-09-12T18:01:51.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='_uQ7G1uqctbmfUi6raXrc_TLrLkfzZNN', time=2024-09-12T19:52:55.895322+0000, chain.objs.size()=2 2024-09-12T18:01:51.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.161__shadow_.-XaE1xasSuImdiVYtPFysV6BFXKd65t_0 2024-09-12T18:01:51.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.161__shadow_.-XaE1xasSuImdiVYtPFysV6BFXKd65t_1 2024-09-12T18:01:51.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15382324411499505883', time=2024-09-12T19:52:56.778175+0000, chain.objs.size()=3 2024-09-12T18:01:51.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__multipart_foo-LUKEWARM.2~MwDPy8Ovz2gBTUUavLRjRHulhgURrPZ.1 2024-09-12T18:01:51.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__multipart_foo-LUKEWARM.2~MwDPy8Ovz2gBTUUavLRjRHulhgURrPZ.2 2024-09-12T18:01:51.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.162__multipart_foo-LUKEWARM.2~MwDPy8Ovz2gBTUUavLRjRHulhgURrPZ.3 2024-09-12T18:01:51.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9864406655940895388', time=2024-09-12T19:54:01.646647+0000, chain.objs.size()=1 2024-09-12T18:01:51.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.241__shadow_.A4UD9bjGkWUdu5szd6ntqnp1omnHtXf_0 2024-09-12T18:01:51.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6120671467509673552', time=2024-09-12T19:54:02.053554+0000, chain.objs.size()=1 2024-09-12T18:01:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.243__shadow_.IYZ4K5PqgvRQe-630l3HMREfwpot3yP_0 2024-09-12T18:01:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2202019652730323702', time=2024-09-12T19:54:05.083965+0000, chain.objs.size()=1 2024-09-12T18:01:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.257__shadow_.mbIjLqUd1l8IZJ5_ELQjbO2yjnj2UDG_0 2024-09-12T18:01:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12308941771745476875', time=2024-09-12T19:54:13.487733+0000, chain.objs.size()=1 2024-09-12T18:01:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.MNggPi1QtiLVPQIhh5GrsNpQBc5Sd_b_0 2024-09-12T18:01:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4150120599947716984', time=2024-09-12T19:54:13.520991+0000, chain.objs.size()=1 2024-09-12T18:01:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.P9CAXNZ7mJegD9ywDAZLLUOearbFqn2_0 2024-09-12T18:01:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8926905396641706448', time=2024-09-12T19:54:13.554984+0000, chain.objs.size()=1 2024-09-12T18:01:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.llzUqDZX-9FHcYMR8nT-P6D_yBhSMLh_0 2024-09-12T18:01:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3573517108389487759', time=2024-09-12T19:54:13.563010+0000, chain.objs.size()=1 2024-09-12T18:01:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.013+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.Q7_NHPsPFPHNz4s00edsmZHgHK-YMjZ_0 2024-09-12T18:01:51.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11088229192077540202', time=2024-09-12T19:54:13.567687+0000, chain.objs.size()=1 2024-09-12T18:01:51.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_._zExz2ivGh_ut192G9HSgPqvex79GJT_0 2024-09-12T18:01:51.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2221101682474202245', time=2024-09-12T19:54:13.575209+0000, chain.objs.size()=1 2024-09-12T18:01:51.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.uhy_BzAzPp3QOJ-Y7eBqCpt10YO7UYh_0 2024-09-12T18:01:51.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6826845880682919585', time=2024-09-12T19:54:13.578794+0000, chain.objs.size()=1 2024-09-12T18:01:51.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.bYl2-z7X_A2JQ6-bx4GNJqmGoM38M3P_0 2024-09-12T18:01:51.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.709482641916295111', time=2024-09-12T19:54:13.679753+0000, chain.objs.size()=1 2024-09-12T18:01:51.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.h4ND1H3eN9JeElWqS-4pLLIC-e48dky_0 2024-09-12T18:01:51.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10994252192817993820', time=2024-09-12T19:54:13.710953+0000, chain.objs.size()=1 2024-09-12T18:01:51.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.MrrdijsBM0RLc_StfuHCWffLZuUuE1J_0 2024-09-12T18:01:51.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6682784482862848806', time=2024-09-12T19:54:13.727651+0000, chain.objs.size()=1 2024-09-12T18:01:51.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.RHOcekLVP6JWuWwrbwcecIZ3xHkYgW0_0 2024-09-12T18:01:51.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8915932195463815193', time=2024-09-12T19:54:13.745457+0000, chain.objs.size()=1 2024-09-12T18:01:51.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.r4pkwZcjPxQCFraKag5AUGbGgOq_NmK_0 2024-09-12T18:01:51.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16754628678783928358', time=2024-09-12T19:54:13.748710+0000, chain.objs.size()=1 2024-09-12T18:01:51.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.TMDDTaRMrLr4biQYpoxaFWEP9NpLZZw_0 2024-09-12T18:01:51.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16419555012016993090', time=2024-09-12T19:54:13.839688+0000, chain.objs.size()=1 2024-09-12T18:01:51.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.JrLTpiaXOKwzU98UjCBNXZgR0RuM3B1_0 2024-09-12T18:01:51.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14293195384428753901', time=2024-09-12T19:54:14.036346+0000, chain.objs.size()=1 2024-09-12T18:01:51.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.OP_HtL5CUC4rsYe4fFasv_5Iy_teVUt_0 2024-09-12T18:01:51.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9546351410569917466', time=2024-09-12T19:54:14.080681+0000, chain.objs.size()=1 2024-09-12T18:01:51.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.017+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.jBp8MjjzLOmQIDVj7WMKzyFjTLvO8SE_0 2024-09-12T18:01:51.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2477478717655834333', time=2024-09-12T19:54:14.289477+0000, chain.objs.size()=1 2024-09-12T18:01:51.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.iwFI1wdrDyHjsAvTtdGBRbEUxIkfEE0_0 2024-09-12T18:01:51.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12308891593249875271', time=2024-09-12T19:54:14.291795+0000, chain.objs.size()=1 2024-09-12T18:01:51.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.-KG53A4bsaR554BRq4C4rF2D2ZM83ur_0 2024-09-12T18:01:51.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6474283296645745589', time=2024-09-12T19:54:14.391519+0000, chain.objs.size()=1 2024-09-12T18:01:51.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.jgmZ3lCegpzudQSZsxv8ED-yjuyru44_0 2024-09-12T18:01:51.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.736584456267394556', time=2024-09-12T19:54:14.405810+0000, chain.objs.size()=1 2024-09-12T18:01:51.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.4JYnidpO_7_CmJfJlpwIvh_omKXqYEB_0 2024-09-12T18:01:51.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12689392949874749538', time=2024-09-12T19:54:14.458669+0000, chain.objs.size()=1 2024-09-12T18:01:51.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.yySKiwsuZIYuxFmElNpLUfjKmTBuDdi_0 2024-09-12T18:01:51.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2972708787033925508', time=2024-09-12T19:54:14.553368+0000, chain.objs.size()=1 2024-09-12T18:01:51.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.mQ0CoxtWZM-mXpDpKUBT522NHzj5Vp__0 2024-09-12T18:01:51.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13345972238105713588', time=2024-09-12T19:54:14.558954+0000, chain.objs.size()=1 2024-09-12T18:01:51.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.XhVcpz4bxSJqsfrNlZFm7tb44T9-At3_0 2024-09-12T18:01:51.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12791887374021507318', time=2024-09-12T19:54:14.606287+0000, chain.objs.size()=1 2024-09-12T18:01:51.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.1iKaXFcNVa7YYT92JZwfc3bOOHCoem0_0 2024-09-12T18:01:51.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13484703365853565554', time=2024-09-12T19:54:14.632185+0000, chain.objs.size()=1 2024-09-12T18:01:51.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.XtwTpl4JH_383O_LsgTBVOAp5UbfD8U_0 2024-09-12T18:01:51.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10929737360017597685', time=2024-09-12T19:54:14.714123+0000, chain.objs.size()=1 2024-09-12T18:01:51.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.HJfaA8rf-NO5c-HcmxfCoPpKAZaUMdX_0 2024-09-12T18:01:51.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13395403781495972396', time=2024-09-12T19:54:14.728327+0000, chain.objs.size()=1 2024-09-12T18:01:51.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.019+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.LR3dcp7NY3X2Qh7aZTDh6LfgkeSii9v_0 2024-09-12T18:01:51.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.021+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16603602681441804522', time=2024-09-12T19:54:14.784072+0000, chain.objs.size()=1 2024-09-12T18:01:51.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.021+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_._QLFXNxH2MN7gfvrqd9GetEFK08cOvV_0 2024-09-12T18:01:51.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.021+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6085109461305935612', time=2024-09-12T19:54:14.876958+0000, chain.objs.size()=1 2024-09-12T18:01:51.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.021+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.i6SjjCzYxR0BHy29Mr2-7nTXqnjTges_0 2024-09-12T18:01:51.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.021+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14690723827613913369', time=2024-09-12T19:54:14.891342+0000, chain.objs.size()=1 2024-09-12T18:01:51.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.021+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.263__shadow_.WnhsiInJSwByZmPPyvlyrBFyLYrksOW_0 2024-09-12T18:01:51.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.021+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4195183322103651827', time=2024-09-12T19:54:18.397108+0000, chain.objs.size()=1 2024-09-12T18:01:51.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.021+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.280__shadow_.sEWCq03S1NbpdUmV51z08J1xgFOaDdf_0 2024-09-12T18:01:51.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.021+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18078069096570359834', time=2024-09-12T19:54:20.197369+0000, chain.objs.size()=1 2024-09-12T18:01:51.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.021+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.288__shadow_.WBVhOujhp6aDPSmrbjs8QWoTn3UuW2u_0 2024-09-12T18:01:51.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.021+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2061539626383453136', time=2024-09-12T19:54:22.170815+0000, chain.objs.size()=1 2024-09-12T18:01:51.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.021+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.294__shadow_.ai5a2sHpjHLvqORNrkemabfQocncpHl_0 2024-09-12T18:01:51.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.022+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4310008616542258763', time=2024-09-12T19:54:24.820924+0000, chain.objs.size()=1 2024-09-12T18:01:51.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.022+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.306__shadow_.ZvDU5Av97cnXkR-qN85eAE6bWb09J40_0 2024-09-12T18:01:51.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.023+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1784713679567024428', time=2024-09-12T19:54:24.821765+0000, chain.objs.size()=1 2024-09-12T18:01:51.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.023+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.306__shadow_.p0hsvONf4tl34ALh1kvPg_SoYqL3yfp_0 2024-09-12T18:01:51.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.023+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2790167340066925058', time=2024-09-12T19:54:35.748322+0000, chain.objs.size()=1 2024-09-12T18:01:51.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.023+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.KbTx3FPXiqLNedwn0CZjkq1CbM7n0lJ_0 2024-09-12T18:01:51.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.023+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2764963761496362639', time=2024-09-12T19:54:35.749273+0000, chain.objs.size()=1 2024-09-12T18:01:51.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.023+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.FAgXrDrNls5Zcokrszo96BkjBuCPDHi_0 2024-09-12T18:01:51.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.023+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11128882889643136855', time=2024-09-12T19:54:35.752590+0000, chain.objs.size()=1 2024-09-12T18:01:51.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.023+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.yR9-uElrzK6lTRk-Olbqd00gYaEQPOy_0 2024-09-12T18:01:51.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.023+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17771446228776649980', time=2024-09-12T19:54:35.758852+0000, chain.objs.size()=1 2024-09-12T18:01:51.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.023+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.nqvYFUdx5nEsqM_AoMD_3ruxW7wo-gr_0 2024-09-12T18:01:51.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.023+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7669506766082872157', time=2024-09-12T19:54:35.766450+0000, chain.objs.size()=1 2024-09-12T18:01:51.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.023+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.o6TnAXS1mxf7TcGqvdJ-3GoVUbApXJa_0 2024-09-12T18:01:51.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.023+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2911328918345029505', time=2024-09-12T19:54:35.796111+0000, chain.objs.size()=1 2024-09-12T18:01:51.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.023+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.juV5yy51Df2NCK1YyWVxUdGRy0qbyzu_0 2024-09-12T18:01:51.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.023+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16678391087689976789', time=2024-09-12T19:54:35.800003+0000, chain.objs.size()=1 2024-09-12T18:01:51.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.023+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.uT7r8Cymbt3Iwq0yLn9I4mWkXRyEGjY_0 2024-09-12T18:01:51.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.025+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13305683282754573526', time=2024-09-12T19:54:35.820775+0000, chain.objs.size()=1 2024-09-12T18:01:51.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.025+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.9fENXJBArae14Bc3IofwZgT9z-0d-36_0 2024-09-12T18:01:51.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.025+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10438981839763649830', time=2024-09-12T19:54:35.822729+0000, chain.objs.size()=1 2024-09-12T18:01:51.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.025+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.rJt2LpN0ChSUuJ1Bug3WlarvuaOSGVD_0 2024-09-12T18:01:51.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.025+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3885320254086243029', time=2024-09-12T19:54:35.837645+0000, chain.objs.size()=1 2024-09-12T18:01:51.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.025+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.kj9szrWBBoZK2ekNxhZkdFZIgc7u6G2_0 2024-09-12T18:01:51.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8617961802418321354', time=2024-09-12T19:54:35.923329+0000, chain.objs.size()=1 2024-09-12T18:01:51.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.zEGLbt95jZBXLwIssbwKUlqREG2EBuV_0 2024-09-12T18:01:51.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9769686013781949195', time=2024-09-12T19:54:35.930705+0000, chain.objs.size()=1 2024-09-12T18:01:51.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.grkg6_JAKQzYtlaP5d36B-XI2udtXbs_0 2024-09-12T18:01:51.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9697544139847212222', time=2024-09-12T19:54:35.934194+0000, chain.objs.size()=1 2024-09-12T18:01:51.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.0P_gIwPUQ4hoDuio8znHOshKHXqr1p__0 2024-09-12T18:01:51.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12963932609726267767', time=2024-09-12T19:54:35.957023+0000, chain.objs.size()=1 2024-09-12T18:01:51.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.TZbHSYE2c-1p4WivALk6lzSXwEMkzaN_0 2024-09-12T18:01:51.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17962545604636922667', time=2024-09-12T19:54:35.960059+0000, chain.objs.size()=1 2024-09-12T18:01:51.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.GxYi_EGJJ1aptq5I_nHDYYYW7DVMf7U_0 2024-09-12T18:01:51.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17540922509165188144', time=2024-09-12T19:54:35.967530+0000, chain.objs.size()=1 2024-09-12T18:01:51.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.xmbO7csa6UjTicz4jfeI8kougdcPFkk_0 2024-09-12T18:01:51.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7460470274575299665', time=2024-09-12T19:54:35.969292+0000, chain.objs.size()=1 2024-09-12T18:01:51.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.miaYFOmtJdTh2k5jwLe0YyG3ttktdIk_0 2024-09-12T18:01:51.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15746550285247690837', time=2024-09-12T19:54:36.099986+0000, chain.objs.size()=1 2024-09-12T18:01:51.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.5ztmnnPFYZXgQhwB_oQp8LnzLdbJhXu_0 2024-09-12T18:01:51.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6299870967829012371', time=2024-09-12T19:54:36.253393+0000, chain.objs.size()=1 2024-09-12T18:01:51.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.j6-iscyLrWhs-uSRUt4NV_3IhtPTwfL_0 2024-09-12T18:01:51.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4582772570546586787', time=2024-09-12T19:54:36.282045+0000, chain.objs.size()=1 2024-09-12T18:01:51.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.lxDV9Y5iR6y53kyd-ffE7xqgoYJTpmr_0 2024-09-12T18:01:51.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4615989081050424586', time=2024-09-12T19:54:36.299010+0000, chain.objs.size()=1 2024-09-12T18:01:51.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.028+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.IYrgmHuRMsN4whdMObntBkHwVj6pC7c_0 2024-09-12T18:01:51.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7143553470734535139', time=2024-09-12T19:54:36.312776+0000, chain.objs.size()=1 2024-09-12T18:01:51.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.p6sdv0RkaNqK2kfLeLZO8PVaVFRVJOU_0 2024-09-12T18:01:51.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8741699605992513522', time=2024-09-12T19:54:36.324365+0000, chain.objs.size()=1 2024-09-12T18:01:51.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.gDcSSg_A9zMmn0iuIgIUiam_k8bsFs5_0 2024-09-12T18:01:51.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5807166159266241515', time=2024-09-12T19:54:36.421271+0000, chain.objs.size()=1 2024-09-12T18:01:51.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.lc2V2jyrwERdOoB_Ne7nn5kB8Eh6A6e_0 2024-09-12T18:01:51.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9130814741554924391', time=2024-09-12T19:54:36.429292+0000, chain.objs.size()=1 2024-09-12T18:01:51.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.kefqy4Yta0cxmyrFCK-Vn6tktrgqUOO_0 2024-09-12T18:01:51.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16072694685933006114', time=2024-09-12T19:54:36.454093+0000, chain.objs.size()=1 2024-09-12T18:01:51.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.ZDDlgnjGhv1pC_NUafDZIsf63Z1E9ni_0 2024-09-12T18:01:51.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10470733456455861019', time=2024-09-12T19:54:36.466938+0000, chain.objs.size()=1 2024-09-12T18:01:51.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.zF3ob4O6VLEymrXwao7HuMwJk8Dg7I8_0 2024-09-12T18:01:51.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6299559515838296975', time=2024-09-12T19:54:36.475526+0000, chain.objs.size()=1 2024-09-12T18:01:51.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.G5SWRRYfeXDoIGGzAcRQyYB7QlK_N4P_0 2024-09-12T18:01:51.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4830822954043766539', time=2024-09-12T19:54:36.496635+0000, chain.objs.size()=1 2024-09-12T18:01:51.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.GppI3ELsdT_i3bRQ4vhS74qyjGe531h_0 2024-09-12T18:01:51.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17897379812909160942', time=2024-09-12T19:54:36.582438+0000, chain.objs.size()=1 2024-09-12T18:01:51.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.dBne8r8UYWSFIsgcNqyId-IWGu1U1ZN_0 2024-09-12T18:01:51.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12945174588408236505', time=2024-09-12T19:54:36.624107+0000, chain.objs.size()=1 2024-09-12T18:01:51.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.g8xupdYKK5Vx-rTmqqZoxIbON0mKoiK_0 2024-09-12T18:01:51.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8093224196339009401', time=2024-09-12T19:54:36.741692+0000, chain.objs.size()=1 2024-09-12T18:01:51.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.031+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.eQs-n225IqFc93zzWXkR6205oz6rmfI_0 2024-09-12T18:01:51.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9057291762833769122', time=2024-09-12T19:54:36.746553+0000, chain.objs.size()=1 2024-09-12T18:01:51.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.M1RAX9FYoQivV2cpE1leYJZOMhnQ_2I_0 2024-09-12T18:01:51.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5653654752274703681', time=2024-09-12T19:54:36.765989+0000, chain.objs.size()=1 2024-09-12T18:01:51.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.XsSVC-jhWwh1EJ67N0UBkTZWDKGooo-_0 2024-09-12T18:01:51.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9537924805624363891', time=2024-09-12T19:54:36.770269+0000, chain.objs.size()=1 2024-09-12T18:01:51.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.-MCTAk7kgKEnnW3alXMHuK_gzXbYb8T_0 2024-09-12T18:01:51.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11135859321892685942', time=2024-09-12T19:54:36.780554+0000, chain.objs.size()=1 2024-09-12T18:01:51.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.iYV_4EZvAa4UIsJwMOmwoMlCkwerYGy_0 2024-09-12T18:01:51.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.7945915807898824098', time=2024-09-12T19:54:36.781458+0000, chain.objs.size()=1 2024-09-12T18:01:51.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.a4nR3WqBcwP1F83PPoGU5vtChdaf5Qp_0 2024-09-12T18:01:51.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12755827287300169211', time=2024-09-12T19:54:36.812187+0000, chain.objs.size()=1 2024-09-12T18:01:51.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.M99xQJ8pBNbHwwn72-S635KuLNxHXk-_0 2024-09-12T18:01:51.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.868820664317285901', time=2024-09-12T19:54:36.916590+0000, chain.objs.size()=1 2024-09-12T18:01:51.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.xVPkcpx9eA509nL2tZpDHpCn4YFr0Ag_0 2024-09-12T18:01:51.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16741978466584682678', time=2024-09-12T19:54:36.927574+0000, chain.objs.size()=1 2024-09-12T18:01:51.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.FNeFjO8o2Zyf2TN16mpZsrZ8mCU4YPh_0 2024-09-12T18:01:51.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9186135886542922645', time=2024-09-12T19:54:36.942712+0000, chain.objs.size()=1 2024-09-12T18:01:51.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.035+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.xwj6JxnsglOp5IpSALG0toY9l5dvS5I_0 2024-09-12T18:01:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.037+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5965767479489279784', time=2024-09-12T19:54:36.951711+0000, chain.objs.size()=1 2024-09-12T18:01:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.037+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.324__shadow_.Aqlh5g4yZ2XtVvqmnvq4eFvZQzD--bI_0 2024-09-12T18:01:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.037+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1451041677755844478', time=2024-09-12T19:54:44.456488+0000, chain.objs.size()=1 2024-09-12T18:01:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.037+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.pB-oQa5M0x3rzoTDk4_-GZe_MTeqnh5_0 2024-09-12T18:01:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12069149251198255771', time=2024-09-12T19:54:44.479824+0000, chain.objs.size()=1 2024-09-12T18:01:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.v8PDJwAFt1tdqe-XXnfkbd4ecYkqXV8_0 2024-09-12T18:01:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.253039190259835687', time=2024-09-12T19:54:44.498674+0000, chain.objs.size()=1 2024-09-12T18:01:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.SAdiYHnXFkUkgD8RpA9JDrGD84PLwKC_0 2024-09-12T18:01:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8577714656753500749', time=2024-09-12T19:54:44.502113+0000, chain.objs.size()=1 2024-09-12T18:01:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.gqrSu6eOYTQ-KAczxfYEEwnIHyEAgzM_0 2024-09-12T18:01:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17986988074686884220', time=2024-09-12T19:54:44.507926+0000, chain.objs.size()=1 2024-09-12T18:01:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.rsUoo377PeZcBvYXTVhiNfPaLErPPwc_0 2024-09-12T18:01:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.16367910765764829042', time=2024-09-12T19:54:44.526455+0000, chain.objs.size()=1 2024-09-12T18:01:51.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.N8PHbravphP__jjl3XQkKdiKnQYwCob_0 2024-09-12T18:01:51.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14763820920487697425', time=2024-09-12T19:54:44.527837+0000, chain.objs.size()=1 2024-09-12T18:01:51.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.3y5GQyc9GcRVgGtZXvX5w2N-9g4Yj57_0 2024-09-12T18:01:51.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4774581605111607367', time=2024-09-12T19:54:44.629087+0000, chain.objs.size()=1 2024-09-12T18:01:51.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.Ip9tDdqdWx64BddDcv4E_rGGnHGNBkS_0 2024-09-12T18:01:51.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3931242682951077327', time=2024-09-12T19:54:44.630640+0000, chain.objs.size()=1 2024-09-12T18:01:51.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.6F2V-s4cL4qpbKYWGbN-EeHbdWzRZpt_0 2024-09-12T18:01:51.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14583330617776005766', time=2024-09-12T19:54:44.664053+0000, chain.objs.size()=1 2024-09-12T18:01:51.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.038+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.70GrOcSV_Eyp23P644sWqi96IpcLoW2_0 2024-09-12T18:01:51.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.039+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.5966322778008949683', time=2024-09-12T19:54:44.716948+0000, chain.objs.size()=1 2024-09-12T18:01:51.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.039+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.pwsRelsJWTbUhv-i2Cf0UH2SAmv__DX_0 2024-09-12T18:01:51.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.039+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8488927736589100887', time=2024-09-12T19:54:44.810630+0000, chain.objs.size()=1 2024-09-12T18:01:51.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.039+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.yv3dJVa9fgk8lVXrnulh9svfhf8103v_0 2024-09-12T18:01:51.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.039+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4973333021158977459', time=2024-09-12T19:54:44.826374+0000, chain.objs.size()=1 2024-09-12T18:01:51.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.039+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.urbQZr_azT7FXcNSVUfHE6hp047N5Ob_0 2024-09-12T18:01:51.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.039+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13586011877972579567', time=2024-09-12T19:54:44.860257+0000, chain.objs.size()=1 2024-09-12T18:01:51.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.039+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.OPwOmKkDhMex-uI-DzajzVZnj5fySFA_0 2024-09-12T18:01:51.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.040+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18081333632269192174', time=2024-09-12T19:54:44.967219+0000, chain.objs.size()=1 2024-09-12T18:01:51.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.040+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.R5gdDEQtWm1-89WXG9JUZ9crGChBZzr_0 2024-09-12T18:01:51.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.040+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14113392043489505571', time=2024-09-12T19:54:45.024327+0000, chain.objs.size()=1 2024-09-12T18:01:51.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.040+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.0251dTlESAGwWxBbgpKLo6uNC6JdoRR_0 2024-09-12T18:01:51.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.040+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13576995221507525194', time=2024-09-12T19:54:45.254402+0000, chain.objs.size()=1 2024-09-12T18:01:51.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.040+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.4ErUMZ62DLY3YSm77obteBlvnpu2YzH_0 2024-09-12T18:01:51.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.040+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4708123630148701523', time=2024-09-12T19:54:45.406351+0000, chain.objs.size()=1 2024-09-12T18:01:51.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.040+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.rJoCXdgGmLHckA18Ek2AUo-Km01Mk9T_0 2024-09-12T18:01:51.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.040+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.46774909234709408', time=2024-09-12T19:54:45.431352+0000, chain.objs.size()=1 2024-09-12T18:01:51.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.040+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.n5FKG4O5LglSBwcjT8rI07wuWHbeFZg_0 2024-09-12T18:01:51.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.042+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 0/49853 2024-09-12T18:01:51.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.044+0000 7f7bf0213800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T18:01:51.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.044+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.14051826583516426790', time=2024-09-12T19:54:45.508344+0000, chain.objs.size()=1 2024-09-12T18:01:51.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.044+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.MO_nDZlBcwuiOQI2DluVB7h9O2V18pR_0 2024-09-12T18:01:51.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.044+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.17116739264585757058', time=2024-09-12T19:54:45.532983+0000, chain.objs.size()=1 2024-09-12T18:01:51.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.044+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.R9R9pxI7Mx5KtiMWnTI2PNo_ZIfsV7B_0 2024-09-12T18:01:51.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10940069637537757025', time=2024-09-12T19:54:45.538222+0000, chain.objs.size()=1 2024-09-12T18:01:51.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.6kpaqCxEiGX6B9Cax1gu1DrNkzOwLJ4_0 2024-09-12T18:01:51.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2813725531707803930', time=2024-09-12T19:54:45.674410+0000, chain.objs.size()=1 2024-09-12T18:01:51.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.JN6UUBKpTv5qPOVT0pa0wCphIDdScbV_0 2024-09-12T18:01:51.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15689856623327585834', time=2024-09-12T19:54:45.677750+0000, chain.objs.size()=1 2024-09-12T18:01:51.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.hjcTMsRYGg1zuLoM1rwMsViu7HujJyd_0 2024-09-12T18:01:51.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.18113911055228168566', time=2024-09-12T19:54:45.679884+0000, chain.objs.size()=1 2024-09-12T18:01:51.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.7uwS-9sAWK6juAjqWBtPo6vygcBVjOR_0 2024-09-12T18:01:51.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9315249658998973467', time=2024-09-12T19:54:45.687265+0000, chain.objs.size()=1 2024-09-12T18:01:51.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.zFICYxvezW6VawTMKOl1YmgmiR9Yxqx_0 2024-09-12T18:01:51.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6985535781004643198', time=2024-09-12T19:54:45.741990+0000, chain.objs.size()=1 2024-09-12T18:01:51.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.325__shadow_.ytRSonwEmApaePLg5V7sTp7pOgU_lSb_0 2024-09-12T18:01:51.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3976702660478310375', time=2024-09-12T19:55:04.076909+0000, chain.objs.size()=1 2024-09-12T18:01:51.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.408__shadow_.i6e4zY2lxuVy7T6pOHxcGgvgyr7kP5q_0 2024-09-12T18:01:51.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.15495602728216704803', time=2024-09-12T19:55:12.256585+0000, chain.objs.size()=1 2024-09-12T18:01:51.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.448__shadow_.YXdNaZXCE8guG2cMIqnpy5rulDBc7bT_0 2024-09-12T18:01:51.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.3002709772094269332', time=2024-09-12T19:55:17.345550+0000, chain.objs.size()=1 2024-09-12T18:01:51.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.465__shadow_.hAuj9GyS5UwV-WKd1tsD4vj7I3T-bNU_0 2024-09-12T18:01:51.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13114023439341057375', time=2024-09-12T19:55:20.956159+0000, chain.objs.size()=1 2024-09-12T18:01:51.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.045+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.484__shadow_.ZZPoQss8r3ZjkFyHU_4mtlkIsoHa-P-_0 2024-09-12T18:01:51.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.046+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9899552749289365847', time=2024-09-12T19:55:25.022956+0000, chain.objs.size()=1 2024-09-12T18:01:51.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.046+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.501__shadow_.Io6_gFUC3FpvRwdtvANHVtUjKXEu3Lj_0 2024-09-12T18:01:51.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.046+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13439249031957506184', time=2024-09-12T19:55:27.600387+0000, chain.objs.size()=6 2024-09-12T18:01:51.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.046+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.1 2024-09-12T18:01:51.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.046+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.2 2024-09-12T18:01:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.046+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.3 2024-09-12T18:01:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.047+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.4 2024-09-12T18:01:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.047+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.5 2024-09-12T18:01:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.047+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.508__multipart_srcmultipart.2~5L7AhkCFgQxVgJ8Jf827PRGjrVkqwM9.6 2024-09-12T18:01:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.047+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.6336397916853848578', time=2024-09-12T19:55:29.343928+0000, chain.objs.size()=1 2024-09-12T18:01:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.047+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.516__shadow_.4p-9mHyC2pDhuLzPhOSgzEbAm_pDmpm_0 2024-09-12T18:01:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.047+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.235718941970193291', time=2024-09-12T19:55:34.624186+0000, chain.objs.size()=6 2024-09-12T18:01:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.047+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.v0VGvC6p4mp145GE4EQati3RTswNwfWz.1 2024-09-12T18:01:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.047+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~TzYF8utmeyWzepw0ZBdAsmu1n3pIAyy.2 2024-09-12T18:01:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.047+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~TzYF8utmeyWzepw0ZBdAsmu1n3pIAyy.3 2024-09-12T18:01:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.049+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~TzYF8utmeyWzepw0ZBdAsmu1n3pIAyy.4 2024-09-12T18:01:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.049+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~TzYF8utmeyWzepw0ZBdAsmu1n3pIAyy.5 2024-09-12T18:01:51.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.049+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.523__multipart_mymultipart.2~TzYF8utmeyWzepw0ZBdAsmu1n3pIAyy.6 2024-09-12T18:01:51.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.049+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10462906126544270683', time=2024-09-12T19:55:39.102561+0000, chain.objs.size()=1 2024-09-12T18:01:51.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.049+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.526__multipart_mymultipart.2~gJ54BcFMScP4Yx3ke54wmTtypfEcIOm.1 2024-09-12T18:01:51.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.049+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2714591486205112686', time=2024-09-12T19:55:39.802980+0000, chain.objs.size()=3 2024-09-12T18:01:51.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.049+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.526__multipart_mymultipart.2~mWvexUSTZbgzrZRTWiXyTcyzu_2cNhW.1 2024-09-12T18:01:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.050+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.526__multipart_mymultipart.2~mWvexUSTZbgzrZRTWiXyTcyzu_2cNhW.2 2024-09-12T18:01:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.050+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.526__multipart_mymultipart.2~mWvexUSTZbgzrZRTWiXyTcyzu_2cNhW.3 2024-09-12T18:01:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.050+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.4585964359667573752', time=2024-09-12T19:56:22.054298+0000, chain.objs.size()=1 2024-09-12T18:01:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.050+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:R6IxqT8rKQS1ny5Ti5eS-AM55FmtnXf_.1pp6TX1xfGGn8YQOj6Hx9vNYSNfftJF_0 2024-09-12T18:01:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.051+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.2409099930240112268', time=2024-09-12T19:56:26.026890+0000, chain.objs.size()=1 2024-09-12T18:01:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.051+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.570__shadow:0Ml90or4j.d-CWNRUhZOprf7Ch4eVjM_.kBCH9KcODSfh0-C_EnhbbvW5YpS0B5l_0 2024-09-12T18:01:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.051+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10658273350315067728', time=2024-09-12T19:56:27.601847+0000, chain.objs.size()=1 2024-09-12T18:01:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.051+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.571__shadow:yvmh5GrU.R7LWMBPAJZtzNX3r4DW2Mr_.PyuR1cxDtOaDf6YLK2FXraRrzBpTrA1_0 2024-09-12T18:01:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.051+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.10051918413249150085', time=2024-09-12T19:56:27.613345+0000, chain.objs.size()=1 2024-09-12T18:01:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.051+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.571__shadow:GCqI143o.RtSdp1.4NDwq-p1E8KB3VA_.AUAapHnTH3kjYUkq2SqNM3YhTCnDnA9_0 2024-09-12T18:01:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.052+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.9681395941469872672', time=2024-09-12T19:56:49.976069+0000, chain.objs.size()=1 2024-09-12T18:01:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.052+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.580__shadow:moX6Gfo0cIVBruBIy1fDIPmA7XQDl9I_.HdgoM19LMYUcnOI2g8jObR0RXJz65hY_0 2024-09-12T18:01:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.052+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.1320409283174367053', time=2024-09-12T19:56:50.002955+0000, chain.objs.size()=1 2024-09-12T18:01:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.052+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.580__shadow:kDu61d3TAHAgZuhY9LHwS4K3UI5DhK5_.jWSnXYtgwEEU6fkbr5gZRGwo0KQvUZb_0 2024-09-12T18:01:51.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.053+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.13928638097673159722', time=2024-09-12T19:56:50.926716+0000, chain.objs.size()=1 2024-09-12T18:01:51.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.053+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.581__shadow:mAGypR.mbp03xAP5p1yBMLel0ghiUBd_._gjce9pn2ddn2JlbfWOP3PIm8ugmk3A_0 2024-09-12T18:01:51.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.053+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.8705656673504810785', time=2024-09-12T19:59:05.088447+0000, chain.objs.size()=6 2024-09-12T18:01:51.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.053+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.624__multipart_multipart_enc.2~7GALUaeSC1z5hin7K9IOzDaoaEuOTPE.1 2024-09-12T18:01:51.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.053+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.624__multipart_multipart_enc.2~7GALUaeSC1z5hin7K9IOzDaoaEuOTPE.2 2024-09-12T18:01:51.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.053+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.624__multipart_multipart_enc.2~7GALUaeSC1z5hin7K9IOzDaoaEuOTPE.3 2024-09-12T18:01:51.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.053+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.624__multipart_multipart_enc.2~7GALUaeSC1z5hin7K9IOzDaoaEuOTPE.4 2024-09-12T18:01:51.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.053+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.624__multipart_multipart_enc.2~7GALUaeSC1z5hin7K9IOzDaoaEuOTPE.5 2024-09-12T18:01:51.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.053+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.624__multipart_multipart_enc.2~7GALUaeSC1z5hin7K9IOzDaoaEuOTPE.6 2024-09-12T18:01:51.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.053+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.12872427533813307349', time=2024-09-12T19:59:10.642122+0000, chain.objs.size()=2 2024-09-12T18:01:51.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.053+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.645__shadow_.oVqlwOshS_AIz1Y3KEeEurBzPmaT0zs_0 2024-09-12T18:01:51.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.053+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.645__shadow_.oVqlwOshS_AIz1Y3KEeEurBzPmaT0zs_1 2024-09-12T18:01:51.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.053+0000 7f7bf0213800 20 garbage collection: RGWGC::process iterating over entry tag='fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.11061341932349216340', time=2024-09-12T19:59:18.657280+0000, chain.objs.size()=1 2024-09-12T18:01:51.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.053+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe33886c-9948-4f8e-85ed-a04bdce9353e.4538.669__shadow_.wWGMP8KYGns_sNqvqW46fUGfRy74iSY_0 2024-09-12T18:01:51.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.058+0000 7f7bf0213800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:01:51.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.061+0000 7f7aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:51.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.063+0000 7f7bf0213800 20 remove_watcher() i=0 2024-09-12T18:01:51.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.063+0000 7f7bf0213800 2 removed watcher, disabling cache 2024-09-12T18:01:51.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.064+0000 7f7bf0213800 20 remove_watcher() i=1 2024-09-12T18:01:51.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.065+0000 7f7bf0213800 20 remove_watcher() i=2 2024-09-12T18:01:51.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.066+0000 7f7bf0213800 20 remove_watcher() i=3 2024-09-12T18:01:51.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.067+0000 7f7bf0213800 20 remove_watcher() i=4 2024-09-12T18:01:51.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.068+0000 7f7bf0213800 20 remove_watcher() i=5 2024-09-12T18:01:51.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.069+0000 7f7bf0213800 20 remove_watcher() i=6 2024-09-12T18:01:51.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T18:01:51.070+0000 7f7bf0213800 20 remove_watcher() i=7 2024-09-12T18:01:51.083 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T18:01:51.093 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T18:01:51.131 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:01:51.132 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:01:51.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:01:51.492 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-12T18:01:51.496 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":1408,"stamp":"2024-09-12T18:01:50.480833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":680549778,"num_objects":4864,"num_object_clones":0,"num_object_copies":9728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4864,"num_whiteouts":0,"num_read":286760,"num_read_kb":2730072,"num_write":157057,"num_write_kb":2469331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13989,"ondisk_log_size":13989,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2812880,"kb_used_data":1398928,"kb_used_omap":12,"kb_used_meta":1413811,"kb_avail":752161840,"statfs":{"total":773094113280,"available":770213724160,"internally_reserved":0,"allocated":1432502272,"data_stored":1387512820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1447743027},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5244214,"num_objects":-58,"num_object_clones":0,"num_object_copies":-116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-58,"num_whiteouts":0,"num_read":504,"num_read_kb":450,"num_write":162,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005093"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412189+0000","last_change":"2024-09-12T17:50:58.430620+0000","last_active":"2024-09-12T17:58:29.412189+0000","last_peered":"2024-09-12T17:58:29.412189+0000","last_clean":"2024-09-12T17:58:29.412189+0000","last_became_active":"2024-09-12T17:50:58.430327+0000","last_became_peered":"2024-09-12T17:50:58.430327+0000","last_unstale":"2024-09-12T17:58:29.412189+0000","last_undegraded":"2024-09-12T17:58:29.412189+0000","last_fullsized":"2024-09-12T17:58:29.412189+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:08.467218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"261'9","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.407973+0000","last_change":"2024-09-12T17:40:30.414114+0000","last_active":"2024-09-12T17:57:59.407973+0000","last_peered":"2024-09-12T17:57:59.407973+0000","last_clean":"2024-09-12T17:57:59.407973+0000","last_became_active":"2024-09-12T17:40:30.413466+0000","last_became_peered":"2024-09-12T17:40:30.413466+0000","last_unstale":"2024-09-12T17:57:59.407973+0000","last_undegraded":"2024-09-12T17:57:59.407973+0000","last_fullsized":"2024-09-12T17:57:59.407973+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:13.588006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":14338,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'1","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:58.405640+0000","last_change":"2024-09-12T17:40:27.384339+0000","last_active":"2024-09-12T17:57:58.405640+0000","last_peered":"2024-09-12T17:57:58.405640+0000","last_clean":"2024-09-12T17:57:58.405640+0000","last_became_active":"2024-09-12T17:40:27.384052+0000","last_became_peered":"2024-09-12T17:40:27.384052+0000","last_unstale":"2024-09-12T17:57:58.405640+0000","last_undegraded":"2024-09-12T17:57:58.405640+0000","last_fullsized":"2024-09-12T17:57:58.405640+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:44.943293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"261'180","reported_seq":604,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.550175+0000","last_change":"2024-09-12T17:38:51.209021+0000","last_active":"2024-09-12T17:59:44.550175+0000","last_peered":"2024-09-12T17:59:44.550175+0000","last_clean":"2024-09-12T17:59:44.550175+0000","last_became_active":"2024-09-12T17:38:51.208740+0000","last_became_peered":"2024-09-12T17:38:51.208740+0000","last_unstale":"2024-09-12T17:59:44.550175+0000","last_undegraded":"2024-09-12T17:59:44.550175+0000","last_fullsized":"2024-09-12T17:59:44.550175+0000","mapping_epoch":248,"log_start":"258'100","ondisk_log_start":"258'100","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:15.411282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1105,"num_read_kb":819,"num_write":215,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612242+0000","last_change":"2024-09-12T17:50:58.429515+0000","last_active":"2024-09-12T17:58:28.612242+0000","last_peered":"2024-09-12T17:58:28.612242+0000","last_clean":"2024-09-12T17:58:28.612242+0000","last_became_active":"2024-09-12T17:50:58.429172+0000","last_became_peered":"2024-09-12T17:50:58.429172+0000","last_unstale":"2024-09-12T17:58:28.612242+0000","last_undegraded":"2024-09-12T17:58:28.612242+0000","last_fullsized":"2024-09-12T17:58:28.612242+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:58.887773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"261'1","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:04.409165+0000","last_change":"2024-09-12T17:40:30.419563+0000","last_active":"2024-09-12T17:58:04.409165+0000","last_peered":"2024-09-12T17:58:04.409165+0000","last_clean":"2024-09-12T17:58:04.409165+0000","last_became_active":"2024-09-12T17:40:30.419270+0000","last_became_peered":"2024-09-12T17:40:30.419270+0000","last_unstale":"2024-09-12T17:58:04.409165+0000","last_undegraded":"2024-09-12T17:58:04.409165+0000","last_fullsized":"2024-09-12T17:58:04.409165+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:40.594940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":118,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.407054+0000","last_change":"2024-09-12T17:40:27.383763+0000","last_active":"2024-09-12T17:57:59.407054+0000","last_peered":"2024-09-12T17:57:59.407054+0000","last_clean":"2024-09-12T17:57:59.407054+0000","last_became_active":"2024-09-12T17:40:27.383464+0000","last_became_peered":"2024-09-12T17:40:27.383464+0000","last_unstale":"2024-09-12T17:57:59.407054+0000","last_undegraded":"2024-09-12T17:57:59.407054+0000","last_fullsized":"2024-09-12T17:57:59.407054+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:17.860149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"261'20","reported_seq":98,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.513810+0000","last_change":"2024-09-12T17:38:51.217668+0000","last_active":"2024-09-12T17:59:54.513810+0000","last_peered":"2024-09-12T17:59:54.513810+0000","last_clean":"2024-09-12T17:59:54.513810+0000","last_became_active":"2024-09-12T17:38:51.217312+0000","last_became_peered":"2024-09-12T17:38:51.217312+0000","last_unstale":"2024-09-12T17:59:54.513810+0000","last_undegraded":"2024-09-12T17:59:54.513810+0000","last_fullsized":"2024-09-12T17:59:54.513810+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:44.870657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":68,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.407763+0000","last_change":"2024-09-12T17:50:58.425626+0000","last_active":"2024-09-12T17:58:14.407763+0000","last_peered":"2024-09-12T17:58:14.407763+0000","last_clean":"2024-09-12T17:58:14.407763+0000","last_became_active":"2024-09-12T17:50:58.425202+0000","last_became_peered":"2024-09-12T17:50:58.425202+0000","last_unstale":"2024-09-12T17:58:14.407763+0000","last_undegraded":"2024-09-12T17:58:14.407763+0000","last_fullsized":"2024-09-12T17:58:14.407763+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:43.003436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546433+0000","last_change":"2024-09-12T17:40:30.428077+0000","last_active":"2024-09-12T17:59:19.546433+0000","last_peered":"2024-09-12T17:59:19.546433+0000","last_clean":"2024-09-12T17:59:19.546433+0000","last_became_active":"2024-09-12T17:40:30.427798+0000","last_became_peered":"2024-09-12T17:40:30.427798+0000","last_unstale":"2024-09-12T17:59:19.546433+0000","last_undegraded":"2024-09-12T17:59:19.546433+0000","last_fullsized":"2024-09-12T17:59:19.546433+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:08.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612294+0000","last_change":"2024-09-12T17:40:27.381742+0000","last_active":"2024-09-12T17:58:28.612294+0000","last_peered":"2024-09-12T17:58:28.612294+0000","last_clean":"2024-09-12T17:58:28.612294+0000","last_became_active":"2024-09-12T17:40:27.381456+0000","last_became_peered":"2024-09-12T17:40:27.381456+0000","last_unstale":"2024-09-12T17:58:28.612294+0000","last_undegraded":"2024-09-12T17:58:28.612294+0000","last_fullsized":"2024-09-12T17:58:28.612294+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:34.919045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"261'39","reported_seq":146,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:54.543334+0000","last_change":"2024-09-12T17:38:51.212514+0000","last_active":"2024-09-12T17:58:54.543334+0000","last_peered":"2024-09-12T17:58:54.543334+0000","last_clean":"2024-09-12T17:58:54.543334+0000","last_became_active":"2024-09-12T17:38:51.212222+0000","last_became_peered":"2024-09-12T17:38:51.212222+0000","last_unstale":"2024-09-12T17:58:54.543334+0000","last_undegraded":"2024-09-12T17:58:54.543334+0000","last_fullsized":"2024-09-12T17:58:54.543334+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:58.957926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":132,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.408592+0000","last_change":"2024-09-12T17:50:58.422072+0000","last_active":"2024-09-12T17:58:18.408592+0000","last_peered":"2024-09-12T17:58:18.408592+0000","last_clean":"2024-09-12T17:58:18.408592+0000","last_became_active":"2024-09-12T17:50:58.421791+0000","last_became_peered":"2024-09-12T17:50:58.421791+0000","last_unstale":"2024-09-12T17:58:18.408592+0000","last_undegraded":"2024-09-12T17:58:18.408592+0000","last_fullsized":"2024-09-12T17:58:18.408592+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:23.289873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'2","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546421+0000","last_change":"2024-09-12T17:41:17.634582+0000","last_active":"2024-09-12T17:59:19.546421+0000","last_peered":"2024-09-12T17:59:19.546421+0000","last_clean":"2024-09-12T17:59:19.546421+0000","last_became_active":"2024-09-12T17:41:17.634263+0000","last_became_peered":"2024-09-12T17:41:17.634263+0000","last_unstale":"2024-09-12T17:59:19.546421+0000","last_undegraded":"2024-09-12T17:59:19.546421+0000","last_fullsized":"2024-09-12T17:59:19.546421+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:21.737434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1f","version":"261'1","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418618+0000","last_change":"2024-09-12T17:40:27.381866+0000","last_active":"2024-09-12T17:59:14.418618+0000","last_peered":"2024-09-12T17:59:14.418618+0000","last_clean":"2024-09-12T17:59:14.418618+0000","last_became_active":"2024-09-12T17:40:27.381587+0000","last_became_peered":"2024-09-12T17:40:27.381587+0000","last_unstale":"2024-09-12T17:59:14.418618+0000","last_undegraded":"2024-09-12T17:59:14.418618+0000","last_fullsized":"2024-09-12T17:59:14.418618+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:05.484868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"261'16","reported_seq":86,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:53.414258+0000","last_change":"2024-09-12T17:38:51.211725+0000","last_active":"2024-09-12T17:58:53.414258+0000","last_peered":"2024-09-12T17:58:53.414258+0000","last_clean":"2024-09-12T17:58:53.414258+0000","last_became_active":"2024-09-12T17:38:51.211429+0000","last_became_peered":"2024-09-12T17:38:51.211429+0000","last_unstale":"2024-09-12T17:58:53.414258+0000","last_undegraded":"2024-09-12T17:58:53.414258+0000","last_fullsized":"2024-09-12T17:58:53.414258+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:51.433082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":53,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:03.415591+0000","last_change":"2024-09-12T17:50:58.425178+0000","last_active":"2024-09-12T17:59:03.415591+0000","last_peered":"2024-09-12T17:59:03.415591+0000","last_clean":"2024-09-12T17:59:03.415591+0000","last_became_active":"2024-09-12T17:50:58.424898+0000","last_became_peered":"2024-09-12T17:50:58.424898+0000","last_unstale":"2024-09-12T17:59:03.415591+0000","last_undegraded":"2024-09-12T17:59:03.415591+0000","last_fullsized":"2024-09-12T17:59:03.415591+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:43.460057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.403387+0000","last_change":"2024-09-12T17:40:30.419273+0000","last_active":"2024-09-12T17:57:29.403387+0000","last_peered":"2024-09-12T17:57:29.403387+0000","last_clean":"2024-09-12T17:57:29.403387+0000","last_became_active":"2024-09-12T17:40:30.418865+0000","last_became_peered":"2024-09-12T17:40:30.418865+0000","last_unstale":"2024-09-12T17:57:29.403387+0000","last_undegraded":"2024-09-12T17:57:29.403387+0000","last_fullsized":"2024-09-12T17:57:29.403387+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:37.865615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'7","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:24.529144+0000","last_change":"2024-09-12T17:40:27.384760+0000","last_active":"2024-09-12T17:57:24.529144+0000","last_peered":"2024-09-12T17:57:24.529144+0000","last_clean":"2024-09-12T17:57:24.529144+0000","last_became_active":"2024-09-12T17:40:27.384445+0000","last_became_peered":"2024-09-12T17:40:27.384445+0000","last_unstale":"2024-09-12T17:57:24.529144+0000","last_undegraded":"2024-09-12T17:57:24.529144+0000","last_fullsized":"2024-09-12T17:57:24.529144+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:48.815935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":14338,"num_write":17,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"261'42","reported_seq":159,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.511172+0000","last_change":"2024-09-12T17:38:51.217731+0000","last_active":"2024-09-12T17:59:16.511172+0000","last_peered":"2024-09-12T17:59:16.511172+0000","last_clean":"2024-09-12T17:59:16.511172+0000","last_became_active":"2024-09-12T17:38:51.217421+0000","last_became_peered":"2024-09-12T17:38:51.217421+0000","last_unstale":"2024-09-12T17:59:16.511172+0000","last_undegraded":"2024-09-12T17:59:16.511172+0000","last_fullsized":"2024-09-12T17:59:16.511172+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:29.905573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":155,"num_write":73,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.418508+0000","last_change":"2024-09-12T17:50:58.422069+0000","last_active":"2024-09-12T17:59:19.418508+0000","last_peered":"2024-09-12T17:59:19.418508+0000","last_clean":"2024-09-12T17:59:19.418508+0000","last_became_active":"2024-09-12T17:50:58.421760+0000","last_became_peered":"2024-09-12T17:50:58.421760+0000","last_unstale":"2024-09-12T17:59:19.418508+0000","last_undegraded":"2024-09-12T17:59:19.418508+0000","last_fullsized":"2024-09-12T17:59:19.418508+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:17.645861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'1","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.401154+0000","last_change":"2024-09-12T17:40:30.417805+0000","last_active":"2024-09-12T17:57:29.401154+0000","last_peered":"2024-09-12T17:57:29.401154+0000","last_clean":"2024-09-12T17:57:29.401154+0000","last_became_active":"2024-09-12T17:40:30.417372+0000","last_became_peered":"2024-09-12T17:40:30.417372+0000","last_unstale":"2024-09-12T17:57:29.401154+0000","last_undegraded":"2024-09-12T17:57:29.401154+0000","last_fullsized":"2024-09-12T17:57:29.401154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:46.977654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":80,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"258'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.403961+0000","last_change":"2024-09-12T17:40:27.379433+0000","last_active":"2024-09-12T17:57:29.403961+0000","last_peered":"2024-09-12T17:57:29.403961+0000","last_clean":"2024-09-12T17:57:29.403961+0000","last_became_active":"2024-09-12T17:40:27.379161+0000","last_became_peered":"2024-09-12T17:40:27.379161+0000","last_unstale":"2024-09-12T17:57:29.403961+0000","last_undegraded":"2024-09-12T17:57:29.403961+0000","last_fullsized":"2024-09-12T17:57:29.403961+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:17.149187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"261'20","reported_seq":98,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:54.413353+0000","last_change":"2024-09-12T17:38:51.214836+0000","last_active":"2024-09-12T17:58:54.413353+0000","last_peered":"2024-09-12T17:58:54.413353+0000","last_clean":"2024-09-12T17:58:54.413353+0000","last_became_active":"2024-09-12T17:38:51.214555+0000","last_became_peered":"2024-09-12T17:38:51.214555+0000","last_unstale":"2024-09-12T17:58:54.413353+0000","last_undegraded":"2024-09-12T17:58:54.413353+0000","last_fullsized":"2024-09-12T17:58:54.413353+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:24.488340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412872+0000","last_change":"2024-09-12T17:50:58.429666+0000","last_active":"2024-09-12T17:58:29.412872+0000","last_peered":"2024-09-12T17:58:29.412872+0000","last_clean":"2024-09-12T17:58:29.412872+0000","last_became_active":"2024-09-12T17:50:58.429381+0000","last_became_peered":"2024-09-12T17:50:58.429381+0000","last_unstale":"2024-09-12T17:58:29.412872+0000","last_undegraded":"2024-09-12T17:58:29.412872+0000","last_fullsized":"2024-09-12T17:58:29.412872+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:24.108837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:04.406346+0000","last_change":"2024-09-12T17:40:30.420492+0000","last_active":"2024-09-12T17:58:04.406346+0000","last_peered":"2024-09-12T17:58:04.406346+0000","last_clean":"2024-09-12T17:58:04.406346+0000","last_became_active":"2024-09-12T17:40:30.420165+0000","last_became_peered":"2024-09-12T17:40:30.420165+0000","last_unstale":"2024-09-12T17:58:04.406346+0000","last_undegraded":"2024-09-12T17:58:04.406346+0000","last_fullsized":"2024-09-12T17:58:04.406346+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:02.691513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"261'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.408364+0000","last_change":"2024-09-12T17:40:27.382601+0000","last_active":"2024-09-12T17:57:59.408364+0000","last_peered":"2024-09-12T17:57:59.408364+0000","last_clean":"2024-09-12T17:57:59.408364+0000","last_became_active":"2024-09-12T17:40:27.382310+0000","last_became_peered":"2024-09-12T17:40:27.382310+0000","last_unstale":"2024-09-12T17:57:59.408364+0000","last_undegraded":"2024-09-12T17:57:59.408364+0000","last_fullsized":"2024-09-12T17:57:59.408364+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:53.252512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"261'83","reported_seq":276,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537110+0000","last_change":"2024-09-12T17:38:51.213883+0000","last_active":"2024-09-12T17:58:14.537110+0000","last_peered":"2024-09-12T17:58:14.537110+0000","last_clean":"2024-09-12T17:58:14.537110+0000","last_became_active":"2024-09-12T17:38:51.213569+0000","last_became_peered":"2024-09-12T17:38:51.213569+0000","last_unstale":"2024-09-12T17:58:14.537110+0000","last_undegraded":"2024-09-12T17:58:14.537110+0000","last_fullsized":"2024-09-12T17:58:14.537110+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:09.021970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":443,"num_read_kb":326,"num_write":140,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412923+0000","last_change":"2024-09-12T17:50:58.431925+0000","last_active":"2024-09-12T17:58:29.412923+0000","last_peered":"2024-09-12T17:58:29.412923+0000","last_clean":"2024-09-12T17:58:29.412923+0000","last_became_active":"2024-09-12T17:50:58.431242+0000","last_became_peered":"2024-09-12T17:50:58.431242+0000","last_unstale":"2024-09-12T17:58:29.412923+0000","last_undegraded":"2024-09-12T17:58:29.412923+0000","last_fullsized":"2024-09-12T17:58:29.412923+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:38.404256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'1","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.406325+0000","last_change":"2024-09-12T17:40:30.417580+0000","last_active":"2024-09-12T17:58:03.406325+0000","last_peered":"2024-09-12T17:58:03.406325+0000","last_clean":"2024-09-12T17:58:03.406325+0000","last_became_active":"2024-09-12T17:40:30.416973+0000","last_became_peered":"2024-09-12T17:40:30.416973+0000","last_unstale":"2024-09-12T17:58:03.406325+0000","last_undegraded":"2024-09-12T17:58:03.406325+0000","last_fullsized":"2024-09-12T17:58:03.406325+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:01.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"258'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.535018+0000","last_change":"2024-09-12T17:40:27.383868+0000","last_active":"2024-09-12T17:57:59.535018+0000","last_peered":"2024-09-12T17:57:59.535018+0000","last_clean":"2024-09-12T17:57:59.535018+0000","last_became_active":"2024-09-12T17:40:27.383589+0000","last_became_peered":"2024-09-12T17:40:27.383589+0000","last_unstale":"2024-09-12T17:57:59.535018+0000","last_undegraded":"2024-09-12T17:57:59.535018+0000","last_fullsized":"2024-09-12T17:57:59.535018+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:33.218417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"261'40","reported_seq":149,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:52.416289+0000","last_change":"2024-09-12T17:38:51.212263+0000","last_active":"2024-09-12T17:59:52.416289+0000","last_peered":"2024-09-12T17:59:52.416289+0000","last_clean":"2024-09-12T17:59:52.416289+0000","last_became_active":"2024-09-12T17:38:51.211962+0000","last_became_peered":"2024-09-12T17:38:51.211962+0000","last_unstale":"2024-09-12T17:59:52.416289+0000","last_undegraded":"2024-09-12T17:59:52.416289+0000","last_fullsized":"2024-09-12T17:59:52.416289+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:27.978434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":137,"num_write":74,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.406991+0000","last_change":"2024-09-12T17:50:58.415378+0000","last_active":"2024-09-12T17:57:59.406991+0000","last_peered":"2024-09-12T17:57:59.406991+0000","last_clean":"2024-09-12T17:57:59.406991+0000","last_became_active":"2024-09-12T17:50:58.415098+0000","last_became_peered":"2024-09-12T17:50:58.415098+0000","last_unstale":"2024-09-12T17:57:59.406991+0000","last_undegraded":"2024-09-12T17:57:59.406991+0000","last_fullsized":"2024-09-12T17:57:59.406991+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:07.460645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.400786+0000","last_change":"2024-09-12T17:40:30.426133+0000","last_active":"2024-09-12T17:57:28.400786+0000","last_peered":"2024-09-12T17:57:28.400786+0000","last_clean":"2024-09-12T17:57:28.400786+0000","last_became_active":"2024-09-12T17:40:30.425845+0000","last_became_peered":"2024-09-12T17:40:30.425845+0000","last_unstale":"2024-09-12T17:57:28.400786+0000","last_undegraded":"2024-09-12T17:57:28.400786+0000","last_fullsized":"2024-09-12T17:57:28.400786+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:39.872124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"261'10","reported_seq":63,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418105+0000","last_change":"2024-09-12T17:40:27.383205+0000","last_active":"2024-09-12T17:59:14.418105+0000","last_peered":"2024-09-12T17:59:14.418105+0000","last_clean":"2024-09-12T17:59:14.418105+0000","last_became_active":"2024-09-12T17:40:27.382833+0000","last_became_peered":"2024-09-12T17:40:27.382833+0000","last_unstale":"2024-09-12T17:59:14.418105+0000","last_undegraded":"2024-09-12T17:59:14.418105+0000","last_fullsized":"2024-09-12T17:59:14.418105+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:27.606242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":32770,"num_write":15,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"261'60","reported_seq":203,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537248+0000","last_change":"2024-09-12T17:38:51.214569+0000","last_active":"2024-09-12T17:58:14.537248+0000","last_peered":"2024-09-12T17:58:14.537248+0000","last_clean":"2024-09-12T17:58:14.537248+0000","last_became_active":"2024-09-12T17:38:51.214274+0000","last_became_peered":"2024-09-12T17:38:51.214274+0000","last_unstale":"2024-09-12T17:58:14.537248+0000","last_undegraded":"2024-09-12T17:58:14.537248+0000","last_fullsized":"2024-09-12T17:58:14.537248+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:23.016284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":211,"num_write":107,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:58.608464+0000","last_change":"2024-09-12T17:50:58.426819+0000","last_active":"2024-09-12T17:57:58.608464+0000","last_peered":"2024-09-12T17:57:58.608464+0000","last_clean":"2024-09-12T17:57:58.608464+0000","last_became_active":"2024-09-12T17:50:58.426537+0000","last_became_peered":"2024-09-12T17:50:58.426537+0000","last_unstale":"2024-09-12T17:57:58.608464+0000","last_undegraded":"2024-09-12T17:57:58.608464+0000","last_fullsized":"2024-09-12T17:57:58.608464+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.965601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"261'7","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.417452+0000","last_change":"2024-09-12T17:40:30.427100+0000","last_active":"2024-09-12T17:59:18.417452+0000","last_peered":"2024-09-12T17:59:18.417452+0000","last_clean":"2024-09-12T17:59:18.417452+0000","last_became_active":"2024-09-12T17:40:30.425368+0000","last_became_peered":"2024-09-12T17:40:30.425368+0000","last_unstale":"2024-09-12T17:59:18.417452+0000","last_undegraded":"2024-09-12T17:59:18.417452+0000","last_fullsized":"2024-09-12T17:59:18.417452+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:47.929671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:24.403574+0000","last_change":"2024-09-12T17:40:27.380566+0000","last_active":"2024-09-12T17:57:24.403574+0000","last_peered":"2024-09-12T17:57:24.403574+0000","last_clean":"2024-09-12T17:57:24.403574+0000","last_became_active":"2024-09-12T17:40:27.380228+0000","last_became_peered":"2024-09-12T17:40:27.380228+0000","last_unstale":"2024-09-12T17:57:24.403574+0000","last_undegraded":"2024-09-12T17:57:24.403574+0000","last_fullsized":"2024-09-12T17:57:24.403574+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:05.600168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"261'21","reported_seq":99,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.495658+0000","last_change":"2024-09-12T17:38:51.218671+0000","last_active":"2024-09-12T17:59:15.495658+0000","last_peered":"2024-09-12T17:59:15.495658+0000","last_clean":"2024-09-12T17:59:15.495658+0000","last_became_active":"2024-09-12T17:38:51.218309+0000","last_became_peered":"2024-09-12T17:38:51.218309+0000","last_unstale":"2024-09-12T17:59:15.495658+0000","last_undegraded":"2024-09-12T17:59:15.495658+0000","last_fullsized":"2024-09-12T17:59:15.495658+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:45.726103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.408378+0000","last_change":"2024-09-12T17:50:58.425291+0000","last_active":"2024-09-12T17:57:59.408378+0000","last_peered":"2024-09-12T17:57:59.408378+0000","last_clean":"2024-09-12T17:57:59.408378+0000","last_became_active":"2024-09-12T17:50:58.425003+0000","last_became_peered":"2024-09-12T17:50:58.425003+0000","last_unstale":"2024-09-12T17:57:59.408378+0000","last_undegraded":"2024-09-12T17:57:59.408378+0000","last_fullsized":"2024-09-12T17:57:59.408378+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:33.694791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"261'2","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.400828+0000","last_change":"2024-09-12T17:40:30.427105+0000","last_active":"2024-09-12T17:57:28.400828+0000","last_peered":"2024-09-12T17:57:28.400828+0000","last_clean":"2024-09-12T17:57:28.400828+0000","last_became_active":"2024-09-12T17:40:30.426714+0000","last_became_peered":"2024-09-12T17:40:30.426714+0000","last_unstale":"2024-09-12T17:57:28.400828+0000","last_undegraded":"2024-09-12T17:57:28.400828+0000","last_fullsized":"2024-09-12T17:57:28.400828+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:21.352761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:23.603864+0000","last_change":"2024-09-12T17:40:27.382447+0000","last_active":"2024-09-12T17:57:23.603864+0000","last_peered":"2024-09-12T17:57:23.603864+0000","last_clean":"2024-09-12T17:57:23.603864+0000","last_became_active":"2024-09-12T17:40:27.382132+0000","last_became_peered":"2024-09-12T17:40:27.382132+0000","last_unstale":"2024-09-12T17:57:23.603864+0000","last_undegraded":"2024-09-12T17:57:23.603864+0000","last_fullsized":"2024-09-12T17:57:23.603864+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:38.796258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"261'28","reported_seq":122,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.610428+0000","last_change":"2024-09-12T17:38:51.215254+0000","last_active":"2024-09-12T17:58:13.610428+0000","last_peered":"2024-09-12T17:58:13.610428+0000","last_clean":"2024-09-12T17:58:13.610428+0000","last_became_active":"2024-09-12T17:38:51.214963+0000","last_became_peered":"2024-09-12T17:38:51.214963+0000","last_unstale":"2024-09-12T17:58:13.610428+0000","last_undegraded":"2024-09-12T17:58:13.610428+0000","last_fullsized":"2024-09-12T17:58:13.610428+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:33.596786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":103,"num_write":58,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.407865+0000","last_change":"2024-09-12T17:50:58.427202+0000","last_active":"2024-09-12T17:57:59.407865+0000","last_peered":"2024-09-12T17:57:59.407865+0000","last_clean":"2024-09-12T17:57:59.407865+0000","last_became_active":"2024-09-12T17:50:58.426779+0000","last_became_peered":"2024-09-12T17:50:58.426779+0000","last_unstale":"2024-09-12T17:57:59.407865+0000","last_undegraded":"2024-09-12T17:57:59.407865+0000","last_fullsized":"2024-09-12T17:57:59.407865+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:56.570650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"258'6","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.404116+0000","last_change":"2024-09-12T17:40:30.419477+0000","last_active":"2024-09-12T17:57:29.404116+0000","last_peered":"2024-09-12T17:57:29.404116+0000","last_clean":"2024-09-12T17:57:29.404116+0000","last_became_active":"2024-09-12T17:40:30.419211+0000","last_became_peered":"2024-09-12T17:40:30.419211+0000","last_unstale":"2024-09-12T17:57:29.404116+0000","last_undegraded":"2024-09-12T17:57:29.404116+0000","last_fullsized":"2024-09-12T17:57:29.404116+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:06.524125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:24.529259+0000","last_change":"2024-09-12T17:40:27.382860+0000","last_active":"2024-09-12T17:57:24.529259+0000","last_peered":"2024-09-12T17:57:24.529259+0000","last_clean":"2024-09-12T17:57:24.529259+0000","last_became_active":"2024-09-12T17:40:27.382564+0000","last_became_peered":"2024-09-12T17:40:27.382564+0000","last_unstale":"2024-09-12T17:57:24.529259+0000","last_undegraded":"2024-09-12T17:57:24.529259+0000","last_fullsized":"2024-09-12T17:57:24.529259+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:37.855260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"261'12","reported_seq":75,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.405626+0000","last_change":"2024-09-12T17:38:51.215105+0000","last_active":"2024-09-12T17:57:39.405626+0000","last_peered":"2024-09-12T17:57:39.405626+0000","last_clean":"2024-09-12T17:57:39.405626+0000","last_became_active":"2024-09-12T17:38:51.214678+0000","last_became_peered":"2024-09-12T17:38:51.214678+0000","last_unstale":"2024-09-12T17:57:39.405626+0000","last_undegraded":"2024-09-12T17:57:39.405626+0000","last_fullsized":"2024-09-12T17:57:39.405626+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:23.825989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":38,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.407844+0000","last_change":"2024-09-12T17:50:58.427915+0000","last_active":"2024-09-12T17:58:13.407844+0000","last_peered":"2024-09-12T17:58:13.407844+0000","last_clean":"2024-09-12T17:58:13.407844+0000","last_became_active":"2024-09-12T17:50:58.427630+0000","last_became_peered":"2024-09-12T17:50:58.427630+0000","last_unstale":"2024-09-12T17:58:13.407844+0000","last_undegraded":"2024-09-12T17:58:13.407844+0000","last_fullsized":"2024-09-12T17:58:13.407844+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:54.698191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"261'12","reported_seq":64,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417124+0000","last_change":"2024-09-12T17:40:30.413875+0000","last_active":"2024-09-12T17:59:09.417124+0000","last_peered":"2024-09-12T17:59:09.417124+0000","last_clean":"2024-09-12T17:59:09.417124+0000","last_became_active":"2024-09-12T17:40:30.413592+0000","last_became_peered":"2024-09-12T17:40:30.413592+0000","last_unstale":"2024-09-12T17:59:09.417124+0000","last_undegraded":"2024-09-12T17:59:09.417124+0000","last_fullsized":"2024-09-12T17:59:09.417124+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:47.033025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":45058,"num_write":22,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'7","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417916+0000","last_change":"2024-09-12T17:40:27.382000+0000","last_active":"2024-09-12T17:59:09.417916+0000","last_peered":"2024-09-12T17:59:09.417916+0000","last_clean":"2024-09-12T17:59:09.417916+0000","last_became_active":"2024-09-12T17:40:27.381516+0000","last_became_peered":"2024-09-12T17:40:27.381516+0000","last_unstale":"2024-09-12T17:59:09.417916+0000","last_undegraded":"2024-09-12T17:59:09.417916+0000","last_fullsized":"2024-09-12T17:59:09.417916+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:48.416419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":32770,"num_write":7,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"261'6","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404930+0000","last_change":"2024-09-12T17:38:51.216019+0000","last_active":"2024-09-12T17:57:34.404930+0000","last_peered":"2024-09-12T17:57:34.404930+0000","last_clean":"2024-09-12T17:57:34.404930+0000","last_became_active":"2024-09-12T17:38:51.215646+0000","last_became_peered":"2024-09-12T17:38:51.215646+0000","last_unstale":"2024-09-12T17:57:34.404930+0000","last_undegraded":"2024-09-12T17:57:34.404930+0000","last_fullsized":"2024-09-12T17:57:34.404930+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:36.940207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537213+0000","last_change":"2024-09-12T17:50:58.423068+0000","last_active":"2024-09-12T17:58:14.537213+0000","last_peered":"2024-09-12T17:58:14.537213+0000","last_clean":"2024-09-12T17:58:14.537213+0000","last_became_active":"2024-09-12T17:50:58.422692+0000","last_became_peered":"2024-09-12T17:50:58.422692+0000","last_unstale":"2024-09-12T17:58:14.537213+0000","last_undegraded":"2024-09-12T17:58:14.537213+0000","last_fullsized":"2024-09-12T17:58:14.537213+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:51.624436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'2","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417077+0000","last_change":"2024-09-12T17:40:30.419235+0000","last_active":"2024-09-12T17:59:09.417077+0000","last_peered":"2024-09-12T17:59:09.417077+0000","last_clean":"2024-09-12T17:59:09.417077+0000","last_became_active":"2024-09-12T17:40:30.418904+0000","last_became_peered":"2024-09-12T17:40:30.418904+0000","last_unstale":"2024-09-12T17:59:09.417077+0000","last_undegraded":"2024-09-12T17:59:09.417077+0000","last_fullsized":"2024-09-12T17:59:09.417077+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:39.501098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.416187+0000","last_change":"2024-09-12T17:40:27.382156+0000","last_active":"2024-09-12T17:59:08.416187+0000","last_peered":"2024-09-12T17:59:08.416187+0000","last_clean":"2024-09-12T17:59:08.416187+0000","last_became_active":"2024-09-12T17:40:27.381849+0000","last_became_peered":"2024-09-12T17:40:27.381849+0000","last_unstale":"2024-09-12T17:59:08.416187+0000","last_undegraded":"2024-09-12T17:59:08.416187+0000","last_fullsized":"2024-09-12T17:59:08.416187+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:03.117165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"261'23","reported_seq":103,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:05.807493+0000","last_change":"2024-09-12T17:38:51.208118+0000","last_active":"2024-09-12T17:59:05.807493+0000","last_peered":"2024-09-12T17:59:05.807493+0000","last_clean":"2024-09-12T17:59:05.807493+0000","last_became_active":"2024-09-12T17:38:51.207804+0000","last_became_peered":"2024-09-12T17:38:51.207804+0000","last_unstale":"2024-09-12T17:59:05.807493+0000","last_undegraded":"2024-09-12T17:59:05.807493+0000","last_fullsized":"2024-09-12T17:59:05.807493+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:07.620875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":76,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.535062+0000","last_change":"2024-09-12T17:50:58.424688+0000","last_active":"2024-09-12T17:57:59.535062+0000","last_peered":"2024-09-12T17:57:59.535062+0000","last_clean":"2024-09-12T17:57:59.535062+0000","last_became_active":"2024-09-12T17:50:58.424379+0000","last_became_peered":"2024-09-12T17:50:58.424379+0000","last_unstale":"2024-09-12T17:57:59.535062+0000","last_undegraded":"2024-09-12T17:57:59.535062+0000","last_fullsized":"2024-09-12T17:57:59.535062+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:33.922718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:13.416845+0000","last_change":"2024-09-12T17:40:30.418399+0000","last_active":"2024-09-12T17:59:13.416845+0000","last_peered":"2024-09-12T17:59:13.416845+0000","last_clean":"2024-09-12T17:59:13.416845+0000","last_became_active":"2024-09-12T17:40:30.417111+0000","last_became_peered":"2024-09-12T17:40:30.417111+0000","last_unstale":"2024-09-12T17:59:13.416845+0000","last_undegraded":"2024-09-12T17:59:13.416845+0000","last_fullsized":"2024-09-12T17:59:13.416845+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:35.848674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415357+0000","last_change":"2024-09-12T17:40:27.378507+0000","last_active":"2024-09-12T17:59:09.415357+0000","last_peered":"2024-09-12T17:59:09.415357+0000","last_clean":"2024-09-12T17:59:09.415357+0000","last_became_active":"2024-09-12T17:40:27.378245+0000","last_became_peered":"2024-09-12T17:40:27.378245+0000","last_unstale":"2024-09-12T17:59:09.415357+0000","last_undegraded":"2024-09-12T17:59:09.415357+0000","last_fullsized":"2024-09-12T17:59:09.415357+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:43.060058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"261'38","reported_seq":153,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404752+0000","last_change":"2024-09-12T17:38:51.209261+0000","last_active":"2024-09-12T17:57:34.404752+0000","last_peered":"2024-09-12T17:57:34.404752+0000","last_clean":"2024-09-12T17:57:34.404752+0000","last_became_active":"2024-09-12T17:38:51.208950+0000","last_became_peered":"2024-09-12T17:38:51.208950+0000","last_unstale":"2024-09-12T17:57:34.404752+0000","last_undegraded":"2024-09-12T17:57:34.404752+0000","last_fullsized":"2024-09-12T17:57:34.404752+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:12.331668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":143,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.407814+0000","last_change":"2024-09-12T17:50:58.426040+0000","last_active":"2024-09-12T17:58:13.407814+0000","last_peered":"2024-09-12T17:58:13.407814+0000","last_clean":"2024-09-12T17:58:13.407814+0000","last_became_active":"2024-09-12T17:50:58.425574+0000","last_became_peered":"2024-09-12T17:50:58.425574+0000","last_unstale":"2024-09-12T17:58:13.407814+0000","last_undegraded":"2024-09-12T17:58:13.407814+0000","last_fullsized":"2024-09-12T17:58:13.407814+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:39.335745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.415906+0000","last_change":"2024-09-12T17:40:30.412045+0000","last_active":"2024-09-12T17:59:14.415906+0000","last_peered":"2024-09-12T17:59:14.415906+0000","last_clean":"2024-09-12T17:59:14.415906+0000","last_became_active":"2024-09-12T17:40:30.411737+0000","last_became_peered":"2024-09-12T17:40:30.411737+0000","last_unstale":"2024-09-12T17:59:14.415906+0000","last_undegraded":"2024-09-12T17:59:14.415906+0000","last_fullsized":"2024-09-12T17:59:14.415906+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:10.622751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417509+0000","last_change":"2024-09-12T17:40:27.372635+0000","last_active":"2024-09-12T17:59:09.417509+0000","last_peered":"2024-09-12T17:59:09.417509+0000","last_clean":"2024-09-12T17:59:09.417509+0000","last_became_active":"2024-09-12T17:40:27.372357+0000","last_became_peered":"2024-09-12T17:40:27.372357+0000","last_unstale":"2024-09-12T17:59:09.417509+0000","last_undegraded":"2024-09-12T17:59:09.417509+0000","last_fullsized":"2024-09-12T17:59:09.417509+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:34.828926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"261'42","reported_seq":150,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.401471+0000","last_change":"2024-09-12T17:38:51.208068+0000","last_active":"2024-09-12T17:57:33.401471+0000","last_peered":"2024-09-12T17:57:33.401471+0000","last_clean":"2024-09-12T17:57:33.401471+0000","last_became_active":"2024-09-12T17:38:51.207798+0000","last_became_peered":"2024-09-12T17:38:51.207798+0000","last_unstale":"2024-09-12T17:57:33.401471+0000","last_undegraded":"2024-09-12T17:57:33.401471+0000","last_fullsized":"2024-09-12T17:57:33.401471+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:58.346672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":137,"num_write":80,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.604511+0000","last_change":"2024-09-12T17:50:58.428924+0000","last_active":"2024-09-12T17:57:28.604511+0000","last_peered":"2024-09-12T17:57:28.604511+0000","last_clean":"2024-09-12T17:57:28.604511+0000","last_became_active":"2024-09-12T17:50:58.428339+0000","last_became_peered":"2024-09-12T17:50:58.428339+0000","last_unstale":"2024-09-12T17:57:28.604511+0000","last_undegraded":"2024-09-12T17:57:28.604511+0000","last_fullsized":"2024-09-12T17:57:28.604511+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:46.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411146+0000","last_change":"2024-09-12T17:40:30.417879+0000","last_active":"2024-09-12T17:58:33.411146+0000","last_peered":"2024-09-12T17:58:33.411146+0000","last_clean":"2024-09-12T17:58:33.411146+0000","last_became_active":"2024-09-12T17:40:30.417583+0000","last_became_peered":"2024-09-12T17:40:30.417583+0000","last_unstale":"2024-09-12T17:58:33.411146+0000","last_undegraded":"2024-09-12T17:58:33.411146+0000","last_fullsized":"2024-09-12T17:58:33.411146+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:57.147303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"258'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412848+0000","last_change":"2024-09-12T17:40:27.381338+0000","last_active":"2024-09-12T17:58:29.412848+0000","last_peered":"2024-09-12T17:58:29.412848+0000","last_clean":"2024-09-12T17:58:29.412848+0000","last_became_active":"2024-09-12T17:40:27.381027+0000","last_became_peered":"2024-09-12T17:40:27.381027+0000","last_unstale":"2024-09-12T17:58:29.412848+0000","last_undegraded":"2024-09-12T17:58:29.412848+0000","last_fullsized":"2024-09-12T17:58:29.412848+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:16.850258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"261'21","reported_seq":98,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.254313+0000","last_change":"2024-09-12T17:38:51.207794+0000","last_active":"2024-09-12T17:59:54.254313+0000","last_peered":"2024-09-12T17:59:54.254313+0000","last_clean":"2024-09-12T17:59:54.254313+0000","last_became_active":"2024-09-12T17:38:51.207487+0000","last_became_peered":"2024-09-12T17:38:51.207487+0000","last_unstale":"2024-09-12T17:59:54.254313+0000","last_undegraded":"2024-09-12T17:59:54.254313+0000","last_fullsized":"2024-09-12T17:59:54.254313+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:45.756120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":66,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:44.406393+0000","last_change":"2024-09-12T17:50:58.431273+0000","last_active":"2024-09-12T17:57:44.406393+0000","last_peered":"2024-09-12T17:57:44.406393+0000","last_clean":"2024-09-12T17:57:44.406393+0000","last_became_active":"2024-09-12T17:50:58.430797+0000","last_became_peered":"2024-09-12T17:50:58.430797+0000","last_unstale":"2024-09-12T17:57:44.406393+0000","last_undegraded":"2024-09-12T17:57:44.406393+0000","last_fullsized":"2024-09-12T17:57:44.406393+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:24.280950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"261'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411117+0000","last_change":"2024-09-12T17:40:30.417952+0000","last_active":"2024-09-12T17:58:33.411117+0000","last_peered":"2024-09-12T17:58:33.411117+0000","last_clean":"2024-09-12T17:58:33.411117+0000","last_became_active":"2024-09-12T17:40:30.417567+0000","last_became_peered":"2024-09-12T17:40:30.417567+0000","last_unstale":"2024-09-12T17:58:33.411117+0000","last_undegraded":"2024-09-12T17:58:33.411117+0000","last_fullsized":"2024-09-12T17:58:33.411117+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:56.583902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"261'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612267+0000","last_change":"2024-09-12T17:40:27.384850+0000","last_active":"2024-09-12T17:58:28.612267+0000","last_peered":"2024-09-12T17:58:28.612267+0000","last_clean":"2024-09-12T17:58:28.612267+0000","last_became_active":"2024-09-12T17:40:27.384579+0000","last_became_peered":"2024-09-12T17:40:27.384579+0000","last_unstale":"2024-09-12T17:58:28.612267+0000","last_undegraded":"2024-09-12T17:58:28.612267+0000","last_fullsized":"2024-09-12T17:58:28.612267+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:22.573347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":11264,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"261'7","reported_seq":61,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417568+0000","last_change":"2024-09-12T17:38:51.215867+0000","last_active":"2024-09-12T17:59:09.417568+0000","last_peered":"2024-09-12T17:59:09.417568+0000","last_clean":"2024-09-12T17:59:09.417568+0000","last_became_active":"2024-09-12T17:38:51.215590+0000","last_became_peered":"2024-09-12T17:38:51.215590+0000","last_unstale":"2024-09-12T17:59:09.417568+0000","last_undegraded":"2024-09-12T17:59:09.417568+0000","last_fullsized":"2024-09-12T17:59:09.417568+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:33.602009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.418983+0000","last_change":"2024-09-12T17:50:58.427213+0000","last_active":"2024-09-12T17:59:39.418983+0000","last_peered":"2024-09-12T17:59:39.418983+0000","last_clean":"2024-09-12T17:59:39.418983+0000","last_became_active":"2024-09-12T17:50:58.426867+0000","last_became_peered":"2024-09-12T17:50:58.426867+0000","last_unstale":"2024-09-12T17:59:39.418983+0000","last_undegraded":"2024-09-12T17:59:39.418983+0000","last_fullsized":"2024-09-12T17:59:39.418983+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:34.833083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"261'2","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:34.412127+0000","last_change":"2024-09-12T17:40:30.426091+0000","last_active":"2024-09-12T17:58:34.412127+0000","last_peered":"2024-09-12T17:58:34.412127+0000","last_clean":"2024-09-12T17:58:34.412127+0000","last_became_active":"2024-09-12T17:40:30.425775+0000","last_became_peered":"2024-09-12T17:40:30.425775+0000","last_unstale":"2024-09-12T17:58:34.412127+0000","last_undegraded":"2024-09-12T17:58:34.412127+0000","last_fullsized":"2024-09-12T17:58:34.412127+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:32.790479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.539586+0000","last_change":"2024-09-12T17:40:27.382194+0000","last_active":"2024-09-12T17:58:29.539586+0000","last_peered":"2024-09-12T17:58:29.539586+0000","last_clean":"2024-09-12T17:58:29.539586+0000","last_became_active":"2024-09-12T17:40:27.381918+0000","last_became_peered":"2024-09-12T17:40:27.381918+0000","last_unstale":"2024-09-12T17:58:29.539586+0000","last_undegraded":"2024-09-12T17:58:29.539586+0000","last_fullsized":"2024-09-12T17:58:29.539586+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:18.545363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"261'43","reported_seq":159,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415390+0000","last_change":"2024-09-12T17:38:51.209399+0000","last_active":"2024-09-12T17:59:09.415390+0000","last_peered":"2024-09-12T17:59:09.415390+0000","last_clean":"2024-09-12T17:59:09.415390+0000","last_became_active":"2024-09-12T17:38:51.209135+0000","last_became_peered":"2024-09-12T17:38:51.209135+0000","last_unstale":"2024-09-12T17:59:09.415390+0000","last_undegraded":"2024-09-12T17:59:09.415390+0000","last_fullsized":"2024-09-12T17:59:09.415390+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:55.234380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":150,"num_write":83,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.422143+0000","last_change":"2024-09-12T17:50:58.431873+0000","last_active":"2024-09-12T17:59:39.422143+0000","last_peered":"2024-09-12T17:59:39.422143+0000","last_clean":"2024-09-12T17:59:39.422143+0000","last_became_active":"2024-09-12T17:50:58.431587+0000","last_became_peered":"2024-09-12T17:50:58.431587+0000","last_unstale":"2024-09-12T17:59:39.422143+0000","last_undegraded":"2024-09-12T17:59:39.422143+0000","last_fullsized":"2024-09-12T17:59:39.422143+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:06.651931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411161+0000","last_change":"2024-09-12T17:40:30.418372+0000","last_active":"2024-09-12T17:58:33.411161+0000","last_peered":"2024-09-12T17:58:33.411161+0000","last_clean":"2024-09-12T17:58:33.411161+0000","last_became_active":"2024-09-12T17:40:30.417998+0000","last_became_peered":"2024-09-12T17:40:30.417998+0000","last_unstale":"2024-09-12T17:58:33.411161+0000","last_undegraded":"2024-09-12T17:58:33.411161+0000","last_fullsized":"2024-09-12T17:58:33.411161+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:45.170209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:34.412106+0000","last_change":"2024-09-12T17:40:27.374835+0000","last_active":"2024-09-12T17:58:34.412106+0000","last_peered":"2024-09-12T17:58:34.412106+0000","last_clean":"2024-09-12T17:58:34.412106+0000","last_became_active":"2024-09-12T17:40:27.374557+0000","last_became_peered":"2024-09-12T17:40:27.374557+0000","last_unstale":"2024-09-12T17:58:34.412106+0000","last_undegraded":"2024-09-12T17:58:34.412106+0000","last_fullsized":"2024-09-12T17:58:34.412106+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:19.232907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"261'32","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.084012+0000","last_change":"2024-09-12T17:38:51.216521+0000","last_active":"2024-09-12T17:59:54.084012+0000","last_peered":"2024-09-12T17:59:54.084012+0000","last_clean":"2024-09-12T17:59:54.084012+0000","last_became_active":"2024-09-12T17:38:51.216209+0000","last_became_peered":"2024-09-12T17:38:51.216209+0000","last_unstale":"2024-09-12T17:59:54.084012+0000","last_undegraded":"2024-09-12T17:59:54.084012+0000","last_fullsized":"2024-09-12T17:59:54.084012+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:23.694199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":109,"num_write":55,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:43.403198+0000","last_change":"2024-09-12T17:50:58.425019+0000","last_active":"2024-09-12T17:57:43.403198+0000","last_peered":"2024-09-12T17:57:43.403198+0000","last_clean":"2024-09-12T17:57:43.403198+0000","last_became_active":"2024-09-12T17:50:58.424452+0000","last_became_peered":"2024-09-12T17:50:58.424452+0000","last_unstale":"2024-09-12T17:57:43.403198+0000","last_undegraded":"2024-09-12T17:57:43.403198+0000","last_fullsized":"2024-09-12T17:57:43.403198+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:27.439096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.407560+0000","last_change":"2024-09-12T17:40:30.418941+0000","last_active":"2024-09-12T17:57:54.407560+0000","last_peered":"2024-09-12T17:57:54.407560+0000","last_clean":"2024-09-12T17:57:54.407560+0000","last_became_active":"2024-09-12T17:40:30.418650+0000","last_became_peered":"2024-09-12T17:40:30.418650+0000","last_unstale":"2024-09-12T17:57:54.407560+0000","last_undegraded":"2024-09-12T17:57:54.407560+0000","last_fullsized":"2024-09-12T17:57:54.407560+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:20.881248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"258'8","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.533425+0000","last_change":"2024-09-12T17:40:27.385454+0000","last_active":"2024-09-12T17:57:49.533425+0000","last_peered":"2024-09-12T17:57:49.533425+0000","last_clean":"2024-09-12T17:57:49.533425+0000","last_became_active":"2024-09-12T17:40:27.385081+0000","last_became_peered":"2024-09-12T17:40:27.385081+0000","last_unstale":"2024-09-12T17:57:49.533425+0000","last_undegraded":"2024-09-12T17:57:49.533425+0000","last_fullsized":"2024-09-12T17:57:49.533425+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:10.053553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"261'37","reported_seq":148,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.545191+0000","last_change":"2024-09-12T17:38:51.209424+0000","last_active":"2024-09-12T17:59:09.545191+0000","last_peered":"2024-09-12T17:59:09.545191+0000","last_clean":"2024-09-12T17:59:09.545191+0000","last_became_active":"2024-09-12T17:38:51.208861+0000","last_became_peered":"2024-09-12T17:38:51.208861+0000","last_unstale":"2024-09-12T17:59:09.545191+0000","last_undegraded":"2024-09-12T17:59:09.545191+0000","last_fullsized":"2024-09-12T17:59:09.545191+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:00.098063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":141,"num_write":67,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.407163+0000","last_change":"2024-09-12T17:50:58.432996+0000","last_active":"2024-09-12T17:57:49.407163+0000","last_peered":"2024-09-12T17:57:49.407163+0000","last_clean":"2024-09-12T17:57:49.407163+0000","last_became_active":"2024-09-12T17:50:58.432245+0000","last_became_peered":"2024-09-12T17:50:58.432245+0000","last_unstale":"2024-09-12T17:57:49.407163+0000","last_undegraded":"2024-09-12T17:57:49.407163+0000","last_fullsized":"2024-09-12T17:57:49.407163+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:12.784598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"258'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.407705+0000","last_change":"2024-09-12T17:40:30.425572+0000","last_active":"2024-09-12T17:57:54.407705+0000","last_peered":"2024-09-12T17:57:54.407705+0000","last_clean":"2024-09-12T17:57:54.407705+0000","last_became_active":"2024-09-12T17:40:30.425293+0000","last_became_peered":"2024-09-12T17:40:30.425293+0000","last_unstale":"2024-09-12T17:57:54.407705+0000","last_undegraded":"2024-09-12T17:57:54.407705+0000","last_fullsized":"2024-09-12T17:57:54.407705+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:39.090717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.405494+0000","last_change":"2024-09-12T17:40:27.377071+0000","last_active":"2024-09-12T17:57:49.405494+0000","last_peered":"2024-09-12T17:57:49.405494+0000","last_clean":"2024-09-12T17:57:49.405494+0000","last_became_active":"2024-09-12T17:40:27.376781+0000","last_became_peered":"2024-09-12T17:40:27.376781+0000","last_unstale":"2024-09-12T17:57:49.405494+0000","last_undegraded":"2024-09-12T17:57:49.405494+0000","last_fullsized":"2024-09-12T17:57:49.405494+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:17.637845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412794+0000","last_change":"2024-09-12T17:38:51.210062+0000","last_active":"2024-09-12T17:58:29.412794+0000","last_peered":"2024-09-12T17:58:29.412794+0000","last_clean":"2024-09-12T17:58:29.412794+0000","last_became_active":"2024-09-12T17:38:51.209772+0000","last_became_peered":"2024-09-12T17:38:51.209772+0000","last_unstale":"2024-09-12T17:58:29.412794+0000","last_undegraded":"2024-09-12T17:58:29.412794+0000","last_fullsized":"2024-09-12T17:58:29.412794+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:25.124534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:44.406424+0000","last_change":"2024-09-12T17:50:58.429816+0000","last_active":"2024-09-12T17:57:44.406424+0000","last_peered":"2024-09-12T17:57:44.406424+0000","last_clean":"2024-09-12T17:57:44.406424+0000","last_became_active":"2024-09-12T17:50:58.429551+0000","last_became_peered":"2024-09-12T17:50:58.429551+0000","last_unstale":"2024-09-12T17:57:44.406424+0000","last_undegraded":"2024-09-12T17:57:44.406424+0000","last_fullsized":"2024-09-12T17:57:44.406424+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:25.259007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'6","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.411292+0000","last_change":"2024-09-12T17:40:30.409389+0000","last_active":"2024-09-12T17:58:29.411292+0000","last_peered":"2024-09-12T17:58:29.411292+0000","last_clean":"2024-09-12T17:58:29.411292+0000","last_became_active":"2024-09-12T17:40:30.408915+0000","last_became_peered":"2024-09-12T17:40:30.408915+0000","last_unstale":"2024-09-12T17:58:29.411292+0000","last_undegraded":"2024-09-12T17:58:29.411292+0000","last_fullsized":"2024-09-12T17:58:29.411292+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:56.865653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25606,"num_write":11,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"258'3","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.533461+0000","last_change":"2024-09-12T17:40:27.382211+0000","last_active":"2024-09-12T17:57:49.533461+0000","last_peered":"2024-09-12T17:57:49.533461+0000","last_clean":"2024-09-12T17:57:49.533461+0000","last_became_active":"2024-09-12T17:40:27.381885+0000","last_became_peered":"2024-09-12T17:40:27.381885+0000","last_unstale":"2024-09-12T17:57:49.533461+0000","last_undegraded":"2024-09-12T17:57:49.533461+0000","last_fullsized":"2024-09-12T17:57:49.533461+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:52.579087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"261'68","reported_seq":231,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.409354+0000","last_change":"2024-09-12T17:38:51.215246+0000","last_active":"2024-09-12T17:58:23.409354+0000","last_peered":"2024-09-12T17:58:23.409354+0000","last_clean":"2024-09-12T17:58:23.409354+0000","last_became_active":"2024-09-12T17:38:51.214940+0000","last_became_peered":"2024-09-12T17:38:51.214940+0000","last_unstale":"2024-09-12T17:58:23.409354+0000","last_undegraded":"2024-09-12T17:58:23.409354+0000","last_fullsized":"2024-09-12T17:58:23.409354+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:11.305564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":356,"num_read_kb":250,"num_write":117,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:44.532653+0000","last_change":"2024-09-12T17:50:58.421234+0000","last_active":"2024-09-12T17:57:44.532653+0000","last_peered":"2024-09-12T17:57:44.532653+0000","last_clean":"2024-09-12T17:57:44.532653+0000","last_became_active":"2024-09-12T17:50:58.420251+0000","last_became_peered":"2024-09-12T17:50:58.420251+0000","last_unstale":"2024-09-12T17:57:44.532653+0000","last_undegraded":"2024-09-12T17:57:44.532653+0000","last_fullsized":"2024-09-12T17:57:44.532653+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:17.481915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"258'7","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.408453+0000","last_change":"2024-09-12T17:40:30.417703+0000","last_active":"2024-09-12T17:57:59.408453+0000","last_peered":"2024-09-12T17:57:59.408453+0000","last_clean":"2024-09-12T17:57:59.408453+0000","last_became_active":"2024-09-12T17:40:30.417393+0000","last_became_peered":"2024-09-12T17:40:30.417393+0000","last_unstale":"2024-09-12T17:57:59.408453+0000","last_undegraded":"2024-09-12T17:57:59.408453+0000","last_fullsized":"2024-09-12T17:57:59.408453+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:40.700927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":7,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'1","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412637+0000","last_change":"2024-09-12T17:40:27.379736+0000","last_active":"2024-09-12T17:58:29.412637+0000","last_peered":"2024-09-12T17:58:29.412637+0000","last_clean":"2024-09-12T17:58:29.412637+0000","last_became_active":"2024-09-12T17:40:27.379472+0000","last_became_peered":"2024-09-12T17:40:27.379472+0000","last_unstale":"2024-09-12T17:58:29.412637+0000","last_undegraded":"2024-09-12T17:58:29.412637+0000","last_fullsized":"2024-09-12T17:58:29.412637+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:36.186301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"261'106","reported_seq":366,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.408959+0000","last_change":"2024-09-12T17:38:51.208031+0000","last_active":"2024-09-12T17:58:24.408959+0000","last_peered":"2024-09-12T17:58:24.408959+0000","last_clean":"2024-09-12T17:58:24.408959+0000","last_became_active":"2024-09-12T17:38:51.207735+0000","last_became_peered":"2024-09-12T17:38:51.207735+0000","last_unstale":"2024-09-12T17:58:24.408959+0000","last_undegraded":"2024-09-12T17:58:24.408959+0000","last_fullsized":"2024-09-12T17:58:24.408959+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:15.007282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":541,"num_write":122,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419330+0000","last_change":"2024-09-12T17:50:58.431116+0000","last_active":"2024-09-12T17:59:19.419330+0000","last_peered":"2024-09-12T17:59:19.419330+0000","last_clean":"2024-09-12T17:59:19.419330+0000","last_became_active":"2024-09-12T17:50:58.430813+0000","last_became_peered":"2024-09-12T17:50:58.430813+0000","last_unstale":"2024-09-12T17:59:19.419330+0000","last_undegraded":"2024-09-12T17:59:19.419330+0000","last_fullsized":"2024-09-12T17:59:19.419330+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:19.189927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546398+0000","last_change":"2024-09-12T17:40:30.411164+0000","last_active":"2024-09-12T17:59:19.546398+0000","last_peered":"2024-09-12T17:59:19.546398+0000","last_clean":"2024-09-12T17:59:19.546398+0000","last_became_active":"2024-09-12T17:40:30.410872+0000","last_became_peered":"2024-09-12T17:40:30.410872+0000","last_unstale":"2024-09-12T17:59:19.546398+0000","last_undegraded":"2024-09-12T17:59:19.546398+0000","last_fullsized":"2024-09-12T17:59:19.546398+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:47.603677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'1","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418811+0000","last_change":"2024-09-12T17:40:27.380593+0000","last_active":"2024-09-12T17:59:14.418811+0000","last_peered":"2024-09-12T17:59:14.418811+0000","last_clean":"2024-09-12T17:59:14.418811+0000","last_became_active":"2024-09-12T17:40:27.380269+0000","last_became_peered":"2024-09-12T17:40:27.380269+0000","last_unstale":"2024-09-12T17:59:14.418811+0000","last_undegraded":"2024-09-12T17:59:14.418811+0000","last_fullsized":"2024-09-12T17:59:14.418811+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:52.967809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"261'42","reported_seq":157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.023193+0000","last_change":"2024-09-12T17:38:51.216559+0000","last_active":"2024-09-12T17:59:16.023193+0000","last_peered":"2024-09-12T17:59:16.023193+0000","last_clean":"2024-09-12T17:59:16.023193+0000","last_became_active":"2024-09-12T17:38:51.216152+0000","last_became_peered":"2024-09-12T17:38:51.216152+0000","last_unstale":"2024-09-12T17:59:16.023193+0000","last_undegraded":"2024-09-12T17:59:16.023193+0000","last_fullsized":"2024-09-12T17:59:16.023193+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:42.821025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":152,"num_write":74,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.418727+0000","last_change":"2024-09-12T17:50:58.431015+0000","last_active":"2024-09-12T17:59:19.418727+0000","last_peered":"2024-09-12T17:59:19.418727+0000","last_clean":"2024-09-12T17:59:19.418727+0000","last_became_active":"2024-09-12T17:50:58.430723+0000","last_became_peered":"2024-09-12T17:50:58.430723+0000","last_unstale":"2024-09-12T17:59:19.418727+0000","last_undegraded":"2024-09-12T17:59:19.418727+0000","last_fullsized":"2024-09-12T17:59:19.418727+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:21.663778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"261'1","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546384+0000","last_change":"2024-09-12T17:40:30.425667+0000","last_active":"2024-09-12T17:59:19.546384+0000","last_peered":"2024-09-12T17:59:19.546384+0000","last_clean":"2024-09-12T17:59:19.546384+0000","last_became_active":"2024-09-12T17:40:30.425368+0000","last_became_peered":"2024-09-12T17:40:30.425368+0000","last_unstale":"2024-09-12T17:59:19.546384+0000","last_undegraded":"2024-09-12T17:59:19.546384+0000","last_fullsized":"2024-09-12T17:59:19.546384+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:57.448155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3212,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:13.618170+0000","last_change":"2024-09-12T17:40:27.384113+0000","last_active":"2024-09-12T17:59:13.618170+0000","last_peered":"2024-09-12T17:59:13.618170+0000","last_clean":"2024-09-12T17:59:13.618170+0000","last_became_active":"2024-09-12T17:40:27.383770+0000","last_became_peered":"2024-09-12T17:40:27.383770+0000","last_unstale":"2024-09-12T17:59:13.618170+0000","last_undegraded":"2024-09-12T17:59:13.618170+0000","last_fullsized":"2024-09-12T17:59:13.618170+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:34.294441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"258'22","reported_seq":108,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.409051+0000","last_change":"2024-09-12T17:38:51.209047+0000","last_active":"2024-09-12T17:58:24.409051+0000","last_peered":"2024-09-12T17:58:24.409051+0000","last_clean":"2024-09-12T17:58:24.409051+0000","last_became_active":"2024-09-12T17:38:51.208767+0000","last_became_peered":"2024-09-12T17:38:51.208767+0000","last_unstale":"2024-09-12T17:58:24.409051+0000","last_undegraded":"2024-09-12T17:58:24.409051+0000","last_fullsized":"2024-09-12T17:58:24.409051+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:21.421941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:04.416155+0000","last_change":"2024-09-12T17:50:58.422944+0000","last_active":"2024-09-12T17:59:04.416155+0000","last_peered":"2024-09-12T17:59:04.416155+0000","last_clean":"2024-09-12T17:59:04.416155+0000","last_became_active":"2024-09-12T17:50:58.422625+0000","last_became_peered":"2024-09-12T17:50:58.422625+0000","last_unstale":"2024-09-12T17:59:04.416155+0000","last_undegraded":"2024-09-12T17:59:04.416155+0000","last_fullsized":"2024-09-12T17:59:04.416155+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:04.987349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"258'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.407842+0000","last_change":"2024-09-12T17:40:30.425786+0000","last_active":"2024-09-12T17:57:54.407842+0000","last_peered":"2024-09-12T17:57:54.407842+0000","last_clean":"2024-09-12T17:57:54.407842+0000","last_became_active":"2024-09-12T17:40:30.425536+0000","last_became_peered":"2024-09-12T17:40:30.425536+0000","last_unstale":"2024-09-12T17:57:54.407842+0000","last_undegraded":"2024-09-12T17:57:54.407842+0000","last_fullsized":"2024-09-12T17:57:54.407842+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:19.565868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"258'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.406415+0000","last_change":"2024-09-12T17:40:27.382099+0000","last_active":"2024-09-12T17:57:49.406415+0000","last_peered":"2024-09-12T17:57:49.406415+0000","last_clean":"2024-09-12T17:57:49.406415+0000","last_became_active":"2024-09-12T17:40:27.381818+0000","last_became_peered":"2024-09-12T17:40:27.381818+0000","last_unstale":"2024-09-12T17:57:49.406415+0000","last_undegraded":"2024-09-12T17:57:49.406415+0000","last_fullsized":"2024-09-12T17:57:49.406415+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:59.918995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"261'42","reported_seq":165,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:44.406455+0000","last_change":"2024-09-12T17:38:51.211565+0000","last_active":"2024-09-12T17:57:44.406455+0000","last_peered":"2024-09-12T17:57:44.406455+0000","last_clean":"2024-09-12T17:57:44.406455+0000","last_became_active":"2024-09-12T17:38:51.211219+0000","last_became_peered":"2024-09-12T17:38:51.211219+0000","last_unstale":"2024-09-12T17:57:44.406455+0000","last_undegraded":"2024-09-12T17:57:44.406455+0000","last_fullsized":"2024-09-12T17:57:44.406455+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:18.738642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":165,"num_write":70,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419044+0000","last_change":"2024-09-12T17:50:58.416892+0000","last_active":"2024-09-12T17:59:19.419044+0000","last_peered":"2024-09-12T17:59:19.419044+0000","last_clean":"2024-09-12T17:59:19.419044+0000","last_became_active":"2024-09-12T17:50:58.416501+0000","last_became_peered":"2024-09-12T17:50:58.416501+0000","last_unstale":"2024-09-12T17:59:19.419044+0000","last_undegraded":"2024-09-12T17:59:19.419044+0000","last_fullsized":"2024-09-12T17:59:19.419044+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:06.098567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"261'4","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.407686+0000","last_change":"2024-09-12T17:40:30.418747+0000","last_active":"2024-09-12T17:57:54.407686+0000","last_peered":"2024-09-12T17:57:54.407686+0000","last_clean":"2024-09-12T17:57:54.407686+0000","last_became_active":"2024-09-12T17:40:30.418418+0000","last_became_peered":"2024-09-12T17:40:30.418418+0000","last_unstale":"2024-09-12T17:57:54.407686+0000","last_undegraded":"2024-09-12T17:57:54.407686+0000","last_fullsized":"2024-09-12T17:57:54.407686+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:50.907324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.407185+0000","last_change":"2024-09-12T17:40:27.383455+0000","last_active":"2024-09-12T17:57:49.407185+0000","last_peered":"2024-09-12T17:57:49.407185+0000","last_clean":"2024-09-12T17:57:49.407185+0000","last_became_active":"2024-09-12T17:40:27.383023+0000","last_became_peered":"2024-09-12T17:40:27.383023+0000","last_unstale":"2024-09-12T17:57:49.407185+0000","last_undegraded":"2024-09-12T17:57:49.407185+0000","last_fullsized":"2024-09-12T17:57:49.407185+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:38.107217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"261'37","reported_seq":149,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.249331+0000","last_change":"2024-09-12T17:38:51.210126+0000","last_active":"2024-09-12T17:59:54.249331+0000","last_peered":"2024-09-12T17:59:54.249331+0000","last_clean":"2024-09-12T17:59:54.249331+0000","last_became_active":"2024-09-12T17:38:51.209833+0000","last_became_peered":"2024-09-12T17:38:51.209833+0000","last_unstale":"2024-09-12T17:59:54.249331+0000","last_undegraded":"2024-09-12T17:59:54.249331+0000","last_fullsized":"2024-09-12T17:59:54.249331+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:29.524821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":141,"num_write":58,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.621111+0000","last_change":"2024-09-12T17:50:58.424105+0000","last_active":"2024-09-12T17:59:38.621111+0000","last_peered":"2024-09-12T17:59:38.621111+0000","last_clean":"2024-09-12T17:59:38.621111+0000","last_became_active":"2024-09-12T17:50:58.423798+0000","last_became_peered":"2024-09-12T17:50:58.423798+0000","last_unstale":"2024-09-12T17:59:38.621111+0000","last_undegraded":"2024-09-12T17:59:38.621111+0000","last_fullsized":"2024-09-12T17:59:38.621111+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:57.214535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.417888+0000","last_change":"2024-09-12T17:40:30.412437+0000","last_active":"2024-09-12T17:59:14.417888+0000","last_peered":"2024-09-12T17:59:14.417888+0000","last_clean":"2024-09-12T17:59:14.417888+0000","last_became_active":"2024-09-12T17:40:30.412140+0000","last_became_peered":"2024-09-12T17:40:30.412140+0000","last_unstale":"2024-09-12T17:59:14.417888+0000","last_undegraded":"2024-09-12T17:59:14.417888+0000","last_fullsized":"2024-09-12T17:59:14.417888+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:44.020052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:34.413567+0000","last_change":"2024-09-12T17:40:27.385866+0000","last_active":"2024-09-12T17:58:34.413567+0000","last_peered":"2024-09-12T17:58:34.413567+0000","last_clean":"2024-09-12T17:58:34.413567+0000","last_became_active":"2024-09-12T17:40:27.385649+0000","last_became_peered":"2024-09-12T17:40:27.385649+0000","last_unstale":"2024-09-12T17:58:34.413567+0000","last_undegraded":"2024-09-12T17:58:34.413567+0000","last_fullsized":"2024-09-12T17:58:34.413567+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:44.080842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"258'14","reported_seq":85,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.422160+0000","last_change":"2024-09-12T17:38:51.216015+0000","last_active":"2024-09-12T17:59:44.422160+0000","last_peered":"2024-09-12T17:59:44.422160+0000","last_clean":"2024-09-12T17:59:44.422160+0000","last_became_active":"2024-09-12T17:38:51.215738+0000","last_became_peered":"2024-09-12T17:38:51.215738+0000","last_unstale":"2024-09-12T17:59:44.422160+0000","last_undegraded":"2024-09-12T17:59:44.422160+0000","last_fullsized":"2024-09-12T17:59:44.422160+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:22.857791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.549295+0000","last_change":"2024-09-12T17:50:58.423755+0000","last_active":"2024-09-12T17:59:39.549295+0000","last_peered":"2024-09-12T17:59:39.549295+0000","last_clean":"2024-09-12T17:59:39.549295+0000","last_became_active":"2024-09-12T17:50:58.423443+0000","last_became_peered":"2024-09-12T17:50:58.423443+0000","last_unstale":"2024-09-12T17:59:39.549295+0000","last_undegraded":"2024-09-12T17:59:39.549295+0000","last_fullsized":"2024-09-12T17:59:39.549295+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:21.905993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:34.412791+0000","last_change":"2024-09-12T17:40:30.415967+0000","last_active":"2024-09-12T17:58:34.412791+0000","last_peered":"2024-09-12T17:58:34.412791+0000","last_clean":"2024-09-12T17:58:34.412791+0000","last_became_active":"2024-09-12T17:40:30.415696+0000","last_became_peered":"2024-09-12T17:40:30.415696+0000","last_unstale":"2024-09-12T17:58:34.412791+0000","last_undegraded":"2024-09-12T17:58:34.412791+0000","last_fullsized":"2024-09-12T17:58:34.412791+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:00.615699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418738+0000","last_change":"2024-09-12T17:40:27.381415+0000","last_active":"2024-09-12T17:59:14.418738+0000","last_peered":"2024-09-12T17:59:14.418738+0000","last_clean":"2024-09-12T17:59:14.418738+0000","last_became_active":"2024-09-12T17:40:27.381128+0000","last_became_peered":"2024-09-12T17:40:27.381128+0000","last_unstale":"2024-09-12T17:59:14.418738+0000","last_undegraded":"2024-09-12T17:59:14.418738+0000","last_fullsized":"2024-09-12T17:59:14.418738+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:41.708551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"261'15","reported_seq":83,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.422414+0000","last_change":"2024-09-12T17:38:51.211542+0000","last_active":"2024-09-12T17:59:44.422414+0000","last_peered":"2024-09-12T17:59:44.422414+0000","last_clean":"2024-09-12T17:59:44.422414+0000","last_became_active":"2024-09-12T17:38:51.210741+0000","last_became_peered":"2024-09-12T17:38:51.210741+0000","last_unstale":"2024-09-12T17:59:44.422414+0000","last_undegraded":"2024-09-12T17:59:44.422414+0000","last_fullsized":"2024-09-12T17:59:44.422414+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:53.102160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":45,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546366+0000","last_change":"2024-09-12T17:50:58.422536+0000","last_active":"2024-09-12T17:59:19.546366+0000","last_peered":"2024-09-12T17:59:19.546366+0000","last_clean":"2024-09-12T17:59:19.546366+0000","last_became_active":"2024-09-12T17:50:58.422195+0000","last_became_peered":"2024-09-12T17:50:58.422195+0000","last_unstale":"2024-09-12T17:59:19.546366+0000","last_undegraded":"2024-09-12T17:59:19.546366+0000","last_fullsized":"2024-09-12T17:59:19.546366+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:53.708044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.416457+0000","last_change":"2024-09-12T17:40:30.418965+0000","last_active":"2024-09-12T17:59:19.416457+0000","last_peered":"2024-09-12T17:59:19.416457+0000","last_clean":"2024-09-12T17:59:19.416457+0000","last_became_active":"2024-09-12T17:40:30.418692+0000","last_became_peered":"2024-09-12T17:40:30.418692+0000","last_unstale":"2024-09-12T17:59:19.416457+0000","last_undegraded":"2024-09-12T17:59:19.416457+0000","last_fullsized":"2024-09-12T17:59:19.416457+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:04.962038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"258'6","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.417950+0000","last_change":"2024-09-12T17:40:27.377091+0000","last_active":"2024-09-12T17:59:14.417950+0000","last_peered":"2024-09-12T17:59:14.417950+0000","last_clean":"2024-09-12T17:59:14.417950+0000","last_became_active":"2024-09-12T17:40:27.376395+0000","last_became_peered":"2024-09-12T17:40:27.376395+0000","last_unstale":"2024-09-12T17:59:14.417950+0000","last_undegraded":"2024-09-12T17:59:14.417950+0000","last_fullsized":"2024-09-12T17:59:14.417950+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:00.248728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"261'24","reported_seq":110,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.419639+0000","last_change":"2024-09-12T17:38:51.213165+0000","last_active":"2024-09-12T17:59:44.419639+0000","last_peered":"2024-09-12T17:59:44.419639+0000","last_clean":"2024-09-12T17:59:44.419639+0000","last_became_active":"2024-09-12T17:38:51.212856+0000","last_became_peered":"2024-09-12T17:38:51.212856+0000","last_unstale":"2024-09-12T17:59:44.419639+0000","last_undegraded":"2024-09-12T17:59:44.419639+0000","last_fullsized":"2024-09-12T17:59:44.419639+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:17.393643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":83,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:24.420242+0000","last_change":"2024-09-12T17:50:58.431889+0000","last_active":"2024-09-12T17:59:24.420242+0000","last_peered":"2024-09-12T17:59:24.420242+0000","last_clean":"2024-09-12T17:59:24.420242+0000","last_became_active":"2024-09-12T17:50:58.431442+0000","last_became_peered":"2024-09-12T17:50:58.431442+0000","last_unstale":"2024-09-12T17:59:24.420242+0000","last_undegraded":"2024-09-12T17:59:24.420242+0000","last_fullsized":"2024-09-12T17:59:24.420242+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:40.014254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419070+0000","last_change":"2024-09-12T17:40:30.418760+0000","last_active":"2024-09-12T17:59:19.419070+0000","last_peered":"2024-09-12T17:59:19.419070+0000","last_clean":"2024-09-12T17:59:19.419070+0000","last_became_active":"2024-09-12T17:40:30.418464+0000","last_became_peered":"2024-09-12T17:40:30.418464+0000","last_unstale":"2024-09-12T17:59:19.419070+0000","last_undegraded":"2024-09-12T17:59:19.419070+0000","last_fullsized":"2024-09-12T17:59:19.419070+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:03.345502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"261'3","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.415954+0000","last_change":"2024-09-12T17:40:27.379405+0000","last_active":"2024-09-12T17:59:14.415954+0000","last_peered":"2024-09-12T17:59:14.415954+0000","last_clean":"2024-09-12T17:59:14.415954+0000","last_became_active":"2024-09-12T17:40:27.379133+0000","last_became_peered":"2024-09-12T17:40:27.379133+0000","last_unstale":"2024-09-12T17:59:14.415954+0000","last_undegraded":"2024-09-12T17:59:14.415954+0000","last_fullsized":"2024-09-12T17:59:14.415954+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:39.813640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246092,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":8,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"261'32","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.417100+0000","last_change":"2024-09-12T17:38:51.208801+0000","last_active":"2024-09-12T17:58:59.417100+0000","last_peered":"2024-09-12T17:58:59.417100+0000","last_clean":"2024-09-12T17:58:59.417100+0000","last_became_active":"2024-09-12T17:38:51.208386+0000","last_became_peered":"2024-09-12T17:38:51.208386+0000","last_unstale":"2024-09-12T17:58:59.417100+0000","last_undegraded":"2024-09-12T17:58:59.417100+0000","last_fullsized":"2024-09-12T17:58:59.417100+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:57.157726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":109,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"261'269","reported_seq":881,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.059607+0000","last_change":"2024-09-12T17:23:40.709230+0000","last_active":"2024-09-12T18:01:34.059607+0000","last_peered":"2024-09-12T18:01:34.059607+0000","last_clean":"2024-09-12T18:01:34.059607+0000","last_became_active":"2024-09-12T17:23:40.708951+0000","last_became_peered":"2024-09-12T17:23:40.708951+0000","last_unstale":"2024-09-12T18:01:34.059607+0000","last_undegraded":"2024-09-12T18:01:34.059607+0000","last_fullsized":"2024-09-12T18:01:34.059607+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:29.306708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7403571,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":399,"num_read_kb":4677,"num_write":1037,"num_write_kb":27229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"261'483","reported_seq":2010,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.776173+0000","last_change":"2024-09-12T17:23:42.147291+0000","last_active":"2024-09-12T18:00:15.776173+0000","last_peered":"2024-09-12T18:00:15.776173+0000","last_clean":"2024-09-12T18:00:15.776173+0000","last_became_active":"2024-09-12T17:23:42.146906+0000","last_became_peered":"2024-09-12T17:23:42.146906+0000","last_unstale":"2024-09-12T18:00:15.776173+0000","last_undegraded":"2024-09-12T18:00:15.776173+0000","last_fullsized":"2024-09-12T18:00:15.776173+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:47.049866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2345,"num_read_kb":2204,"num_write":541,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"261'326","reported_seq":999,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:53.431382+0000","last_change":"2024-09-12T17:23:40.720117+0000","last_active":"2024-09-12T17:59:53.431382+0000","last_peered":"2024-09-12T17:59:53.431382+0000","last_clean":"2024-09-12T17:59:53.431382+0000","last_became_active":"2024-09-12T17:23:40.719834+0000","last_became_peered":"2024-09-12T17:23:40.719834+0000","last_unstale":"2024-09-12T17:59:53.431382+0000","last_undegraded":"2024-09-12T17:59:53.431382+0000","last_fullsized":"2024-09-12T17:59:53.431382+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:08.528131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10874006,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":559,"num_read_kb":15949,"num_write":1128,"num_write_kb":28721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"261'473","reported_seq":2215,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.149339+0000","last_change":"2024-09-12T17:23:42.147555+0000","last_active":"2024-09-12T18:00:18.149339+0000","last_peered":"2024-09-12T18:00:18.149339+0000","last_clean":"2024-09-12T18:00:18.149339+0000","last_became_active":"2024-09-12T17:23:42.147270+0000","last_became_peered":"2024-09-12T17:23:42.147270+0000","last_unstale":"2024-09-12T18:00:18.149339+0000","last_undegraded":"2024-09-12T18:00:18.149339+0000","last_fullsized":"2024-09-12T18:00:18.149339+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:12.132659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3009,"num_read_kb":2866,"num_write":558,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"261'276","reported_seq":1074,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.520775+0000","last_change":"2024-09-12T17:23:40.702160+0000","last_active":"2024-09-12T18:01:49.520775+0000","last_peered":"2024-09-12T18:01:49.520775+0000","last_clean":"2024-09-12T18:01:49.520775+0000","last_became_active":"2024-09-12T17:23:40.701839+0000","last_became_peered":"2024-09-12T17:23:40.701839+0000","last_unstale":"2024-09-12T18:01:49.520775+0000","last_undegraded":"2024-09-12T18:01:49.520775+0000","last_fullsized":"2024-09-12T18:01:49.520775+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:27.896198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10652701,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":775,"num_read_kb":22445,"num_write":923,"num_write_kb":35081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"261'1193","reported_seq":2827,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.787881+0000","last_change":"2024-09-12T17:23:42.143316+0000","last_active":"2024-09-12T18:00:05.787881+0000","last_peered":"2024-09-12T18:00:05.787881+0000","last_clean":"2024-09-12T18:00:05.787881+0000","last_became_active":"2024-09-12T17:23:42.141845+0000","last_became_peered":"2024-09-12T17:23:42.141845+0000","last_unstale":"2024-09-12T18:00:05.787881+0000","last_undegraded":"2024-09-12T18:00:05.787881+0000","last_fullsized":"2024-09-12T18:00:05.787881+0000","mapping_epoch":25,"log_start":"261'1100","ondisk_log_start":"261'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":1100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:43.825593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5470,"num_read_kb":4840,"num_write":1657,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"261'317","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.947792+0000","last_change":"2024-09-12T17:23:40.713745+0000","last_active":"2024-09-12T18:01:36.947792+0000","last_peered":"2024-09-12T18:01:36.947792+0000","last_clean":"2024-09-12T18:01:36.947792+0000","last_became_active":"2024-09-12T17:23:40.712263+0000","last_became_peered":"2024-09-12T17:23:40.712263+0000","last_unstale":"2024-09-12T18:01:36.947792+0000","last_undegraded":"2024-09-12T18:01:36.947792+0000","last_fullsized":"2024-09-12T18:01:36.947792+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:37.480449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1082950,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":465,"num_read_kb":11567,"num_write":1170,"num_write_kb":26002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"261'1241","reported_seq":2921,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.777810+0000","last_change":"2024-09-12T17:23:42.158153+0000","last_active":"2024-09-12T18:00:15.777810+0000","last_peered":"2024-09-12T18:00:15.777810+0000","last_clean":"2024-09-12T18:00:15.777810+0000","last_became_active":"2024-09-12T17:23:42.157835+0000","last_became_peered":"2024-09-12T17:23:42.157835+0000","last_unstale":"2024-09-12T18:00:15.777810+0000","last_undegraded":"2024-09-12T18:00:15.777810+0000","last_fullsized":"2024-09-12T18:00:15.777810+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:20.923845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5656,"num_read_kb":5021,"num_write":1694,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"261'287","reported_seq":972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.627825+0000","last_change":"2024-09-12T17:23:40.706187+0000","last_active":"2024-09-12T17:59:58.627825+0000","last_peered":"2024-09-12T17:59:58.627825+0000","last_clean":"2024-09-12T17:59:58.627825+0000","last_became_active":"2024-09-12T17:23:40.705906+0000","last_became_peered":"2024-09-12T17:23:40.705906+0000","last_unstale":"2024-09-12T17:59:58.627825+0000","last_undegraded":"2024-09-12T17:59:58.627825+0000","last_fullsized":"2024-09-12T17:59:58.627825+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.975637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245706,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":607,"num_read_kb":37545,"num_write":1029,"num_write_kb":42867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"261'385","reported_seq":1824,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.566613+0000","last_change":"2024-09-12T17:23:42.142597+0000","last_active":"2024-09-12T18:00:04.566613+0000","last_peered":"2024-09-12T18:00:04.566613+0000","last_clean":"2024-09-12T18:00:04.566613+0000","last_became_active":"2024-09-12T17:23:42.142311+0000","last_became_peered":"2024-09-12T17:23:42.142311+0000","last_unstale":"2024-09-12T18:00:04.566613+0000","last_undegraded":"2024-09-12T18:00:04.566613+0000","last_fullsized":"2024-09-12T18:00:04.566613+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:25.262592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2045,"num_read_kb":1945,"num_write":422,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"261'326","reported_seq":1018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:57.367503+0000","last_change":"2024-09-12T17:23:40.705539+0000","last_active":"2024-09-12T17:59:57.367503+0000","last_peered":"2024-09-12T17:59:57.367503+0000","last_clean":"2024-09-12T17:59:57.367503+0000","last_became_active":"2024-09-12T17:23:40.705215+0000","last_became_peered":"2024-09-12T17:23:40.705215+0000","last_unstale":"2024-09-12T17:59:57.367503+0000","last_undegraded":"2024-09-12T17:59:57.367503+0000","last_fullsized":"2024-09-12T17:59:57.367503+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:33.336833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295144,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":707,"num_read_kb":26786,"num_write":1227,"num_write_kb":30822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"261'882","reported_seq":2676,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.911490+0000","last_change":"2024-09-12T17:23:42.143689+0000","last_active":"2024-09-12T17:59:59.911490+0000","last_peered":"2024-09-12T17:59:59.911490+0000","last_clean":"2024-09-12T17:59:59.911490+0000","last_became_active":"2024-09-12T17:23:42.143402+0000","last_became_peered":"2024-09-12T17:23:42.143402+0000","last_unstale":"2024-09-12T17:59:59.911490+0000","last_undegraded":"2024-09-12T17:59:59.911490+0000","last_fullsized":"2024-09-12T17:59:59.911490+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:34.164395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4455,"num_read_kb":4051,"num_write":1149,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"261'273","reported_seq":887,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.856750+0000","last_change":"2024-09-12T17:23:40.714177+0000","last_active":"2024-09-12T18:00:02.856750+0000","last_peered":"2024-09-12T18:00:02.856750+0000","last_clean":"2024-09-12T18:00:02.856750+0000","last_became_active":"2024-09-12T17:23:40.713883+0000","last_became_peered":"2024-09-12T17:23:40.713883+0000","last_unstale":"2024-09-12T18:00:02.856750+0000","last_undegraded":"2024-09-12T18:00:02.856750+0000","last_fullsized":"2024-09-12T18:00:02.856750+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:08.265768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19258432,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":416,"num_read_kb":1994,"num_write":1054,"num_write_kb":56686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"261'914","reported_seq":2617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559532+0000","last_change":"2024-09-12T17:23:42.152325+0000","last_active":"2024-09-12T18:00:18.559532+0000","last_peered":"2024-09-12T18:00:18.559532+0000","last_clean":"2024-09-12T18:00:18.559532+0000","last_became_active":"2024-09-12T17:23:42.152030+0000","last_became_peered":"2024-09-12T17:23:42.152030+0000","last_unstale":"2024-09-12T18:00:18.559532+0000","last_undegraded":"2024-09-12T18:00:18.559532+0000","last_fullsized":"2024-09-12T18:00:18.559532+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":900,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:58.696177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4677,"num_read_kb":4199,"num_write":1240,"num_write_kb":482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"261'256","reported_seq":932,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:24.808003+0000","last_change":"2024-09-12T17:23:40.717561+0000","last_active":"2024-09-12T17:59:24.808003+0000","last_peered":"2024-09-12T17:59:24.808003+0000","last_clean":"2024-09-12T17:59:24.808003+0000","last_became_active":"2024-09-12T17:23:40.717097+0000","last_became_peered":"2024-09-12T17:23:40.717097+0000","last_unstale":"2024-09-12T17:59:24.808003+0000","last_undegraded":"2024-09-12T17:59:24.808003+0000","last_fullsized":"2024-09-12T17:59:24.808003+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:08.329294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947935,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":534,"num_read_kb":3212,"num_write":1015,"num_write_kb":17046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"261'390","reported_seq":1862,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.560134+0000","last_change":"2024-09-12T17:24:17.227171+0000","last_active":"2024-09-12T18:00:18.560134+0000","last_peered":"2024-09-12T18:00:18.560134+0000","last_clean":"2024-09-12T18:00:18.560134+0000","last_became_active":"2024-09-12T17:24:17.226840+0000","last_became_peered":"2024-09-12T17:24:17.226840+0000","last_unstale":"2024-09-12T18:00:18.560134+0000","last_undegraded":"2024-09-12T18:00:18.560134+0000","last_fullsized":"2024-09-12T18:00:18.560134+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:26.876837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2081,"num_read_kb":1979,"num_write":442,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"261'751","reported_seq":2065,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.247585+0000","last_change":"2024-09-12T17:23:42.152851+0000","last_active":"2024-09-12T18:00:04.247585+0000","last_peered":"2024-09-12T18:00:04.247585+0000","last_clean":"2024-09-12T18:00:04.247585+0000","last_became_active":"2024-09-12T17:23:42.152513+0000","last_became_peered":"2024-09-12T17:23:42.152513+0000","last_unstale":"2024-09-12T18:00:04.247585+0000","last_undegraded":"2024-09-12T18:00:04.247585+0000","last_fullsized":"2024-09-12T18:00:04.247585+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:34.195735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3383,"num_read_kb":3022,"num_write":991,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"261'251","reported_seq":868,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.359475+0000","last_change":"2024-09-12T17:23:40.713044+0000","last_active":"2024-09-12T18:00:04.359475+0000","last_peered":"2024-09-12T18:00:04.359475+0000","last_clean":"2024-09-12T18:00:04.359475+0000","last_became_active":"2024-09-12T17:23:40.712747+0000","last_became_peered":"2024-09-12T17:23:40.712747+0000","last_unstale":"2024-09-12T18:00:04.359475+0000","last_undegraded":"2024-09-12T18:00:04.359475+0000","last_fullsized":"2024-09-12T18:00:04.359475+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.000672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11859730,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":394,"num_read_kb":32148,"num_write":905,"num_write_kb":37186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"261'506","reported_seq":2009,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.988702+0000","last_change":"2024-09-12T17:23:42.148419+0000","last_active":"2024-09-12T18:00:03.988702+0000","last_peered":"2024-09-12T18:00:03.988702+0000","last_clean":"2024-09-12T18:00:03.988702+0000","last_became_active":"2024-09-12T17:23:42.148091+0000","last_became_peered":"2024-09-12T17:23:42.148091+0000","last_unstale":"2024-09-12T18:00:03.988702+0000","last_undegraded":"2024-09-12T18:00:03.988702+0000","last_fullsized":"2024-09-12T18:00:03.988702+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:49.293452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2605,"num_read_kb":2400,"num_write":650,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"261'289","reported_seq":976,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.193547+0000","last_change":"2024-09-12T17:23:40.708563+0000","last_active":"2024-09-12T17:59:54.193547+0000","last_peered":"2024-09-12T17:59:54.193547+0000","last_clean":"2024-09-12T17:59:54.193547+0000","last_became_active":"2024-09-12T17:23:40.708089+0000","last_became_peered":"2024-09-12T17:23:40.708089+0000","last_unstale":"2024-09-12T17:59:54.193547+0000","last_undegraded":"2024-09-12T17:59:54.193547+0000","last_fullsized":"2024-09-12T17:59:54.193547+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:09.021258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6686981,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":589,"num_read_kb":14171,"num_write":1118,"num_write_kb":46213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"261'906","reported_seq":2491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.398639+0000","last_change":"2024-09-12T17:23:42.146163+0000","last_active":"2024-09-12T18:01:41.398639+0000","last_peered":"2024-09-12T18:01:41.398639+0000","last_clean":"2024-09-12T18:01:41.398639+0000","last_became_active":"2024-09-12T17:23:42.145860+0000","last_became_peered":"2024-09-12T17:23:42.145860+0000","last_unstale":"2024-09-12T18:01:41.398639+0000","last_undegraded":"2024-09-12T18:01:41.398639+0000","last_fullsized":"2024-09-12T18:01:41.398639+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":800,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:47.060225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4352,"num_read_kb":3896,"num_write":1238,"num_write_kb":509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"261'296","reported_seq":1029,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.195573+0000","last_change":"2024-09-12T17:24:17.233383+0000","last_active":"2024-09-12T18:00:03.195573+0000","last_peered":"2024-09-12T18:00:03.195573+0000","last_clean":"2024-09-12T18:00:03.195573+0000","last_became_active":"2024-09-12T17:24:17.232979+0000","last_became_peered":"2024-09-12T17:24:17.232979+0000","last_unstale":"2024-09-12T18:00:03.195573+0000","last_undegraded":"2024-09-12T18:00:03.195573+0000","last_fullsized":"2024-09-12T18:00:03.195573+0000","mapping_epoch":36,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.921503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439574,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":763,"num_read_kb":6334,"num_write":1212,"num_write_kb":23763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"261'427","reported_seq":1989,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.767282+0000","last_change":"2024-09-12T17:23:42.148296+0000","last_active":"2024-09-12T18:00:15.767282+0000","last_peered":"2024-09-12T18:00:15.767282+0000","last_clean":"2024-09-12T18:00:15.767282+0000","last_became_active":"2024-09-12T17:23:42.148023+0000","last_became_peered":"2024-09-12T17:23:42.148023+0000","last_unstale":"2024-09-12T18:00:15.767282+0000","last_undegraded":"2024-09-12T18:00:15.767282+0000","last_fullsized":"2024-09-12T18:00:15.767282+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:08.262875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2276,"num_read_kb":2173,"num_write":473,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"261'281","reported_seq":896,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.805284+0000","last_change":"2024-09-12T17:23:40.714934+0000","last_active":"2024-09-12T18:00:03.805284+0000","last_peered":"2024-09-12T18:00:03.805284+0000","last_clean":"2024-09-12T18:00:03.805284+0000","last_became_active":"2024-09-12T17:23:40.714604+0000","last_became_peered":"2024-09-12T17:23:40.714604+0000","last_unstale":"2024-09-12T18:00:03.805284+0000","last_undegraded":"2024-09-12T18:00:03.805284+0000","last_fullsized":"2024-09-12T18:00:03.805284+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:27.138414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4690785,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":419,"num_read_kb":7311,"num_write":1058,"num_write_kb":22062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"261'420","reported_seq":1932,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.398203+0000","last_change":"2024-09-12T17:23:42.141588+0000","last_active":"2024-09-12T18:01:41.398203+0000","last_peered":"2024-09-12T18:01:41.398203+0000","last_clean":"2024-09-12T18:01:41.398203+0000","last_became_active":"2024-09-12T17:23:42.141237+0000","last_became_peered":"2024-09-12T17:23:42.141237+0000","last_unstale":"2024-09-12T18:01:41.398203+0000","last_undegraded":"2024-09-12T18:01:41.398203+0000","last_fullsized":"2024-09-12T18:01:41.398203+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:12.130382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2248,"num_read_kb":2133,"num_write":484,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"261'265","reported_seq":881,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.145275+0000","last_change":"2024-09-12T17:23:40.705121+0000","last_active":"2024-09-12T18:00:02.145275+0000","last_peered":"2024-09-12T18:00:02.145275+0000","last_clean":"2024-09-12T18:00:02.145275+0000","last_became_active":"2024-09-12T17:23:40.704825+0000","last_became_peered":"2024-09-12T17:23:40.704825+0000","last_unstale":"2024-09-12T18:00:02.145275+0000","last_undegraded":"2024-09-12T18:00:02.145275+0000","last_fullsized":"2024-09-12T18:00:02.145275+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:59.186994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278848,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":394,"num_read_kb":2074,"num_write":982,"num_write_kb":16303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"261'380","reported_seq":1869,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.496044+0000","last_change":"2024-09-12T17:23:42.137722+0000","last_active":"2024-09-12T18:00:05.496044+0000","last_peered":"2024-09-12T18:00:05.496044+0000","last_clean":"2024-09-12T18:00:05.496044+0000","last_became_active":"2024-09-12T17:23:42.137455+0000","last_became_peered":"2024-09-12T17:23:42.137455+0000","last_unstale":"2024-09-12T18:00:05.496044+0000","last_undegraded":"2024-09-12T18:00:05.496044+0000","last_fullsized":"2024-09-12T18:00:05.496044+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:28.273631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2042,"num_read_kb":1965,"num_write":435,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"261'298","reported_seq":941,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.506250+0000","last_change":"2024-09-12T17:23:40.712347+0000","last_active":"2024-09-12T18:01:49.506250+0000","last_peered":"2024-09-12T18:01:49.506250+0000","last_clean":"2024-09-12T18:01:49.506250+0000","last_became_active":"2024-09-12T17:23:40.711201+0000","last_became_peered":"2024-09-12T17:23:40.711201+0000","last_unstale":"2024-09-12T18:01:49.506250+0000","last_undegraded":"2024-09-12T18:01:49.506250+0000","last_fullsized":"2024-09-12T18:01:49.506250+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:09.766467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7876019,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":489,"num_read_kb":25516,"num_write":1139,"num_write_kb":38939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"261'151","reported_seq":661,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.612262+0000","last_change":"2024-09-12T17:23:50.184556+0000","last_active":"2024-09-12T18:00:18.612262+0000","last_peered":"2024-09-12T18:00:18.612262+0000","last_clean":"2024-09-12T18:00:18.612262+0000","last_became_active":"2024-09-12T17:23:50.184149+0000","last_became_peered":"2024-09-12T17:23:50.184149+0000","last_unstale":"2024-09-12T18:00:18.612262+0000","last_undegraded":"2024-09-12T18:00:18.612262+0000","last_fullsized":"2024-09-12T18:00:18.612262+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:56.623668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":269,"num_read_kb":251,"num_write":373,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"261'429","reported_seq":2033,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.775304+0000","last_change":"2024-09-12T17:23:42.154156+0000","last_active":"2024-09-12T18:00:15.775304+0000","last_peered":"2024-09-12T18:00:15.775304+0000","last_clean":"2024-09-12T18:00:15.775304+0000","last_became_active":"2024-09-12T17:23:42.153262+0000","last_became_peered":"2024-09-12T17:23:42.153262+0000","last_unstale":"2024-09-12T18:00:15.775304+0000","last_undegraded":"2024-09-12T18:00:15.775304+0000","last_fullsized":"2024-09-12T18:00:15.775304+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:04.351858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2462,"num_read_kb":2350,"num_write":478,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"261'271","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:26.861166+0000","last_change":"2024-09-12T17:23:40.709825+0000","last_active":"2024-09-12T17:59:26.861166+0000","last_peered":"2024-09-12T17:59:26.861166+0000","last_clean":"2024-09-12T17:59:26.861166+0000","last_became_active":"2024-09-12T17:23:40.709513+0000","last_became_peered":"2024-09-12T17:23:40.709513+0000","last_unstale":"2024-09-12T17:59:26.861166+0000","last_undegraded":"2024-09-12T17:59:26.861166+0000","last_fullsized":"2024-09-12T17:59:26.861166+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:06.392512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9700143,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":416,"num_read_kb":53800,"num_write":1027,"num_write_kb":42009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404158+0000","last_change":"2024-09-12T17:23:44.151154+0000","last_active":"2024-09-12T17:57:34.404158+0000","last_peered":"2024-09-12T17:57:34.404158+0000","last_clean":"2024-09-12T17:57:34.404158+0000","last_became_active":"2024-09-12T17:23:44.150860+0000","last_became_peered":"2024-09-12T17:23:44.150860+0000","last_unstale":"2024-09-12T17:57:34.404158+0000","last_undegraded":"2024-09-12T17:57:34.404158+0000","last_fullsized":"2024-09-12T17:57:34.404158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:48.984288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"261'333","reported_seq":913,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.421054+0000","last_change":"2024-09-12T17:23:46.153152+0000","last_active":"2024-09-12T18:01:42.421054+0000","last_peered":"2024-09-12T18:01:42.421054+0000","last_clean":"2024-09-12T18:01:42.421054+0000","last_became_active":"2024-09-12T17:23:46.152874+0000","last_became_peered":"2024-09-12T17:23:46.152874+0000","last_unstale":"2024-09-12T18:01:42.421054+0000","last_undegraded":"2024-09-12T18:01:42.421054+0000","last_fullsized":"2024-09-12T18:01:42.421054+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:57.758740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64524,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":540,"num_read_kb":1061,"num_write":440,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.405726+0000","last_change":"2024-09-12T17:23:48.168394+0000","last_active":"2024-09-12T17:57:39.405726+0000","last_peered":"2024-09-12T17:57:39.405726+0000","last_clean":"2024-09-12T17:57:39.405726+0000","last_became_active":"2024-09-12T17:23:48.168052+0000","last_became_peered":"2024-09-12T17:23:48.168052+0000","last_unstale":"2024-09-12T17:57:39.405726+0000","last_undegraded":"2024-09-12T17:57:39.405726+0000","last_fullsized":"2024-09-12T17:57:39.405726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:50.986726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"261'173","reported_seq":728,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.773668+0000","last_change":"2024-09-12T17:23:50.188838+0000","last_active":"2024-09-12T18:00:15.773668+0000","last_peered":"2024-09-12T18:00:15.773668+0000","last_clean":"2024-09-12T18:00:15.773668+0000","last_became_active":"2024-09-12T17:23:50.188506+0000","last_became_peered":"2024-09-12T17:23:50.188506+0000","last_unstale":"2024-09-12T18:00:15.773668+0000","last_undegraded":"2024-09-12T18:00:15.773668+0000","last_fullsized":"2024-09-12T18:00:15.773668+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:28.074396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":316,"num_read_kb":300,"num_write":383,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"261'579","reported_seq":2125,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.140832+0000","last_change":"2024-09-12T17:23:42.144567+0000","last_active":"2024-09-12T18:00:18.140832+0000","last_peered":"2024-09-12T18:00:18.140832+0000","last_clean":"2024-09-12T18:00:18.140832+0000","last_became_active":"2024-09-12T17:23:42.143794+0000","last_became_peered":"2024-09-12T17:23:42.143794+0000","last_unstale":"2024-09-12T18:00:18.140832+0000","last_undegraded":"2024-09-12T18:00:18.140832+0000","last_fullsized":"2024-09-12T18:00:18.140832+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:01.173511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3146,"num_read_kb":2882,"num_write":787,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"261'331","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.826279+0000","last_change":"2024-09-12T17:24:17.288249+0000","last_active":"2024-09-12T18:00:03.826279+0000","last_peered":"2024-09-12T18:00:03.826279+0000","last_clean":"2024-09-12T18:00:03.826279+0000","last_became_active":"2024-09-12T17:24:17.287987+0000","last_became_peered":"2024-09-12T17:24:17.287987+0000","last_unstale":"2024-09-12T18:00:03.826279+0000","last_undegraded":"2024-09-12T18:00:03.826279+0000","last_fullsized":"2024-09-12T18:00:03.826279+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:59.986635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15906645,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":535,"num_read_kb":42370,"num_write":1109,"num_write_kb":32675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.413518+0000","last_change":"2024-09-12T17:23:44.149386+0000","last_active":"2024-09-12T17:58:48.413518+0000","last_peered":"2024-09-12T17:58:48.413518+0000","last_clean":"2024-09-12T17:58:48.413518+0000","last_became_active":"2024-09-12T17:23:44.149079+0000","last_became_peered":"2024-09-12T17:23:44.149079+0000","last_unstale":"2024-09-12T17:58:48.413518+0000","last_undegraded":"2024-09-12T17:58:48.413518+0000","last_fullsized":"2024-09-12T17:58:48.413518+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:52.404478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"261'78","reported_seq":591,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:23.586728+0000","last_change":"2024-09-12T17:23:46.150777+0000","last_active":"2024-09-12T17:59:23.586728+0000","last_peered":"2024-09-12T17:59:23.586728+0000","last_clean":"2024-09-12T17:59:23.586728+0000","last_became_active":"2024-09-12T17:23:46.150447+0000","last_became_peered":"2024-09-12T17:23:46.150447+0000","last_unstale":"2024-09-12T17:59:23.586728+0000","last_undegraded":"2024-09-12T17:59:23.586728+0000","last_fullsized":"2024-09-12T17:59:23.586728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:18.226708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":77,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.405649+0000","last_change":"2024-09-12T17:23:48.166388+0000","last_active":"2024-09-12T17:57:39.405649+0000","last_peered":"2024-09-12T17:57:39.405649+0000","last_clean":"2024-09-12T17:57:39.405649+0000","last_became_active":"2024-09-12T17:23:48.165965+0000","last_became_peered":"2024-09-12T17:23:48.165965+0000","last_unstale":"2024-09-12T17:57:39.405649+0000","last_undegraded":"2024-09-12T17:57:39.405649+0000","last_fullsized":"2024-09-12T17:57:39.405649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:48.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"261'113","reported_seq":609,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.639640+0000","last_change":"2024-09-12T17:23:50.188380+0000","last_active":"2024-09-12T17:59:48.639640+0000","last_peered":"2024-09-12T17:59:48.639640+0000","last_clean":"2024-09-12T17:59:48.639640+0000","last_became_active":"2024-09-12T17:23:50.188143+0000","last_became_peered":"2024-09-12T17:23:50.188143+0000","last_unstale":"2024-09-12T17:59:48.639640+0000","last_undegraded":"2024-09-12T17:59:48.639640+0000","last_fullsized":"2024-09-12T17:59:48.639640+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:55.598494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":180,"num_write":267,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"261'430","reported_seq":2047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.138465+0000","last_change":"2024-09-12T17:23:42.155423+0000","last_active":"2024-09-12T18:00:18.138465+0000","last_peered":"2024-09-12T18:00:18.138465+0000","last_clean":"2024-09-12T18:00:18.138465+0000","last_became_active":"2024-09-12T17:23:42.155137+0000","last_became_peered":"2024-09-12T17:23:42.155137+0000","last_unstale":"2024-09-12T18:00:18.138465+0000","last_undegraded":"2024-09-12T18:00:18.138465+0000","last_fullsized":"2024-09-12T18:00:18.138465+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:12.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2401,"num_read_kb":2311,"num_write":475,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"261'417","reported_seq":1066,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.412806+0000","last_change":"2024-09-12T17:23:40.707827+0000","last_active":"2024-09-12T18:01:40.412806+0000","last_peered":"2024-09-12T18:01:40.412806+0000","last_clean":"2024-09-12T18:01:40.412806+0000","last_became_active":"2024-09-12T17:23:40.707549+0000","last_became_peered":"2024-09-12T17:23:40.707549+0000","last_unstale":"2024-09-12T18:01:40.412806+0000","last_undegraded":"2024-09-12T18:01:40.412806+0000","last_fullsized":"2024-09-12T18:01:40.412806+0000","mapping_epoch":23,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:48.898807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457570,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":750,"num_read_kb":5813,"num_write":1310,"num_write_kb":24859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.401656+0000","last_change":"2024-09-12T17:23:44.151294+0000","last_active":"2024-09-12T17:57:33.401656+0000","last_peered":"2024-09-12T17:57:33.401656+0000","last_clean":"2024-09-12T17:57:33.401656+0000","last_became_active":"2024-09-12T17:23:44.150973+0000","last_became_peered":"2024-09-12T17:23:44.150973+0000","last_unstale":"2024-09-12T17:57:33.401656+0000","last_undegraded":"2024-09-12T17:57:33.401656+0000","last_fullsized":"2024-09-12T17:57:33.401656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:15.283072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"261'95","reported_seq":615,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:49.842571+0000","last_change":"2024-09-12T17:23:46.154192+0000","last_active":"2024-09-12T17:59:49.842571+0000","last_peered":"2024-09-12T17:59:49.842571+0000","last_clean":"2024-09-12T17:59:49.842571+0000","last_became_active":"2024-09-12T17:23:46.153864+0000","last_became_peered":"2024-09-12T17:23:46.153864+0000","last_unstale":"2024-09-12T17:59:49.842571+0000","last_undegraded":"2024-09-12T17:59:49.842571+0000","last_fullsized":"2024-09-12T17:59:49.842571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:52.292455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"261'762","reported_seq":2153,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.414646+0000","last_change":"2024-09-12T17:23:48.173728+0000","last_active":"2024-09-12T18:01:49.414646+0000","last_peered":"2024-09-12T18:01:49.414646+0000","last_clean":"2024-09-12T18:01:49.414646+0000","last_became_active":"2024-09-12T17:23:48.173454+0000","last_became_peered":"2024-09-12T17:23:48.173454+0000","last_unstale":"2024-09-12T18:01:49.414646+0000","last_undegraded":"2024-09-12T18:01:49.414646+0000","last_fullsized":"2024-09-12T18:01:49.414646+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:51.582534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"261'214","reported_seq":1037,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.663235+0000","last_change":"2024-09-12T17:23:50.640673+0000","last_active":"2024-09-12T18:00:18.663235+0000","last_peered":"2024-09-12T18:00:18.663235+0000","last_clean":"2024-09-12T18:00:18.663235+0000","last_became_active":"2024-09-12T17:23:50.640401+0000","last_became_peered":"2024-09-12T17:23:50.640401+0000","last_unstale":"2024-09-12T18:00:18.663235+0000","last_undegraded":"2024-09-12T18:00:18.663235+0000","last_fullsized":"2024-09-12T18:00:18.663235+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:04.518137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":682,"num_read_kb":671,"num_write":489,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"261'898","reported_seq":2439,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.892342+0000","last_change":"2024-09-12T17:23:42.148014+0000","last_active":"2024-09-12T18:00:04.892342+0000","last_peered":"2024-09-12T18:00:04.892342+0000","last_clean":"2024-09-12T18:00:04.892342+0000","last_became_active":"2024-09-12T17:23:42.147597+0000","last_became_peered":"2024-09-12T17:23:42.147597+0000","last_unstale":"2024-09-12T18:00:04.892342+0000","last_undegraded":"2024-09-12T18:00:04.892342+0000","last_fullsized":"2024-09-12T18:00:04.892342+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":800,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:17.140238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4183,"num_read_kb":3727,"num_write":1220,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"261'300","reported_seq":977,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.757256+0000","last_change":"2024-09-12T17:23:40.718814+0000","last_active":"2024-09-12T17:59:59.757256+0000","last_peered":"2024-09-12T17:59:59.757256+0000","last_clean":"2024-09-12T17:59:59.757256+0000","last_became_active":"2024-09-12T17:23:40.718582+0000","last_became_peered":"2024-09-12T17:23:40.718582+0000","last_unstale":"2024-09-12T17:59:59.757256+0000","last_undegraded":"2024-09-12T17:59:59.757256+0000","last_fullsized":"2024-09-12T17:59:59.757256+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:35.754217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15438220,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":525,"num_read_kb":83242,"num_write":1040,"num_write_kb":35659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404212+0000","last_change":"2024-09-12T17:23:44.152542+0000","last_active":"2024-09-12T17:57:34.404212+0000","last_peered":"2024-09-12T17:57:34.404212+0000","last_clean":"2024-09-12T17:57:34.404212+0000","last_became_active":"2024-09-12T17:23:44.151918+0000","last_became_peered":"2024-09-12T17:23:44.151918+0000","last_unstale":"2024-09-12T17:57:34.404212+0000","last_undegraded":"2024-09-12T17:57:34.404212+0000","last_fullsized":"2024-09-12T17:57:34.404212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:18.221084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"261'262","reported_seq":808,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.414542+0000","last_change":"2024-09-12T17:23:46.241449+0000","last_active":"2024-09-12T18:01:42.414542+0000","last_peered":"2024-09-12T18:01:42.414542+0000","last_clean":"2024-09-12T18:01:42.414542+0000","last_became_active":"2024-09-12T17:23:46.241137+0000","last_became_peered":"2024-09-12T17:23:46.241137+0000","last_unstale":"2024-09-12T18:01:42.414542+0000","last_undegraded":"2024-09-12T18:01:42.414542+0000","last_fullsized":"2024-09-12T18:01:42.414542+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:58.197635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60790,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":971,"num_write":374,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"261'803","reported_seq":6198,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.456541+0000","last_change":"2024-09-12T17:23:48.167347+0000","last_active":"2024-09-12T18:01:42.456541+0000","last_peered":"2024-09-12T18:01:42.456541+0000","last_clean":"2024-09-12T18:01:42.456541+0000","last_became_active":"2024-09-12T17:23:48.167038+0000","last_became_peered":"2024-09-12T17:23:48.167038+0000","last_unstale":"2024-09-12T18:01:42.456541+0000","last_undegraded":"2024-09-12T18:01:42.456541+0000","last_fullsized":"2024-09-12T18:01:42.456541+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:22.744543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"261'663","reported_seq":2260,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559804+0000","last_change":"2024-09-12T17:23:42.144234+0000","last_active":"2024-09-12T18:00:18.559804+0000","last_peered":"2024-09-12T18:00:18.559804+0000","last_clean":"2024-09-12T18:00:18.559804+0000","last_became_active":"2024-09-12T17:23:42.143778+0000","last_became_peered":"2024-09-12T17:23:42.143778+0000","last_unstale":"2024-09-12T18:00:18.559804+0000","last_undegraded":"2024-09-12T18:00:18.559804+0000","last_fullsized":"2024-09-12T18:00:18.559804+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":600,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:03.567237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3245,"num_read_kb":3064,"num_write":918,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"261'277","reported_seq":878,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.615692+0000","last_change":"2024-09-12T17:23:40.709847+0000","last_active":"2024-09-12T18:00:16.615692+0000","last_peered":"2024-09-12T18:00:16.615692+0000","last_clean":"2024-09-12T18:00:16.615692+0000","last_became_active":"2024-09-12T17:23:40.709587+0000","last_became_peered":"2024-09-12T17:23:40.709587+0000","last_unstale":"2024-09-12T18:00:16.615692+0000","last_undegraded":"2024-09-12T18:00:16.615692+0000","last_fullsized":"2024-09-12T18:00:16.615692+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:52.138227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13193104,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":339,"num_read_kb":61352,"num_write":949,"num_write_kb":60278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.412039+0000","last_change":"2024-09-12T17:23:44.151275+0000","last_active":"2024-09-12T17:58:24.412039+0000","last_peered":"2024-09-12T17:58:24.412039+0000","last_clean":"2024-09-12T17:58:24.412039+0000","last_became_active":"2024-09-12T17:23:44.150957+0000","last_became_peered":"2024-09-12T17:23:44.150957+0000","last_unstale":"2024-09-12T17:58:24.412039+0000","last_undegraded":"2024-09-12T17:58:24.412039+0000","last_fullsized":"2024-09-12T17:58:24.412039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:06.423907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"261'340","reported_seq":927,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:44.431059+0000","last_change":"2024-09-12T17:23:46.241749+0000","last_active":"2024-09-12T18:00:44.431059+0000","last_peered":"2024-09-12T18:00:44.431059+0000","last_clean":"2024-09-12T18:00:44.431059+0000","last_became_active":"2024-09-12T17:23:46.241442+0000","last_became_peered":"2024-09-12T17:23:46.241442+0000","last_unstale":"2024-09-12T18:00:44.431059+0000","last_undegraded":"2024-09-12T18:00:44.431059+0000","last_fullsized":"2024-09-12T18:00:44.431059+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:17.283661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61524,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":549,"num_read_kb":1059,"num_write":442,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.403282+0000","last_change":"2024-09-12T17:23:48.168185+0000","last_active":"2024-09-12T17:57:34.403282+0000","last_peered":"2024-09-12T17:57:34.403282+0000","last_clean":"2024-09-12T17:57:34.403282+0000","last_became_active":"2024-09-12T17:23:48.167925+0000","last_became_peered":"2024-09-12T17:23:48.167925+0000","last_unstale":"2024-09-12T17:57:34.403282+0000","last_undegraded":"2024-09-12T17:57:34.403282+0000","last_fullsized":"2024-09-12T17:57:34.403282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:09.629250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"261'574","reported_seq":1382,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.439771+0000","last_change":"2024-09-12T17:23:50.188392+0000","last_active":"2024-09-12T18:01:42.439771+0000","last_peered":"2024-09-12T18:01:42.439771+0000","last_clean":"2024-09-12T18:01:42.439771+0000","last_became_active":"2024-09-12T17:23:50.188109+0000","last_became_peered":"2024-09-12T17:23:50.188109+0000","last_unstale":"2024-09-12T18:01:42.439771+0000","last_undegraded":"2024-09-12T18:01:42.439771+0000","last_fullsized":"2024-09-12T18:01:42.439771+0000","mapping_epoch":33,"log_start":"261'500","ondisk_log_start":"261'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:18.895859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1373,"num_read_kb":1362,"num_write":1221,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"261'466","reported_seq":2001,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.785578+0000","last_change":"2024-09-12T17:23:42.136630+0000","last_active":"2024-09-12T18:00:05.785578+0000","last_peered":"2024-09-12T18:00:05.785578+0000","last_clean":"2024-09-12T18:00:05.785578+0000","last_became_active":"2024-09-12T17:23:42.135997+0000","last_became_peered":"2024-09-12T17:23:42.135997+0000","last_unstale":"2024-09-12T18:00:05.785578+0000","last_undegraded":"2024-09-12T18:00:05.785578+0000","last_fullsized":"2024-09-12T18:00:05.785578+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:19.635100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2354,"num_read_kb":2214,"num_write":547,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"261'267","reported_seq":894,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.050389+0000","last_change":"2024-09-12T17:23:40.711857+0000","last_active":"2024-09-12T18:00:04.050389+0000","last_peered":"2024-09-12T18:00:04.050389+0000","last_clean":"2024-09-12T18:00:04.050389+0000","last_became_active":"2024-09-12T17:23:40.711546+0000","last_became_peered":"2024-09-12T17:23:40.711546+0000","last_unstale":"2024-09-12T18:00:04.050389+0000","last_undegraded":"2024-09-12T18:00:04.050389+0000","last_fullsized":"2024-09-12T18:00:04.050389+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:28.645374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2048249,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":392,"num_read_kb":14389,"num_write":933,"num_write_kb":31885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.611541+0000","last_change":"2024-09-12T17:23:44.148761+0000","last_active":"2024-09-12T17:58:23.611541+0000","last_peered":"2024-09-12T17:58:23.611541+0000","last_clean":"2024-09-12T17:58:23.611541+0000","last_became_active":"2024-09-12T17:23:44.148472+0000","last_became_peered":"2024-09-12T17:23:44.148472+0000","last_unstale":"2024-09-12T17:58:23.611541+0000","last_undegraded":"2024-09-12T17:58:23.611541+0000","last_fullsized":"2024-09-12T17:58:23.611541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:28.080187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"261'239","reported_seq":790,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:53.569720+0000","last_change":"2024-09-12T17:23:46.153208+0000","last_active":"2024-09-12T17:59:53.569720+0000","last_peered":"2024-09-12T17:59:53.569720+0000","last_clean":"2024-09-12T17:59:53.569720+0000","last_became_active":"2024-09-12T17:23:46.152441+0000","last_became_peered":"2024-09-12T17:23:46.152441+0000","last_unstale":"2024-09-12T17:59:53.569720+0000","last_undegraded":"2024-09-12T17:59:53.569720+0000","last_fullsized":"2024-09-12T17:59:53.569720+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:17.945639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52528,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":843,"num_write":328,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411068+0000","last_change":"2024-09-12T17:23:48.168110+0000","last_active":"2024-09-12T17:58:33.411068+0000","last_peered":"2024-09-12T17:58:33.411068+0000","last_clean":"2024-09-12T17:58:33.411068+0000","last_became_active":"2024-09-12T17:23:48.167829+0000","last_became_peered":"2024-09-12T17:23:48.167829+0000","last_unstale":"2024-09-12T17:58:33.411068+0000","last_undegraded":"2024-09-12T17:58:33.411068+0000","last_fullsized":"2024-09-12T17:58:33.411068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:24.546875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"261'2375","reported_seq":4213,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.434744+0000","last_change":"2024-09-12T17:23:50.186322+0000","last_active":"2024-09-12T18:01:29.434744+0000","last_peered":"2024-09-12T18:01:29.434744+0000","last_clean":"2024-09-12T18:01:29.434744+0000","last_became_active":"2024-09-12T17:23:50.186026+0000","last_became_peered":"2024-09-12T17:23:50.186026+0000","last_unstale":"2024-09-12T18:01:29.434744+0000","last_undegraded":"2024-09-12T18:01:29.434744+0000","last_fullsized":"2024-09-12T18:01:29.434744+0000","mapping_epoch":33,"log_start":"261'2300","ondisk_log_start":"261'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":2300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:19.020080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6096,"num_read_kb":6075,"num_write":4800,"num_write_kb":1772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"261'457","reported_seq":1986,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559814+0000","last_change":"2024-09-12T17:23:42.147429+0000","last_active":"2024-09-12T18:00:18.559814+0000","last_peered":"2024-09-12T18:00:18.559814+0000","last_clean":"2024-09-12T18:00:18.559814+0000","last_became_active":"2024-09-12T17:23:42.147136+0000","last_became_peered":"2024-09-12T17:23:42.147136+0000","last_unstale":"2024-09-12T18:00:18.559814+0000","last_undegraded":"2024-09-12T18:00:18.559814+0000","last_fullsized":"2024-09-12T18:00:18.559814+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:43.868169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2419,"num_read_kb":2271,"num_write":547,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"261'269","reported_seq":863,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.396032+0000","last_change":"2024-09-12T17:23:40.714029+0000","last_active":"2024-09-12T18:01:36.396032+0000","last_peered":"2024-09-12T18:01:36.396032+0000","last_clean":"2024-09-12T18:01:36.396032+0000","last_became_active":"2024-09-12T17:23:40.713481+0000","last_became_peered":"2024-09-12T17:23:40.713481+0000","last_unstale":"2024-09-12T18:01:36.396032+0000","last_undegraded":"2024-09-12T18:01:36.396032+0000","last_fullsized":"2024-09-12T18:01:36.396032+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:10.827842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11560873,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":370,"num_read_kb":5522,"num_write":996,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.604544+0000","last_change":"2024-09-12T17:23:44.147970+0000","last_active":"2024-09-12T17:57:28.604544+0000","last_peered":"2024-09-12T17:57:28.604544+0000","last_clean":"2024-09-12T17:57:28.604544+0000","last_became_active":"2024-09-12T17:23:44.147677+0000","last_became_peered":"2024-09-12T17:23:44.147677+0000","last_unstale":"2024-09-12T17:57:28.604544+0000","last_undegraded":"2024-09-12T17:57:28.604544+0000","last_fullsized":"2024-09-12T17:57:28.604544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:44.346531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"261'281","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:39.430401+0000","last_change":"2024-09-12T17:23:46.150883+0000","last_active":"2024-09-12T18:00:39.430401+0000","last_peered":"2024-09-12T18:00:39.430401+0000","last_clean":"2024-09-12T18:00:39.430401+0000","last_became_active":"2024-09-12T17:23:46.150555+0000","last_became_peered":"2024-09-12T17:23:46.150555+0000","last_unstale":"2024-09-12T18:00:39.430401+0000","last_undegraded":"2024-09-12T18:00:39.430401+0000","last_fullsized":"2024-09-12T18:00:39.430401+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:53.085351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61510,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":472,"num_read_kb":990,"num_write":388,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"261'800","reported_seq":2468,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.420782+0000","last_change":"2024-09-12T17:23:48.165492+0000","last_active":"2024-09-12T18:01:49.420782+0000","last_peered":"2024-09-12T18:01:49.420782+0000","last_clean":"2024-09-12T18:01:49.420782+0000","last_became_active":"2024-09-12T17:23:48.165179+0000","last_became_peered":"2024-09-12T17:23:48.165179+0000","last_unstale":"2024-09-12T18:01:49.420782+0000","last_undegraded":"2024-09-12T18:01:49.420782+0000","last_fullsized":"2024-09-12T18:01:49.420782+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:26.382390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"261'143","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.345598+0000","last_change":"2024-09-12T17:23:50.188608+0000","last_active":"2024-09-12T18:01:41.345598+0000","last_peered":"2024-09-12T18:01:41.345598+0000","last_clean":"2024-09-12T18:01:41.345598+0000","last_became_active":"2024-09-12T17:23:50.188230+0000","last_became_peered":"2024-09-12T17:23:50.188230+0000","last_unstale":"2024-09-12T18:01:41.345598+0000","last_undegraded":"2024-09-12T18:01:41.345598+0000","last_fullsized":"2024-09-12T18:01:41.345598+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:43.821173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":185,"num_write":335,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"261'473","reported_seq":2022,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.409628+0000","last_change":"2024-09-12T17:23:42.154193+0000","last_active":"2024-09-12T18:01:41.409628+0000","last_peered":"2024-09-12T18:01:41.409628+0000","last_clean":"2024-09-12T18:01:41.409628+0000","last_became_active":"2024-09-12T17:23:42.153910+0000","last_became_peered":"2024-09-12T17:23:42.153910+0000","last_unstale":"2024-09-12T18:01:41.409628+0000","last_undegraded":"2024-09-12T18:01:41.409628+0000","last_fullsized":"2024-09-12T18:01:41.409628+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:19.410163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2575,"num_read_kb":2405,"num_write":575,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"261'326","reported_seq":1041,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:52.399872+0000","last_change":"2024-09-12T17:23:40.714040+0000","last_active":"2024-09-12T17:59:52.399872+0000","last_peered":"2024-09-12T17:59:52.399872+0000","last_clean":"2024-09-12T17:59:52.399872+0000","last_became_active":"2024-09-12T17:23:40.712691+0000","last_became_peered":"2024-09-12T17:23:40.712691+0000","last_unstale":"2024-09-12T17:59:52.399872+0000","last_undegraded":"2024-09-12T17:59:52.399872+0000","last_fullsized":"2024-09-12T17:59:52.399872+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:23.050646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23718850,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":623,"num_read_kb":118590,"num_write":1212,"num_write_kb":72411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.611578+0000","last_change":"2024-09-12T17:23:44.143860+0000","last_active":"2024-09-12T17:58:23.611578+0000","last_peered":"2024-09-12T17:58:23.611578+0000","last_clean":"2024-09-12T17:58:23.611578+0000","last_became_active":"2024-09-12T17:23:44.142306+0000","last_became_peered":"2024-09-12T17:23:44.142306+0000","last_unstale":"2024-09-12T17:58:23.611578+0000","last_undegraded":"2024-09-12T17:58:23.611578+0000","last_fullsized":"2024-09-12T17:58:23.611578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:59.833432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"261'448","reported_seq":1052,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.431359+0000","last_change":"2024-09-12T17:23:46.154013+0000","last_active":"2024-09-12T18:01:49.431359+0000","last_peered":"2024-09-12T18:01:49.431359+0000","last_clean":"2024-09-12T18:01:49.431359+0000","last_became_active":"2024-09-12T17:23:46.153719+0000","last_became_peered":"2024-09-12T17:23:46.153719+0000","last_unstale":"2024-09-12T18:01:49.431359+0000","last_undegraded":"2024-09-12T18:01:49.431359+0000","last_fullsized":"2024-09-12T18:01:49.431359+0000","mapping_epoch":29,"log_start":"261'400","ondisk_log_start":"261'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:26.689565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109660,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":784,"num_read_kb":1735,"num_write":652,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612208+0000","last_change":"2024-09-12T17:23:48.170645+0000","last_active":"2024-09-12T17:58:28.612208+0000","last_peered":"2024-09-12T17:58:28.612208+0000","last_clean":"2024-09-12T17:58:28.612208+0000","last_became_active":"2024-09-12T17:23:48.170317+0000","last_became_peered":"2024-09-12T17:23:48.170317+0000","last_unstale":"2024-09-12T17:58:28.612208+0000","last_undegraded":"2024-09-12T17:58:28.612208+0000","last_fullsized":"2024-09-12T17:58:28.612208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:12.486235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"261'153","reported_seq":658,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:22.115592+0000","last_change":"2024-09-12T17:23:50.184354+0000","last_active":"2024-09-12T17:59:22.115592+0000","last_peered":"2024-09-12T17:59:22.115592+0000","last_clean":"2024-09-12T17:59:22.115592+0000","last_became_active":"2024-09-12T17:23:50.184033+0000","last_became_peered":"2024-09-12T17:23:50.184033+0000","last_unstale":"2024-09-12T17:59:22.115592+0000","last_undegraded":"2024-09-12T17:59:22.115592+0000","last_fullsized":"2024-09-12T17:59:22.115592+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:27.722195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":204,"num_write":351,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"261'833","reported_seq":2440,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.139345+0000","last_change":"2024-09-12T17:23:42.145012+0000","last_active":"2024-09-12T18:00:18.139345+0000","last_peered":"2024-09-12T18:00:18.139345+0000","last_clean":"2024-09-12T18:00:18.139345+0000","last_became_active":"2024-09-12T17:23:42.144703+0000","last_became_peered":"2024-09-12T17:23:42.144703+0000","last_unstale":"2024-09-12T18:00:18.139345+0000","last_undegraded":"2024-09-12T18:00:18.139345+0000","last_fullsized":"2024-09-12T18:00:18.139345+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:39.045177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3952,"num_read_kb":3587,"num_write":1103,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"261'330","reported_seq":987,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.456943+0000","last_change":"2024-09-12T17:23:40.706524+0000","last_active":"2024-09-12T17:59:59.456943+0000","last_peered":"2024-09-12T17:59:59.456943+0000","last_clean":"2024-09-12T17:59:59.456943+0000","last_became_active":"2024-09-12T17:23:40.706213+0000","last_became_peered":"2024-09-12T17:23:40.706213+0000","last_unstale":"2024-09-12T17:59:59.456943+0000","last_undegraded":"2024-09-12T17:59:59.456943+0000","last_fullsized":"2024-09-12T17:59:59.456943+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:54.778098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2417800,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":557,"num_read_kb":8190,"num_write":1349,"num_write_kb":25988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.604568+0000","last_change":"2024-09-12T17:23:44.149835+0000","last_active":"2024-09-12T17:57:28.604568+0000","last_peered":"2024-09-12T17:57:28.604568+0000","last_clean":"2024-09-12T17:57:28.604568+0000","last_became_active":"2024-09-12T17:23:44.149550+0000","last_became_peered":"2024-09-12T17:23:44.149550+0000","last_unstale":"2024-09-12T17:57:28.604568+0000","last_undegraded":"2024-09-12T17:57:28.604568+0000","last_fullsized":"2024-09-12T17:57:28.604568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:43.008237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"261'273","reported_seq":831,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.406132+0000","last_change":"2024-09-12T17:23:46.153560+0000","last_active":"2024-09-12T18:01:42.406132+0000","last_peered":"2024-09-12T18:01:42.406132+0000","last_clean":"2024-09-12T18:01:42.406132+0000","last_became_active":"2024-09-12T17:23:46.153210+0000","last_became_peered":"2024-09-12T17:23:46.153210+0000","last_unstale":"2024-09-12T18:01:42.406132+0000","last_undegraded":"2024-09-12T18:01:42.406132+0000","last_fullsized":"2024-09-12T18:01:42.406132+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:53.528030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55204,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":931,"num_write":420,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.531914+0000","last_change":"2024-09-12T17:23:48.168999+0000","last_active":"2024-09-12T17:57:39.531914+0000","last_peered":"2024-09-12T17:57:39.531914+0000","last_clean":"2024-09-12T17:57:39.531914+0000","last_became_active":"2024-09-12T17:23:48.168675+0000","last_became_peered":"2024-09-12T17:23:48.168675+0000","last_unstale":"2024-09-12T17:57:39.531914+0000","last_undegraded":"2024-09-12T17:57:39.531914+0000","last_fullsized":"2024-09-12T17:57:39.531914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:15.332536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"261'97","reported_seq":577,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.616169+0000","last_change":"2024-09-12T17:23:50.186614+0000","last_active":"2024-09-12T18:00:18.616169+0000","last_peered":"2024-09-12T18:00:18.616169+0000","last_clean":"2024-09-12T18:00:18.616169+0000","last_became_active":"2024-09-12T17:23:50.186287+0000","last_became_peered":"2024-09-12T17:23:50.186287+0000","last_unstale":"2024-09-12T18:00:18.616169+0000","last_undegraded":"2024-09-12T18:00:18.616169+0000","last_fullsized":"2024-09-12T18:00:18.616169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:36.361422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":108,"num_read_kb":104,"num_write":228,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"261'640","reported_seq":2241,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.779429+0000","last_change":"2024-09-12T17:23:42.134561+0000","last_active":"2024-09-12T18:00:05.779429+0000","last_peered":"2024-09-12T18:00:05.779429+0000","last_clean":"2024-09-12T18:00:05.779429+0000","last_became_active":"2024-09-12T17:23:42.132858+0000","last_became_peered":"2024-09-12T17:23:42.132858+0000","last_unstale":"2024-09-12T18:00:05.779429+0000","last_undegraded":"2024-09-12T18:00:05.779429+0000","last_fullsized":"2024-09-12T18:00:05.779429+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:47.060225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3409,"num_read_kb":3082,"num_write":929,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"261'340","reported_seq":1013,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.477485+0000","last_change":"2024-09-12T17:23:40.706825+0000","last_active":"2024-09-12T17:59:48.477485+0000","last_peered":"2024-09-12T17:59:48.477485+0000","last_clean":"2024-09-12T17:59:48.477485+0000","last_became_active":"2024-09-12T17:23:40.706531+0000","last_became_peered":"2024-09-12T17:23:40.706531+0000","last_unstale":"2024-09-12T17:59:48.477485+0000","last_undegraded":"2024-09-12T17:59:48.477485+0000","last_fullsized":"2024-09-12T17:59:48.477485+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:47.318982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656147,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":607,"num_read_kb":36587,"num_write":1156,"num_write_kb":30858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"35'5","reported_seq":975,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.979476+0000","last_change":"2024-09-12T17:23:44.147758+0000","last_active":"2024-09-12T18:01:48.979476+0000","last_peered":"2024-09-12T18:01:48.979476+0000","last_clean":"2024-09-12T18:01:48.979476+0000","last_became_active":"2024-09-12T17:23:44.147427+0000","last_became_peered":"2024-09-12T17:23:44.147427+0000","last_unstale":"2024-09-12T18:01:48.979476+0000","last_undegraded":"2024-09-12T18:01:48.979476+0000","last_fullsized":"2024-09-12T18:01:48.979476+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:01.104960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":1201,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"261'294","reported_seq":858,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.883308+0000","last_change":"2024-09-12T17:23:46.153321+0000","last_active":"2024-09-12T17:59:54.883308+0000","last_peered":"2024-09-12T17:59:54.883308+0000","last_clean":"2024-09-12T17:59:54.883308+0000","last_became_active":"2024-09-12T17:23:46.153004+0000","last_became_peered":"2024-09-12T17:23:46.153004+0000","last_unstale":"2024-09-12T17:59:54.883308+0000","last_undegraded":"2024-09-12T17:59:54.883308+0000","last_fullsized":"2024-09-12T17:59:54.883308+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:18.903057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58984,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":484,"num_read_kb":992,"num_write":402,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"261'738","reported_seq":2126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.453623+0000","last_change":"2024-09-12T17:23:48.169354+0000","last_active":"2024-09-12T18:01:42.453623+0000","last_peered":"2024-09-12T18:01:42.453623+0000","last_clean":"2024-09-12T18:01:42.453623+0000","last_became_active":"2024-09-12T17:23:48.169062+0000","last_became_peered":"2024-09-12T17:23:48.169062+0000","last_unstale":"2024-09-12T18:01:42.453623+0000","last_undegraded":"2024-09-12T18:01:42.453623+0000","last_fullsized":"2024-09-12T18:01:42.453623+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:31.045415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"261'140","reported_seq":626,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.160885+0000","last_change":"2024-09-12T17:23:50.184877+0000","last_active":"2024-09-12T18:00:18.160885+0000","last_peered":"2024-09-12T18:00:18.160885+0000","last_clean":"2024-09-12T18:00:18.160885+0000","last_became_active":"2024-09-12T17:23:50.184460+0000","last_became_peered":"2024-09-12T17:23:50.184460+0000","last_unstale":"2024-09-12T18:00:18.160885+0000","last_undegraded":"2024-09-12T18:00:18.160885+0000","last_fullsized":"2024-09-12T18:00:18.160885+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:05.644031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":156,"num_write":329,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"261'797","reported_seq":2252,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.099398+0000","last_change":"2024-09-12T17:23:42.146658+0000","last_active":"2024-09-12T18:00:02.099398+0000","last_peered":"2024-09-12T18:00:02.099398+0000","last_clean":"2024-09-12T18:00:02.099398+0000","last_became_active":"2024-09-12T17:23:42.142896+0000","last_became_peered":"2024-09-12T17:23:42.142896+0000","last_unstale":"2024-09-12T18:00:02.099398+0000","last_undegraded":"2024-09-12T18:00:02.099398+0000","last_fullsized":"2024-09-12T18:00:02.099398+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:06.765117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3737,"num_read_kb":3347,"num_write":1075,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"261'277","reported_seq":940,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:34.428646+0000","last_change":"2024-09-12T17:23:40.708635+0000","last_active":"2024-09-12T18:00:34.428646+0000","last_peered":"2024-09-12T18:00:34.428646+0000","last_clean":"2024-09-12T18:00:34.428646+0000","last_became_active":"2024-09-12T17:23:40.708386+0000","last_became_peered":"2024-09-12T17:23:40.708386+0000","last_unstale":"2024-09-12T18:00:34.428646+0000","last_undegraded":"2024-09-12T18:00:34.428646+0000","last_fullsized":"2024-09-12T18:00:34.428646+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:15.730934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8197355,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":446,"num_read_kb":106949,"num_write":1070,"num_write_kb":37410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1449,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.991695+0000","last_change":"2024-09-12T17:23:44.150061+0000","last_active":"2024-09-12T18:01:48.991695+0000","last_peered":"2024-09-12T18:01:48.991695+0000","last_clean":"2024-09-12T18:01:48.991695+0000","last_became_active":"2024-09-12T17:23:44.149279+0000","last_became_peered":"2024-09-12T17:23:44.149279+0000","last_unstale":"2024-09-12T18:01:48.991695+0000","last_undegraded":"2024-09-12T18:01:48.991695+0000","last_fullsized":"2024-09-12T18:01:48.991695+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:24.241906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"261'63","reported_seq":566,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:21.056971+0000","last_change":"2024-09-12T17:23:46.241422+0000","last_active":"2024-09-12T17:59:21.056971+0000","last_peered":"2024-09-12T17:59:21.056971+0000","last_clean":"2024-09-12T17:59:21.056971+0000","last_became_active":"2024-09-12T17:23:46.240979+0000","last_became_peered":"2024-09-12T17:23:46.240979+0000","last_unstale":"2024-09-12T17:59:21.056971+0000","last_undegraded":"2024-09-12T17:59:21.056971+0000","last_fullsized":"2024-09-12T17:59:21.056971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:39.659261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"261'785","reported_seq":2379,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.417043+0000","last_change":"2024-09-12T17:23:48.172774+0000","last_active":"2024-09-12T18:01:49.417043+0000","last_peered":"2024-09-12T18:01:49.417043+0000","last_clean":"2024-09-12T18:01:49.417043+0000","last_became_active":"2024-09-12T17:23:48.172485+0000","last_became_peered":"2024-09-12T17:23:48.172485+0000","last_unstale":"2024-09-12T18:01:49.417043+0000","last_undegraded":"2024-09-12T18:01:49.417043+0000","last_fullsized":"2024-09-12T18:01:49.417043+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:42.427288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"261'140","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:56.764717+0000","last_change":"2024-09-12T17:23:50.179455+0000","last_active":"2024-09-12T17:59:56.764717+0000","last_peered":"2024-09-12T17:59:56.764717+0000","last_clean":"2024-09-12T17:59:56.764717+0000","last_became_active":"2024-09-12T17:23:50.179153+0000","last_became_peered":"2024-09-12T17:23:50.179153+0000","last_unstale":"2024-09-12T17:59:56.764717+0000","last_undegraded":"2024-09-12T17:59:56.764717+0000","last_fullsized":"2024-09-12T17:59:56.764717+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:04.149720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":149,"num_read_kb":148,"num_write":323,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"261'408","reported_seq":1899,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.498175+0000","last_change":"2024-09-12T17:23:42.152712+0000","last_active":"2024-09-12T18:00:05.498175+0000","last_peered":"2024-09-12T18:00:05.498175+0000","last_clean":"2024-09-12T18:00:05.498175+0000","last_became_active":"2024-09-12T17:23:42.152339+0000","last_became_peered":"2024-09-12T17:23:42.152339+0000","last_unstale":"2024-09-12T18:00:05.498175+0000","last_undegraded":"2024-09-12T18:00:05.498175+0000","last_fullsized":"2024-09-12T18:00:05.498175+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:42.189771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2264,"num_read_kb":2142,"num_write":477,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"261'380","reported_seq":1152,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.831731+0000","last_change":"2024-09-12T17:23:40.714992+0000","last_active":"2024-09-12T18:00:05.831731+0000","last_peered":"2024-09-12T18:00:05.831731+0000","last_clean":"2024-09-12T18:00:05.831731+0000","last_became_active":"2024-09-12T17:23:40.714708+0000","last_became_peered":"2024-09-12T17:23:40.714708+0000","last_unstale":"2024-09-12T18:00:05.831731+0000","last_undegraded":"2024-09-12T18:00:05.831731+0000","last_fullsized":"2024-09-12T18:00:05.831731+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:24.961347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10487247,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":951,"num_read_kb":34670,"num_write":1441,"num_write_kb":45714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.404145+0000","last_change":"2024-09-12T17:23:44.151662+0000","last_active":"2024-09-12T17:57:29.404145+0000","last_peered":"2024-09-12T17:57:29.404145+0000","last_clean":"2024-09-12T17:57:29.404145+0000","last_became_active":"2024-09-12T17:23:44.151392+0000","last_became_peered":"2024-09-12T17:23:44.151392+0000","last_unstale":"2024-09-12T17:57:29.404145+0000","last_undegraded":"2024-09-12T17:57:29.404145+0000","last_fullsized":"2024-09-12T17:57:29.404145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:59.377518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"261'300","reported_seq":882,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:56.779153+0000","last_change":"2024-09-12T17:23:46.145102+0000","last_active":"2024-09-12T17:59:56.779153+0000","last_peered":"2024-09-12T17:59:56.779153+0000","last_clean":"2024-09-12T17:59:56.779153+0000","last_became_active":"2024-09-12T17:23:46.144754+0000","last_became_peered":"2024-09-12T17:23:46.144754+0000","last_unstale":"2024-09-12T17:59:56.779153+0000","last_undegraded":"2024-09-12T17:59:56.779153+0000","last_fullsized":"2024-09-12T17:59:56.779153+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:02.014145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52075,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":487,"num_read_kb":929,"num_write":384,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.402044+0000","last_change":"2024-09-12T17:23:48.170789+0000","last_active":"2024-09-12T17:57:34.402044+0000","last_peered":"2024-09-12T17:57:34.402044+0000","last_clean":"2024-09-12T17:57:34.402044+0000","last_became_active":"2024-09-12T17:23:48.170482+0000","last_became_peered":"2024-09-12T17:23:48.170482+0000","last_unstale":"2024-09-12T17:57:34.402044+0000","last_undegraded":"2024-09-12T17:57:34.402044+0000","last_fullsized":"2024-09-12T17:57:34.402044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:42.252206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"261'140","reported_seq":633,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.433834+0000","last_change":"2024-09-12T17:23:50.187298+0000","last_active":"2024-09-12T18:01:19.433834+0000","last_peered":"2024-09-12T18:01:19.433834+0000","last_clean":"2024-09-12T18:01:19.433834+0000","last_became_active":"2024-09-12T17:23:50.187040+0000","last_became_peered":"2024-09-12T17:23:50.187040+0000","last_unstale":"2024-09-12T18:01:19.433834+0000","last_undegraded":"2024-09-12T18:01:19.433834+0000","last_fullsized":"2024-09-12T18:01:19.433834+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:15.392439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":190,"num_write":335,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"261'1232","reported_seq":2780,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.572788+0000","last_change":"2024-09-12T17:23:42.146501+0000","last_active":"2024-09-12T18:00:04.572788+0000","last_peered":"2024-09-12T18:00:04.572788+0000","last_clean":"2024-09-12T18:00:04.572788+0000","last_became_active":"2024-09-12T17:23:42.146200+0000","last_became_peered":"2024-09-12T17:23:42.146200+0000","last_unstale":"2024-09-12T18:00:04.572788+0000","last_undegraded":"2024-09-12T18:00:04.572788+0000","last_fullsized":"2024-09-12T18:00:04.572788+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":1200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:34.628327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5862,"num_read_kb":5167,"num_write":1742,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":598,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.422110+0000","last_change":"2024-09-12T17:23:26.035893+0000","last_active":"2024-09-12T17:59:39.422110+0000","last_peered":"2024-09-12T17:59:39.422110+0000","last_clean":"2024-09-12T17:59:39.422110+0000","last_became_active":"2024-09-12T17:23:26.034872+0000","last_became_peered":"2024-09-12T17:23:26.034872+0000","last_unstale":"2024-09-12T17:59:39.422110+0000","last_undegraded":"2024-09-12T17:59:39.422110+0000","last_fullsized":"2024-09-12T17:59:39.422110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:24.539348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:24.539348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:24.539348+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:20.611359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":510,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.416227+0000","last_change":"2024-09-12T17:23:33.596450+0000","last_active":"2024-09-12T17:58:59.416227+0000","last_peered":"2024-09-12T17:58:59.416227+0000","last_clean":"2024-09-12T17:58:59.416227+0000","last_became_active":"2024-09-12T17:23:31.584884+0000","last_became_peered":"2024-09-12T17:23:31.584884+0000","last_unstale":"2024-09-12T17:58:59.416227+0000","last_undegraded":"2024-09-12T17:58:59.416227+0000","last_fullsized":"2024-09-12T17:58:59.416227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:30.448834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423087,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"261'250","reported_seq":879,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.339404+0000","last_change":"2024-09-12T17:23:40.719236+0000","last_active":"2024-09-12T18:00:05.339404+0000","last_peered":"2024-09-12T18:00:05.339404+0000","last_clean":"2024-09-12T18:00:05.339404+0000","last_became_active":"2024-09-12T17:23:40.718896+0000","last_became_peered":"2024-09-12T17:23:40.718896+0000","last_unstale":"2024-09-12T18:00:05.339404+0000","last_undegraded":"2024-09-12T18:00:05.339404+0000","last_fullsized":"2024-09-12T18:00:05.339404+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:57.032804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9611018,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":420,"num_read_kb":13107,"num_write":959,"num_write_kb":39939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"35'3","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.980832+0000","last_change":"2024-09-12T17:23:44.152872+0000","last_active":"2024-09-12T18:01:48.980832+0000","last_peered":"2024-09-12T18:01:48.980832+0000","last_clean":"2024-09-12T18:01:48.980832+0000","last_became_active":"2024-09-12T17:23:44.152585+0000","last_became_peered":"2024-09-12T17:23:44.152585+0000","last_unstale":"2024-09-12T18:01:48.980832+0000","last_undegraded":"2024-09-12T18:01:48.980832+0000","last_fullsized":"2024-09-12T18:01:48.980832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:27.878346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"261'702","reported_seq":1377,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.424642+0000","last_change":"2024-09-12T17:23:46.152000+0000","last_active":"2024-09-12T18:01:42.424642+0000","last_peered":"2024-09-12T18:01:42.424642+0000","last_clean":"2024-09-12T18:01:42.424642+0000","last_became_active":"2024-09-12T17:23:46.151673+0000","last_became_peered":"2024-09-12T17:23:46.151673+0000","last_unstale":"2024-09-12T18:01:42.424642+0000","last_undegraded":"2024-09-12T18:01:42.424642+0000","last_fullsized":"2024-09-12T18:01:42.424642+0000","mapping_epoch":29,"log_start":"261'600","ondisk_log_start":"261'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:23.689449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174355,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1389,"num_read_kb":2882,"num_write":1336,"num_write_kb":1200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.539616+0000","last_change":"2024-09-12T17:23:48.170416+0000","last_active":"2024-09-12T17:58:29.539616+0000","last_peered":"2024-09-12T17:58:29.539616+0000","last_clean":"2024-09-12T17:58:29.539616+0000","last_became_active":"2024-09-12T17:23:48.170153+0000","last_became_peered":"2024-09-12T17:23:48.170153+0000","last_unstale":"2024-09-12T17:58:29.539616+0000","last_undegraded":"2024-09-12T17:58:29.539616+0000","last_fullsized":"2024-09-12T17:58:29.539616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:47.543479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"261'224","reported_seq":941,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.565834+0000","last_change":"2024-09-12T17:23:50.188844+0000","last_active":"2024-09-12T18:00:18.565834+0000","last_peered":"2024-09-12T18:00:18.565834+0000","last_clean":"2024-09-12T18:00:18.565834+0000","last_became_active":"2024-09-12T17:23:50.188552+0000","last_became_peered":"2024-09-12T17:23:50.188552+0000","last_unstale":"2024-09-12T18:00:18.565834+0000","last_undegraded":"2024-09-12T18:00:18.565834+0000","last_fullsized":"2024-09-12T18:00:18.565834+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:48.789056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":580,"num_write":503,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"261'388","reported_seq":1826,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.139142+0000","last_change":"2024-09-12T17:23:42.147326+0000","last_active":"2024-09-12T18:00:03.139142+0000","last_peered":"2024-09-12T18:00:03.139142+0000","last_clean":"2024-09-12T18:00:03.139142+0000","last_became_active":"2024-09-12T17:23:42.147045+0000","last_became_peered":"2024-09-12T17:23:42.147045+0000","last_unstale":"2024-09-12T18:00:03.139142+0000","last_undegraded":"2024-09-12T18:00:03.139142+0000","last_fullsized":"2024-09-12T18:00:03.139142+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:25.431740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2080,"num_read_kb":1972,"num_write":429,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":507,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.422739+0000","last_change":"2024-09-12T17:23:33.971250+0000","last_active":"2024-09-12T17:59:44.422739+0000","last_peered":"2024-09-12T17:59:44.422739+0000","last_clean":"2024-09-12T17:59:44.422739+0000","last_became_active":"2024-09-12T17:23:31.588699+0000","last_became_peered":"2024-09-12T17:23:31.588699+0000","last_unstale":"2024-09-12T17:59:44.422739+0000","last_undegraded":"2024-09-12T17:59:44.422739+0000","last_fullsized":"2024-09-12T17:59:44.422739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:46.725886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052181899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"261'288","reported_seq":954,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.528338+0000","last_change":"2024-09-12T17:23:40.713799+0000","last_active":"2024-09-12T18:01:49.528338+0000","last_peered":"2024-09-12T18:01:49.528338+0000","last_clean":"2024-09-12T18:01:49.528338+0000","last_became_active":"2024-09-12T17:23:40.713199+0000","last_became_peered":"2024-09-12T17:23:40.713199+0000","last_unstale":"2024-09-12T18:01:49.528338+0000","last_undegraded":"2024-09-12T18:01:49.528338+0000","last_fullsized":"2024-09-12T18:01:49.528338+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:26.433676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7744105,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":523,"num_read_kb":39284,"num_write":1075,"num_write_kb":55994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.411614+0000","last_change":"2024-09-12T17:23:44.150487+0000","last_active":"2024-09-12T17:58:24.411614+0000","last_peered":"2024-09-12T17:58:24.411614+0000","last_clean":"2024-09-12T17:58:24.411614+0000","last_became_active":"2024-09-12T17:23:44.149400+0000","last_became_peered":"2024-09-12T17:23:44.149400+0000","last_unstale":"2024-09-12T17:58:24.411614+0000","last_undegraded":"2024-09-12T17:58:24.411614+0000","last_fullsized":"2024-09-12T17:58:24.411614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:43.627464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"261'1296","reported_seq":2668,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.423559+0000","last_change":"2024-09-12T17:23:46.145651+0000","last_active":"2024-09-12T18:01:49.423559+0000","last_peered":"2024-09-12T18:01:49.423559+0000","last_clean":"2024-09-12T18:01:49.423559+0000","last_became_active":"2024-09-12T17:23:46.145354+0000","last_became_peered":"2024-09-12T17:23:46.145354+0000","last_unstale":"2024-09-12T18:01:49.423559+0000","last_undegraded":"2024-09-12T18:01:49.423559+0000","last_fullsized":"2024-09-12T18:01:49.423559+0000","mapping_epoch":29,"log_start":"261'1200","ondisk_log_start":"261'1200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:28.485902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178990,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2040,"num_read_kb":3600,"num_write":1154,"num_write_kb":1001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:24.420299+0000","last_change":"2024-09-12T17:23:48.171635+0000","last_active":"2024-09-12T17:59:24.420299+0000","last_peered":"2024-09-12T17:59:24.420299+0000","last_clean":"2024-09-12T17:59:24.420299+0000","last_became_active":"2024-09-12T17:23:48.171355+0000","last_became_peered":"2024-09-12T17:23:48.171355+0000","last_unstale":"2024-09-12T17:59:24.420299+0000","last_undegraded":"2024-09-12T17:59:24.420299+0000","last_fullsized":"2024-09-12T17:59:24.420299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:15.550883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"261'108","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.915226+0000","last_change":"2024-09-12T17:23:50.639398+0000","last_active":"2024-09-12T17:59:59.915226+0000","last_peered":"2024-09-12T17:59:59.915226+0000","last_clean":"2024-09-12T17:59:59.915226+0000","last_became_active":"2024-09-12T17:23:50.639053+0000","last_became_peered":"2024-09-12T17:23:50.639053+0000","last_unstale":"2024-09-12T17:59:59.915226+0000","last_undegraded":"2024-09-12T17:59:59.915226+0000","last_fullsized":"2024-09-12T17:59:59.915226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:38.696802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":162,"num_write":260,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"261'909","reported_seq":2637,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559947+0000","last_change":"2024-09-12T17:23:42.146153+0000","last_active":"2024-09-12T18:00:18.559947+0000","last_peered":"2024-09-12T18:00:18.559947+0000","last_clean":"2024-09-12T18:00:18.559947+0000","last_became_active":"2024-09-12T17:23:42.145049+0000","last_became_peered":"2024-09-12T17:23:42.145049+0000","last_unstale":"2024-09-12T18:00:18.559947+0000","last_undegraded":"2024-09-12T18:00:18.559947+0000","last_fullsized":"2024-09-12T18:00:18.559947+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":800,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:41.855754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4463,"num_read_kb":4014,"num_write":1227,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":511,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:58.616407+0000","last_change":"2024-09-12T17:23:33.835818+0000","last_active":"2024-09-12T17:58:58.616407+0000","last_peered":"2024-09-12T17:58:58.616407+0000","last_clean":"2024-09-12T17:58:58.616407+0000","last_became_active":"2024-09-12T17:23:31.584259+0000","last_became_peered":"2024-09-12T17:23:31.584259+0000","last_unstale":"2024-09-12T17:58:58.616407+0000","last_undegraded":"2024-09-12T17:58:58.616407+0000","last_fullsized":"2024-09-12T17:58:58.616407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:33.916339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045870900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"261'264","reported_seq":886,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.787971+0000","last_change":"2024-09-12T17:23:40.712522+0000","last_active":"2024-09-12T17:59:54.787971+0000","last_peered":"2024-09-12T17:59:54.787971+0000","last_clean":"2024-09-12T17:59:54.787971+0000","last_became_active":"2024-09-12T17:23:40.712276+0000","last_became_peered":"2024-09-12T17:23:40.712276+0000","last_unstale":"2024-09-12T17:59:54.787971+0000","last_undegraded":"2024-09-12T17:59:54.787971+0000","last_fullsized":"2024-09-12T17:59:54.787971+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:20.254346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154629,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":392,"num_read_kb":8922,"num_write":1018,"num_write_kb":17941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.611618+0000","last_change":"2024-09-12T17:23:44.151286+0000","last_active":"2024-09-12T17:58:23.611618+0000","last_peered":"2024-09-12T17:58:23.611618+0000","last_clean":"2024-09-12T17:58:23.611618+0000","last_became_active":"2024-09-12T17:23:44.151006+0000","last_became_peered":"2024-09-12T17:23:44.151006+0000","last_unstale":"2024-09-12T17:58:23.611618+0000","last_undegraded":"2024-09-12T17:58:23.611618+0000","last_fullsized":"2024-09-12T17:58:23.611618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:17.405776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"261'194","reported_seq":1181,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.322144+0000","last_change":"2024-09-12T17:23:46.242242+0000","last_active":"2024-09-12T18:01:38.322144+0000","last_peered":"2024-09-12T18:01:38.322144+0000","last_clean":"2024-09-12T18:01:38.322144+0000","last_became_active":"2024-09-12T17:23:46.241733+0000","last_became_peered":"2024-09-12T17:23:46.241733+0000","last_unstale":"2024-09-12T18:01:38.322144+0000","last_undegraded":"2024-09-12T18:01:38.322144+0000","last_fullsized":"2024-09-12T18:01:38.322144+0000","mapping_epoch":29,"log_start":"258'100","ondisk_log_start":"258'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:35.528461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":152,"num_read_kb":143,"num_write":117,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.545833+0000","last_change":"2024-09-12T17:23:48.168199+0000","last_active":"2024-09-12T17:59:14.545833+0000","last_peered":"2024-09-12T17:59:14.545833+0000","last_clean":"2024-09-12T17:59:14.545833+0000","last_became_active":"2024-09-12T17:23:48.167920+0000","last_became_peered":"2024-09-12T17:23:48.167920+0000","last_unstale":"2024-09-12T17:59:14.545833+0000","last_undegraded":"2024-09-12T17:59:14.545833+0000","last_fullsized":"2024-09-12T17:59:14.545833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:52.699030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"261'262","reported_seq":858,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.252281+0000","last_change":"2024-09-12T17:23:50.177810+0000","last_active":"2024-09-12T18:00:18.252281+0000","last_peered":"2024-09-12T18:00:18.252281+0000","last_clean":"2024-09-12T18:00:18.252281+0000","last_became_active":"2024-09-12T17:23:50.177293+0000","last_became_peered":"2024-09-12T17:23:50.177293+0000","last_unstale":"2024-09-12T18:00:18.252281+0000","last_undegraded":"2024-09-12T18:00:18.252281+0000","last_fullsized":"2024-09-12T18:00:18.252281+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:35.764330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":569,"num_write":571,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"261'440","reported_seq":2030,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.397530+0000","last_change":"2024-09-12T17:23:42.136391+0000","last_active":"2024-09-12T18:01:41.397530+0000","last_peered":"2024-09-12T18:01:41.397530+0000","last_clean":"2024-09-12T18:01:41.397530+0000","last_became_active":"2024-09-12T17:23:42.136083+0000","last_became_peered":"2024-09-12T17:23:42.136083+0000","last_unstale":"2024-09-12T18:01:41.397530+0000","last_undegraded":"2024-09-12T18:01:41.397530+0000","last_fullsized":"2024-09-12T18:01:41.397530+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:29.889920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2433,"num_read_kb":2304,"num_write":511,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":511,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.416186+0000","last_change":"2024-09-12T17:23:33.596992+0000","last_active":"2024-09-12T17:58:59.416186+0000","last_peered":"2024-09-12T17:58:59.416186+0000","last_clean":"2024-09-12T17:58:59.416186+0000","last_became_active":"2024-09-12T17:23:31.588612+0000","last_became_peered":"2024-09-12T17:23:31.588612+0000","last_unstale":"2024-09-12T17:58:59.416186+0000","last_undegraded":"2024-09-12T17:58:59.416186+0000","last_fullsized":"2024-09-12T17:58:59.416186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:20.500808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095838300000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"261'277","reported_seq":993,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.360106+0000","last_change":"2024-09-12T17:23:40.717039+0000","last_active":"2024-09-12T18:00:04.360106+0000","last_peered":"2024-09-12T18:00:04.360106+0000","last_clean":"2024-09-12T18:00:04.360106+0000","last_became_active":"2024-09-12T17:23:40.716786+0000","last_became_peered":"2024-09-12T17:23:40.716786+0000","last_unstale":"2024-09-12T18:00:04.360106+0000","last_undegraded":"2024-09-12T18:00:04.360106+0000","last_fullsized":"2024-09-12T18:00:04.360106+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:37.161545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17125891,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":483,"num_read_kb":40133,"num_write":1009,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.545850+0000","last_change":"2024-09-12T17:23:44.151221+0000","last_active":"2024-09-12T17:59:14.545850+0000","last_peered":"2024-09-12T17:59:14.545850+0000","last_clean":"2024-09-12T17:59:14.545850+0000","last_became_active":"2024-09-12T17:23:44.150912+0000","last_became_peered":"2024-09-12T17:23:44.150912+0000","last_unstale":"2024-09-12T17:59:14.545850+0000","last_undegraded":"2024-09-12T17:59:14.545850+0000","last_fullsized":"2024-09-12T17:59:14.545850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:09.750577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"261'109","reported_seq":634,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:38.427984+0000","last_change":"2024-09-12T17:23:46.155872+0000","last_active":"2024-09-12T18:00:38.427984+0000","last_peered":"2024-09-12T18:00:38.427984+0000","last_clean":"2024-09-12T18:00:38.427984+0000","last_became_active":"2024-09-12T17:23:46.155516+0000","last_became_peered":"2024-09-12T17:23:46.155516+0000","last_unstale":"2024-09-12T18:00:38.427984+0000","last_undegraded":"2024-09-12T18:00:38.427984+0000","last_fullsized":"2024-09-12T18:00:38.427984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:35.167613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":92,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.409748+0000","last_change":"2024-09-12T17:23:48.171371+0000","last_active":"2024-09-12T17:58:29.409748+0000","last_peered":"2024-09-12T17:58:29.409748+0000","last_clean":"2024-09-12T17:58:29.409748+0000","last_became_active":"2024-09-12T17:23:48.170462+0000","last_became_peered":"2024-09-12T17:23:48.170462+0000","last_unstale":"2024-09-12T17:58:29.409748+0000","last_undegraded":"2024-09-12T17:58:29.409748+0000","last_fullsized":"2024-09-12T17:58:29.409748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:11.276085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":655,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.159077+0000","last_change":"2024-09-12T17:23:50.186802+0000","last_active":"2024-09-12T18:00:18.159077+0000","last_peered":"2024-09-12T18:00:18.159077+0000","last_clean":"2024-09-12T18:00:18.159077+0000","last_became_active":"2024-09-12T17:23:50.186526+0000","last_became_peered":"2024-09-12T17:23:50.186526+0000","last_unstale":"2024-09-12T18:00:18.159077+0000","last_undegraded":"2024-09-12T18:00:18.159077+0000","last_fullsized":"2024-09-12T18:00:18.159077+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:15.982689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":247,"num_write":303,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"261'540","reported_seq":2255,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.146276+0000","last_change":"2024-09-12T17:23:42.151997+0000","last_active":"2024-09-12T18:00:18.146276+0000","last_peered":"2024-09-12T18:00:18.146276+0000","last_clean":"2024-09-12T18:00:18.146276+0000","last_became_active":"2024-09-12T17:23:42.151735+0000","last_became_peered":"2024-09-12T17:23:42.151735+0000","last_unstale":"2024-09-12T18:00:18.146276+0000","last_undegraded":"2024-09-12T18:00:18.146276+0000","last_fullsized":"2024-09-12T18:00:18.146276+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:29.033253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2982,"num_read_kb":2809,"num_write":660,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"261'257","reported_seq":846,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:00.087538+0000","last_change":"2024-09-12T17:23:40.712919+0000","last_active":"2024-09-12T18:00:00.087538+0000","last_peered":"2024-09-12T18:00:00.087538+0000","last_clean":"2024-09-12T18:00:00.087538+0000","last_became_active":"2024-09-12T17:23:40.712386+0000","last_became_peered":"2024-09-12T17:23:40.712386+0000","last_unstale":"2024-09-12T18:00:00.087538+0000","last_undegraded":"2024-09-12T18:00:00.087538+0000","last_fullsized":"2024-09-12T18:00:00.087538+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:54.407762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6538157,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":353,"num_read_kb":6504,"num_write":929,"num_write_kb":34893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":513,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.415656+0000","last_change":"2024-09-12T17:23:33.592955+0000","last_active":"2024-09-12T17:58:59.415656+0000","last_peered":"2024-09-12T17:58:59.415656+0000","last_clean":"2024-09-12T17:58:59.415656+0000","last_became_active":"2024-09-12T17:23:31.681209+0000","last_became_peered":"2024-09-12T17:23:31.681209+0000","last_unstale":"2024-09-12T17:58:59.415656+0000","last_undegraded":"2024-09-12T17:58:59.415656+0000","last_fullsized":"2024-09-12T17:58:59.415656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:00.576073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056110600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.545208+0000","last_change":"2024-09-12T17:23:44.148393+0000","last_active":"2024-09-12T17:59:09.545208+0000","last_peered":"2024-09-12T17:59:09.545208+0000","last_clean":"2024-09-12T17:59:09.545208+0000","last_became_active":"2024-09-12T17:23:44.148035+0000","last_became_peered":"2024-09-12T17:23:44.148035+0000","last_unstale":"2024-09-12T17:59:09.545208+0000","last_undegraded":"2024-09-12T17:59:09.545208+0000","last_fullsized":"2024-09-12T17:59:09.545208+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:03.387749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"261'555","reported_seq":1188,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.441319+0000","last_change":"2024-09-12T17:23:46.152284+0000","last_active":"2024-09-12T18:01:49.441319+0000","last_peered":"2024-09-12T18:01:49.441319+0000","last_clean":"2024-09-12T18:01:49.441319+0000","last_became_active":"2024-09-12T17:23:46.151649+0000","last_became_peered":"2024-09-12T17:23:46.151649+0000","last_unstale":"2024-09-12T18:01:49.441319+0000","last_undegraded":"2024-09-12T18:01:49.441319+0000","last_fullsized":"2024-09-12T18:01:49.441319+0000","mapping_epoch":29,"log_start":"261'500","ondisk_log_start":"261'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:44.755894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106631,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1501,"num_read_kb":2466,"num_write":1946,"num_write_kb":1783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418523+0000","last_change":"2024-09-12T17:23:48.166489+0000","last_active":"2024-09-12T17:59:14.418523+0000","last_peered":"2024-09-12T17:59:14.418523+0000","last_clean":"2024-09-12T17:59:14.418523+0000","last_became_active":"2024-09-12T17:23:48.166196+0000","last_became_peered":"2024-09-12T17:23:48.166196+0000","last_unstale":"2024-09-12T17:59:14.418523+0000","last_undegraded":"2024-09-12T17:59:14.418523+0000","last_fullsized":"2024-09-12T17:59:14.418523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:02.318935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"261'221","reported_seq":721,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.429767+0000","last_change":"2024-09-12T17:23:50.640504+0000","last_active":"2024-09-12T17:59:58.429767+0000","last_peered":"2024-09-12T17:59:58.429767+0000","last_clean":"2024-09-12T17:59:58.429767+0000","last_became_active":"2024-09-12T17:23:50.640185+0000","last_became_peered":"2024-09-12T17:23:50.640185+0000","last_unstale":"2024-09-12T17:59:58.429767+0000","last_undegraded":"2024-09-12T17:59:58.429767+0000","last_fullsized":"2024-09-12T17:59:58.429767+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:20.014900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":243,"num_write":513,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"261'509","reported_seq":2065,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.462615+0000","last_change":"2024-09-12T17:23:42.148853+0000","last_active":"2024-09-12T18:00:02.462615+0000","last_peered":"2024-09-12T18:00:02.462615+0000","last_clean":"2024-09-12T18:00:02.462615+0000","last_became_active":"2024-09-12T17:23:42.148578+0000","last_became_peered":"2024-09-12T17:23:42.148578+0000","last_unstale":"2024-09-12T18:00:02.462615+0000","last_undegraded":"2024-09-12T18:00:02.462615+0000","last_fullsized":"2024-09-12T18:00:02.462615+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:05.365806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2709,"num_read_kb":2501,"num_write":646,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"261'292","reported_seq":914,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:56.793221+0000","last_change":"2024-09-12T17:23:40.711077+0000","last_active":"2024-09-12T17:59:56.793221+0000","last_peered":"2024-09-12T17:59:56.793221+0000","last_clean":"2024-09-12T17:59:56.793221+0000","last_became_active":"2024-09-12T17:23:40.710780+0000","last_became_peered":"2024-09-12T17:23:40.710780+0000","last_unstale":"2024-09-12T17:59:56.793221+0000","last_undegraded":"2024-09-12T17:59:56.793221+0000","last_fullsized":"2024-09-12T17:59:56.793221+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:38.403382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615620,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":428,"num_read_kb":525,"num_write":1166,"num_write_kb":43788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":506,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.418269+0000","last_change":"2024-09-12T17:23:33.971206+0000","last_active":"2024-09-12T17:59:09.418269+0000","last_peered":"2024-09-12T17:59:09.418269+0000","last_clean":"2024-09-12T17:59:09.418269+0000","last_became_active":"2024-09-12T17:23:31.681155+0000","last_became_peered":"2024-09-12T17:23:31.681155+0000","last_unstale":"2024-09-12T17:59:09.418269+0000","last_undegraded":"2024-09-12T17:59:09.418269+0000","last_fullsized":"2024-09-12T17:59:09.418269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:20.293962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048562399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415369+0000","last_change":"2024-09-12T17:23:44.147684+0000","last_active":"2024-09-12T17:59:09.415369+0000","last_peered":"2024-09-12T17:59:09.415369+0000","last_clean":"2024-09-12T17:59:09.415369+0000","last_became_active":"2024-09-12T17:23:44.147347+0000","last_became_peered":"2024-09-12T17:23:44.147347+0000","last_unstale":"2024-09-12T17:59:09.415369+0000","last_undegraded":"2024-09-12T17:59:09.415369+0000","last_fullsized":"2024-09-12T17:59:09.415369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:45.660164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"261'149","reported_seq":697,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:23.414940+0000","last_change":"2024-09-12T17:23:46.241508+0000","last_active":"2024-09-12T18:00:23.414940+0000","last_peered":"2024-09-12T18:00:23.414940+0000","last_clean":"2024-09-12T18:00:23.414940+0000","last_became_active":"2024-09-12T17:23:46.241046+0000","last_became_peered":"2024-09-12T17:23:46.241046+0000","last_unstale":"2024-09-12T18:00:23.414940+0000","last_undegraded":"2024-09-12T18:00:23.414940+0000","last_fullsized":"2024-09-12T18:00:23.414940+0000","mapping_epoch":29,"log_start":"258'100","ondisk_log_start":"258'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:42.691500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":154,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"261'789","reported_seq":2338,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.413214+0000","last_change":"2024-09-12T17:23:48.173674+0000","last_active":"2024-09-12T18:01:49.413214+0000","last_peered":"2024-09-12T18:01:49.413214+0000","last_clean":"2024-09-12T18:01:49.413214+0000","last_became_active":"2024-09-12T17:23:48.173351+0000","last_became_peered":"2024-09-12T17:23:48.173351+0000","last_unstale":"2024-09-12T18:01:49.413214+0000","last_undegraded":"2024-09-12T18:01:49.413214+0000","last_fullsized":"2024-09-12T18:01:49.413214+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:23.841940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"261'101","reported_seq":588,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.422953+0000","last_change":"2024-09-12T17:23:50.639372+0000","last_active":"2024-09-12T17:59:58.422953+0000","last_peered":"2024-09-12T17:59:58.422953+0000","last_clean":"2024-09-12T17:59:58.422953+0000","last_became_active":"2024-09-12T17:23:50.639054+0000","last_became_peered":"2024-09-12T17:23:50.639054+0000","last_unstale":"2024-09-12T17:59:58.422953+0000","last_undegraded":"2024-09-12T17:59:58.422953+0000","last_fullsized":"2024-09-12T17:59:58.422953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:27.121755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":220,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"261'494","reported_seq":2015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559802+0000","last_change":"2024-09-12T17:23:42.148855+0000","last_active":"2024-09-12T18:00:18.559802+0000","last_peered":"2024-09-12T18:00:18.559802+0000","last_clean":"2024-09-12T18:00:18.559802+0000","last_became_active":"2024-09-12T17:23:42.148523+0000","last_became_peered":"2024-09-12T17:23:42.148523+0000","last_unstale":"2024-09-12T18:00:18.559802+0000","last_undegraded":"2024-09-12T18:00:18.559802+0000","last_fullsized":"2024-09-12T18:00:18.559802+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:44.314747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2488,"num_read_kb":2312,"num_write":602,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"261'313","reported_seq":1029,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.574035+0000","last_change":"2024-09-12T17:23:40.709406+0000","last_active":"2024-09-12T18:00:16.574035+0000","last_peered":"2024-09-12T18:00:16.574035+0000","last_clean":"2024-09-12T18:00:16.574035+0000","last_became_active":"2024-09-12T17:23:40.709077+0000","last_became_peered":"2024-09-12T17:23:40.709077+0000","last_unstale":"2024-09-12T18:00:16.574035+0000","last_undegraded":"2024-09-12T18:00:16.574035+0000","last_fullsized":"2024-09-12T18:00:16.574035+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:24.640342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19888358,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":626,"num_read_kb":135818,"num_write":1161,"num_write_kb":56746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":512,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.409415+0000","last_change":"2024-09-12T17:23:33.592959+0000","last_active":"2024-09-12T17:58:14.409415+0000","last_peered":"2024-09-12T17:58:14.409415+0000","last_clean":"2024-09-12T17:58:14.409415+0000","last_became_active":"2024-09-12T17:23:31.588526+0000","last_became_peered":"2024-09-12T17:23:31.588526+0000","last_unstale":"2024-09-12T17:58:14.409415+0000","last_undegraded":"2024-09-12T17:58:14.409415+0000","last_fullsized":"2024-09-12T17:58:14.409415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:32.240058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055923099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417985+0000","last_change":"2024-09-12T17:23:44.148290+0000","last_active":"2024-09-12T17:59:09.417985+0000","last_peered":"2024-09-12T17:59:09.417985+0000","last_clean":"2024-09-12T17:59:09.417985+0000","last_became_active":"2024-09-12T17:23:44.147594+0000","last_became_peered":"2024-09-12T17:23:44.147594+0000","last_unstale":"2024-09-12T17:59:09.417985+0000","last_undegraded":"2024-09-12T17:59:09.417985+0000","last_fullsized":"2024-09-12T17:59:09.417985+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:51.406975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"261'97","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.150898+0000","last_change":"2024-09-12T17:23:46.151701+0000","last_active":"2024-09-12T18:00:18.150898+0000","last_peered":"2024-09-12T18:00:18.150898+0000","last_clean":"2024-09-12T18:00:18.150898+0000","last_became_active":"2024-09-12T17:23:46.151335+0000","last_became_peered":"2024-09-12T17:23:46.151335+0000","last_unstale":"2024-09-12T18:00:18.150898+0000","last_undegraded":"2024-09-12T18:00:18.150898+0000","last_fullsized":"2024-09-12T18:00:18.150898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:23.162677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"261'804","reported_seq":2584,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.455650+0000","last_change":"2024-09-12T17:23:48.168044+0000","last_active":"2024-09-12T18:01:42.455650+0000","last_peered":"2024-09-12T18:01:42.455650+0000","last_clean":"2024-09-12T18:01:42.455650+0000","last_became_active":"2024-09-12T17:23:48.167739+0000","last_became_peered":"2024-09-12T17:23:48.167739+0000","last_unstale":"2024-09-12T18:01:42.455650+0000","last_undegraded":"2024-09-12T18:01:42.455650+0000","last_fullsized":"2024-09-12T18:01:42.455650+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:25.436138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"261'311","reported_seq":829,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.346118+0000","last_change":"2024-09-12T17:23:50.179480+0000","last_active":"2024-09-12T18:01:41.346118+0000","last_peered":"2024-09-12T18:01:41.346118+0000","last_clean":"2024-09-12T18:01:41.346118+0000","last_became_active":"2024-09-12T17:23:50.179127+0000","last_became_peered":"2024-09-12T17:23:50.179127+0000","last_unstale":"2024-09-12T18:01:41.346118+0000","last_undegraded":"2024-09-12T18:01:41.346118+0000","last_fullsized":"2024-09-12T18:01:41.346118+0000","mapping_epoch":33,"log_start":"261'300","ondisk_log_start":"261'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:11.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":442,"num_write":705,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"261'1030","reported_seq":2757,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.227573+0000","last_change":"2024-09-12T17:23:42.145784+0000","last_active":"2024-09-12T18:00:05.227573+0000","last_peered":"2024-09-12T18:00:05.227573+0000","last_clean":"2024-09-12T18:00:05.227573+0000","last_became_active":"2024-09-12T17:23:42.145139+0000","last_became_peered":"2024-09-12T17:23:42.145139+0000","last_unstale":"2024-09-12T18:00:05.227573+0000","last_undegraded":"2024-09-12T18:00:05.227573+0000","last_fullsized":"2024-09-12T18:00:05.227573+0000","mapping_epoch":25,"log_start":"261'1000","ondisk_log_start":"261'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1000,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:16.782381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4954,"num_read_kb":4437,"num_write":1455,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"261'305","reported_seq":952,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.520960+0000","last_change":"2024-09-12T17:23:40.713302+0000","last_active":"2024-09-12T18:01:49.520960+0000","last_peered":"2024-09-12T18:01:49.520960+0000","last_clean":"2024-09-12T18:01:49.520960+0000","last_became_active":"2024-09-12T17:23:40.712974+0000","last_became_peered":"2024-09-12T17:23:40.712974+0000","last_unstale":"2024-09-12T18:01:49.520960+0000","last_undegraded":"2024-09-12T18:01:49.520960+0000","last_fullsized":"2024-09-12T18:01:49.520960+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:22.541324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582155,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":449,"num_read_kb":103143,"num_write":1105,"num_write_kb":43429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":507,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.407867+0000","last_change":"2024-09-12T17:23:33.971199+0000","last_active":"2024-09-12T17:58:14.407867+0000","last_peered":"2024-09-12T17:58:14.407867+0000","last_clean":"2024-09-12T17:58:14.407867+0000","last_became_active":"2024-09-12T17:23:31.588266+0000","last_became_peered":"2024-09-12T17:23:31.588266+0000","last_unstale":"2024-09-12T17:58:14.407867+0000","last_undegraded":"2024-09-12T17:58:14.407867+0000","last_fullsized":"2024-09-12T17:58:14.407867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:05.248877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051630700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.421688+0000","last_change":"2024-09-12T17:23:44.149935+0000","last_active":"2024-09-12T17:59:48.421688+0000","last_peered":"2024-09-12T17:59:48.421688+0000","last_clean":"2024-09-12T17:59:48.421688+0000","last_became_active":"2024-09-12T17:23:44.149649+0000","last_became_peered":"2024-09-12T17:23:44.149649+0000","last_unstale":"2024-09-12T17:59:48.421688+0000","last_undegraded":"2024-09-12T17:59:48.421688+0000","last_fullsized":"2024-09-12T17:59:48.421688+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:06.362964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"261'681","reported_seq":1366,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.430148+0000","last_change":"2024-09-12T17:23:46.242153+0000","last_active":"2024-09-12T18:01:49.430148+0000","last_peered":"2024-09-12T18:01:49.430148+0000","last_clean":"2024-09-12T18:01:49.430148+0000","last_became_active":"2024-09-12T17:23:46.241681+0000","last_became_peered":"2024-09-12T17:23:46.241681+0000","last_unstale":"2024-09-12T18:01:49.430148+0000","last_undegraded":"2024-09-12T18:01:49.430148+0000","last_fullsized":"2024-09-12T18:01:49.430148+0000","mapping_epoch":29,"log_start":"261'600","ondisk_log_start":"261'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":600,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:06.488679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180006,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1211,"num_read_kb":2636,"num_write":996,"num_write_kb":858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:13.416822+0000","last_change":"2024-09-12T17:23:48.170996+0000","last_active":"2024-09-12T17:59:13.416822+0000","last_peered":"2024-09-12T17:59:13.416822+0000","last_clean":"2024-09-12T17:59:13.416822+0000","last_became_active":"2024-09-12T17:23:48.170687+0000","last_became_peered":"2024-09-12T17:23:48.170687+0000","last_unstale":"2024-09-12T17:59:13.416822+0000","last_undegraded":"2024-09-12T17:59:13.416822+0000","last_fullsized":"2024-09-12T17:59:13.416822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:56.021234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"261'136","reported_seq":667,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.547879+0000","last_change":"2024-09-12T17:23:50.189525+0000","last_active":"2024-09-12T18:00:18.547879+0000","last_peered":"2024-09-12T18:00:18.547879+0000","last_clean":"2024-09-12T18:00:18.547879+0000","last_became_active":"2024-09-12T17:23:50.188042+0000","last_became_peered":"2024-09-12T17:23:50.188042+0000","last_unstale":"2024-09-12T18:00:18.547879+0000","last_undegraded":"2024-09-12T18:00:18.547879+0000","last_fullsized":"2024-09-12T18:00:18.547879+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:12.246421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":351,"num_read_kb":302,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"261'129","reported_seq":670,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.665733+0000","last_change":"2024-09-12T17:23:50.190175+0000","last_active":"2024-09-12T18:00:18.665733+0000","last_peered":"2024-09-12T18:00:18.665733+0000","last_clean":"2024-09-12T18:00:18.665733+0000","last_became_active":"2024-09-12T17:23:50.189955+0000","last_became_peered":"2024-09-12T17:23:50.189955+0000","last_unstale":"2024-09-12T18:00:18.665733+0000","last_undegraded":"2024-09-12T18:00:18.665733+0000","last_fullsized":"2024-09-12T18:00:18.665733+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:05.002727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":232,"num_write":318,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"261'329","reported_seq":1796,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559462+0000","last_change":"2024-09-12T17:23:42.139182+0000","last_active":"2024-09-12T18:00:18.559462+0000","last_peered":"2024-09-12T18:00:18.559462+0000","last_clean":"2024-09-12T18:00:18.559462+0000","last_became_active":"2024-09-12T17:23:42.138899+0000","last_became_peered":"2024-09-12T17:23:42.138899+0000","last_unstale":"2024-09-12T18:00:18.559462+0000","last_undegraded":"2024-09-12T18:00:18.559462+0000","last_fullsized":"2024-09-12T18:00:18.559462+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:52.392138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1873,"num_read_kb":1826,"num_write":350,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"261'303","reported_seq":936,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.572606+0000","last_change":"2024-09-12T17:23:40.709618+0000","last_active":"2024-09-12T18:00:16.572606+0000","last_peered":"2024-09-12T18:00:16.572606+0000","last_clean":"2024-09-12T18:00:16.572606+0000","last_became_active":"2024-09-12T17:23:40.709219+0000","last_became_peered":"2024-09-12T17:23:40.709219+0000","last_unstale":"2024-09-12T18:00:16.572606+0000","last_undegraded":"2024-09-12T18:00:16.572606+0000","last_fullsized":"2024-09-12T18:00:16.572606+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:01.388035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":701751,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":497,"num_read_kb":4301,"num_write":1202,"num_write_kb":9304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.413627+0000","last_change":"2024-09-12T17:23:44.151482+0000","last_active":"2024-09-12T17:58:44.413627+0000","last_peered":"2024-09-12T17:58:44.413627+0000","last_clean":"2024-09-12T17:58:44.413627+0000","last_became_active":"2024-09-12T17:23:44.151175+0000","last_became_peered":"2024-09-12T17:23:44.151175+0000","last_unstale":"2024-09-12T17:58:44.413627+0000","last_undegraded":"2024-09-12T17:58:44.413627+0000","last_fullsized":"2024-09-12T17:58:44.413627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:07.283799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"261'271","reported_seq":826,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:08.431619+0000","last_change":"2024-09-12T17:23:46.151842+0000","last_active":"2024-09-12T18:01:08.431619+0000","last_peered":"2024-09-12T18:01:08.431619+0000","last_clean":"2024-09-12T18:01:08.431619+0000","last_became_active":"2024-09-12T17:23:46.150505+0000","last_became_peered":"2024-09-12T17:23:46.150505+0000","last_unstale":"2024-09-12T18:01:08.431619+0000","last_undegraded":"2024-09-12T18:01:08.431619+0000","last_fullsized":"2024-09-12T18:01:08.431619+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:29.365545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92207,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":466,"num_read_kb":1051,"num_write":390,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.413394+0000","last_change":"2024-09-12T17:23:48.168196+0000","last_active":"2024-09-12T17:58:48.413394+0000","last_peered":"2024-09-12T17:58:48.413394+0000","last_clean":"2024-09-12T17:58:48.413394+0000","last_became_active":"2024-09-12T17:23:48.167911+0000","last_became_peered":"2024-09-12T17:23:48.167911+0000","last_unstale":"2024-09-12T17:58:48.413394+0000","last_undegraded":"2024-09-12T17:58:48.413394+0000","last_fullsized":"2024-09-12T17:58:48.413394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:27.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"261'95","reported_seq":584,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.804808+0000","last_change":"2024-09-12T17:23:50.183763+0000","last_active":"2024-09-12T17:59:38.804808+0000","last_peered":"2024-09-12T17:59:38.804808+0000","last_clean":"2024-09-12T17:59:38.804808+0000","last_became_active":"2024-09-12T17:23:50.183400+0000","last_became_peered":"2024-09-12T17:23:50.183400+0000","last_unstale":"2024-09-12T17:59:38.804808+0000","last_undegraded":"2024-09-12T17:59:38.804808+0000","last_fullsized":"2024-09-12T17:59:38.804808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:30.231346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":128,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"261'478","reported_seq":1884,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.785644+0000","last_change":"2024-09-12T17:23:42.138814+0000","last_active":"2024-09-12T18:00:05.785644+0000","last_peered":"2024-09-12T18:00:05.785644+0000","last_clean":"2024-09-12T18:00:05.785644+0000","last_became_active":"2024-09-12T17:23:42.137988+0000","last_became_peered":"2024-09-12T17:23:42.137988+0000","last_unstale":"2024-09-12T18:00:05.785644+0000","last_undegraded":"2024-09-12T18:00:05.785644+0000","last_fullsized":"2024-09-12T18:00:05.785644+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:34.256530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2384,"num_read_kb":2190,"num_write":595,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"261'304","reported_seq":942,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.146183+0000","last_change":"2024-09-12T17:23:40.711108+0000","last_active":"2024-09-12T18:00:02.146183+0000","last_peered":"2024-09-12T18:00:02.146183+0000","last_clean":"2024-09-12T18:00:02.146183+0000","last_became_active":"2024-09-12T17:23:40.710425+0000","last_became_peered":"2024-09-12T17:23:40.710425+0000","last_unstale":"2024-09-12T18:00:02.146183+0000","last_undegraded":"2024-09-12T18:00:02.146183+0000","last_fullsized":"2024-09-12T18:00:02.146183+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:29.912015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19579553,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":475,"num_read_kb":49330,"num_write":1083,"num_write_kb":37186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:43.412561+0000","last_change":"2024-09-12T17:23:44.149929+0000","last_active":"2024-09-12T17:58:43.412561+0000","last_peered":"2024-09-12T17:58:43.412561+0000","last_clean":"2024-09-12T17:58:43.412561+0000","last_became_active":"2024-09-12T17:23:44.148078+0000","last_became_peered":"2024-09-12T17:23:44.148078+0000","last_unstale":"2024-09-12T17:58:43.412561+0000","last_undegraded":"2024-09-12T17:58:43.412561+0000","last_fullsized":"2024-09-12T17:58:43.412561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:27.562908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"261'42","reported_seq":529,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.542596+0000","last_change":"2024-09-12T17:23:46.152014+0000","last_active":"2024-09-12T17:58:49.542596+0000","last_peered":"2024-09-12T17:58:49.542596+0000","last_clean":"2024-09-12T17:58:49.542596+0000","last_became_active":"2024-09-12T17:23:46.151258+0000","last_became_peered":"2024-09-12T17:23:46.151258+0000","last_unstale":"2024-09-12T17:58:49.542596+0000","last_undegraded":"2024-09-12T17:58:49.542596+0000","last_fullsized":"2024-09-12T17:58:49.542596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.540146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":25,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.415800+0000","last_change":"2024-09-12T17:23:48.174102+0000","last_active":"2024-09-12T17:58:49.415800+0000","last_peered":"2024-09-12T17:58:49.415800+0000","last_clean":"2024-09-12T17:58:49.415800+0000","last_became_active":"2024-09-12T17:23:48.173781+0000","last_became_peered":"2024-09-12T17:23:48.173781+0000","last_unstale":"2024-09-12T17:58:49.415800+0000","last_undegraded":"2024-09-12T17:58:49.415800+0000","last_fullsized":"2024-09-12T17:58:49.415800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:42.236527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"261'166","reported_seq":668,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.152209+0000","last_change":"2024-09-12T17:23:50.184117+0000","last_active":"2024-09-12T18:00:18.152209+0000","last_peered":"2024-09-12T18:00:18.152209+0000","last_clean":"2024-09-12T18:00:18.152209+0000","last_became_active":"2024-09-12T17:23:50.183784+0000","last_became_peered":"2024-09-12T17:23:50.183784+0000","last_unstale":"2024-09-12T18:00:18.152209+0000","last_undegraded":"2024-09-12T18:00:18.152209+0000","last_fullsized":"2024-09-12T18:00:18.152209+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:59.251619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":278,"num_read_kb":278,"num_write":359,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"261'417","reported_seq":1952,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.897757+0000","last_change":"2024-09-12T17:23:42.147200+0000","last_active":"2024-09-12T18:00:04.897757+0000","last_peered":"2024-09-12T18:00:04.897757+0000","last_clean":"2024-09-12T18:00:04.897757+0000","last_became_active":"2024-09-12T17:23:42.146703+0000","last_became_peered":"2024-09-12T17:23:42.146703+0000","last_unstale":"2024-09-12T18:00:04.897757+0000","last_undegraded":"2024-09-12T18:00:04.897757+0000","last_fullsized":"2024-09-12T18:00:04.897757+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:00.134623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2240,"num_read_kb":2131,"num_write":479,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"261'228","reported_seq":885,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:01.304117+0000","last_change":"2024-09-12T17:23:40.704662+0000","last_active":"2024-09-12T18:00:01.304117+0000","last_peered":"2024-09-12T18:00:01.304117+0000","last_clean":"2024-09-12T18:00:01.304117+0000","last_became_active":"2024-09-12T17:23:40.704278+0000","last_became_peered":"2024-09-12T17:23:40.704278+0000","last_unstale":"2024-09-12T18:00:01.304117+0000","last_undegraded":"2024-09-12T18:00:01.304117+0000","last_fullsized":"2024-09-12T18:00:01.304117+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:07.570947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19121762,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":418,"num_read_kb":96513,"num_write":866,"num_write_kb":33057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.415015+0000","last_change":"2024-09-12T17:23:44.151075+0000","last_active":"2024-09-12T17:58:44.415015+0000","last_peered":"2024-09-12T17:58:44.415015+0000","last_clean":"2024-09-12T17:58:44.415015+0000","last_became_active":"2024-09-12T17:23:44.149838+0000","last_became_peered":"2024-09-12T17:23:44.149838+0000","last_unstale":"2024-09-12T17:58:44.415015+0000","last_undegraded":"2024-09-12T17:58:44.415015+0000","last_fullsized":"2024-09-12T17:58:44.415015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:30.715787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"261'296","reported_seq":867,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:08.431649+0000","last_change":"2024-09-12T17:23:46.150856+0000","last_active":"2024-09-12T18:01:08.431649+0000","last_peered":"2024-09-12T18:01:08.431649+0000","last_clean":"2024-09-12T18:01:08.431649+0000","last_became_active":"2024-09-12T17:23:46.150528+0000","last_became_peered":"2024-09-12T17:23:46.150528+0000","last_unstale":"2024-09-12T18:01:08.431649+0000","last_undegraded":"2024-09-12T18:01:08.431649+0000","last_fullsized":"2024-09-12T18:01:08.431649+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:33.340339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55558,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":967,"num_write":392,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.412615+0000","last_change":"2024-09-12T17:23:48.171496+0000","last_active":"2024-09-12T17:58:49.412615+0000","last_peered":"2024-09-12T17:58:49.412615+0000","last_clean":"2024-09-12T17:58:49.412615+0000","last_became_active":"2024-09-12T17:23:48.171031+0000","last_became_peered":"2024-09-12T17:23:48.171031+0000","last_unstale":"2024-09-12T17:58:49.412615+0000","last_undegraded":"2024-09-12T17:58:49.412615+0000","last_fullsized":"2024-09-12T17:58:49.412615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:49.840358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"261'154","reported_seq":657,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.140462+0000","last_change":"2024-09-12T17:23:50.186163+0000","last_active":"2024-09-12T18:00:03.140462+0000","last_peered":"2024-09-12T18:00:03.140462+0000","last_clean":"2024-09-12T18:00:03.140462+0000","last_became_active":"2024-09-12T17:23:50.185846+0000","last_became_peered":"2024-09-12T17:23:50.185846+0000","last_unstale":"2024-09-12T18:00:03.140462+0000","last_undegraded":"2024-09-12T18:00:03.140462+0000","last_fullsized":"2024-09-12T18:00:03.140462+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:27.173182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":366,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"261'792","reported_seq":2404,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.575412+0000","last_change":"2024-09-12T17:23:42.155181+0000","last_active":"2024-09-12T18:00:04.575412+0000","last_peered":"2024-09-12T18:00:04.575412+0000","last_clean":"2024-09-12T18:00:04.575412+0000","last_became_active":"2024-09-12T17:23:42.154925+0000","last_became_peered":"2024-09-12T17:23:42.154925+0000","last_unstale":"2024-09-12T18:00:04.575412+0000","last_undegraded":"2024-09-12T18:00:04.575412+0000","last_fullsized":"2024-09-12T18:00:04.575412+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:33.690553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3893,"num_read_kb":3543,"num_write":1032,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"261'295","reported_seq":907,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.562583+0000","last_change":"2024-09-12T17:23:40.709552+0000","last_active":"2024-09-12T18:01:49.562583+0000","last_peered":"2024-09-12T18:01:49.562583+0000","last_clean":"2024-09-12T18:01:49.562583+0000","last_became_active":"2024-09-12T17:23:40.708670+0000","last_became_peered":"2024-09-12T17:23:40.708670+0000","last_unstale":"2024-09-12T18:01:49.562583+0000","last_undegraded":"2024-09-12T18:01:49.562583+0000","last_fullsized":"2024-09-12T18:01:49.562583+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:17.377417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334439,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":426,"num_read_kb":1950,"num_write":1046,"num_write_kb":27043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.411789+0000","last_change":"2024-09-12T17:23:44.150241+0000","last_active":"2024-09-12T17:58:44.411789+0000","last_peered":"2024-09-12T17:58:44.411789+0000","last_clean":"2024-09-12T17:58:44.411789+0000","last_became_active":"2024-09-12T17:23:44.149907+0000","last_became_peered":"2024-09-12T17:23:44.149907+0000","last_unstale":"2024-09-12T17:58:44.411789+0000","last_undegraded":"2024-09-12T17:58:44.411789+0000","last_fullsized":"2024-09-12T17:58:44.411789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:57.170825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"261'272","reported_seq":819,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.408760+0000","last_change":"2024-09-12T17:23:46.150337+0000","last_active":"2024-09-12T18:01:42.408760+0000","last_peered":"2024-09-12T18:01:42.408760+0000","last_clean":"2024-09-12T18:01:42.408760+0000","last_became_active":"2024-09-12T17:23:46.149987+0000","last_became_peered":"2024-09-12T17:23:46.149987+0000","last_unstale":"2024-09-12T18:01:42.408760+0000","last_undegraded":"2024-09-12T18:01:42.408760+0000","last_fullsized":"2024-09-12T18:01:42.408760+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:31.163554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58657,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":986,"num_write":384,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.542683+0000","last_change":"2024-09-12T17:23:48.169607+0000","last_active":"2024-09-12T17:58:49.542683+0000","last_peered":"2024-09-12T17:58:49.542683+0000","last_clean":"2024-09-12T17:58:49.542683+0000","last_became_active":"2024-09-12T17:23:48.169308+0000","last_became_peered":"2024-09-12T17:23:48.169308+0000","last_unstale":"2024-09-12T17:58:49.542683+0000","last_undegraded":"2024-09-12T17:58:49.542683+0000","last_fullsized":"2024-09-12T17:58:49.542683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:14.722104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"261'801","reported_seq":2248,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.775817+0000","last_change":"2024-09-12T17:23:42.148700+0000","last_active":"2024-09-12T18:00:15.775817+0000","last_peered":"2024-09-12T18:00:15.775817+0000","last_clean":"2024-09-12T18:00:15.775817+0000","last_became_active":"2024-09-12T17:23:42.148412+0000","last_became_peered":"2024-09-12T17:23:42.148412+0000","last_unstale":"2024-09-12T18:00:15.775817+0000","last_undegraded":"2024-09-12T18:00:15.775817+0000","last_fullsized":"2024-09-12T18:00:15.775817+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:21.039641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3663,"num_read_kb":3282,"num_write":1025,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"261'250","reported_seq":881,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.797639+0000","last_change":"2024-09-12T17:23:40.717850+0000","last_active":"2024-09-12T18:00:02.797639+0000","last_peered":"2024-09-12T18:00:02.797639+0000","last_clean":"2024-09-12T18:00:02.797639+0000","last_became_active":"2024-09-12T17:23:40.717447+0000","last_became_peered":"2024-09-12T17:23:40.717447+0000","last_unstale":"2024-09-12T18:00:02.797639+0000","last_undegraded":"2024-09-12T18:00:02.797639+0000","last_fullsized":"2024-09-12T18:00:02.797639+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:56.974836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11557594,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":426,"num_read_kb":6876,"num_write":914,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:49.550885+0000","last_change":"2024-09-12T17:23:44.150079+0000","last_active":"2024-09-12T17:59:49.550885+0000","last_peered":"2024-09-12T17:59:49.550885+0000","last_clean":"2024-09-12T17:59:49.550885+0000","last_became_active":"2024-09-12T17:23:44.149799+0000","last_became_peered":"2024-09-12T17:23:44.149799+0000","last_unstale":"2024-09-12T17:59:49.550885+0000","last_undegraded":"2024-09-12T17:59:49.550885+0000","last_fullsized":"2024-09-12T17:59:49.550885+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:42.685092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"261'474","reported_seq":1085,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.434616+0000","last_change":"2024-09-12T17:23:46.149613+0000","last_active":"2024-09-12T18:01:42.434616+0000","last_peered":"2024-09-12T18:01:42.434616+0000","last_clean":"2024-09-12T18:01:42.434616+0000","last_became_active":"2024-09-12T17:23:46.148861+0000","last_became_peered":"2024-09-12T17:23:46.148861+0000","last_unstale":"2024-09-12T18:01:42.434616+0000","last_undegraded":"2024-09-12T18:01:42.434616+0000","last_fullsized":"2024-09-12T18:01:42.434616+0000","mapping_epoch":29,"log_start":"261'400","ondisk_log_start":"261'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:49.574258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121423,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":853,"num_read_kb":1879,"num_write":744,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.415004+0000","last_change":"2024-09-12T17:23:48.168964+0000","last_active":"2024-09-12T17:58:49.415004+0000","last_peered":"2024-09-12T17:58:49.415004+0000","last_clean":"2024-09-12T17:58:49.415004+0000","last_became_active":"2024-09-12T17:23:48.168566+0000","last_became_peered":"2024-09-12T17:23:48.168566+0000","last_unstale":"2024-09-12T17:58:49.415004+0000","last_undegraded":"2024-09-12T17:58:49.415004+0000","last_fullsized":"2024-09-12T17:58:49.415004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:54.048241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"261'216","reported_seq":723,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.143900+0000","last_change":"2024-09-12T17:23:50.642047+0000","last_active":"2024-09-12T18:00:18.143900+0000","last_peered":"2024-09-12T18:00:18.143900+0000","last_clean":"2024-09-12T18:00:18.143900+0000","last_became_active":"2024-09-12T17:23:50.641702+0000","last_became_peered":"2024-09-12T17:23:50.641702+0000","last_unstale":"2024-09-12T18:00:18.143900+0000","last_undegraded":"2024-09-12T18:00:18.143900+0000","last_fullsized":"2024-09-12T18:00:18.143900+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:03.863712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":328,"num_write":469,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"261'758","reported_seq":2326,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.409871+0000","last_change":"2024-09-12T17:23:42.142182+0000","last_active":"2024-09-12T18:00:03.409871+0000","last_peered":"2024-09-12T18:00:03.409871+0000","last_clean":"2024-09-12T18:00:03.409871+0000","last_became_active":"2024-09-12T17:23:42.141869+0000","last_became_peered":"2024-09-12T17:23:42.141869+0000","last_unstale":"2024-09-12T18:00:03.409871+0000","last_undegraded":"2024-09-12T18:00:03.409871+0000","last_fullsized":"2024-09-12T18:00:03.409871+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:48.199963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3783,"num_read_kb":3443,"num_write":995,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"261'259","reported_seq":860,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.906319+0000","last_change":"2024-09-12T17:23:40.711959+0000","last_active":"2024-09-12T17:59:38.906319+0000","last_peered":"2024-09-12T17:59:38.906319+0000","last_clean":"2024-09-12T17:59:38.906319+0000","last_became_active":"2024-09-12T17:23:40.711679+0000","last_became_peered":"2024-09-12T17:23:40.711679+0000","last_unstale":"2024-09-12T17:59:38.906319+0000","last_undegraded":"2024-09-12T17:59:38.906319+0000","last_fullsized":"2024-09-12T17:59:38.906319+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:54.430386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243674,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":380,"num_read_kb":3626,"num_write":916,"num_write_kb":35404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415419+0000","last_change":"2024-09-12T17:23:44.148401+0000","last_active":"2024-09-12T17:59:09.415419+0000","last_peered":"2024-09-12T17:59:09.415419+0000","last_clean":"2024-09-12T17:59:09.415419+0000","last_became_active":"2024-09-12T17:23:44.148044+0000","last_became_peered":"2024-09-12T17:23:44.148044+0000","last_unstale":"2024-09-12T17:59:09.415419+0000","last_undegraded":"2024-09-12T17:59:09.415419+0000","last_fullsized":"2024-09-12T17:59:09.415419+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:06.246940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"261'288","reported_seq":846,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.410042+0000","last_change":"2024-09-12T17:23:46.150717+0000","last_active":"2024-09-12T18:01:42.410042+0000","last_peered":"2024-09-12T18:01:42.410042+0000","last_clean":"2024-09-12T18:01:42.410042+0000","last_became_active":"2024-09-12T17:23:46.150380+0000","last_became_peered":"2024-09-12T17:23:46.150380+0000","last_unstale":"2024-09-12T18:01:42.410042+0000","last_undegraded":"2024-09-12T18:01:42.410042+0000","last_fullsized":"2024-09-12T18:01:42.410042+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:35.358954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57700,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":481,"num_read_kb":981,"num_write":410,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.414306+0000","last_change":"2024-09-12T17:23:48.173812+0000","last_active":"2024-09-12T17:58:49.414306+0000","last_peered":"2024-09-12T17:58:49.414306+0000","last_clean":"2024-09-12T17:58:49.414306+0000","last_became_active":"2024-09-12T17:23:48.173575+0000","last_became_peered":"2024-09-12T17:23:48.173575+0000","last_unstale":"2024-09-12T17:58:49.414306+0000","last_undegraded":"2024-09-12T17:58:49.414306+0000","last_fullsized":"2024-09-12T17:58:49.414306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:42.300280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"261'188","reported_seq":1044,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:17.033695+0000","last_change":"2024-09-12T17:23:50.186218+0000","last_active":"2024-09-12T18:00:17.033695+0000","last_peered":"2024-09-12T18:00:17.033695+0000","last_clean":"2024-09-12T18:00:17.033695+0000","last_became_active":"2024-09-12T17:23:50.185853+0000","last_became_peered":"2024-09-12T17:23:50.185853+0000","last_unstale":"2024-09-12T18:00:17.033695+0000","last_undegraded":"2024-09-12T18:00:17.033695+0000","last_fullsized":"2024-09-12T18:00:17.033695+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:01.791901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":633,"num_read_kb":630,"num_write":516,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"261'631","reported_seq":2472,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.504213+0000","last_change":"2024-09-12T17:23:42.154459+0000","last_active":"2024-09-12T18:00:05.504213+0000","last_peered":"2024-09-12T18:00:05.504213+0000","last_clean":"2024-09-12T18:00:05.504213+0000","last_became_active":"2024-09-12T17:23:42.154175+0000","last_became_peered":"2024-09-12T17:23:42.154175+0000","last_unstale":"2024-09-12T18:00:05.504213+0000","last_undegraded":"2024-09-12T18:00:05.504213+0000","last_fullsized":"2024-09-12T18:00:05.504213+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":600,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:46.313807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3404,"num_read_kb":3151,"num_write":789,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"261'277","reported_seq":902,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:23.907452+0000","last_change":"2024-09-12T17:23:40.713263+0000","last_active":"2024-09-12T17:59:23.907452+0000","last_peered":"2024-09-12T17:59:23.907452+0000","last_clean":"2024-09-12T17:59:23.907452+0000","last_became_active":"2024-09-12T17:23:40.712959+0000","last_became_peered":"2024-09-12T17:23:40.712959+0000","last_unstale":"2024-09-12T17:59:23.907452+0000","last_undegraded":"2024-09-12T17:59:23.907452+0000","last_fullsized":"2024-09-12T17:59:23.907452+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:04.359024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6618009,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":454,"num_read_kb":11021,"num_write":998,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.414711+0000","last_change":"2024-09-12T17:23:44.152533+0000","last_active":"2024-09-12T17:58:44.414711+0000","last_peered":"2024-09-12T17:58:44.414711+0000","last_clean":"2024-09-12T17:58:44.414711+0000","last_became_active":"2024-09-12T17:23:44.152006+0000","last_became_peered":"2024-09-12T17:23:44.152006+0000","last_unstale":"2024-09-12T17:58:44.414711+0000","last_undegraded":"2024-09-12T17:58:44.414711+0000","last_fullsized":"2024-09-12T17:58:44.414711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:53.659031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"261'244","reported_seq":801,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.433112+0000","last_change":"2024-09-12T17:23:46.241387+0000","last_active":"2024-09-12T18:01:18.433112+0000","last_peered":"2024-09-12T18:01:18.433112+0000","last_clean":"2024-09-12T18:01:18.433112+0000","last_became_active":"2024-09-12T17:23:46.241001+0000","last_became_peered":"2024-09-12T17:23:46.241001+0000","last_unstale":"2024-09-12T18:01:18.433112+0000","last_undegraded":"2024-09-12T18:01:18.433112+0000","last_fullsized":"2024-09-12T18:01:18.433112+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:50.165152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44275,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":380,"num_read_kb":773,"num_write":308,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.406337+0000","last_change":"2024-09-12T17:23:48.170506+0000","last_active":"2024-09-12T17:57:54.406337+0000","last_peered":"2024-09-12T17:57:54.406337+0000","last_clean":"2024-09-12T17:57:54.406337+0000","last_became_active":"2024-09-12T17:23:48.170212+0000","last_became_peered":"2024-09-12T17:23:48.170212+0000","last_unstale":"2024-09-12T17:57:54.406337+0000","last_undegraded":"2024-09-12T17:57:54.406337+0000","last_fullsized":"2024-09-12T17:57:54.406337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:14.960120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"261'127","reported_seq":607,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.439241+0000","last_change":"2024-09-12T17:23:50.187626+0000","last_active":"2024-09-12T18:01:42.439241+0000","last_peered":"2024-09-12T18:01:42.439241+0000","last_clean":"2024-09-12T18:01:42.439241+0000","last_became_active":"2024-09-12T17:23:50.187329+0000","last_became_peered":"2024-09-12T17:23:50.187329+0000","last_unstale":"2024-09-12T18:01:42.439241+0000","last_undegraded":"2024-09-12T18:01:42.439241+0000","last_fullsized":"2024-09-12T18:01:42.439241+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:50.928583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":770,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":154,"num_read_kb":149,"num_write":327,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"261'776","reported_seq":2292,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.504173+0000","last_change":"2024-09-12T17:23:42.144667+0000","last_active":"2024-09-12T18:00:05.504173+0000","last_peered":"2024-09-12T18:00:05.504173+0000","last_clean":"2024-09-12T18:00:05.504173+0000","last_became_active":"2024-09-12T17:23:42.144384+0000","last_became_peered":"2024-09-12T17:23:42.144384+0000","last_unstale":"2024-09-12T18:00:05.504173+0000","last_undegraded":"2024-09-12T18:00:05.504173+0000","last_fullsized":"2024-09-12T18:00:05.504173+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:07.836356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3720,"num_read_kb":3370,"num_write":1041,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"261'269","reported_seq":878,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.523666+0000","last_change":"2024-09-12T17:23:40.714983+0000","last_active":"2024-09-12T18:01:49.523666+0000","last_peered":"2024-09-12T18:01:49.523666+0000","last_clean":"2024-09-12T18:01:49.523666+0000","last_became_active":"2024-09-12T17:23:40.714710+0000","last_became_peered":"2024-09-12T17:23:40.714710+0000","last_unstale":"2024-09-12T18:01:49.523666+0000","last_undegraded":"2024-09-12T18:01:49.523666+0000","last_fullsized":"2024-09-12T18:01:49.523666+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:51.614208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3465743,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":411,"num_read_kb":6860,"num_write":1044,"num_write_kb":28418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.413676+0000","last_change":"2024-09-12T17:23:44.150532+0000","last_active":"2024-09-12T17:58:44.413676+0000","last_peered":"2024-09-12T17:58:44.413676+0000","last_clean":"2024-09-12T17:58:44.413676+0000","last_became_active":"2024-09-12T17:23:44.147886+0000","last_became_peered":"2024-09-12T17:23:44.147886+0000","last_unstale":"2024-09-12T17:58:44.413676+0000","last_undegraded":"2024-09-12T17:58:44.413676+0000","last_fullsized":"2024-09-12T17:58:44.413676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:53.428886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"261'80","reported_seq":588,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.424428+0000","last_change":"2024-09-12T17:23:46.241390+0000","last_active":"2024-09-12T17:59:59.424428+0000","last_peered":"2024-09-12T17:59:59.424428+0000","last_clean":"2024-09-12T17:59:59.424428+0000","last_became_active":"2024-09-12T17:23:46.241073+0000","last_became_peered":"2024-09-12T17:23:46.241073+0000","last_unstale":"2024-09-12T17:59:59.424428+0000","last_undegraded":"2024-09-12T17:59:59.424428+0000","last_fullsized":"2024-09-12T17:59:59.424428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:13.779221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":73,"num_read_kb":65,"num_write":60,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"261'784","reported_seq":2168,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.411782+0000","last_change":"2024-09-12T17:23:48.171323+0000","last_active":"2024-09-12T18:01:49.411782+0000","last_peered":"2024-09-12T18:01:49.411782+0000","last_clean":"2024-09-12T18:01:49.411782+0000","last_became_active":"2024-09-12T17:23:48.170815+0000","last_became_peered":"2024-09-12T17:23:48.170815+0000","last_unstale":"2024-09-12T18:01:49.411782+0000","last_undegraded":"2024-09-12T18:01:49.411782+0000","last_fullsized":"2024-09-12T18:01:49.411782+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:19.299843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"261'127","reported_seq":616,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:17.186926+0000","last_change":"2024-09-12T17:23:50.190416+0000","last_active":"2024-09-12T18:00:17.186926+0000","last_peered":"2024-09-12T18:00:17.186926+0000","last_clean":"2024-09-12T18:00:17.186926+0000","last_became_active":"2024-09-12T17:23:50.190124+0000","last_became_peered":"2024-09-12T17:23:50.190124+0000","last_unstale":"2024-09-12T18:00:17.186926+0000","last_undegraded":"2024-09-12T18:00:17.186926+0000","last_fullsized":"2024-09-12T18:00:17.186926+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:39.676360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":181,"num_read_kb":172,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"261'818","reported_seq":2433,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.787899+0000","last_change":"2024-09-12T17:23:42.149931+0000","last_active":"2024-09-12T18:00:05.787899+0000","last_peered":"2024-09-12T18:00:05.787899+0000","last_clean":"2024-09-12T18:00:05.787899+0000","last_became_active":"2024-09-12T17:23:42.149314+0000","last_became_peered":"2024-09-12T17:23:42.149314+0000","last_unstale":"2024-09-12T18:00:05.787899+0000","last_undegraded":"2024-09-12T18:00:05.787899+0000","last_fullsized":"2024-09-12T18:00:05.787899+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:45.837125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4083,"num_read_kb":3703,"num_write":1086,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"261'234","reported_seq":855,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.874152+0000","last_change":"2024-09-12T17:23:40.710250+0000","last_active":"2024-09-12T17:59:58.874152+0000","last_peered":"2024-09-12T17:59:58.874152+0000","last_clean":"2024-09-12T17:59:58.874152+0000","last_became_active":"2024-09-12T17:23:40.709818+0000","last_became_peered":"2024-09-12T17:23:40.709818+0000","last_unstale":"2024-09-12T17:59:58.874152+0000","last_undegraded":"2024-09-12T17:59:58.874152+0000","last_fullsized":"2024-09-12T17:59:58.874152+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:49.203826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2657777,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":368,"num_read_kb":69858,"num_write":877,"num_write_kb":36096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.415126+0000","last_change":"2024-09-12T17:23:44.150481+0000","last_active":"2024-09-12T17:58:44.415126+0000","last_peered":"2024-09-12T17:58:44.415126+0000","last_clean":"2024-09-12T17:58:44.415126+0000","last_became_active":"2024-09-12T17:23:44.150183+0000","last_became_peered":"2024-09-12T17:23:44.150183+0000","last_unstale":"2024-09-12T17:58:44.415126+0000","last_undegraded":"2024-09-12T17:58:44.415126+0000","last_fullsized":"2024-09-12T17:58:44.415126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:11.304183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"261'310","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.398549+0000","last_change":"2024-09-12T17:23:46.145061+0000","last_active":"2024-09-12T18:01:42.398549+0000","last_peered":"2024-09-12T18:01:42.398549+0000","last_clean":"2024-09-12T18:01:42.398549+0000","last_became_active":"2024-09-12T17:23:46.144587+0000","last_became_peered":"2024-09-12T17:23:46.144587+0000","last_unstale":"2024-09-12T18:01:42.398549+0000","last_undegraded":"2024-09-12T18:01:42.398549+0000","last_fullsized":"2024-09-12T18:01:42.398549+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:07.704295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60479,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":492,"num_read_kb":1006,"num_write":412,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.531765+0000","last_change":"2024-09-12T17:23:48.171551+0000","last_active":"2024-09-12T17:57:39.531765+0000","last_peered":"2024-09-12T17:57:39.531765+0000","last_clean":"2024-09-12T17:57:39.531765+0000","last_became_active":"2024-09-12T17:23:48.171272+0000","last_became_peered":"2024-09-12T17:23:48.171272+0000","last_unstale":"2024-09-12T17:57:39.531765+0000","last_undegraded":"2024-09-12T17:57:39.531765+0000","last_fullsized":"2024-09-12T17:57:39.531765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:23.692378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"261'102","reported_seq":586,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.251581+0000","last_change":"2024-09-12T17:23:50.192154+0000","last_active":"2024-09-12T18:00:04.251581+0000","last_peered":"2024-09-12T18:00:04.251581+0000","last_clean":"2024-09-12T18:00:04.251581+0000","last_became_active":"2024-09-12T17:23:50.191859+0000","last_became_peered":"2024-09-12T17:23:50.191859+0000","last_unstale":"2024-09-12T18:00:04.251581+0000","last_undegraded":"2024-09-12T18:00:04.251581+0000","last_fullsized":"2024-09-12T18:00:04.251581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:55.936330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":141,"num_write":249,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"261'476","reported_seq":2056,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.920905+0000","last_change":"2024-09-12T17:23:42.149567+0000","last_active":"2024-09-12T18:00:02.920905+0000","last_peered":"2024-09-12T18:00:02.920905+0000","last_clean":"2024-09-12T18:00:02.920905+0000","last_became_active":"2024-09-12T17:23:42.149260+0000","last_became_peered":"2024-09-12T17:23:42.149260+0000","last_unstale":"2024-09-12T18:00:02.920905+0000","last_undegraded":"2024-09-12T18:00:02.920905+0000","last_fullsized":"2024-09-12T18:00:02.920905+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:03.397079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2426,"num_read_kb":2286,"num_write":546,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"261'317","reported_seq":976,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.506110+0000","last_change":"2024-09-12T17:23:40.711299+0000","last_active":"2024-09-12T17:59:27.506110+0000","last_peered":"2024-09-12T17:59:27.506110+0000","last_clean":"2024-09-12T17:59:27.506110+0000","last_became_active":"2024-09-12T17:23:40.711032+0000","last_became_peered":"2024-09-12T17:23:40.711032+0000","last_unstale":"2024-09-12T17:59:27.506110+0000","last_undegraded":"2024-09-12T17:59:27.506110+0000","last_fullsized":"2024-09-12T17:59:27.506110+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:01.273219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10115930,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":547,"num_read_kb":19508,"num_write":1237,"num_write_kb":28388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.414353+0000","last_change":"2024-09-12T17:23:44.148038+0000","last_active":"2024-09-12T17:58:44.414353+0000","last_peered":"2024-09-12T17:58:44.414353+0000","last_clean":"2024-09-12T17:58:44.414353+0000","last_became_active":"2024-09-12T17:23:44.147694+0000","last_became_peered":"2024-09-12T17:23:44.147694+0000","last_unstale":"2024-09-12T17:58:44.414353+0000","last_undegraded":"2024-09-12T17:58:44.414353+0000","last_fullsized":"2024-09-12T17:58:44.414353+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:06.022806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"261'255","reported_seq":801,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.399732+0000","last_change":"2024-09-12T17:23:46.152548+0000","last_active":"2024-09-12T18:01:42.399732+0000","last_peered":"2024-09-12T18:01:42.399732+0000","last_clean":"2024-09-12T18:01:42.399732+0000","last_became_active":"2024-09-12T17:23:46.152028+0000","last_became_peered":"2024-09-12T17:23:46.152028+0000","last_unstale":"2024-09-12T18:01:42.399732+0000","last_undegraded":"2024-09-12T18:01:42.399732+0000","last_fullsized":"2024-09-12T18:01:42.399732+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:32.403280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54478,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":404,"num_read_kb":859,"num_write":332,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.404087+0000","last_change":"2024-09-12T17:23:48.170790+0000","last_active":"2024-09-12T17:57:49.404087+0000","last_peered":"2024-09-12T17:57:49.404087+0000","last_clean":"2024-09-12T17:57:49.404087+0000","last_became_active":"2024-09-12T17:23:48.170452+0000","last_became_peered":"2024-09-12T17:23:48.170452+0000","last_unstale":"2024-09-12T17:57:49.404087+0000","last_undegraded":"2024-09-12T17:57:49.404087+0000","last_fullsized":"2024-09-12T17:57:49.404087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:31.197971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"261'126","reported_seq":628,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.113825+0000","last_change":"2024-09-12T17:23:50.641248+0000","last_active":"2024-09-12T18:00:02.113825+0000","last_peered":"2024-09-12T18:00:02.113825+0000","last_clean":"2024-09-12T18:00:02.113825+0000","last_became_active":"2024-09-12T17:23:50.640911+0000","last_became_peered":"2024-09-12T17:23:50.640911+0000","last_unstale":"2024-09-12T18:00:02.113825+0000","last_undegraded":"2024-09-12T18:00:02.113825+0000","last_fullsized":"2024-09-12T18:00:02.113825+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:33.080397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":307,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"261'389","reported_seq":1787,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.136439+0000","last_change":"2024-09-12T17:23:42.146348+0000","last_active":"2024-09-12T18:00:18.136439+0000","last_peered":"2024-09-12T18:00:18.136439+0000","last_clean":"2024-09-12T18:00:18.136439+0000","last_became_active":"2024-09-12T17:23:42.146055+0000","last_became_peered":"2024-09-12T17:23:42.146055+0000","last_unstale":"2024-09-12T18:00:18.136439+0000","last_undegraded":"2024-09-12T18:00:18.136439+0000","last_fullsized":"2024-09-12T18:00:18.136439+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:11.249424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1982,"num_read_kb":1877,"num_write":444,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"261'255","reported_seq":872,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.155848+0000","last_change":"2024-09-12T17:23:40.712278+0000","last_active":"2024-09-12T17:59:59.155848+0000","last_peered":"2024-09-12T17:59:59.155848+0000","last_clean":"2024-09-12T17:59:59.155848+0000","last_became_active":"2024-09-12T17:23:40.709759+0000","last_became_peered":"2024-09-12T17:23:40.709759+0000","last_unstale":"2024-09-12T17:59:59.155848+0000","last_undegraded":"2024-09-12T17:59:59.155848+0000","last_fullsized":"2024-09-12T17:59:59.155848+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.261512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10792869,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":391,"num_read_kb":23018,"num_write":1015,"num_write_kb":26757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404701+0000","last_change":"2024-09-12T17:23:44.147886+0000","last_active":"2024-09-12T17:57:34.404701+0000","last_peered":"2024-09-12T17:57:34.404701+0000","last_clean":"2024-09-12T17:57:34.404701+0000","last_became_active":"2024-09-12T17:23:44.147372+0000","last_became_peered":"2024-09-12T17:23:44.147372+0000","last_unstale":"2024-09-12T17:57:34.404701+0000","last_undegraded":"2024-09-12T17:57:34.404701+0000","last_fullsized":"2024-09-12T17:57:34.404701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:48.881691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"261'237","reported_seq":779,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.433036+0000","last_change":"2024-09-12T17:23:46.153298+0000","last_active":"2024-09-12T18:01:18.433036+0000","last_peered":"2024-09-12T18:01:18.433036+0000","last_clean":"2024-09-12T18:01:18.433036+0000","last_became_active":"2024-09-12T17:23:46.153024+0000","last_became_peered":"2024-09-12T17:23:46.153024+0000","last_unstale":"2024-09-12T18:01:18.433036+0000","last_undegraded":"2024-09-12T18:01:18.433036+0000","last_fullsized":"2024-09-12T18:01:18.433036+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:00.093006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54635,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":849,"num_write":328,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.415370+0000","last_change":"2024-09-12T17:23:48.172179+0000","last_active":"2024-09-12T17:58:49.415370+0000","last_peered":"2024-09-12T17:58:49.415370+0000","last_clean":"2024-09-12T17:58:49.415370+0000","last_became_active":"2024-09-12T17:23:48.171849+0000","last_became_peered":"2024-09-12T17:23:48.171849+0000","last_unstale":"2024-09-12T17:58:49.415370+0000","last_undegraded":"2024-09-12T17:58:49.415370+0000","last_fullsized":"2024-09-12T17:58:49.415370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:22.948863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"261'139","reported_seq":1240,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.442930+0000","last_change":"2024-09-12T17:23:50.187385+0000","last_active":"2024-09-12T18:00:18.442930+0000","last_peered":"2024-09-12T18:00:18.442930+0000","last_clean":"2024-09-12T18:00:18.442930+0000","last_became_active":"2024-09-12T17:23:50.187084+0000","last_became_peered":"2024-09-12T17:23:50.187084+0000","last_unstale":"2024-09-12T18:00:18.442930+0000","last_undegraded":"2024-09-12T18:00:18.442930+0000","last_fullsized":"2024-09-12T18:00:18.442930+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:15.188210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":862,"num_read_kb":842,"num_write":338,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"261'420","reported_seq":1870,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.767639+0000","last_change":"2024-09-12T17:23:42.136286+0000","last_active":"2024-09-12T18:00:15.767639+0000","last_peered":"2024-09-12T18:00:15.767639+0000","last_clean":"2024-09-12T18:00:15.767639+0000","last_became_active":"2024-09-12T17:23:42.135975+0000","last_became_peered":"2024-09-12T17:23:42.135975+0000","last_unstale":"2024-09-12T18:00:15.767639+0000","last_undegraded":"2024-09-12T18:00:15.767639+0000","last_fullsized":"2024-09-12T18:00:15.767639+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:39.052393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2123,"num_read_kb":2006,"num_write":479,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"261'315","reported_seq":957,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.546600+0000","last_change":"2024-09-12T17:23:40.714142+0000","last_active":"2024-09-12T18:01:49.546600+0000","last_peered":"2024-09-12T18:01:49.546600+0000","last_clean":"2024-09-12T18:01:49.546600+0000","last_became_active":"2024-09-12T17:23:40.713129+0000","last_became_peered":"2024-09-12T17:23:40.713129+0000","last_unstale":"2024-09-12T18:01:49.546600+0000","last_undegraded":"2024-09-12T18:01:49.546600+0000","last_fullsized":"2024-09-12T18:01:49.546600+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:41.054346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8589522,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":473,"num_read_kb":14033,"num_write":1174,"num_write_kb":28273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.404033+0000","last_change":"2024-09-12T17:23:44.151405+0000","last_active":"2024-09-12T17:57:39.404033+0000","last_peered":"2024-09-12T17:57:39.404033+0000","last_clean":"2024-09-12T17:57:39.404033+0000","last_became_active":"2024-09-12T17:23:44.151126+0000","last_became_peered":"2024-09-12T17:23:44.151126+0000","last_unstale":"2024-09-12T17:57:39.404033+0000","last_undegraded":"2024-09-12T17:57:39.404033+0000","last_fullsized":"2024-09-12T17:57:39.404033+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:22.113687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"261'279","reported_seq":849,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.434647+0000","last_change":"2024-09-12T17:23:46.153409+0000","last_active":"2024-09-12T18:01:19.434647+0000","last_peered":"2024-09-12T18:01:19.434647+0000","last_clean":"2024-09-12T18:01:19.434647+0000","last_became_active":"2024-09-12T17:23:46.153111+0000","last_became_peered":"2024-09-12T17:23:46.153111+0000","last_unstale":"2024-09-12T18:01:19.434647+0000","last_undegraded":"2024-09-12T18:01:19.434647+0000","last_fullsized":"2024-09-12T18:01:19.434647+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:10.838059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49755,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":444,"num_read_kb":886,"num_write":356,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.542675+0000","last_change":"2024-09-12T17:23:48.167442+0000","last_active":"2024-09-12T17:58:49.542675+0000","last_peered":"2024-09-12T17:58:49.542675+0000","last_clean":"2024-09-12T17:58:49.542675+0000","last_became_active":"2024-09-12T17:23:48.167070+0000","last_became_peered":"2024-09-12T17:23:48.167070+0000","last_unstale":"2024-09-12T17:58:49.542675+0000","last_undegraded":"2024-09-12T17:58:49.542675+0000","last_fullsized":"2024-09-12T17:58:49.542675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:57.449206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"261'83","reported_seq":563,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.396381+0000","last_change":"2024-09-12T17:23:50.179396+0000","last_active":"2024-09-12T18:01:41.396381+0000","last_peered":"2024-09-12T18:01:41.396381+0000","last_clean":"2024-09-12T18:01:41.396381+0000","last_became_active":"2024-09-12T17:23:50.179075+0000","last_became_peered":"2024-09-12T17:23:50.179075+0000","last_unstale":"2024-09-12T18:01:41.396381+0000","last_undegraded":"2024-09-12T18:01:41.396381+0000","last_fullsized":"2024-09-12T18:01:41.396381+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:17.064467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":88,"num_write":193,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"261'777","reported_seq":2261,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.397855+0000","last_change":"2024-09-12T17:23:42.137451+0000","last_active":"2024-09-12T18:01:41.397855+0000","last_peered":"2024-09-12T18:01:41.397855+0000","last_clean":"2024-09-12T18:01:41.397855+0000","last_became_active":"2024-09-12T17:23:42.137169+0000","last_became_peered":"2024-09-12T17:23:42.137169+0000","last_unstale":"2024-09-12T18:01:41.397855+0000","last_undegraded":"2024-09-12T18:01:41.397855+0000","last_fullsized":"2024-09-12T18:01:41.397855+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:08.945619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3876,"num_read_kb":3488,"num_write":1033,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"261'305","reported_seq":967,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:52.096361+0000","last_change":"2024-09-12T17:23:40.713502+0000","last_active":"2024-09-12T17:59:52.096361+0000","last_peered":"2024-09-12T17:59:52.096361+0000","last_clean":"2024-09-12T17:59:52.096361+0000","last_became_active":"2024-09-12T17:23:40.713212+0000","last_became_peered":"2024-09-12T17:23:40.713212+0000","last_unstale":"2024-09-12T17:59:52.096361+0000","last_undegraded":"2024-09-12T17:59:52.096361+0000","last_fullsized":"2024-09-12T17:59:52.096361+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:39.463517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1300247,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":543,"num_read_kb":38604,"num_write":1106,"num_write_kb":36037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"261'632","reported_seq":2095,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.230241+0000","last_change":"2024-09-12T17:24:17.227806+0000","last_active":"2024-09-12T18:00:05.230241+0000","last_peered":"2024-09-12T18:00:05.230241+0000","last_clean":"2024-09-12T18:00:05.230241+0000","last_became_active":"2024-09-12T17:24:17.227465+0000","last_became_peered":"2024-09-12T17:24:17.227465+0000","last_unstale":"2024-09-12T18:00:05.230241+0000","last_undegraded":"2024-09-12T18:00:05.230241+0000","last_fullsized":"2024-09-12T18:00:05.230241+0000","mapping_epoch":36,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":600,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:02.612199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3072,"num_read_kb":2745,"num_write":824,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"261'255","reported_seq":924,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.574317+0000","last_change":"2024-09-12T17:23:40.708395+0000","last_active":"2024-09-12T18:00:16.574317+0000","last_peered":"2024-09-12T18:00:16.574317+0000","last_clean":"2024-09-12T18:00:16.574317+0000","last_became_active":"2024-09-12T17:23:40.708064+0000","last_became_peered":"2024-09-12T17:23:40.708064+0000","last_unstale":"2024-09-12T18:00:16.574317+0000","last_undegraded":"2024-09-12T18:00:16.574317+0000","last_fullsized":"2024-09-12T18:00:16.574317+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:37.241857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24765059,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":437,"num_read_kb":78914,"num_write":936,"num_write_kb":50917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"261'842","reported_seq":2554,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.897301+0000","last_change":"2024-09-12T17:23:42.145251+0000","last_active":"2024-09-12T18:00:04.897301+0000","last_peered":"2024-09-12T18:00:04.897301+0000","last_clean":"2024-09-12T18:00:04.897301+0000","last_became_active":"2024-09-12T17:23:42.144919+0000","last_became_peered":"2024-09-12T17:23:42.144919+0000","last_unstale":"2024-09-12T18:00:04.897301+0000","last_undegraded":"2024-09-12T18:00:04.897301+0000","last_fullsized":"2024-09-12T18:00:04.897301+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:06.765117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4312,"num_read_kb":3919,"num_write":1107,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"261'264","reported_seq":904,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.605562+0000","last_change":"2024-09-12T17:23:40.715953+0000","last_active":"2024-09-12T18:00:02.605562+0000","last_peered":"2024-09-12T18:00:02.605562+0000","last_clean":"2024-09-12T18:00:02.605562+0000","last_became_active":"2024-09-12T17:23:40.715471+0000","last_became_peered":"2024-09-12T17:23:40.715471+0000","last_unstale":"2024-09-12T18:00:02.605562+0000","last_undegraded":"2024-09-12T18:00:02.605562+0000","last_fullsized":"2024-09-12T18:00:02.605562+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:42.149240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5684255,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":390,"num_read_kb":37845,"num_write":934,"num_write_kb":24242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"261'766","reported_seq":2207,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.398961+0000","last_change":"2024-09-12T17:23:42.143464+0000","last_active":"2024-09-12T18:01:41.398961+0000","last_peered":"2024-09-12T18:01:41.398961+0000","last_clean":"2024-09-12T18:01:41.398961+0000","last_became_active":"2024-09-12T17:23:42.142672+0000","last_became_peered":"2024-09-12T17:23:42.142672+0000","last_unstale":"2024-09-12T18:01:41.398961+0000","last_undegraded":"2024-09-12T18:01:41.398961+0000","last_fullsized":"2024-09-12T18:01:41.398961+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:24.449488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3573,"num_read_kb":3224,"num_write":1004,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"261'227","reported_seq":847,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.535155+0000","last_change":"2024-09-12T17:23:40.703276+0000","last_active":"2024-09-12T18:01:49.535155+0000","last_peered":"2024-09-12T18:01:49.535155+0000","last_clean":"2024-09-12T18:01:49.535155+0000","last_became_active":"2024-09-12T17:23:40.702991+0000","last_became_peered":"2024-09-12T17:23:40.702991+0000","last_unstale":"2024-09-12T18:01:49.535155+0000","last_undegraded":"2024-09-12T18:01:49.535155+0000","last_fullsized":"2024-09-12T18:01:49.535155+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:10.880499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17109169,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":372,"num_read_kb":57190,"num_write":822,"num_write_kb":43690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"261'412","reported_seq":1898,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559469+0000","last_change":"2024-09-12T17:23:42.147003+0000","last_active":"2024-09-12T18:00:18.559469+0000","last_peered":"2024-09-12T18:00:18.559469+0000","last_clean":"2024-09-12T18:00:18.559469+0000","last_became_active":"2024-09-12T17:23:42.146394+0000","last_became_peered":"2024-09-12T17:23:42.146394+0000","last_unstale":"2024-09-12T18:00:18.559469+0000","last_undegraded":"2024-09-12T18:00:18.559469+0000","last_fullsized":"2024-09-12T18:00:18.559469+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:36.451547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2184,"num_read_kb":2068,"num_write":471,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"261'293","reported_seq":1034,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.409420+0000","last_change":"2024-09-12T17:23:40.712996+0000","last_active":"2024-09-12T17:58:23.409420+0000","last_peered":"2024-09-12T17:58:23.409420+0000","last_clean":"2024-09-12T17:58:23.409420+0000","last_became_active":"2024-09-12T17:23:40.712702+0000","last_became_peered":"2024-09-12T17:23:40.712702+0000","last_unstale":"2024-09-12T17:58:23.409420+0000","last_undegraded":"2024-09-12T17:58:23.409420+0000","last_fullsized":"2024-09-12T17:58:23.409420+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:27.121297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16644326,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":653,"num_read_kb":69808,"num_write":1120,"num_write_kb":31106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"261'857","reported_seq":2441,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.776265+0000","last_change":"2024-09-12T17:23:42.143639+0000","last_active":"2024-09-12T18:00:15.776265+0000","last_peered":"2024-09-12T18:00:15.776265+0000","last_clean":"2024-09-12T18:00:15.776265+0000","last_became_active":"2024-09-12T17:23:42.141605+0000","last_became_peered":"2024-09-12T17:23:42.141605+0000","last_unstale":"2024-09-12T18:00:15.776265+0000","last_undegraded":"2024-09-12T18:00:15.776265+0000","last_fullsized":"2024-09-12T18:00:15.776265+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:51.809611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4009,"num_read_kb":3625,"num_write":1130,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"261'250","reported_seq":976,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:55.754138+0000","last_change":"2024-09-12T17:23:40.716113+0000","last_active":"2024-09-12T17:59:55.754138+0000","last_peered":"2024-09-12T17:59:55.754138+0000","last_clean":"2024-09-12T17:59:55.754138+0000","last_became_active":"2024-09-12T17:23:40.715809+0000","last_became_peered":"2024-09-12T17:23:40.715809+0000","last_unstale":"2024-09-12T17:59:55.754138+0000","last_undegraded":"2024-09-12T17:59:55.754138+0000","last_fullsized":"2024-09-12T17:59:55.754138+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:47.361193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10487171,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":687,"num_read_kb":58572,"num_write":976,"num_write_kb":36244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"261'1242","reported_seq":2732,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.227974+0000","last_change":"2024-09-12T17:23:42.155774+0000","last_active":"2024-09-12T18:00:05.227974+0000","last_peered":"2024-09-12T18:00:05.227974+0000","last_clean":"2024-09-12T18:00:05.227974+0000","last_became_active":"2024-09-12T17:23:42.155489+0000","last_became_peered":"2024-09-12T17:23:42.155489+0000","last_unstale":"2024-09-12T18:00:05.227974+0000","last_undegraded":"2024-09-12T18:00:05.227974+0000","last_fullsized":"2024-09-12T18:00:05.227974+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:36.957522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5619,"num_read_kb":4947,"num_write":1761,"num_write_kb":787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"261'302","reported_seq":929,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.846138+0000","last_change":"2024-09-12T17:23:40.704880+0000","last_active":"2024-09-12T18:00:16.846138+0000","last_peered":"2024-09-12T18:00:16.846138+0000","last_clean":"2024-09-12T18:00:16.846138+0000","last_became_active":"2024-09-12T17:23:40.704582+0000","last_became_peered":"2024-09-12T17:23:40.704582+0000","last_unstale":"2024-09-12T18:00:16.846138+0000","last_undegraded":"2024-09-12T18:00:16.846138+0000","last_fullsized":"2024-09-12T18:00:16.846138+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:16.868554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13648727,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":476,"num_read_kb":13831,"num_write":1096,"num_write_kb":46857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"261'752","reported_seq":2383,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:01.852133+0000","last_change":"2024-09-12T17:23:42.141856+0000","last_active":"2024-09-12T18:00:01.852133+0000","last_peered":"2024-09-12T18:00:01.852133+0000","last_clean":"2024-09-12T18:00:01.852133+0000","last_became_active":"2024-09-12T17:23:42.141542+0000","last_became_peered":"2024-09-12T17:23:42.141542+0000","last_unstale":"2024-09-12T18:00:01.852133+0000","last_undegraded":"2024-09-12T18:00:01.852133+0000","last_fullsized":"2024-09-12T18:00:01.852133+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:24.628553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3956,"num_read_kb":3681,"num_write":1110,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"261'313","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:53.737394+0000","last_change":"2024-09-12T17:24:17.227402+0000","last_active":"2024-09-12T17:59:53.737394+0000","last_peered":"2024-09-12T17:59:53.737394+0000","last_clean":"2024-09-12T17:59:53.737394+0000","last_became_active":"2024-09-12T17:24:17.227082+0000","last_became_peered":"2024-09-12T17:24:17.227082+0000","last_unstale":"2024-09-12T17:59:53.737394+0000","last_undegraded":"2024-09-12T17:59:53.737394+0000","last_fullsized":"2024-09-12T17:59:53.737394+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:39.821544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3033,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":567,"num_read_kb":9829,"num_write":1382,"num_write_kb":18369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"261'766","reported_seq":2160,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.407235+0000","last_change":"2024-09-12T17:23:42.155753+0000","last_active":"2024-09-12T18:01:41.407235+0000","last_peered":"2024-09-12T18:01:41.407235+0000","last_clean":"2024-09-12T18:01:41.407235+0000","last_became_active":"2024-09-12T17:23:42.155052+0000","last_became_peered":"2024-09-12T17:23:42.155052+0000","last_unstale":"2024-09-12T18:01:41.407235+0000","last_undegraded":"2024-09-12T18:01:41.407235+0000","last_fullsized":"2024-09-12T18:01:41.407235+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:06.879341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3588,"num_read_kb":3224,"num_write":1013,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"261'283","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.602552+0000","last_change":"2024-09-12T17:23:40.707697+0000","last_active":"2024-09-12T18:00:05.602552+0000","last_peered":"2024-09-12T18:00:05.602552+0000","last_clean":"2024-09-12T18:00:05.602552+0000","last_became_active":"2024-09-12T17:23:40.707220+0000","last_became_peered":"2024-09-12T17:23:40.707220+0000","last_unstale":"2024-09-12T18:00:05.602552+0000","last_undegraded":"2024-09-12T18:00:05.602552+0000","last_fullsized":"2024-09-12T18:00:05.602552+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:32.088764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16446959,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":613,"num_read_kb":59084,"num_write":1062,"num_write_kb":27945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"261'437","reported_seq":1932,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.785671+0000","last_change":"2024-09-12T17:23:42.135161+0000","last_active":"2024-09-12T18:00:05.785671+0000","last_peered":"2024-09-12T18:00:05.785671+0000","last_clean":"2024-09-12T18:00:05.785671+0000","last_became_active":"2024-09-12T17:23:42.134859+0000","last_became_peered":"2024-09-12T17:23:42.134859+0000","last_unstale":"2024-09-12T18:00:05.785671+0000","last_undegraded":"2024-09-12T18:00:05.785671+0000","last_fullsized":"2024-09-12T18:00:05.785671+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:02.200019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2327,"num_read_kb":2188,"num_write":509,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"261'276","reported_seq":909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.144545+0000","last_change":"2024-09-12T17:23:40.711309+0000","last_active":"2024-09-12T17:59:59.144545+0000","last_peered":"2024-09-12T17:59:59.144545+0000","last_clean":"2024-09-12T17:59:59.144545+0000","last_became_active":"2024-09-12T17:23:40.711042+0000","last_became_peered":"2024-09-12T17:23:40.711042+0000","last_unstale":"2024-09-12T17:59:59.144545+0000","last_undegraded":"2024-09-12T17:59:59.144545+0000","last_fullsized":"2024-09-12T17:59:59.144545+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:52.925495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5649623,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":483,"num_read_kb":6765,"num_write":1118,"num_write_kb":43884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"261'951","reported_seq":2509,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.982322+0000","last_change":"2024-09-12T17:23:42.141720+0000","last_active":"2024-09-12T18:00:03.982322+0000","last_peered":"2024-09-12T18:00:03.982322+0000","last_clean":"2024-09-12T18:00:03.982322+0000","last_became_active":"2024-09-12T17:23:42.141379+0000","last_became_peered":"2024-09-12T17:23:42.141379+0000","last_unstale":"2024-09-12T18:00:03.982322+0000","last_undegraded":"2024-09-12T18:00:03.982322+0000","last_fullsized":"2024-09-12T18:00:03.982322+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:42.201491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4545,"num_read_kb":4064,"num_write":1359,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"261'328","reported_seq":954,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:01.938308+0000","last_change":"2024-09-12T17:23:40.704486+0000","last_active":"2024-09-12T18:00:01.938308+0000","last_peered":"2024-09-12T18:00:01.938308+0000","last_clean":"2024-09-12T18:00:01.938308+0000","last_became_active":"2024-09-12T17:23:40.702825+0000","last_became_peered":"2024-09-12T17:23:40.702825+0000","last_unstale":"2024-09-12T18:00:01.938308+0000","last_undegraded":"2024-09-12T18:00:01.938308+0000","last_fullsized":"2024-09-12T18:00:01.938308+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:59.455771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":275287,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":579,"num_read_kb":541,"num_write":1109,"num_write_kb":8662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"261'394","reported_seq":1802,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.719075+0000","last_change":"2024-09-12T17:23:42.140485+0000","last_active":"2024-09-12T18:00:03.719075+0000","last_peered":"2024-09-12T18:00:03.719075+0000","last_clean":"2024-09-12T18:00:03.719075+0000","last_became_active":"2024-09-12T17:23:42.139735+0000","last_became_peered":"2024-09-12T17:23:42.139735+0000","last_unstale":"2024-09-12T18:00:03.719075+0000","last_undegraded":"2024-09-12T18:00:03.719075+0000","last_fullsized":"2024-09-12T18:00:03.719075+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:08.857406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2037,"num_read_kb":1920,"num_write":445,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"261'283","reported_seq":944,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.542185+0000","last_change":"2024-09-12T17:23:40.709866+0000","last_active":"2024-09-12T18:01:49.542185+0000","last_peered":"2024-09-12T18:01:49.542185+0000","last_clean":"2024-09-12T18:01:49.542185+0000","last_became_active":"2024-09-12T17:23:40.709392+0000","last_became_peered":"2024-09-12T17:23:40.709392+0000","last_unstale":"2024-09-12T18:01:49.542185+0000","last_undegraded":"2024-09-12T18:01:49.542185+0000","last_fullsized":"2024-09-12T18:01:49.542185+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:11.200927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12947734,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":457,"num_read_kb":64698,"num_write":1081,"num_write_kb":39876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"261'1133","reported_seq":2665,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.137309+0000","last_change":"2024-09-12T17:23:42.154482+0000","last_active":"2024-09-12T18:00:18.137309+0000","last_peered":"2024-09-12T18:00:18.137309+0000","last_clean":"2024-09-12T18:00:18.137309+0000","last_became_active":"2024-09-12T17:23:42.154127+0000","last_became_peered":"2024-09-12T17:23:42.154127+0000","last_unstale":"2024-09-12T18:00:18.137309+0000","last_undegraded":"2024-09-12T18:00:18.137309+0000","last_fullsized":"2024-09-12T18:00:18.137309+0000","mapping_epoch":25,"log_start":"261'1100","ondisk_log_start":"261'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:39.681068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5169,"num_read_kb":4583,"num_write":1562,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"261'283","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.030587+0000","last_change":"2024-09-12T17:23:40.714617+0000","last_active":"2024-09-12T18:00:05.030587+0000","last_peered":"2024-09-12T18:00:05.030587+0000","last_clean":"2024-09-12T18:00:05.030587+0000","last_became_active":"2024-09-12T17:23:40.714343+0000","last_became_peered":"2024-09-12T17:23:40.714343+0000","last_unstale":"2024-09-12T18:00:05.030587+0000","last_undegraded":"2024-09-12T18:00:05.030587+0000","last_fullsized":"2024-09-12T18:00:05.030587+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:08.542048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5254957,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":548,"num_read_kb":27408,"num_write":1157,"num_write_kb":25060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"261'994","reported_seq":2614,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.219834+0000","last_change":"2024-09-12T17:23:42.146400+0000","last_active":"2024-09-12T18:00:05.219834+0000","last_peered":"2024-09-12T18:00:05.219834+0000","last_clean":"2024-09-12T18:00:05.219834+0000","last_became_active":"2024-09-12T17:23:42.146107+0000","last_became_peered":"2024-09-12T17:23:42.146107+0000","last_unstale":"2024-09-12T18:00:05.219834+0000","last_undegraded":"2024-09-12T18:00:05.219834+0000","last_fullsized":"2024-09-12T18:00:05.219834+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:14.764258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4676,"num_read_kb":4145,"num_write":1343,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"261'259","reported_seq":901,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.704801+0000","last_change":"2024-09-12T17:23:40.707232+0000","last_active":"2024-09-12T18:00:04.704801+0000","last_peered":"2024-09-12T18:00:04.704801+0000","last_clean":"2024-09-12T18:00:04.704801+0000","last_became_active":"2024-09-12T17:23:40.706951+0000","last_became_peered":"2024-09-12T17:23:40.706951+0000","last_unstale":"2024-09-12T18:00:04.704801+0000","last_undegraded":"2024-09-12T18:00:04.704801+0000","last_fullsized":"2024-09-12T18:00:04.704801+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:17.981456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17691166,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":463,"num_read_kb":7213,"num_write":904,"num_write_kb":28374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"261'489","reported_seq":1993,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.982703+0000","last_change":"2024-09-12T17:23:42.153312+0000","last_active":"2024-09-12T18:00:03.982703+0000","last_peered":"2024-09-12T18:00:03.982703+0000","last_clean":"2024-09-12T18:00:03.982703+0000","last_became_active":"2024-09-12T17:23:42.152999+0000","last_became_peered":"2024-09-12T17:23:42.152999+0000","last_unstale":"2024-09-12T18:00:03.982703+0000","last_undegraded":"2024-09-12T18:00:03.982703+0000","last_fullsized":"2024-09-12T18:00:03.982703+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:03.127915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2525,"num_read_kb":2342,"num_write":624,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"261'279","reported_seq":896,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:56.793678+0000","last_change":"2024-09-12T17:23:40.705092+0000","last_active":"2024-09-12T17:59:56.793678+0000","last_peered":"2024-09-12T17:59:56.793678+0000","last_clean":"2024-09-12T17:59:56.793678+0000","last_became_active":"2024-09-12T17:23:40.704585+0000","last_became_peered":"2024-09-12T17:23:40.704585+0000","last_unstale":"2024-09-12T17:59:56.793678+0000","last_undegraded":"2024-09-12T17:59:56.793678+0000","last_fullsized":"2024-09-12T17:59:56.793678+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:15.307799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298013,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":395,"num_read_kb":452,"num_write":1033,"num_write_kb":34111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"261'439","reported_seq":2020,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.777791+0000","last_change":"2024-09-12T17:23:42.154717+0000","last_active":"2024-09-12T18:00:15.777791+0000","last_peered":"2024-09-12T18:00:15.777791+0000","last_clean":"2024-09-12T18:00:15.777791+0000","last_became_active":"2024-09-12T17:23:42.154367+0000","last_became_peered":"2024-09-12T17:23:42.154367+0000","last_unstale":"2024-09-12T18:00:15.777791+0000","last_undegraded":"2024-09-12T18:00:15.777791+0000","last_fullsized":"2024-09-12T18:00:15.777791+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:21.496903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2387,"num_read_kb":2268,"num_write":501,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"261'332","reported_seq":935,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.882744+0000","last_change":"2024-09-12T17:24:17.287754+0000","last_active":"2024-09-12T18:01:36.882744+0000","last_peered":"2024-09-12T18:01:36.882744+0000","last_clean":"2024-09-12T18:01:36.882744+0000","last_became_active":"2024-09-12T17:24:17.287516+0000","last_became_peered":"2024-09-12T17:24:17.287516+0000","last_unstale":"2024-09-12T18:01:36.882744+0000","last_undegraded":"2024-09-12T18:01:36.882744+0000","last_fullsized":"2024-09-12T18:01:36.882744+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:04.002445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1983283,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":519,"num_read_kb":2150,"num_write":1146,"num_write_kb":17735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"261'294","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.046378+0000","last_change":"2024-09-12T17:23:40.706233+0000","last_active":"2024-09-12T18:00:05.046378+0000","last_peered":"2024-09-12T18:00:05.046378+0000","last_clean":"2024-09-12T18:00:05.046378+0000","last_became_active":"2024-09-12T17:23:40.705975+0000","last_became_peered":"2024-09-12T17:23:40.705975+0000","last_unstale":"2024-09-12T18:00:05.046378+0000","last_undegraded":"2024-09-12T18:00:05.046378+0000","last_fullsized":"2024-09-12T18:00:05.046378+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:14.609978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8493877,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":558,"num_read_kb":38544,"num_write":1107,"num_write_kb":29966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"261'887","reported_seq":2649,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.400463+0000","last_change":"2024-09-12T17:23:42.156067+0000","last_active":"2024-09-12T18:01:41.400463+0000","last_peered":"2024-09-12T18:01:41.400463+0000","last_clean":"2024-09-12T18:01:41.400463+0000","last_became_active":"2024-09-12T17:23:42.155431+0000","last_became_peered":"2024-09-12T17:23:42.155431+0000","last_unstale":"2024-09-12T18:01:41.400463+0000","last_undegraded":"2024-09-12T18:01:41.400463+0000","last_fullsized":"2024-09-12T18:01:41.400463+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:57.623164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4337,"num_read_kb":3945,"num_write":1177,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"261'259","reported_seq":904,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.577657+0000","last_change":"2024-09-12T17:23:40.714200+0000","last_active":"2024-09-12T18:00:16.577657+0000","last_peered":"2024-09-12T18:00:16.577657+0000","last_clean":"2024-09-12T18:00:16.577657+0000","last_became_active":"2024-09-12T17:23:40.713729+0000","last_became_peered":"2024-09-12T17:23:40.713729+0000","last_unstale":"2024-09-12T18:00:16.577657+0000","last_undegraded":"2024-09-12T18:00:16.577657+0000","last_fullsized":"2024-09-12T18:00:16.577657+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:29.670887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11936418,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":409,"num_read_kb":88924,"num_write":941,"num_write_kb":31954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"261'919","reported_seq":2505,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.399527+0000","last_change":"2024-09-12T17:23:42.151306+0000","last_active":"2024-09-12T18:01:41.399527+0000","last_peered":"2024-09-12T18:01:41.399527+0000","last_clean":"2024-09-12T18:01:41.399527+0000","last_became_active":"2024-09-12T17:23:42.151035+0000","last_became_peered":"2024-09-12T17:23:42.151035+0000","last_unstale":"2024-09-12T18:01:41.399527+0000","last_undegraded":"2024-09-12T18:01:41.399527+0000","last_fullsized":"2024-09-12T18:01:41.399527+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":900,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:08.657281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4231,"num_read_kb":3788,"num_write":1202,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6418,"num_read_kb":4664,"num_write":2041,"num_write_kb":938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1112,"ondisk_log_size":1112,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16069,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16200,"num_read_kb":15888,"num_write":16774,"num_write_kb":4891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1650,"ondisk_log_size":1650,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":665,"ondisk_log_size":665,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1866102,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":16527,"num_read_kb":32201,"num_write":13993,"num_write_kb":11365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3284992,"data_stored":2749168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2337,"ondisk_log_size":2337,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2424,"num_read_kb":2890,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212759,"num_read_kb":194564,"num_write":55413,"num_write_kb":18856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3940,"ondisk_log_size":3940,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":552032445,"num_objects":4349,"num_object_clones":0,"num_object_copies":8698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4349,"num_whiteouts":0,"num_read":32110,"num_read_kb":2097905,"num_write":68413,"num_write_kb":2176823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1131245568,"data_stored":1098822149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4032,"ondisk_log_size":4032,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":63021491,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":125,"num_read_kb":196116,"num_write":140,"num_write_kb":127401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126050304,"data_stored":126042982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":63021491,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":119,"num_read_kb":185777,"num_write":140,"num_write_kb":127401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126050304,"data_stored":126042982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509904,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484396,"kb_used_data":218588,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93887444,"statfs":{"total":96636764160,"available":96140742656,"internally_reserved":0,"allocated":223834112,"data_stored":217289232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":272169418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509904,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322200,"kb_used_data":92488,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94049640,"statfs":{"total":96636764160,"available":96306831360,"internally_reserved":0,"allocated":94707712,"data_stored":90280003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509905,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":337764,"kb_used_data":220564,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94034076,"statfs":{"total":96636764160,"available":96290893824,"internally_reserved":0,"allocated":225857536,"data_stored":219438838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509905,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":230236,"kb_used_data":167116,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94141604,"statfs":{"total":96636764160,"available":96401002496,"internally_reserved":0,"allocated":171126784,"data_stored":164811483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509904,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274508,"kb_used_data":135100,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94097332,"statfs":{"total":96636764160,"available":96355667968,"internally_reserved":0,"allocated":138342400,"data_stored":133976523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509906,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":464828,"kb_used_data":217132,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":93907012,"statfs":{"total":96636764160,"available":96160780288,"internally_reserved":0,"allocated":222343168,"data_stored":216203904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253622727},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542609,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":501660,"kb_used_data":235916,"kb_used_omap":1,"kb_used_meta":265726,"kb_avail":93870180,"statfs":{"total":96636764160,"available":96123064320,"internally_reserved":0,"allocated":241577984,"data_stored":235285808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272103879},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542610,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":197288,"kb_used_data":112024,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94174552,"statfs":{"total":96636764160,"available":96434741248,"internally_reserved":0,"allocated":114712576,"data_stored":110227029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":161869824,"data_stored":157576671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84967424,"data_stored":82120971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":88948736,"data_stored":85949828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":205901824,"data_stored":201166395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":131698688,"data_stored":126861003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180600832,"data_stored":175786629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69812224,"data_stored":66888939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":207446016,"data_stored":202471713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":340771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":390760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":132593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":463531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":76234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":576021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":255236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":514022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":3790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8391821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6332416,"data_stored":6331601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27308032,"data_stored":27306334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17891328,"data_stored":17889365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15732736,"data_stored":15731852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11595776,"data_stored":11594697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20974732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29425664,"data_stored":29423702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13635584,"data_stored":13634700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25206784,"data_stored":25205969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8450048,"data_stored":8448969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5287936,"data_stored":5286238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:01:51.513 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:01:51.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:01:51.859 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-12T18:01:51.861 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":1408,"stamp":"2024-09-12T18:01:50.480833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":680549778,"num_objects":4864,"num_object_clones":0,"num_object_copies":9728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4864,"num_whiteouts":0,"num_read":286760,"num_read_kb":2730072,"num_write":157057,"num_write_kb":2469331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13989,"ondisk_log_size":13989,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2812880,"kb_used_data":1398928,"kb_used_omap":12,"kb_used_meta":1413811,"kb_avail":752161840,"statfs":{"total":773094113280,"available":770213724160,"internally_reserved":0,"allocated":1432502272,"data_stored":1387512820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1447743027},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5244214,"num_objects":-58,"num_object_clones":0,"num_object_copies":-116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-58,"num_whiteouts":0,"num_read":504,"num_read_kb":450,"num_write":162,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005093"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412189+0000","last_change":"2024-09-12T17:50:58.430620+0000","last_active":"2024-09-12T17:58:29.412189+0000","last_peered":"2024-09-12T17:58:29.412189+0000","last_clean":"2024-09-12T17:58:29.412189+0000","last_became_active":"2024-09-12T17:50:58.430327+0000","last_became_peered":"2024-09-12T17:50:58.430327+0000","last_unstale":"2024-09-12T17:58:29.412189+0000","last_undegraded":"2024-09-12T17:58:29.412189+0000","last_fullsized":"2024-09-12T17:58:29.412189+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:08.467218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"261'9","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.407973+0000","last_change":"2024-09-12T17:40:30.414114+0000","last_active":"2024-09-12T17:57:59.407973+0000","last_peered":"2024-09-12T17:57:59.407973+0000","last_clean":"2024-09-12T17:57:59.407973+0000","last_became_active":"2024-09-12T17:40:30.413466+0000","last_became_peered":"2024-09-12T17:40:30.413466+0000","last_unstale":"2024-09-12T17:57:59.407973+0000","last_undegraded":"2024-09-12T17:57:59.407973+0000","last_fullsized":"2024-09-12T17:57:59.407973+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:13.588006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":14338,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'1","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:58.405640+0000","last_change":"2024-09-12T17:40:27.384339+0000","last_active":"2024-09-12T17:57:58.405640+0000","last_peered":"2024-09-12T17:57:58.405640+0000","last_clean":"2024-09-12T17:57:58.405640+0000","last_became_active":"2024-09-12T17:40:27.384052+0000","last_became_peered":"2024-09-12T17:40:27.384052+0000","last_unstale":"2024-09-12T17:57:58.405640+0000","last_undegraded":"2024-09-12T17:57:58.405640+0000","last_fullsized":"2024-09-12T17:57:58.405640+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:44.943293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"261'180","reported_seq":604,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.550175+0000","last_change":"2024-09-12T17:38:51.209021+0000","last_active":"2024-09-12T17:59:44.550175+0000","last_peered":"2024-09-12T17:59:44.550175+0000","last_clean":"2024-09-12T17:59:44.550175+0000","last_became_active":"2024-09-12T17:38:51.208740+0000","last_became_peered":"2024-09-12T17:38:51.208740+0000","last_unstale":"2024-09-12T17:59:44.550175+0000","last_undegraded":"2024-09-12T17:59:44.550175+0000","last_fullsized":"2024-09-12T17:59:44.550175+0000","mapping_epoch":248,"log_start":"258'100","ondisk_log_start":"258'100","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:15.411282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1105,"num_read_kb":819,"num_write":215,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612242+0000","last_change":"2024-09-12T17:50:58.429515+0000","last_active":"2024-09-12T17:58:28.612242+0000","last_peered":"2024-09-12T17:58:28.612242+0000","last_clean":"2024-09-12T17:58:28.612242+0000","last_became_active":"2024-09-12T17:50:58.429172+0000","last_became_peered":"2024-09-12T17:50:58.429172+0000","last_unstale":"2024-09-12T17:58:28.612242+0000","last_undegraded":"2024-09-12T17:58:28.612242+0000","last_fullsized":"2024-09-12T17:58:28.612242+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:58.887773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"261'1","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:04.409165+0000","last_change":"2024-09-12T17:40:30.419563+0000","last_active":"2024-09-12T17:58:04.409165+0000","last_peered":"2024-09-12T17:58:04.409165+0000","last_clean":"2024-09-12T17:58:04.409165+0000","last_became_active":"2024-09-12T17:40:30.419270+0000","last_became_peered":"2024-09-12T17:40:30.419270+0000","last_unstale":"2024-09-12T17:58:04.409165+0000","last_undegraded":"2024-09-12T17:58:04.409165+0000","last_fullsized":"2024-09-12T17:58:04.409165+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:40.594940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":118,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.407054+0000","last_change":"2024-09-12T17:40:27.383763+0000","last_active":"2024-09-12T17:57:59.407054+0000","last_peered":"2024-09-12T17:57:59.407054+0000","last_clean":"2024-09-12T17:57:59.407054+0000","last_became_active":"2024-09-12T17:40:27.383464+0000","last_became_peered":"2024-09-12T17:40:27.383464+0000","last_unstale":"2024-09-12T17:57:59.407054+0000","last_undegraded":"2024-09-12T17:57:59.407054+0000","last_fullsized":"2024-09-12T17:57:59.407054+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:17.860149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"261'20","reported_seq":98,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.513810+0000","last_change":"2024-09-12T17:38:51.217668+0000","last_active":"2024-09-12T17:59:54.513810+0000","last_peered":"2024-09-12T17:59:54.513810+0000","last_clean":"2024-09-12T17:59:54.513810+0000","last_became_active":"2024-09-12T17:38:51.217312+0000","last_became_peered":"2024-09-12T17:38:51.217312+0000","last_unstale":"2024-09-12T17:59:54.513810+0000","last_undegraded":"2024-09-12T17:59:54.513810+0000","last_fullsized":"2024-09-12T17:59:54.513810+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:44.870657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":68,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.407763+0000","last_change":"2024-09-12T17:50:58.425626+0000","last_active":"2024-09-12T17:58:14.407763+0000","last_peered":"2024-09-12T17:58:14.407763+0000","last_clean":"2024-09-12T17:58:14.407763+0000","last_became_active":"2024-09-12T17:50:58.425202+0000","last_became_peered":"2024-09-12T17:50:58.425202+0000","last_unstale":"2024-09-12T17:58:14.407763+0000","last_undegraded":"2024-09-12T17:58:14.407763+0000","last_fullsized":"2024-09-12T17:58:14.407763+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:43.003436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546433+0000","last_change":"2024-09-12T17:40:30.428077+0000","last_active":"2024-09-12T17:59:19.546433+0000","last_peered":"2024-09-12T17:59:19.546433+0000","last_clean":"2024-09-12T17:59:19.546433+0000","last_became_active":"2024-09-12T17:40:30.427798+0000","last_became_peered":"2024-09-12T17:40:30.427798+0000","last_unstale":"2024-09-12T17:59:19.546433+0000","last_undegraded":"2024-09-12T17:59:19.546433+0000","last_fullsized":"2024-09-12T17:59:19.546433+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:08.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612294+0000","last_change":"2024-09-12T17:40:27.381742+0000","last_active":"2024-09-12T17:58:28.612294+0000","last_peered":"2024-09-12T17:58:28.612294+0000","last_clean":"2024-09-12T17:58:28.612294+0000","last_became_active":"2024-09-12T17:40:27.381456+0000","last_became_peered":"2024-09-12T17:40:27.381456+0000","last_unstale":"2024-09-12T17:58:28.612294+0000","last_undegraded":"2024-09-12T17:58:28.612294+0000","last_fullsized":"2024-09-12T17:58:28.612294+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:34.919045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"261'39","reported_seq":146,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:54.543334+0000","last_change":"2024-09-12T17:38:51.212514+0000","last_active":"2024-09-12T17:58:54.543334+0000","last_peered":"2024-09-12T17:58:54.543334+0000","last_clean":"2024-09-12T17:58:54.543334+0000","last_became_active":"2024-09-12T17:38:51.212222+0000","last_became_peered":"2024-09-12T17:38:51.212222+0000","last_unstale":"2024-09-12T17:58:54.543334+0000","last_undegraded":"2024-09-12T17:58:54.543334+0000","last_fullsized":"2024-09-12T17:58:54.543334+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:58.957926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":132,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.408592+0000","last_change":"2024-09-12T17:50:58.422072+0000","last_active":"2024-09-12T17:58:18.408592+0000","last_peered":"2024-09-12T17:58:18.408592+0000","last_clean":"2024-09-12T17:58:18.408592+0000","last_became_active":"2024-09-12T17:50:58.421791+0000","last_became_peered":"2024-09-12T17:50:58.421791+0000","last_unstale":"2024-09-12T17:58:18.408592+0000","last_undegraded":"2024-09-12T17:58:18.408592+0000","last_fullsized":"2024-09-12T17:58:18.408592+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:23.289873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'2","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546421+0000","last_change":"2024-09-12T17:41:17.634582+0000","last_active":"2024-09-12T17:59:19.546421+0000","last_peered":"2024-09-12T17:59:19.546421+0000","last_clean":"2024-09-12T17:59:19.546421+0000","last_became_active":"2024-09-12T17:41:17.634263+0000","last_became_peered":"2024-09-12T17:41:17.634263+0000","last_unstale":"2024-09-12T17:59:19.546421+0000","last_undegraded":"2024-09-12T17:59:19.546421+0000","last_fullsized":"2024-09-12T17:59:19.546421+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:21.737434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1f","version":"261'1","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418618+0000","last_change":"2024-09-12T17:40:27.381866+0000","last_active":"2024-09-12T17:59:14.418618+0000","last_peered":"2024-09-12T17:59:14.418618+0000","last_clean":"2024-09-12T17:59:14.418618+0000","last_became_active":"2024-09-12T17:40:27.381587+0000","last_became_peered":"2024-09-12T17:40:27.381587+0000","last_unstale":"2024-09-12T17:59:14.418618+0000","last_undegraded":"2024-09-12T17:59:14.418618+0000","last_fullsized":"2024-09-12T17:59:14.418618+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:05.484868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"261'16","reported_seq":86,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:53.414258+0000","last_change":"2024-09-12T17:38:51.211725+0000","last_active":"2024-09-12T17:58:53.414258+0000","last_peered":"2024-09-12T17:58:53.414258+0000","last_clean":"2024-09-12T17:58:53.414258+0000","last_became_active":"2024-09-12T17:38:51.211429+0000","last_became_peered":"2024-09-12T17:38:51.211429+0000","last_unstale":"2024-09-12T17:58:53.414258+0000","last_undegraded":"2024-09-12T17:58:53.414258+0000","last_fullsized":"2024-09-12T17:58:53.414258+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:51.433082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":53,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:03.415591+0000","last_change":"2024-09-12T17:50:58.425178+0000","last_active":"2024-09-12T17:59:03.415591+0000","last_peered":"2024-09-12T17:59:03.415591+0000","last_clean":"2024-09-12T17:59:03.415591+0000","last_became_active":"2024-09-12T17:50:58.424898+0000","last_became_peered":"2024-09-12T17:50:58.424898+0000","last_unstale":"2024-09-12T17:59:03.415591+0000","last_undegraded":"2024-09-12T17:59:03.415591+0000","last_fullsized":"2024-09-12T17:59:03.415591+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:43.460057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.403387+0000","last_change":"2024-09-12T17:40:30.419273+0000","last_active":"2024-09-12T17:57:29.403387+0000","last_peered":"2024-09-12T17:57:29.403387+0000","last_clean":"2024-09-12T17:57:29.403387+0000","last_became_active":"2024-09-12T17:40:30.418865+0000","last_became_peered":"2024-09-12T17:40:30.418865+0000","last_unstale":"2024-09-12T17:57:29.403387+0000","last_undegraded":"2024-09-12T17:57:29.403387+0000","last_fullsized":"2024-09-12T17:57:29.403387+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:37.865615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'7","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:24.529144+0000","last_change":"2024-09-12T17:40:27.384760+0000","last_active":"2024-09-12T17:57:24.529144+0000","last_peered":"2024-09-12T17:57:24.529144+0000","last_clean":"2024-09-12T17:57:24.529144+0000","last_became_active":"2024-09-12T17:40:27.384445+0000","last_became_peered":"2024-09-12T17:40:27.384445+0000","last_unstale":"2024-09-12T17:57:24.529144+0000","last_undegraded":"2024-09-12T17:57:24.529144+0000","last_fullsized":"2024-09-12T17:57:24.529144+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:48.815935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":14338,"num_write":17,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"261'42","reported_seq":159,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.511172+0000","last_change":"2024-09-12T17:38:51.217731+0000","last_active":"2024-09-12T17:59:16.511172+0000","last_peered":"2024-09-12T17:59:16.511172+0000","last_clean":"2024-09-12T17:59:16.511172+0000","last_became_active":"2024-09-12T17:38:51.217421+0000","last_became_peered":"2024-09-12T17:38:51.217421+0000","last_unstale":"2024-09-12T17:59:16.511172+0000","last_undegraded":"2024-09-12T17:59:16.511172+0000","last_fullsized":"2024-09-12T17:59:16.511172+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:29.905573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":155,"num_write":73,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.418508+0000","last_change":"2024-09-12T17:50:58.422069+0000","last_active":"2024-09-12T17:59:19.418508+0000","last_peered":"2024-09-12T17:59:19.418508+0000","last_clean":"2024-09-12T17:59:19.418508+0000","last_became_active":"2024-09-12T17:50:58.421760+0000","last_became_peered":"2024-09-12T17:50:58.421760+0000","last_unstale":"2024-09-12T17:59:19.418508+0000","last_undegraded":"2024-09-12T17:59:19.418508+0000","last_fullsized":"2024-09-12T17:59:19.418508+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:17.645861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'1","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.401154+0000","last_change":"2024-09-12T17:40:30.417805+0000","last_active":"2024-09-12T17:57:29.401154+0000","last_peered":"2024-09-12T17:57:29.401154+0000","last_clean":"2024-09-12T17:57:29.401154+0000","last_became_active":"2024-09-12T17:40:30.417372+0000","last_became_peered":"2024-09-12T17:40:30.417372+0000","last_unstale":"2024-09-12T17:57:29.401154+0000","last_undegraded":"2024-09-12T17:57:29.401154+0000","last_fullsized":"2024-09-12T17:57:29.401154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:46.977654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":80,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"258'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.403961+0000","last_change":"2024-09-12T17:40:27.379433+0000","last_active":"2024-09-12T17:57:29.403961+0000","last_peered":"2024-09-12T17:57:29.403961+0000","last_clean":"2024-09-12T17:57:29.403961+0000","last_became_active":"2024-09-12T17:40:27.379161+0000","last_became_peered":"2024-09-12T17:40:27.379161+0000","last_unstale":"2024-09-12T17:57:29.403961+0000","last_undegraded":"2024-09-12T17:57:29.403961+0000","last_fullsized":"2024-09-12T17:57:29.403961+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:17.149187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"261'20","reported_seq":98,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:54.413353+0000","last_change":"2024-09-12T17:38:51.214836+0000","last_active":"2024-09-12T17:58:54.413353+0000","last_peered":"2024-09-12T17:58:54.413353+0000","last_clean":"2024-09-12T17:58:54.413353+0000","last_became_active":"2024-09-12T17:38:51.214555+0000","last_became_peered":"2024-09-12T17:38:51.214555+0000","last_unstale":"2024-09-12T17:58:54.413353+0000","last_undegraded":"2024-09-12T17:58:54.413353+0000","last_fullsized":"2024-09-12T17:58:54.413353+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:24.488340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412872+0000","last_change":"2024-09-12T17:50:58.429666+0000","last_active":"2024-09-12T17:58:29.412872+0000","last_peered":"2024-09-12T17:58:29.412872+0000","last_clean":"2024-09-12T17:58:29.412872+0000","last_became_active":"2024-09-12T17:50:58.429381+0000","last_became_peered":"2024-09-12T17:50:58.429381+0000","last_unstale":"2024-09-12T17:58:29.412872+0000","last_undegraded":"2024-09-12T17:58:29.412872+0000","last_fullsized":"2024-09-12T17:58:29.412872+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:24.108837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:04.406346+0000","last_change":"2024-09-12T17:40:30.420492+0000","last_active":"2024-09-12T17:58:04.406346+0000","last_peered":"2024-09-12T17:58:04.406346+0000","last_clean":"2024-09-12T17:58:04.406346+0000","last_became_active":"2024-09-12T17:40:30.420165+0000","last_became_peered":"2024-09-12T17:40:30.420165+0000","last_unstale":"2024-09-12T17:58:04.406346+0000","last_undegraded":"2024-09-12T17:58:04.406346+0000","last_fullsized":"2024-09-12T17:58:04.406346+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:02.691513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"261'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.408364+0000","last_change":"2024-09-12T17:40:27.382601+0000","last_active":"2024-09-12T17:57:59.408364+0000","last_peered":"2024-09-12T17:57:59.408364+0000","last_clean":"2024-09-12T17:57:59.408364+0000","last_became_active":"2024-09-12T17:40:27.382310+0000","last_became_peered":"2024-09-12T17:40:27.382310+0000","last_unstale":"2024-09-12T17:57:59.408364+0000","last_undegraded":"2024-09-12T17:57:59.408364+0000","last_fullsized":"2024-09-12T17:57:59.408364+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:53.252512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"261'83","reported_seq":276,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537110+0000","last_change":"2024-09-12T17:38:51.213883+0000","last_active":"2024-09-12T17:58:14.537110+0000","last_peered":"2024-09-12T17:58:14.537110+0000","last_clean":"2024-09-12T17:58:14.537110+0000","last_became_active":"2024-09-12T17:38:51.213569+0000","last_became_peered":"2024-09-12T17:38:51.213569+0000","last_unstale":"2024-09-12T17:58:14.537110+0000","last_undegraded":"2024-09-12T17:58:14.537110+0000","last_fullsized":"2024-09-12T17:58:14.537110+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:09.021970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":443,"num_read_kb":326,"num_write":140,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412923+0000","last_change":"2024-09-12T17:50:58.431925+0000","last_active":"2024-09-12T17:58:29.412923+0000","last_peered":"2024-09-12T17:58:29.412923+0000","last_clean":"2024-09-12T17:58:29.412923+0000","last_became_active":"2024-09-12T17:50:58.431242+0000","last_became_peered":"2024-09-12T17:50:58.431242+0000","last_unstale":"2024-09-12T17:58:29.412923+0000","last_undegraded":"2024-09-12T17:58:29.412923+0000","last_fullsized":"2024-09-12T17:58:29.412923+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:38.404256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'1","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.406325+0000","last_change":"2024-09-12T17:40:30.417580+0000","last_active":"2024-09-12T17:58:03.406325+0000","last_peered":"2024-09-12T17:58:03.406325+0000","last_clean":"2024-09-12T17:58:03.406325+0000","last_became_active":"2024-09-12T17:40:30.416973+0000","last_became_peered":"2024-09-12T17:40:30.416973+0000","last_unstale":"2024-09-12T17:58:03.406325+0000","last_undegraded":"2024-09-12T17:58:03.406325+0000","last_fullsized":"2024-09-12T17:58:03.406325+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:01.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"258'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.535018+0000","last_change":"2024-09-12T17:40:27.383868+0000","last_active":"2024-09-12T17:57:59.535018+0000","last_peered":"2024-09-12T17:57:59.535018+0000","last_clean":"2024-09-12T17:57:59.535018+0000","last_became_active":"2024-09-12T17:40:27.383589+0000","last_became_peered":"2024-09-12T17:40:27.383589+0000","last_unstale":"2024-09-12T17:57:59.535018+0000","last_undegraded":"2024-09-12T17:57:59.535018+0000","last_fullsized":"2024-09-12T17:57:59.535018+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:33.218417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"261'40","reported_seq":149,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:52.416289+0000","last_change":"2024-09-12T17:38:51.212263+0000","last_active":"2024-09-12T17:59:52.416289+0000","last_peered":"2024-09-12T17:59:52.416289+0000","last_clean":"2024-09-12T17:59:52.416289+0000","last_became_active":"2024-09-12T17:38:51.211962+0000","last_became_peered":"2024-09-12T17:38:51.211962+0000","last_unstale":"2024-09-12T17:59:52.416289+0000","last_undegraded":"2024-09-12T17:59:52.416289+0000","last_fullsized":"2024-09-12T17:59:52.416289+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:27.978434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":137,"num_write":74,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.406991+0000","last_change":"2024-09-12T17:50:58.415378+0000","last_active":"2024-09-12T17:57:59.406991+0000","last_peered":"2024-09-12T17:57:59.406991+0000","last_clean":"2024-09-12T17:57:59.406991+0000","last_became_active":"2024-09-12T17:50:58.415098+0000","last_became_peered":"2024-09-12T17:50:58.415098+0000","last_unstale":"2024-09-12T17:57:59.406991+0000","last_undegraded":"2024-09-12T17:57:59.406991+0000","last_fullsized":"2024-09-12T17:57:59.406991+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:07.460645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.400786+0000","last_change":"2024-09-12T17:40:30.426133+0000","last_active":"2024-09-12T17:57:28.400786+0000","last_peered":"2024-09-12T17:57:28.400786+0000","last_clean":"2024-09-12T17:57:28.400786+0000","last_became_active":"2024-09-12T17:40:30.425845+0000","last_became_peered":"2024-09-12T17:40:30.425845+0000","last_unstale":"2024-09-12T17:57:28.400786+0000","last_undegraded":"2024-09-12T17:57:28.400786+0000","last_fullsized":"2024-09-12T17:57:28.400786+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:39.872124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"261'10","reported_seq":63,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418105+0000","last_change":"2024-09-12T17:40:27.383205+0000","last_active":"2024-09-12T17:59:14.418105+0000","last_peered":"2024-09-12T17:59:14.418105+0000","last_clean":"2024-09-12T17:59:14.418105+0000","last_became_active":"2024-09-12T17:40:27.382833+0000","last_became_peered":"2024-09-12T17:40:27.382833+0000","last_unstale":"2024-09-12T17:59:14.418105+0000","last_undegraded":"2024-09-12T17:59:14.418105+0000","last_fullsized":"2024-09-12T17:59:14.418105+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:27.606242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":32770,"num_write":15,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"261'60","reported_seq":203,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537248+0000","last_change":"2024-09-12T17:38:51.214569+0000","last_active":"2024-09-12T17:58:14.537248+0000","last_peered":"2024-09-12T17:58:14.537248+0000","last_clean":"2024-09-12T17:58:14.537248+0000","last_became_active":"2024-09-12T17:38:51.214274+0000","last_became_peered":"2024-09-12T17:38:51.214274+0000","last_unstale":"2024-09-12T17:58:14.537248+0000","last_undegraded":"2024-09-12T17:58:14.537248+0000","last_fullsized":"2024-09-12T17:58:14.537248+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:23.016284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":211,"num_write":107,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:58.608464+0000","last_change":"2024-09-12T17:50:58.426819+0000","last_active":"2024-09-12T17:57:58.608464+0000","last_peered":"2024-09-12T17:57:58.608464+0000","last_clean":"2024-09-12T17:57:58.608464+0000","last_became_active":"2024-09-12T17:50:58.426537+0000","last_became_peered":"2024-09-12T17:50:58.426537+0000","last_unstale":"2024-09-12T17:57:58.608464+0000","last_undegraded":"2024-09-12T17:57:58.608464+0000","last_fullsized":"2024-09-12T17:57:58.608464+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.965601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"261'7","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.417452+0000","last_change":"2024-09-12T17:40:30.427100+0000","last_active":"2024-09-12T17:59:18.417452+0000","last_peered":"2024-09-12T17:59:18.417452+0000","last_clean":"2024-09-12T17:59:18.417452+0000","last_became_active":"2024-09-12T17:40:30.425368+0000","last_became_peered":"2024-09-12T17:40:30.425368+0000","last_unstale":"2024-09-12T17:59:18.417452+0000","last_undegraded":"2024-09-12T17:59:18.417452+0000","last_fullsized":"2024-09-12T17:59:18.417452+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:47.929671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:24.403574+0000","last_change":"2024-09-12T17:40:27.380566+0000","last_active":"2024-09-12T17:57:24.403574+0000","last_peered":"2024-09-12T17:57:24.403574+0000","last_clean":"2024-09-12T17:57:24.403574+0000","last_became_active":"2024-09-12T17:40:27.380228+0000","last_became_peered":"2024-09-12T17:40:27.380228+0000","last_unstale":"2024-09-12T17:57:24.403574+0000","last_undegraded":"2024-09-12T17:57:24.403574+0000","last_fullsized":"2024-09-12T17:57:24.403574+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:05.600168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"261'21","reported_seq":99,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.495658+0000","last_change":"2024-09-12T17:38:51.218671+0000","last_active":"2024-09-12T17:59:15.495658+0000","last_peered":"2024-09-12T17:59:15.495658+0000","last_clean":"2024-09-12T17:59:15.495658+0000","last_became_active":"2024-09-12T17:38:51.218309+0000","last_became_peered":"2024-09-12T17:38:51.218309+0000","last_unstale":"2024-09-12T17:59:15.495658+0000","last_undegraded":"2024-09-12T17:59:15.495658+0000","last_fullsized":"2024-09-12T17:59:15.495658+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:45.726103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.408378+0000","last_change":"2024-09-12T17:50:58.425291+0000","last_active":"2024-09-12T17:57:59.408378+0000","last_peered":"2024-09-12T17:57:59.408378+0000","last_clean":"2024-09-12T17:57:59.408378+0000","last_became_active":"2024-09-12T17:50:58.425003+0000","last_became_peered":"2024-09-12T17:50:58.425003+0000","last_unstale":"2024-09-12T17:57:59.408378+0000","last_undegraded":"2024-09-12T17:57:59.408378+0000","last_fullsized":"2024-09-12T17:57:59.408378+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:33.694791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"261'2","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.400828+0000","last_change":"2024-09-12T17:40:30.427105+0000","last_active":"2024-09-12T17:57:28.400828+0000","last_peered":"2024-09-12T17:57:28.400828+0000","last_clean":"2024-09-12T17:57:28.400828+0000","last_became_active":"2024-09-12T17:40:30.426714+0000","last_became_peered":"2024-09-12T17:40:30.426714+0000","last_unstale":"2024-09-12T17:57:28.400828+0000","last_undegraded":"2024-09-12T17:57:28.400828+0000","last_fullsized":"2024-09-12T17:57:28.400828+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:21.352761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:23.603864+0000","last_change":"2024-09-12T17:40:27.382447+0000","last_active":"2024-09-12T17:57:23.603864+0000","last_peered":"2024-09-12T17:57:23.603864+0000","last_clean":"2024-09-12T17:57:23.603864+0000","last_became_active":"2024-09-12T17:40:27.382132+0000","last_became_peered":"2024-09-12T17:40:27.382132+0000","last_unstale":"2024-09-12T17:57:23.603864+0000","last_undegraded":"2024-09-12T17:57:23.603864+0000","last_fullsized":"2024-09-12T17:57:23.603864+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:38.796258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"261'28","reported_seq":122,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.610428+0000","last_change":"2024-09-12T17:38:51.215254+0000","last_active":"2024-09-12T17:58:13.610428+0000","last_peered":"2024-09-12T17:58:13.610428+0000","last_clean":"2024-09-12T17:58:13.610428+0000","last_became_active":"2024-09-12T17:38:51.214963+0000","last_became_peered":"2024-09-12T17:38:51.214963+0000","last_unstale":"2024-09-12T17:58:13.610428+0000","last_undegraded":"2024-09-12T17:58:13.610428+0000","last_fullsized":"2024-09-12T17:58:13.610428+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:33.596786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":103,"num_write":58,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.407865+0000","last_change":"2024-09-12T17:50:58.427202+0000","last_active":"2024-09-12T17:57:59.407865+0000","last_peered":"2024-09-12T17:57:59.407865+0000","last_clean":"2024-09-12T17:57:59.407865+0000","last_became_active":"2024-09-12T17:50:58.426779+0000","last_became_peered":"2024-09-12T17:50:58.426779+0000","last_unstale":"2024-09-12T17:57:59.407865+0000","last_undegraded":"2024-09-12T17:57:59.407865+0000","last_fullsized":"2024-09-12T17:57:59.407865+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:56.570650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"258'6","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.404116+0000","last_change":"2024-09-12T17:40:30.419477+0000","last_active":"2024-09-12T17:57:29.404116+0000","last_peered":"2024-09-12T17:57:29.404116+0000","last_clean":"2024-09-12T17:57:29.404116+0000","last_became_active":"2024-09-12T17:40:30.419211+0000","last_became_peered":"2024-09-12T17:40:30.419211+0000","last_unstale":"2024-09-12T17:57:29.404116+0000","last_undegraded":"2024-09-12T17:57:29.404116+0000","last_fullsized":"2024-09-12T17:57:29.404116+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:06.524125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:24.529259+0000","last_change":"2024-09-12T17:40:27.382860+0000","last_active":"2024-09-12T17:57:24.529259+0000","last_peered":"2024-09-12T17:57:24.529259+0000","last_clean":"2024-09-12T17:57:24.529259+0000","last_became_active":"2024-09-12T17:40:27.382564+0000","last_became_peered":"2024-09-12T17:40:27.382564+0000","last_unstale":"2024-09-12T17:57:24.529259+0000","last_undegraded":"2024-09-12T17:57:24.529259+0000","last_fullsized":"2024-09-12T17:57:24.529259+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:37.855260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"261'12","reported_seq":75,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.405626+0000","last_change":"2024-09-12T17:38:51.215105+0000","last_active":"2024-09-12T17:57:39.405626+0000","last_peered":"2024-09-12T17:57:39.405626+0000","last_clean":"2024-09-12T17:57:39.405626+0000","last_became_active":"2024-09-12T17:38:51.214678+0000","last_became_peered":"2024-09-12T17:38:51.214678+0000","last_unstale":"2024-09-12T17:57:39.405626+0000","last_undegraded":"2024-09-12T17:57:39.405626+0000","last_fullsized":"2024-09-12T17:57:39.405626+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:23.825989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":38,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.407844+0000","last_change":"2024-09-12T17:50:58.427915+0000","last_active":"2024-09-12T17:58:13.407844+0000","last_peered":"2024-09-12T17:58:13.407844+0000","last_clean":"2024-09-12T17:58:13.407844+0000","last_became_active":"2024-09-12T17:50:58.427630+0000","last_became_peered":"2024-09-12T17:50:58.427630+0000","last_unstale":"2024-09-12T17:58:13.407844+0000","last_undegraded":"2024-09-12T17:58:13.407844+0000","last_fullsized":"2024-09-12T17:58:13.407844+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:54.698191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"261'12","reported_seq":64,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417124+0000","last_change":"2024-09-12T17:40:30.413875+0000","last_active":"2024-09-12T17:59:09.417124+0000","last_peered":"2024-09-12T17:59:09.417124+0000","last_clean":"2024-09-12T17:59:09.417124+0000","last_became_active":"2024-09-12T17:40:30.413592+0000","last_became_peered":"2024-09-12T17:40:30.413592+0000","last_unstale":"2024-09-12T17:59:09.417124+0000","last_undegraded":"2024-09-12T17:59:09.417124+0000","last_fullsized":"2024-09-12T17:59:09.417124+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:47.033025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":45058,"num_write":22,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'7","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417916+0000","last_change":"2024-09-12T17:40:27.382000+0000","last_active":"2024-09-12T17:59:09.417916+0000","last_peered":"2024-09-12T17:59:09.417916+0000","last_clean":"2024-09-12T17:59:09.417916+0000","last_became_active":"2024-09-12T17:40:27.381516+0000","last_became_peered":"2024-09-12T17:40:27.381516+0000","last_unstale":"2024-09-12T17:59:09.417916+0000","last_undegraded":"2024-09-12T17:59:09.417916+0000","last_fullsized":"2024-09-12T17:59:09.417916+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:48.416419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":32770,"num_write":7,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"261'6","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404930+0000","last_change":"2024-09-12T17:38:51.216019+0000","last_active":"2024-09-12T17:57:34.404930+0000","last_peered":"2024-09-12T17:57:34.404930+0000","last_clean":"2024-09-12T17:57:34.404930+0000","last_became_active":"2024-09-12T17:38:51.215646+0000","last_became_peered":"2024-09-12T17:38:51.215646+0000","last_unstale":"2024-09-12T17:57:34.404930+0000","last_undegraded":"2024-09-12T17:57:34.404930+0000","last_fullsized":"2024-09-12T17:57:34.404930+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:36.940207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537213+0000","last_change":"2024-09-12T17:50:58.423068+0000","last_active":"2024-09-12T17:58:14.537213+0000","last_peered":"2024-09-12T17:58:14.537213+0000","last_clean":"2024-09-12T17:58:14.537213+0000","last_became_active":"2024-09-12T17:50:58.422692+0000","last_became_peered":"2024-09-12T17:50:58.422692+0000","last_unstale":"2024-09-12T17:58:14.537213+0000","last_undegraded":"2024-09-12T17:58:14.537213+0000","last_fullsized":"2024-09-12T17:58:14.537213+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:51.624436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'2","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417077+0000","last_change":"2024-09-12T17:40:30.419235+0000","last_active":"2024-09-12T17:59:09.417077+0000","last_peered":"2024-09-12T17:59:09.417077+0000","last_clean":"2024-09-12T17:59:09.417077+0000","last_became_active":"2024-09-12T17:40:30.418904+0000","last_became_peered":"2024-09-12T17:40:30.418904+0000","last_unstale":"2024-09-12T17:59:09.417077+0000","last_undegraded":"2024-09-12T17:59:09.417077+0000","last_fullsized":"2024-09-12T17:59:09.417077+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:39.501098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.416187+0000","last_change":"2024-09-12T17:40:27.382156+0000","last_active":"2024-09-12T17:59:08.416187+0000","last_peered":"2024-09-12T17:59:08.416187+0000","last_clean":"2024-09-12T17:59:08.416187+0000","last_became_active":"2024-09-12T17:40:27.381849+0000","last_became_peered":"2024-09-12T17:40:27.381849+0000","last_unstale":"2024-09-12T17:59:08.416187+0000","last_undegraded":"2024-09-12T17:59:08.416187+0000","last_fullsized":"2024-09-12T17:59:08.416187+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:03.117165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"261'23","reported_seq":103,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:05.807493+0000","last_change":"2024-09-12T17:38:51.208118+0000","last_active":"2024-09-12T17:59:05.807493+0000","last_peered":"2024-09-12T17:59:05.807493+0000","last_clean":"2024-09-12T17:59:05.807493+0000","last_became_active":"2024-09-12T17:38:51.207804+0000","last_became_peered":"2024-09-12T17:38:51.207804+0000","last_unstale":"2024-09-12T17:59:05.807493+0000","last_undegraded":"2024-09-12T17:59:05.807493+0000","last_fullsized":"2024-09-12T17:59:05.807493+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:07.620875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":76,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.535062+0000","last_change":"2024-09-12T17:50:58.424688+0000","last_active":"2024-09-12T17:57:59.535062+0000","last_peered":"2024-09-12T17:57:59.535062+0000","last_clean":"2024-09-12T17:57:59.535062+0000","last_became_active":"2024-09-12T17:50:58.424379+0000","last_became_peered":"2024-09-12T17:50:58.424379+0000","last_unstale":"2024-09-12T17:57:59.535062+0000","last_undegraded":"2024-09-12T17:57:59.535062+0000","last_fullsized":"2024-09-12T17:57:59.535062+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:33.922718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:13.416845+0000","last_change":"2024-09-12T17:40:30.418399+0000","last_active":"2024-09-12T17:59:13.416845+0000","last_peered":"2024-09-12T17:59:13.416845+0000","last_clean":"2024-09-12T17:59:13.416845+0000","last_became_active":"2024-09-12T17:40:30.417111+0000","last_became_peered":"2024-09-12T17:40:30.417111+0000","last_unstale":"2024-09-12T17:59:13.416845+0000","last_undegraded":"2024-09-12T17:59:13.416845+0000","last_fullsized":"2024-09-12T17:59:13.416845+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:35.848674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415357+0000","last_change":"2024-09-12T17:40:27.378507+0000","last_active":"2024-09-12T17:59:09.415357+0000","last_peered":"2024-09-12T17:59:09.415357+0000","last_clean":"2024-09-12T17:59:09.415357+0000","last_became_active":"2024-09-12T17:40:27.378245+0000","last_became_peered":"2024-09-12T17:40:27.378245+0000","last_unstale":"2024-09-12T17:59:09.415357+0000","last_undegraded":"2024-09-12T17:59:09.415357+0000","last_fullsized":"2024-09-12T17:59:09.415357+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:43.060058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"261'38","reported_seq":153,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404752+0000","last_change":"2024-09-12T17:38:51.209261+0000","last_active":"2024-09-12T17:57:34.404752+0000","last_peered":"2024-09-12T17:57:34.404752+0000","last_clean":"2024-09-12T17:57:34.404752+0000","last_became_active":"2024-09-12T17:38:51.208950+0000","last_became_peered":"2024-09-12T17:38:51.208950+0000","last_unstale":"2024-09-12T17:57:34.404752+0000","last_undegraded":"2024-09-12T17:57:34.404752+0000","last_fullsized":"2024-09-12T17:57:34.404752+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:12.331668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":143,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.407814+0000","last_change":"2024-09-12T17:50:58.426040+0000","last_active":"2024-09-12T17:58:13.407814+0000","last_peered":"2024-09-12T17:58:13.407814+0000","last_clean":"2024-09-12T17:58:13.407814+0000","last_became_active":"2024-09-12T17:50:58.425574+0000","last_became_peered":"2024-09-12T17:50:58.425574+0000","last_unstale":"2024-09-12T17:58:13.407814+0000","last_undegraded":"2024-09-12T17:58:13.407814+0000","last_fullsized":"2024-09-12T17:58:13.407814+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:39.335745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.415906+0000","last_change":"2024-09-12T17:40:30.412045+0000","last_active":"2024-09-12T17:59:14.415906+0000","last_peered":"2024-09-12T17:59:14.415906+0000","last_clean":"2024-09-12T17:59:14.415906+0000","last_became_active":"2024-09-12T17:40:30.411737+0000","last_became_peered":"2024-09-12T17:40:30.411737+0000","last_unstale":"2024-09-12T17:59:14.415906+0000","last_undegraded":"2024-09-12T17:59:14.415906+0000","last_fullsized":"2024-09-12T17:59:14.415906+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:10.622751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417509+0000","last_change":"2024-09-12T17:40:27.372635+0000","last_active":"2024-09-12T17:59:09.417509+0000","last_peered":"2024-09-12T17:59:09.417509+0000","last_clean":"2024-09-12T17:59:09.417509+0000","last_became_active":"2024-09-12T17:40:27.372357+0000","last_became_peered":"2024-09-12T17:40:27.372357+0000","last_unstale":"2024-09-12T17:59:09.417509+0000","last_undegraded":"2024-09-12T17:59:09.417509+0000","last_fullsized":"2024-09-12T17:59:09.417509+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:34.828926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"261'42","reported_seq":150,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.401471+0000","last_change":"2024-09-12T17:38:51.208068+0000","last_active":"2024-09-12T17:57:33.401471+0000","last_peered":"2024-09-12T17:57:33.401471+0000","last_clean":"2024-09-12T17:57:33.401471+0000","last_became_active":"2024-09-12T17:38:51.207798+0000","last_became_peered":"2024-09-12T17:38:51.207798+0000","last_unstale":"2024-09-12T17:57:33.401471+0000","last_undegraded":"2024-09-12T17:57:33.401471+0000","last_fullsized":"2024-09-12T17:57:33.401471+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:58.346672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":137,"num_write":80,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.604511+0000","last_change":"2024-09-12T17:50:58.428924+0000","last_active":"2024-09-12T17:57:28.604511+0000","last_peered":"2024-09-12T17:57:28.604511+0000","last_clean":"2024-09-12T17:57:28.604511+0000","last_became_active":"2024-09-12T17:50:58.428339+0000","last_became_peered":"2024-09-12T17:50:58.428339+0000","last_unstale":"2024-09-12T17:57:28.604511+0000","last_undegraded":"2024-09-12T17:57:28.604511+0000","last_fullsized":"2024-09-12T17:57:28.604511+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:46.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411146+0000","last_change":"2024-09-12T17:40:30.417879+0000","last_active":"2024-09-12T17:58:33.411146+0000","last_peered":"2024-09-12T17:58:33.411146+0000","last_clean":"2024-09-12T17:58:33.411146+0000","last_became_active":"2024-09-12T17:40:30.417583+0000","last_became_peered":"2024-09-12T17:40:30.417583+0000","last_unstale":"2024-09-12T17:58:33.411146+0000","last_undegraded":"2024-09-12T17:58:33.411146+0000","last_fullsized":"2024-09-12T17:58:33.411146+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:57.147303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"258'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412848+0000","last_change":"2024-09-12T17:40:27.381338+0000","last_active":"2024-09-12T17:58:29.412848+0000","last_peered":"2024-09-12T17:58:29.412848+0000","last_clean":"2024-09-12T17:58:29.412848+0000","last_became_active":"2024-09-12T17:40:27.381027+0000","last_became_peered":"2024-09-12T17:40:27.381027+0000","last_unstale":"2024-09-12T17:58:29.412848+0000","last_undegraded":"2024-09-12T17:58:29.412848+0000","last_fullsized":"2024-09-12T17:58:29.412848+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:16.850258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"261'21","reported_seq":98,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.254313+0000","last_change":"2024-09-12T17:38:51.207794+0000","last_active":"2024-09-12T17:59:54.254313+0000","last_peered":"2024-09-12T17:59:54.254313+0000","last_clean":"2024-09-12T17:59:54.254313+0000","last_became_active":"2024-09-12T17:38:51.207487+0000","last_became_peered":"2024-09-12T17:38:51.207487+0000","last_unstale":"2024-09-12T17:59:54.254313+0000","last_undegraded":"2024-09-12T17:59:54.254313+0000","last_fullsized":"2024-09-12T17:59:54.254313+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:45.756120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":66,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:44.406393+0000","last_change":"2024-09-12T17:50:58.431273+0000","last_active":"2024-09-12T17:57:44.406393+0000","last_peered":"2024-09-12T17:57:44.406393+0000","last_clean":"2024-09-12T17:57:44.406393+0000","last_became_active":"2024-09-12T17:50:58.430797+0000","last_became_peered":"2024-09-12T17:50:58.430797+0000","last_unstale":"2024-09-12T17:57:44.406393+0000","last_undegraded":"2024-09-12T17:57:44.406393+0000","last_fullsized":"2024-09-12T17:57:44.406393+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:24.280950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"261'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411117+0000","last_change":"2024-09-12T17:40:30.417952+0000","last_active":"2024-09-12T17:58:33.411117+0000","last_peered":"2024-09-12T17:58:33.411117+0000","last_clean":"2024-09-12T17:58:33.411117+0000","last_became_active":"2024-09-12T17:40:30.417567+0000","last_became_peered":"2024-09-12T17:40:30.417567+0000","last_unstale":"2024-09-12T17:58:33.411117+0000","last_undegraded":"2024-09-12T17:58:33.411117+0000","last_fullsized":"2024-09-12T17:58:33.411117+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:56.583902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"261'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612267+0000","last_change":"2024-09-12T17:40:27.384850+0000","last_active":"2024-09-12T17:58:28.612267+0000","last_peered":"2024-09-12T17:58:28.612267+0000","last_clean":"2024-09-12T17:58:28.612267+0000","last_became_active":"2024-09-12T17:40:27.384579+0000","last_became_peered":"2024-09-12T17:40:27.384579+0000","last_unstale":"2024-09-12T17:58:28.612267+0000","last_undegraded":"2024-09-12T17:58:28.612267+0000","last_fullsized":"2024-09-12T17:58:28.612267+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:22.573347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":11264,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"261'7","reported_seq":61,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417568+0000","last_change":"2024-09-12T17:38:51.215867+0000","last_active":"2024-09-12T17:59:09.417568+0000","last_peered":"2024-09-12T17:59:09.417568+0000","last_clean":"2024-09-12T17:59:09.417568+0000","last_became_active":"2024-09-12T17:38:51.215590+0000","last_became_peered":"2024-09-12T17:38:51.215590+0000","last_unstale":"2024-09-12T17:59:09.417568+0000","last_undegraded":"2024-09-12T17:59:09.417568+0000","last_fullsized":"2024-09-12T17:59:09.417568+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:33.602009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.418983+0000","last_change":"2024-09-12T17:50:58.427213+0000","last_active":"2024-09-12T17:59:39.418983+0000","last_peered":"2024-09-12T17:59:39.418983+0000","last_clean":"2024-09-12T17:59:39.418983+0000","last_became_active":"2024-09-12T17:50:58.426867+0000","last_became_peered":"2024-09-12T17:50:58.426867+0000","last_unstale":"2024-09-12T17:59:39.418983+0000","last_undegraded":"2024-09-12T17:59:39.418983+0000","last_fullsized":"2024-09-12T17:59:39.418983+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:34.833083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"261'2","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:34.412127+0000","last_change":"2024-09-12T17:40:30.426091+0000","last_active":"2024-09-12T17:58:34.412127+0000","last_peered":"2024-09-12T17:58:34.412127+0000","last_clean":"2024-09-12T17:58:34.412127+0000","last_became_active":"2024-09-12T17:40:30.425775+0000","last_became_peered":"2024-09-12T17:40:30.425775+0000","last_unstale":"2024-09-12T17:58:34.412127+0000","last_undegraded":"2024-09-12T17:58:34.412127+0000","last_fullsized":"2024-09-12T17:58:34.412127+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:32.790479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.539586+0000","last_change":"2024-09-12T17:40:27.382194+0000","last_active":"2024-09-12T17:58:29.539586+0000","last_peered":"2024-09-12T17:58:29.539586+0000","last_clean":"2024-09-12T17:58:29.539586+0000","last_became_active":"2024-09-12T17:40:27.381918+0000","last_became_peered":"2024-09-12T17:40:27.381918+0000","last_unstale":"2024-09-12T17:58:29.539586+0000","last_undegraded":"2024-09-12T17:58:29.539586+0000","last_fullsized":"2024-09-12T17:58:29.539586+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:18.545363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"261'43","reported_seq":159,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415390+0000","last_change":"2024-09-12T17:38:51.209399+0000","last_active":"2024-09-12T17:59:09.415390+0000","last_peered":"2024-09-12T17:59:09.415390+0000","last_clean":"2024-09-12T17:59:09.415390+0000","last_became_active":"2024-09-12T17:38:51.209135+0000","last_became_peered":"2024-09-12T17:38:51.209135+0000","last_unstale":"2024-09-12T17:59:09.415390+0000","last_undegraded":"2024-09-12T17:59:09.415390+0000","last_fullsized":"2024-09-12T17:59:09.415390+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:55.234380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":150,"num_write":83,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.422143+0000","last_change":"2024-09-12T17:50:58.431873+0000","last_active":"2024-09-12T17:59:39.422143+0000","last_peered":"2024-09-12T17:59:39.422143+0000","last_clean":"2024-09-12T17:59:39.422143+0000","last_became_active":"2024-09-12T17:50:58.431587+0000","last_became_peered":"2024-09-12T17:50:58.431587+0000","last_unstale":"2024-09-12T17:59:39.422143+0000","last_undegraded":"2024-09-12T17:59:39.422143+0000","last_fullsized":"2024-09-12T17:59:39.422143+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:06.651931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411161+0000","last_change":"2024-09-12T17:40:30.418372+0000","last_active":"2024-09-12T17:58:33.411161+0000","last_peered":"2024-09-12T17:58:33.411161+0000","last_clean":"2024-09-12T17:58:33.411161+0000","last_became_active":"2024-09-12T17:40:30.417998+0000","last_became_peered":"2024-09-12T17:40:30.417998+0000","last_unstale":"2024-09-12T17:58:33.411161+0000","last_undegraded":"2024-09-12T17:58:33.411161+0000","last_fullsized":"2024-09-12T17:58:33.411161+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:45.170209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:34.412106+0000","last_change":"2024-09-12T17:40:27.374835+0000","last_active":"2024-09-12T17:58:34.412106+0000","last_peered":"2024-09-12T17:58:34.412106+0000","last_clean":"2024-09-12T17:58:34.412106+0000","last_became_active":"2024-09-12T17:40:27.374557+0000","last_became_peered":"2024-09-12T17:40:27.374557+0000","last_unstale":"2024-09-12T17:58:34.412106+0000","last_undegraded":"2024-09-12T17:58:34.412106+0000","last_fullsized":"2024-09-12T17:58:34.412106+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:19.232907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"261'32","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.084012+0000","last_change":"2024-09-12T17:38:51.216521+0000","last_active":"2024-09-12T17:59:54.084012+0000","last_peered":"2024-09-12T17:59:54.084012+0000","last_clean":"2024-09-12T17:59:54.084012+0000","last_became_active":"2024-09-12T17:38:51.216209+0000","last_became_peered":"2024-09-12T17:38:51.216209+0000","last_unstale":"2024-09-12T17:59:54.084012+0000","last_undegraded":"2024-09-12T17:59:54.084012+0000","last_fullsized":"2024-09-12T17:59:54.084012+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:23.694199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":109,"num_write":55,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:43.403198+0000","last_change":"2024-09-12T17:50:58.425019+0000","last_active":"2024-09-12T17:57:43.403198+0000","last_peered":"2024-09-12T17:57:43.403198+0000","last_clean":"2024-09-12T17:57:43.403198+0000","last_became_active":"2024-09-12T17:50:58.424452+0000","last_became_peered":"2024-09-12T17:50:58.424452+0000","last_unstale":"2024-09-12T17:57:43.403198+0000","last_undegraded":"2024-09-12T17:57:43.403198+0000","last_fullsized":"2024-09-12T17:57:43.403198+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:27.439096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.407560+0000","last_change":"2024-09-12T17:40:30.418941+0000","last_active":"2024-09-12T17:57:54.407560+0000","last_peered":"2024-09-12T17:57:54.407560+0000","last_clean":"2024-09-12T17:57:54.407560+0000","last_became_active":"2024-09-12T17:40:30.418650+0000","last_became_peered":"2024-09-12T17:40:30.418650+0000","last_unstale":"2024-09-12T17:57:54.407560+0000","last_undegraded":"2024-09-12T17:57:54.407560+0000","last_fullsized":"2024-09-12T17:57:54.407560+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:20.881248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"258'8","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.533425+0000","last_change":"2024-09-12T17:40:27.385454+0000","last_active":"2024-09-12T17:57:49.533425+0000","last_peered":"2024-09-12T17:57:49.533425+0000","last_clean":"2024-09-12T17:57:49.533425+0000","last_became_active":"2024-09-12T17:40:27.385081+0000","last_became_peered":"2024-09-12T17:40:27.385081+0000","last_unstale":"2024-09-12T17:57:49.533425+0000","last_undegraded":"2024-09-12T17:57:49.533425+0000","last_fullsized":"2024-09-12T17:57:49.533425+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:10.053553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"261'37","reported_seq":148,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.545191+0000","last_change":"2024-09-12T17:38:51.209424+0000","last_active":"2024-09-12T17:59:09.545191+0000","last_peered":"2024-09-12T17:59:09.545191+0000","last_clean":"2024-09-12T17:59:09.545191+0000","last_became_active":"2024-09-12T17:38:51.208861+0000","last_became_peered":"2024-09-12T17:38:51.208861+0000","last_unstale":"2024-09-12T17:59:09.545191+0000","last_undegraded":"2024-09-12T17:59:09.545191+0000","last_fullsized":"2024-09-12T17:59:09.545191+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:00.098063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":141,"num_write":67,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.407163+0000","last_change":"2024-09-12T17:50:58.432996+0000","last_active":"2024-09-12T17:57:49.407163+0000","last_peered":"2024-09-12T17:57:49.407163+0000","last_clean":"2024-09-12T17:57:49.407163+0000","last_became_active":"2024-09-12T17:50:58.432245+0000","last_became_peered":"2024-09-12T17:50:58.432245+0000","last_unstale":"2024-09-12T17:57:49.407163+0000","last_undegraded":"2024-09-12T17:57:49.407163+0000","last_fullsized":"2024-09-12T17:57:49.407163+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:12.784598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"258'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.407705+0000","last_change":"2024-09-12T17:40:30.425572+0000","last_active":"2024-09-12T17:57:54.407705+0000","last_peered":"2024-09-12T17:57:54.407705+0000","last_clean":"2024-09-12T17:57:54.407705+0000","last_became_active":"2024-09-12T17:40:30.425293+0000","last_became_peered":"2024-09-12T17:40:30.425293+0000","last_unstale":"2024-09-12T17:57:54.407705+0000","last_undegraded":"2024-09-12T17:57:54.407705+0000","last_fullsized":"2024-09-12T17:57:54.407705+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:39.090717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.405494+0000","last_change":"2024-09-12T17:40:27.377071+0000","last_active":"2024-09-12T17:57:49.405494+0000","last_peered":"2024-09-12T17:57:49.405494+0000","last_clean":"2024-09-12T17:57:49.405494+0000","last_became_active":"2024-09-12T17:40:27.376781+0000","last_became_peered":"2024-09-12T17:40:27.376781+0000","last_unstale":"2024-09-12T17:57:49.405494+0000","last_undegraded":"2024-09-12T17:57:49.405494+0000","last_fullsized":"2024-09-12T17:57:49.405494+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:17.637845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412794+0000","last_change":"2024-09-12T17:38:51.210062+0000","last_active":"2024-09-12T17:58:29.412794+0000","last_peered":"2024-09-12T17:58:29.412794+0000","last_clean":"2024-09-12T17:58:29.412794+0000","last_became_active":"2024-09-12T17:38:51.209772+0000","last_became_peered":"2024-09-12T17:38:51.209772+0000","last_unstale":"2024-09-12T17:58:29.412794+0000","last_undegraded":"2024-09-12T17:58:29.412794+0000","last_fullsized":"2024-09-12T17:58:29.412794+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:25.124534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:44.406424+0000","last_change":"2024-09-12T17:50:58.429816+0000","last_active":"2024-09-12T17:57:44.406424+0000","last_peered":"2024-09-12T17:57:44.406424+0000","last_clean":"2024-09-12T17:57:44.406424+0000","last_became_active":"2024-09-12T17:50:58.429551+0000","last_became_peered":"2024-09-12T17:50:58.429551+0000","last_unstale":"2024-09-12T17:57:44.406424+0000","last_undegraded":"2024-09-12T17:57:44.406424+0000","last_fullsized":"2024-09-12T17:57:44.406424+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:25.259007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'6","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.411292+0000","last_change":"2024-09-12T17:40:30.409389+0000","last_active":"2024-09-12T17:58:29.411292+0000","last_peered":"2024-09-12T17:58:29.411292+0000","last_clean":"2024-09-12T17:58:29.411292+0000","last_became_active":"2024-09-12T17:40:30.408915+0000","last_became_peered":"2024-09-12T17:40:30.408915+0000","last_unstale":"2024-09-12T17:58:29.411292+0000","last_undegraded":"2024-09-12T17:58:29.411292+0000","last_fullsized":"2024-09-12T17:58:29.411292+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:56.865653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25606,"num_write":11,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"258'3","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.533461+0000","last_change":"2024-09-12T17:40:27.382211+0000","last_active":"2024-09-12T17:57:49.533461+0000","last_peered":"2024-09-12T17:57:49.533461+0000","last_clean":"2024-09-12T17:57:49.533461+0000","last_became_active":"2024-09-12T17:40:27.381885+0000","last_became_peered":"2024-09-12T17:40:27.381885+0000","last_unstale":"2024-09-12T17:57:49.533461+0000","last_undegraded":"2024-09-12T17:57:49.533461+0000","last_fullsized":"2024-09-12T17:57:49.533461+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:52.579087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"261'68","reported_seq":231,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.409354+0000","last_change":"2024-09-12T17:38:51.215246+0000","last_active":"2024-09-12T17:58:23.409354+0000","last_peered":"2024-09-12T17:58:23.409354+0000","last_clean":"2024-09-12T17:58:23.409354+0000","last_became_active":"2024-09-12T17:38:51.214940+0000","last_became_peered":"2024-09-12T17:38:51.214940+0000","last_unstale":"2024-09-12T17:58:23.409354+0000","last_undegraded":"2024-09-12T17:58:23.409354+0000","last_fullsized":"2024-09-12T17:58:23.409354+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:11.305564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":356,"num_read_kb":250,"num_write":117,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:44.532653+0000","last_change":"2024-09-12T17:50:58.421234+0000","last_active":"2024-09-12T17:57:44.532653+0000","last_peered":"2024-09-12T17:57:44.532653+0000","last_clean":"2024-09-12T17:57:44.532653+0000","last_became_active":"2024-09-12T17:50:58.420251+0000","last_became_peered":"2024-09-12T17:50:58.420251+0000","last_unstale":"2024-09-12T17:57:44.532653+0000","last_undegraded":"2024-09-12T17:57:44.532653+0000","last_fullsized":"2024-09-12T17:57:44.532653+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:17.481915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"258'7","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.408453+0000","last_change":"2024-09-12T17:40:30.417703+0000","last_active":"2024-09-12T17:57:59.408453+0000","last_peered":"2024-09-12T17:57:59.408453+0000","last_clean":"2024-09-12T17:57:59.408453+0000","last_became_active":"2024-09-12T17:40:30.417393+0000","last_became_peered":"2024-09-12T17:40:30.417393+0000","last_unstale":"2024-09-12T17:57:59.408453+0000","last_undegraded":"2024-09-12T17:57:59.408453+0000","last_fullsized":"2024-09-12T17:57:59.408453+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:40.700927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":7,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'1","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412637+0000","last_change":"2024-09-12T17:40:27.379736+0000","last_active":"2024-09-12T17:58:29.412637+0000","last_peered":"2024-09-12T17:58:29.412637+0000","last_clean":"2024-09-12T17:58:29.412637+0000","last_became_active":"2024-09-12T17:40:27.379472+0000","last_became_peered":"2024-09-12T17:40:27.379472+0000","last_unstale":"2024-09-12T17:58:29.412637+0000","last_undegraded":"2024-09-12T17:58:29.412637+0000","last_fullsized":"2024-09-12T17:58:29.412637+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:36.186301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"261'106","reported_seq":366,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.408959+0000","last_change":"2024-09-12T17:38:51.208031+0000","last_active":"2024-09-12T17:58:24.408959+0000","last_peered":"2024-09-12T17:58:24.408959+0000","last_clean":"2024-09-12T17:58:24.408959+0000","last_became_active":"2024-09-12T17:38:51.207735+0000","last_became_peered":"2024-09-12T17:38:51.207735+0000","last_unstale":"2024-09-12T17:58:24.408959+0000","last_undegraded":"2024-09-12T17:58:24.408959+0000","last_fullsized":"2024-09-12T17:58:24.408959+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:15.007282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":541,"num_write":122,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419330+0000","last_change":"2024-09-12T17:50:58.431116+0000","last_active":"2024-09-12T17:59:19.419330+0000","last_peered":"2024-09-12T17:59:19.419330+0000","last_clean":"2024-09-12T17:59:19.419330+0000","last_became_active":"2024-09-12T17:50:58.430813+0000","last_became_peered":"2024-09-12T17:50:58.430813+0000","last_unstale":"2024-09-12T17:59:19.419330+0000","last_undegraded":"2024-09-12T17:59:19.419330+0000","last_fullsized":"2024-09-12T17:59:19.419330+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:19.189927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546398+0000","last_change":"2024-09-12T17:40:30.411164+0000","last_active":"2024-09-12T17:59:19.546398+0000","last_peered":"2024-09-12T17:59:19.546398+0000","last_clean":"2024-09-12T17:59:19.546398+0000","last_became_active":"2024-09-12T17:40:30.410872+0000","last_became_peered":"2024-09-12T17:40:30.410872+0000","last_unstale":"2024-09-12T17:59:19.546398+0000","last_undegraded":"2024-09-12T17:59:19.546398+0000","last_fullsized":"2024-09-12T17:59:19.546398+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:47.603677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'1","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418811+0000","last_change":"2024-09-12T17:40:27.380593+0000","last_active":"2024-09-12T17:59:14.418811+0000","last_peered":"2024-09-12T17:59:14.418811+0000","last_clean":"2024-09-12T17:59:14.418811+0000","last_became_active":"2024-09-12T17:40:27.380269+0000","last_became_peered":"2024-09-12T17:40:27.380269+0000","last_unstale":"2024-09-12T17:59:14.418811+0000","last_undegraded":"2024-09-12T17:59:14.418811+0000","last_fullsized":"2024-09-12T17:59:14.418811+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:52.967809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"261'42","reported_seq":157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.023193+0000","last_change":"2024-09-12T17:38:51.216559+0000","last_active":"2024-09-12T17:59:16.023193+0000","last_peered":"2024-09-12T17:59:16.023193+0000","last_clean":"2024-09-12T17:59:16.023193+0000","last_became_active":"2024-09-12T17:38:51.216152+0000","last_became_peered":"2024-09-12T17:38:51.216152+0000","last_unstale":"2024-09-12T17:59:16.023193+0000","last_undegraded":"2024-09-12T17:59:16.023193+0000","last_fullsized":"2024-09-12T17:59:16.023193+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:42.821025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":152,"num_write":74,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.418727+0000","last_change":"2024-09-12T17:50:58.431015+0000","last_active":"2024-09-12T17:59:19.418727+0000","last_peered":"2024-09-12T17:59:19.418727+0000","last_clean":"2024-09-12T17:59:19.418727+0000","last_became_active":"2024-09-12T17:50:58.430723+0000","last_became_peered":"2024-09-12T17:50:58.430723+0000","last_unstale":"2024-09-12T17:59:19.418727+0000","last_undegraded":"2024-09-12T17:59:19.418727+0000","last_fullsized":"2024-09-12T17:59:19.418727+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:21.663778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"261'1","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546384+0000","last_change":"2024-09-12T17:40:30.425667+0000","last_active":"2024-09-12T17:59:19.546384+0000","last_peered":"2024-09-12T17:59:19.546384+0000","last_clean":"2024-09-12T17:59:19.546384+0000","last_became_active":"2024-09-12T17:40:30.425368+0000","last_became_peered":"2024-09-12T17:40:30.425368+0000","last_unstale":"2024-09-12T17:59:19.546384+0000","last_undegraded":"2024-09-12T17:59:19.546384+0000","last_fullsized":"2024-09-12T17:59:19.546384+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:57.448155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3212,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:13.618170+0000","last_change":"2024-09-12T17:40:27.384113+0000","last_active":"2024-09-12T17:59:13.618170+0000","last_peered":"2024-09-12T17:59:13.618170+0000","last_clean":"2024-09-12T17:59:13.618170+0000","last_became_active":"2024-09-12T17:40:27.383770+0000","last_became_peered":"2024-09-12T17:40:27.383770+0000","last_unstale":"2024-09-12T17:59:13.618170+0000","last_undegraded":"2024-09-12T17:59:13.618170+0000","last_fullsized":"2024-09-12T17:59:13.618170+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:34.294441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"258'22","reported_seq":108,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.409051+0000","last_change":"2024-09-12T17:38:51.209047+0000","last_active":"2024-09-12T17:58:24.409051+0000","last_peered":"2024-09-12T17:58:24.409051+0000","last_clean":"2024-09-12T17:58:24.409051+0000","last_became_active":"2024-09-12T17:38:51.208767+0000","last_became_peered":"2024-09-12T17:38:51.208767+0000","last_unstale":"2024-09-12T17:58:24.409051+0000","last_undegraded":"2024-09-12T17:58:24.409051+0000","last_fullsized":"2024-09-12T17:58:24.409051+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:21.421941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:04.416155+0000","last_change":"2024-09-12T17:50:58.422944+0000","last_active":"2024-09-12T17:59:04.416155+0000","last_peered":"2024-09-12T17:59:04.416155+0000","last_clean":"2024-09-12T17:59:04.416155+0000","last_became_active":"2024-09-12T17:50:58.422625+0000","last_became_peered":"2024-09-12T17:50:58.422625+0000","last_unstale":"2024-09-12T17:59:04.416155+0000","last_undegraded":"2024-09-12T17:59:04.416155+0000","last_fullsized":"2024-09-12T17:59:04.416155+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:04.987349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"258'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.407842+0000","last_change":"2024-09-12T17:40:30.425786+0000","last_active":"2024-09-12T17:57:54.407842+0000","last_peered":"2024-09-12T17:57:54.407842+0000","last_clean":"2024-09-12T17:57:54.407842+0000","last_became_active":"2024-09-12T17:40:30.425536+0000","last_became_peered":"2024-09-12T17:40:30.425536+0000","last_unstale":"2024-09-12T17:57:54.407842+0000","last_undegraded":"2024-09-12T17:57:54.407842+0000","last_fullsized":"2024-09-12T17:57:54.407842+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:19.565868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"258'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.406415+0000","last_change":"2024-09-12T17:40:27.382099+0000","last_active":"2024-09-12T17:57:49.406415+0000","last_peered":"2024-09-12T17:57:49.406415+0000","last_clean":"2024-09-12T17:57:49.406415+0000","last_became_active":"2024-09-12T17:40:27.381818+0000","last_became_peered":"2024-09-12T17:40:27.381818+0000","last_unstale":"2024-09-12T17:57:49.406415+0000","last_undegraded":"2024-09-12T17:57:49.406415+0000","last_fullsized":"2024-09-12T17:57:49.406415+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:59.918995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"261'42","reported_seq":165,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:44.406455+0000","last_change":"2024-09-12T17:38:51.211565+0000","last_active":"2024-09-12T17:57:44.406455+0000","last_peered":"2024-09-12T17:57:44.406455+0000","last_clean":"2024-09-12T17:57:44.406455+0000","last_became_active":"2024-09-12T17:38:51.211219+0000","last_became_peered":"2024-09-12T17:38:51.211219+0000","last_unstale":"2024-09-12T17:57:44.406455+0000","last_undegraded":"2024-09-12T17:57:44.406455+0000","last_fullsized":"2024-09-12T17:57:44.406455+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:18.738642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":165,"num_write":70,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419044+0000","last_change":"2024-09-12T17:50:58.416892+0000","last_active":"2024-09-12T17:59:19.419044+0000","last_peered":"2024-09-12T17:59:19.419044+0000","last_clean":"2024-09-12T17:59:19.419044+0000","last_became_active":"2024-09-12T17:50:58.416501+0000","last_became_peered":"2024-09-12T17:50:58.416501+0000","last_unstale":"2024-09-12T17:59:19.419044+0000","last_undegraded":"2024-09-12T17:59:19.419044+0000","last_fullsized":"2024-09-12T17:59:19.419044+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:06.098567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"261'4","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.407686+0000","last_change":"2024-09-12T17:40:30.418747+0000","last_active":"2024-09-12T17:57:54.407686+0000","last_peered":"2024-09-12T17:57:54.407686+0000","last_clean":"2024-09-12T17:57:54.407686+0000","last_became_active":"2024-09-12T17:40:30.418418+0000","last_became_peered":"2024-09-12T17:40:30.418418+0000","last_unstale":"2024-09-12T17:57:54.407686+0000","last_undegraded":"2024-09-12T17:57:54.407686+0000","last_fullsized":"2024-09-12T17:57:54.407686+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:50.907324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.407185+0000","last_change":"2024-09-12T17:40:27.383455+0000","last_active":"2024-09-12T17:57:49.407185+0000","last_peered":"2024-09-12T17:57:49.407185+0000","last_clean":"2024-09-12T17:57:49.407185+0000","last_became_active":"2024-09-12T17:40:27.383023+0000","last_became_peered":"2024-09-12T17:40:27.383023+0000","last_unstale":"2024-09-12T17:57:49.407185+0000","last_undegraded":"2024-09-12T17:57:49.407185+0000","last_fullsized":"2024-09-12T17:57:49.407185+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:38.107217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"261'37","reported_seq":149,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.249331+0000","last_change":"2024-09-12T17:38:51.210126+0000","last_active":"2024-09-12T17:59:54.249331+0000","last_peered":"2024-09-12T17:59:54.249331+0000","last_clean":"2024-09-12T17:59:54.249331+0000","last_became_active":"2024-09-12T17:38:51.209833+0000","last_became_peered":"2024-09-12T17:38:51.209833+0000","last_unstale":"2024-09-12T17:59:54.249331+0000","last_undegraded":"2024-09-12T17:59:54.249331+0000","last_fullsized":"2024-09-12T17:59:54.249331+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:29.524821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":141,"num_write":58,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.621111+0000","last_change":"2024-09-12T17:50:58.424105+0000","last_active":"2024-09-12T17:59:38.621111+0000","last_peered":"2024-09-12T17:59:38.621111+0000","last_clean":"2024-09-12T17:59:38.621111+0000","last_became_active":"2024-09-12T17:50:58.423798+0000","last_became_peered":"2024-09-12T17:50:58.423798+0000","last_unstale":"2024-09-12T17:59:38.621111+0000","last_undegraded":"2024-09-12T17:59:38.621111+0000","last_fullsized":"2024-09-12T17:59:38.621111+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:57.214535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.417888+0000","last_change":"2024-09-12T17:40:30.412437+0000","last_active":"2024-09-12T17:59:14.417888+0000","last_peered":"2024-09-12T17:59:14.417888+0000","last_clean":"2024-09-12T17:59:14.417888+0000","last_became_active":"2024-09-12T17:40:30.412140+0000","last_became_peered":"2024-09-12T17:40:30.412140+0000","last_unstale":"2024-09-12T17:59:14.417888+0000","last_undegraded":"2024-09-12T17:59:14.417888+0000","last_fullsized":"2024-09-12T17:59:14.417888+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:44.020052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:34.413567+0000","last_change":"2024-09-12T17:40:27.385866+0000","last_active":"2024-09-12T17:58:34.413567+0000","last_peered":"2024-09-12T17:58:34.413567+0000","last_clean":"2024-09-12T17:58:34.413567+0000","last_became_active":"2024-09-12T17:40:27.385649+0000","last_became_peered":"2024-09-12T17:40:27.385649+0000","last_unstale":"2024-09-12T17:58:34.413567+0000","last_undegraded":"2024-09-12T17:58:34.413567+0000","last_fullsized":"2024-09-12T17:58:34.413567+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:44.080842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"258'14","reported_seq":85,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.422160+0000","last_change":"2024-09-12T17:38:51.216015+0000","last_active":"2024-09-12T17:59:44.422160+0000","last_peered":"2024-09-12T17:59:44.422160+0000","last_clean":"2024-09-12T17:59:44.422160+0000","last_became_active":"2024-09-12T17:38:51.215738+0000","last_became_peered":"2024-09-12T17:38:51.215738+0000","last_unstale":"2024-09-12T17:59:44.422160+0000","last_undegraded":"2024-09-12T17:59:44.422160+0000","last_fullsized":"2024-09-12T17:59:44.422160+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:22.857791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.549295+0000","last_change":"2024-09-12T17:50:58.423755+0000","last_active":"2024-09-12T17:59:39.549295+0000","last_peered":"2024-09-12T17:59:39.549295+0000","last_clean":"2024-09-12T17:59:39.549295+0000","last_became_active":"2024-09-12T17:50:58.423443+0000","last_became_peered":"2024-09-12T17:50:58.423443+0000","last_unstale":"2024-09-12T17:59:39.549295+0000","last_undegraded":"2024-09-12T17:59:39.549295+0000","last_fullsized":"2024-09-12T17:59:39.549295+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:21.905993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:34.412791+0000","last_change":"2024-09-12T17:40:30.415967+0000","last_active":"2024-09-12T17:58:34.412791+0000","last_peered":"2024-09-12T17:58:34.412791+0000","last_clean":"2024-09-12T17:58:34.412791+0000","last_became_active":"2024-09-12T17:40:30.415696+0000","last_became_peered":"2024-09-12T17:40:30.415696+0000","last_unstale":"2024-09-12T17:58:34.412791+0000","last_undegraded":"2024-09-12T17:58:34.412791+0000","last_fullsized":"2024-09-12T17:58:34.412791+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:00.615699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418738+0000","last_change":"2024-09-12T17:40:27.381415+0000","last_active":"2024-09-12T17:59:14.418738+0000","last_peered":"2024-09-12T17:59:14.418738+0000","last_clean":"2024-09-12T17:59:14.418738+0000","last_became_active":"2024-09-12T17:40:27.381128+0000","last_became_peered":"2024-09-12T17:40:27.381128+0000","last_unstale":"2024-09-12T17:59:14.418738+0000","last_undegraded":"2024-09-12T17:59:14.418738+0000","last_fullsized":"2024-09-12T17:59:14.418738+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:41.708551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"261'15","reported_seq":83,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.422414+0000","last_change":"2024-09-12T17:38:51.211542+0000","last_active":"2024-09-12T17:59:44.422414+0000","last_peered":"2024-09-12T17:59:44.422414+0000","last_clean":"2024-09-12T17:59:44.422414+0000","last_became_active":"2024-09-12T17:38:51.210741+0000","last_became_peered":"2024-09-12T17:38:51.210741+0000","last_unstale":"2024-09-12T17:59:44.422414+0000","last_undegraded":"2024-09-12T17:59:44.422414+0000","last_fullsized":"2024-09-12T17:59:44.422414+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:53.102160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":45,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546366+0000","last_change":"2024-09-12T17:50:58.422536+0000","last_active":"2024-09-12T17:59:19.546366+0000","last_peered":"2024-09-12T17:59:19.546366+0000","last_clean":"2024-09-12T17:59:19.546366+0000","last_became_active":"2024-09-12T17:50:58.422195+0000","last_became_peered":"2024-09-12T17:50:58.422195+0000","last_unstale":"2024-09-12T17:59:19.546366+0000","last_undegraded":"2024-09-12T17:59:19.546366+0000","last_fullsized":"2024-09-12T17:59:19.546366+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:53.708044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.416457+0000","last_change":"2024-09-12T17:40:30.418965+0000","last_active":"2024-09-12T17:59:19.416457+0000","last_peered":"2024-09-12T17:59:19.416457+0000","last_clean":"2024-09-12T17:59:19.416457+0000","last_became_active":"2024-09-12T17:40:30.418692+0000","last_became_peered":"2024-09-12T17:40:30.418692+0000","last_unstale":"2024-09-12T17:59:19.416457+0000","last_undegraded":"2024-09-12T17:59:19.416457+0000","last_fullsized":"2024-09-12T17:59:19.416457+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:04.962038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"258'6","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.417950+0000","last_change":"2024-09-12T17:40:27.377091+0000","last_active":"2024-09-12T17:59:14.417950+0000","last_peered":"2024-09-12T17:59:14.417950+0000","last_clean":"2024-09-12T17:59:14.417950+0000","last_became_active":"2024-09-12T17:40:27.376395+0000","last_became_peered":"2024-09-12T17:40:27.376395+0000","last_unstale":"2024-09-12T17:59:14.417950+0000","last_undegraded":"2024-09-12T17:59:14.417950+0000","last_fullsized":"2024-09-12T17:59:14.417950+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:00.248728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"261'24","reported_seq":110,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.419639+0000","last_change":"2024-09-12T17:38:51.213165+0000","last_active":"2024-09-12T17:59:44.419639+0000","last_peered":"2024-09-12T17:59:44.419639+0000","last_clean":"2024-09-12T17:59:44.419639+0000","last_became_active":"2024-09-12T17:38:51.212856+0000","last_became_peered":"2024-09-12T17:38:51.212856+0000","last_unstale":"2024-09-12T17:59:44.419639+0000","last_undegraded":"2024-09-12T17:59:44.419639+0000","last_fullsized":"2024-09-12T17:59:44.419639+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:17.393643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":83,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:24.420242+0000","last_change":"2024-09-12T17:50:58.431889+0000","last_active":"2024-09-12T17:59:24.420242+0000","last_peered":"2024-09-12T17:59:24.420242+0000","last_clean":"2024-09-12T17:59:24.420242+0000","last_became_active":"2024-09-12T17:50:58.431442+0000","last_became_peered":"2024-09-12T17:50:58.431442+0000","last_unstale":"2024-09-12T17:59:24.420242+0000","last_undegraded":"2024-09-12T17:59:24.420242+0000","last_fullsized":"2024-09-12T17:59:24.420242+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:40.014254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419070+0000","last_change":"2024-09-12T17:40:30.418760+0000","last_active":"2024-09-12T17:59:19.419070+0000","last_peered":"2024-09-12T17:59:19.419070+0000","last_clean":"2024-09-12T17:59:19.419070+0000","last_became_active":"2024-09-12T17:40:30.418464+0000","last_became_peered":"2024-09-12T17:40:30.418464+0000","last_unstale":"2024-09-12T17:59:19.419070+0000","last_undegraded":"2024-09-12T17:59:19.419070+0000","last_fullsized":"2024-09-12T17:59:19.419070+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:03.345502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"261'3","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.415954+0000","last_change":"2024-09-12T17:40:27.379405+0000","last_active":"2024-09-12T17:59:14.415954+0000","last_peered":"2024-09-12T17:59:14.415954+0000","last_clean":"2024-09-12T17:59:14.415954+0000","last_became_active":"2024-09-12T17:40:27.379133+0000","last_became_peered":"2024-09-12T17:40:27.379133+0000","last_unstale":"2024-09-12T17:59:14.415954+0000","last_undegraded":"2024-09-12T17:59:14.415954+0000","last_fullsized":"2024-09-12T17:59:14.415954+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:39.813640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246092,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":8,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"261'32","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.417100+0000","last_change":"2024-09-12T17:38:51.208801+0000","last_active":"2024-09-12T17:58:59.417100+0000","last_peered":"2024-09-12T17:58:59.417100+0000","last_clean":"2024-09-12T17:58:59.417100+0000","last_became_active":"2024-09-12T17:38:51.208386+0000","last_became_peered":"2024-09-12T17:38:51.208386+0000","last_unstale":"2024-09-12T17:58:59.417100+0000","last_undegraded":"2024-09-12T17:58:59.417100+0000","last_fullsized":"2024-09-12T17:58:59.417100+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:57.157726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":109,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"261'269","reported_seq":881,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.059607+0000","last_change":"2024-09-12T17:23:40.709230+0000","last_active":"2024-09-12T18:01:34.059607+0000","last_peered":"2024-09-12T18:01:34.059607+0000","last_clean":"2024-09-12T18:01:34.059607+0000","last_became_active":"2024-09-12T17:23:40.708951+0000","last_became_peered":"2024-09-12T17:23:40.708951+0000","last_unstale":"2024-09-12T18:01:34.059607+0000","last_undegraded":"2024-09-12T18:01:34.059607+0000","last_fullsized":"2024-09-12T18:01:34.059607+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:29.306708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7403571,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":399,"num_read_kb":4677,"num_write":1037,"num_write_kb":27229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"261'483","reported_seq":2010,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.776173+0000","last_change":"2024-09-12T17:23:42.147291+0000","last_active":"2024-09-12T18:00:15.776173+0000","last_peered":"2024-09-12T18:00:15.776173+0000","last_clean":"2024-09-12T18:00:15.776173+0000","last_became_active":"2024-09-12T17:23:42.146906+0000","last_became_peered":"2024-09-12T17:23:42.146906+0000","last_unstale":"2024-09-12T18:00:15.776173+0000","last_undegraded":"2024-09-12T18:00:15.776173+0000","last_fullsized":"2024-09-12T18:00:15.776173+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:47.049866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2345,"num_read_kb":2204,"num_write":541,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"261'326","reported_seq":999,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:53.431382+0000","last_change":"2024-09-12T17:23:40.720117+0000","last_active":"2024-09-12T17:59:53.431382+0000","last_peered":"2024-09-12T17:59:53.431382+0000","last_clean":"2024-09-12T17:59:53.431382+0000","last_became_active":"2024-09-12T17:23:40.719834+0000","last_became_peered":"2024-09-12T17:23:40.719834+0000","last_unstale":"2024-09-12T17:59:53.431382+0000","last_undegraded":"2024-09-12T17:59:53.431382+0000","last_fullsized":"2024-09-12T17:59:53.431382+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:08.528131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10874006,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":559,"num_read_kb":15949,"num_write":1128,"num_write_kb":28721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"261'473","reported_seq":2215,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.149339+0000","last_change":"2024-09-12T17:23:42.147555+0000","last_active":"2024-09-12T18:00:18.149339+0000","last_peered":"2024-09-12T18:00:18.149339+0000","last_clean":"2024-09-12T18:00:18.149339+0000","last_became_active":"2024-09-12T17:23:42.147270+0000","last_became_peered":"2024-09-12T17:23:42.147270+0000","last_unstale":"2024-09-12T18:00:18.149339+0000","last_undegraded":"2024-09-12T18:00:18.149339+0000","last_fullsized":"2024-09-12T18:00:18.149339+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:12.132659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3009,"num_read_kb":2866,"num_write":558,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"261'276","reported_seq":1074,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.520775+0000","last_change":"2024-09-12T17:23:40.702160+0000","last_active":"2024-09-12T18:01:49.520775+0000","last_peered":"2024-09-12T18:01:49.520775+0000","last_clean":"2024-09-12T18:01:49.520775+0000","last_became_active":"2024-09-12T17:23:40.701839+0000","last_became_peered":"2024-09-12T17:23:40.701839+0000","last_unstale":"2024-09-12T18:01:49.520775+0000","last_undegraded":"2024-09-12T18:01:49.520775+0000","last_fullsized":"2024-09-12T18:01:49.520775+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:27.896198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10652701,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":775,"num_read_kb":22445,"num_write":923,"num_write_kb":35081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"261'1193","reported_seq":2827,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.787881+0000","last_change":"2024-09-12T17:23:42.143316+0000","last_active":"2024-09-12T18:00:05.787881+0000","last_peered":"2024-09-12T18:00:05.787881+0000","last_clean":"2024-09-12T18:00:05.787881+0000","last_became_active":"2024-09-12T17:23:42.141845+0000","last_became_peered":"2024-09-12T17:23:42.141845+0000","last_unstale":"2024-09-12T18:00:05.787881+0000","last_undegraded":"2024-09-12T18:00:05.787881+0000","last_fullsized":"2024-09-12T18:00:05.787881+0000","mapping_epoch":25,"log_start":"261'1100","ondisk_log_start":"261'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":1100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:43.825593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5470,"num_read_kb":4840,"num_write":1657,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"261'317","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.947792+0000","last_change":"2024-09-12T17:23:40.713745+0000","last_active":"2024-09-12T18:01:36.947792+0000","last_peered":"2024-09-12T18:01:36.947792+0000","last_clean":"2024-09-12T18:01:36.947792+0000","last_became_active":"2024-09-12T17:23:40.712263+0000","last_became_peered":"2024-09-12T17:23:40.712263+0000","last_unstale":"2024-09-12T18:01:36.947792+0000","last_undegraded":"2024-09-12T18:01:36.947792+0000","last_fullsized":"2024-09-12T18:01:36.947792+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:37.480449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1082950,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":465,"num_read_kb":11567,"num_write":1170,"num_write_kb":26002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"261'1241","reported_seq":2921,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.777810+0000","last_change":"2024-09-12T17:23:42.158153+0000","last_active":"2024-09-12T18:00:15.777810+0000","last_peered":"2024-09-12T18:00:15.777810+0000","last_clean":"2024-09-12T18:00:15.777810+0000","last_became_active":"2024-09-12T17:23:42.157835+0000","last_became_peered":"2024-09-12T17:23:42.157835+0000","last_unstale":"2024-09-12T18:00:15.777810+0000","last_undegraded":"2024-09-12T18:00:15.777810+0000","last_fullsized":"2024-09-12T18:00:15.777810+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:20.923845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5656,"num_read_kb":5021,"num_write":1694,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"261'287","reported_seq":972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.627825+0000","last_change":"2024-09-12T17:23:40.706187+0000","last_active":"2024-09-12T17:59:58.627825+0000","last_peered":"2024-09-12T17:59:58.627825+0000","last_clean":"2024-09-12T17:59:58.627825+0000","last_became_active":"2024-09-12T17:23:40.705906+0000","last_became_peered":"2024-09-12T17:23:40.705906+0000","last_unstale":"2024-09-12T17:59:58.627825+0000","last_undegraded":"2024-09-12T17:59:58.627825+0000","last_fullsized":"2024-09-12T17:59:58.627825+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.975637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245706,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":607,"num_read_kb":37545,"num_write":1029,"num_write_kb":42867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"261'385","reported_seq":1824,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.566613+0000","last_change":"2024-09-12T17:23:42.142597+0000","last_active":"2024-09-12T18:00:04.566613+0000","last_peered":"2024-09-12T18:00:04.566613+0000","last_clean":"2024-09-12T18:00:04.566613+0000","last_became_active":"2024-09-12T17:23:42.142311+0000","last_became_peered":"2024-09-12T17:23:42.142311+0000","last_unstale":"2024-09-12T18:00:04.566613+0000","last_undegraded":"2024-09-12T18:00:04.566613+0000","last_fullsized":"2024-09-12T18:00:04.566613+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:25.262592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2045,"num_read_kb":1945,"num_write":422,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"261'326","reported_seq":1018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:57.367503+0000","last_change":"2024-09-12T17:23:40.705539+0000","last_active":"2024-09-12T17:59:57.367503+0000","last_peered":"2024-09-12T17:59:57.367503+0000","last_clean":"2024-09-12T17:59:57.367503+0000","last_became_active":"2024-09-12T17:23:40.705215+0000","last_became_peered":"2024-09-12T17:23:40.705215+0000","last_unstale":"2024-09-12T17:59:57.367503+0000","last_undegraded":"2024-09-12T17:59:57.367503+0000","last_fullsized":"2024-09-12T17:59:57.367503+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:33.336833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295144,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":707,"num_read_kb":26786,"num_write":1227,"num_write_kb":30822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"261'882","reported_seq":2676,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.911490+0000","last_change":"2024-09-12T17:23:42.143689+0000","last_active":"2024-09-12T17:59:59.911490+0000","last_peered":"2024-09-12T17:59:59.911490+0000","last_clean":"2024-09-12T17:59:59.911490+0000","last_became_active":"2024-09-12T17:23:42.143402+0000","last_became_peered":"2024-09-12T17:23:42.143402+0000","last_unstale":"2024-09-12T17:59:59.911490+0000","last_undegraded":"2024-09-12T17:59:59.911490+0000","last_fullsized":"2024-09-12T17:59:59.911490+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:34.164395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4455,"num_read_kb":4051,"num_write":1149,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"261'273","reported_seq":887,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.856750+0000","last_change":"2024-09-12T17:23:40.714177+0000","last_active":"2024-09-12T18:00:02.856750+0000","last_peered":"2024-09-12T18:00:02.856750+0000","last_clean":"2024-09-12T18:00:02.856750+0000","last_became_active":"2024-09-12T17:23:40.713883+0000","last_became_peered":"2024-09-12T17:23:40.713883+0000","last_unstale":"2024-09-12T18:00:02.856750+0000","last_undegraded":"2024-09-12T18:00:02.856750+0000","last_fullsized":"2024-09-12T18:00:02.856750+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:08.265768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19258432,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":416,"num_read_kb":1994,"num_write":1054,"num_write_kb":56686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"261'914","reported_seq":2617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559532+0000","last_change":"2024-09-12T17:23:42.152325+0000","last_active":"2024-09-12T18:00:18.559532+0000","last_peered":"2024-09-12T18:00:18.559532+0000","last_clean":"2024-09-12T18:00:18.559532+0000","last_became_active":"2024-09-12T17:23:42.152030+0000","last_became_peered":"2024-09-12T17:23:42.152030+0000","last_unstale":"2024-09-12T18:00:18.559532+0000","last_undegraded":"2024-09-12T18:00:18.559532+0000","last_fullsized":"2024-09-12T18:00:18.559532+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":900,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:58.696177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4677,"num_read_kb":4199,"num_write":1240,"num_write_kb":482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"261'256","reported_seq":932,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:24.808003+0000","last_change":"2024-09-12T17:23:40.717561+0000","last_active":"2024-09-12T17:59:24.808003+0000","last_peered":"2024-09-12T17:59:24.808003+0000","last_clean":"2024-09-12T17:59:24.808003+0000","last_became_active":"2024-09-12T17:23:40.717097+0000","last_became_peered":"2024-09-12T17:23:40.717097+0000","last_unstale":"2024-09-12T17:59:24.808003+0000","last_undegraded":"2024-09-12T17:59:24.808003+0000","last_fullsized":"2024-09-12T17:59:24.808003+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:08.329294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947935,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":534,"num_read_kb":3212,"num_write":1015,"num_write_kb":17046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"261'390","reported_seq":1862,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.560134+0000","last_change":"2024-09-12T17:24:17.227171+0000","last_active":"2024-09-12T18:00:18.560134+0000","last_peered":"2024-09-12T18:00:18.560134+0000","last_clean":"2024-09-12T18:00:18.560134+0000","last_became_active":"2024-09-12T17:24:17.226840+0000","last_became_peered":"2024-09-12T17:24:17.226840+0000","last_unstale":"2024-09-12T18:00:18.560134+0000","last_undegraded":"2024-09-12T18:00:18.560134+0000","last_fullsized":"2024-09-12T18:00:18.560134+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:26.876837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2081,"num_read_kb":1979,"num_write":442,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"261'751","reported_seq":2065,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.247585+0000","last_change":"2024-09-12T17:23:42.152851+0000","last_active":"2024-09-12T18:00:04.247585+0000","last_peered":"2024-09-12T18:00:04.247585+0000","last_clean":"2024-09-12T18:00:04.247585+0000","last_became_active":"2024-09-12T17:23:42.152513+0000","last_became_peered":"2024-09-12T17:23:42.152513+0000","last_unstale":"2024-09-12T18:00:04.247585+0000","last_undegraded":"2024-09-12T18:00:04.247585+0000","last_fullsized":"2024-09-12T18:00:04.247585+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:34.195735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3383,"num_read_kb":3022,"num_write":991,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"261'251","reported_seq":868,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.359475+0000","last_change":"2024-09-12T17:23:40.713044+0000","last_active":"2024-09-12T18:00:04.359475+0000","last_peered":"2024-09-12T18:00:04.359475+0000","last_clean":"2024-09-12T18:00:04.359475+0000","last_became_active":"2024-09-12T17:23:40.712747+0000","last_became_peered":"2024-09-12T17:23:40.712747+0000","last_unstale":"2024-09-12T18:00:04.359475+0000","last_undegraded":"2024-09-12T18:00:04.359475+0000","last_fullsized":"2024-09-12T18:00:04.359475+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.000672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11859730,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":394,"num_read_kb":32148,"num_write":905,"num_write_kb":37186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"261'506","reported_seq":2009,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.988702+0000","last_change":"2024-09-12T17:23:42.148419+0000","last_active":"2024-09-12T18:00:03.988702+0000","last_peered":"2024-09-12T18:00:03.988702+0000","last_clean":"2024-09-12T18:00:03.988702+0000","last_became_active":"2024-09-12T17:23:42.148091+0000","last_became_peered":"2024-09-12T17:23:42.148091+0000","last_unstale":"2024-09-12T18:00:03.988702+0000","last_undegraded":"2024-09-12T18:00:03.988702+0000","last_fullsized":"2024-09-12T18:00:03.988702+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:49.293452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2605,"num_read_kb":2400,"num_write":650,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"261'289","reported_seq":976,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.193547+0000","last_change":"2024-09-12T17:23:40.708563+0000","last_active":"2024-09-12T17:59:54.193547+0000","last_peered":"2024-09-12T17:59:54.193547+0000","last_clean":"2024-09-12T17:59:54.193547+0000","last_became_active":"2024-09-12T17:23:40.708089+0000","last_became_peered":"2024-09-12T17:23:40.708089+0000","last_unstale":"2024-09-12T17:59:54.193547+0000","last_undegraded":"2024-09-12T17:59:54.193547+0000","last_fullsized":"2024-09-12T17:59:54.193547+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:09.021258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6686981,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":589,"num_read_kb":14171,"num_write":1118,"num_write_kb":46213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"261'906","reported_seq":2491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.398639+0000","last_change":"2024-09-12T17:23:42.146163+0000","last_active":"2024-09-12T18:01:41.398639+0000","last_peered":"2024-09-12T18:01:41.398639+0000","last_clean":"2024-09-12T18:01:41.398639+0000","last_became_active":"2024-09-12T17:23:42.145860+0000","last_became_peered":"2024-09-12T17:23:42.145860+0000","last_unstale":"2024-09-12T18:01:41.398639+0000","last_undegraded":"2024-09-12T18:01:41.398639+0000","last_fullsized":"2024-09-12T18:01:41.398639+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":800,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:47.060225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4352,"num_read_kb":3896,"num_write":1238,"num_write_kb":509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"261'296","reported_seq":1029,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.195573+0000","last_change":"2024-09-12T17:24:17.233383+0000","last_active":"2024-09-12T18:00:03.195573+0000","last_peered":"2024-09-12T18:00:03.195573+0000","last_clean":"2024-09-12T18:00:03.195573+0000","last_became_active":"2024-09-12T17:24:17.232979+0000","last_became_peered":"2024-09-12T17:24:17.232979+0000","last_unstale":"2024-09-12T18:00:03.195573+0000","last_undegraded":"2024-09-12T18:00:03.195573+0000","last_fullsized":"2024-09-12T18:00:03.195573+0000","mapping_epoch":36,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.921503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439574,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":763,"num_read_kb":6334,"num_write":1212,"num_write_kb":23763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"261'427","reported_seq":1989,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.767282+0000","last_change":"2024-09-12T17:23:42.148296+0000","last_active":"2024-09-12T18:00:15.767282+0000","last_peered":"2024-09-12T18:00:15.767282+0000","last_clean":"2024-09-12T18:00:15.767282+0000","last_became_active":"2024-09-12T17:23:42.148023+0000","last_became_peered":"2024-09-12T17:23:42.148023+0000","last_unstale":"2024-09-12T18:00:15.767282+0000","last_undegraded":"2024-09-12T18:00:15.767282+0000","last_fullsized":"2024-09-12T18:00:15.767282+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:08.262875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2276,"num_read_kb":2173,"num_write":473,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"261'281","reported_seq":896,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.805284+0000","last_change":"2024-09-12T17:23:40.714934+0000","last_active":"2024-09-12T18:00:03.805284+0000","last_peered":"2024-09-12T18:00:03.805284+0000","last_clean":"2024-09-12T18:00:03.805284+0000","last_became_active":"2024-09-12T17:23:40.714604+0000","last_became_peered":"2024-09-12T17:23:40.714604+0000","last_unstale":"2024-09-12T18:00:03.805284+0000","last_undegraded":"2024-09-12T18:00:03.805284+0000","last_fullsized":"2024-09-12T18:00:03.805284+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:27.138414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4690785,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":419,"num_read_kb":7311,"num_write":1058,"num_write_kb":22062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"261'420","reported_seq":1932,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.398203+0000","last_change":"2024-09-12T17:23:42.141588+0000","last_active":"2024-09-12T18:01:41.398203+0000","last_peered":"2024-09-12T18:01:41.398203+0000","last_clean":"2024-09-12T18:01:41.398203+0000","last_became_active":"2024-09-12T17:23:42.141237+0000","last_became_peered":"2024-09-12T17:23:42.141237+0000","last_unstale":"2024-09-12T18:01:41.398203+0000","last_undegraded":"2024-09-12T18:01:41.398203+0000","last_fullsized":"2024-09-12T18:01:41.398203+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:12.130382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2248,"num_read_kb":2133,"num_write":484,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"261'265","reported_seq":881,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.145275+0000","last_change":"2024-09-12T17:23:40.705121+0000","last_active":"2024-09-12T18:00:02.145275+0000","last_peered":"2024-09-12T18:00:02.145275+0000","last_clean":"2024-09-12T18:00:02.145275+0000","last_became_active":"2024-09-12T17:23:40.704825+0000","last_became_peered":"2024-09-12T17:23:40.704825+0000","last_unstale":"2024-09-12T18:00:02.145275+0000","last_undegraded":"2024-09-12T18:00:02.145275+0000","last_fullsized":"2024-09-12T18:00:02.145275+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:59.186994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278848,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":394,"num_read_kb":2074,"num_write":982,"num_write_kb":16303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"261'380","reported_seq":1869,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.496044+0000","last_change":"2024-09-12T17:23:42.137722+0000","last_active":"2024-09-12T18:00:05.496044+0000","last_peered":"2024-09-12T18:00:05.496044+0000","last_clean":"2024-09-12T18:00:05.496044+0000","last_became_active":"2024-09-12T17:23:42.137455+0000","last_became_peered":"2024-09-12T17:23:42.137455+0000","last_unstale":"2024-09-12T18:00:05.496044+0000","last_undegraded":"2024-09-12T18:00:05.496044+0000","last_fullsized":"2024-09-12T18:00:05.496044+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:28.273631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2042,"num_read_kb":1965,"num_write":435,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"261'298","reported_seq":941,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.506250+0000","last_change":"2024-09-12T17:23:40.712347+0000","last_active":"2024-09-12T18:01:49.506250+0000","last_peered":"2024-09-12T18:01:49.506250+0000","last_clean":"2024-09-12T18:01:49.506250+0000","last_became_active":"2024-09-12T17:23:40.711201+0000","last_became_peered":"2024-09-12T17:23:40.711201+0000","last_unstale":"2024-09-12T18:01:49.506250+0000","last_undegraded":"2024-09-12T18:01:49.506250+0000","last_fullsized":"2024-09-12T18:01:49.506250+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:09.766467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7876019,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":489,"num_read_kb":25516,"num_write":1139,"num_write_kb":38939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"261'151","reported_seq":661,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.612262+0000","last_change":"2024-09-12T17:23:50.184556+0000","last_active":"2024-09-12T18:00:18.612262+0000","last_peered":"2024-09-12T18:00:18.612262+0000","last_clean":"2024-09-12T18:00:18.612262+0000","last_became_active":"2024-09-12T17:23:50.184149+0000","last_became_peered":"2024-09-12T17:23:50.184149+0000","last_unstale":"2024-09-12T18:00:18.612262+0000","last_undegraded":"2024-09-12T18:00:18.612262+0000","last_fullsized":"2024-09-12T18:00:18.612262+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:56.623668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":269,"num_read_kb":251,"num_write":373,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"261'429","reported_seq":2033,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.775304+0000","last_change":"2024-09-12T17:23:42.154156+0000","last_active":"2024-09-12T18:00:15.775304+0000","last_peered":"2024-09-12T18:00:15.775304+0000","last_clean":"2024-09-12T18:00:15.775304+0000","last_became_active":"2024-09-12T17:23:42.153262+0000","last_became_peered":"2024-09-12T17:23:42.153262+0000","last_unstale":"2024-09-12T18:00:15.775304+0000","last_undegraded":"2024-09-12T18:00:15.775304+0000","last_fullsized":"2024-09-12T18:00:15.775304+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:04.351858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2462,"num_read_kb":2350,"num_write":478,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"261'271","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:26.861166+0000","last_change":"2024-09-12T17:23:40.709825+0000","last_active":"2024-09-12T17:59:26.861166+0000","last_peered":"2024-09-12T17:59:26.861166+0000","last_clean":"2024-09-12T17:59:26.861166+0000","last_became_active":"2024-09-12T17:23:40.709513+0000","last_became_peered":"2024-09-12T17:23:40.709513+0000","last_unstale":"2024-09-12T17:59:26.861166+0000","last_undegraded":"2024-09-12T17:59:26.861166+0000","last_fullsized":"2024-09-12T17:59:26.861166+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:06.392512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9700143,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":416,"num_read_kb":53800,"num_write":1027,"num_write_kb":42009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404158+0000","last_change":"2024-09-12T17:23:44.151154+0000","last_active":"2024-09-12T17:57:34.404158+0000","last_peered":"2024-09-12T17:57:34.404158+0000","last_clean":"2024-09-12T17:57:34.404158+0000","last_became_active":"2024-09-12T17:23:44.150860+0000","last_became_peered":"2024-09-12T17:23:44.150860+0000","last_unstale":"2024-09-12T17:57:34.404158+0000","last_undegraded":"2024-09-12T17:57:34.404158+0000","last_fullsized":"2024-09-12T17:57:34.404158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:48.984288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"261'333","reported_seq":913,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.421054+0000","last_change":"2024-09-12T17:23:46.153152+0000","last_active":"2024-09-12T18:01:42.421054+0000","last_peered":"2024-09-12T18:01:42.421054+0000","last_clean":"2024-09-12T18:01:42.421054+0000","last_became_active":"2024-09-12T17:23:46.152874+0000","last_became_peered":"2024-09-12T17:23:46.152874+0000","last_unstale":"2024-09-12T18:01:42.421054+0000","last_undegraded":"2024-09-12T18:01:42.421054+0000","last_fullsized":"2024-09-12T18:01:42.421054+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:57.758740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64524,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":540,"num_read_kb":1061,"num_write":440,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.405726+0000","last_change":"2024-09-12T17:23:48.168394+0000","last_active":"2024-09-12T17:57:39.405726+0000","last_peered":"2024-09-12T17:57:39.405726+0000","last_clean":"2024-09-12T17:57:39.405726+0000","last_became_active":"2024-09-12T17:23:48.168052+0000","last_became_peered":"2024-09-12T17:23:48.168052+0000","last_unstale":"2024-09-12T17:57:39.405726+0000","last_undegraded":"2024-09-12T17:57:39.405726+0000","last_fullsized":"2024-09-12T17:57:39.405726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:50.986726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"261'173","reported_seq":728,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.773668+0000","last_change":"2024-09-12T17:23:50.188838+0000","last_active":"2024-09-12T18:00:15.773668+0000","last_peered":"2024-09-12T18:00:15.773668+0000","last_clean":"2024-09-12T18:00:15.773668+0000","last_became_active":"2024-09-12T17:23:50.188506+0000","last_became_peered":"2024-09-12T17:23:50.188506+0000","last_unstale":"2024-09-12T18:00:15.773668+0000","last_undegraded":"2024-09-12T18:00:15.773668+0000","last_fullsized":"2024-09-12T18:00:15.773668+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:28.074396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":316,"num_read_kb":300,"num_write":383,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"261'579","reported_seq":2125,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.140832+0000","last_change":"2024-09-12T17:23:42.144567+0000","last_active":"2024-09-12T18:00:18.140832+0000","last_peered":"2024-09-12T18:00:18.140832+0000","last_clean":"2024-09-12T18:00:18.140832+0000","last_became_active":"2024-09-12T17:23:42.143794+0000","last_became_peered":"2024-09-12T17:23:42.143794+0000","last_unstale":"2024-09-12T18:00:18.140832+0000","last_undegraded":"2024-09-12T18:00:18.140832+0000","last_fullsized":"2024-09-12T18:00:18.140832+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:01.173511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3146,"num_read_kb":2882,"num_write":787,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"261'331","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.826279+0000","last_change":"2024-09-12T17:24:17.288249+0000","last_active":"2024-09-12T18:00:03.826279+0000","last_peered":"2024-09-12T18:00:03.826279+0000","last_clean":"2024-09-12T18:00:03.826279+0000","last_became_active":"2024-09-12T17:24:17.287987+0000","last_became_peered":"2024-09-12T17:24:17.287987+0000","last_unstale":"2024-09-12T18:00:03.826279+0000","last_undegraded":"2024-09-12T18:00:03.826279+0000","last_fullsized":"2024-09-12T18:00:03.826279+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:59.986635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15906645,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":535,"num_read_kb":42370,"num_write":1109,"num_write_kb":32675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.413518+0000","last_change":"2024-09-12T17:23:44.149386+0000","last_active":"2024-09-12T17:58:48.413518+0000","last_peered":"2024-09-12T17:58:48.413518+0000","last_clean":"2024-09-12T17:58:48.413518+0000","last_became_active":"2024-09-12T17:23:44.149079+0000","last_became_peered":"2024-09-12T17:23:44.149079+0000","last_unstale":"2024-09-12T17:58:48.413518+0000","last_undegraded":"2024-09-12T17:58:48.413518+0000","last_fullsized":"2024-09-12T17:58:48.413518+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:52.404478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"261'78","reported_seq":591,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:23.586728+0000","last_change":"2024-09-12T17:23:46.150777+0000","last_active":"2024-09-12T17:59:23.586728+0000","last_peered":"2024-09-12T17:59:23.586728+0000","last_clean":"2024-09-12T17:59:23.586728+0000","last_became_active":"2024-09-12T17:23:46.150447+0000","last_became_peered":"2024-09-12T17:23:46.150447+0000","last_unstale":"2024-09-12T17:59:23.586728+0000","last_undegraded":"2024-09-12T17:59:23.586728+0000","last_fullsized":"2024-09-12T17:59:23.586728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:18.226708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":77,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.405649+0000","last_change":"2024-09-12T17:23:48.166388+0000","last_active":"2024-09-12T17:57:39.405649+0000","last_peered":"2024-09-12T17:57:39.405649+0000","last_clean":"2024-09-12T17:57:39.405649+0000","last_became_active":"2024-09-12T17:23:48.165965+0000","last_became_peered":"2024-09-12T17:23:48.165965+0000","last_unstale":"2024-09-12T17:57:39.405649+0000","last_undegraded":"2024-09-12T17:57:39.405649+0000","last_fullsized":"2024-09-12T17:57:39.405649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:48.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"261'113","reported_seq":609,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.639640+0000","last_change":"2024-09-12T17:23:50.188380+0000","last_active":"2024-09-12T17:59:48.639640+0000","last_peered":"2024-09-12T17:59:48.639640+0000","last_clean":"2024-09-12T17:59:48.639640+0000","last_became_active":"2024-09-12T17:23:50.188143+0000","last_became_peered":"2024-09-12T17:23:50.188143+0000","last_unstale":"2024-09-12T17:59:48.639640+0000","last_undegraded":"2024-09-12T17:59:48.639640+0000","last_fullsized":"2024-09-12T17:59:48.639640+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:55.598494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":180,"num_write":267,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"261'430","reported_seq":2047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.138465+0000","last_change":"2024-09-12T17:23:42.155423+0000","last_active":"2024-09-12T18:00:18.138465+0000","last_peered":"2024-09-12T18:00:18.138465+0000","last_clean":"2024-09-12T18:00:18.138465+0000","last_became_active":"2024-09-12T17:23:42.155137+0000","last_became_peered":"2024-09-12T17:23:42.155137+0000","last_unstale":"2024-09-12T18:00:18.138465+0000","last_undegraded":"2024-09-12T18:00:18.138465+0000","last_fullsized":"2024-09-12T18:00:18.138465+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:12.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2401,"num_read_kb":2311,"num_write":475,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"261'417","reported_seq":1066,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.412806+0000","last_change":"2024-09-12T17:23:40.707827+0000","last_active":"2024-09-12T18:01:40.412806+0000","last_peered":"2024-09-12T18:01:40.412806+0000","last_clean":"2024-09-12T18:01:40.412806+0000","last_became_active":"2024-09-12T17:23:40.707549+0000","last_became_peered":"2024-09-12T17:23:40.707549+0000","last_unstale":"2024-09-12T18:01:40.412806+0000","last_undegraded":"2024-09-12T18:01:40.412806+0000","last_fullsized":"2024-09-12T18:01:40.412806+0000","mapping_epoch":23,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:48.898807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457570,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":750,"num_read_kb":5813,"num_write":1310,"num_write_kb":24859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.401656+0000","last_change":"2024-09-12T17:23:44.151294+0000","last_active":"2024-09-12T17:57:33.401656+0000","last_peered":"2024-09-12T17:57:33.401656+0000","last_clean":"2024-09-12T17:57:33.401656+0000","last_became_active":"2024-09-12T17:23:44.150973+0000","last_became_peered":"2024-09-12T17:23:44.150973+0000","last_unstale":"2024-09-12T17:57:33.401656+0000","last_undegraded":"2024-09-12T17:57:33.401656+0000","last_fullsized":"2024-09-12T17:57:33.401656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:15.283072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"261'95","reported_seq":615,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:49.842571+0000","last_change":"2024-09-12T17:23:46.154192+0000","last_active":"2024-09-12T17:59:49.842571+0000","last_peered":"2024-09-12T17:59:49.842571+0000","last_clean":"2024-09-12T17:59:49.842571+0000","last_became_active":"2024-09-12T17:23:46.153864+0000","last_became_peered":"2024-09-12T17:23:46.153864+0000","last_unstale":"2024-09-12T17:59:49.842571+0000","last_undegraded":"2024-09-12T17:59:49.842571+0000","last_fullsized":"2024-09-12T17:59:49.842571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:52.292455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"261'762","reported_seq":2153,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.414646+0000","last_change":"2024-09-12T17:23:48.173728+0000","last_active":"2024-09-12T18:01:49.414646+0000","last_peered":"2024-09-12T18:01:49.414646+0000","last_clean":"2024-09-12T18:01:49.414646+0000","last_became_active":"2024-09-12T17:23:48.173454+0000","last_became_peered":"2024-09-12T17:23:48.173454+0000","last_unstale":"2024-09-12T18:01:49.414646+0000","last_undegraded":"2024-09-12T18:01:49.414646+0000","last_fullsized":"2024-09-12T18:01:49.414646+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:51.582534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"261'214","reported_seq":1037,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.663235+0000","last_change":"2024-09-12T17:23:50.640673+0000","last_active":"2024-09-12T18:00:18.663235+0000","last_peered":"2024-09-12T18:00:18.663235+0000","last_clean":"2024-09-12T18:00:18.663235+0000","last_became_active":"2024-09-12T17:23:50.640401+0000","last_became_peered":"2024-09-12T17:23:50.640401+0000","last_unstale":"2024-09-12T18:00:18.663235+0000","last_undegraded":"2024-09-12T18:00:18.663235+0000","last_fullsized":"2024-09-12T18:00:18.663235+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:04.518137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":682,"num_read_kb":671,"num_write":489,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"261'898","reported_seq":2439,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.892342+0000","last_change":"2024-09-12T17:23:42.148014+0000","last_active":"2024-09-12T18:00:04.892342+0000","last_peered":"2024-09-12T18:00:04.892342+0000","last_clean":"2024-09-12T18:00:04.892342+0000","last_became_active":"2024-09-12T17:23:42.147597+0000","last_became_peered":"2024-09-12T17:23:42.147597+0000","last_unstale":"2024-09-12T18:00:04.892342+0000","last_undegraded":"2024-09-12T18:00:04.892342+0000","last_fullsized":"2024-09-12T18:00:04.892342+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":800,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:17.140238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4183,"num_read_kb":3727,"num_write":1220,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"261'300","reported_seq":977,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.757256+0000","last_change":"2024-09-12T17:23:40.718814+0000","last_active":"2024-09-12T17:59:59.757256+0000","last_peered":"2024-09-12T17:59:59.757256+0000","last_clean":"2024-09-12T17:59:59.757256+0000","last_became_active":"2024-09-12T17:23:40.718582+0000","last_became_peered":"2024-09-12T17:23:40.718582+0000","last_unstale":"2024-09-12T17:59:59.757256+0000","last_undegraded":"2024-09-12T17:59:59.757256+0000","last_fullsized":"2024-09-12T17:59:59.757256+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:35.754217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15438220,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":525,"num_read_kb":83242,"num_write":1040,"num_write_kb":35659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404212+0000","last_change":"2024-09-12T17:23:44.152542+0000","last_active":"2024-09-12T17:57:34.404212+0000","last_peered":"2024-09-12T17:57:34.404212+0000","last_clean":"2024-09-12T17:57:34.404212+0000","last_became_active":"2024-09-12T17:23:44.151918+0000","last_became_peered":"2024-09-12T17:23:44.151918+0000","last_unstale":"2024-09-12T17:57:34.404212+0000","last_undegraded":"2024-09-12T17:57:34.404212+0000","last_fullsized":"2024-09-12T17:57:34.404212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:18.221084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"261'262","reported_seq":808,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.414542+0000","last_change":"2024-09-12T17:23:46.241449+0000","last_active":"2024-09-12T18:01:42.414542+0000","last_peered":"2024-09-12T18:01:42.414542+0000","last_clean":"2024-09-12T18:01:42.414542+0000","last_became_active":"2024-09-12T17:23:46.241137+0000","last_became_peered":"2024-09-12T17:23:46.241137+0000","last_unstale":"2024-09-12T18:01:42.414542+0000","last_undegraded":"2024-09-12T18:01:42.414542+0000","last_fullsized":"2024-09-12T18:01:42.414542+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:58.197635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60790,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":971,"num_write":374,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"261'803","reported_seq":6198,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.456541+0000","last_change":"2024-09-12T17:23:48.167347+0000","last_active":"2024-09-12T18:01:42.456541+0000","last_peered":"2024-09-12T18:01:42.456541+0000","last_clean":"2024-09-12T18:01:42.456541+0000","last_became_active":"2024-09-12T17:23:48.167038+0000","last_became_peered":"2024-09-12T17:23:48.167038+0000","last_unstale":"2024-09-12T18:01:42.456541+0000","last_undegraded":"2024-09-12T18:01:42.456541+0000","last_fullsized":"2024-09-12T18:01:42.456541+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:22.744543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"261'663","reported_seq":2260,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559804+0000","last_change":"2024-09-12T17:23:42.144234+0000","last_active":"2024-09-12T18:00:18.559804+0000","last_peered":"2024-09-12T18:00:18.559804+0000","last_clean":"2024-09-12T18:00:18.559804+0000","last_became_active":"2024-09-12T17:23:42.143778+0000","last_became_peered":"2024-09-12T17:23:42.143778+0000","last_unstale":"2024-09-12T18:00:18.559804+0000","last_undegraded":"2024-09-12T18:00:18.559804+0000","last_fullsized":"2024-09-12T18:00:18.559804+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":600,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:03.567237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3245,"num_read_kb":3064,"num_write":918,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"261'277","reported_seq":878,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.615692+0000","last_change":"2024-09-12T17:23:40.709847+0000","last_active":"2024-09-12T18:00:16.615692+0000","last_peered":"2024-09-12T18:00:16.615692+0000","last_clean":"2024-09-12T18:00:16.615692+0000","last_became_active":"2024-09-12T17:23:40.709587+0000","last_became_peered":"2024-09-12T17:23:40.709587+0000","last_unstale":"2024-09-12T18:00:16.615692+0000","last_undegraded":"2024-09-12T18:00:16.615692+0000","last_fullsized":"2024-09-12T18:00:16.615692+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:52.138227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13193104,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":339,"num_read_kb":61352,"num_write":949,"num_write_kb":60278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.412039+0000","last_change":"2024-09-12T17:23:44.151275+0000","last_active":"2024-09-12T17:58:24.412039+0000","last_peered":"2024-09-12T17:58:24.412039+0000","last_clean":"2024-09-12T17:58:24.412039+0000","last_became_active":"2024-09-12T17:23:44.150957+0000","last_became_peered":"2024-09-12T17:23:44.150957+0000","last_unstale":"2024-09-12T17:58:24.412039+0000","last_undegraded":"2024-09-12T17:58:24.412039+0000","last_fullsized":"2024-09-12T17:58:24.412039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:06.423907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"261'340","reported_seq":927,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:44.431059+0000","last_change":"2024-09-12T17:23:46.241749+0000","last_active":"2024-09-12T18:00:44.431059+0000","last_peered":"2024-09-12T18:00:44.431059+0000","last_clean":"2024-09-12T18:00:44.431059+0000","last_became_active":"2024-09-12T17:23:46.241442+0000","last_became_peered":"2024-09-12T17:23:46.241442+0000","last_unstale":"2024-09-12T18:00:44.431059+0000","last_undegraded":"2024-09-12T18:00:44.431059+0000","last_fullsized":"2024-09-12T18:00:44.431059+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:17.283661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61524,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":549,"num_read_kb":1059,"num_write":442,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.403282+0000","last_change":"2024-09-12T17:23:48.168185+0000","last_active":"2024-09-12T17:57:34.403282+0000","last_peered":"2024-09-12T17:57:34.403282+0000","last_clean":"2024-09-12T17:57:34.403282+0000","last_became_active":"2024-09-12T17:23:48.167925+0000","last_became_peered":"2024-09-12T17:23:48.167925+0000","last_unstale":"2024-09-12T17:57:34.403282+0000","last_undegraded":"2024-09-12T17:57:34.403282+0000","last_fullsized":"2024-09-12T17:57:34.403282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:09.629250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"261'574","reported_seq":1382,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.439771+0000","last_change":"2024-09-12T17:23:50.188392+0000","last_active":"2024-09-12T18:01:42.439771+0000","last_peered":"2024-09-12T18:01:42.439771+0000","last_clean":"2024-09-12T18:01:42.439771+0000","last_became_active":"2024-09-12T17:23:50.188109+0000","last_became_peered":"2024-09-12T17:23:50.188109+0000","last_unstale":"2024-09-12T18:01:42.439771+0000","last_undegraded":"2024-09-12T18:01:42.439771+0000","last_fullsized":"2024-09-12T18:01:42.439771+0000","mapping_epoch":33,"log_start":"261'500","ondisk_log_start":"261'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:18.895859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1373,"num_read_kb":1362,"num_write":1221,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"261'466","reported_seq":2001,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.785578+0000","last_change":"2024-09-12T17:23:42.136630+0000","last_active":"2024-09-12T18:00:05.785578+0000","last_peered":"2024-09-12T18:00:05.785578+0000","last_clean":"2024-09-12T18:00:05.785578+0000","last_became_active":"2024-09-12T17:23:42.135997+0000","last_became_peered":"2024-09-12T17:23:42.135997+0000","last_unstale":"2024-09-12T18:00:05.785578+0000","last_undegraded":"2024-09-12T18:00:05.785578+0000","last_fullsized":"2024-09-12T18:00:05.785578+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:19.635100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2354,"num_read_kb":2214,"num_write":547,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"261'267","reported_seq":894,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.050389+0000","last_change":"2024-09-12T17:23:40.711857+0000","last_active":"2024-09-12T18:00:04.050389+0000","last_peered":"2024-09-12T18:00:04.050389+0000","last_clean":"2024-09-12T18:00:04.050389+0000","last_became_active":"2024-09-12T17:23:40.711546+0000","last_became_peered":"2024-09-12T17:23:40.711546+0000","last_unstale":"2024-09-12T18:00:04.050389+0000","last_undegraded":"2024-09-12T18:00:04.050389+0000","last_fullsized":"2024-09-12T18:00:04.050389+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:28.645374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2048249,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":392,"num_read_kb":14389,"num_write":933,"num_write_kb":31885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.611541+0000","last_change":"2024-09-12T17:23:44.148761+0000","last_active":"2024-09-12T17:58:23.611541+0000","last_peered":"2024-09-12T17:58:23.611541+0000","last_clean":"2024-09-12T17:58:23.611541+0000","last_became_active":"2024-09-12T17:23:44.148472+0000","last_became_peered":"2024-09-12T17:23:44.148472+0000","last_unstale":"2024-09-12T17:58:23.611541+0000","last_undegraded":"2024-09-12T17:58:23.611541+0000","last_fullsized":"2024-09-12T17:58:23.611541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:28.080187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"261'239","reported_seq":790,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:53.569720+0000","last_change":"2024-09-12T17:23:46.153208+0000","last_active":"2024-09-12T17:59:53.569720+0000","last_peered":"2024-09-12T17:59:53.569720+0000","last_clean":"2024-09-12T17:59:53.569720+0000","last_became_active":"2024-09-12T17:23:46.152441+0000","last_became_peered":"2024-09-12T17:23:46.152441+0000","last_unstale":"2024-09-12T17:59:53.569720+0000","last_undegraded":"2024-09-12T17:59:53.569720+0000","last_fullsized":"2024-09-12T17:59:53.569720+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:17.945639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52528,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":843,"num_write":328,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411068+0000","last_change":"2024-09-12T17:23:48.168110+0000","last_active":"2024-09-12T17:58:33.411068+0000","last_peered":"2024-09-12T17:58:33.411068+0000","last_clean":"2024-09-12T17:58:33.411068+0000","last_became_active":"2024-09-12T17:23:48.167829+0000","last_became_peered":"2024-09-12T17:23:48.167829+0000","last_unstale":"2024-09-12T17:58:33.411068+0000","last_undegraded":"2024-09-12T17:58:33.411068+0000","last_fullsized":"2024-09-12T17:58:33.411068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:24.546875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"261'2375","reported_seq":4213,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.434744+0000","last_change":"2024-09-12T17:23:50.186322+0000","last_active":"2024-09-12T18:01:29.434744+0000","last_peered":"2024-09-12T18:01:29.434744+0000","last_clean":"2024-09-12T18:01:29.434744+0000","last_became_active":"2024-09-12T17:23:50.186026+0000","last_became_peered":"2024-09-12T17:23:50.186026+0000","last_unstale":"2024-09-12T18:01:29.434744+0000","last_undegraded":"2024-09-12T18:01:29.434744+0000","last_fullsized":"2024-09-12T18:01:29.434744+0000","mapping_epoch":33,"log_start":"261'2300","ondisk_log_start":"261'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":2300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:19.020080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6096,"num_read_kb":6075,"num_write":4800,"num_write_kb":1772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"261'457","reported_seq":1986,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559814+0000","last_change":"2024-09-12T17:23:42.147429+0000","last_active":"2024-09-12T18:00:18.559814+0000","last_peered":"2024-09-12T18:00:18.559814+0000","last_clean":"2024-09-12T18:00:18.559814+0000","last_became_active":"2024-09-12T17:23:42.147136+0000","last_became_peered":"2024-09-12T17:23:42.147136+0000","last_unstale":"2024-09-12T18:00:18.559814+0000","last_undegraded":"2024-09-12T18:00:18.559814+0000","last_fullsized":"2024-09-12T18:00:18.559814+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:43.868169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2419,"num_read_kb":2271,"num_write":547,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"261'269","reported_seq":863,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.396032+0000","last_change":"2024-09-12T17:23:40.714029+0000","last_active":"2024-09-12T18:01:36.396032+0000","last_peered":"2024-09-12T18:01:36.396032+0000","last_clean":"2024-09-12T18:01:36.396032+0000","last_became_active":"2024-09-12T17:23:40.713481+0000","last_became_peered":"2024-09-12T17:23:40.713481+0000","last_unstale":"2024-09-12T18:01:36.396032+0000","last_undegraded":"2024-09-12T18:01:36.396032+0000","last_fullsized":"2024-09-12T18:01:36.396032+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:10.827842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11560873,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":370,"num_read_kb":5522,"num_write":996,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.604544+0000","last_change":"2024-09-12T17:23:44.147970+0000","last_active":"2024-09-12T17:57:28.604544+0000","last_peered":"2024-09-12T17:57:28.604544+0000","last_clean":"2024-09-12T17:57:28.604544+0000","last_became_active":"2024-09-12T17:23:44.147677+0000","last_became_peered":"2024-09-12T17:23:44.147677+0000","last_unstale":"2024-09-12T17:57:28.604544+0000","last_undegraded":"2024-09-12T17:57:28.604544+0000","last_fullsized":"2024-09-12T17:57:28.604544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:44.346531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"261'281","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:39.430401+0000","last_change":"2024-09-12T17:23:46.150883+0000","last_active":"2024-09-12T18:00:39.430401+0000","last_peered":"2024-09-12T18:00:39.430401+0000","last_clean":"2024-09-12T18:00:39.430401+0000","last_became_active":"2024-09-12T17:23:46.150555+0000","last_became_peered":"2024-09-12T17:23:46.150555+0000","last_unstale":"2024-09-12T18:00:39.430401+0000","last_undegraded":"2024-09-12T18:00:39.430401+0000","last_fullsized":"2024-09-12T18:00:39.430401+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:53.085351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61510,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":472,"num_read_kb":990,"num_write":388,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"261'800","reported_seq":2468,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.420782+0000","last_change":"2024-09-12T17:23:48.165492+0000","last_active":"2024-09-12T18:01:49.420782+0000","last_peered":"2024-09-12T18:01:49.420782+0000","last_clean":"2024-09-12T18:01:49.420782+0000","last_became_active":"2024-09-12T17:23:48.165179+0000","last_became_peered":"2024-09-12T17:23:48.165179+0000","last_unstale":"2024-09-12T18:01:49.420782+0000","last_undegraded":"2024-09-12T18:01:49.420782+0000","last_fullsized":"2024-09-12T18:01:49.420782+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:26.382390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"261'143","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.345598+0000","last_change":"2024-09-12T17:23:50.188608+0000","last_active":"2024-09-12T18:01:41.345598+0000","last_peered":"2024-09-12T18:01:41.345598+0000","last_clean":"2024-09-12T18:01:41.345598+0000","last_became_active":"2024-09-12T17:23:50.188230+0000","last_became_peered":"2024-09-12T17:23:50.188230+0000","last_unstale":"2024-09-12T18:01:41.345598+0000","last_undegraded":"2024-09-12T18:01:41.345598+0000","last_fullsized":"2024-09-12T18:01:41.345598+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:43.821173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":185,"num_write":335,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"261'473","reported_seq":2022,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.409628+0000","last_change":"2024-09-12T17:23:42.154193+0000","last_active":"2024-09-12T18:01:41.409628+0000","last_peered":"2024-09-12T18:01:41.409628+0000","last_clean":"2024-09-12T18:01:41.409628+0000","last_became_active":"2024-09-12T17:23:42.153910+0000","last_became_peered":"2024-09-12T17:23:42.153910+0000","last_unstale":"2024-09-12T18:01:41.409628+0000","last_undegraded":"2024-09-12T18:01:41.409628+0000","last_fullsized":"2024-09-12T18:01:41.409628+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:19.410163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2575,"num_read_kb":2405,"num_write":575,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"261'326","reported_seq":1041,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:52.399872+0000","last_change":"2024-09-12T17:23:40.714040+0000","last_active":"2024-09-12T17:59:52.399872+0000","last_peered":"2024-09-12T17:59:52.399872+0000","last_clean":"2024-09-12T17:59:52.399872+0000","last_became_active":"2024-09-12T17:23:40.712691+0000","last_became_peered":"2024-09-12T17:23:40.712691+0000","last_unstale":"2024-09-12T17:59:52.399872+0000","last_undegraded":"2024-09-12T17:59:52.399872+0000","last_fullsized":"2024-09-12T17:59:52.399872+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:23.050646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23718850,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":623,"num_read_kb":118590,"num_write":1212,"num_write_kb":72411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.611578+0000","last_change":"2024-09-12T17:23:44.143860+0000","last_active":"2024-09-12T17:58:23.611578+0000","last_peered":"2024-09-12T17:58:23.611578+0000","last_clean":"2024-09-12T17:58:23.611578+0000","last_became_active":"2024-09-12T17:23:44.142306+0000","last_became_peered":"2024-09-12T17:23:44.142306+0000","last_unstale":"2024-09-12T17:58:23.611578+0000","last_undegraded":"2024-09-12T17:58:23.611578+0000","last_fullsized":"2024-09-12T17:58:23.611578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:59.833432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"261'448","reported_seq":1052,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.431359+0000","last_change":"2024-09-12T17:23:46.154013+0000","last_active":"2024-09-12T18:01:49.431359+0000","last_peered":"2024-09-12T18:01:49.431359+0000","last_clean":"2024-09-12T18:01:49.431359+0000","last_became_active":"2024-09-12T17:23:46.153719+0000","last_became_peered":"2024-09-12T17:23:46.153719+0000","last_unstale":"2024-09-12T18:01:49.431359+0000","last_undegraded":"2024-09-12T18:01:49.431359+0000","last_fullsized":"2024-09-12T18:01:49.431359+0000","mapping_epoch":29,"log_start":"261'400","ondisk_log_start":"261'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:26.689565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109660,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":784,"num_read_kb":1735,"num_write":652,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612208+0000","last_change":"2024-09-12T17:23:48.170645+0000","last_active":"2024-09-12T17:58:28.612208+0000","last_peered":"2024-09-12T17:58:28.612208+0000","last_clean":"2024-09-12T17:58:28.612208+0000","last_became_active":"2024-09-12T17:23:48.170317+0000","last_became_peered":"2024-09-12T17:23:48.170317+0000","last_unstale":"2024-09-12T17:58:28.612208+0000","last_undegraded":"2024-09-12T17:58:28.612208+0000","last_fullsized":"2024-09-12T17:58:28.612208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:12.486235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"261'153","reported_seq":658,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:22.115592+0000","last_change":"2024-09-12T17:23:50.184354+0000","last_active":"2024-09-12T17:59:22.115592+0000","last_peered":"2024-09-12T17:59:22.115592+0000","last_clean":"2024-09-12T17:59:22.115592+0000","last_became_active":"2024-09-12T17:23:50.184033+0000","last_became_peered":"2024-09-12T17:23:50.184033+0000","last_unstale":"2024-09-12T17:59:22.115592+0000","last_undegraded":"2024-09-12T17:59:22.115592+0000","last_fullsized":"2024-09-12T17:59:22.115592+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:27.722195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":204,"num_write":351,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"261'833","reported_seq":2440,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.139345+0000","last_change":"2024-09-12T17:23:42.145012+0000","last_active":"2024-09-12T18:00:18.139345+0000","last_peered":"2024-09-12T18:00:18.139345+0000","last_clean":"2024-09-12T18:00:18.139345+0000","last_became_active":"2024-09-12T17:23:42.144703+0000","last_became_peered":"2024-09-12T17:23:42.144703+0000","last_unstale":"2024-09-12T18:00:18.139345+0000","last_undegraded":"2024-09-12T18:00:18.139345+0000","last_fullsized":"2024-09-12T18:00:18.139345+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:39.045177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3952,"num_read_kb":3587,"num_write":1103,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"261'330","reported_seq":987,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.456943+0000","last_change":"2024-09-12T17:23:40.706524+0000","last_active":"2024-09-12T17:59:59.456943+0000","last_peered":"2024-09-12T17:59:59.456943+0000","last_clean":"2024-09-12T17:59:59.456943+0000","last_became_active":"2024-09-12T17:23:40.706213+0000","last_became_peered":"2024-09-12T17:23:40.706213+0000","last_unstale":"2024-09-12T17:59:59.456943+0000","last_undegraded":"2024-09-12T17:59:59.456943+0000","last_fullsized":"2024-09-12T17:59:59.456943+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:54.778098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2417800,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":557,"num_read_kb":8190,"num_write":1349,"num_write_kb":25988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.604568+0000","last_change":"2024-09-12T17:23:44.149835+0000","last_active":"2024-09-12T17:57:28.604568+0000","last_peered":"2024-09-12T17:57:28.604568+0000","last_clean":"2024-09-12T17:57:28.604568+0000","last_became_active":"2024-09-12T17:23:44.149550+0000","last_became_peered":"2024-09-12T17:23:44.149550+0000","last_unstale":"2024-09-12T17:57:28.604568+0000","last_undegraded":"2024-09-12T17:57:28.604568+0000","last_fullsized":"2024-09-12T17:57:28.604568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:43.008237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"261'273","reported_seq":831,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.406132+0000","last_change":"2024-09-12T17:23:46.153560+0000","last_active":"2024-09-12T18:01:42.406132+0000","last_peered":"2024-09-12T18:01:42.406132+0000","last_clean":"2024-09-12T18:01:42.406132+0000","last_became_active":"2024-09-12T17:23:46.153210+0000","last_became_peered":"2024-09-12T17:23:46.153210+0000","last_unstale":"2024-09-12T18:01:42.406132+0000","last_undegraded":"2024-09-12T18:01:42.406132+0000","last_fullsized":"2024-09-12T18:01:42.406132+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:53.528030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55204,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":931,"num_write":420,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.531914+0000","last_change":"2024-09-12T17:23:48.168999+0000","last_active":"2024-09-12T17:57:39.531914+0000","last_peered":"2024-09-12T17:57:39.531914+0000","last_clean":"2024-09-12T17:57:39.531914+0000","last_became_active":"2024-09-12T17:23:48.168675+0000","last_became_peered":"2024-09-12T17:23:48.168675+0000","last_unstale":"2024-09-12T17:57:39.531914+0000","last_undegraded":"2024-09-12T17:57:39.531914+0000","last_fullsized":"2024-09-12T17:57:39.531914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:15.332536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"261'97","reported_seq":577,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.616169+0000","last_change":"2024-09-12T17:23:50.186614+0000","last_active":"2024-09-12T18:00:18.616169+0000","last_peered":"2024-09-12T18:00:18.616169+0000","last_clean":"2024-09-12T18:00:18.616169+0000","last_became_active":"2024-09-12T17:23:50.186287+0000","last_became_peered":"2024-09-12T17:23:50.186287+0000","last_unstale":"2024-09-12T18:00:18.616169+0000","last_undegraded":"2024-09-12T18:00:18.616169+0000","last_fullsized":"2024-09-12T18:00:18.616169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:36.361422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":108,"num_read_kb":104,"num_write":228,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"261'640","reported_seq":2241,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.779429+0000","last_change":"2024-09-12T17:23:42.134561+0000","last_active":"2024-09-12T18:00:05.779429+0000","last_peered":"2024-09-12T18:00:05.779429+0000","last_clean":"2024-09-12T18:00:05.779429+0000","last_became_active":"2024-09-12T17:23:42.132858+0000","last_became_peered":"2024-09-12T17:23:42.132858+0000","last_unstale":"2024-09-12T18:00:05.779429+0000","last_undegraded":"2024-09-12T18:00:05.779429+0000","last_fullsized":"2024-09-12T18:00:05.779429+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:47.060225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3409,"num_read_kb":3082,"num_write":929,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"261'340","reported_seq":1013,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.477485+0000","last_change":"2024-09-12T17:23:40.706825+0000","last_active":"2024-09-12T17:59:48.477485+0000","last_peered":"2024-09-12T17:59:48.477485+0000","last_clean":"2024-09-12T17:59:48.477485+0000","last_became_active":"2024-09-12T17:23:40.706531+0000","last_became_peered":"2024-09-12T17:23:40.706531+0000","last_unstale":"2024-09-12T17:59:48.477485+0000","last_undegraded":"2024-09-12T17:59:48.477485+0000","last_fullsized":"2024-09-12T17:59:48.477485+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:47.318982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656147,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":607,"num_read_kb":36587,"num_write":1156,"num_write_kb":30858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"35'5","reported_seq":975,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.979476+0000","last_change":"2024-09-12T17:23:44.147758+0000","last_active":"2024-09-12T18:01:48.979476+0000","last_peered":"2024-09-12T18:01:48.979476+0000","last_clean":"2024-09-12T18:01:48.979476+0000","last_became_active":"2024-09-12T17:23:44.147427+0000","last_became_peered":"2024-09-12T17:23:44.147427+0000","last_unstale":"2024-09-12T18:01:48.979476+0000","last_undegraded":"2024-09-12T18:01:48.979476+0000","last_fullsized":"2024-09-12T18:01:48.979476+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:01.104960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":1201,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"261'294","reported_seq":858,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.883308+0000","last_change":"2024-09-12T17:23:46.153321+0000","last_active":"2024-09-12T17:59:54.883308+0000","last_peered":"2024-09-12T17:59:54.883308+0000","last_clean":"2024-09-12T17:59:54.883308+0000","last_became_active":"2024-09-12T17:23:46.153004+0000","last_became_peered":"2024-09-12T17:23:46.153004+0000","last_unstale":"2024-09-12T17:59:54.883308+0000","last_undegraded":"2024-09-12T17:59:54.883308+0000","last_fullsized":"2024-09-12T17:59:54.883308+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:18.903057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58984,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":484,"num_read_kb":992,"num_write":402,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"261'738","reported_seq":2126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.453623+0000","last_change":"2024-09-12T17:23:48.169354+0000","last_active":"2024-09-12T18:01:42.453623+0000","last_peered":"2024-09-12T18:01:42.453623+0000","last_clean":"2024-09-12T18:01:42.453623+0000","last_became_active":"2024-09-12T17:23:48.169062+0000","last_became_peered":"2024-09-12T17:23:48.169062+0000","last_unstale":"2024-09-12T18:01:42.453623+0000","last_undegraded":"2024-09-12T18:01:42.453623+0000","last_fullsized":"2024-09-12T18:01:42.453623+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:31.045415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"261'140","reported_seq":626,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.160885+0000","last_change":"2024-09-12T17:23:50.184877+0000","last_active":"2024-09-12T18:00:18.160885+0000","last_peered":"2024-09-12T18:00:18.160885+0000","last_clean":"2024-09-12T18:00:18.160885+0000","last_became_active":"2024-09-12T17:23:50.184460+0000","last_became_peered":"2024-09-12T17:23:50.184460+0000","last_unstale":"2024-09-12T18:00:18.160885+0000","last_undegraded":"2024-09-12T18:00:18.160885+0000","last_fullsized":"2024-09-12T18:00:18.160885+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:05.644031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":156,"num_write":329,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"261'797","reported_seq":2252,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.099398+0000","last_change":"2024-09-12T17:23:42.146658+0000","last_active":"2024-09-12T18:00:02.099398+0000","last_peered":"2024-09-12T18:00:02.099398+0000","last_clean":"2024-09-12T18:00:02.099398+0000","last_became_active":"2024-09-12T17:23:42.142896+0000","last_became_peered":"2024-09-12T17:23:42.142896+0000","last_unstale":"2024-09-12T18:00:02.099398+0000","last_undegraded":"2024-09-12T18:00:02.099398+0000","last_fullsized":"2024-09-12T18:00:02.099398+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:06.765117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3737,"num_read_kb":3347,"num_write":1075,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"261'277","reported_seq":940,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:34.428646+0000","last_change":"2024-09-12T17:23:40.708635+0000","last_active":"2024-09-12T18:00:34.428646+0000","last_peered":"2024-09-12T18:00:34.428646+0000","last_clean":"2024-09-12T18:00:34.428646+0000","last_became_active":"2024-09-12T17:23:40.708386+0000","last_became_peered":"2024-09-12T17:23:40.708386+0000","last_unstale":"2024-09-12T18:00:34.428646+0000","last_undegraded":"2024-09-12T18:00:34.428646+0000","last_fullsized":"2024-09-12T18:00:34.428646+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:15.730934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8197355,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":446,"num_read_kb":106949,"num_write":1070,"num_write_kb":37410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1449,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.991695+0000","last_change":"2024-09-12T17:23:44.150061+0000","last_active":"2024-09-12T18:01:48.991695+0000","last_peered":"2024-09-12T18:01:48.991695+0000","last_clean":"2024-09-12T18:01:48.991695+0000","last_became_active":"2024-09-12T17:23:44.149279+0000","last_became_peered":"2024-09-12T17:23:44.149279+0000","last_unstale":"2024-09-12T18:01:48.991695+0000","last_undegraded":"2024-09-12T18:01:48.991695+0000","last_fullsized":"2024-09-12T18:01:48.991695+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:24.241906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"261'63","reported_seq":566,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:21.056971+0000","last_change":"2024-09-12T17:23:46.241422+0000","last_active":"2024-09-12T17:59:21.056971+0000","last_peered":"2024-09-12T17:59:21.056971+0000","last_clean":"2024-09-12T17:59:21.056971+0000","last_became_active":"2024-09-12T17:23:46.240979+0000","last_became_peered":"2024-09-12T17:23:46.240979+0000","last_unstale":"2024-09-12T17:59:21.056971+0000","last_undegraded":"2024-09-12T17:59:21.056971+0000","last_fullsized":"2024-09-12T17:59:21.056971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:39.659261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"261'785","reported_seq":2379,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.417043+0000","last_change":"2024-09-12T17:23:48.172774+0000","last_active":"2024-09-12T18:01:49.417043+0000","last_peered":"2024-09-12T18:01:49.417043+0000","last_clean":"2024-09-12T18:01:49.417043+0000","last_became_active":"2024-09-12T17:23:48.172485+0000","last_became_peered":"2024-09-12T17:23:48.172485+0000","last_unstale":"2024-09-12T18:01:49.417043+0000","last_undegraded":"2024-09-12T18:01:49.417043+0000","last_fullsized":"2024-09-12T18:01:49.417043+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:42.427288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"261'140","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:56.764717+0000","last_change":"2024-09-12T17:23:50.179455+0000","last_active":"2024-09-12T17:59:56.764717+0000","last_peered":"2024-09-12T17:59:56.764717+0000","last_clean":"2024-09-12T17:59:56.764717+0000","last_became_active":"2024-09-12T17:23:50.179153+0000","last_became_peered":"2024-09-12T17:23:50.179153+0000","last_unstale":"2024-09-12T17:59:56.764717+0000","last_undegraded":"2024-09-12T17:59:56.764717+0000","last_fullsized":"2024-09-12T17:59:56.764717+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:04.149720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":149,"num_read_kb":148,"num_write":323,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"261'408","reported_seq":1899,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.498175+0000","last_change":"2024-09-12T17:23:42.152712+0000","last_active":"2024-09-12T18:00:05.498175+0000","last_peered":"2024-09-12T18:00:05.498175+0000","last_clean":"2024-09-12T18:00:05.498175+0000","last_became_active":"2024-09-12T17:23:42.152339+0000","last_became_peered":"2024-09-12T17:23:42.152339+0000","last_unstale":"2024-09-12T18:00:05.498175+0000","last_undegraded":"2024-09-12T18:00:05.498175+0000","last_fullsized":"2024-09-12T18:00:05.498175+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:42.189771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2264,"num_read_kb":2142,"num_write":477,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"261'380","reported_seq":1152,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.831731+0000","last_change":"2024-09-12T17:23:40.714992+0000","last_active":"2024-09-12T18:00:05.831731+0000","last_peered":"2024-09-12T18:00:05.831731+0000","last_clean":"2024-09-12T18:00:05.831731+0000","last_became_active":"2024-09-12T17:23:40.714708+0000","last_became_peered":"2024-09-12T17:23:40.714708+0000","last_unstale":"2024-09-12T18:00:05.831731+0000","last_undegraded":"2024-09-12T18:00:05.831731+0000","last_fullsized":"2024-09-12T18:00:05.831731+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:24.961347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10487247,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":951,"num_read_kb":34670,"num_write":1441,"num_write_kb":45714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.404145+0000","last_change":"2024-09-12T17:23:44.151662+0000","last_active":"2024-09-12T17:57:29.404145+0000","last_peered":"2024-09-12T17:57:29.404145+0000","last_clean":"2024-09-12T17:57:29.404145+0000","last_became_active":"2024-09-12T17:23:44.151392+0000","last_became_peered":"2024-09-12T17:23:44.151392+0000","last_unstale":"2024-09-12T17:57:29.404145+0000","last_undegraded":"2024-09-12T17:57:29.404145+0000","last_fullsized":"2024-09-12T17:57:29.404145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:59.377518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"261'300","reported_seq":882,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:56.779153+0000","last_change":"2024-09-12T17:23:46.145102+0000","last_active":"2024-09-12T17:59:56.779153+0000","last_peered":"2024-09-12T17:59:56.779153+0000","last_clean":"2024-09-12T17:59:56.779153+0000","last_became_active":"2024-09-12T17:23:46.144754+0000","last_became_peered":"2024-09-12T17:23:46.144754+0000","last_unstale":"2024-09-12T17:59:56.779153+0000","last_undegraded":"2024-09-12T17:59:56.779153+0000","last_fullsized":"2024-09-12T17:59:56.779153+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:02.014145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52075,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":487,"num_read_kb":929,"num_write":384,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.402044+0000","last_change":"2024-09-12T17:23:48.170789+0000","last_active":"2024-09-12T17:57:34.402044+0000","last_peered":"2024-09-12T17:57:34.402044+0000","last_clean":"2024-09-12T17:57:34.402044+0000","last_became_active":"2024-09-12T17:23:48.170482+0000","last_became_peered":"2024-09-12T17:23:48.170482+0000","last_unstale":"2024-09-12T17:57:34.402044+0000","last_undegraded":"2024-09-12T17:57:34.402044+0000","last_fullsized":"2024-09-12T17:57:34.402044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:42.252206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"261'140","reported_seq":633,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.433834+0000","last_change":"2024-09-12T17:23:50.187298+0000","last_active":"2024-09-12T18:01:19.433834+0000","last_peered":"2024-09-12T18:01:19.433834+0000","last_clean":"2024-09-12T18:01:19.433834+0000","last_became_active":"2024-09-12T17:23:50.187040+0000","last_became_peered":"2024-09-12T17:23:50.187040+0000","last_unstale":"2024-09-12T18:01:19.433834+0000","last_undegraded":"2024-09-12T18:01:19.433834+0000","last_fullsized":"2024-09-12T18:01:19.433834+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:15.392439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":190,"num_write":335,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"261'1232","reported_seq":2780,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.572788+0000","last_change":"2024-09-12T17:23:42.146501+0000","last_active":"2024-09-12T18:00:04.572788+0000","last_peered":"2024-09-12T18:00:04.572788+0000","last_clean":"2024-09-12T18:00:04.572788+0000","last_became_active":"2024-09-12T17:23:42.146200+0000","last_became_peered":"2024-09-12T17:23:42.146200+0000","last_unstale":"2024-09-12T18:00:04.572788+0000","last_undegraded":"2024-09-12T18:00:04.572788+0000","last_fullsized":"2024-09-12T18:00:04.572788+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":1200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:34.628327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5862,"num_read_kb":5167,"num_write":1742,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":598,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.422110+0000","last_change":"2024-09-12T17:23:26.035893+0000","last_active":"2024-09-12T17:59:39.422110+0000","last_peered":"2024-09-12T17:59:39.422110+0000","last_clean":"2024-09-12T17:59:39.422110+0000","last_became_active":"2024-09-12T17:23:26.034872+0000","last_became_peered":"2024-09-12T17:23:26.034872+0000","last_unstale":"2024-09-12T17:59:39.422110+0000","last_undegraded":"2024-09-12T17:59:39.422110+0000","last_fullsized":"2024-09-12T17:59:39.422110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:24.539348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:24.539348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:24.539348+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:20.611359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":510,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.416227+0000","last_change":"2024-09-12T17:23:33.596450+0000","last_active":"2024-09-12T17:58:59.416227+0000","last_peered":"2024-09-12T17:58:59.416227+0000","last_clean":"2024-09-12T17:58:59.416227+0000","last_became_active":"2024-09-12T17:23:31.584884+0000","last_became_peered":"2024-09-12T17:23:31.584884+0000","last_unstale":"2024-09-12T17:58:59.416227+0000","last_undegraded":"2024-09-12T17:58:59.416227+0000","last_fullsized":"2024-09-12T17:58:59.416227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:30.448834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423087,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"261'250","reported_seq":879,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.339404+0000","last_change":"2024-09-12T17:23:40.719236+0000","last_active":"2024-09-12T18:00:05.339404+0000","last_peered":"2024-09-12T18:00:05.339404+0000","last_clean":"2024-09-12T18:00:05.339404+0000","last_became_active":"2024-09-12T17:23:40.718896+0000","last_became_peered":"2024-09-12T17:23:40.718896+0000","last_unstale":"2024-09-12T18:00:05.339404+0000","last_undegraded":"2024-09-12T18:00:05.339404+0000","last_fullsized":"2024-09-12T18:00:05.339404+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:57.032804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9611018,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":420,"num_read_kb":13107,"num_write":959,"num_write_kb":39939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"35'3","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.980832+0000","last_change":"2024-09-12T17:23:44.152872+0000","last_active":"2024-09-12T18:01:48.980832+0000","last_peered":"2024-09-12T18:01:48.980832+0000","last_clean":"2024-09-12T18:01:48.980832+0000","last_became_active":"2024-09-12T17:23:44.152585+0000","last_became_peered":"2024-09-12T17:23:44.152585+0000","last_unstale":"2024-09-12T18:01:48.980832+0000","last_undegraded":"2024-09-12T18:01:48.980832+0000","last_fullsized":"2024-09-12T18:01:48.980832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:27.878346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"261'702","reported_seq":1377,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.424642+0000","last_change":"2024-09-12T17:23:46.152000+0000","last_active":"2024-09-12T18:01:42.424642+0000","last_peered":"2024-09-12T18:01:42.424642+0000","last_clean":"2024-09-12T18:01:42.424642+0000","last_became_active":"2024-09-12T17:23:46.151673+0000","last_became_peered":"2024-09-12T17:23:46.151673+0000","last_unstale":"2024-09-12T18:01:42.424642+0000","last_undegraded":"2024-09-12T18:01:42.424642+0000","last_fullsized":"2024-09-12T18:01:42.424642+0000","mapping_epoch":29,"log_start":"261'600","ondisk_log_start":"261'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:23.689449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174355,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1389,"num_read_kb":2882,"num_write":1336,"num_write_kb":1200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.539616+0000","last_change":"2024-09-12T17:23:48.170416+0000","last_active":"2024-09-12T17:58:29.539616+0000","last_peered":"2024-09-12T17:58:29.539616+0000","last_clean":"2024-09-12T17:58:29.539616+0000","last_became_active":"2024-09-12T17:23:48.170153+0000","last_became_peered":"2024-09-12T17:23:48.170153+0000","last_unstale":"2024-09-12T17:58:29.539616+0000","last_undegraded":"2024-09-12T17:58:29.539616+0000","last_fullsized":"2024-09-12T17:58:29.539616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:47.543479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"261'224","reported_seq":941,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.565834+0000","last_change":"2024-09-12T17:23:50.188844+0000","last_active":"2024-09-12T18:00:18.565834+0000","last_peered":"2024-09-12T18:00:18.565834+0000","last_clean":"2024-09-12T18:00:18.565834+0000","last_became_active":"2024-09-12T17:23:50.188552+0000","last_became_peered":"2024-09-12T17:23:50.188552+0000","last_unstale":"2024-09-12T18:00:18.565834+0000","last_undegraded":"2024-09-12T18:00:18.565834+0000","last_fullsized":"2024-09-12T18:00:18.565834+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:48.789056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":580,"num_write":503,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"261'388","reported_seq":1826,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.139142+0000","last_change":"2024-09-12T17:23:42.147326+0000","last_active":"2024-09-12T18:00:03.139142+0000","last_peered":"2024-09-12T18:00:03.139142+0000","last_clean":"2024-09-12T18:00:03.139142+0000","last_became_active":"2024-09-12T17:23:42.147045+0000","last_became_peered":"2024-09-12T17:23:42.147045+0000","last_unstale":"2024-09-12T18:00:03.139142+0000","last_undegraded":"2024-09-12T18:00:03.139142+0000","last_fullsized":"2024-09-12T18:00:03.139142+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:25.431740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2080,"num_read_kb":1972,"num_write":429,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":507,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.422739+0000","last_change":"2024-09-12T17:23:33.971250+0000","last_active":"2024-09-12T17:59:44.422739+0000","last_peered":"2024-09-12T17:59:44.422739+0000","last_clean":"2024-09-12T17:59:44.422739+0000","last_became_active":"2024-09-12T17:23:31.588699+0000","last_became_peered":"2024-09-12T17:23:31.588699+0000","last_unstale":"2024-09-12T17:59:44.422739+0000","last_undegraded":"2024-09-12T17:59:44.422739+0000","last_fullsized":"2024-09-12T17:59:44.422739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:46.725886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052181899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"261'288","reported_seq":954,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.528338+0000","last_change":"2024-09-12T17:23:40.713799+0000","last_active":"2024-09-12T18:01:49.528338+0000","last_peered":"2024-09-12T18:01:49.528338+0000","last_clean":"2024-09-12T18:01:49.528338+0000","last_became_active":"2024-09-12T17:23:40.713199+0000","last_became_peered":"2024-09-12T17:23:40.713199+0000","last_unstale":"2024-09-12T18:01:49.528338+0000","last_undegraded":"2024-09-12T18:01:49.528338+0000","last_fullsized":"2024-09-12T18:01:49.528338+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:26.433676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7744105,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":523,"num_read_kb":39284,"num_write":1075,"num_write_kb":55994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.411614+0000","last_change":"2024-09-12T17:23:44.150487+0000","last_active":"2024-09-12T17:58:24.411614+0000","last_peered":"2024-09-12T17:58:24.411614+0000","last_clean":"2024-09-12T17:58:24.411614+0000","last_became_active":"2024-09-12T17:23:44.149400+0000","last_became_peered":"2024-09-12T17:23:44.149400+0000","last_unstale":"2024-09-12T17:58:24.411614+0000","last_undegraded":"2024-09-12T17:58:24.411614+0000","last_fullsized":"2024-09-12T17:58:24.411614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:43.627464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"261'1296","reported_seq":2668,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.423559+0000","last_change":"2024-09-12T17:23:46.145651+0000","last_active":"2024-09-12T18:01:49.423559+0000","last_peered":"2024-09-12T18:01:49.423559+0000","last_clean":"2024-09-12T18:01:49.423559+0000","last_became_active":"2024-09-12T17:23:46.145354+0000","last_became_peered":"2024-09-12T17:23:46.145354+0000","last_unstale":"2024-09-12T18:01:49.423559+0000","last_undegraded":"2024-09-12T18:01:49.423559+0000","last_fullsized":"2024-09-12T18:01:49.423559+0000","mapping_epoch":29,"log_start":"261'1200","ondisk_log_start":"261'1200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:28.485902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178990,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2040,"num_read_kb":3600,"num_write":1154,"num_write_kb":1001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:24.420299+0000","last_change":"2024-09-12T17:23:48.171635+0000","last_active":"2024-09-12T17:59:24.420299+0000","last_peered":"2024-09-12T17:59:24.420299+0000","last_clean":"2024-09-12T17:59:24.420299+0000","last_became_active":"2024-09-12T17:23:48.171355+0000","last_became_peered":"2024-09-12T17:23:48.171355+0000","last_unstale":"2024-09-12T17:59:24.420299+0000","last_undegraded":"2024-09-12T17:59:24.420299+0000","last_fullsized":"2024-09-12T17:59:24.420299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:15.550883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"261'108","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.915226+0000","last_change":"2024-09-12T17:23:50.639398+0000","last_active":"2024-09-12T17:59:59.915226+0000","last_peered":"2024-09-12T17:59:59.915226+0000","last_clean":"2024-09-12T17:59:59.915226+0000","last_became_active":"2024-09-12T17:23:50.639053+0000","last_became_peered":"2024-09-12T17:23:50.639053+0000","last_unstale":"2024-09-12T17:59:59.915226+0000","last_undegraded":"2024-09-12T17:59:59.915226+0000","last_fullsized":"2024-09-12T17:59:59.915226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:38.696802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":162,"num_write":260,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"261'909","reported_seq":2637,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559947+0000","last_change":"2024-09-12T17:23:42.146153+0000","last_active":"2024-09-12T18:00:18.559947+0000","last_peered":"2024-09-12T18:00:18.559947+0000","last_clean":"2024-09-12T18:00:18.559947+0000","last_became_active":"2024-09-12T17:23:42.145049+0000","last_became_peered":"2024-09-12T17:23:42.145049+0000","last_unstale":"2024-09-12T18:00:18.559947+0000","last_undegraded":"2024-09-12T18:00:18.559947+0000","last_fullsized":"2024-09-12T18:00:18.559947+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":800,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:41.855754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4463,"num_read_kb":4014,"num_write":1227,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":511,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:58.616407+0000","last_change":"2024-09-12T17:23:33.835818+0000","last_active":"2024-09-12T17:58:58.616407+0000","last_peered":"2024-09-12T17:58:58.616407+0000","last_clean":"2024-09-12T17:58:58.616407+0000","last_became_active":"2024-09-12T17:23:31.584259+0000","last_became_peered":"2024-09-12T17:23:31.584259+0000","last_unstale":"2024-09-12T17:58:58.616407+0000","last_undegraded":"2024-09-12T17:58:58.616407+0000","last_fullsized":"2024-09-12T17:58:58.616407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:33.916339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045870900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"261'264","reported_seq":886,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.787971+0000","last_change":"2024-09-12T17:23:40.712522+0000","last_active":"2024-09-12T17:59:54.787971+0000","last_peered":"2024-09-12T17:59:54.787971+0000","last_clean":"2024-09-12T17:59:54.787971+0000","last_became_active":"2024-09-12T17:23:40.712276+0000","last_became_peered":"2024-09-12T17:23:40.712276+0000","last_unstale":"2024-09-12T17:59:54.787971+0000","last_undegraded":"2024-09-12T17:59:54.787971+0000","last_fullsized":"2024-09-12T17:59:54.787971+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:20.254346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154629,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":392,"num_read_kb":8922,"num_write":1018,"num_write_kb":17941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.611618+0000","last_change":"2024-09-12T17:23:44.151286+0000","last_active":"2024-09-12T17:58:23.611618+0000","last_peered":"2024-09-12T17:58:23.611618+0000","last_clean":"2024-09-12T17:58:23.611618+0000","last_became_active":"2024-09-12T17:23:44.151006+0000","last_became_peered":"2024-09-12T17:23:44.151006+0000","last_unstale":"2024-09-12T17:58:23.611618+0000","last_undegraded":"2024-09-12T17:58:23.611618+0000","last_fullsized":"2024-09-12T17:58:23.611618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:17.405776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"261'194","reported_seq":1181,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.322144+0000","last_change":"2024-09-12T17:23:46.242242+0000","last_active":"2024-09-12T18:01:38.322144+0000","last_peered":"2024-09-12T18:01:38.322144+0000","last_clean":"2024-09-12T18:01:38.322144+0000","last_became_active":"2024-09-12T17:23:46.241733+0000","last_became_peered":"2024-09-12T17:23:46.241733+0000","last_unstale":"2024-09-12T18:01:38.322144+0000","last_undegraded":"2024-09-12T18:01:38.322144+0000","last_fullsized":"2024-09-12T18:01:38.322144+0000","mapping_epoch":29,"log_start":"258'100","ondisk_log_start":"258'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:35.528461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":152,"num_read_kb":143,"num_write":117,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.545833+0000","last_change":"2024-09-12T17:23:48.168199+0000","last_active":"2024-09-12T17:59:14.545833+0000","last_peered":"2024-09-12T17:59:14.545833+0000","last_clean":"2024-09-12T17:59:14.545833+0000","last_became_active":"2024-09-12T17:23:48.167920+0000","last_became_peered":"2024-09-12T17:23:48.167920+0000","last_unstale":"2024-09-12T17:59:14.545833+0000","last_undegraded":"2024-09-12T17:59:14.545833+0000","last_fullsized":"2024-09-12T17:59:14.545833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:52.699030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"261'262","reported_seq":858,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.252281+0000","last_change":"2024-09-12T17:23:50.177810+0000","last_active":"2024-09-12T18:00:18.252281+0000","last_peered":"2024-09-12T18:00:18.252281+0000","last_clean":"2024-09-12T18:00:18.252281+0000","last_became_active":"2024-09-12T17:23:50.177293+0000","last_became_peered":"2024-09-12T17:23:50.177293+0000","last_unstale":"2024-09-12T18:00:18.252281+0000","last_undegraded":"2024-09-12T18:00:18.252281+0000","last_fullsized":"2024-09-12T18:00:18.252281+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:35.764330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":569,"num_write":571,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"261'440","reported_seq":2030,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.397530+0000","last_change":"2024-09-12T17:23:42.136391+0000","last_active":"2024-09-12T18:01:41.397530+0000","last_peered":"2024-09-12T18:01:41.397530+0000","last_clean":"2024-09-12T18:01:41.397530+0000","last_became_active":"2024-09-12T17:23:42.136083+0000","last_became_peered":"2024-09-12T17:23:42.136083+0000","last_unstale":"2024-09-12T18:01:41.397530+0000","last_undegraded":"2024-09-12T18:01:41.397530+0000","last_fullsized":"2024-09-12T18:01:41.397530+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:29.889920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2433,"num_read_kb":2304,"num_write":511,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":511,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.416186+0000","last_change":"2024-09-12T17:23:33.596992+0000","last_active":"2024-09-12T17:58:59.416186+0000","last_peered":"2024-09-12T17:58:59.416186+0000","last_clean":"2024-09-12T17:58:59.416186+0000","last_became_active":"2024-09-12T17:23:31.588612+0000","last_became_peered":"2024-09-12T17:23:31.588612+0000","last_unstale":"2024-09-12T17:58:59.416186+0000","last_undegraded":"2024-09-12T17:58:59.416186+0000","last_fullsized":"2024-09-12T17:58:59.416186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:20.500808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095838300000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"261'277","reported_seq":993,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.360106+0000","last_change":"2024-09-12T17:23:40.717039+0000","last_active":"2024-09-12T18:00:04.360106+0000","last_peered":"2024-09-12T18:00:04.360106+0000","last_clean":"2024-09-12T18:00:04.360106+0000","last_became_active":"2024-09-12T17:23:40.716786+0000","last_became_peered":"2024-09-12T17:23:40.716786+0000","last_unstale":"2024-09-12T18:00:04.360106+0000","last_undegraded":"2024-09-12T18:00:04.360106+0000","last_fullsized":"2024-09-12T18:00:04.360106+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:37.161545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17125891,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":483,"num_read_kb":40133,"num_write":1009,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.545850+0000","last_change":"2024-09-12T17:23:44.151221+0000","last_active":"2024-09-12T17:59:14.545850+0000","last_peered":"2024-09-12T17:59:14.545850+0000","last_clean":"2024-09-12T17:59:14.545850+0000","last_became_active":"2024-09-12T17:23:44.150912+0000","last_became_peered":"2024-09-12T17:23:44.150912+0000","last_unstale":"2024-09-12T17:59:14.545850+0000","last_undegraded":"2024-09-12T17:59:14.545850+0000","last_fullsized":"2024-09-12T17:59:14.545850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:09.750577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"261'109","reported_seq":634,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:38.427984+0000","last_change":"2024-09-12T17:23:46.155872+0000","last_active":"2024-09-12T18:00:38.427984+0000","last_peered":"2024-09-12T18:00:38.427984+0000","last_clean":"2024-09-12T18:00:38.427984+0000","last_became_active":"2024-09-12T17:23:46.155516+0000","last_became_peered":"2024-09-12T17:23:46.155516+0000","last_unstale":"2024-09-12T18:00:38.427984+0000","last_undegraded":"2024-09-12T18:00:38.427984+0000","last_fullsized":"2024-09-12T18:00:38.427984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:35.167613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":92,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.409748+0000","last_change":"2024-09-12T17:23:48.171371+0000","last_active":"2024-09-12T17:58:29.409748+0000","last_peered":"2024-09-12T17:58:29.409748+0000","last_clean":"2024-09-12T17:58:29.409748+0000","last_became_active":"2024-09-12T17:23:48.170462+0000","last_became_peered":"2024-09-12T17:23:48.170462+0000","last_unstale":"2024-09-12T17:58:29.409748+0000","last_undegraded":"2024-09-12T17:58:29.409748+0000","last_fullsized":"2024-09-12T17:58:29.409748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:11.276085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":655,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.159077+0000","last_change":"2024-09-12T17:23:50.186802+0000","last_active":"2024-09-12T18:00:18.159077+0000","last_peered":"2024-09-12T18:00:18.159077+0000","last_clean":"2024-09-12T18:00:18.159077+0000","last_became_active":"2024-09-12T17:23:50.186526+0000","last_became_peered":"2024-09-12T17:23:50.186526+0000","last_unstale":"2024-09-12T18:00:18.159077+0000","last_undegraded":"2024-09-12T18:00:18.159077+0000","last_fullsized":"2024-09-12T18:00:18.159077+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:15.982689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":247,"num_write":303,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"261'540","reported_seq":2255,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.146276+0000","last_change":"2024-09-12T17:23:42.151997+0000","last_active":"2024-09-12T18:00:18.146276+0000","last_peered":"2024-09-12T18:00:18.146276+0000","last_clean":"2024-09-12T18:00:18.146276+0000","last_became_active":"2024-09-12T17:23:42.151735+0000","last_became_peered":"2024-09-12T17:23:42.151735+0000","last_unstale":"2024-09-12T18:00:18.146276+0000","last_undegraded":"2024-09-12T18:00:18.146276+0000","last_fullsized":"2024-09-12T18:00:18.146276+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:29.033253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2982,"num_read_kb":2809,"num_write":660,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"261'257","reported_seq":846,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:00.087538+0000","last_change":"2024-09-12T17:23:40.712919+0000","last_active":"2024-09-12T18:00:00.087538+0000","last_peered":"2024-09-12T18:00:00.087538+0000","last_clean":"2024-09-12T18:00:00.087538+0000","last_became_active":"2024-09-12T17:23:40.712386+0000","last_became_peered":"2024-09-12T17:23:40.712386+0000","last_unstale":"2024-09-12T18:00:00.087538+0000","last_undegraded":"2024-09-12T18:00:00.087538+0000","last_fullsized":"2024-09-12T18:00:00.087538+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:54.407762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6538157,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":353,"num_read_kb":6504,"num_write":929,"num_write_kb":34893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":513,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.415656+0000","last_change":"2024-09-12T17:23:33.592955+0000","last_active":"2024-09-12T17:58:59.415656+0000","last_peered":"2024-09-12T17:58:59.415656+0000","last_clean":"2024-09-12T17:58:59.415656+0000","last_became_active":"2024-09-12T17:23:31.681209+0000","last_became_peered":"2024-09-12T17:23:31.681209+0000","last_unstale":"2024-09-12T17:58:59.415656+0000","last_undegraded":"2024-09-12T17:58:59.415656+0000","last_fullsized":"2024-09-12T17:58:59.415656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:00.576073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056110600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.545208+0000","last_change":"2024-09-12T17:23:44.148393+0000","last_active":"2024-09-12T17:59:09.545208+0000","last_peered":"2024-09-12T17:59:09.545208+0000","last_clean":"2024-09-12T17:59:09.545208+0000","last_became_active":"2024-09-12T17:23:44.148035+0000","last_became_peered":"2024-09-12T17:23:44.148035+0000","last_unstale":"2024-09-12T17:59:09.545208+0000","last_undegraded":"2024-09-12T17:59:09.545208+0000","last_fullsized":"2024-09-12T17:59:09.545208+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:03.387749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"261'555","reported_seq":1188,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.441319+0000","last_change":"2024-09-12T17:23:46.152284+0000","last_active":"2024-09-12T18:01:49.441319+0000","last_peered":"2024-09-12T18:01:49.441319+0000","last_clean":"2024-09-12T18:01:49.441319+0000","last_became_active":"2024-09-12T17:23:46.151649+0000","last_became_peered":"2024-09-12T17:23:46.151649+0000","last_unstale":"2024-09-12T18:01:49.441319+0000","last_undegraded":"2024-09-12T18:01:49.441319+0000","last_fullsized":"2024-09-12T18:01:49.441319+0000","mapping_epoch":29,"log_start":"261'500","ondisk_log_start":"261'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:44.755894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106631,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1501,"num_read_kb":2466,"num_write":1946,"num_write_kb":1783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418523+0000","last_change":"2024-09-12T17:23:48.166489+0000","last_active":"2024-09-12T17:59:14.418523+0000","last_peered":"2024-09-12T17:59:14.418523+0000","last_clean":"2024-09-12T17:59:14.418523+0000","last_became_active":"2024-09-12T17:23:48.166196+0000","last_became_peered":"2024-09-12T17:23:48.166196+0000","last_unstale":"2024-09-12T17:59:14.418523+0000","last_undegraded":"2024-09-12T17:59:14.418523+0000","last_fullsized":"2024-09-12T17:59:14.418523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:02.318935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"261'221","reported_seq":721,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.429767+0000","last_change":"2024-09-12T17:23:50.640504+0000","last_active":"2024-09-12T17:59:58.429767+0000","last_peered":"2024-09-12T17:59:58.429767+0000","last_clean":"2024-09-12T17:59:58.429767+0000","last_became_active":"2024-09-12T17:23:50.640185+0000","last_became_peered":"2024-09-12T17:23:50.640185+0000","last_unstale":"2024-09-12T17:59:58.429767+0000","last_undegraded":"2024-09-12T17:59:58.429767+0000","last_fullsized":"2024-09-12T17:59:58.429767+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:20.014900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":243,"num_write":513,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"261'509","reported_seq":2065,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.462615+0000","last_change":"2024-09-12T17:23:42.148853+0000","last_active":"2024-09-12T18:00:02.462615+0000","last_peered":"2024-09-12T18:00:02.462615+0000","last_clean":"2024-09-12T18:00:02.462615+0000","last_became_active":"2024-09-12T17:23:42.148578+0000","last_became_peered":"2024-09-12T17:23:42.148578+0000","last_unstale":"2024-09-12T18:00:02.462615+0000","last_undegraded":"2024-09-12T18:00:02.462615+0000","last_fullsized":"2024-09-12T18:00:02.462615+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:05.365806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2709,"num_read_kb":2501,"num_write":646,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"261'292","reported_seq":914,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:56.793221+0000","last_change":"2024-09-12T17:23:40.711077+0000","last_active":"2024-09-12T17:59:56.793221+0000","last_peered":"2024-09-12T17:59:56.793221+0000","last_clean":"2024-09-12T17:59:56.793221+0000","last_became_active":"2024-09-12T17:23:40.710780+0000","last_became_peered":"2024-09-12T17:23:40.710780+0000","last_unstale":"2024-09-12T17:59:56.793221+0000","last_undegraded":"2024-09-12T17:59:56.793221+0000","last_fullsized":"2024-09-12T17:59:56.793221+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:38.403382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615620,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":428,"num_read_kb":525,"num_write":1166,"num_write_kb":43788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":506,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.418269+0000","last_change":"2024-09-12T17:23:33.971206+0000","last_active":"2024-09-12T17:59:09.418269+0000","last_peered":"2024-09-12T17:59:09.418269+0000","last_clean":"2024-09-12T17:59:09.418269+0000","last_became_active":"2024-09-12T17:23:31.681155+0000","last_became_peered":"2024-09-12T17:23:31.681155+0000","last_unstale":"2024-09-12T17:59:09.418269+0000","last_undegraded":"2024-09-12T17:59:09.418269+0000","last_fullsized":"2024-09-12T17:59:09.418269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:20.293962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048562399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415369+0000","last_change":"2024-09-12T17:23:44.147684+0000","last_active":"2024-09-12T17:59:09.415369+0000","last_peered":"2024-09-12T17:59:09.415369+0000","last_clean":"2024-09-12T17:59:09.415369+0000","last_became_active":"2024-09-12T17:23:44.147347+0000","last_became_peered":"2024-09-12T17:23:44.147347+0000","last_unstale":"2024-09-12T17:59:09.415369+0000","last_undegraded":"2024-09-12T17:59:09.415369+0000","last_fullsized":"2024-09-12T17:59:09.415369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:45.660164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"261'149","reported_seq":697,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:23.414940+0000","last_change":"2024-09-12T17:23:46.241508+0000","last_active":"2024-09-12T18:00:23.414940+0000","last_peered":"2024-09-12T18:00:23.414940+0000","last_clean":"2024-09-12T18:00:23.414940+0000","last_became_active":"2024-09-12T17:23:46.241046+0000","last_became_peered":"2024-09-12T17:23:46.241046+0000","last_unstale":"2024-09-12T18:00:23.414940+0000","last_undegraded":"2024-09-12T18:00:23.414940+0000","last_fullsized":"2024-09-12T18:00:23.414940+0000","mapping_epoch":29,"log_start":"258'100","ondisk_log_start":"258'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:42.691500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":154,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"261'789","reported_seq":2338,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.413214+0000","last_change":"2024-09-12T17:23:48.173674+0000","last_active":"2024-09-12T18:01:49.413214+0000","last_peered":"2024-09-12T18:01:49.413214+0000","last_clean":"2024-09-12T18:01:49.413214+0000","last_became_active":"2024-09-12T17:23:48.173351+0000","last_became_peered":"2024-09-12T17:23:48.173351+0000","last_unstale":"2024-09-12T18:01:49.413214+0000","last_undegraded":"2024-09-12T18:01:49.413214+0000","last_fullsized":"2024-09-12T18:01:49.413214+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:23.841940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"261'101","reported_seq":588,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.422953+0000","last_change":"2024-09-12T17:23:50.639372+0000","last_active":"2024-09-12T17:59:58.422953+0000","last_peered":"2024-09-12T17:59:58.422953+0000","last_clean":"2024-09-12T17:59:58.422953+0000","last_became_active":"2024-09-12T17:23:50.639054+0000","last_became_peered":"2024-09-12T17:23:50.639054+0000","last_unstale":"2024-09-12T17:59:58.422953+0000","last_undegraded":"2024-09-12T17:59:58.422953+0000","last_fullsized":"2024-09-12T17:59:58.422953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:27.121755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":220,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"261'494","reported_seq":2015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559802+0000","last_change":"2024-09-12T17:23:42.148855+0000","last_active":"2024-09-12T18:00:18.559802+0000","last_peered":"2024-09-12T18:00:18.559802+0000","last_clean":"2024-09-12T18:00:18.559802+0000","last_became_active":"2024-09-12T17:23:42.148523+0000","last_became_peered":"2024-09-12T17:23:42.148523+0000","last_unstale":"2024-09-12T18:00:18.559802+0000","last_undegraded":"2024-09-12T18:00:18.559802+0000","last_fullsized":"2024-09-12T18:00:18.559802+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:44.314747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2488,"num_read_kb":2312,"num_write":602,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"261'313","reported_seq":1029,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.574035+0000","last_change":"2024-09-12T17:23:40.709406+0000","last_active":"2024-09-12T18:00:16.574035+0000","last_peered":"2024-09-12T18:00:16.574035+0000","last_clean":"2024-09-12T18:00:16.574035+0000","last_became_active":"2024-09-12T17:23:40.709077+0000","last_became_peered":"2024-09-12T17:23:40.709077+0000","last_unstale":"2024-09-12T18:00:16.574035+0000","last_undegraded":"2024-09-12T18:00:16.574035+0000","last_fullsized":"2024-09-12T18:00:16.574035+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:24.640342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19888358,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":626,"num_read_kb":135818,"num_write":1161,"num_write_kb":56746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":512,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.409415+0000","last_change":"2024-09-12T17:23:33.592959+0000","last_active":"2024-09-12T17:58:14.409415+0000","last_peered":"2024-09-12T17:58:14.409415+0000","last_clean":"2024-09-12T17:58:14.409415+0000","last_became_active":"2024-09-12T17:23:31.588526+0000","last_became_peered":"2024-09-12T17:23:31.588526+0000","last_unstale":"2024-09-12T17:58:14.409415+0000","last_undegraded":"2024-09-12T17:58:14.409415+0000","last_fullsized":"2024-09-12T17:58:14.409415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:32.240058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055923099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417985+0000","last_change":"2024-09-12T17:23:44.148290+0000","last_active":"2024-09-12T17:59:09.417985+0000","last_peered":"2024-09-12T17:59:09.417985+0000","last_clean":"2024-09-12T17:59:09.417985+0000","last_became_active":"2024-09-12T17:23:44.147594+0000","last_became_peered":"2024-09-12T17:23:44.147594+0000","last_unstale":"2024-09-12T17:59:09.417985+0000","last_undegraded":"2024-09-12T17:59:09.417985+0000","last_fullsized":"2024-09-12T17:59:09.417985+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:51.406975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"261'97","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.150898+0000","last_change":"2024-09-12T17:23:46.151701+0000","last_active":"2024-09-12T18:00:18.150898+0000","last_peered":"2024-09-12T18:00:18.150898+0000","last_clean":"2024-09-12T18:00:18.150898+0000","last_became_active":"2024-09-12T17:23:46.151335+0000","last_became_peered":"2024-09-12T17:23:46.151335+0000","last_unstale":"2024-09-12T18:00:18.150898+0000","last_undegraded":"2024-09-12T18:00:18.150898+0000","last_fullsized":"2024-09-12T18:00:18.150898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:23.162677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"261'804","reported_seq":2584,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.455650+0000","last_change":"2024-09-12T17:23:48.168044+0000","last_active":"2024-09-12T18:01:42.455650+0000","last_peered":"2024-09-12T18:01:42.455650+0000","last_clean":"2024-09-12T18:01:42.455650+0000","last_became_active":"2024-09-12T17:23:48.167739+0000","last_became_peered":"2024-09-12T17:23:48.167739+0000","last_unstale":"2024-09-12T18:01:42.455650+0000","last_undegraded":"2024-09-12T18:01:42.455650+0000","last_fullsized":"2024-09-12T18:01:42.455650+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:25.436138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"261'311","reported_seq":829,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.346118+0000","last_change":"2024-09-12T17:23:50.179480+0000","last_active":"2024-09-12T18:01:41.346118+0000","last_peered":"2024-09-12T18:01:41.346118+0000","last_clean":"2024-09-12T18:01:41.346118+0000","last_became_active":"2024-09-12T17:23:50.179127+0000","last_became_peered":"2024-09-12T17:23:50.179127+0000","last_unstale":"2024-09-12T18:01:41.346118+0000","last_undegraded":"2024-09-12T18:01:41.346118+0000","last_fullsized":"2024-09-12T18:01:41.346118+0000","mapping_epoch":33,"log_start":"261'300","ondisk_log_start":"261'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:11.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":442,"num_write":705,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"261'1030","reported_seq":2757,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.227573+0000","last_change":"2024-09-12T17:23:42.145784+0000","last_active":"2024-09-12T18:00:05.227573+0000","last_peered":"2024-09-12T18:00:05.227573+0000","last_clean":"2024-09-12T18:00:05.227573+0000","last_became_active":"2024-09-12T17:23:42.145139+0000","last_became_peered":"2024-09-12T17:23:42.145139+0000","last_unstale":"2024-09-12T18:00:05.227573+0000","last_undegraded":"2024-09-12T18:00:05.227573+0000","last_fullsized":"2024-09-12T18:00:05.227573+0000","mapping_epoch":25,"log_start":"261'1000","ondisk_log_start":"261'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1000,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:16.782381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4954,"num_read_kb":4437,"num_write":1455,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"261'305","reported_seq":952,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.520960+0000","last_change":"2024-09-12T17:23:40.713302+0000","last_active":"2024-09-12T18:01:49.520960+0000","last_peered":"2024-09-12T18:01:49.520960+0000","last_clean":"2024-09-12T18:01:49.520960+0000","last_became_active":"2024-09-12T17:23:40.712974+0000","last_became_peered":"2024-09-12T17:23:40.712974+0000","last_unstale":"2024-09-12T18:01:49.520960+0000","last_undegraded":"2024-09-12T18:01:49.520960+0000","last_fullsized":"2024-09-12T18:01:49.520960+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:22.541324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582155,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":449,"num_read_kb":103143,"num_write":1105,"num_write_kb":43429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":507,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.407867+0000","last_change":"2024-09-12T17:23:33.971199+0000","last_active":"2024-09-12T17:58:14.407867+0000","last_peered":"2024-09-12T17:58:14.407867+0000","last_clean":"2024-09-12T17:58:14.407867+0000","last_became_active":"2024-09-12T17:23:31.588266+0000","last_became_peered":"2024-09-12T17:23:31.588266+0000","last_unstale":"2024-09-12T17:58:14.407867+0000","last_undegraded":"2024-09-12T17:58:14.407867+0000","last_fullsized":"2024-09-12T17:58:14.407867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:05.248877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051630700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.421688+0000","last_change":"2024-09-12T17:23:44.149935+0000","last_active":"2024-09-12T17:59:48.421688+0000","last_peered":"2024-09-12T17:59:48.421688+0000","last_clean":"2024-09-12T17:59:48.421688+0000","last_became_active":"2024-09-12T17:23:44.149649+0000","last_became_peered":"2024-09-12T17:23:44.149649+0000","last_unstale":"2024-09-12T17:59:48.421688+0000","last_undegraded":"2024-09-12T17:59:48.421688+0000","last_fullsized":"2024-09-12T17:59:48.421688+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:06.362964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"261'681","reported_seq":1366,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.430148+0000","last_change":"2024-09-12T17:23:46.242153+0000","last_active":"2024-09-12T18:01:49.430148+0000","last_peered":"2024-09-12T18:01:49.430148+0000","last_clean":"2024-09-12T18:01:49.430148+0000","last_became_active":"2024-09-12T17:23:46.241681+0000","last_became_peered":"2024-09-12T17:23:46.241681+0000","last_unstale":"2024-09-12T18:01:49.430148+0000","last_undegraded":"2024-09-12T18:01:49.430148+0000","last_fullsized":"2024-09-12T18:01:49.430148+0000","mapping_epoch":29,"log_start":"261'600","ondisk_log_start":"261'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":600,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:06.488679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180006,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1211,"num_read_kb":2636,"num_write":996,"num_write_kb":858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:13.416822+0000","last_change":"2024-09-12T17:23:48.170996+0000","last_active":"2024-09-12T17:59:13.416822+0000","last_peered":"2024-09-12T17:59:13.416822+0000","last_clean":"2024-09-12T17:59:13.416822+0000","last_became_active":"2024-09-12T17:23:48.170687+0000","last_became_peered":"2024-09-12T17:23:48.170687+0000","last_unstale":"2024-09-12T17:59:13.416822+0000","last_undegraded":"2024-09-12T17:59:13.416822+0000","last_fullsized":"2024-09-12T17:59:13.416822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:56.021234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"261'136","reported_seq":667,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.547879+0000","last_change":"2024-09-12T17:23:50.189525+0000","last_active":"2024-09-12T18:00:18.547879+0000","last_peered":"2024-09-12T18:00:18.547879+0000","last_clean":"2024-09-12T18:00:18.547879+0000","last_became_active":"2024-09-12T17:23:50.188042+0000","last_became_peered":"2024-09-12T17:23:50.188042+0000","last_unstale":"2024-09-12T18:00:18.547879+0000","last_undegraded":"2024-09-12T18:00:18.547879+0000","last_fullsized":"2024-09-12T18:00:18.547879+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:12.246421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":351,"num_read_kb":302,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"261'129","reported_seq":670,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.665733+0000","last_change":"2024-09-12T17:23:50.190175+0000","last_active":"2024-09-12T18:00:18.665733+0000","last_peered":"2024-09-12T18:00:18.665733+0000","last_clean":"2024-09-12T18:00:18.665733+0000","last_became_active":"2024-09-12T17:23:50.189955+0000","last_became_peered":"2024-09-12T17:23:50.189955+0000","last_unstale":"2024-09-12T18:00:18.665733+0000","last_undegraded":"2024-09-12T18:00:18.665733+0000","last_fullsized":"2024-09-12T18:00:18.665733+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:05.002727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":232,"num_write":318,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"261'329","reported_seq":1796,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559462+0000","last_change":"2024-09-12T17:23:42.139182+0000","last_active":"2024-09-12T18:00:18.559462+0000","last_peered":"2024-09-12T18:00:18.559462+0000","last_clean":"2024-09-12T18:00:18.559462+0000","last_became_active":"2024-09-12T17:23:42.138899+0000","last_became_peered":"2024-09-12T17:23:42.138899+0000","last_unstale":"2024-09-12T18:00:18.559462+0000","last_undegraded":"2024-09-12T18:00:18.559462+0000","last_fullsized":"2024-09-12T18:00:18.559462+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:52.392138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1873,"num_read_kb":1826,"num_write":350,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"261'303","reported_seq":936,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.572606+0000","last_change":"2024-09-12T17:23:40.709618+0000","last_active":"2024-09-12T18:00:16.572606+0000","last_peered":"2024-09-12T18:00:16.572606+0000","last_clean":"2024-09-12T18:00:16.572606+0000","last_became_active":"2024-09-12T17:23:40.709219+0000","last_became_peered":"2024-09-12T17:23:40.709219+0000","last_unstale":"2024-09-12T18:00:16.572606+0000","last_undegraded":"2024-09-12T18:00:16.572606+0000","last_fullsized":"2024-09-12T18:00:16.572606+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:01.388035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":701751,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":497,"num_read_kb":4301,"num_write":1202,"num_write_kb":9304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.413627+0000","last_change":"2024-09-12T17:23:44.151482+0000","last_active":"2024-09-12T17:58:44.413627+0000","last_peered":"2024-09-12T17:58:44.413627+0000","last_clean":"2024-09-12T17:58:44.413627+0000","last_became_active":"2024-09-12T17:23:44.151175+0000","last_became_peered":"2024-09-12T17:23:44.151175+0000","last_unstale":"2024-09-12T17:58:44.413627+0000","last_undegraded":"2024-09-12T17:58:44.413627+0000","last_fullsized":"2024-09-12T17:58:44.413627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:07.283799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"261'271","reported_seq":826,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:08.431619+0000","last_change":"2024-09-12T17:23:46.151842+0000","last_active":"2024-09-12T18:01:08.431619+0000","last_peered":"2024-09-12T18:01:08.431619+0000","last_clean":"2024-09-12T18:01:08.431619+0000","last_became_active":"2024-09-12T17:23:46.150505+0000","last_became_peered":"2024-09-12T17:23:46.150505+0000","last_unstale":"2024-09-12T18:01:08.431619+0000","last_undegraded":"2024-09-12T18:01:08.431619+0000","last_fullsized":"2024-09-12T18:01:08.431619+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:29.365545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92207,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":466,"num_read_kb":1051,"num_write":390,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.413394+0000","last_change":"2024-09-12T17:23:48.168196+0000","last_active":"2024-09-12T17:58:48.413394+0000","last_peered":"2024-09-12T17:58:48.413394+0000","last_clean":"2024-09-12T17:58:48.413394+0000","last_became_active":"2024-09-12T17:23:48.167911+0000","last_became_peered":"2024-09-12T17:23:48.167911+0000","last_unstale":"2024-09-12T17:58:48.413394+0000","last_undegraded":"2024-09-12T17:58:48.413394+0000","last_fullsized":"2024-09-12T17:58:48.413394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:27.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"261'95","reported_seq":584,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.804808+0000","last_change":"2024-09-12T17:23:50.183763+0000","last_active":"2024-09-12T17:59:38.804808+0000","last_peered":"2024-09-12T17:59:38.804808+0000","last_clean":"2024-09-12T17:59:38.804808+0000","last_became_active":"2024-09-12T17:23:50.183400+0000","last_became_peered":"2024-09-12T17:23:50.183400+0000","last_unstale":"2024-09-12T17:59:38.804808+0000","last_undegraded":"2024-09-12T17:59:38.804808+0000","last_fullsized":"2024-09-12T17:59:38.804808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:30.231346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":128,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"261'478","reported_seq":1884,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.785644+0000","last_change":"2024-09-12T17:23:42.138814+0000","last_active":"2024-09-12T18:00:05.785644+0000","last_peered":"2024-09-12T18:00:05.785644+0000","last_clean":"2024-09-12T18:00:05.785644+0000","last_became_active":"2024-09-12T17:23:42.137988+0000","last_became_peered":"2024-09-12T17:23:42.137988+0000","last_unstale":"2024-09-12T18:00:05.785644+0000","last_undegraded":"2024-09-12T18:00:05.785644+0000","last_fullsized":"2024-09-12T18:00:05.785644+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:34.256530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2384,"num_read_kb":2190,"num_write":595,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"261'304","reported_seq":942,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.146183+0000","last_change":"2024-09-12T17:23:40.711108+0000","last_active":"2024-09-12T18:00:02.146183+0000","last_peered":"2024-09-12T18:00:02.146183+0000","last_clean":"2024-09-12T18:00:02.146183+0000","last_became_active":"2024-09-12T17:23:40.710425+0000","last_became_peered":"2024-09-12T17:23:40.710425+0000","last_unstale":"2024-09-12T18:00:02.146183+0000","last_undegraded":"2024-09-12T18:00:02.146183+0000","last_fullsized":"2024-09-12T18:00:02.146183+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:29.912015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19579553,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":475,"num_read_kb":49330,"num_write":1083,"num_write_kb":37186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:43.412561+0000","last_change":"2024-09-12T17:23:44.149929+0000","last_active":"2024-09-12T17:58:43.412561+0000","last_peered":"2024-09-12T17:58:43.412561+0000","last_clean":"2024-09-12T17:58:43.412561+0000","last_became_active":"2024-09-12T17:23:44.148078+0000","last_became_peered":"2024-09-12T17:23:44.148078+0000","last_unstale":"2024-09-12T17:58:43.412561+0000","last_undegraded":"2024-09-12T17:58:43.412561+0000","last_fullsized":"2024-09-12T17:58:43.412561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:27.562908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"261'42","reported_seq":529,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.542596+0000","last_change":"2024-09-12T17:23:46.152014+0000","last_active":"2024-09-12T17:58:49.542596+0000","last_peered":"2024-09-12T17:58:49.542596+0000","last_clean":"2024-09-12T17:58:49.542596+0000","last_became_active":"2024-09-12T17:23:46.151258+0000","last_became_peered":"2024-09-12T17:23:46.151258+0000","last_unstale":"2024-09-12T17:58:49.542596+0000","last_undegraded":"2024-09-12T17:58:49.542596+0000","last_fullsized":"2024-09-12T17:58:49.542596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.540146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":25,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.415800+0000","last_change":"2024-09-12T17:23:48.174102+0000","last_active":"2024-09-12T17:58:49.415800+0000","last_peered":"2024-09-12T17:58:49.415800+0000","last_clean":"2024-09-12T17:58:49.415800+0000","last_became_active":"2024-09-12T17:23:48.173781+0000","last_became_peered":"2024-09-12T17:23:48.173781+0000","last_unstale":"2024-09-12T17:58:49.415800+0000","last_undegraded":"2024-09-12T17:58:49.415800+0000","last_fullsized":"2024-09-12T17:58:49.415800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:42.236527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"261'166","reported_seq":668,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.152209+0000","last_change":"2024-09-12T17:23:50.184117+0000","last_active":"2024-09-12T18:00:18.152209+0000","last_peered":"2024-09-12T18:00:18.152209+0000","last_clean":"2024-09-12T18:00:18.152209+0000","last_became_active":"2024-09-12T17:23:50.183784+0000","last_became_peered":"2024-09-12T17:23:50.183784+0000","last_unstale":"2024-09-12T18:00:18.152209+0000","last_undegraded":"2024-09-12T18:00:18.152209+0000","last_fullsized":"2024-09-12T18:00:18.152209+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:59.251619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":278,"num_read_kb":278,"num_write":359,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"261'417","reported_seq":1952,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.897757+0000","last_change":"2024-09-12T17:23:42.147200+0000","last_active":"2024-09-12T18:00:04.897757+0000","last_peered":"2024-09-12T18:00:04.897757+0000","last_clean":"2024-09-12T18:00:04.897757+0000","last_became_active":"2024-09-12T17:23:42.146703+0000","last_became_peered":"2024-09-12T17:23:42.146703+0000","last_unstale":"2024-09-12T18:00:04.897757+0000","last_undegraded":"2024-09-12T18:00:04.897757+0000","last_fullsized":"2024-09-12T18:00:04.897757+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:00.134623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2240,"num_read_kb":2131,"num_write":479,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"261'228","reported_seq":885,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:01.304117+0000","last_change":"2024-09-12T17:23:40.704662+0000","last_active":"2024-09-12T18:00:01.304117+0000","last_peered":"2024-09-12T18:00:01.304117+0000","last_clean":"2024-09-12T18:00:01.304117+0000","last_became_active":"2024-09-12T17:23:40.704278+0000","last_became_peered":"2024-09-12T17:23:40.704278+0000","last_unstale":"2024-09-12T18:00:01.304117+0000","last_undegraded":"2024-09-12T18:00:01.304117+0000","last_fullsized":"2024-09-12T18:00:01.304117+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:07.570947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19121762,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":418,"num_read_kb":96513,"num_write":866,"num_write_kb":33057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.415015+0000","last_change":"2024-09-12T17:23:44.151075+0000","last_active":"2024-09-12T17:58:44.415015+0000","last_peered":"2024-09-12T17:58:44.415015+0000","last_clean":"2024-09-12T17:58:44.415015+0000","last_became_active":"2024-09-12T17:23:44.149838+0000","last_became_peered":"2024-09-12T17:23:44.149838+0000","last_unstale":"2024-09-12T17:58:44.415015+0000","last_undegraded":"2024-09-12T17:58:44.415015+0000","last_fullsized":"2024-09-12T17:58:44.415015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:30.715787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"261'296","reported_seq":867,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:08.431649+0000","last_change":"2024-09-12T17:23:46.150856+0000","last_active":"2024-09-12T18:01:08.431649+0000","last_peered":"2024-09-12T18:01:08.431649+0000","last_clean":"2024-09-12T18:01:08.431649+0000","last_became_active":"2024-09-12T17:23:46.150528+0000","last_became_peered":"2024-09-12T17:23:46.150528+0000","last_unstale":"2024-09-12T18:01:08.431649+0000","last_undegraded":"2024-09-12T18:01:08.431649+0000","last_fullsized":"2024-09-12T18:01:08.431649+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:33.340339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55558,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":967,"num_write":392,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.412615+0000","last_change":"2024-09-12T17:23:48.171496+0000","last_active":"2024-09-12T17:58:49.412615+0000","last_peered":"2024-09-12T17:58:49.412615+0000","last_clean":"2024-09-12T17:58:49.412615+0000","last_became_active":"2024-09-12T17:23:48.171031+0000","last_became_peered":"2024-09-12T17:23:48.171031+0000","last_unstale":"2024-09-12T17:58:49.412615+0000","last_undegraded":"2024-09-12T17:58:49.412615+0000","last_fullsized":"2024-09-12T17:58:49.412615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:49.840358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"261'154","reported_seq":657,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.140462+0000","last_change":"2024-09-12T17:23:50.186163+0000","last_active":"2024-09-12T18:00:03.140462+0000","last_peered":"2024-09-12T18:00:03.140462+0000","last_clean":"2024-09-12T18:00:03.140462+0000","last_became_active":"2024-09-12T17:23:50.185846+0000","last_became_peered":"2024-09-12T17:23:50.185846+0000","last_unstale":"2024-09-12T18:00:03.140462+0000","last_undegraded":"2024-09-12T18:00:03.140462+0000","last_fullsized":"2024-09-12T18:00:03.140462+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:27.173182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":366,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"261'792","reported_seq":2404,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.575412+0000","last_change":"2024-09-12T17:23:42.155181+0000","last_active":"2024-09-12T18:00:04.575412+0000","last_peered":"2024-09-12T18:00:04.575412+0000","last_clean":"2024-09-12T18:00:04.575412+0000","last_became_active":"2024-09-12T17:23:42.154925+0000","last_became_peered":"2024-09-12T17:23:42.154925+0000","last_unstale":"2024-09-12T18:00:04.575412+0000","last_undegraded":"2024-09-12T18:00:04.575412+0000","last_fullsized":"2024-09-12T18:00:04.575412+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:33.690553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3893,"num_read_kb":3543,"num_write":1032,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"261'295","reported_seq":907,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.562583+0000","last_change":"2024-09-12T17:23:40.709552+0000","last_active":"2024-09-12T18:01:49.562583+0000","last_peered":"2024-09-12T18:01:49.562583+0000","last_clean":"2024-09-12T18:01:49.562583+0000","last_became_active":"2024-09-12T17:23:40.708670+0000","last_became_peered":"2024-09-12T17:23:40.708670+0000","last_unstale":"2024-09-12T18:01:49.562583+0000","last_undegraded":"2024-09-12T18:01:49.562583+0000","last_fullsized":"2024-09-12T18:01:49.562583+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:17.377417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334439,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":426,"num_read_kb":1950,"num_write":1046,"num_write_kb":27043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.411789+0000","last_change":"2024-09-12T17:23:44.150241+0000","last_active":"2024-09-12T17:58:44.411789+0000","last_peered":"2024-09-12T17:58:44.411789+0000","last_clean":"2024-09-12T17:58:44.411789+0000","last_became_active":"2024-09-12T17:23:44.149907+0000","last_became_peered":"2024-09-12T17:23:44.149907+0000","last_unstale":"2024-09-12T17:58:44.411789+0000","last_undegraded":"2024-09-12T17:58:44.411789+0000","last_fullsized":"2024-09-12T17:58:44.411789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:57.170825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"261'272","reported_seq":819,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.408760+0000","last_change":"2024-09-12T17:23:46.150337+0000","last_active":"2024-09-12T18:01:42.408760+0000","last_peered":"2024-09-12T18:01:42.408760+0000","last_clean":"2024-09-12T18:01:42.408760+0000","last_became_active":"2024-09-12T17:23:46.149987+0000","last_became_peered":"2024-09-12T17:23:46.149987+0000","last_unstale":"2024-09-12T18:01:42.408760+0000","last_undegraded":"2024-09-12T18:01:42.408760+0000","last_fullsized":"2024-09-12T18:01:42.408760+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:31.163554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58657,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":986,"num_write":384,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.542683+0000","last_change":"2024-09-12T17:23:48.169607+0000","last_active":"2024-09-12T17:58:49.542683+0000","last_peered":"2024-09-12T17:58:49.542683+0000","last_clean":"2024-09-12T17:58:49.542683+0000","last_became_active":"2024-09-12T17:23:48.169308+0000","last_became_peered":"2024-09-12T17:23:48.169308+0000","last_unstale":"2024-09-12T17:58:49.542683+0000","last_undegraded":"2024-09-12T17:58:49.542683+0000","last_fullsized":"2024-09-12T17:58:49.542683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:14.722104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"261'801","reported_seq":2248,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.775817+0000","last_change":"2024-09-12T17:23:42.148700+0000","last_active":"2024-09-12T18:00:15.775817+0000","last_peered":"2024-09-12T18:00:15.775817+0000","last_clean":"2024-09-12T18:00:15.775817+0000","last_became_active":"2024-09-12T17:23:42.148412+0000","last_became_peered":"2024-09-12T17:23:42.148412+0000","last_unstale":"2024-09-12T18:00:15.775817+0000","last_undegraded":"2024-09-12T18:00:15.775817+0000","last_fullsized":"2024-09-12T18:00:15.775817+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:21.039641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3663,"num_read_kb":3282,"num_write":1025,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"261'250","reported_seq":881,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.797639+0000","last_change":"2024-09-12T17:23:40.717850+0000","last_active":"2024-09-12T18:00:02.797639+0000","last_peered":"2024-09-12T18:00:02.797639+0000","last_clean":"2024-09-12T18:00:02.797639+0000","last_became_active":"2024-09-12T17:23:40.717447+0000","last_became_peered":"2024-09-12T17:23:40.717447+0000","last_unstale":"2024-09-12T18:00:02.797639+0000","last_undegraded":"2024-09-12T18:00:02.797639+0000","last_fullsized":"2024-09-12T18:00:02.797639+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:56.974836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11557594,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":426,"num_read_kb":6876,"num_write":914,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:49.550885+0000","last_change":"2024-09-12T17:23:44.150079+0000","last_active":"2024-09-12T17:59:49.550885+0000","last_peered":"2024-09-12T17:59:49.550885+0000","last_clean":"2024-09-12T17:59:49.550885+0000","last_became_active":"2024-09-12T17:23:44.149799+0000","last_became_peered":"2024-09-12T17:23:44.149799+0000","last_unstale":"2024-09-12T17:59:49.550885+0000","last_undegraded":"2024-09-12T17:59:49.550885+0000","last_fullsized":"2024-09-12T17:59:49.550885+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:42.685092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"261'474","reported_seq":1085,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.434616+0000","last_change":"2024-09-12T17:23:46.149613+0000","last_active":"2024-09-12T18:01:42.434616+0000","last_peered":"2024-09-12T18:01:42.434616+0000","last_clean":"2024-09-12T18:01:42.434616+0000","last_became_active":"2024-09-12T17:23:46.148861+0000","last_became_peered":"2024-09-12T17:23:46.148861+0000","last_unstale":"2024-09-12T18:01:42.434616+0000","last_undegraded":"2024-09-12T18:01:42.434616+0000","last_fullsized":"2024-09-12T18:01:42.434616+0000","mapping_epoch":29,"log_start":"261'400","ondisk_log_start":"261'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:49.574258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121423,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":853,"num_read_kb":1879,"num_write":744,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.415004+0000","last_change":"2024-09-12T17:23:48.168964+0000","last_active":"2024-09-12T17:58:49.415004+0000","last_peered":"2024-09-12T17:58:49.415004+0000","last_clean":"2024-09-12T17:58:49.415004+0000","last_became_active":"2024-09-12T17:23:48.168566+0000","last_became_peered":"2024-09-12T17:23:48.168566+0000","last_unstale":"2024-09-12T17:58:49.415004+0000","last_undegraded":"2024-09-12T17:58:49.415004+0000","last_fullsized":"2024-09-12T17:58:49.415004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:54.048241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"261'216","reported_seq":723,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.143900+0000","last_change":"2024-09-12T17:23:50.642047+0000","last_active":"2024-09-12T18:00:18.143900+0000","last_peered":"2024-09-12T18:00:18.143900+0000","last_clean":"2024-09-12T18:00:18.143900+0000","last_became_active":"2024-09-12T17:23:50.641702+0000","last_became_peered":"2024-09-12T17:23:50.641702+0000","last_unstale":"2024-09-12T18:00:18.143900+0000","last_undegraded":"2024-09-12T18:00:18.143900+0000","last_fullsized":"2024-09-12T18:00:18.143900+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:03.863712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":328,"num_write":469,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"261'758","reported_seq":2326,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.409871+0000","last_change":"2024-09-12T17:23:42.142182+0000","last_active":"2024-09-12T18:00:03.409871+0000","last_peered":"2024-09-12T18:00:03.409871+0000","last_clean":"2024-09-12T18:00:03.409871+0000","last_became_active":"2024-09-12T17:23:42.141869+0000","last_became_peered":"2024-09-12T17:23:42.141869+0000","last_unstale":"2024-09-12T18:00:03.409871+0000","last_undegraded":"2024-09-12T18:00:03.409871+0000","last_fullsized":"2024-09-12T18:00:03.409871+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:48.199963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3783,"num_read_kb":3443,"num_write":995,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"261'259","reported_seq":860,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.906319+0000","last_change":"2024-09-12T17:23:40.711959+0000","last_active":"2024-09-12T17:59:38.906319+0000","last_peered":"2024-09-12T17:59:38.906319+0000","last_clean":"2024-09-12T17:59:38.906319+0000","last_became_active":"2024-09-12T17:23:40.711679+0000","last_became_peered":"2024-09-12T17:23:40.711679+0000","last_unstale":"2024-09-12T17:59:38.906319+0000","last_undegraded":"2024-09-12T17:59:38.906319+0000","last_fullsized":"2024-09-12T17:59:38.906319+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:54.430386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243674,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":380,"num_read_kb":3626,"num_write":916,"num_write_kb":35404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415419+0000","last_change":"2024-09-12T17:23:44.148401+0000","last_active":"2024-09-12T17:59:09.415419+0000","last_peered":"2024-09-12T17:59:09.415419+0000","last_clean":"2024-09-12T17:59:09.415419+0000","last_became_active":"2024-09-12T17:23:44.148044+0000","last_became_peered":"2024-09-12T17:23:44.148044+0000","last_unstale":"2024-09-12T17:59:09.415419+0000","last_undegraded":"2024-09-12T17:59:09.415419+0000","last_fullsized":"2024-09-12T17:59:09.415419+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:06.246940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"261'288","reported_seq":846,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.410042+0000","last_change":"2024-09-12T17:23:46.150717+0000","last_active":"2024-09-12T18:01:42.410042+0000","last_peered":"2024-09-12T18:01:42.410042+0000","last_clean":"2024-09-12T18:01:42.410042+0000","last_became_active":"2024-09-12T17:23:46.150380+0000","last_became_peered":"2024-09-12T17:23:46.150380+0000","last_unstale":"2024-09-12T18:01:42.410042+0000","last_undegraded":"2024-09-12T18:01:42.410042+0000","last_fullsized":"2024-09-12T18:01:42.410042+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:35.358954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57700,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":481,"num_read_kb":981,"num_write":410,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.414306+0000","last_change":"2024-09-12T17:23:48.173812+0000","last_active":"2024-09-12T17:58:49.414306+0000","last_peered":"2024-09-12T17:58:49.414306+0000","last_clean":"2024-09-12T17:58:49.414306+0000","last_became_active":"2024-09-12T17:23:48.173575+0000","last_became_peered":"2024-09-12T17:23:48.173575+0000","last_unstale":"2024-09-12T17:58:49.414306+0000","last_undegraded":"2024-09-12T17:58:49.414306+0000","last_fullsized":"2024-09-12T17:58:49.414306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:42.300280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"261'188","reported_seq":1044,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:17.033695+0000","last_change":"2024-09-12T17:23:50.186218+0000","last_active":"2024-09-12T18:00:17.033695+0000","last_peered":"2024-09-12T18:00:17.033695+0000","last_clean":"2024-09-12T18:00:17.033695+0000","last_became_active":"2024-09-12T17:23:50.185853+0000","last_became_peered":"2024-09-12T17:23:50.185853+0000","last_unstale":"2024-09-12T18:00:17.033695+0000","last_undegraded":"2024-09-12T18:00:17.033695+0000","last_fullsized":"2024-09-12T18:00:17.033695+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:01.791901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":633,"num_read_kb":630,"num_write":516,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"261'631","reported_seq":2472,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.504213+0000","last_change":"2024-09-12T17:23:42.154459+0000","last_active":"2024-09-12T18:00:05.504213+0000","last_peered":"2024-09-12T18:00:05.504213+0000","last_clean":"2024-09-12T18:00:05.504213+0000","last_became_active":"2024-09-12T17:23:42.154175+0000","last_became_peered":"2024-09-12T17:23:42.154175+0000","last_unstale":"2024-09-12T18:00:05.504213+0000","last_undegraded":"2024-09-12T18:00:05.504213+0000","last_fullsized":"2024-09-12T18:00:05.504213+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":600,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:46.313807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3404,"num_read_kb":3151,"num_write":789,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"261'277","reported_seq":902,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:23.907452+0000","last_change":"2024-09-12T17:23:40.713263+0000","last_active":"2024-09-12T17:59:23.907452+0000","last_peered":"2024-09-12T17:59:23.907452+0000","last_clean":"2024-09-12T17:59:23.907452+0000","last_became_active":"2024-09-12T17:23:40.712959+0000","last_became_peered":"2024-09-12T17:23:40.712959+0000","last_unstale":"2024-09-12T17:59:23.907452+0000","last_undegraded":"2024-09-12T17:59:23.907452+0000","last_fullsized":"2024-09-12T17:59:23.907452+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:04.359024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6618009,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":454,"num_read_kb":11021,"num_write":998,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.414711+0000","last_change":"2024-09-12T17:23:44.152533+0000","last_active":"2024-09-12T17:58:44.414711+0000","last_peered":"2024-09-12T17:58:44.414711+0000","last_clean":"2024-09-12T17:58:44.414711+0000","last_became_active":"2024-09-12T17:23:44.152006+0000","last_became_peered":"2024-09-12T17:23:44.152006+0000","last_unstale":"2024-09-12T17:58:44.414711+0000","last_undegraded":"2024-09-12T17:58:44.414711+0000","last_fullsized":"2024-09-12T17:58:44.414711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:53.659031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"261'244","reported_seq":801,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.433112+0000","last_change":"2024-09-12T17:23:46.241387+0000","last_active":"2024-09-12T18:01:18.433112+0000","last_peered":"2024-09-12T18:01:18.433112+0000","last_clean":"2024-09-12T18:01:18.433112+0000","last_became_active":"2024-09-12T17:23:46.241001+0000","last_became_peered":"2024-09-12T17:23:46.241001+0000","last_unstale":"2024-09-12T18:01:18.433112+0000","last_undegraded":"2024-09-12T18:01:18.433112+0000","last_fullsized":"2024-09-12T18:01:18.433112+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:50.165152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44275,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":380,"num_read_kb":773,"num_write":308,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.406337+0000","last_change":"2024-09-12T17:23:48.170506+0000","last_active":"2024-09-12T17:57:54.406337+0000","last_peered":"2024-09-12T17:57:54.406337+0000","last_clean":"2024-09-12T17:57:54.406337+0000","last_became_active":"2024-09-12T17:23:48.170212+0000","last_became_peered":"2024-09-12T17:23:48.170212+0000","last_unstale":"2024-09-12T17:57:54.406337+0000","last_undegraded":"2024-09-12T17:57:54.406337+0000","last_fullsized":"2024-09-12T17:57:54.406337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:14.960120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"261'127","reported_seq":607,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.439241+0000","last_change":"2024-09-12T17:23:50.187626+0000","last_active":"2024-09-12T18:01:42.439241+0000","last_peered":"2024-09-12T18:01:42.439241+0000","last_clean":"2024-09-12T18:01:42.439241+0000","last_became_active":"2024-09-12T17:23:50.187329+0000","last_became_peered":"2024-09-12T17:23:50.187329+0000","last_unstale":"2024-09-12T18:01:42.439241+0000","last_undegraded":"2024-09-12T18:01:42.439241+0000","last_fullsized":"2024-09-12T18:01:42.439241+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:50.928583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":770,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":154,"num_read_kb":149,"num_write":327,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"261'776","reported_seq":2292,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.504173+0000","last_change":"2024-09-12T17:23:42.144667+0000","last_active":"2024-09-12T18:00:05.504173+0000","last_peered":"2024-09-12T18:00:05.504173+0000","last_clean":"2024-09-12T18:00:05.504173+0000","last_became_active":"2024-09-12T17:23:42.144384+0000","last_became_peered":"2024-09-12T17:23:42.144384+0000","last_unstale":"2024-09-12T18:00:05.504173+0000","last_undegraded":"2024-09-12T18:00:05.504173+0000","last_fullsized":"2024-09-12T18:00:05.504173+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:07.836356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3720,"num_read_kb":3370,"num_write":1041,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"261'269","reported_seq":878,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.523666+0000","last_change":"2024-09-12T17:23:40.714983+0000","last_active":"2024-09-12T18:01:49.523666+0000","last_peered":"2024-09-12T18:01:49.523666+0000","last_clean":"2024-09-12T18:01:49.523666+0000","last_became_active":"2024-09-12T17:23:40.714710+0000","last_became_peered":"2024-09-12T17:23:40.714710+0000","last_unstale":"2024-09-12T18:01:49.523666+0000","last_undegraded":"2024-09-12T18:01:49.523666+0000","last_fullsized":"2024-09-12T18:01:49.523666+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:51.614208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3465743,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":411,"num_read_kb":6860,"num_write":1044,"num_write_kb":28418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.413676+0000","last_change":"2024-09-12T17:23:44.150532+0000","last_active":"2024-09-12T17:58:44.413676+0000","last_peered":"2024-09-12T17:58:44.413676+0000","last_clean":"2024-09-12T17:58:44.413676+0000","last_became_active":"2024-09-12T17:23:44.147886+0000","last_became_peered":"2024-09-12T17:23:44.147886+0000","last_unstale":"2024-09-12T17:58:44.413676+0000","last_undegraded":"2024-09-12T17:58:44.413676+0000","last_fullsized":"2024-09-12T17:58:44.413676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:53.428886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"261'80","reported_seq":588,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.424428+0000","last_change":"2024-09-12T17:23:46.241390+0000","last_active":"2024-09-12T17:59:59.424428+0000","last_peered":"2024-09-12T17:59:59.424428+0000","last_clean":"2024-09-12T17:59:59.424428+0000","last_became_active":"2024-09-12T17:23:46.241073+0000","last_became_peered":"2024-09-12T17:23:46.241073+0000","last_unstale":"2024-09-12T17:59:59.424428+0000","last_undegraded":"2024-09-12T17:59:59.424428+0000","last_fullsized":"2024-09-12T17:59:59.424428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:13.779221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":73,"num_read_kb":65,"num_write":60,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"261'784","reported_seq":2168,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.411782+0000","last_change":"2024-09-12T17:23:48.171323+0000","last_active":"2024-09-12T18:01:49.411782+0000","last_peered":"2024-09-12T18:01:49.411782+0000","last_clean":"2024-09-12T18:01:49.411782+0000","last_became_active":"2024-09-12T17:23:48.170815+0000","last_became_peered":"2024-09-12T17:23:48.170815+0000","last_unstale":"2024-09-12T18:01:49.411782+0000","last_undegraded":"2024-09-12T18:01:49.411782+0000","last_fullsized":"2024-09-12T18:01:49.411782+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:19.299843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"261'127","reported_seq":616,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:17.186926+0000","last_change":"2024-09-12T17:23:50.190416+0000","last_active":"2024-09-12T18:00:17.186926+0000","last_peered":"2024-09-12T18:00:17.186926+0000","last_clean":"2024-09-12T18:00:17.186926+0000","last_became_active":"2024-09-12T17:23:50.190124+0000","last_became_peered":"2024-09-12T17:23:50.190124+0000","last_unstale":"2024-09-12T18:00:17.186926+0000","last_undegraded":"2024-09-12T18:00:17.186926+0000","last_fullsized":"2024-09-12T18:00:17.186926+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:39.676360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":181,"num_read_kb":172,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"261'818","reported_seq":2433,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.787899+0000","last_change":"2024-09-12T17:23:42.149931+0000","last_active":"2024-09-12T18:00:05.787899+0000","last_peered":"2024-09-12T18:00:05.787899+0000","last_clean":"2024-09-12T18:00:05.787899+0000","last_became_active":"2024-09-12T17:23:42.149314+0000","last_became_peered":"2024-09-12T17:23:42.149314+0000","last_unstale":"2024-09-12T18:00:05.787899+0000","last_undegraded":"2024-09-12T18:00:05.787899+0000","last_fullsized":"2024-09-12T18:00:05.787899+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:45.837125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4083,"num_read_kb":3703,"num_write":1086,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"261'234","reported_seq":855,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.874152+0000","last_change":"2024-09-12T17:23:40.710250+0000","last_active":"2024-09-12T17:59:58.874152+0000","last_peered":"2024-09-12T17:59:58.874152+0000","last_clean":"2024-09-12T17:59:58.874152+0000","last_became_active":"2024-09-12T17:23:40.709818+0000","last_became_peered":"2024-09-12T17:23:40.709818+0000","last_unstale":"2024-09-12T17:59:58.874152+0000","last_undegraded":"2024-09-12T17:59:58.874152+0000","last_fullsized":"2024-09-12T17:59:58.874152+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:49.203826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2657777,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":368,"num_read_kb":69858,"num_write":877,"num_write_kb":36096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.415126+0000","last_change":"2024-09-12T17:23:44.150481+0000","last_active":"2024-09-12T17:58:44.415126+0000","last_peered":"2024-09-12T17:58:44.415126+0000","last_clean":"2024-09-12T17:58:44.415126+0000","last_became_active":"2024-09-12T17:23:44.150183+0000","last_became_peered":"2024-09-12T17:23:44.150183+0000","last_unstale":"2024-09-12T17:58:44.415126+0000","last_undegraded":"2024-09-12T17:58:44.415126+0000","last_fullsized":"2024-09-12T17:58:44.415126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:11.304183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"261'310","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.398549+0000","last_change":"2024-09-12T17:23:46.145061+0000","last_active":"2024-09-12T18:01:42.398549+0000","last_peered":"2024-09-12T18:01:42.398549+0000","last_clean":"2024-09-12T18:01:42.398549+0000","last_became_active":"2024-09-12T17:23:46.144587+0000","last_became_peered":"2024-09-12T17:23:46.144587+0000","last_unstale":"2024-09-12T18:01:42.398549+0000","last_undegraded":"2024-09-12T18:01:42.398549+0000","last_fullsized":"2024-09-12T18:01:42.398549+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:07.704295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60479,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":492,"num_read_kb":1006,"num_write":412,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.531765+0000","last_change":"2024-09-12T17:23:48.171551+0000","last_active":"2024-09-12T17:57:39.531765+0000","last_peered":"2024-09-12T17:57:39.531765+0000","last_clean":"2024-09-12T17:57:39.531765+0000","last_became_active":"2024-09-12T17:23:48.171272+0000","last_became_peered":"2024-09-12T17:23:48.171272+0000","last_unstale":"2024-09-12T17:57:39.531765+0000","last_undegraded":"2024-09-12T17:57:39.531765+0000","last_fullsized":"2024-09-12T17:57:39.531765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:23.692378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"261'102","reported_seq":586,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.251581+0000","last_change":"2024-09-12T17:23:50.192154+0000","last_active":"2024-09-12T18:00:04.251581+0000","last_peered":"2024-09-12T18:00:04.251581+0000","last_clean":"2024-09-12T18:00:04.251581+0000","last_became_active":"2024-09-12T17:23:50.191859+0000","last_became_peered":"2024-09-12T17:23:50.191859+0000","last_unstale":"2024-09-12T18:00:04.251581+0000","last_undegraded":"2024-09-12T18:00:04.251581+0000","last_fullsized":"2024-09-12T18:00:04.251581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:55.936330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":141,"num_write":249,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"261'476","reported_seq":2056,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.920905+0000","last_change":"2024-09-12T17:23:42.149567+0000","last_active":"2024-09-12T18:00:02.920905+0000","last_peered":"2024-09-12T18:00:02.920905+0000","last_clean":"2024-09-12T18:00:02.920905+0000","last_became_active":"2024-09-12T17:23:42.149260+0000","last_became_peered":"2024-09-12T17:23:42.149260+0000","last_unstale":"2024-09-12T18:00:02.920905+0000","last_undegraded":"2024-09-12T18:00:02.920905+0000","last_fullsized":"2024-09-12T18:00:02.920905+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:03.397079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2426,"num_read_kb":2286,"num_write":546,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"261'317","reported_seq":976,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.506110+0000","last_change":"2024-09-12T17:23:40.711299+0000","last_active":"2024-09-12T17:59:27.506110+0000","last_peered":"2024-09-12T17:59:27.506110+0000","last_clean":"2024-09-12T17:59:27.506110+0000","last_became_active":"2024-09-12T17:23:40.711032+0000","last_became_peered":"2024-09-12T17:23:40.711032+0000","last_unstale":"2024-09-12T17:59:27.506110+0000","last_undegraded":"2024-09-12T17:59:27.506110+0000","last_fullsized":"2024-09-12T17:59:27.506110+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:01.273219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10115930,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":547,"num_read_kb":19508,"num_write":1237,"num_write_kb":28388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.414353+0000","last_change":"2024-09-12T17:23:44.148038+0000","last_active":"2024-09-12T17:58:44.414353+0000","last_peered":"2024-09-12T17:58:44.414353+0000","last_clean":"2024-09-12T17:58:44.414353+0000","last_became_active":"2024-09-12T17:23:44.147694+0000","last_became_peered":"2024-09-12T17:23:44.147694+0000","last_unstale":"2024-09-12T17:58:44.414353+0000","last_undegraded":"2024-09-12T17:58:44.414353+0000","last_fullsized":"2024-09-12T17:58:44.414353+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:06.022806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"261'255","reported_seq":801,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.399732+0000","last_change":"2024-09-12T17:23:46.152548+0000","last_active":"2024-09-12T18:01:42.399732+0000","last_peered":"2024-09-12T18:01:42.399732+0000","last_clean":"2024-09-12T18:01:42.399732+0000","last_became_active":"2024-09-12T17:23:46.152028+0000","last_became_peered":"2024-09-12T17:23:46.152028+0000","last_unstale":"2024-09-12T18:01:42.399732+0000","last_undegraded":"2024-09-12T18:01:42.399732+0000","last_fullsized":"2024-09-12T18:01:42.399732+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:32.403280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54478,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":404,"num_read_kb":859,"num_write":332,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.404087+0000","last_change":"2024-09-12T17:23:48.170790+0000","last_active":"2024-09-12T17:57:49.404087+0000","last_peered":"2024-09-12T17:57:49.404087+0000","last_clean":"2024-09-12T17:57:49.404087+0000","last_became_active":"2024-09-12T17:23:48.170452+0000","last_became_peered":"2024-09-12T17:23:48.170452+0000","last_unstale":"2024-09-12T17:57:49.404087+0000","last_undegraded":"2024-09-12T17:57:49.404087+0000","last_fullsized":"2024-09-12T17:57:49.404087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:31.197971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"261'126","reported_seq":628,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.113825+0000","last_change":"2024-09-12T17:23:50.641248+0000","last_active":"2024-09-12T18:00:02.113825+0000","last_peered":"2024-09-12T18:00:02.113825+0000","last_clean":"2024-09-12T18:00:02.113825+0000","last_became_active":"2024-09-12T17:23:50.640911+0000","last_became_peered":"2024-09-12T17:23:50.640911+0000","last_unstale":"2024-09-12T18:00:02.113825+0000","last_undegraded":"2024-09-12T18:00:02.113825+0000","last_fullsized":"2024-09-12T18:00:02.113825+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:33.080397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":307,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"261'389","reported_seq":1787,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.136439+0000","last_change":"2024-09-12T17:23:42.146348+0000","last_active":"2024-09-12T18:00:18.136439+0000","last_peered":"2024-09-12T18:00:18.136439+0000","last_clean":"2024-09-12T18:00:18.136439+0000","last_became_active":"2024-09-12T17:23:42.146055+0000","last_became_peered":"2024-09-12T17:23:42.146055+0000","last_unstale":"2024-09-12T18:00:18.136439+0000","last_undegraded":"2024-09-12T18:00:18.136439+0000","last_fullsized":"2024-09-12T18:00:18.136439+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:11.249424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1982,"num_read_kb":1877,"num_write":444,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"261'255","reported_seq":872,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.155848+0000","last_change":"2024-09-12T17:23:40.712278+0000","last_active":"2024-09-12T17:59:59.155848+0000","last_peered":"2024-09-12T17:59:59.155848+0000","last_clean":"2024-09-12T17:59:59.155848+0000","last_became_active":"2024-09-12T17:23:40.709759+0000","last_became_peered":"2024-09-12T17:23:40.709759+0000","last_unstale":"2024-09-12T17:59:59.155848+0000","last_undegraded":"2024-09-12T17:59:59.155848+0000","last_fullsized":"2024-09-12T17:59:59.155848+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.261512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10792869,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":391,"num_read_kb":23018,"num_write":1015,"num_write_kb":26757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404701+0000","last_change":"2024-09-12T17:23:44.147886+0000","last_active":"2024-09-12T17:57:34.404701+0000","last_peered":"2024-09-12T17:57:34.404701+0000","last_clean":"2024-09-12T17:57:34.404701+0000","last_became_active":"2024-09-12T17:23:44.147372+0000","last_became_peered":"2024-09-12T17:23:44.147372+0000","last_unstale":"2024-09-12T17:57:34.404701+0000","last_undegraded":"2024-09-12T17:57:34.404701+0000","last_fullsized":"2024-09-12T17:57:34.404701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:48.881691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"261'237","reported_seq":779,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.433036+0000","last_change":"2024-09-12T17:23:46.153298+0000","last_active":"2024-09-12T18:01:18.433036+0000","last_peered":"2024-09-12T18:01:18.433036+0000","last_clean":"2024-09-12T18:01:18.433036+0000","last_became_active":"2024-09-12T17:23:46.153024+0000","last_became_peered":"2024-09-12T17:23:46.153024+0000","last_unstale":"2024-09-12T18:01:18.433036+0000","last_undegraded":"2024-09-12T18:01:18.433036+0000","last_fullsized":"2024-09-12T18:01:18.433036+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:00.093006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54635,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":849,"num_write":328,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.415370+0000","last_change":"2024-09-12T17:23:48.172179+0000","last_active":"2024-09-12T17:58:49.415370+0000","last_peered":"2024-09-12T17:58:49.415370+0000","last_clean":"2024-09-12T17:58:49.415370+0000","last_became_active":"2024-09-12T17:23:48.171849+0000","last_became_peered":"2024-09-12T17:23:48.171849+0000","last_unstale":"2024-09-12T17:58:49.415370+0000","last_undegraded":"2024-09-12T17:58:49.415370+0000","last_fullsized":"2024-09-12T17:58:49.415370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:22.948863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"261'139","reported_seq":1240,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.442930+0000","last_change":"2024-09-12T17:23:50.187385+0000","last_active":"2024-09-12T18:00:18.442930+0000","last_peered":"2024-09-12T18:00:18.442930+0000","last_clean":"2024-09-12T18:00:18.442930+0000","last_became_active":"2024-09-12T17:23:50.187084+0000","last_became_peered":"2024-09-12T17:23:50.187084+0000","last_unstale":"2024-09-12T18:00:18.442930+0000","last_undegraded":"2024-09-12T18:00:18.442930+0000","last_fullsized":"2024-09-12T18:00:18.442930+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:15.188210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":862,"num_read_kb":842,"num_write":338,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"261'420","reported_seq":1870,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.767639+0000","last_change":"2024-09-12T17:23:42.136286+0000","last_active":"2024-09-12T18:00:15.767639+0000","last_peered":"2024-09-12T18:00:15.767639+0000","last_clean":"2024-09-12T18:00:15.767639+0000","last_became_active":"2024-09-12T17:23:42.135975+0000","last_became_peered":"2024-09-12T17:23:42.135975+0000","last_unstale":"2024-09-12T18:00:15.767639+0000","last_undegraded":"2024-09-12T18:00:15.767639+0000","last_fullsized":"2024-09-12T18:00:15.767639+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:39.052393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2123,"num_read_kb":2006,"num_write":479,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"261'315","reported_seq":957,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.546600+0000","last_change":"2024-09-12T17:23:40.714142+0000","last_active":"2024-09-12T18:01:49.546600+0000","last_peered":"2024-09-12T18:01:49.546600+0000","last_clean":"2024-09-12T18:01:49.546600+0000","last_became_active":"2024-09-12T17:23:40.713129+0000","last_became_peered":"2024-09-12T17:23:40.713129+0000","last_unstale":"2024-09-12T18:01:49.546600+0000","last_undegraded":"2024-09-12T18:01:49.546600+0000","last_fullsized":"2024-09-12T18:01:49.546600+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:41.054346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8589522,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":473,"num_read_kb":14033,"num_write":1174,"num_write_kb":28273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.404033+0000","last_change":"2024-09-12T17:23:44.151405+0000","last_active":"2024-09-12T17:57:39.404033+0000","last_peered":"2024-09-12T17:57:39.404033+0000","last_clean":"2024-09-12T17:57:39.404033+0000","last_became_active":"2024-09-12T17:23:44.151126+0000","last_became_peered":"2024-09-12T17:23:44.151126+0000","last_unstale":"2024-09-12T17:57:39.404033+0000","last_undegraded":"2024-09-12T17:57:39.404033+0000","last_fullsized":"2024-09-12T17:57:39.404033+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:22.113687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"261'279","reported_seq":849,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.434647+0000","last_change":"2024-09-12T17:23:46.153409+0000","last_active":"2024-09-12T18:01:19.434647+0000","last_peered":"2024-09-12T18:01:19.434647+0000","last_clean":"2024-09-12T18:01:19.434647+0000","last_became_active":"2024-09-12T17:23:46.153111+0000","last_became_peered":"2024-09-12T17:23:46.153111+0000","last_unstale":"2024-09-12T18:01:19.434647+0000","last_undegraded":"2024-09-12T18:01:19.434647+0000","last_fullsized":"2024-09-12T18:01:19.434647+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:10.838059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49755,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":444,"num_read_kb":886,"num_write":356,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.542675+0000","last_change":"2024-09-12T17:23:48.167442+0000","last_active":"2024-09-12T17:58:49.542675+0000","last_peered":"2024-09-12T17:58:49.542675+0000","last_clean":"2024-09-12T17:58:49.542675+0000","last_became_active":"2024-09-12T17:23:48.167070+0000","last_became_peered":"2024-09-12T17:23:48.167070+0000","last_unstale":"2024-09-12T17:58:49.542675+0000","last_undegraded":"2024-09-12T17:58:49.542675+0000","last_fullsized":"2024-09-12T17:58:49.542675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:57.449206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"261'83","reported_seq":563,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.396381+0000","last_change":"2024-09-12T17:23:50.179396+0000","last_active":"2024-09-12T18:01:41.396381+0000","last_peered":"2024-09-12T18:01:41.396381+0000","last_clean":"2024-09-12T18:01:41.396381+0000","last_became_active":"2024-09-12T17:23:50.179075+0000","last_became_peered":"2024-09-12T17:23:50.179075+0000","last_unstale":"2024-09-12T18:01:41.396381+0000","last_undegraded":"2024-09-12T18:01:41.396381+0000","last_fullsized":"2024-09-12T18:01:41.396381+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:17.064467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":88,"num_write":193,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"261'777","reported_seq":2261,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.397855+0000","last_change":"2024-09-12T17:23:42.137451+0000","last_active":"2024-09-12T18:01:41.397855+0000","last_peered":"2024-09-12T18:01:41.397855+0000","last_clean":"2024-09-12T18:01:41.397855+0000","last_became_active":"2024-09-12T17:23:42.137169+0000","last_became_peered":"2024-09-12T17:23:42.137169+0000","last_unstale":"2024-09-12T18:01:41.397855+0000","last_undegraded":"2024-09-12T18:01:41.397855+0000","last_fullsized":"2024-09-12T18:01:41.397855+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:08.945619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3876,"num_read_kb":3488,"num_write":1033,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"261'305","reported_seq":967,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:52.096361+0000","last_change":"2024-09-12T17:23:40.713502+0000","last_active":"2024-09-12T17:59:52.096361+0000","last_peered":"2024-09-12T17:59:52.096361+0000","last_clean":"2024-09-12T17:59:52.096361+0000","last_became_active":"2024-09-12T17:23:40.713212+0000","last_became_peered":"2024-09-12T17:23:40.713212+0000","last_unstale":"2024-09-12T17:59:52.096361+0000","last_undegraded":"2024-09-12T17:59:52.096361+0000","last_fullsized":"2024-09-12T17:59:52.096361+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:39.463517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1300247,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":543,"num_read_kb":38604,"num_write":1106,"num_write_kb":36037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"261'632","reported_seq":2095,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.230241+0000","last_change":"2024-09-12T17:24:17.227806+0000","last_active":"2024-09-12T18:00:05.230241+0000","last_peered":"2024-09-12T18:00:05.230241+0000","last_clean":"2024-09-12T18:00:05.230241+0000","last_became_active":"2024-09-12T17:24:17.227465+0000","last_became_peered":"2024-09-12T17:24:17.227465+0000","last_unstale":"2024-09-12T18:00:05.230241+0000","last_undegraded":"2024-09-12T18:00:05.230241+0000","last_fullsized":"2024-09-12T18:00:05.230241+0000","mapping_epoch":36,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":600,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:02.612199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3072,"num_read_kb":2745,"num_write":824,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"261'255","reported_seq":924,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.574317+0000","last_change":"2024-09-12T17:23:40.708395+0000","last_active":"2024-09-12T18:00:16.574317+0000","last_peered":"2024-09-12T18:00:16.574317+0000","last_clean":"2024-09-12T18:00:16.574317+0000","last_became_active":"2024-09-12T17:23:40.708064+0000","last_became_peered":"2024-09-12T17:23:40.708064+0000","last_unstale":"2024-09-12T18:00:16.574317+0000","last_undegraded":"2024-09-12T18:00:16.574317+0000","last_fullsized":"2024-09-12T18:00:16.574317+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:37.241857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24765059,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":437,"num_read_kb":78914,"num_write":936,"num_write_kb":50917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"261'842","reported_seq":2554,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.897301+0000","last_change":"2024-09-12T17:23:42.145251+0000","last_active":"2024-09-12T18:00:04.897301+0000","last_peered":"2024-09-12T18:00:04.897301+0000","last_clean":"2024-09-12T18:00:04.897301+0000","last_became_active":"2024-09-12T17:23:42.144919+0000","last_became_peered":"2024-09-12T17:23:42.144919+0000","last_unstale":"2024-09-12T18:00:04.897301+0000","last_undegraded":"2024-09-12T18:00:04.897301+0000","last_fullsized":"2024-09-12T18:00:04.897301+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:06.765117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4312,"num_read_kb":3919,"num_write":1107,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"261'264","reported_seq":904,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.605562+0000","last_change":"2024-09-12T17:23:40.715953+0000","last_active":"2024-09-12T18:00:02.605562+0000","last_peered":"2024-09-12T18:00:02.605562+0000","last_clean":"2024-09-12T18:00:02.605562+0000","last_became_active":"2024-09-12T17:23:40.715471+0000","last_became_peered":"2024-09-12T17:23:40.715471+0000","last_unstale":"2024-09-12T18:00:02.605562+0000","last_undegraded":"2024-09-12T18:00:02.605562+0000","last_fullsized":"2024-09-12T18:00:02.605562+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:42.149240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5684255,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":390,"num_read_kb":37845,"num_write":934,"num_write_kb":24242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"261'766","reported_seq":2207,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.398961+0000","last_change":"2024-09-12T17:23:42.143464+0000","last_active":"2024-09-12T18:01:41.398961+0000","last_peered":"2024-09-12T18:01:41.398961+0000","last_clean":"2024-09-12T18:01:41.398961+0000","last_became_active":"2024-09-12T17:23:42.142672+0000","last_became_peered":"2024-09-12T17:23:42.142672+0000","last_unstale":"2024-09-12T18:01:41.398961+0000","last_undegraded":"2024-09-12T18:01:41.398961+0000","last_fullsized":"2024-09-12T18:01:41.398961+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:24.449488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3573,"num_read_kb":3224,"num_write":1004,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"261'227","reported_seq":847,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.535155+0000","last_change":"2024-09-12T17:23:40.703276+0000","last_active":"2024-09-12T18:01:49.535155+0000","last_peered":"2024-09-12T18:01:49.535155+0000","last_clean":"2024-09-12T18:01:49.535155+0000","last_became_active":"2024-09-12T17:23:40.702991+0000","last_became_peered":"2024-09-12T17:23:40.702991+0000","last_unstale":"2024-09-12T18:01:49.535155+0000","last_undegraded":"2024-09-12T18:01:49.535155+0000","last_fullsized":"2024-09-12T18:01:49.535155+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:10.880499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17109169,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":372,"num_read_kb":57190,"num_write":822,"num_write_kb":43690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"261'412","reported_seq":1898,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559469+0000","last_change":"2024-09-12T17:23:42.147003+0000","last_active":"2024-09-12T18:00:18.559469+0000","last_peered":"2024-09-12T18:00:18.559469+0000","last_clean":"2024-09-12T18:00:18.559469+0000","last_became_active":"2024-09-12T17:23:42.146394+0000","last_became_peered":"2024-09-12T17:23:42.146394+0000","last_unstale":"2024-09-12T18:00:18.559469+0000","last_undegraded":"2024-09-12T18:00:18.559469+0000","last_fullsized":"2024-09-12T18:00:18.559469+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:36.451547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2184,"num_read_kb":2068,"num_write":471,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"261'293","reported_seq":1034,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.409420+0000","last_change":"2024-09-12T17:23:40.712996+0000","last_active":"2024-09-12T17:58:23.409420+0000","last_peered":"2024-09-12T17:58:23.409420+0000","last_clean":"2024-09-12T17:58:23.409420+0000","last_became_active":"2024-09-12T17:23:40.712702+0000","last_became_peered":"2024-09-12T17:23:40.712702+0000","last_unstale":"2024-09-12T17:58:23.409420+0000","last_undegraded":"2024-09-12T17:58:23.409420+0000","last_fullsized":"2024-09-12T17:58:23.409420+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:27.121297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16644326,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":653,"num_read_kb":69808,"num_write":1120,"num_write_kb":31106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"261'857","reported_seq":2441,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.776265+0000","last_change":"2024-09-12T17:23:42.143639+0000","last_active":"2024-09-12T18:00:15.776265+0000","last_peered":"2024-09-12T18:00:15.776265+0000","last_clean":"2024-09-12T18:00:15.776265+0000","last_became_active":"2024-09-12T17:23:42.141605+0000","last_became_peered":"2024-09-12T17:23:42.141605+0000","last_unstale":"2024-09-12T18:00:15.776265+0000","last_undegraded":"2024-09-12T18:00:15.776265+0000","last_fullsized":"2024-09-12T18:00:15.776265+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:51.809611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4009,"num_read_kb":3625,"num_write":1130,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"261'250","reported_seq":976,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:55.754138+0000","last_change":"2024-09-12T17:23:40.716113+0000","last_active":"2024-09-12T17:59:55.754138+0000","last_peered":"2024-09-12T17:59:55.754138+0000","last_clean":"2024-09-12T17:59:55.754138+0000","last_became_active":"2024-09-12T17:23:40.715809+0000","last_became_peered":"2024-09-12T17:23:40.715809+0000","last_unstale":"2024-09-12T17:59:55.754138+0000","last_undegraded":"2024-09-12T17:59:55.754138+0000","last_fullsized":"2024-09-12T17:59:55.754138+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:47.361193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10487171,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":687,"num_read_kb":58572,"num_write":976,"num_write_kb":36244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"261'1242","reported_seq":2732,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.227974+0000","last_change":"2024-09-12T17:23:42.155774+0000","last_active":"2024-09-12T18:00:05.227974+0000","last_peered":"2024-09-12T18:00:05.227974+0000","last_clean":"2024-09-12T18:00:05.227974+0000","last_became_active":"2024-09-12T17:23:42.155489+0000","last_became_peered":"2024-09-12T17:23:42.155489+0000","last_unstale":"2024-09-12T18:00:05.227974+0000","last_undegraded":"2024-09-12T18:00:05.227974+0000","last_fullsized":"2024-09-12T18:00:05.227974+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:36.957522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5619,"num_read_kb":4947,"num_write":1761,"num_write_kb":787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"261'302","reported_seq":929,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.846138+0000","last_change":"2024-09-12T17:23:40.704880+0000","last_active":"2024-09-12T18:00:16.846138+0000","last_peered":"2024-09-12T18:00:16.846138+0000","last_clean":"2024-09-12T18:00:16.846138+0000","last_became_active":"2024-09-12T17:23:40.704582+0000","last_became_peered":"2024-09-12T17:23:40.704582+0000","last_unstale":"2024-09-12T18:00:16.846138+0000","last_undegraded":"2024-09-12T18:00:16.846138+0000","last_fullsized":"2024-09-12T18:00:16.846138+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:16.868554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13648727,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":476,"num_read_kb":13831,"num_write":1096,"num_write_kb":46857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"261'752","reported_seq":2383,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:01.852133+0000","last_change":"2024-09-12T17:23:42.141856+0000","last_active":"2024-09-12T18:00:01.852133+0000","last_peered":"2024-09-12T18:00:01.852133+0000","last_clean":"2024-09-12T18:00:01.852133+0000","last_became_active":"2024-09-12T17:23:42.141542+0000","last_became_peered":"2024-09-12T17:23:42.141542+0000","last_unstale":"2024-09-12T18:00:01.852133+0000","last_undegraded":"2024-09-12T18:00:01.852133+0000","last_fullsized":"2024-09-12T18:00:01.852133+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:24.628553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3956,"num_read_kb":3681,"num_write":1110,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"261'313","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:53.737394+0000","last_change":"2024-09-12T17:24:17.227402+0000","last_active":"2024-09-12T17:59:53.737394+0000","last_peered":"2024-09-12T17:59:53.737394+0000","last_clean":"2024-09-12T17:59:53.737394+0000","last_became_active":"2024-09-12T17:24:17.227082+0000","last_became_peered":"2024-09-12T17:24:17.227082+0000","last_unstale":"2024-09-12T17:59:53.737394+0000","last_undegraded":"2024-09-12T17:59:53.737394+0000","last_fullsized":"2024-09-12T17:59:53.737394+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:39.821544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3033,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":567,"num_read_kb":9829,"num_write":1382,"num_write_kb":18369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"261'766","reported_seq":2160,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.407235+0000","last_change":"2024-09-12T17:23:42.155753+0000","last_active":"2024-09-12T18:01:41.407235+0000","last_peered":"2024-09-12T18:01:41.407235+0000","last_clean":"2024-09-12T18:01:41.407235+0000","last_became_active":"2024-09-12T17:23:42.155052+0000","last_became_peered":"2024-09-12T17:23:42.155052+0000","last_unstale":"2024-09-12T18:01:41.407235+0000","last_undegraded":"2024-09-12T18:01:41.407235+0000","last_fullsized":"2024-09-12T18:01:41.407235+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:06.879341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3588,"num_read_kb":3224,"num_write":1013,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"261'283","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.602552+0000","last_change":"2024-09-12T17:23:40.707697+0000","last_active":"2024-09-12T18:00:05.602552+0000","last_peered":"2024-09-12T18:00:05.602552+0000","last_clean":"2024-09-12T18:00:05.602552+0000","last_became_active":"2024-09-12T17:23:40.707220+0000","last_became_peered":"2024-09-12T17:23:40.707220+0000","last_unstale":"2024-09-12T18:00:05.602552+0000","last_undegraded":"2024-09-12T18:00:05.602552+0000","last_fullsized":"2024-09-12T18:00:05.602552+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:32.088764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16446959,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":613,"num_read_kb":59084,"num_write":1062,"num_write_kb":27945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"261'437","reported_seq":1932,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.785671+0000","last_change":"2024-09-12T17:23:42.135161+0000","last_active":"2024-09-12T18:00:05.785671+0000","last_peered":"2024-09-12T18:00:05.785671+0000","last_clean":"2024-09-12T18:00:05.785671+0000","last_became_active":"2024-09-12T17:23:42.134859+0000","last_became_peered":"2024-09-12T17:23:42.134859+0000","last_unstale":"2024-09-12T18:00:05.785671+0000","last_undegraded":"2024-09-12T18:00:05.785671+0000","last_fullsized":"2024-09-12T18:00:05.785671+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:02.200019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2327,"num_read_kb":2188,"num_write":509,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"261'276","reported_seq":909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.144545+0000","last_change":"2024-09-12T17:23:40.711309+0000","last_active":"2024-09-12T17:59:59.144545+0000","last_peered":"2024-09-12T17:59:59.144545+0000","last_clean":"2024-09-12T17:59:59.144545+0000","last_became_active":"2024-09-12T17:23:40.711042+0000","last_became_peered":"2024-09-12T17:23:40.711042+0000","last_unstale":"2024-09-12T17:59:59.144545+0000","last_undegraded":"2024-09-12T17:59:59.144545+0000","last_fullsized":"2024-09-12T17:59:59.144545+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:52.925495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5649623,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":483,"num_read_kb":6765,"num_write":1118,"num_write_kb":43884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"261'951","reported_seq":2509,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.982322+0000","last_change":"2024-09-12T17:23:42.141720+0000","last_active":"2024-09-12T18:00:03.982322+0000","last_peered":"2024-09-12T18:00:03.982322+0000","last_clean":"2024-09-12T18:00:03.982322+0000","last_became_active":"2024-09-12T17:23:42.141379+0000","last_became_peered":"2024-09-12T17:23:42.141379+0000","last_unstale":"2024-09-12T18:00:03.982322+0000","last_undegraded":"2024-09-12T18:00:03.982322+0000","last_fullsized":"2024-09-12T18:00:03.982322+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:42.201491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4545,"num_read_kb":4064,"num_write":1359,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"261'328","reported_seq":954,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:01.938308+0000","last_change":"2024-09-12T17:23:40.704486+0000","last_active":"2024-09-12T18:00:01.938308+0000","last_peered":"2024-09-12T18:00:01.938308+0000","last_clean":"2024-09-12T18:00:01.938308+0000","last_became_active":"2024-09-12T17:23:40.702825+0000","last_became_peered":"2024-09-12T17:23:40.702825+0000","last_unstale":"2024-09-12T18:00:01.938308+0000","last_undegraded":"2024-09-12T18:00:01.938308+0000","last_fullsized":"2024-09-12T18:00:01.938308+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:59.455771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":275287,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":579,"num_read_kb":541,"num_write":1109,"num_write_kb":8662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"261'394","reported_seq":1802,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.719075+0000","last_change":"2024-09-12T17:23:42.140485+0000","last_active":"2024-09-12T18:00:03.719075+0000","last_peered":"2024-09-12T18:00:03.719075+0000","last_clean":"2024-09-12T18:00:03.719075+0000","last_became_active":"2024-09-12T17:23:42.139735+0000","last_became_peered":"2024-09-12T17:23:42.139735+0000","last_unstale":"2024-09-12T18:00:03.719075+0000","last_undegraded":"2024-09-12T18:00:03.719075+0000","last_fullsized":"2024-09-12T18:00:03.719075+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:08.857406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2037,"num_read_kb":1920,"num_write":445,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"261'283","reported_seq":944,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.542185+0000","last_change":"2024-09-12T17:23:40.709866+0000","last_active":"2024-09-12T18:01:49.542185+0000","last_peered":"2024-09-12T18:01:49.542185+0000","last_clean":"2024-09-12T18:01:49.542185+0000","last_became_active":"2024-09-12T17:23:40.709392+0000","last_became_peered":"2024-09-12T17:23:40.709392+0000","last_unstale":"2024-09-12T18:01:49.542185+0000","last_undegraded":"2024-09-12T18:01:49.542185+0000","last_fullsized":"2024-09-12T18:01:49.542185+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:11.200927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12947734,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":457,"num_read_kb":64698,"num_write":1081,"num_write_kb":39876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"261'1133","reported_seq":2665,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.137309+0000","last_change":"2024-09-12T17:23:42.154482+0000","last_active":"2024-09-12T18:00:18.137309+0000","last_peered":"2024-09-12T18:00:18.137309+0000","last_clean":"2024-09-12T18:00:18.137309+0000","last_became_active":"2024-09-12T17:23:42.154127+0000","last_became_peered":"2024-09-12T17:23:42.154127+0000","last_unstale":"2024-09-12T18:00:18.137309+0000","last_undegraded":"2024-09-12T18:00:18.137309+0000","last_fullsized":"2024-09-12T18:00:18.137309+0000","mapping_epoch":25,"log_start":"261'1100","ondisk_log_start":"261'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:39.681068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5169,"num_read_kb":4583,"num_write":1562,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"261'283","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.030587+0000","last_change":"2024-09-12T17:23:40.714617+0000","last_active":"2024-09-12T18:00:05.030587+0000","last_peered":"2024-09-12T18:00:05.030587+0000","last_clean":"2024-09-12T18:00:05.030587+0000","last_became_active":"2024-09-12T17:23:40.714343+0000","last_became_peered":"2024-09-12T17:23:40.714343+0000","last_unstale":"2024-09-12T18:00:05.030587+0000","last_undegraded":"2024-09-12T18:00:05.030587+0000","last_fullsized":"2024-09-12T18:00:05.030587+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:08.542048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5254957,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":548,"num_read_kb":27408,"num_write":1157,"num_write_kb":25060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"261'994","reported_seq":2614,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.219834+0000","last_change":"2024-09-12T17:23:42.146400+0000","last_active":"2024-09-12T18:00:05.219834+0000","last_peered":"2024-09-12T18:00:05.219834+0000","last_clean":"2024-09-12T18:00:05.219834+0000","last_became_active":"2024-09-12T17:23:42.146107+0000","last_became_peered":"2024-09-12T17:23:42.146107+0000","last_unstale":"2024-09-12T18:00:05.219834+0000","last_undegraded":"2024-09-12T18:00:05.219834+0000","last_fullsized":"2024-09-12T18:00:05.219834+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:14.764258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4676,"num_read_kb":4145,"num_write":1343,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"261'259","reported_seq":901,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.704801+0000","last_change":"2024-09-12T17:23:40.707232+0000","last_active":"2024-09-12T18:00:04.704801+0000","last_peered":"2024-09-12T18:00:04.704801+0000","last_clean":"2024-09-12T18:00:04.704801+0000","last_became_active":"2024-09-12T17:23:40.706951+0000","last_became_peered":"2024-09-12T17:23:40.706951+0000","last_unstale":"2024-09-12T18:00:04.704801+0000","last_undegraded":"2024-09-12T18:00:04.704801+0000","last_fullsized":"2024-09-12T18:00:04.704801+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:17.981456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17691166,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":463,"num_read_kb":7213,"num_write":904,"num_write_kb":28374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"261'489","reported_seq":1993,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.982703+0000","last_change":"2024-09-12T17:23:42.153312+0000","last_active":"2024-09-12T18:00:03.982703+0000","last_peered":"2024-09-12T18:00:03.982703+0000","last_clean":"2024-09-12T18:00:03.982703+0000","last_became_active":"2024-09-12T17:23:42.152999+0000","last_became_peered":"2024-09-12T17:23:42.152999+0000","last_unstale":"2024-09-12T18:00:03.982703+0000","last_undegraded":"2024-09-12T18:00:03.982703+0000","last_fullsized":"2024-09-12T18:00:03.982703+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:03.127915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2525,"num_read_kb":2342,"num_write":624,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"261'279","reported_seq":896,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:56.793678+0000","last_change":"2024-09-12T17:23:40.705092+0000","last_active":"2024-09-12T17:59:56.793678+0000","last_peered":"2024-09-12T17:59:56.793678+0000","last_clean":"2024-09-12T17:59:56.793678+0000","last_became_active":"2024-09-12T17:23:40.704585+0000","last_became_peered":"2024-09-12T17:23:40.704585+0000","last_unstale":"2024-09-12T17:59:56.793678+0000","last_undegraded":"2024-09-12T17:59:56.793678+0000","last_fullsized":"2024-09-12T17:59:56.793678+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:15.307799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298013,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":395,"num_read_kb":452,"num_write":1033,"num_write_kb":34111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"261'439","reported_seq":2020,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.777791+0000","last_change":"2024-09-12T17:23:42.154717+0000","last_active":"2024-09-12T18:00:15.777791+0000","last_peered":"2024-09-12T18:00:15.777791+0000","last_clean":"2024-09-12T18:00:15.777791+0000","last_became_active":"2024-09-12T17:23:42.154367+0000","last_became_peered":"2024-09-12T17:23:42.154367+0000","last_unstale":"2024-09-12T18:00:15.777791+0000","last_undegraded":"2024-09-12T18:00:15.777791+0000","last_fullsized":"2024-09-12T18:00:15.777791+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:21.496903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2387,"num_read_kb":2268,"num_write":501,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"261'332","reported_seq":935,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.882744+0000","last_change":"2024-09-12T17:24:17.287754+0000","last_active":"2024-09-12T18:01:36.882744+0000","last_peered":"2024-09-12T18:01:36.882744+0000","last_clean":"2024-09-12T18:01:36.882744+0000","last_became_active":"2024-09-12T17:24:17.287516+0000","last_became_peered":"2024-09-12T17:24:17.287516+0000","last_unstale":"2024-09-12T18:01:36.882744+0000","last_undegraded":"2024-09-12T18:01:36.882744+0000","last_fullsized":"2024-09-12T18:01:36.882744+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:04.002445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1983283,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":519,"num_read_kb":2150,"num_write":1146,"num_write_kb":17735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"261'294","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.046378+0000","last_change":"2024-09-12T17:23:40.706233+0000","last_active":"2024-09-12T18:00:05.046378+0000","last_peered":"2024-09-12T18:00:05.046378+0000","last_clean":"2024-09-12T18:00:05.046378+0000","last_became_active":"2024-09-12T17:23:40.705975+0000","last_became_peered":"2024-09-12T17:23:40.705975+0000","last_unstale":"2024-09-12T18:00:05.046378+0000","last_undegraded":"2024-09-12T18:00:05.046378+0000","last_fullsized":"2024-09-12T18:00:05.046378+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:14.609978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8493877,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":558,"num_read_kb":38544,"num_write":1107,"num_write_kb":29966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"261'887","reported_seq":2649,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.400463+0000","last_change":"2024-09-12T17:23:42.156067+0000","last_active":"2024-09-12T18:01:41.400463+0000","last_peered":"2024-09-12T18:01:41.400463+0000","last_clean":"2024-09-12T18:01:41.400463+0000","last_became_active":"2024-09-12T17:23:42.155431+0000","last_became_peered":"2024-09-12T17:23:42.155431+0000","last_unstale":"2024-09-12T18:01:41.400463+0000","last_undegraded":"2024-09-12T18:01:41.400463+0000","last_fullsized":"2024-09-12T18:01:41.400463+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:57.623164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4337,"num_read_kb":3945,"num_write":1177,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"261'259","reported_seq":904,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.577657+0000","last_change":"2024-09-12T17:23:40.714200+0000","last_active":"2024-09-12T18:00:16.577657+0000","last_peered":"2024-09-12T18:00:16.577657+0000","last_clean":"2024-09-12T18:00:16.577657+0000","last_became_active":"2024-09-12T17:23:40.713729+0000","last_became_peered":"2024-09-12T17:23:40.713729+0000","last_unstale":"2024-09-12T18:00:16.577657+0000","last_undegraded":"2024-09-12T18:00:16.577657+0000","last_fullsized":"2024-09-12T18:00:16.577657+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:29.670887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11936418,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":409,"num_read_kb":88924,"num_write":941,"num_write_kb":31954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"261'919","reported_seq":2505,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.399527+0000","last_change":"2024-09-12T17:23:42.151306+0000","last_active":"2024-09-12T18:01:41.399527+0000","last_peered":"2024-09-12T18:01:41.399527+0000","last_clean":"2024-09-12T18:01:41.399527+0000","last_became_active":"2024-09-12T17:23:42.151035+0000","last_became_peered":"2024-09-12T17:23:42.151035+0000","last_unstale":"2024-09-12T18:01:41.399527+0000","last_undegraded":"2024-09-12T18:01:41.399527+0000","last_fullsized":"2024-09-12T18:01:41.399527+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":900,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:08.657281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4231,"num_read_kb":3788,"num_write":1202,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6418,"num_read_kb":4664,"num_write":2041,"num_write_kb":938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1112,"ondisk_log_size":1112,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16069,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16200,"num_read_kb":15888,"num_write":16774,"num_write_kb":4891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1650,"ondisk_log_size":1650,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":665,"ondisk_log_size":665,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1866102,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":16527,"num_read_kb":32201,"num_write":13993,"num_write_kb":11365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3284992,"data_stored":2749168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2337,"ondisk_log_size":2337,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2424,"num_read_kb":2890,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212759,"num_read_kb":194564,"num_write":55413,"num_write_kb":18856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3940,"ondisk_log_size":3940,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":552032445,"num_objects":4349,"num_object_clones":0,"num_object_copies":8698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4349,"num_whiteouts":0,"num_read":32110,"num_read_kb":2097905,"num_write":68413,"num_write_kb":2176823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1131245568,"data_stored":1098822149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4032,"ondisk_log_size":4032,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":63021491,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":125,"num_read_kb":196116,"num_write":140,"num_write_kb":127401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126050304,"data_stored":126042982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":63021491,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":119,"num_read_kb":185777,"num_write":140,"num_write_kb":127401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126050304,"data_stored":126042982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509904,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484396,"kb_used_data":218588,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93887444,"statfs":{"total":96636764160,"available":96140742656,"internally_reserved":0,"allocated":223834112,"data_stored":217289232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":272169418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509904,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322200,"kb_used_data":92488,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94049640,"statfs":{"total":96636764160,"available":96306831360,"internally_reserved":0,"allocated":94707712,"data_stored":90280003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509905,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":337764,"kb_used_data":220564,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94034076,"statfs":{"total":96636764160,"available":96290893824,"internally_reserved":0,"allocated":225857536,"data_stored":219438838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509905,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":230236,"kb_used_data":167116,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94141604,"statfs":{"total":96636764160,"available":96401002496,"internally_reserved":0,"allocated":171126784,"data_stored":164811483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509904,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274508,"kb_used_data":135100,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94097332,"statfs":{"total":96636764160,"available":96355667968,"internally_reserved":0,"allocated":138342400,"data_stored":133976523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509906,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":464828,"kb_used_data":217132,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":93907012,"statfs":{"total":96636764160,"available":96160780288,"internally_reserved":0,"allocated":222343168,"data_stored":216203904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253622727},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542609,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":501660,"kb_used_data":235916,"kb_used_omap":1,"kb_used_meta":265726,"kb_avail":93870180,"statfs":{"total":96636764160,"available":96123064320,"internally_reserved":0,"allocated":241577984,"data_stored":235285808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272103879},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542610,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":197288,"kb_used_data":112024,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94174552,"statfs":{"total":96636764160,"available":96434741248,"internally_reserved":0,"allocated":114712576,"data_stored":110227029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":161869824,"data_stored":157576671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84967424,"data_stored":82120971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":88948736,"data_stored":85949828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":205901824,"data_stored":201166395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":131698688,"data_stored":126861003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180600832,"data_stored":175786629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69812224,"data_stored":66888939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":207446016,"data_stored":202471713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":340771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":390760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":132593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":463531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":76234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":576021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":255236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":514022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":3790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8391821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6332416,"data_stored":6331601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27308032,"data_stored":27306334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17891328,"data_stored":17889365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15732736,"data_stored":15731852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11595776,"data_stored":11594697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20974732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29425664,"data_stored":29423702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13635584,"data_stored":13634700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25206784,"data_stored":25205969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8450048,"data_stored":8448969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5287936,"data_stored":5286238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:01:51.875 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:01:51.875 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:01:52.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:01:52.242 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-12T18:01:52.244 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":1408,"stamp":"2024-09-12T18:01:50.480833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":680549778,"num_objects":4864,"num_object_clones":0,"num_object_copies":9728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4864,"num_whiteouts":0,"num_read":286760,"num_read_kb":2730072,"num_write":157057,"num_write_kb":2469331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13989,"ondisk_log_size":13989,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2812880,"kb_used_data":1398928,"kb_used_omap":12,"kb_used_meta":1413811,"kb_avail":752161840,"statfs":{"total":773094113280,"available":770213724160,"internally_reserved":0,"allocated":1432502272,"data_stored":1387512820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1447743027},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5244214,"num_objects":-58,"num_object_clones":0,"num_object_copies":-116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-58,"num_whiteouts":0,"num_read":504,"num_read_kb":450,"num_write":162,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005093"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412189+0000","last_change":"2024-09-12T17:50:58.430620+0000","last_active":"2024-09-12T17:58:29.412189+0000","last_peered":"2024-09-12T17:58:29.412189+0000","last_clean":"2024-09-12T17:58:29.412189+0000","last_became_active":"2024-09-12T17:50:58.430327+0000","last_became_peered":"2024-09-12T17:50:58.430327+0000","last_unstale":"2024-09-12T17:58:29.412189+0000","last_undegraded":"2024-09-12T17:58:29.412189+0000","last_fullsized":"2024-09-12T17:58:29.412189+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:08.467218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"261'9","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.407973+0000","last_change":"2024-09-12T17:40:30.414114+0000","last_active":"2024-09-12T17:57:59.407973+0000","last_peered":"2024-09-12T17:57:59.407973+0000","last_clean":"2024-09-12T17:57:59.407973+0000","last_became_active":"2024-09-12T17:40:30.413466+0000","last_became_peered":"2024-09-12T17:40:30.413466+0000","last_unstale":"2024-09-12T17:57:59.407973+0000","last_undegraded":"2024-09-12T17:57:59.407973+0000","last_fullsized":"2024-09-12T17:57:59.407973+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:13.588006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":14338,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'1","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:58.405640+0000","last_change":"2024-09-12T17:40:27.384339+0000","last_active":"2024-09-12T17:57:58.405640+0000","last_peered":"2024-09-12T17:57:58.405640+0000","last_clean":"2024-09-12T17:57:58.405640+0000","last_became_active":"2024-09-12T17:40:27.384052+0000","last_became_peered":"2024-09-12T17:40:27.384052+0000","last_unstale":"2024-09-12T17:57:58.405640+0000","last_undegraded":"2024-09-12T17:57:58.405640+0000","last_fullsized":"2024-09-12T17:57:58.405640+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:44.943293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"261'180","reported_seq":604,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.550175+0000","last_change":"2024-09-12T17:38:51.209021+0000","last_active":"2024-09-12T17:59:44.550175+0000","last_peered":"2024-09-12T17:59:44.550175+0000","last_clean":"2024-09-12T17:59:44.550175+0000","last_became_active":"2024-09-12T17:38:51.208740+0000","last_became_peered":"2024-09-12T17:38:51.208740+0000","last_unstale":"2024-09-12T17:59:44.550175+0000","last_undegraded":"2024-09-12T17:59:44.550175+0000","last_fullsized":"2024-09-12T17:59:44.550175+0000","mapping_epoch":248,"log_start":"258'100","ondisk_log_start":"258'100","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:15.411282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1105,"num_read_kb":819,"num_write":215,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612242+0000","last_change":"2024-09-12T17:50:58.429515+0000","last_active":"2024-09-12T17:58:28.612242+0000","last_peered":"2024-09-12T17:58:28.612242+0000","last_clean":"2024-09-12T17:58:28.612242+0000","last_became_active":"2024-09-12T17:50:58.429172+0000","last_became_peered":"2024-09-12T17:50:58.429172+0000","last_unstale":"2024-09-12T17:58:28.612242+0000","last_undegraded":"2024-09-12T17:58:28.612242+0000","last_fullsized":"2024-09-12T17:58:28.612242+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:58.887773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"261'1","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:04.409165+0000","last_change":"2024-09-12T17:40:30.419563+0000","last_active":"2024-09-12T17:58:04.409165+0000","last_peered":"2024-09-12T17:58:04.409165+0000","last_clean":"2024-09-12T17:58:04.409165+0000","last_became_active":"2024-09-12T17:40:30.419270+0000","last_became_peered":"2024-09-12T17:40:30.419270+0000","last_unstale":"2024-09-12T17:58:04.409165+0000","last_undegraded":"2024-09-12T17:58:04.409165+0000","last_fullsized":"2024-09-12T17:58:04.409165+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:40.594940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":118,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.407054+0000","last_change":"2024-09-12T17:40:27.383763+0000","last_active":"2024-09-12T17:57:59.407054+0000","last_peered":"2024-09-12T17:57:59.407054+0000","last_clean":"2024-09-12T17:57:59.407054+0000","last_became_active":"2024-09-12T17:40:27.383464+0000","last_became_peered":"2024-09-12T17:40:27.383464+0000","last_unstale":"2024-09-12T17:57:59.407054+0000","last_undegraded":"2024-09-12T17:57:59.407054+0000","last_fullsized":"2024-09-12T17:57:59.407054+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:17.860149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"261'20","reported_seq":98,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.513810+0000","last_change":"2024-09-12T17:38:51.217668+0000","last_active":"2024-09-12T17:59:54.513810+0000","last_peered":"2024-09-12T17:59:54.513810+0000","last_clean":"2024-09-12T17:59:54.513810+0000","last_became_active":"2024-09-12T17:38:51.217312+0000","last_became_peered":"2024-09-12T17:38:51.217312+0000","last_unstale":"2024-09-12T17:59:54.513810+0000","last_undegraded":"2024-09-12T17:59:54.513810+0000","last_fullsized":"2024-09-12T17:59:54.513810+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:44.870657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":68,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.407763+0000","last_change":"2024-09-12T17:50:58.425626+0000","last_active":"2024-09-12T17:58:14.407763+0000","last_peered":"2024-09-12T17:58:14.407763+0000","last_clean":"2024-09-12T17:58:14.407763+0000","last_became_active":"2024-09-12T17:50:58.425202+0000","last_became_peered":"2024-09-12T17:50:58.425202+0000","last_unstale":"2024-09-12T17:58:14.407763+0000","last_undegraded":"2024-09-12T17:58:14.407763+0000","last_fullsized":"2024-09-12T17:58:14.407763+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:43.003436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546433+0000","last_change":"2024-09-12T17:40:30.428077+0000","last_active":"2024-09-12T17:59:19.546433+0000","last_peered":"2024-09-12T17:59:19.546433+0000","last_clean":"2024-09-12T17:59:19.546433+0000","last_became_active":"2024-09-12T17:40:30.427798+0000","last_became_peered":"2024-09-12T17:40:30.427798+0000","last_unstale":"2024-09-12T17:59:19.546433+0000","last_undegraded":"2024-09-12T17:59:19.546433+0000","last_fullsized":"2024-09-12T17:59:19.546433+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:08.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612294+0000","last_change":"2024-09-12T17:40:27.381742+0000","last_active":"2024-09-12T17:58:28.612294+0000","last_peered":"2024-09-12T17:58:28.612294+0000","last_clean":"2024-09-12T17:58:28.612294+0000","last_became_active":"2024-09-12T17:40:27.381456+0000","last_became_peered":"2024-09-12T17:40:27.381456+0000","last_unstale":"2024-09-12T17:58:28.612294+0000","last_undegraded":"2024-09-12T17:58:28.612294+0000","last_fullsized":"2024-09-12T17:58:28.612294+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:34.919045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"261'39","reported_seq":146,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:54.543334+0000","last_change":"2024-09-12T17:38:51.212514+0000","last_active":"2024-09-12T17:58:54.543334+0000","last_peered":"2024-09-12T17:58:54.543334+0000","last_clean":"2024-09-12T17:58:54.543334+0000","last_became_active":"2024-09-12T17:38:51.212222+0000","last_became_peered":"2024-09-12T17:38:51.212222+0000","last_unstale":"2024-09-12T17:58:54.543334+0000","last_undegraded":"2024-09-12T17:58:54.543334+0000","last_fullsized":"2024-09-12T17:58:54.543334+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:58.957926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":132,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.408592+0000","last_change":"2024-09-12T17:50:58.422072+0000","last_active":"2024-09-12T17:58:18.408592+0000","last_peered":"2024-09-12T17:58:18.408592+0000","last_clean":"2024-09-12T17:58:18.408592+0000","last_became_active":"2024-09-12T17:50:58.421791+0000","last_became_peered":"2024-09-12T17:50:58.421791+0000","last_unstale":"2024-09-12T17:58:18.408592+0000","last_undegraded":"2024-09-12T17:58:18.408592+0000","last_fullsized":"2024-09-12T17:58:18.408592+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:23.289873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'2","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546421+0000","last_change":"2024-09-12T17:41:17.634582+0000","last_active":"2024-09-12T17:59:19.546421+0000","last_peered":"2024-09-12T17:59:19.546421+0000","last_clean":"2024-09-12T17:59:19.546421+0000","last_became_active":"2024-09-12T17:41:17.634263+0000","last_became_peered":"2024-09-12T17:41:17.634263+0000","last_unstale":"2024-09-12T17:59:19.546421+0000","last_undegraded":"2024-09-12T17:59:19.546421+0000","last_fullsized":"2024-09-12T17:59:19.546421+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:21.737434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1f","version":"261'1","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418618+0000","last_change":"2024-09-12T17:40:27.381866+0000","last_active":"2024-09-12T17:59:14.418618+0000","last_peered":"2024-09-12T17:59:14.418618+0000","last_clean":"2024-09-12T17:59:14.418618+0000","last_became_active":"2024-09-12T17:40:27.381587+0000","last_became_peered":"2024-09-12T17:40:27.381587+0000","last_unstale":"2024-09-12T17:59:14.418618+0000","last_undegraded":"2024-09-12T17:59:14.418618+0000","last_fullsized":"2024-09-12T17:59:14.418618+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:05.484868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"261'16","reported_seq":86,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:53.414258+0000","last_change":"2024-09-12T17:38:51.211725+0000","last_active":"2024-09-12T17:58:53.414258+0000","last_peered":"2024-09-12T17:58:53.414258+0000","last_clean":"2024-09-12T17:58:53.414258+0000","last_became_active":"2024-09-12T17:38:51.211429+0000","last_became_peered":"2024-09-12T17:38:51.211429+0000","last_unstale":"2024-09-12T17:58:53.414258+0000","last_undegraded":"2024-09-12T17:58:53.414258+0000","last_fullsized":"2024-09-12T17:58:53.414258+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:51.433082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":53,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:03.415591+0000","last_change":"2024-09-12T17:50:58.425178+0000","last_active":"2024-09-12T17:59:03.415591+0000","last_peered":"2024-09-12T17:59:03.415591+0000","last_clean":"2024-09-12T17:59:03.415591+0000","last_became_active":"2024-09-12T17:50:58.424898+0000","last_became_peered":"2024-09-12T17:50:58.424898+0000","last_unstale":"2024-09-12T17:59:03.415591+0000","last_undegraded":"2024-09-12T17:59:03.415591+0000","last_fullsized":"2024-09-12T17:59:03.415591+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:43.460057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.403387+0000","last_change":"2024-09-12T17:40:30.419273+0000","last_active":"2024-09-12T17:57:29.403387+0000","last_peered":"2024-09-12T17:57:29.403387+0000","last_clean":"2024-09-12T17:57:29.403387+0000","last_became_active":"2024-09-12T17:40:30.418865+0000","last_became_peered":"2024-09-12T17:40:30.418865+0000","last_unstale":"2024-09-12T17:57:29.403387+0000","last_undegraded":"2024-09-12T17:57:29.403387+0000","last_fullsized":"2024-09-12T17:57:29.403387+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:37.865615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'7","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:24.529144+0000","last_change":"2024-09-12T17:40:27.384760+0000","last_active":"2024-09-12T17:57:24.529144+0000","last_peered":"2024-09-12T17:57:24.529144+0000","last_clean":"2024-09-12T17:57:24.529144+0000","last_became_active":"2024-09-12T17:40:27.384445+0000","last_became_peered":"2024-09-12T17:40:27.384445+0000","last_unstale":"2024-09-12T17:57:24.529144+0000","last_undegraded":"2024-09-12T17:57:24.529144+0000","last_fullsized":"2024-09-12T17:57:24.529144+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:48.815935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":14338,"num_write":17,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"261'42","reported_seq":159,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.511172+0000","last_change":"2024-09-12T17:38:51.217731+0000","last_active":"2024-09-12T17:59:16.511172+0000","last_peered":"2024-09-12T17:59:16.511172+0000","last_clean":"2024-09-12T17:59:16.511172+0000","last_became_active":"2024-09-12T17:38:51.217421+0000","last_became_peered":"2024-09-12T17:38:51.217421+0000","last_unstale":"2024-09-12T17:59:16.511172+0000","last_undegraded":"2024-09-12T17:59:16.511172+0000","last_fullsized":"2024-09-12T17:59:16.511172+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:29.905573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":155,"num_write":73,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.418508+0000","last_change":"2024-09-12T17:50:58.422069+0000","last_active":"2024-09-12T17:59:19.418508+0000","last_peered":"2024-09-12T17:59:19.418508+0000","last_clean":"2024-09-12T17:59:19.418508+0000","last_became_active":"2024-09-12T17:50:58.421760+0000","last_became_peered":"2024-09-12T17:50:58.421760+0000","last_unstale":"2024-09-12T17:59:19.418508+0000","last_undegraded":"2024-09-12T17:59:19.418508+0000","last_fullsized":"2024-09-12T17:59:19.418508+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:17.645861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'1","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.401154+0000","last_change":"2024-09-12T17:40:30.417805+0000","last_active":"2024-09-12T17:57:29.401154+0000","last_peered":"2024-09-12T17:57:29.401154+0000","last_clean":"2024-09-12T17:57:29.401154+0000","last_became_active":"2024-09-12T17:40:30.417372+0000","last_became_peered":"2024-09-12T17:40:30.417372+0000","last_unstale":"2024-09-12T17:57:29.401154+0000","last_undegraded":"2024-09-12T17:57:29.401154+0000","last_fullsized":"2024-09-12T17:57:29.401154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:46.977654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":80,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"258'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.403961+0000","last_change":"2024-09-12T17:40:27.379433+0000","last_active":"2024-09-12T17:57:29.403961+0000","last_peered":"2024-09-12T17:57:29.403961+0000","last_clean":"2024-09-12T17:57:29.403961+0000","last_became_active":"2024-09-12T17:40:27.379161+0000","last_became_peered":"2024-09-12T17:40:27.379161+0000","last_unstale":"2024-09-12T17:57:29.403961+0000","last_undegraded":"2024-09-12T17:57:29.403961+0000","last_fullsized":"2024-09-12T17:57:29.403961+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:17.149187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"261'20","reported_seq":98,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:54.413353+0000","last_change":"2024-09-12T17:38:51.214836+0000","last_active":"2024-09-12T17:58:54.413353+0000","last_peered":"2024-09-12T17:58:54.413353+0000","last_clean":"2024-09-12T17:58:54.413353+0000","last_became_active":"2024-09-12T17:38:51.214555+0000","last_became_peered":"2024-09-12T17:38:51.214555+0000","last_unstale":"2024-09-12T17:58:54.413353+0000","last_undegraded":"2024-09-12T17:58:54.413353+0000","last_fullsized":"2024-09-12T17:58:54.413353+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:24.488340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412872+0000","last_change":"2024-09-12T17:50:58.429666+0000","last_active":"2024-09-12T17:58:29.412872+0000","last_peered":"2024-09-12T17:58:29.412872+0000","last_clean":"2024-09-12T17:58:29.412872+0000","last_became_active":"2024-09-12T17:50:58.429381+0000","last_became_peered":"2024-09-12T17:50:58.429381+0000","last_unstale":"2024-09-12T17:58:29.412872+0000","last_undegraded":"2024-09-12T17:58:29.412872+0000","last_fullsized":"2024-09-12T17:58:29.412872+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:24.108837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:04.406346+0000","last_change":"2024-09-12T17:40:30.420492+0000","last_active":"2024-09-12T17:58:04.406346+0000","last_peered":"2024-09-12T17:58:04.406346+0000","last_clean":"2024-09-12T17:58:04.406346+0000","last_became_active":"2024-09-12T17:40:30.420165+0000","last_became_peered":"2024-09-12T17:40:30.420165+0000","last_unstale":"2024-09-12T17:58:04.406346+0000","last_undegraded":"2024-09-12T17:58:04.406346+0000","last_fullsized":"2024-09-12T17:58:04.406346+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:02.691513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"261'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.408364+0000","last_change":"2024-09-12T17:40:27.382601+0000","last_active":"2024-09-12T17:57:59.408364+0000","last_peered":"2024-09-12T17:57:59.408364+0000","last_clean":"2024-09-12T17:57:59.408364+0000","last_became_active":"2024-09-12T17:40:27.382310+0000","last_became_peered":"2024-09-12T17:40:27.382310+0000","last_unstale":"2024-09-12T17:57:59.408364+0000","last_undegraded":"2024-09-12T17:57:59.408364+0000","last_fullsized":"2024-09-12T17:57:59.408364+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:53.252512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"261'83","reported_seq":276,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537110+0000","last_change":"2024-09-12T17:38:51.213883+0000","last_active":"2024-09-12T17:58:14.537110+0000","last_peered":"2024-09-12T17:58:14.537110+0000","last_clean":"2024-09-12T17:58:14.537110+0000","last_became_active":"2024-09-12T17:38:51.213569+0000","last_became_peered":"2024-09-12T17:38:51.213569+0000","last_unstale":"2024-09-12T17:58:14.537110+0000","last_undegraded":"2024-09-12T17:58:14.537110+0000","last_fullsized":"2024-09-12T17:58:14.537110+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:09.021970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":443,"num_read_kb":326,"num_write":140,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412923+0000","last_change":"2024-09-12T17:50:58.431925+0000","last_active":"2024-09-12T17:58:29.412923+0000","last_peered":"2024-09-12T17:58:29.412923+0000","last_clean":"2024-09-12T17:58:29.412923+0000","last_became_active":"2024-09-12T17:50:58.431242+0000","last_became_peered":"2024-09-12T17:50:58.431242+0000","last_unstale":"2024-09-12T17:58:29.412923+0000","last_undegraded":"2024-09-12T17:58:29.412923+0000","last_fullsized":"2024-09-12T17:58:29.412923+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:38.404256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'1","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:03.406325+0000","last_change":"2024-09-12T17:40:30.417580+0000","last_active":"2024-09-12T17:58:03.406325+0000","last_peered":"2024-09-12T17:58:03.406325+0000","last_clean":"2024-09-12T17:58:03.406325+0000","last_became_active":"2024-09-12T17:40:30.416973+0000","last_became_peered":"2024-09-12T17:40:30.416973+0000","last_unstale":"2024-09-12T17:58:03.406325+0000","last_undegraded":"2024-09-12T17:58:03.406325+0000","last_fullsized":"2024-09-12T17:58:03.406325+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:01.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"258'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.535018+0000","last_change":"2024-09-12T17:40:27.383868+0000","last_active":"2024-09-12T17:57:59.535018+0000","last_peered":"2024-09-12T17:57:59.535018+0000","last_clean":"2024-09-12T17:57:59.535018+0000","last_became_active":"2024-09-12T17:40:27.383589+0000","last_became_peered":"2024-09-12T17:40:27.383589+0000","last_unstale":"2024-09-12T17:57:59.535018+0000","last_undegraded":"2024-09-12T17:57:59.535018+0000","last_fullsized":"2024-09-12T17:57:59.535018+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:33.218417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"261'40","reported_seq":149,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:52.416289+0000","last_change":"2024-09-12T17:38:51.212263+0000","last_active":"2024-09-12T17:59:52.416289+0000","last_peered":"2024-09-12T17:59:52.416289+0000","last_clean":"2024-09-12T17:59:52.416289+0000","last_became_active":"2024-09-12T17:38:51.211962+0000","last_became_peered":"2024-09-12T17:38:51.211962+0000","last_unstale":"2024-09-12T17:59:52.416289+0000","last_undegraded":"2024-09-12T17:59:52.416289+0000","last_fullsized":"2024-09-12T17:59:52.416289+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:27.978434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":137,"num_write":74,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.406991+0000","last_change":"2024-09-12T17:50:58.415378+0000","last_active":"2024-09-12T17:57:59.406991+0000","last_peered":"2024-09-12T17:57:59.406991+0000","last_clean":"2024-09-12T17:57:59.406991+0000","last_became_active":"2024-09-12T17:50:58.415098+0000","last_became_peered":"2024-09-12T17:50:58.415098+0000","last_unstale":"2024-09-12T17:57:59.406991+0000","last_undegraded":"2024-09-12T17:57:59.406991+0000","last_fullsized":"2024-09-12T17:57:59.406991+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:07.460645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.400786+0000","last_change":"2024-09-12T17:40:30.426133+0000","last_active":"2024-09-12T17:57:28.400786+0000","last_peered":"2024-09-12T17:57:28.400786+0000","last_clean":"2024-09-12T17:57:28.400786+0000","last_became_active":"2024-09-12T17:40:30.425845+0000","last_became_peered":"2024-09-12T17:40:30.425845+0000","last_unstale":"2024-09-12T17:57:28.400786+0000","last_undegraded":"2024-09-12T17:57:28.400786+0000","last_fullsized":"2024-09-12T17:57:28.400786+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:39.872124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"261'10","reported_seq":63,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418105+0000","last_change":"2024-09-12T17:40:27.383205+0000","last_active":"2024-09-12T17:59:14.418105+0000","last_peered":"2024-09-12T17:59:14.418105+0000","last_clean":"2024-09-12T17:59:14.418105+0000","last_became_active":"2024-09-12T17:40:27.382833+0000","last_became_peered":"2024-09-12T17:40:27.382833+0000","last_unstale":"2024-09-12T17:59:14.418105+0000","last_undegraded":"2024-09-12T17:59:14.418105+0000","last_fullsized":"2024-09-12T17:59:14.418105+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:27.606242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":32770,"num_write":15,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"261'60","reported_seq":203,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537248+0000","last_change":"2024-09-12T17:38:51.214569+0000","last_active":"2024-09-12T17:58:14.537248+0000","last_peered":"2024-09-12T17:58:14.537248+0000","last_clean":"2024-09-12T17:58:14.537248+0000","last_became_active":"2024-09-12T17:38:51.214274+0000","last_became_peered":"2024-09-12T17:38:51.214274+0000","last_unstale":"2024-09-12T17:58:14.537248+0000","last_undegraded":"2024-09-12T17:58:14.537248+0000","last_fullsized":"2024-09-12T17:58:14.537248+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:23.016284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":211,"num_write":107,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:58.608464+0000","last_change":"2024-09-12T17:50:58.426819+0000","last_active":"2024-09-12T17:57:58.608464+0000","last_peered":"2024-09-12T17:57:58.608464+0000","last_clean":"2024-09-12T17:57:58.608464+0000","last_became_active":"2024-09-12T17:50:58.426537+0000","last_became_peered":"2024-09-12T17:50:58.426537+0000","last_unstale":"2024-09-12T17:57:58.608464+0000","last_undegraded":"2024-09-12T17:57:58.608464+0000","last_fullsized":"2024-09-12T17:57:58.608464+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.965601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"261'7","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:18.417452+0000","last_change":"2024-09-12T17:40:30.427100+0000","last_active":"2024-09-12T17:59:18.417452+0000","last_peered":"2024-09-12T17:59:18.417452+0000","last_clean":"2024-09-12T17:59:18.417452+0000","last_became_active":"2024-09-12T17:40:30.425368+0000","last_became_peered":"2024-09-12T17:40:30.425368+0000","last_unstale":"2024-09-12T17:59:18.417452+0000","last_undegraded":"2024-09-12T17:59:18.417452+0000","last_fullsized":"2024-09-12T17:59:18.417452+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:47.929671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:24.403574+0000","last_change":"2024-09-12T17:40:27.380566+0000","last_active":"2024-09-12T17:57:24.403574+0000","last_peered":"2024-09-12T17:57:24.403574+0000","last_clean":"2024-09-12T17:57:24.403574+0000","last_became_active":"2024-09-12T17:40:27.380228+0000","last_became_peered":"2024-09-12T17:40:27.380228+0000","last_unstale":"2024-09-12T17:57:24.403574+0000","last_undegraded":"2024-09-12T17:57:24.403574+0000","last_fullsized":"2024-09-12T17:57:24.403574+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:05.600168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"261'21","reported_seq":99,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.495658+0000","last_change":"2024-09-12T17:38:51.218671+0000","last_active":"2024-09-12T17:59:15.495658+0000","last_peered":"2024-09-12T17:59:15.495658+0000","last_clean":"2024-09-12T17:59:15.495658+0000","last_became_active":"2024-09-12T17:38:51.218309+0000","last_became_peered":"2024-09-12T17:38:51.218309+0000","last_unstale":"2024-09-12T17:59:15.495658+0000","last_undegraded":"2024-09-12T17:59:15.495658+0000","last_fullsized":"2024-09-12T17:59:15.495658+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:45.726103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.408378+0000","last_change":"2024-09-12T17:50:58.425291+0000","last_active":"2024-09-12T17:57:59.408378+0000","last_peered":"2024-09-12T17:57:59.408378+0000","last_clean":"2024-09-12T17:57:59.408378+0000","last_became_active":"2024-09-12T17:50:58.425003+0000","last_became_peered":"2024-09-12T17:50:58.425003+0000","last_unstale":"2024-09-12T17:57:59.408378+0000","last_undegraded":"2024-09-12T17:57:59.408378+0000","last_fullsized":"2024-09-12T17:57:59.408378+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:33.694791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"261'2","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.400828+0000","last_change":"2024-09-12T17:40:30.427105+0000","last_active":"2024-09-12T17:57:28.400828+0000","last_peered":"2024-09-12T17:57:28.400828+0000","last_clean":"2024-09-12T17:57:28.400828+0000","last_became_active":"2024-09-12T17:40:30.426714+0000","last_became_peered":"2024-09-12T17:40:30.426714+0000","last_unstale":"2024-09-12T17:57:28.400828+0000","last_undegraded":"2024-09-12T17:57:28.400828+0000","last_fullsized":"2024-09-12T17:57:28.400828+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:21.352761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:23.603864+0000","last_change":"2024-09-12T17:40:27.382447+0000","last_active":"2024-09-12T17:57:23.603864+0000","last_peered":"2024-09-12T17:57:23.603864+0000","last_clean":"2024-09-12T17:57:23.603864+0000","last_became_active":"2024-09-12T17:40:27.382132+0000","last_became_peered":"2024-09-12T17:40:27.382132+0000","last_unstale":"2024-09-12T17:57:23.603864+0000","last_undegraded":"2024-09-12T17:57:23.603864+0000","last_fullsized":"2024-09-12T17:57:23.603864+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:38.796258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"261'28","reported_seq":122,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.610428+0000","last_change":"2024-09-12T17:38:51.215254+0000","last_active":"2024-09-12T17:58:13.610428+0000","last_peered":"2024-09-12T17:58:13.610428+0000","last_clean":"2024-09-12T17:58:13.610428+0000","last_became_active":"2024-09-12T17:38:51.214963+0000","last_became_peered":"2024-09-12T17:38:51.214963+0000","last_unstale":"2024-09-12T17:58:13.610428+0000","last_undegraded":"2024-09-12T17:58:13.610428+0000","last_fullsized":"2024-09-12T17:58:13.610428+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:33.596786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":103,"num_write":58,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.407865+0000","last_change":"2024-09-12T17:50:58.427202+0000","last_active":"2024-09-12T17:57:59.407865+0000","last_peered":"2024-09-12T17:57:59.407865+0000","last_clean":"2024-09-12T17:57:59.407865+0000","last_became_active":"2024-09-12T17:50:58.426779+0000","last_became_peered":"2024-09-12T17:50:58.426779+0000","last_unstale":"2024-09-12T17:57:59.407865+0000","last_undegraded":"2024-09-12T17:57:59.407865+0000","last_fullsized":"2024-09-12T17:57:59.407865+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:56.570650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"258'6","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.404116+0000","last_change":"2024-09-12T17:40:30.419477+0000","last_active":"2024-09-12T17:57:29.404116+0000","last_peered":"2024-09-12T17:57:29.404116+0000","last_clean":"2024-09-12T17:57:29.404116+0000","last_became_active":"2024-09-12T17:40:30.419211+0000","last_became_peered":"2024-09-12T17:40:30.419211+0000","last_unstale":"2024-09-12T17:57:29.404116+0000","last_undegraded":"2024-09-12T17:57:29.404116+0000","last_fullsized":"2024-09-12T17:57:29.404116+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:06.524125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:24.529259+0000","last_change":"2024-09-12T17:40:27.382860+0000","last_active":"2024-09-12T17:57:24.529259+0000","last_peered":"2024-09-12T17:57:24.529259+0000","last_clean":"2024-09-12T17:57:24.529259+0000","last_became_active":"2024-09-12T17:40:27.382564+0000","last_became_peered":"2024-09-12T17:40:27.382564+0000","last_unstale":"2024-09-12T17:57:24.529259+0000","last_undegraded":"2024-09-12T17:57:24.529259+0000","last_fullsized":"2024-09-12T17:57:24.529259+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:37.855260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"261'12","reported_seq":75,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.405626+0000","last_change":"2024-09-12T17:38:51.215105+0000","last_active":"2024-09-12T17:57:39.405626+0000","last_peered":"2024-09-12T17:57:39.405626+0000","last_clean":"2024-09-12T17:57:39.405626+0000","last_became_active":"2024-09-12T17:38:51.214678+0000","last_became_peered":"2024-09-12T17:38:51.214678+0000","last_unstale":"2024-09-12T17:57:39.405626+0000","last_undegraded":"2024-09-12T17:57:39.405626+0000","last_fullsized":"2024-09-12T17:57:39.405626+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:23.825989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":38,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.407844+0000","last_change":"2024-09-12T17:50:58.427915+0000","last_active":"2024-09-12T17:58:13.407844+0000","last_peered":"2024-09-12T17:58:13.407844+0000","last_clean":"2024-09-12T17:58:13.407844+0000","last_became_active":"2024-09-12T17:50:58.427630+0000","last_became_peered":"2024-09-12T17:50:58.427630+0000","last_unstale":"2024-09-12T17:58:13.407844+0000","last_undegraded":"2024-09-12T17:58:13.407844+0000","last_fullsized":"2024-09-12T17:58:13.407844+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:54.698191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"261'12","reported_seq":64,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417124+0000","last_change":"2024-09-12T17:40:30.413875+0000","last_active":"2024-09-12T17:59:09.417124+0000","last_peered":"2024-09-12T17:59:09.417124+0000","last_clean":"2024-09-12T17:59:09.417124+0000","last_became_active":"2024-09-12T17:40:30.413592+0000","last_became_peered":"2024-09-12T17:40:30.413592+0000","last_unstale":"2024-09-12T17:59:09.417124+0000","last_undegraded":"2024-09-12T17:59:09.417124+0000","last_fullsized":"2024-09-12T17:59:09.417124+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:47.033025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":45058,"num_write":22,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'7","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417916+0000","last_change":"2024-09-12T17:40:27.382000+0000","last_active":"2024-09-12T17:59:09.417916+0000","last_peered":"2024-09-12T17:59:09.417916+0000","last_clean":"2024-09-12T17:59:09.417916+0000","last_became_active":"2024-09-12T17:40:27.381516+0000","last_became_peered":"2024-09-12T17:40:27.381516+0000","last_unstale":"2024-09-12T17:59:09.417916+0000","last_undegraded":"2024-09-12T17:59:09.417916+0000","last_fullsized":"2024-09-12T17:59:09.417916+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:48.416419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":32770,"num_write":7,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"261'6","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404930+0000","last_change":"2024-09-12T17:38:51.216019+0000","last_active":"2024-09-12T17:57:34.404930+0000","last_peered":"2024-09-12T17:57:34.404930+0000","last_clean":"2024-09-12T17:57:34.404930+0000","last_became_active":"2024-09-12T17:38:51.215646+0000","last_became_peered":"2024-09-12T17:38:51.215646+0000","last_unstale":"2024-09-12T17:57:34.404930+0000","last_undegraded":"2024-09-12T17:57:34.404930+0000","last_fullsized":"2024-09-12T17:57:34.404930+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:36.940207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537213+0000","last_change":"2024-09-12T17:50:58.423068+0000","last_active":"2024-09-12T17:58:14.537213+0000","last_peered":"2024-09-12T17:58:14.537213+0000","last_clean":"2024-09-12T17:58:14.537213+0000","last_became_active":"2024-09-12T17:50:58.422692+0000","last_became_peered":"2024-09-12T17:50:58.422692+0000","last_unstale":"2024-09-12T17:58:14.537213+0000","last_undegraded":"2024-09-12T17:58:14.537213+0000","last_fullsized":"2024-09-12T17:58:14.537213+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:51.624436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'2","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417077+0000","last_change":"2024-09-12T17:40:30.419235+0000","last_active":"2024-09-12T17:59:09.417077+0000","last_peered":"2024-09-12T17:59:09.417077+0000","last_clean":"2024-09-12T17:59:09.417077+0000","last_became_active":"2024-09-12T17:40:30.418904+0000","last_became_peered":"2024-09-12T17:40:30.418904+0000","last_unstale":"2024-09-12T17:59:09.417077+0000","last_undegraded":"2024-09-12T17:59:09.417077+0000","last_fullsized":"2024-09-12T17:59:09.417077+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:39.501098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.416187+0000","last_change":"2024-09-12T17:40:27.382156+0000","last_active":"2024-09-12T17:59:08.416187+0000","last_peered":"2024-09-12T17:59:08.416187+0000","last_clean":"2024-09-12T17:59:08.416187+0000","last_became_active":"2024-09-12T17:40:27.381849+0000","last_became_peered":"2024-09-12T17:40:27.381849+0000","last_unstale":"2024-09-12T17:59:08.416187+0000","last_undegraded":"2024-09-12T17:59:08.416187+0000","last_fullsized":"2024-09-12T17:59:08.416187+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:03.117165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"261'23","reported_seq":103,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:05.807493+0000","last_change":"2024-09-12T17:38:51.208118+0000","last_active":"2024-09-12T17:59:05.807493+0000","last_peered":"2024-09-12T17:59:05.807493+0000","last_clean":"2024-09-12T17:59:05.807493+0000","last_became_active":"2024-09-12T17:38:51.207804+0000","last_became_peered":"2024-09-12T17:38:51.207804+0000","last_unstale":"2024-09-12T17:59:05.807493+0000","last_undegraded":"2024-09-12T17:59:05.807493+0000","last_fullsized":"2024-09-12T17:59:05.807493+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:07.620875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":76,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.535062+0000","last_change":"2024-09-12T17:50:58.424688+0000","last_active":"2024-09-12T17:57:59.535062+0000","last_peered":"2024-09-12T17:57:59.535062+0000","last_clean":"2024-09-12T17:57:59.535062+0000","last_became_active":"2024-09-12T17:50:58.424379+0000","last_became_peered":"2024-09-12T17:50:58.424379+0000","last_unstale":"2024-09-12T17:57:59.535062+0000","last_undegraded":"2024-09-12T17:57:59.535062+0000","last_fullsized":"2024-09-12T17:57:59.535062+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:33.922718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:13.416845+0000","last_change":"2024-09-12T17:40:30.418399+0000","last_active":"2024-09-12T17:59:13.416845+0000","last_peered":"2024-09-12T17:59:13.416845+0000","last_clean":"2024-09-12T17:59:13.416845+0000","last_became_active":"2024-09-12T17:40:30.417111+0000","last_became_peered":"2024-09-12T17:40:30.417111+0000","last_unstale":"2024-09-12T17:59:13.416845+0000","last_undegraded":"2024-09-12T17:59:13.416845+0000","last_fullsized":"2024-09-12T17:59:13.416845+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:35.848674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415357+0000","last_change":"2024-09-12T17:40:27.378507+0000","last_active":"2024-09-12T17:59:09.415357+0000","last_peered":"2024-09-12T17:59:09.415357+0000","last_clean":"2024-09-12T17:59:09.415357+0000","last_became_active":"2024-09-12T17:40:27.378245+0000","last_became_peered":"2024-09-12T17:40:27.378245+0000","last_unstale":"2024-09-12T17:59:09.415357+0000","last_undegraded":"2024-09-12T17:59:09.415357+0000","last_fullsized":"2024-09-12T17:59:09.415357+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:43.060058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"261'38","reported_seq":153,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404752+0000","last_change":"2024-09-12T17:38:51.209261+0000","last_active":"2024-09-12T17:57:34.404752+0000","last_peered":"2024-09-12T17:57:34.404752+0000","last_clean":"2024-09-12T17:57:34.404752+0000","last_became_active":"2024-09-12T17:38:51.208950+0000","last_became_peered":"2024-09-12T17:38:51.208950+0000","last_unstale":"2024-09-12T17:57:34.404752+0000","last_undegraded":"2024-09-12T17:57:34.404752+0000","last_fullsized":"2024-09-12T17:57:34.404752+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:12.331668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":143,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.407814+0000","last_change":"2024-09-12T17:50:58.426040+0000","last_active":"2024-09-12T17:58:13.407814+0000","last_peered":"2024-09-12T17:58:13.407814+0000","last_clean":"2024-09-12T17:58:13.407814+0000","last_became_active":"2024-09-12T17:50:58.425574+0000","last_became_peered":"2024-09-12T17:50:58.425574+0000","last_unstale":"2024-09-12T17:58:13.407814+0000","last_undegraded":"2024-09-12T17:58:13.407814+0000","last_fullsized":"2024-09-12T17:58:13.407814+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:39.335745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.415906+0000","last_change":"2024-09-12T17:40:30.412045+0000","last_active":"2024-09-12T17:59:14.415906+0000","last_peered":"2024-09-12T17:59:14.415906+0000","last_clean":"2024-09-12T17:59:14.415906+0000","last_became_active":"2024-09-12T17:40:30.411737+0000","last_became_peered":"2024-09-12T17:40:30.411737+0000","last_unstale":"2024-09-12T17:59:14.415906+0000","last_undegraded":"2024-09-12T17:59:14.415906+0000","last_fullsized":"2024-09-12T17:59:14.415906+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:10.622751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417509+0000","last_change":"2024-09-12T17:40:27.372635+0000","last_active":"2024-09-12T17:59:09.417509+0000","last_peered":"2024-09-12T17:59:09.417509+0000","last_clean":"2024-09-12T17:59:09.417509+0000","last_became_active":"2024-09-12T17:40:27.372357+0000","last_became_peered":"2024-09-12T17:40:27.372357+0000","last_unstale":"2024-09-12T17:59:09.417509+0000","last_undegraded":"2024-09-12T17:59:09.417509+0000","last_fullsized":"2024-09-12T17:59:09.417509+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:34.828926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"261'42","reported_seq":150,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.401471+0000","last_change":"2024-09-12T17:38:51.208068+0000","last_active":"2024-09-12T17:57:33.401471+0000","last_peered":"2024-09-12T17:57:33.401471+0000","last_clean":"2024-09-12T17:57:33.401471+0000","last_became_active":"2024-09-12T17:38:51.207798+0000","last_became_peered":"2024-09-12T17:38:51.207798+0000","last_unstale":"2024-09-12T17:57:33.401471+0000","last_undegraded":"2024-09-12T17:57:33.401471+0000","last_fullsized":"2024-09-12T17:57:33.401471+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:58.346672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":137,"num_write":80,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.604511+0000","last_change":"2024-09-12T17:50:58.428924+0000","last_active":"2024-09-12T17:57:28.604511+0000","last_peered":"2024-09-12T17:57:28.604511+0000","last_clean":"2024-09-12T17:57:28.604511+0000","last_became_active":"2024-09-12T17:50:58.428339+0000","last_became_peered":"2024-09-12T17:50:58.428339+0000","last_unstale":"2024-09-12T17:57:28.604511+0000","last_undegraded":"2024-09-12T17:57:28.604511+0000","last_fullsized":"2024-09-12T17:57:28.604511+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:46.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411146+0000","last_change":"2024-09-12T17:40:30.417879+0000","last_active":"2024-09-12T17:58:33.411146+0000","last_peered":"2024-09-12T17:58:33.411146+0000","last_clean":"2024-09-12T17:58:33.411146+0000","last_became_active":"2024-09-12T17:40:30.417583+0000","last_became_peered":"2024-09-12T17:40:30.417583+0000","last_unstale":"2024-09-12T17:58:33.411146+0000","last_undegraded":"2024-09-12T17:58:33.411146+0000","last_fullsized":"2024-09-12T17:58:33.411146+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:57.147303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"258'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412848+0000","last_change":"2024-09-12T17:40:27.381338+0000","last_active":"2024-09-12T17:58:29.412848+0000","last_peered":"2024-09-12T17:58:29.412848+0000","last_clean":"2024-09-12T17:58:29.412848+0000","last_became_active":"2024-09-12T17:40:27.381027+0000","last_became_peered":"2024-09-12T17:40:27.381027+0000","last_unstale":"2024-09-12T17:58:29.412848+0000","last_undegraded":"2024-09-12T17:58:29.412848+0000","last_fullsized":"2024-09-12T17:58:29.412848+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:16.850258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"261'21","reported_seq":98,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.254313+0000","last_change":"2024-09-12T17:38:51.207794+0000","last_active":"2024-09-12T17:59:54.254313+0000","last_peered":"2024-09-12T17:59:54.254313+0000","last_clean":"2024-09-12T17:59:54.254313+0000","last_became_active":"2024-09-12T17:38:51.207487+0000","last_became_peered":"2024-09-12T17:38:51.207487+0000","last_unstale":"2024-09-12T17:59:54.254313+0000","last_undegraded":"2024-09-12T17:59:54.254313+0000","last_fullsized":"2024-09-12T17:59:54.254313+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:45.756120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":66,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:44.406393+0000","last_change":"2024-09-12T17:50:58.431273+0000","last_active":"2024-09-12T17:57:44.406393+0000","last_peered":"2024-09-12T17:57:44.406393+0000","last_clean":"2024-09-12T17:57:44.406393+0000","last_became_active":"2024-09-12T17:50:58.430797+0000","last_became_peered":"2024-09-12T17:50:58.430797+0000","last_unstale":"2024-09-12T17:57:44.406393+0000","last_undegraded":"2024-09-12T17:57:44.406393+0000","last_fullsized":"2024-09-12T17:57:44.406393+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:24.280950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"261'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411117+0000","last_change":"2024-09-12T17:40:30.417952+0000","last_active":"2024-09-12T17:58:33.411117+0000","last_peered":"2024-09-12T17:58:33.411117+0000","last_clean":"2024-09-12T17:58:33.411117+0000","last_became_active":"2024-09-12T17:40:30.417567+0000","last_became_peered":"2024-09-12T17:40:30.417567+0000","last_unstale":"2024-09-12T17:58:33.411117+0000","last_undegraded":"2024-09-12T17:58:33.411117+0000","last_fullsized":"2024-09-12T17:58:33.411117+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:56.583902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"261'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612267+0000","last_change":"2024-09-12T17:40:27.384850+0000","last_active":"2024-09-12T17:58:28.612267+0000","last_peered":"2024-09-12T17:58:28.612267+0000","last_clean":"2024-09-12T17:58:28.612267+0000","last_became_active":"2024-09-12T17:40:27.384579+0000","last_became_peered":"2024-09-12T17:40:27.384579+0000","last_unstale":"2024-09-12T17:58:28.612267+0000","last_undegraded":"2024-09-12T17:58:28.612267+0000","last_fullsized":"2024-09-12T17:58:28.612267+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:22.573347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":11264,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"261'7","reported_seq":61,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417568+0000","last_change":"2024-09-12T17:38:51.215867+0000","last_active":"2024-09-12T17:59:09.417568+0000","last_peered":"2024-09-12T17:59:09.417568+0000","last_clean":"2024-09-12T17:59:09.417568+0000","last_became_active":"2024-09-12T17:38:51.215590+0000","last_became_peered":"2024-09-12T17:38:51.215590+0000","last_unstale":"2024-09-12T17:59:09.417568+0000","last_undegraded":"2024-09-12T17:59:09.417568+0000","last_fullsized":"2024-09-12T17:59:09.417568+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:33.602009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.418983+0000","last_change":"2024-09-12T17:50:58.427213+0000","last_active":"2024-09-12T17:59:39.418983+0000","last_peered":"2024-09-12T17:59:39.418983+0000","last_clean":"2024-09-12T17:59:39.418983+0000","last_became_active":"2024-09-12T17:50:58.426867+0000","last_became_peered":"2024-09-12T17:50:58.426867+0000","last_unstale":"2024-09-12T17:59:39.418983+0000","last_undegraded":"2024-09-12T17:59:39.418983+0000","last_fullsized":"2024-09-12T17:59:39.418983+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:34.833083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"261'2","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:34.412127+0000","last_change":"2024-09-12T17:40:30.426091+0000","last_active":"2024-09-12T17:58:34.412127+0000","last_peered":"2024-09-12T17:58:34.412127+0000","last_clean":"2024-09-12T17:58:34.412127+0000","last_became_active":"2024-09-12T17:40:30.425775+0000","last_became_peered":"2024-09-12T17:40:30.425775+0000","last_unstale":"2024-09-12T17:58:34.412127+0000","last_undegraded":"2024-09-12T17:58:34.412127+0000","last_fullsized":"2024-09-12T17:58:34.412127+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:32.790479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.539586+0000","last_change":"2024-09-12T17:40:27.382194+0000","last_active":"2024-09-12T17:58:29.539586+0000","last_peered":"2024-09-12T17:58:29.539586+0000","last_clean":"2024-09-12T17:58:29.539586+0000","last_became_active":"2024-09-12T17:40:27.381918+0000","last_became_peered":"2024-09-12T17:40:27.381918+0000","last_unstale":"2024-09-12T17:58:29.539586+0000","last_undegraded":"2024-09-12T17:58:29.539586+0000","last_fullsized":"2024-09-12T17:58:29.539586+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:18.545363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"261'43","reported_seq":159,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415390+0000","last_change":"2024-09-12T17:38:51.209399+0000","last_active":"2024-09-12T17:59:09.415390+0000","last_peered":"2024-09-12T17:59:09.415390+0000","last_clean":"2024-09-12T17:59:09.415390+0000","last_became_active":"2024-09-12T17:38:51.209135+0000","last_became_peered":"2024-09-12T17:38:51.209135+0000","last_unstale":"2024-09-12T17:59:09.415390+0000","last_undegraded":"2024-09-12T17:59:09.415390+0000","last_fullsized":"2024-09-12T17:59:09.415390+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:55.234380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":150,"num_write":83,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.422143+0000","last_change":"2024-09-12T17:50:58.431873+0000","last_active":"2024-09-12T17:59:39.422143+0000","last_peered":"2024-09-12T17:59:39.422143+0000","last_clean":"2024-09-12T17:59:39.422143+0000","last_became_active":"2024-09-12T17:50:58.431587+0000","last_became_peered":"2024-09-12T17:50:58.431587+0000","last_unstale":"2024-09-12T17:59:39.422143+0000","last_undegraded":"2024-09-12T17:59:39.422143+0000","last_fullsized":"2024-09-12T17:59:39.422143+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:06.651931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411161+0000","last_change":"2024-09-12T17:40:30.418372+0000","last_active":"2024-09-12T17:58:33.411161+0000","last_peered":"2024-09-12T17:58:33.411161+0000","last_clean":"2024-09-12T17:58:33.411161+0000","last_became_active":"2024-09-12T17:40:30.417998+0000","last_became_peered":"2024-09-12T17:40:30.417998+0000","last_unstale":"2024-09-12T17:58:33.411161+0000","last_undegraded":"2024-09-12T17:58:33.411161+0000","last_fullsized":"2024-09-12T17:58:33.411161+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:45.170209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:34.412106+0000","last_change":"2024-09-12T17:40:27.374835+0000","last_active":"2024-09-12T17:58:34.412106+0000","last_peered":"2024-09-12T17:58:34.412106+0000","last_clean":"2024-09-12T17:58:34.412106+0000","last_became_active":"2024-09-12T17:40:27.374557+0000","last_became_peered":"2024-09-12T17:40:27.374557+0000","last_unstale":"2024-09-12T17:58:34.412106+0000","last_undegraded":"2024-09-12T17:58:34.412106+0000","last_fullsized":"2024-09-12T17:58:34.412106+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:19.232907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"261'32","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.084012+0000","last_change":"2024-09-12T17:38:51.216521+0000","last_active":"2024-09-12T17:59:54.084012+0000","last_peered":"2024-09-12T17:59:54.084012+0000","last_clean":"2024-09-12T17:59:54.084012+0000","last_became_active":"2024-09-12T17:38:51.216209+0000","last_became_peered":"2024-09-12T17:38:51.216209+0000","last_unstale":"2024-09-12T17:59:54.084012+0000","last_undegraded":"2024-09-12T17:59:54.084012+0000","last_fullsized":"2024-09-12T17:59:54.084012+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:23.694199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":109,"num_write":55,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:43.403198+0000","last_change":"2024-09-12T17:50:58.425019+0000","last_active":"2024-09-12T17:57:43.403198+0000","last_peered":"2024-09-12T17:57:43.403198+0000","last_clean":"2024-09-12T17:57:43.403198+0000","last_became_active":"2024-09-12T17:50:58.424452+0000","last_became_peered":"2024-09-12T17:50:58.424452+0000","last_unstale":"2024-09-12T17:57:43.403198+0000","last_undegraded":"2024-09-12T17:57:43.403198+0000","last_fullsized":"2024-09-12T17:57:43.403198+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:27.439096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.407560+0000","last_change":"2024-09-12T17:40:30.418941+0000","last_active":"2024-09-12T17:57:54.407560+0000","last_peered":"2024-09-12T17:57:54.407560+0000","last_clean":"2024-09-12T17:57:54.407560+0000","last_became_active":"2024-09-12T17:40:30.418650+0000","last_became_peered":"2024-09-12T17:40:30.418650+0000","last_unstale":"2024-09-12T17:57:54.407560+0000","last_undegraded":"2024-09-12T17:57:54.407560+0000","last_fullsized":"2024-09-12T17:57:54.407560+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:20.881248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"258'8","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.533425+0000","last_change":"2024-09-12T17:40:27.385454+0000","last_active":"2024-09-12T17:57:49.533425+0000","last_peered":"2024-09-12T17:57:49.533425+0000","last_clean":"2024-09-12T17:57:49.533425+0000","last_became_active":"2024-09-12T17:40:27.385081+0000","last_became_peered":"2024-09-12T17:40:27.385081+0000","last_unstale":"2024-09-12T17:57:49.533425+0000","last_undegraded":"2024-09-12T17:57:49.533425+0000","last_fullsized":"2024-09-12T17:57:49.533425+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:10.053553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"261'37","reported_seq":148,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.545191+0000","last_change":"2024-09-12T17:38:51.209424+0000","last_active":"2024-09-12T17:59:09.545191+0000","last_peered":"2024-09-12T17:59:09.545191+0000","last_clean":"2024-09-12T17:59:09.545191+0000","last_became_active":"2024-09-12T17:38:51.208861+0000","last_became_peered":"2024-09-12T17:38:51.208861+0000","last_unstale":"2024-09-12T17:59:09.545191+0000","last_undegraded":"2024-09-12T17:59:09.545191+0000","last_fullsized":"2024-09-12T17:59:09.545191+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:00.098063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":141,"num_write":67,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.407163+0000","last_change":"2024-09-12T17:50:58.432996+0000","last_active":"2024-09-12T17:57:49.407163+0000","last_peered":"2024-09-12T17:57:49.407163+0000","last_clean":"2024-09-12T17:57:49.407163+0000","last_became_active":"2024-09-12T17:50:58.432245+0000","last_became_peered":"2024-09-12T17:50:58.432245+0000","last_unstale":"2024-09-12T17:57:49.407163+0000","last_undegraded":"2024-09-12T17:57:49.407163+0000","last_fullsized":"2024-09-12T17:57:49.407163+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:12.784598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"258'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.407705+0000","last_change":"2024-09-12T17:40:30.425572+0000","last_active":"2024-09-12T17:57:54.407705+0000","last_peered":"2024-09-12T17:57:54.407705+0000","last_clean":"2024-09-12T17:57:54.407705+0000","last_became_active":"2024-09-12T17:40:30.425293+0000","last_became_peered":"2024-09-12T17:40:30.425293+0000","last_unstale":"2024-09-12T17:57:54.407705+0000","last_undegraded":"2024-09-12T17:57:54.407705+0000","last_fullsized":"2024-09-12T17:57:54.407705+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:39.090717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.405494+0000","last_change":"2024-09-12T17:40:27.377071+0000","last_active":"2024-09-12T17:57:49.405494+0000","last_peered":"2024-09-12T17:57:49.405494+0000","last_clean":"2024-09-12T17:57:49.405494+0000","last_became_active":"2024-09-12T17:40:27.376781+0000","last_became_peered":"2024-09-12T17:40:27.376781+0000","last_unstale":"2024-09-12T17:57:49.405494+0000","last_undegraded":"2024-09-12T17:57:49.405494+0000","last_fullsized":"2024-09-12T17:57:49.405494+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:17.637845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412794+0000","last_change":"2024-09-12T17:38:51.210062+0000","last_active":"2024-09-12T17:58:29.412794+0000","last_peered":"2024-09-12T17:58:29.412794+0000","last_clean":"2024-09-12T17:58:29.412794+0000","last_became_active":"2024-09-12T17:38:51.209772+0000","last_became_peered":"2024-09-12T17:38:51.209772+0000","last_unstale":"2024-09-12T17:58:29.412794+0000","last_undegraded":"2024-09-12T17:58:29.412794+0000","last_fullsized":"2024-09-12T17:58:29.412794+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:25.124534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:44.406424+0000","last_change":"2024-09-12T17:50:58.429816+0000","last_active":"2024-09-12T17:57:44.406424+0000","last_peered":"2024-09-12T17:57:44.406424+0000","last_clean":"2024-09-12T17:57:44.406424+0000","last_became_active":"2024-09-12T17:50:58.429551+0000","last_became_peered":"2024-09-12T17:50:58.429551+0000","last_unstale":"2024-09-12T17:57:44.406424+0000","last_undegraded":"2024-09-12T17:57:44.406424+0000","last_fullsized":"2024-09-12T17:57:44.406424+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:25.259007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'6","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.411292+0000","last_change":"2024-09-12T17:40:30.409389+0000","last_active":"2024-09-12T17:58:29.411292+0000","last_peered":"2024-09-12T17:58:29.411292+0000","last_clean":"2024-09-12T17:58:29.411292+0000","last_became_active":"2024-09-12T17:40:30.408915+0000","last_became_peered":"2024-09-12T17:40:30.408915+0000","last_unstale":"2024-09-12T17:58:29.411292+0000","last_undegraded":"2024-09-12T17:58:29.411292+0000","last_fullsized":"2024-09-12T17:58:29.411292+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:56.865653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25606,"num_write":11,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"258'3","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.533461+0000","last_change":"2024-09-12T17:40:27.382211+0000","last_active":"2024-09-12T17:57:49.533461+0000","last_peered":"2024-09-12T17:57:49.533461+0000","last_clean":"2024-09-12T17:57:49.533461+0000","last_became_active":"2024-09-12T17:40:27.381885+0000","last_became_peered":"2024-09-12T17:40:27.381885+0000","last_unstale":"2024-09-12T17:57:49.533461+0000","last_undegraded":"2024-09-12T17:57:49.533461+0000","last_fullsized":"2024-09-12T17:57:49.533461+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:52.579087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"261'68","reported_seq":231,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.409354+0000","last_change":"2024-09-12T17:38:51.215246+0000","last_active":"2024-09-12T17:58:23.409354+0000","last_peered":"2024-09-12T17:58:23.409354+0000","last_clean":"2024-09-12T17:58:23.409354+0000","last_became_active":"2024-09-12T17:38:51.214940+0000","last_became_peered":"2024-09-12T17:38:51.214940+0000","last_unstale":"2024-09-12T17:58:23.409354+0000","last_undegraded":"2024-09-12T17:58:23.409354+0000","last_fullsized":"2024-09-12T17:58:23.409354+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:11.305564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":356,"num_read_kb":250,"num_write":117,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:44.532653+0000","last_change":"2024-09-12T17:50:58.421234+0000","last_active":"2024-09-12T17:57:44.532653+0000","last_peered":"2024-09-12T17:57:44.532653+0000","last_clean":"2024-09-12T17:57:44.532653+0000","last_became_active":"2024-09-12T17:50:58.420251+0000","last_became_peered":"2024-09-12T17:50:58.420251+0000","last_unstale":"2024-09-12T17:57:44.532653+0000","last_undegraded":"2024-09-12T17:57:44.532653+0000","last_fullsized":"2024-09-12T17:57:44.532653+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:17.481915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"258'7","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.408453+0000","last_change":"2024-09-12T17:40:30.417703+0000","last_active":"2024-09-12T17:57:59.408453+0000","last_peered":"2024-09-12T17:57:59.408453+0000","last_clean":"2024-09-12T17:57:59.408453+0000","last_became_active":"2024-09-12T17:40:30.417393+0000","last_became_peered":"2024-09-12T17:40:30.417393+0000","last_unstale":"2024-09-12T17:57:59.408453+0000","last_undegraded":"2024-09-12T17:57:59.408453+0000","last_fullsized":"2024-09-12T17:57:59.408453+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:40.700927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":7,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'1","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412637+0000","last_change":"2024-09-12T17:40:27.379736+0000","last_active":"2024-09-12T17:58:29.412637+0000","last_peered":"2024-09-12T17:58:29.412637+0000","last_clean":"2024-09-12T17:58:29.412637+0000","last_became_active":"2024-09-12T17:40:27.379472+0000","last_became_peered":"2024-09-12T17:40:27.379472+0000","last_unstale":"2024-09-12T17:58:29.412637+0000","last_undegraded":"2024-09-12T17:58:29.412637+0000","last_fullsized":"2024-09-12T17:58:29.412637+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:36.186301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"261'106","reported_seq":366,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.408959+0000","last_change":"2024-09-12T17:38:51.208031+0000","last_active":"2024-09-12T17:58:24.408959+0000","last_peered":"2024-09-12T17:58:24.408959+0000","last_clean":"2024-09-12T17:58:24.408959+0000","last_became_active":"2024-09-12T17:38:51.207735+0000","last_became_peered":"2024-09-12T17:38:51.207735+0000","last_unstale":"2024-09-12T17:58:24.408959+0000","last_undegraded":"2024-09-12T17:58:24.408959+0000","last_fullsized":"2024-09-12T17:58:24.408959+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:15.007282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":541,"num_write":122,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419330+0000","last_change":"2024-09-12T17:50:58.431116+0000","last_active":"2024-09-12T17:59:19.419330+0000","last_peered":"2024-09-12T17:59:19.419330+0000","last_clean":"2024-09-12T17:59:19.419330+0000","last_became_active":"2024-09-12T17:50:58.430813+0000","last_became_peered":"2024-09-12T17:50:58.430813+0000","last_unstale":"2024-09-12T17:59:19.419330+0000","last_undegraded":"2024-09-12T17:59:19.419330+0000","last_fullsized":"2024-09-12T17:59:19.419330+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:19.189927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546398+0000","last_change":"2024-09-12T17:40:30.411164+0000","last_active":"2024-09-12T17:59:19.546398+0000","last_peered":"2024-09-12T17:59:19.546398+0000","last_clean":"2024-09-12T17:59:19.546398+0000","last_became_active":"2024-09-12T17:40:30.410872+0000","last_became_peered":"2024-09-12T17:40:30.410872+0000","last_unstale":"2024-09-12T17:59:19.546398+0000","last_undegraded":"2024-09-12T17:59:19.546398+0000","last_fullsized":"2024-09-12T17:59:19.546398+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:47.603677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'1","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418811+0000","last_change":"2024-09-12T17:40:27.380593+0000","last_active":"2024-09-12T17:59:14.418811+0000","last_peered":"2024-09-12T17:59:14.418811+0000","last_clean":"2024-09-12T17:59:14.418811+0000","last_became_active":"2024-09-12T17:40:27.380269+0000","last_became_peered":"2024-09-12T17:40:27.380269+0000","last_unstale":"2024-09-12T17:59:14.418811+0000","last_undegraded":"2024-09-12T17:59:14.418811+0000","last_fullsized":"2024-09-12T17:59:14.418811+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:52.967809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60361,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"261'42","reported_seq":157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.023193+0000","last_change":"2024-09-12T17:38:51.216559+0000","last_active":"2024-09-12T17:59:16.023193+0000","last_peered":"2024-09-12T17:59:16.023193+0000","last_clean":"2024-09-12T17:59:16.023193+0000","last_became_active":"2024-09-12T17:38:51.216152+0000","last_became_peered":"2024-09-12T17:38:51.216152+0000","last_unstale":"2024-09-12T17:59:16.023193+0000","last_undegraded":"2024-09-12T17:59:16.023193+0000","last_fullsized":"2024-09-12T17:59:16.023193+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:42.821025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":152,"num_write":74,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.418727+0000","last_change":"2024-09-12T17:50:58.431015+0000","last_active":"2024-09-12T17:59:19.418727+0000","last_peered":"2024-09-12T17:59:19.418727+0000","last_clean":"2024-09-12T17:59:19.418727+0000","last_became_active":"2024-09-12T17:50:58.430723+0000","last_became_peered":"2024-09-12T17:50:58.430723+0000","last_unstale":"2024-09-12T17:59:19.418727+0000","last_undegraded":"2024-09-12T17:59:19.418727+0000","last_fullsized":"2024-09-12T17:59:19.418727+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:21.663778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"261'1","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546384+0000","last_change":"2024-09-12T17:40:30.425667+0000","last_active":"2024-09-12T17:59:19.546384+0000","last_peered":"2024-09-12T17:59:19.546384+0000","last_clean":"2024-09-12T17:59:19.546384+0000","last_became_active":"2024-09-12T17:40:30.425368+0000","last_became_peered":"2024-09-12T17:40:30.425368+0000","last_unstale":"2024-09-12T17:59:19.546384+0000","last_undegraded":"2024-09-12T17:59:19.546384+0000","last_fullsized":"2024-09-12T17:59:19.546384+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:57.448155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3212,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:13.618170+0000","last_change":"2024-09-12T17:40:27.384113+0000","last_active":"2024-09-12T17:59:13.618170+0000","last_peered":"2024-09-12T17:59:13.618170+0000","last_clean":"2024-09-12T17:59:13.618170+0000","last_became_active":"2024-09-12T17:40:27.383770+0000","last_became_peered":"2024-09-12T17:40:27.383770+0000","last_unstale":"2024-09-12T17:59:13.618170+0000","last_undegraded":"2024-09-12T17:59:13.618170+0000","last_fullsized":"2024-09-12T17:59:13.618170+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:34.294441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"258'22","reported_seq":108,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.409051+0000","last_change":"2024-09-12T17:38:51.209047+0000","last_active":"2024-09-12T17:58:24.409051+0000","last_peered":"2024-09-12T17:58:24.409051+0000","last_clean":"2024-09-12T17:58:24.409051+0000","last_became_active":"2024-09-12T17:38:51.208767+0000","last_became_peered":"2024-09-12T17:38:51.208767+0000","last_unstale":"2024-09-12T17:58:24.409051+0000","last_undegraded":"2024-09-12T17:58:24.409051+0000","last_fullsized":"2024-09-12T17:58:24.409051+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:21.421941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:04.416155+0000","last_change":"2024-09-12T17:50:58.422944+0000","last_active":"2024-09-12T17:59:04.416155+0000","last_peered":"2024-09-12T17:59:04.416155+0000","last_clean":"2024-09-12T17:59:04.416155+0000","last_became_active":"2024-09-12T17:50:58.422625+0000","last_became_peered":"2024-09-12T17:50:58.422625+0000","last_unstale":"2024-09-12T17:59:04.416155+0000","last_undegraded":"2024-09-12T17:59:04.416155+0000","last_fullsized":"2024-09-12T17:59:04.416155+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:04.987349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"258'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.407842+0000","last_change":"2024-09-12T17:40:30.425786+0000","last_active":"2024-09-12T17:57:54.407842+0000","last_peered":"2024-09-12T17:57:54.407842+0000","last_clean":"2024-09-12T17:57:54.407842+0000","last_became_active":"2024-09-12T17:40:30.425536+0000","last_became_peered":"2024-09-12T17:40:30.425536+0000","last_unstale":"2024-09-12T17:57:54.407842+0000","last_undegraded":"2024-09-12T17:57:54.407842+0000","last_fullsized":"2024-09-12T17:57:54.407842+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:19.565868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"258'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.406415+0000","last_change":"2024-09-12T17:40:27.382099+0000","last_active":"2024-09-12T17:57:49.406415+0000","last_peered":"2024-09-12T17:57:49.406415+0000","last_clean":"2024-09-12T17:57:49.406415+0000","last_became_active":"2024-09-12T17:40:27.381818+0000","last_became_peered":"2024-09-12T17:40:27.381818+0000","last_unstale":"2024-09-12T17:57:49.406415+0000","last_undegraded":"2024-09-12T17:57:49.406415+0000","last_fullsized":"2024-09-12T17:57:49.406415+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:59.918995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"261'42","reported_seq":165,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:44.406455+0000","last_change":"2024-09-12T17:38:51.211565+0000","last_active":"2024-09-12T17:57:44.406455+0000","last_peered":"2024-09-12T17:57:44.406455+0000","last_clean":"2024-09-12T17:57:44.406455+0000","last_became_active":"2024-09-12T17:38:51.211219+0000","last_became_peered":"2024-09-12T17:38:51.211219+0000","last_unstale":"2024-09-12T17:57:44.406455+0000","last_undegraded":"2024-09-12T17:57:44.406455+0000","last_fullsized":"2024-09-12T17:57:44.406455+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:18.738642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":165,"num_write":70,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419044+0000","last_change":"2024-09-12T17:50:58.416892+0000","last_active":"2024-09-12T17:59:19.419044+0000","last_peered":"2024-09-12T17:59:19.419044+0000","last_clean":"2024-09-12T17:59:19.419044+0000","last_became_active":"2024-09-12T17:50:58.416501+0000","last_became_peered":"2024-09-12T17:50:58.416501+0000","last_unstale":"2024-09-12T17:59:19.419044+0000","last_undegraded":"2024-09-12T17:59:19.419044+0000","last_fullsized":"2024-09-12T17:59:19.419044+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:06.098567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"261'4","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.407686+0000","last_change":"2024-09-12T17:40:30.418747+0000","last_active":"2024-09-12T17:57:54.407686+0000","last_peered":"2024-09-12T17:57:54.407686+0000","last_clean":"2024-09-12T17:57:54.407686+0000","last_became_active":"2024-09-12T17:40:30.418418+0000","last_became_peered":"2024-09-12T17:40:30.418418+0000","last_unstale":"2024-09-12T17:57:54.407686+0000","last_undegraded":"2024-09-12T17:57:54.407686+0000","last_fullsized":"2024-09-12T17:57:54.407686+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:50.907324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.407185+0000","last_change":"2024-09-12T17:40:27.383455+0000","last_active":"2024-09-12T17:57:49.407185+0000","last_peered":"2024-09-12T17:57:49.407185+0000","last_clean":"2024-09-12T17:57:49.407185+0000","last_became_active":"2024-09-12T17:40:27.383023+0000","last_became_peered":"2024-09-12T17:40:27.383023+0000","last_unstale":"2024-09-12T17:57:49.407185+0000","last_undegraded":"2024-09-12T17:57:49.407185+0000","last_fullsized":"2024-09-12T17:57:49.407185+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:38.107217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"261'37","reported_seq":149,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.249331+0000","last_change":"2024-09-12T17:38:51.210126+0000","last_active":"2024-09-12T17:59:54.249331+0000","last_peered":"2024-09-12T17:59:54.249331+0000","last_clean":"2024-09-12T17:59:54.249331+0000","last_became_active":"2024-09-12T17:38:51.209833+0000","last_became_peered":"2024-09-12T17:38:51.209833+0000","last_unstale":"2024-09-12T17:59:54.249331+0000","last_undegraded":"2024-09-12T17:59:54.249331+0000","last_fullsized":"2024-09-12T17:59:54.249331+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:29.524821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":141,"num_write":58,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.621111+0000","last_change":"2024-09-12T17:50:58.424105+0000","last_active":"2024-09-12T17:59:38.621111+0000","last_peered":"2024-09-12T17:59:38.621111+0000","last_clean":"2024-09-12T17:59:38.621111+0000","last_became_active":"2024-09-12T17:50:58.423798+0000","last_became_peered":"2024-09-12T17:50:58.423798+0000","last_unstale":"2024-09-12T17:59:38.621111+0000","last_undegraded":"2024-09-12T17:59:38.621111+0000","last_fullsized":"2024-09-12T17:59:38.621111+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:57.214535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.417888+0000","last_change":"2024-09-12T17:40:30.412437+0000","last_active":"2024-09-12T17:59:14.417888+0000","last_peered":"2024-09-12T17:59:14.417888+0000","last_clean":"2024-09-12T17:59:14.417888+0000","last_became_active":"2024-09-12T17:40:30.412140+0000","last_became_peered":"2024-09-12T17:40:30.412140+0000","last_unstale":"2024-09-12T17:59:14.417888+0000","last_undegraded":"2024-09-12T17:59:14.417888+0000","last_fullsized":"2024-09-12T17:59:14.417888+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:44.020052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:34.413567+0000","last_change":"2024-09-12T17:40:27.385866+0000","last_active":"2024-09-12T17:58:34.413567+0000","last_peered":"2024-09-12T17:58:34.413567+0000","last_clean":"2024-09-12T17:58:34.413567+0000","last_became_active":"2024-09-12T17:40:27.385649+0000","last_became_peered":"2024-09-12T17:40:27.385649+0000","last_unstale":"2024-09-12T17:58:34.413567+0000","last_undegraded":"2024-09-12T17:58:34.413567+0000","last_fullsized":"2024-09-12T17:58:34.413567+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:44.080842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"258'14","reported_seq":85,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.422160+0000","last_change":"2024-09-12T17:38:51.216015+0000","last_active":"2024-09-12T17:59:44.422160+0000","last_peered":"2024-09-12T17:59:44.422160+0000","last_clean":"2024-09-12T17:59:44.422160+0000","last_became_active":"2024-09-12T17:38:51.215738+0000","last_became_peered":"2024-09-12T17:38:51.215738+0000","last_unstale":"2024-09-12T17:59:44.422160+0000","last_undegraded":"2024-09-12T17:59:44.422160+0000","last_fullsized":"2024-09-12T17:59:44.422160+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:22.857791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.549295+0000","last_change":"2024-09-12T17:50:58.423755+0000","last_active":"2024-09-12T17:59:39.549295+0000","last_peered":"2024-09-12T17:59:39.549295+0000","last_clean":"2024-09-12T17:59:39.549295+0000","last_became_active":"2024-09-12T17:50:58.423443+0000","last_became_peered":"2024-09-12T17:50:58.423443+0000","last_unstale":"2024-09-12T17:59:39.549295+0000","last_undegraded":"2024-09-12T17:59:39.549295+0000","last_fullsized":"2024-09-12T17:59:39.549295+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:21.905993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:34.412791+0000","last_change":"2024-09-12T17:40:30.415967+0000","last_active":"2024-09-12T17:58:34.412791+0000","last_peered":"2024-09-12T17:58:34.412791+0000","last_clean":"2024-09-12T17:58:34.412791+0000","last_became_active":"2024-09-12T17:40:30.415696+0000","last_became_peered":"2024-09-12T17:40:30.415696+0000","last_unstale":"2024-09-12T17:58:34.412791+0000","last_undegraded":"2024-09-12T17:58:34.412791+0000","last_fullsized":"2024-09-12T17:58:34.412791+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:00.615699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418738+0000","last_change":"2024-09-12T17:40:27.381415+0000","last_active":"2024-09-12T17:59:14.418738+0000","last_peered":"2024-09-12T17:59:14.418738+0000","last_clean":"2024-09-12T17:59:14.418738+0000","last_became_active":"2024-09-12T17:40:27.381128+0000","last_became_peered":"2024-09-12T17:40:27.381128+0000","last_unstale":"2024-09-12T17:59:14.418738+0000","last_undegraded":"2024-09-12T17:59:14.418738+0000","last_fullsized":"2024-09-12T17:59:14.418738+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:41.708551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"261'15","reported_seq":83,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.422414+0000","last_change":"2024-09-12T17:38:51.211542+0000","last_active":"2024-09-12T17:59:44.422414+0000","last_peered":"2024-09-12T17:59:44.422414+0000","last_clean":"2024-09-12T17:59:44.422414+0000","last_became_active":"2024-09-12T17:38:51.210741+0000","last_became_peered":"2024-09-12T17:38:51.210741+0000","last_unstale":"2024-09-12T17:59:44.422414+0000","last_undegraded":"2024-09-12T17:59:44.422414+0000","last_fullsized":"2024-09-12T17:59:44.422414+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:53.102160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":45,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546366+0000","last_change":"2024-09-12T17:50:58.422536+0000","last_active":"2024-09-12T17:59:19.546366+0000","last_peered":"2024-09-12T17:59:19.546366+0000","last_clean":"2024-09-12T17:59:19.546366+0000","last_became_active":"2024-09-12T17:50:58.422195+0000","last_became_peered":"2024-09-12T17:50:58.422195+0000","last_unstale":"2024-09-12T17:59:19.546366+0000","last_undegraded":"2024-09-12T17:59:19.546366+0000","last_fullsized":"2024-09-12T17:59:19.546366+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:53.708044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.416457+0000","last_change":"2024-09-12T17:40:30.418965+0000","last_active":"2024-09-12T17:59:19.416457+0000","last_peered":"2024-09-12T17:59:19.416457+0000","last_clean":"2024-09-12T17:59:19.416457+0000","last_became_active":"2024-09-12T17:40:30.418692+0000","last_became_peered":"2024-09-12T17:40:30.418692+0000","last_unstale":"2024-09-12T17:59:19.416457+0000","last_undegraded":"2024-09-12T17:59:19.416457+0000","last_fullsized":"2024-09-12T17:59:19.416457+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:04.962038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"258'6","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.417950+0000","last_change":"2024-09-12T17:40:27.377091+0000","last_active":"2024-09-12T17:59:14.417950+0000","last_peered":"2024-09-12T17:59:14.417950+0000","last_clean":"2024-09-12T17:59:14.417950+0000","last_became_active":"2024-09-12T17:40:27.376395+0000","last_became_peered":"2024-09-12T17:40:27.376395+0000","last_unstale":"2024-09-12T17:59:14.417950+0000","last_undegraded":"2024-09-12T17:59:14.417950+0000","last_fullsized":"2024-09-12T17:59:14.417950+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:00.248728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"261'24","reported_seq":110,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.419639+0000","last_change":"2024-09-12T17:38:51.213165+0000","last_active":"2024-09-12T17:59:44.419639+0000","last_peered":"2024-09-12T17:59:44.419639+0000","last_clean":"2024-09-12T17:59:44.419639+0000","last_became_active":"2024-09-12T17:38:51.212856+0000","last_became_peered":"2024-09-12T17:38:51.212856+0000","last_unstale":"2024-09-12T17:59:44.419639+0000","last_undegraded":"2024-09-12T17:59:44.419639+0000","last_fullsized":"2024-09-12T17:59:44.419639+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:17.393643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":83,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:24.420242+0000","last_change":"2024-09-12T17:50:58.431889+0000","last_active":"2024-09-12T17:59:24.420242+0000","last_peered":"2024-09-12T17:59:24.420242+0000","last_clean":"2024-09-12T17:59:24.420242+0000","last_became_active":"2024-09-12T17:50:58.431442+0000","last_became_peered":"2024-09-12T17:50:58.431442+0000","last_unstale":"2024-09-12T17:59:24.420242+0000","last_undegraded":"2024-09-12T17:59:24.420242+0000","last_fullsized":"2024-09-12T17:59:24.420242+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:40.014254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419070+0000","last_change":"2024-09-12T17:40:30.418760+0000","last_active":"2024-09-12T17:59:19.419070+0000","last_peered":"2024-09-12T17:59:19.419070+0000","last_clean":"2024-09-12T17:59:19.419070+0000","last_became_active":"2024-09-12T17:40:30.418464+0000","last_became_peered":"2024-09-12T17:40:30.418464+0000","last_unstale":"2024-09-12T17:59:19.419070+0000","last_undegraded":"2024-09-12T17:59:19.419070+0000","last_fullsized":"2024-09-12T17:59:19.419070+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:03.345502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"261'3","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.415954+0000","last_change":"2024-09-12T17:40:27.379405+0000","last_active":"2024-09-12T17:59:14.415954+0000","last_peered":"2024-09-12T17:59:14.415954+0000","last_clean":"2024-09-12T17:59:14.415954+0000","last_became_active":"2024-09-12T17:40:27.379133+0000","last_became_peered":"2024-09-12T17:40:27.379133+0000","last_unstale":"2024-09-12T17:59:14.415954+0000","last_undegraded":"2024-09-12T17:59:14.415954+0000","last_fullsized":"2024-09-12T17:59:14.415954+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:39.813640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246092,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":8,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"261'32","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.417100+0000","last_change":"2024-09-12T17:38:51.208801+0000","last_active":"2024-09-12T17:58:59.417100+0000","last_peered":"2024-09-12T17:58:59.417100+0000","last_clean":"2024-09-12T17:58:59.417100+0000","last_became_active":"2024-09-12T17:38:51.208386+0000","last_became_peered":"2024-09-12T17:38:51.208386+0000","last_unstale":"2024-09-12T17:58:59.417100+0000","last_undegraded":"2024-09-12T17:58:59.417100+0000","last_fullsized":"2024-09-12T17:58:59.417100+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:57.157726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":109,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"261'269","reported_seq":881,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.059607+0000","last_change":"2024-09-12T17:23:40.709230+0000","last_active":"2024-09-12T18:01:34.059607+0000","last_peered":"2024-09-12T18:01:34.059607+0000","last_clean":"2024-09-12T18:01:34.059607+0000","last_became_active":"2024-09-12T17:23:40.708951+0000","last_became_peered":"2024-09-12T17:23:40.708951+0000","last_unstale":"2024-09-12T18:01:34.059607+0000","last_undegraded":"2024-09-12T18:01:34.059607+0000","last_fullsized":"2024-09-12T18:01:34.059607+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:29.306708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7403571,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":399,"num_read_kb":4677,"num_write":1037,"num_write_kb":27229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"261'483","reported_seq":2010,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.776173+0000","last_change":"2024-09-12T17:23:42.147291+0000","last_active":"2024-09-12T18:00:15.776173+0000","last_peered":"2024-09-12T18:00:15.776173+0000","last_clean":"2024-09-12T18:00:15.776173+0000","last_became_active":"2024-09-12T17:23:42.146906+0000","last_became_peered":"2024-09-12T17:23:42.146906+0000","last_unstale":"2024-09-12T18:00:15.776173+0000","last_undegraded":"2024-09-12T18:00:15.776173+0000","last_fullsized":"2024-09-12T18:00:15.776173+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:47.049866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2345,"num_read_kb":2204,"num_write":541,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"261'326","reported_seq":999,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:53.431382+0000","last_change":"2024-09-12T17:23:40.720117+0000","last_active":"2024-09-12T17:59:53.431382+0000","last_peered":"2024-09-12T17:59:53.431382+0000","last_clean":"2024-09-12T17:59:53.431382+0000","last_became_active":"2024-09-12T17:23:40.719834+0000","last_became_peered":"2024-09-12T17:23:40.719834+0000","last_unstale":"2024-09-12T17:59:53.431382+0000","last_undegraded":"2024-09-12T17:59:53.431382+0000","last_fullsized":"2024-09-12T17:59:53.431382+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:08.528131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10874006,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":559,"num_read_kb":15949,"num_write":1128,"num_write_kb":28721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"261'473","reported_seq":2215,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.149339+0000","last_change":"2024-09-12T17:23:42.147555+0000","last_active":"2024-09-12T18:00:18.149339+0000","last_peered":"2024-09-12T18:00:18.149339+0000","last_clean":"2024-09-12T18:00:18.149339+0000","last_became_active":"2024-09-12T17:23:42.147270+0000","last_became_peered":"2024-09-12T17:23:42.147270+0000","last_unstale":"2024-09-12T18:00:18.149339+0000","last_undegraded":"2024-09-12T18:00:18.149339+0000","last_fullsized":"2024-09-12T18:00:18.149339+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:12.132659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3009,"num_read_kb":2866,"num_write":558,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"261'276","reported_seq":1074,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.520775+0000","last_change":"2024-09-12T17:23:40.702160+0000","last_active":"2024-09-12T18:01:49.520775+0000","last_peered":"2024-09-12T18:01:49.520775+0000","last_clean":"2024-09-12T18:01:49.520775+0000","last_became_active":"2024-09-12T17:23:40.701839+0000","last_became_peered":"2024-09-12T17:23:40.701839+0000","last_unstale":"2024-09-12T18:01:49.520775+0000","last_undegraded":"2024-09-12T18:01:49.520775+0000","last_fullsized":"2024-09-12T18:01:49.520775+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:27.896198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10652701,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":775,"num_read_kb":22445,"num_write":923,"num_write_kb":35081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"261'1193","reported_seq":2827,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.787881+0000","last_change":"2024-09-12T17:23:42.143316+0000","last_active":"2024-09-12T18:00:05.787881+0000","last_peered":"2024-09-12T18:00:05.787881+0000","last_clean":"2024-09-12T18:00:05.787881+0000","last_became_active":"2024-09-12T17:23:42.141845+0000","last_became_peered":"2024-09-12T17:23:42.141845+0000","last_unstale":"2024-09-12T18:00:05.787881+0000","last_undegraded":"2024-09-12T18:00:05.787881+0000","last_fullsized":"2024-09-12T18:00:05.787881+0000","mapping_epoch":25,"log_start":"261'1100","ondisk_log_start":"261'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":1100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:43.825593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5470,"num_read_kb":4840,"num_write":1657,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"261'317","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.947792+0000","last_change":"2024-09-12T17:23:40.713745+0000","last_active":"2024-09-12T18:01:36.947792+0000","last_peered":"2024-09-12T18:01:36.947792+0000","last_clean":"2024-09-12T18:01:36.947792+0000","last_became_active":"2024-09-12T17:23:40.712263+0000","last_became_peered":"2024-09-12T17:23:40.712263+0000","last_unstale":"2024-09-12T18:01:36.947792+0000","last_undegraded":"2024-09-12T18:01:36.947792+0000","last_fullsized":"2024-09-12T18:01:36.947792+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:37.480449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1082950,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":465,"num_read_kb":11567,"num_write":1170,"num_write_kb":26002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"261'1241","reported_seq":2921,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.777810+0000","last_change":"2024-09-12T17:23:42.158153+0000","last_active":"2024-09-12T18:00:15.777810+0000","last_peered":"2024-09-12T18:00:15.777810+0000","last_clean":"2024-09-12T18:00:15.777810+0000","last_became_active":"2024-09-12T17:23:42.157835+0000","last_became_peered":"2024-09-12T17:23:42.157835+0000","last_unstale":"2024-09-12T18:00:15.777810+0000","last_undegraded":"2024-09-12T18:00:15.777810+0000","last_fullsized":"2024-09-12T18:00:15.777810+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:20.923845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5656,"num_read_kb":5021,"num_write":1694,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"261'287","reported_seq":972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.627825+0000","last_change":"2024-09-12T17:23:40.706187+0000","last_active":"2024-09-12T17:59:58.627825+0000","last_peered":"2024-09-12T17:59:58.627825+0000","last_clean":"2024-09-12T17:59:58.627825+0000","last_became_active":"2024-09-12T17:23:40.705906+0000","last_became_peered":"2024-09-12T17:23:40.705906+0000","last_unstale":"2024-09-12T17:59:58.627825+0000","last_undegraded":"2024-09-12T17:59:58.627825+0000","last_fullsized":"2024-09-12T17:59:58.627825+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.975637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245706,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":607,"num_read_kb":37545,"num_write":1029,"num_write_kb":42867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"261'385","reported_seq":1824,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.566613+0000","last_change":"2024-09-12T17:23:42.142597+0000","last_active":"2024-09-12T18:00:04.566613+0000","last_peered":"2024-09-12T18:00:04.566613+0000","last_clean":"2024-09-12T18:00:04.566613+0000","last_became_active":"2024-09-12T17:23:42.142311+0000","last_became_peered":"2024-09-12T17:23:42.142311+0000","last_unstale":"2024-09-12T18:00:04.566613+0000","last_undegraded":"2024-09-12T18:00:04.566613+0000","last_fullsized":"2024-09-12T18:00:04.566613+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:25.262592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2045,"num_read_kb":1945,"num_write":422,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"261'326","reported_seq":1018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:57.367503+0000","last_change":"2024-09-12T17:23:40.705539+0000","last_active":"2024-09-12T17:59:57.367503+0000","last_peered":"2024-09-12T17:59:57.367503+0000","last_clean":"2024-09-12T17:59:57.367503+0000","last_became_active":"2024-09-12T17:23:40.705215+0000","last_became_peered":"2024-09-12T17:23:40.705215+0000","last_unstale":"2024-09-12T17:59:57.367503+0000","last_undegraded":"2024-09-12T17:59:57.367503+0000","last_fullsized":"2024-09-12T17:59:57.367503+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:33.336833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295144,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":707,"num_read_kb":26786,"num_write":1227,"num_write_kb":30822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"261'882","reported_seq":2676,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.911490+0000","last_change":"2024-09-12T17:23:42.143689+0000","last_active":"2024-09-12T17:59:59.911490+0000","last_peered":"2024-09-12T17:59:59.911490+0000","last_clean":"2024-09-12T17:59:59.911490+0000","last_became_active":"2024-09-12T17:23:42.143402+0000","last_became_peered":"2024-09-12T17:23:42.143402+0000","last_unstale":"2024-09-12T17:59:59.911490+0000","last_undegraded":"2024-09-12T17:59:59.911490+0000","last_fullsized":"2024-09-12T17:59:59.911490+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:34.164395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4455,"num_read_kb":4051,"num_write":1149,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"261'273","reported_seq":887,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.856750+0000","last_change":"2024-09-12T17:23:40.714177+0000","last_active":"2024-09-12T18:00:02.856750+0000","last_peered":"2024-09-12T18:00:02.856750+0000","last_clean":"2024-09-12T18:00:02.856750+0000","last_became_active":"2024-09-12T17:23:40.713883+0000","last_became_peered":"2024-09-12T17:23:40.713883+0000","last_unstale":"2024-09-12T18:00:02.856750+0000","last_undegraded":"2024-09-12T18:00:02.856750+0000","last_fullsized":"2024-09-12T18:00:02.856750+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:08.265768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19258432,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":416,"num_read_kb":1994,"num_write":1054,"num_write_kb":56686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"261'914","reported_seq":2617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559532+0000","last_change":"2024-09-12T17:23:42.152325+0000","last_active":"2024-09-12T18:00:18.559532+0000","last_peered":"2024-09-12T18:00:18.559532+0000","last_clean":"2024-09-12T18:00:18.559532+0000","last_became_active":"2024-09-12T17:23:42.152030+0000","last_became_peered":"2024-09-12T17:23:42.152030+0000","last_unstale":"2024-09-12T18:00:18.559532+0000","last_undegraded":"2024-09-12T18:00:18.559532+0000","last_fullsized":"2024-09-12T18:00:18.559532+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":900,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:58.696177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4677,"num_read_kb":4199,"num_write":1240,"num_write_kb":482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"261'256","reported_seq":932,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:24.808003+0000","last_change":"2024-09-12T17:23:40.717561+0000","last_active":"2024-09-12T17:59:24.808003+0000","last_peered":"2024-09-12T17:59:24.808003+0000","last_clean":"2024-09-12T17:59:24.808003+0000","last_became_active":"2024-09-12T17:23:40.717097+0000","last_became_peered":"2024-09-12T17:23:40.717097+0000","last_unstale":"2024-09-12T17:59:24.808003+0000","last_undegraded":"2024-09-12T17:59:24.808003+0000","last_fullsized":"2024-09-12T17:59:24.808003+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:08.329294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947935,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":534,"num_read_kb":3212,"num_write":1015,"num_write_kb":17046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"261'390","reported_seq":1862,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.560134+0000","last_change":"2024-09-12T17:24:17.227171+0000","last_active":"2024-09-12T18:00:18.560134+0000","last_peered":"2024-09-12T18:00:18.560134+0000","last_clean":"2024-09-12T18:00:18.560134+0000","last_became_active":"2024-09-12T17:24:17.226840+0000","last_became_peered":"2024-09-12T17:24:17.226840+0000","last_unstale":"2024-09-12T18:00:18.560134+0000","last_undegraded":"2024-09-12T18:00:18.560134+0000","last_fullsized":"2024-09-12T18:00:18.560134+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:26.876837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2081,"num_read_kb":1979,"num_write":442,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"261'751","reported_seq":2065,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.247585+0000","last_change":"2024-09-12T17:23:42.152851+0000","last_active":"2024-09-12T18:00:04.247585+0000","last_peered":"2024-09-12T18:00:04.247585+0000","last_clean":"2024-09-12T18:00:04.247585+0000","last_became_active":"2024-09-12T17:23:42.152513+0000","last_became_peered":"2024-09-12T17:23:42.152513+0000","last_unstale":"2024-09-12T18:00:04.247585+0000","last_undegraded":"2024-09-12T18:00:04.247585+0000","last_fullsized":"2024-09-12T18:00:04.247585+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:34.195735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3383,"num_read_kb":3022,"num_write":991,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"261'251","reported_seq":868,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.359475+0000","last_change":"2024-09-12T17:23:40.713044+0000","last_active":"2024-09-12T18:00:04.359475+0000","last_peered":"2024-09-12T18:00:04.359475+0000","last_clean":"2024-09-12T18:00:04.359475+0000","last_became_active":"2024-09-12T17:23:40.712747+0000","last_became_peered":"2024-09-12T17:23:40.712747+0000","last_unstale":"2024-09-12T18:00:04.359475+0000","last_undegraded":"2024-09-12T18:00:04.359475+0000","last_fullsized":"2024-09-12T18:00:04.359475+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.000672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11859730,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":394,"num_read_kb":32148,"num_write":905,"num_write_kb":37186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"261'506","reported_seq":2009,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.988702+0000","last_change":"2024-09-12T17:23:42.148419+0000","last_active":"2024-09-12T18:00:03.988702+0000","last_peered":"2024-09-12T18:00:03.988702+0000","last_clean":"2024-09-12T18:00:03.988702+0000","last_became_active":"2024-09-12T17:23:42.148091+0000","last_became_peered":"2024-09-12T17:23:42.148091+0000","last_unstale":"2024-09-12T18:00:03.988702+0000","last_undegraded":"2024-09-12T18:00:03.988702+0000","last_fullsized":"2024-09-12T18:00:03.988702+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:49.293452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2605,"num_read_kb":2400,"num_write":650,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"261'289","reported_seq":976,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.193547+0000","last_change":"2024-09-12T17:23:40.708563+0000","last_active":"2024-09-12T17:59:54.193547+0000","last_peered":"2024-09-12T17:59:54.193547+0000","last_clean":"2024-09-12T17:59:54.193547+0000","last_became_active":"2024-09-12T17:23:40.708089+0000","last_became_peered":"2024-09-12T17:23:40.708089+0000","last_unstale":"2024-09-12T17:59:54.193547+0000","last_undegraded":"2024-09-12T17:59:54.193547+0000","last_fullsized":"2024-09-12T17:59:54.193547+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:09.021258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6686981,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":589,"num_read_kb":14171,"num_write":1118,"num_write_kb":46213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"261'906","reported_seq":2491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.398639+0000","last_change":"2024-09-12T17:23:42.146163+0000","last_active":"2024-09-12T18:01:41.398639+0000","last_peered":"2024-09-12T18:01:41.398639+0000","last_clean":"2024-09-12T18:01:41.398639+0000","last_became_active":"2024-09-12T17:23:42.145860+0000","last_became_peered":"2024-09-12T17:23:42.145860+0000","last_unstale":"2024-09-12T18:01:41.398639+0000","last_undegraded":"2024-09-12T18:01:41.398639+0000","last_fullsized":"2024-09-12T18:01:41.398639+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":800,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:47.060225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4352,"num_read_kb":3896,"num_write":1238,"num_write_kb":509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"261'296","reported_seq":1029,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.195573+0000","last_change":"2024-09-12T17:24:17.233383+0000","last_active":"2024-09-12T18:00:03.195573+0000","last_peered":"2024-09-12T18:00:03.195573+0000","last_clean":"2024-09-12T18:00:03.195573+0000","last_became_active":"2024-09-12T17:24:17.232979+0000","last_became_peered":"2024-09-12T17:24:17.232979+0000","last_unstale":"2024-09-12T18:00:03.195573+0000","last_undegraded":"2024-09-12T18:00:03.195573+0000","last_fullsized":"2024-09-12T18:00:03.195573+0000","mapping_epoch":36,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.921503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439574,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":763,"num_read_kb":6334,"num_write":1212,"num_write_kb":23763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"261'427","reported_seq":1989,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.767282+0000","last_change":"2024-09-12T17:23:42.148296+0000","last_active":"2024-09-12T18:00:15.767282+0000","last_peered":"2024-09-12T18:00:15.767282+0000","last_clean":"2024-09-12T18:00:15.767282+0000","last_became_active":"2024-09-12T17:23:42.148023+0000","last_became_peered":"2024-09-12T17:23:42.148023+0000","last_unstale":"2024-09-12T18:00:15.767282+0000","last_undegraded":"2024-09-12T18:00:15.767282+0000","last_fullsized":"2024-09-12T18:00:15.767282+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:08.262875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2276,"num_read_kb":2173,"num_write":473,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"261'281","reported_seq":896,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.805284+0000","last_change":"2024-09-12T17:23:40.714934+0000","last_active":"2024-09-12T18:00:03.805284+0000","last_peered":"2024-09-12T18:00:03.805284+0000","last_clean":"2024-09-12T18:00:03.805284+0000","last_became_active":"2024-09-12T17:23:40.714604+0000","last_became_peered":"2024-09-12T17:23:40.714604+0000","last_unstale":"2024-09-12T18:00:03.805284+0000","last_undegraded":"2024-09-12T18:00:03.805284+0000","last_fullsized":"2024-09-12T18:00:03.805284+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:27.138414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4690785,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":419,"num_read_kb":7311,"num_write":1058,"num_write_kb":22062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"261'420","reported_seq":1932,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.398203+0000","last_change":"2024-09-12T17:23:42.141588+0000","last_active":"2024-09-12T18:01:41.398203+0000","last_peered":"2024-09-12T18:01:41.398203+0000","last_clean":"2024-09-12T18:01:41.398203+0000","last_became_active":"2024-09-12T17:23:42.141237+0000","last_became_peered":"2024-09-12T17:23:42.141237+0000","last_unstale":"2024-09-12T18:01:41.398203+0000","last_undegraded":"2024-09-12T18:01:41.398203+0000","last_fullsized":"2024-09-12T18:01:41.398203+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:12.130382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2248,"num_read_kb":2133,"num_write":484,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"261'265","reported_seq":881,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.145275+0000","last_change":"2024-09-12T17:23:40.705121+0000","last_active":"2024-09-12T18:00:02.145275+0000","last_peered":"2024-09-12T18:00:02.145275+0000","last_clean":"2024-09-12T18:00:02.145275+0000","last_became_active":"2024-09-12T17:23:40.704825+0000","last_became_peered":"2024-09-12T17:23:40.704825+0000","last_unstale":"2024-09-12T18:00:02.145275+0000","last_undegraded":"2024-09-12T18:00:02.145275+0000","last_fullsized":"2024-09-12T18:00:02.145275+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:59.186994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278848,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":394,"num_read_kb":2074,"num_write":982,"num_write_kb":16303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"261'380","reported_seq":1869,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.496044+0000","last_change":"2024-09-12T17:23:42.137722+0000","last_active":"2024-09-12T18:00:05.496044+0000","last_peered":"2024-09-12T18:00:05.496044+0000","last_clean":"2024-09-12T18:00:05.496044+0000","last_became_active":"2024-09-12T17:23:42.137455+0000","last_became_peered":"2024-09-12T17:23:42.137455+0000","last_unstale":"2024-09-12T18:00:05.496044+0000","last_undegraded":"2024-09-12T18:00:05.496044+0000","last_fullsized":"2024-09-12T18:00:05.496044+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:28.273631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2042,"num_read_kb":1965,"num_write":435,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"261'298","reported_seq":941,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.506250+0000","last_change":"2024-09-12T17:23:40.712347+0000","last_active":"2024-09-12T18:01:49.506250+0000","last_peered":"2024-09-12T18:01:49.506250+0000","last_clean":"2024-09-12T18:01:49.506250+0000","last_became_active":"2024-09-12T17:23:40.711201+0000","last_became_peered":"2024-09-12T17:23:40.711201+0000","last_unstale":"2024-09-12T18:01:49.506250+0000","last_undegraded":"2024-09-12T18:01:49.506250+0000","last_fullsized":"2024-09-12T18:01:49.506250+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:09.766467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7876019,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":489,"num_read_kb":25516,"num_write":1139,"num_write_kb":38939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"261'151","reported_seq":661,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.612262+0000","last_change":"2024-09-12T17:23:50.184556+0000","last_active":"2024-09-12T18:00:18.612262+0000","last_peered":"2024-09-12T18:00:18.612262+0000","last_clean":"2024-09-12T18:00:18.612262+0000","last_became_active":"2024-09-12T17:23:50.184149+0000","last_became_peered":"2024-09-12T17:23:50.184149+0000","last_unstale":"2024-09-12T18:00:18.612262+0000","last_undegraded":"2024-09-12T18:00:18.612262+0000","last_fullsized":"2024-09-12T18:00:18.612262+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:56.623668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":269,"num_read_kb":251,"num_write":373,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"261'429","reported_seq":2033,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.775304+0000","last_change":"2024-09-12T17:23:42.154156+0000","last_active":"2024-09-12T18:00:15.775304+0000","last_peered":"2024-09-12T18:00:15.775304+0000","last_clean":"2024-09-12T18:00:15.775304+0000","last_became_active":"2024-09-12T17:23:42.153262+0000","last_became_peered":"2024-09-12T17:23:42.153262+0000","last_unstale":"2024-09-12T18:00:15.775304+0000","last_undegraded":"2024-09-12T18:00:15.775304+0000","last_fullsized":"2024-09-12T18:00:15.775304+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:04.351858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2462,"num_read_kb":2350,"num_write":478,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"261'271","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:26.861166+0000","last_change":"2024-09-12T17:23:40.709825+0000","last_active":"2024-09-12T17:59:26.861166+0000","last_peered":"2024-09-12T17:59:26.861166+0000","last_clean":"2024-09-12T17:59:26.861166+0000","last_became_active":"2024-09-12T17:23:40.709513+0000","last_became_peered":"2024-09-12T17:23:40.709513+0000","last_unstale":"2024-09-12T17:59:26.861166+0000","last_undegraded":"2024-09-12T17:59:26.861166+0000","last_fullsized":"2024-09-12T17:59:26.861166+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:06.392512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9700143,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":416,"num_read_kb":53800,"num_write":1027,"num_write_kb":42009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404158+0000","last_change":"2024-09-12T17:23:44.151154+0000","last_active":"2024-09-12T17:57:34.404158+0000","last_peered":"2024-09-12T17:57:34.404158+0000","last_clean":"2024-09-12T17:57:34.404158+0000","last_became_active":"2024-09-12T17:23:44.150860+0000","last_became_peered":"2024-09-12T17:23:44.150860+0000","last_unstale":"2024-09-12T17:57:34.404158+0000","last_undegraded":"2024-09-12T17:57:34.404158+0000","last_fullsized":"2024-09-12T17:57:34.404158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:48.984288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"261'333","reported_seq":913,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.421054+0000","last_change":"2024-09-12T17:23:46.153152+0000","last_active":"2024-09-12T18:01:42.421054+0000","last_peered":"2024-09-12T18:01:42.421054+0000","last_clean":"2024-09-12T18:01:42.421054+0000","last_became_active":"2024-09-12T17:23:46.152874+0000","last_became_peered":"2024-09-12T17:23:46.152874+0000","last_unstale":"2024-09-12T18:01:42.421054+0000","last_undegraded":"2024-09-12T18:01:42.421054+0000","last_fullsized":"2024-09-12T18:01:42.421054+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:57.758740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64524,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":540,"num_read_kb":1061,"num_write":440,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.405726+0000","last_change":"2024-09-12T17:23:48.168394+0000","last_active":"2024-09-12T17:57:39.405726+0000","last_peered":"2024-09-12T17:57:39.405726+0000","last_clean":"2024-09-12T17:57:39.405726+0000","last_became_active":"2024-09-12T17:23:48.168052+0000","last_became_peered":"2024-09-12T17:23:48.168052+0000","last_unstale":"2024-09-12T17:57:39.405726+0000","last_undegraded":"2024-09-12T17:57:39.405726+0000","last_fullsized":"2024-09-12T17:57:39.405726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:50.986726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"261'173","reported_seq":728,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.773668+0000","last_change":"2024-09-12T17:23:50.188838+0000","last_active":"2024-09-12T18:00:15.773668+0000","last_peered":"2024-09-12T18:00:15.773668+0000","last_clean":"2024-09-12T18:00:15.773668+0000","last_became_active":"2024-09-12T17:23:50.188506+0000","last_became_peered":"2024-09-12T17:23:50.188506+0000","last_unstale":"2024-09-12T18:00:15.773668+0000","last_undegraded":"2024-09-12T18:00:15.773668+0000","last_fullsized":"2024-09-12T18:00:15.773668+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:28.074396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":316,"num_read_kb":300,"num_write":383,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"261'579","reported_seq":2125,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.140832+0000","last_change":"2024-09-12T17:23:42.144567+0000","last_active":"2024-09-12T18:00:18.140832+0000","last_peered":"2024-09-12T18:00:18.140832+0000","last_clean":"2024-09-12T18:00:18.140832+0000","last_became_active":"2024-09-12T17:23:42.143794+0000","last_became_peered":"2024-09-12T17:23:42.143794+0000","last_unstale":"2024-09-12T18:00:18.140832+0000","last_undegraded":"2024-09-12T18:00:18.140832+0000","last_fullsized":"2024-09-12T18:00:18.140832+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:01.173511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3146,"num_read_kb":2882,"num_write":787,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"261'331","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.826279+0000","last_change":"2024-09-12T17:24:17.288249+0000","last_active":"2024-09-12T18:00:03.826279+0000","last_peered":"2024-09-12T18:00:03.826279+0000","last_clean":"2024-09-12T18:00:03.826279+0000","last_became_active":"2024-09-12T17:24:17.287987+0000","last_became_peered":"2024-09-12T17:24:17.287987+0000","last_unstale":"2024-09-12T18:00:03.826279+0000","last_undegraded":"2024-09-12T18:00:03.826279+0000","last_fullsized":"2024-09-12T18:00:03.826279+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:59.986635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15906645,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":535,"num_read_kb":42370,"num_write":1109,"num_write_kb":32675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.413518+0000","last_change":"2024-09-12T17:23:44.149386+0000","last_active":"2024-09-12T17:58:48.413518+0000","last_peered":"2024-09-12T17:58:48.413518+0000","last_clean":"2024-09-12T17:58:48.413518+0000","last_became_active":"2024-09-12T17:23:44.149079+0000","last_became_peered":"2024-09-12T17:23:44.149079+0000","last_unstale":"2024-09-12T17:58:48.413518+0000","last_undegraded":"2024-09-12T17:58:48.413518+0000","last_fullsized":"2024-09-12T17:58:48.413518+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:52.404478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"261'78","reported_seq":591,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:23.586728+0000","last_change":"2024-09-12T17:23:46.150777+0000","last_active":"2024-09-12T17:59:23.586728+0000","last_peered":"2024-09-12T17:59:23.586728+0000","last_clean":"2024-09-12T17:59:23.586728+0000","last_became_active":"2024-09-12T17:23:46.150447+0000","last_became_peered":"2024-09-12T17:23:46.150447+0000","last_unstale":"2024-09-12T17:59:23.586728+0000","last_undegraded":"2024-09-12T17:59:23.586728+0000","last_fullsized":"2024-09-12T17:59:23.586728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:18.226708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":77,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.405649+0000","last_change":"2024-09-12T17:23:48.166388+0000","last_active":"2024-09-12T17:57:39.405649+0000","last_peered":"2024-09-12T17:57:39.405649+0000","last_clean":"2024-09-12T17:57:39.405649+0000","last_became_active":"2024-09-12T17:23:48.165965+0000","last_became_peered":"2024-09-12T17:23:48.165965+0000","last_unstale":"2024-09-12T17:57:39.405649+0000","last_undegraded":"2024-09-12T17:57:39.405649+0000","last_fullsized":"2024-09-12T17:57:39.405649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:48.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"261'113","reported_seq":609,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.639640+0000","last_change":"2024-09-12T17:23:50.188380+0000","last_active":"2024-09-12T17:59:48.639640+0000","last_peered":"2024-09-12T17:59:48.639640+0000","last_clean":"2024-09-12T17:59:48.639640+0000","last_became_active":"2024-09-12T17:23:50.188143+0000","last_became_peered":"2024-09-12T17:23:50.188143+0000","last_unstale":"2024-09-12T17:59:48.639640+0000","last_undegraded":"2024-09-12T17:59:48.639640+0000","last_fullsized":"2024-09-12T17:59:48.639640+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:55.598494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":180,"num_write":267,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"261'430","reported_seq":2047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.138465+0000","last_change":"2024-09-12T17:23:42.155423+0000","last_active":"2024-09-12T18:00:18.138465+0000","last_peered":"2024-09-12T18:00:18.138465+0000","last_clean":"2024-09-12T18:00:18.138465+0000","last_became_active":"2024-09-12T17:23:42.155137+0000","last_became_peered":"2024-09-12T17:23:42.155137+0000","last_unstale":"2024-09-12T18:00:18.138465+0000","last_undegraded":"2024-09-12T18:00:18.138465+0000","last_fullsized":"2024-09-12T18:00:18.138465+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:12.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2401,"num_read_kb":2311,"num_write":475,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"261'417","reported_seq":1066,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:40.412806+0000","last_change":"2024-09-12T17:23:40.707827+0000","last_active":"2024-09-12T18:01:40.412806+0000","last_peered":"2024-09-12T18:01:40.412806+0000","last_clean":"2024-09-12T18:01:40.412806+0000","last_became_active":"2024-09-12T17:23:40.707549+0000","last_became_peered":"2024-09-12T17:23:40.707549+0000","last_unstale":"2024-09-12T18:01:40.412806+0000","last_undegraded":"2024-09-12T18:01:40.412806+0000","last_fullsized":"2024-09-12T18:01:40.412806+0000","mapping_epoch":23,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:48.898807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457570,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":750,"num_read_kb":5813,"num_write":1310,"num_write_kb":24859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.401656+0000","last_change":"2024-09-12T17:23:44.151294+0000","last_active":"2024-09-12T17:57:33.401656+0000","last_peered":"2024-09-12T17:57:33.401656+0000","last_clean":"2024-09-12T17:57:33.401656+0000","last_became_active":"2024-09-12T17:23:44.150973+0000","last_became_peered":"2024-09-12T17:23:44.150973+0000","last_unstale":"2024-09-12T17:57:33.401656+0000","last_undegraded":"2024-09-12T17:57:33.401656+0000","last_fullsized":"2024-09-12T17:57:33.401656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:15.283072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"261'95","reported_seq":615,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:49.842571+0000","last_change":"2024-09-12T17:23:46.154192+0000","last_active":"2024-09-12T17:59:49.842571+0000","last_peered":"2024-09-12T17:59:49.842571+0000","last_clean":"2024-09-12T17:59:49.842571+0000","last_became_active":"2024-09-12T17:23:46.153864+0000","last_became_peered":"2024-09-12T17:23:46.153864+0000","last_unstale":"2024-09-12T17:59:49.842571+0000","last_undegraded":"2024-09-12T17:59:49.842571+0000","last_fullsized":"2024-09-12T17:59:49.842571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:52.292455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"261'762","reported_seq":2153,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.414646+0000","last_change":"2024-09-12T17:23:48.173728+0000","last_active":"2024-09-12T18:01:49.414646+0000","last_peered":"2024-09-12T18:01:49.414646+0000","last_clean":"2024-09-12T18:01:49.414646+0000","last_became_active":"2024-09-12T17:23:48.173454+0000","last_became_peered":"2024-09-12T17:23:48.173454+0000","last_unstale":"2024-09-12T18:01:49.414646+0000","last_undegraded":"2024-09-12T18:01:49.414646+0000","last_fullsized":"2024-09-12T18:01:49.414646+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:51.582534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"261'214","reported_seq":1037,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.663235+0000","last_change":"2024-09-12T17:23:50.640673+0000","last_active":"2024-09-12T18:00:18.663235+0000","last_peered":"2024-09-12T18:00:18.663235+0000","last_clean":"2024-09-12T18:00:18.663235+0000","last_became_active":"2024-09-12T17:23:50.640401+0000","last_became_peered":"2024-09-12T17:23:50.640401+0000","last_unstale":"2024-09-12T18:00:18.663235+0000","last_undegraded":"2024-09-12T18:00:18.663235+0000","last_fullsized":"2024-09-12T18:00:18.663235+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:04.518137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":682,"num_read_kb":671,"num_write":489,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"261'898","reported_seq":2439,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.892342+0000","last_change":"2024-09-12T17:23:42.148014+0000","last_active":"2024-09-12T18:00:04.892342+0000","last_peered":"2024-09-12T18:00:04.892342+0000","last_clean":"2024-09-12T18:00:04.892342+0000","last_became_active":"2024-09-12T17:23:42.147597+0000","last_became_peered":"2024-09-12T17:23:42.147597+0000","last_unstale":"2024-09-12T18:00:04.892342+0000","last_undegraded":"2024-09-12T18:00:04.892342+0000","last_fullsized":"2024-09-12T18:00:04.892342+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":800,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:17.140238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4183,"num_read_kb":3727,"num_write":1220,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"261'300","reported_seq":977,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.757256+0000","last_change":"2024-09-12T17:23:40.718814+0000","last_active":"2024-09-12T17:59:59.757256+0000","last_peered":"2024-09-12T17:59:59.757256+0000","last_clean":"2024-09-12T17:59:59.757256+0000","last_became_active":"2024-09-12T17:23:40.718582+0000","last_became_peered":"2024-09-12T17:23:40.718582+0000","last_unstale":"2024-09-12T17:59:59.757256+0000","last_undegraded":"2024-09-12T17:59:59.757256+0000","last_fullsized":"2024-09-12T17:59:59.757256+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:35.754217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15438220,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":525,"num_read_kb":83242,"num_write":1040,"num_write_kb":35659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404212+0000","last_change":"2024-09-12T17:23:44.152542+0000","last_active":"2024-09-12T17:57:34.404212+0000","last_peered":"2024-09-12T17:57:34.404212+0000","last_clean":"2024-09-12T17:57:34.404212+0000","last_became_active":"2024-09-12T17:23:44.151918+0000","last_became_peered":"2024-09-12T17:23:44.151918+0000","last_unstale":"2024-09-12T17:57:34.404212+0000","last_undegraded":"2024-09-12T17:57:34.404212+0000","last_fullsized":"2024-09-12T17:57:34.404212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:18.221084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"261'262","reported_seq":808,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.414542+0000","last_change":"2024-09-12T17:23:46.241449+0000","last_active":"2024-09-12T18:01:42.414542+0000","last_peered":"2024-09-12T18:01:42.414542+0000","last_clean":"2024-09-12T18:01:42.414542+0000","last_became_active":"2024-09-12T17:23:46.241137+0000","last_became_peered":"2024-09-12T17:23:46.241137+0000","last_unstale":"2024-09-12T18:01:42.414542+0000","last_undegraded":"2024-09-12T18:01:42.414542+0000","last_fullsized":"2024-09-12T18:01:42.414542+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:58.197635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60790,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":971,"num_write":374,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"261'803","reported_seq":6198,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.456541+0000","last_change":"2024-09-12T17:23:48.167347+0000","last_active":"2024-09-12T18:01:42.456541+0000","last_peered":"2024-09-12T18:01:42.456541+0000","last_clean":"2024-09-12T18:01:42.456541+0000","last_became_active":"2024-09-12T17:23:48.167038+0000","last_became_peered":"2024-09-12T17:23:48.167038+0000","last_unstale":"2024-09-12T18:01:42.456541+0000","last_undegraded":"2024-09-12T18:01:42.456541+0000","last_fullsized":"2024-09-12T18:01:42.456541+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:22.744543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"261'663","reported_seq":2260,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559804+0000","last_change":"2024-09-12T17:23:42.144234+0000","last_active":"2024-09-12T18:00:18.559804+0000","last_peered":"2024-09-12T18:00:18.559804+0000","last_clean":"2024-09-12T18:00:18.559804+0000","last_became_active":"2024-09-12T17:23:42.143778+0000","last_became_peered":"2024-09-12T17:23:42.143778+0000","last_unstale":"2024-09-12T18:00:18.559804+0000","last_undegraded":"2024-09-12T18:00:18.559804+0000","last_fullsized":"2024-09-12T18:00:18.559804+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":600,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:03.567237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3245,"num_read_kb":3064,"num_write":918,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"261'277","reported_seq":878,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.615692+0000","last_change":"2024-09-12T17:23:40.709847+0000","last_active":"2024-09-12T18:00:16.615692+0000","last_peered":"2024-09-12T18:00:16.615692+0000","last_clean":"2024-09-12T18:00:16.615692+0000","last_became_active":"2024-09-12T17:23:40.709587+0000","last_became_peered":"2024-09-12T17:23:40.709587+0000","last_unstale":"2024-09-12T18:00:16.615692+0000","last_undegraded":"2024-09-12T18:00:16.615692+0000","last_fullsized":"2024-09-12T18:00:16.615692+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:52.138227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13193104,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":339,"num_read_kb":61352,"num_write":949,"num_write_kb":60278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.412039+0000","last_change":"2024-09-12T17:23:44.151275+0000","last_active":"2024-09-12T17:58:24.412039+0000","last_peered":"2024-09-12T17:58:24.412039+0000","last_clean":"2024-09-12T17:58:24.412039+0000","last_became_active":"2024-09-12T17:23:44.150957+0000","last_became_peered":"2024-09-12T17:23:44.150957+0000","last_unstale":"2024-09-12T17:58:24.412039+0000","last_undegraded":"2024-09-12T17:58:24.412039+0000","last_fullsized":"2024-09-12T17:58:24.412039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:06.423907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"261'340","reported_seq":927,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:44.431059+0000","last_change":"2024-09-12T17:23:46.241749+0000","last_active":"2024-09-12T18:00:44.431059+0000","last_peered":"2024-09-12T18:00:44.431059+0000","last_clean":"2024-09-12T18:00:44.431059+0000","last_became_active":"2024-09-12T17:23:46.241442+0000","last_became_peered":"2024-09-12T17:23:46.241442+0000","last_unstale":"2024-09-12T18:00:44.431059+0000","last_undegraded":"2024-09-12T18:00:44.431059+0000","last_fullsized":"2024-09-12T18:00:44.431059+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:17.283661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61524,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":549,"num_read_kb":1059,"num_write":442,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.403282+0000","last_change":"2024-09-12T17:23:48.168185+0000","last_active":"2024-09-12T17:57:34.403282+0000","last_peered":"2024-09-12T17:57:34.403282+0000","last_clean":"2024-09-12T17:57:34.403282+0000","last_became_active":"2024-09-12T17:23:48.167925+0000","last_became_peered":"2024-09-12T17:23:48.167925+0000","last_unstale":"2024-09-12T17:57:34.403282+0000","last_undegraded":"2024-09-12T17:57:34.403282+0000","last_fullsized":"2024-09-12T17:57:34.403282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:09.629250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"261'574","reported_seq":1382,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.439771+0000","last_change":"2024-09-12T17:23:50.188392+0000","last_active":"2024-09-12T18:01:42.439771+0000","last_peered":"2024-09-12T18:01:42.439771+0000","last_clean":"2024-09-12T18:01:42.439771+0000","last_became_active":"2024-09-12T17:23:50.188109+0000","last_became_peered":"2024-09-12T17:23:50.188109+0000","last_unstale":"2024-09-12T18:01:42.439771+0000","last_undegraded":"2024-09-12T18:01:42.439771+0000","last_fullsized":"2024-09-12T18:01:42.439771+0000","mapping_epoch":33,"log_start":"261'500","ondisk_log_start":"261'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:18.895859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1373,"num_read_kb":1362,"num_write":1221,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"261'466","reported_seq":2001,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.785578+0000","last_change":"2024-09-12T17:23:42.136630+0000","last_active":"2024-09-12T18:00:05.785578+0000","last_peered":"2024-09-12T18:00:05.785578+0000","last_clean":"2024-09-12T18:00:05.785578+0000","last_became_active":"2024-09-12T17:23:42.135997+0000","last_became_peered":"2024-09-12T17:23:42.135997+0000","last_unstale":"2024-09-12T18:00:05.785578+0000","last_undegraded":"2024-09-12T18:00:05.785578+0000","last_fullsized":"2024-09-12T18:00:05.785578+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:19.635100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2354,"num_read_kb":2214,"num_write":547,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"261'267","reported_seq":894,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.050389+0000","last_change":"2024-09-12T17:23:40.711857+0000","last_active":"2024-09-12T18:00:04.050389+0000","last_peered":"2024-09-12T18:00:04.050389+0000","last_clean":"2024-09-12T18:00:04.050389+0000","last_became_active":"2024-09-12T17:23:40.711546+0000","last_became_peered":"2024-09-12T17:23:40.711546+0000","last_unstale":"2024-09-12T18:00:04.050389+0000","last_undegraded":"2024-09-12T18:00:04.050389+0000","last_fullsized":"2024-09-12T18:00:04.050389+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:28.645374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2048249,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":392,"num_read_kb":14389,"num_write":933,"num_write_kb":31885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.611541+0000","last_change":"2024-09-12T17:23:44.148761+0000","last_active":"2024-09-12T17:58:23.611541+0000","last_peered":"2024-09-12T17:58:23.611541+0000","last_clean":"2024-09-12T17:58:23.611541+0000","last_became_active":"2024-09-12T17:23:44.148472+0000","last_became_peered":"2024-09-12T17:23:44.148472+0000","last_unstale":"2024-09-12T17:58:23.611541+0000","last_undegraded":"2024-09-12T17:58:23.611541+0000","last_fullsized":"2024-09-12T17:58:23.611541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:28.080187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"261'239","reported_seq":790,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:53.569720+0000","last_change":"2024-09-12T17:23:46.153208+0000","last_active":"2024-09-12T17:59:53.569720+0000","last_peered":"2024-09-12T17:59:53.569720+0000","last_clean":"2024-09-12T17:59:53.569720+0000","last_became_active":"2024-09-12T17:23:46.152441+0000","last_became_peered":"2024-09-12T17:23:46.152441+0000","last_unstale":"2024-09-12T17:59:53.569720+0000","last_undegraded":"2024-09-12T17:59:53.569720+0000","last_fullsized":"2024-09-12T17:59:53.569720+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:17.945639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52528,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":843,"num_write":328,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411068+0000","last_change":"2024-09-12T17:23:48.168110+0000","last_active":"2024-09-12T17:58:33.411068+0000","last_peered":"2024-09-12T17:58:33.411068+0000","last_clean":"2024-09-12T17:58:33.411068+0000","last_became_active":"2024-09-12T17:23:48.167829+0000","last_became_peered":"2024-09-12T17:23:48.167829+0000","last_unstale":"2024-09-12T17:58:33.411068+0000","last_undegraded":"2024-09-12T17:58:33.411068+0000","last_fullsized":"2024-09-12T17:58:33.411068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:24.546875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"261'2375","reported_seq":4213,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.434744+0000","last_change":"2024-09-12T17:23:50.186322+0000","last_active":"2024-09-12T18:01:29.434744+0000","last_peered":"2024-09-12T18:01:29.434744+0000","last_clean":"2024-09-12T18:01:29.434744+0000","last_became_active":"2024-09-12T17:23:50.186026+0000","last_became_peered":"2024-09-12T17:23:50.186026+0000","last_unstale":"2024-09-12T18:01:29.434744+0000","last_undegraded":"2024-09-12T18:01:29.434744+0000","last_fullsized":"2024-09-12T18:01:29.434744+0000","mapping_epoch":33,"log_start":"261'2300","ondisk_log_start":"261'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":2300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:19.020080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6096,"num_read_kb":6075,"num_write":4800,"num_write_kb":1772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"261'457","reported_seq":1986,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559814+0000","last_change":"2024-09-12T17:23:42.147429+0000","last_active":"2024-09-12T18:00:18.559814+0000","last_peered":"2024-09-12T18:00:18.559814+0000","last_clean":"2024-09-12T18:00:18.559814+0000","last_became_active":"2024-09-12T17:23:42.147136+0000","last_became_peered":"2024-09-12T17:23:42.147136+0000","last_unstale":"2024-09-12T18:00:18.559814+0000","last_undegraded":"2024-09-12T18:00:18.559814+0000","last_fullsized":"2024-09-12T18:00:18.559814+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:43.868169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2419,"num_read_kb":2271,"num_write":547,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"261'269","reported_seq":863,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.396032+0000","last_change":"2024-09-12T17:23:40.714029+0000","last_active":"2024-09-12T18:01:36.396032+0000","last_peered":"2024-09-12T18:01:36.396032+0000","last_clean":"2024-09-12T18:01:36.396032+0000","last_became_active":"2024-09-12T17:23:40.713481+0000","last_became_peered":"2024-09-12T17:23:40.713481+0000","last_unstale":"2024-09-12T18:01:36.396032+0000","last_undegraded":"2024-09-12T18:01:36.396032+0000","last_fullsized":"2024-09-12T18:01:36.396032+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:10.827842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11560873,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":370,"num_read_kb":5522,"num_write":996,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.604544+0000","last_change":"2024-09-12T17:23:44.147970+0000","last_active":"2024-09-12T17:57:28.604544+0000","last_peered":"2024-09-12T17:57:28.604544+0000","last_clean":"2024-09-12T17:57:28.604544+0000","last_became_active":"2024-09-12T17:23:44.147677+0000","last_became_peered":"2024-09-12T17:23:44.147677+0000","last_unstale":"2024-09-12T17:57:28.604544+0000","last_undegraded":"2024-09-12T17:57:28.604544+0000","last_fullsized":"2024-09-12T17:57:28.604544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:44.346531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"261'281","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:39.430401+0000","last_change":"2024-09-12T17:23:46.150883+0000","last_active":"2024-09-12T18:00:39.430401+0000","last_peered":"2024-09-12T18:00:39.430401+0000","last_clean":"2024-09-12T18:00:39.430401+0000","last_became_active":"2024-09-12T17:23:46.150555+0000","last_became_peered":"2024-09-12T17:23:46.150555+0000","last_unstale":"2024-09-12T18:00:39.430401+0000","last_undegraded":"2024-09-12T18:00:39.430401+0000","last_fullsized":"2024-09-12T18:00:39.430401+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:53.085351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61510,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":472,"num_read_kb":990,"num_write":388,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"261'800","reported_seq":2468,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.420782+0000","last_change":"2024-09-12T17:23:48.165492+0000","last_active":"2024-09-12T18:01:49.420782+0000","last_peered":"2024-09-12T18:01:49.420782+0000","last_clean":"2024-09-12T18:01:49.420782+0000","last_became_active":"2024-09-12T17:23:48.165179+0000","last_became_peered":"2024-09-12T17:23:48.165179+0000","last_unstale":"2024-09-12T18:01:49.420782+0000","last_undegraded":"2024-09-12T18:01:49.420782+0000","last_fullsized":"2024-09-12T18:01:49.420782+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:26.382390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"261'143","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.345598+0000","last_change":"2024-09-12T17:23:50.188608+0000","last_active":"2024-09-12T18:01:41.345598+0000","last_peered":"2024-09-12T18:01:41.345598+0000","last_clean":"2024-09-12T18:01:41.345598+0000","last_became_active":"2024-09-12T17:23:50.188230+0000","last_became_peered":"2024-09-12T17:23:50.188230+0000","last_unstale":"2024-09-12T18:01:41.345598+0000","last_undegraded":"2024-09-12T18:01:41.345598+0000","last_fullsized":"2024-09-12T18:01:41.345598+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:43.821173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":185,"num_write":335,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"261'473","reported_seq":2022,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.409628+0000","last_change":"2024-09-12T17:23:42.154193+0000","last_active":"2024-09-12T18:01:41.409628+0000","last_peered":"2024-09-12T18:01:41.409628+0000","last_clean":"2024-09-12T18:01:41.409628+0000","last_became_active":"2024-09-12T17:23:42.153910+0000","last_became_peered":"2024-09-12T17:23:42.153910+0000","last_unstale":"2024-09-12T18:01:41.409628+0000","last_undegraded":"2024-09-12T18:01:41.409628+0000","last_fullsized":"2024-09-12T18:01:41.409628+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:19.410163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2575,"num_read_kb":2405,"num_write":575,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"261'326","reported_seq":1041,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:52.399872+0000","last_change":"2024-09-12T17:23:40.714040+0000","last_active":"2024-09-12T17:59:52.399872+0000","last_peered":"2024-09-12T17:59:52.399872+0000","last_clean":"2024-09-12T17:59:52.399872+0000","last_became_active":"2024-09-12T17:23:40.712691+0000","last_became_peered":"2024-09-12T17:23:40.712691+0000","last_unstale":"2024-09-12T17:59:52.399872+0000","last_undegraded":"2024-09-12T17:59:52.399872+0000","last_fullsized":"2024-09-12T17:59:52.399872+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:23.050646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23718850,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":623,"num_read_kb":118590,"num_write":1212,"num_write_kb":72411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.611578+0000","last_change":"2024-09-12T17:23:44.143860+0000","last_active":"2024-09-12T17:58:23.611578+0000","last_peered":"2024-09-12T17:58:23.611578+0000","last_clean":"2024-09-12T17:58:23.611578+0000","last_became_active":"2024-09-12T17:23:44.142306+0000","last_became_peered":"2024-09-12T17:23:44.142306+0000","last_unstale":"2024-09-12T17:58:23.611578+0000","last_undegraded":"2024-09-12T17:58:23.611578+0000","last_fullsized":"2024-09-12T17:58:23.611578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:59.833432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"261'448","reported_seq":1052,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.431359+0000","last_change":"2024-09-12T17:23:46.154013+0000","last_active":"2024-09-12T18:01:49.431359+0000","last_peered":"2024-09-12T18:01:49.431359+0000","last_clean":"2024-09-12T18:01:49.431359+0000","last_became_active":"2024-09-12T17:23:46.153719+0000","last_became_peered":"2024-09-12T17:23:46.153719+0000","last_unstale":"2024-09-12T18:01:49.431359+0000","last_undegraded":"2024-09-12T18:01:49.431359+0000","last_fullsized":"2024-09-12T18:01:49.431359+0000","mapping_epoch":29,"log_start":"261'400","ondisk_log_start":"261'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:26.689565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109660,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":784,"num_read_kb":1735,"num_write":652,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612208+0000","last_change":"2024-09-12T17:23:48.170645+0000","last_active":"2024-09-12T17:58:28.612208+0000","last_peered":"2024-09-12T17:58:28.612208+0000","last_clean":"2024-09-12T17:58:28.612208+0000","last_became_active":"2024-09-12T17:23:48.170317+0000","last_became_peered":"2024-09-12T17:23:48.170317+0000","last_unstale":"2024-09-12T17:58:28.612208+0000","last_undegraded":"2024-09-12T17:58:28.612208+0000","last_fullsized":"2024-09-12T17:58:28.612208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:12.486235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"261'153","reported_seq":658,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:22.115592+0000","last_change":"2024-09-12T17:23:50.184354+0000","last_active":"2024-09-12T17:59:22.115592+0000","last_peered":"2024-09-12T17:59:22.115592+0000","last_clean":"2024-09-12T17:59:22.115592+0000","last_became_active":"2024-09-12T17:23:50.184033+0000","last_became_peered":"2024-09-12T17:23:50.184033+0000","last_unstale":"2024-09-12T17:59:22.115592+0000","last_undegraded":"2024-09-12T17:59:22.115592+0000","last_fullsized":"2024-09-12T17:59:22.115592+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:27.722195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":204,"num_write":351,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"261'833","reported_seq":2440,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.139345+0000","last_change":"2024-09-12T17:23:42.145012+0000","last_active":"2024-09-12T18:00:18.139345+0000","last_peered":"2024-09-12T18:00:18.139345+0000","last_clean":"2024-09-12T18:00:18.139345+0000","last_became_active":"2024-09-12T17:23:42.144703+0000","last_became_peered":"2024-09-12T17:23:42.144703+0000","last_unstale":"2024-09-12T18:00:18.139345+0000","last_undegraded":"2024-09-12T18:00:18.139345+0000","last_fullsized":"2024-09-12T18:00:18.139345+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:39.045177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3952,"num_read_kb":3587,"num_write":1103,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"261'330","reported_seq":987,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.456943+0000","last_change":"2024-09-12T17:23:40.706524+0000","last_active":"2024-09-12T17:59:59.456943+0000","last_peered":"2024-09-12T17:59:59.456943+0000","last_clean":"2024-09-12T17:59:59.456943+0000","last_became_active":"2024-09-12T17:23:40.706213+0000","last_became_peered":"2024-09-12T17:23:40.706213+0000","last_unstale":"2024-09-12T17:59:59.456943+0000","last_undegraded":"2024-09-12T17:59:59.456943+0000","last_fullsized":"2024-09-12T17:59:59.456943+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:54.778098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2417800,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":557,"num_read_kb":8190,"num_write":1349,"num_write_kb":25988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.604568+0000","last_change":"2024-09-12T17:23:44.149835+0000","last_active":"2024-09-12T17:57:28.604568+0000","last_peered":"2024-09-12T17:57:28.604568+0000","last_clean":"2024-09-12T17:57:28.604568+0000","last_became_active":"2024-09-12T17:23:44.149550+0000","last_became_peered":"2024-09-12T17:23:44.149550+0000","last_unstale":"2024-09-12T17:57:28.604568+0000","last_undegraded":"2024-09-12T17:57:28.604568+0000","last_fullsized":"2024-09-12T17:57:28.604568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:43.008237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"261'273","reported_seq":831,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.406132+0000","last_change":"2024-09-12T17:23:46.153560+0000","last_active":"2024-09-12T18:01:42.406132+0000","last_peered":"2024-09-12T18:01:42.406132+0000","last_clean":"2024-09-12T18:01:42.406132+0000","last_became_active":"2024-09-12T17:23:46.153210+0000","last_became_peered":"2024-09-12T17:23:46.153210+0000","last_unstale":"2024-09-12T18:01:42.406132+0000","last_undegraded":"2024-09-12T18:01:42.406132+0000","last_fullsized":"2024-09-12T18:01:42.406132+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:53.528030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55204,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":931,"num_write":420,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.531914+0000","last_change":"2024-09-12T17:23:48.168999+0000","last_active":"2024-09-12T17:57:39.531914+0000","last_peered":"2024-09-12T17:57:39.531914+0000","last_clean":"2024-09-12T17:57:39.531914+0000","last_became_active":"2024-09-12T17:23:48.168675+0000","last_became_peered":"2024-09-12T17:23:48.168675+0000","last_unstale":"2024-09-12T17:57:39.531914+0000","last_undegraded":"2024-09-12T17:57:39.531914+0000","last_fullsized":"2024-09-12T17:57:39.531914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:15.332536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"261'97","reported_seq":577,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.616169+0000","last_change":"2024-09-12T17:23:50.186614+0000","last_active":"2024-09-12T18:00:18.616169+0000","last_peered":"2024-09-12T18:00:18.616169+0000","last_clean":"2024-09-12T18:00:18.616169+0000","last_became_active":"2024-09-12T17:23:50.186287+0000","last_became_peered":"2024-09-12T17:23:50.186287+0000","last_unstale":"2024-09-12T18:00:18.616169+0000","last_undegraded":"2024-09-12T18:00:18.616169+0000","last_fullsized":"2024-09-12T18:00:18.616169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:36.361422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":108,"num_read_kb":104,"num_write":228,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"261'640","reported_seq":2241,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.779429+0000","last_change":"2024-09-12T17:23:42.134561+0000","last_active":"2024-09-12T18:00:05.779429+0000","last_peered":"2024-09-12T18:00:05.779429+0000","last_clean":"2024-09-12T18:00:05.779429+0000","last_became_active":"2024-09-12T17:23:42.132858+0000","last_became_peered":"2024-09-12T17:23:42.132858+0000","last_unstale":"2024-09-12T18:00:05.779429+0000","last_undegraded":"2024-09-12T18:00:05.779429+0000","last_fullsized":"2024-09-12T18:00:05.779429+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:47.060225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3409,"num_read_kb":3082,"num_write":929,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"261'340","reported_seq":1013,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.477485+0000","last_change":"2024-09-12T17:23:40.706825+0000","last_active":"2024-09-12T17:59:48.477485+0000","last_peered":"2024-09-12T17:59:48.477485+0000","last_clean":"2024-09-12T17:59:48.477485+0000","last_became_active":"2024-09-12T17:23:40.706531+0000","last_became_peered":"2024-09-12T17:23:40.706531+0000","last_unstale":"2024-09-12T17:59:48.477485+0000","last_undegraded":"2024-09-12T17:59:48.477485+0000","last_fullsized":"2024-09-12T17:59:48.477485+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:47.318982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656147,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":607,"num_read_kb":36587,"num_write":1156,"num_write_kb":30858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"35'5","reported_seq":975,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.979476+0000","last_change":"2024-09-12T17:23:44.147758+0000","last_active":"2024-09-12T18:01:48.979476+0000","last_peered":"2024-09-12T18:01:48.979476+0000","last_clean":"2024-09-12T18:01:48.979476+0000","last_became_active":"2024-09-12T17:23:44.147427+0000","last_became_peered":"2024-09-12T17:23:44.147427+0000","last_unstale":"2024-09-12T18:01:48.979476+0000","last_undegraded":"2024-09-12T18:01:48.979476+0000","last_fullsized":"2024-09-12T18:01:48.979476+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:01.104960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":1201,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"261'294","reported_seq":858,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.883308+0000","last_change":"2024-09-12T17:23:46.153321+0000","last_active":"2024-09-12T17:59:54.883308+0000","last_peered":"2024-09-12T17:59:54.883308+0000","last_clean":"2024-09-12T17:59:54.883308+0000","last_became_active":"2024-09-12T17:23:46.153004+0000","last_became_peered":"2024-09-12T17:23:46.153004+0000","last_unstale":"2024-09-12T17:59:54.883308+0000","last_undegraded":"2024-09-12T17:59:54.883308+0000","last_fullsized":"2024-09-12T17:59:54.883308+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:18.903057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58984,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":484,"num_read_kb":992,"num_write":402,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"261'738","reported_seq":2126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.453623+0000","last_change":"2024-09-12T17:23:48.169354+0000","last_active":"2024-09-12T18:01:42.453623+0000","last_peered":"2024-09-12T18:01:42.453623+0000","last_clean":"2024-09-12T18:01:42.453623+0000","last_became_active":"2024-09-12T17:23:48.169062+0000","last_became_peered":"2024-09-12T17:23:48.169062+0000","last_unstale":"2024-09-12T18:01:42.453623+0000","last_undegraded":"2024-09-12T18:01:42.453623+0000","last_fullsized":"2024-09-12T18:01:42.453623+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:31.045415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"261'140","reported_seq":626,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.160885+0000","last_change":"2024-09-12T17:23:50.184877+0000","last_active":"2024-09-12T18:00:18.160885+0000","last_peered":"2024-09-12T18:00:18.160885+0000","last_clean":"2024-09-12T18:00:18.160885+0000","last_became_active":"2024-09-12T17:23:50.184460+0000","last_became_peered":"2024-09-12T17:23:50.184460+0000","last_unstale":"2024-09-12T18:00:18.160885+0000","last_undegraded":"2024-09-12T18:00:18.160885+0000","last_fullsized":"2024-09-12T18:00:18.160885+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:05.644031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":156,"num_write":329,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"261'797","reported_seq":2252,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.099398+0000","last_change":"2024-09-12T17:23:42.146658+0000","last_active":"2024-09-12T18:00:02.099398+0000","last_peered":"2024-09-12T18:00:02.099398+0000","last_clean":"2024-09-12T18:00:02.099398+0000","last_became_active":"2024-09-12T17:23:42.142896+0000","last_became_peered":"2024-09-12T17:23:42.142896+0000","last_unstale":"2024-09-12T18:00:02.099398+0000","last_undegraded":"2024-09-12T18:00:02.099398+0000","last_fullsized":"2024-09-12T18:00:02.099398+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:06.765117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3737,"num_read_kb":3347,"num_write":1075,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"261'277","reported_seq":940,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:34.428646+0000","last_change":"2024-09-12T17:23:40.708635+0000","last_active":"2024-09-12T18:00:34.428646+0000","last_peered":"2024-09-12T18:00:34.428646+0000","last_clean":"2024-09-12T18:00:34.428646+0000","last_became_active":"2024-09-12T17:23:40.708386+0000","last_became_peered":"2024-09-12T17:23:40.708386+0000","last_unstale":"2024-09-12T18:00:34.428646+0000","last_undegraded":"2024-09-12T18:00:34.428646+0000","last_fullsized":"2024-09-12T18:00:34.428646+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:15.730934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8197355,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":446,"num_read_kb":106949,"num_write":1070,"num_write_kb":37410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1449,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.991695+0000","last_change":"2024-09-12T17:23:44.150061+0000","last_active":"2024-09-12T18:01:48.991695+0000","last_peered":"2024-09-12T18:01:48.991695+0000","last_clean":"2024-09-12T18:01:48.991695+0000","last_became_active":"2024-09-12T17:23:44.149279+0000","last_became_peered":"2024-09-12T17:23:44.149279+0000","last_unstale":"2024-09-12T18:01:48.991695+0000","last_undegraded":"2024-09-12T18:01:48.991695+0000","last_fullsized":"2024-09-12T18:01:48.991695+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:24.241906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"261'63","reported_seq":566,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:21.056971+0000","last_change":"2024-09-12T17:23:46.241422+0000","last_active":"2024-09-12T17:59:21.056971+0000","last_peered":"2024-09-12T17:59:21.056971+0000","last_clean":"2024-09-12T17:59:21.056971+0000","last_became_active":"2024-09-12T17:23:46.240979+0000","last_became_peered":"2024-09-12T17:23:46.240979+0000","last_unstale":"2024-09-12T17:59:21.056971+0000","last_undegraded":"2024-09-12T17:59:21.056971+0000","last_fullsized":"2024-09-12T17:59:21.056971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:39.659261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"261'785","reported_seq":2379,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.417043+0000","last_change":"2024-09-12T17:23:48.172774+0000","last_active":"2024-09-12T18:01:49.417043+0000","last_peered":"2024-09-12T18:01:49.417043+0000","last_clean":"2024-09-12T18:01:49.417043+0000","last_became_active":"2024-09-12T17:23:48.172485+0000","last_became_peered":"2024-09-12T17:23:48.172485+0000","last_unstale":"2024-09-12T18:01:49.417043+0000","last_undegraded":"2024-09-12T18:01:49.417043+0000","last_fullsized":"2024-09-12T18:01:49.417043+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:42.427288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"261'140","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:56.764717+0000","last_change":"2024-09-12T17:23:50.179455+0000","last_active":"2024-09-12T17:59:56.764717+0000","last_peered":"2024-09-12T17:59:56.764717+0000","last_clean":"2024-09-12T17:59:56.764717+0000","last_became_active":"2024-09-12T17:23:50.179153+0000","last_became_peered":"2024-09-12T17:23:50.179153+0000","last_unstale":"2024-09-12T17:59:56.764717+0000","last_undegraded":"2024-09-12T17:59:56.764717+0000","last_fullsized":"2024-09-12T17:59:56.764717+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:04.149720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":149,"num_read_kb":148,"num_write":323,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"261'408","reported_seq":1899,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.498175+0000","last_change":"2024-09-12T17:23:42.152712+0000","last_active":"2024-09-12T18:00:05.498175+0000","last_peered":"2024-09-12T18:00:05.498175+0000","last_clean":"2024-09-12T18:00:05.498175+0000","last_became_active":"2024-09-12T17:23:42.152339+0000","last_became_peered":"2024-09-12T17:23:42.152339+0000","last_unstale":"2024-09-12T18:00:05.498175+0000","last_undegraded":"2024-09-12T18:00:05.498175+0000","last_fullsized":"2024-09-12T18:00:05.498175+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:42.189771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2264,"num_read_kb":2142,"num_write":477,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"261'380","reported_seq":1152,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.831731+0000","last_change":"2024-09-12T17:23:40.714992+0000","last_active":"2024-09-12T18:00:05.831731+0000","last_peered":"2024-09-12T18:00:05.831731+0000","last_clean":"2024-09-12T18:00:05.831731+0000","last_became_active":"2024-09-12T17:23:40.714708+0000","last_became_peered":"2024-09-12T17:23:40.714708+0000","last_unstale":"2024-09-12T18:00:05.831731+0000","last_undegraded":"2024-09-12T18:00:05.831731+0000","last_fullsized":"2024-09-12T18:00:05.831731+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:24.961347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10487247,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":951,"num_read_kb":34670,"num_write":1441,"num_write_kb":45714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.404145+0000","last_change":"2024-09-12T17:23:44.151662+0000","last_active":"2024-09-12T17:57:29.404145+0000","last_peered":"2024-09-12T17:57:29.404145+0000","last_clean":"2024-09-12T17:57:29.404145+0000","last_became_active":"2024-09-12T17:23:44.151392+0000","last_became_peered":"2024-09-12T17:23:44.151392+0000","last_unstale":"2024-09-12T17:57:29.404145+0000","last_undegraded":"2024-09-12T17:57:29.404145+0000","last_fullsized":"2024-09-12T17:57:29.404145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:59.377518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"261'300","reported_seq":882,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:56.779153+0000","last_change":"2024-09-12T17:23:46.145102+0000","last_active":"2024-09-12T17:59:56.779153+0000","last_peered":"2024-09-12T17:59:56.779153+0000","last_clean":"2024-09-12T17:59:56.779153+0000","last_became_active":"2024-09-12T17:23:46.144754+0000","last_became_peered":"2024-09-12T17:23:46.144754+0000","last_unstale":"2024-09-12T17:59:56.779153+0000","last_undegraded":"2024-09-12T17:59:56.779153+0000","last_fullsized":"2024-09-12T17:59:56.779153+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:02.014145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52075,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":487,"num_read_kb":929,"num_write":384,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.402044+0000","last_change":"2024-09-12T17:23:48.170789+0000","last_active":"2024-09-12T17:57:34.402044+0000","last_peered":"2024-09-12T17:57:34.402044+0000","last_clean":"2024-09-12T17:57:34.402044+0000","last_became_active":"2024-09-12T17:23:48.170482+0000","last_became_peered":"2024-09-12T17:23:48.170482+0000","last_unstale":"2024-09-12T17:57:34.402044+0000","last_undegraded":"2024-09-12T17:57:34.402044+0000","last_fullsized":"2024-09-12T17:57:34.402044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:42.252206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"261'140","reported_seq":633,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.433834+0000","last_change":"2024-09-12T17:23:50.187298+0000","last_active":"2024-09-12T18:01:19.433834+0000","last_peered":"2024-09-12T18:01:19.433834+0000","last_clean":"2024-09-12T18:01:19.433834+0000","last_became_active":"2024-09-12T17:23:50.187040+0000","last_became_peered":"2024-09-12T17:23:50.187040+0000","last_unstale":"2024-09-12T18:01:19.433834+0000","last_undegraded":"2024-09-12T18:01:19.433834+0000","last_fullsized":"2024-09-12T18:01:19.433834+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:15.392439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":190,"num_write":335,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"261'1232","reported_seq":2780,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.572788+0000","last_change":"2024-09-12T17:23:42.146501+0000","last_active":"2024-09-12T18:00:04.572788+0000","last_peered":"2024-09-12T18:00:04.572788+0000","last_clean":"2024-09-12T18:00:04.572788+0000","last_became_active":"2024-09-12T17:23:42.146200+0000","last_became_peered":"2024-09-12T17:23:42.146200+0000","last_unstale":"2024-09-12T18:00:04.572788+0000","last_undegraded":"2024-09-12T18:00:04.572788+0000","last_fullsized":"2024-09-12T18:00:04.572788+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":1200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:34.628327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5862,"num_read_kb":5167,"num_write":1742,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":598,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.422110+0000","last_change":"2024-09-12T17:23:26.035893+0000","last_active":"2024-09-12T17:59:39.422110+0000","last_peered":"2024-09-12T17:59:39.422110+0000","last_clean":"2024-09-12T17:59:39.422110+0000","last_became_active":"2024-09-12T17:23:26.034872+0000","last_became_peered":"2024-09-12T17:23:26.034872+0000","last_unstale":"2024-09-12T17:59:39.422110+0000","last_undegraded":"2024-09-12T17:59:39.422110+0000","last_fullsized":"2024-09-12T17:59:39.422110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:24.539348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:24.539348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:24.539348+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:20.611359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":510,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.416227+0000","last_change":"2024-09-12T17:23:33.596450+0000","last_active":"2024-09-12T17:58:59.416227+0000","last_peered":"2024-09-12T17:58:59.416227+0000","last_clean":"2024-09-12T17:58:59.416227+0000","last_became_active":"2024-09-12T17:23:31.584884+0000","last_became_peered":"2024-09-12T17:23:31.584884+0000","last_unstale":"2024-09-12T17:58:59.416227+0000","last_undegraded":"2024-09-12T17:58:59.416227+0000","last_fullsized":"2024-09-12T17:58:59.416227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:30.448834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423087,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"261'250","reported_seq":879,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.339404+0000","last_change":"2024-09-12T17:23:40.719236+0000","last_active":"2024-09-12T18:00:05.339404+0000","last_peered":"2024-09-12T18:00:05.339404+0000","last_clean":"2024-09-12T18:00:05.339404+0000","last_became_active":"2024-09-12T17:23:40.718896+0000","last_became_peered":"2024-09-12T17:23:40.718896+0000","last_unstale":"2024-09-12T18:00:05.339404+0000","last_undegraded":"2024-09-12T18:00:05.339404+0000","last_fullsized":"2024-09-12T18:00:05.339404+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:57.032804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9611018,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":420,"num_read_kb":13107,"num_write":959,"num_write_kb":39939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"35'3","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.980832+0000","last_change":"2024-09-12T17:23:44.152872+0000","last_active":"2024-09-12T18:01:48.980832+0000","last_peered":"2024-09-12T18:01:48.980832+0000","last_clean":"2024-09-12T18:01:48.980832+0000","last_became_active":"2024-09-12T17:23:44.152585+0000","last_became_peered":"2024-09-12T17:23:44.152585+0000","last_unstale":"2024-09-12T18:01:48.980832+0000","last_undegraded":"2024-09-12T18:01:48.980832+0000","last_fullsized":"2024-09-12T18:01:48.980832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:27.878346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"261'702","reported_seq":1377,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.424642+0000","last_change":"2024-09-12T17:23:46.152000+0000","last_active":"2024-09-12T18:01:42.424642+0000","last_peered":"2024-09-12T18:01:42.424642+0000","last_clean":"2024-09-12T18:01:42.424642+0000","last_became_active":"2024-09-12T17:23:46.151673+0000","last_became_peered":"2024-09-12T17:23:46.151673+0000","last_unstale":"2024-09-12T18:01:42.424642+0000","last_undegraded":"2024-09-12T18:01:42.424642+0000","last_fullsized":"2024-09-12T18:01:42.424642+0000","mapping_epoch":29,"log_start":"261'600","ondisk_log_start":"261'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:23.689449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174355,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1389,"num_read_kb":2882,"num_write":1336,"num_write_kb":1200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.539616+0000","last_change":"2024-09-12T17:23:48.170416+0000","last_active":"2024-09-12T17:58:29.539616+0000","last_peered":"2024-09-12T17:58:29.539616+0000","last_clean":"2024-09-12T17:58:29.539616+0000","last_became_active":"2024-09-12T17:23:48.170153+0000","last_became_peered":"2024-09-12T17:23:48.170153+0000","last_unstale":"2024-09-12T17:58:29.539616+0000","last_undegraded":"2024-09-12T17:58:29.539616+0000","last_fullsized":"2024-09-12T17:58:29.539616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:47.543479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"261'224","reported_seq":941,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.565834+0000","last_change":"2024-09-12T17:23:50.188844+0000","last_active":"2024-09-12T18:00:18.565834+0000","last_peered":"2024-09-12T18:00:18.565834+0000","last_clean":"2024-09-12T18:00:18.565834+0000","last_became_active":"2024-09-12T17:23:50.188552+0000","last_became_peered":"2024-09-12T17:23:50.188552+0000","last_unstale":"2024-09-12T18:00:18.565834+0000","last_undegraded":"2024-09-12T18:00:18.565834+0000","last_fullsized":"2024-09-12T18:00:18.565834+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:48.789056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":580,"num_write":503,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"261'388","reported_seq":1826,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.139142+0000","last_change":"2024-09-12T17:23:42.147326+0000","last_active":"2024-09-12T18:00:03.139142+0000","last_peered":"2024-09-12T18:00:03.139142+0000","last_clean":"2024-09-12T18:00:03.139142+0000","last_became_active":"2024-09-12T17:23:42.147045+0000","last_became_peered":"2024-09-12T17:23:42.147045+0000","last_unstale":"2024-09-12T18:00:03.139142+0000","last_undegraded":"2024-09-12T18:00:03.139142+0000","last_fullsized":"2024-09-12T18:00:03.139142+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:25.431740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2080,"num_read_kb":1972,"num_write":429,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":507,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.422739+0000","last_change":"2024-09-12T17:23:33.971250+0000","last_active":"2024-09-12T17:59:44.422739+0000","last_peered":"2024-09-12T17:59:44.422739+0000","last_clean":"2024-09-12T17:59:44.422739+0000","last_became_active":"2024-09-12T17:23:31.588699+0000","last_became_peered":"2024-09-12T17:23:31.588699+0000","last_unstale":"2024-09-12T17:59:44.422739+0000","last_undegraded":"2024-09-12T17:59:44.422739+0000","last_fullsized":"2024-09-12T17:59:44.422739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:46.725886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052181899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"261'288","reported_seq":954,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.528338+0000","last_change":"2024-09-12T17:23:40.713799+0000","last_active":"2024-09-12T18:01:49.528338+0000","last_peered":"2024-09-12T18:01:49.528338+0000","last_clean":"2024-09-12T18:01:49.528338+0000","last_became_active":"2024-09-12T17:23:40.713199+0000","last_became_peered":"2024-09-12T17:23:40.713199+0000","last_unstale":"2024-09-12T18:01:49.528338+0000","last_undegraded":"2024-09-12T18:01:49.528338+0000","last_fullsized":"2024-09-12T18:01:49.528338+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:26.433676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7744105,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":523,"num_read_kb":39284,"num_write":1075,"num_write_kb":55994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.411614+0000","last_change":"2024-09-12T17:23:44.150487+0000","last_active":"2024-09-12T17:58:24.411614+0000","last_peered":"2024-09-12T17:58:24.411614+0000","last_clean":"2024-09-12T17:58:24.411614+0000","last_became_active":"2024-09-12T17:23:44.149400+0000","last_became_peered":"2024-09-12T17:23:44.149400+0000","last_unstale":"2024-09-12T17:58:24.411614+0000","last_undegraded":"2024-09-12T17:58:24.411614+0000","last_fullsized":"2024-09-12T17:58:24.411614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:43.627464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"261'1296","reported_seq":2668,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.423559+0000","last_change":"2024-09-12T17:23:46.145651+0000","last_active":"2024-09-12T18:01:49.423559+0000","last_peered":"2024-09-12T18:01:49.423559+0000","last_clean":"2024-09-12T18:01:49.423559+0000","last_became_active":"2024-09-12T17:23:46.145354+0000","last_became_peered":"2024-09-12T17:23:46.145354+0000","last_unstale":"2024-09-12T18:01:49.423559+0000","last_undegraded":"2024-09-12T18:01:49.423559+0000","last_fullsized":"2024-09-12T18:01:49.423559+0000","mapping_epoch":29,"log_start":"261'1200","ondisk_log_start":"261'1200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:28.485902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178990,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2040,"num_read_kb":3600,"num_write":1154,"num_write_kb":1001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:24.420299+0000","last_change":"2024-09-12T17:23:48.171635+0000","last_active":"2024-09-12T17:59:24.420299+0000","last_peered":"2024-09-12T17:59:24.420299+0000","last_clean":"2024-09-12T17:59:24.420299+0000","last_became_active":"2024-09-12T17:23:48.171355+0000","last_became_peered":"2024-09-12T17:23:48.171355+0000","last_unstale":"2024-09-12T17:59:24.420299+0000","last_undegraded":"2024-09-12T17:59:24.420299+0000","last_fullsized":"2024-09-12T17:59:24.420299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:15.550883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"261'108","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.915226+0000","last_change":"2024-09-12T17:23:50.639398+0000","last_active":"2024-09-12T17:59:59.915226+0000","last_peered":"2024-09-12T17:59:59.915226+0000","last_clean":"2024-09-12T17:59:59.915226+0000","last_became_active":"2024-09-12T17:23:50.639053+0000","last_became_peered":"2024-09-12T17:23:50.639053+0000","last_unstale":"2024-09-12T17:59:59.915226+0000","last_undegraded":"2024-09-12T17:59:59.915226+0000","last_fullsized":"2024-09-12T17:59:59.915226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:38.696802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":162,"num_write":260,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"261'909","reported_seq":2637,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559947+0000","last_change":"2024-09-12T17:23:42.146153+0000","last_active":"2024-09-12T18:00:18.559947+0000","last_peered":"2024-09-12T18:00:18.559947+0000","last_clean":"2024-09-12T18:00:18.559947+0000","last_became_active":"2024-09-12T17:23:42.145049+0000","last_became_peered":"2024-09-12T17:23:42.145049+0000","last_unstale":"2024-09-12T18:00:18.559947+0000","last_undegraded":"2024-09-12T18:00:18.559947+0000","last_fullsized":"2024-09-12T18:00:18.559947+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":800,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:41.855754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4463,"num_read_kb":4014,"num_write":1227,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":511,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:58.616407+0000","last_change":"2024-09-12T17:23:33.835818+0000","last_active":"2024-09-12T17:58:58.616407+0000","last_peered":"2024-09-12T17:58:58.616407+0000","last_clean":"2024-09-12T17:58:58.616407+0000","last_became_active":"2024-09-12T17:23:31.584259+0000","last_became_peered":"2024-09-12T17:23:31.584259+0000","last_unstale":"2024-09-12T17:58:58.616407+0000","last_undegraded":"2024-09-12T17:58:58.616407+0000","last_fullsized":"2024-09-12T17:58:58.616407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:33.916339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045870900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"261'264","reported_seq":886,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.787971+0000","last_change":"2024-09-12T17:23:40.712522+0000","last_active":"2024-09-12T17:59:54.787971+0000","last_peered":"2024-09-12T17:59:54.787971+0000","last_clean":"2024-09-12T17:59:54.787971+0000","last_became_active":"2024-09-12T17:23:40.712276+0000","last_became_peered":"2024-09-12T17:23:40.712276+0000","last_unstale":"2024-09-12T17:59:54.787971+0000","last_undegraded":"2024-09-12T17:59:54.787971+0000","last_fullsized":"2024-09-12T17:59:54.787971+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:20.254346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154629,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":392,"num_read_kb":8922,"num_write":1018,"num_write_kb":17941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.611618+0000","last_change":"2024-09-12T17:23:44.151286+0000","last_active":"2024-09-12T17:58:23.611618+0000","last_peered":"2024-09-12T17:58:23.611618+0000","last_clean":"2024-09-12T17:58:23.611618+0000","last_became_active":"2024-09-12T17:23:44.151006+0000","last_became_peered":"2024-09-12T17:23:44.151006+0000","last_unstale":"2024-09-12T17:58:23.611618+0000","last_undegraded":"2024-09-12T17:58:23.611618+0000","last_fullsized":"2024-09-12T17:58:23.611618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:17.405776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"261'194","reported_seq":1181,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.322144+0000","last_change":"2024-09-12T17:23:46.242242+0000","last_active":"2024-09-12T18:01:38.322144+0000","last_peered":"2024-09-12T18:01:38.322144+0000","last_clean":"2024-09-12T18:01:38.322144+0000","last_became_active":"2024-09-12T17:23:46.241733+0000","last_became_peered":"2024-09-12T17:23:46.241733+0000","last_unstale":"2024-09-12T18:01:38.322144+0000","last_undegraded":"2024-09-12T18:01:38.322144+0000","last_fullsized":"2024-09-12T18:01:38.322144+0000","mapping_epoch":29,"log_start":"258'100","ondisk_log_start":"258'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:35.528461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":152,"num_read_kb":143,"num_write":117,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.545833+0000","last_change":"2024-09-12T17:23:48.168199+0000","last_active":"2024-09-12T17:59:14.545833+0000","last_peered":"2024-09-12T17:59:14.545833+0000","last_clean":"2024-09-12T17:59:14.545833+0000","last_became_active":"2024-09-12T17:23:48.167920+0000","last_became_peered":"2024-09-12T17:23:48.167920+0000","last_unstale":"2024-09-12T17:59:14.545833+0000","last_undegraded":"2024-09-12T17:59:14.545833+0000","last_fullsized":"2024-09-12T17:59:14.545833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:52.699030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"261'262","reported_seq":858,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.252281+0000","last_change":"2024-09-12T17:23:50.177810+0000","last_active":"2024-09-12T18:00:18.252281+0000","last_peered":"2024-09-12T18:00:18.252281+0000","last_clean":"2024-09-12T18:00:18.252281+0000","last_became_active":"2024-09-12T17:23:50.177293+0000","last_became_peered":"2024-09-12T17:23:50.177293+0000","last_unstale":"2024-09-12T18:00:18.252281+0000","last_undegraded":"2024-09-12T18:00:18.252281+0000","last_fullsized":"2024-09-12T18:00:18.252281+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:35.764330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":569,"num_write":571,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"261'440","reported_seq":2030,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.397530+0000","last_change":"2024-09-12T17:23:42.136391+0000","last_active":"2024-09-12T18:01:41.397530+0000","last_peered":"2024-09-12T18:01:41.397530+0000","last_clean":"2024-09-12T18:01:41.397530+0000","last_became_active":"2024-09-12T17:23:42.136083+0000","last_became_peered":"2024-09-12T17:23:42.136083+0000","last_unstale":"2024-09-12T18:01:41.397530+0000","last_undegraded":"2024-09-12T18:01:41.397530+0000","last_fullsized":"2024-09-12T18:01:41.397530+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:29.889920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2433,"num_read_kb":2304,"num_write":511,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":511,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.416186+0000","last_change":"2024-09-12T17:23:33.596992+0000","last_active":"2024-09-12T17:58:59.416186+0000","last_peered":"2024-09-12T17:58:59.416186+0000","last_clean":"2024-09-12T17:58:59.416186+0000","last_became_active":"2024-09-12T17:23:31.588612+0000","last_became_peered":"2024-09-12T17:23:31.588612+0000","last_unstale":"2024-09-12T17:58:59.416186+0000","last_undegraded":"2024-09-12T17:58:59.416186+0000","last_fullsized":"2024-09-12T17:58:59.416186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:20.500808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095838300000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"261'277","reported_seq":993,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.360106+0000","last_change":"2024-09-12T17:23:40.717039+0000","last_active":"2024-09-12T18:00:04.360106+0000","last_peered":"2024-09-12T18:00:04.360106+0000","last_clean":"2024-09-12T18:00:04.360106+0000","last_became_active":"2024-09-12T17:23:40.716786+0000","last_became_peered":"2024-09-12T17:23:40.716786+0000","last_unstale":"2024-09-12T18:00:04.360106+0000","last_undegraded":"2024-09-12T18:00:04.360106+0000","last_fullsized":"2024-09-12T18:00:04.360106+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:37.161545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17125891,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":483,"num_read_kb":40133,"num_write":1009,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.545850+0000","last_change":"2024-09-12T17:23:44.151221+0000","last_active":"2024-09-12T17:59:14.545850+0000","last_peered":"2024-09-12T17:59:14.545850+0000","last_clean":"2024-09-12T17:59:14.545850+0000","last_became_active":"2024-09-12T17:23:44.150912+0000","last_became_peered":"2024-09-12T17:23:44.150912+0000","last_unstale":"2024-09-12T17:59:14.545850+0000","last_undegraded":"2024-09-12T17:59:14.545850+0000","last_fullsized":"2024-09-12T17:59:14.545850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:09.750577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"261'109","reported_seq":634,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:38.427984+0000","last_change":"2024-09-12T17:23:46.155872+0000","last_active":"2024-09-12T18:00:38.427984+0000","last_peered":"2024-09-12T18:00:38.427984+0000","last_clean":"2024-09-12T18:00:38.427984+0000","last_became_active":"2024-09-12T17:23:46.155516+0000","last_became_peered":"2024-09-12T17:23:46.155516+0000","last_unstale":"2024-09-12T18:00:38.427984+0000","last_undegraded":"2024-09-12T18:00:38.427984+0000","last_fullsized":"2024-09-12T18:00:38.427984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:35.167613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":92,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.409748+0000","last_change":"2024-09-12T17:23:48.171371+0000","last_active":"2024-09-12T17:58:29.409748+0000","last_peered":"2024-09-12T17:58:29.409748+0000","last_clean":"2024-09-12T17:58:29.409748+0000","last_became_active":"2024-09-12T17:23:48.170462+0000","last_became_peered":"2024-09-12T17:23:48.170462+0000","last_unstale":"2024-09-12T17:58:29.409748+0000","last_undegraded":"2024-09-12T17:58:29.409748+0000","last_fullsized":"2024-09-12T17:58:29.409748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:11.276085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":655,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.159077+0000","last_change":"2024-09-12T17:23:50.186802+0000","last_active":"2024-09-12T18:00:18.159077+0000","last_peered":"2024-09-12T18:00:18.159077+0000","last_clean":"2024-09-12T18:00:18.159077+0000","last_became_active":"2024-09-12T17:23:50.186526+0000","last_became_peered":"2024-09-12T17:23:50.186526+0000","last_unstale":"2024-09-12T18:00:18.159077+0000","last_undegraded":"2024-09-12T18:00:18.159077+0000","last_fullsized":"2024-09-12T18:00:18.159077+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:15.982689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":247,"num_write":303,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"261'540","reported_seq":2255,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.146276+0000","last_change":"2024-09-12T17:23:42.151997+0000","last_active":"2024-09-12T18:00:18.146276+0000","last_peered":"2024-09-12T18:00:18.146276+0000","last_clean":"2024-09-12T18:00:18.146276+0000","last_became_active":"2024-09-12T17:23:42.151735+0000","last_became_peered":"2024-09-12T17:23:42.151735+0000","last_unstale":"2024-09-12T18:00:18.146276+0000","last_undegraded":"2024-09-12T18:00:18.146276+0000","last_fullsized":"2024-09-12T18:00:18.146276+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:29.033253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2982,"num_read_kb":2809,"num_write":660,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"261'257","reported_seq":846,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:00.087538+0000","last_change":"2024-09-12T17:23:40.712919+0000","last_active":"2024-09-12T18:00:00.087538+0000","last_peered":"2024-09-12T18:00:00.087538+0000","last_clean":"2024-09-12T18:00:00.087538+0000","last_became_active":"2024-09-12T17:23:40.712386+0000","last_became_peered":"2024-09-12T17:23:40.712386+0000","last_unstale":"2024-09-12T18:00:00.087538+0000","last_undegraded":"2024-09-12T18:00:00.087538+0000","last_fullsized":"2024-09-12T18:00:00.087538+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:54.407762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6538157,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":353,"num_read_kb":6504,"num_write":929,"num_write_kb":34893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":513,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.415656+0000","last_change":"2024-09-12T17:23:33.592955+0000","last_active":"2024-09-12T17:58:59.415656+0000","last_peered":"2024-09-12T17:58:59.415656+0000","last_clean":"2024-09-12T17:58:59.415656+0000","last_became_active":"2024-09-12T17:23:31.681209+0000","last_became_peered":"2024-09-12T17:23:31.681209+0000","last_unstale":"2024-09-12T17:58:59.415656+0000","last_undegraded":"2024-09-12T17:58:59.415656+0000","last_fullsized":"2024-09-12T17:58:59.415656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:00.576073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056110600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.545208+0000","last_change":"2024-09-12T17:23:44.148393+0000","last_active":"2024-09-12T17:59:09.545208+0000","last_peered":"2024-09-12T17:59:09.545208+0000","last_clean":"2024-09-12T17:59:09.545208+0000","last_became_active":"2024-09-12T17:23:44.148035+0000","last_became_peered":"2024-09-12T17:23:44.148035+0000","last_unstale":"2024-09-12T17:59:09.545208+0000","last_undegraded":"2024-09-12T17:59:09.545208+0000","last_fullsized":"2024-09-12T17:59:09.545208+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:03.387749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"261'555","reported_seq":1188,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.441319+0000","last_change":"2024-09-12T17:23:46.152284+0000","last_active":"2024-09-12T18:01:49.441319+0000","last_peered":"2024-09-12T18:01:49.441319+0000","last_clean":"2024-09-12T18:01:49.441319+0000","last_became_active":"2024-09-12T17:23:46.151649+0000","last_became_peered":"2024-09-12T17:23:46.151649+0000","last_unstale":"2024-09-12T18:01:49.441319+0000","last_undegraded":"2024-09-12T18:01:49.441319+0000","last_fullsized":"2024-09-12T18:01:49.441319+0000","mapping_epoch":29,"log_start":"261'500","ondisk_log_start":"261'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:44.755894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106631,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1501,"num_read_kb":2466,"num_write":1946,"num_write_kb":1783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418523+0000","last_change":"2024-09-12T17:23:48.166489+0000","last_active":"2024-09-12T17:59:14.418523+0000","last_peered":"2024-09-12T17:59:14.418523+0000","last_clean":"2024-09-12T17:59:14.418523+0000","last_became_active":"2024-09-12T17:23:48.166196+0000","last_became_peered":"2024-09-12T17:23:48.166196+0000","last_unstale":"2024-09-12T17:59:14.418523+0000","last_undegraded":"2024-09-12T17:59:14.418523+0000","last_fullsized":"2024-09-12T17:59:14.418523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:02.318935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"261'221","reported_seq":721,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.429767+0000","last_change":"2024-09-12T17:23:50.640504+0000","last_active":"2024-09-12T17:59:58.429767+0000","last_peered":"2024-09-12T17:59:58.429767+0000","last_clean":"2024-09-12T17:59:58.429767+0000","last_became_active":"2024-09-12T17:23:50.640185+0000","last_became_peered":"2024-09-12T17:23:50.640185+0000","last_unstale":"2024-09-12T17:59:58.429767+0000","last_undegraded":"2024-09-12T17:59:58.429767+0000","last_fullsized":"2024-09-12T17:59:58.429767+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:20.014900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":243,"num_write":513,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"261'509","reported_seq":2065,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.462615+0000","last_change":"2024-09-12T17:23:42.148853+0000","last_active":"2024-09-12T18:00:02.462615+0000","last_peered":"2024-09-12T18:00:02.462615+0000","last_clean":"2024-09-12T18:00:02.462615+0000","last_became_active":"2024-09-12T17:23:42.148578+0000","last_became_peered":"2024-09-12T17:23:42.148578+0000","last_unstale":"2024-09-12T18:00:02.462615+0000","last_undegraded":"2024-09-12T18:00:02.462615+0000","last_fullsized":"2024-09-12T18:00:02.462615+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:05.365806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2709,"num_read_kb":2501,"num_write":646,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"261'292","reported_seq":914,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:56.793221+0000","last_change":"2024-09-12T17:23:40.711077+0000","last_active":"2024-09-12T17:59:56.793221+0000","last_peered":"2024-09-12T17:59:56.793221+0000","last_clean":"2024-09-12T17:59:56.793221+0000","last_became_active":"2024-09-12T17:23:40.710780+0000","last_became_peered":"2024-09-12T17:23:40.710780+0000","last_unstale":"2024-09-12T17:59:56.793221+0000","last_undegraded":"2024-09-12T17:59:56.793221+0000","last_fullsized":"2024-09-12T17:59:56.793221+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:38.403382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615620,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":428,"num_read_kb":525,"num_write":1166,"num_write_kb":43788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":506,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.418269+0000","last_change":"2024-09-12T17:23:33.971206+0000","last_active":"2024-09-12T17:59:09.418269+0000","last_peered":"2024-09-12T17:59:09.418269+0000","last_clean":"2024-09-12T17:59:09.418269+0000","last_became_active":"2024-09-12T17:23:31.681155+0000","last_became_peered":"2024-09-12T17:23:31.681155+0000","last_unstale":"2024-09-12T17:59:09.418269+0000","last_undegraded":"2024-09-12T17:59:09.418269+0000","last_fullsized":"2024-09-12T17:59:09.418269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:20.293962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048562399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415369+0000","last_change":"2024-09-12T17:23:44.147684+0000","last_active":"2024-09-12T17:59:09.415369+0000","last_peered":"2024-09-12T17:59:09.415369+0000","last_clean":"2024-09-12T17:59:09.415369+0000","last_became_active":"2024-09-12T17:23:44.147347+0000","last_became_peered":"2024-09-12T17:23:44.147347+0000","last_unstale":"2024-09-12T17:59:09.415369+0000","last_undegraded":"2024-09-12T17:59:09.415369+0000","last_fullsized":"2024-09-12T17:59:09.415369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:45.660164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"261'149","reported_seq":697,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:23.414940+0000","last_change":"2024-09-12T17:23:46.241508+0000","last_active":"2024-09-12T18:00:23.414940+0000","last_peered":"2024-09-12T18:00:23.414940+0000","last_clean":"2024-09-12T18:00:23.414940+0000","last_became_active":"2024-09-12T17:23:46.241046+0000","last_became_peered":"2024-09-12T17:23:46.241046+0000","last_unstale":"2024-09-12T18:00:23.414940+0000","last_undegraded":"2024-09-12T18:00:23.414940+0000","last_fullsized":"2024-09-12T18:00:23.414940+0000","mapping_epoch":29,"log_start":"258'100","ondisk_log_start":"258'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:42.691500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":154,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"261'789","reported_seq":2338,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.413214+0000","last_change":"2024-09-12T17:23:48.173674+0000","last_active":"2024-09-12T18:01:49.413214+0000","last_peered":"2024-09-12T18:01:49.413214+0000","last_clean":"2024-09-12T18:01:49.413214+0000","last_became_active":"2024-09-12T17:23:48.173351+0000","last_became_peered":"2024-09-12T17:23:48.173351+0000","last_unstale":"2024-09-12T18:01:49.413214+0000","last_undegraded":"2024-09-12T18:01:49.413214+0000","last_fullsized":"2024-09-12T18:01:49.413214+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:23.841940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"261'101","reported_seq":588,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.422953+0000","last_change":"2024-09-12T17:23:50.639372+0000","last_active":"2024-09-12T17:59:58.422953+0000","last_peered":"2024-09-12T17:59:58.422953+0000","last_clean":"2024-09-12T17:59:58.422953+0000","last_became_active":"2024-09-12T17:23:50.639054+0000","last_became_peered":"2024-09-12T17:23:50.639054+0000","last_unstale":"2024-09-12T17:59:58.422953+0000","last_undegraded":"2024-09-12T17:59:58.422953+0000","last_fullsized":"2024-09-12T17:59:58.422953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:27.121755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":220,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"261'494","reported_seq":2015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559802+0000","last_change":"2024-09-12T17:23:42.148855+0000","last_active":"2024-09-12T18:00:18.559802+0000","last_peered":"2024-09-12T18:00:18.559802+0000","last_clean":"2024-09-12T18:00:18.559802+0000","last_became_active":"2024-09-12T17:23:42.148523+0000","last_became_peered":"2024-09-12T17:23:42.148523+0000","last_unstale":"2024-09-12T18:00:18.559802+0000","last_undegraded":"2024-09-12T18:00:18.559802+0000","last_fullsized":"2024-09-12T18:00:18.559802+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:44.314747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2488,"num_read_kb":2312,"num_write":602,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"261'313","reported_seq":1029,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.574035+0000","last_change":"2024-09-12T17:23:40.709406+0000","last_active":"2024-09-12T18:00:16.574035+0000","last_peered":"2024-09-12T18:00:16.574035+0000","last_clean":"2024-09-12T18:00:16.574035+0000","last_became_active":"2024-09-12T17:23:40.709077+0000","last_became_peered":"2024-09-12T17:23:40.709077+0000","last_unstale":"2024-09-12T18:00:16.574035+0000","last_undegraded":"2024-09-12T18:00:16.574035+0000","last_fullsized":"2024-09-12T18:00:16.574035+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:24.640342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19888358,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":626,"num_read_kb":135818,"num_write":1161,"num_write_kb":56746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":512,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.409415+0000","last_change":"2024-09-12T17:23:33.592959+0000","last_active":"2024-09-12T17:58:14.409415+0000","last_peered":"2024-09-12T17:58:14.409415+0000","last_clean":"2024-09-12T17:58:14.409415+0000","last_became_active":"2024-09-12T17:23:31.588526+0000","last_became_peered":"2024-09-12T17:23:31.588526+0000","last_unstale":"2024-09-12T17:58:14.409415+0000","last_undegraded":"2024-09-12T17:58:14.409415+0000","last_fullsized":"2024-09-12T17:58:14.409415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:32.240058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055923099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417985+0000","last_change":"2024-09-12T17:23:44.148290+0000","last_active":"2024-09-12T17:59:09.417985+0000","last_peered":"2024-09-12T17:59:09.417985+0000","last_clean":"2024-09-12T17:59:09.417985+0000","last_became_active":"2024-09-12T17:23:44.147594+0000","last_became_peered":"2024-09-12T17:23:44.147594+0000","last_unstale":"2024-09-12T17:59:09.417985+0000","last_undegraded":"2024-09-12T17:59:09.417985+0000","last_fullsized":"2024-09-12T17:59:09.417985+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:51.406975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"261'97","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.150898+0000","last_change":"2024-09-12T17:23:46.151701+0000","last_active":"2024-09-12T18:00:18.150898+0000","last_peered":"2024-09-12T18:00:18.150898+0000","last_clean":"2024-09-12T18:00:18.150898+0000","last_became_active":"2024-09-12T17:23:46.151335+0000","last_became_peered":"2024-09-12T17:23:46.151335+0000","last_unstale":"2024-09-12T18:00:18.150898+0000","last_undegraded":"2024-09-12T18:00:18.150898+0000","last_fullsized":"2024-09-12T18:00:18.150898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:23.162677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"261'804","reported_seq":2584,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.455650+0000","last_change":"2024-09-12T17:23:48.168044+0000","last_active":"2024-09-12T18:01:42.455650+0000","last_peered":"2024-09-12T18:01:42.455650+0000","last_clean":"2024-09-12T18:01:42.455650+0000","last_became_active":"2024-09-12T17:23:48.167739+0000","last_became_peered":"2024-09-12T17:23:48.167739+0000","last_unstale":"2024-09-12T18:01:42.455650+0000","last_undegraded":"2024-09-12T18:01:42.455650+0000","last_fullsized":"2024-09-12T18:01:42.455650+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:25.436138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"261'311","reported_seq":829,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.346118+0000","last_change":"2024-09-12T17:23:50.179480+0000","last_active":"2024-09-12T18:01:41.346118+0000","last_peered":"2024-09-12T18:01:41.346118+0000","last_clean":"2024-09-12T18:01:41.346118+0000","last_became_active":"2024-09-12T17:23:50.179127+0000","last_became_peered":"2024-09-12T17:23:50.179127+0000","last_unstale":"2024-09-12T18:01:41.346118+0000","last_undegraded":"2024-09-12T18:01:41.346118+0000","last_fullsized":"2024-09-12T18:01:41.346118+0000","mapping_epoch":33,"log_start":"261'300","ondisk_log_start":"261'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:11.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":442,"num_write":705,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"261'1030","reported_seq":2757,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.227573+0000","last_change":"2024-09-12T17:23:42.145784+0000","last_active":"2024-09-12T18:00:05.227573+0000","last_peered":"2024-09-12T18:00:05.227573+0000","last_clean":"2024-09-12T18:00:05.227573+0000","last_became_active":"2024-09-12T17:23:42.145139+0000","last_became_peered":"2024-09-12T17:23:42.145139+0000","last_unstale":"2024-09-12T18:00:05.227573+0000","last_undegraded":"2024-09-12T18:00:05.227573+0000","last_fullsized":"2024-09-12T18:00:05.227573+0000","mapping_epoch":25,"log_start":"261'1000","ondisk_log_start":"261'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1000,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:16.782381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4954,"num_read_kb":4437,"num_write":1455,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"261'305","reported_seq":952,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.520960+0000","last_change":"2024-09-12T17:23:40.713302+0000","last_active":"2024-09-12T18:01:49.520960+0000","last_peered":"2024-09-12T18:01:49.520960+0000","last_clean":"2024-09-12T18:01:49.520960+0000","last_became_active":"2024-09-12T17:23:40.712974+0000","last_became_peered":"2024-09-12T17:23:40.712974+0000","last_unstale":"2024-09-12T18:01:49.520960+0000","last_undegraded":"2024-09-12T18:01:49.520960+0000","last_fullsized":"2024-09-12T18:01:49.520960+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:22.541324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582155,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":449,"num_read_kb":103143,"num_write":1105,"num_write_kb":43429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":507,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.407867+0000","last_change":"2024-09-12T17:23:33.971199+0000","last_active":"2024-09-12T17:58:14.407867+0000","last_peered":"2024-09-12T17:58:14.407867+0000","last_clean":"2024-09-12T17:58:14.407867+0000","last_became_active":"2024-09-12T17:23:31.588266+0000","last_became_peered":"2024-09-12T17:23:31.588266+0000","last_unstale":"2024-09-12T17:58:14.407867+0000","last_undegraded":"2024-09-12T17:58:14.407867+0000","last_fullsized":"2024-09-12T17:58:14.407867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:05.248877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051630700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.421688+0000","last_change":"2024-09-12T17:23:44.149935+0000","last_active":"2024-09-12T17:59:48.421688+0000","last_peered":"2024-09-12T17:59:48.421688+0000","last_clean":"2024-09-12T17:59:48.421688+0000","last_became_active":"2024-09-12T17:23:44.149649+0000","last_became_peered":"2024-09-12T17:23:44.149649+0000","last_unstale":"2024-09-12T17:59:48.421688+0000","last_undegraded":"2024-09-12T17:59:48.421688+0000","last_fullsized":"2024-09-12T17:59:48.421688+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:06.362964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"261'681","reported_seq":1366,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.430148+0000","last_change":"2024-09-12T17:23:46.242153+0000","last_active":"2024-09-12T18:01:49.430148+0000","last_peered":"2024-09-12T18:01:49.430148+0000","last_clean":"2024-09-12T18:01:49.430148+0000","last_became_active":"2024-09-12T17:23:46.241681+0000","last_became_peered":"2024-09-12T17:23:46.241681+0000","last_unstale":"2024-09-12T18:01:49.430148+0000","last_undegraded":"2024-09-12T18:01:49.430148+0000","last_fullsized":"2024-09-12T18:01:49.430148+0000","mapping_epoch":29,"log_start":"261'600","ondisk_log_start":"261'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":600,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:06.488679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180006,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1211,"num_read_kb":2636,"num_write":996,"num_write_kb":858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:13.416822+0000","last_change":"2024-09-12T17:23:48.170996+0000","last_active":"2024-09-12T17:59:13.416822+0000","last_peered":"2024-09-12T17:59:13.416822+0000","last_clean":"2024-09-12T17:59:13.416822+0000","last_became_active":"2024-09-12T17:23:48.170687+0000","last_became_peered":"2024-09-12T17:23:48.170687+0000","last_unstale":"2024-09-12T17:59:13.416822+0000","last_undegraded":"2024-09-12T17:59:13.416822+0000","last_fullsized":"2024-09-12T17:59:13.416822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:56.021234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"261'136","reported_seq":667,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.547879+0000","last_change":"2024-09-12T17:23:50.189525+0000","last_active":"2024-09-12T18:00:18.547879+0000","last_peered":"2024-09-12T18:00:18.547879+0000","last_clean":"2024-09-12T18:00:18.547879+0000","last_became_active":"2024-09-12T17:23:50.188042+0000","last_became_peered":"2024-09-12T17:23:50.188042+0000","last_unstale":"2024-09-12T18:00:18.547879+0000","last_undegraded":"2024-09-12T18:00:18.547879+0000","last_fullsized":"2024-09-12T18:00:18.547879+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:12.246421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":351,"num_read_kb":302,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"261'129","reported_seq":670,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.665733+0000","last_change":"2024-09-12T17:23:50.190175+0000","last_active":"2024-09-12T18:00:18.665733+0000","last_peered":"2024-09-12T18:00:18.665733+0000","last_clean":"2024-09-12T18:00:18.665733+0000","last_became_active":"2024-09-12T17:23:50.189955+0000","last_became_peered":"2024-09-12T17:23:50.189955+0000","last_unstale":"2024-09-12T18:00:18.665733+0000","last_undegraded":"2024-09-12T18:00:18.665733+0000","last_fullsized":"2024-09-12T18:00:18.665733+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:05.002727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":232,"num_write":318,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"261'329","reported_seq":1796,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559462+0000","last_change":"2024-09-12T17:23:42.139182+0000","last_active":"2024-09-12T18:00:18.559462+0000","last_peered":"2024-09-12T18:00:18.559462+0000","last_clean":"2024-09-12T18:00:18.559462+0000","last_became_active":"2024-09-12T17:23:42.138899+0000","last_became_peered":"2024-09-12T17:23:42.138899+0000","last_unstale":"2024-09-12T18:00:18.559462+0000","last_undegraded":"2024-09-12T18:00:18.559462+0000","last_fullsized":"2024-09-12T18:00:18.559462+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:52.392138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1873,"num_read_kb":1826,"num_write":350,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"261'303","reported_seq":936,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.572606+0000","last_change":"2024-09-12T17:23:40.709618+0000","last_active":"2024-09-12T18:00:16.572606+0000","last_peered":"2024-09-12T18:00:16.572606+0000","last_clean":"2024-09-12T18:00:16.572606+0000","last_became_active":"2024-09-12T17:23:40.709219+0000","last_became_peered":"2024-09-12T17:23:40.709219+0000","last_unstale":"2024-09-12T18:00:16.572606+0000","last_undegraded":"2024-09-12T18:00:16.572606+0000","last_fullsized":"2024-09-12T18:00:16.572606+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:01.388035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":701751,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":497,"num_read_kb":4301,"num_write":1202,"num_write_kb":9304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.413627+0000","last_change":"2024-09-12T17:23:44.151482+0000","last_active":"2024-09-12T17:58:44.413627+0000","last_peered":"2024-09-12T17:58:44.413627+0000","last_clean":"2024-09-12T17:58:44.413627+0000","last_became_active":"2024-09-12T17:23:44.151175+0000","last_became_peered":"2024-09-12T17:23:44.151175+0000","last_unstale":"2024-09-12T17:58:44.413627+0000","last_undegraded":"2024-09-12T17:58:44.413627+0000","last_fullsized":"2024-09-12T17:58:44.413627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:07.283799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"261'271","reported_seq":826,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:08.431619+0000","last_change":"2024-09-12T17:23:46.151842+0000","last_active":"2024-09-12T18:01:08.431619+0000","last_peered":"2024-09-12T18:01:08.431619+0000","last_clean":"2024-09-12T18:01:08.431619+0000","last_became_active":"2024-09-12T17:23:46.150505+0000","last_became_peered":"2024-09-12T17:23:46.150505+0000","last_unstale":"2024-09-12T18:01:08.431619+0000","last_undegraded":"2024-09-12T18:01:08.431619+0000","last_fullsized":"2024-09-12T18:01:08.431619+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:29.365545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92207,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":466,"num_read_kb":1051,"num_write":390,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.413394+0000","last_change":"2024-09-12T17:23:48.168196+0000","last_active":"2024-09-12T17:58:48.413394+0000","last_peered":"2024-09-12T17:58:48.413394+0000","last_clean":"2024-09-12T17:58:48.413394+0000","last_became_active":"2024-09-12T17:23:48.167911+0000","last_became_peered":"2024-09-12T17:23:48.167911+0000","last_unstale":"2024-09-12T17:58:48.413394+0000","last_undegraded":"2024-09-12T17:58:48.413394+0000","last_fullsized":"2024-09-12T17:58:48.413394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:27.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"261'95","reported_seq":584,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.804808+0000","last_change":"2024-09-12T17:23:50.183763+0000","last_active":"2024-09-12T17:59:38.804808+0000","last_peered":"2024-09-12T17:59:38.804808+0000","last_clean":"2024-09-12T17:59:38.804808+0000","last_became_active":"2024-09-12T17:23:50.183400+0000","last_became_peered":"2024-09-12T17:23:50.183400+0000","last_unstale":"2024-09-12T17:59:38.804808+0000","last_undegraded":"2024-09-12T17:59:38.804808+0000","last_fullsized":"2024-09-12T17:59:38.804808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:30.231346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":128,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"261'478","reported_seq":1884,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.785644+0000","last_change":"2024-09-12T17:23:42.138814+0000","last_active":"2024-09-12T18:00:05.785644+0000","last_peered":"2024-09-12T18:00:05.785644+0000","last_clean":"2024-09-12T18:00:05.785644+0000","last_became_active":"2024-09-12T17:23:42.137988+0000","last_became_peered":"2024-09-12T17:23:42.137988+0000","last_unstale":"2024-09-12T18:00:05.785644+0000","last_undegraded":"2024-09-12T18:00:05.785644+0000","last_fullsized":"2024-09-12T18:00:05.785644+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:34.256530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2384,"num_read_kb":2190,"num_write":595,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"261'304","reported_seq":942,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.146183+0000","last_change":"2024-09-12T17:23:40.711108+0000","last_active":"2024-09-12T18:00:02.146183+0000","last_peered":"2024-09-12T18:00:02.146183+0000","last_clean":"2024-09-12T18:00:02.146183+0000","last_became_active":"2024-09-12T17:23:40.710425+0000","last_became_peered":"2024-09-12T17:23:40.710425+0000","last_unstale":"2024-09-12T18:00:02.146183+0000","last_undegraded":"2024-09-12T18:00:02.146183+0000","last_fullsized":"2024-09-12T18:00:02.146183+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:29.912015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19579553,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":475,"num_read_kb":49330,"num_write":1083,"num_write_kb":37186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:43.412561+0000","last_change":"2024-09-12T17:23:44.149929+0000","last_active":"2024-09-12T17:58:43.412561+0000","last_peered":"2024-09-12T17:58:43.412561+0000","last_clean":"2024-09-12T17:58:43.412561+0000","last_became_active":"2024-09-12T17:23:44.148078+0000","last_became_peered":"2024-09-12T17:23:44.148078+0000","last_unstale":"2024-09-12T17:58:43.412561+0000","last_undegraded":"2024-09-12T17:58:43.412561+0000","last_fullsized":"2024-09-12T17:58:43.412561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:27.562908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"261'42","reported_seq":529,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.542596+0000","last_change":"2024-09-12T17:23:46.152014+0000","last_active":"2024-09-12T17:58:49.542596+0000","last_peered":"2024-09-12T17:58:49.542596+0000","last_clean":"2024-09-12T17:58:49.542596+0000","last_became_active":"2024-09-12T17:23:46.151258+0000","last_became_peered":"2024-09-12T17:23:46.151258+0000","last_unstale":"2024-09-12T17:58:49.542596+0000","last_undegraded":"2024-09-12T17:58:49.542596+0000","last_fullsized":"2024-09-12T17:58:49.542596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.540146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":25,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.415800+0000","last_change":"2024-09-12T17:23:48.174102+0000","last_active":"2024-09-12T17:58:49.415800+0000","last_peered":"2024-09-12T17:58:49.415800+0000","last_clean":"2024-09-12T17:58:49.415800+0000","last_became_active":"2024-09-12T17:23:48.173781+0000","last_became_peered":"2024-09-12T17:23:48.173781+0000","last_unstale":"2024-09-12T17:58:49.415800+0000","last_undegraded":"2024-09-12T17:58:49.415800+0000","last_fullsized":"2024-09-12T17:58:49.415800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:42.236527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"261'166","reported_seq":668,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.152209+0000","last_change":"2024-09-12T17:23:50.184117+0000","last_active":"2024-09-12T18:00:18.152209+0000","last_peered":"2024-09-12T18:00:18.152209+0000","last_clean":"2024-09-12T18:00:18.152209+0000","last_became_active":"2024-09-12T17:23:50.183784+0000","last_became_peered":"2024-09-12T17:23:50.183784+0000","last_unstale":"2024-09-12T18:00:18.152209+0000","last_undegraded":"2024-09-12T18:00:18.152209+0000","last_fullsized":"2024-09-12T18:00:18.152209+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:59.251619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":278,"num_read_kb":278,"num_write":359,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"261'417","reported_seq":1952,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.897757+0000","last_change":"2024-09-12T17:23:42.147200+0000","last_active":"2024-09-12T18:00:04.897757+0000","last_peered":"2024-09-12T18:00:04.897757+0000","last_clean":"2024-09-12T18:00:04.897757+0000","last_became_active":"2024-09-12T17:23:42.146703+0000","last_became_peered":"2024-09-12T17:23:42.146703+0000","last_unstale":"2024-09-12T18:00:04.897757+0000","last_undegraded":"2024-09-12T18:00:04.897757+0000","last_fullsized":"2024-09-12T18:00:04.897757+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:00.134623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2240,"num_read_kb":2131,"num_write":479,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"261'228","reported_seq":885,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:01.304117+0000","last_change":"2024-09-12T17:23:40.704662+0000","last_active":"2024-09-12T18:00:01.304117+0000","last_peered":"2024-09-12T18:00:01.304117+0000","last_clean":"2024-09-12T18:00:01.304117+0000","last_became_active":"2024-09-12T17:23:40.704278+0000","last_became_peered":"2024-09-12T17:23:40.704278+0000","last_unstale":"2024-09-12T18:00:01.304117+0000","last_undegraded":"2024-09-12T18:00:01.304117+0000","last_fullsized":"2024-09-12T18:00:01.304117+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:07.570947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19121762,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":418,"num_read_kb":96513,"num_write":866,"num_write_kb":33057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.415015+0000","last_change":"2024-09-12T17:23:44.151075+0000","last_active":"2024-09-12T17:58:44.415015+0000","last_peered":"2024-09-12T17:58:44.415015+0000","last_clean":"2024-09-12T17:58:44.415015+0000","last_became_active":"2024-09-12T17:23:44.149838+0000","last_became_peered":"2024-09-12T17:23:44.149838+0000","last_unstale":"2024-09-12T17:58:44.415015+0000","last_undegraded":"2024-09-12T17:58:44.415015+0000","last_fullsized":"2024-09-12T17:58:44.415015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:30.715787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"261'296","reported_seq":867,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:08.431649+0000","last_change":"2024-09-12T17:23:46.150856+0000","last_active":"2024-09-12T18:01:08.431649+0000","last_peered":"2024-09-12T18:01:08.431649+0000","last_clean":"2024-09-12T18:01:08.431649+0000","last_became_active":"2024-09-12T17:23:46.150528+0000","last_became_peered":"2024-09-12T17:23:46.150528+0000","last_unstale":"2024-09-12T18:01:08.431649+0000","last_undegraded":"2024-09-12T18:01:08.431649+0000","last_fullsized":"2024-09-12T18:01:08.431649+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:33.340339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55558,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":967,"num_write":392,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.412615+0000","last_change":"2024-09-12T17:23:48.171496+0000","last_active":"2024-09-12T17:58:49.412615+0000","last_peered":"2024-09-12T17:58:49.412615+0000","last_clean":"2024-09-12T17:58:49.412615+0000","last_became_active":"2024-09-12T17:23:48.171031+0000","last_became_peered":"2024-09-12T17:23:48.171031+0000","last_unstale":"2024-09-12T17:58:49.412615+0000","last_undegraded":"2024-09-12T17:58:49.412615+0000","last_fullsized":"2024-09-12T17:58:49.412615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:49.840358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"261'154","reported_seq":657,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.140462+0000","last_change":"2024-09-12T17:23:50.186163+0000","last_active":"2024-09-12T18:00:03.140462+0000","last_peered":"2024-09-12T18:00:03.140462+0000","last_clean":"2024-09-12T18:00:03.140462+0000","last_became_active":"2024-09-12T17:23:50.185846+0000","last_became_peered":"2024-09-12T17:23:50.185846+0000","last_unstale":"2024-09-12T18:00:03.140462+0000","last_undegraded":"2024-09-12T18:00:03.140462+0000","last_fullsized":"2024-09-12T18:00:03.140462+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:27.173182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":366,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"261'792","reported_seq":2404,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.575412+0000","last_change":"2024-09-12T17:23:42.155181+0000","last_active":"2024-09-12T18:00:04.575412+0000","last_peered":"2024-09-12T18:00:04.575412+0000","last_clean":"2024-09-12T18:00:04.575412+0000","last_became_active":"2024-09-12T17:23:42.154925+0000","last_became_peered":"2024-09-12T17:23:42.154925+0000","last_unstale":"2024-09-12T18:00:04.575412+0000","last_undegraded":"2024-09-12T18:00:04.575412+0000","last_fullsized":"2024-09-12T18:00:04.575412+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:33.690553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3893,"num_read_kb":3543,"num_write":1032,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"261'295","reported_seq":907,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.562583+0000","last_change":"2024-09-12T17:23:40.709552+0000","last_active":"2024-09-12T18:01:49.562583+0000","last_peered":"2024-09-12T18:01:49.562583+0000","last_clean":"2024-09-12T18:01:49.562583+0000","last_became_active":"2024-09-12T17:23:40.708670+0000","last_became_peered":"2024-09-12T17:23:40.708670+0000","last_unstale":"2024-09-12T18:01:49.562583+0000","last_undegraded":"2024-09-12T18:01:49.562583+0000","last_fullsized":"2024-09-12T18:01:49.562583+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:17.377417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334439,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":426,"num_read_kb":1950,"num_write":1046,"num_write_kb":27043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.411789+0000","last_change":"2024-09-12T17:23:44.150241+0000","last_active":"2024-09-12T17:58:44.411789+0000","last_peered":"2024-09-12T17:58:44.411789+0000","last_clean":"2024-09-12T17:58:44.411789+0000","last_became_active":"2024-09-12T17:23:44.149907+0000","last_became_peered":"2024-09-12T17:23:44.149907+0000","last_unstale":"2024-09-12T17:58:44.411789+0000","last_undegraded":"2024-09-12T17:58:44.411789+0000","last_fullsized":"2024-09-12T17:58:44.411789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:57.170825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"261'272","reported_seq":819,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.408760+0000","last_change":"2024-09-12T17:23:46.150337+0000","last_active":"2024-09-12T18:01:42.408760+0000","last_peered":"2024-09-12T18:01:42.408760+0000","last_clean":"2024-09-12T18:01:42.408760+0000","last_became_active":"2024-09-12T17:23:46.149987+0000","last_became_peered":"2024-09-12T17:23:46.149987+0000","last_unstale":"2024-09-12T18:01:42.408760+0000","last_undegraded":"2024-09-12T18:01:42.408760+0000","last_fullsized":"2024-09-12T18:01:42.408760+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:31.163554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58657,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":986,"num_write":384,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.542683+0000","last_change":"2024-09-12T17:23:48.169607+0000","last_active":"2024-09-12T17:58:49.542683+0000","last_peered":"2024-09-12T17:58:49.542683+0000","last_clean":"2024-09-12T17:58:49.542683+0000","last_became_active":"2024-09-12T17:23:48.169308+0000","last_became_peered":"2024-09-12T17:23:48.169308+0000","last_unstale":"2024-09-12T17:58:49.542683+0000","last_undegraded":"2024-09-12T17:58:49.542683+0000","last_fullsized":"2024-09-12T17:58:49.542683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:14.722104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"261'801","reported_seq":2248,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.775817+0000","last_change":"2024-09-12T17:23:42.148700+0000","last_active":"2024-09-12T18:00:15.775817+0000","last_peered":"2024-09-12T18:00:15.775817+0000","last_clean":"2024-09-12T18:00:15.775817+0000","last_became_active":"2024-09-12T17:23:42.148412+0000","last_became_peered":"2024-09-12T17:23:42.148412+0000","last_unstale":"2024-09-12T18:00:15.775817+0000","last_undegraded":"2024-09-12T18:00:15.775817+0000","last_fullsized":"2024-09-12T18:00:15.775817+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:21.039641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3663,"num_read_kb":3282,"num_write":1025,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"261'250","reported_seq":881,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.797639+0000","last_change":"2024-09-12T17:23:40.717850+0000","last_active":"2024-09-12T18:00:02.797639+0000","last_peered":"2024-09-12T18:00:02.797639+0000","last_clean":"2024-09-12T18:00:02.797639+0000","last_became_active":"2024-09-12T17:23:40.717447+0000","last_became_peered":"2024-09-12T17:23:40.717447+0000","last_unstale":"2024-09-12T18:00:02.797639+0000","last_undegraded":"2024-09-12T18:00:02.797639+0000","last_fullsized":"2024-09-12T18:00:02.797639+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:56.974836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11557594,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":426,"num_read_kb":6876,"num_write":914,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:49.550885+0000","last_change":"2024-09-12T17:23:44.150079+0000","last_active":"2024-09-12T17:59:49.550885+0000","last_peered":"2024-09-12T17:59:49.550885+0000","last_clean":"2024-09-12T17:59:49.550885+0000","last_became_active":"2024-09-12T17:23:44.149799+0000","last_became_peered":"2024-09-12T17:23:44.149799+0000","last_unstale":"2024-09-12T17:59:49.550885+0000","last_undegraded":"2024-09-12T17:59:49.550885+0000","last_fullsized":"2024-09-12T17:59:49.550885+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:42.685092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"261'474","reported_seq":1085,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.434616+0000","last_change":"2024-09-12T17:23:46.149613+0000","last_active":"2024-09-12T18:01:42.434616+0000","last_peered":"2024-09-12T18:01:42.434616+0000","last_clean":"2024-09-12T18:01:42.434616+0000","last_became_active":"2024-09-12T17:23:46.148861+0000","last_became_peered":"2024-09-12T17:23:46.148861+0000","last_unstale":"2024-09-12T18:01:42.434616+0000","last_undegraded":"2024-09-12T18:01:42.434616+0000","last_fullsized":"2024-09-12T18:01:42.434616+0000","mapping_epoch":29,"log_start":"261'400","ondisk_log_start":"261'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:49.574258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121423,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":853,"num_read_kb":1879,"num_write":744,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.415004+0000","last_change":"2024-09-12T17:23:48.168964+0000","last_active":"2024-09-12T17:58:49.415004+0000","last_peered":"2024-09-12T17:58:49.415004+0000","last_clean":"2024-09-12T17:58:49.415004+0000","last_became_active":"2024-09-12T17:23:48.168566+0000","last_became_peered":"2024-09-12T17:23:48.168566+0000","last_unstale":"2024-09-12T17:58:49.415004+0000","last_undegraded":"2024-09-12T17:58:49.415004+0000","last_fullsized":"2024-09-12T17:58:49.415004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:54.048241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"261'216","reported_seq":723,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.143900+0000","last_change":"2024-09-12T17:23:50.642047+0000","last_active":"2024-09-12T18:00:18.143900+0000","last_peered":"2024-09-12T18:00:18.143900+0000","last_clean":"2024-09-12T18:00:18.143900+0000","last_became_active":"2024-09-12T17:23:50.641702+0000","last_became_peered":"2024-09-12T17:23:50.641702+0000","last_unstale":"2024-09-12T18:00:18.143900+0000","last_undegraded":"2024-09-12T18:00:18.143900+0000","last_fullsized":"2024-09-12T18:00:18.143900+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:03.863712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":328,"num_write":469,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"261'758","reported_seq":2326,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.409871+0000","last_change":"2024-09-12T17:23:42.142182+0000","last_active":"2024-09-12T18:00:03.409871+0000","last_peered":"2024-09-12T18:00:03.409871+0000","last_clean":"2024-09-12T18:00:03.409871+0000","last_became_active":"2024-09-12T17:23:42.141869+0000","last_became_peered":"2024-09-12T17:23:42.141869+0000","last_unstale":"2024-09-12T18:00:03.409871+0000","last_undegraded":"2024-09-12T18:00:03.409871+0000","last_fullsized":"2024-09-12T18:00:03.409871+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:48.199963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3783,"num_read_kb":3443,"num_write":995,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"261'259","reported_seq":860,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.906319+0000","last_change":"2024-09-12T17:23:40.711959+0000","last_active":"2024-09-12T17:59:38.906319+0000","last_peered":"2024-09-12T17:59:38.906319+0000","last_clean":"2024-09-12T17:59:38.906319+0000","last_became_active":"2024-09-12T17:23:40.711679+0000","last_became_peered":"2024-09-12T17:23:40.711679+0000","last_unstale":"2024-09-12T17:59:38.906319+0000","last_undegraded":"2024-09-12T17:59:38.906319+0000","last_fullsized":"2024-09-12T17:59:38.906319+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:54.430386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243674,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":380,"num_read_kb":3626,"num_write":916,"num_write_kb":35404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415419+0000","last_change":"2024-09-12T17:23:44.148401+0000","last_active":"2024-09-12T17:59:09.415419+0000","last_peered":"2024-09-12T17:59:09.415419+0000","last_clean":"2024-09-12T17:59:09.415419+0000","last_became_active":"2024-09-12T17:23:44.148044+0000","last_became_peered":"2024-09-12T17:23:44.148044+0000","last_unstale":"2024-09-12T17:59:09.415419+0000","last_undegraded":"2024-09-12T17:59:09.415419+0000","last_fullsized":"2024-09-12T17:59:09.415419+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:06.246940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"261'288","reported_seq":846,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.410042+0000","last_change":"2024-09-12T17:23:46.150717+0000","last_active":"2024-09-12T18:01:42.410042+0000","last_peered":"2024-09-12T18:01:42.410042+0000","last_clean":"2024-09-12T18:01:42.410042+0000","last_became_active":"2024-09-12T17:23:46.150380+0000","last_became_peered":"2024-09-12T17:23:46.150380+0000","last_unstale":"2024-09-12T18:01:42.410042+0000","last_undegraded":"2024-09-12T18:01:42.410042+0000","last_fullsized":"2024-09-12T18:01:42.410042+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:35.358954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57700,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":481,"num_read_kb":981,"num_write":410,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.414306+0000","last_change":"2024-09-12T17:23:48.173812+0000","last_active":"2024-09-12T17:58:49.414306+0000","last_peered":"2024-09-12T17:58:49.414306+0000","last_clean":"2024-09-12T17:58:49.414306+0000","last_became_active":"2024-09-12T17:23:48.173575+0000","last_became_peered":"2024-09-12T17:23:48.173575+0000","last_unstale":"2024-09-12T17:58:49.414306+0000","last_undegraded":"2024-09-12T17:58:49.414306+0000","last_fullsized":"2024-09-12T17:58:49.414306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:42.300280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"261'188","reported_seq":1044,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:17.033695+0000","last_change":"2024-09-12T17:23:50.186218+0000","last_active":"2024-09-12T18:00:17.033695+0000","last_peered":"2024-09-12T18:00:17.033695+0000","last_clean":"2024-09-12T18:00:17.033695+0000","last_became_active":"2024-09-12T17:23:50.185853+0000","last_became_peered":"2024-09-12T17:23:50.185853+0000","last_unstale":"2024-09-12T18:00:17.033695+0000","last_undegraded":"2024-09-12T18:00:17.033695+0000","last_fullsized":"2024-09-12T18:00:17.033695+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:01.791901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":633,"num_read_kb":630,"num_write":516,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"261'631","reported_seq":2472,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.504213+0000","last_change":"2024-09-12T17:23:42.154459+0000","last_active":"2024-09-12T18:00:05.504213+0000","last_peered":"2024-09-12T18:00:05.504213+0000","last_clean":"2024-09-12T18:00:05.504213+0000","last_became_active":"2024-09-12T17:23:42.154175+0000","last_became_peered":"2024-09-12T17:23:42.154175+0000","last_unstale":"2024-09-12T18:00:05.504213+0000","last_undegraded":"2024-09-12T18:00:05.504213+0000","last_fullsized":"2024-09-12T18:00:05.504213+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":600,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:46.313807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3404,"num_read_kb":3151,"num_write":789,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"261'277","reported_seq":902,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:23.907452+0000","last_change":"2024-09-12T17:23:40.713263+0000","last_active":"2024-09-12T17:59:23.907452+0000","last_peered":"2024-09-12T17:59:23.907452+0000","last_clean":"2024-09-12T17:59:23.907452+0000","last_became_active":"2024-09-12T17:23:40.712959+0000","last_became_peered":"2024-09-12T17:23:40.712959+0000","last_unstale":"2024-09-12T17:59:23.907452+0000","last_undegraded":"2024-09-12T17:59:23.907452+0000","last_fullsized":"2024-09-12T17:59:23.907452+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:04.359024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6618009,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":454,"num_read_kb":11021,"num_write":998,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.414711+0000","last_change":"2024-09-12T17:23:44.152533+0000","last_active":"2024-09-12T17:58:44.414711+0000","last_peered":"2024-09-12T17:58:44.414711+0000","last_clean":"2024-09-12T17:58:44.414711+0000","last_became_active":"2024-09-12T17:23:44.152006+0000","last_became_peered":"2024-09-12T17:23:44.152006+0000","last_unstale":"2024-09-12T17:58:44.414711+0000","last_undegraded":"2024-09-12T17:58:44.414711+0000","last_fullsized":"2024-09-12T17:58:44.414711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:53.659031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"261'244","reported_seq":801,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.433112+0000","last_change":"2024-09-12T17:23:46.241387+0000","last_active":"2024-09-12T18:01:18.433112+0000","last_peered":"2024-09-12T18:01:18.433112+0000","last_clean":"2024-09-12T18:01:18.433112+0000","last_became_active":"2024-09-12T17:23:46.241001+0000","last_became_peered":"2024-09-12T17:23:46.241001+0000","last_unstale":"2024-09-12T18:01:18.433112+0000","last_undegraded":"2024-09-12T18:01:18.433112+0000","last_fullsized":"2024-09-12T18:01:18.433112+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:50.165152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44275,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":380,"num_read_kb":773,"num_write":308,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.406337+0000","last_change":"2024-09-12T17:23:48.170506+0000","last_active":"2024-09-12T17:57:54.406337+0000","last_peered":"2024-09-12T17:57:54.406337+0000","last_clean":"2024-09-12T17:57:54.406337+0000","last_became_active":"2024-09-12T17:23:48.170212+0000","last_became_peered":"2024-09-12T17:23:48.170212+0000","last_unstale":"2024-09-12T17:57:54.406337+0000","last_undegraded":"2024-09-12T17:57:54.406337+0000","last_fullsized":"2024-09-12T17:57:54.406337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:14.960120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"261'127","reported_seq":607,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.439241+0000","last_change":"2024-09-12T17:23:50.187626+0000","last_active":"2024-09-12T18:01:42.439241+0000","last_peered":"2024-09-12T18:01:42.439241+0000","last_clean":"2024-09-12T18:01:42.439241+0000","last_became_active":"2024-09-12T17:23:50.187329+0000","last_became_peered":"2024-09-12T17:23:50.187329+0000","last_unstale":"2024-09-12T18:01:42.439241+0000","last_undegraded":"2024-09-12T18:01:42.439241+0000","last_fullsized":"2024-09-12T18:01:42.439241+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:50.928583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":770,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":154,"num_read_kb":149,"num_write":327,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"261'776","reported_seq":2292,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.504173+0000","last_change":"2024-09-12T17:23:42.144667+0000","last_active":"2024-09-12T18:00:05.504173+0000","last_peered":"2024-09-12T18:00:05.504173+0000","last_clean":"2024-09-12T18:00:05.504173+0000","last_became_active":"2024-09-12T17:23:42.144384+0000","last_became_peered":"2024-09-12T17:23:42.144384+0000","last_unstale":"2024-09-12T18:00:05.504173+0000","last_undegraded":"2024-09-12T18:00:05.504173+0000","last_fullsized":"2024-09-12T18:00:05.504173+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:07.836356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3720,"num_read_kb":3370,"num_write":1041,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"261'269","reported_seq":878,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.523666+0000","last_change":"2024-09-12T17:23:40.714983+0000","last_active":"2024-09-12T18:01:49.523666+0000","last_peered":"2024-09-12T18:01:49.523666+0000","last_clean":"2024-09-12T18:01:49.523666+0000","last_became_active":"2024-09-12T17:23:40.714710+0000","last_became_peered":"2024-09-12T17:23:40.714710+0000","last_unstale":"2024-09-12T18:01:49.523666+0000","last_undegraded":"2024-09-12T18:01:49.523666+0000","last_fullsized":"2024-09-12T18:01:49.523666+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:51.614208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3465743,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":411,"num_read_kb":6860,"num_write":1044,"num_write_kb":28418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.413676+0000","last_change":"2024-09-12T17:23:44.150532+0000","last_active":"2024-09-12T17:58:44.413676+0000","last_peered":"2024-09-12T17:58:44.413676+0000","last_clean":"2024-09-12T17:58:44.413676+0000","last_became_active":"2024-09-12T17:23:44.147886+0000","last_became_peered":"2024-09-12T17:23:44.147886+0000","last_unstale":"2024-09-12T17:58:44.413676+0000","last_undegraded":"2024-09-12T17:58:44.413676+0000","last_fullsized":"2024-09-12T17:58:44.413676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:53.428886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"261'80","reported_seq":588,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.424428+0000","last_change":"2024-09-12T17:23:46.241390+0000","last_active":"2024-09-12T17:59:59.424428+0000","last_peered":"2024-09-12T17:59:59.424428+0000","last_clean":"2024-09-12T17:59:59.424428+0000","last_became_active":"2024-09-12T17:23:46.241073+0000","last_became_peered":"2024-09-12T17:23:46.241073+0000","last_unstale":"2024-09-12T17:59:59.424428+0000","last_undegraded":"2024-09-12T17:59:59.424428+0000","last_fullsized":"2024-09-12T17:59:59.424428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:13.779221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":73,"num_read_kb":65,"num_write":60,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"261'784","reported_seq":2168,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.411782+0000","last_change":"2024-09-12T17:23:48.171323+0000","last_active":"2024-09-12T18:01:49.411782+0000","last_peered":"2024-09-12T18:01:49.411782+0000","last_clean":"2024-09-12T18:01:49.411782+0000","last_became_active":"2024-09-12T17:23:48.170815+0000","last_became_peered":"2024-09-12T17:23:48.170815+0000","last_unstale":"2024-09-12T18:01:49.411782+0000","last_undegraded":"2024-09-12T18:01:49.411782+0000","last_fullsized":"2024-09-12T18:01:49.411782+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:19.299843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"261'127","reported_seq":616,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:17.186926+0000","last_change":"2024-09-12T17:23:50.190416+0000","last_active":"2024-09-12T18:00:17.186926+0000","last_peered":"2024-09-12T18:00:17.186926+0000","last_clean":"2024-09-12T18:00:17.186926+0000","last_became_active":"2024-09-12T17:23:50.190124+0000","last_became_peered":"2024-09-12T17:23:50.190124+0000","last_unstale":"2024-09-12T18:00:17.186926+0000","last_undegraded":"2024-09-12T18:00:17.186926+0000","last_fullsized":"2024-09-12T18:00:17.186926+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:39.676360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":181,"num_read_kb":172,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"261'818","reported_seq":2433,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.787899+0000","last_change":"2024-09-12T17:23:42.149931+0000","last_active":"2024-09-12T18:00:05.787899+0000","last_peered":"2024-09-12T18:00:05.787899+0000","last_clean":"2024-09-12T18:00:05.787899+0000","last_became_active":"2024-09-12T17:23:42.149314+0000","last_became_peered":"2024-09-12T17:23:42.149314+0000","last_unstale":"2024-09-12T18:00:05.787899+0000","last_undegraded":"2024-09-12T18:00:05.787899+0000","last_fullsized":"2024-09-12T18:00:05.787899+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:45.837125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4083,"num_read_kb":3703,"num_write":1086,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"261'234","reported_seq":855,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.874152+0000","last_change":"2024-09-12T17:23:40.710250+0000","last_active":"2024-09-12T17:59:58.874152+0000","last_peered":"2024-09-12T17:59:58.874152+0000","last_clean":"2024-09-12T17:59:58.874152+0000","last_became_active":"2024-09-12T17:23:40.709818+0000","last_became_peered":"2024-09-12T17:23:40.709818+0000","last_unstale":"2024-09-12T17:59:58.874152+0000","last_undegraded":"2024-09-12T17:59:58.874152+0000","last_fullsized":"2024-09-12T17:59:58.874152+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:49.203826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2657777,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":368,"num_read_kb":69858,"num_write":877,"num_write_kb":36096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.415126+0000","last_change":"2024-09-12T17:23:44.150481+0000","last_active":"2024-09-12T17:58:44.415126+0000","last_peered":"2024-09-12T17:58:44.415126+0000","last_clean":"2024-09-12T17:58:44.415126+0000","last_became_active":"2024-09-12T17:23:44.150183+0000","last_became_peered":"2024-09-12T17:23:44.150183+0000","last_unstale":"2024-09-12T17:58:44.415126+0000","last_undegraded":"2024-09-12T17:58:44.415126+0000","last_fullsized":"2024-09-12T17:58:44.415126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:11.304183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"261'310","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.398549+0000","last_change":"2024-09-12T17:23:46.145061+0000","last_active":"2024-09-12T18:01:42.398549+0000","last_peered":"2024-09-12T18:01:42.398549+0000","last_clean":"2024-09-12T18:01:42.398549+0000","last_became_active":"2024-09-12T17:23:46.144587+0000","last_became_peered":"2024-09-12T17:23:46.144587+0000","last_unstale":"2024-09-12T18:01:42.398549+0000","last_undegraded":"2024-09-12T18:01:42.398549+0000","last_fullsized":"2024-09-12T18:01:42.398549+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:07.704295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60479,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":492,"num_read_kb":1006,"num_write":412,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.531765+0000","last_change":"2024-09-12T17:23:48.171551+0000","last_active":"2024-09-12T17:57:39.531765+0000","last_peered":"2024-09-12T17:57:39.531765+0000","last_clean":"2024-09-12T17:57:39.531765+0000","last_became_active":"2024-09-12T17:23:48.171272+0000","last_became_peered":"2024-09-12T17:23:48.171272+0000","last_unstale":"2024-09-12T17:57:39.531765+0000","last_undegraded":"2024-09-12T17:57:39.531765+0000","last_fullsized":"2024-09-12T17:57:39.531765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:23.692378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"261'102","reported_seq":586,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.251581+0000","last_change":"2024-09-12T17:23:50.192154+0000","last_active":"2024-09-12T18:00:04.251581+0000","last_peered":"2024-09-12T18:00:04.251581+0000","last_clean":"2024-09-12T18:00:04.251581+0000","last_became_active":"2024-09-12T17:23:50.191859+0000","last_became_peered":"2024-09-12T17:23:50.191859+0000","last_unstale":"2024-09-12T18:00:04.251581+0000","last_undegraded":"2024-09-12T18:00:04.251581+0000","last_fullsized":"2024-09-12T18:00:04.251581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:55.936330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":141,"num_write":249,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"261'476","reported_seq":2056,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.920905+0000","last_change":"2024-09-12T17:23:42.149567+0000","last_active":"2024-09-12T18:00:02.920905+0000","last_peered":"2024-09-12T18:00:02.920905+0000","last_clean":"2024-09-12T18:00:02.920905+0000","last_became_active":"2024-09-12T17:23:42.149260+0000","last_became_peered":"2024-09-12T17:23:42.149260+0000","last_unstale":"2024-09-12T18:00:02.920905+0000","last_undegraded":"2024-09-12T18:00:02.920905+0000","last_fullsized":"2024-09-12T18:00:02.920905+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:03.397079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2426,"num_read_kb":2286,"num_write":546,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"261'317","reported_seq":976,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:27.506110+0000","last_change":"2024-09-12T17:23:40.711299+0000","last_active":"2024-09-12T17:59:27.506110+0000","last_peered":"2024-09-12T17:59:27.506110+0000","last_clean":"2024-09-12T17:59:27.506110+0000","last_became_active":"2024-09-12T17:23:40.711032+0000","last_became_peered":"2024-09-12T17:23:40.711032+0000","last_unstale":"2024-09-12T17:59:27.506110+0000","last_undegraded":"2024-09-12T17:59:27.506110+0000","last_fullsized":"2024-09-12T17:59:27.506110+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:01.273219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10115930,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":547,"num_read_kb":19508,"num_write":1237,"num_write_kb":28388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.414353+0000","last_change":"2024-09-12T17:23:44.148038+0000","last_active":"2024-09-12T17:58:44.414353+0000","last_peered":"2024-09-12T17:58:44.414353+0000","last_clean":"2024-09-12T17:58:44.414353+0000","last_became_active":"2024-09-12T17:23:44.147694+0000","last_became_peered":"2024-09-12T17:23:44.147694+0000","last_unstale":"2024-09-12T17:58:44.414353+0000","last_undegraded":"2024-09-12T17:58:44.414353+0000","last_fullsized":"2024-09-12T17:58:44.414353+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:06.022806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"261'255","reported_seq":801,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.399732+0000","last_change":"2024-09-12T17:23:46.152548+0000","last_active":"2024-09-12T18:01:42.399732+0000","last_peered":"2024-09-12T18:01:42.399732+0000","last_clean":"2024-09-12T18:01:42.399732+0000","last_became_active":"2024-09-12T17:23:46.152028+0000","last_became_peered":"2024-09-12T17:23:46.152028+0000","last_unstale":"2024-09-12T18:01:42.399732+0000","last_undegraded":"2024-09-12T18:01:42.399732+0000","last_fullsized":"2024-09-12T18:01:42.399732+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:32.403280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54478,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":404,"num_read_kb":859,"num_write":332,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.404087+0000","last_change":"2024-09-12T17:23:48.170790+0000","last_active":"2024-09-12T17:57:49.404087+0000","last_peered":"2024-09-12T17:57:49.404087+0000","last_clean":"2024-09-12T17:57:49.404087+0000","last_became_active":"2024-09-12T17:23:48.170452+0000","last_became_peered":"2024-09-12T17:23:48.170452+0000","last_unstale":"2024-09-12T17:57:49.404087+0000","last_undegraded":"2024-09-12T17:57:49.404087+0000","last_fullsized":"2024-09-12T17:57:49.404087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:31.197971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"261'126","reported_seq":628,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.113825+0000","last_change":"2024-09-12T17:23:50.641248+0000","last_active":"2024-09-12T18:00:02.113825+0000","last_peered":"2024-09-12T18:00:02.113825+0000","last_clean":"2024-09-12T18:00:02.113825+0000","last_became_active":"2024-09-12T17:23:50.640911+0000","last_became_peered":"2024-09-12T17:23:50.640911+0000","last_unstale":"2024-09-12T18:00:02.113825+0000","last_undegraded":"2024-09-12T18:00:02.113825+0000","last_fullsized":"2024-09-12T18:00:02.113825+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:33.080397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":307,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"261'389","reported_seq":1787,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.136439+0000","last_change":"2024-09-12T17:23:42.146348+0000","last_active":"2024-09-12T18:00:18.136439+0000","last_peered":"2024-09-12T18:00:18.136439+0000","last_clean":"2024-09-12T18:00:18.136439+0000","last_became_active":"2024-09-12T17:23:42.146055+0000","last_became_peered":"2024-09-12T17:23:42.146055+0000","last_unstale":"2024-09-12T18:00:18.136439+0000","last_undegraded":"2024-09-12T18:00:18.136439+0000","last_fullsized":"2024-09-12T18:00:18.136439+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:11.249424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1982,"num_read_kb":1877,"num_write":444,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"261'255","reported_seq":872,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.155848+0000","last_change":"2024-09-12T17:23:40.712278+0000","last_active":"2024-09-12T17:59:59.155848+0000","last_peered":"2024-09-12T17:59:59.155848+0000","last_clean":"2024-09-12T17:59:59.155848+0000","last_became_active":"2024-09-12T17:23:40.709759+0000","last_became_peered":"2024-09-12T17:23:40.709759+0000","last_unstale":"2024-09-12T17:59:59.155848+0000","last_undegraded":"2024-09-12T17:59:59.155848+0000","last_fullsized":"2024-09-12T17:59:59.155848+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.261512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10792869,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":391,"num_read_kb":23018,"num_write":1015,"num_write_kb":26757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404701+0000","last_change":"2024-09-12T17:23:44.147886+0000","last_active":"2024-09-12T17:57:34.404701+0000","last_peered":"2024-09-12T17:57:34.404701+0000","last_clean":"2024-09-12T17:57:34.404701+0000","last_became_active":"2024-09-12T17:23:44.147372+0000","last_became_peered":"2024-09-12T17:23:44.147372+0000","last_unstale":"2024-09-12T17:57:34.404701+0000","last_undegraded":"2024-09-12T17:57:34.404701+0000","last_fullsized":"2024-09-12T17:57:34.404701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:48.881691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"261'237","reported_seq":779,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:18.433036+0000","last_change":"2024-09-12T17:23:46.153298+0000","last_active":"2024-09-12T18:01:18.433036+0000","last_peered":"2024-09-12T18:01:18.433036+0000","last_clean":"2024-09-12T18:01:18.433036+0000","last_became_active":"2024-09-12T17:23:46.153024+0000","last_became_peered":"2024-09-12T17:23:46.153024+0000","last_unstale":"2024-09-12T18:01:18.433036+0000","last_undegraded":"2024-09-12T18:01:18.433036+0000","last_fullsized":"2024-09-12T18:01:18.433036+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:00.093006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54635,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":849,"num_write":328,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.415370+0000","last_change":"2024-09-12T17:23:48.172179+0000","last_active":"2024-09-12T17:58:49.415370+0000","last_peered":"2024-09-12T17:58:49.415370+0000","last_clean":"2024-09-12T17:58:49.415370+0000","last_became_active":"2024-09-12T17:23:48.171849+0000","last_became_peered":"2024-09-12T17:23:48.171849+0000","last_unstale":"2024-09-12T17:58:49.415370+0000","last_undegraded":"2024-09-12T17:58:49.415370+0000","last_fullsized":"2024-09-12T17:58:49.415370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:22.948863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"261'139","reported_seq":1240,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.442930+0000","last_change":"2024-09-12T17:23:50.187385+0000","last_active":"2024-09-12T18:00:18.442930+0000","last_peered":"2024-09-12T18:00:18.442930+0000","last_clean":"2024-09-12T18:00:18.442930+0000","last_became_active":"2024-09-12T17:23:50.187084+0000","last_became_peered":"2024-09-12T17:23:50.187084+0000","last_unstale":"2024-09-12T18:00:18.442930+0000","last_undegraded":"2024-09-12T18:00:18.442930+0000","last_fullsized":"2024-09-12T18:00:18.442930+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:15.188210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":862,"num_read_kb":842,"num_write":338,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"261'420","reported_seq":1870,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.767639+0000","last_change":"2024-09-12T17:23:42.136286+0000","last_active":"2024-09-12T18:00:15.767639+0000","last_peered":"2024-09-12T18:00:15.767639+0000","last_clean":"2024-09-12T18:00:15.767639+0000","last_became_active":"2024-09-12T17:23:42.135975+0000","last_became_peered":"2024-09-12T17:23:42.135975+0000","last_unstale":"2024-09-12T18:00:15.767639+0000","last_undegraded":"2024-09-12T18:00:15.767639+0000","last_fullsized":"2024-09-12T18:00:15.767639+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:39.052393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2123,"num_read_kb":2006,"num_write":479,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"261'315","reported_seq":957,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.546600+0000","last_change":"2024-09-12T17:23:40.714142+0000","last_active":"2024-09-12T18:01:49.546600+0000","last_peered":"2024-09-12T18:01:49.546600+0000","last_clean":"2024-09-12T18:01:49.546600+0000","last_became_active":"2024-09-12T17:23:40.713129+0000","last_became_peered":"2024-09-12T17:23:40.713129+0000","last_unstale":"2024-09-12T18:01:49.546600+0000","last_undegraded":"2024-09-12T18:01:49.546600+0000","last_fullsized":"2024-09-12T18:01:49.546600+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:41.054346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8589522,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":473,"num_read_kb":14033,"num_write":1174,"num_write_kb":28273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.404033+0000","last_change":"2024-09-12T17:23:44.151405+0000","last_active":"2024-09-12T17:57:39.404033+0000","last_peered":"2024-09-12T17:57:39.404033+0000","last_clean":"2024-09-12T17:57:39.404033+0000","last_became_active":"2024-09-12T17:23:44.151126+0000","last_became_peered":"2024-09-12T17:23:44.151126+0000","last_unstale":"2024-09-12T17:57:39.404033+0000","last_undegraded":"2024-09-12T17:57:39.404033+0000","last_fullsized":"2024-09-12T17:57:39.404033+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:22.113687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"261'279","reported_seq":849,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.434647+0000","last_change":"2024-09-12T17:23:46.153409+0000","last_active":"2024-09-12T18:01:19.434647+0000","last_peered":"2024-09-12T18:01:19.434647+0000","last_clean":"2024-09-12T18:01:19.434647+0000","last_became_active":"2024-09-12T17:23:46.153111+0000","last_became_peered":"2024-09-12T17:23:46.153111+0000","last_unstale":"2024-09-12T18:01:19.434647+0000","last_undegraded":"2024-09-12T18:01:19.434647+0000","last_fullsized":"2024-09-12T18:01:19.434647+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:10.838059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49755,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":444,"num_read_kb":886,"num_write":356,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.542675+0000","last_change":"2024-09-12T17:23:48.167442+0000","last_active":"2024-09-12T17:58:49.542675+0000","last_peered":"2024-09-12T17:58:49.542675+0000","last_clean":"2024-09-12T17:58:49.542675+0000","last_became_active":"2024-09-12T17:23:48.167070+0000","last_became_peered":"2024-09-12T17:23:48.167070+0000","last_unstale":"2024-09-12T17:58:49.542675+0000","last_undegraded":"2024-09-12T17:58:49.542675+0000","last_fullsized":"2024-09-12T17:58:49.542675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:57.449206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"261'83","reported_seq":563,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.396381+0000","last_change":"2024-09-12T17:23:50.179396+0000","last_active":"2024-09-12T18:01:41.396381+0000","last_peered":"2024-09-12T18:01:41.396381+0000","last_clean":"2024-09-12T18:01:41.396381+0000","last_became_active":"2024-09-12T17:23:50.179075+0000","last_became_peered":"2024-09-12T17:23:50.179075+0000","last_unstale":"2024-09-12T18:01:41.396381+0000","last_undegraded":"2024-09-12T18:01:41.396381+0000","last_fullsized":"2024-09-12T18:01:41.396381+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:17.064467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":88,"num_write":193,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"261'777","reported_seq":2261,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.397855+0000","last_change":"2024-09-12T17:23:42.137451+0000","last_active":"2024-09-12T18:01:41.397855+0000","last_peered":"2024-09-12T18:01:41.397855+0000","last_clean":"2024-09-12T18:01:41.397855+0000","last_became_active":"2024-09-12T17:23:42.137169+0000","last_became_peered":"2024-09-12T17:23:42.137169+0000","last_unstale":"2024-09-12T18:01:41.397855+0000","last_undegraded":"2024-09-12T18:01:41.397855+0000","last_fullsized":"2024-09-12T18:01:41.397855+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:08.945619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3876,"num_read_kb":3488,"num_write":1033,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"261'305","reported_seq":967,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:52.096361+0000","last_change":"2024-09-12T17:23:40.713502+0000","last_active":"2024-09-12T17:59:52.096361+0000","last_peered":"2024-09-12T17:59:52.096361+0000","last_clean":"2024-09-12T17:59:52.096361+0000","last_became_active":"2024-09-12T17:23:40.713212+0000","last_became_peered":"2024-09-12T17:23:40.713212+0000","last_unstale":"2024-09-12T17:59:52.096361+0000","last_undegraded":"2024-09-12T17:59:52.096361+0000","last_fullsized":"2024-09-12T17:59:52.096361+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:39.463517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1300247,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":543,"num_read_kb":38604,"num_write":1106,"num_write_kb":36037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"261'632","reported_seq":2095,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.230241+0000","last_change":"2024-09-12T17:24:17.227806+0000","last_active":"2024-09-12T18:00:05.230241+0000","last_peered":"2024-09-12T18:00:05.230241+0000","last_clean":"2024-09-12T18:00:05.230241+0000","last_became_active":"2024-09-12T17:24:17.227465+0000","last_became_peered":"2024-09-12T17:24:17.227465+0000","last_unstale":"2024-09-12T18:00:05.230241+0000","last_undegraded":"2024-09-12T18:00:05.230241+0000","last_fullsized":"2024-09-12T18:00:05.230241+0000","mapping_epoch":36,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":600,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:02.612199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3072,"num_read_kb":2745,"num_write":824,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"261'255","reported_seq":924,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.574317+0000","last_change":"2024-09-12T17:23:40.708395+0000","last_active":"2024-09-12T18:00:16.574317+0000","last_peered":"2024-09-12T18:00:16.574317+0000","last_clean":"2024-09-12T18:00:16.574317+0000","last_became_active":"2024-09-12T17:23:40.708064+0000","last_became_peered":"2024-09-12T17:23:40.708064+0000","last_unstale":"2024-09-12T18:00:16.574317+0000","last_undegraded":"2024-09-12T18:00:16.574317+0000","last_fullsized":"2024-09-12T18:00:16.574317+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:37.241857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24765059,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":437,"num_read_kb":78914,"num_write":936,"num_write_kb":50917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"261'842","reported_seq":2554,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.897301+0000","last_change":"2024-09-12T17:23:42.145251+0000","last_active":"2024-09-12T18:00:04.897301+0000","last_peered":"2024-09-12T18:00:04.897301+0000","last_clean":"2024-09-12T18:00:04.897301+0000","last_became_active":"2024-09-12T17:23:42.144919+0000","last_became_peered":"2024-09-12T17:23:42.144919+0000","last_unstale":"2024-09-12T18:00:04.897301+0000","last_undegraded":"2024-09-12T18:00:04.897301+0000","last_fullsized":"2024-09-12T18:00:04.897301+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:06.765117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4312,"num_read_kb":3919,"num_write":1107,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"261'264","reported_seq":904,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.605562+0000","last_change":"2024-09-12T17:23:40.715953+0000","last_active":"2024-09-12T18:00:02.605562+0000","last_peered":"2024-09-12T18:00:02.605562+0000","last_clean":"2024-09-12T18:00:02.605562+0000","last_became_active":"2024-09-12T17:23:40.715471+0000","last_became_peered":"2024-09-12T17:23:40.715471+0000","last_unstale":"2024-09-12T18:00:02.605562+0000","last_undegraded":"2024-09-12T18:00:02.605562+0000","last_fullsized":"2024-09-12T18:00:02.605562+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:42.149240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5684255,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":390,"num_read_kb":37845,"num_write":934,"num_write_kb":24242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"261'766","reported_seq":2207,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.398961+0000","last_change":"2024-09-12T17:23:42.143464+0000","last_active":"2024-09-12T18:01:41.398961+0000","last_peered":"2024-09-12T18:01:41.398961+0000","last_clean":"2024-09-12T18:01:41.398961+0000","last_became_active":"2024-09-12T17:23:42.142672+0000","last_became_peered":"2024-09-12T17:23:42.142672+0000","last_unstale":"2024-09-12T18:01:41.398961+0000","last_undegraded":"2024-09-12T18:01:41.398961+0000","last_fullsized":"2024-09-12T18:01:41.398961+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:24.449488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3573,"num_read_kb":3224,"num_write":1004,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"261'227","reported_seq":847,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.535155+0000","last_change":"2024-09-12T17:23:40.703276+0000","last_active":"2024-09-12T18:01:49.535155+0000","last_peered":"2024-09-12T18:01:49.535155+0000","last_clean":"2024-09-12T18:01:49.535155+0000","last_became_active":"2024-09-12T17:23:40.702991+0000","last_became_peered":"2024-09-12T17:23:40.702991+0000","last_unstale":"2024-09-12T18:01:49.535155+0000","last_undegraded":"2024-09-12T18:01:49.535155+0000","last_fullsized":"2024-09-12T18:01:49.535155+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:10.880499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17109169,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":372,"num_read_kb":57190,"num_write":822,"num_write_kb":43690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"261'412","reported_seq":1898,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559469+0000","last_change":"2024-09-12T17:23:42.147003+0000","last_active":"2024-09-12T18:00:18.559469+0000","last_peered":"2024-09-12T18:00:18.559469+0000","last_clean":"2024-09-12T18:00:18.559469+0000","last_became_active":"2024-09-12T17:23:42.146394+0000","last_became_peered":"2024-09-12T17:23:42.146394+0000","last_unstale":"2024-09-12T18:00:18.559469+0000","last_undegraded":"2024-09-12T18:00:18.559469+0000","last_fullsized":"2024-09-12T18:00:18.559469+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:36.451547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2184,"num_read_kb":2068,"num_write":471,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"261'293","reported_seq":1034,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.409420+0000","last_change":"2024-09-12T17:23:40.712996+0000","last_active":"2024-09-12T17:58:23.409420+0000","last_peered":"2024-09-12T17:58:23.409420+0000","last_clean":"2024-09-12T17:58:23.409420+0000","last_became_active":"2024-09-12T17:23:40.712702+0000","last_became_peered":"2024-09-12T17:23:40.712702+0000","last_unstale":"2024-09-12T17:58:23.409420+0000","last_undegraded":"2024-09-12T17:58:23.409420+0000","last_fullsized":"2024-09-12T17:58:23.409420+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:27.121297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16644326,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":653,"num_read_kb":69808,"num_write":1120,"num_write_kb":31106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"261'857","reported_seq":2441,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.776265+0000","last_change":"2024-09-12T17:23:42.143639+0000","last_active":"2024-09-12T18:00:15.776265+0000","last_peered":"2024-09-12T18:00:15.776265+0000","last_clean":"2024-09-12T18:00:15.776265+0000","last_became_active":"2024-09-12T17:23:42.141605+0000","last_became_peered":"2024-09-12T17:23:42.141605+0000","last_unstale":"2024-09-12T18:00:15.776265+0000","last_undegraded":"2024-09-12T18:00:15.776265+0000","last_fullsized":"2024-09-12T18:00:15.776265+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:51.809611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4009,"num_read_kb":3625,"num_write":1130,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"261'250","reported_seq":976,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:55.754138+0000","last_change":"2024-09-12T17:23:40.716113+0000","last_active":"2024-09-12T17:59:55.754138+0000","last_peered":"2024-09-12T17:59:55.754138+0000","last_clean":"2024-09-12T17:59:55.754138+0000","last_became_active":"2024-09-12T17:23:40.715809+0000","last_became_peered":"2024-09-12T17:23:40.715809+0000","last_unstale":"2024-09-12T17:59:55.754138+0000","last_undegraded":"2024-09-12T17:59:55.754138+0000","last_fullsized":"2024-09-12T17:59:55.754138+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:47.361193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10487171,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":687,"num_read_kb":58572,"num_write":976,"num_write_kb":36244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"261'1242","reported_seq":2732,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.227974+0000","last_change":"2024-09-12T17:23:42.155774+0000","last_active":"2024-09-12T18:00:05.227974+0000","last_peered":"2024-09-12T18:00:05.227974+0000","last_clean":"2024-09-12T18:00:05.227974+0000","last_became_active":"2024-09-12T17:23:42.155489+0000","last_became_peered":"2024-09-12T17:23:42.155489+0000","last_unstale":"2024-09-12T18:00:05.227974+0000","last_undegraded":"2024-09-12T18:00:05.227974+0000","last_fullsized":"2024-09-12T18:00:05.227974+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:36.957522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5619,"num_read_kb":4947,"num_write":1761,"num_write_kb":787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"261'302","reported_seq":929,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.846138+0000","last_change":"2024-09-12T17:23:40.704880+0000","last_active":"2024-09-12T18:00:16.846138+0000","last_peered":"2024-09-12T18:00:16.846138+0000","last_clean":"2024-09-12T18:00:16.846138+0000","last_became_active":"2024-09-12T17:23:40.704582+0000","last_became_peered":"2024-09-12T17:23:40.704582+0000","last_unstale":"2024-09-12T18:00:16.846138+0000","last_undegraded":"2024-09-12T18:00:16.846138+0000","last_fullsized":"2024-09-12T18:00:16.846138+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:16.868554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13648727,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":476,"num_read_kb":13831,"num_write":1096,"num_write_kb":46857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"261'752","reported_seq":2383,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:01.852133+0000","last_change":"2024-09-12T17:23:42.141856+0000","last_active":"2024-09-12T18:00:01.852133+0000","last_peered":"2024-09-12T18:00:01.852133+0000","last_clean":"2024-09-12T18:00:01.852133+0000","last_became_active":"2024-09-12T17:23:42.141542+0000","last_became_peered":"2024-09-12T17:23:42.141542+0000","last_unstale":"2024-09-12T18:00:01.852133+0000","last_undegraded":"2024-09-12T18:00:01.852133+0000","last_fullsized":"2024-09-12T18:00:01.852133+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:24.628553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3956,"num_read_kb":3681,"num_write":1110,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"261'313","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:53.737394+0000","last_change":"2024-09-12T17:24:17.227402+0000","last_active":"2024-09-12T17:59:53.737394+0000","last_peered":"2024-09-12T17:59:53.737394+0000","last_clean":"2024-09-12T17:59:53.737394+0000","last_became_active":"2024-09-12T17:24:17.227082+0000","last_became_peered":"2024-09-12T17:24:17.227082+0000","last_unstale":"2024-09-12T17:59:53.737394+0000","last_undegraded":"2024-09-12T17:59:53.737394+0000","last_fullsized":"2024-09-12T17:59:53.737394+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:39.821544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3033,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":567,"num_read_kb":9829,"num_write":1382,"num_write_kb":18369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"261'766","reported_seq":2160,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.407235+0000","last_change":"2024-09-12T17:23:42.155753+0000","last_active":"2024-09-12T18:01:41.407235+0000","last_peered":"2024-09-12T18:01:41.407235+0000","last_clean":"2024-09-12T18:01:41.407235+0000","last_became_active":"2024-09-12T17:23:42.155052+0000","last_became_peered":"2024-09-12T17:23:42.155052+0000","last_unstale":"2024-09-12T18:01:41.407235+0000","last_undegraded":"2024-09-12T18:01:41.407235+0000","last_fullsized":"2024-09-12T18:01:41.407235+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:06.879341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3588,"num_read_kb":3224,"num_write":1013,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"261'283","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.602552+0000","last_change":"2024-09-12T17:23:40.707697+0000","last_active":"2024-09-12T18:00:05.602552+0000","last_peered":"2024-09-12T18:00:05.602552+0000","last_clean":"2024-09-12T18:00:05.602552+0000","last_became_active":"2024-09-12T17:23:40.707220+0000","last_became_peered":"2024-09-12T17:23:40.707220+0000","last_unstale":"2024-09-12T18:00:05.602552+0000","last_undegraded":"2024-09-12T18:00:05.602552+0000","last_fullsized":"2024-09-12T18:00:05.602552+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:32.088764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16446959,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":613,"num_read_kb":59084,"num_write":1062,"num_write_kb":27945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"261'437","reported_seq":1932,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.785671+0000","last_change":"2024-09-12T17:23:42.135161+0000","last_active":"2024-09-12T18:00:05.785671+0000","last_peered":"2024-09-12T18:00:05.785671+0000","last_clean":"2024-09-12T18:00:05.785671+0000","last_became_active":"2024-09-12T17:23:42.134859+0000","last_became_peered":"2024-09-12T17:23:42.134859+0000","last_unstale":"2024-09-12T18:00:05.785671+0000","last_undegraded":"2024-09-12T18:00:05.785671+0000","last_fullsized":"2024-09-12T18:00:05.785671+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:02.200019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2327,"num_read_kb":2188,"num_write":509,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"261'276","reported_seq":909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.144545+0000","last_change":"2024-09-12T17:23:40.711309+0000","last_active":"2024-09-12T17:59:59.144545+0000","last_peered":"2024-09-12T17:59:59.144545+0000","last_clean":"2024-09-12T17:59:59.144545+0000","last_became_active":"2024-09-12T17:23:40.711042+0000","last_became_peered":"2024-09-12T17:23:40.711042+0000","last_unstale":"2024-09-12T17:59:59.144545+0000","last_undegraded":"2024-09-12T17:59:59.144545+0000","last_fullsized":"2024-09-12T17:59:59.144545+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:52.925495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5649623,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":483,"num_read_kb":6765,"num_write":1118,"num_write_kb":43884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"261'951","reported_seq":2509,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.982322+0000","last_change":"2024-09-12T17:23:42.141720+0000","last_active":"2024-09-12T18:00:03.982322+0000","last_peered":"2024-09-12T18:00:03.982322+0000","last_clean":"2024-09-12T18:00:03.982322+0000","last_became_active":"2024-09-12T17:23:42.141379+0000","last_became_peered":"2024-09-12T17:23:42.141379+0000","last_unstale":"2024-09-12T18:00:03.982322+0000","last_undegraded":"2024-09-12T18:00:03.982322+0000","last_fullsized":"2024-09-12T18:00:03.982322+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:42.201491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4545,"num_read_kb":4064,"num_write":1359,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"261'328","reported_seq":954,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:01.938308+0000","last_change":"2024-09-12T17:23:40.704486+0000","last_active":"2024-09-12T18:00:01.938308+0000","last_peered":"2024-09-12T18:00:01.938308+0000","last_clean":"2024-09-12T18:00:01.938308+0000","last_became_active":"2024-09-12T17:23:40.702825+0000","last_became_peered":"2024-09-12T17:23:40.702825+0000","last_unstale":"2024-09-12T18:00:01.938308+0000","last_undegraded":"2024-09-12T18:00:01.938308+0000","last_fullsized":"2024-09-12T18:00:01.938308+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:59.455771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":275287,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":579,"num_read_kb":541,"num_write":1109,"num_write_kb":8662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"261'394","reported_seq":1802,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.719075+0000","last_change":"2024-09-12T17:23:42.140485+0000","last_active":"2024-09-12T18:00:03.719075+0000","last_peered":"2024-09-12T18:00:03.719075+0000","last_clean":"2024-09-12T18:00:03.719075+0000","last_became_active":"2024-09-12T17:23:42.139735+0000","last_became_peered":"2024-09-12T17:23:42.139735+0000","last_unstale":"2024-09-12T18:00:03.719075+0000","last_undegraded":"2024-09-12T18:00:03.719075+0000","last_fullsized":"2024-09-12T18:00:03.719075+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:08.857406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2037,"num_read_kb":1920,"num_write":445,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"261'283","reported_seq":944,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.542185+0000","last_change":"2024-09-12T17:23:40.709866+0000","last_active":"2024-09-12T18:01:49.542185+0000","last_peered":"2024-09-12T18:01:49.542185+0000","last_clean":"2024-09-12T18:01:49.542185+0000","last_became_active":"2024-09-12T17:23:40.709392+0000","last_became_peered":"2024-09-12T17:23:40.709392+0000","last_unstale":"2024-09-12T18:01:49.542185+0000","last_undegraded":"2024-09-12T18:01:49.542185+0000","last_fullsized":"2024-09-12T18:01:49.542185+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:11.200927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12947734,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":457,"num_read_kb":64698,"num_write":1081,"num_write_kb":39876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"261'1133","reported_seq":2665,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.137309+0000","last_change":"2024-09-12T17:23:42.154482+0000","last_active":"2024-09-12T18:00:18.137309+0000","last_peered":"2024-09-12T18:00:18.137309+0000","last_clean":"2024-09-12T18:00:18.137309+0000","last_became_active":"2024-09-12T17:23:42.154127+0000","last_became_peered":"2024-09-12T17:23:42.154127+0000","last_unstale":"2024-09-12T18:00:18.137309+0000","last_undegraded":"2024-09-12T18:00:18.137309+0000","last_fullsized":"2024-09-12T18:00:18.137309+0000","mapping_epoch":25,"log_start":"261'1100","ondisk_log_start":"261'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:39.681068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5169,"num_read_kb":4583,"num_write":1562,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"261'283","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.030587+0000","last_change":"2024-09-12T17:23:40.714617+0000","last_active":"2024-09-12T18:00:05.030587+0000","last_peered":"2024-09-12T18:00:05.030587+0000","last_clean":"2024-09-12T18:00:05.030587+0000","last_became_active":"2024-09-12T17:23:40.714343+0000","last_became_peered":"2024-09-12T17:23:40.714343+0000","last_unstale":"2024-09-12T18:00:05.030587+0000","last_undegraded":"2024-09-12T18:00:05.030587+0000","last_fullsized":"2024-09-12T18:00:05.030587+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:08.542048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5254957,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":548,"num_read_kb":27408,"num_write":1157,"num_write_kb":25060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"261'994","reported_seq":2614,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.219834+0000","last_change":"2024-09-12T17:23:42.146400+0000","last_active":"2024-09-12T18:00:05.219834+0000","last_peered":"2024-09-12T18:00:05.219834+0000","last_clean":"2024-09-12T18:00:05.219834+0000","last_became_active":"2024-09-12T17:23:42.146107+0000","last_became_peered":"2024-09-12T17:23:42.146107+0000","last_unstale":"2024-09-12T18:00:05.219834+0000","last_undegraded":"2024-09-12T18:00:05.219834+0000","last_fullsized":"2024-09-12T18:00:05.219834+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:14.764258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4676,"num_read_kb":4145,"num_write":1343,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"261'259","reported_seq":901,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.704801+0000","last_change":"2024-09-12T17:23:40.707232+0000","last_active":"2024-09-12T18:00:04.704801+0000","last_peered":"2024-09-12T18:00:04.704801+0000","last_clean":"2024-09-12T18:00:04.704801+0000","last_became_active":"2024-09-12T17:23:40.706951+0000","last_became_peered":"2024-09-12T17:23:40.706951+0000","last_unstale":"2024-09-12T18:00:04.704801+0000","last_undegraded":"2024-09-12T18:00:04.704801+0000","last_fullsized":"2024-09-12T18:00:04.704801+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:17.981456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17691166,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":463,"num_read_kb":7213,"num_write":904,"num_write_kb":28374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"261'489","reported_seq":1993,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.982703+0000","last_change":"2024-09-12T17:23:42.153312+0000","last_active":"2024-09-12T18:00:03.982703+0000","last_peered":"2024-09-12T18:00:03.982703+0000","last_clean":"2024-09-12T18:00:03.982703+0000","last_became_active":"2024-09-12T17:23:42.152999+0000","last_became_peered":"2024-09-12T17:23:42.152999+0000","last_unstale":"2024-09-12T18:00:03.982703+0000","last_undegraded":"2024-09-12T18:00:03.982703+0000","last_fullsized":"2024-09-12T18:00:03.982703+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:03.127915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2525,"num_read_kb":2342,"num_write":624,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"261'279","reported_seq":896,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:56.793678+0000","last_change":"2024-09-12T17:23:40.705092+0000","last_active":"2024-09-12T17:59:56.793678+0000","last_peered":"2024-09-12T17:59:56.793678+0000","last_clean":"2024-09-12T17:59:56.793678+0000","last_became_active":"2024-09-12T17:23:40.704585+0000","last_became_peered":"2024-09-12T17:23:40.704585+0000","last_unstale":"2024-09-12T17:59:56.793678+0000","last_undegraded":"2024-09-12T17:59:56.793678+0000","last_fullsized":"2024-09-12T17:59:56.793678+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:15.307799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298013,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":395,"num_read_kb":452,"num_write":1033,"num_write_kb":34111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"261'439","reported_seq":2020,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.777791+0000","last_change":"2024-09-12T17:23:42.154717+0000","last_active":"2024-09-12T18:00:15.777791+0000","last_peered":"2024-09-12T18:00:15.777791+0000","last_clean":"2024-09-12T18:00:15.777791+0000","last_became_active":"2024-09-12T17:23:42.154367+0000","last_became_peered":"2024-09-12T17:23:42.154367+0000","last_unstale":"2024-09-12T18:00:15.777791+0000","last_undegraded":"2024-09-12T18:00:15.777791+0000","last_fullsized":"2024-09-12T18:00:15.777791+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:21.496903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2387,"num_read_kb":2268,"num_write":501,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"261'332","reported_seq":935,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:36.882744+0000","last_change":"2024-09-12T17:24:17.287754+0000","last_active":"2024-09-12T18:01:36.882744+0000","last_peered":"2024-09-12T18:01:36.882744+0000","last_clean":"2024-09-12T18:01:36.882744+0000","last_became_active":"2024-09-12T17:24:17.287516+0000","last_became_peered":"2024-09-12T17:24:17.287516+0000","last_unstale":"2024-09-12T18:01:36.882744+0000","last_undegraded":"2024-09-12T18:01:36.882744+0000","last_fullsized":"2024-09-12T18:01:36.882744+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:04.002445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1983283,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":519,"num_read_kb":2150,"num_write":1146,"num_write_kb":17735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"261'294","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.046378+0000","last_change":"2024-09-12T17:23:40.706233+0000","last_active":"2024-09-12T18:00:05.046378+0000","last_peered":"2024-09-12T18:00:05.046378+0000","last_clean":"2024-09-12T18:00:05.046378+0000","last_became_active":"2024-09-12T17:23:40.705975+0000","last_became_peered":"2024-09-12T17:23:40.705975+0000","last_unstale":"2024-09-12T18:00:05.046378+0000","last_undegraded":"2024-09-12T18:00:05.046378+0000","last_fullsized":"2024-09-12T18:00:05.046378+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:14.609978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8493877,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":558,"num_read_kb":38544,"num_write":1107,"num_write_kb":29966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"261'887","reported_seq":2649,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.400463+0000","last_change":"2024-09-12T17:23:42.156067+0000","last_active":"2024-09-12T18:01:41.400463+0000","last_peered":"2024-09-12T18:01:41.400463+0000","last_clean":"2024-09-12T18:01:41.400463+0000","last_became_active":"2024-09-12T17:23:42.155431+0000","last_became_peered":"2024-09-12T17:23:42.155431+0000","last_unstale":"2024-09-12T18:01:41.400463+0000","last_undegraded":"2024-09-12T18:01:41.400463+0000","last_fullsized":"2024-09-12T18:01:41.400463+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:57.623164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4337,"num_read_kb":3945,"num_write":1177,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"261'259","reported_seq":904,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:16.577657+0000","last_change":"2024-09-12T17:23:40.714200+0000","last_active":"2024-09-12T18:00:16.577657+0000","last_peered":"2024-09-12T18:00:16.577657+0000","last_clean":"2024-09-12T18:00:16.577657+0000","last_became_active":"2024-09-12T17:23:40.713729+0000","last_became_peered":"2024-09-12T17:23:40.713729+0000","last_unstale":"2024-09-12T18:00:16.577657+0000","last_undegraded":"2024-09-12T18:00:16.577657+0000","last_fullsized":"2024-09-12T18:00:16.577657+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:29.670887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11936418,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":409,"num_read_kb":88924,"num_write":941,"num_write_kb":31954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"261'919","reported_seq":2505,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.399527+0000","last_change":"2024-09-12T17:23:42.151306+0000","last_active":"2024-09-12T18:01:41.399527+0000","last_peered":"2024-09-12T18:01:41.399527+0000","last_clean":"2024-09-12T18:01:41.399527+0000","last_became_active":"2024-09-12T17:23:42.151035+0000","last_became_peered":"2024-09-12T17:23:42.151035+0000","last_unstale":"2024-09-12T18:01:41.399527+0000","last_undegraded":"2024-09-12T18:01:41.399527+0000","last_fullsized":"2024-09-12T18:01:41.399527+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":900,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:08.657281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4231,"num_read_kb":3788,"num_write":1202,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6418,"num_read_kb":4664,"num_write":2041,"num_write_kb":938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1112,"ondisk_log_size":1112,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16069,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16200,"num_read_kb":15888,"num_write":16774,"num_write_kb":4891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1650,"ondisk_log_size":1650,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":665,"ondisk_log_size":665,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1866102,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":16527,"num_read_kb":32201,"num_write":13993,"num_write_kb":11365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3284992,"data_stored":2749168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2337,"ondisk_log_size":2337,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2424,"num_read_kb":2890,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212759,"num_read_kb":194564,"num_write":55413,"num_write_kb":18856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3940,"ondisk_log_size":3940,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":552032445,"num_objects":4349,"num_object_clones":0,"num_object_copies":8698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4349,"num_whiteouts":0,"num_read":32110,"num_read_kb":2097905,"num_write":68413,"num_write_kb":2176823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1131245568,"data_stored":1098822149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4032,"ondisk_log_size":4032,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":63021491,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":125,"num_read_kb":196116,"num_write":140,"num_write_kb":127401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126050304,"data_stored":126042982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":63021491,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":119,"num_read_kb":185777,"num_write":140,"num_write_kb":127401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126050304,"data_stored":126042982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509904,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484396,"kb_used_data":218588,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93887444,"statfs":{"total":96636764160,"available":96140742656,"internally_reserved":0,"allocated":223834112,"data_stored":217289232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":272169418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509904,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322200,"kb_used_data":92488,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94049640,"statfs":{"total":96636764160,"available":96306831360,"internally_reserved":0,"allocated":94707712,"data_stored":90280003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509905,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":337764,"kb_used_data":220564,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94034076,"statfs":{"total":96636764160,"available":96290893824,"internally_reserved":0,"allocated":225857536,"data_stored":219438838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509905,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":230236,"kb_used_data":167116,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94141604,"statfs":{"total":96636764160,"available":96401002496,"internally_reserved":0,"allocated":171126784,"data_stored":164811483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509904,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274508,"kb_used_data":135100,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94097332,"statfs":{"total":96636764160,"available":96355667968,"internally_reserved":0,"allocated":138342400,"data_stored":133976523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509906,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":464828,"kb_used_data":217132,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":93907012,"statfs":{"total":96636764160,"available":96160780288,"internally_reserved":0,"allocated":222343168,"data_stored":216203904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253622727},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542609,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":501660,"kb_used_data":235916,"kb_used_omap":1,"kb_used_meta":265726,"kb_avail":93870180,"statfs":{"total":96636764160,"available":96123064320,"internally_reserved":0,"allocated":241577984,"data_stored":235285808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272103879},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542610,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":197288,"kb_used_data":112024,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94174552,"statfs":{"total":96636764160,"available":96434741248,"internally_reserved":0,"allocated":114712576,"data_stored":110227029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":161869824,"data_stored":157576671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84967424,"data_stored":82120971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":88948736,"data_stored":85949828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":205901824,"data_stored":201166395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":131698688,"data_stored":126861003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180600832,"data_stored":175786629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69812224,"data_stored":66888939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":207446016,"data_stored":202471713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":340771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":390760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":132593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":463531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":76234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":576021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":255236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":514022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":3790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8391821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6332416,"data_stored":6331601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27308032,"data_stored":27306334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17891328,"data_stored":17889365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15732736,"data_stored":15731852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11595776,"data_stored":11594697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20974732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29425664,"data_stored":29423702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13635584,"data_stored":13634700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25206784,"data_stored":25205969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8450048,"data_stored":8448969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5287936,"data_stored":5286238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:01:52.258 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:01:52.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:01:52.596 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":261,"fsid":"e2fc0024-c5a5-4250-915f-923340ab7b0f","created":"2024-09-12T17:23:11.337064+0000","modified":"2024-09-12T17:50:59.404346+0000","last_up_change":"2024-09-12T17:23:23.530521+0000","last_in_change":"2024-09-12T17:23:13.896535+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:23:23.633116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:23:29.858635+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T17:23:39.157684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T17:23:41.043493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T17:23:42.305685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T17:23:44.209474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T17:23:46.165620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T17:23:48.246171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T17:38:49.884679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"250","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T17:40:25.859962+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"253","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T17:40:28.452734+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"256","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T17:50:57.051968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"261","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc14ac54-a573-4ab7-9060-b1b49e7f29ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2872503546},{"type":"v1","addr":"172.21.15.44:6825","nonce":2872503546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2872503546},{"type":"v1","addr":"172.21.15.44:6827","nonce":2872503546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2872503546},{"type":"v1","addr":"172.21.15.44:6831","nonce":2872503546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2872503546},{"type":"v1","addr":"172.21.15.44:6829","nonce":2872503546}]},"public_addr":"172.21.15.44:6825/2872503546","cluster_addr":"172.21.15.44:6827/2872503546","heartbeat_back_addr":"172.21.15.44:6831/2872503546","heartbeat_front_addr":"172.21.15.44:6829/2872503546","state":["exists","up"]},{"osd":1,"uuid":"aa0a9bcc-3ee4-467e-882e-b81ac1e33d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2388684615},{"type":"v1","addr":"172.21.15.44:6817","nonce":2388684615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2388684615},{"type":"v1","addr":"172.21.15.44:6819","nonce":2388684615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2388684615},{"type":"v1","addr":"172.21.15.44:6823","nonce":2388684615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2388684615},{"type":"v1","addr":"172.21.15.44:6821","nonce":2388684615}]},"public_addr":"172.21.15.44:6817/2388684615","cluster_addr":"172.21.15.44:6819/2388684615","heartbeat_back_addr":"172.21.15.44:6823/2388684615","heartbeat_front_addr":"172.21.15.44:6821/2388684615","state":["exists","up"]},{"osd":2,"uuid":"7b386e6f-8a15-4112-be99-d23d16d6e0ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1676130713},{"type":"v1","addr":"172.21.15.44:6809","nonce":1676130713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1676130713},{"type":"v1","addr":"172.21.15.44:6811","nonce":1676130713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1676130713},{"type":"v1","addr":"172.21.15.44:6815","nonce":1676130713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1676130713},{"type":"v1","addr":"172.21.15.44:6813","nonce":1676130713}]},"public_addr":"172.21.15.44:6809/1676130713","cluster_addr":"172.21.15.44:6811/1676130713","heartbeat_back_addr":"172.21.15.44:6815/1676130713","heartbeat_front_addr":"172.21.15.44:6813/1676130713","state":["exists","up"]},{"osd":3,"uuid":"971fc3af-fe85-46e5-8a51-44f1e460416b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":4250907931},{"type":"v1","addr":"172.21.15.44:6801","nonce":4250907931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4250907931},{"type":"v1","addr":"172.21.15.44:6803","nonce":4250907931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4250907931},{"type":"v1","addr":"172.21.15.44:6807","nonce":4250907931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4250907931},{"type":"v1","addr":"172.21.15.44:6805","nonce":4250907931}]},"public_addr":"172.21.15.44:6801/4250907931","cluster_addr":"172.21.15.44:6803/4250907931","heartbeat_back_addr":"172.21.15.44:6807/4250907931","heartbeat_front_addr":"172.21.15.44:6805/4250907931","state":["exists","up"]},{"osd":4,"uuid":"b70b28f6-11c6-468b-9059-400624bcbdea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2591499742},{"type":"v1","addr":"172.21.15.181:6819","nonce":2591499742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2591499742},{"type":"v1","addr":"172.21.15.181:6821","nonce":2591499742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2591499742},{"type":"v1","addr":"172.21.15.181:6825","nonce":2591499742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2591499742},{"type":"v1","addr":"172.21.15.181:6823","nonce":2591499742}]},"public_addr":"172.21.15.181:6819/2591499742","cluster_addr":"172.21.15.181:6821/2591499742","heartbeat_back_addr":"172.21.15.181:6825/2591499742","heartbeat_front_addr":"172.21.15.181:6823/2591499742","state":["exists","up"]},{"osd":5,"uuid":"564a5e08-75c6-45fa-aa10-4231c4284450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1273321942},{"type":"v1","addr":"172.21.15.181:6827","nonce":1273321942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1273321942},{"type":"v1","addr":"172.21.15.181:6829","nonce":1273321942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1273321942},{"type":"v1","addr":"172.21.15.181:6833","nonce":1273321942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1273321942},{"type":"v1","addr":"172.21.15.181:6831","nonce":1273321942}]},"public_addr":"172.21.15.181:6827/1273321942","cluster_addr":"172.21.15.181:6829/1273321942","heartbeat_back_addr":"172.21.15.181:6833/1273321942","heartbeat_front_addr":"172.21.15.181:6831/1273321942","state":["exists","up"]},{"osd":6,"uuid":"cbcc8c67-5471-43d4-a384-01f692997d65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2228110208},{"type":"v1","addr":"172.21.15.181:6811","nonce":2228110208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2228110208},{"type":"v1","addr":"172.21.15.181:6813","nonce":2228110208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2228110208},{"type":"v1","addr":"172.21.15.181:6817","nonce":2228110208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2228110208},{"type":"v1","addr":"172.21.15.181:6815","nonce":2228110208}]},"public_addr":"172.21.15.181:6811/2228110208","cluster_addr":"172.21.15.181:6813/2228110208","heartbeat_back_addr":"172.21.15.181:6817/2228110208","heartbeat_front_addr":"172.21.15.181:6815/2228110208","state":["exists","up"]},{"osd":7,"uuid":"bfc77994-e3e4-4c97-87b7-ce5eb6424fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1372247348},{"type":"v1","addr":"172.21.15.181:6803","nonce":1372247348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1372247348},{"type":"v1","addr":"172.21.15.181:6805","nonce":1372247348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1372247348},{"type":"v1","addr":"172.21.15.181:6809","nonce":1372247348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1372247348},{"type":"v1","addr":"172.21.15.181:6807","nonce":1372247348}]},"public_addr":"172.21.15.181:6803/1372247348","cluster_addr":"172.21.15.181:6805/1372247348","heartbeat_back_addr":"172.21.15.181:6809/1372247348","heartbeat_front_addr":"172.21.15.181:6807/1372247348","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.920869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.697020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.045772+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.209650+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.616652+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.802487+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.481025+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:23:20.698668+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.26","mappings":[{"from":1,"to":5}]},{"pgid":"4.3f","mappings":[{"from":3,"to":5}]},{"pgid":"67.1e","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:01:53.610 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T18:01:53.610 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:01:53.767 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T18:01:53.767 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:01:53.767 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T18:01:53.777 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T18:01:54.094 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T18:01:54.108 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T18:01:54.108 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:01:54.249 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T18:01:54.249 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:01:54.249 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T18:01:54.260 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T18:01:54.576 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T18:01:54.589 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T18:01:54.590 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:01:54.731 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T18:01:54.731 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:01:54.731 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T18:01:54.742 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T18:01:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T18:01:55.069 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T18:01:55.069 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:01:55.211 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T18:01:55.211 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:01:55.211 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T18:01:55.222 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T18:01:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T18:01:55.554 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T18:01:55.554 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:01:55.696 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T18:01:55.696 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:01:55.696 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T18:01:55.707 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T18:01:56.023 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T18:01:56.036 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T18:01:56.037 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:01:56.179 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T18:01:56.179 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:01:56.179 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T18:01:56.190 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T18:01:56.506 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T18:01:56.519 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T18:01:56.519 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:01:56.661 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T18:01:56.661 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:01:56.661 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T18:01:56.671 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T18:01:56.991 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T18:01:57.004 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T18:01:57.005 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:01:57.148 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T18:01:57.148 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:01:57.148 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T18:01:57.158 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T18:01:57.470 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T18:01:57.483 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:01:57.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:01:57.837 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-12T18:01:57.839 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":1411,"stamp":"2024-09-12T18:01:56.483790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":84255101,"num_objects":839,"num_object_clones":0,"num_object_copies":1678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":839,"num_whiteouts":0,"num_read":291262,"num_read_kb":2734161,"num_write":161335,"num_write_kb":2469395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13646,"ondisk_log_size":13646,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1675592,"kb_used_data":190856,"kb_used_omap":12,"kb_used_meta":1483187,"kb_avail":753299128,"statfs":{"total":773094113280,"available":771378307072,"internally_reserved":0,"allocated":195436544,"data_stored":182289284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1518784051},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-601538703,"num_objects":-4074,"num_object_clones":0,"num_object_copies":-8148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4074,"num_whiteouts":0,"num_read":4652,"num_read_kb":4198,"num_write":4329,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005658"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412189+0000","last_change":"2024-09-12T17:50:58.430620+0000","last_active":"2024-09-12T17:58:29.412189+0000","last_peered":"2024-09-12T17:58:29.412189+0000","last_clean":"2024-09-12T17:58:29.412189+0000","last_became_active":"2024-09-12T17:50:58.430327+0000","last_became_peered":"2024-09-12T17:50:58.430327+0000","last_unstale":"2024-09-12T17:58:29.412189+0000","last_undegraded":"2024-09-12T17:58:29.412189+0000","last_fullsized":"2024-09-12T17:58:29.412189+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:08.467218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"261'11","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.719698+0000","last_change":"2024-09-12T17:40:30.414114+0000","last_active":"2024-09-12T18:01:49.719698+0000","last_peered":"2024-09-12T18:01:49.719698+0000","last_clean":"2024-09-12T18:01:49.719698+0000","last_became_active":"2024-09-12T17:40:30.413466+0000","last_became_peered":"2024-09-12T17:40:30.413466+0000","last_unstale":"2024-09-12T18:01:49.719698+0000","last_undegraded":"2024-09-12T18:01:49.719698+0000","last_fullsized":"2024-09-12T18:01:49.719698+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:13.588006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14338,"num_write":26,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'2","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:28.426364+0000","last_change":"2024-09-12T17:40:27.384339+0000","last_active":"2024-09-12T18:00:28.426364+0000","last_peered":"2024-09-12T18:00:28.426364+0000","last_clean":"2024-09-12T18:00:28.426364+0000","last_became_active":"2024-09-12T17:40:27.384052+0000","last_became_peered":"2024-09-12T17:40:27.384052+0000","last_unstale":"2024-09-12T18:00:28.426364+0000","last_undegraded":"2024-09-12T18:00:28.426364+0000","last_fullsized":"2024-09-12T18:00:28.426364+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:44.943293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"261'180","reported_seq":604,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.550175+0000","last_change":"2024-09-12T17:38:51.209021+0000","last_active":"2024-09-12T17:59:44.550175+0000","last_peered":"2024-09-12T17:59:44.550175+0000","last_clean":"2024-09-12T17:59:44.550175+0000","last_became_active":"2024-09-12T17:38:51.208740+0000","last_became_peered":"2024-09-12T17:38:51.208740+0000","last_unstale":"2024-09-12T17:59:44.550175+0000","last_undegraded":"2024-09-12T17:59:44.550175+0000","last_fullsized":"2024-09-12T17:59:44.550175+0000","mapping_epoch":248,"log_start":"258'100","ondisk_log_start":"258'100","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:15.411282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1105,"num_read_kb":819,"num_write":215,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612242+0000","last_change":"2024-09-12T17:50:58.429515+0000","last_active":"2024-09-12T17:58:28.612242+0000","last_peered":"2024-09-12T17:58:28.612242+0000","last_clean":"2024-09-12T17:58:28.612242+0000","last_became_active":"2024-09-12T17:50:58.429172+0000","last_became_peered":"2024-09-12T17:50:58.429172+0000","last_unstale":"2024-09-12T17:58:28.612242+0000","last_undegraded":"2024-09-12T17:58:28.612242+0000","last_fullsized":"2024-09-12T17:58:28.612242+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:58.887773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:34.428739+0000","last_change":"2024-09-12T17:40:30.419563+0000","last_active":"2024-09-12T18:00:34.428739+0000","last_peered":"2024-09-12T18:00:34.428739+0000","last_clean":"2024-09-12T18:00:34.428739+0000","last_became_active":"2024-09-12T17:40:30.419270+0000","last_became_peered":"2024-09-12T17:40:30.419270+0000","last_unstale":"2024-09-12T18:00:34.428739+0000","last_undegraded":"2024-09-12T18:00:34.428739+0000","last_fullsized":"2024-09-12T18:00:34.428739+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:40.594940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.407054+0000","last_change":"2024-09-12T17:40:27.383763+0000","last_active":"2024-09-12T17:57:59.407054+0000","last_peered":"2024-09-12T17:57:59.407054+0000","last_clean":"2024-09-12T17:57:59.407054+0000","last_became_active":"2024-09-12T17:40:27.383464+0000","last_became_peered":"2024-09-12T17:40:27.383464+0000","last_unstale":"2024-09-12T17:57:59.407054+0000","last_undegraded":"2024-09-12T17:57:59.407054+0000","last_fullsized":"2024-09-12T17:57:59.407054+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:17.860149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"261'20","reported_seq":98,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.513810+0000","last_change":"2024-09-12T17:38:51.217668+0000","last_active":"2024-09-12T17:59:54.513810+0000","last_peered":"2024-09-12T17:59:54.513810+0000","last_clean":"2024-09-12T17:59:54.513810+0000","last_became_active":"2024-09-12T17:38:51.217312+0000","last_became_peered":"2024-09-12T17:38:51.217312+0000","last_unstale":"2024-09-12T17:59:54.513810+0000","last_undegraded":"2024-09-12T17:59:54.513810+0000","last_fullsized":"2024-09-12T17:59:54.513810+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:44.870657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":68,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.407763+0000","last_change":"2024-09-12T17:50:58.425626+0000","last_active":"2024-09-12T17:58:14.407763+0000","last_peered":"2024-09-12T17:58:14.407763+0000","last_clean":"2024-09-12T17:58:14.407763+0000","last_became_active":"2024-09-12T17:50:58.425202+0000","last_became_peered":"2024-09-12T17:50:58.425202+0000","last_unstale":"2024-09-12T17:58:14.407763+0000","last_undegraded":"2024-09-12T17:58:14.407763+0000","last_fullsized":"2024-09-12T17:58:14.407763+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:43.003436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546433+0000","last_change":"2024-09-12T17:40:30.428077+0000","last_active":"2024-09-12T17:59:19.546433+0000","last_peered":"2024-09-12T17:59:19.546433+0000","last_clean":"2024-09-12T17:59:19.546433+0000","last_became_active":"2024-09-12T17:40:30.427798+0000","last_became_peered":"2024-09-12T17:40:30.427798+0000","last_unstale":"2024-09-12T17:59:19.546433+0000","last_undegraded":"2024-09-12T17:59:19.546433+0000","last_fullsized":"2024-09-12T17:59:19.546433+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:08.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612294+0000","last_change":"2024-09-12T17:40:27.381742+0000","last_active":"2024-09-12T17:58:28.612294+0000","last_peered":"2024-09-12T17:58:28.612294+0000","last_clean":"2024-09-12T17:58:28.612294+0000","last_became_active":"2024-09-12T17:40:27.381456+0000","last_became_peered":"2024-09-12T17:40:27.381456+0000","last_unstale":"2024-09-12T17:58:28.612294+0000","last_undegraded":"2024-09-12T17:58:28.612294+0000","last_fullsized":"2024-09-12T17:58:28.612294+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:34.919045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"261'39","reported_seq":146,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:54.543334+0000","last_change":"2024-09-12T17:38:51.212514+0000","last_active":"2024-09-12T17:58:54.543334+0000","last_peered":"2024-09-12T17:58:54.543334+0000","last_clean":"2024-09-12T17:58:54.543334+0000","last_became_active":"2024-09-12T17:38:51.212222+0000","last_became_peered":"2024-09-12T17:38:51.212222+0000","last_unstale":"2024-09-12T17:58:54.543334+0000","last_undegraded":"2024-09-12T17:58:54.543334+0000","last_fullsized":"2024-09-12T17:58:54.543334+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:58.957926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":132,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.408592+0000","last_change":"2024-09-12T17:50:58.422072+0000","last_active":"2024-09-12T17:58:18.408592+0000","last_peered":"2024-09-12T17:58:18.408592+0000","last_clean":"2024-09-12T17:58:18.408592+0000","last_became_active":"2024-09-12T17:50:58.421791+0000","last_became_peered":"2024-09-12T17:50:58.421791+0000","last_unstale":"2024-09-12T17:58:18.408592+0000","last_undegraded":"2024-09-12T17:58:18.408592+0000","last_fullsized":"2024-09-12T17:58:18.408592+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:23.289873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'3","reported_seq":30,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.562664+0000","last_change":"2024-09-12T17:41:17.634582+0000","last_active":"2024-09-12T18:01:19.562664+0000","last_peered":"2024-09-12T18:01:19.562664+0000","last_clean":"2024-09-12T18:01:19.562664+0000","last_became_active":"2024-09-12T17:41:17.634263+0000","last_became_peered":"2024-09-12T17:41:17.634263+0000","last_unstale":"2024-09-12T18:01:19.562664+0000","last_undegraded":"2024-09-12T18:01:19.562664+0000","last_fullsized":"2024-09-12T18:01:19.562664+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:21.737434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1f","version":"261'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.434726+0000","last_change":"2024-09-12T17:40:27.381866+0000","last_active":"2024-09-12T18:01:19.434726+0000","last_peered":"2024-09-12T18:01:19.434726+0000","last_clean":"2024-09-12T18:01:19.434726+0000","last_became_active":"2024-09-12T17:40:27.381587+0000","last_became_peered":"2024-09-12T17:40:27.381587+0000","last_unstale":"2024-09-12T18:01:19.434726+0000","last_undegraded":"2024-09-12T18:01:19.434726+0000","last_fullsized":"2024-09-12T18:01:19.434726+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:05.484868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"261'16","reported_seq":86,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:53.414258+0000","last_change":"2024-09-12T17:38:51.211725+0000","last_active":"2024-09-12T17:58:53.414258+0000","last_peered":"2024-09-12T17:58:53.414258+0000","last_clean":"2024-09-12T17:58:53.414258+0000","last_became_active":"2024-09-12T17:38:51.211429+0000","last_became_peered":"2024-09-12T17:38:51.211429+0000","last_unstale":"2024-09-12T17:58:53.414258+0000","last_undegraded":"2024-09-12T17:58:53.414258+0000","last_fullsized":"2024-09-12T17:58:53.414258+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:51.433082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":53,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:03.415591+0000","last_change":"2024-09-12T17:50:58.425178+0000","last_active":"2024-09-12T17:59:03.415591+0000","last_peered":"2024-09-12T17:59:03.415591+0000","last_clean":"2024-09-12T17:59:03.415591+0000","last_became_active":"2024-09-12T17:50:58.424898+0000","last_became_peered":"2024-09-12T17:50:58.424898+0000","last_unstale":"2024-09-12T17:59:03.415591+0000","last_undegraded":"2024-09-12T17:59:03.415591+0000","last_fullsized":"2024-09-12T17:59:03.415591+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:43.460057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.403387+0000","last_change":"2024-09-12T17:40:30.419273+0000","last_active":"2024-09-12T17:57:29.403387+0000","last_peered":"2024-09-12T17:57:29.403387+0000","last_clean":"2024-09-12T17:57:29.403387+0000","last_became_active":"2024-09-12T17:40:30.418865+0000","last_became_peered":"2024-09-12T17:40:30.418865+0000","last_unstale":"2024-09-12T17:57:29.403387+0000","last_undegraded":"2024-09-12T17:57:29.403387+0000","last_fullsized":"2024-09-12T17:57:29.403387+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:37.865615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'8","reported_seq":55,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:49.550781+0000","last_change":"2024-09-12T17:40:27.384760+0000","last_active":"2024-09-12T17:59:49.550781+0000","last_peered":"2024-09-12T17:59:49.550781+0000","last_clean":"2024-09-12T17:59:49.550781+0000","last_became_active":"2024-09-12T17:40:27.384445+0000","last_became_peered":"2024-09-12T17:40:27.384445+0000","last_unstale":"2024-09-12T17:59:49.550781+0000","last_undegraded":"2024-09-12T17:59:49.550781+0000","last_fullsized":"2024-09-12T17:59:49.550781+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:48.815935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"261'42","reported_seq":159,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.511172+0000","last_change":"2024-09-12T17:38:51.217731+0000","last_active":"2024-09-12T17:59:16.511172+0000","last_peered":"2024-09-12T17:59:16.511172+0000","last_clean":"2024-09-12T17:59:16.511172+0000","last_became_active":"2024-09-12T17:38:51.217421+0000","last_became_peered":"2024-09-12T17:38:51.217421+0000","last_unstale":"2024-09-12T17:59:16.511172+0000","last_undegraded":"2024-09-12T17:59:16.511172+0000","last_fullsized":"2024-09-12T17:59:16.511172+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:29.905573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":155,"num_write":73,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.418508+0000","last_change":"2024-09-12T17:50:58.422069+0000","last_active":"2024-09-12T17:59:19.418508+0000","last_peered":"2024-09-12T17:59:19.418508+0000","last_clean":"2024-09-12T17:59:19.418508+0000","last_became_active":"2024-09-12T17:50:58.421760+0000","last_became_peered":"2024-09-12T17:50:58.421760+0000","last_unstale":"2024-09-12T17:59:19.418508+0000","last_undegraded":"2024-09-12T17:59:19.418508+0000","last_fullsized":"2024-09-12T17:59:19.418508+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:17.645861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'2","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.420697+0000","last_change":"2024-09-12T17:40:30.417805+0000","last_active":"2024-09-12T17:59:54.420697+0000","last_peered":"2024-09-12T17:59:54.420697+0000","last_clean":"2024-09-12T17:59:54.420697+0000","last_became_active":"2024-09-12T17:40:30.417372+0000","last_became_peered":"2024-09-12T17:40:30.417372+0000","last_unstale":"2024-09-12T17:59:54.420697+0000","last_undegraded":"2024-09-12T17:59:54.420697+0000","last_fullsized":"2024-09-12T17:59:54.420697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:46.977654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"258'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.403961+0000","last_change":"2024-09-12T17:40:27.379433+0000","last_active":"2024-09-12T17:57:29.403961+0000","last_peered":"2024-09-12T17:57:29.403961+0000","last_clean":"2024-09-12T17:57:29.403961+0000","last_became_active":"2024-09-12T17:40:27.379161+0000","last_became_peered":"2024-09-12T17:40:27.379161+0000","last_unstale":"2024-09-12T17:57:29.403961+0000","last_undegraded":"2024-09-12T17:57:29.403961+0000","last_fullsized":"2024-09-12T17:57:29.403961+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:17.149187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"261'20","reported_seq":98,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:54.413353+0000","last_change":"2024-09-12T17:38:51.214836+0000","last_active":"2024-09-12T17:58:54.413353+0000","last_peered":"2024-09-12T17:58:54.413353+0000","last_clean":"2024-09-12T17:58:54.413353+0000","last_became_active":"2024-09-12T17:38:51.214555+0000","last_became_peered":"2024-09-12T17:38:51.214555+0000","last_unstale":"2024-09-12T17:58:54.413353+0000","last_undegraded":"2024-09-12T17:58:54.413353+0000","last_fullsized":"2024-09-12T17:58:54.413353+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:24.488340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412872+0000","last_change":"2024-09-12T17:50:58.429666+0000","last_active":"2024-09-12T17:58:29.412872+0000","last_peered":"2024-09-12T17:58:29.412872+0000","last_clean":"2024-09-12T17:58:29.412872+0000","last_became_active":"2024-09-12T17:50:58.429381+0000","last_became_peered":"2024-09-12T17:50:58.429381+0000","last_unstale":"2024-09-12T17:58:29.412872+0000","last_undegraded":"2024-09-12T17:58:29.412872+0000","last_fullsized":"2024-09-12T17:58:29.412872+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:24.108837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:04.406346+0000","last_change":"2024-09-12T17:40:30.420492+0000","last_active":"2024-09-12T17:58:04.406346+0000","last_peered":"2024-09-12T17:58:04.406346+0000","last_clean":"2024-09-12T17:58:04.406346+0000","last_became_active":"2024-09-12T17:40:30.420165+0000","last_became_peered":"2024-09-12T17:40:30.420165+0000","last_unstale":"2024-09-12T17:58:04.406346+0000","last_undegraded":"2024-09-12T17:58:04.406346+0000","last_fullsized":"2024-09-12T17:58:04.406346+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:02.691513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"261'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:29.427973+0000","last_change":"2024-09-12T17:40:27.382601+0000","last_active":"2024-09-12T18:00:29.427973+0000","last_peered":"2024-09-12T18:00:29.427973+0000","last_clean":"2024-09-12T18:00:29.427973+0000","last_became_active":"2024-09-12T17:40:27.382310+0000","last_became_peered":"2024-09-12T17:40:27.382310+0000","last_unstale":"2024-09-12T18:00:29.427973+0000","last_undegraded":"2024-09-12T18:00:29.427973+0000","last_fullsized":"2024-09-12T18:00:29.427973+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:53.252512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"261'83","reported_seq":276,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537110+0000","last_change":"2024-09-12T17:38:51.213883+0000","last_active":"2024-09-12T17:58:14.537110+0000","last_peered":"2024-09-12T17:58:14.537110+0000","last_clean":"2024-09-12T17:58:14.537110+0000","last_became_active":"2024-09-12T17:38:51.213569+0000","last_became_peered":"2024-09-12T17:38:51.213569+0000","last_unstale":"2024-09-12T17:58:14.537110+0000","last_undegraded":"2024-09-12T17:58:14.537110+0000","last_fullsized":"2024-09-12T17:58:14.537110+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:09.021970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":443,"num_read_kb":326,"num_write":140,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412923+0000","last_change":"2024-09-12T17:50:58.431925+0000","last_active":"2024-09-12T17:58:29.412923+0000","last_peered":"2024-09-12T17:58:29.412923+0000","last_clean":"2024-09-12T17:58:29.412923+0000","last_became_active":"2024-09-12T17:50:58.431242+0000","last_became_peered":"2024-09-12T17:50:58.431242+0000","last_unstale":"2024-09-12T17:58:29.412923+0000","last_undegraded":"2024-09-12T17:58:29.412923+0000","last_fullsized":"2024-09-12T17:58:29.412923+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:38.404256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'2","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:33.427097+0000","last_change":"2024-09-12T17:40:30.417580+0000","last_active":"2024-09-12T18:00:33.427097+0000","last_peered":"2024-09-12T18:00:33.427097+0000","last_clean":"2024-09-12T18:00:33.427097+0000","last_became_active":"2024-09-12T17:40:30.416973+0000","last_became_peered":"2024-09-12T17:40:30.416973+0000","last_unstale":"2024-09-12T18:00:33.427097+0000","last_undegraded":"2024-09-12T18:00:33.427097+0000","last_fullsized":"2024-09-12T18:00:33.427097+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:01.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"258'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.535018+0000","last_change":"2024-09-12T17:40:27.383868+0000","last_active":"2024-09-12T17:57:59.535018+0000","last_peered":"2024-09-12T17:57:59.535018+0000","last_clean":"2024-09-12T17:57:59.535018+0000","last_became_active":"2024-09-12T17:40:27.383589+0000","last_became_peered":"2024-09-12T17:40:27.383589+0000","last_unstale":"2024-09-12T17:57:59.535018+0000","last_undegraded":"2024-09-12T17:57:59.535018+0000","last_fullsized":"2024-09-12T17:57:59.535018+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:33.218417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"261'40","reported_seq":149,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:52.416289+0000","last_change":"2024-09-12T17:38:51.212263+0000","last_active":"2024-09-12T17:59:52.416289+0000","last_peered":"2024-09-12T17:59:52.416289+0000","last_clean":"2024-09-12T17:59:52.416289+0000","last_became_active":"2024-09-12T17:38:51.211962+0000","last_became_peered":"2024-09-12T17:38:51.211962+0000","last_unstale":"2024-09-12T17:59:52.416289+0000","last_undegraded":"2024-09-12T17:59:52.416289+0000","last_fullsized":"2024-09-12T17:59:52.416289+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:27.978434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":137,"num_write":74,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.406991+0000","last_change":"2024-09-12T17:50:58.415378+0000","last_active":"2024-09-12T17:57:59.406991+0000","last_peered":"2024-09-12T17:57:59.406991+0000","last_clean":"2024-09-12T17:57:59.406991+0000","last_became_active":"2024-09-12T17:50:58.415098+0000","last_became_peered":"2024-09-12T17:50:58.415098+0000","last_unstale":"2024-09-12T17:57:59.406991+0000","last_undegraded":"2024-09-12T17:57:59.406991+0000","last_fullsized":"2024-09-12T17:57:59.406991+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:07.460645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.400786+0000","last_change":"2024-09-12T17:40:30.426133+0000","last_active":"2024-09-12T17:57:28.400786+0000","last_peered":"2024-09-12T17:57:28.400786+0000","last_clean":"2024-09-12T17:57:28.400786+0000","last_became_active":"2024-09-12T17:40:30.425845+0000","last_became_peered":"2024-09-12T17:40:30.425845+0000","last_unstale":"2024-09-12T17:57:28.400786+0000","last_undegraded":"2024-09-12T17:57:28.400786+0000","last_fullsized":"2024-09-12T17:57:28.400786+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:39.872124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"261'11","reported_seq":64,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.440175+0000","last_change":"2024-09-12T17:40:27.383205+0000","last_active":"2024-09-12T18:01:34.440175+0000","last_peered":"2024-09-12T18:01:34.440175+0000","last_clean":"2024-09-12T18:01:34.440175+0000","last_became_active":"2024-09-12T17:40:27.382833+0000","last_became_peered":"2024-09-12T17:40:27.382833+0000","last_unstale":"2024-09-12T18:01:34.440175+0000","last_undegraded":"2024-09-12T18:01:34.440175+0000","last_fullsized":"2024-09-12T18:01:34.440175+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:27.606242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32770,"num_write":16,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"261'60","reported_seq":203,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537248+0000","last_change":"2024-09-12T17:38:51.214569+0000","last_active":"2024-09-12T17:58:14.537248+0000","last_peered":"2024-09-12T17:58:14.537248+0000","last_clean":"2024-09-12T17:58:14.537248+0000","last_became_active":"2024-09-12T17:38:51.214274+0000","last_became_peered":"2024-09-12T17:38:51.214274+0000","last_unstale":"2024-09-12T17:58:14.537248+0000","last_undegraded":"2024-09-12T17:58:14.537248+0000","last_fullsized":"2024-09-12T17:58:14.537248+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:23.016284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":211,"num_write":107,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:58.608464+0000","last_change":"2024-09-12T17:50:58.426819+0000","last_active":"2024-09-12T17:57:58.608464+0000","last_peered":"2024-09-12T17:57:58.608464+0000","last_clean":"2024-09-12T17:57:58.608464+0000","last_became_active":"2024-09-12T17:50:58.426537+0000","last_became_peered":"2024-09-12T17:50:58.426537+0000","last_unstale":"2024-09-12T17:57:58.608464+0000","last_undegraded":"2024-09-12T17:57:58.608464+0000","last_fullsized":"2024-09-12T17:57:58.608464+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.965601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"261'8","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.435543+0000","last_change":"2024-09-12T17:40:30.427100+0000","last_active":"2024-09-12T18:01:38.435543+0000","last_peered":"2024-09-12T18:01:38.435543+0000","last_clean":"2024-09-12T18:01:38.435543+0000","last_became_active":"2024-09-12T17:40:30.425368+0000","last_became_peered":"2024-09-12T17:40:30.425368+0000","last_unstale":"2024-09-12T18:01:38.435543+0000","last_undegraded":"2024-09-12T18:01:38.435543+0000","last_fullsized":"2024-09-12T18:01:38.435543+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:47.929671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:49.423468+0000","last_change":"2024-09-12T17:40:27.380566+0000","last_active":"2024-09-12T17:59:49.423468+0000","last_peered":"2024-09-12T17:59:49.423468+0000","last_clean":"2024-09-12T17:59:49.423468+0000","last_became_active":"2024-09-12T17:40:27.380228+0000","last_became_peered":"2024-09-12T17:40:27.380228+0000","last_unstale":"2024-09-12T17:59:49.423468+0000","last_undegraded":"2024-09-12T17:59:49.423468+0000","last_fullsized":"2024-09-12T17:59:49.423468+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:05.600168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"261'21","reported_seq":99,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.495658+0000","last_change":"2024-09-12T17:38:51.218671+0000","last_active":"2024-09-12T17:59:15.495658+0000","last_peered":"2024-09-12T17:59:15.495658+0000","last_clean":"2024-09-12T17:59:15.495658+0000","last_became_active":"2024-09-12T17:38:51.218309+0000","last_became_peered":"2024-09-12T17:38:51.218309+0000","last_unstale":"2024-09-12T17:59:15.495658+0000","last_undegraded":"2024-09-12T17:59:15.495658+0000","last_fullsized":"2024-09-12T17:59:15.495658+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:45.726103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.408378+0000","last_change":"2024-09-12T17:50:58.425291+0000","last_active":"2024-09-12T17:57:59.408378+0000","last_peered":"2024-09-12T17:57:59.408378+0000","last_clean":"2024-09-12T17:57:59.408378+0000","last_became_active":"2024-09-12T17:50:58.425003+0000","last_became_peered":"2024-09-12T17:50:58.425003+0000","last_unstale":"2024-09-12T17:57:59.408378+0000","last_undegraded":"2024-09-12T17:57:59.408378+0000","last_fullsized":"2024-09-12T17:57:59.408378+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:33.694791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"261'3","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:53.422356+0000","last_change":"2024-09-12T17:40:30.427105+0000","last_active":"2024-09-12T17:59:53.422356+0000","last_peered":"2024-09-12T17:59:53.422356+0000","last_clean":"2024-09-12T17:59:53.422356+0000","last_became_active":"2024-09-12T17:40:30.426714+0000","last_became_peered":"2024-09-12T17:40:30.426714+0000","last_unstale":"2024-09-12T17:59:53.422356+0000","last_undegraded":"2024-09-12T17:59:53.422356+0000","last_fullsized":"2024-09-12T17:59:53.422356+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:21.352761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:23.603864+0000","last_change":"2024-09-12T17:40:27.382447+0000","last_active":"2024-09-12T17:57:23.603864+0000","last_peered":"2024-09-12T17:57:23.603864+0000","last_clean":"2024-09-12T17:57:23.603864+0000","last_became_active":"2024-09-12T17:40:27.382132+0000","last_became_peered":"2024-09-12T17:40:27.382132+0000","last_unstale":"2024-09-12T17:57:23.603864+0000","last_undegraded":"2024-09-12T17:57:23.603864+0000","last_fullsized":"2024-09-12T17:57:23.603864+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:38.796258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"261'28","reported_seq":122,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.610428+0000","last_change":"2024-09-12T17:38:51.215254+0000","last_active":"2024-09-12T17:58:13.610428+0000","last_peered":"2024-09-12T17:58:13.610428+0000","last_clean":"2024-09-12T17:58:13.610428+0000","last_became_active":"2024-09-12T17:38:51.214963+0000","last_became_peered":"2024-09-12T17:38:51.214963+0000","last_unstale":"2024-09-12T17:58:13.610428+0000","last_undegraded":"2024-09-12T17:58:13.610428+0000","last_fullsized":"2024-09-12T17:58:13.610428+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:33.596786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":103,"num_write":58,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.407865+0000","last_change":"2024-09-12T17:50:58.427202+0000","last_active":"2024-09-12T17:57:59.407865+0000","last_peered":"2024-09-12T17:57:59.407865+0000","last_clean":"2024-09-12T17:57:59.407865+0000","last_became_active":"2024-09-12T17:50:58.426779+0000","last_became_peered":"2024-09-12T17:50:58.426779+0000","last_unstale":"2024-09-12T17:57:59.407865+0000","last_undegraded":"2024-09-12T17:57:59.407865+0000","last_fullsized":"2024-09-12T17:57:59.407865+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:56.570650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"258'6","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.404116+0000","last_change":"2024-09-12T17:40:30.419477+0000","last_active":"2024-09-12T17:57:29.404116+0000","last_peered":"2024-09-12T17:57:29.404116+0000","last_clean":"2024-09-12T17:57:29.404116+0000","last_became_active":"2024-09-12T17:40:30.419211+0000","last_became_peered":"2024-09-12T17:40:30.419211+0000","last_unstale":"2024-09-12T17:57:29.404116+0000","last_undegraded":"2024-09-12T17:57:29.404116+0000","last_fullsized":"2024-09-12T17:57:29.404116+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:06.524125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:24.529259+0000","last_change":"2024-09-12T17:40:27.382860+0000","last_active":"2024-09-12T17:57:24.529259+0000","last_peered":"2024-09-12T17:57:24.529259+0000","last_clean":"2024-09-12T17:57:24.529259+0000","last_became_active":"2024-09-12T17:40:27.382564+0000","last_became_peered":"2024-09-12T17:40:27.382564+0000","last_unstale":"2024-09-12T17:57:24.529259+0000","last_undegraded":"2024-09-12T17:57:24.529259+0000","last_fullsized":"2024-09-12T17:57:24.529259+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:37.855260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"261'12","reported_seq":75,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.405626+0000","last_change":"2024-09-12T17:38:51.215105+0000","last_active":"2024-09-12T17:57:39.405626+0000","last_peered":"2024-09-12T17:57:39.405626+0000","last_clean":"2024-09-12T17:57:39.405626+0000","last_became_active":"2024-09-12T17:38:51.214678+0000","last_became_peered":"2024-09-12T17:38:51.214678+0000","last_unstale":"2024-09-12T17:57:39.405626+0000","last_undegraded":"2024-09-12T17:57:39.405626+0000","last_fullsized":"2024-09-12T17:57:39.405626+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:23.825989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":38,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.407844+0000","last_change":"2024-09-12T17:50:58.427915+0000","last_active":"2024-09-12T17:58:13.407844+0000","last_peered":"2024-09-12T17:58:13.407844+0000","last_clean":"2024-09-12T17:58:13.407844+0000","last_became_active":"2024-09-12T17:50:58.427630+0000","last_became_peered":"2024-09-12T17:50:58.427630+0000","last_unstale":"2024-09-12T17:58:13.407844+0000","last_undegraded":"2024-09-12T17:58:13.407844+0000","last_fullsized":"2024-09-12T17:58:13.407844+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:54.698191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"261'14","reported_seq":66,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.149935+0000","last_change":"2024-09-12T17:40:30.413875+0000","last_active":"2024-09-12T18:01:50.149935+0000","last_peered":"2024-09-12T18:01:50.149935+0000","last_clean":"2024-09-12T18:01:50.149935+0000","last_became_active":"2024-09-12T17:40:30.413592+0000","last_became_peered":"2024-09-12T17:40:30.413592+0000","last_unstale":"2024-09-12T18:01:50.149935+0000","last_undegraded":"2024-09-12T18:01:50.149935+0000","last_fullsized":"2024-09-12T18:01:50.149935+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:47.033025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":45058,"num_write":24,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'8","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.435790+0000","last_change":"2024-09-12T17:40:27.382000+0000","last_active":"2024-09-12T18:01:29.435790+0000","last_peered":"2024-09-12T18:01:29.435790+0000","last_clean":"2024-09-12T18:01:29.435790+0000","last_became_active":"2024-09-12T17:40:27.381516+0000","last_became_peered":"2024-09-12T17:40:27.381516+0000","last_unstale":"2024-09-12T18:01:29.435790+0000","last_undegraded":"2024-09-12T18:01:29.435790+0000","last_fullsized":"2024-09-12T18:01:29.435790+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:48.416419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"261'6","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404930+0000","last_change":"2024-09-12T17:38:51.216019+0000","last_active":"2024-09-12T17:57:34.404930+0000","last_peered":"2024-09-12T17:57:34.404930+0000","last_clean":"2024-09-12T17:57:34.404930+0000","last_became_active":"2024-09-12T17:38:51.215646+0000","last_became_peered":"2024-09-12T17:38:51.215646+0000","last_unstale":"2024-09-12T17:57:34.404930+0000","last_undegraded":"2024-09-12T17:57:34.404930+0000","last_fullsized":"2024-09-12T17:57:34.404930+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:36.940207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537213+0000","last_change":"2024-09-12T17:50:58.423068+0000","last_active":"2024-09-12T17:58:14.537213+0000","last_peered":"2024-09-12T17:58:14.537213+0000","last_clean":"2024-09-12T17:58:14.537213+0000","last_became_active":"2024-09-12T17:50:58.422692+0000","last_became_peered":"2024-09-12T17:50:58.422692+0000","last_unstale":"2024-09-12T17:58:14.537213+0000","last_undegraded":"2024-09-12T17:58:14.537213+0000","last_fullsized":"2024-09-12T17:58:14.537213+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:51.624436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.434925+0000","last_change":"2024-09-12T17:40:30.419235+0000","last_active":"2024-09-12T18:01:29.434925+0000","last_peered":"2024-09-12T18:01:29.434925+0000","last_clean":"2024-09-12T18:01:29.434925+0000","last_became_active":"2024-09-12T17:40:30.418904+0000","last_became_peered":"2024-09-12T17:40:30.418904+0000","last_unstale":"2024-09-12T18:01:29.434925+0000","last_undegraded":"2024-09-12T18:01:29.434925+0000","last_fullsized":"2024-09-12T18:01:29.434925+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:39.501098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.416187+0000","last_change":"2024-09-12T17:40:27.382156+0000","last_active":"2024-09-12T17:59:08.416187+0000","last_peered":"2024-09-12T17:59:08.416187+0000","last_clean":"2024-09-12T17:59:08.416187+0000","last_became_active":"2024-09-12T17:40:27.381849+0000","last_became_peered":"2024-09-12T17:40:27.381849+0000","last_unstale":"2024-09-12T17:59:08.416187+0000","last_undegraded":"2024-09-12T17:59:08.416187+0000","last_fullsized":"2024-09-12T17:59:08.416187+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:03.117165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"261'23","reported_seq":103,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:05.807493+0000","last_change":"2024-09-12T17:38:51.208118+0000","last_active":"2024-09-12T17:59:05.807493+0000","last_peered":"2024-09-12T17:59:05.807493+0000","last_clean":"2024-09-12T17:59:05.807493+0000","last_became_active":"2024-09-12T17:38:51.207804+0000","last_became_peered":"2024-09-12T17:38:51.207804+0000","last_unstale":"2024-09-12T17:59:05.807493+0000","last_undegraded":"2024-09-12T17:59:05.807493+0000","last_fullsized":"2024-09-12T17:59:05.807493+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:07.620875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":76,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.535062+0000","last_change":"2024-09-12T17:50:58.424688+0000","last_active":"2024-09-12T17:57:59.535062+0000","last_peered":"2024-09-12T17:57:59.535062+0000","last_clean":"2024-09-12T17:57:59.535062+0000","last_became_active":"2024-09-12T17:50:58.424379+0000","last_became_peered":"2024-09-12T17:50:58.424379+0000","last_unstale":"2024-09-12T17:57:59.535062+0000","last_undegraded":"2024-09-12T17:57:59.535062+0000","last_fullsized":"2024-09-12T17:57:59.535062+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:33.922718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:13.416845+0000","last_change":"2024-09-12T17:40:30.418399+0000","last_active":"2024-09-12T17:59:13.416845+0000","last_peered":"2024-09-12T17:59:13.416845+0000","last_clean":"2024-09-12T17:59:13.416845+0000","last_became_active":"2024-09-12T17:40:30.417111+0000","last_became_peered":"2024-09-12T17:40:30.417111+0000","last_unstale":"2024-09-12T17:59:13.416845+0000","last_undegraded":"2024-09-12T17:59:13.416845+0000","last_fullsized":"2024-09-12T17:59:13.416845+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:35.848674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415357+0000","last_change":"2024-09-12T17:40:27.378507+0000","last_active":"2024-09-12T17:59:09.415357+0000","last_peered":"2024-09-12T17:59:09.415357+0000","last_clean":"2024-09-12T17:59:09.415357+0000","last_became_active":"2024-09-12T17:40:27.378245+0000","last_became_peered":"2024-09-12T17:40:27.378245+0000","last_unstale":"2024-09-12T17:59:09.415357+0000","last_undegraded":"2024-09-12T17:59:09.415357+0000","last_fullsized":"2024-09-12T17:59:09.415357+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:43.060058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"261'38","reported_seq":153,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404752+0000","last_change":"2024-09-12T17:38:51.209261+0000","last_active":"2024-09-12T17:57:34.404752+0000","last_peered":"2024-09-12T17:57:34.404752+0000","last_clean":"2024-09-12T17:57:34.404752+0000","last_became_active":"2024-09-12T17:38:51.208950+0000","last_became_peered":"2024-09-12T17:38:51.208950+0000","last_unstale":"2024-09-12T17:57:34.404752+0000","last_undegraded":"2024-09-12T17:57:34.404752+0000","last_fullsized":"2024-09-12T17:57:34.404752+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:12.331668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":143,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.407814+0000","last_change":"2024-09-12T17:50:58.426040+0000","last_active":"2024-09-12T17:58:13.407814+0000","last_peered":"2024-09-12T17:58:13.407814+0000","last_clean":"2024-09-12T17:58:13.407814+0000","last_became_active":"2024-09-12T17:50:58.425574+0000","last_became_peered":"2024-09-12T17:50:58.425574+0000","last_unstale":"2024-09-12T17:58:13.407814+0000","last_undegraded":"2024-09-12T17:58:13.407814+0000","last_fullsized":"2024-09-12T17:58:13.407814+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:39.335745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.415906+0000","last_change":"2024-09-12T17:40:30.412045+0000","last_active":"2024-09-12T17:59:14.415906+0000","last_peered":"2024-09-12T17:59:14.415906+0000","last_clean":"2024-09-12T17:59:14.415906+0000","last_became_active":"2024-09-12T17:40:30.411737+0000","last_became_peered":"2024-09-12T17:40:30.411737+0000","last_unstale":"2024-09-12T17:59:14.415906+0000","last_undegraded":"2024-09-12T17:59:14.415906+0000","last_fullsized":"2024-09-12T17:59:14.415906+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:10.622751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417509+0000","last_change":"2024-09-12T17:40:27.372635+0000","last_active":"2024-09-12T17:59:09.417509+0000","last_peered":"2024-09-12T17:59:09.417509+0000","last_clean":"2024-09-12T17:59:09.417509+0000","last_became_active":"2024-09-12T17:40:27.372357+0000","last_became_peered":"2024-09-12T17:40:27.372357+0000","last_unstale":"2024-09-12T17:59:09.417509+0000","last_undegraded":"2024-09-12T17:59:09.417509+0000","last_fullsized":"2024-09-12T17:59:09.417509+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:34.828926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"261'42","reported_seq":150,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.401471+0000","last_change":"2024-09-12T17:38:51.208068+0000","last_active":"2024-09-12T17:57:33.401471+0000","last_peered":"2024-09-12T17:57:33.401471+0000","last_clean":"2024-09-12T17:57:33.401471+0000","last_became_active":"2024-09-12T17:38:51.207798+0000","last_became_peered":"2024-09-12T17:38:51.207798+0000","last_unstale":"2024-09-12T17:57:33.401471+0000","last_undegraded":"2024-09-12T17:57:33.401471+0000","last_fullsized":"2024-09-12T17:57:33.401471+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:58.346672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":137,"num_write":80,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.621049+0000","last_change":"2024-09-12T17:50:58.428924+0000","last_active":"2024-09-12T17:59:38.621049+0000","last_peered":"2024-09-12T17:59:38.621049+0000","last_clean":"2024-09-12T17:59:38.621049+0000","last_became_active":"2024-09-12T17:50:58.428339+0000","last_became_peered":"2024-09-12T17:50:58.428339+0000","last_unstale":"2024-09-12T17:59:38.621049+0000","last_undegraded":"2024-09-12T17:59:38.621049+0000","last_fullsized":"2024-09-12T17:59:38.621049+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:46.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"261'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:48.429079+0000","last_change":"2024-09-12T17:40:30.417879+0000","last_active":"2024-09-12T18:00:48.429079+0000","last_peered":"2024-09-12T18:00:48.429079+0000","last_clean":"2024-09-12T18:00:48.429079+0000","last_became_active":"2024-09-12T17:40:30.417583+0000","last_became_peered":"2024-09-12T17:40:30.417583+0000","last_unstale":"2024-09-12T18:00:48.429079+0000","last_undegraded":"2024-09-12T18:00:48.429079+0000","last_fullsized":"2024-09-12T18:00:48.429079+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:57.147303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"258'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412848+0000","last_change":"2024-09-12T17:40:27.381338+0000","last_active":"2024-09-12T17:58:29.412848+0000","last_peered":"2024-09-12T17:58:29.412848+0000","last_clean":"2024-09-12T17:58:29.412848+0000","last_became_active":"2024-09-12T17:40:27.381027+0000","last_became_peered":"2024-09-12T17:40:27.381027+0000","last_unstale":"2024-09-12T17:58:29.412848+0000","last_undegraded":"2024-09-12T17:58:29.412848+0000","last_fullsized":"2024-09-12T17:58:29.412848+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:16.850258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"261'21","reported_seq":98,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.254313+0000","last_change":"2024-09-12T17:38:51.207794+0000","last_active":"2024-09-12T17:59:54.254313+0000","last_peered":"2024-09-12T17:59:54.254313+0000","last_clean":"2024-09-12T17:59:54.254313+0000","last_became_active":"2024-09-12T17:38:51.207487+0000","last_became_peered":"2024-09-12T17:38:51.207487+0000","last_unstale":"2024-09-12T17:59:54.254313+0000","last_undegraded":"2024-09-12T17:59:54.254313+0000","last_fullsized":"2024-09-12T17:59:54.254313+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:45.756120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":66,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:44.406393+0000","last_change":"2024-09-12T17:50:58.431273+0000","last_active":"2024-09-12T17:57:44.406393+0000","last_peered":"2024-09-12T17:57:44.406393+0000","last_clean":"2024-09-12T17:57:44.406393+0000","last_became_active":"2024-09-12T17:50:58.430797+0000","last_became_peered":"2024-09-12T17:50:58.430797+0000","last_unstale":"2024-09-12T17:57:44.406393+0000","last_undegraded":"2024-09-12T17:57:44.406393+0000","last_fullsized":"2024-09-12T17:57:44.406393+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:24.280950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"261'5","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.622623+0000","last_change":"2024-09-12T17:40:30.417952+0000","last_active":"2024-09-12T18:01:50.622623+0000","last_peered":"2024-09-12T18:01:50.622623+0000","last_clean":"2024-09-12T18:01:50.622623+0000","last_became_active":"2024-09-12T17:40:30.417567+0000","last_became_peered":"2024-09-12T17:40:30.417567+0000","last_unstale":"2024-09-12T18:01:50.622623+0000","last_undegraded":"2024-09-12T18:01:50.622623+0000","last_fullsized":"2024-09-12T18:01:50.622623+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:56.583902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"261'10","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.420818+0000","last_change":"2024-09-12T17:40:27.384850+0000","last_active":"2024-09-12T18:01:50.420818+0000","last_peered":"2024-09-12T18:01:50.420818+0000","last_clean":"2024-09-12T18:01:50.420818+0000","last_became_active":"2024-09-12T17:40:27.384579+0000","last_became_peered":"2024-09-12T17:40:27.384579+0000","last_unstale":"2024-09-12T18:01:50.420818+0000","last_undegraded":"2024-09-12T18:01:50.420818+0000","last_fullsized":"2024-09-12T18:01:50.420818+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:22.573347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":20,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"261'7","reported_seq":61,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417568+0000","last_change":"2024-09-12T17:38:51.215867+0000","last_active":"2024-09-12T17:59:09.417568+0000","last_peered":"2024-09-12T17:59:09.417568+0000","last_clean":"2024-09-12T17:59:09.417568+0000","last_became_active":"2024-09-12T17:38:51.215590+0000","last_became_peered":"2024-09-12T17:38:51.215590+0000","last_unstale":"2024-09-12T17:59:09.417568+0000","last_undegraded":"2024-09-12T17:59:09.417568+0000","last_fullsized":"2024-09-12T17:59:09.417568+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:33.602009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.418983+0000","last_change":"2024-09-12T17:50:58.427213+0000","last_active":"2024-09-12T17:59:39.418983+0000","last_peered":"2024-09-12T17:59:39.418983+0000","last_clean":"2024-09-12T17:59:39.418983+0000","last_became_active":"2024-09-12T17:50:58.426867+0000","last_became_peered":"2024-09-12T17:50:58.426867+0000","last_unstale":"2024-09-12T17:59:39.418983+0000","last_undegraded":"2024-09-12T17:59:39.418983+0000","last_fullsized":"2024-09-12T17:59:39.418983+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:34.833083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"261'3","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:49.430023+0000","last_change":"2024-09-12T17:40:30.426091+0000","last_active":"2024-09-12T18:00:49.430023+0000","last_peered":"2024-09-12T18:00:49.430023+0000","last_clean":"2024-09-12T18:00:49.430023+0000","last_became_active":"2024-09-12T17:40:30.425775+0000","last_became_peered":"2024-09-12T17:40:30.425775+0000","last_unstale":"2024-09-12T18:00:49.430023+0000","last_undegraded":"2024-09-12T18:00:49.430023+0000","last_fullsized":"2024-09-12T18:00:49.430023+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:32.790479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.539586+0000","last_change":"2024-09-12T17:40:27.382194+0000","last_active":"2024-09-12T17:58:29.539586+0000","last_peered":"2024-09-12T17:58:29.539586+0000","last_clean":"2024-09-12T17:58:29.539586+0000","last_became_active":"2024-09-12T17:40:27.381918+0000","last_became_peered":"2024-09-12T17:40:27.381918+0000","last_unstale":"2024-09-12T17:58:29.539586+0000","last_undegraded":"2024-09-12T17:58:29.539586+0000","last_fullsized":"2024-09-12T17:58:29.539586+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:18.545363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"261'43","reported_seq":159,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415390+0000","last_change":"2024-09-12T17:38:51.209399+0000","last_active":"2024-09-12T17:59:09.415390+0000","last_peered":"2024-09-12T17:59:09.415390+0000","last_clean":"2024-09-12T17:59:09.415390+0000","last_became_active":"2024-09-12T17:38:51.209135+0000","last_became_peered":"2024-09-12T17:38:51.209135+0000","last_unstale":"2024-09-12T17:59:09.415390+0000","last_undegraded":"2024-09-12T17:59:09.415390+0000","last_fullsized":"2024-09-12T17:59:09.415390+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:55.234380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":150,"num_write":83,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.422143+0000","last_change":"2024-09-12T17:50:58.431873+0000","last_active":"2024-09-12T17:59:39.422143+0000","last_peered":"2024-09-12T17:59:39.422143+0000","last_clean":"2024-09-12T17:59:39.422143+0000","last_became_active":"2024-09-12T17:50:58.431587+0000","last_became_peered":"2024-09-12T17:50:58.431587+0000","last_unstale":"2024-09-12T17:59:39.422143+0000","last_undegraded":"2024-09-12T17:59:39.422143+0000","last_fullsized":"2024-09-12T17:59:39.422143+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:06.651931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411161+0000","last_change":"2024-09-12T17:40:30.418372+0000","last_active":"2024-09-12T17:58:33.411161+0000","last_peered":"2024-09-12T17:58:33.411161+0000","last_clean":"2024-09-12T17:58:33.411161+0000","last_became_active":"2024-09-12T17:40:30.417998+0000","last_became_peered":"2024-09-12T17:40:30.417998+0000","last_unstale":"2024-09-12T17:58:33.411161+0000","last_undegraded":"2024-09-12T17:58:33.411161+0000","last_fullsized":"2024-09-12T17:58:33.411161+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:45.170209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:49.429997+0000","last_change":"2024-09-12T17:40:27.374835+0000","last_active":"2024-09-12T18:00:49.429997+0000","last_peered":"2024-09-12T18:00:49.429997+0000","last_clean":"2024-09-12T18:00:49.429997+0000","last_became_active":"2024-09-12T17:40:27.374557+0000","last_became_peered":"2024-09-12T17:40:27.374557+0000","last_unstale":"2024-09-12T18:00:49.429997+0000","last_undegraded":"2024-09-12T18:00:49.429997+0000","last_fullsized":"2024-09-12T18:00:49.429997+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:19.232907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"261'32","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.084012+0000","last_change":"2024-09-12T17:38:51.216521+0000","last_active":"2024-09-12T17:59:54.084012+0000","last_peered":"2024-09-12T17:59:54.084012+0000","last_clean":"2024-09-12T17:59:54.084012+0000","last_became_active":"2024-09-12T17:38:51.216209+0000","last_became_peered":"2024-09-12T17:38:51.216209+0000","last_unstale":"2024-09-12T17:59:54.084012+0000","last_undegraded":"2024-09-12T17:59:54.084012+0000","last_fullsized":"2024-09-12T17:59:54.084012+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:23.694199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":109,"num_write":55,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:43.403198+0000","last_change":"2024-09-12T17:50:58.425019+0000","last_active":"2024-09-12T17:57:43.403198+0000","last_peered":"2024-09-12T17:57:43.403198+0000","last_clean":"2024-09-12T17:57:43.403198+0000","last_became_active":"2024-09-12T17:50:58.424452+0000","last_became_peered":"2024-09-12T17:50:58.424452+0000","last_unstale":"2024-09-12T17:57:43.403198+0000","last_undegraded":"2024-09-12T17:57:43.403198+0000","last_fullsized":"2024-09-12T17:57:43.403198+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:27.439096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.407560+0000","last_change":"2024-09-12T17:40:30.418941+0000","last_active":"2024-09-12T17:57:54.407560+0000","last_peered":"2024-09-12T17:57:54.407560+0000","last_clean":"2024-09-12T17:57:54.407560+0000","last_became_active":"2024-09-12T17:40:30.418650+0000","last_became_peered":"2024-09-12T17:40:30.418650+0000","last_unstale":"2024-09-12T17:57:54.407560+0000","last_undegraded":"2024-09-12T17:57:54.407560+0000","last_fullsized":"2024-09-12T17:57:54.407560+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:20.881248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"258'8","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.533425+0000","last_change":"2024-09-12T17:40:27.385454+0000","last_active":"2024-09-12T17:57:49.533425+0000","last_peered":"2024-09-12T17:57:49.533425+0000","last_clean":"2024-09-12T17:57:49.533425+0000","last_became_active":"2024-09-12T17:40:27.385081+0000","last_became_peered":"2024-09-12T17:40:27.385081+0000","last_unstale":"2024-09-12T17:57:49.533425+0000","last_undegraded":"2024-09-12T17:57:49.533425+0000","last_fullsized":"2024-09-12T17:57:49.533425+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:10.053553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"261'37","reported_seq":148,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.545191+0000","last_change":"2024-09-12T17:38:51.209424+0000","last_active":"2024-09-12T17:59:09.545191+0000","last_peered":"2024-09-12T17:59:09.545191+0000","last_clean":"2024-09-12T17:59:09.545191+0000","last_became_active":"2024-09-12T17:38:51.208861+0000","last_became_peered":"2024-09-12T17:38:51.208861+0000","last_unstale":"2024-09-12T17:59:09.545191+0000","last_undegraded":"2024-09-12T17:59:09.545191+0000","last_fullsized":"2024-09-12T17:59:09.545191+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:00.098063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":141,"num_write":67,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.407163+0000","last_change":"2024-09-12T17:50:58.432996+0000","last_active":"2024-09-12T17:57:49.407163+0000","last_peered":"2024-09-12T17:57:49.407163+0000","last_clean":"2024-09-12T17:57:49.407163+0000","last_became_active":"2024-09-12T17:50:58.432245+0000","last_became_peered":"2024-09-12T17:50:58.432245+0000","last_unstale":"2024-09-12T17:57:49.407163+0000","last_undegraded":"2024-09-12T17:57:49.407163+0000","last_fullsized":"2024-09-12T17:57:49.407163+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:12.784598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"258'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.407705+0000","last_change":"2024-09-12T17:40:30.425572+0000","last_active":"2024-09-12T17:57:54.407705+0000","last_peered":"2024-09-12T17:57:54.407705+0000","last_clean":"2024-09-12T17:57:54.407705+0000","last_became_active":"2024-09-12T17:40:30.425293+0000","last_became_peered":"2024-09-12T17:40:30.425293+0000","last_unstale":"2024-09-12T17:57:54.407705+0000","last_undegraded":"2024-09-12T17:57:54.407705+0000","last_fullsized":"2024-09-12T17:57:54.407705+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:39.090717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"261'3","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.423526+0000","last_change":"2024-09-12T17:40:27.377071+0000","last_active":"2024-09-12T17:59:59.423526+0000","last_peered":"2024-09-12T17:59:59.423526+0000","last_clean":"2024-09-12T17:59:59.423526+0000","last_became_active":"2024-09-12T17:40:27.376781+0000","last_became_peered":"2024-09-12T17:40:27.376781+0000","last_unstale":"2024-09-12T17:59:59.423526+0000","last_undegraded":"2024-09-12T17:59:59.423526+0000","last_fullsized":"2024-09-12T17:59:59.423526+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:17.637845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412794+0000","last_change":"2024-09-12T17:38:51.210062+0000","last_active":"2024-09-12T17:58:29.412794+0000","last_peered":"2024-09-12T17:58:29.412794+0000","last_clean":"2024-09-12T17:58:29.412794+0000","last_became_active":"2024-09-12T17:38:51.209772+0000","last_became_peered":"2024-09-12T17:38:51.209772+0000","last_unstale":"2024-09-12T17:58:29.412794+0000","last_undegraded":"2024-09-12T17:58:29.412794+0000","last_fullsized":"2024-09-12T17:58:29.412794+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:25.124534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:44.406424+0000","last_change":"2024-09-12T17:50:58.429816+0000","last_active":"2024-09-12T17:57:44.406424+0000","last_peered":"2024-09-12T17:57:44.406424+0000","last_clean":"2024-09-12T17:57:44.406424+0000","last_became_active":"2024-09-12T17:50:58.429551+0000","last_became_peered":"2024-09-12T17:50:58.429551+0000","last_unstale":"2024-09-12T17:57:44.406424+0000","last_undegraded":"2024-09-12T17:57:44.406424+0000","last_fullsized":"2024-09-12T17:57:44.406424+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:25.259007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'7","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:44.429426+0000","last_change":"2024-09-12T17:40:30.409389+0000","last_active":"2024-09-12T18:00:44.429426+0000","last_peered":"2024-09-12T18:00:44.429426+0000","last_clean":"2024-09-12T18:00:44.429426+0000","last_became_active":"2024-09-12T17:40:30.408915+0000","last_became_peered":"2024-09-12T17:40:30.408915+0000","last_unstale":"2024-09-12T18:00:44.429426+0000","last_undegraded":"2024-09-12T18:00:44.429426+0000","last_fullsized":"2024-09-12T18:00:44.429426+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:56.865653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25606,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"258'3","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.533461+0000","last_change":"2024-09-12T17:40:27.382211+0000","last_active":"2024-09-12T17:57:49.533461+0000","last_peered":"2024-09-12T17:57:49.533461+0000","last_clean":"2024-09-12T17:57:49.533461+0000","last_became_active":"2024-09-12T17:40:27.381885+0000","last_became_peered":"2024-09-12T17:40:27.381885+0000","last_unstale":"2024-09-12T17:57:49.533461+0000","last_undegraded":"2024-09-12T17:57:49.533461+0000","last_fullsized":"2024-09-12T17:57:49.533461+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:52.579087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"261'68","reported_seq":231,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.409354+0000","last_change":"2024-09-12T17:38:51.215246+0000","last_active":"2024-09-12T17:58:23.409354+0000","last_peered":"2024-09-12T17:58:23.409354+0000","last_clean":"2024-09-12T17:58:23.409354+0000","last_became_active":"2024-09-12T17:38:51.214940+0000","last_became_peered":"2024-09-12T17:38:51.214940+0000","last_unstale":"2024-09-12T17:58:23.409354+0000","last_undegraded":"2024-09-12T17:58:23.409354+0000","last_fullsized":"2024-09-12T17:58:23.409354+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:11.305564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":356,"num_read_kb":250,"num_write":117,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:44.532653+0000","last_change":"2024-09-12T17:50:58.421234+0000","last_active":"2024-09-12T17:57:44.532653+0000","last_peered":"2024-09-12T17:57:44.532653+0000","last_clean":"2024-09-12T17:57:44.532653+0000","last_became_active":"2024-09-12T17:50:58.420251+0000","last_became_peered":"2024-09-12T17:50:58.420251+0000","last_unstale":"2024-09-12T17:57:44.532653+0000","last_undegraded":"2024-09-12T17:57:44.532653+0000","last_fullsized":"2024-09-12T17:57:44.532653+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:17.481915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"258'7","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.408453+0000","last_change":"2024-09-12T17:40:30.417703+0000","last_active":"2024-09-12T17:57:59.408453+0000","last_peered":"2024-09-12T17:57:59.408453+0000","last_clean":"2024-09-12T17:57:59.408453+0000","last_became_active":"2024-09-12T17:40:30.417393+0000","last_became_peered":"2024-09-12T17:40:30.417393+0000","last_unstale":"2024-09-12T17:57:59.408453+0000","last_undegraded":"2024-09-12T17:57:59.408453+0000","last_fullsized":"2024-09-12T17:57:59.408453+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:40.700927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":7,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:44.430042+0000","last_change":"2024-09-12T17:40:27.379736+0000","last_active":"2024-09-12T18:00:44.430042+0000","last_peered":"2024-09-12T18:00:44.430042+0000","last_clean":"2024-09-12T18:00:44.430042+0000","last_became_active":"2024-09-12T17:40:27.379472+0000","last_became_peered":"2024-09-12T17:40:27.379472+0000","last_unstale":"2024-09-12T18:00:44.430042+0000","last_undegraded":"2024-09-12T18:00:44.430042+0000","last_fullsized":"2024-09-12T18:00:44.430042+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:36.186301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"261'106","reported_seq":366,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.408959+0000","last_change":"2024-09-12T17:38:51.208031+0000","last_active":"2024-09-12T17:58:24.408959+0000","last_peered":"2024-09-12T17:58:24.408959+0000","last_clean":"2024-09-12T17:58:24.408959+0000","last_became_active":"2024-09-12T17:38:51.207735+0000","last_became_peered":"2024-09-12T17:38:51.207735+0000","last_unstale":"2024-09-12T17:58:24.408959+0000","last_undegraded":"2024-09-12T17:58:24.408959+0000","last_fullsized":"2024-09-12T17:58:24.408959+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:15.007282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":541,"num_write":122,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419330+0000","last_change":"2024-09-12T17:50:58.431116+0000","last_active":"2024-09-12T17:59:19.419330+0000","last_peered":"2024-09-12T17:59:19.419330+0000","last_clean":"2024-09-12T17:59:19.419330+0000","last_became_active":"2024-09-12T17:50:58.430813+0000","last_became_peered":"2024-09-12T17:50:58.430813+0000","last_unstale":"2024-09-12T17:59:19.419330+0000","last_undegraded":"2024-09-12T17:59:19.419330+0000","last_fullsized":"2024-09-12T17:59:19.419330+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:19.189927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546398+0000","last_change":"2024-09-12T17:40:30.411164+0000","last_active":"2024-09-12T17:59:19.546398+0000","last_peered":"2024-09-12T17:59:19.546398+0000","last_clean":"2024-09-12T17:59:19.546398+0000","last_became_active":"2024-09-12T17:40:30.410872+0000","last_became_peered":"2024-09-12T17:40:30.410872+0000","last_unstale":"2024-09-12T17:59:19.546398+0000","last_undegraded":"2024-09-12T17:59:19.546398+0000","last_fullsized":"2024-09-12T17:59:19.546398+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:47.603677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.437671+0000","last_change":"2024-09-12T17:40:27.380593+0000","last_active":"2024-09-12T18:01:19.437671+0000","last_peered":"2024-09-12T18:01:19.437671+0000","last_clean":"2024-09-12T18:01:19.437671+0000","last_became_active":"2024-09-12T17:40:27.380269+0000","last_became_peered":"2024-09-12T17:40:27.380269+0000","last_unstale":"2024-09-12T18:01:19.437671+0000","last_undegraded":"2024-09-12T18:01:19.437671+0000","last_fullsized":"2024-09-12T18:01:19.437671+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:52.967809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"261'42","reported_seq":157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.023193+0000","last_change":"2024-09-12T17:38:51.216559+0000","last_active":"2024-09-12T17:59:16.023193+0000","last_peered":"2024-09-12T17:59:16.023193+0000","last_clean":"2024-09-12T17:59:16.023193+0000","last_became_active":"2024-09-12T17:38:51.216152+0000","last_became_peered":"2024-09-12T17:38:51.216152+0000","last_unstale":"2024-09-12T17:59:16.023193+0000","last_undegraded":"2024-09-12T17:59:16.023193+0000","last_fullsized":"2024-09-12T17:59:16.023193+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:42.821025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":152,"num_write":74,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.418727+0000","last_change":"2024-09-12T17:50:58.431015+0000","last_active":"2024-09-12T17:59:19.418727+0000","last_peered":"2024-09-12T17:59:19.418727+0000","last_clean":"2024-09-12T17:59:19.418727+0000","last_became_active":"2024-09-12T17:50:58.430723+0000","last_became_peered":"2024-09-12T17:50:58.430723+0000","last_unstale":"2024-09-12T17:59:19.418727+0000","last_undegraded":"2024-09-12T17:59:19.418727+0000","last_fullsized":"2024-09-12T17:59:19.418727+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:21.663778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"261'2","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.563246+0000","last_change":"2024-09-12T17:40:30.425667+0000","last_active":"2024-09-12T18:01:24.563246+0000","last_peered":"2024-09-12T18:01:24.563246+0000","last_clean":"2024-09-12T18:01:24.563246+0000","last_became_active":"2024-09-12T17:40:30.425368+0000","last_became_peered":"2024-09-12T17:40:30.425368+0000","last_unstale":"2024-09-12T18:01:24.563246+0000","last_undegraded":"2024-09-12T18:01:24.563246+0000","last_fullsized":"2024-09-12T18:01:24.563246+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:57.448155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:13.618170+0000","last_change":"2024-09-12T17:40:27.384113+0000","last_active":"2024-09-12T17:59:13.618170+0000","last_peered":"2024-09-12T17:59:13.618170+0000","last_clean":"2024-09-12T17:59:13.618170+0000","last_became_active":"2024-09-12T17:40:27.383770+0000","last_became_peered":"2024-09-12T17:40:27.383770+0000","last_unstale":"2024-09-12T17:59:13.618170+0000","last_undegraded":"2024-09-12T17:59:13.618170+0000","last_fullsized":"2024-09-12T17:59:13.618170+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:34.294441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"258'22","reported_seq":108,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.409051+0000","last_change":"2024-09-12T17:38:51.209047+0000","last_active":"2024-09-12T17:58:24.409051+0000","last_peered":"2024-09-12T17:58:24.409051+0000","last_clean":"2024-09-12T17:58:24.409051+0000","last_became_active":"2024-09-12T17:38:51.208767+0000","last_became_peered":"2024-09-12T17:38:51.208767+0000","last_unstale":"2024-09-12T17:58:24.409051+0000","last_undegraded":"2024-09-12T17:58:24.409051+0000","last_fullsized":"2024-09-12T17:58:24.409051+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:21.421941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:04.416155+0000","last_change":"2024-09-12T17:50:58.422944+0000","last_active":"2024-09-12T17:59:04.416155+0000","last_peered":"2024-09-12T17:59:04.416155+0000","last_clean":"2024-09-12T17:59:04.416155+0000","last_became_active":"2024-09-12T17:50:58.422625+0000","last_became_peered":"2024-09-12T17:50:58.422625+0000","last_unstale":"2024-09-12T17:59:04.416155+0000","last_undegraded":"2024-09-12T17:59:04.416155+0000","last_fullsized":"2024-09-12T17:59:04.416155+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:04.987349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"258'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:54.407842+0000","last_change":"2024-09-12T17:40:30.425786+0000","last_active":"2024-09-12T17:57:54.407842+0000","last_peered":"2024-09-12T17:57:54.407842+0000","last_clean":"2024-09-12T17:57:54.407842+0000","last_became_active":"2024-09-12T17:40:30.425536+0000","last_became_peered":"2024-09-12T17:40:30.425536+0000","last_unstale":"2024-09-12T17:57:54.407842+0000","last_undegraded":"2024-09-12T17:57:54.407842+0000","last_fullsized":"2024-09-12T17:57:54.407842+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:19.565868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"258'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.406415+0000","last_change":"2024-09-12T17:40:27.382099+0000","last_active":"2024-09-12T17:57:49.406415+0000","last_peered":"2024-09-12T17:57:49.406415+0000","last_clean":"2024-09-12T17:57:49.406415+0000","last_became_active":"2024-09-12T17:40:27.381818+0000","last_became_peered":"2024-09-12T17:40:27.381818+0000","last_unstale":"2024-09-12T17:57:49.406415+0000","last_undegraded":"2024-09-12T17:57:49.406415+0000","last_fullsized":"2024-09-12T17:57:49.406415+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:59.918995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"261'42","reported_seq":166,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:49.423442+0000","last_change":"2024-09-12T17:38:51.211565+0000","last_active":"2024-09-12T17:59:49.423442+0000","last_peered":"2024-09-12T17:59:49.423442+0000","last_clean":"2024-09-12T17:59:49.423442+0000","last_became_active":"2024-09-12T17:38:51.211219+0000","last_became_peered":"2024-09-12T17:38:51.211219+0000","last_unstale":"2024-09-12T17:59:49.423442+0000","last_undegraded":"2024-09-12T17:59:49.423442+0000","last_fullsized":"2024-09-12T17:59:49.423442+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:18.738642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":165,"num_write":70,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419044+0000","last_change":"2024-09-12T17:50:58.416892+0000","last_active":"2024-09-12T17:59:19.419044+0000","last_peered":"2024-09-12T17:59:19.419044+0000","last_clean":"2024-09-12T17:59:19.419044+0000","last_became_active":"2024-09-12T17:50:58.416501+0000","last_became_peered":"2024-09-12T17:50:58.416501+0000","last_unstale":"2024-09-12T17:59:19.419044+0000","last_undegraded":"2024-09-12T17:59:19.419044+0000","last_fullsized":"2024-09-12T17:59:19.419044+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:06.098567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"261'5","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.425043+0000","last_change":"2024-09-12T17:40:30.418747+0000","last_active":"2024-09-12T18:00:04.425043+0000","last_peered":"2024-09-12T18:00:04.425043+0000","last_clean":"2024-09-12T18:00:04.425043+0000","last_became_active":"2024-09-12T17:40:30.418418+0000","last_became_peered":"2024-09-12T17:40:30.418418+0000","last_unstale":"2024-09-12T18:00:04.425043+0000","last_undegraded":"2024-09-12T18:00:04.425043+0000","last_fullsized":"2024-09-12T18:00:04.425043+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:50.907324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.407185+0000","last_change":"2024-09-12T17:40:27.383455+0000","last_active":"2024-09-12T17:57:49.407185+0000","last_peered":"2024-09-12T17:57:49.407185+0000","last_clean":"2024-09-12T17:57:49.407185+0000","last_became_active":"2024-09-12T17:40:27.383023+0000","last_became_peered":"2024-09-12T17:40:27.383023+0000","last_unstale":"2024-09-12T17:57:49.407185+0000","last_undegraded":"2024-09-12T17:57:49.407185+0000","last_fullsized":"2024-09-12T17:57:49.407185+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:38.107217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"261'37","reported_seq":149,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.249331+0000","last_change":"2024-09-12T17:38:51.210126+0000","last_active":"2024-09-12T17:59:54.249331+0000","last_peered":"2024-09-12T17:59:54.249331+0000","last_clean":"2024-09-12T17:59:54.249331+0000","last_became_active":"2024-09-12T17:38:51.209833+0000","last_became_peered":"2024-09-12T17:38:51.209833+0000","last_unstale":"2024-09-12T17:59:54.249331+0000","last_undegraded":"2024-09-12T17:59:54.249331+0000","last_fullsized":"2024-09-12T17:59:54.249331+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:29.524821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":141,"num_write":58,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.621111+0000","last_change":"2024-09-12T17:50:58.424105+0000","last_active":"2024-09-12T17:59:38.621111+0000","last_peered":"2024-09-12T17:59:38.621111+0000","last_clean":"2024-09-12T17:59:38.621111+0000","last_became_active":"2024-09-12T17:50:58.423798+0000","last_became_peered":"2024-09-12T17:50:58.423798+0000","last_unstale":"2024-09-12T17:59:38.621111+0000","last_undegraded":"2024-09-12T17:59:38.621111+0000","last_fullsized":"2024-09-12T17:59:38.621111+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:57.214535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.417888+0000","last_change":"2024-09-12T17:40:30.412437+0000","last_active":"2024-09-12T17:59:14.417888+0000","last_peered":"2024-09-12T17:59:14.417888+0000","last_clean":"2024-09-12T17:59:14.417888+0000","last_became_active":"2024-09-12T17:40:30.412140+0000","last_became_peered":"2024-09-12T17:40:30.412140+0000","last_unstale":"2024-09-12T17:59:14.417888+0000","last_undegraded":"2024-09-12T17:59:14.417888+0000","last_fullsized":"2024-09-12T17:59:14.417888+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:44.020052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:34.429669+0000","last_change":"2024-09-12T17:40:27.385866+0000","last_active":"2024-09-12T18:00:34.429669+0000","last_peered":"2024-09-12T18:00:34.429669+0000","last_clean":"2024-09-12T18:00:34.429669+0000","last_became_active":"2024-09-12T17:40:27.385649+0000","last_became_peered":"2024-09-12T17:40:27.385649+0000","last_unstale":"2024-09-12T18:00:34.429669+0000","last_undegraded":"2024-09-12T18:00:34.429669+0000","last_fullsized":"2024-09-12T18:00:34.429669+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:44.080842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"258'14","reported_seq":85,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.422160+0000","last_change":"2024-09-12T17:38:51.216015+0000","last_active":"2024-09-12T17:59:44.422160+0000","last_peered":"2024-09-12T17:59:44.422160+0000","last_clean":"2024-09-12T17:59:44.422160+0000","last_became_active":"2024-09-12T17:38:51.215738+0000","last_became_peered":"2024-09-12T17:38:51.215738+0000","last_unstale":"2024-09-12T17:59:44.422160+0000","last_undegraded":"2024-09-12T17:59:44.422160+0000","last_fullsized":"2024-09-12T17:59:44.422160+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:22.857791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.549295+0000","last_change":"2024-09-12T17:50:58.423755+0000","last_active":"2024-09-12T17:59:39.549295+0000","last_peered":"2024-09-12T17:59:39.549295+0000","last_clean":"2024-09-12T17:59:39.549295+0000","last_became_active":"2024-09-12T17:50:58.423443+0000","last_became_peered":"2024-09-12T17:50:58.423443+0000","last_unstale":"2024-09-12T17:59:39.549295+0000","last_undegraded":"2024-09-12T17:59:39.549295+0000","last_fullsized":"2024-09-12T17:59:39.549295+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:21.905993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:34.412791+0000","last_change":"2024-09-12T17:40:30.415967+0000","last_active":"2024-09-12T17:58:34.412791+0000","last_peered":"2024-09-12T17:58:34.412791+0000","last_clean":"2024-09-12T17:58:34.412791+0000","last_became_active":"2024-09-12T17:40:30.415696+0000","last_became_peered":"2024-09-12T17:40:30.415696+0000","last_unstale":"2024-09-12T17:58:34.412791+0000","last_undegraded":"2024-09-12T17:58:34.412791+0000","last_fullsized":"2024-09-12T17:58:34.412791+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:00.615699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418738+0000","last_change":"2024-09-12T17:40:27.381415+0000","last_active":"2024-09-12T17:59:14.418738+0000","last_peered":"2024-09-12T17:59:14.418738+0000","last_clean":"2024-09-12T17:59:14.418738+0000","last_became_active":"2024-09-12T17:40:27.381128+0000","last_became_peered":"2024-09-12T17:40:27.381128+0000","last_unstale":"2024-09-12T17:59:14.418738+0000","last_undegraded":"2024-09-12T17:59:14.418738+0000","last_fullsized":"2024-09-12T17:59:14.418738+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:41.708551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"261'15","reported_seq":83,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.422414+0000","last_change":"2024-09-12T17:38:51.211542+0000","last_active":"2024-09-12T17:59:44.422414+0000","last_peered":"2024-09-12T17:59:44.422414+0000","last_clean":"2024-09-12T17:59:44.422414+0000","last_became_active":"2024-09-12T17:38:51.210741+0000","last_became_peered":"2024-09-12T17:38:51.210741+0000","last_unstale":"2024-09-12T17:59:44.422414+0000","last_undegraded":"2024-09-12T17:59:44.422414+0000","last_fullsized":"2024-09-12T17:59:44.422414+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:53.102160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":45,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546366+0000","last_change":"2024-09-12T17:50:58.422536+0000","last_active":"2024-09-12T17:59:19.546366+0000","last_peered":"2024-09-12T17:59:19.546366+0000","last_clean":"2024-09-12T17:59:19.546366+0000","last_became_active":"2024-09-12T17:50:58.422195+0000","last_became_peered":"2024-09-12T17:50:58.422195+0000","last_unstale":"2024-09-12T17:59:19.546366+0000","last_undegraded":"2024-09-12T17:59:19.546366+0000","last_fullsized":"2024-09-12T17:59:19.546366+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:53.708044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.416457+0000","last_change":"2024-09-12T17:40:30.418965+0000","last_active":"2024-09-12T17:59:19.416457+0000","last_peered":"2024-09-12T17:59:19.416457+0000","last_clean":"2024-09-12T17:59:19.416457+0000","last_became_active":"2024-09-12T17:40:30.418692+0000","last_became_peered":"2024-09-12T17:40:30.418692+0000","last_unstale":"2024-09-12T17:59:19.416457+0000","last_undegraded":"2024-09-12T17:59:19.416457+0000","last_fullsized":"2024-09-12T17:59:19.416457+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:04.962038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"258'6","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.417950+0000","last_change":"2024-09-12T17:40:27.377091+0000","last_active":"2024-09-12T17:59:14.417950+0000","last_peered":"2024-09-12T17:59:14.417950+0000","last_clean":"2024-09-12T17:59:14.417950+0000","last_became_active":"2024-09-12T17:40:27.376395+0000","last_became_peered":"2024-09-12T17:40:27.376395+0000","last_unstale":"2024-09-12T17:59:14.417950+0000","last_undegraded":"2024-09-12T17:59:14.417950+0000","last_fullsized":"2024-09-12T17:59:14.417950+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:00.248728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"261'24","reported_seq":110,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.419639+0000","last_change":"2024-09-12T17:38:51.213165+0000","last_active":"2024-09-12T17:59:44.419639+0000","last_peered":"2024-09-12T17:59:44.419639+0000","last_clean":"2024-09-12T17:59:44.419639+0000","last_became_active":"2024-09-12T17:38:51.212856+0000","last_became_peered":"2024-09-12T17:38:51.212856+0000","last_unstale":"2024-09-12T17:59:44.419639+0000","last_undegraded":"2024-09-12T17:59:44.419639+0000","last_fullsized":"2024-09-12T17:59:44.419639+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:17.393643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":83,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:24.420242+0000","last_change":"2024-09-12T17:50:58.431889+0000","last_active":"2024-09-12T17:59:24.420242+0000","last_peered":"2024-09-12T17:59:24.420242+0000","last_clean":"2024-09-12T17:59:24.420242+0000","last_became_active":"2024-09-12T17:50:58.431442+0000","last_became_peered":"2024-09-12T17:50:58.431442+0000","last_unstale":"2024-09-12T17:59:24.420242+0000","last_undegraded":"2024-09-12T17:59:24.420242+0000","last_fullsized":"2024-09-12T17:59:24.420242+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:40.014254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419070+0000","last_change":"2024-09-12T17:40:30.418760+0000","last_active":"2024-09-12T17:59:19.419070+0000","last_peered":"2024-09-12T17:59:19.419070+0000","last_clean":"2024-09-12T17:59:19.419070+0000","last_became_active":"2024-09-12T17:40:30.418464+0000","last_became_peered":"2024-09-12T17:40:30.418464+0000","last_unstale":"2024-09-12T17:59:19.419070+0000","last_undegraded":"2024-09-12T17:59:19.419070+0000","last_fullsized":"2024-09-12T17:59:19.419070+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:03.345502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"261'5","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.921356+0000","last_change":"2024-09-12T17:40:27.379405+0000","last_active":"2024-09-12T18:01:49.921356+0000","last_peered":"2024-09-12T18:01:49.921356+0000","last_clean":"2024-09-12T18:01:49.921356+0000","last_became_active":"2024-09-12T17:40:27.379133+0000","last_became_peered":"2024-09-12T17:40:27.379133+0000","last_unstale":"2024-09-12T18:01:49.921356+0000","last_undegraded":"2024-09-12T18:01:49.921356+0000","last_fullsized":"2024-09-12T18:01:49.921356+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:39.813640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"261'32","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.417100+0000","last_change":"2024-09-12T17:38:51.208801+0000","last_active":"2024-09-12T17:58:59.417100+0000","last_peered":"2024-09-12T17:58:59.417100+0000","last_clean":"2024-09-12T17:58:59.417100+0000","last_became_active":"2024-09-12T17:38:51.208386+0000","last_became_peered":"2024-09-12T17:38:51.208386+0000","last_unstale":"2024-09-12T17:58:59.417100+0000","last_undegraded":"2024-09-12T17:58:59.417100+0000","last_fullsized":"2024-09-12T17:58:59.417100+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:57.157726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":109,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"261'339","reported_seq":951,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.053797+0000","last_change":"2024-09-12T17:23:40.709230+0000","last_active":"2024-09-12T18:01:51.053797+0000","last_peered":"2024-09-12T18:01:51.053797+0000","last_clean":"2024-09-12T18:01:51.053797+0000","last_became_active":"2024-09-12T17:23:40.708951+0000","last_became_peered":"2024-09-12T17:23:40.708951+0000","last_unstale":"2024-09-12T18:01:51.053797+0000","last_undegraded":"2024-09-12T18:01:51.053797+0000","last_fullsized":"2024-09-12T18:01:51.053797+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:29.306708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25551,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":469,"num_read_kb":4680,"num_write":1107,"num_write_kb":27229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"261'483","reported_seq":2010,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.776173+0000","last_change":"2024-09-12T17:23:42.147291+0000","last_active":"2024-09-12T18:00:15.776173+0000","last_peered":"2024-09-12T18:00:15.776173+0000","last_clean":"2024-09-12T18:00:15.776173+0000","last_became_active":"2024-09-12T17:23:42.146906+0000","last_became_peered":"2024-09-12T17:23:42.146906+0000","last_unstale":"2024-09-12T18:00:15.776173+0000","last_undegraded":"2024-09-12T18:00:15.776173+0000","last_fullsized":"2024-09-12T18:00:15.776173+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:47.049866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2345,"num_read_kb":2204,"num_write":541,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"261'404","reported_seq":1077,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.054173+0000","last_change":"2024-09-12T17:23:40.720117+0000","last_active":"2024-09-12T18:01:51.054173+0000","last_peered":"2024-09-12T18:01:51.054173+0000","last_clean":"2024-09-12T18:01:51.054173+0000","last_became_active":"2024-09-12T17:23:40.719834+0000","last_became_peered":"2024-09-12T17:23:40.719834+0000","last_unstale":"2024-09-12T18:01:51.054173+0000","last_undegraded":"2024-09-12T18:01:51.054173+0000","last_fullsized":"2024-09-12T18:01:51.054173+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:08.528131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":637,"num_read_kb":15953,"num_write":1206,"num_write_kb":28721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"261'473","reported_seq":2215,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.149339+0000","last_change":"2024-09-12T17:23:42.147555+0000","last_active":"2024-09-12T18:00:18.149339+0000","last_peered":"2024-09-12T18:00:18.149339+0000","last_clean":"2024-09-12T18:00:18.149339+0000","last_became_active":"2024-09-12T17:23:42.147270+0000","last_became_peered":"2024-09-12T17:23:42.147270+0000","last_unstale":"2024-09-12T18:00:18.149339+0000","last_undegraded":"2024-09-12T18:00:18.149339+0000","last_fullsized":"2024-09-12T18:00:18.149339+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:12.132659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3009,"num_read_kb":2866,"num_write":558,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"261'346","reported_seq":1144,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.030710+0000","last_change":"2024-09-12T17:23:40.702160+0000","last_active":"2024-09-12T18:01:51.030710+0000","last_peered":"2024-09-12T18:01:51.030710+0000","last_clean":"2024-09-12T18:01:51.030710+0000","last_became_active":"2024-09-12T17:23:40.701839+0000","last_became_peered":"2024-09-12T17:23:40.701839+0000","last_unstale":"2024-09-12T18:01:51.030710+0000","last_undegraded":"2024-09-12T18:01:51.030710+0000","last_fullsized":"2024-09-12T18:01:51.030710+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:27.896198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311813,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":845,"num_read_kb":22445,"num_write":993,"num_write_kb":35081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"261'1193","reported_seq":2827,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.787881+0000","last_change":"2024-09-12T17:23:42.143316+0000","last_active":"2024-09-12T18:00:05.787881+0000","last_peered":"2024-09-12T18:00:05.787881+0000","last_clean":"2024-09-12T18:00:05.787881+0000","last_became_active":"2024-09-12T17:23:42.141845+0000","last_became_peered":"2024-09-12T17:23:42.141845+0000","last_unstale":"2024-09-12T18:00:05.787881+0000","last_undegraded":"2024-09-12T18:00:05.787881+0000","last_fullsized":"2024-09-12T18:00:05.787881+0000","mapping_epoch":25,"log_start":"261'1100","ondisk_log_start":"261'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":1100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:43.825593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5470,"num_read_kb":4840,"num_write":1657,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"261'395","reported_seq":1031,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.023027+0000","last_change":"2024-09-12T17:23:40.713745+0000","last_active":"2024-09-12T18:01:51.023027+0000","last_peered":"2024-09-12T18:01:51.023027+0000","last_clean":"2024-09-12T18:01:51.023027+0000","last_became_active":"2024-09-12T17:23:40.712263+0000","last_became_peered":"2024-09-12T17:23:40.712263+0000","last_unstale":"2024-09-12T18:01:51.023027+0000","last_undegraded":"2024-09-12T18:01:51.023027+0000","last_fullsized":"2024-09-12T18:01:51.023027+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:37.480449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262228,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":543,"num_read_kb":11573,"num_write":1248,"num_write_kb":26002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"261'1241","reported_seq":2921,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.777810+0000","last_change":"2024-09-12T17:23:42.158153+0000","last_active":"2024-09-12T18:00:15.777810+0000","last_peered":"2024-09-12T18:00:15.777810+0000","last_clean":"2024-09-12T18:00:15.777810+0000","last_became_active":"2024-09-12T17:23:42.157835+0000","last_became_peered":"2024-09-12T17:23:42.157835+0000","last_unstale":"2024-09-12T18:00:15.777810+0000","last_undegraded":"2024-09-12T18:00:15.777810+0000","last_fullsized":"2024-09-12T18:00:15.777810+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:20.923845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5656,"num_read_kb":5021,"num_write":1694,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"261'353","reported_seq":1038,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.047097+0000","last_change":"2024-09-12T17:23:40.706187+0000","last_active":"2024-09-12T18:01:51.047097+0000","last_peered":"2024-09-12T18:01:51.047097+0000","last_clean":"2024-09-12T18:01:51.047097+0000","last_became_active":"2024-09-12T17:23:40.705906+0000","last_became_peered":"2024-09-12T17:23:40.705906+0000","last_unstale":"2024-09-12T18:01:51.047097+0000","last_undegraded":"2024-09-12T18:01:51.047097+0000","last_fullsized":"2024-09-12T18:01:51.047097+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.975637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":673,"num_read_kb":37545,"num_write":1095,"num_write_kb":42867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"261'385","reported_seq":1825,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.575104+0000","last_change":"2024-09-12T17:23:42.142597+0000","last_active":"2024-09-12T18:00:04.575104+0000","last_peered":"2024-09-12T18:00:04.575104+0000","last_clean":"2024-09-12T18:00:04.575104+0000","last_became_active":"2024-09-12T17:23:42.142311+0000","last_became_peered":"2024-09-12T17:23:42.142311+0000","last_unstale":"2024-09-12T18:00:04.575104+0000","last_undegraded":"2024-09-12T18:00:04.575104+0000","last_fullsized":"2024-09-12T18:00:04.575104+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:25.262592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2045,"num_read_kb":1945,"num_write":422,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"261'379","reported_seq":1071,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.996152+0000","last_change":"2024-09-12T17:23:40.705539+0000","last_active":"2024-09-12T18:01:50.996152+0000","last_peered":"2024-09-12T18:01:50.996152+0000","last_clean":"2024-09-12T18:01:50.996152+0000","last_became_active":"2024-09-12T17:23:40.705215+0000","last_became_peered":"2024-09-12T17:23:40.705215+0000","last_unstale":"2024-09-12T18:01:50.996152+0000","last_undegraded":"2024-09-12T18:01:50.996152+0000","last_fullsized":"2024-09-12T18:01:50.996152+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:33.336833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253978,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":760,"num_read_kb":26786,"num_write":1280,"num_write_kb":30822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"261'882","reported_seq":2676,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.911490+0000","last_change":"2024-09-12T17:23:42.143689+0000","last_active":"2024-09-12T17:59:59.911490+0000","last_peered":"2024-09-12T17:59:59.911490+0000","last_clean":"2024-09-12T17:59:59.911490+0000","last_became_active":"2024-09-12T17:23:42.143402+0000","last_became_peered":"2024-09-12T17:23:42.143402+0000","last_unstale":"2024-09-12T17:59:59.911490+0000","last_undegraded":"2024-09-12T17:59:59.911490+0000","last_fullsized":"2024-09-12T17:59:59.911490+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:34.164395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4455,"num_read_kb":4051,"num_write":1149,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"261'323","reported_seq":937,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.986112+0000","last_change":"2024-09-12T17:23:40.714177+0000","last_active":"2024-09-12T18:01:50.986112+0000","last_peered":"2024-09-12T18:01:50.986112+0000","last_clean":"2024-09-12T18:01:50.986112+0000","last_became_active":"2024-09-12T17:23:40.713883+0000","last_became_peered":"2024-09-12T17:23:40.713883+0000","last_unstale":"2024-09-12T18:01:50.986112+0000","last_undegraded":"2024-09-12T18:01:50.986112+0000","last_fullsized":"2024-09-12T18:01:50.986112+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:08.265768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":466,"num_read_kb":1994,"num_write":1104,"num_write_kb":56686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"261'914","reported_seq":2617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559532+0000","last_change":"2024-09-12T17:23:42.152325+0000","last_active":"2024-09-12T18:00:18.559532+0000","last_peered":"2024-09-12T18:00:18.559532+0000","last_clean":"2024-09-12T18:00:18.559532+0000","last_became_active":"2024-09-12T17:23:42.152030+0000","last_became_peered":"2024-09-12T17:23:42.152030+0000","last_unstale":"2024-09-12T18:00:18.559532+0000","last_undegraded":"2024-09-12T18:00:18.559532+0000","last_fullsized":"2024-09-12T18:00:18.559532+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":900,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:58.696177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4677,"num_read_kb":4199,"num_write":1240,"num_write_kb":482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"261'308","reported_seq":984,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.008097+0000","last_change":"2024-09-12T17:23:40.717561+0000","last_active":"2024-09-12T18:01:51.008097+0000","last_peered":"2024-09-12T18:01:51.008097+0000","last_clean":"2024-09-12T18:01:51.008097+0000","last_became_active":"2024-09-12T17:23:40.717097+0000","last_became_peered":"2024-09-12T17:23:40.717097+0000","last_unstale":"2024-09-12T18:01:51.008097+0000","last_undegraded":"2024-09-12T18:01:51.008097+0000","last_fullsized":"2024-09-12T18:01:51.008097+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:08.329294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655891,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":586,"num_read_kb":3212,"num_write":1067,"num_write_kb":17046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"261'390","reported_seq":1862,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.560134+0000","last_change":"2024-09-12T17:24:17.227171+0000","last_active":"2024-09-12T18:00:18.560134+0000","last_peered":"2024-09-12T18:00:18.560134+0000","last_clean":"2024-09-12T18:00:18.560134+0000","last_became_active":"2024-09-12T17:24:17.226840+0000","last_became_peered":"2024-09-12T17:24:17.226840+0000","last_unstale":"2024-09-12T18:00:18.560134+0000","last_undegraded":"2024-09-12T18:00:18.560134+0000","last_fullsized":"2024-09-12T18:00:18.560134+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:26.876837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2081,"num_read_kb":1979,"num_write":442,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"261'751","reported_seq":2065,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.247585+0000","last_change":"2024-09-12T17:23:42.152851+0000","last_active":"2024-09-12T18:00:04.247585+0000","last_peered":"2024-09-12T18:00:04.247585+0000","last_clean":"2024-09-12T18:00:04.247585+0000","last_became_active":"2024-09-12T17:23:42.152513+0000","last_became_peered":"2024-09-12T17:23:42.152513+0000","last_unstale":"2024-09-12T18:00:04.247585+0000","last_undegraded":"2024-09-12T18:00:04.247585+0000","last_fullsized":"2024-09-12T18:00:04.247585+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:34.195735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3383,"num_read_kb":3022,"num_write":991,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"261'309","reported_seq":926,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.052314+0000","last_change":"2024-09-12T17:23:40.713044+0000","last_active":"2024-09-12T18:01:51.052314+0000","last_peered":"2024-09-12T18:01:51.052314+0000","last_clean":"2024-09-12T18:01:51.052314+0000","last_became_active":"2024-09-12T17:23:40.712747+0000","last_became_peered":"2024-09-12T17:23:40.712747+0000","last_unstale":"2024-09-12T18:01:51.052314+0000","last_undegraded":"2024-09-12T18:01:51.052314+0000","last_fullsized":"2024-09-12T18:01:51.052314+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.000672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":452,"num_read_kb":32150,"num_write":963,"num_write_kb":37186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"261'506","reported_seq":2009,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.988702+0000","last_change":"2024-09-12T17:23:42.148419+0000","last_active":"2024-09-12T18:00:03.988702+0000","last_peered":"2024-09-12T18:00:03.988702+0000","last_clean":"2024-09-12T18:00:03.988702+0000","last_became_active":"2024-09-12T17:23:42.148091+0000","last_became_peered":"2024-09-12T17:23:42.148091+0000","last_unstale":"2024-09-12T18:00:03.988702+0000","last_undegraded":"2024-09-12T18:00:03.988702+0000","last_fullsized":"2024-09-12T18:00:03.988702+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:49.293452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2605,"num_read_kb":2400,"num_write":650,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"261'347","reported_seq":1034,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.021943+0000","last_change":"2024-09-12T17:23:40.708563+0000","last_active":"2024-09-12T18:01:51.021943+0000","last_peered":"2024-09-12T18:01:51.021943+0000","last_clean":"2024-09-12T18:01:51.021943+0000","last_became_active":"2024-09-12T17:23:40.708089+0000","last_became_peered":"2024-09-12T17:23:40.708089+0000","last_unstale":"2024-09-12T18:01:51.021943+0000","last_undegraded":"2024-09-12T18:01:51.021943+0000","last_fullsized":"2024-09-12T18:01:51.021943+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:09.021258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":647,"num_read_kb":14175,"num_write":1176,"num_write_kb":46213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"261'906","reported_seq":2491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.398639+0000","last_change":"2024-09-12T17:23:42.146163+0000","last_active":"2024-09-12T18:01:41.398639+0000","last_peered":"2024-09-12T18:01:41.398639+0000","last_clean":"2024-09-12T18:01:41.398639+0000","last_became_active":"2024-09-12T17:23:42.145860+0000","last_became_peered":"2024-09-12T17:23:42.145860+0000","last_unstale":"2024-09-12T18:01:41.398639+0000","last_undegraded":"2024-09-12T18:01:41.398639+0000","last_fullsized":"2024-09-12T18:01:41.398639+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":800,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:47.060225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4352,"num_read_kb":3896,"num_write":1238,"num_write_kb":509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"261'342","reported_seq":1075,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.027677+0000","last_change":"2024-09-12T17:24:17.233383+0000","last_active":"2024-09-12T18:01:51.027677+0000","last_peered":"2024-09-12T18:01:51.027677+0000","last_clean":"2024-09-12T18:01:51.027677+0000","last_became_active":"2024-09-12T17:24:17.232979+0000","last_became_peered":"2024-09-12T17:24:17.232979+0000","last_unstale":"2024-09-12T18:01:51.027677+0000","last_undegraded":"2024-09-12T18:01:51.027677+0000","last_fullsized":"2024-09-12T18:01:51.027677+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:03.921503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":809,"num_read_kb":6334,"num_write":1258,"num_write_kb":23763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"261'427","reported_seq":1989,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.767282+0000","last_change":"2024-09-12T17:23:42.148296+0000","last_active":"2024-09-12T18:00:15.767282+0000","last_peered":"2024-09-12T18:00:15.767282+0000","last_clean":"2024-09-12T18:00:15.767282+0000","last_became_active":"2024-09-12T17:23:42.148023+0000","last_became_peered":"2024-09-12T17:23:42.148023+0000","last_unstale":"2024-09-12T18:00:15.767282+0000","last_undegraded":"2024-09-12T18:00:15.767282+0000","last_fullsized":"2024-09-12T18:00:15.767282+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:08.262875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2276,"num_read_kb":2173,"num_write":473,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"261'347","reported_seq":962,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.032056+0000","last_change":"2024-09-12T17:23:40.714934+0000","last_active":"2024-09-12T18:01:51.032056+0000","last_peered":"2024-09-12T18:01:51.032056+0000","last_clean":"2024-09-12T18:01:51.032056+0000","last_became_active":"2024-09-12T17:23:40.714604+0000","last_became_peered":"2024-09-12T17:23:40.714604+0000","last_unstale":"2024-09-12T18:01:51.032056+0000","last_undegraded":"2024-09-12T18:01:51.032056+0000","last_fullsized":"2024-09-12T18:01:51.032056+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:27.138414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":7319,"num_write":1124,"num_write_kb":22062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"261'420","reported_seq":1932,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.398203+0000","last_change":"2024-09-12T17:23:42.141588+0000","last_active":"2024-09-12T18:01:41.398203+0000","last_peered":"2024-09-12T18:01:41.398203+0000","last_clean":"2024-09-12T18:01:41.398203+0000","last_became_active":"2024-09-12T17:23:42.141237+0000","last_became_peered":"2024-09-12T17:23:42.141237+0000","last_unstale":"2024-09-12T18:01:41.398203+0000","last_undegraded":"2024-09-12T18:01:41.398203+0000","last_fullsized":"2024-09-12T18:01:41.398203+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:12.130382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2248,"num_read_kb":2133,"num_write":484,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"261'327","reported_seq":943,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.031448+0000","last_change":"2024-09-12T17:23:40.705121+0000","last_active":"2024-09-12T18:01:51.031448+0000","last_peered":"2024-09-12T18:01:51.031448+0000","last_clean":"2024-09-12T18:01:51.031448+0000","last_became_active":"2024-09-12T17:23:40.704825+0000","last_became_peered":"2024-09-12T17:23:40.704825+0000","last_unstale":"2024-09-12T18:01:51.031448+0000","last_undegraded":"2024-09-12T18:01:51.031448+0000","last_fullsized":"2024-09-12T18:01:51.031448+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:59.186994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":456,"num_read_kb":2074,"num_write":1044,"num_write_kb":16303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"261'380","reported_seq":1869,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.496044+0000","last_change":"2024-09-12T17:23:42.137722+0000","last_active":"2024-09-12T18:00:05.496044+0000","last_peered":"2024-09-12T18:00:05.496044+0000","last_clean":"2024-09-12T18:00:05.496044+0000","last_became_active":"2024-09-12T17:23:42.137455+0000","last_became_peered":"2024-09-12T17:23:42.137455+0000","last_unstale":"2024-09-12T18:00:05.496044+0000","last_undegraded":"2024-09-12T18:00:05.496044+0000","last_fullsized":"2024-09-12T18:00:05.496044+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:28.273631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2042,"num_read_kb":1965,"num_write":435,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"261'358","reported_seq":1001,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.042089+0000","last_change":"2024-09-12T17:23:40.712347+0000","last_active":"2024-09-12T18:01:51.042089+0000","last_peered":"2024-09-12T18:01:51.042089+0000","last_clean":"2024-09-12T18:01:51.042089+0000","last_became_active":"2024-09-12T17:23:40.711201+0000","last_became_peered":"2024-09-12T17:23:40.711201+0000","last_unstale":"2024-09-12T18:01:51.042089+0000","last_undegraded":"2024-09-12T18:01:51.042089+0000","last_fullsized":"2024-09-12T18:01:51.042089+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:09.766467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2561815,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":549,"num_read_kb":25516,"num_write":1199,"num_write_kb":38939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"261'151","reported_seq":661,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.612262+0000","last_change":"2024-09-12T17:23:50.184556+0000","last_active":"2024-09-12T18:00:18.612262+0000","last_peered":"2024-09-12T18:00:18.612262+0000","last_clean":"2024-09-12T18:00:18.612262+0000","last_became_active":"2024-09-12T17:23:50.184149+0000","last_became_peered":"2024-09-12T17:23:50.184149+0000","last_unstale":"2024-09-12T18:00:18.612262+0000","last_undegraded":"2024-09-12T18:00:18.612262+0000","last_fullsized":"2024-09-12T18:00:18.612262+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:56.623668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":269,"num_read_kb":251,"num_write":373,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"261'429","reported_seq":2033,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.775304+0000","last_change":"2024-09-12T17:23:42.154156+0000","last_active":"2024-09-12T18:00:15.775304+0000","last_peered":"2024-09-12T18:00:15.775304+0000","last_clean":"2024-09-12T18:00:15.775304+0000","last_became_active":"2024-09-12T17:23:42.153262+0000","last_became_peered":"2024-09-12T17:23:42.153262+0000","last_unstale":"2024-09-12T18:00:15.775304+0000","last_undegraded":"2024-09-12T18:00:15.775304+0000","last_fullsized":"2024-09-12T18:00:15.775304+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:04.351858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2462,"num_read_kb":2350,"num_write":478,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"261'336","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.001097+0000","last_change":"2024-09-12T17:23:40.709825+0000","last_active":"2024-09-12T18:01:51.001097+0000","last_peered":"2024-09-12T18:01:51.001097+0000","last_clean":"2024-09-12T18:01:51.001097+0000","last_became_active":"2024-09-12T17:23:40.709513+0000","last_became_peered":"2024-09-12T17:23:40.709513+0000","last_unstale":"2024-09-12T18:01:51.001097+0000","last_undegraded":"2024-09-12T18:01:51.001097+0000","last_fullsized":"2024-09-12T18:01:51.001097+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:06.392512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":481,"num_read_kb":53800,"num_write":1092,"num_write_kb":42009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404158+0000","last_change":"2024-09-12T17:23:44.151154+0000","last_active":"2024-09-12T17:57:34.404158+0000","last_peered":"2024-09-12T17:57:34.404158+0000","last_clean":"2024-09-12T17:57:34.404158+0000","last_became_active":"2024-09-12T17:23:44.150860+0000","last_became_peered":"2024-09-12T17:23:44.150860+0000","last_unstale":"2024-09-12T17:57:34.404158+0000","last_undegraded":"2024-09-12T17:57:34.404158+0000","last_fullsized":"2024-09-12T17:57:34.404158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:48.984288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"261'337","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.059907+0000","last_change":"2024-09-12T17:23:46.153152+0000","last_active":"2024-09-12T18:01:51.059907+0000","last_peered":"2024-09-12T18:01:51.059907+0000","last_clean":"2024-09-12T18:01:51.059907+0000","last_became_active":"2024-09-12T17:23:46.152874+0000","last_became_peered":"2024-09-12T17:23:46.152874+0000","last_unstale":"2024-09-12T18:01:51.059907+0000","last_undegraded":"2024-09-12T18:01:51.059907+0000","last_fullsized":"2024-09-12T18:01:51.059907+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:57.758740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49853,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":1208,"num_write":446,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.405726+0000","last_change":"2024-09-12T17:23:48.168394+0000","last_active":"2024-09-12T17:57:39.405726+0000","last_peered":"2024-09-12T17:57:39.405726+0000","last_clean":"2024-09-12T17:57:39.405726+0000","last_became_active":"2024-09-12T17:23:48.168052+0000","last_became_peered":"2024-09-12T17:23:48.168052+0000","last_unstale":"2024-09-12T17:57:39.405726+0000","last_undegraded":"2024-09-12T17:57:39.405726+0000","last_fullsized":"2024-09-12T17:57:39.405726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:50.986726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"261'173","reported_seq":728,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.773668+0000","last_change":"2024-09-12T17:23:50.188838+0000","last_active":"2024-09-12T18:00:15.773668+0000","last_peered":"2024-09-12T18:00:15.773668+0000","last_clean":"2024-09-12T18:00:15.773668+0000","last_became_active":"2024-09-12T17:23:50.188506+0000","last_became_peered":"2024-09-12T17:23:50.188506+0000","last_unstale":"2024-09-12T18:00:15.773668+0000","last_undegraded":"2024-09-12T18:00:15.773668+0000","last_fullsized":"2024-09-12T18:00:15.773668+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:28.074396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":316,"num_read_kb":300,"num_write":383,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"261'579","reported_seq":2125,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.140832+0000","last_change":"2024-09-12T17:23:42.144567+0000","last_active":"2024-09-12T18:00:18.140832+0000","last_peered":"2024-09-12T18:00:18.140832+0000","last_clean":"2024-09-12T18:00:18.140832+0000","last_became_active":"2024-09-12T17:23:42.143794+0000","last_became_peered":"2024-09-12T17:23:42.143794+0000","last_unstale":"2024-09-12T18:00:18.140832+0000","last_undegraded":"2024-09-12T18:00:18.140832+0000","last_fullsized":"2024-09-12T18:00:18.140832+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:01.173511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3146,"num_read_kb":2882,"num_write":787,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"261'426","reported_seq":1064,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.058477+0000","last_change":"2024-09-12T17:24:17.288249+0000","last_active":"2024-09-12T18:01:51.058477+0000","last_peered":"2024-09-12T18:01:51.058477+0000","last_clean":"2024-09-12T18:01:51.058477+0000","last_became_active":"2024-09-12T17:24:17.287987+0000","last_became_peered":"2024-09-12T17:24:17.287987+0000","last_unstale":"2024-09-12T18:01:51.058477+0000","last_undegraded":"2024-09-12T18:01:51.058477+0000","last_fullsized":"2024-09-12T18:01:51.058477+0000","mapping_epoch":36,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:59.986635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174825,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":630,"num_read_kb":42370,"num_write":1204,"num_write_kb":32675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.413518+0000","last_change":"2024-09-12T17:23:44.149386+0000","last_active":"2024-09-12T17:58:48.413518+0000","last_peered":"2024-09-12T17:58:48.413518+0000","last_clean":"2024-09-12T17:58:48.413518+0000","last_became_active":"2024-09-12T17:23:44.149079+0000","last_became_peered":"2024-09-12T17:23:44.149079+0000","last_unstale":"2024-09-12T17:58:48.413518+0000","last_undegraded":"2024-09-12T17:58:48.413518+0000","last_fullsized":"2024-09-12T17:58:48.413518+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:52.404478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"261'78","reported_seq":591,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:23.586728+0000","last_change":"2024-09-12T17:23:46.150777+0000","last_active":"2024-09-12T17:59:23.586728+0000","last_peered":"2024-09-12T17:59:23.586728+0000","last_clean":"2024-09-12T17:59:23.586728+0000","last_became_active":"2024-09-12T17:23:46.150447+0000","last_became_peered":"2024-09-12T17:23:46.150447+0000","last_unstale":"2024-09-12T17:59:23.586728+0000","last_undegraded":"2024-09-12T17:59:23.586728+0000","last_fullsized":"2024-09-12T17:59:23.586728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:18.226708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":77,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.405649+0000","last_change":"2024-09-12T17:23:48.166388+0000","last_active":"2024-09-12T17:57:39.405649+0000","last_peered":"2024-09-12T17:57:39.405649+0000","last_clean":"2024-09-12T17:57:39.405649+0000","last_became_active":"2024-09-12T17:23:48.165965+0000","last_became_peered":"2024-09-12T17:23:48.165965+0000","last_unstale":"2024-09-12T17:57:39.405649+0000","last_undegraded":"2024-09-12T17:57:39.405649+0000","last_fullsized":"2024-09-12T17:57:39.405649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:48.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"261'113","reported_seq":609,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.639640+0000","last_change":"2024-09-12T17:23:50.188380+0000","last_active":"2024-09-12T17:59:48.639640+0000","last_peered":"2024-09-12T17:59:48.639640+0000","last_clean":"2024-09-12T17:59:48.639640+0000","last_became_active":"2024-09-12T17:23:50.188143+0000","last_became_peered":"2024-09-12T17:23:50.188143+0000","last_unstale":"2024-09-12T17:59:48.639640+0000","last_undegraded":"2024-09-12T17:59:48.639640+0000","last_fullsized":"2024-09-12T17:59:48.639640+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:55.598494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":180,"num_write":267,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"261'430","reported_seq":2047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.138465+0000","last_change":"2024-09-12T17:23:42.155423+0000","last_active":"2024-09-12T18:00:18.138465+0000","last_peered":"2024-09-12T18:00:18.138465+0000","last_clean":"2024-09-12T18:00:18.138465+0000","last_became_active":"2024-09-12T17:23:42.155137+0000","last_became_peered":"2024-09-12T17:23:42.155137+0000","last_unstale":"2024-09-12T18:00:18.138465+0000","last_undegraded":"2024-09-12T18:00:18.138465+0000","last_fullsized":"2024-09-12T18:00:18.138465+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:12.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2401,"num_read_kb":2311,"num_write":475,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"261'489","reported_seq":1138,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.989895+0000","last_change":"2024-09-12T17:23:40.707827+0000","last_active":"2024-09-12T18:01:50.989895+0000","last_peered":"2024-09-12T18:01:50.989895+0000","last_clean":"2024-09-12T18:01:50.989895+0000","last_became_active":"2024-09-12T17:23:40.707549+0000","last_became_peered":"2024-09-12T17:23:40.707549+0000","last_unstale":"2024-09-12T18:01:50.989895+0000","last_undegraded":"2024-09-12T18:01:50.989895+0000","last_fullsized":"2024-09-12T18:01:50.989895+0000","mapping_epoch":23,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:48.898807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":822,"num_read_kb":5813,"num_write":1382,"num_write_kb":24859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.401656+0000","last_change":"2024-09-12T17:23:44.151294+0000","last_active":"2024-09-12T17:57:33.401656+0000","last_peered":"2024-09-12T17:57:33.401656+0000","last_clean":"2024-09-12T17:57:33.401656+0000","last_became_active":"2024-09-12T17:23:44.150973+0000","last_became_peered":"2024-09-12T17:23:44.150973+0000","last_unstale":"2024-09-12T17:57:33.401656+0000","last_undegraded":"2024-09-12T17:57:33.401656+0000","last_fullsized":"2024-09-12T17:57:33.401656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:15.283072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"261'95","reported_seq":615,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:49.842571+0000","last_change":"2024-09-12T17:23:46.154192+0000","last_active":"2024-09-12T17:59:49.842571+0000","last_peered":"2024-09-12T17:59:49.842571+0000","last_clean":"2024-09-12T17:59:49.842571+0000","last_became_active":"2024-09-12T17:23:46.153864+0000","last_became_peered":"2024-09-12T17:23:46.153864+0000","last_unstale":"2024-09-12T17:59:49.842571+0000","last_undegraded":"2024-09-12T17:59:49.842571+0000","last_fullsized":"2024-09-12T17:59:49.842571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:52.292455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"261'764","reported_seq":2155,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.485904+0000","last_change":"2024-09-12T17:23:48.173728+0000","last_active":"2024-09-12T18:01:50.485904+0000","last_peered":"2024-09-12T18:01:50.485904+0000","last_clean":"2024-09-12T18:01:50.485904+0000","last_became_active":"2024-09-12T17:23:48.173454+0000","last_became_peered":"2024-09-12T17:23:48.173454+0000","last_unstale":"2024-09-12T18:01:50.485904+0000","last_undegraded":"2024-09-12T18:01:50.485904+0000","last_fullsized":"2024-09-12T18:01:50.485904+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:51.582534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"261'214","reported_seq":1037,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.663235+0000","last_change":"2024-09-12T17:23:50.640673+0000","last_active":"2024-09-12T18:00:18.663235+0000","last_peered":"2024-09-12T18:00:18.663235+0000","last_clean":"2024-09-12T18:00:18.663235+0000","last_became_active":"2024-09-12T17:23:50.640401+0000","last_became_peered":"2024-09-12T17:23:50.640401+0000","last_unstale":"2024-09-12T18:00:18.663235+0000","last_undegraded":"2024-09-12T18:00:18.663235+0000","last_fullsized":"2024-09-12T18:00:18.663235+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:04.518137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":682,"num_read_kb":671,"num_write":489,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"261'898","reported_seq":2439,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.892342+0000","last_change":"2024-09-12T17:23:42.148014+0000","last_active":"2024-09-12T18:00:04.892342+0000","last_peered":"2024-09-12T18:00:04.892342+0000","last_clean":"2024-09-12T18:00:04.892342+0000","last_became_active":"2024-09-12T17:23:42.147597+0000","last_became_peered":"2024-09-12T17:23:42.147597+0000","last_unstale":"2024-09-12T18:00:04.892342+0000","last_undegraded":"2024-09-12T18:00:04.892342+0000","last_fullsized":"2024-09-12T18:00:04.892342+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":800,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:17.140238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4183,"num_read_kb":3727,"num_write":1220,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"261'363","reported_seq":1040,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.008425+0000","last_change":"2024-09-12T17:23:40.718814+0000","last_active":"2024-09-12T18:01:51.008425+0000","last_peered":"2024-09-12T18:01:51.008425+0000","last_clean":"2024-09-12T18:01:51.008425+0000","last_became_active":"2024-09-12T17:23:40.718582+0000","last_became_peered":"2024-09-12T17:23:40.718582+0000","last_unstale":"2024-09-12T18:01:51.008425+0000","last_undegraded":"2024-09-12T18:01:51.008425+0000","last_fullsized":"2024-09-12T18:01:51.008425+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:35.754217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":588,"num_read_kb":83250,"num_write":1103,"num_write_kb":35659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404212+0000","last_change":"2024-09-12T17:23:44.152542+0000","last_active":"2024-09-12T17:57:34.404212+0000","last_peered":"2024-09-12T17:57:34.404212+0000","last_clean":"2024-09-12T17:57:34.404212+0000","last_became_active":"2024-09-12T17:23:44.151918+0000","last_became_peered":"2024-09-12T17:23:44.151918+0000","last_unstale":"2024-09-12T17:57:34.404212+0000","last_undegraded":"2024-09-12T17:57:34.404212+0000","last_fullsized":"2024-09-12T17:57:34.404212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:18.221084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"261'266","reported_seq":817,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.830183+0000","last_change":"2024-09-12T17:23:46.241449+0000","last_active":"2024-09-12T18:01:50.830183+0000","last_peered":"2024-09-12T18:01:50.830183+0000","last_clean":"2024-09-12T18:01:50.830183+0000","last_became_active":"2024-09-12T17:23:46.241137+0000","last_became_peered":"2024-09-12T17:23:46.241137+0000","last_unstale":"2024-09-12T18:01:50.830183+0000","last_undegraded":"2024-09-12T18:01:50.830183+0000","last_fullsized":"2024-09-12T18:01:50.830183+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:58.197635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":1112,"num_write":380,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"261'806","reported_seq":6201,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.420683+0000","last_change":"2024-09-12T17:23:48.167347+0000","last_active":"2024-09-12T18:01:49.420683+0000","last_peered":"2024-09-12T18:01:49.420683+0000","last_clean":"2024-09-12T18:01:49.420683+0000","last_became_active":"2024-09-12T17:23:48.167038+0000","last_became_peered":"2024-09-12T17:23:48.167038+0000","last_unstale":"2024-09-12T18:01:49.420683+0000","last_undegraded":"2024-09-12T18:01:49.420683+0000","last_fullsized":"2024-09-12T18:01:49.420683+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:22.744543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"261'663","reported_seq":2260,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559804+0000","last_change":"2024-09-12T17:23:42.144234+0000","last_active":"2024-09-12T18:00:18.559804+0000","last_peered":"2024-09-12T18:00:18.559804+0000","last_clean":"2024-09-12T18:00:18.559804+0000","last_became_active":"2024-09-12T17:23:42.143778+0000","last_became_peered":"2024-09-12T17:23:42.143778+0000","last_unstale":"2024-09-12T18:00:18.559804+0000","last_undegraded":"2024-09-12T18:00:18.559804+0000","last_fullsized":"2024-09-12T18:00:18.559804+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":600,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:03.567237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3245,"num_read_kb":3064,"num_write":918,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"261'347","reported_seq":948,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.047081+0000","last_change":"2024-09-12T17:23:40.709847+0000","last_active":"2024-09-12T18:01:51.047081+0000","last_peered":"2024-09-12T18:01:51.047081+0000","last_clean":"2024-09-12T18:01:51.047081+0000","last_became_active":"2024-09-12T17:23:40.709587+0000","last_became_peered":"2024-09-12T17:23:40.709587+0000","last_unstale":"2024-09-12T18:01:51.047081+0000","last_undegraded":"2024-09-12T18:01:51.047081+0000","last_fullsized":"2024-09-12T18:01:51.047081+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:52.138227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947352,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":408,"num_read_kb":61352,"num_write":1018,"num_write_kb":60278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.412039+0000","last_change":"2024-09-12T17:23:44.151275+0000","last_active":"2024-09-12T17:58:24.412039+0000","last_peered":"2024-09-12T17:58:24.412039+0000","last_clean":"2024-09-12T17:58:24.412039+0000","last_became_active":"2024-09-12T17:23:44.150957+0000","last_became_peered":"2024-09-12T17:23:44.150957+0000","last_unstale":"2024-09-12T17:58:24.412039+0000","last_undegraded":"2024-09-12T17:58:24.412039+0000","last_fullsized":"2024-09-12T17:58:24.412039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:06.423907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"261'345","reported_seq":937,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.669893+0000","last_change":"2024-09-12T17:23:46.241749+0000","last_active":"2024-09-12T18:01:49.669893+0000","last_peered":"2024-09-12T18:01:49.669893+0000","last_clean":"2024-09-12T18:01:49.669893+0000","last_became_active":"2024-09-12T17:23:46.241442+0000","last_became_peered":"2024-09-12T17:23:46.241442+0000","last_unstale":"2024-09-12T18:01:49.669893+0000","last_undegraded":"2024-09-12T18:01:49.669893+0000","last_fullsized":"2024-09-12T18:01:49.669893+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:17.283661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47631,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":562,"num_read_kb":1202,"num_write":448,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.403282+0000","last_change":"2024-09-12T17:23:48.168185+0000","last_active":"2024-09-12T17:57:34.403282+0000","last_peered":"2024-09-12T17:57:34.403282+0000","last_clean":"2024-09-12T17:57:34.403282+0000","last_became_active":"2024-09-12T17:23:48.167925+0000","last_became_peered":"2024-09-12T17:23:48.167925+0000","last_unstale":"2024-09-12T17:57:34.403282+0000","last_undegraded":"2024-09-12T17:57:34.403282+0000","last_fullsized":"2024-09-12T17:57:34.403282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:09.629250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"261'574","reported_seq":1382,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.439771+0000","last_change":"2024-09-12T17:23:50.188392+0000","last_active":"2024-09-12T18:01:42.439771+0000","last_peered":"2024-09-12T18:01:42.439771+0000","last_clean":"2024-09-12T18:01:42.439771+0000","last_became_active":"2024-09-12T17:23:50.188109+0000","last_became_peered":"2024-09-12T17:23:50.188109+0000","last_unstale":"2024-09-12T18:01:42.439771+0000","last_undegraded":"2024-09-12T18:01:42.439771+0000","last_fullsized":"2024-09-12T18:01:42.439771+0000","mapping_epoch":33,"log_start":"261'500","ondisk_log_start":"261'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:18.895859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1373,"num_read_kb":1362,"num_write":1221,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"261'466","reported_seq":2001,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.785578+0000","last_change":"2024-09-12T17:23:42.136630+0000","last_active":"2024-09-12T18:00:05.785578+0000","last_peered":"2024-09-12T18:00:05.785578+0000","last_clean":"2024-09-12T18:00:05.785578+0000","last_became_active":"2024-09-12T17:23:42.135997+0000","last_became_peered":"2024-09-12T17:23:42.135997+0000","last_unstale":"2024-09-12T18:00:05.785578+0000","last_undegraded":"2024-09-12T18:00:05.785578+0000","last_fullsized":"2024-09-12T18:00:05.785578+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:19.635100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2354,"num_read_kb":2214,"num_write":547,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"261'344","reported_seq":971,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.054003+0000","last_change":"2024-09-12T17:23:40.711857+0000","last_active":"2024-09-12T18:01:51.054003+0000","last_peered":"2024-09-12T18:01:51.054003+0000","last_clean":"2024-09-12T18:01:51.054003+0000","last_became_active":"2024-09-12T17:23:40.711546+0000","last_became_peered":"2024-09-12T17:23:40.711546+0000","last_unstale":"2024-09-12T18:01:51.054003+0000","last_undegraded":"2024-09-12T18:01:51.054003+0000","last_fullsized":"2024-09-12T18:01:51.054003+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:28.645374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":612536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":14392,"num_write":1010,"num_write_kb":31885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.611541+0000","last_change":"2024-09-12T17:23:44.148761+0000","last_active":"2024-09-12T17:58:23.611541+0000","last_peered":"2024-09-12T17:58:23.611541+0000","last_clean":"2024-09-12T17:58:23.611541+0000","last_became_active":"2024-09-12T17:23:44.148472+0000","last_became_peered":"2024-09-12T17:23:44.148472+0000","last_unstale":"2024-09-12T17:58:23.611541+0000","last_undegraded":"2024-09-12T17:58:23.611541+0000","last_fullsized":"2024-09-12T17:58:23.611541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:28.080187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"261'244","reported_seq":800,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.309618+0000","last_change":"2024-09-12T17:23:46.153208+0000","last_active":"2024-09-12T18:01:50.309618+0000","last_peered":"2024-09-12T18:01:50.309618+0000","last_clean":"2024-09-12T18:01:50.309618+0000","last_became_active":"2024-09-12T17:23:46.152441+0000","last_became_peered":"2024-09-12T17:23:46.152441+0000","last_unstale":"2024-09-12T18:01:50.309618+0000","last_undegraded":"2024-09-12T18:01:50.309618+0000","last_fullsized":"2024-09-12T18:01:50.309618+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:17.945639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46658,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":411,"num_read_kb":954,"num_write":334,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411068+0000","last_change":"2024-09-12T17:23:48.168110+0000","last_active":"2024-09-12T17:58:33.411068+0000","last_peered":"2024-09-12T17:58:33.411068+0000","last_clean":"2024-09-12T17:58:33.411068+0000","last_became_active":"2024-09-12T17:23:48.167829+0000","last_became_peered":"2024-09-12T17:23:48.167829+0000","last_unstale":"2024-09-12T17:58:33.411068+0000","last_undegraded":"2024-09-12T17:58:33.411068+0000","last_fullsized":"2024-09-12T17:58:33.411068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:24.546875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"261'2375","reported_seq":4213,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.434744+0000","last_change":"2024-09-12T17:23:50.186322+0000","last_active":"2024-09-12T18:01:29.434744+0000","last_peered":"2024-09-12T18:01:29.434744+0000","last_clean":"2024-09-12T18:01:29.434744+0000","last_became_active":"2024-09-12T17:23:50.186026+0000","last_became_peered":"2024-09-12T17:23:50.186026+0000","last_unstale":"2024-09-12T18:01:29.434744+0000","last_undegraded":"2024-09-12T18:01:29.434744+0000","last_fullsized":"2024-09-12T18:01:29.434744+0000","mapping_epoch":33,"log_start":"261'2300","ondisk_log_start":"261'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":2300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:19.020080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6096,"num_read_kb":6075,"num_write":4800,"num_write_kb":1772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"261'457","reported_seq":1986,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559814+0000","last_change":"2024-09-12T17:23:42.147429+0000","last_active":"2024-09-12T18:00:18.559814+0000","last_peered":"2024-09-12T18:00:18.559814+0000","last_clean":"2024-09-12T18:00:18.559814+0000","last_became_active":"2024-09-12T17:23:42.147136+0000","last_became_peered":"2024-09-12T17:23:42.147136+0000","last_unstale":"2024-09-12T18:00:18.559814+0000","last_undegraded":"2024-09-12T18:00:18.559814+0000","last_fullsized":"2024-09-12T18:00:18.559814+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:43.868169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2419,"num_read_kb":2271,"num_write":547,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"261'320","reported_seq":914,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.930669+0000","last_change":"2024-09-12T17:23:40.714029+0000","last_active":"2024-09-12T18:01:50.930669+0000","last_peered":"2024-09-12T18:01:50.930669+0000","last_clean":"2024-09-12T18:01:50.930669+0000","last_became_active":"2024-09-12T17:23:40.713481+0000","last_became_peered":"2024-09-12T17:23:40.713481+0000","last_unstale":"2024-09-12T18:01:50.930669+0000","last_undegraded":"2024-09-12T18:01:50.930669+0000","last_fullsized":"2024-09-12T18:01:50.930669+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:10.827842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":421,"num_read_kb":5522,"num_write":1047,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.604544+0000","last_change":"2024-09-12T17:23:44.147970+0000","last_active":"2024-09-12T17:57:28.604544+0000","last_peered":"2024-09-12T17:57:28.604544+0000","last_clean":"2024-09-12T17:57:28.604544+0000","last_became_active":"2024-09-12T17:23:44.147677+0000","last_became_peered":"2024-09-12T17:23:44.147677+0000","last_unstale":"2024-09-12T17:57:28.604544+0000","last_undegraded":"2024-09-12T17:57:28.604544+0000","last_fullsized":"2024-09-12T17:57:28.604544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:44.346531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"261'286","reported_seq":851,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.768095+0000","last_change":"2024-09-12T17:23:46.150883+0000","last_active":"2024-09-12T18:01:49.768095+0000","last_peered":"2024-09-12T18:01:49.768095+0000","last_clean":"2024-09-12T18:01:49.768095+0000","last_became_active":"2024-09-12T17:23:46.150555+0000","last_became_peered":"2024-09-12T17:23:46.150555+0000","last_unstale":"2024-09-12T18:01:49.768095+0000","last_undegraded":"2024-09-12T18:01:49.768095+0000","last_fullsized":"2024-09-12T18:01:49.768095+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:53.085351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53816,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":485,"num_read_kb":1109,"num_write":394,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"261'804","reported_seq":2472,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.870728+0000","last_change":"2024-09-12T17:23:48.165492+0000","last_active":"2024-09-12T18:01:50.870728+0000","last_peered":"2024-09-12T18:01:50.870728+0000","last_clean":"2024-09-12T18:01:50.870728+0000","last_became_active":"2024-09-12T17:23:48.165179+0000","last_became_peered":"2024-09-12T17:23:48.165179+0000","last_unstale":"2024-09-12T18:01:50.870728+0000","last_undegraded":"2024-09-12T18:01:50.870728+0000","last_fullsized":"2024-09-12T18:01:50.870728+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:26.382390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"261'143","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.345598+0000","last_change":"2024-09-12T17:23:50.188608+0000","last_active":"2024-09-12T18:01:41.345598+0000","last_peered":"2024-09-12T18:01:41.345598+0000","last_clean":"2024-09-12T18:01:41.345598+0000","last_became_active":"2024-09-12T17:23:50.188230+0000","last_became_peered":"2024-09-12T17:23:50.188230+0000","last_unstale":"2024-09-12T18:01:41.345598+0000","last_undegraded":"2024-09-12T18:01:41.345598+0000","last_fullsized":"2024-09-12T18:01:41.345598+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:43.821173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":185,"num_write":335,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"261'473","reported_seq":2022,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.409628+0000","last_change":"2024-09-12T17:23:42.154193+0000","last_active":"2024-09-12T18:01:41.409628+0000","last_peered":"2024-09-12T18:01:41.409628+0000","last_clean":"2024-09-12T18:01:41.409628+0000","last_became_active":"2024-09-12T17:23:42.153910+0000","last_became_peered":"2024-09-12T17:23:42.153910+0000","last_unstale":"2024-09-12T18:01:41.409628+0000","last_undegraded":"2024-09-12T18:01:41.409628+0000","last_fullsized":"2024-09-12T18:01:41.409628+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:19.410163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2575,"num_read_kb":2405,"num_write":575,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"261'397","reported_seq":1112,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.029034+0000","last_change":"2024-09-12T17:23:40.714040+0000","last_active":"2024-09-12T18:01:51.029034+0000","last_peered":"2024-09-12T18:01:51.029034+0000","last_clean":"2024-09-12T18:01:51.029034+0000","last_became_active":"2024-09-12T17:23:40.712691+0000","last_became_peered":"2024-09-12T17:23:40.712691+0000","last_unstale":"2024-09-12T18:01:51.029034+0000","last_undegraded":"2024-09-12T18:01:51.029034+0000","last_fullsized":"2024-09-12T18:01:51.029034+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:23.050646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":118590,"num_write":1283,"num_write_kb":72411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.611578+0000","last_change":"2024-09-12T17:23:44.143860+0000","last_active":"2024-09-12T17:58:23.611578+0000","last_peered":"2024-09-12T17:58:23.611578+0000","last_clean":"2024-09-12T17:58:23.611578+0000","last_became_active":"2024-09-12T17:23:44.142306+0000","last_became_peered":"2024-09-12T17:23:44.142306+0000","last_unstale":"2024-09-12T17:58:23.611578+0000","last_undegraded":"2024-09-12T17:58:23.611578+0000","last_fullsized":"2024-09-12T17:58:23.611578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:59.833432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"261'456","reported_seq":1070,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.456866+0000","last_change":"2024-09-12T17:23:46.154013+0000","last_active":"2024-09-12T18:01:50.456866+0000","last_peered":"2024-09-12T18:01:50.456866+0000","last_clean":"2024-09-12T18:01:50.456866+0000","last_became_active":"2024-09-12T17:23:46.153719+0000","last_became_peered":"2024-09-12T17:23:46.153719+0000","last_unstale":"2024-09-12T18:01:50.456866+0000","last_undegraded":"2024-09-12T18:01:50.456866+0000","last_fullsized":"2024-09-12T18:01:50.456866+0000","mapping_epoch":29,"log_start":"261'400","ondisk_log_start":"261'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:26.689565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96999,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":810,"num_read_kb":1963,"num_write":664,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612208+0000","last_change":"2024-09-12T17:23:48.170645+0000","last_active":"2024-09-12T17:58:28.612208+0000","last_peered":"2024-09-12T17:58:28.612208+0000","last_clean":"2024-09-12T17:58:28.612208+0000","last_became_active":"2024-09-12T17:23:48.170317+0000","last_became_peered":"2024-09-12T17:23:48.170317+0000","last_unstale":"2024-09-12T17:58:28.612208+0000","last_undegraded":"2024-09-12T17:58:28.612208+0000","last_fullsized":"2024-09-12T17:58:28.612208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:12.486235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"261'153","reported_seq":658,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:22.115592+0000","last_change":"2024-09-12T17:23:50.184354+0000","last_active":"2024-09-12T17:59:22.115592+0000","last_peered":"2024-09-12T17:59:22.115592+0000","last_clean":"2024-09-12T17:59:22.115592+0000","last_became_active":"2024-09-12T17:23:50.184033+0000","last_became_peered":"2024-09-12T17:23:50.184033+0000","last_unstale":"2024-09-12T17:59:22.115592+0000","last_undegraded":"2024-09-12T17:59:22.115592+0000","last_fullsized":"2024-09-12T17:59:22.115592+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:27.722195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":204,"num_write":351,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"261'833","reported_seq":2440,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.139345+0000","last_change":"2024-09-12T17:23:42.145012+0000","last_active":"2024-09-12T18:00:18.139345+0000","last_peered":"2024-09-12T18:00:18.139345+0000","last_clean":"2024-09-12T18:00:18.139345+0000","last_became_active":"2024-09-12T17:23:42.144703+0000","last_became_peered":"2024-09-12T17:23:42.144703+0000","last_unstale":"2024-09-12T18:00:18.139345+0000","last_undegraded":"2024-09-12T18:00:18.139345+0000","last_fullsized":"2024-09-12T18:00:18.139345+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:39.045177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3952,"num_read_kb":3587,"num_write":1103,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"261'388","reported_seq":1045,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.038150+0000","last_change":"2024-09-12T17:23:40.706524+0000","last_active":"2024-09-12T18:01:51.038150+0000","last_peered":"2024-09-12T18:01:51.038150+0000","last_clean":"2024-09-12T18:01:51.038150+0000","last_became_active":"2024-09-12T17:23:40.706213+0000","last_became_peered":"2024-09-12T17:23:40.706213+0000","last_unstale":"2024-09-12T18:01:51.038150+0000","last_undegraded":"2024-09-12T18:01:51.038150+0000","last_fullsized":"2024-09-12T18:01:51.038150+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:54.778098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2088372,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":615,"num_read_kb":8190,"num_write":1407,"num_write_kb":25988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.604568+0000","last_change":"2024-09-12T17:23:44.149835+0000","last_active":"2024-09-12T17:57:28.604568+0000","last_peered":"2024-09-12T17:57:28.604568+0000","last_clean":"2024-09-12T17:57:28.604568+0000","last_became_active":"2024-09-12T17:23:44.149550+0000","last_became_peered":"2024-09-12T17:23:44.149550+0000","last_unstale":"2024-09-12T17:57:28.604568+0000","last_undegraded":"2024-09-12T17:57:28.604568+0000","last_fullsized":"2024-09-12T17:57:28.604568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:43.008237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"261'277","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.509891+0000","last_change":"2024-09-12T17:23:46.153560+0000","last_active":"2024-09-12T18:01:50.509891+0000","last_peered":"2024-09-12T18:01:50.509891+0000","last_clean":"2024-09-12T18:01:50.509891+0000","last_became_active":"2024-09-12T17:23:46.153210+0000","last_became_peered":"2024-09-12T17:23:46.153210+0000","last_unstale":"2024-09-12T18:01:50.509891+0000","last_undegraded":"2024-09-12T18:01:50.509891+0000","last_fullsized":"2024-09-12T18:01:50.509891+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:53.528030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":1026,"num_write":426,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.531914+0000","last_change":"2024-09-12T17:23:48.168999+0000","last_active":"2024-09-12T17:57:39.531914+0000","last_peered":"2024-09-12T17:57:39.531914+0000","last_clean":"2024-09-12T17:57:39.531914+0000","last_became_active":"2024-09-12T17:23:48.168675+0000","last_became_peered":"2024-09-12T17:23:48.168675+0000","last_unstale":"2024-09-12T17:57:39.531914+0000","last_undegraded":"2024-09-12T17:57:39.531914+0000","last_fullsized":"2024-09-12T17:57:39.531914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:15.332536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"261'97","reported_seq":577,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.616169+0000","last_change":"2024-09-12T17:23:50.186614+0000","last_active":"2024-09-12T18:00:18.616169+0000","last_peered":"2024-09-12T18:00:18.616169+0000","last_clean":"2024-09-12T18:00:18.616169+0000","last_became_active":"2024-09-12T17:23:50.186287+0000","last_became_peered":"2024-09-12T17:23:50.186287+0000","last_unstale":"2024-09-12T18:00:18.616169+0000","last_undegraded":"2024-09-12T18:00:18.616169+0000","last_fullsized":"2024-09-12T18:00:18.616169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:36.361422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":108,"num_read_kb":104,"num_write":228,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"261'640","reported_seq":2241,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.779429+0000","last_change":"2024-09-12T17:23:42.134561+0000","last_active":"2024-09-12T18:00:05.779429+0000","last_peered":"2024-09-12T18:00:05.779429+0000","last_clean":"2024-09-12T18:00:05.779429+0000","last_became_active":"2024-09-12T17:23:42.132858+0000","last_became_peered":"2024-09-12T17:23:42.132858+0000","last_unstale":"2024-09-12T18:00:05.779429+0000","last_undegraded":"2024-09-12T18:00:05.779429+0000","last_fullsized":"2024-09-12T18:00:05.779429+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:47.060225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3409,"num_read_kb":3082,"num_write":929,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"261'403","reported_seq":1076,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.019150+0000","last_change":"2024-09-12T17:23:40.706825+0000","last_active":"2024-09-12T18:01:51.019150+0000","last_peered":"2024-09-12T18:01:51.019150+0000","last_clean":"2024-09-12T18:01:51.019150+0000","last_became_active":"2024-09-12T17:23:40.706531+0000","last_became_peered":"2024-09-12T17:23:40.706531+0000","last_unstale":"2024-09-12T18:01:51.019150+0000","last_undegraded":"2024-09-12T18:01:51.019150+0000","last_fullsized":"2024-09-12T18:01:51.019150+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:47.318982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":670,"num_read_kb":36595,"num_write":1219,"num_write_kb":30858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"35'5","reported_seq":975,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.979476+0000","last_change":"2024-09-12T17:23:44.147758+0000","last_active":"2024-09-12T18:01:48.979476+0000","last_peered":"2024-09-12T18:01:48.979476+0000","last_clean":"2024-09-12T18:01:48.979476+0000","last_became_active":"2024-09-12T17:23:44.147427+0000","last_became_peered":"2024-09-12T17:23:44.147427+0000","last_unstale":"2024-09-12T18:01:48.979476+0000","last_undegraded":"2024-09-12T18:01:48.979476+0000","last_fullsized":"2024-09-12T18:01:48.979476+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:01.104960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":1201,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"261'299","reported_seq":868,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.143116+0000","last_change":"2024-09-12T17:23:46.153321+0000","last_active":"2024-09-12T18:01:50.143116+0000","last_peered":"2024-09-12T18:01:50.143116+0000","last_clean":"2024-09-12T18:01:50.143116+0000","last_became_active":"2024-09-12T17:23:46.153004+0000","last_became_peered":"2024-09-12T17:23:46.153004+0000","last_unstale":"2024-09-12T18:01:50.143116+0000","last_undegraded":"2024-09-12T18:01:50.143116+0000","last_fullsized":"2024-09-12T18:01:50.143116+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:18.903057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46983,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":497,"num_read_kb":1127,"num_write":408,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"261'742","reported_seq":2130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.605475+0000","last_change":"2024-09-12T17:23:48.169354+0000","last_active":"2024-09-12T18:01:50.605475+0000","last_peered":"2024-09-12T18:01:50.605475+0000","last_clean":"2024-09-12T18:01:50.605475+0000","last_became_active":"2024-09-12T17:23:48.169062+0000","last_became_peered":"2024-09-12T17:23:48.169062+0000","last_unstale":"2024-09-12T18:01:50.605475+0000","last_undegraded":"2024-09-12T18:01:50.605475+0000","last_fullsized":"2024-09-12T18:01:50.605475+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:31.045415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"261'140","reported_seq":626,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.160885+0000","last_change":"2024-09-12T17:23:50.184877+0000","last_active":"2024-09-12T18:00:18.160885+0000","last_peered":"2024-09-12T18:00:18.160885+0000","last_clean":"2024-09-12T18:00:18.160885+0000","last_became_active":"2024-09-12T17:23:50.184460+0000","last_became_peered":"2024-09-12T17:23:50.184460+0000","last_unstale":"2024-09-12T18:00:18.160885+0000","last_undegraded":"2024-09-12T18:00:18.160885+0000","last_fullsized":"2024-09-12T18:00:18.160885+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:05.644031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":156,"num_write":329,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"261'797","reported_seq":2252,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.099398+0000","last_change":"2024-09-12T17:23:42.146658+0000","last_active":"2024-09-12T18:00:02.099398+0000","last_peered":"2024-09-12T18:00:02.099398+0000","last_clean":"2024-09-12T18:00:02.099398+0000","last_became_active":"2024-09-12T17:23:42.142896+0000","last_became_peered":"2024-09-12T17:23:42.142896+0000","last_unstale":"2024-09-12T18:00:02.099398+0000","last_undegraded":"2024-09-12T18:00:02.099398+0000","last_fullsized":"2024-09-12T18:00:02.099398+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:06.765117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3737,"num_read_kb":3347,"num_write":1075,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"261'338","reported_seq":1001,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.987627+0000","last_change":"2024-09-12T17:23:40.708635+0000","last_active":"2024-09-12T18:01:50.987627+0000","last_peered":"2024-09-12T18:01:50.987627+0000","last_clean":"2024-09-12T18:01:50.987627+0000","last_became_active":"2024-09-12T17:23:40.708386+0000","last_became_peered":"2024-09-12T17:23:40.708386+0000","last_unstale":"2024-09-12T18:01:50.987627+0000","last_undegraded":"2024-09-12T18:01:50.987627+0000","last_fullsized":"2024-09-12T18:01:50.987627+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:15.730934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655881,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":106949,"num_write":1131,"num_write_kb":37410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1449,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.991695+0000","last_change":"2024-09-12T17:23:44.150061+0000","last_active":"2024-09-12T18:01:48.991695+0000","last_peered":"2024-09-12T18:01:48.991695+0000","last_clean":"2024-09-12T18:01:48.991695+0000","last_became_active":"2024-09-12T17:23:44.149279+0000","last_became_peered":"2024-09-12T17:23:44.149279+0000","last_unstale":"2024-09-12T18:01:48.991695+0000","last_undegraded":"2024-09-12T18:01:48.991695+0000","last_fullsized":"2024-09-12T18:01:48.991695+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:24.241906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"261'63","reported_seq":566,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:21.056971+0000","last_change":"2024-09-12T17:23:46.241422+0000","last_active":"2024-09-12T17:59:21.056971+0000","last_peered":"2024-09-12T17:59:21.056971+0000","last_clean":"2024-09-12T17:59:21.056971+0000","last_became_active":"2024-09-12T17:23:46.240979+0000","last_became_peered":"2024-09-12T17:23:46.240979+0000","last_unstale":"2024-09-12T17:59:21.056971+0000","last_undegraded":"2024-09-12T17:59:21.056971+0000","last_fullsized":"2024-09-12T17:59:21.056971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:39.659261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"261'786","reported_seq":2380,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.418254+0000","last_change":"2024-09-12T17:23:48.172774+0000","last_active":"2024-09-12T18:01:49.418254+0000","last_peered":"2024-09-12T18:01:49.418254+0000","last_clean":"2024-09-12T18:01:49.418254+0000","last_became_active":"2024-09-12T17:23:48.172485+0000","last_became_peered":"2024-09-12T17:23:48.172485+0000","last_unstale":"2024-09-12T18:01:49.418254+0000","last_undegraded":"2024-09-12T18:01:49.418254+0000","last_fullsized":"2024-09-12T18:01:49.418254+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:42.427288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"261'140","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:56.764717+0000","last_change":"2024-09-12T17:23:50.179455+0000","last_active":"2024-09-12T17:59:56.764717+0000","last_peered":"2024-09-12T17:59:56.764717+0000","last_clean":"2024-09-12T17:59:56.764717+0000","last_became_active":"2024-09-12T17:23:50.179153+0000","last_became_peered":"2024-09-12T17:23:50.179153+0000","last_unstale":"2024-09-12T17:59:56.764717+0000","last_undegraded":"2024-09-12T17:59:56.764717+0000","last_fullsized":"2024-09-12T17:59:56.764717+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:04.149720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":149,"num_read_kb":148,"num_write":323,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"261'408","reported_seq":1899,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.498175+0000","last_change":"2024-09-12T17:23:42.152712+0000","last_active":"2024-09-12T18:00:05.498175+0000","last_peered":"2024-09-12T18:00:05.498175+0000","last_clean":"2024-09-12T18:00:05.498175+0000","last_became_active":"2024-09-12T17:23:42.152339+0000","last_became_peered":"2024-09-12T17:23:42.152339+0000","last_unstale":"2024-09-12T18:00:05.498175+0000","last_undegraded":"2024-09-12T18:00:05.498175+0000","last_fullsized":"2024-09-12T18:00:05.498175+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:42.189771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2264,"num_read_kb":2142,"num_write":477,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"261'434","reported_seq":1206,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.019406+0000","last_change":"2024-09-12T17:23:40.714992+0000","last_active":"2024-09-12T18:01:51.019406+0000","last_peered":"2024-09-12T18:01:51.019406+0000","last_clean":"2024-09-12T18:01:51.019406+0000","last_became_active":"2024-09-12T17:23:40.714708+0000","last_became_peered":"2024-09-12T17:23:40.714708+0000","last_unstale":"2024-09-12T18:01:51.019406+0000","last_undegraded":"2024-09-12T18:01:51.019406+0000","last_fullsized":"2024-09-12T18:01:51.019406+0000","mapping_epoch":23,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:24.961347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1005,"num_read_kb":34670,"num_write":1495,"num_write_kb":45714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.404145+0000","last_change":"2024-09-12T17:23:44.151662+0000","last_active":"2024-09-12T17:57:29.404145+0000","last_peered":"2024-09-12T17:57:29.404145+0000","last_clean":"2024-09-12T17:57:29.404145+0000","last_became_active":"2024-09-12T17:23:44.151392+0000","last_became_peered":"2024-09-12T17:23:44.151392+0000","last_unstale":"2024-09-12T17:57:29.404145+0000","last_undegraded":"2024-09-12T17:57:29.404145+0000","last_fullsized":"2024-09-12T17:57:29.404145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:59.377518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"261'305","reported_seq":892,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.510136+0000","last_change":"2024-09-12T17:23:46.145102+0000","last_active":"2024-09-12T18:01:49.510136+0000","last_peered":"2024-09-12T18:01:49.510136+0000","last_clean":"2024-09-12T18:01:49.510136+0000","last_became_active":"2024-09-12T17:23:46.144754+0000","last_became_peered":"2024-09-12T17:23:46.144754+0000","last_unstale":"2024-09-12T18:01:49.510136+0000","last_undegraded":"2024-09-12T18:01:49.510136+0000","last_fullsized":"2024-09-12T18:01:49.510136+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:02.014145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46816,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":500,"num_read_kb":1038,"num_write":390,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.402044+0000","last_change":"2024-09-12T17:23:48.170789+0000","last_active":"2024-09-12T17:57:34.402044+0000","last_peered":"2024-09-12T17:57:34.402044+0000","last_clean":"2024-09-12T17:57:34.402044+0000","last_became_active":"2024-09-12T17:23:48.170482+0000","last_became_peered":"2024-09-12T17:23:48.170482+0000","last_unstale":"2024-09-12T17:57:34.402044+0000","last_undegraded":"2024-09-12T17:57:34.402044+0000","last_fullsized":"2024-09-12T17:57:34.402044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:42.252206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"261'140","reported_seq":633,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.433834+0000","last_change":"2024-09-12T17:23:50.187298+0000","last_active":"2024-09-12T18:01:19.433834+0000","last_peered":"2024-09-12T18:01:19.433834+0000","last_clean":"2024-09-12T18:01:19.433834+0000","last_became_active":"2024-09-12T17:23:50.187040+0000","last_became_peered":"2024-09-12T17:23:50.187040+0000","last_unstale":"2024-09-12T18:01:19.433834+0000","last_undegraded":"2024-09-12T18:01:19.433834+0000","last_fullsized":"2024-09-12T18:01:19.433834+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:15.392439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":190,"num_write":335,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"261'1232","reported_seq":2780,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.572788+0000","last_change":"2024-09-12T17:23:42.146501+0000","last_active":"2024-09-12T18:00:04.572788+0000","last_peered":"2024-09-12T18:00:04.572788+0000","last_clean":"2024-09-12T18:00:04.572788+0000","last_became_active":"2024-09-12T17:23:42.146200+0000","last_became_peered":"2024-09-12T17:23:42.146200+0000","last_unstale":"2024-09-12T18:00:04.572788+0000","last_undegraded":"2024-09-12T18:00:04.572788+0000","last_fullsized":"2024-09-12T18:00:04.572788+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":1200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:34.628327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5862,"num_read_kb":5167,"num_write":1742,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":598,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.422110+0000","last_change":"2024-09-12T17:23:26.035893+0000","last_active":"2024-09-12T17:59:39.422110+0000","last_peered":"2024-09-12T17:59:39.422110+0000","last_clean":"2024-09-12T17:59:39.422110+0000","last_became_active":"2024-09-12T17:23:26.034872+0000","last_became_peered":"2024-09-12T17:23:26.034872+0000","last_unstale":"2024-09-12T17:59:39.422110+0000","last_undegraded":"2024-09-12T17:59:39.422110+0000","last_fullsized":"2024-09-12T17:59:39.422110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:24.539348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:24.539348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:24.539348+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:20.611359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":510,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.416227+0000","last_change":"2024-09-12T17:23:33.596450+0000","last_active":"2024-09-12T17:58:59.416227+0000","last_peered":"2024-09-12T17:58:59.416227+0000","last_clean":"2024-09-12T17:58:59.416227+0000","last_became_active":"2024-09-12T17:23:31.584884+0000","last_became_peered":"2024-09-12T17:23:31.584884+0000","last_unstale":"2024-09-12T17:58:59.416227+0000","last_undegraded":"2024-09-12T17:58:59.416227+0000","last_fullsized":"2024-09-12T17:58:59.416227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:30.448834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423087,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"261'309","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.996122+0000","last_change":"2024-09-12T17:23:40.719236+0000","last_active":"2024-09-12T18:01:50.996122+0000","last_peered":"2024-09-12T18:01:50.996122+0000","last_clean":"2024-09-12T18:01:50.996122+0000","last_became_active":"2024-09-12T17:23:40.718896+0000","last_became_peered":"2024-09-12T17:23:40.718896+0000","last_unstale":"2024-09-12T18:01:50.996122+0000","last_undegraded":"2024-09-12T18:01:50.996122+0000","last_fullsized":"2024-09-12T18:01:50.996122+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:57.032804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":13109,"num_write":1018,"num_write_kb":39939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"35'3","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.980832+0000","last_change":"2024-09-12T17:23:44.152872+0000","last_active":"2024-09-12T18:01:48.980832+0000","last_peered":"2024-09-12T18:01:48.980832+0000","last_clean":"2024-09-12T18:01:48.980832+0000","last_became_active":"2024-09-12T17:23:44.152585+0000","last_became_peered":"2024-09-12T17:23:44.152585+0000","last_unstale":"2024-09-12T18:01:48.980832+0000","last_undegraded":"2024-09-12T18:01:48.980832+0000","last_fullsized":"2024-09-12T18:01:48.980832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:27.878346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"261'717","reported_seq":1407,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.964239+0000","last_change":"2024-09-12T17:23:46.152000+0000","last_active":"2024-09-12T18:01:50.964239+0000","last_peered":"2024-09-12T18:01:50.964239+0000","last_clean":"2024-09-12T18:01:50.964239+0000","last_became_active":"2024-09-12T17:23:46.151673+0000","last_became_peered":"2024-09-12T17:23:46.151673+0000","last_unstale":"2024-09-12T18:01:50.964239+0000","last_undegraded":"2024-09-12T18:01:50.964239+0000","last_fullsized":"2024-09-12T18:01:50.964239+0000","mapping_epoch":29,"log_start":"261'700","ondisk_log_start":"261'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":700,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:23.689449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145502,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1428,"num_read_kb":3259,"num_write":1354,"num_write_kb":1206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.539616+0000","last_change":"2024-09-12T17:23:48.170416+0000","last_active":"2024-09-12T17:58:29.539616+0000","last_peered":"2024-09-12T17:58:29.539616+0000","last_clean":"2024-09-12T17:58:29.539616+0000","last_became_active":"2024-09-12T17:23:48.170153+0000","last_became_peered":"2024-09-12T17:23:48.170153+0000","last_unstale":"2024-09-12T17:58:29.539616+0000","last_undegraded":"2024-09-12T17:58:29.539616+0000","last_fullsized":"2024-09-12T17:58:29.539616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:47.543479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"261'224","reported_seq":941,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.565834+0000","last_change":"2024-09-12T17:23:50.188844+0000","last_active":"2024-09-12T18:00:18.565834+0000","last_peered":"2024-09-12T18:00:18.565834+0000","last_clean":"2024-09-12T18:00:18.565834+0000","last_became_active":"2024-09-12T17:23:50.188552+0000","last_became_peered":"2024-09-12T17:23:50.188552+0000","last_unstale":"2024-09-12T18:00:18.565834+0000","last_undegraded":"2024-09-12T18:00:18.565834+0000","last_fullsized":"2024-09-12T18:00:18.565834+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:48.789056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":580,"num_write":503,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"261'388","reported_seq":1826,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.139142+0000","last_change":"2024-09-12T17:23:42.147326+0000","last_active":"2024-09-12T18:00:03.139142+0000","last_peered":"2024-09-12T18:00:03.139142+0000","last_clean":"2024-09-12T18:00:03.139142+0000","last_became_active":"2024-09-12T17:23:42.147045+0000","last_became_peered":"2024-09-12T17:23:42.147045+0000","last_unstale":"2024-09-12T18:00:03.139142+0000","last_undegraded":"2024-09-12T18:00:03.139142+0000","last_fullsized":"2024-09-12T18:00:03.139142+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:25.431740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2080,"num_read_kb":1972,"num_write":429,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":507,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.422739+0000","last_change":"2024-09-12T17:23:33.971250+0000","last_active":"2024-09-12T17:59:44.422739+0000","last_peered":"2024-09-12T17:59:44.422739+0000","last_clean":"2024-09-12T17:59:44.422739+0000","last_became_active":"2024-09-12T17:23:31.588699+0000","last_became_peered":"2024-09-12T17:23:31.588699+0000","last_unstale":"2024-09-12T17:59:44.422739+0000","last_undegraded":"2024-09-12T17:59:44.422739+0000","last_fullsized":"2024-09-12T17:59:44.422739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:46.725886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052181899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"261'337","reported_seq":1003,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.053531+0000","last_change":"2024-09-12T17:23:40.713799+0000","last_active":"2024-09-12T18:01:51.053531+0000","last_peered":"2024-09-12T18:01:51.053531+0000","last_clean":"2024-09-12T18:01:51.053531+0000","last_became_active":"2024-09-12T17:23:40.713199+0000","last_became_peered":"2024-09-12T17:23:40.713199+0000","last_unstale":"2024-09-12T18:01:51.053531+0000","last_undegraded":"2024-09-12T18:01:51.053531+0000","last_fullsized":"2024-09-12T18:01:51.053531+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:26.433676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":39290,"num_write":1124,"num_write_kb":55994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.411614+0000","last_change":"2024-09-12T17:23:44.150487+0000","last_active":"2024-09-12T17:58:24.411614+0000","last_peered":"2024-09-12T17:58:24.411614+0000","last_clean":"2024-09-12T17:58:24.411614+0000","last_became_active":"2024-09-12T17:23:44.149400+0000","last_became_peered":"2024-09-12T17:23:44.149400+0000","last_unstale":"2024-09-12T17:58:24.411614+0000","last_undegraded":"2024-09-12T17:58:24.411614+0000","last_fullsized":"2024-09-12T17:58:24.411614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:43.627464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"261'1312","reported_seq":2699,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.919043+0000","last_change":"2024-09-12T17:23:46.145651+0000","last_active":"2024-09-12T18:01:50.919043+0000","last_peered":"2024-09-12T18:01:50.919043+0000","last_clean":"2024-09-12T18:01:50.919043+0000","last_became_active":"2024-09-12T17:23:46.145354+0000","last_became_peered":"2024-09-12T17:23:46.145354+0000","last_unstale":"2024-09-12T18:01:50.919043+0000","last_undegraded":"2024-09-12T18:01:50.919043+0000","last_fullsized":"2024-09-12T18:01:50.919043+0000","mapping_epoch":29,"log_start":"261'1300","ondisk_log_start":"261'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":1300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:28.485902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139395,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2079,"num_read_kb":4017,"num_write":1172,"num_write_kb":1007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:24.420299+0000","last_change":"2024-09-12T17:23:48.171635+0000","last_active":"2024-09-12T17:59:24.420299+0000","last_peered":"2024-09-12T17:59:24.420299+0000","last_clean":"2024-09-12T17:59:24.420299+0000","last_became_active":"2024-09-12T17:23:48.171355+0000","last_became_peered":"2024-09-12T17:23:48.171355+0000","last_unstale":"2024-09-12T17:59:24.420299+0000","last_undegraded":"2024-09-12T17:59:24.420299+0000","last_fullsized":"2024-09-12T17:59:24.420299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:15.550883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"261'108","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.915226+0000","last_change":"2024-09-12T17:23:50.639398+0000","last_active":"2024-09-12T17:59:59.915226+0000","last_peered":"2024-09-12T17:59:59.915226+0000","last_clean":"2024-09-12T17:59:59.915226+0000","last_became_active":"2024-09-12T17:23:50.639053+0000","last_became_peered":"2024-09-12T17:23:50.639053+0000","last_unstale":"2024-09-12T17:59:59.915226+0000","last_undegraded":"2024-09-12T17:59:59.915226+0000","last_fullsized":"2024-09-12T17:59:59.915226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:38.696802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":162,"num_write":260,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"261'909","reported_seq":2637,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559947+0000","last_change":"2024-09-12T17:23:42.146153+0000","last_active":"2024-09-12T18:00:18.559947+0000","last_peered":"2024-09-12T18:00:18.559947+0000","last_clean":"2024-09-12T18:00:18.559947+0000","last_became_active":"2024-09-12T17:23:42.145049+0000","last_became_peered":"2024-09-12T17:23:42.145049+0000","last_unstale":"2024-09-12T18:00:18.559947+0000","last_undegraded":"2024-09-12T18:00:18.559947+0000","last_fullsized":"2024-09-12T18:00:18.559947+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":800,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:41.855754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4463,"num_read_kb":4014,"num_write":1227,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":511,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:58.616407+0000","last_change":"2024-09-12T17:23:33.835818+0000","last_active":"2024-09-12T17:58:58.616407+0000","last_peered":"2024-09-12T17:58:58.616407+0000","last_clean":"2024-09-12T17:58:58.616407+0000","last_became_active":"2024-09-12T17:23:31.584259+0000","last_became_peered":"2024-09-12T17:23:31.584259+0000","last_unstale":"2024-09-12T17:58:58.616407+0000","last_undegraded":"2024-09-12T17:58:58.616407+0000","last_fullsized":"2024-09-12T17:58:58.616407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:33.916339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045870900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"261'328","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.002991+0000","last_change":"2024-09-12T17:23:40.712522+0000","last_active":"2024-09-12T18:01:51.002991+0000","last_peered":"2024-09-12T18:01:51.002991+0000","last_clean":"2024-09-12T18:01:51.002991+0000","last_became_active":"2024-09-12T17:23:40.712276+0000","last_became_peered":"2024-09-12T17:23:40.712276+0000","last_unstale":"2024-09-12T18:01:51.002991+0000","last_undegraded":"2024-09-12T18:01:51.002991+0000","last_fullsized":"2024-09-12T18:01:51.002991+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:20.254346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":8922,"num_write":1082,"num_write_kb":17941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.611618+0000","last_change":"2024-09-12T17:23:44.151286+0000","last_active":"2024-09-12T17:58:23.611618+0000","last_peered":"2024-09-12T17:58:23.611618+0000","last_clean":"2024-09-12T17:58:23.611618+0000","last_became_active":"2024-09-12T17:23:44.151006+0000","last_became_peered":"2024-09-12T17:23:44.151006+0000","last_unstale":"2024-09-12T17:58:23.611618+0000","last_undegraded":"2024-09-12T17:58:23.611618+0000","last_fullsized":"2024-09-12T17:58:23.611618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:17.405776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"261'194","reported_seq":1181,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.322144+0000","last_change":"2024-09-12T17:23:46.242242+0000","last_active":"2024-09-12T18:01:38.322144+0000","last_peered":"2024-09-12T18:01:38.322144+0000","last_clean":"2024-09-12T18:01:38.322144+0000","last_became_active":"2024-09-12T17:23:46.241733+0000","last_became_peered":"2024-09-12T17:23:46.241733+0000","last_unstale":"2024-09-12T18:01:38.322144+0000","last_undegraded":"2024-09-12T18:01:38.322144+0000","last_fullsized":"2024-09-12T18:01:38.322144+0000","mapping_epoch":29,"log_start":"258'100","ondisk_log_start":"258'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:35.528461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":152,"num_read_kb":143,"num_write":117,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.545833+0000","last_change":"2024-09-12T17:23:48.168199+0000","last_active":"2024-09-12T17:59:14.545833+0000","last_peered":"2024-09-12T17:59:14.545833+0000","last_clean":"2024-09-12T17:59:14.545833+0000","last_became_active":"2024-09-12T17:23:48.167920+0000","last_became_peered":"2024-09-12T17:23:48.167920+0000","last_unstale":"2024-09-12T17:59:14.545833+0000","last_undegraded":"2024-09-12T17:59:14.545833+0000","last_fullsized":"2024-09-12T17:59:14.545833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:52.699030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"261'262","reported_seq":858,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.252281+0000","last_change":"2024-09-12T17:23:50.177810+0000","last_active":"2024-09-12T18:00:18.252281+0000","last_peered":"2024-09-12T18:00:18.252281+0000","last_clean":"2024-09-12T18:00:18.252281+0000","last_became_active":"2024-09-12T17:23:50.177293+0000","last_became_peered":"2024-09-12T17:23:50.177293+0000","last_unstale":"2024-09-12T18:00:18.252281+0000","last_undegraded":"2024-09-12T18:00:18.252281+0000","last_fullsized":"2024-09-12T18:00:18.252281+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:35.764330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":569,"num_write":571,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"261'440","reported_seq":2030,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.397530+0000","last_change":"2024-09-12T17:23:42.136391+0000","last_active":"2024-09-12T18:01:41.397530+0000","last_peered":"2024-09-12T18:01:41.397530+0000","last_clean":"2024-09-12T18:01:41.397530+0000","last_became_active":"2024-09-12T17:23:42.136083+0000","last_became_peered":"2024-09-12T17:23:42.136083+0000","last_unstale":"2024-09-12T18:01:41.397530+0000","last_undegraded":"2024-09-12T18:01:41.397530+0000","last_fullsized":"2024-09-12T18:01:41.397530+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:29.889920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2433,"num_read_kb":2304,"num_write":511,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":511,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.416186+0000","last_change":"2024-09-12T17:23:33.596992+0000","last_active":"2024-09-12T17:58:59.416186+0000","last_peered":"2024-09-12T17:58:59.416186+0000","last_clean":"2024-09-12T17:58:59.416186+0000","last_became_active":"2024-09-12T17:23:31.588612+0000","last_became_peered":"2024-09-12T17:23:31.588612+0000","last_unstale":"2024-09-12T17:58:59.416186+0000","last_undegraded":"2024-09-12T17:58:59.416186+0000","last_fullsized":"2024-09-12T17:58:59.416186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:20.500808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095838300000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"261'349","reported_seq":1065,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.019833+0000","last_change":"2024-09-12T17:23:40.717039+0000","last_active":"2024-09-12T18:01:51.019833+0000","last_peered":"2024-09-12T18:01:51.019833+0000","last_clean":"2024-09-12T18:01:51.019833+0000","last_became_active":"2024-09-12T17:23:40.716786+0000","last_became_peered":"2024-09-12T17:23:40.716786+0000","last_unstale":"2024-09-12T18:01:51.019833+0000","last_undegraded":"2024-09-12T18:01:51.019833+0000","last_fullsized":"2024-09-12T18:01:51.019833+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:37.161545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287987,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":555,"num_read_kb":40133,"num_write":1081,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.545850+0000","last_change":"2024-09-12T17:23:44.151221+0000","last_active":"2024-09-12T17:59:14.545850+0000","last_peered":"2024-09-12T17:59:14.545850+0000","last_clean":"2024-09-12T17:59:14.545850+0000","last_became_active":"2024-09-12T17:23:44.150912+0000","last_became_peered":"2024-09-12T17:23:44.150912+0000","last_unstale":"2024-09-12T17:59:14.545850+0000","last_undegraded":"2024-09-12T17:59:14.545850+0000","last_fullsized":"2024-09-12T17:59:14.545850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:09.750577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"261'109","reported_seq":634,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:38.427984+0000","last_change":"2024-09-12T17:23:46.155872+0000","last_active":"2024-09-12T18:00:38.427984+0000","last_peered":"2024-09-12T18:00:38.427984+0000","last_clean":"2024-09-12T18:00:38.427984+0000","last_became_active":"2024-09-12T17:23:46.155516+0000","last_became_peered":"2024-09-12T17:23:46.155516+0000","last_unstale":"2024-09-12T18:00:38.427984+0000","last_undegraded":"2024-09-12T18:00:38.427984+0000","last_fullsized":"2024-09-12T18:00:38.427984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:35.167613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":92,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.409748+0000","last_change":"2024-09-12T17:23:48.171371+0000","last_active":"2024-09-12T17:58:29.409748+0000","last_peered":"2024-09-12T17:58:29.409748+0000","last_clean":"2024-09-12T17:58:29.409748+0000","last_became_active":"2024-09-12T17:23:48.170462+0000","last_became_peered":"2024-09-12T17:23:48.170462+0000","last_unstale":"2024-09-12T17:58:29.409748+0000","last_undegraded":"2024-09-12T17:58:29.409748+0000","last_fullsized":"2024-09-12T17:58:29.409748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:11.276085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":655,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.159077+0000","last_change":"2024-09-12T17:23:50.186802+0000","last_active":"2024-09-12T18:00:18.159077+0000","last_peered":"2024-09-12T18:00:18.159077+0000","last_clean":"2024-09-12T18:00:18.159077+0000","last_became_active":"2024-09-12T17:23:50.186526+0000","last_became_peered":"2024-09-12T17:23:50.186526+0000","last_unstale":"2024-09-12T18:00:18.159077+0000","last_undegraded":"2024-09-12T18:00:18.159077+0000","last_fullsized":"2024-09-12T18:00:18.159077+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:15.982689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":247,"num_write":303,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"261'540","reported_seq":2255,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.146276+0000","last_change":"2024-09-12T17:23:42.151997+0000","last_active":"2024-09-12T18:00:18.146276+0000","last_peered":"2024-09-12T18:00:18.146276+0000","last_clean":"2024-09-12T18:00:18.146276+0000","last_became_active":"2024-09-12T17:23:42.151735+0000","last_became_peered":"2024-09-12T17:23:42.151735+0000","last_unstale":"2024-09-12T18:00:18.146276+0000","last_undegraded":"2024-09-12T18:00:18.146276+0000","last_fullsized":"2024-09-12T18:00:18.146276+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:29.033253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2982,"num_read_kb":2809,"num_write":660,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"261'319","reported_seq":908,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.949271+0000","last_change":"2024-09-12T17:23:40.712919+0000","last_active":"2024-09-12T18:01:50.949271+0000","last_peered":"2024-09-12T18:01:50.949271+0000","last_clean":"2024-09-12T18:01:50.949271+0000","last_became_active":"2024-09-12T17:23:40.712386+0000","last_became_peered":"2024-09-12T17:23:40.712386+0000","last_unstale":"2024-09-12T18:01:50.949271+0000","last_undegraded":"2024-09-12T18:01:50.949271+0000","last_fullsized":"2024-09-12T18:01:50.949271+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:54.407762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":415,"num_read_kb":6504,"num_write":991,"num_write_kb":34893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":513,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.415656+0000","last_change":"2024-09-12T17:23:33.592955+0000","last_active":"2024-09-12T17:58:59.415656+0000","last_peered":"2024-09-12T17:58:59.415656+0000","last_clean":"2024-09-12T17:58:59.415656+0000","last_became_active":"2024-09-12T17:23:31.681209+0000","last_became_peered":"2024-09-12T17:23:31.681209+0000","last_unstale":"2024-09-12T17:58:59.415656+0000","last_undegraded":"2024-09-12T17:58:59.415656+0000","last_fullsized":"2024-09-12T17:58:59.415656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:00.576073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056110600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.545208+0000","last_change":"2024-09-12T17:23:44.148393+0000","last_active":"2024-09-12T17:59:09.545208+0000","last_peered":"2024-09-12T17:59:09.545208+0000","last_clean":"2024-09-12T17:59:09.545208+0000","last_became_active":"2024-09-12T17:23:44.148035+0000","last_became_peered":"2024-09-12T17:23:44.148035+0000","last_unstale":"2024-09-12T17:59:09.545208+0000","last_undegraded":"2024-09-12T17:59:09.545208+0000","last_fullsized":"2024-09-12T17:59:09.545208+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:03.387749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"261'563","reported_seq":1207,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.878780+0000","last_change":"2024-09-12T17:23:46.152284+0000","last_active":"2024-09-12T18:01:50.878780+0000","last_peered":"2024-09-12T18:01:50.878780+0000","last_clean":"2024-09-12T18:01:50.878780+0000","last_became_active":"2024-09-12T17:23:46.151649+0000","last_became_peered":"2024-09-12T17:23:46.151649+0000","last_unstale":"2024-09-12T18:01:50.878780+0000","last_undegraded":"2024-09-12T18:01:50.878780+0000","last_fullsized":"2024-09-12T18:01:50.878780+0000","mapping_epoch":29,"log_start":"261'500","ondisk_log_start":"261'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91231,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1527,"num_read_kb":2702,"num_write":1958,"num_write_kb":1787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418523+0000","last_change":"2024-09-12T17:23:48.166489+0000","last_active":"2024-09-12T17:59:14.418523+0000","last_peered":"2024-09-12T17:59:14.418523+0000","last_clean":"2024-09-12T17:59:14.418523+0000","last_became_active":"2024-09-12T17:23:48.166196+0000","last_became_peered":"2024-09-12T17:23:48.166196+0000","last_unstale":"2024-09-12T17:59:14.418523+0000","last_undegraded":"2024-09-12T17:59:14.418523+0000","last_fullsized":"2024-09-12T17:59:14.418523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:02.318935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"261'221","reported_seq":721,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.429767+0000","last_change":"2024-09-12T17:23:50.640504+0000","last_active":"2024-09-12T17:59:58.429767+0000","last_peered":"2024-09-12T17:59:58.429767+0000","last_clean":"2024-09-12T17:59:58.429767+0000","last_became_active":"2024-09-12T17:23:50.640185+0000","last_became_peered":"2024-09-12T17:23:50.640185+0000","last_unstale":"2024-09-12T17:59:58.429767+0000","last_undegraded":"2024-09-12T17:59:58.429767+0000","last_fullsized":"2024-09-12T17:59:58.429767+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:20.014900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":243,"num_write":513,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"261'509","reported_seq":2065,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.462615+0000","last_change":"2024-09-12T17:23:42.148853+0000","last_active":"2024-09-12T18:00:02.462615+0000","last_peered":"2024-09-12T18:00:02.462615+0000","last_clean":"2024-09-12T18:00:02.462615+0000","last_became_active":"2024-09-12T17:23:42.148578+0000","last_became_peered":"2024-09-12T17:23:42.148578+0000","last_unstale":"2024-09-12T18:00:02.462615+0000","last_undegraded":"2024-09-12T18:00:02.462615+0000","last_fullsized":"2024-09-12T18:00:02.462615+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:05.365806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2709,"num_read_kb":2501,"num_write":646,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"261'353","reported_seq":975,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.030721+0000","last_change":"2024-09-12T17:23:40.711077+0000","last_active":"2024-09-12T18:01:51.030721+0000","last_peered":"2024-09-12T18:01:51.030721+0000","last_clean":"2024-09-12T18:01:51.030721+0000","last_became_active":"2024-09-12T17:23:40.710780+0000","last_became_peered":"2024-09-12T17:23:40.710780+0000","last_unstale":"2024-09-12T18:01:51.030721+0000","last_undegraded":"2024-09-12T18:01:51.030721+0000","last_fullsized":"2024-09-12T18:01:51.030721+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:38.403382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":525,"num_write":1227,"num_write_kb":43788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":506,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.418269+0000","last_change":"2024-09-12T17:23:33.971206+0000","last_active":"2024-09-12T17:59:09.418269+0000","last_peered":"2024-09-12T17:59:09.418269+0000","last_clean":"2024-09-12T17:59:09.418269+0000","last_became_active":"2024-09-12T17:23:31.681155+0000","last_became_peered":"2024-09-12T17:23:31.681155+0000","last_unstale":"2024-09-12T17:59:09.418269+0000","last_undegraded":"2024-09-12T17:59:09.418269+0000","last_fullsized":"2024-09-12T17:59:09.418269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:20.293962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048562399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415369+0000","last_change":"2024-09-12T17:23:44.147684+0000","last_active":"2024-09-12T17:59:09.415369+0000","last_peered":"2024-09-12T17:59:09.415369+0000","last_clean":"2024-09-12T17:59:09.415369+0000","last_became_active":"2024-09-12T17:23:44.147347+0000","last_became_peered":"2024-09-12T17:23:44.147347+0000","last_unstale":"2024-09-12T17:59:09.415369+0000","last_undegraded":"2024-09-12T17:59:09.415369+0000","last_fullsized":"2024-09-12T17:59:09.415369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:45.660164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"261'149","reported_seq":697,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:23.414940+0000","last_change":"2024-09-12T17:23:46.241508+0000","last_active":"2024-09-12T18:00:23.414940+0000","last_peered":"2024-09-12T18:00:23.414940+0000","last_clean":"2024-09-12T18:00:23.414940+0000","last_became_active":"2024-09-12T17:23:46.241046+0000","last_became_peered":"2024-09-12T17:23:46.241046+0000","last_unstale":"2024-09-12T18:00:23.414940+0000","last_undegraded":"2024-09-12T18:00:23.414940+0000","last_fullsized":"2024-09-12T18:00:23.414940+0000","mapping_epoch":29,"log_start":"258'100","ondisk_log_start":"258'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:42.691500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":154,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"261'794","reported_seq":2344,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.064925+0000","last_change":"2024-09-12T17:23:48.173674+0000","last_active":"2024-09-12T18:01:51.064925+0000","last_peered":"2024-09-12T18:01:51.064925+0000","last_clean":"2024-09-12T18:01:51.064925+0000","last_became_active":"2024-09-12T17:23:48.173351+0000","last_became_peered":"2024-09-12T17:23:48.173351+0000","last_unstale":"2024-09-12T18:01:51.064925+0000","last_undegraded":"2024-09-12T18:01:51.064925+0000","last_fullsized":"2024-09-12T18:01:51.064925+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:23.841940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"261'101","reported_seq":588,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.422953+0000","last_change":"2024-09-12T17:23:50.639372+0000","last_active":"2024-09-12T17:59:58.422953+0000","last_peered":"2024-09-12T17:59:58.422953+0000","last_clean":"2024-09-12T17:59:58.422953+0000","last_became_active":"2024-09-12T17:23:50.639054+0000","last_became_peered":"2024-09-12T17:23:50.639054+0000","last_unstale":"2024-09-12T17:59:58.422953+0000","last_undegraded":"2024-09-12T17:59:58.422953+0000","last_fullsized":"2024-09-12T17:59:58.422953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:27.121755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":220,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"261'494","reported_seq":2015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559802+0000","last_change":"2024-09-12T17:23:42.148855+0000","last_active":"2024-09-12T18:00:18.559802+0000","last_peered":"2024-09-12T18:00:18.559802+0000","last_clean":"2024-09-12T18:00:18.559802+0000","last_became_active":"2024-09-12T17:23:42.148523+0000","last_became_peered":"2024-09-12T17:23:42.148523+0000","last_unstale":"2024-09-12T18:00:18.559802+0000","last_undegraded":"2024-09-12T18:00:18.559802+0000","last_fullsized":"2024-09-12T18:00:18.559802+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:44.314747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2488,"num_read_kb":2312,"num_write":602,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"261'374","reported_seq":1090,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.040254+0000","last_change":"2024-09-12T17:23:40.709406+0000","last_active":"2024-09-12T18:01:51.040254+0000","last_peered":"2024-09-12T18:01:51.040254+0000","last_clean":"2024-09-12T18:01:51.040254+0000","last_became_active":"2024-09-12T17:23:40.709077+0000","last_became_peered":"2024-09-12T17:23:40.709077+0000","last_unstale":"2024-09-12T18:01:51.040254+0000","last_undegraded":"2024-09-12T18:01:51.040254+0000","last_fullsized":"2024-09-12T18:01:51.040254+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:24.640342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8154045,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":687,"num_read_kb":135818,"num_write":1222,"num_write_kb":56746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":512,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.409415+0000","last_change":"2024-09-12T17:23:33.592959+0000","last_active":"2024-09-12T17:58:14.409415+0000","last_peered":"2024-09-12T17:58:14.409415+0000","last_clean":"2024-09-12T17:58:14.409415+0000","last_became_active":"2024-09-12T17:23:31.588526+0000","last_became_peered":"2024-09-12T17:23:31.588526+0000","last_unstale":"2024-09-12T17:58:14.409415+0000","last_undegraded":"2024-09-12T17:58:14.409415+0000","last_fullsized":"2024-09-12T17:58:14.409415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:32.240058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055923099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417985+0000","last_change":"2024-09-12T17:23:44.148290+0000","last_active":"2024-09-12T17:59:09.417985+0000","last_peered":"2024-09-12T17:59:09.417985+0000","last_clean":"2024-09-12T17:59:09.417985+0000","last_became_active":"2024-09-12T17:23:44.147594+0000","last_became_peered":"2024-09-12T17:23:44.147594+0000","last_unstale":"2024-09-12T17:59:09.417985+0000","last_undegraded":"2024-09-12T17:59:09.417985+0000","last_fullsized":"2024-09-12T17:59:09.417985+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:51.406975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"261'97","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.150898+0000","last_change":"2024-09-12T17:23:46.151701+0000","last_active":"2024-09-12T18:00:18.150898+0000","last_peered":"2024-09-12T18:00:18.150898+0000","last_clean":"2024-09-12T18:00:18.150898+0000","last_became_active":"2024-09-12T17:23:46.151335+0000","last_became_peered":"2024-09-12T17:23:46.151335+0000","last_unstale":"2024-09-12T18:00:18.150898+0000","last_undegraded":"2024-09-12T18:00:18.150898+0000","last_fullsized":"2024-09-12T18:00:18.150898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:23.162677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"261'807","reported_seq":2587,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.419707+0000","last_change":"2024-09-12T17:23:48.168044+0000","last_active":"2024-09-12T18:01:49.419707+0000","last_peered":"2024-09-12T18:01:49.419707+0000","last_clean":"2024-09-12T18:01:49.419707+0000","last_became_active":"2024-09-12T17:23:48.167739+0000","last_became_peered":"2024-09-12T17:23:48.167739+0000","last_unstale":"2024-09-12T18:01:49.419707+0000","last_undegraded":"2024-09-12T18:01:49.419707+0000","last_fullsized":"2024-09-12T18:01:49.419707+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:25.436138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"261'311","reported_seq":829,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.346118+0000","last_change":"2024-09-12T17:23:50.179480+0000","last_active":"2024-09-12T18:01:41.346118+0000","last_peered":"2024-09-12T18:01:41.346118+0000","last_clean":"2024-09-12T18:01:41.346118+0000","last_became_active":"2024-09-12T17:23:50.179127+0000","last_became_peered":"2024-09-12T17:23:50.179127+0000","last_unstale":"2024-09-12T18:01:41.346118+0000","last_undegraded":"2024-09-12T18:01:41.346118+0000","last_fullsized":"2024-09-12T18:01:41.346118+0000","mapping_epoch":33,"log_start":"261'300","ondisk_log_start":"261'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:11.353710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":442,"num_write":705,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"261'1030","reported_seq":2757,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.227573+0000","last_change":"2024-09-12T17:23:42.145784+0000","last_active":"2024-09-12T18:00:05.227573+0000","last_peered":"2024-09-12T18:00:05.227573+0000","last_clean":"2024-09-12T18:00:05.227573+0000","last_became_active":"2024-09-12T17:23:42.145139+0000","last_became_peered":"2024-09-12T17:23:42.145139+0000","last_unstale":"2024-09-12T18:00:05.227573+0000","last_undegraded":"2024-09-12T18:00:05.227573+0000","last_fullsized":"2024-09-12T18:00:05.227573+0000","mapping_epoch":25,"log_start":"261'1000","ondisk_log_start":"261'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1000,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:16.782381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4954,"num_read_kb":4437,"num_write":1455,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"261'374","reported_seq":1021,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.026252+0000","last_change":"2024-09-12T17:23:40.713302+0000","last_active":"2024-09-12T18:01:51.026252+0000","last_peered":"2024-09-12T18:01:51.026252+0000","last_clean":"2024-09-12T18:01:51.026252+0000","last_became_active":"2024-09-12T17:23:40.712974+0000","last_became_peered":"2024-09-12T17:23:40.712974+0000","last_unstale":"2024-09-12T18:01:51.026252+0000","last_undegraded":"2024-09-12T18:01:51.026252+0000","last_fullsized":"2024-09-12T18:01:51.026252+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:22.541324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048959,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":103148,"num_write":1174,"num_write_kb":43429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":507,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.407867+0000","last_change":"2024-09-12T17:23:33.971199+0000","last_active":"2024-09-12T17:58:14.407867+0000","last_peered":"2024-09-12T17:58:14.407867+0000","last_clean":"2024-09-12T17:58:14.407867+0000","last_became_active":"2024-09-12T17:23:31.588266+0000","last_became_peered":"2024-09-12T17:23:31.588266+0000","last_unstale":"2024-09-12T17:58:14.407867+0000","last_undegraded":"2024-09-12T17:58:14.407867+0000","last_fullsized":"2024-09-12T17:58:14.407867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:30.571145+0000","last_clean_scrub_stamp":"2024-09-12T17:23:30.571145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:05.248877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051630700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.421688+0000","last_change":"2024-09-12T17:23:44.149935+0000","last_active":"2024-09-12T17:59:48.421688+0000","last_peered":"2024-09-12T17:59:48.421688+0000","last_clean":"2024-09-12T17:59:48.421688+0000","last_became_active":"2024-09-12T17:23:44.149649+0000","last_became_peered":"2024-09-12T17:23:44.149649+0000","last_unstale":"2024-09-12T17:59:48.421688+0000","last_undegraded":"2024-09-12T17:59:48.421688+0000","last_fullsized":"2024-09-12T17:59:48.421688+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:06.362964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"261'694","reported_seq":1394,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.010604+0000","last_change":"2024-09-12T17:23:46.242153+0000","last_active":"2024-09-12T18:01:51.010604+0000","last_peered":"2024-09-12T18:01:51.010604+0000","last_clean":"2024-09-12T18:01:51.010604+0000","last_became_active":"2024-09-12T17:23:46.241681+0000","last_became_peered":"2024-09-12T17:23:46.241681+0000","last_unstale":"2024-09-12T18:01:51.010604+0000","last_undegraded":"2024-09-12T18:01:51.010604+0000","last_fullsized":"2024-09-12T18:01:51.010604+0000","mapping_epoch":29,"log_start":"261'600","ondisk_log_start":"261'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:06.488679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155444,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1250,"num_read_kb":2999,"num_write":1014,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:13.416822+0000","last_change":"2024-09-12T17:23:48.170996+0000","last_active":"2024-09-12T17:59:13.416822+0000","last_peered":"2024-09-12T17:59:13.416822+0000","last_clean":"2024-09-12T17:59:13.416822+0000","last_became_active":"2024-09-12T17:23:48.170687+0000","last_became_peered":"2024-09-12T17:23:48.170687+0000","last_unstale":"2024-09-12T17:59:13.416822+0000","last_undegraded":"2024-09-12T17:59:13.416822+0000","last_fullsized":"2024-09-12T17:59:13.416822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:56.021234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"261'136","reported_seq":667,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.547879+0000","last_change":"2024-09-12T17:23:50.189525+0000","last_active":"2024-09-12T18:00:18.547879+0000","last_peered":"2024-09-12T18:00:18.547879+0000","last_clean":"2024-09-12T18:00:18.547879+0000","last_became_active":"2024-09-12T17:23:50.188042+0000","last_became_peered":"2024-09-12T17:23:50.188042+0000","last_unstale":"2024-09-12T18:00:18.547879+0000","last_undegraded":"2024-09-12T18:00:18.547879+0000","last_fullsized":"2024-09-12T18:00:18.547879+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:12.246421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":351,"num_read_kb":302,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"261'129","reported_seq":670,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.665733+0000","last_change":"2024-09-12T17:23:50.190175+0000","last_active":"2024-09-12T18:00:18.665733+0000","last_peered":"2024-09-12T18:00:18.665733+0000","last_clean":"2024-09-12T18:00:18.665733+0000","last_became_active":"2024-09-12T17:23:50.189955+0000","last_became_peered":"2024-09-12T17:23:50.189955+0000","last_unstale":"2024-09-12T18:00:18.665733+0000","last_undegraded":"2024-09-12T18:00:18.665733+0000","last_fullsized":"2024-09-12T18:00:18.665733+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:05.002727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":232,"num_write":318,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"261'329","reported_seq":1796,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559462+0000","last_change":"2024-09-12T17:23:42.139182+0000","last_active":"2024-09-12T18:00:18.559462+0000","last_peered":"2024-09-12T18:00:18.559462+0000","last_clean":"2024-09-12T18:00:18.559462+0000","last_became_active":"2024-09-12T17:23:42.138899+0000","last_became_peered":"2024-09-12T17:23:42.138899+0000","last_unstale":"2024-09-12T18:00:18.559462+0000","last_undegraded":"2024-09-12T18:00:18.559462+0000","last_fullsized":"2024-09-12T18:00:18.559462+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:52.392138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1873,"num_read_kb":1826,"num_write":350,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"261'368","reported_seq":1001,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.037683+0000","last_change":"2024-09-12T17:23:40.709618+0000","last_active":"2024-09-12T18:01:51.037683+0000","last_peered":"2024-09-12T18:01:51.037683+0000","last_clean":"2024-09-12T18:01:51.037683+0000","last_became_active":"2024-09-12T17:23:40.709219+0000","last_became_peered":"2024-09-12T17:23:40.709219+0000","last_unstale":"2024-09-12T18:01:51.037683+0000","last_undegraded":"2024-09-12T18:01:51.037683+0000","last_fullsized":"2024-09-12T18:01:51.037683+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:01.388035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":4301,"num_write":1267,"num_write_kb":9304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.413627+0000","last_change":"2024-09-12T17:23:44.151482+0000","last_active":"2024-09-12T17:58:44.413627+0000","last_peered":"2024-09-12T17:58:44.413627+0000","last_clean":"2024-09-12T17:58:44.413627+0000","last_became_active":"2024-09-12T17:23:44.151175+0000","last_became_peered":"2024-09-12T17:23:44.151175+0000","last_unstale":"2024-09-12T17:58:44.413627+0000","last_undegraded":"2024-09-12T17:58:44.413627+0000","last_fullsized":"2024-09-12T17:58:44.413627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:07.283799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"261'276","reported_seq":836,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.711803+0000","last_change":"2024-09-12T17:23:46.151842+0000","last_active":"2024-09-12T18:01:49.711803+0000","last_peered":"2024-09-12T18:01:49.711803+0000","last_clean":"2024-09-12T18:01:49.711803+0000","last_became_active":"2024-09-12T17:23:46.150505+0000","last_became_peered":"2024-09-12T17:23:46.150505+0000","last_unstale":"2024-09-12T18:01:49.711803+0000","last_undegraded":"2024-09-12T18:01:49.711803+0000","last_fullsized":"2024-09-12T18:01:49.711803+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:29.365545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80053,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":479,"num_read_kb":1186,"num_write":396,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.413394+0000","last_change":"2024-09-12T17:23:48.168196+0000","last_active":"2024-09-12T17:58:48.413394+0000","last_peered":"2024-09-12T17:58:48.413394+0000","last_clean":"2024-09-12T17:58:48.413394+0000","last_became_active":"2024-09-12T17:23:48.167911+0000","last_became_peered":"2024-09-12T17:23:48.167911+0000","last_unstale":"2024-09-12T17:58:48.413394+0000","last_undegraded":"2024-09-12T17:58:48.413394+0000","last_fullsized":"2024-09-12T17:58:48.413394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:27.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"261'95","reported_seq":584,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.804808+0000","last_change":"2024-09-12T17:23:50.183763+0000","last_active":"2024-09-12T17:59:38.804808+0000","last_peered":"2024-09-12T17:59:38.804808+0000","last_clean":"2024-09-12T17:59:38.804808+0000","last_became_active":"2024-09-12T17:23:50.183400+0000","last_became_peered":"2024-09-12T17:23:50.183400+0000","last_unstale":"2024-09-12T17:59:38.804808+0000","last_undegraded":"2024-09-12T17:59:38.804808+0000","last_fullsized":"2024-09-12T17:59:38.804808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:30.231346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":128,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"261'478","reported_seq":1884,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.785644+0000","last_change":"2024-09-12T17:23:42.138814+0000","last_active":"2024-09-12T18:00:05.785644+0000","last_peered":"2024-09-12T18:00:05.785644+0000","last_clean":"2024-09-12T18:00:05.785644+0000","last_became_active":"2024-09-12T17:23:42.137988+0000","last_became_peered":"2024-09-12T17:23:42.137988+0000","last_unstale":"2024-09-12T18:00:05.785644+0000","last_undegraded":"2024-09-12T18:00:05.785644+0000","last_fullsized":"2024-09-12T18:00:05.785644+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:34.256530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2384,"num_read_kb":2190,"num_write":595,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"261'373","reported_seq":1011,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.005468+0000","last_change":"2024-09-12T17:23:40.711108+0000","last_active":"2024-09-12T18:01:51.005468+0000","last_peered":"2024-09-12T18:01:51.005468+0000","last_clean":"2024-09-12T18:01:51.005468+0000","last_became_active":"2024-09-12T17:23:40.710425+0000","last_became_peered":"2024-09-12T17:23:40.710425+0000","last_unstale":"2024-09-12T18:01:51.005468+0000","last_undegraded":"2024-09-12T18:01:51.005468+0000","last_fullsized":"2024-09-12T18:01:51.005468+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:29.912015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6598189,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":49330,"num_write":1152,"num_write_kb":37186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:43.412561+0000","last_change":"2024-09-12T17:23:44.149929+0000","last_active":"2024-09-12T17:58:43.412561+0000","last_peered":"2024-09-12T17:58:43.412561+0000","last_clean":"2024-09-12T17:58:43.412561+0000","last_became_active":"2024-09-12T17:23:44.148078+0000","last_became_peered":"2024-09-12T17:23:44.148078+0000","last_unstale":"2024-09-12T17:58:43.412561+0000","last_undegraded":"2024-09-12T17:58:43.412561+0000","last_fullsized":"2024-09-12T17:58:43.412561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:27.562908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"261'42","reported_seq":529,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.542596+0000","last_change":"2024-09-12T17:23:46.152014+0000","last_active":"2024-09-12T17:58:49.542596+0000","last_peered":"2024-09-12T17:58:49.542596+0000","last_clean":"2024-09-12T17:58:49.542596+0000","last_became_active":"2024-09-12T17:23:46.151258+0000","last_became_peered":"2024-09-12T17:23:46.151258+0000","last_unstale":"2024-09-12T17:58:49.542596+0000","last_undegraded":"2024-09-12T17:58:49.542596+0000","last_fullsized":"2024-09-12T17:58:49.542596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.540146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":25,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.415800+0000","last_change":"2024-09-12T17:23:48.174102+0000","last_active":"2024-09-12T17:58:49.415800+0000","last_peered":"2024-09-12T17:58:49.415800+0000","last_clean":"2024-09-12T17:58:49.415800+0000","last_became_active":"2024-09-12T17:23:48.173781+0000","last_became_peered":"2024-09-12T17:23:48.173781+0000","last_unstale":"2024-09-12T17:58:49.415800+0000","last_undegraded":"2024-09-12T17:58:49.415800+0000","last_fullsized":"2024-09-12T17:58:49.415800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:42.236527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"261'166","reported_seq":668,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.152209+0000","last_change":"2024-09-12T17:23:50.184117+0000","last_active":"2024-09-12T18:00:18.152209+0000","last_peered":"2024-09-12T18:00:18.152209+0000","last_clean":"2024-09-12T18:00:18.152209+0000","last_became_active":"2024-09-12T17:23:50.183784+0000","last_became_peered":"2024-09-12T17:23:50.183784+0000","last_unstale":"2024-09-12T18:00:18.152209+0000","last_undegraded":"2024-09-12T18:00:18.152209+0000","last_fullsized":"2024-09-12T18:00:18.152209+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:59.251619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":278,"num_read_kb":278,"num_write":359,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"261'417","reported_seq":1952,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.897757+0000","last_change":"2024-09-12T17:23:42.147200+0000","last_active":"2024-09-12T18:00:04.897757+0000","last_peered":"2024-09-12T18:00:04.897757+0000","last_clean":"2024-09-12T18:00:04.897757+0000","last_became_active":"2024-09-12T17:23:42.146703+0000","last_became_peered":"2024-09-12T17:23:42.146703+0000","last_unstale":"2024-09-12T18:00:04.897757+0000","last_undegraded":"2024-09-12T18:00:04.897757+0000","last_fullsized":"2024-09-12T18:00:04.897757+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:00.134623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2240,"num_read_kb":2131,"num_write":479,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"261'289","reported_seq":946,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.050309+0000","last_change":"2024-09-12T17:23:40.704662+0000","last_active":"2024-09-12T18:01:51.050309+0000","last_peered":"2024-09-12T18:01:51.050309+0000","last_clean":"2024-09-12T18:01:51.050309+0000","last_became_active":"2024-09-12T17:23:40.704278+0000","last_became_peered":"2024-09-12T17:23:40.704278+0000","last_unstale":"2024-09-12T18:01:51.050309+0000","last_undegraded":"2024-09-12T18:01:51.050309+0000","last_fullsized":"2024-09-12T18:01:51.050309+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:07.570947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3045160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":96519,"num_write":927,"num_write_kb":33057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.415015+0000","last_change":"2024-09-12T17:23:44.151075+0000","last_active":"2024-09-12T17:58:44.415015+0000","last_peered":"2024-09-12T17:58:44.415015+0000","last_clean":"2024-09-12T17:58:44.415015+0000","last_became_active":"2024-09-12T17:23:44.149838+0000","last_became_peered":"2024-09-12T17:23:44.149838+0000","last_unstale":"2024-09-12T17:58:44.415015+0000","last_undegraded":"2024-09-12T17:58:44.415015+0000","last_fullsized":"2024-09-12T17:58:44.415015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:30.715787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"261'301","reported_seq":877,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.784022+0000","last_change":"2024-09-12T17:23:46.150856+0000","last_active":"2024-09-12T18:01:50.784022+0000","last_peered":"2024-09-12T18:01:50.784022+0000","last_clean":"2024-09-12T18:01:50.784022+0000","last_became_active":"2024-09-12T17:23:46.150528+0000","last_became_peered":"2024-09-12T17:23:46.150528+0000","last_unstale":"2024-09-12T18:01:50.784022+0000","last_undegraded":"2024-09-12T18:01:50.784022+0000","last_fullsized":"2024-09-12T18:01:50.784022+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:33.340339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45198,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":1096,"num_write":398,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.412615+0000","last_change":"2024-09-12T17:23:48.171496+0000","last_active":"2024-09-12T17:58:49.412615+0000","last_peered":"2024-09-12T17:58:49.412615+0000","last_clean":"2024-09-12T17:58:49.412615+0000","last_became_active":"2024-09-12T17:23:48.171031+0000","last_became_peered":"2024-09-12T17:23:48.171031+0000","last_unstale":"2024-09-12T17:58:49.412615+0000","last_undegraded":"2024-09-12T17:58:49.412615+0000","last_fullsized":"2024-09-12T17:58:49.412615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:49.840358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"261'154","reported_seq":657,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.140462+0000","last_change":"2024-09-12T17:23:50.186163+0000","last_active":"2024-09-12T18:00:03.140462+0000","last_peered":"2024-09-12T18:00:03.140462+0000","last_clean":"2024-09-12T18:00:03.140462+0000","last_became_active":"2024-09-12T17:23:50.185846+0000","last_became_peered":"2024-09-12T17:23:50.185846+0000","last_unstale":"2024-09-12T18:00:03.140462+0000","last_undegraded":"2024-09-12T18:00:03.140462+0000","last_fullsized":"2024-09-12T18:00:03.140462+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:27.173182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":366,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"261'792","reported_seq":2404,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.575412+0000","last_change":"2024-09-12T17:23:42.155181+0000","last_active":"2024-09-12T18:00:04.575412+0000","last_peered":"2024-09-12T18:00:04.575412+0000","last_clean":"2024-09-12T18:00:04.575412+0000","last_became_active":"2024-09-12T17:23:42.154925+0000","last_became_peered":"2024-09-12T17:23:42.154925+0000","last_unstale":"2024-09-12T18:00:04.575412+0000","last_undegraded":"2024-09-12T18:00:04.575412+0000","last_fullsized":"2024-09-12T18:00:04.575412+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:33.690553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3893,"num_read_kb":3543,"num_write":1032,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"261'360","reported_seq":972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.042583+0000","last_change":"2024-09-12T17:23:40.709552+0000","last_active":"2024-09-12T18:01:51.042583+0000","last_peered":"2024-09-12T18:01:51.042583+0000","last_clean":"2024-09-12T18:01:51.042583+0000","last_became_active":"2024-09-12T17:23:40.708670+0000","last_became_peered":"2024-09-12T17:23:40.708670+0000","last_unstale":"2024-09-12T18:01:51.042583+0000","last_undegraded":"2024-09-12T18:01:51.042583+0000","last_fullsized":"2024-09-12T18:01:51.042583+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:17.377417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306433,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":1950,"num_write":1111,"num_write_kb":27043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.411789+0000","last_change":"2024-09-12T17:23:44.150241+0000","last_active":"2024-09-12T17:58:44.411789+0000","last_peered":"2024-09-12T17:58:44.411789+0000","last_clean":"2024-09-12T17:58:44.411789+0000","last_became_active":"2024-09-12T17:23:44.149907+0000","last_became_peered":"2024-09-12T17:23:44.149907+0000","last_unstale":"2024-09-12T17:58:44.411789+0000","last_undegraded":"2024-09-12T17:58:44.411789+0000","last_fullsized":"2024-09-12T17:58:44.411789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:57.170825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"261'276","reported_seq":828,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.612579+0000","last_change":"2024-09-12T17:23:46.150337+0000","last_active":"2024-09-12T18:01:50.612579+0000","last_peered":"2024-09-12T18:01:50.612579+0000","last_clean":"2024-09-12T18:01:50.612579+0000","last_became_active":"2024-09-12T17:23:46.149987+0000","last_became_peered":"2024-09-12T17:23:46.149987+0000","last_unstale":"2024-09-12T18:01:50.612579+0000","last_undegraded":"2024-09-12T18:01:50.612579+0000","last_fullsized":"2024-09-12T18:01:50.612579+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:31.163554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46832,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":1121,"num_write":390,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.542683+0000","last_change":"2024-09-12T17:23:48.169607+0000","last_active":"2024-09-12T17:58:49.542683+0000","last_peered":"2024-09-12T17:58:49.542683+0000","last_clean":"2024-09-12T17:58:49.542683+0000","last_became_active":"2024-09-12T17:23:48.169308+0000","last_became_peered":"2024-09-12T17:23:48.169308+0000","last_unstale":"2024-09-12T17:58:49.542683+0000","last_undegraded":"2024-09-12T17:58:49.542683+0000","last_fullsized":"2024-09-12T17:58:49.542683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:14.722104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"261'801","reported_seq":2248,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.775817+0000","last_change":"2024-09-12T17:23:42.148700+0000","last_active":"2024-09-12T18:00:15.775817+0000","last_peered":"2024-09-12T18:00:15.775817+0000","last_clean":"2024-09-12T18:00:15.775817+0000","last_became_active":"2024-09-12T17:23:42.148412+0000","last_became_peered":"2024-09-12T17:23:42.148412+0000","last_unstale":"2024-09-12T18:00:15.775817+0000","last_undegraded":"2024-09-12T18:00:15.775817+0000","last_fullsized":"2024-09-12T18:00:15.775817+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:21.039641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3663,"num_read_kb":3282,"num_write":1025,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"261'309","reported_seq":940,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.003643+0000","last_change":"2024-09-12T17:23:40.717850+0000","last_active":"2024-09-12T18:01:51.003643+0000","last_peered":"2024-09-12T18:01:51.003643+0000","last_clean":"2024-09-12T18:01:51.003643+0000","last_became_active":"2024-09-12T17:23:40.717447+0000","last_became_peered":"2024-09-12T17:23:40.717447+0000","last_unstale":"2024-09-12T18:01:51.003643+0000","last_undegraded":"2024-09-12T18:01:51.003643+0000","last_fullsized":"2024-09-12T18:01:51.003643+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:56.974836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":485,"num_read_kb":6880,"num_write":973,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:49.550885+0000","last_change":"2024-09-12T17:23:44.150079+0000","last_active":"2024-09-12T17:59:49.550885+0000","last_peered":"2024-09-12T17:59:49.550885+0000","last_clean":"2024-09-12T17:59:49.550885+0000","last_became_active":"2024-09-12T17:23:44.149799+0000","last_became_peered":"2024-09-12T17:23:44.149799+0000","last_unstale":"2024-09-12T17:59:49.550885+0000","last_undegraded":"2024-09-12T17:59:49.550885+0000","last_fullsized":"2024-09-12T17:59:49.550885+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:42.685092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"261'483","reported_seq":1104,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.564135+0000","last_change":"2024-09-12T17:23:46.149613+0000","last_active":"2024-09-12T18:01:50.564135+0000","last_peered":"2024-09-12T18:01:50.564135+0000","last_clean":"2024-09-12T18:01:50.564135+0000","last_became_active":"2024-09-12T17:23:46.148861+0000","last_became_peered":"2024-09-12T17:23:46.148861+0000","last_unstale":"2024-09-12T18:01:50.564135+0000","last_undegraded":"2024-09-12T18:01:50.564135+0000","last_fullsized":"2024-09-12T18:01:50.564135+0000","mapping_epoch":29,"log_start":"261'400","ondisk_log_start":"261'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:49.574258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101554,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":879,"num_read_kb":2135,"num_write":756,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.415004+0000","last_change":"2024-09-12T17:23:48.168964+0000","last_active":"2024-09-12T17:58:49.415004+0000","last_peered":"2024-09-12T17:58:49.415004+0000","last_clean":"2024-09-12T17:58:49.415004+0000","last_became_active":"2024-09-12T17:23:48.168566+0000","last_became_peered":"2024-09-12T17:23:48.168566+0000","last_unstale":"2024-09-12T17:58:49.415004+0000","last_undegraded":"2024-09-12T17:58:49.415004+0000","last_fullsized":"2024-09-12T17:58:49.415004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:54.048241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"261'216","reported_seq":723,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.143900+0000","last_change":"2024-09-12T17:23:50.642047+0000","last_active":"2024-09-12T18:00:18.143900+0000","last_peered":"2024-09-12T18:00:18.143900+0000","last_clean":"2024-09-12T18:00:18.143900+0000","last_became_active":"2024-09-12T17:23:50.641702+0000","last_became_peered":"2024-09-12T17:23:50.641702+0000","last_unstale":"2024-09-12T18:00:18.143900+0000","last_undegraded":"2024-09-12T18:00:18.143900+0000","last_fullsized":"2024-09-12T18:00:18.143900+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:03.863712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":328,"num_write":469,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"261'758","reported_seq":2326,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.409871+0000","last_change":"2024-09-12T17:23:42.142182+0000","last_active":"2024-09-12T18:00:03.409871+0000","last_peered":"2024-09-12T18:00:03.409871+0000","last_clean":"2024-09-12T18:00:03.409871+0000","last_became_active":"2024-09-12T17:23:42.141869+0000","last_became_peered":"2024-09-12T17:23:42.141869+0000","last_unstale":"2024-09-12T18:00:03.409871+0000","last_undegraded":"2024-09-12T18:00:03.409871+0000","last_fullsized":"2024-09-12T18:00:03.409871+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:48.199963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3783,"num_read_kb":3443,"num_write":995,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"261'320","reported_seq":921,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.038514+0000","last_change":"2024-09-12T17:23:40.711959+0000","last_active":"2024-09-12T18:01:51.038514+0000","last_peered":"2024-09-12T18:01:51.038514+0000","last_clean":"2024-09-12T18:01:51.038514+0000","last_became_active":"2024-09-12T17:23:40.711679+0000","last_became_peered":"2024-09-12T17:23:40.711679+0000","last_unstale":"2024-09-12T18:01:51.038514+0000","last_undegraded":"2024-09-12T18:01:51.038514+0000","last_fullsized":"2024-09-12T18:01:51.038514+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:54.430386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":441,"num_read_kb":3628,"num_write":977,"num_write_kb":35404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415419+0000","last_change":"2024-09-12T17:23:44.148401+0000","last_active":"2024-09-12T17:59:09.415419+0000","last_peered":"2024-09-12T17:59:09.415419+0000","last_clean":"2024-09-12T17:59:09.415419+0000","last_became_active":"2024-09-12T17:23:44.148044+0000","last_became_peered":"2024-09-12T17:23:44.148044+0000","last_unstale":"2024-09-12T17:59:09.415419+0000","last_undegraded":"2024-09-12T17:59:09.415419+0000","last_fullsized":"2024-09-12T17:59:09.415419+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:06.246940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"261'292","reported_seq":855,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.669739+0000","last_change":"2024-09-12T17:23:46.150717+0000","last_active":"2024-09-12T18:01:50.669739+0000","last_peered":"2024-09-12T18:01:50.669739+0000","last_clean":"2024-09-12T18:01:50.669739+0000","last_became_active":"2024-09-12T17:23:46.150380+0000","last_became_peered":"2024-09-12T17:23:46.150380+0000","last_unstale":"2024-09-12T18:01:50.669739+0000","last_undegraded":"2024-09-12T18:01:50.669739+0000","last_fullsized":"2024-09-12T18:01:50.669739+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:35.358954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47278,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":1112,"num_write":416,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.414306+0000","last_change":"2024-09-12T17:23:48.173812+0000","last_active":"2024-09-12T17:58:49.414306+0000","last_peered":"2024-09-12T17:58:49.414306+0000","last_clean":"2024-09-12T17:58:49.414306+0000","last_became_active":"2024-09-12T17:23:48.173575+0000","last_became_peered":"2024-09-12T17:23:48.173575+0000","last_unstale":"2024-09-12T17:58:49.414306+0000","last_undegraded":"2024-09-12T17:58:49.414306+0000","last_fullsized":"2024-09-12T17:58:49.414306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:42.300280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"261'188","reported_seq":1044,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:17.033695+0000","last_change":"2024-09-12T17:23:50.186218+0000","last_active":"2024-09-12T18:00:17.033695+0000","last_peered":"2024-09-12T18:00:17.033695+0000","last_clean":"2024-09-12T18:00:17.033695+0000","last_became_active":"2024-09-12T17:23:50.185853+0000","last_became_peered":"2024-09-12T17:23:50.185853+0000","last_unstale":"2024-09-12T18:00:17.033695+0000","last_undegraded":"2024-09-12T18:00:17.033695+0000","last_fullsized":"2024-09-12T18:00:17.033695+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:01.791901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":633,"num_read_kb":630,"num_write":516,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"261'631","reported_seq":2472,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.504213+0000","last_change":"2024-09-12T17:23:42.154459+0000","last_active":"2024-09-12T18:00:05.504213+0000","last_peered":"2024-09-12T18:00:05.504213+0000","last_clean":"2024-09-12T18:00:05.504213+0000","last_became_active":"2024-09-12T17:23:42.154175+0000","last_became_peered":"2024-09-12T17:23:42.154175+0000","last_unstale":"2024-09-12T18:00:05.504213+0000","last_undegraded":"2024-09-12T18:00:05.504213+0000","last_fullsized":"2024-09-12T18:00:05.504213+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":600,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:46.313807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3404,"num_read_kb":3151,"num_write":789,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"261'345","reported_seq":970,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.960203+0000","last_change":"2024-09-12T17:23:40.713263+0000","last_active":"2024-09-12T18:01:50.960203+0000","last_peered":"2024-09-12T18:01:50.960203+0000","last_clean":"2024-09-12T18:01:50.960203+0000","last_became_active":"2024-09-12T17:23:40.712959+0000","last_became_peered":"2024-09-12T17:23:40.712959+0000","last_unstale":"2024-09-12T18:01:50.960203+0000","last_undegraded":"2024-09-12T18:01:50.960203+0000","last_fullsized":"2024-09-12T18:01:50.960203+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:04.359024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":522,"num_read_kb":11025,"num_write":1066,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.414711+0000","last_change":"2024-09-12T17:23:44.152533+0000","last_active":"2024-09-12T17:58:44.414711+0000","last_peered":"2024-09-12T17:58:44.414711+0000","last_clean":"2024-09-12T17:58:44.414711+0000","last_became_active":"2024-09-12T17:23:44.152006+0000","last_became_peered":"2024-09-12T17:23:44.152006+0000","last_unstale":"2024-09-12T17:58:44.414711+0000","last_undegraded":"2024-09-12T17:58:44.414711+0000","last_fullsized":"2024-09-12T17:58:44.414711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:53.659031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"261'249","reported_seq":811,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.915471+0000","last_change":"2024-09-12T17:23:46.241387+0000","last_active":"2024-09-12T18:01:49.915471+0000","last_peered":"2024-09-12T18:01:49.915471+0000","last_clean":"2024-09-12T18:01:49.915471+0000","last_became_active":"2024-09-12T17:23:46.241001+0000","last_became_peered":"2024-09-12T17:23:46.241001+0000","last_unstale":"2024-09-12T18:01:49.915471+0000","last_undegraded":"2024-09-12T18:01:49.915471+0000","last_fullsized":"2024-09-12T18:01:49.915471+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:50.165152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42355,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":393,"num_read_kb":868,"num_write":314,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.422835+0000","last_change":"2024-09-12T17:23:48.170506+0000","last_active":"2024-09-12T17:59:54.422835+0000","last_peered":"2024-09-12T17:59:54.422835+0000","last_clean":"2024-09-12T17:59:54.422835+0000","last_became_active":"2024-09-12T17:23:48.170212+0000","last_became_peered":"2024-09-12T17:23:48.170212+0000","last_unstale":"2024-09-12T17:59:54.422835+0000","last_undegraded":"2024-09-12T17:59:54.422835+0000","last_fullsized":"2024-09-12T17:59:54.422835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:14.960120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"261'127","reported_seq":607,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.439241+0000","last_change":"2024-09-12T17:23:50.187626+0000","last_active":"2024-09-12T18:01:42.439241+0000","last_peered":"2024-09-12T18:01:42.439241+0000","last_clean":"2024-09-12T18:01:42.439241+0000","last_became_active":"2024-09-12T17:23:50.187329+0000","last_became_peered":"2024-09-12T17:23:50.187329+0000","last_unstale":"2024-09-12T18:01:42.439241+0000","last_undegraded":"2024-09-12T18:01:42.439241+0000","last_fullsized":"2024-09-12T18:01:42.439241+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:50.928583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":770,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":154,"num_read_kb":149,"num_write":327,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"261'776","reported_seq":2292,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.504173+0000","last_change":"2024-09-12T17:23:42.144667+0000","last_active":"2024-09-12T18:00:05.504173+0000","last_peered":"2024-09-12T18:00:05.504173+0000","last_clean":"2024-09-12T18:00:05.504173+0000","last_became_active":"2024-09-12T17:23:42.144384+0000","last_became_peered":"2024-09-12T17:23:42.144384+0000","last_unstale":"2024-09-12T18:00:05.504173+0000","last_undegraded":"2024-09-12T18:00:05.504173+0000","last_fullsized":"2024-09-12T18:00:05.504173+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:07.836356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3720,"num_read_kb":3370,"num_write":1041,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"261'325","reported_seq":934,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.000652+0000","last_change":"2024-09-12T17:23:40.714983+0000","last_active":"2024-09-12T18:01:51.000652+0000","last_peered":"2024-09-12T18:01:51.000652+0000","last_clean":"2024-09-12T18:01:51.000652+0000","last_became_active":"2024-09-12T17:23:40.714710+0000","last_became_peered":"2024-09-12T17:23:40.714710+0000","last_unstale":"2024-09-12T18:01:51.000652+0000","last_undegraded":"2024-09-12T18:01:51.000652+0000","last_fullsized":"2024-09-12T18:01:51.000652+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:51.614208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311482,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":467,"num_read_kb":6860,"num_write":1100,"num_write_kb":28418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.413676+0000","last_change":"2024-09-12T17:23:44.150532+0000","last_active":"2024-09-12T17:58:44.413676+0000","last_peered":"2024-09-12T17:58:44.413676+0000","last_clean":"2024-09-12T17:58:44.413676+0000","last_became_active":"2024-09-12T17:23:44.147886+0000","last_became_peered":"2024-09-12T17:23:44.147886+0000","last_unstale":"2024-09-12T17:58:44.413676+0000","last_undegraded":"2024-09-12T17:58:44.413676+0000","last_fullsized":"2024-09-12T17:58:44.413676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:53.428886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"261'80","reported_seq":588,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.424428+0000","last_change":"2024-09-12T17:23:46.241390+0000","last_active":"2024-09-12T17:59:59.424428+0000","last_peered":"2024-09-12T17:59:59.424428+0000","last_clean":"2024-09-12T17:59:59.424428+0000","last_became_active":"2024-09-12T17:23:46.241073+0000","last_became_peered":"2024-09-12T17:23:46.241073+0000","last_unstale":"2024-09-12T17:59:59.424428+0000","last_undegraded":"2024-09-12T17:59:59.424428+0000","last_fullsized":"2024-09-12T17:59:59.424428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:13.779221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":73,"num_read_kb":65,"num_write":60,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"261'785","reported_seq":2169,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.413100+0000","last_change":"2024-09-12T17:23:48.171323+0000","last_active":"2024-09-12T18:01:49.413100+0000","last_peered":"2024-09-12T18:01:49.413100+0000","last_clean":"2024-09-12T18:01:49.413100+0000","last_became_active":"2024-09-12T17:23:48.170815+0000","last_became_peered":"2024-09-12T17:23:48.170815+0000","last_unstale":"2024-09-12T18:01:49.413100+0000","last_undegraded":"2024-09-12T18:01:49.413100+0000","last_fullsized":"2024-09-12T18:01:49.413100+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:19.299843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"261'127","reported_seq":616,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:17.186926+0000","last_change":"2024-09-12T17:23:50.190416+0000","last_active":"2024-09-12T18:00:17.186926+0000","last_peered":"2024-09-12T18:00:17.186926+0000","last_clean":"2024-09-12T18:00:17.186926+0000","last_became_active":"2024-09-12T17:23:50.190124+0000","last_became_peered":"2024-09-12T17:23:50.190124+0000","last_unstale":"2024-09-12T18:00:17.186926+0000","last_undegraded":"2024-09-12T18:00:17.186926+0000","last_fullsized":"2024-09-12T18:00:17.186926+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:39.676360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":181,"num_read_kb":172,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"261'818","reported_seq":2433,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.787899+0000","last_change":"2024-09-12T17:23:42.149931+0000","last_active":"2024-09-12T18:00:05.787899+0000","last_peered":"2024-09-12T18:00:05.787899+0000","last_clean":"2024-09-12T18:00:05.787899+0000","last_became_active":"2024-09-12T17:23:42.149314+0000","last_became_peered":"2024-09-12T17:23:42.149314+0000","last_unstale":"2024-09-12T18:00:05.787899+0000","last_undegraded":"2024-09-12T18:00:05.787899+0000","last_fullsized":"2024-09-12T18:00:05.787899+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:45.837125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4083,"num_read_kb":3703,"num_write":1086,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"261'292","reported_seq":913,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.001085+0000","last_change":"2024-09-12T17:23:40.710250+0000","last_active":"2024-09-12T18:01:51.001085+0000","last_peered":"2024-09-12T18:01:51.001085+0000","last_clean":"2024-09-12T18:01:51.001085+0000","last_became_active":"2024-09-12T17:23:40.709818+0000","last_became_peered":"2024-09-12T17:23:40.709818+0000","last_unstale":"2024-09-12T18:01:51.001085+0000","last_undegraded":"2024-09-12T18:01:51.001085+0000","last_fullsized":"2024-09-12T18:01:51.001085+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:49.203826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":426,"num_read_kb":69858,"num_write":935,"num_write_kb":36096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.415126+0000","last_change":"2024-09-12T17:23:44.150481+0000","last_active":"2024-09-12T17:58:44.415126+0000","last_peered":"2024-09-12T17:58:44.415126+0000","last_clean":"2024-09-12T17:58:44.415126+0000","last_became_active":"2024-09-12T17:23:44.150183+0000","last_became_peered":"2024-09-12T17:23:44.150183+0000","last_unstale":"2024-09-12T17:58:44.415126+0000","last_undegraded":"2024-09-12T17:58:44.415126+0000","last_fullsized":"2024-09-12T17:58:44.415126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:11.304183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"261'314","reported_seq":880,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.205309+0000","last_change":"2024-09-12T17:23:46.145061+0000","last_active":"2024-09-12T18:01:50.205309+0000","last_peered":"2024-09-12T18:01:50.205309+0000","last_clean":"2024-09-12T18:01:50.205309+0000","last_became_active":"2024-09-12T17:23:46.144587+0000","last_became_peered":"2024-09-12T17:23:46.144587+0000","last_unstale":"2024-09-12T18:01:50.205309+0000","last_undegraded":"2024-09-12T18:01:50.205309+0000","last_fullsized":"2024-09-12T18:01:50.205309+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:07.704295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46086,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":505,"num_read_kb":1153,"num_write":418,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.531765+0000","last_change":"2024-09-12T17:23:48.171551+0000","last_active":"2024-09-12T17:57:39.531765+0000","last_peered":"2024-09-12T17:57:39.531765+0000","last_clean":"2024-09-12T17:57:39.531765+0000","last_became_active":"2024-09-12T17:23:48.171272+0000","last_became_peered":"2024-09-12T17:23:48.171272+0000","last_unstale":"2024-09-12T17:57:39.531765+0000","last_undegraded":"2024-09-12T17:57:39.531765+0000","last_fullsized":"2024-09-12T17:57:39.531765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:23.692378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"261'102","reported_seq":586,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.251581+0000","last_change":"2024-09-12T17:23:50.192154+0000","last_active":"2024-09-12T18:00:04.251581+0000","last_peered":"2024-09-12T18:00:04.251581+0000","last_clean":"2024-09-12T18:00:04.251581+0000","last_became_active":"2024-09-12T17:23:50.191859+0000","last_became_peered":"2024-09-12T17:23:50.191859+0000","last_unstale":"2024-09-12T18:00:04.251581+0000","last_undegraded":"2024-09-12T18:00:04.251581+0000","last_fullsized":"2024-09-12T18:00:04.251581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:55.936330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":141,"num_write":249,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"261'476","reported_seq":2056,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.920905+0000","last_change":"2024-09-12T17:23:42.149567+0000","last_active":"2024-09-12T18:00:02.920905+0000","last_peered":"2024-09-12T18:00:02.920905+0000","last_clean":"2024-09-12T18:00:02.920905+0000","last_became_active":"2024-09-12T17:23:42.149260+0000","last_became_peered":"2024-09-12T17:23:42.149260+0000","last_unstale":"2024-09-12T18:00:02.920905+0000","last_undegraded":"2024-09-12T18:00:02.920905+0000","last_fullsized":"2024-09-12T18:00:02.920905+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:03.397079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2426,"num_read_kb":2286,"num_write":546,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"261'377","reported_seq":1036,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.009294+0000","last_change":"2024-09-12T17:23:40.711299+0000","last_active":"2024-09-12T18:01:51.009294+0000","last_peered":"2024-09-12T18:01:51.009294+0000","last_clean":"2024-09-12T18:01:51.009294+0000","last_became_active":"2024-09-12T17:23:40.711032+0000","last_became_peered":"2024-09-12T17:23:40.711032+0000","last_unstale":"2024-09-12T18:01:51.009294+0000","last_undegraded":"2024-09-12T18:01:51.009294+0000","last_fullsized":"2024-09-12T18:01:51.009294+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:01.273219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":607,"num_read_kb":19508,"num_write":1297,"num_write_kb":28388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.414353+0000","last_change":"2024-09-12T17:23:44.148038+0000","last_active":"2024-09-12T17:58:44.414353+0000","last_peered":"2024-09-12T17:58:44.414353+0000","last_clean":"2024-09-12T17:58:44.414353+0000","last_became_active":"2024-09-12T17:23:44.147694+0000","last_became_peered":"2024-09-12T17:23:44.147694+0000","last_unstale":"2024-09-12T17:58:44.414353+0000","last_undegraded":"2024-09-12T17:58:44.414353+0000","last_fullsized":"2024-09-12T17:58:44.414353+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:06.022806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"261'259","reported_seq":810,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.261172+0000","last_change":"2024-09-12T17:23:46.152548+0000","last_active":"2024-09-12T18:01:50.261172+0000","last_peered":"2024-09-12T18:01:50.261172+0000","last_clean":"2024-09-12T18:01:50.261172+0000","last_became_active":"2024-09-12T17:23:46.152028+0000","last_became_peered":"2024-09-12T17:23:46.152028+0000","last_unstale":"2024-09-12T18:01:50.261172+0000","last_undegraded":"2024-09-12T18:01:50.261172+0000","last_fullsized":"2024-09-12T18:01:50.261172+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:32.403280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":974,"num_write":338,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.404087+0000","last_change":"2024-09-12T17:23:48.170790+0000","last_active":"2024-09-12T17:57:49.404087+0000","last_peered":"2024-09-12T17:57:49.404087+0000","last_clean":"2024-09-12T17:57:49.404087+0000","last_became_active":"2024-09-12T17:23:48.170452+0000","last_became_peered":"2024-09-12T17:23:48.170452+0000","last_unstale":"2024-09-12T17:57:49.404087+0000","last_undegraded":"2024-09-12T17:57:49.404087+0000","last_fullsized":"2024-09-12T17:57:49.404087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:31.197971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"261'126","reported_seq":628,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.113825+0000","last_change":"2024-09-12T17:23:50.641248+0000","last_active":"2024-09-12T18:00:02.113825+0000","last_peered":"2024-09-12T18:00:02.113825+0000","last_clean":"2024-09-12T18:00:02.113825+0000","last_became_active":"2024-09-12T17:23:50.640911+0000","last_became_peered":"2024-09-12T17:23:50.640911+0000","last_unstale":"2024-09-12T18:00:02.113825+0000","last_undegraded":"2024-09-12T18:00:02.113825+0000","last_fullsized":"2024-09-12T18:00:02.113825+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:33.080397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":307,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"261'389","reported_seq":1787,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.136439+0000","last_change":"2024-09-12T17:23:42.146348+0000","last_active":"2024-09-12T18:00:18.136439+0000","last_peered":"2024-09-12T18:00:18.136439+0000","last_clean":"2024-09-12T18:00:18.136439+0000","last_became_active":"2024-09-12T17:23:42.146055+0000","last_became_peered":"2024-09-12T17:23:42.146055+0000","last_unstale":"2024-09-12T18:00:18.136439+0000","last_undegraded":"2024-09-12T18:00:18.136439+0000","last_fullsized":"2024-09-12T18:00:18.136439+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:11.249424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1982,"num_read_kb":1877,"num_write":444,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"261'316","reported_seq":933,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.007772+0000","last_change":"2024-09-12T17:23:40.712278+0000","last_active":"2024-09-12T18:01:51.007772+0000","last_peered":"2024-09-12T18:01:51.007772+0000","last_clean":"2024-09-12T18:01:51.007772+0000","last_became_active":"2024-09-12T17:23:40.709759+0000","last_became_peered":"2024-09-12T17:23:40.709759+0000","last_unstale":"2024-09-12T18:01:51.007772+0000","last_undegraded":"2024-09-12T18:01:51.007772+0000","last_fullsized":"2024-09-12T18:01:51.007772+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.261512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306344,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":452,"num_read_kb":23018,"num_write":1076,"num_write_kb":26757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404701+0000","last_change":"2024-09-12T17:23:44.147886+0000","last_active":"2024-09-12T17:57:34.404701+0000","last_peered":"2024-09-12T17:57:34.404701+0000","last_clean":"2024-09-12T17:57:34.404701+0000","last_became_active":"2024-09-12T17:23:44.147372+0000","last_became_peered":"2024-09-12T17:23:44.147372+0000","last_unstale":"2024-09-12T17:57:34.404701+0000","last_undegraded":"2024-09-12T17:57:34.404701+0000","last_fullsized":"2024-09-12T17:57:34.404701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:48.881691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"261'242","reported_seq":789,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.813412+0000","last_change":"2024-09-12T17:23:46.153298+0000","last_active":"2024-09-12T18:01:49.813412+0000","last_peered":"2024-09-12T18:01:49.813412+0000","last_clean":"2024-09-12T18:01:49.813412+0000","last_became_active":"2024-09-12T17:23:46.153024+0000","last_became_peered":"2024-09-12T17:23:46.153024+0000","last_unstale":"2024-09-12T18:01:49.813412+0000","last_undegraded":"2024-09-12T18:01:49.813412+0000","last_fullsized":"2024-09-12T18:01:49.813412+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:00.093006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46277,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":401,"num_read_kb":970,"num_write":334,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.415370+0000","last_change":"2024-09-12T17:23:48.172179+0000","last_active":"2024-09-12T17:58:49.415370+0000","last_peered":"2024-09-12T17:58:49.415370+0000","last_clean":"2024-09-12T17:58:49.415370+0000","last_became_active":"2024-09-12T17:23:48.171849+0000","last_became_peered":"2024-09-12T17:23:48.171849+0000","last_unstale":"2024-09-12T17:58:49.415370+0000","last_undegraded":"2024-09-12T17:58:49.415370+0000","last_fullsized":"2024-09-12T17:58:49.415370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:22.948863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"261'139","reported_seq":1240,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.442930+0000","last_change":"2024-09-12T17:23:50.187385+0000","last_active":"2024-09-12T18:00:18.442930+0000","last_peered":"2024-09-12T18:00:18.442930+0000","last_clean":"2024-09-12T18:00:18.442930+0000","last_became_active":"2024-09-12T17:23:50.187084+0000","last_became_peered":"2024-09-12T17:23:50.187084+0000","last_unstale":"2024-09-12T18:00:18.442930+0000","last_undegraded":"2024-09-12T18:00:18.442930+0000","last_fullsized":"2024-09-12T18:00:18.442930+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:15.188210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":862,"num_read_kb":842,"num_write":338,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"261'420","reported_seq":1870,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.767639+0000","last_change":"2024-09-12T17:23:42.136286+0000","last_active":"2024-09-12T18:00:15.767639+0000","last_peered":"2024-09-12T18:00:15.767639+0000","last_clean":"2024-09-12T18:00:15.767639+0000","last_became_active":"2024-09-12T17:23:42.135975+0000","last_became_peered":"2024-09-12T17:23:42.135975+0000","last_unstale":"2024-09-12T18:00:15.767639+0000","last_undegraded":"2024-09-12T18:00:15.767639+0000","last_fullsized":"2024-09-12T18:00:15.767639+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:39.052393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2123,"num_read_kb":2006,"num_write":479,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"261'379","reported_seq":1021,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.972241+0000","last_change":"2024-09-12T17:23:40.714142+0000","last_active":"2024-09-12T18:01:50.972241+0000","last_peered":"2024-09-12T18:01:50.972241+0000","last_clean":"2024-09-12T18:01:50.972241+0000","last_became_active":"2024-09-12T17:23:40.713129+0000","last_became_peered":"2024-09-12T17:23:40.713129+0000","last_unstale":"2024-09-12T18:01:50.972241+0000","last_undegraded":"2024-09-12T18:01:50.972241+0000","last_fullsized":"2024-09-12T18:01:50.972241+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:41.054346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311685,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":537,"num_read_kb":14035,"num_write":1238,"num_write_kb":28273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.404033+0000","last_change":"2024-09-12T17:23:44.151405+0000","last_active":"2024-09-12T17:57:39.404033+0000","last_peered":"2024-09-12T17:57:39.404033+0000","last_clean":"2024-09-12T17:57:39.404033+0000","last_became_active":"2024-09-12T17:23:44.151126+0000","last_became_peered":"2024-09-12T17:23:44.151126+0000","last_unstale":"2024-09-12T17:57:39.404033+0000","last_undegraded":"2024-09-12T17:57:39.404033+0000","last_fullsized":"2024-09-12T17:57:39.404033+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:22.113687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"261'284","reported_seq":859,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.950235+0000","last_change":"2024-09-12T17:23:46.153409+0000","last_active":"2024-09-12T18:01:49.950235+0000","last_peered":"2024-09-12T18:01:49.950235+0000","last_clean":"2024-09-12T18:01:49.950235+0000","last_became_active":"2024-09-12T17:23:46.153111+0000","last_became_peered":"2024-09-12T17:23:46.153111+0000","last_unstale":"2024-09-12T18:01:49.950235+0000","last_undegraded":"2024-09-12T18:01:49.950235+0000","last_fullsized":"2024-09-12T18:01:49.950235+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:10.838059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":457,"num_read_kb":1001,"num_write":362,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.542675+0000","last_change":"2024-09-12T17:23:48.167442+0000","last_active":"2024-09-12T17:58:49.542675+0000","last_peered":"2024-09-12T17:58:49.542675+0000","last_clean":"2024-09-12T17:58:49.542675+0000","last_became_active":"2024-09-12T17:23:48.167070+0000","last_became_peered":"2024-09-12T17:23:48.167070+0000","last_unstale":"2024-09-12T17:58:49.542675+0000","last_undegraded":"2024-09-12T17:58:49.542675+0000","last_fullsized":"2024-09-12T17:58:49.542675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:57.449206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"261'83","reported_seq":563,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.396381+0000","last_change":"2024-09-12T17:23:50.179396+0000","last_active":"2024-09-12T18:01:41.396381+0000","last_peered":"2024-09-12T18:01:41.396381+0000","last_clean":"2024-09-12T18:01:41.396381+0000","last_became_active":"2024-09-12T17:23:50.179075+0000","last_became_peered":"2024-09-12T17:23:50.179075+0000","last_unstale":"2024-09-12T18:01:41.396381+0000","last_undegraded":"2024-09-12T18:01:41.396381+0000","last_fullsized":"2024-09-12T18:01:41.396381+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:17.064467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":88,"num_write":193,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"261'777","reported_seq":2261,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.397855+0000","last_change":"2024-09-12T17:23:42.137451+0000","last_active":"2024-09-12T18:01:41.397855+0000","last_peered":"2024-09-12T18:01:41.397855+0000","last_clean":"2024-09-12T18:01:41.397855+0000","last_became_active":"2024-09-12T17:23:42.137169+0000","last_became_peered":"2024-09-12T17:23:42.137169+0000","last_unstale":"2024-09-12T18:01:41.397855+0000","last_undegraded":"2024-09-12T18:01:41.397855+0000","last_fullsized":"2024-09-12T18:01:41.397855+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:08.945619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3876,"num_read_kb":3488,"num_write":1033,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"261'365","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.040459+0000","last_change":"2024-09-12T17:23:40.713502+0000","last_active":"2024-09-12T18:01:51.040459+0000","last_peered":"2024-09-12T18:01:51.040459+0000","last_clean":"2024-09-12T18:01:51.040459+0000","last_became_active":"2024-09-12T17:23:40.713212+0000","last_became_peered":"2024-09-12T17:23:40.713212+0000","last_unstale":"2024-09-12T18:01:51.040459+0000","last_undegraded":"2024-09-12T18:01:51.040459+0000","last_fullsized":"2024-09-12T18:01:51.040459+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:39.463517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":603,"num_read_kb":38604,"num_write":1166,"num_write_kb":36037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"261'632","reported_seq":2095,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.230241+0000","last_change":"2024-09-12T17:24:17.227806+0000","last_active":"2024-09-12T18:00:05.230241+0000","last_peered":"2024-09-12T18:00:05.230241+0000","last_clean":"2024-09-12T18:00:05.230241+0000","last_became_active":"2024-09-12T17:24:17.227465+0000","last_became_peered":"2024-09-12T17:24:17.227465+0000","last_unstale":"2024-09-12T18:00:05.230241+0000","last_undegraded":"2024-09-12T18:00:05.230241+0000","last_fullsized":"2024-09-12T18:00:05.230241+0000","mapping_epoch":36,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":600,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:02.612199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3072,"num_read_kb":2745,"num_write":824,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"261'315","reported_seq":984,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.052484+0000","last_change":"2024-09-12T17:23:40.708395+0000","last_active":"2024-09-12T18:01:51.052484+0000","last_peered":"2024-09-12T18:01:51.052484+0000","last_clean":"2024-09-12T18:01:51.052484+0000","last_became_active":"2024-09-12T17:23:40.708064+0000","last_became_peered":"2024-09-12T17:23:40.708064+0000","last_unstale":"2024-09-12T18:01:51.052484+0000","last_undegraded":"2024-09-12T18:01:51.052484+0000","last_fullsized":"2024-09-12T18:01:51.052484+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:37.241857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8958905,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":78914,"num_write":996,"num_write_kb":50917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"261'842","reported_seq":2554,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.897301+0000","last_change":"2024-09-12T17:23:42.145251+0000","last_active":"2024-09-12T18:00:04.897301+0000","last_peered":"2024-09-12T18:00:04.897301+0000","last_clean":"2024-09-12T18:00:04.897301+0000","last_became_active":"2024-09-12T17:23:42.144919+0000","last_became_peered":"2024-09-12T17:23:42.144919+0000","last_unstale":"2024-09-12T18:00:04.897301+0000","last_undegraded":"2024-09-12T18:00:04.897301+0000","last_fullsized":"2024-09-12T18:00:04.897301+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:06.765117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4312,"num_read_kb":3919,"num_write":1107,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"261'344","reported_seq":984,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.029306+0000","last_change":"2024-09-12T17:23:40.715953+0000","last_active":"2024-09-12T18:01:51.029306+0000","last_peered":"2024-09-12T18:01:51.029306+0000","last_clean":"2024-09-12T18:01:51.029306+0000","last_became_active":"2024-09-12T17:23:40.715471+0000","last_became_peered":"2024-09-12T17:23:40.715471+0000","last_unstale":"2024-09-12T18:01:51.029306+0000","last_undegraded":"2024-09-12T18:01:51.029306+0000","last_fullsized":"2024-09-12T18:01:51.029306+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:42.149240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":470,"num_read_kb":37845,"num_write":1014,"num_write_kb":24242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"261'766","reported_seq":2207,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.398961+0000","last_change":"2024-09-12T17:23:42.143464+0000","last_active":"2024-09-12T18:01:41.398961+0000","last_peered":"2024-09-12T18:01:41.398961+0000","last_clean":"2024-09-12T18:01:41.398961+0000","last_became_active":"2024-09-12T17:23:42.142672+0000","last_became_peered":"2024-09-12T17:23:42.142672+0000","last_unstale":"2024-09-12T18:01:41.398961+0000","last_undegraded":"2024-09-12T18:01:41.398961+0000","last_fullsized":"2024-09-12T18:01:41.398961+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:24.449488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3573,"num_read_kb":3224,"num_write":1004,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"261'284","reported_seq":904,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.995939+0000","last_change":"2024-09-12T17:23:40.703276+0000","last_active":"2024-09-12T18:01:50.995939+0000","last_peered":"2024-09-12T18:01:50.995939+0000","last_clean":"2024-09-12T18:01:50.995939+0000","last_became_active":"2024-09-12T17:23:40.702991+0000","last_became_peered":"2024-09-12T17:23:40.702991+0000","last_unstale":"2024-09-12T18:01:50.995939+0000","last_undegraded":"2024-09-12T18:01:50.995939+0000","last_fullsized":"2024-09-12T18:01:50.995939+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:10.880499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306617,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":429,"num_read_kb":57192,"num_write":879,"num_write_kb":43690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"261'412","reported_seq":1898,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559469+0000","last_change":"2024-09-12T17:23:42.147003+0000","last_active":"2024-09-12T18:00:18.559469+0000","last_peered":"2024-09-12T18:00:18.559469+0000","last_clean":"2024-09-12T18:00:18.559469+0000","last_became_active":"2024-09-12T17:23:42.146394+0000","last_became_peered":"2024-09-12T17:23:42.146394+0000","last_unstale":"2024-09-12T18:00:18.559469+0000","last_undegraded":"2024-09-12T18:00:18.559469+0000","last_fullsized":"2024-09-12T18:00:18.559469+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:36.451547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2184,"num_read_kb":2068,"num_write":471,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"261'360","reported_seq":1101,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.050835+0000","last_change":"2024-09-12T17:23:40.712996+0000","last_active":"2024-09-12T18:01:51.050835+0000","last_peered":"2024-09-12T18:01:51.050835+0000","last_clean":"2024-09-12T18:01:51.050835+0000","last_became_active":"2024-09-12T17:23:40.712702+0000","last_became_peered":"2024-09-12T17:23:40.712702+0000","last_unstale":"2024-09-12T18:01:51.050835+0000","last_undegraded":"2024-09-12T18:01:51.050835+0000","last_fullsized":"2024-09-12T18:01:51.050835+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:27.121297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":720,"num_read_kb":69814,"num_write":1187,"num_write_kb":31106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"261'857","reported_seq":2441,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.776265+0000","last_change":"2024-09-12T17:23:42.143639+0000","last_active":"2024-09-12T18:00:15.776265+0000","last_peered":"2024-09-12T18:00:15.776265+0000","last_clean":"2024-09-12T18:00:15.776265+0000","last_became_active":"2024-09-12T17:23:42.141605+0000","last_became_peered":"2024-09-12T17:23:42.141605+0000","last_unstale":"2024-09-12T18:00:15.776265+0000","last_undegraded":"2024-09-12T18:00:15.776265+0000","last_fullsized":"2024-09-12T18:00:15.776265+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:51.809611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4009,"num_read_kb":3625,"num_write":1130,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"261'303","reported_seq":1029,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.029004+0000","last_change":"2024-09-12T17:23:40.716113+0000","last_active":"2024-09-12T18:01:51.029004+0000","last_peered":"2024-09-12T18:01:51.029004+0000","last_clean":"2024-09-12T18:01:51.029004+0000","last_became_active":"2024-09-12T17:23:40.715809+0000","last_became_peered":"2024-09-12T17:23:40.715809+0000","last_unstale":"2024-09-12T18:01:51.029004+0000","last_undegraded":"2024-09-12T18:01:51.029004+0000","last_fullsized":"2024-09-12T18:01:51.029004+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:47.361193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":740,"num_read_kb":58572,"num_write":1029,"num_write_kb":36244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"261'1242","reported_seq":2732,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.227974+0000","last_change":"2024-09-12T17:23:42.155774+0000","last_active":"2024-09-12T18:00:05.227974+0000","last_peered":"2024-09-12T18:00:05.227974+0000","last_clean":"2024-09-12T18:00:05.227974+0000","last_became_active":"2024-09-12T17:23:42.155489+0000","last_became_peered":"2024-09-12T17:23:42.155489+0000","last_unstale":"2024-09-12T18:00:05.227974+0000","last_undegraded":"2024-09-12T18:00:05.227974+0000","last_fullsized":"2024-09-12T18:00:05.227974+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:36.957522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5619,"num_read_kb":4947,"num_write":1761,"num_write_kb":787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"261'361","reported_seq":988,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.979380+0000","last_change":"2024-09-12T17:23:40.704880+0000","last_active":"2024-09-12T18:01:50.979380+0000","last_peered":"2024-09-12T18:01:50.979380+0000","last_clean":"2024-09-12T18:01:50.979380+0000","last_became_active":"2024-09-12T17:23:40.704582+0000","last_became_peered":"2024-09-12T17:23:40.704582+0000","last_unstale":"2024-09-12T18:01:50.979380+0000","last_undegraded":"2024-09-12T18:01:50.979380+0000","last_fullsized":"2024-09-12T18:01:50.979380+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:16.868554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5258296,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":535,"num_read_kb":13831,"num_write":1155,"num_write_kb":46857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"261'752","reported_seq":2383,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:01.852133+0000","last_change":"2024-09-12T17:23:42.141856+0000","last_active":"2024-09-12T18:00:01.852133+0000","last_peered":"2024-09-12T18:00:01.852133+0000","last_clean":"2024-09-12T18:00:01.852133+0000","last_became_active":"2024-09-12T17:23:42.141542+0000","last_became_peered":"2024-09-12T17:23:42.141542+0000","last_unstale":"2024-09-12T18:00:01.852133+0000","last_undegraded":"2024-09-12T18:00:01.852133+0000","last_fullsized":"2024-09-12T18:00:01.852133+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:24.628553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3956,"num_read_kb":3681,"num_write":1110,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"261'384","reported_seq":1024,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.987735+0000","last_change":"2024-09-12T17:24:17.227402+0000","last_active":"2024-09-12T18:01:50.987735+0000","last_peered":"2024-09-12T18:01:50.987735+0000","last_clean":"2024-09-12T18:01:50.987735+0000","last_became_active":"2024-09-12T17:24:17.227082+0000","last_became_peered":"2024-09-12T17:24:17.227082+0000","last_unstale":"2024-09-12T18:01:50.987735+0000","last_undegraded":"2024-09-12T18:01:50.987735+0000","last_fullsized":"2024-09-12T18:01:50.987735+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:39.821544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":638,"num_read_kb":9829,"num_write":1453,"num_write_kb":18369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"261'766","reported_seq":2160,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.407235+0000","last_change":"2024-09-12T17:23:42.155753+0000","last_active":"2024-09-12T18:01:41.407235+0000","last_peered":"2024-09-12T18:01:41.407235+0000","last_clean":"2024-09-12T18:01:41.407235+0000","last_became_active":"2024-09-12T17:23:42.155052+0000","last_became_peered":"2024-09-12T17:23:42.155052+0000","last_unstale":"2024-09-12T18:01:41.407235+0000","last_undegraded":"2024-09-12T18:01:41.407235+0000","last_fullsized":"2024-09-12T18:01:41.407235+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:06.879341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3588,"num_read_kb":3224,"num_write":1013,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"261'346","reported_seq":1111,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.042468+0000","last_change":"2024-09-12T17:23:40.707697+0000","last_active":"2024-09-12T18:01:51.042468+0000","last_peered":"2024-09-12T18:01:51.042468+0000","last_clean":"2024-09-12T18:01:51.042468+0000","last_became_active":"2024-09-12T17:23:40.707220+0000","last_became_peered":"2024-09-12T17:23:40.707220+0000","last_unstale":"2024-09-12T18:01:51.042468+0000","last_undegraded":"2024-09-12T18:01:51.042468+0000","last_fullsized":"2024-09-12T18:01:51.042468+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:32.088764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5635850,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":676,"num_read_kb":59084,"num_write":1125,"num_write_kb":27945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"261'437","reported_seq":1932,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.785671+0000","last_change":"2024-09-12T17:23:42.135161+0000","last_active":"2024-09-12T18:00:05.785671+0000","last_peered":"2024-09-12T18:00:05.785671+0000","last_clean":"2024-09-12T18:00:05.785671+0000","last_became_active":"2024-09-12T17:23:42.134859+0000","last_became_peered":"2024-09-12T17:23:42.134859+0000","last_unstale":"2024-09-12T18:00:05.785671+0000","last_undegraded":"2024-09-12T18:00:05.785671+0000","last_fullsized":"2024-09-12T18:00:05.785671+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:02.200019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2327,"num_read_kb":2188,"num_write":509,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"261'324","reported_seq":957,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.924990+0000","last_change":"2024-09-12T17:23:40.711309+0000","last_active":"2024-09-12T18:01:50.924990+0000","last_peered":"2024-09-12T18:01:50.924990+0000","last_clean":"2024-09-12T18:01:50.924990+0000","last_became_active":"2024-09-12T17:23:40.711042+0000","last_became_peered":"2024-09-12T17:23:40.711042+0000","last_unstale":"2024-09-12T18:01:50.924990+0000","last_undegraded":"2024-09-12T18:01:50.924990+0000","last_fullsized":"2024-09-12T18:01:50.924990+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:52.925495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":531,"num_read_kb":6765,"num_write":1166,"num_write_kb":43884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"261'951","reported_seq":2509,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.982322+0000","last_change":"2024-09-12T17:23:42.141720+0000","last_active":"2024-09-12T18:00:03.982322+0000","last_peered":"2024-09-12T18:00:03.982322+0000","last_clean":"2024-09-12T18:00:03.982322+0000","last_became_active":"2024-09-12T17:23:42.141379+0000","last_became_peered":"2024-09-12T17:23:42.141379+0000","last_unstale":"2024-09-12T18:00:03.982322+0000","last_undegraded":"2024-09-12T18:00:03.982322+0000","last_fullsized":"2024-09-12T18:00:03.982322+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:42.201491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4545,"num_read_kb":4064,"num_write":1359,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"261'391","reported_seq":1017,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.022480+0000","last_change":"2024-09-12T17:23:40.704486+0000","last_active":"2024-09-12T18:01:51.022480+0000","last_peered":"2024-09-12T18:01:51.022480+0000","last_clean":"2024-09-12T18:01:51.022480+0000","last_became_active":"2024-09-12T17:23:40.702825+0000","last_became_peered":"2024-09-12T17:23:40.702825+0000","last_unstale":"2024-09-12T18:01:51.022480+0000","last_undegraded":"2024-09-12T18:01:51.022480+0000","last_fullsized":"2024-09-12T18:01:51.022480+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:59.455771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":642,"num_read_kb":543,"num_write":1172,"num_write_kb":8662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"261'394","reported_seq":1802,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.719075+0000","last_change":"2024-09-12T17:23:42.140485+0000","last_active":"2024-09-12T18:00:03.719075+0000","last_peered":"2024-09-12T18:00:03.719075+0000","last_clean":"2024-09-12T18:00:03.719075+0000","last_became_active":"2024-09-12T17:23:42.139735+0000","last_became_peered":"2024-09-12T17:23:42.139735+0000","last_unstale":"2024-09-12T18:00:03.719075+0000","last_undegraded":"2024-09-12T18:00:03.719075+0000","last_fullsized":"2024-09-12T18:00:03.719075+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:08.857406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2037,"num_read_kb":1920,"num_write":445,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"261'342","reported_seq":1003,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.985438+0000","last_change":"2024-09-12T17:23:40.709866+0000","last_active":"2024-09-12T18:01:50.985438+0000","last_peered":"2024-09-12T18:01:50.985438+0000","last_clean":"2024-09-12T18:01:50.985438+0000","last_became_active":"2024-09-12T17:23:40.709392+0000","last_became_peered":"2024-09-12T17:23:40.709392+0000","last_unstale":"2024-09-12T18:01:50.985438+0000","last_undegraded":"2024-09-12T18:01:50.985438+0000","last_fullsized":"2024-09-12T18:01:50.985438+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:11.200927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":64698,"num_write":1140,"num_write_kb":39876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"261'1133","reported_seq":2665,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.137309+0000","last_change":"2024-09-12T17:23:42.154482+0000","last_active":"2024-09-12T18:00:18.137309+0000","last_peered":"2024-09-12T18:00:18.137309+0000","last_clean":"2024-09-12T18:00:18.137309+0000","last_became_active":"2024-09-12T17:23:42.154127+0000","last_became_peered":"2024-09-12T17:23:42.154127+0000","last_unstale":"2024-09-12T18:00:18.137309+0000","last_undegraded":"2024-09-12T18:00:18.137309+0000","last_fullsized":"2024-09-12T18:00:18.137309+0000","mapping_epoch":25,"log_start":"261'1100","ondisk_log_start":"261'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:39.681068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5169,"num_read_kb":4583,"num_write":1562,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"261'345","reported_seq":1031,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.039867+0000","last_change":"2024-09-12T17:23:40.714617+0000","last_active":"2024-09-12T18:01:51.039867+0000","last_peered":"2024-09-12T18:01:51.039867+0000","last_clean":"2024-09-12T18:01:51.039867+0000","last_became_active":"2024-09-12T17:23:40.714343+0000","last_became_peered":"2024-09-12T17:23:40.714343+0000","last_unstale":"2024-09-12T18:01:51.039867+0000","last_undegraded":"2024-09-12T18:01:51.039867+0000","last_fullsized":"2024-09-12T18:01:51.039867+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:08.542048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":610,"num_read_kb":27408,"num_write":1219,"num_write_kb":25060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"261'994","reported_seq":2614,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.219834+0000","last_change":"2024-09-12T17:23:42.146400+0000","last_active":"2024-09-12T18:00:05.219834+0000","last_peered":"2024-09-12T18:00:05.219834+0000","last_clean":"2024-09-12T18:00:05.219834+0000","last_became_active":"2024-09-12T17:23:42.146107+0000","last_became_peered":"2024-09-12T17:23:42.146107+0000","last_unstale":"2024-09-12T18:00:05.219834+0000","last_undegraded":"2024-09-12T18:00:05.219834+0000","last_fullsized":"2024-09-12T18:00:05.219834+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:14.764258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4676,"num_read_kb":4145,"num_write":1343,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"261'332","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.040313+0000","last_change":"2024-09-12T17:23:40.707232+0000","last_active":"2024-09-12T18:01:51.040313+0000","last_peered":"2024-09-12T18:01:51.040313+0000","last_clean":"2024-09-12T18:01:51.040313+0000","last_became_active":"2024-09-12T17:23:40.706951+0000","last_became_peered":"2024-09-12T17:23:40.706951+0000","last_unstale":"2024-09-12T18:01:51.040313+0000","last_undegraded":"2024-09-12T18:01:51.040313+0000","last_fullsized":"2024-09-12T18:01:51.040313+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:17.981456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918016,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":7215,"num_write":977,"num_write_kb":28374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"261'489","reported_seq":1993,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.982703+0000","last_change":"2024-09-12T17:23:42.153312+0000","last_active":"2024-09-12T18:00:03.982703+0000","last_peered":"2024-09-12T18:00:03.982703+0000","last_clean":"2024-09-12T18:00:03.982703+0000","last_became_active":"2024-09-12T17:23:42.152999+0000","last_became_peered":"2024-09-12T17:23:42.152999+0000","last_unstale":"2024-09-12T18:00:03.982703+0000","last_undegraded":"2024-09-12T18:00:03.982703+0000","last_fullsized":"2024-09-12T18:00:03.982703+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:03.127915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2525,"num_read_kb":2342,"num_write":624,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"261'350","reported_seq":967,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.041936+0000","last_change":"2024-09-12T17:23:40.705092+0000","last_active":"2024-09-12T18:01:51.041936+0000","last_peered":"2024-09-12T18:01:51.041936+0000","last_clean":"2024-09-12T18:01:51.041936+0000","last_became_active":"2024-09-12T17:23:40.704585+0000","last_became_peered":"2024-09-12T17:23:40.704585+0000","last_unstale":"2024-09-12T18:01:51.041936+0000","last_undegraded":"2024-09-12T18:01:51.041936+0000","last_fullsized":"2024-09-12T18:01:51.041936+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:15.307799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262306,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":466,"num_read_kb":452,"num_write":1104,"num_write_kb":34111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"261'439","reported_seq":2020,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.777791+0000","last_change":"2024-09-12T17:23:42.154717+0000","last_active":"2024-09-12T18:00:15.777791+0000","last_peered":"2024-09-12T18:00:15.777791+0000","last_clean":"2024-09-12T18:00:15.777791+0000","last_became_active":"2024-09-12T17:23:42.154367+0000","last_became_peered":"2024-09-12T17:23:42.154367+0000","last_unstale":"2024-09-12T18:00:15.777791+0000","last_undegraded":"2024-09-12T18:00:15.777791+0000","last_fullsized":"2024-09-12T18:00:15.777791+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:21.496903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2387,"num_read_kb":2268,"num_write":501,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"261'397","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.974339+0000","last_change":"2024-09-12T17:24:17.287754+0000","last_active":"2024-09-12T18:01:50.974339+0000","last_peered":"2024-09-12T18:01:50.974339+0000","last_clean":"2024-09-12T18:01:50.974339+0000","last_became_active":"2024-09-12T17:24:17.287516+0000","last_became_peered":"2024-09-12T17:24:17.287516+0000","last_unstale":"2024-09-12T18:01:50.974339+0000","last_undegraded":"2024-09-12T18:01:50.974339+0000","last_fullsized":"2024-09-12T18:01:50.974339+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:04.002445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":2150,"num_write":1211,"num_write_kb":17735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"261'364","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.990946+0000","last_change":"2024-09-12T17:23:40.706233+0000","last_active":"2024-09-12T18:01:50.990946+0000","last_peered":"2024-09-12T18:01:50.990946+0000","last_clean":"2024-09-12T18:01:50.990946+0000","last_became_active":"2024-09-12T17:23:40.705975+0000","last_became_peered":"2024-09-12T17:23:40.705975+0000","last_unstale":"2024-09-12T18:01:50.990946+0000","last_undegraded":"2024-09-12T18:01:50.990946+0000","last_fullsized":"2024-09-12T18:01:50.990946+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:14.609978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102345,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":38544,"num_write":1177,"num_write_kb":29966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"261'887","reported_seq":2649,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.400463+0000","last_change":"2024-09-12T17:23:42.156067+0000","last_active":"2024-09-12T18:01:41.400463+0000","last_peered":"2024-09-12T18:01:41.400463+0000","last_clean":"2024-09-12T18:01:41.400463+0000","last_became_active":"2024-09-12T17:23:42.155431+0000","last_became_peered":"2024-09-12T17:23:42.155431+0000","last_unstale":"2024-09-12T18:01:41.400463+0000","last_undegraded":"2024-09-12T18:01:41.400463+0000","last_fullsized":"2024-09-12T18:01:41.400463+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:57.623164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4337,"num_read_kb":3945,"num_write":1177,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"261'318","reported_seq":963,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.021401+0000","last_change":"2024-09-12T17:23:40.714200+0000","last_active":"2024-09-12T18:01:51.021401+0000","last_peered":"2024-09-12T18:01:51.021401+0000","last_clean":"2024-09-12T18:01:51.021401+0000","last_became_active":"2024-09-12T17:23:40.713729+0000","last_became_peered":"2024-09-12T17:23:40.713729+0000","last_unstale":"2024-09-12T18:01:51.021401+0000","last_undegraded":"2024-09-12T18:01:51.021401+0000","last_fullsized":"2024-09-12T18:01:51.021401+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:29.670887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6690697,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":468,"num_read_kb":88924,"num_write":1000,"num_write_kb":31954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"261'919","reported_seq":2505,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.399527+0000","last_change":"2024-09-12T17:23:42.151306+0000","last_active":"2024-09-12T18:01:41.399527+0000","last_peered":"2024-09-12T18:01:41.399527+0000","last_clean":"2024-09-12T18:01:41.399527+0000","last_became_active":"2024-09-12T17:23:42.151035+0000","last_became_peered":"2024-09-12T17:23:42.151035+0000","last_unstale":"2024-09-12T18:01:41.399527+0000","last_undegraded":"2024-09-12T18:01:41.399527+0000","last_fullsized":"2024-09-12T18:01:41.399527+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":900,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:08.657281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4231,"num_read_kb":3788,"num_write":1202,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6418,"num_read_kb":4664,"num_write":2041,"num_write_kb":938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1112,"ondisk_log_size":1112,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16069,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16200,"num_read_kb":15888,"num_write":16774,"num_write_kb":4891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1650,"ondisk_log_size":1650,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":688,"ondisk_log_size":688,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1568925,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":16943,"num_read_kb":36201,"num_write":14185,"num_write_kb":11429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2184,"ondisk_log_size":2184,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2424,"num_read_kb":2890,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212759,"num_read_kb":194564,"num_write":55413,"num_write_kb":18856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3940,"ondisk_log_size":3940,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":82077927,"num_objects":360,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":360,"num_whiteouts":0,"num_read":36160,"num_read_kb":2097994,"num_write":72463,"num_write_kb":2176823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":165306368,"data_stored":164155854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3783,"ondisk_log_size":3783,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":196116,"num_write":158,"num_write_kb":127401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":185777,"num_write":158,"num_write_kb":127401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509905,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313724,"kb_used_data":39404,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94058116,"statfs":{"total":96636764160,"available":96315510784,"internally_reserved":0,"allocated":40349696,"data_stored":38689531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509905,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263736,"kb_used_data":11636,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94108104,"statfs":{"total":96636764160,"available":96366698496,"internally_reserved":0,"allocated":11915264,"data_stored":10326315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509906,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150536,"kb_used_data":28932,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94221304,"statfs":{"total":96636764160,"available":96482615296,"internally_reserved":0,"allocated":29626368,"data_stored":27895637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509906,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108568,"kb_used_data":23200,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94263272,"statfs":{"total":96636764160,"available":96525590528,"internally_reserved":0,"allocated":23756800,"data_stored":22112034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509905,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153664,"kb_used_data":13924,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94218176,"statfs":{"total":96636764160,"available":96479412224,"internally_reserved":0,"allocated":14258176,"data_stored":12683013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509907,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273520,"kb_used_data":21428,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94098320,"statfs":{"total":96636764160,"available":96356679680,"internally_reserved":0,"allocated":21942272,"data_stored":20239121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257882567},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542610,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300580,"kb_used_data":30540,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":94071260,"statfs":{"total":96636764160,"available":96328970240,"internally_reserved":0,"allocated":31272960,"data_stored":29588476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276363719},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542611,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111264,"kb_used_data":21792,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94260576,"statfs":{"total":96636764160,"available":96522829824,"internally_reserved":0,"allocated":22315008,"data_stored":20755157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17715200,"data_stored":17530392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10657792,"data_stored":10563849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18726912,"data_stored":18636740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27639808,"data_stored":27468954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20172800,"data_stored":19992871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25960448,"data_stored":25776028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8314880,"data_stored":8207763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36118528,"data_stored":35979257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":3790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:01:57.857 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.858 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.858 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.858 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.858 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.858 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.858 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.858 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.859 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.859 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.859 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.859 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.859 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.859 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.859 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.859 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.860 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.860 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.860 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.860 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.860 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.860 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.860 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.860 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.860 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.861 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.861 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.861 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.861 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.861 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.861 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.861 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.861 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.861 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.862 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.862 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.862 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.862 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.862 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.862 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.862 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.862 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.863 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.863 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.863 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.863 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.863 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.863 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.863 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.863 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.863 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.864 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.864 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.864 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.864 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.864 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.864 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.864 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.865 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.865 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.865 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.865 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.865 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.865 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.865 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.865 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.866 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.866 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.866 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.866 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.866 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.866 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.866 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.866 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.866 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.867 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.867 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.867 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.867 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.867 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.867 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.867 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.867 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.867 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.867 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.868 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.868 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.868 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.868 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.868 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.868 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.868 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.868 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.869 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.869 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.869 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.869 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.869 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.869 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.870 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.870 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.870 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.870 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.870 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.870 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.870 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.870 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.871 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.871 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.871 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.871 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.871 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.871 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.871 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.871 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.872 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.872 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.872 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.872 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.872 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.872 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.872 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.872 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.873 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.873 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.873 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.873 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.873 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.873 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.873 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.874 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.874 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.874 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.874 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.874 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.874 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.874 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.874 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.874 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.875 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.875 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.875 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.875 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.875 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.875 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.875 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.875 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.875 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.876 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.876 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.876 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.876 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.876 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.876 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.876 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.876 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.876 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.877 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.877 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.877 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.877 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.877 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.877 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.877 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.877 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.878 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.878 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.878 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.878 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.878 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.878 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.878 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.878 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.879 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.879 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.879 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.879 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.879 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.879 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.879 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.879 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.880 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.880 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.880 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.880 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.880 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.880 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.881 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.881 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.881 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.881 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.881 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.881 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.881 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.881 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.882 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.882 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.882 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.882 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.882 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.882 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.882 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.882 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.883 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.883 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.883 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.883 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.883 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.883 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.883 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.883 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.884 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.884 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.884 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.884 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.884 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.884 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.884 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.884 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.884 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.884 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.885 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.885 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.885 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.885 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.885 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.885 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.885 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.885 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.885 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T17:23:24.539348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.886 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T17:23:30.571145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.886 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.886 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.886 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.886 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.886 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.886 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.886 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T17:23:30.571145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.887 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.887 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.887 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.887 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.887 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.887 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.887 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T17:23:30.571145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.887 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.887 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.888 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.888 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.888 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.888 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.888 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T17:23:30.571145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.888 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.888 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.888 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.888 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.889 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.889 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.889 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.889 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T17:23:30.571145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.889 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.889 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.889 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.889 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.889 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.890 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.890 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T17:23:30.571145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.890 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.890 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.890 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.890 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.890 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.890 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.891 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T17:23:30.571145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.891 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.891 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.891 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.891 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.891 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.891 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.891 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T17:23:30.571145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.891 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.891 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.891 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.892 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.892 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.892 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.892 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.892 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.892 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.892 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.892 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.892 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.893 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.893 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.893 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.893 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.893 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.893 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.893 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.894 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.894 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.894 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.894 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.894 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.894 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.894 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.894 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.895 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.895 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.895 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.895 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.895 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.895 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.895 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.896 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.896 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.896 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.896 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.896 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.897 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.897 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.897 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.897 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.897 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.897 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.897 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.897 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.898 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.898 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.898 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.898 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.898 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.898 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.898 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.898 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.898 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.899 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.899 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.899 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.899 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.899 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.899 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.899 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.899 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.899 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.900 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.900 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.900 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.900 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.900 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.900 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.900 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.901 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.901 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.901 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.901 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.901 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.901 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.901 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.901 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.902 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.902 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.902 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.902 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.902 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.902 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.902 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.902 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.903 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.903 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.903 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.903 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.903 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.903 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.903 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.903 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.904 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.904 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.904 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.904 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.904 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.904 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.904 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.904 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.905 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.905 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.905 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.905 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.905 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.905 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.905 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.905 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:01:57.905 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:02:17.907 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:18.266 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:02:18.279 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-12T18:02:18.281 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":1421,"stamp":"2024-09-12T18:02:16.492622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":84255101,"num_objects":839,"num_object_clones":0,"num_object_copies":1678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":839,"num_whiteouts":0,"num_read":291262,"num_read_kb":2734161,"num_write":161335,"num_write_kb":2469395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35973,"num_omap_keys":145,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13464,"ondisk_log_size":13464,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1678344,"kb_used_data":190856,"kb_used_omap":12,"kb_used_meta":1487347,"kb_avail":753296376,"statfs":{"total":773094113280,"available":771375489024,"internally_reserved":0,"allocated":195436544,"data_stored":182289284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1523043891},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35256,"num_omap_keys":142,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005404"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412189+0000","last_change":"2024-09-12T17:50:58.430620+0000","last_active":"2024-09-12T17:58:29.412189+0000","last_peered":"2024-09-12T17:58:29.412189+0000","last_clean":"2024-09-12T17:58:29.412189+0000","last_became_active":"2024-09-12T17:50:58.430327+0000","last_became_peered":"2024-09-12T17:50:58.430327+0000","last_unstale":"2024-09-12T17:58:29.412189+0000","last_undegraded":"2024-09-12T17:58:29.412189+0000","last_fullsized":"2024-09-12T17:58:29.412189+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:08.467218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"261'11","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.719698+0000","last_change":"2024-09-12T17:40:30.414114+0000","last_active":"2024-09-12T18:01:49.719698+0000","last_peered":"2024-09-12T18:01:49.719698+0000","last_clean":"2024-09-12T18:01:49.719698+0000","last_became_active":"2024-09-12T17:40:30.413466+0000","last_became_peered":"2024-09-12T17:40:30.413466+0000","last_unstale":"2024-09-12T18:01:49.719698+0000","last_undegraded":"2024-09-12T18:01:49.719698+0000","last_fullsized":"2024-09-12T18:01:49.719698+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:13.588006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14338,"num_write":26,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'2","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:28.426364+0000","last_change":"2024-09-12T17:40:27.384339+0000","last_active":"2024-09-12T18:00:28.426364+0000","last_peered":"2024-09-12T18:00:28.426364+0000","last_clean":"2024-09-12T18:00:28.426364+0000","last_became_active":"2024-09-12T17:40:27.384052+0000","last_became_peered":"2024-09-12T17:40:27.384052+0000","last_unstale":"2024-09-12T18:00:28.426364+0000","last_undegraded":"2024-09-12T18:00:28.426364+0000","last_fullsized":"2024-09-12T18:00:28.426364+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:44.943293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"261'180","reported_seq":604,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.550175+0000","last_change":"2024-09-12T17:38:51.209021+0000","last_active":"2024-09-12T17:59:44.550175+0000","last_peered":"2024-09-12T17:59:44.550175+0000","last_clean":"2024-09-12T17:59:44.550175+0000","last_became_active":"2024-09-12T17:38:51.208740+0000","last_became_peered":"2024-09-12T17:38:51.208740+0000","last_unstale":"2024-09-12T17:59:44.550175+0000","last_undegraded":"2024-09-12T17:59:44.550175+0000","last_fullsized":"2024-09-12T17:59:44.550175+0000","mapping_epoch":248,"log_start":"258'100","ondisk_log_start":"258'100","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:15.411282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1105,"num_read_kb":819,"num_write":215,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612242+0000","last_change":"2024-09-12T17:50:58.429515+0000","last_active":"2024-09-12T17:58:28.612242+0000","last_peered":"2024-09-12T17:58:28.612242+0000","last_clean":"2024-09-12T17:58:28.612242+0000","last_became_active":"2024-09-12T17:50:58.429172+0000","last_became_peered":"2024-09-12T17:50:58.429172+0000","last_unstale":"2024-09-12T17:58:28.612242+0000","last_undegraded":"2024-09-12T17:58:28.612242+0000","last_fullsized":"2024-09-12T17:58:28.612242+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:58.887773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:34.428739+0000","last_change":"2024-09-12T17:40:30.419563+0000","last_active":"2024-09-12T18:00:34.428739+0000","last_peered":"2024-09-12T18:00:34.428739+0000","last_clean":"2024-09-12T18:00:34.428739+0000","last_became_active":"2024-09-12T17:40:30.419270+0000","last_became_peered":"2024-09-12T17:40:30.419270+0000","last_unstale":"2024-09-12T18:00:34.428739+0000","last_undegraded":"2024-09-12T18:00:34.428739+0000","last_fullsized":"2024-09-12T18:00:34.428739+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:40.594940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.407054+0000","last_change":"2024-09-12T17:40:27.383763+0000","last_active":"2024-09-12T17:57:59.407054+0000","last_peered":"2024-09-12T17:57:59.407054+0000","last_clean":"2024-09-12T17:57:59.407054+0000","last_became_active":"2024-09-12T17:40:27.383464+0000","last_became_peered":"2024-09-12T17:40:27.383464+0000","last_unstale":"2024-09-12T17:57:59.407054+0000","last_undegraded":"2024-09-12T17:57:59.407054+0000","last_fullsized":"2024-09-12T17:57:59.407054+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:17.860149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"261'20","reported_seq":98,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.513810+0000","last_change":"2024-09-12T17:38:51.217668+0000","last_active":"2024-09-12T17:59:54.513810+0000","last_peered":"2024-09-12T17:59:54.513810+0000","last_clean":"2024-09-12T17:59:54.513810+0000","last_became_active":"2024-09-12T17:38:51.217312+0000","last_became_peered":"2024-09-12T17:38:51.217312+0000","last_unstale":"2024-09-12T17:59:54.513810+0000","last_undegraded":"2024-09-12T17:59:54.513810+0000","last_fullsized":"2024-09-12T17:59:54.513810+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:44.870657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":68,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.407763+0000","last_change":"2024-09-12T17:50:58.425626+0000","last_active":"2024-09-12T17:58:14.407763+0000","last_peered":"2024-09-12T17:58:14.407763+0000","last_clean":"2024-09-12T17:58:14.407763+0000","last_became_active":"2024-09-12T17:50:58.425202+0000","last_became_peered":"2024-09-12T17:50:58.425202+0000","last_unstale":"2024-09-12T17:58:14.407763+0000","last_undegraded":"2024-09-12T17:58:14.407763+0000","last_fullsized":"2024-09-12T17:58:14.407763+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:43.003436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546433+0000","last_change":"2024-09-12T17:40:30.428077+0000","last_active":"2024-09-12T17:59:19.546433+0000","last_peered":"2024-09-12T17:59:19.546433+0000","last_clean":"2024-09-12T17:59:19.546433+0000","last_became_active":"2024-09-12T17:40:30.427798+0000","last_became_peered":"2024-09-12T17:40:30.427798+0000","last_unstale":"2024-09-12T17:59:19.546433+0000","last_undegraded":"2024-09-12T17:59:19.546433+0000","last_fullsized":"2024-09-12T17:59:19.546433+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:08.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:28.612294+0000","last_change":"2024-09-12T17:40:27.381742+0000","last_active":"2024-09-12T17:58:28.612294+0000","last_peered":"2024-09-12T17:58:28.612294+0000","last_clean":"2024-09-12T17:58:28.612294+0000","last_became_active":"2024-09-12T17:40:27.381456+0000","last_became_peered":"2024-09-12T17:40:27.381456+0000","last_unstale":"2024-09-12T17:58:28.612294+0000","last_undegraded":"2024-09-12T17:58:28.612294+0000","last_fullsized":"2024-09-12T17:58:28.612294+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:34.919045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"261'39","reported_seq":146,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:54.543334+0000","last_change":"2024-09-12T17:38:51.212514+0000","last_active":"2024-09-12T17:58:54.543334+0000","last_peered":"2024-09-12T17:58:54.543334+0000","last_clean":"2024-09-12T17:58:54.543334+0000","last_became_active":"2024-09-12T17:38:51.212222+0000","last_became_peered":"2024-09-12T17:38:51.212222+0000","last_unstale":"2024-09-12T17:58:54.543334+0000","last_undegraded":"2024-09-12T17:58:54.543334+0000","last_fullsized":"2024-09-12T17:58:54.543334+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:58.957926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":132,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.408592+0000","last_change":"2024-09-12T17:50:58.422072+0000","last_active":"2024-09-12T17:58:18.408592+0000","last_peered":"2024-09-12T17:58:18.408592+0000","last_clean":"2024-09-12T17:58:18.408592+0000","last_became_active":"2024-09-12T17:50:58.421791+0000","last_became_peered":"2024-09-12T17:50:58.421791+0000","last_unstale":"2024-09-12T17:58:18.408592+0000","last_undegraded":"2024-09-12T17:58:18.408592+0000","last_fullsized":"2024-09-12T17:58:18.408592+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:23.289873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'3","reported_seq":30,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.562664+0000","last_change":"2024-09-12T17:41:17.634582+0000","last_active":"2024-09-12T18:01:19.562664+0000","last_peered":"2024-09-12T18:01:19.562664+0000","last_clean":"2024-09-12T18:01:19.562664+0000","last_became_active":"2024-09-12T17:41:17.634263+0000","last_became_peered":"2024-09-12T17:41:17.634263+0000","last_unstale":"2024-09-12T18:01:19.562664+0000","last_undegraded":"2024-09-12T18:01:19.562664+0000","last_fullsized":"2024-09-12T18:01:19.562664+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:21.737434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1f","version":"261'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.434726+0000","last_change":"2024-09-12T17:40:27.381866+0000","last_active":"2024-09-12T18:01:19.434726+0000","last_peered":"2024-09-12T18:01:19.434726+0000","last_clean":"2024-09-12T18:01:19.434726+0000","last_became_active":"2024-09-12T17:40:27.381587+0000","last_became_peered":"2024-09-12T17:40:27.381587+0000","last_unstale":"2024-09-12T18:01:19.434726+0000","last_undegraded":"2024-09-12T18:01:19.434726+0000","last_fullsized":"2024-09-12T18:01:19.434726+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:05.484868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"261'16","reported_seq":86,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:53.414258+0000","last_change":"2024-09-12T17:38:51.211725+0000","last_active":"2024-09-12T17:58:53.414258+0000","last_peered":"2024-09-12T17:58:53.414258+0000","last_clean":"2024-09-12T17:58:53.414258+0000","last_became_active":"2024-09-12T17:38:51.211429+0000","last_became_peered":"2024-09-12T17:38:51.211429+0000","last_unstale":"2024-09-12T17:58:53.414258+0000","last_undegraded":"2024-09-12T17:58:53.414258+0000","last_fullsized":"2024-09-12T17:58:53.414258+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:51.433082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":53,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:03.415591+0000","last_change":"2024-09-12T17:50:58.425178+0000","last_active":"2024-09-12T17:59:03.415591+0000","last_peered":"2024-09-12T17:59:03.415591+0000","last_clean":"2024-09-12T17:59:03.415591+0000","last_became_active":"2024-09-12T17:50:58.424898+0000","last_became_peered":"2024-09-12T17:50:58.424898+0000","last_unstale":"2024-09-12T17:59:03.415591+0000","last_undegraded":"2024-09-12T17:59:03.415591+0000","last_fullsized":"2024-09-12T17:59:03.415591+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:43.460057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.403387+0000","last_change":"2024-09-12T17:40:30.419273+0000","last_active":"2024-09-12T17:57:29.403387+0000","last_peered":"2024-09-12T17:57:29.403387+0000","last_clean":"2024-09-12T17:57:29.403387+0000","last_became_active":"2024-09-12T17:40:30.418865+0000","last_became_peered":"2024-09-12T17:40:30.418865+0000","last_unstale":"2024-09-12T17:57:29.403387+0000","last_undegraded":"2024-09-12T17:57:29.403387+0000","last_fullsized":"2024-09-12T17:57:29.403387+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:37.865615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'8","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.622468+0000","last_change":"2024-09-12T17:40:27.384760+0000","last_active":"2024-09-12T18:01:50.622468+0000","last_peered":"2024-09-12T18:01:50.622468+0000","last_clean":"2024-09-12T18:01:50.622468+0000","last_became_active":"2024-09-12T17:40:27.384445+0000","last_became_peered":"2024-09-12T17:40:27.384445+0000","last_unstale":"2024-09-12T18:01:50.622468+0000","last_undegraded":"2024-09-12T18:01:50.622468+0000","last_fullsized":"2024-09-12T18:01:50.622468+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"261'42","reported_seq":159,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.511172+0000","last_change":"2024-09-12T17:38:51.217731+0000","last_active":"2024-09-12T17:59:16.511172+0000","last_peered":"2024-09-12T17:59:16.511172+0000","last_clean":"2024-09-12T17:59:16.511172+0000","last_became_active":"2024-09-12T17:38:51.217421+0000","last_became_peered":"2024-09-12T17:38:51.217421+0000","last_unstale":"2024-09-12T17:59:16.511172+0000","last_undegraded":"2024-09-12T17:59:16.511172+0000","last_fullsized":"2024-09-12T17:59:16.511172+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:29.905573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":155,"num_write":73,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.418508+0000","last_change":"2024-09-12T17:50:58.422069+0000","last_active":"2024-09-12T17:59:19.418508+0000","last_peered":"2024-09-12T17:59:19.418508+0000","last_clean":"2024-09-12T17:59:19.418508+0000","last_became_active":"2024-09-12T17:50:58.421760+0000","last_became_peered":"2024-09-12T17:50:58.421760+0000","last_unstale":"2024-09-12T17:59:19.418508+0000","last_undegraded":"2024-09-12T17:59:19.418508+0000","last_fullsized":"2024-09-12T17:59:19.418508+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:17.645861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'2","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.420697+0000","last_change":"2024-09-12T17:40:30.417805+0000","last_active":"2024-09-12T17:59:54.420697+0000","last_peered":"2024-09-12T17:59:54.420697+0000","last_clean":"2024-09-12T17:59:54.420697+0000","last_became_active":"2024-09-12T17:40:30.417372+0000","last_became_peered":"2024-09-12T17:40:30.417372+0000","last_unstale":"2024-09-12T17:59:54.420697+0000","last_undegraded":"2024-09-12T17:59:54.420697+0000","last_fullsized":"2024-09-12T17:59:54.420697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:46.977654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"258'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.403961+0000","last_change":"2024-09-12T17:40:27.379433+0000","last_active":"2024-09-12T17:57:29.403961+0000","last_peered":"2024-09-12T17:57:29.403961+0000","last_clean":"2024-09-12T17:57:29.403961+0000","last_became_active":"2024-09-12T17:40:27.379161+0000","last_became_peered":"2024-09-12T17:40:27.379161+0000","last_unstale":"2024-09-12T17:57:29.403961+0000","last_undegraded":"2024-09-12T17:57:29.403961+0000","last_fullsized":"2024-09-12T17:57:29.403961+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:17.149187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"261'20","reported_seq":98,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:54.413353+0000","last_change":"2024-09-12T17:38:51.214836+0000","last_active":"2024-09-12T17:58:54.413353+0000","last_peered":"2024-09-12T17:58:54.413353+0000","last_clean":"2024-09-12T17:58:54.413353+0000","last_became_active":"2024-09-12T17:38:51.214555+0000","last_became_peered":"2024-09-12T17:38:51.214555+0000","last_unstale":"2024-09-12T17:58:54.413353+0000","last_undegraded":"2024-09-12T17:58:54.413353+0000","last_fullsized":"2024-09-12T17:58:54.413353+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:24.488340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412872+0000","last_change":"2024-09-12T17:50:58.429666+0000","last_active":"2024-09-12T17:58:29.412872+0000","last_peered":"2024-09-12T17:58:29.412872+0000","last_clean":"2024-09-12T17:58:29.412872+0000","last_became_active":"2024-09-12T17:50:58.429381+0000","last_became_peered":"2024-09-12T17:50:58.429381+0000","last_unstale":"2024-09-12T17:58:29.412872+0000","last_undegraded":"2024-09-12T17:58:29.412872+0000","last_fullsized":"2024-09-12T17:58:29.412872+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:24.108837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:04.406346+0000","last_change":"2024-09-12T17:40:30.420492+0000","last_active":"2024-09-12T17:58:04.406346+0000","last_peered":"2024-09-12T17:58:04.406346+0000","last_clean":"2024-09-12T17:58:04.406346+0000","last_became_active":"2024-09-12T17:40:30.420165+0000","last_became_peered":"2024-09-12T17:40:30.420165+0000","last_unstale":"2024-09-12T17:58:04.406346+0000","last_undegraded":"2024-09-12T17:58:04.406346+0000","last_fullsized":"2024-09-12T17:58:04.406346+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:02.691513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"261'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:29.427973+0000","last_change":"2024-09-12T17:40:27.382601+0000","last_active":"2024-09-12T18:00:29.427973+0000","last_peered":"2024-09-12T18:00:29.427973+0000","last_clean":"2024-09-12T18:00:29.427973+0000","last_became_active":"2024-09-12T17:40:27.382310+0000","last_became_peered":"2024-09-12T17:40:27.382310+0000","last_unstale":"2024-09-12T18:00:29.427973+0000","last_undegraded":"2024-09-12T18:00:29.427973+0000","last_fullsized":"2024-09-12T18:00:29.427973+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:53.252512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"261'83","reported_seq":276,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537110+0000","last_change":"2024-09-12T17:38:51.213883+0000","last_active":"2024-09-12T17:58:14.537110+0000","last_peered":"2024-09-12T17:58:14.537110+0000","last_clean":"2024-09-12T17:58:14.537110+0000","last_became_active":"2024-09-12T17:38:51.213569+0000","last_became_peered":"2024-09-12T17:38:51.213569+0000","last_unstale":"2024-09-12T17:58:14.537110+0000","last_undegraded":"2024-09-12T17:58:14.537110+0000","last_fullsized":"2024-09-12T17:58:14.537110+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:09.021970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":443,"num_read_kb":326,"num_write":140,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412923+0000","last_change":"2024-09-12T17:50:58.431925+0000","last_active":"2024-09-12T17:58:29.412923+0000","last_peered":"2024-09-12T17:58:29.412923+0000","last_clean":"2024-09-12T17:58:29.412923+0000","last_became_active":"2024-09-12T17:50:58.431242+0000","last_became_peered":"2024-09-12T17:50:58.431242+0000","last_unstale":"2024-09-12T17:58:29.412923+0000","last_undegraded":"2024-09-12T17:58:29.412923+0000","last_fullsized":"2024-09-12T17:58:29.412923+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:38.404256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'2","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:33.427097+0000","last_change":"2024-09-12T17:40:30.417580+0000","last_active":"2024-09-12T18:00:33.427097+0000","last_peered":"2024-09-12T18:00:33.427097+0000","last_clean":"2024-09-12T18:00:33.427097+0000","last_became_active":"2024-09-12T17:40:30.416973+0000","last_became_peered":"2024-09-12T17:40:30.416973+0000","last_unstale":"2024-09-12T18:00:33.427097+0000","last_undegraded":"2024-09-12T18:00:33.427097+0000","last_fullsized":"2024-09-12T18:00:33.427097+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:01.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"258'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.535018+0000","last_change":"2024-09-12T17:40:27.383868+0000","last_active":"2024-09-12T17:57:59.535018+0000","last_peered":"2024-09-12T17:57:59.535018+0000","last_clean":"2024-09-12T17:57:59.535018+0000","last_became_active":"2024-09-12T17:40:27.383589+0000","last_became_peered":"2024-09-12T17:40:27.383589+0000","last_unstale":"2024-09-12T17:57:59.535018+0000","last_undegraded":"2024-09-12T17:57:59.535018+0000","last_fullsized":"2024-09-12T17:57:59.535018+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:33.218417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"261'40","reported_seq":149,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:52.416289+0000","last_change":"2024-09-12T17:38:51.212263+0000","last_active":"2024-09-12T17:59:52.416289+0000","last_peered":"2024-09-12T17:59:52.416289+0000","last_clean":"2024-09-12T17:59:52.416289+0000","last_became_active":"2024-09-12T17:38:51.211962+0000","last_became_peered":"2024-09-12T17:38:51.211962+0000","last_unstale":"2024-09-12T17:59:52.416289+0000","last_undegraded":"2024-09-12T17:59:52.416289+0000","last_fullsized":"2024-09-12T17:59:52.416289+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:27.978434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":137,"num_write":74,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.406991+0000","last_change":"2024-09-12T17:50:58.415378+0000","last_active":"2024-09-12T17:57:59.406991+0000","last_peered":"2024-09-12T17:57:59.406991+0000","last_clean":"2024-09-12T17:57:59.406991+0000","last_became_active":"2024-09-12T17:50:58.415098+0000","last_became_peered":"2024-09-12T17:50:58.415098+0000","last_unstale":"2024-09-12T17:57:59.406991+0000","last_undegraded":"2024-09-12T17:57:59.406991+0000","last_fullsized":"2024-09-12T17:57:59.406991+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:07.460645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:28.400786+0000","last_change":"2024-09-12T17:40:30.426133+0000","last_active":"2024-09-12T17:57:28.400786+0000","last_peered":"2024-09-12T17:57:28.400786+0000","last_clean":"2024-09-12T17:57:28.400786+0000","last_became_active":"2024-09-12T17:40:30.425845+0000","last_became_peered":"2024-09-12T17:40:30.425845+0000","last_unstale":"2024-09-12T17:57:28.400786+0000","last_undegraded":"2024-09-12T17:57:28.400786+0000","last_fullsized":"2024-09-12T17:57:28.400786+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:39.872124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"261'11","reported_seq":64,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.440175+0000","last_change":"2024-09-12T17:40:27.383205+0000","last_active":"2024-09-12T18:01:34.440175+0000","last_peered":"2024-09-12T18:01:34.440175+0000","last_clean":"2024-09-12T18:01:34.440175+0000","last_became_active":"2024-09-12T17:40:27.382833+0000","last_became_peered":"2024-09-12T17:40:27.382833+0000","last_unstale":"2024-09-12T18:01:34.440175+0000","last_undegraded":"2024-09-12T18:01:34.440175+0000","last_fullsized":"2024-09-12T18:01:34.440175+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:27.606242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32770,"num_write":16,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"261'60","reported_seq":203,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537248+0000","last_change":"2024-09-12T17:38:51.214569+0000","last_active":"2024-09-12T17:58:14.537248+0000","last_peered":"2024-09-12T17:58:14.537248+0000","last_clean":"2024-09-12T17:58:14.537248+0000","last_became_active":"2024-09-12T17:38:51.214274+0000","last_became_peered":"2024-09-12T17:38:51.214274+0000","last_unstale":"2024-09-12T17:58:14.537248+0000","last_undegraded":"2024-09-12T17:58:14.537248+0000","last_fullsized":"2024-09-12T17:58:14.537248+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:23.016284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":211,"num_write":107,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:58.608464+0000","last_change":"2024-09-12T17:50:58.426819+0000","last_active":"2024-09-12T17:57:58.608464+0000","last_peered":"2024-09-12T17:57:58.608464+0000","last_clean":"2024-09-12T17:57:58.608464+0000","last_became_active":"2024-09-12T17:50:58.426537+0000","last_became_peered":"2024-09-12T17:50:58.426537+0000","last_unstale":"2024-09-12T17:57:58.608464+0000","last_undegraded":"2024-09-12T17:57:58.608464+0000","last_fullsized":"2024-09-12T17:57:58.608464+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.965601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"261'8","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.435543+0000","last_change":"2024-09-12T17:40:30.427100+0000","last_active":"2024-09-12T18:01:38.435543+0000","last_peered":"2024-09-12T18:01:38.435543+0000","last_clean":"2024-09-12T18:01:38.435543+0000","last_became_active":"2024-09-12T17:40:30.425368+0000","last_became_peered":"2024-09-12T17:40:30.425368+0000","last_unstale":"2024-09-12T18:01:38.435543+0000","last_undegraded":"2024-09-12T18:01:38.435543+0000","last_fullsized":"2024-09-12T18:01:38.435543+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:47.929671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'3","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.017569+0000","last_change":"2024-09-12T17:40:27.380566+0000","last_active":"2024-09-12T18:01:51.017569+0000","last_peered":"2024-09-12T18:01:51.017569+0000","last_clean":"2024-09-12T18:01:51.017569+0000","last_became_active":"2024-09-12T17:40:27.380228+0000","last_became_peered":"2024-09-12T17:40:27.380228+0000","last_unstale":"2024-09-12T18:01:51.017569+0000","last_undegraded":"2024-09-12T18:01:51.017569+0000","last_fullsized":"2024-09-12T18:01:51.017569+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"261'21","reported_seq":99,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.495658+0000","last_change":"2024-09-12T17:38:51.218671+0000","last_active":"2024-09-12T17:59:15.495658+0000","last_peered":"2024-09-12T17:59:15.495658+0000","last_clean":"2024-09-12T17:59:15.495658+0000","last_became_active":"2024-09-12T17:38:51.218309+0000","last_became_peered":"2024-09-12T17:38:51.218309+0000","last_unstale":"2024-09-12T17:59:15.495658+0000","last_undegraded":"2024-09-12T17:59:15.495658+0000","last_fullsized":"2024-09-12T17:59:15.495658+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:45.726103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.408378+0000","last_change":"2024-09-12T17:50:58.425291+0000","last_active":"2024-09-12T17:57:59.408378+0000","last_peered":"2024-09-12T17:57:59.408378+0000","last_clean":"2024-09-12T17:57:59.408378+0000","last_became_active":"2024-09-12T17:50:58.425003+0000","last_became_peered":"2024-09-12T17:50:58.425003+0000","last_unstale":"2024-09-12T17:57:59.408378+0000","last_undegraded":"2024-09-12T17:57:59.408378+0000","last_fullsized":"2024-09-12T17:57:59.408378+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:33.694791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"261'3","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:53.422356+0000","last_change":"2024-09-12T17:40:30.427105+0000","last_active":"2024-09-12T17:59:53.422356+0000","last_peered":"2024-09-12T17:59:53.422356+0000","last_clean":"2024-09-12T17:59:53.422356+0000","last_became_active":"2024-09-12T17:40:30.426714+0000","last_became_peered":"2024-09-12T17:40:30.426714+0000","last_unstale":"2024-09-12T17:59:53.422356+0000","last_undegraded":"2024-09-12T17:59:53.422356+0000","last_fullsized":"2024-09-12T17:59:53.422356+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:21.352761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.413465+0000","last_change":"2024-09-12T17:40:27.382447+0000","last_active":"2024-09-12T17:59:48.413465+0000","last_peered":"2024-09-12T17:59:48.413465+0000","last_clean":"2024-09-12T17:59:48.413465+0000","last_became_active":"2024-09-12T17:40:27.382132+0000","last_became_peered":"2024-09-12T17:40:27.382132+0000","last_unstale":"2024-09-12T17:59:48.413465+0000","last_undegraded":"2024-09-12T17:59:48.413465+0000","last_fullsized":"2024-09-12T17:59:48.413465+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"261'28","reported_seq":122,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.610428+0000","last_change":"2024-09-12T17:38:51.215254+0000","last_active":"2024-09-12T17:58:13.610428+0000","last_peered":"2024-09-12T17:58:13.610428+0000","last_clean":"2024-09-12T17:58:13.610428+0000","last_became_active":"2024-09-12T17:38:51.214963+0000","last_became_peered":"2024-09-12T17:38:51.214963+0000","last_unstale":"2024-09-12T17:58:13.610428+0000","last_undegraded":"2024-09-12T17:58:13.610428+0000","last_fullsized":"2024-09-12T17:58:13.610428+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:33.596786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":103,"num_write":58,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.407865+0000","last_change":"2024-09-12T17:50:58.427202+0000","last_active":"2024-09-12T17:57:59.407865+0000","last_peered":"2024-09-12T17:57:59.407865+0000","last_clean":"2024-09-12T17:57:59.407865+0000","last_became_active":"2024-09-12T17:50:58.426779+0000","last_became_peered":"2024-09-12T17:50:58.426779+0000","last_unstale":"2024-09-12T17:57:59.407865+0000","last_undegraded":"2024-09-12T17:57:59.407865+0000","last_fullsized":"2024-09-12T17:57:59.407865+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:56.570650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"258'6","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:29.404116+0000","last_change":"2024-09-12T17:40:30.419477+0000","last_active":"2024-09-12T17:57:29.404116+0000","last_peered":"2024-09-12T17:57:29.404116+0000","last_clean":"2024-09-12T17:57:29.404116+0000","last_became_active":"2024-09-12T17:40:30.419211+0000","last_became_peered":"2024-09-12T17:40:30.419211+0000","last_unstale":"2024-09-12T17:57:29.404116+0000","last_undegraded":"2024-09-12T17:57:29.404116+0000","last_fullsized":"2024-09-12T17:57:29.404116+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:06.524125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:49.550910+0000","last_change":"2024-09-12T17:40:27.382860+0000","last_active":"2024-09-12T17:59:49.550910+0000","last_peered":"2024-09-12T17:59:49.550910+0000","last_clean":"2024-09-12T17:59:49.550910+0000","last_became_active":"2024-09-12T17:40:27.382564+0000","last_became_peered":"2024-09-12T17:40:27.382564+0000","last_unstale":"2024-09-12T17:59:49.550910+0000","last_undegraded":"2024-09-12T17:59:49.550910+0000","last_fullsized":"2024-09-12T17:59:49.550910+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"261'12","reported_seq":75,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.405626+0000","last_change":"2024-09-12T17:38:51.215105+0000","last_active":"2024-09-12T17:57:39.405626+0000","last_peered":"2024-09-12T17:57:39.405626+0000","last_clean":"2024-09-12T17:57:39.405626+0000","last_became_active":"2024-09-12T17:38:51.214678+0000","last_became_peered":"2024-09-12T17:38:51.214678+0000","last_unstale":"2024-09-12T17:57:39.405626+0000","last_undegraded":"2024-09-12T17:57:39.405626+0000","last_fullsized":"2024-09-12T17:57:39.405626+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:23.825989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":38,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.407844+0000","last_change":"2024-09-12T17:50:58.427915+0000","last_active":"2024-09-12T17:58:13.407844+0000","last_peered":"2024-09-12T17:58:13.407844+0000","last_clean":"2024-09-12T17:58:13.407844+0000","last_became_active":"2024-09-12T17:50:58.427630+0000","last_became_peered":"2024-09-12T17:50:58.427630+0000","last_unstale":"2024-09-12T17:58:13.407844+0000","last_undegraded":"2024-09-12T17:58:13.407844+0000","last_fullsized":"2024-09-12T17:58:13.407844+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:54.698191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"261'14","reported_seq":66,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.149935+0000","last_change":"2024-09-12T17:40:30.413875+0000","last_active":"2024-09-12T18:01:50.149935+0000","last_peered":"2024-09-12T18:01:50.149935+0000","last_clean":"2024-09-12T18:01:50.149935+0000","last_became_active":"2024-09-12T17:40:30.413592+0000","last_became_peered":"2024-09-12T17:40:30.413592+0000","last_unstale":"2024-09-12T18:01:50.149935+0000","last_undegraded":"2024-09-12T18:01:50.149935+0000","last_fullsized":"2024-09-12T18:01:50.149935+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:47.033025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":45058,"num_write":24,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'8","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.435790+0000","last_change":"2024-09-12T17:40:27.382000+0000","last_active":"2024-09-12T18:01:29.435790+0000","last_peered":"2024-09-12T18:01:29.435790+0000","last_clean":"2024-09-12T18:01:29.435790+0000","last_became_active":"2024-09-12T17:40:27.381516+0000","last_became_peered":"2024-09-12T17:40:27.381516+0000","last_unstale":"2024-09-12T18:01:29.435790+0000","last_undegraded":"2024-09-12T18:01:29.435790+0000","last_fullsized":"2024-09-12T18:01:29.435790+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:48.416419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"261'6","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.423962+0000","last_change":"2024-09-12T17:38:51.216019+0000","last_active":"2024-09-12T17:59:54.423962+0000","last_peered":"2024-09-12T17:59:54.423962+0000","last_clean":"2024-09-12T17:59:54.423962+0000","last_became_active":"2024-09-12T17:38:51.215646+0000","last_became_peered":"2024-09-12T17:38:51.215646+0000","last_unstale":"2024-09-12T17:59:54.423962+0000","last_undegraded":"2024-09-12T17:59:54.423962+0000","last_fullsized":"2024-09-12T17:59:54.423962+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537213+0000","last_change":"2024-09-12T17:50:58.423068+0000","last_active":"2024-09-12T17:58:14.537213+0000","last_peered":"2024-09-12T17:58:14.537213+0000","last_clean":"2024-09-12T17:58:14.537213+0000","last_became_active":"2024-09-12T17:50:58.422692+0000","last_became_peered":"2024-09-12T17:50:58.422692+0000","last_unstale":"2024-09-12T17:58:14.537213+0000","last_undegraded":"2024-09-12T17:58:14.537213+0000","last_fullsized":"2024-09-12T17:58:14.537213+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:51.624436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.434925+0000","last_change":"2024-09-12T17:40:30.419235+0000","last_active":"2024-09-12T18:01:29.434925+0000","last_peered":"2024-09-12T18:01:29.434925+0000","last_clean":"2024-09-12T18:01:29.434925+0000","last_became_active":"2024-09-12T17:40:30.418904+0000","last_became_peered":"2024-09-12T17:40:30.418904+0000","last_unstale":"2024-09-12T18:01:29.434925+0000","last_undegraded":"2024-09-12T18:01:29.434925+0000","last_fullsized":"2024-09-12T18:01:29.434925+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:39.501098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.416187+0000","last_change":"2024-09-12T17:40:27.382156+0000","last_active":"2024-09-12T17:59:08.416187+0000","last_peered":"2024-09-12T17:59:08.416187+0000","last_clean":"2024-09-12T17:59:08.416187+0000","last_became_active":"2024-09-12T17:40:27.381849+0000","last_became_peered":"2024-09-12T17:40:27.381849+0000","last_unstale":"2024-09-12T17:59:08.416187+0000","last_undegraded":"2024-09-12T17:59:08.416187+0000","last_fullsized":"2024-09-12T17:59:08.416187+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:03.117165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"261'23","reported_seq":104,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.551408+0000","last_change":"2024-09-12T17:38:51.208118+0000","last_active":"2024-09-12T17:59:54.551408+0000","last_peered":"2024-09-12T17:59:54.551408+0000","last_clean":"2024-09-12T17:59:54.551408+0000","last_became_active":"2024-09-12T17:38:51.207804+0000","last_became_peered":"2024-09-12T17:38:51.207804+0000","last_unstale":"2024-09-12T17:59:54.551408+0000","last_undegraded":"2024-09-12T17:59:54.551408+0000","last_fullsized":"2024-09-12T17:59:54.551408+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":76,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.535062+0000","last_change":"2024-09-12T17:50:58.424688+0000","last_active":"2024-09-12T17:57:59.535062+0000","last_peered":"2024-09-12T17:57:59.535062+0000","last_clean":"2024-09-12T17:57:59.535062+0000","last_became_active":"2024-09-12T17:50:58.424379+0000","last_became_peered":"2024-09-12T17:50:58.424379+0000","last_unstale":"2024-09-12T17:57:59.535062+0000","last_undegraded":"2024-09-12T17:57:59.535062+0000","last_fullsized":"2024-09-12T17:57:59.535062+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:33.922718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:13.416845+0000","last_change":"2024-09-12T17:40:30.418399+0000","last_active":"2024-09-12T17:59:13.416845+0000","last_peered":"2024-09-12T17:59:13.416845+0000","last_clean":"2024-09-12T17:59:13.416845+0000","last_became_active":"2024-09-12T17:40:30.417111+0000","last_became_peered":"2024-09-12T17:40:30.417111+0000","last_unstale":"2024-09-12T17:59:13.416845+0000","last_undegraded":"2024-09-12T17:59:13.416845+0000","last_fullsized":"2024-09-12T17:59:13.416845+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:35.848674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415357+0000","last_change":"2024-09-12T17:40:27.378507+0000","last_active":"2024-09-12T17:59:09.415357+0000","last_peered":"2024-09-12T17:59:09.415357+0000","last_clean":"2024-09-12T17:59:09.415357+0000","last_became_active":"2024-09-12T17:40:27.378245+0000","last_became_peered":"2024-09-12T17:40:27.378245+0000","last_unstale":"2024-09-12T17:59:09.415357+0000","last_undegraded":"2024-09-12T17:59:09.415357+0000","last_fullsized":"2024-09-12T17:59:09.415357+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:43.060058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"261'38","reported_seq":154,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.423582+0000","last_change":"2024-09-12T17:38:51.209261+0000","last_active":"2024-09-12T17:59:54.423582+0000","last_peered":"2024-09-12T17:59:54.423582+0000","last_clean":"2024-09-12T17:59:54.423582+0000","last_became_active":"2024-09-12T17:38:51.208950+0000","last_became_peered":"2024-09-12T17:38:51.208950+0000","last_unstale":"2024-09-12T17:59:54.423582+0000","last_undegraded":"2024-09-12T17:59:54.423582+0000","last_fullsized":"2024-09-12T17:59:54.423582+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":143,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.407814+0000","last_change":"2024-09-12T17:50:58.426040+0000","last_active":"2024-09-12T17:58:13.407814+0000","last_peered":"2024-09-12T17:58:13.407814+0000","last_clean":"2024-09-12T17:58:13.407814+0000","last_became_active":"2024-09-12T17:50:58.425574+0000","last_became_peered":"2024-09-12T17:50:58.425574+0000","last_unstale":"2024-09-12T17:58:13.407814+0000","last_undegraded":"2024-09-12T17:58:13.407814+0000","last_fullsized":"2024-09-12T17:58:13.407814+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:39.335745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.415906+0000","last_change":"2024-09-12T17:40:30.412045+0000","last_active":"2024-09-12T17:59:14.415906+0000","last_peered":"2024-09-12T17:59:14.415906+0000","last_clean":"2024-09-12T17:59:14.415906+0000","last_became_active":"2024-09-12T17:40:30.411737+0000","last_became_peered":"2024-09-12T17:40:30.411737+0000","last_unstale":"2024-09-12T17:59:14.415906+0000","last_undegraded":"2024-09-12T17:59:14.415906+0000","last_fullsized":"2024-09-12T17:59:14.415906+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:10.622751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417509+0000","last_change":"2024-09-12T17:40:27.372635+0000","last_active":"2024-09-12T17:59:09.417509+0000","last_peered":"2024-09-12T17:59:09.417509+0000","last_clean":"2024-09-12T17:59:09.417509+0000","last_became_active":"2024-09-12T17:40:27.372357+0000","last_became_peered":"2024-09-12T17:40:27.372357+0000","last_unstale":"2024-09-12T17:59:09.417509+0000","last_undegraded":"2024-09-12T17:59:09.417509+0000","last_fullsized":"2024-09-12T17:59:09.417509+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:34.828926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"261'42","reported_seq":151,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:53.422224+0000","last_change":"2024-09-12T17:38:51.208068+0000","last_active":"2024-09-12T17:59:53.422224+0000","last_peered":"2024-09-12T17:59:53.422224+0000","last_clean":"2024-09-12T17:59:53.422224+0000","last_became_active":"2024-09-12T17:38:51.207798+0000","last_became_peered":"2024-09-12T17:38:51.207798+0000","last_unstale":"2024-09-12T17:59:53.422224+0000","last_undegraded":"2024-09-12T17:59:53.422224+0000","last_fullsized":"2024-09-12T17:59:53.422224+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":137,"num_write":80,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.621049+0000","last_change":"2024-09-12T17:50:58.428924+0000","last_active":"2024-09-12T17:59:38.621049+0000","last_peered":"2024-09-12T17:59:38.621049+0000","last_clean":"2024-09-12T17:59:38.621049+0000","last_became_active":"2024-09-12T17:50:58.428339+0000","last_became_peered":"2024-09-12T17:50:58.428339+0000","last_unstale":"2024-09-12T17:59:38.621049+0000","last_undegraded":"2024-09-12T17:59:38.621049+0000","last_fullsized":"2024-09-12T17:59:38.621049+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:46.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"261'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:48.429079+0000","last_change":"2024-09-12T17:40:30.417879+0000","last_active":"2024-09-12T18:00:48.429079+0000","last_peered":"2024-09-12T18:00:48.429079+0000","last_clean":"2024-09-12T18:00:48.429079+0000","last_became_active":"2024-09-12T17:40:30.417583+0000","last_became_peered":"2024-09-12T17:40:30.417583+0000","last_unstale":"2024-09-12T18:00:48.429079+0000","last_undegraded":"2024-09-12T18:00:48.429079+0000","last_fullsized":"2024-09-12T18:00:48.429079+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:57.147303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"258'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412848+0000","last_change":"2024-09-12T17:40:27.381338+0000","last_active":"2024-09-12T17:58:29.412848+0000","last_peered":"2024-09-12T17:58:29.412848+0000","last_clean":"2024-09-12T17:58:29.412848+0000","last_became_active":"2024-09-12T17:40:27.381027+0000","last_became_peered":"2024-09-12T17:40:27.381027+0000","last_unstale":"2024-09-12T17:58:29.412848+0000","last_undegraded":"2024-09-12T17:58:29.412848+0000","last_fullsized":"2024-09-12T17:58:29.412848+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:16.850258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"261'21","reported_seq":98,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.254313+0000","last_change":"2024-09-12T17:38:51.207794+0000","last_active":"2024-09-12T17:59:54.254313+0000","last_peered":"2024-09-12T17:59:54.254313+0000","last_clean":"2024-09-12T17:59:54.254313+0000","last_became_active":"2024-09-12T17:38:51.207487+0000","last_became_peered":"2024-09-12T17:38:51.207487+0000","last_unstale":"2024-09-12T17:59:54.254313+0000","last_undegraded":"2024-09-12T17:59:54.254313+0000","last_fullsized":"2024-09-12T17:59:54.254313+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:45.756120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":66,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.424626+0000","last_change":"2024-09-12T17:50:58.431273+0000","last_active":"2024-09-12T17:59:59.424626+0000","last_peered":"2024-09-12T17:59:59.424626+0000","last_clean":"2024-09-12T17:59:59.424626+0000","last_became_active":"2024-09-12T17:50:58.430797+0000","last_became_peered":"2024-09-12T17:50:58.430797+0000","last_unstale":"2024-09-12T17:59:59.424626+0000","last_undegraded":"2024-09-12T17:59:59.424626+0000","last_fullsized":"2024-09-12T17:59:59.424626+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"261'5","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.622623+0000","last_change":"2024-09-12T17:40:30.417952+0000","last_active":"2024-09-12T18:01:50.622623+0000","last_peered":"2024-09-12T18:01:50.622623+0000","last_clean":"2024-09-12T18:01:50.622623+0000","last_became_active":"2024-09-12T17:40:30.417567+0000","last_became_peered":"2024-09-12T17:40:30.417567+0000","last_unstale":"2024-09-12T18:01:50.622623+0000","last_undegraded":"2024-09-12T18:01:50.622623+0000","last_fullsized":"2024-09-12T18:01:50.622623+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:56.583902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"261'10","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.420818+0000","last_change":"2024-09-12T17:40:27.384850+0000","last_active":"2024-09-12T18:01:50.420818+0000","last_peered":"2024-09-12T18:01:50.420818+0000","last_clean":"2024-09-12T18:01:50.420818+0000","last_became_active":"2024-09-12T17:40:27.384579+0000","last_became_peered":"2024-09-12T17:40:27.384579+0000","last_unstale":"2024-09-12T18:01:50.420818+0000","last_undegraded":"2024-09-12T18:01:50.420818+0000","last_fullsized":"2024-09-12T18:01:50.420818+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:22.573347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":20,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"261'7","reported_seq":61,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417568+0000","last_change":"2024-09-12T17:38:51.215867+0000","last_active":"2024-09-12T17:59:09.417568+0000","last_peered":"2024-09-12T17:59:09.417568+0000","last_clean":"2024-09-12T17:59:09.417568+0000","last_became_active":"2024-09-12T17:38:51.215590+0000","last_became_peered":"2024-09-12T17:38:51.215590+0000","last_unstale":"2024-09-12T17:59:09.417568+0000","last_undegraded":"2024-09-12T17:59:09.417568+0000","last_fullsized":"2024-09-12T17:59:09.417568+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:33.602009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.418983+0000","last_change":"2024-09-12T17:50:58.427213+0000","last_active":"2024-09-12T17:59:39.418983+0000","last_peered":"2024-09-12T17:59:39.418983+0000","last_clean":"2024-09-12T17:59:39.418983+0000","last_became_active":"2024-09-12T17:50:58.426867+0000","last_became_peered":"2024-09-12T17:50:58.426867+0000","last_unstale":"2024-09-12T17:59:39.418983+0000","last_undegraded":"2024-09-12T17:59:39.418983+0000","last_fullsized":"2024-09-12T17:59:39.418983+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:34.833083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"261'3","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:49.430023+0000","last_change":"2024-09-12T17:40:30.426091+0000","last_active":"2024-09-12T18:00:49.430023+0000","last_peered":"2024-09-12T18:00:49.430023+0000","last_clean":"2024-09-12T18:00:49.430023+0000","last_became_active":"2024-09-12T17:40:30.425775+0000","last_became_peered":"2024-09-12T17:40:30.425775+0000","last_unstale":"2024-09-12T18:00:49.430023+0000","last_undegraded":"2024-09-12T18:00:49.430023+0000","last_fullsized":"2024-09-12T18:00:49.430023+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:32.790479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.539586+0000","last_change":"2024-09-12T17:40:27.382194+0000","last_active":"2024-09-12T17:58:29.539586+0000","last_peered":"2024-09-12T17:58:29.539586+0000","last_clean":"2024-09-12T17:58:29.539586+0000","last_became_active":"2024-09-12T17:40:27.381918+0000","last_became_peered":"2024-09-12T17:40:27.381918+0000","last_unstale":"2024-09-12T17:58:29.539586+0000","last_undegraded":"2024-09-12T17:58:29.539586+0000","last_fullsized":"2024-09-12T17:58:29.539586+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:18.545363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"261'43","reported_seq":159,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.415390+0000","last_change":"2024-09-12T17:38:51.209399+0000","last_active":"2024-09-12T17:59:09.415390+0000","last_peered":"2024-09-12T17:59:09.415390+0000","last_clean":"2024-09-12T17:59:09.415390+0000","last_became_active":"2024-09-12T17:38:51.209135+0000","last_became_peered":"2024-09-12T17:38:51.209135+0000","last_unstale":"2024-09-12T17:59:09.415390+0000","last_undegraded":"2024-09-12T17:59:09.415390+0000","last_fullsized":"2024-09-12T17:59:09.415390+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:55.234380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":150,"num_write":83,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.422143+0000","last_change":"2024-09-12T17:50:58.431873+0000","last_active":"2024-09-12T17:59:39.422143+0000","last_peered":"2024-09-12T17:59:39.422143+0000","last_clean":"2024-09-12T17:59:39.422143+0000","last_became_active":"2024-09-12T17:50:58.431587+0000","last_became_peered":"2024-09-12T17:50:58.431587+0000","last_unstale":"2024-09-12T17:59:39.422143+0000","last_undegraded":"2024-09-12T17:59:39.422143+0000","last_fullsized":"2024-09-12T17:59:39.422143+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:06.651931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411161+0000","last_change":"2024-09-12T17:40:30.418372+0000","last_active":"2024-09-12T17:58:33.411161+0000","last_peered":"2024-09-12T17:58:33.411161+0000","last_clean":"2024-09-12T17:58:33.411161+0000","last_became_active":"2024-09-12T17:40:30.417998+0000","last_became_peered":"2024-09-12T17:40:30.417998+0000","last_unstale":"2024-09-12T17:58:33.411161+0000","last_undegraded":"2024-09-12T17:58:33.411161+0000","last_fullsized":"2024-09-12T17:58:33.411161+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:45.170209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:49.429997+0000","last_change":"2024-09-12T17:40:27.374835+0000","last_active":"2024-09-12T18:00:49.429997+0000","last_peered":"2024-09-12T18:00:49.429997+0000","last_clean":"2024-09-12T18:00:49.429997+0000","last_became_active":"2024-09-12T17:40:27.374557+0000","last_became_peered":"2024-09-12T17:40:27.374557+0000","last_unstale":"2024-09-12T18:00:49.429997+0000","last_undegraded":"2024-09-12T18:00:49.429997+0000","last_fullsized":"2024-09-12T18:00:49.429997+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:19.232907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"261'32","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.084012+0000","last_change":"2024-09-12T17:38:51.216521+0000","last_active":"2024-09-12T17:59:54.084012+0000","last_peered":"2024-09-12T17:59:54.084012+0000","last_clean":"2024-09-12T17:59:54.084012+0000","last_became_active":"2024-09-12T17:38:51.216209+0000","last_became_peered":"2024-09-12T17:38:51.216209+0000","last_unstale":"2024-09-12T17:59:54.084012+0000","last_undegraded":"2024-09-12T17:59:54.084012+0000","last_fullsized":"2024-09-12T17:59:54.084012+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:23.694199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":109,"num_write":55,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.422930+0000","last_change":"2024-09-12T17:50:58.425019+0000","last_active":"2024-09-12T17:59:58.422930+0000","last_peered":"2024-09-12T17:59:58.422930+0000","last_clean":"2024-09-12T17:59:58.422930+0000","last_became_active":"2024-09-12T17:50:58.424452+0000","last_became_peered":"2024-09-12T17:50:58.424452+0000","last_unstale":"2024-09-12T17:59:58.422930+0000","last_undegraded":"2024-09-12T17:59:58.422930+0000","last_fullsized":"2024-09-12T17:59:58.422930+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.424960+0000","last_change":"2024-09-12T17:40:30.418941+0000","last_active":"2024-09-12T18:00:04.424960+0000","last_peered":"2024-09-12T18:00:04.424960+0000","last_clean":"2024-09-12T18:00:04.424960+0000","last_became_active":"2024-09-12T17:40:30.418650+0000","last_became_peered":"2024-09-12T17:40:30.418650+0000","last_unstale":"2024-09-12T18:00:04.424960+0000","last_undegraded":"2024-09-12T18:00:04.424960+0000","last_fullsized":"2024-09-12T18:00:04.424960+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"258'8","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.551958+0000","last_change":"2024-09-12T17:40:27.385454+0000","last_active":"2024-09-12T17:59:59.551958+0000","last_peered":"2024-09-12T17:59:59.551958+0000","last_clean":"2024-09-12T17:59:59.551958+0000","last_became_active":"2024-09-12T17:40:27.385081+0000","last_became_peered":"2024-09-12T17:40:27.385081+0000","last_unstale":"2024-09-12T17:59:59.551958+0000","last_undegraded":"2024-09-12T17:59:59.551958+0000","last_fullsized":"2024-09-12T17:59:59.551958+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"261'37","reported_seq":148,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.545191+0000","last_change":"2024-09-12T17:38:51.209424+0000","last_active":"2024-09-12T17:59:09.545191+0000","last_peered":"2024-09-12T17:59:09.545191+0000","last_clean":"2024-09-12T17:59:09.545191+0000","last_became_active":"2024-09-12T17:38:51.208861+0000","last_became_peered":"2024-09-12T17:38:51.208861+0000","last_unstale":"2024-09-12T17:59:09.545191+0000","last_undegraded":"2024-09-12T17:59:09.545191+0000","last_fullsized":"2024-09-12T17:59:09.545191+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:00.098063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":141,"num_write":67,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.407163+0000","last_change":"2024-09-12T17:50:58.432996+0000","last_active":"2024-09-12T17:57:49.407163+0000","last_peered":"2024-09-12T17:57:49.407163+0000","last_clean":"2024-09-12T17:57:49.407163+0000","last_became_active":"2024-09-12T17:50:58.432245+0000","last_became_peered":"2024-09-12T17:50:58.432245+0000","last_unstale":"2024-09-12T17:57:49.407163+0000","last_undegraded":"2024-09-12T17:57:49.407163+0000","last_fullsized":"2024-09-12T17:57:49.407163+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:12.784598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.425280+0000","last_change":"2024-09-12T17:40:30.425572+0000","last_active":"2024-09-12T18:00:04.425280+0000","last_peered":"2024-09-12T18:00:04.425280+0000","last_clean":"2024-09-12T18:00:04.425280+0000","last_became_active":"2024-09-12T17:40:30.425293+0000","last_became_peered":"2024-09-12T17:40:30.425293+0000","last_unstale":"2024-09-12T18:00:04.425280+0000","last_undegraded":"2024-09-12T18:00:04.425280+0000","last_fullsized":"2024-09-12T18:00:04.425280+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"261'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.619926+0000","last_change":"2024-09-12T17:40:27.377071+0000","last_active":"2024-09-12T18:01:50.619926+0000","last_peered":"2024-09-12T18:01:50.619926+0000","last_clean":"2024-09-12T18:01:50.619926+0000","last_became_active":"2024-09-12T17:40:27.376781+0000","last_became_peered":"2024-09-12T17:40:27.376781+0000","last_unstale":"2024-09-12T18:01:50.619926+0000","last_undegraded":"2024-09-12T18:01:50.619926+0000","last_fullsized":"2024-09-12T18:01:50.619926+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412794+0000","last_change":"2024-09-12T17:38:51.210062+0000","last_active":"2024-09-12T17:58:29.412794+0000","last_peered":"2024-09-12T17:58:29.412794+0000","last_clean":"2024-09-12T17:58:29.412794+0000","last_became_active":"2024-09-12T17:38:51.209772+0000","last_became_peered":"2024-09-12T17:38:51.209772+0000","last_unstale":"2024-09-12T17:58:29.412794+0000","last_undegraded":"2024-09-12T17:58:29.412794+0000","last_fullsized":"2024-09-12T17:58:29.412794+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:25.124534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"261'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.424659+0000","last_change":"2024-09-12T17:50:58.429816+0000","last_active":"2024-09-12T17:59:59.424659+0000","last_peered":"2024-09-12T17:59:59.424659+0000","last_clean":"2024-09-12T17:59:59.424659+0000","last_became_active":"2024-09-12T17:50:58.429551+0000","last_became_peered":"2024-09-12T17:50:58.429551+0000","last_unstale":"2024-09-12T17:59:59.424659+0000","last_undegraded":"2024-09-12T17:59:59.424659+0000","last_fullsized":"2024-09-12T17:59:59.424659+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'7","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:44.429426+0000","last_change":"2024-09-12T17:40:30.409389+0000","last_active":"2024-09-12T18:00:44.429426+0000","last_peered":"2024-09-12T18:00:44.429426+0000","last_clean":"2024-09-12T18:00:44.429426+0000","last_became_active":"2024-09-12T17:40:30.408915+0000","last_became_peered":"2024-09-12T17:40:30.408915+0000","last_unstale":"2024-09-12T18:00:44.429426+0000","last_undegraded":"2024-09-12T18:00:44.429426+0000","last_fullsized":"2024-09-12T18:00:44.429426+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:56.865653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25606,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"258'3","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.552001+0000","last_change":"2024-09-12T17:40:27.382211+0000","last_active":"2024-09-12T17:59:59.552001+0000","last_peered":"2024-09-12T17:59:59.552001+0000","last_clean":"2024-09-12T17:59:59.552001+0000","last_became_active":"2024-09-12T17:40:27.381885+0000","last_became_peered":"2024-09-12T17:40:27.381885+0000","last_unstale":"2024-09-12T17:59:59.552001+0000","last_undegraded":"2024-09-12T17:59:59.552001+0000","last_fullsized":"2024-09-12T17:59:59.552001+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"261'68","reported_seq":231,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.409354+0000","last_change":"2024-09-12T17:38:51.215246+0000","last_active":"2024-09-12T17:58:23.409354+0000","last_peered":"2024-09-12T17:58:23.409354+0000","last_clean":"2024-09-12T17:58:23.409354+0000","last_became_active":"2024-09-12T17:38:51.214940+0000","last_became_peered":"2024-09-12T17:38:51.214940+0000","last_unstale":"2024-09-12T17:58:23.409354+0000","last_undegraded":"2024-09-12T17:58:23.409354+0000","last_fullsized":"2024-09-12T17:58:23.409354+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:11.305564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":356,"num_read_kb":250,"num_write":117,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.552047+0000","last_change":"2024-09-12T17:50:58.421234+0000","last_active":"2024-09-12T17:59:59.552047+0000","last_peered":"2024-09-12T17:59:59.552047+0000","last_clean":"2024-09-12T17:59:59.552047+0000","last_became_active":"2024-09-12T17:50:58.420251+0000","last_became_peered":"2024-09-12T17:50:58.420251+0000","last_unstale":"2024-09-12T17:59:59.552047+0000","last_undegraded":"2024-09-12T17:59:59.552047+0000","last_fullsized":"2024-09-12T17:59:59.552047+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"258'7","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.408453+0000","last_change":"2024-09-12T17:40:30.417703+0000","last_active":"2024-09-12T17:57:59.408453+0000","last_peered":"2024-09-12T17:57:59.408453+0000","last_clean":"2024-09-12T17:57:59.408453+0000","last_became_active":"2024-09-12T17:40:30.417393+0000","last_became_peered":"2024-09-12T17:40:30.417393+0000","last_unstale":"2024-09-12T17:57:59.408453+0000","last_undegraded":"2024-09-12T17:57:59.408453+0000","last_fullsized":"2024-09-12T17:57:59.408453+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:40.700927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":7,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:44.430042+0000","last_change":"2024-09-12T17:40:27.379736+0000","last_active":"2024-09-12T18:00:44.430042+0000","last_peered":"2024-09-12T18:00:44.430042+0000","last_clean":"2024-09-12T18:00:44.430042+0000","last_became_active":"2024-09-12T17:40:27.379472+0000","last_became_peered":"2024-09-12T17:40:27.379472+0000","last_unstale":"2024-09-12T18:00:44.430042+0000","last_undegraded":"2024-09-12T18:00:44.430042+0000","last_fullsized":"2024-09-12T18:00:44.430042+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:36.186301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"261'106","reported_seq":366,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.408959+0000","last_change":"2024-09-12T17:38:51.208031+0000","last_active":"2024-09-12T17:58:24.408959+0000","last_peered":"2024-09-12T17:58:24.408959+0000","last_clean":"2024-09-12T17:58:24.408959+0000","last_became_active":"2024-09-12T17:38:51.207735+0000","last_became_peered":"2024-09-12T17:38:51.207735+0000","last_unstale":"2024-09-12T17:58:24.408959+0000","last_undegraded":"2024-09-12T17:58:24.408959+0000","last_fullsized":"2024-09-12T17:58:24.408959+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:15.007282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":541,"num_write":122,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419330+0000","last_change":"2024-09-12T17:50:58.431116+0000","last_active":"2024-09-12T17:59:19.419330+0000","last_peered":"2024-09-12T17:59:19.419330+0000","last_clean":"2024-09-12T17:59:19.419330+0000","last_became_active":"2024-09-12T17:50:58.430813+0000","last_became_peered":"2024-09-12T17:50:58.430813+0000","last_unstale":"2024-09-12T17:59:19.419330+0000","last_undegraded":"2024-09-12T17:59:19.419330+0000","last_fullsized":"2024-09-12T17:59:19.419330+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:19.189927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546398+0000","last_change":"2024-09-12T17:40:30.411164+0000","last_active":"2024-09-12T17:59:19.546398+0000","last_peered":"2024-09-12T17:59:19.546398+0000","last_clean":"2024-09-12T17:59:19.546398+0000","last_became_active":"2024-09-12T17:40:30.410872+0000","last_became_peered":"2024-09-12T17:40:30.410872+0000","last_unstale":"2024-09-12T17:59:19.546398+0000","last_undegraded":"2024-09-12T17:59:19.546398+0000","last_fullsized":"2024-09-12T17:59:19.546398+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:47.603677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.437671+0000","last_change":"2024-09-12T17:40:27.380593+0000","last_active":"2024-09-12T18:01:19.437671+0000","last_peered":"2024-09-12T18:01:19.437671+0000","last_clean":"2024-09-12T18:01:19.437671+0000","last_became_active":"2024-09-12T17:40:27.380269+0000","last_became_peered":"2024-09-12T17:40:27.380269+0000","last_unstale":"2024-09-12T18:01:19.437671+0000","last_undegraded":"2024-09-12T18:01:19.437671+0000","last_fullsized":"2024-09-12T18:01:19.437671+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:52.967809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"261'42","reported_seq":157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.023193+0000","last_change":"2024-09-12T17:38:51.216559+0000","last_active":"2024-09-12T17:59:16.023193+0000","last_peered":"2024-09-12T17:59:16.023193+0000","last_clean":"2024-09-12T17:59:16.023193+0000","last_became_active":"2024-09-12T17:38:51.216152+0000","last_became_peered":"2024-09-12T17:38:51.216152+0000","last_unstale":"2024-09-12T17:59:16.023193+0000","last_undegraded":"2024-09-12T17:59:16.023193+0000","last_fullsized":"2024-09-12T17:59:16.023193+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:42.821025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":152,"num_write":74,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.418727+0000","last_change":"2024-09-12T17:50:58.431015+0000","last_active":"2024-09-12T17:59:19.418727+0000","last_peered":"2024-09-12T17:59:19.418727+0000","last_clean":"2024-09-12T17:59:19.418727+0000","last_became_active":"2024-09-12T17:50:58.430723+0000","last_became_peered":"2024-09-12T17:50:58.430723+0000","last_unstale":"2024-09-12T17:59:19.418727+0000","last_undegraded":"2024-09-12T17:59:19.418727+0000","last_fullsized":"2024-09-12T17:59:19.418727+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:21.663778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"261'2","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.563246+0000","last_change":"2024-09-12T17:40:30.425667+0000","last_active":"2024-09-12T18:01:24.563246+0000","last_peered":"2024-09-12T18:01:24.563246+0000","last_clean":"2024-09-12T18:01:24.563246+0000","last_became_active":"2024-09-12T17:40:30.425368+0000","last_became_peered":"2024-09-12T17:40:30.425368+0000","last_unstale":"2024-09-12T18:01:24.563246+0000","last_undegraded":"2024-09-12T18:01:24.563246+0000","last_fullsized":"2024-09-12T18:01:24.563246+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:57.448155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:13.618170+0000","last_change":"2024-09-12T17:40:27.384113+0000","last_active":"2024-09-12T17:59:13.618170+0000","last_peered":"2024-09-12T17:59:13.618170+0000","last_clean":"2024-09-12T17:59:13.618170+0000","last_became_active":"2024-09-12T17:40:27.383770+0000","last_became_peered":"2024-09-12T17:40:27.383770+0000","last_unstale":"2024-09-12T17:59:13.618170+0000","last_undegraded":"2024-09-12T17:59:13.618170+0000","last_fullsized":"2024-09-12T17:59:13.618170+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:34.294441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"258'22","reported_seq":108,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.409051+0000","last_change":"2024-09-12T17:38:51.209047+0000","last_active":"2024-09-12T17:58:24.409051+0000","last_peered":"2024-09-12T17:58:24.409051+0000","last_clean":"2024-09-12T17:58:24.409051+0000","last_became_active":"2024-09-12T17:38:51.208767+0000","last_became_peered":"2024-09-12T17:38:51.208767+0000","last_unstale":"2024-09-12T17:58:24.409051+0000","last_undegraded":"2024-09-12T17:58:24.409051+0000","last_fullsized":"2024-09-12T17:58:24.409051+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:21.421941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:04.416155+0000","last_change":"2024-09-12T17:50:58.422944+0000","last_active":"2024-09-12T17:59:04.416155+0000","last_peered":"2024-09-12T17:59:04.416155+0000","last_clean":"2024-09-12T17:59:04.416155+0000","last_became_active":"2024-09-12T17:50:58.422625+0000","last_became_peered":"2024-09-12T17:50:58.422625+0000","last_unstale":"2024-09-12T17:59:04.416155+0000","last_undegraded":"2024-09-12T17:59:04.416155+0000","last_fullsized":"2024-09-12T17:59:04.416155+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:04.987349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.425459+0000","last_change":"2024-09-12T17:40:30.425786+0000","last_active":"2024-09-12T18:00:04.425459+0000","last_peered":"2024-09-12T18:00:04.425459+0000","last_clean":"2024-09-12T18:00:04.425459+0000","last_became_active":"2024-09-12T17:40:30.425536+0000","last_became_peered":"2024-09-12T17:40:30.425536+0000","last_unstale":"2024-09-12T18:00:04.425459+0000","last_undegraded":"2024-09-12T18:00:04.425459+0000","last_fullsized":"2024-09-12T18:00:04.425459+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"258'6","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.424962+0000","last_change":"2024-09-12T17:40:27.382099+0000","last_active":"2024-09-12T17:59:59.424962+0000","last_peered":"2024-09-12T17:59:59.424962+0000","last_clean":"2024-09-12T17:59:59.424962+0000","last_became_active":"2024-09-12T17:40:27.381818+0000","last_became_peered":"2024-09-12T17:40:27.381818+0000","last_unstale":"2024-09-12T17:59:59.424962+0000","last_undegraded":"2024-09-12T17:59:59.424962+0000","last_fullsized":"2024-09-12T17:59:59.424962+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"261'42","reported_seq":166,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:49.423442+0000","last_change":"2024-09-12T17:38:51.211565+0000","last_active":"2024-09-12T17:59:49.423442+0000","last_peered":"2024-09-12T17:59:49.423442+0000","last_clean":"2024-09-12T17:59:49.423442+0000","last_became_active":"2024-09-12T17:38:51.211219+0000","last_became_peered":"2024-09-12T17:38:51.211219+0000","last_unstale":"2024-09-12T17:59:49.423442+0000","last_undegraded":"2024-09-12T17:59:49.423442+0000","last_fullsized":"2024-09-12T17:59:49.423442+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:18.738642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":165,"num_write":70,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419044+0000","last_change":"2024-09-12T17:50:58.416892+0000","last_active":"2024-09-12T17:59:19.419044+0000","last_peered":"2024-09-12T17:59:19.419044+0000","last_clean":"2024-09-12T17:59:19.419044+0000","last_became_active":"2024-09-12T17:50:58.416501+0000","last_became_peered":"2024-09-12T17:50:58.416501+0000","last_unstale":"2024-09-12T17:59:19.419044+0000","last_undegraded":"2024-09-12T17:59:19.419044+0000","last_fullsized":"2024-09-12T17:59:19.419044+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:06.098567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"261'5","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.926782+0000","last_change":"2024-09-12T17:40:30.418747+0000","last_active":"2024-09-12T18:01:50.926782+0000","last_peered":"2024-09-12T18:01:50.926782+0000","last_clean":"2024-09-12T18:01:50.926782+0000","last_became_active":"2024-09-12T17:40:30.418418+0000","last_became_peered":"2024-09-12T17:40:30.418418+0000","last_unstale":"2024-09-12T18:01:50.926782+0000","last_undegraded":"2024-09-12T18:01:50.926782+0000","last_fullsized":"2024-09-12T18:01:50.926782+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.424752+0000","last_change":"2024-09-12T17:40:27.383455+0000","last_active":"2024-09-12T17:59:59.424752+0000","last_peered":"2024-09-12T17:59:59.424752+0000","last_clean":"2024-09-12T17:59:59.424752+0000","last_became_active":"2024-09-12T17:40:27.383023+0000","last_became_peered":"2024-09-12T17:40:27.383023+0000","last_unstale":"2024-09-12T17:59:59.424752+0000","last_undegraded":"2024-09-12T17:59:59.424752+0000","last_fullsized":"2024-09-12T17:59:59.424752+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"261'37","reported_seq":149,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.249331+0000","last_change":"2024-09-12T17:38:51.210126+0000","last_active":"2024-09-12T17:59:54.249331+0000","last_peered":"2024-09-12T17:59:54.249331+0000","last_clean":"2024-09-12T17:59:54.249331+0000","last_became_active":"2024-09-12T17:38:51.209833+0000","last_became_peered":"2024-09-12T17:38:51.209833+0000","last_unstale":"2024-09-12T17:59:54.249331+0000","last_undegraded":"2024-09-12T17:59:54.249331+0000","last_fullsized":"2024-09-12T17:59:54.249331+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:29.524821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":141,"num_write":58,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:38.621111+0000","last_change":"2024-09-12T17:50:58.424105+0000","last_active":"2024-09-12T17:59:38.621111+0000","last_peered":"2024-09-12T17:59:38.621111+0000","last_clean":"2024-09-12T17:59:38.621111+0000","last_became_active":"2024-09-12T17:50:58.423798+0000","last_became_peered":"2024-09-12T17:50:58.423798+0000","last_unstale":"2024-09-12T17:59:38.621111+0000","last_undegraded":"2024-09-12T17:59:38.621111+0000","last_fullsized":"2024-09-12T17:59:38.621111+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:57.214535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.417888+0000","last_change":"2024-09-12T17:40:30.412437+0000","last_active":"2024-09-12T17:59:14.417888+0000","last_peered":"2024-09-12T17:59:14.417888+0000","last_clean":"2024-09-12T17:59:14.417888+0000","last_became_active":"2024-09-12T17:40:30.412140+0000","last_became_peered":"2024-09-12T17:40:30.412140+0000","last_unstale":"2024-09-12T17:59:14.417888+0000","last_undegraded":"2024-09-12T17:59:14.417888+0000","last_fullsized":"2024-09-12T17:59:14.417888+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:44.020052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:34.429669+0000","last_change":"2024-09-12T17:40:27.385866+0000","last_active":"2024-09-12T18:00:34.429669+0000","last_peered":"2024-09-12T18:00:34.429669+0000","last_clean":"2024-09-12T18:00:34.429669+0000","last_became_active":"2024-09-12T17:40:27.385649+0000","last_became_peered":"2024-09-12T17:40:27.385649+0000","last_unstale":"2024-09-12T18:00:34.429669+0000","last_undegraded":"2024-09-12T18:00:34.429669+0000","last_fullsized":"2024-09-12T18:00:34.429669+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:44.080842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"258'14","reported_seq":85,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.422160+0000","last_change":"2024-09-12T17:38:51.216015+0000","last_active":"2024-09-12T17:59:44.422160+0000","last_peered":"2024-09-12T17:59:44.422160+0000","last_clean":"2024-09-12T17:59:44.422160+0000","last_became_active":"2024-09-12T17:38:51.215738+0000","last_became_peered":"2024-09-12T17:38:51.215738+0000","last_unstale":"2024-09-12T17:59:44.422160+0000","last_undegraded":"2024-09-12T17:59:44.422160+0000","last_fullsized":"2024-09-12T17:59:44.422160+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:22.857791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.549295+0000","last_change":"2024-09-12T17:50:58.423755+0000","last_active":"2024-09-12T17:59:39.549295+0000","last_peered":"2024-09-12T17:59:39.549295+0000","last_clean":"2024-09-12T17:59:39.549295+0000","last_became_active":"2024-09-12T17:50:58.423443+0000","last_became_peered":"2024-09-12T17:50:58.423443+0000","last_unstale":"2024-09-12T17:59:39.549295+0000","last_undegraded":"2024-09-12T17:59:39.549295+0000","last_fullsized":"2024-09-12T17:59:39.549295+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:21.905993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:34.412791+0000","last_change":"2024-09-12T17:40:30.415967+0000","last_active":"2024-09-12T17:58:34.412791+0000","last_peered":"2024-09-12T17:58:34.412791+0000","last_clean":"2024-09-12T17:58:34.412791+0000","last_became_active":"2024-09-12T17:40:30.415696+0000","last_became_peered":"2024-09-12T17:40:30.415696+0000","last_unstale":"2024-09-12T17:58:34.412791+0000","last_undegraded":"2024-09-12T17:58:34.412791+0000","last_fullsized":"2024-09-12T17:58:34.412791+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:00.615699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418738+0000","last_change":"2024-09-12T17:40:27.381415+0000","last_active":"2024-09-12T17:59:14.418738+0000","last_peered":"2024-09-12T17:59:14.418738+0000","last_clean":"2024-09-12T17:59:14.418738+0000","last_became_active":"2024-09-12T17:40:27.381128+0000","last_became_peered":"2024-09-12T17:40:27.381128+0000","last_unstale":"2024-09-12T17:59:14.418738+0000","last_undegraded":"2024-09-12T17:59:14.418738+0000","last_fullsized":"2024-09-12T17:59:14.418738+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:41.708551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"261'15","reported_seq":83,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.422414+0000","last_change":"2024-09-12T17:38:51.211542+0000","last_active":"2024-09-12T17:59:44.422414+0000","last_peered":"2024-09-12T17:59:44.422414+0000","last_clean":"2024-09-12T17:59:44.422414+0000","last_became_active":"2024-09-12T17:38:51.210741+0000","last_became_peered":"2024-09-12T17:38:51.210741+0000","last_unstale":"2024-09-12T17:59:44.422414+0000","last_undegraded":"2024-09-12T17:59:44.422414+0000","last_fullsized":"2024-09-12T17:59:44.422414+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:53.102160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":45,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546366+0000","last_change":"2024-09-12T17:50:58.422536+0000","last_active":"2024-09-12T17:59:19.546366+0000","last_peered":"2024-09-12T17:59:19.546366+0000","last_clean":"2024-09-12T17:59:19.546366+0000","last_became_active":"2024-09-12T17:50:58.422195+0000","last_became_peered":"2024-09-12T17:50:58.422195+0000","last_unstale":"2024-09-12T17:59:19.546366+0000","last_undegraded":"2024-09-12T17:59:19.546366+0000","last_fullsized":"2024-09-12T17:59:19.546366+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:53.708044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.416457+0000","last_change":"2024-09-12T17:40:30.418965+0000","last_active":"2024-09-12T17:59:19.416457+0000","last_peered":"2024-09-12T17:59:19.416457+0000","last_clean":"2024-09-12T17:59:19.416457+0000","last_became_active":"2024-09-12T17:40:30.418692+0000","last_became_peered":"2024-09-12T17:40:30.418692+0000","last_unstale":"2024-09-12T17:59:19.416457+0000","last_undegraded":"2024-09-12T17:59:19.416457+0000","last_fullsized":"2024-09-12T17:59:19.416457+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:04.962038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"258'6","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.417950+0000","last_change":"2024-09-12T17:40:27.377091+0000","last_active":"2024-09-12T17:59:14.417950+0000","last_peered":"2024-09-12T17:59:14.417950+0000","last_clean":"2024-09-12T17:59:14.417950+0000","last_became_active":"2024-09-12T17:40:27.376395+0000","last_became_peered":"2024-09-12T17:40:27.376395+0000","last_unstale":"2024-09-12T17:59:14.417950+0000","last_undegraded":"2024-09-12T17:59:14.417950+0000","last_fullsized":"2024-09-12T17:59:14.417950+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:00.248728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"261'24","reported_seq":110,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.419639+0000","last_change":"2024-09-12T17:38:51.213165+0000","last_active":"2024-09-12T17:59:44.419639+0000","last_peered":"2024-09-12T17:59:44.419639+0000","last_clean":"2024-09-12T17:59:44.419639+0000","last_became_active":"2024-09-12T17:38:51.212856+0000","last_became_peered":"2024-09-12T17:38:51.212856+0000","last_unstale":"2024-09-12T17:59:44.419639+0000","last_undegraded":"2024-09-12T17:59:44.419639+0000","last_fullsized":"2024-09-12T17:59:44.419639+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:17.393643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":83,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:24.420242+0000","last_change":"2024-09-12T17:50:58.431889+0000","last_active":"2024-09-12T17:59:24.420242+0000","last_peered":"2024-09-12T17:59:24.420242+0000","last_clean":"2024-09-12T17:59:24.420242+0000","last_became_active":"2024-09-12T17:50:58.431442+0000","last_became_peered":"2024-09-12T17:50:58.431442+0000","last_unstale":"2024-09-12T17:59:24.420242+0000","last_undegraded":"2024-09-12T17:59:24.420242+0000","last_fullsized":"2024-09-12T17:59:24.420242+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:40.014254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419070+0000","last_change":"2024-09-12T17:40:30.418760+0000","last_active":"2024-09-12T17:59:19.419070+0000","last_peered":"2024-09-12T17:59:19.419070+0000","last_clean":"2024-09-12T17:59:19.419070+0000","last_became_active":"2024-09-12T17:40:30.418464+0000","last_became_peered":"2024-09-12T17:40:30.418464+0000","last_unstale":"2024-09-12T17:59:19.419070+0000","last_undegraded":"2024-09-12T17:59:19.419070+0000","last_fullsized":"2024-09-12T17:59:19.419070+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:03.345502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"261'5","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.921356+0000","last_change":"2024-09-12T17:40:27.379405+0000","last_active":"2024-09-12T18:01:49.921356+0000","last_peered":"2024-09-12T18:01:49.921356+0000","last_clean":"2024-09-12T18:01:49.921356+0000","last_became_active":"2024-09-12T17:40:27.379133+0000","last_became_peered":"2024-09-12T17:40:27.379133+0000","last_unstale":"2024-09-12T18:01:49.921356+0000","last_undegraded":"2024-09-12T18:01:49.921356+0000","last_fullsized":"2024-09-12T18:01:49.921356+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:39.813640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"261'32","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:59.417100+0000","last_change":"2024-09-12T17:38:51.208801+0000","last_active":"2024-09-12T17:58:59.417100+0000","last_peered":"2024-09-12T17:58:59.417100+0000","last_clean":"2024-09-12T17:58:59.417100+0000","last_became_active":"2024-09-12T17:38:51.208386+0000","last_became_peered":"2024-09-12T17:38:51.208386+0000","last_unstale":"2024-09-12T17:58:59.417100+0000","last_undegraded":"2024-09-12T17:58:59.417100+0000","last_fullsized":"2024-09-12T17:58:59.417100+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:57.157726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":109,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"261'339","reported_seq":951,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.053797+0000","last_change":"2024-09-12T17:23:40.709230+0000","last_active":"2024-09-12T18:01:51.053797+0000","last_peered":"2024-09-12T18:01:51.053797+0000","last_clean":"2024-09-12T18:01:51.053797+0000","last_became_active":"2024-09-12T17:23:40.708951+0000","last_became_peered":"2024-09-12T17:23:40.708951+0000","last_unstale":"2024-09-12T18:01:51.053797+0000","last_undegraded":"2024-09-12T18:01:51.053797+0000","last_fullsized":"2024-09-12T18:01:51.053797+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:39.682207+0000","last_clean_scrub_stamp":"2024-09-12T17:23:39.682207+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:29.306708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25551,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":469,"num_read_kb":4680,"num_write":1107,"num_write_kb":27229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"261'483","reported_seq":2010,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.776173+0000","last_change":"2024-09-12T17:23:42.147291+0000","last_active":"2024-09-12T18:00:15.776173+0000","last_peered":"2024-09-12T18:00:15.776173+0000","last_clean":"2024-09-12T18:00:15.776173+0000","last_became_active":"2024-09-12T17:23:42.146906+0000","last_became_peered":"2024-09-12T17:23:42.146906+0000","last_unstale":"2024-09-12T18:00:15.776173+0000","last_undegraded":"2024-09-12T18:00:15.776173+0000","last_fullsized":"2024-09-12T18:00:15.776173+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:47.049866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2345,"num_read_kb":2204,"num_write":541,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"261'408","reported_seq":1089,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.042650+0000","last_change":"2024-09-12T18:02:02.042650+0000","last_active":"2024-09-12T18:02:02.042650+0000","last_peered":"2024-09-12T18:02:02.042650+0000","last_clean":"2024-09-12T18:02:02.042650+0000","last_became_active":"2024-09-12T17:23:40.719834+0000","last_became_peered":"2024-09-12T17:23:40.719834+0000","last_unstale":"2024-09-12T18:02:02.042650+0000","last_undegraded":"2024-09-12T18:02:02.042650+0000","last_fullsized":"2024-09-12T18:02:02.042650+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'408","last_scrub_stamp":"2024-09-12T18:02:02.042521+0000","last_deep_scrub":"261'408","last_deep_scrub_stamp":"2024-09-12T18:02:02.042521+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.042521+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:05.142643+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":637,"num_read_kb":15953,"num_write":1206,"num_write_kb":28721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"261'478","reported_seq":2228,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.743852+0000","last_change":"2024-09-12T18:02:12.743852+0000","last_active":"2024-09-12T18:02:12.743852+0000","last_peered":"2024-09-12T18:02:12.743852+0000","last_clean":"2024-09-12T18:02:12.743852+0000","last_became_active":"2024-09-12T17:23:42.147270+0000","last_became_peered":"2024-09-12T17:23:42.147270+0000","last_unstale":"2024-09-12T18:02:12.743852+0000","last_undegraded":"2024-09-12T18:02:12.743852+0000","last_fullsized":"2024-09-12T18:02:12.743852+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'478","last_scrub_stamp":"2024-09-12T18:02:12.743753+0000","last_deep_scrub":"261'478","last_deep_scrub_stamp":"2024-09-12T18:02:12.743753+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.743753+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:19.692853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3009,"num_read_kb":2866,"num_write":558,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"261'351","reported_seq":1157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.764996+0000","last_change":"2024-09-12T18:02:00.764996+0000","last_active":"2024-09-12T18:02:00.764996+0000","last_peered":"2024-09-12T18:02:00.764996+0000","last_clean":"2024-09-12T18:02:00.764996+0000","last_became_active":"2024-09-12T17:23:40.701839+0000","last_became_peered":"2024-09-12T17:23:40.701839+0000","last_unstale":"2024-09-12T18:02:00.764996+0000","last_undegraded":"2024-09-12T18:02:00.764996+0000","last_fullsized":"2024-09-12T18:02:00.764996+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'351","last_scrub_stamp":"2024-09-12T18:02:00.764896+0000","last_deep_scrub":"261'351","last_deep_scrub_stamp":"2024-09-12T18:02:00.764896+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.764896+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:13.922951+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311813,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":845,"num_read_kb":22445,"num_write":993,"num_write_kb":35081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"261'1193","reported_seq":2827,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.787881+0000","last_change":"2024-09-12T17:23:42.143316+0000","last_active":"2024-09-12T18:00:05.787881+0000","last_peered":"2024-09-12T18:00:05.787881+0000","last_clean":"2024-09-12T18:00:05.787881+0000","last_became_active":"2024-09-12T17:23:42.141845+0000","last_became_peered":"2024-09-12T17:23:42.141845+0000","last_unstale":"2024-09-12T18:00:05.787881+0000","last_undegraded":"2024-09-12T18:00:05.787881+0000","last_fullsized":"2024-09-12T18:00:05.787881+0000","mapping_epoch":25,"log_start":"261'1100","ondisk_log_start":"261'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":1100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:43.825593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5470,"num_read_kb":4840,"num_write":1657,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"261'403","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.267301+0000","last_change":"2024-09-12T18:02:09.267301+0000","last_active":"2024-09-12T18:02:09.267301+0000","last_peered":"2024-09-12T18:02:09.267301+0000","last_clean":"2024-09-12T18:02:09.267301+0000","last_became_active":"2024-09-12T17:23:40.712263+0000","last_became_peered":"2024-09-12T17:23:40.712263+0000","last_unstale":"2024-09-12T18:02:09.267301+0000","last_undegraded":"2024-09-12T18:02:09.267301+0000","last_fullsized":"2024-09-12T18:02:09.267301+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'403","last_scrub_stamp":"2024-09-12T18:02:09.267186+0000","last_deep_scrub":"261'403","last_deep_scrub_stamp":"2024-09-12T18:02:09.267186+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.267186+0000","objects_scrubbed":8,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:55.391563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262228,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":543,"num_read_kb":11573,"num_write":1248,"num_write_kb":26002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"261'1243","reported_seq":2931,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.621430+0000","last_change":"2024-09-12T18:02:11.621430+0000","last_active":"2024-09-12T18:02:11.621430+0000","last_peered":"2024-09-12T18:02:11.621430+0000","last_clean":"2024-09-12T18:02:11.621430+0000","last_became_active":"2024-09-12T17:23:42.157835+0000","last_became_peered":"2024-09-12T17:23:42.157835+0000","last_unstale":"2024-09-12T18:02:11.621430+0000","last_undegraded":"2024-09-12T18:02:11.621430+0000","last_fullsized":"2024-09-12T18:02:11.621430+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1243","last_scrub_stamp":"2024-09-12T18:02:11.621334+0000","last_deep_scrub":"261'1243","last_deep_scrub_stamp":"2024-09-12T18:02:11.621334+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.621334+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:43.082819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5656,"num_read_kb":5021,"num_write":1694,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":960,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"261'354","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.716953+0000","last_change":"2024-09-12T18:02:09.716953+0000","last_active":"2024-09-12T18:02:09.716953+0000","last_peered":"2024-09-12T18:02:09.716953+0000","last_clean":"2024-09-12T18:02:09.716953+0000","last_became_active":"2024-09-12T17:23:40.705906+0000","last_became_peered":"2024-09-12T17:23:40.705906+0000","last_unstale":"2024-09-12T18:02:09.716953+0000","last_undegraded":"2024-09-12T18:02:09.716953+0000","last_fullsized":"2024-09-12T18:02:09.716953+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-12T18:02:09.716851+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-12T18:02:09.716851+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.716851+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:14.429035+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":673,"num_read_kb":37545,"num_write":1095,"num_write_kb":42867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"261'385","reported_seq":1833,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.133940+0000","last_change":"2024-09-12T18:02:07.133940+0000","last_active":"2024-09-12T18:02:07.133940+0000","last_peered":"2024-09-12T18:02:07.133940+0000","last_clean":"2024-09-12T18:02:07.133940+0000","last_became_active":"2024-09-12T17:23:42.142311+0000","last_became_peered":"2024-09-12T17:23:42.142311+0000","last_unstale":"2024-09-12T18:02:07.133940+0000","last_undegraded":"2024-09-12T18:02:07.133940+0000","last_fullsized":"2024-09-12T18:02:07.133940+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'385","last_scrub_stamp":"2024-09-12T18:02:07.133832+0000","last_deep_scrub":"261'385","last_deep_scrub_stamp":"2024-09-12T18:02:07.133832+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.133832+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:19.123354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2045,"num_read_kb":1945,"num_write":422,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"261'388","reported_seq":1088,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.238542+0000","last_change":"2024-09-12T18:02:08.238542+0000","last_active":"2024-09-12T18:02:08.238542+0000","last_peered":"2024-09-12T18:02:08.238542+0000","last_clean":"2024-09-12T18:02:08.238542+0000","last_became_active":"2024-09-12T17:23:40.705215+0000","last_became_peered":"2024-09-12T17:23:40.705215+0000","last_unstale":"2024-09-12T18:02:08.238542+0000","last_undegraded":"2024-09-12T18:02:08.238542+0000","last_fullsized":"2024-09-12T18:02:08.238542+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'388","last_scrub_stamp":"2024-09-12T18:02:08.238416+0000","last_deep_scrub":"261'388","last_deep_scrub_stamp":"2024-09-12T18:02:08.238416+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.238416+0000","objects_scrubbed":9,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:20.183404+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253978,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":760,"num_read_kb":26786,"num_write":1280,"num_write_kb":30822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"261'882","reported_seq":2676,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.911490+0000","last_change":"2024-09-12T17:23:42.143689+0000","last_active":"2024-09-12T17:59:59.911490+0000","last_peered":"2024-09-12T17:59:59.911490+0000","last_clean":"2024-09-12T17:59:59.911490+0000","last_became_active":"2024-09-12T17:23:42.143402+0000","last_became_peered":"2024-09-12T17:23:42.143402+0000","last_unstale":"2024-09-12T17:59:59.911490+0000","last_undegraded":"2024-09-12T17:59:59.911490+0000","last_fullsized":"2024-09-12T17:59:59.911490+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:34.164395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4455,"num_read_kb":4051,"num_write":1149,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"261'328","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.738544+0000","last_change":"2024-09-12T18:02:08.738544+0000","last_active":"2024-09-12T18:02:08.738544+0000","last_peered":"2024-09-12T18:02:08.738544+0000","last_clean":"2024-09-12T18:02:08.738544+0000","last_became_active":"2024-09-12T17:23:40.713883+0000","last_became_peered":"2024-09-12T17:23:40.713883+0000","last_unstale":"2024-09-12T18:02:08.738544+0000","last_undegraded":"2024-09-12T18:02:08.738544+0000","last_fullsized":"2024-09-12T18:02:08.738544+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'328","last_scrub_stamp":"2024-09-12T18:02:08.738443+0000","last_deep_scrub":"261'328","last_deep_scrub_stamp":"2024-09-12T18:02:08.738443+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.738443+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:35.473029+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":466,"num_read_kb":1994,"num_write":1104,"num_write_kb":56686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"261'914","reported_seq":2617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.559532+0000","last_change":"2024-09-12T17:23:42.152325+0000","last_active":"2024-09-12T18:00:18.559532+0000","last_peered":"2024-09-12T18:00:18.559532+0000","last_clean":"2024-09-12T18:00:18.559532+0000","last_became_active":"2024-09-12T17:23:42.152030+0000","last_became_peered":"2024-09-12T17:23:42.152030+0000","last_unstale":"2024-09-12T18:00:18.559532+0000","last_undegraded":"2024-09-12T18:00:18.559532+0000","last_fullsized":"2024-09-12T18:00:18.559532+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":900,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:58.696177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4677,"num_read_kb":4199,"num_write":1240,"num_write_kb":482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"261'319","reported_seq":1003,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.254612+0000","last_change":"2024-09-12T18:02:04.254612+0000","last_active":"2024-09-12T18:02:04.254612+0000","last_peered":"2024-09-12T18:02:04.254612+0000","last_clean":"2024-09-12T18:02:04.254612+0000","last_became_active":"2024-09-12T17:23:40.717097+0000","last_became_peered":"2024-09-12T17:23:40.717097+0000","last_unstale":"2024-09-12T18:02:04.254612+0000","last_undegraded":"2024-09-12T18:02:04.254612+0000","last_fullsized":"2024-09-12T18:02:04.254612+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'319","last_scrub_stamp":"2024-09-12T18:02:04.254489+0000","last_deep_scrub":"261'319","last_deep_scrub_stamp":"2024-09-12T18:02:04.254489+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.254489+0000","objects_scrubbed":11,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:54.537782+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655891,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":586,"num_read_kb":3212,"num_write":1067,"num_write_kb":17046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"261'393","reported_seq":1873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.028847+0000","last_change":"2024-09-12T18:02:04.028847+0000","last_active":"2024-09-12T18:02:04.028847+0000","last_peered":"2024-09-12T18:02:04.028847+0000","last_clean":"2024-09-12T18:02:04.028847+0000","last_became_active":"2024-09-12T17:24:17.226840+0000","last_became_peered":"2024-09-12T17:24:17.226840+0000","last_unstale":"2024-09-12T18:02:04.028847+0000","last_undegraded":"2024-09-12T18:02:04.028847+0000","last_fullsized":"2024-09-12T18:02:04.028847+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'393","last_scrub_stamp":"2024-09-12T18:02:04.028758+0000","last_deep_scrub":"261'393","last_deep_scrub_stamp":"2024-09-12T18:02:04.028758+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.028758+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:31.967642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2081,"num_read_kb":1979,"num_write":442,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"261'752","reported_seq":2074,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.188709+0000","last_change":"2024-09-12T18:02:14.188709+0000","last_active":"2024-09-12T18:02:14.188709+0000","last_peered":"2024-09-12T18:02:14.188709+0000","last_clean":"2024-09-12T18:02:14.188709+0000","last_became_active":"2024-09-12T17:23:42.152513+0000","last_became_peered":"2024-09-12T17:23:42.152513+0000","last_unstale":"2024-09-12T18:02:14.188709+0000","last_undegraded":"2024-09-12T18:02:14.188709+0000","last_fullsized":"2024-09-12T18:02:14.188709+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'752","last_scrub_stamp":"2024-09-12T18:02:14.188596+0000","last_deep_scrub":"261'752","last_deep_scrub_stamp":"2024-09-12T18:02:14.188596+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.188596+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:55.988212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3383,"num_read_kb":3022,"num_write":991,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"261'313","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.746218+0000","last_change":"2024-09-12T18:02:07.746218+0000","last_active":"2024-09-12T18:02:07.746218+0000","last_peered":"2024-09-12T18:02:07.746218+0000","last_clean":"2024-09-12T18:02:07.746218+0000","last_became_active":"2024-09-12T17:23:40.712747+0000","last_became_peered":"2024-09-12T17:23:40.712747+0000","last_unstale":"2024-09-12T18:02:07.746218+0000","last_undegraded":"2024-09-12T18:02:07.746218+0000","last_fullsized":"2024-09-12T18:02:07.746218+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'313","last_scrub_stamp":"2024-09-12T18:02:07.746109+0000","last_deep_scrub":"261'313","last_deep_scrub_stamp":"2024-09-12T18:02:07.746109+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.746109+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:03.900469+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":452,"num_read_kb":32150,"num_write":963,"num_write_kb":37186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"261'506","reported_seq":2017,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.701997+0000","last_change":"2024-09-12T18:02:11.701997+0000","last_active":"2024-09-12T18:02:11.701997+0000","last_peered":"2024-09-12T18:02:11.701997+0000","last_clean":"2024-09-12T18:02:11.701997+0000","last_became_active":"2024-09-12T17:23:42.148091+0000","last_became_peered":"2024-09-12T17:23:42.148091+0000","last_unstale":"2024-09-12T18:02:11.701997+0000","last_undegraded":"2024-09-12T18:02:11.701997+0000","last_fullsized":"2024-09-12T18:02:11.701997+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'506","last_scrub_stamp":"2024-09-12T18:02:11.701886+0000","last_deep_scrub":"261'506","last_deep_scrub_stamp":"2024-09-12T18:02:11.701886+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.701886+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:22.240495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2605,"num_read_kb":2400,"num_write":650,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"261'353","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.106506+0000","last_change":"2024-09-12T18:02:03.106506+0000","last_active":"2024-09-12T18:02:03.106506+0000","last_peered":"2024-09-12T18:02:03.106506+0000","last_clean":"2024-09-12T18:02:03.106506+0000","last_became_active":"2024-09-12T17:23:40.708089+0000","last_became_peered":"2024-09-12T17:23:40.708089+0000","last_unstale":"2024-09-12T18:02:03.106506+0000","last_undegraded":"2024-09-12T18:02:03.106506+0000","last_fullsized":"2024-09-12T18:02:03.106506+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'353","last_scrub_stamp":"2024-09-12T18:02:03.106382+0000","last_deep_scrub":"261'353","last_deep_scrub_stamp":"2024-09-12T18:02:03.106382+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.106382+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:42.275338+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":647,"num_read_kb":14175,"num_write":1176,"num_write_kb":46213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"261'912","reported_seq":2505,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.237194+0000","last_change":"2024-09-12T18:02:14.237194+0000","last_active":"2024-09-12T18:02:14.237194+0000","last_peered":"2024-09-12T18:02:14.237194+0000","last_clean":"2024-09-12T18:02:14.237194+0000","last_became_active":"2024-09-12T17:23:42.145860+0000","last_became_peered":"2024-09-12T17:23:42.145860+0000","last_unstale":"2024-09-12T18:02:14.237194+0000","last_undegraded":"2024-09-12T18:02:14.237194+0000","last_fullsized":"2024-09-12T18:02:14.237194+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'912","last_scrub_stamp":"2024-09-12T18:02:14.237107+0000","last_deep_scrub":"261'912","last_deep_scrub_stamp":"2024-09-12T18:02:14.237107+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.237107+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":900,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:39.982382+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4352,"num_read_kb":3896,"num_write":1238,"num_write_kb":509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"261'349","reported_seq":1090,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.094282+0000","last_change":"2024-09-12T18:02:02.094282+0000","last_active":"2024-09-12T18:02:02.094282+0000","last_peered":"2024-09-12T18:02:02.094282+0000","last_clean":"2024-09-12T18:02:02.094282+0000","last_became_active":"2024-09-12T17:24:17.232979+0000","last_became_peered":"2024-09-12T17:24:17.232979+0000","last_unstale":"2024-09-12T18:02:02.094282+0000","last_undegraded":"2024-09-12T18:02:02.094282+0000","last_fullsized":"2024-09-12T18:02:02.094282+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T18:02:02.094149+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T18:02:02.094149+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.094149+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:51.671674+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":809,"num_read_kb":6334,"num_write":1258,"num_write_kb":23763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"261'428","reported_seq":1998,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.031835+0000","last_change":"2024-09-12T18:02:02.031835+0000","last_active":"2024-09-12T18:02:02.031835+0000","last_peered":"2024-09-12T18:02:02.031835+0000","last_clean":"2024-09-12T18:02:02.031835+0000","last_became_active":"2024-09-12T17:23:42.148023+0000","last_became_peered":"2024-09-12T17:23:42.148023+0000","last_unstale":"2024-09-12T18:02:02.031835+0000","last_undegraded":"2024-09-12T18:02:02.031835+0000","last_fullsized":"2024-09-12T18:02:02.031835+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'428","last_scrub_stamp":"2024-09-12T18:02:02.031748+0000","last_deep_scrub":"261'428","last_deep_scrub_stamp":"2024-09-12T18:02:02.031748+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.031748+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:37.883390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2276,"num_read_kb":2173,"num_write":473,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"261'353","reported_seq":976,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.085723+0000","last_change":"2024-09-12T18:02:00.085723+0000","last_active":"2024-09-12T18:02:00.085723+0000","last_peered":"2024-09-12T18:02:00.085723+0000","last_clean":"2024-09-12T18:02:00.085723+0000","last_became_active":"2024-09-12T17:23:40.714604+0000","last_became_peered":"2024-09-12T17:23:40.714604+0000","last_unstale":"2024-09-12T18:02:00.085723+0000","last_undegraded":"2024-09-12T18:02:00.085723+0000","last_fullsized":"2024-09-12T18:02:00.085723+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'353","last_scrub_stamp":"2024-09-12T18:02:00.085618+0000","last_deep_scrub":"261'353","last_deep_scrub_stamp":"2024-09-12T18:02:00.085618+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.085618+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:44.532607+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":7319,"num_write":1124,"num_write_kb":22062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"261'421","reported_seq":1941,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.017362+0000","last_change":"2024-09-12T18:02:03.017362+0000","last_active":"2024-09-12T18:02:03.017362+0000","last_peered":"2024-09-12T18:02:03.017362+0000","last_clean":"2024-09-12T18:02:03.017362+0000","last_became_active":"2024-09-12T17:23:42.141237+0000","last_became_peered":"2024-09-12T17:23:42.141237+0000","last_unstale":"2024-09-12T18:02:03.017362+0000","last_undegraded":"2024-09-12T18:02:03.017362+0000","last_fullsized":"2024-09-12T18:02:03.017362+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'421","last_scrub_stamp":"2024-09-12T18:02:03.017268+0000","last_deep_scrub":"261'421","last_deep_scrub_stamp":"2024-09-12T18:02:03.017268+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.017268+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:06.467480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2248,"num_read_kb":2133,"num_write":484,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"261'334","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.234682+0000","last_change":"2024-09-12T18:02:03.234682+0000","last_active":"2024-09-12T18:02:03.234682+0000","last_peered":"2024-09-12T18:02:03.234682+0000","last_clean":"2024-09-12T18:02:03.234682+0000","last_became_active":"2024-09-12T17:23:40.704825+0000","last_became_peered":"2024-09-12T17:23:40.704825+0000","last_unstale":"2024-09-12T18:02:03.234682+0000","last_undegraded":"2024-09-12T18:02:03.234682+0000","last_fullsized":"2024-09-12T18:02:03.234682+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'334","last_scrub_stamp":"2024-09-12T18:02:03.234556+0000","last_deep_scrub":"261'334","last_deep_scrub_stamp":"2024-09-12T18:02:03.234556+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.234556+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:14.374566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":456,"num_read_kb":2074,"num_write":1044,"num_write_kb":16303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"261'381","reported_seq":1878,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.160794+0000","last_change":"2024-09-12T18:02:13.160794+0000","last_active":"2024-09-12T18:02:13.160794+0000","last_peered":"2024-09-12T18:02:13.160794+0000","last_clean":"2024-09-12T18:02:13.160794+0000","last_became_active":"2024-09-12T17:23:42.137455+0000","last_became_peered":"2024-09-12T17:23:42.137455+0000","last_unstale":"2024-09-12T18:02:13.160794+0000","last_undegraded":"2024-09-12T18:02:13.160794+0000","last_fullsized":"2024-09-12T18:02:13.160794+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'381","last_scrub_stamp":"2024-09-12T18:02:13.160695+0000","last_deep_scrub":"261'381","last_deep_scrub_stamp":"2024-09-12T18:02:13.160695+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.160695+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:54.943636+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2042,"num_read_kb":1965,"num_write":435,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"261'367","reported_seq":1018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.735389+0000","last_change":"2024-09-12T18:01:59.735389+0000","last_active":"2024-09-12T18:01:59.735389+0000","last_peered":"2024-09-12T18:01:59.735389+0000","last_clean":"2024-09-12T18:01:59.735389+0000","last_became_active":"2024-09-12T17:23:40.711201+0000","last_became_peered":"2024-09-12T17:23:40.711201+0000","last_unstale":"2024-09-12T18:01:59.735389+0000","last_undegraded":"2024-09-12T18:01:59.735389+0000","last_fullsized":"2024-09-12T18:01:59.735389+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'367","last_scrub_stamp":"2024-09-12T18:01:59.735272+0000","last_deep_scrub":"261'367","last_deep_scrub_stamp":"2024-09-12T18:01:59.735272+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.735272+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:34.384056+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2561815,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":549,"num_read_kb":25516,"num_write":1199,"num_write_kb":38939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"261'151","reported_seq":661,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.612262+0000","last_change":"2024-09-12T17:23:50.184556+0000","last_active":"2024-09-12T18:00:18.612262+0000","last_peered":"2024-09-12T18:00:18.612262+0000","last_clean":"2024-09-12T18:00:18.612262+0000","last_became_active":"2024-09-12T17:23:50.184149+0000","last_became_peered":"2024-09-12T17:23:50.184149+0000","last_unstale":"2024-09-12T18:00:18.612262+0000","last_undegraded":"2024-09-12T18:00:18.612262+0000","last_fullsized":"2024-09-12T18:00:18.612262+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:56.623668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":269,"num_read_kb":251,"num_write":373,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"261'433","reported_seq":2045,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.276276+0000","last_change":"2024-09-12T18:02:08.276276+0000","last_active":"2024-09-12T18:02:08.276276+0000","last_peered":"2024-09-12T18:02:08.276276+0000","last_clean":"2024-09-12T18:02:08.276276+0000","last_became_active":"2024-09-12T17:23:42.153262+0000","last_became_peered":"2024-09-12T17:23:42.153262+0000","last_unstale":"2024-09-12T18:02:08.276276+0000","last_undegraded":"2024-09-12T18:02:08.276276+0000","last_fullsized":"2024-09-12T18:02:08.276276+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'433","last_scrub_stamp":"2024-09-12T18:02:08.276184+0000","last_deep_scrub":"261'433","last_deep_scrub_stamp":"2024-09-12T18:02:08.276184+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.276184+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:25.968608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2462,"num_read_kb":2350,"num_write":478,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"261'337","reported_seq":967,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.703031+0000","last_change":"2024-09-12T18:02:04.703031+0000","last_active":"2024-09-12T18:02:04.703031+0000","last_peered":"2024-09-12T18:02:04.703031+0000","last_clean":"2024-09-12T18:02:04.703031+0000","last_became_active":"2024-09-12T17:23:40.709513+0000","last_became_peered":"2024-09-12T17:23:40.709513+0000","last_unstale":"2024-09-12T18:02:04.703031+0000","last_undegraded":"2024-09-12T18:02:04.703031+0000","last_fullsized":"2024-09-12T18:02:04.703031+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'337","last_scrub_stamp":"2024-09-12T18:02:04.702947+0000","last_deep_scrub":"261'337","last_deep_scrub_stamp":"2024-09-12T18:02:04.702947+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.702947+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:03.175885+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":481,"num_read_kb":53800,"num_write":1092,"num_write_kb":42009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404158+0000","last_change":"2024-09-12T17:23:44.151154+0000","last_active":"2024-09-12T17:57:34.404158+0000","last_peered":"2024-09-12T17:57:34.404158+0000","last_clean":"2024-09-12T17:57:34.404158+0000","last_became_active":"2024-09-12T17:23:44.150860+0000","last_became_peered":"2024-09-12T17:23:44.150860+0000","last_unstale":"2024-09-12T17:57:34.404158+0000","last_undegraded":"2024-09-12T17:57:34.404158+0000","last_fullsized":"2024-09-12T17:57:34.404158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:48.984288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"261'337","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.059907+0000","last_change":"2024-09-12T17:23:46.153152+0000","last_active":"2024-09-12T18:01:51.059907+0000","last_peered":"2024-09-12T18:01:51.059907+0000","last_clean":"2024-09-12T18:01:51.059907+0000","last_became_active":"2024-09-12T17:23:46.152874+0000","last_became_peered":"2024-09-12T17:23:46.152874+0000","last_unstale":"2024-09-12T18:01:51.059907+0000","last_undegraded":"2024-09-12T18:01:51.059907+0000","last_fullsized":"2024-09-12T18:01:51.059907+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:57.758740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49853,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":1208,"num_write":446,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.405726+0000","last_change":"2024-09-12T17:23:48.168394+0000","last_active":"2024-09-12T17:57:39.405726+0000","last_peered":"2024-09-12T17:57:39.405726+0000","last_clean":"2024-09-12T17:57:39.405726+0000","last_became_active":"2024-09-12T17:23:48.168052+0000","last_became_peered":"2024-09-12T17:23:48.168052+0000","last_unstale":"2024-09-12T17:57:39.405726+0000","last_undegraded":"2024-09-12T17:57:39.405726+0000","last_fullsized":"2024-09-12T17:57:39.405726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:50.986726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"261'173","reported_seq":728,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:15.773668+0000","last_change":"2024-09-12T17:23:50.188838+0000","last_active":"2024-09-12T18:00:15.773668+0000","last_peered":"2024-09-12T18:00:15.773668+0000","last_clean":"2024-09-12T18:00:15.773668+0000","last_became_active":"2024-09-12T17:23:50.188506+0000","last_became_peered":"2024-09-12T17:23:50.188506+0000","last_unstale":"2024-09-12T18:00:15.773668+0000","last_undegraded":"2024-09-12T18:00:15.773668+0000","last_fullsized":"2024-09-12T18:00:15.773668+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:28.074396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":316,"num_read_kb":300,"num_write":383,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"261'581","reported_seq":2135,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.271006+0000","last_change":"2024-09-12T18:02:11.271006+0000","last_active":"2024-09-12T18:02:11.271006+0000","last_peered":"2024-09-12T18:02:11.271006+0000","last_clean":"2024-09-12T18:02:11.271006+0000","last_became_active":"2024-09-12T17:23:42.143794+0000","last_became_peered":"2024-09-12T17:23:42.143794+0000","last_unstale":"2024-09-12T18:02:11.271006+0000","last_undegraded":"2024-09-12T18:02:11.271006+0000","last_fullsized":"2024-09-12T18:02:11.271006+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'581","last_scrub_stamp":"2024-09-12T18:02:11.270879+0000","last_deep_scrub":"261'581","last_deep_scrub_stamp":"2024-09-12T18:02:11.270879+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.270879+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:08.118727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3146,"num_read_kb":2882,"num_write":787,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1514,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"261'432","reported_seq":1078,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.940842+0000","last_change":"2024-09-12T18:01:57.940842+0000","last_active":"2024-09-12T18:01:57.940842+0000","last_peered":"2024-09-12T18:01:57.940842+0000","last_clean":"2024-09-12T18:01:57.940842+0000","last_became_active":"2024-09-12T17:24:17.287987+0000","last_became_peered":"2024-09-12T17:24:17.287987+0000","last_unstale":"2024-09-12T18:01:57.940842+0000","last_undegraded":"2024-09-12T18:01:57.940842+0000","last_fullsized":"2024-09-12T18:01:57.940842+0000","mapping_epoch":36,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'432","last_scrub_stamp":"2024-09-12T18:01:57.940767+0000","last_deep_scrub":"261'432","last_deep_scrub_stamp":"2024-09-12T18:01:57.940767+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.940767+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:05.500595+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174825,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":630,"num_read_kb":42370,"num_write":1204,"num_write_kb":32675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.413518+0000","last_change":"2024-09-12T17:23:44.149386+0000","last_active":"2024-09-12T17:58:48.413518+0000","last_peered":"2024-09-12T17:58:48.413518+0000","last_clean":"2024-09-12T17:58:48.413518+0000","last_became_active":"2024-09-12T17:23:44.149079+0000","last_became_peered":"2024-09-12T17:23:44.149079+0000","last_unstale":"2024-09-12T17:58:48.413518+0000","last_undegraded":"2024-09-12T17:58:48.413518+0000","last_fullsized":"2024-09-12T17:58:48.413518+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:52.404478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"261'78","reported_seq":591,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:23.586728+0000","last_change":"2024-09-12T17:23:46.150777+0000","last_active":"2024-09-12T17:59:23.586728+0000","last_peered":"2024-09-12T17:59:23.586728+0000","last_clean":"2024-09-12T17:59:23.586728+0000","last_became_active":"2024-09-12T17:23:46.150447+0000","last_became_peered":"2024-09-12T17:23:46.150447+0000","last_unstale":"2024-09-12T17:59:23.586728+0000","last_undegraded":"2024-09-12T17:59:23.586728+0000","last_fullsized":"2024-09-12T17:59:23.586728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:18.226708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":77,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.405649+0000","last_change":"2024-09-12T17:23:48.166388+0000","last_active":"2024-09-12T17:57:39.405649+0000","last_peered":"2024-09-12T17:57:39.405649+0000","last_clean":"2024-09-12T17:57:39.405649+0000","last_became_active":"2024-09-12T17:23:48.165965+0000","last_became_peered":"2024-09-12T17:23:48.165965+0000","last_unstale":"2024-09-12T17:57:39.405649+0000","last_undegraded":"2024-09-12T17:57:39.405649+0000","last_fullsized":"2024-09-12T17:57:39.405649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:48.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"261'113","reported_seq":609,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.639640+0000","last_change":"2024-09-12T17:23:50.188380+0000","last_active":"2024-09-12T17:59:48.639640+0000","last_peered":"2024-09-12T17:59:48.639640+0000","last_clean":"2024-09-12T17:59:48.639640+0000","last_became_active":"2024-09-12T17:23:50.188143+0000","last_became_peered":"2024-09-12T17:23:50.188143+0000","last_unstale":"2024-09-12T17:59:48.639640+0000","last_undegraded":"2024-09-12T17:59:48.639640+0000","last_fullsized":"2024-09-12T17:59:48.639640+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:55.598494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":180,"num_write":267,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"261'433","reported_seq":2058,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.637886+0000","last_change":"2024-09-12T18:02:06.637886+0000","last_active":"2024-09-12T18:02:06.637886+0000","last_peered":"2024-09-12T18:02:06.637886+0000","last_clean":"2024-09-12T18:02:06.637886+0000","last_became_active":"2024-09-12T17:23:42.155137+0000","last_became_peered":"2024-09-12T17:23:42.155137+0000","last_unstale":"2024-09-12T18:02:06.637886+0000","last_undegraded":"2024-09-12T18:02:06.637886+0000","last_fullsized":"2024-09-12T18:02:06.637886+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'433","last_scrub_stamp":"2024-09-12T18:02:06.637778+0000","last_deep_scrub":"261'433","last_deep_scrub_stamp":"2024-09-12T18:02:06.637778+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.637778+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:48.440676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2401,"num_read_kb":2311,"num_write":475,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1514,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"261'493","reported_seq":1150,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.668021+0000","last_change":"2024-09-12T18:02:02.668021+0000","last_active":"2024-09-12T18:02:02.668021+0000","last_peered":"2024-09-12T18:02:02.668021+0000","last_clean":"2024-09-12T18:02:02.668021+0000","last_became_active":"2024-09-12T17:23:40.707549+0000","last_became_peered":"2024-09-12T17:23:40.707549+0000","last_unstale":"2024-09-12T18:02:02.668021+0000","last_undegraded":"2024-09-12T18:02:02.668021+0000","last_fullsized":"2024-09-12T18:02:02.668021+0000","mapping_epoch":23,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'493","last_scrub_stamp":"2024-09-12T18:02:02.667893+0000","last_deep_scrub":"261'493","last_deep_scrub_stamp":"2024-09-12T18:02:02.667893+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.667893+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:16.321949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":822,"num_read_kb":5813,"num_write":1382,"num_write_kb":24859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:33.401656+0000","last_change":"2024-09-12T17:23:44.151294+0000","last_active":"2024-09-12T17:57:33.401656+0000","last_peered":"2024-09-12T17:57:33.401656+0000","last_clean":"2024-09-12T17:57:33.401656+0000","last_became_active":"2024-09-12T17:23:44.150973+0000","last_became_peered":"2024-09-12T17:23:44.150973+0000","last_unstale":"2024-09-12T17:57:33.401656+0000","last_undegraded":"2024-09-12T17:57:33.401656+0000","last_fullsized":"2024-09-12T17:57:33.401656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:15.283072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"261'100","reported_seq":628,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.959168+0000","last_change":"2024-09-12T18:02:12.959168+0000","last_active":"2024-09-12T18:02:12.959168+0000","last_peered":"2024-09-12T18:02:12.959168+0000","last_clean":"2024-09-12T18:02:12.959168+0000","last_became_active":"2024-09-12T17:23:46.153864+0000","last_became_peered":"2024-09-12T17:23:46.153864+0000","last_unstale":"2024-09-12T18:02:12.959168+0000","last_undegraded":"2024-09-12T18:02:12.959168+0000","last_fullsized":"2024-09-12T18:02:12.959168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'100","last_scrub_stamp":"2024-09-12T18:02:12.959072+0000","last_deep_scrub":"261'100","last_deep_scrub_stamp":"2024-09-12T18:02:12.959072+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.959072+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:33.074044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"261'764","reported_seq":2155,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.485904+0000","last_change":"2024-09-12T17:23:48.173728+0000","last_active":"2024-09-12T18:01:50.485904+0000","last_peered":"2024-09-12T18:01:50.485904+0000","last_clean":"2024-09-12T18:01:50.485904+0000","last_became_active":"2024-09-12T17:23:48.173454+0000","last_became_peered":"2024-09-12T17:23:48.173454+0000","last_unstale":"2024-09-12T18:01:50.485904+0000","last_undegraded":"2024-09-12T18:01:50.485904+0000","last_fullsized":"2024-09-12T18:01:50.485904+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:51.582534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"261'214","reported_seq":1037,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.663235+0000","last_change":"2024-09-12T17:23:50.640673+0000","last_active":"2024-09-12T18:00:18.663235+0000","last_peered":"2024-09-12T18:00:18.663235+0000","last_clean":"2024-09-12T18:00:18.663235+0000","last_became_active":"2024-09-12T17:23:50.640401+0000","last_became_peered":"2024-09-12T17:23:50.640401+0000","last_unstale":"2024-09-12T18:00:18.663235+0000","last_undegraded":"2024-09-12T18:00:18.663235+0000","last_fullsized":"2024-09-12T18:00:18.663235+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:04.518137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":682,"num_read_kb":671,"num_write":489,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"261'900","reported_seq":2449,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.245763+0000","last_change":"2024-09-12T18:02:09.245763+0000","last_active":"2024-09-12T18:02:09.245763+0000","last_peered":"2024-09-12T18:02:09.245763+0000","last_clean":"2024-09-12T18:02:09.245763+0000","last_became_active":"2024-09-12T17:23:42.147597+0000","last_became_peered":"2024-09-12T17:23:42.147597+0000","last_unstale":"2024-09-12T18:02:09.245763+0000","last_undegraded":"2024-09-12T18:02:09.245763+0000","last_fullsized":"2024-09-12T18:02:09.245763+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'900","last_scrub_stamp":"2024-09-12T18:02:09.245668+0000","last_deep_scrub":"261'900","last_deep_scrub_stamp":"2024-09-12T18:02:09.245668+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.245668+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:31.980911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4183,"num_read_kb":3727,"num_write":1220,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"261'367","reported_seq":1052,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.070259+0000","last_change":"2024-09-12T18:02:00.070259+0000","last_active":"2024-09-12T18:02:00.070259+0000","last_peered":"2024-09-12T18:02:00.070259+0000","last_clean":"2024-09-12T18:02:00.070259+0000","last_became_active":"2024-09-12T17:23:40.718582+0000","last_became_peered":"2024-09-12T17:23:40.718582+0000","last_unstale":"2024-09-12T18:02:00.070259+0000","last_undegraded":"2024-09-12T18:02:00.070259+0000","last_fullsized":"2024-09-12T18:02:00.070259+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'367","last_scrub_stamp":"2024-09-12T18:02:00.070123+0000","last_deep_scrub":"261'367","last_deep_scrub_stamp":"2024-09-12T18:02:00.070123+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.070123+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:55.441884+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":588,"num_read_kb":83250,"num_write":1103,"num_write_kb":35659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404212+0000","last_change":"2024-09-12T17:23:44.152542+0000","last_active":"2024-09-12T17:57:34.404212+0000","last_peered":"2024-09-12T17:57:34.404212+0000","last_clean":"2024-09-12T17:57:34.404212+0000","last_became_active":"2024-09-12T17:23:44.151918+0000","last_became_peered":"2024-09-12T17:23:44.151918+0000","last_unstale":"2024-09-12T17:57:34.404212+0000","last_undegraded":"2024-09-12T17:57:34.404212+0000","last_fullsized":"2024-09-12T17:57:34.404212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:18.221084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"261'266","reported_seq":817,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.830183+0000","last_change":"2024-09-12T17:23:46.241449+0000","last_active":"2024-09-12T18:01:50.830183+0000","last_peered":"2024-09-12T18:01:50.830183+0000","last_clean":"2024-09-12T18:01:50.830183+0000","last_became_active":"2024-09-12T17:23:46.241137+0000","last_became_peered":"2024-09-12T17:23:46.241137+0000","last_unstale":"2024-09-12T18:01:50.830183+0000","last_undegraded":"2024-09-12T18:01:50.830183+0000","last_fullsized":"2024-09-12T18:01:50.830183+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:58.197635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":1112,"num_write":380,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"261'806","reported_seq":6201,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.420683+0000","last_change":"2024-09-12T17:23:48.167347+0000","last_active":"2024-09-12T18:01:49.420683+0000","last_peered":"2024-09-12T18:01:49.420683+0000","last_clean":"2024-09-12T18:01:49.420683+0000","last_became_active":"2024-09-12T17:23:48.167038+0000","last_became_peered":"2024-09-12T17:23:48.167038+0000","last_unstale":"2024-09-12T18:01:49.420683+0000","last_undegraded":"2024-09-12T18:01:49.420683+0000","last_fullsized":"2024-09-12T18:01:49.420683+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:22.744543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"261'667","reported_seq":2272,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.287880+0000","last_change":"2024-09-12T18:02:10.287880+0000","last_active":"2024-09-12T18:02:10.287880+0000","last_peered":"2024-09-12T18:02:10.287880+0000","last_clean":"2024-09-12T18:02:10.287880+0000","last_became_active":"2024-09-12T17:23:42.143778+0000","last_became_peered":"2024-09-12T17:23:42.143778+0000","last_unstale":"2024-09-12T18:02:10.287880+0000","last_undegraded":"2024-09-12T18:02:10.287880+0000","last_fullsized":"2024-09-12T18:02:10.287880+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'667","last_scrub_stamp":"2024-09-12T18:02:10.287792+0000","last_deep_scrub":"261'667","last_deep_scrub_stamp":"2024-09-12T18:02:10.287792+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.287792+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":600,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:51.075062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3245,"num_read_kb":3064,"num_write":918,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"261'356","reported_seq":966,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.667617+0000","last_change":"2024-09-12T18:02:01.667556+0000","last_active":"2024-09-12T18:02:01.667617+0000","last_peered":"2024-09-12T18:02:01.667617+0000","last_clean":"2024-09-12T18:02:01.667617+0000","last_became_active":"2024-09-12T17:23:40.709587+0000","last_became_peered":"2024-09-12T17:23:40.709587+0000","last_unstale":"2024-09-12T18:02:01.667617+0000","last_undegraded":"2024-09-12T18:02:01.667617+0000","last_fullsized":"2024-09-12T18:02:01.667617+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'356","last_scrub_stamp":"2024-09-12T18:02:01.667423+0000","last_deep_scrub":"261'356","last_deep_scrub_stamp":"2024-09-12T18:02:01.667423+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.667423+0000","objects_scrubbed":9,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:03.026185+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947352,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":408,"num_read_kb":61352,"num_write":1018,"num_write_kb":60278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.412039+0000","last_change":"2024-09-12T17:23:44.151275+0000","last_active":"2024-09-12T17:58:24.412039+0000","last_peered":"2024-09-12T17:58:24.412039+0000","last_clean":"2024-09-12T17:58:24.412039+0000","last_became_active":"2024-09-12T17:23:44.150957+0000","last_became_peered":"2024-09-12T17:23:44.150957+0000","last_unstale":"2024-09-12T17:58:24.412039+0000","last_undegraded":"2024-09-12T17:58:24.412039+0000","last_fullsized":"2024-09-12T17:58:24.412039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:06.423907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"261'345","reported_seq":937,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.669893+0000","last_change":"2024-09-12T17:23:46.241749+0000","last_active":"2024-09-12T18:01:49.669893+0000","last_peered":"2024-09-12T18:01:49.669893+0000","last_clean":"2024-09-12T18:01:49.669893+0000","last_became_active":"2024-09-12T17:23:46.241442+0000","last_became_peered":"2024-09-12T17:23:46.241442+0000","last_unstale":"2024-09-12T18:01:49.669893+0000","last_undegraded":"2024-09-12T18:01:49.669893+0000","last_fullsized":"2024-09-12T18:01:49.669893+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:17.283661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47631,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":562,"num_read_kb":1202,"num_write":448,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:49.422294+0000","last_change":"2024-09-12T17:23:48.168185+0000","last_active":"2024-09-12T17:59:49.422294+0000","last_peered":"2024-09-12T17:59:49.422294+0000","last_clean":"2024-09-12T17:59:49.422294+0000","last_became_active":"2024-09-12T17:23:48.167925+0000","last_became_peered":"2024-09-12T17:23:48.167925+0000","last_unstale":"2024-09-12T17:59:49.422294+0000","last_undegraded":"2024-09-12T17:59:49.422294+0000","last_fullsized":"2024-09-12T17:59:49.422294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"261'574","reported_seq":1382,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.439771+0000","last_change":"2024-09-12T17:23:50.188392+0000","last_active":"2024-09-12T18:01:42.439771+0000","last_peered":"2024-09-12T18:01:42.439771+0000","last_clean":"2024-09-12T18:01:42.439771+0000","last_became_active":"2024-09-12T17:23:50.188109+0000","last_became_peered":"2024-09-12T17:23:50.188109+0000","last_unstale":"2024-09-12T18:01:42.439771+0000","last_undegraded":"2024-09-12T18:01:42.439771+0000","last_fullsized":"2024-09-12T18:01:42.439771+0000","mapping_epoch":33,"log_start":"261'500","ondisk_log_start":"261'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:18.895859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1373,"num_read_kb":1362,"num_write":1221,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"261'468","reported_seq":2011,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.076591+0000","last_change":"2024-09-12T18:02:01.076591+0000","last_active":"2024-09-12T18:02:01.076591+0000","last_peered":"2024-09-12T18:02:01.076591+0000","last_clean":"2024-09-12T18:02:01.076591+0000","last_became_active":"2024-09-12T17:23:42.135997+0000","last_became_peered":"2024-09-12T17:23:42.135997+0000","last_unstale":"2024-09-12T18:02:01.076591+0000","last_undegraded":"2024-09-12T18:02:01.076591+0000","last_fullsized":"2024-09-12T18:02:01.076591+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'468","last_scrub_stamp":"2024-09-12T18:02:01.076481+0000","last_deep_scrub":"261'468","last_deep_scrub_stamp":"2024-09-12T18:02:01.076481+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.076481+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:43.499647+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2354,"num_read_kb":2214,"num_write":547,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"261'349","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.611950+0000","last_change":"2024-09-12T18:01:59.611950+0000","last_active":"2024-09-12T18:01:59.611950+0000","last_peered":"2024-09-12T18:01:59.611950+0000","last_clean":"2024-09-12T18:01:59.611950+0000","last_became_active":"2024-09-12T17:23:40.711546+0000","last_became_peered":"2024-09-12T17:23:40.711546+0000","last_unstale":"2024-09-12T18:01:59.611950+0000","last_undegraded":"2024-09-12T18:01:59.611950+0000","last_fullsized":"2024-09-12T18:01:59.611950+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T18:01:59.611817+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T18:01:59.611817+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.611817+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:06.835809+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":612536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":14392,"num_write":1010,"num_write_kb":31885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.005898+0000","last_change":"2024-09-12T18:02:07.005898+0000","last_active":"2024-09-12T18:02:07.005898+0000","last_peered":"2024-09-12T18:02:07.005898+0000","last_clean":"2024-09-12T18:02:07.005898+0000","last_became_active":"2024-09-12T17:23:44.148472+0000","last_became_peered":"2024-09-12T17:23:44.148472+0000","last_unstale":"2024-09-12T18:02:07.005898+0000","last_undegraded":"2024-09-12T18:02:07.005898+0000","last_fullsized":"2024-09-12T18:02:07.005898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:07.005812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:07.005812+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.005812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:49.459504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"261'244","reported_seq":801,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.310570+0000","last_change":"2024-09-12T17:23:46.153208+0000","last_active":"2024-09-12T18:01:50.310570+0000","last_peered":"2024-09-12T18:01:50.310570+0000","last_clean":"2024-09-12T18:01:50.310570+0000","last_became_active":"2024-09-12T17:23:46.152441+0000","last_became_peered":"2024-09-12T17:23:46.152441+0000","last_unstale":"2024-09-12T18:01:50.310570+0000","last_undegraded":"2024-09-12T18:01:50.310570+0000","last_fullsized":"2024-09-12T18:01:50.310570+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46658,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":411,"num_read_kb":954,"num_write":334,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411068+0000","last_change":"2024-09-12T17:23:48.168110+0000","last_active":"2024-09-12T17:58:33.411068+0000","last_peered":"2024-09-12T17:58:33.411068+0000","last_clean":"2024-09-12T17:58:33.411068+0000","last_became_active":"2024-09-12T17:23:48.167829+0000","last_became_peered":"2024-09-12T17:23:48.167829+0000","last_unstale":"2024-09-12T17:58:33.411068+0000","last_undegraded":"2024-09-12T17:58:33.411068+0000","last_fullsized":"2024-09-12T17:58:33.411068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:24.546875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"261'2375","reported_seq":4213,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.434744+0000","last_change":"2024-09-12T17:23:50.186322+0000","last_active":"2024-09-12T18:01:29.434744+0000","last_peered":"2024-09-12T18:01:29.434744+0000","last_clean":"2024-09-12T18:01:29.434744+0000","last_became_active":"2024-09-12T17:23:50.186026+0000","last_became_peered":"2024-09-12T17:23:50.186026+0000","last_unstale":"2024-09-12T18:01:29.434744+0000","last_undegraded":"2024-09-12T18:01:29.434744+0000","last_fullsized":"2024-09-12T18:01:29.434744+0000","mapping_epoch":33,"log_start":"261'2300","ondisk_log_start":"261'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":2300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:19.020080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6096,"num_read_kb":6075,"num_write":4800,"num_write_kb":1772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"261'459","reported_seq":1996,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.193479+0000","last_change":"2024-09-12T18:02:11.193479+0000","last_active":"2024-09-12T18:02:11.193479+0000","last_peered":"2024-09-12T18:02:11.193479+0000","last_clean":"2024-09-12T18:02:11.193479+0000","last_became_active":"2024-09-12T17:23:42.147136+0000","last_became_peered":"2024-09-12T17:23:42.147136+0000","last_unstale":"2024-09-12T18:02:11.193479+0000","last_undegraded":"2024-09-12T18:02:11.193479+0000","last_fullsized":"2024-09-12T18:02:11.193479+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'459","last_scrub_stamp":"2024-09-12T18:02:11.193356+0000","last_deep_scrub":"261'459","last_deep_scrub_stamp":"2024-09-12T18:02:11.193356+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.193356+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:03.523588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2419,"num_read_kb":2271,"num_write":547,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"261'326","reported_seq":929,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.661213+0000","last_change":"2024-09-12T18:02:03.661213+0000","last_active":"2024-09-12T18:02:03.661213+0000","last_peered":"2024-09-12T18:02:03.661213+0000","last_clean":"2024-09-12T18:02:03.661213+0000","last_became_active":"2024-09-12T17:23:40.713481+0000","last_became_peered":"2024-09-12T17:23:40.713481+0000","last_unstale":"2024-09-12T18:02:03.661213+0000","last_undegraded":"2024-09-12T18:02:03.661213+0000","last_fullsized":"2024-09-12T18:02:03.661213+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-12T18:02:03.661110+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-12T18:02:03.661110+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.661110+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:27.094156+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":421,"num_read_kb":5522,"num_write":1047,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.030052+0000","last_change":"2024-09-12T18:02:10.030052+0000","last_active":"2024-09-12T18:02:10.030052+0000","last_peered":"2024-09-12T18:02:10.030052+0000","last_clean":"2024-09-12T18:02:10.030052+0000","last_became_active":"2024-09-12T17:23:44.147677+0000","last_became_peered":"2024-09-12T17:23:44.147677+0000","last_unstale":"2024-09-12T18:02:10.030052+0000","last_undegraded":"2024-09-12T18:02:10.030052+0000","last_fullsized":"2024-09-12T18:02:10.030052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:10.029964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:10.029964+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.029964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:58.321187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"261'286","reported_seq":851,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.768095+0000","last_change":"2024-09-12T17:23:46.150883+0000","last_active":"2024-09-12T18:01:49.768095+0000","last_peered":"2024-09-12T18:01:49.768095+0000","last_clean":"2024-09-12T18:01:49.768095+0000","last_became_active":"2024-09-12T17:23:46.150555+0000","last_became_peered":"2024-09-12T17:23:46.150555+0000","last_unstale":"2024-09-12T18:01:49.768095+0000","last_undegraded":"2024-09-12T18:01:49.768095+0000","last_fullsized":"2024-09-12T18:01:49.768095+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:53.085351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53816,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":485,"num_read_kb":1109,"num_write":394,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"261'804","reported_seq":2472,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.870728+0000","last_change":"2024-09-12T17:23:48.165492+0000","last_active":"2024-09-12T18:01:50.870728+0000","last_peered":"2024-09-12T18:01:50.870728+0000","last_clean":"2024-09-12T18:01:50.870728+0000","last_became_active":"2024-09-12T17:23:48.165179+0000","last_became_peered":"2024-09-12T17:23:48.165179+0000","last_unstale":"2024-09-12T18:01:50.870728+0000","last_undegraded":"2024-09-12T18:01:50.870728+0000","last_fullsized":"2024-09-12T18:01:50.870728+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:26.382390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"261'143","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.345598+0000","last_change":"2024-09-12T17:23:50.188608+0000","last_active":"2024-09-12T18:01:41.345598+0000","last_peered":"2024-09-12T18:01:41.345598+0000","last_clean":"2024-09-12T18:01:41.345598+0000","last_became_active":"2024-09-12T17:23:50.188230+0000","last_became_peered":"2024-09-12T17:23:50.188230+0000","last_unstale":"2024-09-12T18:01:41.345598+0000","last_undegraded":"2024-09-12T18:01:41.345598+0000","last_fullsized":"2024-09-12T18:01:41.345598+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:43.821173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":185,"num_write":335,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"261'475","reported_seq":2033,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.632480+0000","last_change":"2024-09-12T18:02:04.632480+0000","last_active":"2024-09-12T18:02:04.632480+0000","last_peered":"2024-09-12T18:02:04.632480+0000","last_clean":"2024-09-12T18:02:04.632480+0000","last_became_active":"2024-09-12T17:23:42.153910+0000","last_became_peered":"2024-09-12T17:23:42.153910+0000","last_unstale":"2024-09-12T18:02:04.632480+0000","last_undegraded":"2024-09-12T18:02:04.632480+0000","last_fullsized":"2024-09-12T18:02:04.632480+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'475","last_scrub_stamp":"2024-09-12T18:02:04.632383+0000","last_deep_scrub":"261'475","last_deep_scrub_stamp":"2024-09-12T18:02:04.632383+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.632383+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:53.568782+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2575,"num_read_kb":2405,"num_write":575,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"261'399","reported_seq":1123,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.268326+0000","last_change":"2024-09-12T18:02:00.268326+0000","last_active":"2024-09-12T18:02:00.268326+0000","last_peered":"2024-09-12T18:02:00.268326+0000","last_clean":"2024-09-12T18:02:00.268326+0000","last_became_active":"2024-09-12T17:23:40.712691+0000","last_became_peered":"2024-09-12T17:23:40.712691+0000","last_unstale":"2024-09-12T18:02:00.268326+0000","last_undegraded":"2024-09-12T18:02:00.268326+0000","last_fullsized":"2024-09-12T18:02:00.268326+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'399","last_scrub_stamp":"2024-09-12T18:02:00.268230+0000","last_deep_scrub":"261'399","last_deep_scrub_stamp":"2024-09-12T18:02:00.268230+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.268230+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:40.016187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":118590,"num_write":1283,"num_write_kb":72411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.002484+0000","last_change":"2024-09-12T18:02:09.002484+0000","last_active":"2024-09-12T18:02:09.002484+0000","last_peered":"2024-09-12T18:02:09.002484+0000","last_clean":"2024-09-12T18:02:09.002484+0000","last_became_active":"2024-09-12T17:23:44.142306+0000","last_became_peered":"2024-09-12T17:23:44.142306+0000","last_unstale":"2024-09-12T18:02:09.002484+0000","last_undegraded":"2024-09-12T18:02:09.002484+0000","last_fullsized":"2024-09-12T18:02:09.002484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:09.002389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:09.002389+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.002389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:07.194068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"261'456","reported_seq":1070,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.456866+0000","last_change":"2024-09-12T17:23:46.154013+0000","last_active":"2024-09-12T18:01:50.456866+0000","last_peered":"2024-09-12T18:01:50.456866+0000","last_clean":"2024-09-12T18:01:50.456866+0000","last_became_active":"2024-09-12T17:23:46.153719+0000","last_became_peered":"2024-09-12T17:23:46.153719+0000","last_unstale":"2024-09-12T18:01:50.456866+0000","last_undegraded":"2024-09-12T18:01:50.456866+0000","last_fullsized":"2024-09-12T18:01:50.456866+0000","mapping_epoch":29,"log_start":"261'400","ondisk_log_start":"261'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:26.689565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96999,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":810,"num_read_kb":1963,"num_write":664,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.004207+0000","last_change":"2024-09-12T18:02:12.004207+0000","last_active":"2024-09-12T18:02:12.004207+0000","last_peered":"2024-09-12T18:02:12.004207+0000","last_clean":"2024-09-12T18:02:12.004207+0000","last_became_active":"2024-09-12T17:23:48.170317+0000","last_became_peered":"2024-09-12T17:23:48.170317+0000","last_unstale":"2024-09-12T18:02:12.004207+0000","last_undegraded":"2024-09-12T18:02:12.004207+0000","last_fullsized":"2024-09-12T18:02:12.004207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:12.004106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:12.004106+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.004106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:51.147942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"261'153","reported_seq":658,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:22.115592+0000","last_change":"2024-09-12T17:23:50.184354+0000","last_active":"2024-09-12T17:59:22.115592+0000","last_peered":"2024-09-12T17:59:22.115592+0000","last_clean":"2024-09-12T17:59:22.115592+0000","last_became_active":"2024-09-12T17:23:50.184033+0000","last_became_peered":"2024-09-12T17:23:50.184033+0000","last_unstale":"2024-09-12T17:59:22.115592+0000","last_undegraded":"2024-09-12T17:59:22.115592+0000","last_fullsized":"2024-09-12T17:59:22.115592+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:27.722195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":204,"num_write":351,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"261'835","reported_seq":2451,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.034117+0000","last_change":"2024-09-12T18:02:03.034117+0000","last_active":"2024-09-12T18:02:03.034117+0000","last_peered":"2024-09-12T18:02:03.034117+0000","last_clean":"2024-09-12T18:02:03.034117+0000","last_became_active":"2024-09-12T17:23:42.144703+0000","last_became_peered":"2024-09-12T17:23:42.144703+0000","last_unstale":"2024-09-12T18:02:03.034117+0000","last_undegraded":"2024-09-12T18:02:03.034117+0000","last_fullsized":"2024-09-12T18:02:03.034117+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'835","last_scrub_stamp":"2024-09-12T18:02:03.034031+0000","last_deep_scrub":"261'835","last_deep_scrub_stamp":"2024-09-12T18:02:03.034031+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.034031+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:20.574756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3952,"num_read_kb":3587,"num_write":1103,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"261'396","reported_seq":1062,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.233459+0000","last_change":"2024-09-12T18:01:59.233459+0000","last_active":"2024-09-12T18:01:59.233459+0000","last_peered":"2024-09-12T18:01:59.233459+0000","last_clean":"2024-09-12T18:01:59.233459+0000","last_became_active":"2024-09-12T17:23:40.706213+0000","last_became_peered":"2024-09-12T17:23:40.706213+0000","last_unstale":"2024-09-12T18:01:59.233459+0000","last_undegraded":"2024-09-12T18:01:59.233459+0000","last_fullsized":"2024-09-12T18:01:59.233459+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'396","last_scrub_stamp":"2024-09-12T18:01:59.233355+0000","last_deep_scrub":"261'396","last_deep_scrub_stamp":"2024-09-12T18:01:59.233355+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.233355+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:59.541266+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2088372,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":615,"num_read_kb":8190,"num_write":1407,"num_write_kb":25988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.021025+0000","last_change":"2024-09-12T18:02:08.021025+0000","last_active":"2024-09-12T18:02:08.021025+0000","last_peered":"2024-09-12T18:02:08.021025+0000","last_clean":"2024-09-12T18:02:08.021025+0000","last_became_active":"2024-09-12T17:23:44.149550+0000","last_became_peered":"2024-09-12T17:23:44.149550+0000","last_unstale":"2024-09-12T18:02:08.021025+0000","last_undegraded":"2024-09-12T18:02:08.021025+0000","last_fullsized":"2024-09-12T18:02:08.021025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:08.020929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:08.020929+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.020929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:44.082038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"261'277","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.511100+0000","last_change":"2024-09-12T17:23:46.153560+0000","last_active":"2024-09-12T18:01:50.511100+0000","last_peered":"2024-09-12T18:01:50.511100+0000","last_clean":"2024-09-12T18:01:50.511100+0000","last_became_active":"2024-09-12T17:23:46.153210+0000","last_became_peered":"2024-09-12T17:23:46.153210+0000","last_unstale":"2024-09-12T18:01:50.511100+0000","last_undegraded":"2024-09-12T18:01:50.511100+0000","last_fullsized":"2024-09-12T18:01:50.511100+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":1026,"num_write":426,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.551482+0000","last_change":"2024-09-12T17:23:48.168999+0000","last_active":"2024-09-12T17:59:54.551482+0000","last_peered":"2024-09-12T17:59:54.551482+0000","last_clean":"2024-09-12T17:59:54.551482+0000","last_became_active":"2024-09-12T17:23:48.168675+0000","last_became_peered":"2024-09-12T17:23:48.168675+0000","last_unstale":"2024-09-12T17:59:54.551482+0000","last_undegraded":"2024-09-12T17:59:54.551482+0000","last_fullsized":"2024-09-12T17:59:54.551482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"261'97","reported_seq":578,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:32.142963+0000","last_change":"2024-09-12T17:23:50.186614+0000","last_active":"2024-09-12T18:01:32.142963+0000","last_peered":"2024-09-12T18:01:32.142963+0000","last_clean":"2024-09-12T18:01:32.142963+0000","last_became_active":"2024-09-12T17:23:50.186287+0000","last_became_peered":"2024-09-12T17:23:50.186287+0000","last_unstale":"2024-09-12T18:01:32.142963+0000","last_undegraded":"2024-09-12T18:01:32.142963+0000","last_fullsized":"2024-09-12T18:01:32.142963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":108,"num_read_kb":104,"num_write":228,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"261'642","reported_seq":2252,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.070744+0000","last_change":"2024-09-12T18:02:04.070744+0000","last_active":"2024-09-12T18:02:04.070744+0000","last_peered":"2024-09-12T18:02:04.070744+0000","last_clean":"2024-09-12T18:02:04.070744+0000","last_became_active":"2024-09-12T17:23:42.132858+0000","last_became_peered":"2024-09-12T17:23:42.132858+0000","last_unstale":"2024-09-12T18:02:04.070744+0000","last_undegraded":"2024-09-12T18:02:04.070744+0000","last_fullsized":"2024-09-12T18:02:04.070744+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'642","last_scrub_stamp":"2024-09-12T18:02:04.070634+0000","last_deep_scrub":"261'642","last_deep_scrub_stamp":"2024-09-12T18:02:04.070634+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.070634+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:45.786486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3409,"num_read_kb":3082,"num_write":929,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"261'409","reported_seq":1090,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.166598+0000","last_change":"2024-09-12T18:01:57.166598+0000","last_active":"2024-09-12T18:01:57.166598+0000","last_peered":"2024-09-12T18:01:57.166598+0000","last_clean":"2024-09-12T18:01:57.166598+0000","last_became_active":"2024-09-12T17:23:40.706531+0000","last_became_peered":"2024-09-12T17:23:40.706531+0000","last_unstale":"2024-09-12T18:01:57.166598+0000","last_undegraded":"2024-09-12T18:01:57.166598+0000","last_fullsized":"2024-09-12T18:01:57.166598+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'409","last_scrub_stamp":"2024-09-12T18:01:57.166513+0000","last_deep_scrub":"261'409","last_deep_scrub_stamp":"2024-09-12T18:01:57.166513+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.166513+0000","objects_scrubbed":6,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:43.195543+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":670,"num_read_kb":36595,"num_write":1219,"num_write_kb":30858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"261'6","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.977020+0000","last_change":"2024-09-12T18:02:11.977020+0000","last_active":"2024-09-12T18:02:11.977020+0000","last_peered":"2024-09-12T18:02:11.977020+0000","last_clean":"2024-09-12T18:02:11.977020+0000","last_became_active":"2024-09-12T17:23:44.147427+0000","last_became_peered":"2024-09-12T17:23:44.147427+0000","last_unstale":"2024-09-12T18:02:11.977020+0000","last_undegraded":"2024-09-12T18:02:11.977020+0000","last_fullsized":"2024-09-12T18:02:11.977020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T18:02:11.976933+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T18:02:11.976933+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.976933+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:25.517914+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":1201,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"261'305","reported_seq":883,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.994122+0000","last_change":"2024-09-12T18:02:10.994122+0000","last_active":"2024-09-12T18:02:10.994122+0000","last_peered":"2024-09-12T18:02:10.994122+0000","last_clean":"2024-09-12T18:02:10.994122+0000","last_became_active":"2024-09-12T17:23:46.153004+0000","last_became_peered":"2024-09-12T17:23:46.153004+0000","last_unstale":"2024-09-12T18:02:10.994122+0000","last_undegraded":"2024-09-12T18:02:10.994122+0000","last_fullsized":"2024-09-12T18:02:10.994122+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'305","last_scrub_stamp":"2024-09-12T18:02:10.994015+0000","last_deep_scrub":"261'305","last_deep_scrub_stamp":"2024-09-12T18:02:10.994015+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.994015+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:16.444198+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46983,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":497,"num_read_kb":1127,"num_write":408,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"261'742","reported_seq":2131,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.067029+0000","last_change":"2024-09-12T17:23:48.169354+0000","last_active":"2024-09-12T18:01:51.067029+0000","last_peered":"2024-09-12T18:01:51.067029+0000","last_clean":"2024-09-12T18:01:51.067029+0000","last_became_active":"2024-09-12T17:23:48.169062+0000","last_became_peered":"2024-09-12T17:23:48.169062+0000","last_unstale":"2024-09-12T18:01:51.067029+0000","last_undegraded":"2024-09-12T18:01:51.067029+0000","last_fullsized":"2024-09-12T18:01:51.067029+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"261'140","reported_seq":626,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.160885+0000","last_change":"2024-09-12T17:23:50.184877+0000","last_active":"2024-09-12T18:00:18.160885+0000","last_peered":"2024-09-12T18:00:18.160885+0000","last_clean":"2024-09-12T18:00:18.160885+0000","last_became_active":"2024-09-12T17:23:50.184460+0000","last_became_peered":"2024-09-12T17:23:50.184460+0000","last_unstale":"2024-09-12T18:00:18.160885+0000","last_undegraded":"2024-09-12T18:00:18.160885+0000","last_fullsized":"2024-09-12T18:00:18.160885+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:05.644031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":156,"num_write":329,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"261'798","reported_seq":2262,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.150267+0000","last_change":"2024-09-12T18:02:06.150267+0000","last_active":"2024-09-12T18:02:06.150267+0000","last_peered":"2024-09-12T18:02:06.150267+0000","last_clean":"2024-09-12T18:02:06.150267+0000","last_became_active":"2024-09-12T17:23:42.142896+0000","last_became_peered":"2024-09-12T17:23:42.142896+0000","last_unstale":"2024-09-12T18:02:06.150267+0000","last_undegraded":"2024-09-12T18:02:06.150267+0000","last_fullsized":"2024-09-12T18:02:06.150267+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'798","last_scrub_stamp":"2024-09-12T18:02:06.150180+0000","last_deep_scrub":"261'798","last_deep_scrub_stamp":"2024-09-12T18:02:06.150180+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.150180+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:47.648995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3737,"num_read_kb":3347,"num_write":1075,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"261'343","reported_seq":1014,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.076389+0000","last_change":"2024-09-12T18:01:56.076389+0000","last_active":"2024-09-12T18:01:56.076389+0000","last_peered":"2024-09-12T18:01:56.076389+0000","last_clean":"2024-09-12T18:01:56.076389+0000","last_became_active":"2024-09-12T17:23:40.708386+0000","last_became_peered":"2024-09-12T17:23:40.708386+0000","last_unstale":"2024-09-12T18:01:56.076389+0000","last_undegraded":"2024-09-12T18:01:56.076389+0000","last_fullsized":"2024-09-12T18:01:56.076389+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'343","last_scrub_stamp":"2024-09-12T18:01:56.076247+0000","last_deep_scrub":"261'343","last_deep_scrub_stamp":"2024-09-12T18:01:56.076247+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.076247+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:59.205706+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655881,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":106949,"num_write":1131,"num_write_kb":37410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1450,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.408849+0000","last_change":"2024-09-12T17:23:44.150061+0000","last_active":"2024-09-12T18:01:49.408849+0000","last_peered":"2024-09-12T18:01:49.408849+0000","last_clean":"2024-09-12T18:01:49.408849+0000","last_became_active":"2024-09-12T17:23:44.149279+0000","last_became_peered":"2024-09-12T17:23:44.149279+0000","last_unstale":"2024-09-12T18:01:49.408849+0000","last_undegraded":"2024-09-12T18:01:49.408849+0000","last_fullsized":"2024-09-12T18:01:49.408849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"261'63","reported_seq":567,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.421759+0000","last_change":"2024-09-12T17:23:46.241422+0000","last_active":"2024-09-12T17:59:48.421759+0000","last_peered":"2024-09-12T17:59:48.421759+0000","last_clean":"2024-09-12T17:59:48.421759+0000","last_became_active":"2024-09-12T17:23:46.240979+0000","last_became_peered":"2024-09-12T17:23:46.240979+0000","last_unstale":"2024-09-12T17:59:48.421759+0000","last_undegraded":"2024-09-12T17:59:48.421759+0000","last_fullsized":"2024-09-12T17:59:48.421759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"261'786","reported_seq":2381,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.068088+0000","last_change":"2024-09-12T17:23:48.172774+0000","last_active":"2024-09-12T18:01:51.068088+0000","last_peered":"2024-09-12T18:01:51.068088+0000","last_clean":"2024-09-12T18:01:51.068088+0000","last_became_active":"2024-09-12T17:23:48.172485+0000","last_became_peered":"2024-09-12T17:23:48.172485+0000","last_unstale":"2024-09-12T18:01:51.068088+0000","last_undegraded":"2024-09-12T18:01:51.068088+0000","last_fullsized":"2024-09-12T18:01:51.068088+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"261'140","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:56.764717+0000","last_change":"2024-09-12T17:23:50.179455+0000","last_active":"2024-09-12T17:59:56.764717+0000","last_peered":"2024-09-12T17:59:56.764717+0000","last_clean":"2024-09-12T17:59:56.764717+0000","last_became_active":"2024-09-12T17:23:50.179153+0000","last_became_peered":"2024-09-12T17:23:50.179153+0000","last_unstale":"2024-09-12T17:59:56.764717+0000","last_undegraded":"2024-09-12T17:59:56.764717+0000","last_fullsized":"2024-09-12T17:59:56.764717+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:04.149720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":149,"num_read_kb":148,"num_write":323,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"261'409","reported_seq":1909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.043260+0000","last_change":"2024-09-12T18:02:07.043260+0000","last_active":"2024-09-12T18:02:07.043260+0000","last_peered":"2024-09-12T18:02:07.043260+0000","last_clean":"2024-09-12T18:02:07.043260+0000","last_became_active":"2024-09-12T17:23:42.152339+0000","last_became_peered":"2024-09-12T17:23:42.152339+0000","last_unstale":"2024-09-12T18:02:07.043260+0000","last_undegraded":"2024-09-12T18:02:07.043260+0000","last_fullsized":"2024-09-12T18:02:07.043260+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'409","last_scrub_stamp":"2024-09-12T18:02:07.043170+0000","last_deep_scrub":"261'409","last_deep_scrub_stamp":"2024-09-12T18:02:07.043170+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.043170+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:06.071189+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2264,"num_read_kb":2142,"num_write":477,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"261'440","reported_seq":1220,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.180910+0000","last_change":"2024-09-12T18:01:58.180910+0000","last_active":"2024-09-12T18:01:58.180910+0000","last_peered":"2024-09-12T18:01:58.180910+0000","last_clean":"2024-09-12T18:01:58.180910+0000","last_became_active":"2024-09-12T17:23:40.714708+0000","last_became_peered":"2024-09-12T17:23:40.714708+0000","last_unstale":"2024-09-12T18:01:58.180910+0000","last_undegraded":"2024-09-12T18:01:58.180910+0000","last_fullsized":"2024-09-12T18:01:58.180910+0000","mapping_epoch":23,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'440","last_scrub_stamp":"2024-09-12T18:01:58.180819+0000","last_deep_scrub":"261'440","last_deep_scrub_stamp":"2024-09-12T18:01:58.180819+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.180819+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:13.620327+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1005,"num_read_kb":34670,"num_write":1495,"num_write_kb":45714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.422581+0000","last_change":"2024-09-12T17:23:44.151662+0000","last_active":"2024-09-12T17:59:44.422581+0000","last_peered":"2024-09-12T17:59:44.422581+0000","last_clean":"2024-09-12T17:59:44.422581+0000","last_became_active":"2024-09-12T17:23:44.151392+0000","last_became_peered":"2024-09-12T17:23:44.151392+0000","last_unstale":"2024-09-12T17:59:44.422581+0000","last_undegraded":"2024-09-12T17:59:44.422581+0000","last_fullsized":"2024-09-12T17:59:44.422581+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"261'305","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.511369+0000","last_change":"2024-09-12T17:23:46.145102+0000","last_active":"2024-09-12T18:01:49.511369+0000","last_peered":"2024-09-12T18:01:49.511369+0000","last_clean":"2024-09-12T18:01:49.511369+0000","last_became_active":"2024-09-12T17:23:46.144754+0000","last_became_peered":"2024-09-12T17:23:46.144754+0000","last_unstale":"2024-09-12T18:01:49.511369+0000","last_undegraded":"2024-09-12T18:01:49.511369+0000","last_fullsized":"2024-09-12T18:01:49.511369+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46816,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":500,"num_read_kb":1038,"num_write":390,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.115251+0000","last_change":"2024-09-12T18:02:13.115251+0000","last_active":"2024-09-12T18:02:13.115251+0000","last_peered":"2024-09-12T18:02:13.115251+0000","last_clean":"2024-09-12T18:02:13.115251+0000","last_became_active":"2024-09-12T17:23:48.170482+0000","last_became_peered":"2024-09-12T17:23:48.170482+0000","last_unstale":"2024-09-12T18:02:13.115251+0000","last_undegraded":"2024-09-12T18:02:13.115251+0000","last_fullsized":"2024-09-12T18:02:13.115251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:13.115166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:13.115166+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.115166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:47.974782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"261'140","reported_seq":633,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.433834+0000","last_change":"2024-09-12T17:23:50.187298+0000","last_active":"2024-09-12T18:01:19.433834+0000","last_peered":"2024-09-12T18:01:19.433834+0000","last_clean":"2024-09-12T18:01:19.433834+0000","last_became_active":"2024-09-12T17:23:50.187040+0000","last_became_peered":"2024-09-12T17:23:50.187040+0000","last_unstale":"2024-09-12T18:01:19.433834+0000","last_undegraded":"2024-09-12T18:01:19.433834+0000","last_fullsized":"2024-09-12T18:01:19.433834+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:15.392439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":190,"num_write":335,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"261'1233","reported_seq":2789,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.139896+0000","last_change":"2024-09-12T18:02:05.139896+0000","last_active":"2024-09-12T18:02:05.139896+0000","last_peered":"2024-09-12T18:02:05.139896+0000","last_clean":"2024-09-12T18:02:05.139896+0000","last_became_active":"2024-09-12T17:23:42.146200+0000","last_became_peered":"2024-09-12T17:23:42.146200+0000","last_unstale":"2024-09-12T18:02:05.139896+0000","last_undegraded":"2024-09-12T18:02:05.139896+0000","last_fullsized":"2024-09-12T18:02:05.139896+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1233","last_scrub_stamp":"2024-09-12T18:02:05.139829+0000","last_deep_scrub":"261'1233","last_deep_scrub_stamp":"2024-09-12T18:02:05.139829+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.139829+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":1200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:20.252996+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5862,"num_read_kb":5167,"num_write":1742,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"261'74","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.604067+0000","last_change":"2024-09-12T18:01:57.604067+0000","last_active":"2024-09-12T18:01:57.604067+0000","last_peered":"2024-09-12T18:01:57.604067+0000","last_clean":"2024-09-12T18:01:57.604067+0000","last_became_active":"2024-09-12T17:23:26.034872+0000","last_became_peered":"2024-09-12T17:23:26.034872+0000","last_unstale":"2024-09-12T18:01:57.604067+0000","last_undegraded":"2024-09-12T18:01:57.604067+0000","last_fullsized":"2024-09-12T18:01:57.604067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'74","last_scrub_stamp":"2024-09-12T18:01:57.603967+0000","last_deep_scrub":"261'74","last_deep_scrub_stamp":"2024-09-12T18:01:57.603967+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.603967+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:41.712562+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"261'2","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.219549+0000","last_change":"2024-09-12T18:01:58.219549+0000","last_active":"2024-09-12T18:01:58.219549+0000","last_peered":"2024-09-12T18:01:58.219549+0000","last_clean":"2024-09-12T18:01:58.219549+0000","last_became_active":"2024-09-12T17:23:31.584884+0000","last_became_peered":"2024-09-12T17:23:31.584884+0000","last_unstale":"2024-09-12T18:01:58.219549+0000","last_undegraded":"2024-09-12T18:01:58.219549+0000","last_fullsized":"2024-09-12T18:01:58.219549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:01:58.219468+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:01:58.219468+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.219468+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:46.365922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000423087,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"261'317","reported_seq":954,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.118593+0000","last_change":"2024-09-12T18:01:56.118593+0000","last_active":"2024-09-12T18:01:56.118593+0000","last_peered":"2024-09-12T18:01:56.118593+0000","last_clean":"2024-09-12T18:01:56.118593+0000","last_became_active":"2024-09-12T17:23:40.718896+0000","last_became_peered":"2024-09-12T17:23:40.718896+0000","last_unstale":"2024-09-12T18:01:56.118593+0000","last_undegraded":"2024-09-12T18:01:56.118593+0000","last_fullsized":"2024-09-12T18:01:56.118593+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'317","last_scrub_stamp":"2024-09-12T18:01:56.118490+0000","last_deep_scrub":"261'317","last_deep_scrub_stamp":"2024-09-12T18:01:56.118490+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.118490+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:05.520040+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":13109,"num_write":1018,"num_write_kb":39939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"35'3","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:48.980832+0000","last_change":"2024-09-12T17:23:44.152872+0000","last_active":"2024-09-12T18:01:48.980832+0000","last_peered":"2024-09-12T18:01:48.980832+0000","last_clean":"2024-09-12T18:01:48.980832+0000","last_became_active":"2024-09-12T17:23:44.152585+0000","last_became_peered":"2024-09-12T17:23:44.152585+0000","last_unstale":"2024-09-12T18:01:48.980832+0000","last_undegraded":"2024-09-12T18:01:48.980832+0000","last_fullsized":"2024-09-12T18:01:48.980832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:27.878346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"261'717","reported_seq":1407,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.964239+0000","last_change":"2024-09-12T17:23:46.152000+0000","last_active":"2024-09-12T18:01:50.964239+0000","last_peered":"2024-09-12T18:01:50.964239+0000","last_clean":"2024-09-12T18:01:50.964239+0000","last_became_active":"2024-09-12T17:23:46.151673+0000","last_became_peered":"2024-09-12T17:23:46.151673+0000","last_unstale":"2024-09-12T18:01:50.964239+0000","last_undegraded":"2024-09-12T18:01:50.964239+0000","last_fullsized":"2024-09-12T18:01:50.964239+0000","mapping_epoch":29,"log_start":"261'700","ondisk_log_start":"261'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":700,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:23.689449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145502,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1428,"num_read_kb":3259,"num_write":1354,"num_write_kb":1206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.539616+0000","last_change":"2024-09-12T17:23:48.170416+0000","last_active":"2024-09-12T17:58:29.539616+0000","last_peered":"2024-09-12T17:58:29.539616+0000","last_clean":"2024-09-12T17:58:29.539616+0000","last_became_active":"2024-09-12T17:23:48.170153+0000","last_became_peered":"2024-09-12T17:23:48.170153+0000","last_unstale":"2024-09-12T17:58:29.539616+0000","last_undegraded":"2024-09-12T17:58:29.539616+0000","last_fullsized":"2024-09-12T17:58:29.539616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:47.543479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"261'224","reported_seq":941,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.565834+0000","last_change":"2024-09-12T17:23:50.188844+0000","last_active":"2024-09-12T18:00:18.565834+0000","last_peered":"2024-09-12T18:00:18.565834+0000","last_clean":"2024-09-12T18:00:18.565834+0000","last_became_active":"2024-09-12T17:23:50.188552+0000","last_became_peered":"2024-09-12T17:23:50.188552+0000","last_unstale":"2024-09-12T18:00:18.565834+0000","last_undegraded":"2024-09-12T18:00:18.565834+0000","last_fullsized":"2024-09-12T18:00:18.565834+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:48.789056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":580,"num_write":503,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"261'393","reported_seq":1839,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.682090+0000","last_change":"2024-09-12T18:02:03.682090+0000","last_active":"2024-09-12T18:02:03.682090+0000","last_peered":"2024-09-12T18:02:03.682090+0000","last_clean":"2024-09-12T18:02:03.682090+0000","last_became_active":"2024-09-12T17:23:42.147045+0000","last_became_peered":"2024-09-12T17:23:42.147045+0000","last_unstale":"2024-09-12T18:02:03.682090+0000","last_undegraded":"2024-09-12T18:02:03.682090+0000","last_fullsized":"2024-09-12T18:02:03.682090+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'393","last_scrub_stamp":"2024-09-12T18:02:03.681965+0000","last_deep_scrub":"261'393","last_deep_scrub_stamp":"2024-09-12T18:02:03.681965+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.681965+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:17.784933+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2080,"num_read_kb":1972,"num_write":429,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1199,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":515,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.639675+0000","last_change":"2024-09-12T18:01:58.639675+0000","last_active":"2024-09-12T18:01:58.639675+0000","last_peered":"2024-09-12T18:01:58.639675+0000","last_clean":"2024-09-12T18:01:58.639675+0000","last_became_active":"2024-09-12T17:23:31.588699+0000","last_became_peered":"2024-09-12T17:23:31.588699+0000","last_unstale":"2024-09-12T18:01:58.639675+0000","last_undegraded":"2024-09-12T18:01:58.639675+0000","last_fullsized":"2024-09-12T18:01:58.639675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:58.639583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:58.639583+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.639583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:21.037862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052181899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"261'342","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.723017+0000","last_change":"2024-09-12T18:01:58.723017+0000","last_active":"2024-09-12T18:01:58.723017+0000","last_peered":"2024-09-12T18:01:58.723017+0000","last_clean":"2024-09-12T18:01:58.723017+0000","last_became_active":"2024-09-12T17:23:40.713199+0000","last_became_peered":"2024-09-12T17:23:40.713199+0000","last_unstale":"2024-09-12T18:01:58.723017+0000","last_undegraded":"2024-09-12T18:01:58.723017+0000","last_fullsized":"2024-09-12T18:01:58.723017+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'342","last_scrub_stamp":"2024-09-12T18:01:58.722915+0000","last_deep_scrub":"261'342","last_deep_scrub_stamp":"2024-09-12T18:01:58.722915+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.722915+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:52.223877+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":39290,"num_write":1124,"num_write_kb":55994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:24.411614+0000","last_change":"2024-09-12T17:23:44.150487+0000","last_active":"2024-09-12T17:58:24.411614+0000","last_peered":"2024-09-12T17:58:24.411614+0000","last_clean":"2024-09-12T17:58:24.411614+0000","last_became_active":"2024-09-12T17:23:44.149400+0000","last_became_peered":"2024-09-12T17:23:44.149400+0000","last_unstale":"2024-09-12T17:58:24.411614+0000","last_undegraded":"2024-09-12T17:58:24.411614+0000","last_fullsized":"2024-09-12T17:58:24.411614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:43.627464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"261'1312","reported_seq":2699,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.919043+0000","last_change":"2024-09-12T17:23:46.145651+0000","last_active":"2024-09-12T18:01:50.919043+0000","last_peered":"2024-09-12T18:01:50.919043+0000","last_clean":"2024-09-12T18:01:50.919043+0000","last_became_active":"2024-09-12T17:23:46.145354+0000","last_became_peered":"2024-09-12T17:23:46.145354+0000","last_unstale":"2024-09-12T18:01:50.919043+0000","last_undegraded":"2024-09-12T18:01:50.919043+0000","last_fullsized":"2024-09-12T18:01:50.919043+0000","mapping_epoch":29,"log_start":"261'1300","ondisk_log_start":"261'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":1300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:28.485902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139395,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2079,"num_read_kb":4017,"num_write":1172,"num_write_kb":1007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:24.420299+0000","last_change":"2024-09-12T17:23:48.171635+0000","last_active":"2024-09-12T17:59:24.420299+0000","last_peered":"2024-09-12T17:59:24.420299+0000","last_clean":"2024-09-12T17:59:24.420299+0000","last_became_active":"2024-09-12T17:23:48.171355+0000","last_became_peered":"2024-09-12T17:23:48.171355+0000","last_unstale":"2024-09-12T17:59:24.420299+0000","last_undegraded":"2024-09-12T17:59:24.420299+0000","last_fullsized":"2024-09-12T17:59:24.420299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:15.550883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"261'108","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.915226+0000","last_change":"2024-09-12T17:23:50.639398+0000","last_active":"2024-09-12T17:59:59.915226+0000","last_peered":"2024-09-12T17:59:59.915226+0000","last_clean":"2024-09-12T17:59:59.915226+0000","last_became_active":"2024-09-12T17:23:50.639053+0000","last_became_peered":"2024-09-12T17:23:50.639053+0000","last_unstale":"2024-09-12T17:59:59.915226+0000","last_undegraded":"2024-09-12T17:59:59.915226+0000","last_fullsized":"2024-09-12T17:59:59.915226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:38.696802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":162,"num_write":260,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"261'914","reported_seq":2650,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.066774+0000","last_change":"2024-09-12T18:02:06.066774+0000","last_active":"2024-09-12T18:02:06.066774+0000","last_peered":"2024-09-12T18:02:06.066774+0000","last_clean":"2024-09-12T18:02:06.066774+0000","last_became_active":"2024-09-12T17:23:42.145049+0000","last_became_peered":"2024-09-12T17:23:42.145049+0000","last_unstale":"2024-09-12T18:02:06.066774+0000","last_undegraded":"2024-09-12T18:02:06.066774+0000","last_fullsized":"2024-09-12T18:02:06.066774+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'914","last_scrub_stamp":"2024-09-12T18:02:06.066685+0000","last_deep_scrub":"261'914","last_deep_scrub_stamp":"2024-09-12T18:02:06.066685+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.066685+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":900,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:56.688488+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4463,"num_read_kb":4014,"num_write":1227,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.898988+0000","last_change":"2024-09-12T18:01:55.898988+0000","last_active":"2024-09-12T18:01:55.898988+0000","last_peered":"2024-09-12T18:01:55.898988+0000","last_clean":"2024-09-12T18:01:55.898988+0000","last_became_active":"2024-09-12T17:23:31.584259+0000","last_became_peered":"2024-09-12T17:23:31.584259+0000","last_unstale":"2024-09-12T18:01:55.898988+0000","last_undegraded":"2024-09-12T18:01:55.898988+0000","last_fullsized":"2024-09-12T18:01:55.898988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:55.898906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:55.898906+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.898906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:27.914712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045870900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"261'331","reported_seq":961,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.976477+0000","last_change":"2024-09-12T18:01:55.976477+0000","last_active":"2024-09-12T18:01:55.976477+0000","last_peered":"2024-09-12T18:01:55.976477+0000","last_clean":"2024-09-12T18:01:55.976477+0000","last_became_active":"2024-09-12T17:23:40.712276+0000","last_became_peered":"2024-09-12T17:23:40.712276+0000","last_unstale":"2024-09-12T18:01:55.976477+0000","last_undegraded":"2024-09-12T18:01:55.976477+0000","last_fullsized":"2024-09-12T18:01:55.976477+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'331","last_scrub_stamp":"2024-09-12T18:01:55.976396+0000","last_deep_scrub":"261'331","last_deep_scrub_stamp":"2024-09-12T18:01:55.976396+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.976396+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:09.619450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":8922,"num_write":1082,"num_write_kb":17941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"261'2","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.053911+0000","last_change":"2024-09-12T18:02:06.053911+0000","last_active":"2024-09-12T18:02:06.053911+0000","last_peered":"2024-09-12T18:02:06.053911+0000","last_clean":"2024-09-12T18:02:06.053911+0000","last_became_active":"2024-09-12T17:23:44.151006+0000","last_became_peered":"2024-09-12T17:23:44.151006+0000","last_unstale":"2024-09-12T18:02:06.053911+0000","last_undegraded":"2024-09-12T18:02:06.053911+0000","last_fullsized":"2024-09-12T18:02:06.053911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:06.053826+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:06.053826+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.053826+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:20.770473+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"261'194","reported_seq":1181,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.322144+0000","last_change":"2024-09-12T17:23:46.242242+0000","last_active":"2024-09-12T18:01:38.322144+0000","last_peered":"2024-09-12T18:01:38.322144+0000","last_clean":"2024-09-12T18:01:38.322144+0000","last_became_active":"2024-09-12T17:23:46.241733+0000","last_became_peered":"2024-09-12T17:23:46.241733+0000","last_unstale":"2024-09-12T18:01:38.322144+0000","last_undegraded":"2024-09-12T18:01:38.322144+0000","last_fullsized":"2024-09-12T18:01:38.322144+0000","mapping_epoch":29,"log_start":"258'100","ondisk_log_start":"258'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:35.528461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":152,"num_read_kb":143,"num_write":117,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.545833+0000","last_change":"2024-09-12T17:23:48.168199+0000","last_active":"2024-09-12T17:59:14.545833+0000","last_peered":"2024-09-12T17:59:14.545833+0000","last_clean":"2024-09-12T17:59:14.545833+0000","last_became_active":"2024-09-12T17:23:48.167920+0000","last_became_peered":"2024-09-12T17:23:48.167920+0000","last_unstale":"2024-09-12T17:59:14.545833+0000","last_undegraded":"2024-09-12T17:59:14.545833+0000","last_fullsized":"2024-09-12T17:59:14.545833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:52.699030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"261'262","reported_seq":859,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.708721+0000","last_change":"2024-09-12T17:23:50.177810+0000","last_active":"2024-09-12T18:00:18.708721+0000","last_peered":"2024-09-12T18:00:18.708721+0000","last_clean":"2024-09-12T18:00:18.708721+0000","last_became_active":"2024-09-12T17:23:50.177293+0000","last_became_peered":"2024-09-12T17:23:50.177293+0000","last_unstale":"2024-09-12T18:00:18.708721+0000","last_undegraded":"2024-09-12T18:00:18.708721+0000","last_fullsized":"2024-09-12T18:00:18.708721+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":569,"num_write":571,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"261'445","reported_seq":2043,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.029638+0000","last_change":"2024-09-12T18:02:05.029638+0000","last_active":"2024-09-12T18:02:05.029638+0000","last_peered":"2024-09-12T18:02:05.029638+0000","last_clean":"2024-09-12T18:02:05.029638+0000","last_became_active":"2024-09-12T17:23:42.136083+0000","last_became_peered":"2024-09-12T17:23:42.136083+0000","last_unstale":"2024-09-12T18:02:05.029638+0000","last_undegraded":"2024-09-12T18:02:05.029638+0000","last_fullsized":"2024-09-12T18:02:05.029638+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'445","last_scrub_stamp":"2024-09-12T18:02:05.029525+0000","last_deep_scrub":"261'445","last_deep_scrub_stamp":"2024-09-12T18:02:05.029525+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.029525+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:54.386989+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2433,"num_read_kb":2304,"num_write":511,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"261'3","reported_seq":520,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.201047+0000","last_change":"2024-09-12T18:01:57.201047+0000","last_active":"2024-09-12T18:01:57.201047+0000","last_peered":"2024-09-12T18:01:57.201047+0000","last_clean":"2024-09-12T18:01:57.201047+0000","last_became_active":"2024-09-12T17:23:31.588612+0000","last_became_peered":"2024-09-12T17:23:31.588612+0000","last_unstale":"2024-09-12T18:01:57.201047+0000","last_undegraded":"2024-09-12T18:01:57.201047+0000","last_fullsized":"2024-09-12T18:01:57.201047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:01:57.200972+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:01:57.200972+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.200972+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:08.741396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00095838300000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"261'358","reported_seq":1082,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.069482+0000","last_change":"2024-09-12T18:01:57.069482+0000","last_active":"2024-09-12T18:01:57.069482+0000","last_peered":"2024-09-12T18:01:57.069482+0000","last_clean":"2024-09-12T18:01:57.069482+0000","last_became_active":"2024-09-12T17:23:40.716786+0000","last_became_peered":"2024-09-12T17:23:40.716786+0000","last_unstale":"2024-09-12T18:01:57.069482+0000","last_undegraded":"2024-09-12T18:01:57.069482+0000","last_fullsized":"2024-09-12T18:01:57.069482+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'358","last_scrub_stamp":"2024-09-12T18:01:57.069360+0000","last_deep_scrub":"261'358","last_deep_scrub_stamp":"2024-09-12T18:01:57.069360+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.069360+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:04.851606+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287987,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":555,"num_read_kb":40133,"num_write":1081,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.579113+0000","last_change":"2024-09-12T18:02:13.579113+0000","last_active":"2024-09-12T18:02:13.579113+0000","last_peered":"2024-09-12T18:02:13.579113+0000","last_clean":"2024-09-12T18:02:13.579113+0000","last_became_active":"2024-09-12T17:23:44.150912+0000","last_became_peered":"2024-09-12T17:23:44.150912+0000","last_unstale":"2024-09-12T18:02:13.579113+0000","last_undegraded":"2024-09-12T18:02:13.579113+0000","last_fullsized":"2024-09-12T18:02:13.579113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:13.579019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:13.579019+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.579019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:58.259163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"261'109","reported_seq":634,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:38.427984+0000","last_change":"2024-09-12T17:23:46.155872+0000","last_active":"2024-09-12T18:00:38.427984+0000","last_peered":"2024-09-12T18:00:38.427984+0000","last_clean":"2024-09-12T18:00:38.427984+0000","last_became_active":"2024-09-12T17:23:46.155516+0000","last_became_peered":"2024-09-12T17:23:46.155516+0000","last_unstale":"2024-09-12T18:00:38.427984+0000","last_undegraded":"2024-09-12T18:00:38.427984+0000","last_fullsized":"2024-09-12T18:00:38.427984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:35.167613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":92,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.131263+0000","last_change":"2024-09-12T18:02:14.131263+0000","last_active":"2024-09-12T18:02:14.131263+0000","last_peered":"2024-09-12T18:02:14.131263+0000","last_clean":"2024-09-12T18:02:14.131263+0000","last_became_active":"2024-09-12T17:23:48.170462+0000","last_became_peered":"2024-09-12T17:23:48.170462+0000","last_unstale":"2024-09-12T18:02:14.131263+0000","last_undegraded":"2024-09-12T18:02:14.131263+0000","last_fullsized":"2024-09-12T18:02:14.131263+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:14.131174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:14.131174+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.131174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:21.306321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":655,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.159077+0000","last_change":"2024-09-12T17:23:50.186802+0000","last_active":"2024-09-12T18:00:18.159077+0000","last_peered":"2024-09-12T18:00:18.159077+0000","last_clean":"2024-09-12T18:00:18.159077+0000","last_became_active":"2024-09-12T17:23:50.186526+0000","last_became_peered":"2024-09-12T17:23:50.186526+0000","last_unstale":"2024-09-12T18:00:18.159077+0000","last_undegraded":"2024-09-12T18:00:18.159077+0000","last_fullsized":"2024-09-12T18:00:18.159077+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:15.982689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":247,"num_write":303,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"261'542","reported_seq":2265,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.073021+0000","last_change":"2024-09-12T18:02:03.073021+0000","last_active":"2024-09-12T18:02:03.073021+0000","last_peered":"2024-09-12T18:02:03.073021+0000","last_clean":"2024-09-12T18:02:03.073021+0000","last_became_active":"2024-09-12T17:23:42.151735+0000","last_became_peered":"2024-09-12T17:23:42.151735+0000","last_unstale":"2024-09-12T18:02:03.073021+0000","last_undegraded":"2024-09-12T18:02:03.073021+0000","last_fullsized":"2024-09-12T18:02:03.073021+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'542","last_scrub_stamp":"2024-09-12T18:02:03.072918+0000","last_deep_scrub":"261'542","last_deep_scrub_stamp":"2024-09-12T18:02:03.072918+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.072918+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:38.792420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2982,"num_read_kb":2809,"num_write":660,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"261'324","reported_seq":921,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.273198+0000","last_change":"2024-09-12T18:01:59.273198+0000","last_active":"2024-09-12T18:01:59.273198+0000","last_peered":"2024-09-12T18:01:59.273198+0000","last_clean":"2024-09-12T18:01:59.273198+0000","last_became_active":"2024-09-12T17:23:40.712386+0000","last_became_peered":"2024-09-12T17:23:40.712386+0000","last_unstale":"2024-09-12T18:01:59.273198+0000","last_undegraded":"2024-09-12T18:01:59.273198+0000","last_fullsized":"2024-09-12T18:01:59.273198+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'324","last_scrub_stamp":"2024-09-12T18:01:59.273097+0000","last_deep_scrub":"261'324","last_deep_scrub_stamp":"2024-09-12T18:01:59.273097+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.273097+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:24.760087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":415,"num_read_kb":6504,"num_write":991,"num_write_kb":34893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":521,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.011936+0000","last_change":"2024-09-12T18:01:55.011936+0000","last_active":"2024-09-12T18:01:55.011936+0000","last_peered":"2024-09-12T18:01:55.011936+0000","last_clean":"2024-09-12T18:01:55.011936+0000","last_became_active":"2024-09-12T17:23:31.681209+0000","last_became_peered":"2024-09-12T17:23:31.681209+0000","last_unstale":"2024-09-12T18:01:55.011936+0000","last_undegraded":"2024-09-12T18:01:55.011936+0000","last_fullsized":"2024-09-12T18:01:55.011936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:55.011864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:55.011864+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.011864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:54.403724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056110600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.613324+0000","last_change":"2024-09-12T18:02:12.613324+0000","last_active":"2024-09-12T18:02:12.613324+0000","last_peered":"2024-09-12T18:02:12.613324+0000","last_clean":"2024-09-12T18:02:12.613324+0000","last_became_active":"2024-09-12T17:23:44.148035+0000","last_became_peered":"2024-09-12T17:23:44.148035+0000","last_unstale":"2024-09-12T18:02:12.613324+0000","last_undegraded":"2024-09-12T18:02:12.613324+0000","last_fullsized":"2024-09-12T18:02:12.613324+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:12.613224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:12.613224+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.613224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:09.496521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"261'563","reported_seq":1207,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.878780+0000","last_change":"2024-09-12T17:23:46.152284+0000","last_active":"2024-09-12T18:01:50.878780+0000","last_peered":"2024-09-12T18:01:50.878780+0000","last_clean":"2024-09-12T18:01:50.878780+0000","last_became_active":"2024-09-12T17:23:46.151649+0000","last_became_peered":"2024-09-12T17:23:46.151649+0000","last_unstale":"2024-09-12T18:01:50.878780+0000","last_undegraded":"2024-09-12T18:01:50.878780+0000","last_fullsized":"2024-09-12T18:01:50.878780+0000","mapping_epoch":29,"log_start":"261'500","ondisk_log_start":"261'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91231,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1527,"num_read_kb":2702,"num_write":1958,"num_write_kb":1787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418523+0000","last_change":"2024-09-12T17:23:48.166489+0000","last_active":"2024-09-12T17:59:14.418523+0000","last_peered":"2024-09-12T17:59:14.418523+0000","last_clean":"2024-09-12T17:59:14.418523+0000","last_became_active":"2024-09-12T17:23:48.166196+0000","last_became_peered":"2024-09-12T17:23:48.166196+0000","last_unstale":"2024-09-12T17:59:14.418523+0000","last_undegraded":"2024-09-12T17:59:14.418523+0000","last_fullsized":"2024-09-12T17:59:14.418523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:02.318935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"261'221","reported_seq":722,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.442973+0000","last_change":"2024-09-12T17:23:50.640504+0000","last_active":"2024-09-12T17:59:58.442973+0000","last_peered":"2024-09-12T17:59:58.442973+0000","last_clean":"2024-09-12T17:59:58.442973+0000","last_became_active":"2024-09-12T17:23:50.640185+0000","last_became_peered":"2024-09-12T17:23:50.640185+0000","last_unstale":"2024-09-12T17:59:58.442973+0000","last_undegraded":"2024-09-12T17:59:58.442973+0000","last_fullsized":"2024-09-12T17:59:58.442973+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":243,"num_write":513,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"261'511","reported_seq":2075,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.675785+0000","last_change":"2024-09-12T18:02:05.675785+0000","last_active":"2024-09-12T18:02:05.675785+0000","last_peered":"2024-09-12T18:02:05.675785+0000","last_clean":"2024-09-12T18:02:05.675785+0000","last_became_active":"2024-09-12T17:23:42.148578+0000","last_became_peered":"2024-09-12T17:23:42.148578+0000","last_unstale":"2024-09-12T18:02:05.675785+0000","last_undegraded":"2024-09-12T18:02:05.675785+0000","last_fullsized":"2024-09-12T18:02:05.675785+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'511","last_scrub_stamp":"2024-09-12T18:02:05.675698+0000","last_deep_scrub":"261'511","last_deep_scrub_stamp":"2024-09-12T18:02:05.675698+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.675698+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:16.683349+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2709,"num_read_kb":2501,"num_write":646,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"261'359","reported_seq":989,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.005174+0000","last_change":"2024-09-12T18:01:58.005174+0000","last_active":"2024-09-12T18:01:58.005174+0000","last_peered":"2024-09-12T18:01:58.005174+0000","last_clean":"2024-09-12T18:01:58.005174+0000","last_became_active":"2024-09-12T17:23:40.710780+0000","last_became_peered":"2024-09-12T17:23:40.710780+0000","last_unstale":"2024-09-12T18:01:58.005174+0000","last_undegraded":"2024-09-12T18:01:58.005174+0000","last_fullsized":"2024-09-12T18:01:58.005174+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'359","last_scrub_stamp":"2024-09-12T18:01:58.005070+0000","last_deep_scrub":"261'359","last_deep_scrub_stamp":"2024-09-12T18:01:58.005070+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.005070+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:48.684663+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":525,"num_write":1227,"num_write_kb":43788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":514,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.654264+0000","last_change":"2024-09-12T18:02:00.654264+0000","last_active":"2024-09-12T18:02:00.654264+0000","last_peered":"2024-09-12T18:02:00.654264+0000","last_clean":"2024-09-12T18:02:00.654264+0000","last_became_active":"2024-09-12T17:23:31.681155+0000","last_became_peered":"2024-09-12T17:23:31.681155+0000","last_unstale":"2024-09-12T18:02:00.654264+0000","last_undegraded":"2024-09-12T18:02:00.654264+0000","last_fullsized":"2024-09-12T18:02:00.654264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:00.654154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:00.654154+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.654154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:58.454140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00048562399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.149994+0000","last_change":"2024-09-12T18:02:08.149994+0000","last_active":"2024-09-12T18:02:08.149994+0000","last_peered":"2024-09-12T18:02:08.149994+0000","last_clean":"2024-09-12T18:02:08.149994+0000","last_became_active":"2024-09-12T17:23:44.147347+0000","last_became_peered":"2024-09-12T17:23:44.147347+0000","last_unstale":"2024-09-12T18:02:08.149994+0000","last_undegraded":"2024-09-12T18:02:08.149994+0000","last_fullsized":"2024-09-12T18:02:08.149994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:08.149901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:08.149901+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.149901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:21.117683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"261'149","reported_seq":697,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:23.414940+0000","last_change":"2024-09-12T17:23:46.241508+0000","last_active":"2024-09-12T18:00:23.414940+0000","last_peered":"2024-09-12T18:00:23.414940+0000","last_clean":"2024-09-12T18:00:23.414940+0000","last_became_active":"2024-09-12T17:23:46.241046+0000","last_became_peered":"2024-09-12T17:23:46.241046+0000","last_unstale":"2024-09-12T18:00:23.414940+0000","last_undegraded":"2024-09-12T18:00:23.414940+0000","last_fullsized":"2024-09-12T18:00:23.414940+0000","mapping_epoch":29,"log_start":"258'100","ondisk_log_start":"258'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:42.691500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":154,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"261'794","reported_seq":2344,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.064925+0000","last_change":"2024-09-12T17:23:48.173674+0000","last_active":"2024-09-12T18:01:51.064925+0000","last_peered":"2024-09-12T18:01:51.064925+0000","last_clean":"2024-09-12T18:01:51.064925+0000","last_became_active":"2024-09-12T17:23:48.173351+0000","last_became_peered":"2024-09-12T17:23:48.173351+0000","last_unstale":"2024-09-12T18:01:51.064925+0000","last_undegraded":"2024-09-12T18:01:51.064925+0000","last_fullsized":"2024-09-12T18:01:51.064925+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:23.841940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"261'101","reported_seq":589,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.442556+0000","last_change":"2024-09-12T17:23:50.639372+0000","last_active":"2024-09-12T18:01:42.442556+0000","last_peered":"2024-09-12T18:01:42.442556+0000","last_clean":"2024-09-12T18:01:42.442556+0000","last_became_active":"2024-09-12T17:23:50.639054+0000","last_became_peered":"2024-09-12T17:23:50.639054+0000","last_unstale":"2024-09-12T18:01:42.442556+0000","last_undegraded":"2024-09-12T18:01:42.442556+0000","last_fullsized":"2024-09-12T18:01:42.442556+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":220,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"261'498","reported_seq":2027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.237197+0000","last_change":"2024-09-12T18:02:07.237197+0000","last_active":"2024-09-12T18:02:07.237197+0000","last_peered":"2024-09-12T18:02:07.237197+0000","last_clean":"2024-09-12T18:02:07.237197+0000","last_became_active":"2024-09-12T17:23:42.148523+0000","last_became_peered":"2024-09-12T17:23:42.148523+0000","last_unstale":"2024-09-12T18:02:07.237197+0000","last_undegraded":"2024-09-12T18:02:07.237197+0000","last_fullsized":"2024-09-12T18:02:07.237197+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'498","last_scrub_stamp":"2024-09-12T18:02:07.237103+0000","last_deep_scrub":"261'498","last_deep_scrub_stamp":"2024-09-12T18:02:07.237103+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.237103+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:26.038707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2488,"num_read_kb":2312,"num_write":602,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":892,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"261'378","reported_seq":1102,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.174066+0000","last_change":"2024-09-12T18:01:57.174066+0000","last_active":"2024-09-12T18:01:57.174066+0000","last_peered":"2024-09-12T18:01:57.174066+0000","last_clean":"2024-09-12T18:01:57.174066+0000","last_became_active":"2024-09-12T17:23:40.709077+0000","last_became_peered":"2024-09-12T17:23:40.709077+0000","last_unstale":"2024-09-12T18:01:57.174066+0000","last_undegraded":"2024-09-12T18:01:57.174066+0000","last_fullsized":"2024-09-12T18:01:57.174066+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'378","last_scrub_stamp":"2024-09-12T18:01:57.173981+0000","last_deep_scrub":"261'378","last_deep_scrub_stamp":"2024-09-12T18:01:57.173981+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.173981+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:35.684048+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8154045,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":687,"num_read_kb":135818,"num_write":1222,"num_write_kb":56746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":520,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.952897+0000","last_change":"2024-09-12T18:01:56.952897+0000","last_active":"2024-09-12T18:01:56.952897+0000","last_peered":"2024-09-12T18:01:56.952897+0000","last_clean":"2024-09-12T18:01:56.952897+0000","last_became_active":"2024-09-12T17:23:31.588526+0000","last_became_peered":"2024-09-12T17:23:31.588526+0000","last_unstale":"2024-09-12T18:01:56.952897+0000","last_undegraded":"2024-09-12T18:01:56.952897+0000","last_fullsized":"2024-09-12T18:01:56.952897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:56.952784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:56.952784+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.952784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:58.755509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055923099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417985+0000","last_change":"2024-09-12T17:23:44.148290+0000","last_active":"2024-09-12T17:59:09.417985+0000","last_peered":"2024-09-12T17:59:09.417985+0000","last_clean":"2024-09-12T17:59:09.417985+0000","last_became_active":"2024-09-12T17:23:44.147594+0000","last_became_peered":"2024-09-12T17:23:44.147594+0000","last_unstale":"2024-09-12T17:59:09.417985+0000","last_undegraded":"2024-09-12T17:59:09.417985+0000","last_fullsized":"2024-09-12T17:59:09.417985+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:51.406975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"261'97","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.150898+0000","last_change":"2024-09-12T17:23:46.151701+0000","last_active":"2024-09-12T18:00:18.150898+0000","last_peered":"2024-09-12T18:00:18.150898+0000","last_clean":"2024-09-12T18:00:18.150898+0000","last_became_active":"2024-09-12T17:23:46.151335+0000","last_became_peered":"2024-09-12T17:23:46.151335+0000","last_unstale":"2024-09-12T18:00:18.150898+0000","last_undegraded":"2024-09-12T18:00:18.150898+0000","last_fullsized":"2024-09-12T18:00:18.150898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:23.162677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"261'807","reported_seq":2587,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.419707+0000","last_change":"2024-09-12T17:23:48.168044+0000","last_active":"2024-09-12T18:01:49.419707+0000","last_peered":"2024-09-12T18:01:49.419707+0000","last_clean":"2024-09-12T18:01:49.419707+0000","last_became_active":"2024-09-12T17:23:48.167739+0000","last_became_peered":"2024-09-12T17:23:48.167739+0000","last_unstale":"2024-09-12T18:01:49.419707+0000","last_undegraded":"2024-09-12T18:01:49.419707+0000","last_fullsized":"2024-09-12T18:01:49.419707+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:25.436138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"261'311","reported_seq":830,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.404826+0000","last_change":"2024-09-12T17:23:50.179480+0000","last_active":"2024-09-12T18:01:41.404826+0000","last_peered":"2024-09-12T18:01:41.404826+0000","last_clean":"2024-09-12T18:01:41.404826+0000","last_became_active":"2024-09-12T17:23:50.179127+0000","last_became_peered":"2024-09-12T17:23:50.179127+0000","last_unstale":"2024-09-12T18:01:41.404826+0000","last_undegraded":"2024-09-12T18:01:41.404826+0000","last_fullsized":"2024-09-12T18:01:41.404826+0000","mapping_epoch":33,"log_start":"261'300","ondisk_log_start":"261'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":442,"num_write":705,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"261'1032","reported_seq":2767,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.065931+0000","last_change":"2024-09-12T18:02:02.065931+0000","last_active":"2024-09-12T18:02:02.065931+0000","last_peered":"2024-09-12T18:02:02.065931+0000","last_clean":"2024-09-12T18:02:02.065931+0000","last_became_active":"2024-09-12T17:23:42.145139+0000","last_became_peered":"2024-09-12T17:23:42.145139+0000","last_unstale":"2024-09-12T18:02:02.065931+0000","last_undegraded":"2024-09-12T18:02:02.065931+0000","last_fullsized":"2024-09-12T18:02:02.065931+0000","mapping_epoch":25,"log_start":"261'1000","ondisk_log_start":"261'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1032","last_scrub_stamp":"2024-09-12T18:02:02.065838+0000","last_deep_scrub":"261'1032","last_deep_scrub_stamp":"2024-09-12T18:02:02.065838+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.065838+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":1000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:57.748014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4954,"num_read_kb":4437,"num_write":1455,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"261'378","reported_seq":1033,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.770846+0000","last_change":"2024-09-12T18:01:56.770846+0000","last_active":"2024-09-12T18:01:56.770846+0000","last_peered":"2024-09-12T18:01:56.770846+0000","last_clean":"2024-09-12T18:01:56.770846+0000","last_became_active":"2024-09-12T17:23:40.712974+0000","last_became_peered":"2024-09-12T17:23:40.712974+0000","last_unstale":"2024-09-12T18:01:56.770846+0000","last_undegraded":"2024-09-12T18:01:56.770846+0000","last_fullsized":"2024-09-12T18:01:56.770846+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'378","last_scrub_stamp":"2024-09-12T18:01:56.770724+0000","last_deep_scrub":"261'378","last_deep_scrub_stamp":"2024-09-12T18:01:56.770724+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.770724+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:19.994907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048959,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":103148,"num_write":1174,"num_write_kb":43429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":515,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.061986+0000","last_change":"2024-09-12T18:02:01.061986+0000","last_active":"2024-09-12T18:02:01.061986+0000","last_peered":"2024-09-12T18:02:01.061986+0000","last_clean":"2024-09-12T18:02:01.061986+0000","last_became_active":"2024-09-12T17:23:31.588266+0000","last_became_peered":"2024-09-12T17:23:31.588266+0000","last_unstale":"2024-09-12T18:02:01.061986+0000","last_undegraded":"2024-09-12T18:02:01.061986+0000","last_fullsized":"2024-09-12T18:02:01.061986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:01.061897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:01.061897+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.061897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:32.592640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051630700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:48.421688+0000","last_change":"2024-09-12T17:23:44.149935+0000","last_active":"2024-09-12T17:59:48.421688+0000","last_peered":"2024-09-12T17:59:48.421688+0000","last_clean":"2024-09-12T17:59:48.421688+0000","last_became_active":"2024-09-12T17:23:44.149649+0000","last_became_peered":"2024-09-12T17:23:44.149649+0000","last_unstale":"2024-09-12T17:59:48.421688+0000","last_undegraded":"2024-09-12T17:59:48.421688+0000","last_fullsized":"2024-09-12T17:59:48.421688+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:06.362964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"261'694","reported_seq":1394,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.010604+0000","last_change":"2024-09-12T17:23:46.242153+0000","last_active":"2024-09-12T18:01:51.010604+0000","last_peered":"2024-09-12T18:01:51.010604+0000","last_clean":"2024-09-12T18:01:51.010604+0000","last_became_active":"2024-09-12T17:23:46.241681+0000","last_became_peered":"2024-09-12T17:23:46.241681+0000","last_unstale":"2024-09-12T18:01:51.010604+0000","last_undegraded":"2024-09-12T18:01:51.010604+0000","last_fullsized":"2024-09-12T18:01:51.010604+0000","mapping_epoch":29,"log_start":"261'600","ondisk_log_start":"261'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:06.488679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155444,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1250,"num_read_kb":2999,"num_write":1014,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:13.416822+0000","last_change":"2024-09-12T17:23:48.170996+0000","last_active":"2024-09-12T17:59:13.416822+0000","last_peered":"2024-09-12T17:59:13.416822+0000","last_clean":"2024-09-12T17:59:13.416822+0000","last_became_active":"2024-09-12T17:23:48.170687+0000","last_became_peered":"2024-09-12T17:23:48.170687+0000","last_unstale":"2024-09-12T17:59:13.416822+0000","last_undegraded":"2024-09-12T17:59:13.416822+0000","last_fullsized":"2024-09-12T17:59:13.416822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:56.021234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"261'136","reported_seq":668,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.618153+0000","last_change":"2024-09-12T17:23:50.189525+0000","last_active":"2024-09-12T18:00:18.618153+0000","last_peered":"2024-09-12T18:00:18.618153+0000","last_clean":"2024-09-12T18:00:18.618153+0000","last_became_active":"2024-09-12T17:23:50.188042+0000","last_became_peered":"2024-09-12T17:23:50.188042+0000","last_unstale":"2024-09-12T18:00:18.618153+0000","last_undegraded":"2024-09-12T18:00:18.618153+0000","last_fullsized":"2024-09-12T18:00:18.618153+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":351,"num_read_kb":302,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"261'129","reported_seq":670,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.665733+0000","last_change":"2024-09-12T17:23:50.190175+0000","last_active":"2024-09-12T18:00:18.665733+0000","last_peered":"2024-09-12T18:00:18.665733+0000","last_clean":"2024-09-12T18:00:18.665733+0000","last_became_active":"2024-09-12T17:23:50.189955+0000","last_became_peered":"2024-09-12T17:23:50.189955+0000","last_unstale":"2024-09-12T18:00:18.665733+0000","last_undegraded":"2024-09-12T18:00:18.665733+0000","last_fullsized":"2024-09-12T18:00:18.665733+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:05.002727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":232,"num_write":318,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"261'332","reported_seq":1807,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.103984+0000","last_change":"2024-09-12T18:02:05.103984+0000","last_active":"2024-09-12T18:02:05.103984+0000","last_peered":"2024-09-12T18:02:05.103984+0000","last_clean":"2024-09-12T18:02:05.103984+0000","last_became_active":"2024-09-12T17:23:42.138899+0000","last_became_peered":"2024-09-12T17:23:42.138899+0000","last_unstale":"2024-09-12T18:02:05.103984+0000","last_undegraded":"2024-09-12T18:02:05.103984+0000","last_fullsized":"2024-09-12T18:02:05.103984+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'332","last_scrub_stamp":"2024-09-12T18:02:05.103884+0000","last_deep_scrub":"261'332","last_deep_scrub_stamp":"2024-09-12T18:02:05.103884+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.103884+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:33.934674+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1873,"num_read_kb":1826,"num_write":350,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"261'371","reported_seq":1012,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.041826+0000","last_change":"2024-09-12T18:01:59.041826+0000","last_active":"2024-09-12T18:01:59.041826+0000","last_peered":"2024-09-12T18:01:59.041826+0000","last_clean":"2024-09-12T18:01:59.041826+0000","last_became_active":"2024-09-12T17:23:40.709219+0000","last_became_peered":"2024-09-12T17:23:40.709219+0000","last_unstale":"2024-09-12T18:01:59.041826+0000","last_undegraded":"2024-09-12T18:01:59.041826+0000","last_fullsized":"2024-09-12T18:01:59.041826+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'371","last_scrub_stamp":"2024-09-12T18:01:59.041598+0000","last_deep_scrub":"261'371","last_deep_scrub_stamp":"2024-09-12T18:01:59.041598+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.041598+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:07.760220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":4301,"num_write":1267,"num_write_kb":9304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.977761+0000","last_change":"2024-09-12T18:02:09.977761+0000","last_active":"2024-09-12T18:02:09.977761+0000","last_peered":"2024-09-12T18:02:09.977761+0000","last_clean":"2024-09-12T18:02:09.977761+0000","last_became_active":"2024-09-12T17:23:44.151175+0000","last_became_peered":"2024-09-12T17:23:44.151175+0000","last_unstale":"2024-09-12T18:02:09.977761+0000","last_undegraded":"2024-09-12T18:02:09.977761+0000","last_fullsized":"2024-09-12T18:02:09.977761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:09.977657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:09.977657+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.977657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:18.070048+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"261'276","reported_seq":836,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.711803+0000","last_change":"2024-09-12T17:23:46.151842+0000","last_active":"2024-09-12T18:01:49.711803+0000","last_peered":"2024-09-12T18:01:49.711803+0000","last_clean":"2024-09-12T18:01:49.711803+0000","last_became_active":"2024-09-12T17:23:46.150505+0000","last_became_peered":"2024-09-12T17:23:46.150505+0000","last_unstale":"2024-09-12T18:01:49.711803+0000","last_undegraded":"2024-09-12T18:01:49.711803+0000","last_fullsized":"2024-09-12T18:01:49.711803+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:29.365545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80053,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":479,"num_read_kb":1186,"num_write":396,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:48.413394+0000","last_change":"2024-09-12T17:23:48.168196+0000","last_active":"2024-09-12T17:58:48.413394+0000","last_peered":"2024-09-12T17:58:48.413394+0000","last_clean":"2024-09-12T17:58:48.413394+0000","last_became_active":"2024-09-12T17:23:48.167911+0000","last_became_peered":"2024-09-12T17:23:48.167911+0000","last_unstale":"2024-09-12T17:58:48.413394+0000","last_undegraded":"2024-09-12T17:58:48.413394+0000","last_fullsized":"2024-09-12T17:58:48.413394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:27.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"261'95","reported_seq":585,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.422912+0000","last_change":"2024-09-12T17:23:50.183763+0000","last_active":"2024-09-12T17:59:58.422912+0000","last_peered":"2024-09-12T17:59:58.422912+0000","last_clean":"2024-09-12T17:59:58.422912+0000","last_became_active":"2024-09-12T17:23:50.183400+0000","last_became_peered":"2024-09-12T17:23:50.183400+0000","last_unstale":"2024-09-12T17:59:58.422912+0000","last_undegraded":"2024-09-12T17:59:58.422912+0000","last_fullsized":"2024-09-12T17:59:58.422912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":128,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"261'480","reported_seq":1894,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.032918+0000","last_change":"2024-09-12T18:02:08.032918+0000","last_active":"2024-09-12T18:02:08.032918+0000","last_peered":"2024-09-12T18:02:08.032918+0000","last_clean":"2024-09-12T18:02:08.032918+0000","last_became_active":"2024-09-12T17:23:42.137988+0000","last_became_peered":"2024-09-12T17:23:42.137988+0000","last_unstale":"2024-09-12T18:02:08.032918+0000","last_undegraded":"2024-09-12T18:02:08.032918+0000","last_fullsized":"2024-09-12T18:02:08.032918+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'480","last_scrub_stamp":"2024-09-12T18:02:08.032812+0000","last_deep_scrub":"261'480","last_deep_scrub_stamp":"2024-09-12T18:02:08.032812+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.032812+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:49.513754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2384,"num_read_kb":2190,"num_write":595,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"261'377","reported_seq":1023,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.757480+0000","last_change":"2024-09-12T18:02:05.757480+0000","last_active":"2024-09-12T18:02:05.757480+0000","last_peered":"2024-09-12T18:02:05.757480+0000","last_clean":"2024-09-12T18:02:05.757480+0000","last_became_active":"2024-09-12T17:23:40.710425+0000","last_became_peered":"2024-09-12T17:23:40.710425+0000","last_unstale":"2024-09-12T18:02:05.757480+0000","last_undegraded":"2024-09-12T18:02:05.757480+0000","last_fullsized":"2024-09-12T18:02:05.757480+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'377","last_scrub_stamp":"2024-09-12T18:02:05.757380+0000","last_deep_scrub":"261'377","last_deep_scrub_stamp":"2024-09-12T18:02:05.757380+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.757380+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:11.058871+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6598189,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":49330,"num_write":1152,"num_write_kb":37186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:43.412561+0000","last_change":"2024-09-12T17:23:44.149929+0000","last_active":"2024-09-12T17:58:43.412561+0000","last_peered":"2024-09-12T17:58:43.412561+0000","last_clean":"2024-09-12T17:58:43.412561+0000","last_became_active":"2024-09-12T17:23:44.148078+0000","last_became_peered":"2024-09-12T17:23:44.148078+0000","last_unstale":"2024-09-12T17:58:43.412561+0000","last_undegraded":"2024-09-12T17:58:43.412561+0000","last_fullsized":"2024-09-12T17:58:43.412561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:27.562908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"261'42","reported_seq":529,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.542596+0000","last_change":"2024-09-12T17:23:46.152014+0000","last_active":"2024-09-12T17:58:49.542596+0000","last_peered":"2024-09-12T17:58:49.542596+0000","last_clean":"2024-09-12T17:58:49.542596+0000","last_became_active":"2024-09-12T17:23:46.151258+0000","last_became_peered":"2024-09-12T17:23:46.151258+0000","last_unstale":"2024-09-12T17:58:49.542596+0000","last_undegraded":"2024-09-12T17:58:49.542596+0000","last_fullsized":"2024-09-12T17:58:49.542596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.540146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":25,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.415800+0000","last_change":"2024-09-12T17:23:48.174102+0000","last_active":"2024-09-12T17:58:49.415800+0000","last_peered":"2024-09-12T17:58:49.415800+0000","last_clean":"2024-09-12T17:58:49.415800+0000","last_became_active":"2024-09-12T17:23:48.173781+0000","last_became_peered":"2024-09-12T17:23:48.173781+0000","last_unstale":"2024-09-12T17:58:49.415800+0000","last_undegraded":"2024-09-12T17:58:49.415800+0000","last_fullsized":"2024-09-12T17:58:49.415800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:42.236527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"261'166","reported_seq":668,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.152209+0000","last_change":"2024-09-12T17:23:50.184117+0000","last_active":"2024-09-12T18:00:18.152209+0000","last_peered":"2024-09-12T18:00:18.152209+0000","last_clean":"2024-09-12T18:00:18.152209+0000","last_became_active":"2024-09-12T17:23:50.183784+0000","last_became_peered":"2024-09-12T17:23:50.183784+0000","last_unstale":"2024-09-12T18:00:18.152209+0000","last_undegraded":"2024-09-12T18:00:18.152209+0000","last_fullsized":"2024-09-12T18:00:18.152209+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:59.251619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":278,"num_read_kb":278,"num_write":359,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"261'419","reported_seq":1962,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.192402+0000","last_change":"2024-09-12T18:02:06.192402+0000","last_active":"2024-09-12T18:02:06.192402+0000","last_peered":"2024-09-12T18:02:06.192402+0000","last_clean":"2024-09-12T18:02:06.192402+0000","last_became_active":"2024-09-12T17:23:42.146703+0000","last_became_peered":"2024-09-12T17:23:42.146703+0000","last_unstale":"2024-09-12T18:02:06.192402+0000","last_undegraded":"2024-09-12T18:02:06.192402+0000","last_fullsized":"2024-09-12T18:02:06.192402+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'419","last_scrub_stamp":"2024-09-12T18:02:06.192317+0000","last_deep_scrub":"261'419","last_deep_scrub_stamp":"2024-09-12T18:02:06.192317+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.192317+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:52.444010+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2240,"num_read_kb":2131,"num_write":479,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":501,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"261'293","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.316120+0000","last_change":"2024-09-12T18:02:01.316120+0000","last_active":"2024-09-12T18:02:01.316120+0000","last_peered":"2024-09-12T18:02:01.316120+0000","last_clean":"2024-09-12T18:02:01.316120+0000","last_became_active":"2024-09-12T17:23:40.704278+0000","last_became_peered":"2024-09-12T17:23:40.704278+0000","last_unstale":"2024-09-12T18:02:01.316120+0000","last_undegraded":"2024-09-12T18:02:01.316120+0000","last_fullsized":"2024-09-12T18:02:01.316120+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'293","last_scrub_stamp":"2024-09-12T18:02:01.316032+0000","last_deep_scrub":"261'293","last_deep_scrub_stamp":"2024-09-12T18:02:01.316032+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.316032+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:16.068553+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3045160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":96519,"num_write":927,"num_write_kb":33057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.415015+0000","last_change":"2024-09-12T17:23:44.151075+0000","last_active":"2024-09-12T17:58:44.415015+0000","last_peered":"2024-09-12T17:58:44.415015+0000","last_clean":"2024-09-12T17:58:44.415015+0000","last_became_active":"2024-09-12T17:23:44.149838+0000","last_became_peered":"2024-09-12T17:23:44.149838+0000","last_unstale":"2024-09-12T17:58:44.415015+0000","last_undegraded":"2024-09-12T17:58:44.415015+0000","last_fullsized":"2024-09-12T17:58:44.415015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:30.715787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"261'301","reported_seq":877,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.784022+0000","last_change":"2024-09-12T17:23:46.150856+0000","last_active":"2024-09-12T18:01:50.784022+0000","last_peered":"2024-09-12T18:01:50.784022+0000","last_clean":"2024-09-12T18:01:50.784022+0000","last_became_active":"2024-09-12T17:23:46.150528+0000","last_became_peered":"2024-09-12T17:23:46.150528+0000","last_unstale":"2024-09-12T18:01:50.784022+0000","last_undegraded":"2024-09-12T18:01:50.784022+0000","last_fullsized":"2024-09-12T18:01:50.784022+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:33.340339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45198,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":1096,"num_write":398,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.412615+0000","last_change":"2024-09-12T17:23:48.171496+0000","last_active":"2024-09-12T17:58:49.412615+0000","last_peered":"2024-09-12T17:58:49.412615+0000","last_clean":"2024-09-12T17:58:49.412615+0000","last_became_active":"2024-09-12T17:23:48.171031+0000","last_became_peered":"2024-09-12T17:23:48.171031+0000","last_unstale":"2024-09-12T17:58:49.412615+0000","last_undegraded":"2024-09-12T17:58:49.412615+0000","last_fullsized":"2024-09-12T17:58:49.412615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:49.840358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"261'154","reported_seq":657,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.140462+0000","last_change":"2024-09-12T17:23:50.186163+0000","last_active":"2024-09-12T18:00:03.140462+0000","last_peered":"2024-09-12T18:00:03.140462+0000","last_clean":"2024-09-12T18:00:03.140462+0000","last_became_active":"2024-09-12T17:23:50.185846+0000","last_became_peered":"2024-09-12T17:23:50.185846+0000","last_unstale":"2024-09-12T18:00:03.140462+0000","last_undegraded":"2024-09-12T18:00:03.140462+0000","last_fullsized":"2024-09-12T18:00:03.140462+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:27.173182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":366,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"261'794","reported_seq":2414,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.273399+0000","last_change":"2024-09-12T18:02:11.273399+0000","last_active":"2024-09-12T18:02:11.273399+0000","last_peered":"2024-09-12T18:02:11.273399+0000","last_clean":"2024-09-12T18:02:11.273399+0000","last_became_active":"2024-09-12T17:23:42.154925+0000","last_became_peered":"2024-09-12T17:23:42.154925+0000","last_unstale":"2024-09-12T18:02:11.273399+0000","last_undegraded":"2024-09-12T18:02:11.273399+0000","last_fullsized":"2024-09-12T18:02:11.273399+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'794","last_scrub_stamp":"2024-09-12T18:02:11.273304+0000","last_deep_scrub":"261'794","last_deep_scrub_stamp":"2024-09-12T18:02:11.273304+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.273304+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:14.231877+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3893,"num_read_kb":3543,"num_write":1032,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"261'364","reported_seq":984,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:54.755805+0000","last_change":"2024-09-12T18:01:54.755805+0000","last_active":"2024-09-12T18:01:54.755805+0000","last_peered":"2024-09-12T18:01:54.755805+0000","last_clean":"2024-09-12T18:01:54.755805+0000","last_became_active":"2024-09-12T17:23:40.708670+0000","last_became_peered":"2024-09-12T17:23:40.708670+0000","last_unstale":"2024-09-12T18:01:54.755805+0000","last_undegraded":"2024-09-12T18:01:54.755805+0000","last_fullsized":"2024-09-12T18:01:54.755805+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'364","last_scrub_stamp":"2024-09-12T18:01:54.755697+0000","last_deep_scrub":"261'364","last_deep_scrub_stamp":"2024-09-12T18:01:54.755697+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.755697+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:28.461074+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306433,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":1950,"num_write":1111,"num_write_kb":27043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.155600+0000","last_change":"2024-09-12T18:02:12.155600+0000","last_active":"2024-09-12T18:02:12.155600+0000","last_peered":"2024-09-12T18:02:12.155600+0000","last_clean":"2024-09-12T18:02:12.155600+0000","last_became_active":"2024-09-12T17:23:44.149907+0000","last_became_peered":"2024-09-12T17:23:44.149907+0000","last_unstale":"2024-09-12T18:02:12.155600+0000","last_undegraded":"2024-09-12T18:02:12.155600+0000","last_fullsized":"2024-09-12T18:02:12.155600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:12.155514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:12.155514+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.155514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:15.472208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"261'276","reported_seq":828,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.612579+0000","last_change":"2024-09-12T17:23:46.150337+0000","last_active":"2024-09-12T18:01:50.612579+0000","last_peered":"2024-09-12T18:01:50.612579+0000","last_clean":"2024-09-12T18:01:50.612579+0000","last_became_active":"2024-09-12T17:23:46.149987+0000","last_became_peered":"2024-09-12T17:23:46.149987+0000","last_unstale":"2024-09-12T18:01:50.612579+0000","last_undegraded":"2024-09-12T18:01:50.612579+0000","last_fullsized":"2024-09-12T18:01:50.612579+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:31.163554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46832,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":1121,"num_write":390,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.542683+0000","last_change":"2024-09-12T17:23:48.169607+0000","last_active":"2024-09-12T17:58:49.542683+0000","last_peered":"2024-09-12T17:58:49.542683+0000","last_clean":"2024-09-12T17:58:49.542683+0000","last_became_active":"2024-09-12T17:23:48.169308+0000","last_became_peered":"2024-09-12T17:23:48.169308+0000","last_unstale":"2024-09-12T17:58:49.542683+0000","last_undegraded":"2024-09-12T17:58:49.542683+0000","last_fullsized":"2024-09-12T17:58:49.542683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:14.722104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"261'807","reported_seq":2262,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.135687+0000","last_change":"2024-09-12T18:02:06.135687+0000","last_active":"2024-09-12T18:02:06.135687+0000","last_peered":"2024-09-12T18:02:06.135687+0000","last_clean":"2024-09-12T18:02:06.135687+0000","last_became_active":"2024-09-12T17:23:42.148412+0000","last_became_peered":"2024-09-12T17:23:42.148412+0000","last_unstale":"2024-09-12T18:02:06.135687+0000","last_undegraded":"2024-09-12T18:02:06.135687+0000","last_fullsized":"2024-09-12T18:02:06.135687+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'807","last_scrub_stamp":"2024-09-12T18:02:06.135591+0000","last_deep_scrub":"261'807","last_deep_scrub_stamp":"2024-09-12T18:02:06.135591+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.135591+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:19.719813+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3663,"num_read_kb":3282,"num_write":1025,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"261'314","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.212827+0000","last_change":"2024-09-12T18:02:05.212827+0000","last_active":"2024-09-12T18:02:05.212827+0000","last_peered":"2024-09-12T18:02:05.212827+0000","last_clean":"2024-09-12T18:02:05.212827+0000","last_became_active":"2024-09-12T17:23:40.717447+0000","last_became_peered":"2024-09-12T17:23:40.717447+0000","last_unstale":"2024-09-12T18:02:05.212827+0000","last_undegraded":"2024-09-12T18:02:05.212827+0000","last_fullsized":"2024-09-12T18:02:05.212827+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'314","last_scrub_stamp":"2024-09-12T18:02:05.212709+0000","last_deep_scrub":"261'314","last_deep_scrub_stamp":"2024-09-12T18:02:05.212709+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.212709+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:03.962158+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":485,"num_read_kb":6880,"num_write":973,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:49.550885+0000","last_change":"2024-09-12T17:23:44.150079+0000","last_active":"2024-09-12T17:59:49.550885+0000","last_peered":"2024-09-12T17:59:49.550885+0000","last_clean":"2024-09-12T17:59:49.550885+0000","last_became_active":"2024-09-12T17:23:44.149799+0000","last_became_peered":"2024-09-12T17:23:44.149799+0000","last_unstale":"2024-09-12T17:59:49.550885+0000","last_undegraded":"2024-09-12T17:59:49.550885+0000","last_fullsized":"2024-09-12T17:59:49.550885+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:42.685092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"261'483","reported_seq":1104,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.564135+0000","last_change":"2024-09-12T17:23:46.149613+0000","last_active":"2024-09-12T18:01:50.564135+0000","last_peered":"2024-09-12T18:01:50.564135+0000","last_clean":"2024-09-12T18:01:50.564135+0000","last_became_active":"2024-09-12T17:23:46.148861+0000","last_became_peered":"2024-09-12T17:23:46.148861+0000","last_unstale":"2024-09-12T18:01:50.564135+0000","last_undegraded":"2024-09-12T18:01:50.564135+0000","last_fullsized":"2024-09-12T18:01:50.564135+0000","mapping_epoch":29,"log_start":"261'400","ondisk_log_start":"261'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:49.574258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101554,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":879,"num_read_kb":2135,"num_write":756,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.415004+0000","last_change":"2024-09-12T17:23:48.168964+0000","last_active":"2024-09-12T17:58:49.415004+0000","last_peered":"2024-09-12T17:58:49.415004+0000","last_clean":"2024-09-12T17:58:49.415004+0000","last_became_active":"2024-09-12T17:23:48.168566+0000","last_became_peered":"2024-09-12T17:23:48.168566+0000","last_unstale":"2024-09-12T17:58:49.415004+0000","last_undegraded":"2024-09-12T17:58:49.415004+0000","last_fullsized":"2024-09-12T17:58:49.415004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:54.048241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"261'216","reported_seq":723,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.143900+0000","last_change":"2024-09-12T17:23:50.642047+0000","last_active":"2024-09-12T18:00:18.143900+0000","last_peered":"2024-09-12T18:00:18.143900+0000","last_clean":"2024-09-12T18:00:18.143900+0000","last_became_active":"2024-09-12T17:23:50.641702+0000","last_became_peered":"2024-09-12T17:23:50.641702+0000","last_unstale":"2024-09-12T18:00:18.143900+0000","last_undegraded":"2024-09-12T18:00:18.143900+0000","last_fullsized":"2024-09-12T18:00:18.143900+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:03.863712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":328,"num_write":469,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"261'761","reported_seq":2337,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.610751+0000","last_change":"2024-09-12T18:02:07.610751+0000","last_active":"2024-09-12T18:02:07.610751+0000","last_peered":"2024-09-12T18:02:07.610751+0000","last_clean":"2024-09-12T18:02:07.610751+0000","last_became_active":"2024-09-12T17:23:42.141869+0000","last_became_peered":"2024-09-12T17:23:42.141869+0000","last_unstale":"2024-09-12T18:02:07.610751+0000","last_undegraded":"2024-09-12T18:02:07.610751+0000","last_fullsized":"2024-09-12T18:02:07.610751+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'761","last_scrub_stamp":"2024-09-12T18:02:07.610649+0000","last_deep_scrub":"261'761","last_deep_scrub_stamp":"2024-09-12T18:02:07.610649+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.610649+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:59.154743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3783,"num_read_kb":3443,"num_write":995,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"261'326","reported_seq":935,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.085100+0000","last_change":"2024-09-12T18:02:00.085100+0000","last_active":"2024-09-12T18:02:00.085100+0000","last_peered":"2024-09-12T18:02:00.085100+0000","last_clean":"2024-09-12T18:02:00.085100+0000","last_became_active":"2024-09-12T17:23:40.711679+0000","last_became_peered":"2024-09-12T17:23:40.711679+0000","last_unstale":"2024-09-12T18:02:00.085100+0000","last_undegraded":"2024-09-12T18:02:00.085100+0000","last_fullsized":"2024-09-12T18:02:00.085100+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-12T18:02:00.084987+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-12T18:02:00.084987+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.084987+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:03.235507+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":441,"num_read_kb":3628,"num_write":977,"num_write_kb":35404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.204703+0000","last_change":"2024-09-12T18:02:10.204703+0000","last_active":"2024-09-12T18:02:10.204703+0000","last_peered":"2024-09-12T18:02:10.204703+0000","last_clean":"2024-09-12T18:02:10.204703+0000","last_became_active":"2024-09-12T17:23:44.148044+0000","last_became_peered":"2024-09-12T17:23:44.148044+0000","last_unstale":"2024-09-12T18:02:10.204703+0000","last_undegraded":"2024-09-12T18:02:10.204703+0000","last_fullsized":"2024-09-12T18:02:10.204703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:10.204586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:10.204586+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.204586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:28.253142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"261'292","reported_seq":855,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.669739+0000","last_change":"2024-09-12T17:23:46.150717+0000","last_active":"2024-09-12T18:01:50.669739+0000","last_peered":"2024-09-12T18:01:50.669739+0000","last_clean":"2024-09-12T18:01:50.669739+0000","last_became_active":"2024-09-12T17:23:46.150380+0000","last_became_peered":"2024-09-12T17:23:46.150380+0000","last_unstale":"2024-09-12T18:01:50.669739+0000","last_undegraded":"2024-09-12T18:01:50.669739+0000","last_fullsized":"2024-09-12T18:01:50.669739+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:35.358954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47278,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":1112,"num_write":416,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.414306+0000","last_change":"2024-09-12T17:23:48.173812+0000","last_active":"2024-09-12T17:58:49.414306+0000","last_peered":"2024-09-12T17:58:49.414306+0000","last_clean":"2024-09-12T17:58:49.414306+0000","last_became_active":"2024-09-12T17:23:48.173575+0000","last_became_peered":"2024-09-12T17:23:48.173575+0000","last_unstale":"2024-09-12T17:58:49.414306+0000","last_undegraded":"2024-09-12T17:58:49.414306+0000","last_fullsized":"2024-09-12T17:58:49.414306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:42.300280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"261'188","reported_seq":1044,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:17.033695+0000","last_change":"2024-09-12T17:23:50.186218+0000","last_active":"2024-09-12T18:00:17.033695+0000","last_peered":"2024-09-12T18:00:17.033695+0000","last_clean":"2024-09-12T18:00:17.033695+0000","last_became_active":"2024-09-12T17:23:50.185853+0000","last_became_peered":"2024-09-12T17:23:50.185853+0000","last_unstale":"2024-09-12T18:00:17.033695+0000","last_undegraded":"2024-09-12T18:00:17.033695+0000","last_fullsized":"2024-09-12T18:00:17.033695+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:01.791901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":633,"num_read_kb":630,"num_write":516,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"261'633","reported_seq":2482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.239446+0000","last_change":"2024-09-12T18:02:12.239446+0000","last_active":"2024-09-12T18:02:12.239446+0000","last_peered":"2024-09-12T18:02:12.239446+0000","last_clean":"2024-09-12T18:02:12.239446+0000","last_became_active":"2024-09-12T17:23:42.154175+0000","last_became_peered":"2024-09-12T17:23:42.154175+0000","last_unstale":"2024-09-12T18:02:12.239446+0000","last_undegraded":"2024-09-12T18:02:12.239446+0000","last_fullsized":"2024-09-12T18:02:12.239446+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'633","last_scrub_stamp":"2024-09-12T18:02:12.239338+0000","last_deep_scrub":"261'633","last_deep_scrub_stamp":"2024-09-12T18:02:12.239338+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.239338+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":600,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:45.683746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3404,"num_read_kb":3151,"num_write":789,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1533,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"261'349","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.040975+0000","last_change":"2024-09-12T18:01:58.040975+0000","last_active":"2024-09-12T18:01:58.040975+0000","last_peered":"2024-09-12T18:01:58.040975+0000","last_clean":"2024-09-12T18:01:58.040975+0000","last_became_active":"2024-09-12T17:23:40.712959+0000","last_became_peered":"2024-09-12T17:23:40.712959+0000","last_unstale":"2024-09-12T18:01:58.040975+0000","last_undegraded":"2024-09-12T18:01:58.040975+0000","last_fullsized":"2024-09-12T18:01:58.040975+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T18:01:58.040878+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T18:01:58.040878+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.040878+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:42.713508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":522,"num_read_kb":11025,"num_write":1066,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.414711+0000","last_change":"2024-09-12T17:23:44.152533+0000","last_active":"2024-09-12T17:58:44.414711+0000","last_peered":"2024-09-12T17:58:44.414711+0000","last_clean":"2024-09-12T17:58:44.414711+0000","last_became_active":"2024-09-12T17:23:44.152006+0000","last_became_peered":"2024-09-12T17:23:44.152006+0000","last_unstale":"2024-09-12T17:58:44.414711+0000","last_undegraded":"2024-09-12T17:58:44.414711+0000","last_fullsized":"2024-09-12T17:58:44.414711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:53.659031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"261'249","reported_seq":811,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.915471+0000","last_change":"2024-09-12T17:23:46.241387+0000","last_active":"2024-09-12T18:01:49.915471+0000","last_peered":"2024-09-12T18:01:49.915471+0000","last_clean":"2024-09-12T18:01:49.915471+0000","last_became_active":"2024-09-12T17:23:46.241001+0000","last_became_peered":"2024-09-12T17:23:46.241001+0000","last_unstale":"2024-09-12T18:01:49.915471+0000","last_undegraded":"2024-09-12T18:01:49.915471+0000","last_fullsized":"2024-09-12T18:01:49.915471+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:50.165152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42355,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":393,"num_read_kb":868,"num_write":314,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.422835+0000","last_change":"2024-09-12T17:23:48.170506+0000","last_active":"2024-09-12T17:59:54.422835+0000","last_peered":"2024-09-12T17:59:54.422835+0000","last_clean":"2024-09-12T17:59:54.422835+0000","last_became_active":"2024-09-12T17:23:48.170212+0000","last_became_peered":"2024-09-12T17:23:48.170212+0000","last_unstale":"2024-09-12T17:59:54.422835+0000","last_undegraded":"2024-09-12T17:59:54.422835+0000","last_fullsized":"2024-09-12T17:59:54.422835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:14.960120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"261'127","reported_seq":607,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:42.439241+0000","last_change":"2024-09-12T17:23:50.187626+0000","last_active":"2024-09-12T18:01:42.439241+0000","last_peered":"2024-09-12T18:01:42.439241+0000","last_clean":"2024-09-12T18:01:42.439241+0000","last_became_active":"2024-09-12T17:23:50.187329+0000","last_became_peered":"2024-09-12T17:23:50.187329+0000","last_unstale":"2024-09-12T18:01:42.439241+0000","last_undegraded":"2024-09-12T18:01:42.439241+0000","last_fullsized":"2024-09-12T18:01:42.439241+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:50.928583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":770,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":154,"num_read_kb":149,"num_write":327,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"261'777","reported_seq":2301,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.938708+0000","last_change":"2024-09-12T18:01:59.938708+0000","last_active":"2024-09-12T18:01:59.938708+0000","last_peered":"2024-09-12T18:01:59.938708+0000","last_clean":"2024-09-12T18:01:59.938708+0000","last_became_active":"2024-09-12T17:23:42.144384+0000","last_became_peered":"2024-09-12T17:23:42.144384+0000","last_unstale":"2024-09-12T18:01:59.938708+0000","last_undegraded":"2024-09-12T18:01:59.938708+0000","last_fullsized":"2024-09-12T18:01:59.938708+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'777","last_scrub_stamp":"2024-09-12T18:01:59.938618+0000","last_deep_scrub":"261'777","last_deep_scrub_stamp":"2024-09-12T18:01:59.938618+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.938618+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:20.494541+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3720,"num_read_kb":3370,"num_write":1041,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"261'331","reported_seq":948,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.748832+0000","last_change":"2024-09-12T18:01:55.748832+0000","last_active":"2024-09-12T18:01:55.748832+0000","last_peered":"2024-09-12T18:01:55.748832+0000","last_clean":"2024-09-12T18:01:55.748832+0000","last_became_active":"2024-09-12T17:23:40.714710+0000","last_became_peered":"2024-09-12T17:23:40.714710+0000","last_unstale":"2024-09-12T18:01:55.748832+0000","last_undegraded":"2024-09-12T18:01:55.748832+0000","last_fullsized":"2024-09-12T18:01:55.748832+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'331","last_scrub_stamp":"2024-09-12T18:01:55.748688+0000","last_deep_scrub":"261'331","last_deep_scrub_stamp":"2024-09-12T18:01:55.748688+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.748688+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:42.546066+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311482,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":467,"num_read_kb":6860,"num_write":1100,"num_write_kb":28418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.007474+0000","last_change":"2024-09-12T18:02:13.007474+0000","last_active":"2024-09-12T18:02:13.007474+0000","last_peered":"2024-09-12T18:02:13.007474+0000","last_clean":"2024-09-12T18:02:13.007474+0000","last_became_active":"2024-09-12T17:23:44.147886+0000","last_became_peered":"2024-09-12T17:23:44.147886+0000","last_unstale":"2024-09-12T18:02:13.007474+0000","last_undegraded":"2024-09-12T18:02:13.007474+0000","last_fullsized":"2024-09-12T18:02:13.007474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:13.007389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:13.007389+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.007389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:11.491836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"261'80","reported_seq":589,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.411565+0000","last_change":"2024-09-12T17:23:46.241390+0000","last_active":"2024-09-12T18:01:41.411565+0000","last_peered":"2024-09-12T18:01:41.411565+0000","last_clean":"2024-09-12T18:01:41.411565+0000","last_became_active":"2024-09-12T17:23:46.241073+0000","last_became_peered":"2024-09-12T17:23:46.241073+0000","last_unstale":"2024-09-12T18:01:41.411565+0000","last_undegraded":"2024-09-12T18:01:41.411565+0000","last_fullsized":"2024-09-12T18:01:41.411565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":73,"num_read_kb":65,"num_write":60,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"261'785","reported_seq":2169,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.413100+0000","last_change":"2024-09-12T17:23:48.171323+0000","last_active":"2024-09-12T18:01:49.413100+0000","last_peered":"2024-09-12T18:01:49.413100+0000","last_clean":"2024-09-12T18:01:49.413100+0000","last_became_active":"2024-09-12T17:23:48.170815+0000","last_became_peered":"2024-09-12T17:23:48.170815+0000","last_unstale":"2024-09-12T18:01:49.413100+0000","last_undegraded":"2024-09-12T18:01:49.413100+0000","last_fullsized":"2024-09-12T18:01:49.413100+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:19.299843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"261'127","reported_seq":616,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:17.186926+0000","last_change":"2024-09-12T17:23:50.190416+0000","last_active":"2024-09-12T18:00:17.186926+0000","last_peered":"2024-09-12T18:00:17.186926+0000","last_clean":"2024-09-12T18:00:17.186926+0000","last_became_active":"2024-09-12T17:23:50.190124+0000","last_became_peered":"2024-09-12T17:23:50.190124+0000","last_unstale":"2024-09-12T18:00:17.186926+0000","last_undegraded":"2024-09-12T18:00:17.186926+0000","last_fullsized":"2024-09-12T18:00:17.186926+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:39.676360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":181,"num_read_kb":172,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"261'824","reported_seq":2447,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.135447+0000","last_change":"2024-09-12T18:02:09.135447+0000","last_active":"2024-09-12T18:02:09.135447+0000","last_peered":"2024-09-12T18:02:09.135447+0000","last_clean":"2024-09-12T18:02:09.135447+0000","last_became_active":"2024-09-12T17:23:42.149314+0000","last_became_peered":"2024-09-12T17:23:42.149314+0000","last_unstale":"2024-09-12T18:02:09.135447+0000","last_undegraded":"2024-09-12T18:02:09.135447+0000","last_fullsized":"2024-09-12T18:02:09.135447+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'824","last_scrub_stamp":"2024-09-12T18:02:09.135365+0000","last_deep_scrub":"261'824","last_deep_scrub_stamp":"2024-09-12T18:02:09.135365+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.135365+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:09.176143+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4083,"num_read_kb":3703,"num_write":1086,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":756,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"261'295","reported_seq":924,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.265156+0000","last_change":"2024-09-12T18:02:02.265156+0000","last_active":"2024-09-12T18:02:02.265156+0000","last_peered":"2024-09-12T18:02:02.265156+0000","last_clean":"2024-09-12T18:02:02.265156+0000","last_became_active":"2024-09-12T17:23:40.709818+0000","last_became_peered":"2024-09-12T17:23:40.709818+0000","last_unstale":"2024-09-12T18:02:02.265156+0000","last_undegraded":"2024-09-12T18:02:02.265156+0000","last_fullsized":"2024-09-12T18:02:02.265156+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'295","last_scrub_stamp":"2024-09-12T18:02:02.265077+0000","last_deep_scrub":"261'295","last_deep_scrub_stamp":"2024-09-12T18:02:02.265077+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.265077+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:25.521537+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":426,"num_read_kb":69858,"num_write":935,"num_write_kb":36096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.415126+0000","last_change":"2024-09-12T17:23:44.150481+0000","last_active":"2024-09-12T17:58:44.415126+0000","last_peered":"2024-09-12T17:58:44.415126+0000","last_clean":"2024-09-12T17:58:44.415126+0000","last_became_active":"2024-09-12T17:23:44.150183+0000","last_became_peered":"2024-09-12T17:23:44.150183+0000","last_unstale":"2024-09-12T17:58:44.415126+0000","last_undegraded":"2024-09-12T17:58:44.415126+0000","last_fullsized":"2024-09-12T17:58:44.415126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:11.304183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"261'314","reported_seq":880,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.205309+0000","last_change":"2024-09-12T17:23:46.145061+0000","last_active":"2024-09-12T18:01:50.205309+0000","last_peered":"2024-09-12T18:01:50.205309+0000","last_clean":"2024-09-12T18:01:50.205309+0000","last_became_active":"2024-09-12T17:23:46.144587+0000","last_became_peered":"2024-09-12T17:23:46.144587+0000","last_unstale":"2024-09-12T18:01:50.205309+0000","last_undegraded":"2024-09-12T18:01:50.205309+0000","last_fullsized":"2024-09-12T18:01:50.205309+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:07.704295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46086,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":505,"num_read_kb":1153,"num_write":418,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:39.531765+0000","last_change":"2024-09-12T17:23:48.171551+0000","last_active":"2024-09-12T17:57:39.531765+0000","last_peered":"2024-09-12T17:57:39.531765+0000","last_clean":"2024-09-12T17:57:39.531765+0000","last_became_active":"2024-09-12T17:23:48.171272+0000","last_became_peered":"2024-09-12T17:23:48.171272+0000","last_unstale":"2024-09-12T17:57:39.531765+0000","last_undegraded":"2024-09-12T17:57:39.531765+0000","last_fullsized":"2024-09-12T17:57:39.531765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:23.692378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"261'102","reported_seq":586,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.251581+0000","last_change":"2024-09-12T17:23:50.192154+0000","last_active":"2024-09-12T18:00:04.251581+0000","last_peered":"2024-09-12T18:00:04.251581+0000","last_clean":"2024-09-12T18:00:04.251581+0000","last_became_active":"2024-09-12T17:23:50.191859+0000","last_became_peered":"2024-09-12T17:23:50.191859+0000","last_unstale":"2024-09-12T18:00:04.251581+0000","last_undegraded":"2024-09-12T18:00:04.251581+0000","last_fullsized":"2024-09-12T18:00:04.251581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:55.936330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":141,"num_write":249,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"261'477","reported_seq":2065,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.167430+0000","last_change":"2024-09-12T18:02:07.167430+0000","last_active":"2024-09-12T18:02:07.167430+0000","last_peered":"2024-09-12T18:02:07.167430+0000","last_clean":"2024-09-12T18:02:07.167430+0000","last_became_active":"2024-09-12T17:23:42.149260+0000","last_became_peered":"2024-09-12T17:23:42.149260+0000","last_unstale":"2024-09-12T18:02:07.167430+0000","last_undegraded":"2024-09-12T18:02:07.167430+0000","last_fullsized":"2024-09-12T18:02:07.167430+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'477","last_scrub_stamp":"2024-09-12T18:02:07.167342+0000","last_deep_scrub":"261'477","last_deep_scrub_stamp":"2024-09-12T18:02:07.167342+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.167342+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:54.938925+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2426,"num_read_kb":2286,"num_write":546,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"261'381","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.261206+0000","last_change":"2024-09-12T18:02:03.261206+0000","last_active":"2024-09-12T18:02:03.261206+0000","last_peered":"2024-09-12T18:02:03.261206+0000","last_clean":"2024-09-12T18:02:03.261206+0000","last_became_active":"2024-09-12T17:23:40.711032+0000","last_became_peered":"2024-09-12T17:23:40.711032+0000","last_unstale":"2024-09-12T18:02:03.261206+0000","last_undegraded":"2024-09-12T18:02:03.261206+0000","last_fullsized":"2024-09-12T18:02:03.261206+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'381","last_scrub_stamp":"2024-09-12T18:02:03.261091+0000","last_deep_scrub":"261'381","last_deep_scrub_stamp":"2024-09-12T18:02:03.261091+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.261091+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:14.427700+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":607,"num_read_kb":19508,"num_write":1297,"num_write_kb":28388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:44.414353+0000","last_change":"2024-09-12T17:23:44.148038+0000","last_active":"2024-09-12T17:58:44.414353+0000","last_peered":"2024-09-12T17:58:44.414353+0000","last_clean":"2024-09-12T17:58:44.414353+0000","last_became_active":"2024-09-12T17:23:44.147694+0000","last_became_peered":"2024-09-12T17:23:44.147694+0000","last_unstale":"2024-09-12T17:58:44.414353+0000","last_undegraded":"2024-09-12T17:58:44.414353+0000","last_fullsized":"2024-09-12T17:58:44.414353+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:06.022806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"261'259","reported_seq":810,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.261172+0000","last_change":"2024-09-12T17:23:46.152548+0000","last_active":"2024-09-12T18:01:50.261172+0000","last_peered":"2024-09-12T18:01:50.261172+0000","last_clean":"2024-09-12T18:01:50.261172+0000","last_became_active":"2024-09-12T17:23:46.152028+0000","last_became_peered":"2024-09-12T17:23:46.152028+0000","last_unstale":"2024-09-12T18:01:50.261172+0000","last_undegraded":"2024-09-12T18:01:50.261172+0000","last_fullsized":"2024-09-12T18:01:50.261172+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:32.403280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":974,"num_write":338,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:49.404087+0000","last_change":"2024-09-12T17:23:48.170790+0000","last_active":"2024-09-12T17:57:49.404087+0000","last_peered":"2024-09-12T17:57:49.404087+0000","last_clean":"2024-09-12T17:57:49.404087+0000","last_became_active":"2024-09-12T17:23:48.170452+0000","last_became_peered":"2024-09-12T17:23:48.170452+0000","last_unstale":"2024-09-12T17:57:49.404087+0000","last_undegraded":"2024-09-12T17:57:49.404087+0000","last_fullsized":"2024-09-12T17:57:49.404087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:31.197971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"261'126","reported_seq":628,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:02.113825+0000","last_change":"2024-09-12T17:23:50.641248+0000","last_active":"2024-09-12T18:00:02.113825+0000","last_peered":"2024-09-12T18:00:02.113825+0000","last_clean":"2024-09-12T18:00:02.113825+0000","last_became_active":"2024-09-12T17:23:50.640911+0000","last_became_peered":"2024-09-12T17:23:50.640911+0000","last_unstale":"2024-09-12T18:00:02.113825+0000","last_undegraded":"2024-09-12T18:00:02.113825+0000","last_fullsized":"2024-09-12T18:00:02.113825+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:33.080397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":307,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"261'391","reported_seq":1797,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.243251+0000","last_change":"2024-09-12T18:02:10.243251+0000","last_active":"2024-09-12T18:02:10.243251+0000","last_peered":"2024-09-12T18:02:10.243251+0000","last_clean":"2024-09-12T18:02:10.243251+0000","last_became_active":"2024-09-12T17:23:42.146055+0000","last_became_peered":"2024-09-12T17:23:42.146055+0000","last_unstale":"2024-09-12T18:02:10.243251+0000","last_undegraded":"2024-09-12T18:02:10.243251+0000","last_fullsized":"2024-09-12T18:02:10.243251+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'391","last_scrub_stamp":"2024-09-12T18:02:10.243153+0000","last_deep_scrub":"261'391","last_deep_scrub_stamp":"2024-09-12T18:02:10.243153+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.243153+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:14.671527+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1982,"num_read_kb":1877,"num_write":444,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"261'319","reported_seq":944,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.219235+0000","last_change":"2024-09-12T18:02:00.219235+0000","last_active":"2024-09-12T18:02:00.219235+0000","last_peered":"2024-09-12T18:02:00.219235+0000","last_clean":"2024-09-12T18:02:00.219235+0000","last_became_active":"2024-09-12T17:23:40.709759+0000","last_became_peered":"2024-09-12T17:23:40.709759+0000","last_unstale":"2024-09-12T18:02:00.219235+0000","last_undegraded":"2024-09-12T18:02:00.219235+0000","last_fullsized":"2024-09-12T18:02:00.219235+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'319","last_scrub_stamp":"2024-09-12T18:02:00.219087+0000","last_deep_scrub":"261'319","last_deep_scrub_stamp":"2024-09-12T18:02:00.219087+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.219087+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:11.536241+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306344,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":452,"num_read_kb":23018,"num_write":1076,"num_write_kb":26757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:34.404701+0000","last_change":"2024-09-12T17:23:44.147886+0000","last_active":"2024-09-12T17:57:34.404701+0000","last_peered":"2024-09-12T17:57:34.404701+0000","last_clean":"2024-09-12T17:57:34.404701+0000","last_became_active":"2024-09-12T17:23:44.147372+0000","last_became_peered":"2024-09-12T17:23:44.147372+0000","last_unstale":"2024-09-12T17:57:34.404701+0000","last_undegraded":"2024-09-12T17:57:34.404701+0000","last_fullsized":"2024-09-12T17:57:34.404701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:43.122116+0000","last_clean_scrub_stamp":"2024-09-12T17:23:43.122116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:48.881691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"261'242","reported_seq":789,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.813412+0000","last_change":"2024-09-12T17:23:46.153298+0000","last_active":"2024-09-12T18:01:49.813412+0000","last_peered":"2024-09-12T18:01:49.813412+0000","last_clean":"2024-09-12T18:01:49.813412+0000","last_became_active":"2024-09-12T17:23:46.153024+0000","last_became_peered":"2024-09-12T17:23:46.153024+0000","last_unstale":"2024-09-12T18:01:49.813412+0000","last_undegraded":"2024-09-12T18:01:49.813412+0000","last_fullsized":"2024-09-12T18:01:49.813412+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:00.093006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46277,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":401,"num_read_kb":970,"num_write":334,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.415370+0000","last_change":"2024-09-12T17:23:48.172179+0000","last_active":"2024-09-12T17:58:49.415370+0000","last_peered":"2024-09-12T17:58:49.415370+0000","last_clean":"2024-09-12T17:58:49.415370+0000","last_became_active":"2024-09-12T17:23:48.171849+0000","last_became_peered":"2024-09-12T17:23:48.171849+0000","last_unstale":"2024-09-12T17:58:49.415370+0000","last_undegraded":"2024-09-12T17:58:49.415370+0000","last_fullsized":"2024-09-12T17:58:49.415370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:22.948863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"261'139","reported_seq":1240,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:18.442930+0000","last_change":"2024-09-12T17:23:50.187385+0000","last_active":"2024-09-12T18:00:18.442930+0000","last_peered":"2024-09-12T18:00:18.442930+0000","last_clean":"2024-09-12T18:00:18.442930+0000","last_became_active":"2024-09-12T17:23:50.187084+0000","last_became_peered":"2024-09-12T17:23:50.187084+0000","last_unstale":"2024-09-12T18:00:18.442930+0000","last_undegraded":"2024-09-12T18:00:18.442930+0000","last_fullsized":"2024-09-12T18:00:18.442930+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:15.188210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":862,"num_read_kb":842,"num_write":338,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"261'421","reported_seq":1879,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.174681+0000","last_change":"2024-09-12T18:02:08.174681+0000","last_active":"2024-09-12T18:02:08.174681+0000","last_peered":"2024-09-12T18:02:08.174681+0000","last_clean":"2024-09-12T18:02:08.174681+0000","last_became_active":"2024-09-12T17:23:42.135975+0000","last_became_peered":"2024-09-12T17:23:42.135975+0000","last_unstale":"2024-09-12T18:02:08.174681+0000","last_undegraded":"2024-09-12T18:02:08.174681+0000","last_fullsized":"2024-09-12T18:02:08.174681+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'421","last_scrub_stamp":"2024-09-12T18:02:08.174594+0000","last_deep_scrub":"261'421","last_deep_scrub_stamp":"2024-09-12T18:02:08.174594+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.174594+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:26.404773+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2123,"num_read_kb":2006,"num_write":479,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"261'385","reported_seq":1035,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.733545+0000","last_change":"2024-09-12T18:01:57.733545+0000","last_active":"2024-09-12T18:01:57.733545+0000","last_peered":"2024-09-12T18:01:57.733545+0000","last_clean":"2024-09-12T18:01:57.733545+0000","last_became_active":"2024-09-12T17:23:40.713129+0000","last_became_peered":"2024-09-12T17:23:40.713129+0000","last_unstale":"2024-09-12T18:01:57.733545+0000","last_undegraded":"2024-09-12T18:01:57.733545+0000","last_fullsized":"2024-09-12T18:01:57.733545+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'385","last_scrub_stamp":"2024-09-12T18:01:57.733451+0000","last_deep_scrub":"261'385","last_deep_scrub_stamp":"2024-09-12T18:01:57.733451+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.733451+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:01.262019+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311685,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":537,"num_read_kb":14035,"num_write":1238,"num_write_kb":28273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"261'2","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.041733+0000","last_change":"2024-09-12T18:02:14.041733+0000","last_active":"2024-09-12T18:02:14.041733+0000","last_peered":"2024-09-12T18:02:14.041733+0000","last_clean":"2024-09-12T18:02:14.041733+0000","last_became_active":"2024-09-12T17:23:44.151126+0000","last_became_peered":"2024-09-12T17:23:44.151126+0000","last_unstale":"2024-09-12T18:02:14.041733+0000","last_undegraded":"2024-09-12T18:02:14.041733+0000","last_fullsized":"2024-09-12T18:02:14.041733+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:14.041603+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:14.041603+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.041603+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:38.127428+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"261'284","reported_seq":859,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.950235+0000","last_change":"2024-09-12T17:23:46.153409+0000","last_active":"2024-09-12T18:01:49.950235+0000","last_peered":"2024-09-12T18:01:49.950235+0000","last_clean":"2024-09-12T18:01:49.950235+0000","last_became_active":"2024-09-12T17:23:46.153111+0000","last_became_peered":"2024-09-12T17:23:46.153111+0000","last_unstale":"2024-09-12T18:01:49.950235+0000","last_undegraded":"2024-09-12T18:01:49.950235+0000","last_fullsized":"2024-09-12T18:01:49.950235+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:45.131166+0000","last_clean_scrub_stamp":"2024-09-12T17:23:45.131166+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:10.838059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":457,"num_read_kb":1001,"num_write":362,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:49.542675+0000","last_change":"2024-09-12T17:23:48.167442+0000","last_active":"2024-09-12T17:58:49.542675+0000","last_peered":"2024-09-12T17:58:49.542675+0000","last_clean":"2024-09-12T17:58:49.542675+0000","last_became_active":"2024-09-12T17:23:48.167070+0000","last_became_peered":"2024-09-12T17:23:48.167070+0000","last_unstale":"2024-09-12T17:58:49.542675+0000","last_undegraded":"2024-09-12T17:58:49.542675+0000","last_fullsized":"2024-09-12T17:58:49.542675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:47.147348+0000","last_clean_scrub_stamp":"2024-09-12T17:23:47.147348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:57.449206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"261'83","reported_seq":563,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.396381+0000","last_change":"2024-09-12T17:23:50.179396+0000","last_active":"2024-09-12T18:01:41.396381+0000","last_peered":"2024-09-12T18:01:41.396381+0000","last_clean":"2024-09-12T18:01:41.396381+0000","last_became_active":"2024-09-12T17:23:50.179075+0000","last_became_peered":"2024-09-12T17:23:50.179075+0000","last_unstale":"2024-09-12T18:01:41.396381+0000","last_undegraded":"2024-09-12T18:01:41.396381+0000","last_fullsized":"2024-09-12T18:01:41.396381+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:49.164328+0000","last_clean_scrub_stamp":"2024-09-12T17:23:49.164328+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:17.064467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":88,"num_write":193,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"261'780","reported_seq":2272,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.014426+0000","last_change":"2024-09-12T18:02:11.014426+0000","last_active":"2024-09-12T18:02:11.014426+0000","last_peered":"2024-09-12T18:02:11.014426+0000","last_clean":"2024-09-12T18:02:11.014426+0000","last_became_active":"2024-09-12T17:23:42.137169+0000","last_became_peered":"2024-09-12T17:23:42.137169+0000","last_unstale":"2024-09-12T18:02:11.014426+0000","last_undegraded":"2024-09-12T18:02:11.014426+0000","last_fullsized":"2024-09-12T18:02:11.014426+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'780","last_scrub_stamp":"2024-09-12T18:02:11.014345+0000","last_deep_scrub":"261'780","last_deep_scrub_stamp":"2024-09-12T18:02:11.014345+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.014345+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:33.609949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3876,"num_read_kb":3488,"num_write":1033,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3280,"num_omap_keys":13,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"261'371","reported_seq":1041,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.139558+0000","last_change":"2024-09-12T18:01:58.139558+0000","last_active":"2024-09-12T18:01:58.139558+0000","last_peered":"2024-09-12T18:01:58.139558+0000","last_clean":"2024-09-12T18:01:58.139558+0000","last_became_active":"2024-09-12T17:23:40.713212+0000","last_became_peered":"2024-09-12T17:23:40.713212+0000","last_unstale":"2024-09-12T18:01:58.139558+0000","last_undegraded":"2024-09-12T18:01:58.139558+0000","last_fullsized":"2024-09-12T18:01:58.139558+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'371","last_scrub_stamp":"2024-09-12T18:01:58.139456+0000","last_deep_scrub":"261'371","last_deep_scrub_stamp":"2024-09-12T18:01:58.139456+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.139456+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:12.945343+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":603,"num_read_kb":38604,"num_write":1166,"num_write_kb":36037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"261'634","reported_seq":2105,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.191292+0000","last_change":"2024-09-12T18:02:13.191292+0000","last_active":"2024-09-12T18:02:13.191292+0000","last_peered":"2024-09-12T18:02:13.191292+0000","last_clean":"2024-09-12T18:02:13.191292+0000","last_became_active":"2024-09-12T17:24:17.227465+0000","last_became_peered":"2024-09-12T17:24:17.227465+0000","last_unstale":"2024-09-12T18:02:13.191292+0000","last_undegraded":"2024-09-12T18:02:13.191292+0000","last_fullsized":"2024-09-12T18:02:13.191292+0000","mapping_epoch":36,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'634","last_scrub_stamp":"2024-09-12T18:02:13.191170+0000","last_deep_scrub":"261'634","last_deep_scrub_stamp":"2024-09-12T18:02:13.191170+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.191170+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":600,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:52.485072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3072,"num_read_kb":2745,"num_write":824,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":266,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"261'324","reported_seq":1001,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.956126+0000","last_change":"2024-09-12T18:01:56.956126+0000","last_active":"2024-09-12T18:01:56.956126+0000","last_peered":"2024-09-12T18:01:56.956126+0000","last_clean":"2024-09-12T18:01:56.956126+0000","last_became_active":"2024-09-12T17:23:40.708064+0000","last_became_peered":"2024-09-12T17:23:40.708064+0000","last_unstale":"2024-09-12T18:01:56.956126+0000","last_undegraded":"2024-09-12T18:01:56.956126+0000","last_fullsized":"2024-09-12T18:01:56.956126+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'324","last_scrub_stamp":"2024-09-12T18:01:56.956049+0000","last_deep_scrub":"261'324","last_deep_scrub_stamp":"2024-09-12T18:01:56.956049+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.956049+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:22.585210+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8958905,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":78914,"num_write":996,"num_write_kb":50917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"261'846","reported_seq":2566,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.231701+0000","last_change":"2024-09-12T18:02:12.231701+0000","last_active":"2024-09-12T18:02:12.231701+0000","last_peered":"2024-09-12T18:02:12.231701+0000","last_clean":"2024-09-12T18:02:12.231701+0000","last_became_active":"2024-09-12T17:23:42.144919+0000","last_became_peered":"2024-09-12T17:23:42.144919+0000","last_unstale":"2024-09-12T18:02:12.231701+0000","last_undegraded":"2024-09-12T18:02:12.231701+0000","last_fullsized":"2024-09-12T18:02:12.231701+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'846","last_scrub_stamp":"2024-09-12T18:02:12.231607+0000","last_deep_scrub":"261'846","last_deep_scrub_stamp":"2024-09-12T18:02:12.231607+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.231607+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:17.452515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4312,"num_read_kb":3919,"num_write":1107,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1165,"num_omap_keys":5,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"261'352","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.251183+0000","last_change":"2024-09-12T18:02:04.251183+0000","last_active":"2024-09-12T18:02:04.251183+0000","last_peered":"2024-09-12T18:02:04.251183+0000","last_clean":"2024-09-12T18:02:04.251183+0000","last_became_active":"2024-09-12T17:23:40.715471+0000","last_became_peered":"2024-09-12T17:23:40.715471+0000","last_unstale":"2024-09-12T18:02:04.251183+0000","last_undegraded":"2024-09-12T18:02:04.251183+0000","last_fullsized":"2024-09-12T18:02:04.251183+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'352","last_scrub_stamp":"2024-09-12T18:02:04.251012+0000","last_deep_scrub":"261'352","last_deep_scrub_stamp":"2024-09-12T18:02:04.251012+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.251012+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:39.383192+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":470,"num_read_kb":37845,"num_write":1014,"num_write_kb":24242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"261'768","reported_seq":2217,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.004437+0000","last_change":"2024-09-12T18:02:09.004437+0000","last_active":"2024-09-12T18:02:09.004437+0000","last_peered":"2024-09-12T18:02:09.004437+0000","last_clean":"2024-09-12T18:02:09.004437+0000","last_became_active":"2024-09-12T17:23:42.142672+0000","last_became_peered":"2024-09-12T17:23:42.142672+0000","last_unstale":"2024-09-12T18:02:09.004437+0000","last_undegraded":"2024-09-12T18:02:09.004437+0000","last_fullsized":"2024-09-12T18:02:09.004437+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'768","last_scrub_stamp":"2024-09-12T18:02:09.004346+0000","last_deep_scrub":"261'768","last_deep_scrub_stamp":"2024-09-12T18:02:09.004346+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.004346+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:52.254410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3573,"num_read_kb":3224,"num_write":1004,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"261'287","reported_seq":915,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.707639+0000","last_change":"2024-09-12T18:02:01.707639+0000","last_active":"2024-09-12T18:02:01.707639+0000","last_peered":"2024-09-12T18:02:01.707639+0000","last_clean":"2024-09-12T18:02:01.707639+0000","last_became_active":"2024-09-12T17:23:40.702991+0000","last_became_peered":"2024-09-12T17:23:40.702991+0000","last_unstale":"2024-09-12T18:02:01.707639+0000","last_undegraded":"2024-09-12T18:02:01.707639+0000","last_fullsized":"2024-09-12T18:02:01.707639+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'287","last_scrub_stamp":"2024-09-12T18:02:01.707536+0000","last_deep_scrub":"261'287","last_deep_scrub_stamp":"2024-09-12T18:02:01.707536+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.707536+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:27.542681+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306617,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":429,"num_read_kb":57192,"num_write":879,"num_write_kb":43690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"261'414","reported_seq":1908,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.286617+0000","last_change":"2024-09-12T18:02:13.286617+0000","last_active":"2024-09-12T18:02:13.286617+0000","last_peered":"2024-09-12T18:02:13.286617+0000","last_clean":"2024-09-12T18:02:13.286617+0000","last_became_active":"2024-09-12T17:23:42.146394+0000","last_became_peered":"2024-09-12T17:23:42.146394+0000","last_unstale":"2024-09-12T18:02:13.286617+0000","last_undegraded":"2024-09-12T18:02:13.286617+0000","last_fullsized":"2024-09-12T18:02:13.286617+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'414","last_scrub_stamp":"2024-09-12T18:02:13.286513+0000","last_deep_scrub":"261'414","last_deep_scrub_stamp":"2024-09-12T18:02:13.286513+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.286513+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:01.693990+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2184,"num_read_kb":2068,"num_write":471,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"261'366","reported_seq":1115,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.241761+0000","last_change":"2024-09-12T18:02:02.241761+0000","last_active":"2024-09-12T18:02:02.241761+0000","last_peered":"2024-09-12T18:02:02.241761+0000","last_clean":"2024-09-12T18:02:02.241761+0000","last_became_active":"2024-09-12T17:23:40.712702+0000","last_became_peered":"2024-09-12T17:23:40.712702+0000","last_unstale":"2024-09-12T18:02:02.241761+0000","last_undegraded":"2024-09-12T18:02:02.241761+0000","last_fullsized":"2024-09-12T18:02:02.241761+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'366","last_scrub_stamp":"2024-09-12T18:02:02.241608+0000","last_deep_scrub":"261'366","last_deep_scrub_stamp":"2024-09-12T18:02:02.241608+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.241608+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:45.785430+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":720,"num_read_kb":69814,"num_write":1187,"num_write_kb":31106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"261'859","reported_seq":2451,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.138788+0000","last_change":"2024-09-12T18:02:10.138788+0000","last_active":"2024-09-12T18:02:10.138788+0000","last_peered":"2024-09-12T18:02:10.138788+0000","last_clean":"2024-09-12T18:02:10.138788+0000","last_became_active":"2024-09-12T17:23:42.141605+0000","last_became_peered":"2024-09-12T17:23:42.141605+0000","last_unstale":"2024-09-12T18:02:10.138788+0000","last_undegraded":"2024-09-12T18:02:10.138788+0000","last_fullsized":"2024-09-12T18:02:10.138788+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'859","last_scrub_stamp":"2024-09-12T18:02:10.138696+0000","last_deep_scrub":"261'859","last_deep_scrub_stamp":"2024-09-12T18:02:10.138696+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.138696+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:59.422337+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4009,"num_read_kb":3625,"num_write":1130,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"261'305","reported_seq":1039,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.036630+0000","last_change":"2024-09-12T18:01:59.036630+0000","last_active":"2024-09-12T18:01:59.036630+0000","last_peered":"2024-09-12T18:01:59.036630+0000","last_clean":"2024-09-12T18:01:59.036630+0000","last_became_active":"2024-09-12T17:23:40.715809+0000","last_became_peered":"2024-09-12T17:23:40.715809+0000","last_unstale":"2024-09-12T18:01:59.036630+0000","last_undegraded":"2024-09-12T18:01:59.036630+0000","last_fullsized":"2024-09-12T18:01:59.036630+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'305","last_scrub_stamp":"2024-09-12T18:01:59.036534+0000","last_deep_scrub":"261'305","last_deep_scrub_stamp":"2024-09-12T18:01:59.036534+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.036534+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:38.706923+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":740,"num_read_kb":58572,"num_write":1029,"num_write_kb":36244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"261'1242","reported_seq":2732,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:05.227974+0000","last_change":"2024-09-12T17:23:42.155774+0000","last_active":"2024-09-12T18:00:05.227974+0000","last_peered":"2024-09-12T18:00:05.227974+0000","last_clean":"2024-09-12T18:00:05.227974+0000","last_became_active":"2024-09-12T17:23:42.155489+0000","last_became_peered":"2024-09-12T17:23:42.155489+0000","last_unstale":"2024-09-12T18:00:05.227974+0000","last_undegraded":"2024-09-12T18:00:05.227974+0000","last_fullsized":"2024-09-12T18:00:05.227974+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:36.957522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5619,"num_read_kb":4947,"num_write":1761,"num_write_kb":787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"261'369","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.101987+0000","last_change":"2024-09-12T18:01:59.101987+0000","last_active":"2024-09-12T18:01:59.101987+0000","last_peered":"2024-09-12T18:01:59.101987+0000","last_clean":"2024-09-12T18:01:59.101987+0000","last_became_active":"2024-09-12T17:23:40.704582+0000","last_became_peered":"2024-09-12T17:23:40.704582+0000","last_unstale":"2024-09-12T18:01:59.101987+0000","last_undegraded":"2024-09-12T18:01:59.101987+0000","last_fullsized":"2024-09-12T18:01:59.101987+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'369","last_scrub_stamp":"2024-09-12T18:01:59.101815+0000","last_deep_scrub":"261'369","last_deep_scrub_stamp":"2024-09-12T18:01:59.101815+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.101815+0000","objects_scrubbed":8,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:05.038276+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5258296,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":535,"num_read_kb":13831,"num_write":1155,"num_write_kb":46857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"261'755","reported_seq":2394,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.168066+0000","last_change":"2024-09-12T18:02:09.168066+0000","last_active":"2024-09-12T18:02:09.168066+0000","last_peered":"2024-09-12T18:02:09.168066+0000","last_clean":"2024-09-12T18:02:09.168066+0000","last_became_active":"2024-09-12T17:23:42.141542+0000","last_became_peered":"2024-09-12T17:23:42.141542+0000","last_unstale":"2024-09-12T18:02:09.168066+0000","last_undegraded":"2024-09-12T18:02:09.168066+0000","last_fullsized":"2024-09-12T18:02:09.168066+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'755","last_scrub_stamp":"2024-09-12T18:02:09.167983+0000","last_deep_scrub":"261'755","last_deep_scrub_stamp":"2024-09-12T18:02:09.167983+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.167983+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:32.809383+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3956,"num_read_kb":3681,"num_write":1110,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"261'391","reported_seq":1039,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.073856+0000","last_change":"2024-09-12T18:02:04.073856+0000","last_active":"2024-09-12T18:02:04.073856+0000","last_peered":"2024-09-12T18:02:04.073856+0000","last_clean":"2024-09-12T18:02:04.073856+0000","last_became_active":"2024-09-12T17:24:17.227082+0000","last_became_peered":"2024-09-12T17:24:17.227082+0000","last_unstale":"2024-09-12T18:02:04.073856+0000","last_undegraded":"2024-09-12T18:02:04.073856+0000","last_fullsized":"2024-09-12T18:02:04.073856+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'391","last_scrub_stamp":"2024-09-12T18:02:04.073725+0000","last_deep_scrub":"261'391","last_deep_scrub_stamp":"2024-09-12T18:02:04.073725+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.073725+0000","objects_scrubbed":7,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:53.651302+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":638,"num_read_kb":9829,"num_write":1453,"num_write_kb":18369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"261'767","reported_seq":2170,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.572908+0000","last_change":"2024-09-12T18:02:09.572908+0000","last_active":"2024-09-12T18:02:09.572908+0000","last_peered":"2024-09-12T18:02:09.572908+0000","last_clean":"2024-09-12T18:02:09.572908+0000","last_became_active":"2024-09-12T17:23:42.155052+0000","last_became_peered":"2024-09-12T17:23:42.155052+0000","last_unstale":"2024-09-12T18:02:09.572908+0000","last_undegraded":"2024-09-12T18:02:09.572908+0000","last_fullsized":"2024-09-12T18:02:09.572908+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'767","last_scrub_stamp":"2024-09-12T18:02:09.572815+0000","last_deep_scrub":"261'767","last_deep_scrub_stamp":"2024-09-12T18:02:09.572815+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.572815+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:37.232559+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3588,"num_read_kb":3224,"num_write":1013,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"261'354","reported_seq":1127,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.257003+0000","last_change":"2024-09-12T18:02:05.257003+0000","last_active":"2024-09-12T18:02:05.257003+0000","last_peered":"2024-09-12T18:02:05.257003+0000","last_clean":"2024-09-12T18:02:05.257003+0000","last_became_active":"2024-09-12T17:23:40.707220+0000","last_became_peered":"2024-09-12T17:23:40.707220+0000","last_unstale":"2024-09-12T18:02:05.257003+0000","last_undegraded":"2024-09-12T18:02:05.257003+0000","last_fullsized":"2024-09-12T18:02:05.257003+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-12T18:02:05.256842+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-12T18:02:05.256842+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.256842+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:56.340735+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5635850,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":676,"num_read_kb":59084,"num_write":1125,"num_write_kb":27945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"261'440","reported_seq":1943,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.202872+0000","last_change":"2024-09-12T18:02:12.202872+0000","last_active":"2024-09-12T18:02:12.202872+0000","last_peered":"2024-09-12T18:02:12.202872+0000","last_clean":"2024-09-12T18:02:12.202872+0000","last_became_active":"2024-09-12T17:23:42.134859+0000","last_became_peered":"2024-09-12T17:23:42.134859+0000","last_unstale":"2024-09-12T18:02:12.202872+0000","last_undegraded":"2024-09-12T18:02:12.202872+0000","last_fullsized":"2024-09-12T18:02:12.202872+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'440","last_scrub_stamp":"2024-09-12T18:02:12.202782+0000","last_deep_scrub":"261'440","last_deep_scrub_stamp":"2024-09-12T18:02:12.202782+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.202782+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:10.816400+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2327,"num_read_kb":2188,"num_write":509,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"261'326","reported_seq":968,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.213894+0000","last_change":"2024-09-12T18:02:01.213894+0000","last_active":"2024-09-12T18:02:01.213894+0000","last_peered":"2024-09-12T18:02:01.213894+0000","last_clean":"2024-09-12T18:02:01.213894+0000","last_became_active":"2024-09-12T17:23:40.711042+0000","last_became_peered":"2024-09-12T17:23:40.711042+0000","last_unstale":"2024-09-12T18:02:01.213894+0000","last_undegraded":"2024-09-12T18:02:01.213894+0000","last_fullsized":"2024-09-12T18:02:01.213894+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-12T18:02:01.213797+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-12T18:02:01.213797+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.213797+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:05.849655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":531,"num_read_kb":6765,"num_write":1166,"num_write_kb":43884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"261'952","reported_seq":2519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.074553+0000","last_change":"2024-09-12T18:02:05.074553+0000","last_active":"2024-09-12T18:02:05.074553+0000","last_peered":"2024-09-12T18:02:05.074553+0000","last_clean":"2024-09-12T18:02:05.074553+0000","last_became_active":"2024-09-12T17:23:42.141379+0000","last_became_peered":"2024-09-12T17:23:42.141379+0000","last_unstale":"2024-09-12T18:02:05.074553+0000","last_undegraded":"2024-09-12T18:02:05.074553+0000","last_fullsized":"2024-09-12T18:02:05.074553+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'952","last_scrub_stamp":"2024-09-12T18:02:05.074457+0000","last_deep_scrub":"261'952","last_deep_scrub_stamp":"2024-09-12T18:02:05.074457+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.074457+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":900,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:43.879354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4545,"num_read_kb":4064,"num_write":1359,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"261'399","reported_seq":1034,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.207269+0000","last_change":"2024-09-12T18:02:06.207269+0000","last_active":"2024-09-12T18:02:06.207269+0000","last_peered":"2024-09-12T18:02:06.207269+0000","last_clean":"2024-09-12T18:02:06.207269+0000","last_became_active":"2024-09-12T17:23:40.702825+0000","last_became_peered":"2024-09-12T17:23:40.702825+0000","last_unstale":"2024-09-12T18:02:06.207269+0000","last_undegraded":"2024-09-12T18:02:06.207269+0000","last_fullsized":"2024-09-12T18:02:06.207269+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'399","last_scrub_stamp":"2024-09-12T18:02:06.207160+0000","last_deep_scrub":"261'399","last_deep_scrub_stamp":"2024-09-12T18:02:06.207160+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.207160+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:02.674525+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":642,"num_read_kb":543,"num_write":1172,"num_write_kb":8662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"261'400","reported_seq":1817,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.185744+0000","last_change":"2024-09-12T18:02:11.185744+0000","last_active":"2024-09-12T18:02:11.185744+0000","last_peered":"2024-09-12T18:02:11.185744+0000","last_clean":"2024-09-12T18:02:11.185744+0000","last_became_active":"2024-09-12T17:23:42.139735+0000","last_became_peered":"2024-09-12T17:23:42.139735+0000","last_unstale":"2024-09-12T18:02:11.185744+0000","last_undegraded":"2024-09-12T18:02:11.185744+0000","last_fullsized":"2024-09-12T18:02:11.185744+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'400","last_scrub_stamp":"2024-09-12T18:02:11.185659+0000","last_deep_scrub":"261'400","last_deep_scrub_stamp":"2024-09-12T18:02:11.185659+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.185659+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:20.796201+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2037,"num_read_kb":1920,"num_write":445,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"261'345","reported_seq":1015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.727921+0000","last_change":"2024-09-12T18:02:02.727921+0000","last_active":"2024-09-12T18:02:02.727921+0000","last_peered":"2024-09-12T18:02:02.727921+0000","last_clean":"2024-09-12T18:02:02.727921+0000","last_became_active":"2024-09-12T17:23:40.709392+0000","last_became_peered":"2024-09-12T17:23:40.709392+0000","last_unstale":"2024-09-12T18:02:02.727921+0000","last_undegraded":"2024-09-12T18:02:02.727921+0000","last_fullsized":"2024-09-12T18:02:02.727921+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'345","last_scrub_stamp":"2024-09-12T18:02:02.727811+0000","last_deep_scrub":"261'345","last_deep_scrub_stamp":"2024-09-12T18:02:02.727811+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.727811+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:55.006739+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":64698,"num_write":1140,"num_write_kb":39876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"261'1136","reported_seq":2677,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.696246+0000","last_change":"2024-09-12T18:02:13.696246+0000","last_active":"2024-09-12T18:02:13.696246+0000","last_peered":"2024-09-12T18:02:13.696246+0000","last_clean":"2024-09-12T18:02:13.696246+0000","last_became_active":"2024-09-12T17:23:42.154127+0000","last_became_peered":"2024-09-12T17:23:42.154127+0000","last_unstale":"2024-09-12T18:02:13.696246+0000","last_undegraded":"2024-09-12T18:02:13.696246+0000","last_fullsized":"2024-09-12T18:02:13.696246+0000","mapping_epoch":25,"log_start":"261'1100","ondisk_log_start":"261'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1136","last_scrub_stamp":"2024-09-12T18:02:13.696125+0000","last_deep_scrub":"261'1136","last_deep_scrub_stamp":"2024-09-12T18:02:13.696125+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.696125+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":1100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:51.177021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5169,"num_read_kb":4583,"num_write":1562,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"261'352","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.136792+0000","last_change":"2024-09-12T18:02:04.136792+0000","last_active":"2024-09-12T18:02:04.136792+0000","last_peered":"2024-09-12T18:02:04.136792+0000","last_clean":"2024-09-12T18:02:04.136792+0000","last_became_active":"2024-09-12T17:23:40.714343+0000","last_became_peered":"2024-09-12T17:23:40.714343+0000","last_unstale":"2024-09-12T18:02:04.136792+0000","last_undegraded":"2024-09-12T18:02:04.136792+0000","last_fullsized":"2024-09-12T18:02:04.136792+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'352","last_scrub_stamp":"2024-09-12T18:02:04.136686+0000","last_deep_scrub":"261'352","last_deep_scrub_stamp":"2024-09-12T18:02:04.136686+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.136686+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:10.141603+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":610,"num_read_kb":27408,"num_write":1219,"num_write_kb":25060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"261'997","reported_seq":2626,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.621762+0000","last_change":"2024-09-12T18:02:08.621762+0000","last_active":"2024-09-12T18:02:08.621762+0000","last_peered":"2024-09-12T18:02:08.621762+0000","last_clean":"2024-09-12T18:02:08.621762+0000","last_became_active":"2024-09-12T17:23:42.146107+0000","last_became_peered":"2024-09-12T17:23:42.146107+0000","last_unstale":"2024-09-12T18:02:08.621762+0000","last_undegraded":"2024-09-12T18:02:08.621762+0000","last_fullsized":"2024-09-12T18:02:08.621762+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'997","last_scrub_stamp":"2024-09-12T18:02:08.621665+0000","last_deep_scrub":"261'997","last_deep_scrub_stamp":"2024-09-12T18:02:08.621665+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.621665+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.465820+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4676,"num_read_kb":4145,"num_write":1343,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"261'339","reported_seq":990,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.782950+0000","last_change":"2024-09-12T18:02:06.782877+0000","last_active":"2024-09-12T18:02:06.782950+0000","last_peered":"2024-09-12T18:02:06.782950+0000","last_clean":"2024-09-12T18:02:06.782950+0000","last_became_active":"2024-09-12T17:23:40.706951+0000","last_became_peered":"2024-09-12T17:23:40.706951+0000","last_unstale":"2024-09-12T18:02:06.782950+0000","last_undegraded":"2024-09-12T18:02:06.782950+0000","last_fullsized":"2024-09-12T18:02:06.782950+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'339","last_scrub_stamp":"2024-09-12T18:02:06.782780+0000","last_deep_scrub":"261'339","last_deep_scrub_stamp":"2024-09-12T18:02:06.782780+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.782780+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:28.262679+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918016,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":7215,"num_write":977,"num_write_kb":28374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"261'489","reported_seq":1994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:03.988472+0000","last_change":"2024-09-12T17:23:42.153312+0000","last_active":"2024-09-12T18:00:03.988472+0000","last_peered":"2024-09-12T18:00:03.988472+0000","last_clean":"2024-09-12T18:00:03.988472+0000","last_became_active":"2024-09-12T17:23:42.152999+0000","last_became_peered":"2024-09-12T17:23:42.152999+0000","last_unstale":"2024-09-12T18:00:03.988472+0000","last_undegraded":"2024-09-12T18:00:03.988472+0000","last_fullsized":"2024-09-12T18:00:03.988472+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2525,"num_read_kb":2342,"num_write":624,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"261'358","reported_seq":983,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.987950+0000","last_change":"2024-09-12T18:01:58.987950+0000","last_active":"2024-09-12T18:01:58.987950+0000","last_peered":"2024-09-12T18:01:58.987950+0000","last_clean":"2024-09-12T18:01:58.987950+0000","last_became_active":"2024-09-12T17:23:40.704585+0000","last_became_peered":"2024-09-12T17:23:40.704585+0000","last_unstale":"2024-09-12T18:01:58.987950+0000","last_undegraded":"2024-09-12T18:01:58.987950+0000","last_fullsized":"2024-09-12T18:01:58.987950+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'358","last_scrub_stamp":"2024-09-12T18:01:58.987801+0000","last_deep_scrub":"261'358","last_deep_scrub_stamp":"2024-09-12T18:01:58.987801+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.987801+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:52.057616+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262306,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":466,"num_read_kb":452,"num_write":1104,"num_write_kb":34111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"261'445","reported_seq":2034,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.717537+0000","last_change":"2024-09-12T18:02:10.717537+0000","last_active":"2024-09-12T18:02:10.717537+0000","last_peered":"2024-09-12T18:02:10.717537+0000","last_clean":"2024-09-12T18:02:10.717537+0000","last_became_active":"2024-09-12T17:23:42.154367+0000","last_became_peered":"2024-09-12T17:23:42.154367+0000","last_unstale":"2024-09-12T18:02:10.717537+0000","last_undegraded":"2024-09-12T18:02:10.717537+0000","last_fullsized":"2024-09-12T18:02:10.717537+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'445","last_scrub_stamp":"2024-09-12T18:02:10.717445+0000","last_deep_scrub":"261'445","last_deep_scrub_stamp":"2024-09-12T18:02:10.717445+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.717445+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:16.473683+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2387,"num_read_kb":2268,"num_write":501,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"261'401","reported_seq":1012,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.992526+0000","last_change":"2024-09-12T18:02:00.992526+0000","last_active":"2024-09-12T18:02:00.992526+0000","last_peered":"2024-09-12T18:02:00.992526+0000","last_clean":"2024-09-12T18:02:00.992526+0000","last_became_active":"2024-09-12T17:24:17.287516+0000","last_became_peered":"2024-09-12T17:24:17.287516+0000","last_unstale":"2024-09-12T18:02:00.992526+0000","last_undegraded":"2024-09-12T18:02:00.992526+0000","last_fullsized":"2024-09-12T18:02:00.992526+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'401","last_scrub_stamp":"2024-09-12T18:02:00.992392+0000","last_deep_scrub":"261'401","last_deep_scrub_stamp":"2024-09-12T18:02:00.992392+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.992392+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:29.409874+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":2150,"num_write":1211,"num_write_kb":17735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"261'371","reported_seq":1063,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.201850+0000","last_change":"2024-09-12T18:02:07.201850+0000","last_active":"2024-09-12T18:02:07.201850+0000","last_peered":"2024-09-12T18:02:07.201850+0000","last_clean":"2024-09-12T18:02:07.201850+0000","last_became_active":"2024-09-12T17:23:40.705975+0000","last_became_peered":"2024-09-12T17:23:40.705975+0000","last_unstale":"2024-09-12T18:02:07.201850+0000","last_undegraded":"2024-09-12T18:02:07.201850+0000","last_fullsized":"2024-09-12T18:02:07.201850+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'371","last_scrub_stamp":"2024-09-12T18:02:07.201750+0000","last_deep_scrub":"261'371","last_deep_scrub_stamp":"2024-09-12T18:02:07.201750+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.201750+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:00.288303+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102345,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":38544,"num_write":1177,"num_write_kb":29966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"261'892","reported_seq":2662,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.600768+0000","last_change":"2024-09-12T18:02:10.600768+0000","last_active":"2024-09-12T18:02:10.600768+0000","last_peered":"2024-09-12T18:02:10.600768+0000","last_clean":"2024-09-12T18:02:10.600768+0000","last_became_active":"2024-09-12T17:23:42.155431+0000","last_became_peered":"2024-09-12T17:23:42.155431+0000","last_unstale":"2024-09-12T18:02:10.600768+0000","last_undegraded":"2024-09-12T18:02:10.600768+0000","last_fullsized":"2024-09-12T18:02:10.600768+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'892","last_scrub_stamp":"2024-09-12T18:02:10.600663+0000","last_deep_scrub":"261'892","last_deep_scrub_stamp":"2024-09-12T18:02:10.600663+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.600663+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:56.558490+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4337,"num_read_kb":3945,"num_write":1177,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"261'325","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.090071+0000","last_change":"2024-09-12T18:02:01.090071+0000","last_active":"2024-09-12T18:02:01.090071+0000","last_peered":"2024-09-12T18:02:01.090071+0000","last_clean":"2024-09-12T18:02:01.090071+0000","last_became_active":"2024-09-12T17:23:40.713729+0000","last_became_peered":"2024-09-12T17:23:40.713729+0000","last_unstale":"2024-09-12T18:02:01.090071+0000","last_undegraded":"2024-09-12T18:02:01.090071+0000","last_fullsized":"2024-09-12T18:02:01.090071+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'325","last_scrub_stamp":"2024-09-12T18:02:01.089958+0000","last_deep_scrub":"261'325","last_deep_scrub_stamp":"2024-09-12T18:02:01.089958+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.089958+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:09.856184+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6690697,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":468,"num_read_kb":88924,"num_write":1000,"num_write_kb":31954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"261'919","reported_seq":2505,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:41.399527+0000","last_change":"2024-09-12T17:23:42.151306+0000","last_active":"2024-09-12T18:01:41.399527+0000","last_peered":"2024-09-12T18:01:41.399527+0000","last_clean":"2024-09-12T18:01:41.399527+0000","last_became_active":"2024-09-12T17:23:42.151035+0000","last_became_peered":"2024-09-12T17:23:42.151035+0000","last_unstale":"2024-09-12T18:01:41.399527+0000","last_undegraded":"2024-09-12T18:01:41.399527+0000","last_fullsized":"2024-09-12T18:01:41.399527+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:23:41.110914+0000","last_clean_scrub_stamp":"2024-09-12T17:23:41.110914+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":900,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:08.657281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4231,"num_read_kb":3788,"num_write":1202,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6418,"num_read_kb":4664,"num_write":2041,"num_write_kb":938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1112,"ondisk_log_size":1112,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16069,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16200,"num_read_kb":15888,"num_write":16774,"num_write_kb":4891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1650,"ondisk_log_size":1650,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":688,"ondisk_log_size":688,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1568925,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":16943,"num_read_kb":36201,"num_write":14185,"num_write_kb":11429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2195,"ondisk_log_size":2195,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2424,"num_read_kb":2890,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212759,"num_read_kb":194564,"num_write":55413,"num_write_kb":18856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35973,"num_omap_keys":145,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3790,"ondisk_log_size":3790,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":82077927,"num_objects":360,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":360,"num_whiteouts":0,"num_read":36160,"num_read_kb":2097994,"num_write":72463,"num_write_kb":2176823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":165306368,"data_stored":164155854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3733,"ondisk_log_size":3733,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":196116,"num_write":158,"num_write_kb":127401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":185777,"num_write":158,"num_write_kb":127401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509909,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313532,"kb_used_data":39404,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94058308,"statfs":{"total":96636764160,"available":96315707392,"internally_reserved":0,"allocated":40349696,"data_stored":38689531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509909,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263556,"kb_used_data":11636,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94108284,"statfs":{"total":96636764160,"available":96366882816,"internally_reserved":0,"allocated":11915264,"data_stored":10326315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509910,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150292,"kb_used_data":28932,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94221548,"statfs":{"total":96636764160,"available":96482865152,"internally_reserved":0,"allocated":29626368,"data_stored":27895637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509910,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108528,"kb_used_data":23200,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94263312,"statfs":{"total":96636764160,"available":96525631488,"internally_reserved":0,"allocated":23756800,"data_stored":22112034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509909,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157492,"kb_used_data":13924,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94214348,"statfs":{"total":96636764160,"available":96475492352,"internally_reserved":0,"allocated":14258176,"data_stored":12683013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509911,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273284,"kb_used_data":21428,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94098556,"statfs":{"total":96636764160,"available":96356921344,"internally_reserved":0,"allocated":21942272,"data_stored":20239121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257882567},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542614,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300444,"kb_used_data":30540,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":94071396,"statfs":{"total":96636764160,"available":96329109504,"internally_reserved":0,"allocated":31272960,"data_stored":29588476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276363719},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542615,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111216,"kb_used_data":21792,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94260624,"statfs":{"total":96636764160,"available":96522878976,"internally_reserved":0,"allocated":22315008,"data_stored":20755157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17715200,"data_stored":17530392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10657792,"data_stored":10563849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18726912,"data_stored":18636740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27639808,"data_stored":27468954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20172800,"data_stored":19992871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25960448,"data_stored":25776028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8314880,"data_stored":8207763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36118528,"data_stored":35979257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":3790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:18.299 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.299 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.299 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.299 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.300 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.300 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.300 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.300 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.300 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.300 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.300 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.300 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.301 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.301 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.301 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.301 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.301 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.301 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.301 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.301 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.302 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.302 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.302 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.302 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.302 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.302 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.302 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.302 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.302 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.303 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.303 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.303 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.303 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.303 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.303 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.303 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.304 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.304 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.304 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.304 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.304 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.304 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.304 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.305 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.305 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.305 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.305 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.305 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.305 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.305 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.306 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.306 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.306 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.306 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.306 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.306 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.306 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.307 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.307 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.307 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.307 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.307 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.307 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.307 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.308 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.308 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.308 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.308 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.308 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.308 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.308 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.309 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.309 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.309 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.309 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.309 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.309 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.309 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.309 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.310 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.310 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.310 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.310 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.310 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.310 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.310 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.311 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.311 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.311 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.311 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.311 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.311 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.311 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.312 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.312 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.312 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.312 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.312 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.312 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.312 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.313 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.313 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.313 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.313 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.313 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.313 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.313 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.314 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.314 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.314 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.314 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.314 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.314 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.314 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.315 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.315 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.315 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.315 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.315 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.315 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.315 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.315 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.316 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.316 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.316 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.316 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.316 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.316 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.316 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T17:23:39.682207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.317 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.317 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.317 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.317 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.318 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.318 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.318 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.318 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.318 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.318 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.319 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.319 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.319 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.319 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.319 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.319 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.319 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.320 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.320 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.320 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.320 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.320 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.320 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.320 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.321 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.321 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.321 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.321 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.321 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.321 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.322 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.322 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.322 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.322 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.322 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.322 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.323 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.323 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.323 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.323 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.323 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.323 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.324 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.324 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.324 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.324 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.324 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.324 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.325 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.325 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.325 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.325 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.325 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.325 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.326 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.326 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.326 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.326 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.326 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.326 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.326 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.327 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.327 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.327 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.327 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.327 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.327 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.327 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.328 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.328 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.328 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.328 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.328 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.328 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.329 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.329 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.329 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.329 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.329 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.329 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.329 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.330 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.330 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.330 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.330 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.330 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.330 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.331 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.331 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.331 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.331 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.331 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.331 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.331 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.332 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.332 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.332 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.332 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.332 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.332 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.332 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.333 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.333 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.333 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.333 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.333 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.333 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:23:43.122116+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.333 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.334 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.334 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.334 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:23:45.131166+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.334 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:23:47.147348+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.334 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:23:49.164328+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.335 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.335 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.335 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:23:41.110914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=23, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:18.335 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:02:38.336 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:38.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:02:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-12T18:02:38.705 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":1432,"stamp":"2024-09-12T18:02:38.501831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":84255101,"num_objects":839,"num_object_clones":0,"num_object_copies":1678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":839,"num_whiteouts":0,"num_read":291262,"num_read_kb":2734161,"num_write":161335,"num_write_kb":2469395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":732527,"num_omap_keys":1768,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13560,"ondisk_log_size":13560,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1686664,"kb_used_data":190856,"kb_used_omap":12,"kb_used_meta":1495667,"kb_avail":753288056,"statfs":{"total":773094113280,"available":771366969344,"internally_reserved":0,"allocated":195436544,"data_stored":182289284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1531563571},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15876,"num_omap_keys":47,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004885"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412189+0000","last_change":"2024-09-12T17:50:58.430620+0000","last_active":"2024-09-12T17:58:29.412189+0000","last_peered":"2024-09-12T17:58:29.412189+0000","last_clean":"2024-09-12T17:58:29.412189+0000","last_became_active":"2024-09-12T17:50:58.430327+0000","last_became_peered":"2024-09-12T17:50:58.430327+0000","last_unstale":"2024-09-12T17:58:29.412189+0000","last_undegraded":"2024-09-12T17:58:29.412189+0000","last_fullsized":"2024-09-12T17:58:29.412189+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:08.467218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"261'11","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.719698+0000","last_change":"2024-09-12T17:40:30.414114+0000","last_active":"2024-09-12T18:01:49.719698+0000","last_peered":"2024-09-12T18:01:49.719698+0000","last_clean":"2024-09-12T18:01:49.719698+0000","last_became_active":"2024-09-12T17:40:30.413466+0000","last_became_peered":"2024-09-12T17:40:30.413466+0000","last_unstale":"2024-09-12T18:01:49.719698+0000","last_undegraded":"2024-09-12T18:01:49.719698+0000","last_fullsized":"2024-09-12T18:01:49.719698+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:13.588006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14338,"num_write":26,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'2","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:28.426364+0000","last_change":"2024-09-12T17:40:27.384339+0000","last_active":"2024-09-12T18:00:28.426364+0000","last_peered":"2024-09-12T18:00:28.426364+0000","last_clean":"2024-09-12T18:00:28.426364+0000","last_became_active":"2024-09-12T17:40:27.384052+0000","last_became_peered":"2024-09-12T17:40:27.384052+0000","last_unstale":"2024-09-12T18:00:28.426364+0000","last_undegraded":"2024-09-12T18:00:28.426364+0000","last_fullsized":"2024-09-12T18:00:28.426364+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:44.943293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"261'180","reported_seq":604,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.550175+0000","last_change":"2024-09-12T17:38:51.209021+0000","last_active":"2024-09-12T17:59:44.550175+0000","last_peered":"2024-09-12T17:59:44.550175+0000","last_clean":"2024-09-12T17:59:44.550175+0000","last_became_active":"2024-09-12T17:38:51.208740+0000","last_became_peered":"2024-09-12T17:38:51.208740+0000","last_unstale":"2024-09-12T17:59:44.550175+0000","last_undegraded":"2024-09-12T17:59:44.550175+0000","last_fullsized":"2024-09-12T17:59:44.550175+0000","mapping_epoch":248,"log_start":"258'100","ondisk_log_start":"258'100","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:15.411282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1105,"num_read_kb":819,"num_write":215,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.054688+0000","last_change":"2024-09-12T18:02:25.054688+0000","last_active":"2024-09-12T18:02:25.054688+0000","last_peered":"2024-09-12T18:02:25.054688+0000","last_clean":"2024-09-12T18:02:25.054688+0000","last_became_active":"2024-09-12T17:50:58.429172+0000","last_became_peered":"2024-09-12T17:50:58.429172+0000","last_unstale":"2024-09-12T18:02:25.054688+0000","last_undegraded":"2024-09-12T18:02:25.054688+0000","last_fullsized":"2024-09-12T18:02:25.054688+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:25.054583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:25.054583+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.054583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:48.707684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:34.428739+0000","last_change":"2024-09-12T17:40:30.419563+0000","last_active":"2024-09-12T18:00:34.428739+0000","last_peered":"2024-09-12T18:00:34.428739+0000","last_clean":"2024-09-12T18:00:34.428739+0000","last_became_active":"2024-09-12T17:40:30.419270+0000","last_became_peered":"2024-09-12T17:40:30.419270+0000","last_unstale":"2024-09-12T18:00:34.428739+0000","last_undegraded":"2024-09-12T18:00:34.428739+0000","last_fullsized":"2024-09-12T18:00:34.428739+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:40.594940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.913848+0000","last_change":"2024-09-12T18:02:29.913848+0000","last_active":"2024-09-12T18:02:29.913848+0000","last_peered":"2024-09-12T18:02:29.913848+0000","last_clean":"2024-09-12T18:02:29.913848+0000","last_became_active":"2024-09-12T17:40:27.383464+0000","last_became_peered":"2024-09-12T17:40:27.383464+0000","last_unstale":"2024-09-12T18:02:29.913848+0000","last_undegraded":"2024-09-12T18:02:29.913848+0000","last_fullsized":"2024-09-12T18:02:29.913848+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:29.913762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:29.913762+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.913762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:04.461544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"261'20","reported_seq":106,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.018133+0000","last_change":"2024-09-12T18:02:17.018133+0000","last_active":"2024-09-12T18:02:17.018133+0000","last_peered":"2024-09-12T18:02:17.018133+0000","last_clean":"2024-09-12T18:02:17.018133+0000","last_became_active":"2024-09-12T17:38:51.217312+0000","last_became_peered":"2024-09-12T17:38:51.217312+0000","last_unstale":"2024-09-12T18:02:17.018133+0000","last_undegraded":"2024-09-12T18:02:17.018133+0000","last_fullsized":"2024-09-12T18:02:17.018133+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'20","last_scrub_stamp":"2024-09-12T18:02:17.018046+0000","last_deep_scrub":"261'20","last_deep_scrub_stamp":"2024-09-12T18:02:17.018046+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.018046+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:10.005857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":68,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.944792+0000","last_change":"2024-09-12T18:02:33.944792+0000","last_active":"2024-09-12T18:02:33.944792+0000","last_peered":"2024-09-12T18:02:33.944792+0000","last_clean":"2024-09-12T18:02:33.944792+0000","last_became_active":"2024-09-12T17:50:58.425202+0000","last_became_peered":"2024-09-12T17:50:58.425202+0000","last_unstale":"2024-09-12T18:02:33.944792+0000","last_undegraded":"2024-09-12T18:02:33.944792+0000","last_fullsized":"2024-09-12T18:02:33.944792+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:33.944707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:33.944707+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.944707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:05.234661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546433+0000","last_change":"2024-09-12T17:40:30.428077+0000","last_active":"2024-09-12T17:59:19.546433+0000","last_peered":"2024-09-12T17:59:19.546433+0000","last_clean":"2024-09-12T17:59:19.546433+0000","last_became_active":"2024-09-12T17:40:30.427798+0000","last_became_peered":"2024-09-12T17:40:30.427798+0000","last_unstale":"2024-09-12T17:59:19.546433+0000","last_undegraded":"2024-09-12T17:59:19.546433+0000","last_fullsized":"2024-09-12T17:59:19.546433+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:08.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.981318+0000","last_change":"2024-09-12T18:02:20.981243+0000","last_active":"2024-09-12T18:02:20.981318+0000","last_peered":"2024-09-12T18:02:20.981318+0000","last_clean":"2024-09-12T18:02:20.981318+0000","last_became_active":"2024-09-12T17:40:27.381456+0000","last_became_peered":"2024-09-12T17:40:27.381456+0000","last_unstale":"2024-09-12T18:02:20.981318+0000","last_undegraded":"2024-09-12T18:02:20.981318+0000","last_fullsized":"2024-09-12T18:02:20.981318+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:20.981153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:20.981153+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.981153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:22.793630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"261'39","reported_seq":146,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:54.543334+0000","last_change":"2024-09-12T17:38:51.212514+0000","last_active":"2024-09-12T17:58:54.543334+0000","last_peered":"2024-09-12T17:58:54.543334+0000","last_clean":"2024-09-12T17:58:54.543334+0000","last_became_active":"2024-09-12T17:38:51.212222+0000","last_became_peered":"2024-09-12T17:38:51.212222+0000","last_unstale":"2024-09-12T17:58:54.543334+0000","last_undegraded":"2024-09-12T17:58:54.543334+0000","last_fullsized":"2024-09-12T17:58:54.543334+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:58.957926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":132,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.408592+0000","last_change":"2024-09-12T17:50:58.422072+0000","last_active":"2024-09-12T17:58:18.408592+0000","last_peered":"2024-09-12T17:58:18.408592+0000","last_clean":"2024-09-12T17:58:18.408592+0000","last_became_active":"2024-09-12T17:50:58.421791+0000","last_became_peered":"2024-09-12T17:50:58.421791+0000","last_unstale":"2024-09-12T17:58:18.408592+0000","last_undegraded":"2024-09-12T17:58:18.408592+0000","last_fullsized":"2024-09-12T17:58:18.408592+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:23.289873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'3","reported_seq":30,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.562664+0000","last_change":"2024-09-12T17:41:17.634582+0000","last_active":"2024-09-12T18:01:19.562664+0000","last_peered":"2024-09-12T18:01:19.562664+0000","last_clean":"2024-09-12T18:01:19.562664+0000","last_became_active":"2024-09-12T17:41:17.634263+0000","last_became_peered":"2024-09-12T17:41:17.634263+0000","last_unstale":"2024-09-12T18:01:19.562664+0000","last_undegraded":"2024-09-12T18:01:19.562664+0000","last_fullsized":"2024-09-12T18:01:19.562664+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:21.737434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1f","version":"261'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.434726+0000","last_change":"2024-09-12T17:40:27.381866+0000","last_active":"2024-09-12T18:01:19.434726+0000","last_peered":"2024-09-12T18:01:19.434726+0000","last_clean":"2024-09-12T18:01:19.434726+0000","last_became_active":"2024-09-12T17:40:27.381587+0000","last_became_peered":"2024-09-12T17:40:27.381587+0000","last_unstale":"2024-09-12T18:01:19.434726+0000","last_undegraded":"2024-09-12T18:01:19.434726+0000","last_fullsized":"2024-09-12T18:01:19.434726+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:05.484868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"261'16","reported_seq":86,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:53.414258+0000","last_change":"2024-09-12T17:38:51.211725+0000","last_active":"2024-09-12T17:58:53.414258+0000","last_peered":"2024-09-12T17:58:53.414258+0000","last_clean":"2024-09-12T17:58:53.414258+0000","last_became_active":"2024-09-12T17:38:51.211429+0000","last_became_peered":"2024-09-12T17:38:51.211429+0000","last_unstale":"2024-09-12T17:58:53.414258+0000","last_undegraded":"2024-09-12T17:58:53.414258+0000","last_fullsized":"2024-09-12T17:58:53.414258+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:51.433082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":53,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:03.415591+0000","last_change":"2024-09-12T17:50:58.425178+0000","last_active":"2024-09-12T17:59:03.415591+0000","last_peered":"2024-09-12T17:59:03.415591+0000","last_clean":"2024-09-12T17:59:03.415591+0000","last_became_active":"2024-09-12T17:50:58.424898+0000","last_became_peered":"2024-09-12T17:50:58.424898+0000","last_unstale":"2024-09-12T17:59:03.415591+0000","last_undegraded":"2024-09-12T17:59:03.415591+0000","last_fullsized":"2024-09-12T17:59:03.415591+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:43.460057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.423267+0000","last_change":"2024-09-12T17:40:30.419273+0000","last_active":"2024-09-12T17:59:54.423267+0000","last_peered":"2024-09-12T17:59:54.423267+0000","last_clean":"2024-09-12T17:59:54.423267+0000","last_became_active":"2024-09-12T17:40:30.418865+0000","last_became_peered":"2024-09-12T17:40:30.418865+0000","last_unstale":"2024-09-12T17:59:54.423267+0000","last_undegraded":"2024-09-12T17:59:54.423267+0000","last_fullsized":"2024-09-12T17:59:54.423267+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'8","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.622468+0000","last_change":"2024-09-12T17:40:27.384760+0000","last_active":"2024-09-12T18:01:50.622468+0000","last_peered":"2024-09-12T18:01:50.622468+0000","last_clean":"2024-09-12T18:01:50.622468+0000","last_became_active":"2024-09-12T17:40:27.384445+0000","last_became_peered":"2024-09-12T17:40:27.384445+0000","last_unstale":"2024-09-12T18:01:50.622468+0000","last_undegraded":"2024-09-12T18:01:50.622468+0000","last_fullsized":"2024-09-12T18:01:50.622468+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"261'42","reported_seq":159,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:16.511172+0000","last_change":"2024-09-12T17:38:51.217731+0000","last_active":"2024-09-12T17:59:16.511172+0000","last_peered":"2024-09-12T17:59:16.511172+0000","last_clean":"2024-09-12T17:59:16.511172+0000","last_became_active":"2024-09-12T17:38:51.217421+0000","last_became_peered":"2024-09-12T17:38:51.217421+0000","last_unstale":"2024-09-12T17:59:16.511172+0000","last_undegraded":"2024-09-12T17:59:16.511172+0000","last_fullsized":"2024-09-12T17:59:16.511172+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:29.905573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":155,"num_write":73,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.418508+0000","last_change":"2024-09-12T17:50:58.422069+0000","last_active":"2024-09-12T17:59:19.418508+0000","last_peered":"2024-09-12T17:59:19.418508+0000","last_clean":"2024-09-12T17:59:19.418508+0000","last_became_active":"2024-09-12T17:50:58.421760+0000","last_became_peered":"2024-09-12T17:50:58.421760+0000","last_unstale":"2024-09-12T17:59:19.418508+0000","last_undegraded":"2024-09-12T17:59:19.418508+0000","last_fullsized":"2024-09-12T17:59:19.418508+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:17.645861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.887608+0000","last_change":"2024-09-12T18:02:30.887608+0000","last_active":"2024-09-12T18:02:30.887608+0000","last_peered":"2024-09-12T18:02:30.887608+0000","last_clean":"2024-09-12T18:02:30.887608+0000","last_became_active":"2024-09-12T17:40:30.417372+0000","last_became_peered":"2024-09-12T17:40:30.417372+0000","last_unstale":"2024-09-12T18:02:30.887608+0000","last_undegraded":"2024-09-12T18:02:30.887608+0000","last_fullsized":"2024-09-12T18:02:30.887608+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:30.887486+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:30.887486+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.887486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:48.515535+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"258'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.423608+0000","last_change":"2024-09-12T17:40:27.379433+0000","last_active":"2024-09-12T17:59:54.423608+0000","last_peered":"2024-09-12T17:59:54.423608+0000","last_clean":"2024-09-12T17:59:54.423608+0000","last_became_active":"2024-09-12T17:40:27.379161+0000","last_became_peered":"2024-09-12T17:40:27.379161+0000","last_unstale":"2024-09-12T17:59:54.423608+0000","last_undegraded":"2024-09-12T17:59:54.423608+0000","last_fullsized":"2024-09-12T17:59:54.423608+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"261'20","reported_seq":106,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.989175+0000","last_change":"2024-09-12T18:02:25.989175+0000","last_active":"2024-09-12T18:02:25.989175+0000","last_peered":"2024-09-12T18:02:25.989175+0000","last_clean":"2024-09-12T18:02:25.989175+0000","last_became_active":"2024-09-12T17:38:51.214555+0000","last_became_peered":"2024-09-12T17:38:51.214555+0000","last_unstale":"2024-09-12T18:02:25.989175+0000","last_undegraded":"2024-09-12T18:02:25.989175+0000","last_fullsized":"2024-09-12T18:02:25.989175+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'20","last_scrub_stamp":"2024-09-12T18:02:25.989086+0000","last_deep_scrub":"261'20","last_deep_scrub_stamp":"2024-09-12T18:02:25.989086+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.989086+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:21.310126+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412872+0000","last_change":"2024-09-12T17:50:58.429666+0000","last_active":"2024-09-12T17:58:29.412872+0000","last_peered":"2024-09-12T17:58:29.412872+0000","last_clean":"2024-09-12T17:58:29.412872+0000","last_became_active":"2024-09-12T17:50:58.429381+0000","last_became_peered":"2024-09-12T17:50:58.429381+0000","last_unstale":"2024-09-12T17:58:29.412872+0000","last_undegraded":"2024-09-12T17:58:29.412872+0000","last_fullsized":"2024-09-12T17:58:29.412872+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:24.108837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.882157+0000","last_change":"2024-09-12T18:02:31.882157+0000","last_active":"2024-09-12T18:02:31.882157+0000","last_peered":"2024-09-12T18:02:31.882157+0000","last_clean":"2024-09-12T18:02:31.882157+0000","last_became_active":"2024-09-12T17:40:30.420165+0000","last_became_peered":"2024-09-12T17:40:30.420165+0000","last_unstale":"2024-09-12T18:02:31.882157+0000","last_undegraded":"2024-09-12T18:02:31.882157+0000","last_fullsized":"2024-09-12T18:02:31.882157+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:31.882070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:31.882070+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.882070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:43.238046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"261'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:29.427973+0000","last_change":"2024-09-12T17:40:27.382601+0000","last_active":"2024-09-12T18:00:29.427973+0000","last_peered":"2024-09-12T18:00:29.427973+0000","last_clean":"2024-09-12T18:00:29.427973+0000","last_became_active":"2024-09-12T17:40:27.382310+0000","last_became_peered":"2024-09-12T17:40:27.382310+0000","last_unstale":"2024-09-12T18:00:29.427973+0000","last_undegraded":"2024-09-12T18:00:29.427973+0000","last_fullsized":"2024-09-12T18:00:29.427973+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:53.252512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"261'83","reported_seq":276,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537110+0000","last_change":"2024-09-12T17:38:51.213883+0000","last_active":"2024-09-12T17:58:14.537110+0000","last_peered":"2024-09-12T17:58:14.537110+0000","last_clean":"2024-09-12T17:58:14.537110+0000","last_became_active":"2024-09-12T17:38:51.213569+0000","last_became_peered":"2024-09-12T17:38:51.213569+0000","last_unstale":"2024-09-12T17:58:14.537110+0000","last_undegraded":"2024-09-12T17:58:14.537110+0000","last_fullsized":"2024-09-12T17:58:14.537110+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:09.021970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":443,"num_read_kb":326,"num_write":140,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412923+0000","last_change":"2024-09-12T17:50:58.431925+0000","last_active":"2024-09-12T17:58:29.412923+0000","last_peered":"2024-09-12T17:58:29.412923+0000","last_clean":"2024-09-12T17:58:29.412923+0000","last_became_active":"2024-09-12T17:50:58.431242+0000","last_became_peered":"2024-09-12T17:50:58.431242+0000","last_unstale":"2024-09-12T17:58:29.412923+0000","last_undegraded":"2024-09-12T17:58:29.412923+0000","last_fullsized":"2024-09-12T17:58:29.412923+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:38.404256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'2","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:33.427097+0000","last_change":"2024-09-12T17:40:30.417580+0000","last_active":"2024-09-12T18:00:33.427097+0000","last_peered":"2024-09-12T18:00:33.427097+0000","last_clean":"2024-09-12T18:00:33.427097+0000","last_became_active":"2024-09-12T17:40:30.416973+0000","last_became_peered":"2024-09-12T17:40:30.416973+0000","last_unstale":"2024-09-12T18:00:33.427097+0000","last_undegraded":"2024-09-12T18:00:33.427097+0000","last_fullsized":"2024-09-12T18:00:33.427097+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:01.885986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"258'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.535018+0000","last_change":"2024-09-12T17:40:27.383868+0000","last_active":"2024-09-12T17:57:59.535018+0000","last_peered":"2024-09-12T17:57:59.535018+0000","last_clean":"2024-09-12T17:57:59.535018+0000","last_became_active":"2024-09-12T17:40:27.383589+0000","last_became_peered":"2024-09-12T17:40:27.383589+0000","last_unstale":"2024-09-12T17:57:59.535018+0000","last_undegraded":"2024-09-12T17:57:59.535018+0000","last_fullsized":"2024-09-12T17:57:59.535018+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:33.218417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"261'40","reported_seq":157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.928364+0000","last_change":"2024-09-12T18:02:25.928364+0000","last_active":"2024-09-12T18:02:25.928364+0000","last_peered":"2024-09-12T18:02:25.928364+0000","last_clean":"2024-09-12T18:02:25.928364+0000","last_became_active":"2024-09-12T17:38:51.211962+0000","last_became_peered":"2024-09-12T17:38:51.211962+0000","last_unstale":"2024-09-12T18:02:25.928364+0000","last_undegraded":"2024-09-12T18:02:25.928364+0000","last_fullsized":"2024-09-12T18:02:25.928364+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'40","last_scrub_stamp":"2024-09-12T18:02:25.928263+0000","last_deep_scrub":"261'40","last_deep_scrub_stamp":"2024-09-12T18:02:25.928263+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.928263+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:28.089551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":137,"num_write":74,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.406991+0000","last_change":"2024-09-12T17:50:58.415378+0000","last_active":"2024-09-12T17:57:59.406991+0000","last_peered":"2024-09-12T17:57:59.406991+0000","last_clean":"2024-09-12T17:57:59.406991+0000","last_became_active":"2024-09-12T17:50:58.415098+0000","last_became_peered":"2024-09-12T17:50:58.415098+0000","last_unstale":"2024-09-12T17:57:59.406991+0000","last_undegraded":"2024-09-12T17:57:59.406991+0000","last_fullsized":"2024-09-12T17:57:59.406991+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:07.460645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:53.422324+0000","last_change":"2024-09-12T17:40:30.426133+0000","last_active":"2024-09-12T17:59:53.422324+0000","last_peered":"2024-09-12T17:59:53.422324+0000","last_clean":"2024-09-12T17:59:53.422324+0000","last_became_active":"2024-09-12T17:40:30.425845+0000","last_became_peered":"2024-09-12T17:40:30.425845+0000","last_unstale":"2024-09-12T17:59:53.422324+0000","last_undegraded":"2024-09-12T17:59:53.422324+0000","last_fullsized":"2024-09-12T17:59:53.422324+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"261'11","reported_seq":64,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:34.440175+0000","last_change":"2024-09-12T17:40:27.383205+0000","last_active":"2024-09-12T18:01:34.440175+0000","last_peered":"2024-09-12T18:01:34.440175+0000","last_clean":"2024-09-12T18:01:34.440175+0000","last_became_active":"2024-09-12T17:40:27.382833+0000","last_became_peered":"2024-09-12T17:40:27.382833+0000","last_unstale":"2024-09-12T18:01:34.440175+0000","last_undegraded":"2024-09-12T18:01:34.440175+0000","last_fullsized":"2024-09-12T18:01:34.440175+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:27.606242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32770,"num_write":16,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"261'60","reported_seq":203,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537248+0000","last_change":"2024-09-12T17:38:51.214569+0000","last_active":"2024-09-12T17:58:14.537248+0000","last_peered":"2024-09-12T17:58:14.537248+0000","last_clean":"2024-09-12T17:58:14.537248+0000","last_became_active":"2024-09-12T17:38:51.214274+0000","last_became_peered":"2024-09-12T17:38:51.214274+0000","last_unstale":"2024-09-12T17:58:14.537248+0000","last_undegraded":"2024-09-12T17:58:14.537248+0000","last_fullsized":"2024-09-12T17:58:14.537248+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:23.016284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":211,"num_write":107,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.038837+0000","last_change":"2024-09-12T18:02:24.038781+0000","last_active":"2024-09-12T18:02:24.038837+0000","last_peered":"2024-09-12T18:02:24.038837+0000","last_clean":"2024-09-12T18:02:24.038837+0000","last_became_active":"2024-09-12T17:50:58.426537+0000","last_became_peered":"2024-09-12T17:50:58.426537+0000","last_unstale":"2024-09-12T18:02:24.038837+0000","last_undegraded":"2024-09-12T18:02:24.038837+0000","last_fullsized":"2024-09-12T18:02:24.038837+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:24.038695+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:24.038695+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.038695+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:53.395847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"261'8","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:38.435543+0000","last_change":"2024-09-12T17:40:30.427100+0000","last_active":"2024-09-12T18:01:38.435543+0000","last_peered":"2024-09-12T18:01:38.435543+0000","last_clean":"2024-09-12T18:01:38.435543+0000","last_became_active":"2024-09-12T17:40:30.425368+0000","last_became_peered":"2024-09-12T17:40:30.425368+0000","last_unstale":"2024-09-12T18:01:38.435543+0000","last_undegraded":"2024-09-12T18:01:38.435543+0000","last_fullsized":"2024-09-12T18:01:38.435543+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:47.929671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'3","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:51.017569+0000","last_change":"2024-09-12T17:40:27.380566+0000","last_active":"2024-09-12T18:01:51.017569+0000","last_peered":"2024-09-12T18:01:51.017569+0000","last_clean":"2024-09-12T18:01:51.017569+0000","last_became_active":"2024-09-12T17:40:27.380228+0000","last_became_peered":"2024-09-12T17:40:27.380228+0000","last_unstale":"2024-09-12T18:01:51.017569+0000","last_undegraded":"2024-09-12T18:01:51.017569+0000","last_fullsized":"2024-09-12T18:01:51.017569+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"261'21","reported_seq":99,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:15.495658+0000","last_change":"2024-09-12T17:38:51.218671+0000","last_active":"2024-09-12T17:59:15.495658+0000","last_peered":"2024-09-12T17:59:15.495658+0000","last_clean":"2024-09-12T17:59:15.495658+0000","last_became_active":"2024-09-12T17:38:51.218309+0000","last_became_peered":"2024-09-12T17:38:51.218309+0000","last_unstale":"2024-09-12T17:59:15.495658+0000","last_undegraded":"2024-09-12T17:59:15.495658+0000","last_fullsized":"2024-09-12T17:59:15.495658+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:45.726103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.408378+0000","last_change":"2024-09-12T17:50:58.425291+0000","last_active":"2024-09-12T17:57:59.408378+0000","last_peered":"2024-09-12T17:57:59.408378+0000","last_clean":"2024-09-12T17:57:59.408378+0000","last_became_active":"2024-09-12T17:50:58.425003+0000","last_became_peered":"2024-09-12T17:50:58.425003+0000","last_unstale":"2024-09-12T17:57:59.408378+0000","last_undegraded":"2024-09-12T17:57:59.408378+0000","last_fullsized":"2024-09-12T17:57:59.408378+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:33.694791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"261'3","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:49.874640+0000","last_change":"2024-09-12T17:40:30.427105+0000","last_active":"2024-09-12T18:01:49.874640+0000","last_peered":"2024-09-12T18:01:49.874640+0000","last_clean":"2024-09-12T18:01:49.874640+0000","last_became_active":"2024-09-12T17:40:30.426714+0000","last_became_peered":"2024-09-12T17:40:30.426714+0000","last_unstale":"2024-09-12T18:01:49.874640+0000","last_undegraded":"2024-09-12T18:01:49.874640+0000","last_fullsized":"2024-09-12T18:01:49.874640+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.968483+0000","last_change":"2024-09-12T18:02:19.968483+0000","last_active":"2024-09-12T18:02:19.968483+0000","last_peered":"2024-09-12T18:02:19.968483+0000","last_clean":"2024-09-12T18:02:19.968483+0000","last_became_active":"2024-09-12T17:40:27.382132+0000","last_became_peered":"2024-09-12T17:40:27.382132+0000","last_unstale":"2024-09-12T18:02:19.968483+0000","last_undegraded":"2024-09-12T18:02:19.968483+0000","last_fullsized":"2024-09-12T18:02:19.968483+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:19.968389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:19.968389+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.968389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:16.177909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"261'28","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.950452+0000","last_change":"2024-09-12T18:02:14.950452+0000","last_active":"2024-09-12T18:02:14.950452+0000","last_peered":"2024-09-12T18:02:14.950452+0000","last_clean":"2024-09-12T18:02:14.950452+0000","last_became_active":"2024-09-12T17:38:51.214963+0000","last_became_peered":"2024-09-12T17:38:51.214963+0000","last_unstale":"2024-09-12T18:02:14.950452+0000","last_undegraded":"2024-09-12T18:02:14.950452+0000","last_fullsized":"2024-09-12T18:02:14.950452+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'28","last_scrub_stamp":"2024-09-12T18:02:14.950343+0000","last_deep_scrub":"261'28","last_deep_scrub_stamp":"2024-09-12T18:02:14.950343+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.950343+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:23.488575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":103,"num_write":58,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.407865+0000","last_change":"2024-09-12T17:50:58.427202+0000","last_active":"2024-09-12T17:57:59.407865+0000","last_peered":"2024-09-12T17:57:59.407865+0000","last_clean":"2024-09-12T17:57:59.407865+0000","last_became_active":"2024-09-12T17:50:58.426779+0000","last_became_peered":"2024-09-12T17:50:58.426779+0000","last_unstale":"2024-09-12T17:57:59.407865+0000","last_undegraded":"2024-09-12T17:57:59.407865+0000","last_fullsized":"2024-09-12T17:57:59.407865+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:56.570650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"258'6","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.423669+0000","last_change":"2024-09-12T17:40:30.419477+0000","last_active":"2024-09-12T17:59:54.423669+0000","last_peered":"2024-09-12T17:59:54.423669+0000","last_clean":"2024-09-12T17:59:54.423669+0000","last_became_active":"2024-09-12T17:40:30.419211+0000","last_became_peered":"2024-09-12T17:40:30.419211+0000","last_unstale":"2024-09-12T17:59:54.423669+0000","last_undegraded":"2024-09-12T17:59:54.423669+0000","last_fullsized":"2024-09-12T17:59:54.423669+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:49.550910+0000","last_change":"2024-09-12T17:40:27.382860+0000","last_active":"2024-09-12T17:59:49.550910+0000","last_peered":"2024-09-12T17:59:49.550910+0000","last_clean":"2024-09-12T17:59:49.550910+0000","last_became_active":"2024-09-12T17:40:27.382564+0000","last_became_peered":"2024-09-12T17:40:27.382564+0000","last_unstale":"2024-09-12T17:59:49.550910+0000","last_undegraded":"2024-09-12T17:59:49.550910+0000","last_fullsized":"2024-09-12T17:59:49.550910+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"261'12","reported_seq":76,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.424675+0000","last_change":"2024-09-12T17:38:51.215105+0000","last_active":"2024-09-12T17:59:59.424675+0000","last_peered":"2024-09-12T17:59:59.424675+0000","last_clean":"2024-09-12T17:59:59.424675+0000","last_became_active":"2024-09-12T17:38:51.214678+0000","last_became_peered":"2024-09-12T17:38:51.214678+0000","last_unstale":"2024-09-12T17:59:59.424675+0000","last_undegraded":"2024-09-12T17:59:59.424675+0000","last_fullsized":"2024-09-12T17:59:59.424675+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":38,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.407844+0000","last_change":"2024-09-12T17:50:58.427915+0000","last_active":"2024-09-12T17:58:13.407844+0000","last_peered":"2024-09-12T17:58:13.407844+0000","last_clean":"2024-09-12T17:58:13.407844+0000","last_became_active":"2024-09-12T17:50:58.427630+0000","last_became_peered":"2024-09-12T17:50:58.427630+0000","last_unstale":"2024-09-12T17:58:13.407844+0000","last_undegraded":"2024-09-12T17:58:13.407844+0000","last_fullsized":"2024-09-12T17:58:13.407844+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:54.698191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"261'14","reported_seq":66,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.149935+0000","last_change":"2024-09-12T17:40:30.413875+0000","last_active":"2024-09-12T18:01:50.149935+0000","last_peered":"2024-09-12T18:01:50.149935+0000","last_clean":"2024-09-12T18:01:50.149935+0000","last_became_active":"2024-09-12T17:40:30.413592+0000","last_became_peered":"2024-09-12T17:40:30.413592+0000","last_unstale":"2024-09-12T18:01:50.149935+0000","last_undegraded":"2024-09-12T18:01:50.149935+0000","last_fullsized":"2024-09-12T18:01:50.149935+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:47.033025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":45058,"num_write":24,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'8","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:29.435790+0000","last_change":"2024-09-12T17:40:27.382000+0000","last_active":"2024-09-12T18:01:29.435790+0000","last_peered":"2024-09-12T18:01:29.435790+0000","last_clean":"2024-09-12T18:01:29.435790+0000","last_became_active":"2024-09-12T17:40:27.381516+0000","last_became_peered":"2024-09-12T17:40:27.381516+0000","last_unstale":"2024-09-12T18:01:29.435790+0000","last_undegraded":"2024-09-12T18:01:29.435790+0000","last_fullsized":"2024-09-12T18:01:29.435790+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:48.416419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"261'6","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.423962+0000","last_change":"2024-09-12T17:38:51.216019+0000","last_active":"2024-09-12T17:59:54.423962+0000","last_peered":"2024-09-12T17:59:54.423962+0000","last_clean":"2024-09-12T17:59:54.423962+0000","last_became_active":"2024-09-12T17:38:51.215646+0000","last_became_peered":"2024-09-12T17:38:51.215646+0000","last_unstale":"2024-09-12T17:59:54.423962+0000","last_undegraded":"2024-09-12T17:59:54.423962+0000","last_fullsized":"2024-09-12T17:59:54.423962+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:14.537213+0000","last_change":"2024-09-12T17:50:58.423068+0000","last_active":"2024-09-12T17:58:14.537213+0000","last_peered":"2024-09-12T17:58:14.537213+0000","last_clean":"2024-09-12T17:58:14.537213+0000","last_became_active":"2024-09-12T17:50:58.422692+0000","last_became_peered":"2024-09-12T17:50:58.422692+0000","last_unstale":"2024-09-12T17:58:14.537213+0000","last_undegraded":"2024-09-12T17:58:14.537213+0000","last_fullsized":"2024-09-12T17:58:14.537213+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:51.624436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.829091+0000","last_change":"2024-09-12T18:02:33.829091+0000","last_active":"2024-09-12T18:02:33.829091+0000","last_peered":"2024-09-12T18:02:33.829091+0000","last_clean":"2024-09-12T18:02:33.829091+0000","last_became_active":"2024-09-12T17:40:30.418904+0000","last_became_peered":"2024-09-12T17:40:30.418904+0000","last_unstale":"2024-09-12T18:02:33.829091+0000","last_undegraded":"2024-09-12T18:02:33.829091+0000","last_fullsized":"2024-09-12T18:02:33.829091+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:33.828999+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:33.828999+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.828999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:57.783167+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:08.416187+0000","last_change":"2024-09-12T17:40:27.382156+0000","last_active":"2024-09-12T17:59:08.416187+0000","last_peered":"2024-09-12T17:59:08.416187+0000","last_clean":"2024-09-12T17:59:08.416187+0000","last_became_active":"2024-09-12T17:40:27.381849+0000","last_became_peered":"2024-09-12T17:40:27.381849+0000","last_unstale":"2024-09-12T17:59:08.416187+0000","last_undegraded":"2024-09-12T17:59:08.416187+0000","last_fullsized":"2024-09-12T17:59:08.416187+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:03.117165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"261'23","reported_seq":104,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.551408+0000","last_change":"2024-09-12T17:38:51.208118+0000","last_active":"2024-09-12T17:59:54.551408+0000","last_peered":"2024-09-12T17:59:54.551408+0000","last_clean":"2024-09-12T17:59:54.551408+0000","last_became_active":"2024-09-12T17:38:51.207804+0000","last_became_peered":"2024-09-12T17:38:51.207804+0000","last_unstale":"2024-09-12T17:59:54.551408+0000","last_undegraded":"2024-09-12T17:59:54.551408+0000","last_fullsized":"2024-09-12T17:59:54.551408+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":76,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:57:59.535062+0000","last_change":"2024-09-12T17:50:58.424688+0000","last_active":"2024-09-12T17:57:59.535062+0000","last_peered":"2024-09-12T17:57:59.535062+0000","last_clean":"2024-09-12T17:57:59.535062+0000","last_became_active":"2024-09-12T17:50:58.424379+0000","last_became_peered":"2024-09-12T17:50:58.424379+0000","last_unstale":"2024-09-12T17:57:59.535062+0000","last_undegraded":"2024-09-12T17:57:59.535062+0000","last_fullsized":"2024-09-12T17:57:59.535062+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:33.922718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:13.416845+0000","last_change":"2024-09-12T17:40:30.418399+0000","last_active":"2024-09-12T17:59:13.416845+0000","last_peered":"2024-09-12T17:59:13.416845+0000","last_clean":"2024-09-12T17:59:13.416845+0000","last_became_active":"2024-09-12T17:40:30.417111+0000","last_became_peered":"2024-09-12T17:40:30.417111+0000","last_unstale":"2024-09-12T17:59:13.416845+0000","last_undegraded":"2024-09-12T17:59:13.416845+0000","last_fullsized":"2024-09-12T17:59:13.416845+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:35.848674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.954712+0000","last_change":"2024-09-12T18:02:26.954712+0000","last_active":"2024-09-12T18:02:26.954712+0000","last_peered":"2024-09-12T18:02:26.954712+0000","last_clean":"2024-09-12T18:02:26.954712+0000","last_became_active":"2024-09-12T17:40:27.378245+0000","last_became_peered":"2024-09-12T17:40:27.378245+0000","last_unstale":"2024-09-12T18:02:26.954712+0000","last_undegraded":"2024-09-12T18:02:26.954712+0000","last_fullsized":"2024-09-12T18:02:26.954712+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:26.954627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:26.954627+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.954627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:34.497961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"261'38","reported_seq":154,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.423582+0000","last_change":"2024-09-12T17:38:51.209261+0000","last_active":"2024-09-12T17:59:54.423582+0000","last_peered":"2024-09-12T17:59:54.423582+0000","last_clean":"2024-09-12T17:59:54.423582+0000","last_became_active":"2024-09-12T17:38:51.208950+0000","last_became_peered":"2024-09-12T17:38:51.208950+0000","last_unstale":"2024-09-12T17:59:54.423582+0000","last_undegraded":"2024-09-12T17:59:54.423582+0000","last_fullsized":"2024-09-12T17:59:54.423582+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":143,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:13.407814+0000","last_change":"2024-09-12T17:50:58.426040+0000","last_active":"2024-09-12T17:58:13.407814+0000","last_peered":"2024-09-12T17:58:13.407814+0000","last_clean":"2024-09-12T17:58:13.407814+0000","last_became_active":"2024-09-12T17:50:58.425574+0000","last_became_peered":"2024-09-12T17:50:58.425574+0000","last_unstale":"2024-09-12T17:58:13.407814+0000","last_undegraded":"2024-09-12T17:58:13.407814+0000","last_fullsized":"2024-09-12T17:58:13.407814+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:39.335745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.874045+0000","last_change":"2024-09-12T18:02:29.874045+0000","last_active":"2024-09-12T18:02:29.874045+0000","last_peered":"2024-09-12T18:02:29.874045+0000","last_clean":"2024-09-12T18:02:29.874045+0000","last_became_active":"2024-09-12T17:40:30.411737+0000","last_became_peered":"2024-09-12T17:40:30.411737+0000","last_unstale":"2024-09-12T18:02:29.874045+0000","last_undegraded":"2024-09-12T18:02:29.874045+0000","last_fullsized":"2024-09-12T18:02:29.874045+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:29.873959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:29.873959+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.873959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:35.256924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417509+0000","last_change":"2024-09-12T17:40:27.372635+0000","last_active":"2024-09-12T17:59:09.417509+0000","last_peered":"2024-09-12T17:59:09.417509+0000","last_clean":"2024-09-12T17:59:09.417509+0000","last_became_active":"2024-09-12T17:40:27.372357+0000","last_became_peered":"2024-09-12T17:40:27.372357+0000","last_unstale":"2024-09-12T17:59:09.417509+0000","last_undegraded":"2024-09-12T17:59:09.417509+0000","last_fullsized":"2024-09-12T17:59:09.417509+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:34.828926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"261'42","reported_seq":151,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:53.422224+0000","last_change":"2024-09-12T17:38:51.208068+0000","last_active":"2024-09-12T17:59:53.422224+0000","last_peered":"2024-09-12T17:59:53.422224+0000","last_clean":"2024-09-12T17:59:53.422224+0000","last_became_active":"2024-09-12T17:38:51.207798+0000","last_became_peered":"2024-09-12T17:38:51.207798+0000","last_unstale":"2024-09-12T17:59:53.422224+0000","last_undegraded":"2024-09-12T17:59:53.422224+0000","last_fullsized":"2024-09-12T17:59:53.422224+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":137,"num_write":80,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.001901+0000","last_change":"2024-09-12T18:02:23.001901+0000","last_active":"2024-09-12T18:02:23.001901+0000","last_peered":"2024-09-12T18:02:23.001901+0000","last_clean":"2024-09-12T18:02:23.001901+0000","last_became_active":"2024-09-12T17:50:58.428339+0000","last_became_peered":"2024-09-12T17:50:58.428339+0000","last_unstale":"2024-09-12T18:02:23.001901+0000","last_undegraded":"2024-09-12T18:02:23.001901+0000","last_fullsized":"2024-09-12T18:02:23.001901+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:23.001816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:23.001816+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.001816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:27.387765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"261'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:48.429079+0000","last_change":"2024-09-12T17:40:30.417879+0000","last_active":"2024-09-12T18:00:48.429079+0000","last_peered":"2024-09-12T18:00:48.429079+0000","last_clean":"2024-09-12T18:00:48.429079+0000","last_became_active":"2024-09-12T17:40:30.417583+0000","last_became_peered":"2024-09-12T17:40:30.417583+0000","last_unstale":"2024-09-12T18:00:48.429079+0000","last_undegraded":"2024-09-12T18:00:48.429079+0000","last_fullsized":"2024-09-12T18:00:48.429079+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:57.147303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"258'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412848+0000","last_change":"2024-09-12T17:40:27.381338+0000","last_active":"2024-09-12T17:58:29.412848+0000","last_peered":"2024-09-12T17:58:29.412848+0000","last_clean":"2024-09-12T17:58:29.412848+0000","last_became_active":"2024-09-12T17:40:27.381027+0000","last_became_peered":"2024-09-12T17:40:27.381027+0000","last_unstale":"2024-09-12T17:58:29.412848+0000","last_undegraded":"2024-09-12T17:58:29.412848+0000","last_fullsized":"2024-09-12T17:58:29.412848+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:16.850258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"261'21","reported_seq":98,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:54.254313+0000","last_change":"2024-09-12T17:38:51.207794+0000","last_active":"2024-09-12T17:59:54.254313+0000","last_peered":"2024-09-12T17:59:54.254313+0000","last_clean":"2024-09-12T17:59:54.254313+0000","last_became_active":"2024-09-12T17:38:51.207487+0000","last_became_peered":"2024-09-12T17:38:51.207487+0000","last_unstale":"2024-09-12T17:59:54.254313+0000","last_undegraded":"2024-09-12T17:59:54.254313+0000","last_fullsized":"2024-09-12T17:59:54.254313+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:45.756120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":66,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.424626+0000","last_change":"2024-09-12T17:50:58.431273+0000","last_active":"2024-09-12T17:59:59.424626+0000","last_peered":"2024-09-12T17:59:59.424626+0000","last_clean":"2024-09-12T17:59:59.424626+0000","last_became_active":"2024-09-12T17:50:58.430797+0000","last_became_peered":"2024-09-12T17:50:58.430797+0000","last_unstale":"2024-09-12T17:59:59.424626+0000","last_undegraded":"2024-09-12T17:59:59.424626+0000","last_fullsized":"2024-09-12T17:59:59.424626+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"261'5","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.622623+0000","last_change":"2024-09-12T17:40:30.417952+0000","last_active":"2024-09-12T18:01:50.622623+0000","last_peered":"2024-09-12T18:01:50.622623+0000","last_clean":"2024-09-12T18:01:50.622623+0000","last_became_active":"2024-09-12T17:40:30.417567+0000","last_became_peered":"2024-09-12T17:40:30.417567+0000","last_unstale":"2024-09-12T18:01:50.622623+0000","last_undegraded":"2024-09-12T18:01:50.622623+0000","last_fullsized":"2024-09-12T18:01:50.622623+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:56.583902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"261'10","reported_seq":61,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.008973+0000","last_change":"2024-09-12T18:02:19.008973+0000","last_active":"2024-09-12T18:02:19.008973+0000","last_peered":"2024-09-12T18:02:19.008973+0000","last_clean":"2024-09-12T18:02:19.008973+0000","last_became_active":"2024-09-12T17:40:27.384579+0000","last_became_peered":"2024-09-12T17:40:27.384579+0000","last_unstale":"2024-09-12T18:02:19.008973+0000","last_undegraded":"2024-09-12T18:02:19.008973+0000","last_fullsized":"2024-09-12T18:02:19.008973+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'10","last_scrub_stamp":"2024-09-12T18:02:19.008873+0000","last_deep_scrub":"261'10","last_deep_scrub_stamp":"2024-09-12T18:02:19.008873+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.008873+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:19.052107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":20,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"261'7","reported_seq":61,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.417568+0000","last_change":"2024-09-12T17:38:51.215867+0000","last_active":"2024-09-12T17:59:09.417568+0000","last_peered":"2024-09-12T17:59:09.417568+0000","last_clean":"2024-09-12T17:59:09.417568+0000","last_became_active":"2024-09-12T17:38:51.215590+0000","last_became_peered":"2024-09-12T17:38:51.215590+0000","last_unstale":"2024-09-12T17:59:09.417568+0000","last_undegraded":"2024-09-12T17:59:09.417568+0000","last_fullsized":"2024-09-12T17:59:09.417568+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:33.602009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.906222+0000","last_change":"2024-09-12T18:02:32.906222+0000","last_active":"2024-09-12T18:02:32.906222+0000","last_peered":"2024-09-12T18:02:32.906222+0000","last_clean":"2024-09-12T18:02:32.906222+0000","last_became_active":"2024-09-12T17:50:58.426867+0000","last_became_peered":"2024-09-12T17:50:58.426867+0000","last_unstale":"2024-09-12T18:02:32.906222+0000","last_undegraded":"2024-09-12T18:02:32.906222+0000","last_fullsized":"2024-09-12T18:02:32.906222+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:32.906115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:32.906115+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.906115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:04.281587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"261'3","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.833051+0000","last_change":"2024-09-12T18:02:32.833051+0000","last_active":"2024-09-12T18:02:32.833051+0000","last_peered":"2024-09-12T18:02:32.833051+0000","last_clean":"2024-09-12T18:02:32.833051+0000","last_became_active":"2024-09-12T17:40:30.425775+0000","last_became_peered":"2024-09-12T17:40:30.425775+0000","last_unstale":"2024-09-12T18:02:32.833051+0000","last_undegraded":"2024-09-12T18:02:32.833051+0000","last_fullsized":"2024-09-12T18:02:32.833051+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:32.832964+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:32.832964+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.832964+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:26.129620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.539586+0000","last_change":"2024-09-12T17:40:27.382194+0000","last_active":"2024-09-12T17:58:29.539586+0000","last_peered":"2024-09-12T17:58:29.539586+0000","last_clean":"2024-09-12T17:58:29.539586+0000","last_became_active":"2024-09-12T17:40:27.381918+0000","last_became_peered":"2024-09-12T17:40:27.381918+0000","last_unstale":"2024-09-12T17:58:29.539586+0000","last_undegraded":"2024-09-12T17:58:29.539586+0000","last_fullsized":"2024-09-12T17:58:29.539586+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:18.545363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"261'43","reported_seq":167,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.034768+0000","last_change":"2024-09-12T18:02:24.034768+0000","last_active":"2024-09-12T18:02:24.034768+0000","last_peered":"2024-09-12T18:02:24.034768+0000","last_clean":"2024-09-12T18:02:24.034768+0000","last_became_active":"2024-09-12T17:38:51.209135+0000","last_became_peered":"2024-09-12T17:38:51.209135+0000","last_unstale":"2024-09-12T18:02:24.034768+0000","last_undegraded":"2024-09-12T18:02:24.034768+0000","last_fullsized":"2024-09-12T18:02:24.034768+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'43","last_scrub_stamp":"2024-09-12T18:02:24.034658+0000","last_deep_scrub":"261'43","last_deep_scrub_stamp":"2024-09-12T18:02:24.034658+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.034658+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:57.068969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":150,"num_write":83,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.422143+0000","last_change":"2024-09-12T17:50:58.431873+0000","last_active":"2024-09-12T17:59:39.422143+0000","last_peered":"2024-09-12T17:59:39.422143+0000","last_clean":"2024-09-12T17:59:39.422143+0000","last_became_active":"2024-09-12T17:50:58.431587+0000","last_became_peered":"2024-09-12T17:50:58.431587+0000","last_unstale":"2024-09-12T17:59:39.422143+0000","last_undegraded":"2024-09-12T17:59:39.422143+0000","last_fullsized":"2024-09-12T17:59:39.422143+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:06.651931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:33.411161+0000","last_change":"2024-09-12T17:40:30.418372+0000","last_active":"2024-09-12T17:58:33.411161+0000","last_peered":"2024-09-12T17:58:33.411161+0000","last_clean":"2024-09-12T17:58:33.411161+0000","last_became_active":"2024-09-12T17:40:30.417998+0000","last_became_peered":"2024-09-12T17:40:30.417998+0000","last_unstale":"2024-09-12T17:58:33.411161+0000","last_undegraded":"2024-09-12T17:58:33.411161+0000","last_fullsized":"2024-09-12T17:58:33.411161+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:45.170209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.942781+0000","last_change":"2024-09-12T18:02:28.942781+0000","last_active":"2024-09-12T18:02:28.942781+0000","last_peered":"2024-09-12T18:02:28.942781+0000","last_clean":"2024-09-12T18:02:28.942781+0000","last_became_active":"2024-09-12T17:40:27.374557+0000","last_became_peered":"2024-09-12T17:40:27.374557+0000","last_unstale":"2024-09-12T18:02:28.942781+0000","last_undegraded":"2024-09-12T18:02:28.942781+0000","last_fullsized":"2024-09-12T18:02:28.942781+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:28.942693+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:28.942693+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.942693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:26.660387+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"261'32","reported_seq":138,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.979713+0000","last_change":"2024-09-12T18:02:15.979713+0000","last_active":"2024-09-12T18:02:15.979713+0000","last_peered":"2024-09-12T18:02:15.979713+0000","last_clean":"2024-09-12T18:02:15.979713+0000","last_became_active":"2024-09-12T17:38:51.216209+0000","last_became_peered":"2024-09-12T17:38:51.216209+0000","last_unstale":"2024-09-12T18:02:15.979713+0000","last_undegraded":"2024-09-12T18:02:15.979713+0000","last_fullsized":"2024-09-12T18:02:15.979713+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'32","last_scrub_stamp":"2024-09-12T18:02:15.979620+0000","last_deep_scrub":"261'32","last_deep_scrub_stamp":"2024-09-12T18:02:15.979620+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.979620+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:08.310333+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":109,"num_write":55,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:58.422930+0000","last_change":"2024-09-12T17:50:58.425019+0000","last_active":"2024-09-12T17:59:58.422930+0000","last_peered":"2024-09-12T17:59:58.422930+0000","last_clean":"2024-09-12T17:59:58.422930+0000","last_became_active":"2024-09-12T17:50:58.424452+0000","last_became_peered":"2024-09-12T17:50:58.424452+0000","last_unstale":"2024-09-12T17:59:58.422930+0000","last_undegraded":"2024-09-12T17:59:58.422930+0000","last_fullsized":"2024-09-12T17:59:58.422930+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.424960+0000","last_change":"2024-09-12T17:40:30.418941+0000","last_active":"2024-09-12T18:00:04.424960+0000","last_peered":"2024-09-12T18:00:04.424960+0000","last_clean":"2024-09-12T18:00:04.424960+0000","last_became_active":"2024-09-12T17:40:30.418650+0000","last_became_peered":"2024-09-12T17:40:30.418650+0000","last_unstale":"2024-09-12T18:00:04.424960+0000","last_undegraded":"2024-09-12T18:00:04.424960+0000","last_fullsized":"2024-09-12T18:00:04.424960+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"258'8","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.551958+0000","last_change":"2024-09-12T17:40:27.385454+0000","last_active":"2024-09-12T17:59:59.551958+0000","last_peered":"2024-09-12T17:59:59.551958+0000","last_clean":"2024-09-12T17:59:59.551958+0000","last_became_active":"2024-09-12T17:40:27.385081+0000","last_became_peered":"2024-09-12T17:40:27.385081+0000","last_unstale":"2024-09-12T17:59:59.551958+0000","last_undegraded":"2024-09-12T17:59:59.551958+0000","last_fullsized":"2024-09-12T17:59:59.551958+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"261'37","reported_seq":148,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:09.545191+0000","last_change":"2024-09-12T17:38:51.209424+0000","last_active":"2024-09-12T17:59:09.545191+0000","last_peered":"2024-09-12T17:59:09.545191+0000","last_clean":"2024-09-12T17:59:09.545191+0000","last_became_active":"2024-09-12T17:38:51.208861+0000","last_became_peered":"2024-09-12T17:38:51.208861+0000","last_unstale":"2024-09-12T17:59:09.545191+0000","last_undegraded":"2024-09-12T17:59:09.545191+0000","last_fullsized":"2024-09-12T17:59:09.545191+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:00.098063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":141,"num_write":67,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.425448+0000","last_change":"2024-09-12T17:50:58.432996+0000","last_active":"2024-09-12T18:00:04.425448+0000","last_peered":"2024-09-12T18:00:04.425448+0000","last_clean":"2024-09-12T18:00:04.425448+0000","last_became_active":"2024-09-12T17:50:58.432245+0000","last_became_peered":"2024-09-12T17:50:58.432245+0000","last_unstale":"2024-09-12T18:00:04.425448+0000","last_undegraded":"2024-09-12T18:00:04.425448+0000","last_fullsized":"2024-09-12T18:00:04.425448+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.425280+0000","last_change":"2024-09-12T17:40:30.425572+0000","last_active":"2024-09-12T18:00:04.425280+0000","last_peered":"2024-09-12T18:00:04.425280+0000","last_clean":"2024-09-12T18:00:04.425280+0000","last_became_active":"2024-09-12T17:40:30.425293+0000","last_became_peered":"2024-09-12T17:40:30.425293+0000","last_unstale":"2024-09-12T18:00:04.425280+0000","last_undegraded":"2024-09-12T18:00:04.425280+0000","last_fullsized":"2024-09-12T18:00:04.425280+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"261'3","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.904837+0000","last_change":"2024-09-12T18:02:27.904837+0000","last_active":"2024-09-12T18:02:27.904837+0000","last_peered":"2024-09-12T18:02:27.904837+0000","last_clean":"2024-09-12T18:02:27.904837+0000","last_became_active":"2024-09-12T17:40:27.376781+0000","last_became_peered":"2024-09-12T17:40:27.376781+0000","last_unstale":"2024-09-12T18:02:27.904837+0000","last_undegraded":"2024-09-12T18:02:27.904837+0000","last_fullsized":"2024-09-12T18:02:27.904837+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:27.904747+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:27.904747+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.904747+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:18.705963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412794+0000","last_change":"2024-09-12T17:38:51.210062+0000","last_active":"2024-09-12T17:58:29.412794+0000","last_peered":"2024-09-12T17:58:29.412794+0000","last_clean":"2024-09-12T17:58:29.412794+0000","last_became_active":"2024-09-12T17:38:51.209772+0000","last_became_peered":"2024-09-12T17:38:51.209772+0000","last_unstale":"2024-09-12T17:58:29.412794+0000","last_undegraded":"2024-09-12T17:58:29.412794+0000","last_fullsized":"2024-09-12T17:58:29.412794+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:25.124534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"261'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.424659+0000","last_change":"2024-09-12T17:50:58.429816+0000","last_active":"2024-09-12T17:59:59.424659+0000","last_peered":"2024-09-12T17:59:59.424659+0000","last_clean":"2024-09-12T17:59:59.424659+0000","last_became_active":"2024-09-12T17:50:58.429551+0000","last_became_peered":"2024-09-12T17:50:58.429551+0000","last_unstale":"2024-09-12T17:59:59.424659+0000","last_undegraded":"2024-09-12T17:59:59.424659+0000","last_fullsized":"2024-09-12T17:59:59.424659+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'7","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.870607+0000","last_change":"2024-09-12T18:02:31.870607+0000","last_active":"2024-09-12T18:02:31.870607+0000","last_peered":"2024-09-12T18:02:31.870607+0000","last_clean":"2024-09-12T18:02:31.870607+0000","last_became_active":"2024-09-12T17:40:30.408915+0000","last_became_peered":"2024-09-12T17:40:30.408915+0000","last_unstale":"2024-09-12T18:02:31.870607+0000","last_undegraded":"2024-09-12T18:02:31.870607+0000","last_fullsized":"2024-09-12T18:02:31.870607+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-12T18:02:31.870487+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-12T18:02:31.870487+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.870487+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:45.211938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25606,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"258'3","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.552001+0000","last_change":"2024-09-12T17:40:27.382211+0000","last_active":"2024-09-12T17:59:59.552001+0000","last_peered":"2024-09-12T17:59:59.552001+0000","last_clean":"2024-09-12T17:59:59.552001+0000","last_became_active":"2024-09-12T17:40:27.381885+0000","last_became_peered":"2024-09-12T17:40:27.381885+0000","last_unstale":"2024-09-12T17:59:59.552001+0000","last_undegraded":"2024-09-12T17:59:59.552001+0000","last_fullsized":"2024-09-12T17:59:59.552001+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"261'68","reported_seq":231,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:23.409354+0000","last_change":"2024-09-12T17:38:51.215246+0000","last_active":"2024-09-12T17:58:23.409354+0000","last_peered":"2024-09-12T17:58:23.409354+0000","last_clean":"2024-09-12T17:58:23.409354+0000","last_became_active":"2024-09-12T17:38:51.214940+0000","last_became_peered":"2024-09-12T17:38:51.214940+0000","last_unstale":"2024-09-12T17:58:23.409354+0000","last_undegraded":"2024-09-12T17:58:23.409354+0000","last_fullsized":"2024-09-12T17:58:23.409354+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:11.305564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":356,"num_read_kb":250,"num_write":117,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.552047+0000","last_change":"2024-09-12T17:50:58.421234+0000","last_active":"2024-09-12T17:59:59.552047+0000","last_peered":"2024-09-12T17:59:59.552047+0000","last_clean":"2024-09-12T17:59:59.552047+0000","last_became_active":"2024-09-12T17:50:58.420251+0000","last_became_peered":"2024-09-12T17:50:58.420251+0000","last_unstale":"2024-09-12T17:59:59.552047+0000","last_undegraded":"2024-09-12T17:59:59.552047+0000","last_fullsized":"2024-09-12T17:59:59.552047+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"258'7","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:09.426073+0000","last_change":"2024-09-12T17:40:30.417703+0000","last_active":"2024-09-12T18:00:09.426073+0000","last_peered":"2024-09-12T18:00:09.426073+0000","last_clean":"2024-09-12T18:00:09.426073+0000","last_became_active":"2024-09-12T17:40:30.417393+0000","last_became_peered":"2024-09-12T17:40:30.417393+0000","last_unstale":"2024-09-12T18:00:09.426073+0000","last_undegraded":"2024-09-12T18:00:09.426073+0000","last_fullsized":"2024-09-12T18:00:09.426073+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":7,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'2","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.001262+0000","last_change":"2024-09-12T18:02:34.001262+0000","last_active":"2024-09-12T18:02:34.001262+0000","last_peered":"2024-09-12T18:02:34.001262+0000","last_clean":"2024-09-12T18:02:34.001262+0000","last_became_active":"2024-09-12T17:40:27.379472+0000","last_became_peered":"2024-09-12T17:40:27.379472+0000","last_unstale":"2024-09-12T18:02:34.001262+0000","last_undegraded":"2024-09-12T18:02:34.001262+0000","last_fullsized":"2024-09-12T18:02:34.001262+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:34.001145+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:34.001145+0000","last_clean_scrub_stamp":"2024-09-12T18:02:34.001145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:27.189307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"261'106","reported_seq":374,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.000259+0000","last_change":"2024-09-12T18:02:25.000259+0000","last_active":"2024-09-12T18:02:25.000259+0000","last_peered":"2024-09-12T18:02:25.000259+0000","last_clean":"2024-09-12T18:02:25.000259+0000","last_became_active":"2024-09-12T17:38:51.207735+0000","last_became_peered":"2024-09-12T17:38:51.207735+0000","last_unstale":"2024-09-12T18:02:25.000259+0000","last_undegraded":"2024-09-12T18:02:25.000259+0000","last_fullsized":"2024-09-12T18:02:25.000259+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'106","last_scrub_stamp":"2024-09-12T18:02:25.000158+0000","last_deep_scrub":"261'106","last_deep_scrub_stamp":"2024-09-12T18:02:25.000158+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.000158+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.557077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":541,"num_write":122,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419330+0000","last_change":"2024-09-12T17:50:58.431116+0000","last_active":"2024-09-12T17:59:19.419330+0000","last_peered":"2024-09-12T17:59:19.419330+0000","last_clean":"2024-09-12T17:59:19.419330+0000","last_became_active":"2024-09-12T17:50:58.430813+0000","last_became_peered":"2024-09-12T17:50:58.430813+0000","last_unstale":"2024-09-12T17:59:19.419330+0000","last_undegraded":"2024-09-12T17:59:19.419330+0000","last_fullsized":"2024-09-12T17:59:19.419330+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:19.189927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546398+0000","last_change":"2024-09-12T17:40:30.411164+0000","last_active":"2024-09-12T17:59:19.546398+0000","last_peered":"2024-09-12T17:59:19.546398+0000","last_clean":"2024-09-12T17:59:19.546398+0000","last_became_active":"2024-09-12T17:40:30.410872+0000","last_became_peered":"2024-09-12T17:40:30.410872+0000","last_unstale":"2024-09-12T17:59:19.546398+0000","last_undegraded":"2024-09-12T17:59:19.546398+0000","last_fullsized":"2024-09-12T17:59:19.546398+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:47.603677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:19.437671+0000","last_change":"2024-09-12T17:40:27.380593+0000","last_active":"2024-09-12T18:01:19.437671+0000","last_peered":"2024-09-12T18:01:19.437671+0000","last_clean":"2024-09-12T18:01:19.437671+0000","last_became_active":"2024-09-12T17:40:27.380269+0000","last_became_peered":"2024-09-12T17:40:27.380269+0000","last_unstale":"2024-09-12T18:01:19.437671+0000","last_undegraded":"2024-09-12T18:01:19.437671+0000","last_fullsized":"2024-09-12T18:01:19.437671+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:52.967809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"261'42","reported_seq":165,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.731875+0000","last_change":"2024-09-12T18:02:33.731875+0000","last_active":"2024-09-12T18:02:33.731875+0000","last_peered":"2024-09-12T18:02:33.731875+0000","last_clean":"2024-09-12T18:02:33.731875+0000","last_became_active":"2024-09-12T17:38:51.216152+0000","last_became_peered":"2024-09-12T17:38:51.216152+0000","last_unstale":"2024-09-12T18:02:33.731875+0000","last_undegraded":"2024-09-12T18:02:33.731875+0000","last_fullsized":"2024-09-12T18:02:33.731875+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'42","last_scrub_stamp":"2024-09-12T18:02:33.731790+0000","last_deep_scrub":"261'42","last_deep_scrub_stamp":"2024-09-12T18:02:33.731790+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.731790+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:48:40.551255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":152,"num_write":74,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.418727+0000","last_change":"2024-09-12T17:50:58.431015+0000","last_active":"2024-09-12T17:59:19.418727+0000","last_peered":"2024-09-12T17:59:19.418727+0000","last_clean":"2024-09-12T17:59:19.418727+0000","last_became_active":"2024-09-12T17:50:58.430723+0000","last_became_peered":"2024-09-12T17:50:58.430723+0000","last_unstale":"2024-09-12T17:59:19.418727+0000","last_undegraded":"2024-09-12T17:59:19.418727+0000","last_fullsized":"2024-09-12T17:59:19.418727+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:21.663778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"261'2","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:24.563246+0000","last_change":"2024-09-12T17:40:30.425667+0000","last_active":"2024-09-12T18:01:24.563246+0000","last_peered":"2024-09-12T18:01:24.563246+0000","last_clean":"2024-09-12T18:01:24.563246+0000","last_became_active":"2024-09-12T17:40:30.425368+0000","last_became_peered":"2024-09-12T17:40:30.425368+0000","last_unstale":"2024-09-12T18:01:24.563246+0000","last_undegraded":"2024-09-12T18:01:24.563246+0000","last_fullsized":"2024-09-12T18:01:24.563246+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:57.448155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.015051+0000","last_change":"2024-09-12T18:02:18.015051+0000","last_active":"2024-09-12T18:02:18.015051+0000","last_peered":"2024-09-12T18:02:18.015051+0000","last_clean":"2024-09-12T18:02:18.015051+0000","last_became_active":"2024-09-12T17:40:27.383770+0000","last_became_peered":"2024-09-12T17:40:27.383770+0000","last_unstale":"2024-09-12T18:02:18.015051+0000","last_undegraded":"2024-09-12T18:02:18.015051+0000","last_fullsized":"2024-09-12T18:02:18.015051+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:18.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:18.014972+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:48.282723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"258'22","reported_seq":116,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.068222+0000","last_change":"2024-09-12T18:02:23.068222+0000","last_active":"2024-09-12T18:02:23.068222+0000","last_peered":"2024-09-12T18:02:23.068222+0000","last_clean":"2024-09-12T18:02:23.068222+0000","last_became_active":"2024-09-12T17:38:51.208767+0000","last_became_peered":"2024-09-12T17:38:51.208767+0000","last_unstale":"2024-09-12T18:02:23.068222+0000","last_undegraded":"2024-09-12T18:02:23.068222+0000","last_fullsized":"2024-09-12T18:02:23.068222+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'22","last_scrub_stamp":"2024-09-12T18:02:23.068136+0000","last_deep_scrub":"258'22","last_deep_scrub_stamp":"2024-09-12T18:02:23.068136+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.068136+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:52.412076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:04.416155+0000","last_change":"2024-09-12T17:50:58.422944+0000","last_active":"2024-09-12T17:59:04.416155+0000","last_peered":"2024-09-12T17:59:04.416155+0000","last_clean":"2024-09-12T17:59:04.416155+0000","last_became_active":"2024-09-12T17:50:58.422625+0000","last_became_peered":"2024-09-12T17:50:58.422625+0000","last_unstale":"2024-09-12T17:59:04.416155+0000","last_undegraded":"2024-09-12T17:59:04.416155+0000","last_fullsized":"2024-09-12T17:59:04.416155+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:04.987349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:04.425459+0000","last_change":"2024-09-12T17:40:30.425786+0000","last_active":"2024-09-12T18:00:04.425459+0000","last_peered":"2024-09-12T18:00:04.425459+0000","last_clean":"2024-09-12T18:00:04.425459+0000","last_became_active":"2024-09-12T17:40:30.425536+0000","last_became_peered":"2024-09-12T17:40:30.425536+0000","last_unstale":"2024-09-12T18:00:04.425459+0000","last_undegraded":"2024-09-12T18:00:04.425459+0000","last_fullsized":"2024-09-12T18:00:04.425459+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"258'6","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.424962+0000","last_change":"2024-09-12T17:40:27.382099+0000","last_active":"2024-09-12T17:59:59.424962+0000","last_peered":"2024-09-12T17:59:59.424962+0000","last_clean":"2024-09-12T17:59:59.424962+0000","last_became_active":"2024-09-12T17:40:27.381818+0000","last_became_peered":"2024-09-12T17:40:27.381818+0000","last_unstale":"2024-09-12T17:59:59.424962+0000","last_undegraded":"2024-09-12T17:59:59.424962+0000","last_fullsized":"2024-09-12T17:59:59.424962+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"261'42","reported_seq":174,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.707951+0000","last_change":"2024-09-12T18:02:33.707951+0000","last_active":"2024-09-12T18:02:33.707951+0000","last_peered":"2024-09-12T18:02:33.707951+0000","last_clean":"2024-09-12T18:02:33.707951+0000","last_became_active":"2024-09-12T17:38:51.211219+0000","last_became_peered":"2024-09-12T17:38:51.211219+0000","last_unstale":"2024-09-12T18:02:33.707951+0000","last_undegraded":"2024-09-12T18:02:33.707951+0000","last_fullsized":"2024-09-12T18:02:33.707951+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'42","last_scrub_stamp":"2024-09-12T18:02:33.707856+0000","last_deep_scrub":"261'42","last_deep_scrub_stamp":"2024-09-12T18:02:33.707856+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.707856+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:07.552173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":165,"num_write":70,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419044+0000","last_change":"2024-09-12T17:50:58.416892+0000","last_active":"2024-09-12T17:59:19.419044+0000","last_peered":"2024-09-12T17:59:19.419044+0000","last_clean":"2024-09-12T17:59:19.419044+0000","last_became_active":"2024-09-12T17:50:58.416501+0000","last_became_peered":"2024-09-12T17:50:58.416501+0000","last_unstale":"2024-09-12T17:59:19.419044+0000","last_undegraded":"2024-09-12T17:59:19.419044+0000","last_fullsized":"2024-09-12T17:59:19.419044+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:06.098567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"261'5","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.926782+0000","last_change":"2024-09-12T17:40:30.418747+0000","last_active":"2024-09-12T18:01:50.926782+0000","last_peered":"2024-09-12T18:01:50.926782+0000","last_clean":"2024-09-12T18:01:50.926782+0000","last_became_active":"2024-09-12T17:40:30.418418+0000","last_became_peered":"2024-09-12T17:40:30.418418+0000","last_unstale":"2024-09-12T18:01:50.926782+0000","last_undegraded":"2024-09-12T18:01:50.926782+0000","last_fullsized":"2024-09-12T18:01:50.926782+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:59.424752+0000","last_change":"2024-09-12T17:40:27.383455+0000","last_active":"2024-09-12T17:59:59.424752+0000","last_peered":"2024-09-12T17:59:59.424752+0000","last_clean":"2024-09-12T17:59:59.424752+0000","last_became_active":"2024-09-12T17:40:27.383023+0000","last_became_peered":"2024-09-12T17:40:27.383023+0000","last_unstale":"2024-09-12T17:59:59.424752+0000","last_undegraded":"2024-09-12T17:59:59.424752+0000","last_fullsized":"2024-09-12T17:59:59.424752+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"261'37","reported_seq":157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.979731+0000","last_change":"2024-09-12T18:02:23.979731+0000","last_active":"2024-09-12T18:02:23.979731+0000","last_peered":"2024-09-12T18:02:23.979731+0000","last_clean":"2024-09-12T18:02:23.979731+0000","last_became_active":"2024-09-12T17:38:51.209833+0000","last_became_peered":"2024-09-12T17:38:51.209833+0000","last_unstale":"2024-09-12T18:02:23.979731+0000","last_undegraded":"2024-09-12T18:02:23.979731+0000","last_fullsized":"2024-09-12T18:02:23.979731+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'37","last_scrub_stamp":"2024-09-12T18:02:23.979634+0000","last_deep_scrub":"261'37","last_deep_scrub_stamp":"2024-09-12T18:02:23.979634+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.979634+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:50.358860+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":141,"num_write":58,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.021561+0000","last_change":"2024-09-12T18:02:22.021561+0000","last_active":"2024-09-12T18:02:22.021561+0000","last_peered":"2024-09-12T18:02:22.021561+0000","last_clean":"2024-09-12T18:02:22.021561+0000","last_became_active":"2024-09-12T17:50:58.423798+0000","last_became_peered":"2024-09-12T17:50:58.423798+0000","last_unstale":"2024-09-12T18:02:22.021561+0000","last_undegraded":"2024-09-12T18:02:22.021561+0000","last_fullsized":"2024-09-12T18:02:22.021561+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:22.021459+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:22.021459+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.021459+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:55.158982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"258'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.914129+0000","last_change":"2024-09-12T18:02:30.914129+0000","last_active":"2024-09-12T18:02:30.914129+0000","last_peered":"2024-09-12T18:02:30.914129+0000","last_clean":"2024-09-12T18:02:30.914129+0000","last_became_active":"2024-09-12T17:40:30.412140+0000","last_became_peered":"2024-09-12T17:40:30.412140+0000","last_unstale":"2024-09-12T18:02:30.914129+0000","last_undegraded":"2024-09-12T18:02:30.914129+0000","last_fullsized":"2024-09-12T18:02:30.914129+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T18:02:30.914030+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T18:02:30.914030+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.914030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:31.123475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'3","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:50.422280+0000","last_change":"2024-09-12T17:40:27.385866+0000","last_active":"2024-09-12T18:01:50.422280+0000","last_peered":"2024-09-12T18:01:50.422280+0000","last_clean":"2024-09-12T18:01:50.422280+0000","last_became_active":"2024-09-12T17:40:27.385649+0000","last_became_peered":"2024-09-12T17:40:27.385649+0000","last_unstale":"2024-09-12T18:01:50.422280+0000","last_undegraded":"2024-09-12T18:01:50.422280+0000","last_fullsized":"2024-09-12T18:01:50.422280+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"258'14","reported_seq":85,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:44.422160+0000","last_change":"2024-09-12T17:38:51.216015+0000","last_active":"2024-09-12T17:59:44.422160+0000","last_peered":"2024-09-12T17:59:44.422160+0000","last_clean":"2024-09-12T17:59:44.422160+0000","last_became_active":"2024-09-12T17:38:51.215738+0000","last_became_peered":"2024-09-12T17:38:51.215738+0000","last_unstale":"2024-09-12T17:59:44.422160+0000","last_undegraded":"2024-09-12T17:59:44.422160+0000","last_fullsized":"2024-09-12T17:59:44.422160+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:38:49.986477+0000","last_clean_scrub_stamp":"2024-09-12T17:38:49.986477+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:22.857791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:39.549295+0000","last_change":"2024-09-12T17:50:58.423755+0000","last_active":"2024-09-12T17:59:39.549295+0000","last_peered":"2024-09-12T17:59:39.549295+0000","last_clean":"2024-09-12T17:59:39.549295+0000","last_became_active":"2024-09-12T17:50:58.423443+0000","last_became_peered":"2024-09-12T17:50:58.423443+0000","last_unstale":"2024-09-12T17:59:39.549295+0000","last_undegraded":"2024-09-12T17:59:39.549295+0000","last_fullsized":"2024-09-12T17:59:39.549295+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:21.905993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:34.429475+0000","last_change":"2024-09-12T17:40:30.415967+0000","last_active":"2024-09-12T18:00:34.429475+0000","last_peered":"2024-09-12T18:00:34.429475+0000","last_clean":"2024-09-12T18:00:34.429475+0000","last_became_active":"2024-09-12T17:40:30.415696+0000","last_became_peered":"2024-09-12T17:40:30.415696+0000","last_unstale":"2024-09-12T18:00:34.429475+0000","last_undegraded":"2024-09-12T18:00:34.429475+0000","last_fullsized":"2024-09-12T18:00:34.429475+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:14.418738+0000","last_change":"2024-09-12T17:40:27.381415+0000","last_active":"2024-09-12T17:59:14.418738+0000","last_peered":"2024-09-12T17:59:14.418738+0000","last_clean":"2024-09-12T17:59:14.418738+0000","last_became_active":"2024-09-12T17:40:27.381128+0000","last_became_peered":"2024-09-12T17:40:27.381128+0000","last_unstale":"2024-09-12T17:59:14.418738+0000","last_undegraded":"2024-09-12T17:59:14.418738+0000","last_fullsized":"2024-09-12T17:59:14.418738+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:26.355034+0000","last_clean_scrub_stamp":"2024-09-12T17:40:26.355034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:41.708551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"261'15","reported_seq":91,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.028722+0000","last_change":"2024-09-12T18:02:33.028722+0000","last_active":"2024-09-12T18:02:33.028722+0000","last_peered":"2024-09-12T18:02:33.028722+0000","last_clean":"2024-09-12T18:02:33.028722+0000","last_became_active":"2024-09-12T17:38:51.210741+0000","last_became_peered":"2024-09-12T17:38:51.210741+0000","last_unstale":"2024-09-12T18:02:33.028722+0000","last_undegraded":"2024-09-12T18:02:33.028722+0000","last_fullsized":"2024-09-12T18:02:33.028722+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'15","last_scrub_stamp":"2024-09-12T18:02:33.028632+0000","last_deep_scrub":"261'15","last_deep_scrub_stamp":"2024-09-12T18:02:33.028632+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.028632+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:25.853519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":45,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.546366+0000","last_change":"2024-09-12T17:50:58.422536+0000","last_active":"2024-09-12T17:59:19.546366+0000","last_peered":"2024-09-12T17:59:19.546366+0000","last_clean":"2024-09-12T17:59:19.546366+0000","last_became_active":"2024-09-12T17:50:58.422195+0000","last_became_peered":"2024-09-12T17:50:58.422195+0000","last_unstale":"2024-09-12T17:59:19.546366+0000","last_undegraded":"2024-09-12T17:59:19.546366+0000","last_fullsized":"2024-09-12T17:59:19.546366+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:53.708044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.917383+0000","last_change":"2024-09-12T18:02:28.917383+0000","last_active":"2024-09-12T18:02:28.917383+0000","last_peered":"2024-09-12T18:02:28.917383+0000","last_clean":"2024-09-12T18:02:28.917383+0000","last_became_active":"2024-09-12T17:40:30.418692+0000","last_became_peered":"2024-09-12T17:40:30.418692+0000","last_unstale":"2024-09-12T18:02:28.917383+0000","last_undegraded":"2024-09-12T18:02:28.917383+0000","last_fullsized":"2024-09-12T18:02:28.917383+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:28.917289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:28.917289+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.917289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:06.086875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"258'6","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.908948+0000","last_change":"2024-09-12T18:02:26.908948+0000","last_active":"2024-09-12T18:02:26.908948+0000","last_peered":"2024-09-12T18:02:26.908948+0000","last_clean":"2024-09-12T18:02:26.908948+0000","last_became_active":"2024-09-12T17:40:27.376395+0000","last_became_peered":"2024-09-12T17:40:27.376395+0000","last_unstale":"2024-09-12T18:02:26.908948+0000","last_undegraded":"2024-09-12T18:02:26.908948+0000","last_fullsized":"2024-09-12T18:02:26.908948+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'6","last_scrub_stamp":"2024-09-12T18:02:26.908837+0000","last_deep_scrub":"258'6","last_deep_scrub_stamp":"2024-09-12T18:02:26.908837+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.908837+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:49.934905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"261'24","reported_seq":118,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.063627+0000","last_change":"2024-09-12T18:02:22.063627+0000","last_active":"2024-09-12T18:02:22.063627+0000","last_peered":"2024-09-12T18:02:22.063627+0000","last_clean":"2024-09-12T18:02:22.063627+0000","last_became_active":"2024-09-12T17:38:51.212856+0000","last_became_peered":"2024-09-12T17:38:51.212856+0000","last_unstale":"2024-09-12T18:02:22.063627+0000","last_undegraded":"2024-09-12T18:02:22.063627+0000","last_fullsized":"2024-09-12T18:02:22.063627+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'24","last_scrub_stamp":"2024-09-12T18:02:22.063538+0000","last_deep_scrub":"261'24","last_deep_scrub_stamp":"2024-09-12T18:02:22.063538+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.063538+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:33.470326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":83,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:24.420242+0000","last_change":"2024-09-12T17:50:58.431889+0000","last_active":"2024-09-12T17:59:24.420242+0000","last_peered":"2024-09-12T17:59:24.420242+0000","last_clean":"2024-09-12T17:59:24.420242+0000","last_became_active":"2024-09-12T17:50:58.431442+0000","last_became_peered":"2024-09-12T17:50:58.431442+0000","last_unstale":"2024-09-12T17:59:24.420242+0000","last_undegraded":"2024-09-12T17:59:24.420242+0000","last_fullsized":"2024-09-12T17:59:24.420242+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:40.014254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:59:19.419070+0000","last_change":"2024-09-12T17:40:30.418760+0000","last_active":"2024-09-12T17:59:19.419070+0000","last_peered":"2024-09-12T17:59:19.419070+0000","last_clean":"2024-09-12T17:59:19.419070+0000","last_became_active":"2024-09-12T17:40:30.418464+0000","last_became_peered":"2024-09-12T17:40:30.418464+0000","last_unstale":"2024-09-12T17:59:19.419070+0000","last_undegraded":"2024-09-12T17:59:19.419070+0000","last_fullsized":"2024-09-12T17:59:19.419070+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:40:29.380493+0000","last_clean_scrub_stamp":"2024-09-12T17:40:29.380493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:03.345502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"261'5","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.917366+0000","last_change":"2024-09-12T18:02:27.917366+0000","last_active":"2024-09-12T18:02:27.917366+0000","last_peered":"2024-09-12T18:02:27.917366+0000","last_clean":"2024-09-12T18:02:27.917366+0000","last_became_active":"2024-09-12T17:40:27.379133+0000","last_became_peered":"2024-09-12T17:40:27.379133+0000","last_unstale":"2024-09-12T18:02:27.917366+0000","last_undegraded":"2024-09-12T18:02:27.917366+0000","last_fullsized":"2024-09-12T18:02:27.917366+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:02:27.917270+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:02:27.917270+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.917270+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:50.826263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"261'32","reported_seq":138,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.720076+0000","last_change":"2024-09-12T18:02:30.720076+0000","last_active":"2024-09-12T18:02:30.720076+0000","last_peered":"2024-09-12T18:02:30.720076+0000","last_clean":"2024-09-12T18:02:30.720076+0000","last_became_active":"2024-09-12T17:38:51.208386+0000","last_became_peered":"2024-09-12T17:38:51.208386+0000","last_unstale":"2024-09-12T18:02:30.720076+0000","last_undegraded":"2024-09-12T18:02:30.720076+0000","last_fullsized":"2024-09-12T18:02:30.720076+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'32","last_scrub_stamp":"2024-09-12T18:02:30.719990+0000","last_deep_scrub":"261'32","last_deep_scrub_stamp":"2024-09-12T18:02:30.719990+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.719990+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:28.036111+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":109,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"261'348","reported_seq":968,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.683587+0000","last_change":"2024-09-12T18:02:14.683587+0000","last_active":"2024-09-12T18:02:14.683587+0000","last_peered":"2024-09-12T18:02:14.683587+0000","last_clean":"2024-09-12T18:02:14.683587+0000","last_became_active":"2024-09-12T17:23:40.708951+0000","last_became_peered":"2024-09-12T17:23:40.708951+0000","last_unstale":"2024-09-12T18:02:14.683587+0000","last_undegraded":"2024-09-12T18:02:14.683587+0000","last_fullsized":"2024-09-12T18:02:14.683587+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'348","last_scrub_stamp":"2024-09-12T18:02:14.683458+0000","last_deep_scrub":"261'348","last_deep_scrub_stamp":"2024-09-12T18:02:14.683458+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.683458+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:37.385508+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25551,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":469,"num_read_kb":4680,"num_write":1107,"num_write_kb":27229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"261'484","reported_seq":2019,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.256682+0000","last_change":"2024-09-12T18:02:18.256682+0000","last_active":"2024-09-12T18:02:18.256682+0000","last_peered":"2024-09-12T18:02:18.256682+0000","last_clean":"2024-09-12T18:02:18.256682+0000","last_became_active":"2024-09-12T17:23:42.146906+0000","last_became_peered":"2024-09-12T17:23:42.146906+0000","last_unstale":"2024-09-12T18:02:18.256682+0000","last_undegraded":"2024-09-12T18:02:18.256682+0000","last_fullsized":"2024-09-12T18:02:18.256682+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'484","last_scrub_stamp":"2024-09-12T18:02:18.256606+0000","last_deep_scrub":"261'484","last_deep_scrub_stamp":"2024-09-12T18:02:18.256606+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.256606+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:20.735639+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2345,"num_read_kb":2204,"num_write":541,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"261'408","reported_seq":1089,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.042650+0000","last_change":"2024-09-12T18:02:02.042650+0000","last_active":"2024-09-12T18:02:02.042650+0000","last_peered":"2024-09-12T18:02:02.042650+0000","last_clean":"2024-09-12T18:02:02.042650+0000","last_became_active":"2024-09-12T17:23:40.719834+0000","last_became_peered":"2024-09-12T17:23:40.719834+0000","last_unstale":"2024-09-12T18:02:02.042650+0000","last_undegraded":"2024-09-12T18:02:02.042650+0000","last_fullsized":"2024-09-12T18:02:02.042650+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'408","last_scrub_stamp":"2024-09-12T18:02:02.042521+0000","last_deep_scrub":"261'408","last_deep_scrub_stamp":"2024-09-12T18:02:02.042521+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.042521+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:05.142643+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":637,"num_read_kb":15953,"num_write":1206,"num_write_kb":28721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"261'478","reported_seq":2228,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.743852+0000","last_change":"2024-09-12T18:02:12.743852+0000","last_active":"2024-09-12T18:02:12.743852+0000","last_peered":"2024-09-12T18:02:12.743852+0000","last_clean":"2024-09-12T18:02:12.743852+0000","last_became_active":"2024-09-12T17:23:42.147270+0000","last_became_peered":"2024-09-12T17:23:42.147270+0000","last_unstale":"2024-09-12T18:02:12.743852+0000","last_undegraded":"2024-09-12T18:02:12.743852+0000","last_fullsized":"2024-09-12T18:02:12.743852+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'478","last_scrub_stamp":"2024-09-12T18:02:12.743753+0000","last_deep_scrub":"261'478","last_deep_scrub_stamp":"2024-09-12T18:02:12.743753+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.743753+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:19.692853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3009,"num_read_kb":2866,"num_write":558,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"261'351","reported_seq":1157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.764996+0000","last_change":"2024-09-12T18:02:00.764996+0000","last_active":"2024-09-12T18:02:00.764996+0000","last_peered":"2024-09-12T18:02:00.764996+0000","last_clean":"2024-09-12T18:02:00.764996+0000","last_became_active":"2024-09-12T17:23:40.701839+0000","last_became_peered":"2024-09-12T17:23:40.701839+0000","last_unstale":"2024-09-12T18:02:00.764996+0000","last_undegraded":"2024-09-12T18:02:00.764996+0000","last_fullsized":"2024-09-12T18:02:00.764996+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'351","last_scrub_stamp":"2024-09-12T18:02:00.764896+0000","last_deep_scrub":"261'351","last_deep_scrub_stamp":"2024-09-12T18:02:00.764896+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.764896+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:13.922951+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311813,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":845,"num_read_kb":22445,"num_write":993,"num_write_kb":35081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"261'1195","reported_seq":2837,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.220054+0000","last_change":"2024-09-12T18:02:15.220054+0000","last_active":"2024-09-12T18:02:15.220054+0000","last_peered":"2024-09-12T18:02:15.220054+0000","last_clean":"2024-09-12T18:02:15.220054+0000","last_became_active":"2024-09-12T17:23:42.141845+0000","last_became_peered":"2024-09-12T17:23:42.141845+0000","last_unstale":"2024-09-12T18:02:15.220054+0000","last_undegraded":"2024-09-12T18:02:15.220054+0000","last_fullsized":"2024-09-12T18:02:15.220054+0000","mapping_epoch":25,"log_start":"261'1100","ondisk_log_start":"261'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1195","last_scrub_stamp":"2024-09-12T18:02:15.219948+0000","last_deep_scrub":"261'1195","last_deep_scrub_stamp":"2024-09-12T18:02:15.219948+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.219948+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":1100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:58.470773+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5470,"num_read_kb":4840,"num_write":1657,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"261'403","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.267301+0000","last_change":"2024-09-12T18:02:09.267301+0000","last_active":"2024-09-12T18:02:09.267301+0000","last_peered":"2024-09-12T18:02:09.267301+0000","last_clean":"2024-09-12T18:02:09.267301+0000","last_became_active":"2024-09-12T17:23:40.712263+0000","last_became_peered":"2024-09-12T17:23:40.712263+0000","last_unstale":"2024-09-12T18:02:09.267301+0000","last_undegraded":"2024-09-12T18:02:09.267301+0000","last_fullsized":"2024-09-12T18:02:09.267301+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'403","last_scrub_stamp":"2024-09-12T18:02:09.267186+0000","last_deep_scrub":"261'403","last_deep_scrub_stamp":"2024-09-12T18:02:09.267186+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.267186+0000","objects_scrubbed":8,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:55.391563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262228,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":543,"num_read_kb":11573,"num_write":1248,"num_write_kb":26002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"261'1243","reported_seq":2931,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.621430+0000","last_change":"2024-09-12T18:02:11.621430+0000","last_active":"2024-09-12T18:02:11.621430+0000","last_peered":"2024-09-12T18:02:11.621430+0000","last_clean":"2024-09-12T18:02:11.621430+0000","last_became_active":"2024-09-12T17:23:42.157835+0000","last_became_peered":"2024-09-12T17:23:42.157835+0000","last_unstale":"2024-09-12T18:02:11.621430+0000","last_undegraded":"2024-09-12T18:02:11.621430+0000","last_fullsized":"2024-09-12T18:02:11.621430+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1243","last_scrub_stamp":"2024-09-12T18:02:11.621334+0000","last_deep_scrub":"261'1243","last_deep_scrub_stamp":"2024-09-12T18:02:11.621334+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.621334+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:43.082819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5656,"num_read_kb":5021,"num_write":1694,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":960,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"261'354","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.716953+0000","last_change":"2024-09-12T18:02:09.716953+0000","last_active":"2024-09-12T18:02:09.716953+0000","last_peered":"2024-09-12T18:02:09.716953+0000","last_clean":"2024-09-12T18:02:09.716953+0000","last_became_active":"2024-09-12T17:23:40.705906+0000","last_became_peered":"2024-09-12T17:23:40.705906+0000","last_unstale":"2024-09-12T18:02:09.716953+0000","last_undegraded":"2024-09-12T18:02:09.716953+0000","last_fullsized":"2024-09-12T18:02:09.716953+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-12T18:02:09.716851+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-12T18:02:09.716851+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.716851+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:14.429035+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":673,"num_read_kb":37545,"num_write":1095,"num_write_kb":42867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"261'385","reported_seq":1833,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.133940+0000","last_change":"2024-09-12T18:02:07.133940+0000","last_active":"2024-09-12T18:02:07.133940+0000","last_peered":"2024-09-12T18:02:07.133940+0000","last_clean":"2024-09-12T18:02:07.133940+0000","last_became_active":"2024-09-12T17:23:42.142311+0000","last_became_peered":"2024-09-12T17:23:42.142311+0000","last_unstale":"2024-09-12T18:02:07.133940+0000","last_undegraded":"2024-09-12T18:02:07.133940+0000","last_fullsized":"2024-09-12T18:02:07.133940+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'385","last_scrub_stamp":"2024-09-12T18:02:07.133832+0000","last_deep_scrub":"261'385","last_deep_scrub_stamp":"2024-09-12T18:02:07.133832+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.133832+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:19.123354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2045,"num_read_kb":1945,"num_write":422,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"261'388","reported_seq":1088,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.238542+0000","last_change":"2024-09-12T18:02:08.238542+0000","last_active":"2024-09-12T18:02:08.238542+0000","last_peered":"2024-09-12T18:02:08.238542+0000","last_clean":"2024-09-12T18:02:08.238542+0000","last_became_active":"2024-09-12T17:23:40.705215+0000","last_became_peered":"2024-09-12T17:23:40.705215+0000","last_unstale":"2024-09-12T18:02:08.238542+0000","last_undegraded":"2024-09-12T18:02:08.238542+0000","last_fullsized":"2024-09-12T18:02:08.238542+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'388","last_scrub_stamp":"2024-09-12T18:02:08.238416+0000","last_deep_scrub":"261'388","last_deep_scrub_stamp":"2024-09-12T18:02:08.238416+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.238416+0000","objects_scrubbed":9,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:20.183404+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253978,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":760,"num_read_kb":26786,"num_write":1280,"num_write_kb":30822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"261'884","reported_seq":2686,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.226415+0000","last_change":"2024-09-12T18:02:18.226415+0000","last_active":"2024-09-12T18:02:18.226415+0000","last_peered":"2024-09-12T18:02:18.226415+0000","last_clean":"2024-09-12T18:02:18.226415+0000","last_became_active":"2024-09-12T17:23:42.143402+0000","last_became_peered":"2024-09-12T17:23:42.143402+0000","last_unstale":"2024-09-12T18:02:18.226415+0000","last_undegraded":"2024-09-12T18:02:18.226415+0000","last_fullsized":"2024-09-12T18:02:18.226415+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'884","last_scrub_stamp":"2024-09-12T18:02:18.226319+0000","last_deep_scrub":"261'884","last_deep_scrub_stamp":"2024-09-12T18:02:18.226319+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.226319+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":800,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:00.126404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4455,"num_read_kb":4051,"num_write":1149,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"261'328","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.738544+0000","last_change":"2024-09-12T18:02:08.738544+0000","last_active":"2024-09-12T18:02:08.738544+0000","last_peered":"2024-09-12T18:02:08.738544+0000","last_clean":"2024-09-12T18:02:08.738544+0000","last_became_active":"2024-09-12T17:23:40.713883+0000","last_became_peered":"2024-09-12T17:23:40.713883+0000","last_unstale":"2024-09-12T18:02:08.738544+0000","last_undegraded":"2024-09-12T18:02:08.738544+0000","last_fullsized":"2024-09-12T18:02:08.738544+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'328","last_scrub_stamp":"2024-09-12T18:02:08.738443+0000","last_deep_scrub":"261'328","last_deep_scrub_stamp":"2024-09-12T18:02:08.738443+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.738443+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:35.473029+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":466,"num_read_kb":1994,"num_write":1104,"num_write_kb":56686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"261'918","reported_seq":2629,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.248516+0000","last_change":"2024-09-12T18:02:16.248516+0000","last_active":"2024-09-12T18:02:16.248516+0000","last_peered":"2024-09-12T18:02:16.248516+0000","last_clean":"2024-09-12T18:02:16.248516+0000","last_became_active":"2024-09-12T17:23:42.152030+0000","last_became_peered":"2024-09-12T17:23:42.152030+0000","last_unstale":"2024-09-12T18:02:16.248516+0000","last_undegraded":"2024-09-12T18:02:16.248516+0000","last_fullsized":"2024-09-12T18:02:16.248516+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'918","last_scrub_stamp":"2024-09-12T18:02:16.248418+0000","last_deep_scrub":"261'918","last_deep_scrub_stamp":"2024-09-12T18:02:16.248418+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.248418+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:33.323420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4677,"num_read_kb":4199,"num_write":1240,"num_write_kb":482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3560,"num_omap_keys":14,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"261'319","reported_seq":1003,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.254612+0000","last_change":"2024-09-12T18:02:04.254612+0000","last_active":"2024-09-12T18:02:04.254612+0000","last_peered":"2024-09-12T18:02:04.254612+0000","last_clean":"2024-09-12T18:02:04.254612+0000","last_became_active":"2024-09-12T17:23:40.717097+0000","last_became_peered":"2024-09-12T17:23:40.717097+0000","last_unstale":"2024-09-12T18:02:04.254612+0000","last_undegraded":"2024-09-12T18:02:04.254612+0000","last_fullsized":"2024-09-12T18:02:04.254612+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'319","last_scrub_stamp":"2024-09-12T18:02:04.254489+0000","last_deep_scrub":"261'319","last_deep_scrub_stamp":"2024-09-12T18:02:04.254489+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.254489+0000","objects_scrubbed":11,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:54.537782+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655891,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":586,"num_read_kb":3212,"num_write":1067,"num_write_kb":17046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"261'393","reported_seq":1873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.028847+0000","last_change":"2024-09-12T18:02:04.028847+0000","last_active":"2024-09-12T18:02:04.028847+0000","last_peered":"2024-09-12T18:02:04.028847+0000","last_clean":"2024-09-12T18:02:04.028847+0000","last_became_active":"2024-09-12T17:24:17.226840+0000","last_became_peered":"2024-09-12T17:24:17.226840+0000","last_unstale":"2024-09-12T18:02:04.028847+0000","last_undegraded":"2024-09-12T18:02:04.028847+0000","last_fullsized":"2024-09-12T18:02:04.028847+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'393","last_scrub_stamp":"2024-09-12T18:02:04.028758+0000","last_deep_scrub":"261'393","last_deep_scrub_stamp":"2024-09-12T18:02:04.028758+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.028758+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:31.967642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2081,"num_read_kb":1979,"num_write":442,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"261'752","reported_seq":2074,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.188709+0000","last_change":"2024-09-12T18:02:14.188709+0000","last_active":"2024-09-12T18:02:14.188709+0000","last_peered":"2024-09-12T18:02:14.188709+0000","last_clean":"2024-09-12T18:02:14.188709+0000","last_became_active":"2024-09-12T17:23:42.152513+0000","last_became_peered":"2024-09-12T17:23:42.152513+0000","last_unstale":"2024-09-12T18:02:14.188709+0000","last_undegraded":"2024-09-12T18:02:14.188709+0000","last_fullsized":"2024-09-12T18:02:14.188709+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'752","last_scrub_stamp":"2024-09-12T18:02:14.188596+0000","last_deep_scrub":"261'752","last_deep_scrub_stamp":"2024-09-12T18:02:14.188596+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.188596+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:55.988212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3383,"num_read_kb":3022,"num_write":991,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"261'313","reported_seq":939,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.746278+0000","last_change":"2024-09-12T18:02:07.746218+0000","last_active":"2024-09-12T18:02:07.746278+0000","last_peered":"2024-09-12T18:02:07.746278+0000","last_clean":"2024-09-12T18:02:07.746278+0000","last_became_active":"2024-09-12T17:23:40.712747+0000","last_became_peered":"2024-09-12T17:23:40.712747+0000","last_unstale":"2024-09-12T18:02:07.746278+0000","last_undegraded":"2024-09-12T18:02:07.746278+0000","last_fullsized":"2024-09-12T18:02:07.746278+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'313","last_scrub_stamp":"2024-09-12T18:02:07.746109+0000","last_deep_scrub":"261'313","last_deep_scrub_stamp":"2024-09-12T18:02:07.746109+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.746109+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:03.900469+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":452,"num_read_kb":32150,"num_write":963,"num_write_kb":37186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"261'506","reported_seq":2017,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.701997+0000","last_change":"2024-09-12T18:02:11.701997+0000","last_active":"2024-09-12T18:02:11.701997+0000","last_peered":"2024-09-12T18:02:11.701997+0000","last_clean":"2024-09-12T18:02:11.701997+0000","last_became_active":"2024-09-12T17:23:42.148091+0000","last_became_peered":"2024-09-12T17:23:42.148091+0000","last_unstale":"2024-09-12T18:02:11.701997+0000","last_undegraded":"2024-09-12T18:02:11.701997+0000","last_fullsized":"2024-09-12T18:02:11.701997+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'506","last_scrub_stamp":"2024-09-12T18:02:11.701886+0000","last_deep_scrub":"261'506","last_deep_scrub_stamp":"2024-09-12T18:02:11.701886+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.701886+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:22.240495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2605,"num_read_kb":2400,"num_write":650,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"261'353","reported_seq":1049,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.106568+0000","last_change":"2024-09-12T18:02:03.106506+0000","last_active":"2024-09-12T18:02:03.106568+0000","last_peered":"2024-09-12T18:02:03.106568+0000","last_clean":"2024-09-12T18:02:03.106568+0000","last_became_active":"2024-09-12T17:23:40.708089+0000","last_became_peered":"2024-09-12T17:23:40.708089+0000","last_unstale":"2024-09-12T18:02:03.106568+0000","last_undegraded":"2024-09-12T18:02:03.106568+0000","last_fullsized":"2024-09-12T18:02:03.106568+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'353","last_scrub_stamp":"2024-09-12T18:02:03.106382+0000","last_deep_scrub":"261'353","last_deep_scrub_stamp":"2024-09-12T18:02:03.106382+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.106382+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:42.275338+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":647,"num_read_kb":14175,"num_write":1176,"num_write_kb":46213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"261'912","reported_seq":2505,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.237194+0000","last_change":"2024-09-12T18:02:14.237194+0000","last_active":"2024-09-12T18:02:14.237194+0000","last_peered":"2024-09-12T18:02:14.237194+0000","last_clean":"2024-09-12T18:02:14.237194+0000","last_became_active":"2024-09-12T17:23:42.145860+0000","last_became_peered":"2024-09-12T17:23:42.145860+0000","last_unstale":"2024-09-12T18:02:14.237194+0000","last_undegraded":"2024-09-12T18:02:14.237194+0000","last_fullsized":"2024-09-12T18:02:14.237194+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'912","last_scrub_stamp":"2024-09-12T18:02:14.237107+0000","last_deep_scrub":"261'912","last_deep_scrub_stamp":"2024-09-12T18:02:14.237107+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.237107+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":900,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:39.982382+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4352,"num_read_kb":3896,"num_write":1238,"num_write_kb":509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"261'349","reported_seq":1091,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.094349+0000","last_change":"2024-09-12T18:02:02.094282+0000","last_active":"2024-09-12T18:02:02.094349+0000","last_peered":"2024-09-12T18:02:02.094349+0000","last_clean":"2024-09-12T18:02:02.094349+0000","last_became_active":"2024-09-12T17:24:17.232979+0000","last_became_peered":"2024-09-12T17:24:17.232979+0000","last_unstale":"2024-09-12T18:02:02.094349+0000","last_undegraded":"2024-09-12T18:02:02.094349+0000","last_fullsized":"2024-09-12T18:02:02.094349+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T18:02:02.094149+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T18:02:02.094149+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.094149+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:51.671674+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":809,"num_read_kb":6334,"num_write":1258,"num_write_kb":23763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"261'428","reported_seq":1999,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.031902+0000","last_change":"2024-09-12T18:02:02.031835+0000","last_active":"2024-09-12T18:02:02.031902+0000","last_peered":"2024-09-12T18:02:02.031902+0000","last_clean":"2024-09-12T18:02:02.031902+0000","last_became_active":"2024-09-12T17:23:42.148023+0000","last_became_peered":"2024-09-12T17:23:42.148023+0000","last_unstale":"2024-09-12T18:02:02.031902+0000","last_undegraded":"2024-09-12T18:02:02.031902+0000","last_fullsized":"2024-09-12T18:02:02.031902+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'428","last_scrub_stamp":"2024-09-12T18:02:02.031748+0000","last_deep_scrub":"261'428","last_deep_scrub_stamp":"2024-09-12T18:02:02.031748+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.031748+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:37.883390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2276,"num_read_kb":2173,"num_write":473,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"261'353","reported_seq":977,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.085784+0000","last_change":"2024-09-12T18:02:00.085723+0000","last_active":"2024-09-12T18:02:00.085784+0000","last_peered":"2024-09-12T18:02:00.085784+0000","last_clean":"2024-09-12T18:02:00.085784+0000","last_became_active":"2024-09-12T17:23:40.714604+0000","last_became_peered":"2024-09-12T17:23:40.714604+0000","last_unstale":"2024-09-12T18:02:00.085784+0000","last_undegraded":"2024-09-12T18:02:00.085784+0000","last_fullsized":"2024-09-12T18:02:00.085784+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'353","last_scrub_stamp":"2024-09-12T18:02:00.085618+0000","last_deep_scrub":"261'353","last_deep_scrub_stamp":"2024-09-12T18:02:00.085618+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.085618+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:44.532607+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":7319,"num_write":1124,"num_write_kb":22062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"261'421","reported_seq":1942,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.017442+0000","last_change":"2024-09-12T18:02:03.017362+0000","last_active":"2024-09-12T18:02:03.017442+0000","last_peered":"2024-09-12T18:02:03.017442+0000","last_clean":"2024-09-12T18:02:03.017442+0000","last_became_active":"2024-09-12T17:23:42.141237+0000","last_became_peered":"2024-09-12T17:23:42.141237+0000","last_unstale":"2024-09-12T18:02:03.017442+0000","last_undegraded":"2024-09-12T18:02:03.017442+0000","last_fullsized":"2024-09-12T18:02:03.017442+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'421","last_scrub_stamp":"2024-09-12T18:02:03.017268+0000","last_deep_scrub":"261'421","last_deep_scrub_stamp":"2024-09-12T18:02:03.017268+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.017268+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:06.467480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2248,"num_read_kb":2133,"num_write":484,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"261'334","reported_seq":959,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.234784+0000","last_change":"2024-09-12T18:02:03.234682+0000","last_active":"2024-09-12T18:02:03.234784+0000","last_peered":"2024-09-12T18:02:03.234784+0000","last_clean":"2024-09-12T18:02:03.234784+0000","last_became_active":"2024-09-12T17:23:40.704825+0000","last_became_peered":"2024-09-12T17:23:40.704825+0000","last_unstale":"2024-09-12T18:02:03.234784+0000","last_undegraded":"2024-09-12T18:02:03.234784+0000","last_fullsized":"2024-09-12T18:02:03.234784+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'334","last_scrub_stamp":"2024-09-12T18:02:03.234556+0000","last_deep_scrub":"261'334","last_deep_scrub_stamp":"2024-09-12T18:02:03.234556+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.234556+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:14.374566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":456,"num_read_kb":2074,"num_write":1044,"num_write_kb":16303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"261'381","reported_seq":1879,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.160859+0000","last_change":"2024-09-12T18:02:13.160794+0000","last_active":"2024-09-12T18:02:13.160859+0000","last_peered":"2024-09-12T18:02:13.160859+0000","last_clean":"2024-09-12T18:02:13.160859+0000","last_became_active":"2024-09-12T17:23:42.137455+0000","last_became_peered":"2024-09-12T17:23:42.137455+0000","last_unstale":"2024-09-12T18:02:13.160859+0000","last_undegraded":"2024-09-12T18:02:13.160859+0000","last_fullsized":"2024-09-12T18:02:13.160859+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'381","last_scrub_stamp":"2024-09-12T18:02:13.160695+0000","last_deep_scrub":"261'381","last_deep_scrub_stamp":"2024-09-12T18:02:13.160695+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.160695+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:54.943636+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2042,"num_read_kb":1965,"num_write":435,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"261'367","reported_seq":1018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.735389+0000","last_change":"2024-09-12T18:01:59.735389+0000","last_active":"2024-09-12T18:01:59.735389+0000","last_peered":"2024-09-12T18:01:59.735389+0000","last_clean":"2024-09-12T18:01:59.735389+0000","last_became_active":"2024-09-12T17:23:40.711201+0000","last_became_peered":"2024-09-12T17:23:40.711201+0000","last_unstale":"2024-09-12T18:01:59.735389+0000","last_undegraded":"2024-09-12T18:01:59.735389+0000","last_fullsized":"2024-09-12T18:01:59.735389+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'367","last_scrub_stamp":"2024-09-12T18:01:59.735272+0000","last_deep_scrub":"261'367","last_deep_scrub_stamp":"2024-09-12T18:01:59.735272+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.735272+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:34.384056+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2561815,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":549,"num_read_kb":25516,"num_write":1199,"num_write_kb":38939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"261'154","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.059026+0000","last_change":"2024-09-12T18:02:31.059026+0000","last_active":"2024-09-12T18:02:31.059026+0000","last_peered":"2024-09-12T18:02:31.059026+0000","last_clean":"2024-09-12T18:02:31.059026+0000","last_became_active":"2024-09-12T17:23:50.184149+0000","last_became_peered":"2024-09-12T17:23:50.184149+0000","last_unstale":"2024-09-12T18:02:31.059026+0000","last_undegraded":"2024-09-12T18:02:31.059026+0000","last_fullsized":"2024-09-12T18:02:31.059026+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'154","last_scrub_stamp":"2024-09-12T18:02:31.058932+0000","last_deep_scrub":"261'154","last_deep_scrub_stamp":"2024-09-12T18:02:31.058932+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.058932+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:01.071144+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":269,"num_read_kb":251,"num_write":373,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"261'433","reported_seq":2045,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.276276+0000","last_change":"2024-09-12T18:02:08.276276+0000","last_active":"2024-09-12T18:02:08.276276+0000","last_peered":"2024-09-12T18:02:08.276276+0000","last_clean":"2024-09-12T18:02:08.276276+0000","last_became_active":"2024-09-12T17:23:42.153262+0000","last_became_peered":"2024-09-12T17:23:42.153262+0000","last_unstale":"2024-09-12T18:02:08.276276+0000","last_undegraded":"2024-09-12T18:02:08.276276+0000","last_fullsized":"2024-09-12T18:02:08.276276+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'433","last_scrub_stamp":"2024-09-12T18:02:08.276184+0000","last_deep_scrub":"261'433","last_deep_scrub_stamp":"2024-09-12T18:02:08.276184+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.276184+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:25.968608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2462,"num_read_kb":2350,"num_write":478,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"261'337","reported_seq":967,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.703031+0000","last_change":"2024-09-12T18:02:04.703031+0000","last_active":"2024-09-12T18:02:04.703031+0000","last_peered":"2024-09-12T18:02:04.703031+0000","last_clean":"2024-09-12T18:02:04.703031+0000","last_became_active":"2024-09-12T17:23:40.709513+0000","last_became_peered":"2024-09-12T17:23:40.709513+0000","last_unstale":"2024-09-12T18:02:04.703031+0000","last_undegraded":"2024-09-12T18:02:04.703031+0000","last_fullsized":"2024-09-12T18:02:04.703031+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'337","last_scrub_stamp":"2024-09-12T18:02:04.702947+0000","last_deep_scrub":"261'337","last_deep_scrub_stamp":"2024-09-12T18:02:04.702947+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.702947+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:03.175885+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":481,"num_read_kb":53800,"num_write":1092,"num_write_kb":42009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.185313+0000","last_change":"2024-09-12T18:02:20.185257+0000","last_active":"2024-09-12T18:02:20.185313+0000","last_peered":"2024-09-12T18:02:20.185313+0000","last_clean":"2024-09-12T18:02:20.185313+0000","last_became_active":"2024-09-12T17:23:44.150860+0000","last_became_peered":"2024-09-12T17:23:44.150860+0000","last_unstale":"2024-09-12T18:02:20.185313+0000","last_undegraded":"2024-09-12T18:02:20.185313+0000","last_fullsized":"2024-09-12T18:02:20.185313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:20.185172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:20.185172+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.185172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:12.927147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"261'341","reported_seq":935,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.590262+0000","last_change":"2024-09-12T18:02:18.590169+0000","last_active":"2024-09-12T18:02:18.590262+0000","last_peered":"2024-09-12T18:02:18.590262+0000","last_clean":"2024-09-12T18:02:18.590262+0000","last_became_active":"2024-09-12T17:23:46.152874+0000","last_became_peered":"2024-09-12T17:23:46.152874+0000","last_unstale":"2024-09-12T18:02:18.590262+0000","last_undegraded":"2024-09-12T18:02:18.590262+0000","last_fullsized":"2024-09-12T18:02:18.590262+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'341","last_scrub_stamp":"2024-09-12T18:02:18.590040+0000","last_deep_scrub":"261'341","last_deep_scrub_stamp":"2024-09-12T18:02:18.590040+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.590040+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:14.837701+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49853,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":1208,"num_write":446,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.690548+0000","last_change":"2024-09-12T18:02:28.690484+0000","last_active":"2024-09-12T18:02:28.690548+0000","last_peered":"2024-09-12T18:02:28.690548+0000","last_clean":"2024-09-12T18:02:28.690548+0000","last_became_active":"2024-09-12T17:23:48.168052+0000","last_became_peered":"2024-09-12T17:23:48.168052+0000","last_unstale":"2024-09-12T18:02:28.690548+0000","last_undegraded":"2024-09-12T18:02:28.690548+0000","last_fullsized":"2024-09-12T18:02:28.690548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:28.690399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:28.690399+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.690399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:50.891973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"261'177","reported_seq":741,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.140625+0000","last_change":"2024-09-12T18:02:33.140566+0000","last_active":"2024-09-12T18:02:33.140625+0000","last_peered":"2024-09-12T18:02:33.140625+0000","last_clean":"2024-09-12T18:02:33.140625+0000","last_became_active":"2024-09-12T17:23:50.188506+0000","last_became_peered":"2024-09-12T17:23:50.188506+0000","last_unstale":"2024-09-12T18:02:33.140625+0000","last_undegraded":"2024-09-12T18:02:33.140625+0000","last_fullsized":"2024-09-12T18:02:33.140625+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'177","last_scrub_stamp":"2024-09-12T18:02:33.140475+0000","last_deep_scrub":"261'177","last_deep_scrub_stamp":"2024-09-12T18:02:33.140475+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.140475+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:01.265620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":316,"num_read_kb":300,"num_write":383,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"261'581","reported_seq":2136,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.271107+0000","last_change":"2024-09-12T18:02:11.271006+0000","last_active":"2024-09-12T18:02:11.271107+0000","last_peered":"2024-09-12T18:02:11.271107+0000","last_clean":"2024-09-12T18:02:11.271107+0000","last_became_active":"2024-09-12T17:23:42.143794+0000","last_became_peered":"2024-09-12T17:23:42.143794+0000","last_unstale":"2024-09-12T18:02:11.271107+0000","last_undegraded":"2024-09-12T18:02:11.271107+0000","last_fullsized":"2024-09-12T18:02:11.271107+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'581","last_scrub_stamp":"2024-09-12T18:02:11.270879+0000","last_deep_scrub":"261'581","last_deep_scrub_stamp":"2024-09-12T18:02:11.270879+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.270879+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:08.118727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3146,"num_read_kb":2882,"num_write":787,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1514,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"261'432","reported_seq":1078,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.940842+0000","last_change":"2024-09-12T18:01:57.940842+0000","last_active":"2024-09-12T18:01:57.940842+0000","last_peered":"2024-09-12T18:01:57.940842+0000","last_clean":"2024-09-12T18:01:57.940842+0000","last_became_active":"2024-09-12T17:24:17.287987+0000","last_became_peered":"2024-09-12T17:24:17.287987+0000","last_unstale":"2024-09-12T18:01:57.940842+0000","last_undegraded":"2024-09-12T18:01:57.940842+0000","last_fullsized":"2024-09-12T18:01:57.940842+0000","mapping_epoch":36,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'432","last_scrub_stamp":"2024-09-12T18:01:57.940767+0000","last_deep_scrub":"261'432","last_deep_scrub_stamp":"2024-09-12T18:01:57.940767+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.940767+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:05.500595+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174825,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":630,"num_read_kb":42370,"num_write":1204,"num_write_kb":32675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.285158+0000","last_change":"2024-09-12T18:02:16.285158+0000","last_active":"2024-09-12T18:02:16.285158+0000","last_peered":"2024-09-12T18:02:16.285158+0000","last_clean":"2024-09-12T18:02:16.285158+0000","last_became_active":"2024-09-12T17:23:44.149079+0000","last_became_peered":"2024-09-12T17:23:44.149079+0000","last_unstale":"2024-09-12T18:02:16.285158+0000","last_undegraded":"2024-09-12T18:02:16.285158+0000","last_fullsized":"2024-09-12T18:02:16.285158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:16.285066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:16.285066+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.285066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:05.713328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"261'81","reported_seq":603,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.236795+0000","last_change":"2024-09-12T18:02:21.236737+0000","last_active":"2024-09-12T18:02:21.236795+0000","last_peered":"2024-09-12T18:02:21.236795+0000","last_clean":"2024-09-12T18:02:21.236795+0000","last_became_active":"2024-09-12T17:23:46.150447+0000","last_became_peered":"2024-09-12T17:23:46.150447+0000","last_unstale":"2024-09-12T18:02:21.236795+0000","last_undegraded":"2024-09-12T18:02:21.236795+0000","last_fullsized":"2024-09-12T18:02:21.236795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'81","last_scrub_stamp":"2024-09-12T18:02:21.236652+0000","last_deep_scrub":"261'81","last_deep_scrub_stamp":"2024-09-12T18:02:21.236652+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.236652+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:38.664086+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":77,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.016420+0000","last_change":"2024-09-12T18:02:29.016340+0000","last_active":"2024-09-12T18:02:29.016420+0000","last_peered":"2024-09-12T18:02:29.016420+0000","last_clean":"2024-09-12T18:02:29.016420+0000","last_became_active":"2024-09-12T17:23:48.165965+0000","last_became_peered":"2024-09-12T17:23:48.165965+0000","last_unstale":"2024-09-12T18:02:29.016420+0000","last_undegraded":"2024-09-12T18:02:29.016420+0000","last_fullsized":"2024-09-12T18:02:29.016420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:29.016243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:29.016243+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.016243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:06.472207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"261'118","reported_seq":622,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.632077+0000","last_change":"2024-09-12T18:02:29.632077+0000","last_active":"2024-09-12T18:02:29.632077+0000","last_peered":"2024-09-12T18:02:29.632077+0000","last_clean":"2024-09-12T18:02:29.632077+0000","last_became_active":"2024-09-12T17:23:50.188143+0000","last_became_peered":"2024-09-12T17:23:50.188143+0000","last_unstale":"2024-09-12T18:02:29.632077+0000","last_undegraded":"2024-09-12T18:02:29.632077+0000","last_fullsized":"2024-09-12T18:02:29.632077+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'118","last_scrub_stamp":"2024-09-12T18:02:29.631986+0000","last_deep_scrub":"261'118","last_deep_scrub_stamp":"2024-09-12T18:02:29.631986+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.631986+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:49.267339+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":180,"num_write":267,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"261'433","reported_seq":2059,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.638005+0000","last_change":"2024-09-12T18:02:06.637886+0000","last_active":"2024-09-12T18:02:06.638005+0000","last_peered":"2024-09-12T18:02:06.638005+0000","last_clean":"2024-09-12T18:02:06.638005+0000","last_became_active":"2024-09-12T17:23:42.155137+0000","last_became_peered":"2024-09-12T17:23:42.155137+0000","last_unstale":"2024-09-12T18:02:06.638005+0000","last_undegraded":"2024-09-12T18:02:06.638005+0000","last_fullsized":"2024-09-12T18:02:06.638005+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'433","last_scrub_stamp":"2024-09-12T18:02:06.637778+0000","last_deep_scrub":"261'433","last_deep_scrub_stamp":"2024-09-12T18:02:06.637778+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.637778+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:48.440676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2401,"num_read_kb":2311,"num_write":475,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1514,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"261'493","reported_seq":1150,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.668021+0000","last_change":"2024-09-12T18:02:02.668021+0000","last_active":"2024-09-12T18:02:02.668021+0000","last_peered":"2024-09-12T18:02:02.668021+0000","last_clean":"2024-09-12T18:02:02.668021+0000","last_became_active":"2024-09-12T17:23:40.707549+0000","last_became_peered":"2024-09-12T17:23:40.707549+0000","last_unstale":"2024-09-12T18:02:02.668021+0000","last_undegraded":"2024-09-12T18:02:02.668021+0000","last_fullsized":"2024-09-12T18:02:02.668021+0000","mapping_epoch":23,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'493","last_scrub_stamp":"2024-09-12T18:02:02.667893+0000","last_deep_scrub":"261'493","last_deep_scrub_stamp":"2024-09-12T18:02:02.667893+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.667893+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:16.321949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":822,"num_read_kb":5813,"num_write":1382,"num_write_kb":24859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.266935+0000","last_change":"2024-09-12T18:02:17.266866+0000","last_active":"2024-09-12T18:02:17.266935+0000","last_peered":"2024-09-12T18:02:17.266935+0000","last_clean":"2024-09-12T18:02:17.266935+0000","last_became_active":"2024-09-12T17:23:44.150973+0000","last_became_peered":"2024-09-12T17:23:44.150973+0000","last_unstale":"2024-09-12T18:02:17.266935+0000","last_undegraded":"2024-09-12T18:02:17.266935+0000","last_fullsized":"2024-09-12T18:02:17.266935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:17.266776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:17.266776+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.266776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:00.212068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"261'100","reported_seq":628,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.959168+0000","last_change":"2024-09-12T18:02:12.959168+0000","last_active":"2024-09-12T18:02:12.959168+0000","last_peered":"2024-09-12T18:02:12.959168+0000","last_clean":"2024-09-12T18:02:12.959168+0000","last_became_active":"2024-09-12T17:23:46.153864+0000","last_became_peered":"2024-09-12T17:23:46.153864+0000","last_unstale":"2024-09-12T18:02:12.959168+0000","last_undegraded":"2024-09-12T18:02:12.959168+0000","last_fullsized":"2024-09-12T18:02:12.959168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'100","last_scrub_stamp":"2024-09-12T18:02:12.959072+0000","last_deep_scrub":"261'100","last_deep_scrub_stamp":"2024-09-12T18:02:12.959072+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.959072+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:33.074044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"261'765","reported_seq":2165,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.701740+0000","last_change":"2024-09-12T18:02:27.701665+0000","last_active":"2024-09-12T18:02:27.701740+0000","last_peered":"2024-09-12T18:02:27.701740+0000","last_clean":"2024-09-12T18:02:27.701740+0000","last_became_active":"2024-09-12T17:23:48.173454+0000","last_became_peered":"2024-09-12T17:23:48.173454+0000","last_unstale":"2024-09-12T18:02:27.701740+0000","last_undegraded":"2024-09-12T18:02:27.701740+0000","last_fullsized":"2024-09-12T18:02:27.701740+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'765","last_scrub_stamp":"2024-09-12T18:02:27.701583+0000","last_deep_scrub":"261'765","last_deep_scrub_stamp":"2024-09-12T18:02:27.701583+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.701583+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:16.305885+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"261'217","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.058144+0000","last_change":"2024-09-12T18:02:32.058144+0000","last_active":"2024-09-12T18:02:32.058144+0000","last_peered":"2024-09-12T18:02:32.058144+0000","last_clean":"2024-09-12T18:02:32.058144+0000","last_became_active":"2024-09-12T17:23:50.640401+0000","last_became_peered":"2024-09-12T17:23:50.640401+0000","last_unstale":"2024-09-12T18:02:32.058144+0000","last_undegraded":"2024-09-12T18:02:32.058144+0000","last_fullsized":"2024-09-12T18:02:32.058144+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'217","last_scrub_stamp":"2024-09-12T18:02:32.058040+0000","last_deep_scrub":"261'217","last_deep_scrub_stamp":"2024-09-12T18:02:32.058040+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.058040+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:19.450219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":682,"num_read_kb":671,"num_write":489,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"261'900","reported_seq":2450,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.245836+0000","last_change":"2024-09-12T18:02:09.245763+0000","last_active":"2024-09-12T18:02:09.245836+0000","last_peered":"2024-09-12T18:02:09.245836+0000","last_clean":"2024-09-12T18:02:09.245836+0000","last_became_active":"2024-09-12T17:23:42.147597+0000","last_became_peered":"2024-09-12T17:23:42.147597+0000","last_unstale":"2024-09-12T18:02:09.245836+0000","last_undegraded":"2024-09-12T18:02:09.245836+0000","last_fullsized":"2024-09-12T18:02:09.245836+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'900","last_scrub_stamp":"2024-09-12T18:02:09.245668+0000","last_deep_scrub":"261'900","last_deep_scrub_stamp":"2024-09-12T18:02:09.245668+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.245668+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:31.980911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4183,"num_read_kb":3727,"num_write":1220,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"261'367","reported_seq":1052,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.070259+0000","last_change":"2024-09-12T18:02:00.070259+0000","last_active":"2024-09-12T18:02:00.070259+0000","last_peered":"2024-09-12T18:02:00.070259+0000","last_clean":"2024-09-12T18:02:00.070259+0000","last_became_active":"2024-09-12T17:23:40.718582+0000","last_became_peered":"2024-09-12T17:23:40.718582+0000","last_unstale":"2024-09-12T18:02:00.070259+0000","last_undegraded":"2024-09-12T18:02:00.070259+0000","last_fullsized":"2024-09-12T18:02:00.070259+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'367","last_scrub_stamp":"2024-09-12T18:02:00.070123+0000","last_deep_scrub":"261'367","last_deep_scrub_stamp":"2024-09-12T18:02:00.070123+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.070123+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:55.441884+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":588,"num_read_kb":83250,"num_write":1103,"num_write_kb":35659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.197737+0000","last_change":"2024-09-12T18:02:21.197644+0000","last_active":"2024-09-12T18:02:21.197737+0000","last_peered":"2024-09-12T18:02:21.197737+0000","last_clean":"2024-09-12T18:02:21.197737+0000","last_became_active":"2024-09-12T17:23:44.151918+0000","last_became_peered":"2024-09-12T17:23:44.151918+0000","last_unstale":"2024-09-12T18:02:21.197737+0000","last_undegraded":"2024-09-12T18:02:21.197737+0000","last_fullsized":"2024-09-12T18:02:21.197737+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:21.197551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:21.197551+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.197551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:36.589194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"261'270","reported_seq":830,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.771840+0000","last_change":"2024-09-12T18:02:23.771736+0000","last_active":"2024-09-12T18:02:23.771840+0000","last_peered":"2024-09-12T18:02:23.771840+0000","last_clean":"2024-09-12T18:02:23.771840+0000","last_became_active":"2024-09-12T17:23:46.241137+0000","last_became_peered":"2024-09-12T17:23:46.241137+0000","last_unstale":"2024-09-12T18:02:23.771840+0000","last_undegraded":"2024-09-12T18:02:23.771840+0000","last_fullsized":"2024-09-12T18:02:23.771840+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'270","last_scrub_stamp":"2024-09-12T18:02:23.771628+0000","last_deep_scrub":"261'270","last_deep_scrub_stamp":"2024-09-12T18:02:23.771628+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.771628+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:32.243330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":1112,"num_write":380,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"261'807","reported_seq":6210,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.371547+0000","last_change":"2024-09-12T18:02:30.371547+0000","last_active":"2024-09-12T18:02:30.371547+0000","last_peered":"2024-09-12T18:02:30.371547+0000","last_clean":"2024-09-12T18:02:30.371547+0000","last_became_active":"2024-09-12T17:23:48.167038+0000","last_became_peered":"2024-09-12T17:23:48.167038+0000","last_unstale":"2024-09-12T18:02:30.371547+0000","last_undegraded":"2024-09-12T18:02:30.371547+0000","last_fullsized":"2024-09-12T18:02:30.371547+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'807","last_scrub_stamp":"2024-09-12T18:02:30.371394+0000","last_deep_scrub":"261'807","last_deep_scrub_stamp":"2024-09-12T18:02:30.371394+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.371394+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:04.660887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"261'667","reported_seq":2272,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.287880+0000","last_change":"2024-09-12T18:02:10.287880+0000","last_active":"2024-09-12T18:02:10.287880+0000","last_peered":"2024-09-12T18:02:10.287880+0000","last_clean":"2024-09-12T18:02:10.287880+0000","last_became_active":"2024-09-12T17:23:42.143778+0000","last_became_peered":"2024-09-12T17:23:42.143778+0000","last_unstale":"2024-09-12T18:02:10.287880+0000","last_undegraded":"2024-09-12T18:02:10.287880+0000","last_fullsized":"2024-09-12T18:02:10.287880+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'667","last_scrub_stamp":"2024-09-12T18:02:10.287792+0000","last_deep_scrub":"261'667","last_deep_scrub_stamp":"2024-09-12T18:02:10.287792+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.287792+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":600,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:51.075062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3245,"num_read_kb":3064,"num_write":918,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"261'356","reported_seq":966,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.667617+0000","last_change":"2024-09-12T18:02:01.667556+0000","last_active":"2024-09-12T18:02:01.667617+0000","last_peered":"2024-09-12T18:02:01.667617+0000","last_clean":"2024-09-12T18:02:01.667617+0000","last_became_active":"2024-09-12T17:23:40.709587+0000","last_became_peered":"2024-09-12T17:23:40.709587+0000","last_unstale":"2024-09-12T18:02:01.667617+0000","last_undegraded":"2024-09-12T18:02:01.667617+0000","last_fullsized":"2024-09-12T18:02:01.667617+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'356","last_scrub_stamp":"2024-09-12T18:02:01.667423+0000","last_deep_scrub":"261'356","last_deep_scrub_stamp":"2024-09-12T18:02:01.667423+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.667423+0000","objects_scrubbed":9,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:03.026185+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947352,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":408,"num_read_kb":61352,"num_write":1018,"num_write_kb":60278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.682052+0000","last_change":"2024-09-12T18:02:16.682052+0000","last_active":"2024-09-12T18:02:16.682052+0000","last_peered":"2024-09-12T18:02:16.682052+0000","last_clean":"2024-09-12T18:02:16.682052+0000","last_became_active":"2024-09-12T17:23:44.150957+0000","last_became_peered":"2024-09-12T17:23:44.150957+0000","last_unstale":"2024-09-12T18:02:16.682052+0000","last_undegraded":"2024-09-12T18:02:16.682052+0000","last_fullsized":"2024-09-12T18:02:16.682052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:16.681963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:16.681963+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.681963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:47.949276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"261'354","reported_seq":954,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.203230+0000","last_change":"2024-09-12T18:02:24.203230+0000","last_active":"2024-09-12T18:02:24.203230+0000","last_peered":"2024-09-12T18:02:24.203230+0000","last_clean":"2024-09-12T18:02:24.203230+0000","last_became_active":"2024-09-12T17:23:46.241442+0000","last_became_peered":"2024-09-12T17:23:46.241442+0000","last_unstale":"2024-09-12T18:02:24.203230+0000","last_undegraded":"2024-09-12T18:02:24.203230+0000","last_fullsized":"2024-09-12T18:02:24.203230+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-12T18:02:24.203125+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-12T18:02:24.203125+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.203125+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:49.009181+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47631,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":562,"num_read_kb":1202,"num_write":448,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.028351+0000","last_change":"2024-09-12T18:02:18.028351+0000","last_active":"2024-09-12T18:02:18.028351+0000","last_peered":"2024-09-12T18:02:18.028351+0000","last_clean":"2024-09-12T18:02:18.028351+0000","last_became_active":"2024-09-12T17:23:48.167925+0000","last_became_peered":"2024-09-12T17:23:48.167925+0000","last_unstale":"2024-09-12T18:02:18.028351+0000","last_undegraded":"2024-09-12T18:02:18.028351+0000","last_fullsized":"2024-09-12T18:02:18.028351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:18.028282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:18.028282+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.028282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:28.697057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"261'579","reported_seq":1395,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.156558+0000","last_change":"2024-09-12T18:02:29.156558+0000","last_active":"2024-09-12T18:02:29.156558+0000","last_peered":"2024-09-12T18:02:29.156558+0000","last_clean":"2024-09-12T18:02:29.156558+0000","last_became_active":"2024-09-12T17:23:50.188109+0000","last_became_peered":"2024-09-12T17:23:50.188109+0000","last_unstale":"2024-09-12T18:02:29.156558+0000","last_undegraded":"2024-09-12T18:02:29.156558+0000","last_fullsized":"2024-09-12T18:02:29.156558+0000","mapping_epoch":33,"log_start":"261'500","ondisk_log_start":"261'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'579","last_scrub_stamp":"2024-09-12T18:02:29.156466+0000","last_deep_scrub":"261'579","last_deep_scrub_stamp":"2024-09-12T18:02:29.156466+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.156466+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:01.376584+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1373,"num_read_kb":1362,"num_write":1221,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"261'468","reported_seq":2011,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.076591+0000","last_change":"2024-09-12T18:02:01.076591+0000","last_active":"2024-09-12T18:02:01.076591+0000","last_peered":"2024-09-12T18:02:01.076591+0000","last_clean":"2024-09-12T18:02:01.076591+0000","last_became_active":"2024-09-12T17:23:42.135997+0000","last_became_peered":"2024-09-12T17:23:42.135997+0000","last_unstale":"2024-09-12T18:02:01.076591+0000","last_undegraded":"2024-09-12T18:02:01.076591+0000","last_fullsized":"2024-09-12T18:02:01.076591+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'468","last_scrub_stamp":"2024-09-12T18:02:01.076481+0000","last_deep_scrub":"261'468","last_deep_scrub_stamp":"2024-09-12T18:02:01.076481+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.076481+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:43.499647+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2354,"num_read_kb":2214,"num_write":547,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"261'349","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.611950+0000","last_change":"2024-09-12T18:01:59.611950+0000","last_active":"2024-09-12T18:01:59.611950+0000","last_peered":"2024-09-12T18:01:59.611950+0000","last_clean":"2024-09-12T18:01:59.611950+0000","last_became_active":"2024-09-12T17:23:40.711546+0000","last_became_peered":"2024-09-12T17:23:40.711546+0000","last_unstale":"2024-09-12T18:01:59.611950+0000","last_undegraded":"2024-09-12T18:01:59.611950+0000","last_fullsized":"2024-09-12T18:01:59.611950+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T18:01:59.611817+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T18:01:59.611817+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.611817+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:06.835809+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":612536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":14392,"num_write":1010,"num_write_kb":31885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.005898+0000","last_change":"2024-09-12T18:02:07.005898+0000","last_active":"2024-09-12T18:02:07.005898+0000","last_peered":"2024-09-12T18:02:07.005898+0000","last_clean":"2024-09-12T18:02:07.005898+0000","last_became_active":"2024-09-12T17:23:44.148472+0000","last_became_peered":"2024-09-12T17:23:44.148472+0000","last_unstale":"2024-09-12T18:02:07.005898+0000","last_undegraded":"2024-09-12T18:02:07.005898+0000","last_fullsized":"2024-09-12T18:02:07.005898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:07.005812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:07.005812+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.005812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:49.459504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"261'249","reported_seq":814,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.315174+0000","last_change":"2024-09-12T18:02:24.315174+0000","last_active":"2024-09-12T18:02:24.315174+0000","last_peered":"2024-09-12T18:02:24.315174+0000","last_clean":"2024-09-12T18:02:24.315174+0000","last_became_active":"2024-09-12T17:23:46.152441+0000","last_became_peered":"2024-09-12T17:23:46.152441+0000","last_unstale":"2024-09-12T18:02:24.315174+0000","last_undegraded":"2024-09-12T18:02:24.315174+0000","last_fullsized":"2024-09-12T18:02:24.315174+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'249","last_scrub_stamp":"2024-09-12T18:02:24.315085+0000","last_deep_scrub":"261'249","last_deep_scrub_stamp":"2024-09-12T18:02:24.315085+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.315085+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:46.268282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46658,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":411,"num_read_kb":954,"num_write":334,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.332954+0000","last_change":"2024-09-12T18:02:29.332954+0000","last_active":"2024-09-12T18:02:29.332954+0000","last_peered":"2024-09-12T18:02:29.332954+0000","last_clean":"2024-09-12T18:02:29.332954+0000","last_became_active":"2024-09-12T17:23:48.167829+0000","last_became_peered":"2024-09-12T17:23:48.167829+0000","last_unstale":"2024-09-12T18:02:29.332954+0000","last_undegraded":"2024-09-12T18:02:29.332954+0000","last_fullsized":"2024-09-12T18:02:29.332954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:29.332866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:29.332866+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.332866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:20.543107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"261'2378","reported_seq":4224,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.107111+0000","last_change":"2024-09-12T18:02:19.107111+0000","last_active":"2024-09-12T18:02:19.107111+0000","last_peered":"2024-09-12T18:02:19.107111+0000","last_clean":"2024-09-12T18:02:19.107111+0000","last_became_active":"2024-09-12T17:23:50.186026+0000","last_became_peered":"2024-09-12T17:23:50.186026+0000","last_unstale":"2024-09-12T18:02:19.107111+0000","last_undegraded":"2024-09-12T18:02:19.107111+0000","last_fullsized":"2024-09-12T18:02:19.107111+0000","mapping_epoch":33,"log_start":"261'2300","ondisk_log_start":"261'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2378","last_scrub_stamp":"2024-09-12T18:02:19.107026+0000","last_deep_scrub":"261'2378","last_deep_scrub_stamp":"2024-09-12T18:02:19.107026+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.107026+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":2300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:43.107144+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6096,"num_read_kb":6075,"num_write":4800,"num_write_kb":1772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"261'459","reported_seq":1996,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.193479+0000","last_change":"2024-09-12T18:02:11.193479+0000","last_active":"2024-09-12T18:02:11.193479+0000","last_peered":"2024-09-12T18:02:11.193479+0000","last_clean":"2024-09-12T18:02:11.193479+0000","last_became_active":"2024-09-12T17:23:42.147136+0000","last_became_peered":"2024-09-12T17:23:42.147136+0000","last_unstale":"2024-09-12T18:02:11.193479+0000","last_undegraded":"2024-09-12T18:02:11.193479+0000","last_fullsized":"2024-09-12T18:02:11.193479+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'459","last_scrub_stamp":"2024-09-12T18:02:11.193356+0000","last_deep_scrub":"261'459","last_deep_scrub_stamp":"2024-09-12T18:02:11.193356+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.193356+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:03.523588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2419,"num_read_kb":2271,"num_write":547,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"261'326","reported_seq":929,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.661213+0000","last_change":"2024-09-12T18:02:03.661213+0000","last_active":"2024-09-12T18:02:03.661213+0000","last_peered":"2024-09-12T18:02:03.661213+0000","last_clean":"2024-09-12T18:02:03.661213+0000","last_became_active":"2024-09-12T17:23:40.713481+0000","last_became_peered":"2024-09-12T17:23:40.713481+0000","last_unstale":"2024-09-12T18:02:03.661213+0000","last_undegraded":"2024-09-12T18:02:03.661213+0000","last_fullsized":"2024-09-12T18:02:03.661213+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-12T18:02:03.661110+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-12T18:02:03.661110+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.661110+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:27.094156+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":421,"num_read_kb":5522,"num_write":1047,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.030052+0000","last_change":"2024-09-12T18:02:10.030052+0000","last_active":"2024-09-12T18:02:10.030052+0000","last_peered":"2024-09-12T18:02:10.030052+0000","last_clean":"2024-09-12T18:02:10.030052+0000","last_became_active":"2024-09-12T17:23:44.147677+0000","last_became_peered":"2024-09-12T17:23:44.147677+0000","last_unstale":"2024-09-12T18:02:10.030052+0000","last_undegraded":"2024-09-12T18:02:10.030052+0000","last_fullsized":"2024-09-12T18:02:10.030052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:10.029964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:10.029964+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.029964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:58.321187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"261'293","reported_seq":866,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.766228+0000","last_change":"2024-09-12T18:02:21.766228+0000","last_active":"2024-09-12T18:02:21.766228+0000","last_peered":"2024-09-12T18:02:21.766228+0000","last_clean":"2024-09-12T18:02:21.766228+0000","last_became_active":"2024-09-12T17:23:46.150555+0000","last_became_peered":"2024-09-12T17:23:46.150555+0000","last_unstale":"2024-09-12T18:02:21.766228+0000","last_undegraded":"2024-09-12T18:02:21.766228+0000","last_fullsized":"2024-09-12T18:02:21.766228+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'293","last_scrub_stamp":"2024-09-12T18:02:21.766124+0000","last_deep_scrub":"261'293","last_deep_scrub_stamp":"2024-09-12T18:02:21.766124+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.766124+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:47.826501+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53816,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":485,"num_read_kb":1109,"num_write":394,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"261'805","reported_seq":2481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.559936+0000","last_change":"2024-09-12T18:02:22.559936+0000","last_active":"2024-09-12T18:02:22.559936+0000","last_peered":"2024-09-12T18:02:22.559936+0000","last_clean":"2024-09-12T18:02:22.559936+0000","last_became_active":"2024-09-12T17:23:48.165179+0000","last_became_peered":"2024-09-12T17:23:48.165179+0000","last_unstale":"2024-09-12T18:02:22.559936+0000","last_undegraded":"2024-09-12T18:02:22.559936+0000","last_fullsized":"2024-09-12T18:02:22.559936+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'805","last_scrub_stamp":"2024-09-12T18:02:22.559848+0000","last_deep_scrub":"261'805","last_deep_scrub_stamp":"2024-09-12T18:02:22.559848+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.559848+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:36.016185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"261'145","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.610738+0000","last_change":"2024-09-12T18:02:26.610738+0000","last_active":"2024-09-12T18:02:26.610738+0000","last_peered":"2024-09-12T18:02:26.610738+0000","last_clean":"2024-09-12T18:02:26.610738+0000","last_became_active":"2024-09-12T17:23:50.188230+0000","last_became_peered":"2024-09-12T17:23:50.188230+0000","last_unstale":"2024-09-12T18:02:26.610738+0000","last_undegraded":"2024-09-12T18:02:26.610738+0000","last_fullsized":"2024-09-12T18:02:26.610738+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'145","last_scrub_stamp":"2024-09-12T18:02:26.610649+0000","last_deep_scrub":"261'145","last_deep_scrub_stamp":"2024-09-12T18:02:26.610649+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.610649+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:02.263154+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":185,"num_write":335,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"261'475","reported_seq":2033,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.632480+0000","last_change":"2024-09-12T18:02:04.632480+0000","last_active":"2024-09-12T18:02:04.632480+0000","last_peered":"2024-09-12T18:02:04.632480+0000","last_clean":"2024-09-12T18:02:04.632480+0000","last_became_active":"2024-09-12T17:23:42.153910+0000","last_became_peered":"2024-09-12T17:23:42.153910+0000","last_unstale":"2024-09-12T18:02:04.632480+0000","last_undegraded":"2024-09-12T18:02:04.632480+0000","last_fullsized":"2024-09-12T18:02:04.632480+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'475","last_scrub_stamp":"2024-09-12T18:02:04.632383+0000","last_deep_scrub":"261'475","last_deep_scrub_stamp":"2024-09-12T18:02:04.632383+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.632383+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:53.568782+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2575,"num_read_kb":2405,"num_write":575,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"261'399","reported_seq":1123,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.268326+0000","last_change":"2024-09-12T18:02:00.268326+0000","last_active":"2024-09-12T18:02:00.268326+0000","last_peered":"2024-09-12T18:02:00.268326+0000","last_clean":"2024-09-12T18:02:00.268326+0000","last_became_active":"2024-09-12T17:23:40.712691+0000","last_became_peered":"2024-09-12T17:23:40.712691+0000","last_unstale":"2024-09-12T18:02:00.268326+0000","last_undegraded":"2024-09-12T18:02:00.268326+0000","last_fullsized":"2024-09-12T18:02:00.268326+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'399","last_scrub_stamp":"2024-09-12T18:02:00.268230+0000","last_deep_scrub":"261'399","last_deep_scrub_stamp":"2024-09-12T18:02:00.268230+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.268230+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:40.016187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":118590,"num_write":1283,"num_write_kb":72411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.002484+0000","last_change":"2024-09-12T18:02:09.002484+0000","last_active":"2024-09-12T18:02:09.002484+0000","last_peered":"2024-09-12T18:02:09.002484+0000","last_clean":"2024-09-12T18:02:09.002484+0000","last_became_active":"2024-09-12T17:23:44.142306+0000","last_became_peered":"2024-09-12T17:23:44.142306+0000","last_unstale":"2024-09-12T18:02:09.002484+0000","last_undegraded":"2024-09-12T18:02:09.002484+0000","last_fullsized":"2024-09-12T18:02:09.002484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:09.002389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:09.002389+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.002389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:07.194068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"261'459","reported_seq":1081,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.599021+0000","last_change":"2024-09-12T18:02:16.599021+0000","last_active":"2024-09-12T18:02:16.599021+0000","last_peered":"2024-09-12T18:02:16.599021+0000","last_clean":"2024-09-12T18:02:16.599021+0000","last_became_active":"2024-09-12T17:23:46.153719+0000","last_became_peered":"2024-09-12T17:23:46.153719+0000","last_unstale":"2024-09-12T18:02:16.599021+0000","last_undegraded":"2024-09-12T18:02:16.599021+0000","last_fullsized":"2024-09-12T18:02:16.599021+0000","mapping_epoch":29,"log_start":"261'400","ondisk_log_start":"261'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'459","last_scrub_stamp":"2024-09-12T18:02:16.598915+0000","last_deep_scrub":"261'459","last_deep_scrub_stamp":"2024-09-12T18:02:16.598915+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.598915+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:21.772998+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96999,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":810,"num_read_kb":1963,"num_write":664,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.004207+0000","last_change":"2024-09-12T18:02:12.004207+0000","last_active":"2024-09-12T18:02:12.004207+0000","last_peered":"2024-09-12T18:02:12.004207+0000","last_clean":"2024-09-12T18:02:12.004207+0000","last_became_active":"2024-09-12T17:23:48.170317+0000","last_became_peered":"2024-09-12T17:23:48.170317+0000","last_unstale":"2024-09-12T18:02:12.004207+0000","last_undegraded":"2024-09-12T18:02:12.004207+0000","last_fullsized":"2024-09-12T18:02:12.004207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:12.004106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:12.004106+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.004106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:51.147942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"261'156","reported_seq":669,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.966413+0000","last_change":"2024-09-12T18:02:22.966413+0000","last_active":"2024-09-12T18:02:22.966413+0000","last_peered":"2024-09-12T18:02:22.966413+0000","last_clean":"2024-09-12T18:02:22.966413+0000","last_became_active":"2024-09-12T17:23:50.184033+0000","last_became_peered":"2024-09-12T17:23:50.184033+0000","last_unstale":"2024-09-12T18:02:22.966413+0000","last_undegraded":"2024-09-12T18:02:22.966413+0000","last_fullsized":"2024-09-12T18:02:22.966413+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'156","last_scrub_stamp":"2024-09-12T18:02:22.966324+0000","last_deep_scrub":"261'156","last_deep_scrub_stamp":"2024-09-12T18:02:22.966324+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.966324+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:45.009578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":204,"num_write":351,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"261'835","reported_seq":2451,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.034117+0000","last_change":"2024-09-12T18:02:03.034117+0000","last_active":"2024-09-12T18:02:03.034117+0000","last_peered":"2024-09-12T18:02:03.034117+0000","last_clean":"2024-09-12T18:02:03.034117+0000","last_became_active":"2024-09-12T17:23:42.144703+0000","last_became_peered":"2024-09-12T17:23:42.144703+0000","last_unstale":"2024-09-12T18:02:03.034117+0000","last_undegraded":"2024-09-12T18:02:03.034117+0000","last_fullsized":"2024-09-12T18:02:03.034117+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'835","last_scrub_stamp":"2024-09-12T18:02:03.034031+0000","last_deep_scrub":"261'835","last_deep_scrub_stamp":"2024-09-12T18:02:03.034031+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.034031+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:20.574756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3952,"num_read_kb":3587,"num_write":1103,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"261'396","reported_seq":1062,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.233459+0000","last_change":"2024-09-12T18:01:59.233459+0000","last_active":"2024-09-12T18:01:59.233459+0000","last_peered":"2024-09-12T18:01:59.233459+0000","last_clean":"2024-09-12T18:01:59.233459+0000","last_became_active":"2024-09-12T17:23:40.706213+0000","last_became_peered":"2024-09-12T17:23:40.706213+0000","last_unstale":"2024-09-12T18:01:59.233459+0000","last_undegraded":"2024-09-12T18:01:59.233459+0000","last_fullsized":"2024-09-12T18:01:59.233459+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'396","last_scrub_stamp":"2024-09-12T18:01:59.233355+0000","last_deep_scrub":"261'396","last_deep_scrub_stamp":"2024-09-12T18:01:59.233355+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.233355+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:59.541266+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2088372,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":615,"num_read_kb":8190,"num_write":1407,"num_write_kb":25988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.021025+0000","last_change":"2024-09-12T18:02:08.021025+0000","last_active":"2024-09-12T18:02:08.021025+0000","last_peered":"2024-09-12T18:02:08.021025+0000","last_clean":"2024-09-12T18:02:08.021025+0000","last_became_active":"2024-09-12T17:23:44.149550+0000","last_became_peered":"2024-09-12T17:23:44.149550+0000","last_unstale":"2024-09-12T18:02:08.021025+0000","last_undegraded":"2024-09-12T18:02:08.021025+0000","last_fullsized":"2024-09-12T18:02:08.021025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:08.020929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:08.020929+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.020929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:44.082038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"261'283","reported_seq":855,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.193388+0000","last_change":"2024-09-12T18:02:22.193388+0000","last_active":"2024-09-12T18:02:22.193388+0000","last_peered":"2024-09-12T18:02:22.193388+0000","last_clean":"2024-09-12T18:02:22.193388+0000","last_became_active":"2024-09-12T17:23:46.153210+0000","last_became_peered":"2024-09-12T17:23:46.153210+0000","last_unstale":"2024-09-12T18:02:22.193388+0000","last_undegraded":"2024-09-12T18:02:22.193388+0000","last_fullsized":"2024-09-12T18:02:22.193388+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'283","last_scrub_stamp":"2024-09-12T18:02:22.193294+0000","last_deep_scrub":"261'283","last_deep_scrub_stamp":"2024-09-12T18:02:22.193294+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.193294+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:46.683819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":1026,"num_write":426,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.528683+0000","last_change":"2024-09-12T18:02:23.528683+0000","last_active":"2024-09-12T18:02:23.528683+0000","last_peered":"2024-09-12T18:02:23.528683+0000","last_clean":"2024-09-12T18:02:23.528683+0000","last_became_active":"2024-09-12T17:23:48.168675+0000","last_became_peered":"2024-09-12T17:23:48.168675+0000","last_unstale":"2024-09-12T18:02:23.528683+0000","last_undegraded":"2024-09-12T18:02:23.528683+0000","last_fullsized":"2024-09-12T18:02:23.528683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:23.528590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:23.528590+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.528590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:41.560581+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"261'101","reported_seq":590,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.335852+0000","last_change":"2024-09-12T18:02:31.335852+0000","last_active":"2024-09-12T18:02:31.335852+0000","last_peered":"2024-09-12T18:02:31.335852+0000","last_clean":"2024-09-12T18:02:31.335852+0000","last_became_active":"2024-09-12T17:23:50.186287+0000","last_became_peered":"2024-09-12T17:23:50.186287+0000","last_unstale":"2024-09-12T18:02:31.335852+0000","last_undegraded":"2024-09-12T18:02:31.335852+0000","last_fullsized":"2024-09-12T18:02:31.335852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'101","last_scrub_stamp":"2024-09-12T18:02:31.335753+0000","last_deep_scrub":"261'101","last_deep_scrub_stamp":"2024-09-12T18:02:31.335753+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.335753+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:10.965870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":108,"num_read_kb":104,"num_write":228,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"261'642","reported_seq":2252,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.070744+0000","last_change":"2024-09-12T18:02:04.070744+0000","last_active":"2024-09-12T18:02:04.070744+0000","last_peered":"2024-09-12T18:02:04.070744+0000","last_clean":"2024-09-12T18:02:04.070744+0000","last_became_active":"2024-09-12T17:23:42.132858+0000","last_became_peered":"2024-09-12T17:23:42.132858+0000","last_unstale":"2024-09-12T18:02:04.070744+0000","last_undegraded":"2024-09-12T18:02:04.070744+0000","last_fullsized":"2024-09-12T18:02:04.070744+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'642","last_scrub_stamp":"2024-09-12T18:02:04.070634+0000","last_deep_scrub":"261'642","last_deep_scrub_stamp":"2024-09-12T18:02:04.070634+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.070634+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:45.786486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3409,"num_read_kb":3082,"num_write":929,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"261'409","reported_seq":1090,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.166598+0000","last_change":"2024-09-12T18:01:57.166598+0000","last_active":"2024-09-12T18:01:57.166598+0000","last_peered":"2024-09-12T18:01:57.166598+0000","last_clean":"2024-09-12T18:01:57.166598+0000","last_became_active":"2024-09-12T17:23:40.706531+0000","last_became_peered":"2024-09-12T17:23:40.706531+0000","last_unstale":"2024-09-12T18:01:57.166598+0000","last_undegraded":"2024-09-12T18:01:57.166598+0000","last_fullsized":"2024-09-12T18:01:57.166598+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'409","last_scrub_stamp":"2024-09-12T18:01:57.166513+0000","last_deep_scrub":"261'409","last_deep_scrub_stamp":"2024-09-12T18:01:57.166513+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.166513+0000","objects_scrubbed":6,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:43.195543+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":670,"num_read_kb":36595,"num_write":1219,"num_write_kb":30858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"261'6","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.977020+0000","last_change":"2024-09-12T18:02:11.977020+0000","last_active":"2024-09-12T18:02:11.977020+0000","last_peered":"2024-09-12T18:02:11.977020+0000","last_clean":"2024-09-12T18:02:11.977020+0000","last_became_active":"2024-09-12T17:23:44.147427+0000","last_became_peered":"2024-09-12T17:23:44.147427+0000","last_unstale":"2024-09-12T18:02:11.977020+0000","last_undegraded":"2024-09-12T18:02:11.977020+0000","last_fullsized":"2024-09-12T18:02:11.977020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T18:02:11.976933+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T18:02:11.976933+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.976933+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:25.517914+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":1201,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"261'305","reported_seq":883,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.994122+0000","last_change":"2024-09-12T18:02:10.994122+0000","last_active":"2024-09-12T18:02:10.994122+0000","last_peered":"2024-09-12T18:02:10.994122+0000","last_clean":"2024-09-12T18:02:10.994122+0000","last_became_active":"2024-09-12T17:23:46.153004+0000","last_became_peered":"2024-09-12T17:23:46.153004+0000","last_unstale":"2024-09-12T18:02:10.994122+0000","last_undegraded":"2024-09-12T18:02:10.994122+0000","last_fullsized":"2024-09-12T18:02:10.994122+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'305","last_scrub_stamp":"2024-09-12T18:02:10.994015+0000","last_deep_scrub":"261'305","last_deep_scrub_stamp":"2024-09-12T18:02:10.994015+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.994015+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:16.444198+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46983,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":497,"num_read_kb":1127,"num_write":408,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"261'742","reported_seq":2139,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.981896+0000","last_change":"2024-09-12T18:02:13.981896+0000","last_active":"2024-09-12T18:02:13.981896+0000","last_peered":"2024-09-12T18:02:13.981896+0000","last_clean":"2024-09-12T18:02:13.981896+0000","last_became_active":"2024-09-12T17:23:48.169062+0000","last_became_peered":"2024-09-12T17:23:48.169062+0000","last_unstale":"2024-09-12T18:02:13.981896+0000","last_undegraded":"2024-09-12T18:02:13.981896+0000","last_fullsized":"2024-09-12T18:02:13.981896+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'742","last_scrub_stamp":"2024-09-12T18:02:13.981802+0000","last_deep_scrub":"261'742","last_deep_scrub_stamp":"2024-09-12T18:02:13.981802+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.981802+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:50.710110+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"261'143","reported_seq":637,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.934580+0000","last_change":"2024-09-12T18:02:24.934580+0000","last_active":"2024-09-12T18:02:24.934580+0000","last_peered":"2024-09-12T18:02:24.934580+0000","last_clean":"2024-09-12T18:02:24.934580+0000","last_became_active":"2024-09-12T17:23:50.184460+0000","last_became_peered":"2024-09-12T17:23:50.184460+0000","last_unstale":"2024-09-12T18:02:24.934580+0000","last_undegraded":"2024-09-12T18:02:24.934580+0000","last_fullsized":"2024-09-12T18:02:24.934580+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'143","last_scrub_stamp":"2024-09-12T18:02:24.934481+0000","last_deep_scrub":"261'143","last_deep_scrub_stamp":"2024-09-12T18:02:24.934481+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.934481+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:59.139694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":156,"num_write":329,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"261'798","reported_seq":2262,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.150267+0000","last_change":"2024-09-12T18:02:06.150267+0000","last_active":"2024-09-12T18:02:06.150267+0000","last_peered":"2024-09-12T18:02:06.150267+0000","last_clean":"2024-09-12T18:02:06.150267+0000","last_became_active":"2024-09-12T17:23:42.142896+0000","last_became_peered":"2024-09-12T17:23:42.142896+0000","last_unstale":"2024-09-12T18:02:06.150267+0000","last_undegraded":"2024-09-12T18:02:06.150267+0000","last_fullsized":"2024-09-12T18:02:06.150267+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'798","last_scrub_stamp":"2024-09-12T18:02:06.150180+0000","last_deep_scrub":"261'798","last_deep_scrub_stamp":"2024-09-12T18:02:06.150180+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.150180+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:47.648995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3737,"num_read_kb":3347,"num_write":1075,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"261'343","reported_seq":1014,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.076389+0000","last_change":"2024-09-12T18:01:56.076389+0000","last_active":"2024-09-12T18:01:56.076389+0000","last_peered":"2024-09-12T18:01:56.076389+0000","last_clean":"2024-09-12T18:01:56.076389+0000","last_became_active":"2024-09-12T17:23:40.708386+0000","last_became_peered":"2024-09-12T17:23:40.708386+0000","last_unstale":"2024-09-12T18:01:56.076389+0000","last_undegraded":"2024-09-12T18:01:56.076389+0000","last_fullsized":"2024-09-12T18:01:56.076389+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'343","last_scrub_stamp":"2024-09-12T18:01:56.076247+0000","last_deep_scrub":"261'343","last_deep_scrub_stamp":"2024-09-12T18:01:56.076247+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.076247+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:59.205706+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655881,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":106949,"num_write":1131,"num_write_kb":37410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"261'4","reported_seq":1460,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.227769+0000","last_change":"2024-09-12T18:02:19.227769+0000","last_active":"2024-09-12T18:02:19.227769+0000","last_peered":"2024-09-12T18:02:19.227769+0000","last_clean":"2024-09-12T18:02:19.227769+0000","last_became_active":"2024-09-12T17:23:44.149279+0000","last_became_peered":"2024-09-12T17:23:44.149279+0000","last_unstale":"2024-09-12T18:02:19.227769+0000","last_undegraded":"2024-09-12T18:02:19.227769+0000","last_fullsized":"2024-09-12T18:02:19.227769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T18:02:19.227681+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T18:02:19.227681+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.227681+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:18.615853+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"261'68","reported_seq":580,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.273405+0000","last_change":"2024-09-12T18:02:20.273405+0000","last_active":"2024-09-12T18:02:20.273405+0000","last_peered":"2024-09-12T18:02:20.273405+0000","last_clean":"2024-09-12T18:02:20.273405+0000","last_became_active":"2024-09-12T17:23:46.240979+0000","last_became_peered":"2024-09-12T17:23:46.240979+0000","last_unstale":"2024-09-12T18:02:20.273405+0000","last_undegraded":"2024-09-12T18:02:20.273405+0000","last_fullsized":"2024-09-12T18:02:20.273405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'68","last_scrub_stamp":"2024-09-12T18:02:20.273317+0000","last_deep_scrub":"261'68","last_deep_scrub_stamp":"2024-09-12T18:02:20.273317+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.273317+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:58.881950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"261'786","reported_seq":2389,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.107046+0000","last_change":"2024-09-12T18:02:17.107046+0000","last_active":"2024-09-12T18:02:17.107046+0000","last_peered":"2024-09-12T18:02:17.107046+0000","last_clean":"2024-09-12T18:02:17.107046+0000","last_became_active":"2024-09-12T17:23:48.172485+0000","last_became_peered":"2024-09-12T17:23:48.172485+0000","last_unstale":"2024-09-12T18:02:17.107046+0000","last_undegraded":"2024-09-12T18:02:17.107046+0000","last_fullsized":"2024-09-12T18:02:17.107046+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'786","last_scrub_stamp":"2024-09-12T18:02:17.106958+0000","last_deep_scrub":"261'786","last_deep_scrub_stamp":"2024-09-12T18:02:17.106958+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.106958+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:38.457220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"261'141","reported_seq":634,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.056357+0000","last_change":"2024-09-12T18:02:28.056357+0000","last_active":"2024-09-12T18:02:28.056357+0000","last_peered":"2024-09-12T18:02:28.056357+0000","last_clean":"2024-09-12T18:02:28.056357+0000","last_became_active":"2024-09-12T17:23:50.179153+0000","last_became_peered":"2024-09-12T17:23:50.179153+0000","last_unstale":"2024-09-12T18:02:28.056357+0000","last_undegraded":"2024-09-12T18:02:28.056357+0000","last_fullsized":"2024-09-12T18:02:28.056357+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'141","last_scrub_stamp":"2024-09-12T18:02:28.056234+0000","last_deep_scrub":"261'141","last_deep_scrub_stamp":"2024-09-12T18:02:28.056234+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.056234+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:22.001475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":149,"num_read_kb":148,"num_write":323,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"261'409","reported_seq":1909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.043260+0000","last_change":"2024-09-12T18:02:07.043260+0000","last_active":"2024-09-12T18:02:07.043260+0000","last_peered":"2024-09-12T18:02:07.043260+0000","last_clean":"2024-09-12T18:02:07.043260+0000","last_became_active":"2024-09-12T17:23:42.152339+0000","last_became_peered":"2024-09-12T17:23:42.152339+0000","last_unstale":"2024-09-12T18:02:07.043260+0000","last_undegraded":"2024-09-12T18:02:07.043260+0000","last_fullsized":"2024-09-12T18:02:07.043260+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'409","last_scrub_stamp":"2024-09-12T18:02:07.043170+0000","last_deep_scrub":"261'409","last_deep_scrub_stamp":"2024-09-12T18:02:07.043170+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.043170+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:06.071189+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2264,"num_read_kb":2142,"num_write":477,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"261'440","reported_seq":1220,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.180910+0000","last_change":"2024-09-12T18:01:58.180910+0000","last_active":"2024-09-12T18:01:58.180910+0000","last_peered":"2024-09-12T18:01:58.180910+0000","last_clean":"2024-09-12T18:01:58.180910+0000","last_became_active":"2024-09-12T17:23:40.714708+0000","last_became_peered":"2024-09-12T17:23:40.714708+0000","last_unstale":"2024-09-12T18:01:58.180910+0000","last_undegraded":"2024-09-12T18:01:58.180910+0000","last_fullsized":"2024-09-12T18:01:58.180910+0000","mapping_epoch":23,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'440","last_scrub_stamp":"2024-09-12T18:01:58.180819+0000","last_deep_scrub":"261'440","last_deep_scrub_stamp":"2024-09-12T18:01:58.180819+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.180819+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:13.620327+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1005,"num_read_kb":34670,"num_write":1495,"num_write_kb":45714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.220941+0000","last_change":"2024-09-12T18:02:16.220941+0000","last_active":"2024-09-12T18:02:16.220941+0000","last_peered":"2024-09-12T18:02:16.220941+0000","last_clean":"2024-09-12T18:02:16.220941+0000","last_became_active":"2024-09-12T17:23:44.151392+0000","last_became_peered":"2024-09-12T17:23:44.151392+0000","last_unstale":"2024-09-12T18:02:16.220941+0000","last_undegraded":"2024-09-12T18:02:16.220941+0000","last_fullsized":"2024-09-12T18:02:16.220941+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:16.220650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:16.220650+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.220650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:42.850614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"261'313","reported_seq":909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.171235+0000","last_change":"2024-09-12T18:02:25.171235+0000","last_active":"2024-09-12T18:02:25.171235+0000","last_peered":"2024-09-12T18:02:25.171235+0000","last_clean":"2024-09-12T18:02:25.171235+0000","last_became_active":"2024-09-12T17:23:46.144754+0000","last_became_peered":"2024-09-12T17:23:46.144754+0000","last_unstale":"2024-09-12T18:02:25.171235+0000","last_undegraded":"2024-09-12T18:02:25.171235+0000","last_fullsized":"2024-09-12T18:02:25.171235+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'313","last_scrub_stamp":"2024-09-12T18:02:25.171143+0000","last_deep_scrub":"261'313","last_deep_scrub_stamp":"2024-09-12T18:02:25.171143+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.171143+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:02.652521+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46816,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":500,"num_read_kb":1038,"num_write":390,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.115251+0000","last_change":"2024-09-12T18:02:13.115251+0000","last_active":"2024-09-12T18:02:13.115251+0000","last_peered":"2024-09-12T18:02:13.115251+0000","last_clean":"2024-09-12T18:02:13.115251+0000","last_became_active":"2024-09-12T17:23:48.170482+0000","last_became_peered":"2024-09-12T17:23:48.170482+0000","last_unstale":"2024-09-12T18:02:13.115251+0000","last_undegraded":"2024-09-12T18:02:13.115251+0000","last_fullsized":"2024-09-12T18:02:13.115251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:13.115166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:13.115166+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.115166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:47.974782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"261'142","reported_seq":643,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.960301+0000","last_change":"2024-09-12T18:02:20.960301+0000","last_active":"2024-09-12T18:02:20.960301+0000","last_peered":"2024-09-12T18:02:20.960301+0000","last_clean":"2024-09-12T18:02:20.960301+0000","last_became_active":"2024-09-12T17:23:50.187040+0000","last_became_peered":"2024-09-12T17:23:50.187040+0000","last_unstale":"2024-09-12T18:02:20.960301+0000","last_undegraded":"2024-09-12T18:02:20.960301+0000","last_fullsized":"2024-09-12T18:02:20.960301+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'142","last_scrub_stamp":"2024-09-12T18:02:20.960210+0000","last_deep_scrub":"261'142","last_deep_scrub_stamp":"2024-09-12T18:02:20.960210+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.960210+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:06.679889+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":190,"num_write":335,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"261'1233","reported_seq":2789,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.139896+0000","last_change":"2024-09-12T18:02:05.139896+0000","last_active":"2024-09-12T18:02:05.139896+0000","last_peered":"2024-09-12T18:02:05.139896+0000","last_clean":"2024-09-12T18:02:05.139896+0000","last_became_active":"2024-09-12T17:23:42.146200+0000","last_became_peered":"2024-09-12T17:23:42.146200+0000","last_unstale":"2024-09-12T18:02:05.139896+0000","last_undegraded":"2024-09-12T18:02:05.139896+0000","last_fullsized":"2024-09-12T18:02:05.139896+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1233","last_scrub_stamp":"2024-09-12T18:02:05.139829+0000","last_deep_scrub":"261'1233","last_deep_scrub_stamp":"2024-09-12T18:02:05.139829+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.139829+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":1200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:20.252996+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5862,"num_read_kb":5167,"num_write":1742,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"261'74","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.604067+0000","last_change":"2024-09-12T18:01:57.604067+0000","last_active":"2024-09-12T18:01:57.604067+0000","last_peered":"2024-09-12T18:01:57.604067+0000","last_clean":"2024-09-12T18:01:57.604067+0000","last_became_active":"2024-09-12T17:23:26.034872+0000","last_became_peered":"2024-09-12T17:23:26.034872+0000","last_unstale":"2024-09-12T18:01:57.604067+0000","last_undegraded":"2024-09-12T18:01:57.604067+0000","last_fullsized":"2024-09-12T18:01:57.604067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'74","last_scrub_stamp":"2024-09-12T18:01:57.603967+0000","last_deep_scrub":"261'74","last_deep_scrub_stamp":"2024-09-12T18:01:57.603967+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.603967+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:41.712562+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"261'2","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.219549+0000","last_change":"2024-09-12T18:01:58.219549+0000","last_active":"2024-09-12T18:01:58.219549+0000","last_peered":"2024-09-12T18:01:58.219549+0000","last_clean":"2024-09-12T18:01:58.219549+0000","last_became_active":"2024-09-12T17:23:31.584884+0000","last_became_peered":"2024-09-12T17:23:31.584884+0000","last_unstale":"2024-09-12T18:01:58.219549+0000","last_undegraded":"2024-09-12T18:01:58.219549+0000","last_fullsized":"2024-09-12T18:01:58.219549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:01:58.219468+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:01:58.219468+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.219468+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:46.365922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000423087,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"261'317","reported_seq":954,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.118593+0000","last_change":"2024-09-12T18:01:56.118593+0000","last_active":"2024-09-12T18:01:56.118593+0000","last_peered":"2024-09-12T18:01:56.118593+0000","last_clean":"2024-09-12T18:01:56.118593+0000","last_became_active":"2024-09-12T17:23:40.718896+0000","last_became_peered":"2024-09-12T17:23:40.718896+0000","last_unstale":"2024-09-12T18:01:56.118593+0000","last_undegraded":"2024-09-12T18:01:56.118593+0000","last_fullsized":"2024-09-12T18:01:56.118593+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'317","last_scrub_stamp":"2024-09-12T18:01:56.118490+0000","last_deep_scrub":"261'317","last_deep_scrub_stamp":"2024-09-12T18:01:56.118490+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.118490+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:05.520040+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":13109,"num_write":1018,"num_write_kb":39939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"261'4","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.686852+0000","last_change":"2024-09-12T18:02:15.686852+0000","last_active":"2024-09-12T18:02:15.686852+0000","last_peered":"2024-09-12T18:02:15.686852+0000","last_clean":"2024-09-12T18:02:15.686852+0000","last_became_active":"2024-09-12T17:23:44.152585+0000","last_became_peered":"2024-09-12T17:23:44.152585+0000","last_unstale":"2024-09-12T18:02:15.686852+0000","last_undegraded":"2024-09-12T18:02:15.686852+0000","last_fullsized":"2024-09-12T18:02:15.686852+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T18:02:15.686767+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T18:02:15.686767+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.686767+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:37.441894+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"261'723","reported_seq":1421,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.163217+0000","last_change":"2024-09-12T18:02:23.163217+0000","last_active":"2024-09-12T18:02:23.163217+0000","last_peered":"2024-09-12T18:02:23.163217+0000","last_clean":"2024-09-12T18:02:23.163217+0000","last_became_active":"2024-09-12T17:23:46.151673+0000","last_became_peered":"2024-09-12T17:23:46.151673+0000","last_unstale":"2024-09-12T18:02:23.163217+0000","last_undegraded":"2024-09-12T18:02:23.163217+0000","last_fullsized":"2024-09-12T18:02:23.163217+0000","mapping_epoch":29,"log_start":"261'700","ondisk_log_start":"261'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'723","last_scrub_stamp":"2024-09-12T18:02:23.163118+0000","last_deep_scrub":"261'723","last_deep_scrub_stamp":"2024-09-12T18:02:23.163118+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.163118+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:13.781960+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145502,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1428,"num_read_kb":3259,"num_write":1354,"num_write_kb":1206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106776,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.604097+0000","last_change":"2024-09-12T18:02:20.604097+0000","last_active":"2024-09-12T18:02:20.604097+0000","last_peered":"2024-09-12T18:02:20.604097+0000","last_clean":"2024-09-12T18:02:20.604097+0000","last_became_active":"2024-09-12T17:23:48.170153+0000","last_became_peered":"2024-09-12T17:23:48.170153+0000","last_unstale":"2024-09-12T18:02:20.604097+0000","last_undegraded":"2024-09-12T18:02:20.604097+0000","last_fullsized":"2024-09-12T18:02:20.604097+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:20.603993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:20.603993+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.603993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:23.747962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"261'227","reported_seq":952,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.107381+0000","last_change":"2024-09-12T18:02:20.107381+0000","last_active":"2024-09-12T18:02:20.107381+0000","last_peered":"2024-09-12T18:02:20.107381+0000","last_clean":"2024-09-12T18:02:20.107381+0000","last_became_active":"2024-09-12T17:23:50.188552+0000","last_became_peered":"2024-09-12T17:23:50.188552+0000","last_unstale":"2024-09-12T18:02:20.107381+0000","last_undegraded":"2024-09-12T18:02:20.107381+0000","last_fullsized":"2024-09-12T18:02:20.107381+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'227","last_scrub_stamp":"2024-09-12T18:02:20.107290+0000","last_deep_scrub":"261'227","last_deep_scrub_stamp":"2024-09-12T18:02:20.107290+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.107290+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:00.704292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":580,"num_write":503,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"261'393","reported_seq":1839,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.682090+0000","last_change":"2024-09-12T18:02:03.682090+0000","last_active":"2024-09-12T18:02:03.682090+0000","last_peered":"2024-09-12T18:02:03.682090+0000","last_clean":"2024-09-12T18:02:03.682090+0000","last_became_active":"2024-09-12T17:23:42.147045+0000","last_became_peered":"2024-09-12T17:23:42.147045+0000","last_unstale":"2024-09-12T18:02:03.682090+0000","last_undegraded":"2024-09-12T18:02:03.682090+0000","last_fullsized":"2024-09-12T18:02:03.682090+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'393","last_scrub_stamp":"2024-09-12T18:02:03.681965+0000","last_deep_scrub":"261'393","last_deep_scrub_stamp":"2024-09-12T18:02:03.681965+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.681965+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:17.784933+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2080,"num_read_kb":1972,"num_write":429,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1199,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":515,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.639675+0000","last_change":"2024-09-12T18:01:58.639675+0000","last_active":"2024-09-12T18:01:58.639675+0000","last_peered":"2024-09-12T18:01:58.639675+0000","last_clean":"2024-09-12T18:01:58.639675+0000","last_became_active":"2024-09-12T17:23:31.588699+0000","last_became_peered":"2024-09-12T17:23:31.588699+0000","last_unstale":"2024-09-12T18:01:58.639675+0000","last_undegraded":"2024-09-12T18:01:58.639675+0000","last_fullsized":"2024-09-12T18:01:58.639675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:58.639583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:58.639583+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.639583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:21.037862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052181899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"261'342","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.723017+0000","last_change":"2024-09-12T18:01:58.723017+0000","last_active":"2024-09-12T18:01:58.723017+0000","last_peered":"2024-09-12T18:01:58.723017+0000","last_clean":"2024-09-12T18:01:58.723017+0000","last_became_active":"2024-09-12T17:23:40.713199+0000","last_became_peered":"2024-09-12T17:23:40.713199+0000","last_unstale":"2024-09-12T18:01:58.723017+0000","last_undegraded":"2024-09-12T18:01:58.723017+0000","last_fullsized":"2024-09-12T18:01:58.723017+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'342","last_scrub_stamp":"2024-09-12T18:01:58.722915+0000","last_deep_scrub":"261'342","last_deep_scrub_stamp":"2024-09-12T18:01:58.722915+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.722915+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:52.223877+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":39290,"num_write":1124,"num_write_kb":55994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.272039+0000","last_change":"2024-09-12T18:02:17.272039+0000","last_active":"2024-09-12T18:02:17.272039+0000","last_peered":"2024-09-12T18:02:17.272039+0000","last_clean":"2024-09-12T18:02:17.272039+0000","last_became_active":"2024-09-12T17:23:44.149400+0000","last_became_peered":"2024-09-12T17:23:44.149400+0000","last_unstale":"2024-09-12T18:02:17.272039+0000","last_undegraded":"2024-09-12T18:02:17.272039+0000","last_fullsized":"2024-09-12T18:02:17.272039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:17.271849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:17.271849+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.271849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:57.900849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"261'1320","reported_seq":2715,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.052671+0000","last_change":"2024-09-12T18:02:15.052671+0000","last_active":"2024-09-12T18:02:15.052671+0000","last_peered":"2024-09-12T18:02:15.052671+0000","last_clean":"2024-09-12T18:02:15.052671+0000","last_became_active":"2024-09-12T17:23:46.145354+0000","last_became_peered":"2024-09-12T17:23:46.145354+0000","last_unstale":"2024-09-12T18:02:15.052671+0000","last_undegraded":"2024-09-12T18:02:15.052671+0000","last_fullsized":"2024-09-12T18:02:15.052671+0000","mapping_epoch":29,"log_start":"261'1300","ondisk_log_start":"261'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1320","last_scrub_stamp":"2024-09-12T18:02:15.052569+0000","last_deep_scrub":"261'1320","last_deep_scrub_stamp":"2024-09-12T18:02:15.052569+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.052569+0000","objects_scrubbed":12,"log_size":20,"log_dups_size":1300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:58.558654+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139395,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2079,"num_read_kb":4017,"num_write":1172,"num_write_kb":1007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.786228+0000","last_change":"2024-09-12T18:02:25.786228+0000","last_active":"2024-09-12T18:02:25.786228+0000","last_peered":"2024-09-12T18:02:25.786228+0000","last_clean":"2024-09-12T18:02:25.786228+0000","last_became_active":"2024-09-12T17:23:48.171355+0000","last_became_peered":"2024-09-12T17:23:48.171355+0000","last_unstale":"2024-09-12T18:02:25.786228+0000","last_undegraded":"2024-09-12T18:02:25.786228+0000","last_fullsized":"2024-09-12T18:02:25.786228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:25.786136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:25.786136+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.786136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:33.215639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"261'109","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.990666+0000","last_change":"2024-09-12T18:02:21.990666+0000","last_active":"2024-09-12T18:02:21.990666+0000","last_peered":"2024-09-12T18:02:21.990666+0000","last_clean":"2024-09-12T18:02:21.990666+0000","last_became_active":"2024-09-12T17:23:50.639053+0000","last_became_peered":"2024-09-12T17:23:50.639053+0000","last_unstale":"2024-09-12T18:02:21.990666+0000","last_undegraded":"2024-09-12T18:02:21.990666+0000","last_fullsized":"2024-09-12T18:02:21.990666+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'109","last_scrub_stamp":"2024-09-12T18:02:21.990551+0000","last_deep_scrub":"261'109","last_deep_scrub_stamp":"2024-09-12T18:02:21.990551+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.990551+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:25.489390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":162,"num_write":260,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"261'914","reported_seq":2650,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.066774+0000","last_change":"2024-09-12T18:02:06.066774+0000","last_active":"2024-09-12T18:02:06.066774+0000","last_peered":"2024-09-12T18:02:06.066774+0000","last_clean":"2024-09-12T18:02:06.066774+0000","last_became_active":"2024-09-12T17:23:42.145049+0000","last_became_peered":"2024-09-12T17:23:42.145049+0000","last_unstale":"2024-09-12T18:02:06.066774+0000","last_undegraded":"2024-09-12T18:02:06.066774+0000","last_fullsized":"2024-09-12T18:02:06.066774+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'914","last_scrub_stamp":"2024-09-12T18:02:06.066685+0000","last_deep_scrub":"261'914","last_deep_scrub_stamp":"2024-09-12T18:02:06.066685+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.066685+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":900,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:56.688488+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4463,"num_read_kb":4014,"num_write":1227,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.898988+0000","last_change":"2024-09-12T18:01:55.898988+0000","last_active":"2024-09-12T18:01:55.898988+0000","last_peered":"2024-09-12T18:01:55.898988+0000","last_clean":"2024-09-12T18:01:55.898988+0000","last_became_active":"2024-09-12T17:23:31.584259+0000","last_became_peered":"2024-09-12T17:23:31.584259+0000","last_unstale":"2024-09-12T18:01:55.898988+0000","last_undegraded":"2024-09-12T18:01:55.898988+0000","last_fullsized":"2024-09-12T18:01:55.898988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:55.898906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:55.898906+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.898906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:27.914712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045870900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"261'331","reported_seq":961,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.976477+0000","last_change":"2024-09-12T18:01:55.976477+0000","last_active":"2024-09-12T18:01:55.976477+0000","last_peered":"2024-09-12T18:01:55.976477+0000","last_clean":"2024-09-12T18:01:55.976477+0000","last_became_active":"2024-09-12T17:23:40.712276+0000","last_became_peered":"2024-09-12T17:23:40.712276+0000","last_unstale":"2024-09-12T18:01:55.976477+0000","last_undegraded":"2024-09-12T18:01:55.976477+0000","last_fullsized":"2024-09-12T18:01:55.976477+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'331","last_scrub_stamp":"2024-09-12T18:01:55.976396+0000","last_deep_scrub":"261'331","last_deep_scrub_stamp":"2024-09-12T18:01:55.976396+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.976396+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:09.619450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":8922,"num_write":1082,"num_write_kb":17941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"261'2","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.053911+0000","last_change":"2024-09-12T18:02:06.053911+0000","last_active":"2024-09-12T18:02:06.053911+0000","last_peered":"2024-09-12T18:02:06.053911+0000","last_clean":"2024-09-12T18:02:06.053911+0000","last_became_active":"2024-09-12T17:23:44.151006+0000","last_became_peered":"2024-09-12T17:23:44.151006+0000","last_unstale":"2024-09-12T18:02:06.053911+0000","last_undegraded":"2024-09-12T18:02:06.053911+0000","last_fullsized":"2024-09-12T18:02:06.053911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:06.053826+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:06.053826+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.053826+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:20.770473+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"261'203","reported_seq":1198,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.748490+0000","last_change":"2024-09-12T18:02:20.748490+0000","last_active":"2024-09-12T18:02:20.748490+0000","last_peered":"2024-09-12T18:02:20.748490+0000","last_clean":"2024-09-12T18:02:20.748490+0000","last_became_active":"2024-09-12T17:23:46.241733+0000","last_became_peered":"2024-09-12T17:23:46.241733+0000","last_unstale":"2024-09-12T18:02:20.748490+0000","last_undegraded":"2024-09-12T18:02:20.748490+0000","last_fullsized":"2024-09-12T18:02:20.748490+0000","mapping_epoch":29,"log_start":"258'100","ondisk_log_start":"258'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'203","last_scrub_stamp":"2024-09-12T18:02:20.748374+0000","last_deep_scrub":"261'203","last_deep_scrub_stamp":"2024-09-12T18:02:20.748374+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.748374+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:40.960458+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":152,"num_read_kb":143,"num_write":117,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.566774+0000","last_change":"2024-09-12T18:02:21.566774+0000","last_active":"2024-09-12T18:02:21.566774+0000","last_peered":"2024-09-12T18:02:21.566774+0000","last_clean":"2024-09-12T18:02:21.566774+0000","last_became_active":"2024-09-12T17:23:48.167920+0000","last_became_peered":"2024-09-12T17:23:48.167920+0000","last_unstale":"2024-09-12T18:02:21.566774+0000","last_undegraded":"2024-09-12T18:02:21.566774+0000","last_fullsized":"2024-09-12T18:02:21.566774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:21.566682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:21.566682+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.566682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:26.235303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"261'265","reported_seq":870,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.378316+0000","last_change":"2024-09-12T18:02:32.378316+0000","last_active":"2024-09-12T18:02:32.378316+0000","last_peered":"2024-09-12T18:02:32.378316+0000","last_clean":"2024-09-12T18:02:32.378316+0000","last_became_active":"2024-09-12T17:23:50.177293+0000","last_became_peered":"2024-09-12T17:23:50.177293+0000","last_unstale":"2024-09-12T18:02:32.378316+0000","last_undegraded":"2024-09-12T18:02:32.378316+0000","last_fullsized":"2024-09-12T18:02:32.378316+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'265","last_scrub_stamp":"2024-09-12T18:02:32.378205+0000","last_deep_scrub":"261'265","last_deep_scrub_stamp":"2024-09-12T18:02:32.378205+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.378205+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:34.137386+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":569,"num_write":571,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"261'445","reported_seq":2043,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.029638+0000","last_change":"2024-09-12T18:02:05.029638+0000","last_active":"2024-09-12T18:02:05.029638+0000","last_peered":"2024-09-12T18:02:05.029638+0000","last_clean":"2024-09-12T18:02:05.029638+0000","last_became_active":"2024-09-12T17:23:42.136083+0000","last_became_peered":"2024-09-12T17:23:42.136083+0000","last_unstale":"2024-09-12T18:02:05.029638+0000","last_undegraded":"2024-09-12T18:02:05.029638+0000","last_fullsized":"2024-09-12T18:02:05.029638+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'445","last_scrub_stamp":"2024-09-12T18:02:05.029525+0000","last_deep_scrub":"261'445","last_deep_scrub_stamp":"2024-09-12T18:02:05.029525+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.029525+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:54.386989+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2433,"num_read_kb":2304,"num_write":511,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"261'3","reported_seq":520,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.201047+0000","last_change":"2024-09-12T18:01:57.201047+0000","last_active":"2024-09-12T18:01:57.201047+0000","last_peered":"2024-09-12T18:01:57.201047+0000","last_clean":"2024-09-12T18:01:57.201047+0000","last_became_active":"2024-09-12T17:23:31.588612+0000","last_became_peered":"2024-09-12T17:23:31.588612+0000","last_unstale":"2024-09-12T18:01:57.201047+0000","last_undegraded":"2024-09-12T18:01:57.201047+0000","last_fullsized":"2024-09-12T18:01:57.201047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:01:57.200972+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:01:57.200972+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.200972+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:08.741396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00095838300000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"261'358","reported_seq":1082,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.069482+0000","last_change":"2024-09-12T18:01:57.069482+0000","last_active":"2024-09-12T18:01:57.069482+0000","last_peered":"2024-09-12T18:01:57.069482+0000","last_clean":"2024-09-12T18:01:57.069482+0000","last_became_active":"2024-09-12T17:23:40.716786+0000","last_became_peered":"2024-09-12T17:23:40.716786+0000","last_unstale":"2024-09-12T18:01:57.069482+0000","last_undegraded":"2024-09-12T18:01:57.069482+0000","last_fullsized":"2024-09-12T18:01:57.069482+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'358","last_scrub_stamp":"2024-09-12T18:01:57.069360+0000","last_deep_scrub":"261'358","last_deep_scrub_stamp":"2024-09-12T18:01:57.069360+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.069360+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:04.851606+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287987,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":555,"num_read_kb":40133,"num_write":1081,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.579113+0000","last_change":"2024-09-12T18:02:13.579113+0000","last_active":"2024-09-12T18:02:13.579113+0000","last_peered":"2024-09-12T18:02:13.579113+0000","last_clean":"2024-09-12T18:02:13.579113+0000","last_became_active":"2024-09-12T17:23:44.150912+0000","last_became_peered":"2024-09-12T17:23:44.150912+0000","last_unstale":"2024-09-12T18:02:13.579113+0000","last_undegraded":"2024-09-12T18:02:13.579113+0000","last_fullsized":"2024-09-12T18:02:13.579113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:13.579019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:13.579019+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.579019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:58.259163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"261'116","reported_seq":649,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.283472+0000","last_change":"2024-09-12T18:02:21.283472+0000","last_active":"2024-09-12T18:02:21.283472+0000","last_peered":"2024-09-12T18:02:21.283472+0000","last_clean":"2024-09-12T18:02:21.283472+0000","last_became_active":"2024-09-12T17:23:46.155516+0000","last_became_peered":"2024-09-12T17:23:46.155516+0000","last_unstale":"2024-09-12T18:02:21.283472+0000","last_undegraded":"2024-09-12T18:02:21.283472+0000","last_fullsized":"2024-09-12T18:02:21.283472+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'116","last_scrub_stamp":"2024-09-12T18:02:21.283360+0000","last_deep_scrub":"261'116","last_deep_scrub_stamp":"2024-09-12T18:02:21.283360+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.283360+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:06.535901+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":92,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.131263+0000","last_change":"2024-09-12T18:02:14.131263+0000","last_active":"2024-09-12T18:02:14.131263+0000","last_peered":"2024-09-12T18:02:14.131263+0000","last_clean":"2024-09-12T18:02:14.131263+0000","last_became_active":"2024-09-12T17:23:48.170462+0000","last_became_peered":"2024-09-12T17:23:48.170462+0000","last_unstale":"2024-09-12T18:02:14.131263+0000","last_undegraded":"2024-09-12T18:02:14.131263+0000","last_fullsized":"2024-09-12T18:02:14.131263+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:14.131174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:14.131174+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.131174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:21.306321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":663,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.164597+0000","last_change":"2024-09-12T18:02:31.164597+0000","last_active":"2024-09-12T18:02:31.164597+0000","last_peered":"2024-09-12T18:02:31.164597+0000","last_clean":"2024-09-12T18:02:31.164597+0000","last_became_active":"2024-09-12T17:23:50.186526+0000","last_became_peered":"2024-09-12T17:23:50.186526+0000","last_unstale":"2024-09-12T18:02:31.164597+0000","last_undegraded":"2024-09-12T18:02:31.164597+0000","last_fullsized":"2024-09-12T18:02:31.164597+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'122","last_scrub_stamp":"2024-09-12T18:02:31.164513+0000","last_deep_scrub":"261'122","last_deep_scrub_stamp":"2024-09-12T18:02:31.164513+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.164513+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:43.441056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":247,"num_write":303,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"261'542","reported_seq":2265,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.073021+0000","last_change":"2024-09-12T18:02:03.073021+0000","last_active":"2024-09-12T18:02:03.073021+0000","last_peered":"2024-09-12T18:02:03.073021+0000","last_clean":"2024-09-12T18:02:03.073021+0000","last_became_active":"2024-09-12T17:23:42.151735+0000","last_became_peered":"2024-09-12T17:23:42.151735+0000","last_unstale":"2024-09-12T18:02:03.073021+0000","last_undegraded":"2024-09-12T18:02:03.073021+0000","last_fullsized":"2024-09-12T18:02:03.073021+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'542","last_scrub_stamp":"2024-09-12T18:02:03.072918+0000","last_deep_scrub":"261'542","last_deep_scrub_stamp":"2024-09-12T18:02:03.072918+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.072918+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:38.792420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2982,"num_read_kb":2809,"num_write":660,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"261'324","reported_seq":921,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.273198+0000","last_change":"2024-09-12T18:01:59.273198+0000","last_active":"2024-09-12T18:01:59.273198+0000","last_peered":"2024-09-12T18:01:59.273198+0000","last_clean":"2024-09-12T18:01:59.273198+0000","last_became_active":"2024-09-12T17:23:40.712386+0000","last_became_peered":"2024-09-12T17:23:40.712386+0000","last_unstale":"2024-09-12T18:01:59.273198+0000","last_undegraded":"2024-09-12T18:01:59.273198+0000","last_fullsized":"2024-09-12T18:01:59.273198+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'324","last_scrub_stamp":"2024-09-12T18:01:59.273097+0000","last_deep_scrub":"261'324","last_deep_scrub_stamp":"2024-09-12T18:01:59.273097+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.273097+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:24.760087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":415,"num_read_kb":6504,"num_write":991,"num_write_kb":34893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":521,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.011936+0000","last_change":"2024-09-12T18:01:55.011936+0000","last_active":"2024-09-12T18:01:55.011936+0000","last_peered":"2024-09-12T18:01:55.011936+0000","last_clean":"2024-09-12T18:01:55.011936+0000","last_became_active":"2024-09-12T17:23:31.681209+0000","last_became_peered":"2024-09-12T17:23:31.681209+0000","last_unstale":"2024-09-12T18:01:55.011936+0000","last_undegraded":"2024-09-12T18:01:55.011936+0000","last_fullsized":"2024-09-12T18:01:55.011936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:55.011864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:55.011864+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.011864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:54.403724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056110600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.613324+0000","last_change":"2024-09-12T18:02:12.613324+0000","last_active":"2024-09-12T18:02:12.613324+0000","last_peered":"2024-09-12T18:02:12.613324+0000","last_clean":"2024-09-12T18:02:12.613324+0000","last_became_active":"2024-09-12T17:23:44.148035+0000","last_became_peered":"2024-09-12T17:23:44.148035+0000","last_unstale":"2024-09-12T18:02:12.613324+0000","last_undegraded":"2024-09-12T18:02:12.613324+0000","last_fullsized":"2024-09-12T18:02:12.613324+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:12.613224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:12.613224+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.613224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:09.496521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"261'571","reported_seq":1223,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.627975+0000","last_change":"2024-09-12T18:02:15.627975+0000","last_active":"2024-09-12T18:02:15.627975+0000","last_peered":"2024-09-12T18:02:15.627975+0000","last_clean":"2024-09-12T18:02:15.627975+0000","last_became_active":"2024-09-12T17:23:46.151649+0000","last_became_peered":"2024-09-12T17:23:46.151649+0000","last_unstale":"2024-09-12T18:02:15.627975+0000","last_undegraded":"2024-09-12T18:02:15.627975+0000","last_fullsized":"2024-09-12T18:02:15.627975+0000","mapping_epoch":29,"log_start":"261'500","ondisk_log_start":"261'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'571","last_scrub_stamp":"2024-09-12T18:02:15.627874+0000","last_deep_scrub":"261'571","last_deep_scrub_stamp":"2024-09-12T18:02:15.627874+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.627874+0000","objects_scrubbed":10,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:19.245704+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91231,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1527,"num_read_kb":2702,"num_write":1958,"num_write_kb":1787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":502154,"num_omap_keys":1138,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.172021+0000","last_change":"2024-09-12T18:02:23.172021+0000","last_active":"2024-09-12T18:02:23.172021+0000","last_peered":"2024-09-12T18:02:23.172021+0000","last_clean":"2024-09-12T18:02:23.172021+0000","last_became_active":"2024-09-12T17:23:48.166196+0000","last_became_peered":"2024-09-12T17:23:48.166196+0000","last_unstale":"2024-09-12T18:02:23.172021+0000","last_undegraded":"2024-09-12T18:02:23.172021+0000","last_fullsized":"2024-09-12T18:02:23.172021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:23.171932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:23.171932+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.171932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:59.532011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"261'227","reported_seq":736,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.593807+0000","last_change":"2024-09-12T18:02:28.593807+0000","last_active":"2024-09-12T18:02:28.593807+0000","last_peered":"2024-09-12T18:02:28.593807+0000","last_clean":"2024-09-12T18:02:28.593807+0000","last_became_active":"2024-09-12T17:23:50.640185+0000","last_became_peered":"2024-09-12T17:23:50.640185+0000","last_unstale":"2024-09-12T18:02:28.593807+0000","last_undegraded":"2024-09-12T18:02:28.593807+0000","last_fullsized":"2024-09-12T18:02:28.593807+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'227","last_scrub_stamp":"2024-09-12T18:02:28.593705+0000","last_deep_scrub":"261'227","last_deep_scrub_stamp":"2024-09-12T18:02:28.593705+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.593705+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:08.171833+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":243,"num_write":513,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"261'511","reported_seq":2075,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.675785+0000","last_change":"2024-09-12T18:02:05.675785+0000","last_active":"2024-09-12T18:02:05.675785+0000","last_peered":"2024-09-12T18:02:05.675785+0000","last_clean":"2024-09-12T18:02:05.675785+0000","last_became_active":"2024-09-12T17:23:42.148578+0000","last_became_peered":"2024-09-12T17:23:42.148578+0000","last_unstale":"2024-09-12T18:02:05.675785+0000","last_undegraded":"2024-09-12T18:02:05.675785+0000","last_fullsized":"2024-09-12T18:02:05.675785+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'511","last_scrub_stamp":"2024-09-12T18:02:05.675698+0000","last_deep_scrub":"261'511","last_deep_scrub_stamp":"2024-09-12T18:02:05.675698+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.675698+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:16.683349+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2709,"num_read_kb":2501,"num_write":646,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"261'359","reported_seq":989,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.005174+0000","last_change":"2024-09-12T18:01:58.005174+0000","last_active":"2024-09-12T18:01:58.005174+0000","last_peered":"2024-09-12T18:01:58.005174+0000","last_clean":"2024-09-12T18:01:58.005174+0000","last_became_active":"2024-09-12T17:23:40.710780+0000","last_became_peered":"2024-09-12T17:23:40.710780+0000","last_unstale":"2024-09-12T18:01:58.005174+0000","last_undegraded":"2024-09-12T18:01:58.005174+0000","last_fullsized":"2024-09-12T18:01:58.005174+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'359","last_scrub_stamp":"2024-09-12T18:01:58.005070+0000","last_deep_scrub":"261'359","last_deep_scrub_stamp":"2024-09-12T18:01:58.005070+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.005070+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:48.684663+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":525,"num_write":1227,"num_write_kb":43788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":514,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.654264+0000","last_change":"2024-09-12T18:02:00.654264+0000","last_active":"2024-09-12T18:02:00.654264+0000","last_peered":"2024-09-12T18:02:00.654264+0000","last_clean":"2024-09-12T18:02:00.654264+0000","last_became_active":"2024-09-12T17:23:31.681155+0000","last_became_peered":"2024-09-12T17:23:31.681155+0000","last_unstale":"2024-09-12T18:02:00.654264+0000","last_undegraded":"2024-09-12T18:02:00.654264+0000","last_fullsized":"2024-09-12T18:02:00.654264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:00.654154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:00.654154+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.654154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:58.454140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00048562399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.149994+0000","last_change":"2024-09-12T18:02:08.149994+0000","last_active":"2024-09-12T18:02:08.149994+0000","last_peered":"2024-09-12T18:02:08.149994+0000","last_clean":"2024-09-12T18:02:08.149994+0000","last_became_active":"2024-09-12T17:23:44.147347+0000","last_became_peered":"2024-09-12T17:23:44.147347+0000","last_unstale":"2024-09-12T18:02:08.149994+0000","last_undegraded":"2024-09-12T18:02:08.149994+0000","last_fullsized":"2024-09-12T18:02:08.149994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:08.149901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:08.149901+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.149901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:21.117683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"261'157","reported_seq":713,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.048995+0000","last_change":"2024-09-12T18:02:17.048995+0000","last_active":"2024-09-12T18:02:17.048995+0000","last_peered":"2024-09-12T18:02:17.048995+0000","last_clean":"2024-09-12T18:02:17.048995+0000","last_became_active":"2024-09-12T17:23:46.241046+0000","last_became_peered":"2024-09-12T17:23:46.241046+0000","last_unstale":"2024-09-12T18:02:17.048995+0000","last_undegraded":"2024-09-12T18:02:17.048995+0000","last_fullsized":"2024-09-12T18:02:17.048995+0000","mapping_epoch":29,"log_start":"258'100","ondisk_log_start":"258'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'157","last_scrub_stamp":"2024-09-12T18:02:17.048897+0000","last_deep_scrub":"261'157","last_deep_scrub_stamp":"2024-09-12T18:02:17.048897+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.048897+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:15.742303+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":154,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"261'795","reported_seq":2353,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.142744+0000","last_change":"2024-09-12T18:02:27.142744+0000","last_active":"2024-09-12T18:02:27.142744+0000","last_peered":"2024-09-12T18:02:27.142744+0000","last_clean":"2024-09-12T18:02:27.142744+0000","last_became_active":"2024-09-12T17:23:48.173351+0000","last_became_peered":"2024-09-12T17:23:48.173351+0000","last_unstale":"2024-09-12T18:02:27.142744+0000","last_undegraded":"2024-09-12T18:02:27.142744+0000","last_fullsized":"2024-09-12T18:02:27.142744+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'795","last_scrub_stamp":"2024-09-12T18:02:27.142659+0000","last_deep_scrub":"261'795","last_deep_scrub_stamp":"2024-09-12T18:02:27.142659+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.142659+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:11.902738+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"261'106","reported_seq":602,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.396475+0000","last_change":"2024-09-12T18:02:34.396475+0000","last_active":"2024-09-12T18:02:34.396475+0000","last_peered":"2024-09-12T18:02:34.396475+0000","last_clean":"2024-09-12T18:02:34.396475+0000","last_became_active":"2024-09-12T17:23:50.639054+0000","last_became_peered":"2024-09-12T17:23:50.639054+0000","last_unstale":"2024-09-12T18:02:34.396475+0000","last_undegraded":"2024-09-12T18:02:34.396475+0000","last_fullsized":"2024-09-12T18:02:34.396475+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'106","last_scrub_stamp":"2024-09-12T18:02:34.396378+0000","last_deep_scrub":"261'106","last_deep_scrub_stamp":"2024-09-12T18:02:34.396378+0000","last_clean_scrub_stamp":"2024-09-12T18:02:34.396378+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:36.065703+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":220,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"261'498","reported_seq":2027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.237197+0000","last_change":"2024-09-12T18:02:07.237197+0000","last_active":"2024-09-12T18:02:07.237197+0000","last_peered":"2024-09-12T18:02:07.237197+0000","last_clean":"2024-09-12T18:02:07.237197+0000","last_became_active":"2024-09-12T17:23:42.148523+0000","last_became_peered":"2024-09-12T17:23:42.148523+0000","last_unstale":"2024-09-12T18:02:07.237197+0000","last_undegraded":"2024-09-12T18:02:07.237197+0000","last_fullsized":"2024-09-12T18:02:07.237197+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'498","last_scrub_stamp":"2024-09-12T18:02:07.237103+0000","last_deep_scrub":"261'498","last_deep_scrub_stamp":"2024-09-12T18:02:07.237103+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.237103+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:26.038707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2488,"num_read_kb":2312,"num_write":602,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":892,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"261'378","reported_seq":1102,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.174066+0000","last_change":"2024-09-12T18:01:57.174066+0000","last_active":"2024-09-12T18:01:57.174066+0000","last_peered":"2024-09-12T18:01:57.174066+0000","last_clean":"2024-09-12T18:01:57.174066+0000","last_became_active":"2024-09-12T17:23:40.709077+0000","last_became_peered":"2024-09-12T17:23:40.709077+0000","last_unstale":"2024-09-12T18:01:57.174066+0000","last_undegraded":"2024-09-12T18:01:57.174066+0000","last_fullsized":"2024-09-12T18:01:57.174066+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'378","last_scrub_stamp":"2024-09-12T18:01:57.173981+0000","last_deep_scrub":"261'378","last_deep_scrub_stamp":"2024-09-12T18:01:57.173981+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.173981+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:35.684048+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8154045,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":687,"num_read_kb":135818,"num_write":1222,"num_write_kb":56746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":521,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.952985+0000","last_change":"2024-09-12T18:01:56.952897+0000","last_active":"2024-09-12T18:01:56.952985+0000","last_peered":"2024-09-12T18:01:56.952985+0000","last_clean":"2024-09-12T18:01:56.952985+0000","last_became_active":"2024-09-12T17:23:31.588526+0000","last_became_peered":"2024-09-12T17:23:31.588526+0000","last_unstale":"2024-09-12T18:01:56.952985+0000","last_undegraded":"2024-09-12T18:01:56.952985+0000","last_fullsized":"2024-09-12T18:01:56.952985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:56.952784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:56.952784+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.952784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:58.755509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055923099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.176243+0000","last_change":"2024-09-12T18:02:17.176243+0000","last_active":"2024-09-12T18:02:17.176243+0000","last_peered":"2024-09-12T18:02:17.176243+0000","last_clean":"2024-09-12T18:02:17.176243+0000","last_became_active":"2024-09-12T17:23:44.147594+0000","last_became_peered":"2024-09-12T17:23:44.147594+0000","last_unstale":"2024-09-12T18:02:17.176243+0000","last_undegraded":"2024-09-12T18:02:17.176243+0000","last_fullsized":"2024-09-12T18:02:17.176243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:17.176158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:17.176158+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.176158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:58.923912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"261'102","reported_seq":634,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.203083+0000","last_change":"2024-09-12T18:02:20.203083+0000","last_active":"2024-09-12T18:02:20.203083+0000","last_peered":"2024-09-12T18:02:20.203083+0000","last_clean":"2024-09-12T18:02:20.203083+0000","last_became_active":"2024-09-12T17:23:46.151335+0000","last_became_peered":"2024-09-12T17:23:46.151335+0000","last_unstale":"2024-09-12T18:02:20.203083+0000","last_undegraded":"2024-09-12T18:02:20.203083+0000","last_fullsized":"2024-09-12T18:02:20.203083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'102","last_scrub_stamp":"2024-09-12T18:02:20.202996+0000","last_deep_scrub":"261'102","last_deep_scrub_stamp":"2024-09-12T18:02:20.202996+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.202996+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:35.603053+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"261'808","reported_seq":2596,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.327575+0000","last_change":"2024-09-12T18:02:28.327575+0000","last_active":"2024-09-12T18:02:28.327575+0000","last_peered":"2024-09-12T18:02:28.327575+0000","last_clean":"2024-09-12T18:02:28.327575+0000","last_became_active":"2024-09-12T17:23:48.167739+0000","last_became_peered":"2024-09-12T17:23:48.167739+0000","last_unstale":"2024-09-12T18:02:28.327575+0000","last_undegraded":"2024-09-12T18:02:28.327575+0000","last_fullsized":"2024-09-12T18:02:28.327575+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'808","last_scrub_stamp":"2024-09-12T18:02:28.327479+0000","last_deep_scrub":"261'808","last_deep_scrub_stamp":"2024-09-12T18:02:28.327479+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.327479+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:39.277808+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"261'315","reported_seq":842,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.571415+0000","last_change":"2024-09-12T18:02:27.571415+0000","last_active":"2024-09-12T18:02:27.571415+0000","last_peered":"2024-09-12T18:02:27.571415+0000","last_clean":"2024-09-12T18:02:27.571415+0000","last_became_active":"2024-09-12T17:23:50.179127+0000","last_became_peered":"2024-09-12T17:23:50.179127+0000","last_unstale":"2024-09-12T18:02:27.571415+0000","last_undegraded":"2024-09-12T18:02:27.571415+0000","last_fullsized":"2024-09-12T18:02:27.571415+0000","mapping_epoch":33,"log_start":"261'300","ondisk_log_start":"261'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'315","last_scrub_stamp":"2024-09-12T18:02:27.571322+0000","last_deep_scrub":"261'315","last_deep_scrub_stamp":"2024-09-12T18:02:27.571322+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.571322+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:01.014783+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":442,"num_write":705,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"261'1032","reported_seq":2767,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.065931+0000","last_change":"2024-09-12T18:02:02.065931+0000","last_active":"2024-09-12T18:02:02.065931+0000","last_peered":"2024-09-12T18:02:02.065931+0000","last_clean":"2024-09-12T18:02:02.065931+0000","last_became_active":"2024-09-12T17:23:42.145139+0000","last_became_peered":"2024-09-12T17:23:42.145139+0000","last_unstale":"2024-09-12T18:02:02.065931+0000","last_undegraded":"2024-09-12T18:02:02.065931+0000","last_fullsized":"2024-09-12T18:02:02.065931+0000","mapping_epoch":25,"log_start":"261'1000","ondisk_log_start":"261'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1032","last_scrub_stamp":"2024-09-12T18:02:02.065838+0000","last_deep_scrub":"261'1032","last_deep_scrub_stamp":"2024-09-12T18:02:02.065838+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.065838+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":1000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:57.748014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4954,"num_read_kb":4437,"num_write":1455,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"261'378","reported_seq":1033,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.770846+0000","last_change":"2024-09-12T18:01:56.770846+0000","last_active":"2024-09-12T18:01:56.770846+0000","last_peered":"2024-09-12T18:01:56.770846+0000","last_clean":"2024-09-12T18:01:56.770846+0000","last_became_active":"2024-09-12T17:23:40.712974+0000","last_became_peered":"2024-09-12T17:23:40.712974+0000","last_unstale":"2024-09-12T18:01:56.770846+0000","last_undegraded":"2024-09-12T18:01:56.770846+0000","last_fullsized":"2024-09-12T18:01:56.770846+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'378","last_scrub_stamp":"2024-09-12T18:01:56.770724+0000","last_deep_scrub":"261'378","last_deep_scrub_stamp":"2024-09-12T18:01:56.770724+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.770724+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:19.994907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048959,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":103148,"num_write":1174,"num_write_kb":43429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.062048+0000","last_change":"2024-09-12T18:02:01.061986+0000","last_active":"2024-09-12T18:02:01.062048+0000","last_peered":"2024-09-12T18:02:01.062048+0000","last_clean":"2024-09-12T18:02:01.062048+0000","last_became_active":"2024-09-12T17:23:31.588266+0000","last_became_peered":"2024-09-12T17:23:31.588266+0000","last_unstale":"2024-09-12T18:02:01.062048+0000","last_undegraded":"2024-09-12T18:02:01.062048+0000","last_fullsized":"2024-09-12T18:02:01.062048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:01.061897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:01.061897+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.061897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:32.592640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051630700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.243385+0000","last_change":"2024-09-12T18:02:19.243385+0000","last_active":"2024-09-12T18:02:19.243385+0000","last_peered":"2024-09-12T18:02:19.243385+0000","last_clean":"2024-09-12T18:02:19.243385+0000","last_became_active":"2024-09-12T17:23:44.149649+0000","last_became_peered":"2024-09-12T17:23:44.149649+0000","last_unstale":"2024-09-12T18:02:19.243385+0000","last_undegraded":"2024-09-12T18:02:19.243385+0000","last_fullsized":"2024-09-12T18:02:19.243385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:19.243293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:19.243293+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.243293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:02.359442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"261'699","reported_seq":1407,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.714172+0000","last_change":"2024-09-12T18:02:19.714172+0000","last_active":"2024-09-12T18:02:19.714172+0000","last_peered":"2024-09-12T18:02:19.714172+0000","last_clean":"2024-09-12T18:02:19.714172+0000","last_became_active":"2024-09-12T17:23:46.241681+0000","last_became_peered":"2024-09-12T17:23:46.241681+0000","last_unstale":"2024-09-12T18:02:19.714172+0000","last_undegraded":"2024-09-12T18:02:19.714172+0000","last_fullsized":"2024-09-12T18:02:19.714172+0000","mapping_epoch":29,"log_start":"261'600","ondisk_log_start":"261'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'699","last_scrub_stamp":"2024-09-12T18:02:19.714079+0000","last_deep_scrub":"261'699","last_deep_scrub_stamp":"2024-09-12T18:02:19.714079+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.714079+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":600,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:03.530890+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155444,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1250,"num_read_kb":2999,"num_write":1014,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.278596+0000","last_change":"2024-09-12T18:02:27.278596+0000","last_active":"2024-09-12T18:02:27.278596+0000","last_peered":"2024-09-12T18:02:27.278596+0000","last_clean":"2024-09-12T18:02:27.278596+0000","last_became_active":"2024-09-12T17:23:48.170687+0000","last_became_peered":"2024-09-12T17:23:48.170687+0000","last_unstale":"2024-09-12T18:02:27.278596+0000","last_undegraded":"2024-09-12T18:02:27.278596+0000","last_fullsized":"2024-09-12T18:02:27.278596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:27.278501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:27.278501+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.278501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:14.871907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"261'138","reported_seq":678,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.156061+0000","last_change":"2024-09-12T18:02:30.156061+0000","last_active":"2024-09-12T18:02:30.156061+0000","last_peered":"2024-09-12T18:02:30.156061+0000","last_clean":"2024-09-12T18:02:30.156061+0000","last_became_active":"2024-09-12T17:23:50.188042+0000","last_became_peered":"2024-09-12T17:23:50.188042+0000","last_unstale":"2024-09-12T18:02:30.156061+0000","last_undegraded":"2024-09-12T18:02:30.156061+0000","last_fullsized":"2024-09-12T18:02:30.156061+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'138","last_scrub_stamp":"2024-09-12T18:02:30.155950+0000","last_deep_scrub":"261'138","last_deep_scrub_stamp":"2024-09-12T18:02:30.155950+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.155950+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:45.806522+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":351,"num_read_kb":302,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"261'130","reported_seq":679,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.707739+0000","last_change":"2024-09-12T18:02:32.707739+0000","last_active":"2024-09-12T18:02:32.707739+0000","last_peered":"2024-09-12T18:02:32.707739+0000","last_clean":"2024-09-12T18:02:32.707739+0000","last_became_active":"2024-09-12T17:23:50.189955+0000","last_became_peered":"2024-09-12T17:23:50.189955+0000","last_unstale":"2024-09-12T18:02:32.707739+0000","last_undegraded":"2024-09-12T18:02:32.707739+0000","last_fullsized":"2024-09-12T18:02:32.707739+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'130","last_scrub_stamp":"2024-09-12T18:02:32.707641+0000","last_deep_scrub":"261'130","last_deep_scrub_stamp":"2024-09-12T18:02:32.707641+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.707641+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:53.507529+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":232,"num_write":318,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"261'332","reported_seq":1807,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.103984+0000","last_change":"2024-09-12T18:02:05.103984+0000","last_active":"2024-09-12T18:02:05.103984+0000","last_peered":"2024-09-12T18:02:05.103984+0000","last_clean":"2024-09-12T18:02:05.103984+0000","last_became_active":"2024-09-12T17:23:42.138899+0000","last_became_peered":"2024-09-12T17:23:42.138899+0000","last_unstale":"2024-09-12T18:02:05.103984+0000","last_undegraded":"2024-09-12T18:02:05.103984+0000","last_fullsized":"2024-09-12T18:02:05.103984+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'332","last_scrub_stamp":"2024-09-12T18:02:05.103884+0000","last_deep_scrub":"261'332","last_deep_scrub_stamp":"2024-09-12T18:02:05.103884+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.103884+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:33.934674+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1873,"num_read_kb":1826,"num_write":350,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"261'371","reported_seq":1012,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.041826+0000","last_change":"2024-09-12T18:01:59.041826+0000","last_active":"2024-09-12T18:01:59.041826+0000","last_peered":"2024-09-12T18:01:59.041826+0000","last_clean":"2024-09-12T18:01:59.041826+0000","last_became_active":"2024-09-12T17:23:40.709219+0000","last_became_peered":"2024-09-12T17:23:40.709219+0000","last_unstale":"2024-09-12T18:01:59.041826+0000","last_undegraded":"2024-09-12T18:01:59.041826+0000","last_fullsized":"2024-09-12T18:01:59.041826+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'371","last_scrub_stamp":"2024-09-12T18:01:59.041598+0000","last_deep_scrub":"261'371","last_deep_scrub_stamp":"2024-09-12T18:01:59.041598+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.041598+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:07.760220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":4301,"num_write":1267,"num_write_kb":9304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.977761+0000","last_change":"2024-09-12T18:02:09.977761+0000","last_active":"2024-09-12T18:02:09.977761+0000","last_peered":"2024-09-12T18:02:09.977761+0000","last_clean":"2024-09-12T18:02:09.977761+0000","last_became_active":"2024-09-12T17:23:44.151175+0000","last_became_peered":"2024-09-12T17:23:44.151175+0000","last_unstale":"2024-09-12T18:02:09.977761+0000","last_undegraded":"2024-09-12T18:02:09.977761+0000","last_fullsized":"2024-09-12T18:02:09.977761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:09.977657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:09.977657+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.977657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:18.070048+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"261'281","reported_seq":849,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.329809+0000","last_change":"2024-09-12T18:02:22.329809+0000","last_active":"2024-09-12T18:02:22.329809+0000","last_peered":"2024-09-12T18:02:22.329809+0000","last_clean":"2024-09-12T18:02:22.329809+0000","last_became_active":"2024-09-12T17:23:46.150505+0000","last_became_peered":"2024-09-12T17:23:46.150505+0000","last_unstale":"2024-09-12T18:02:22.329809+0000","last_undegraded":"2024-09-12T18:02:22.329809+0000","last_fullsized":"2024-09-12T18:02:22.329809+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'281","last_scrub_stamp":"2024-09-12T18:02:22.329716+0000","last_deep_scrub":"261'281","last_deep_scrub_stamp":"2024-09-12T18:02:22.329716+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.329716+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:15.914502+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80053,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":479,"num_read_kb":1186,"num_write":396,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.373878+0000","last_change":"2024-09-12T18:02:33.373878+0000","last_active":"2024-09-12T18:02:33.373878+0000","last_peered":"2024-09-12T18:02:33.373878+0000","last_clean":"2024-09-12T18:02:33.373878+0000","last_became_active":"2024-09-12T17:23:48.167911+0000","last_became_peered":"2024-09-12T17:23:48.167911+0000","last_unstale":"2024-09-12T18:02:33.373878+0000","last_undegraded":"2024-09-12T18:02:33.373878+0000","last_fullsized":"2024-09-12T18:02:33.373878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:33.373775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:33.373775+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.373775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:15.476740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"261'95","reported_seq":593,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:37.489717+0000","last_change":"2024-09-12T18:02:37.489717+0000","last_active":"2024-09-12T18:02:37.489717+0000","last_peered":"2024-09-12T18:02:37.489717+0000","last_clean":"2024-09-12T18:02:37.489717+0000","last_became_active":"2024-09-12T17:23:50.183400+0000","last_became_peered":"2024-09-12T17:23:50.183400+0000","last_unstale":"2024-09-12T18:02:37.489717+0000","last_undegraded":"2024-09-12T18:02:37.489717+0000","last_fullsized":"2024-09-12T18:02:37.489717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'95","last_scrub_stamp":"2024-09-12T18:02:37.489626+0000","last_deep_scrub":"261'95","last_deep_scrub_stamp":"2024-09-12T18:02:37.489626+0000","last_clean_scrub_stamp":"2024-09-12T18:02:37.489626+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:39.081170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":128,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"261'480","reported_seq":1894,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.032918+0000","last_change":"2024-09-12T18:02:08.032918+0000","last_active":"2024-09-12T18:02:08.032918+0000","last_peered":"2024-09-12T18:02:08.032918+0000","last_clean":"2024-09-12T18:02:08.032918+0000","last_became_active":"2024-09-12T17:23:42.137988+0000","last_became_peered":"2024-09-12T17:23:42.137988+0000","last_unstale":"2024-09-12T18:02:08.032918+0000","last_undegraded":"2024-09-12T18:02:08.032918+0000","last_fullsized":"2024-09-12T18:02:08.032918+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'480","last_scrub_stamp":"2024-09-12T18:02:08.032812+0000","last_deep_scrub":"261'480","last_deep_scrub_stamp":"2024-09-12T18:02:08.032812+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.032812+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:49.513754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2384,"num_read_kb":2190,"num_write":595,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"261'377","reported_seq":1024,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.757547+0000","last_change":"2024-09-12T18:02:05.757480+0000","last_active":"2024-09-12T18:02:05.757547+0000","last_peered":"2024-09-12T18:02:05.757547+0000","last_clean":"2024-09-12T18:02:05.757547+0000","last_became_active":"2024-09-12T17:23:40.710425+0000","last_became_peered":"2024-09-12T17:23:40.710425+0000","last_unstale":"2024-09-12T18:02:05.757547+0000","last_undegraded":"2024-09-12T18:02:05.757547+0000","last_fullsized":"2024-09-12T18:02:05.757547+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'377","last_scrub_stamp":"2024-09-12T18:02:05.757380+0000","last_deep_scrub":"261'377","last_deep_scrub_stamp":"2024-09-12T18:02:05.757380+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.757380+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:11.058871+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6598189,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":49330,"num_write":1152,"num_write_kb":37186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.276322+0000","last_change":"2024-09-12T18:02:15.276322+0000","last_active":"2024-09-12T18:02:15.276322+0000","last_peered":"2024-09-12T18:02:15.276322+0000","last_clean":"2024-09-12T18:02:15.276322+0000","last_became_active":"2024-09-12T17:23:44.148078+0000","last_became_peered":"2024-09-12T17:23:44.148078+0000","last_unstale":"2024-09-12T18:02:15.276322+0000","last_undegraded":"2024-09-12T18:02:15.276322+0000","last_fullsized":"2024-09-12T18:02:15.276322+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:15.276227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:15.276227+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.276227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:44.747010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"261'45","reported_seq":540,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.563257+0000","last_change":"2024-09-12T18:02:17.563257+0000","last_active":"2024-09-12T18:02:17.563257+0000","last_peered":"2024-09-12T18:02:17.563257+0000","last_clean":"2024-09-12T18:02:17.563257+0000","last_became_active":"2024-09-12T17:23:46.151258+0000","last_became_peered":"2024-09-12T17:23:46.151258+0000","last_unstale":"2024-09-12T18:02:17.563257+0000","last_undegraded":"2024-09-12T18:02:17.563257+0000","last_fullsized":"2024-09-12T18:02:17.563257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'45","last_scrub_stamp":"2024-09-12T18:02:17.563159+0000","last_deep_scrub":"261'45","last_deep_scrub_stamp":"2024-09-12T18:02:17.563159+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.563159+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:26.970725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":25,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.738619+0000","last_change":"2024-09-12T18:02:26.738619+0000","last_active":"2024-09-12T18:02:26.738619+0000","last_peered":"2024-09-12T18:02:26.738619+0000","last_clean":"2024-09-12T18:02:26.738619+0000","last_became_active":"2024-09-12T17:23:48.173781+0000","last_became_peered":"2024-09-12T17:23:48.173781+0000","last_unstale":"2024-09-12T18:02:26.738619+0000","last_undegraded":"2024-09-12T18:02:26.738619+0000","last_fullsized":"2024-09-12T18:02:26.738619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:26.738530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:26.738530+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.738530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:58.104164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"261'167","reported_seq":677,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.678537+0000","last_change":"2024-09-12T18:02:30.678537+0000","last_active":"2024-09-12T18:02:30.678537+0000","last_peered":"2024-09-12T18:02:30.678537+0000","last_clean":"2024-09-12T18:02:30.678537+0000","last_became_active":"2024-09-12T17:23:50.183784+0000","last_became_peered":"2024-09-12T17:23:50.183784+0000","last_unstale":"2024-09-12T18:02:30.678537+0000","last_undegraded":"2024-09-12T18:02:30.678537+0000","last_fullsized":"2024-09-12T18:02:30.678537+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'167","last_scrub_stamp":"2024-09-12T18:02:30.678426+0000","last_deep_scrub":"261'167","last_deep_scrub_stamp":"2024-09-12T18:02:30.678426+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.678426+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:17.172239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":278,"num_read_kb":278,"num_write":359,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"261'419","reported_seq":1962,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.192402+0000","last_change":"2024-09-12T18:02:06.192402+0000","last_active":"2024-09-12T18:02:06.192402+0000","last_peered":"2024-09-12T18:02:06.192402+0000","last_clean":"2024-09-12T18:02:06.192402+0000","last_became_active":"2024-09-12T17:23:42.146703+0000","last_became_peered":"2024-09-12T17:23:42.146703+0000","last_unstale":"2024-09-12T18:02:06.192402+0000","last_undegraded":"2024-09-12T18:02:06.192402+0000","last_fullsized":"2024-09-12T18:02:06.192402+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'419","last_scrub_stamp":"2024-09-12T18:02:06.192317+0000","last_deep_scrub":"261'419","last_deep_scrub_stamp":"2024-09-12T18:02:06.192317+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.192317+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:52.444010+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2240,"num_read_kb":2131,"num_write":479,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":501,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"261'293","reported_seq":959,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.316196+0000","last_change":"2024-09-12T18:02:01.316120+0000","last_active":"2024-09-12T18:02:01.316196+0000","last_peered":"2024-09-12T18:02:01.316196+0000","last_clean":"2024-09-12T18:02:01.316196+0000","last_became_active":"2024-09-12T17:23:40.704278+0000","last_became_peered":"2024-09-12T17:23:40.704278+0000","last_unstale":"2024-09-12T18:02:01.316196+0000","last_undegraded":"2024-09-12T18:02:01.316196+0000","last_fullsized":"2024-09-12T18:02:01.316196+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'293","last_scrub_stamp":"2024-09-12T18:02:01.316032+0000","last_deep_scrub":"261'293","last_deep_scrub_stamp":"2024-09-12T18:02:01.316032+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.316032+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:16.068553+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3045160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":96519,"num_write":927,"num_write_kb":33057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.706883+0000","last_change":"2024-09-12T18:02:17.706883+0000","last_active":"2024-09-12T18:02:17.706883+0000","last_peered":"2024-09-12T18:02:17.706883+0000","last_clean":"2024-09-12T18:02:17.706883+0000","last_became_active":"2024-09-12T17:23:44.149838+0000","last_became_peered":"2024-09-12T17:23:44.149838+0000","last_unstale":"2024-09-12T18:02:17.706883+0000","last_undegraded":"2024-09-12T18:02:17.706883+0000","last_fullsized":"2024-09-12T18:02:17.706883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:17.706800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:17.706800+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.706800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:08.623448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"261'306","reported_seq":890,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.324912+0000","last_change":"2024-09-12T18:02:23.324912+0000","last_active":"2024-09-12T18:02:23.324912+0000","last_peered":"2024-09-12T18:02:23.324912+0000","last_clean":"2024-09-12T18:02:23.324912+0000","last_became_active":"2024-09-12T17:23:46.150528+0000","last_became_peered":"2024-09-12T17:23:46.150528+0000","last_unstale":"2024-09-12T18:02:23.324912+0000","last_undegraded":"2024-09-12T18:02:23.324912+0000","last_fullsized":"2024-09-12T18:02:23.324912+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'306","last_scrub_stamp":"2024-09-12T18:02:23.324823+0000","last_deep_scrub":"261'306","last_deep_scrub_stamp":"2024-09-12T18:02:23.324823+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.324823+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:51.330358+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45198,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":1096,"num_write":398,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.097012+0000","last_change":"2024-09-12T18:02:15.097012+0000","last_active":"2024-09-12T18:02:15.097012+0000","last_peered":"2024-09-12T18:02:15.097012+0000","last_clean":"2024-09-12T18:02:15.097012+0000","last_became_active":"2024-09-12T17:23:48.171031+0000","last_became_peered":"2024-09-12T17:23:48.171031+0000","last_unstale":"2024-09-12T18:02:15.097012+0000","last_undegraded":"2024-09-12T18:02:15.097012+0000","last_fullsized":"2024-09-12T18:02:15.097012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:15.096890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:15.096890+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.096890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:37.985935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"261'155","reported_seq":666,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.172024+0000","last_change":"2024-09-12T18:02:34.172024+0000","last_active":"2024-09-12T18:02:34.172024+0000","last_peered":"2024-09-12T18:02:34.172024+0000","last_clean":"2024-09-12T18:02:34.172024+0000","last_became_active":"2024-09-12T17:23:50.185846+0000","last_became_peered":"2024-09-12T17:23:50.185846+0000","last_unstale":"2024-09-12T18:02:34.172024+0000","last_undegraded":"2024-09-12T18:02:34.172024+0000","last_fullsized":"2024-09-12T18:02:34.172024+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'155","last_scrub_stamp":"2024-09-12T18:02:34.171906+0000","last_deep_scrub":"261'155","last_deep_scrub_stamp":"2024-09-12T18:02:34.171906+0000","last_clean_scrub_stamp":"2024-09-12T18:02:34.171906+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:47.312682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":366,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"261'794","reported_seq":2414,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.273399+0000","last_change":"2024-09-12T18:02:11.273399+0000","last_active":"2024-09-12T18:02:11.273399+0000","last_peered":"2024-09-12T18:02:11.273399+0000","last_clean":"2024-09-12T18:02:11.273399+0000","last_became_active":"2024-09-12T17:23:42.154925+0000","last_became_peered":"2024-09-12T17:23:42.154925+0000","last_unstale":"2024-09-12T18:02:11.273399+0000","last_undegraded":"2024-09-12T18:02:11.273399+0000","last_fullsized":"2024-09-12T18:02:11.273399+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'794","last_scrub_stamp":"2024-09-12T18:02:11.273304+0000","last_deep_scrub":"261'794","last_deep_scrub_stamp":"2024-09-12T18:02:11.273304+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.273304+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:14.231877+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3893,"num_read_kb":3543,"num_write":1032,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"261'364","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:54.755889+0000","last_change":"2024-09-12T18:01:54.755805+0000","last_active":"2024-09-12T18:01:54.755889+0000","last_peered":"2024-09-12T18:01:54.755889+0000","last_clean":"2024-09-12T18:01:54.755889+0000","last_became_active":"2024-09-12T17:23:40.708670+0000","last_became_peered":"2024-09-12T17:23:40.708670+0000","last_unstale":"2024-09-12T18:01:54.755889+0000","last_undegraded":"2024-09-12T18:01:54.755889+0000","last_fullsized":"2024-09-12T18:01:54.755889+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'364","last_scrub_stamp":"2024-09-12T18:01:54.755697+0000","last_deep_scrub":"261'364","last_deep_scrub_stamp":"2024-09-12T18:01:54.755697+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.755697+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:28.461074+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306433,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":1950,"num_write":1111,"num_write_kb":27043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.155600+0000","last_change":"2024-09-12T18:02:12.155600+0000","last_active":"2024-09-12T18:02:12.155600+0000","last_peered":"2024-09-12T18:02:12.155600+0000","last_clean":"2024-09-12T18:02:12.155600+0000","last_became_active":"2024-09-12T17:23:44.149907+0000","last_became_peered":"2024-09-12T17:23:44.149907+0000","last_unstale":"2024-09-12T18:02:12.155600+0000","last_undegraded":"2024-09-12T18:02:12.155600+0000","last_fullsized":"2024-09-12T18:02:12.155600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:12.155514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:12.155514+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.155514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:15.472208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"261'280","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.813283+0000","last_change":"2024-09-12T18:02:22.813283+0000","last_active":"2024-09-12T18:02:22.813283+0000","last_peered":"2024-09-12T18:02:22.813283+0000","last_clean":"2024-09-12T18:02:22.813283+0000","last_became_active":"2024-09-12T17:23:46.149987+0000","last_became_peered":"2024-09-12T17:23:46.149987+0000","last_unstale":"2024-09-12T18:02:22.813283+0000","last_undegraded":"2024-09-12T18:02:22.813283+0000","last_fullsized":"2024-09-12T18:02:22.813283+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'280","last_scrub_stamp":"2024-09-12T18:02:22.813122+0000","last_deep_scrub":"261'280","last_deep_scrub_stamp":"2024-09-12T18:02:22.813122+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.813122+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:06.437239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46832,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":1121,"num_write":390,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.705411+0000","last_change":"2024-09-12T18:02:31.705411+0000","last_active":"2024-09-12T18:02:31.705411+0000","last_peered":"2024-09-12T18:02:31.705411+0000","last_clean":"2024-09-12T18:02:31.705411+0000","last_became_active":"2024-09-12T17:23:48.169308+0000","last_became_peered":"2024-09-12T17:23:48.169308+0000","last_unstale":"2024-09-12T18:02:31.705411+0000","last_undegraded":"2024-09-12T18:02:31.705411+0000","last_fullsized":"2024-09-12T18:02:31.705411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:31.705317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:31.705317+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.705317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:15.786791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"261'807","reported_seq":2262,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.135687+0000","last_change":"2024-09-12T18:02:06.135687+0000","last_active":"2024-09-12T18:02:06.135687+0000","last_peered":"2024-09-12T18:02:06.135687+0000","last_clean":"2024-09-12T18:02:06.135687+0000","last_became_active":"2024-09-12T17:23:42.148412+0000","last_became_peered":"2024-09-12T17:23:42.148412+0000","last_unstale":"2024-09-12T18:02:06.135687+0000","last_undegraded":"2024-09-12T18:02:06.135687+0000","last_fullsized":"2024-09-12T18:02:06.135687+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'807","last_scrub_stamp":"2024-09-12T18:02:06.135591+0000","last_deep_scrub":"261'807","last_deep_scrub_stamp":"2024-09-12T18:02:06.135591+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.135591+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:19.719813+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3663,"num_read_kb":3282,"num_write":1025,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"261'314","reported_seq":954,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.212887+0000","last_change":"2024-09-12T18:02:05.212827+0000","last_active":"2024-09-12T18:02:05.212887+0000","last_peered":"2024-09-12T18:02:05.212887+0000","last_clean":"2024-09-12T18:02:05.212887+0000","last_became_active":"2024-09-12T17:23:40.717447+0000","last_became_peered":"2024-09-12T17:23:40.717447+0000","last_unstale":"2024-09-12T18:02:05.212887+0000","last_undegraded":"2024-09-12T18:02:05.212887+0000","last_fullsized":"2024-09-12T18:02:05.212887+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'314","last_scrub_stamp":"2024-09-12T18:02:05.212709+0000","last_deep_scrub":"261'314","last_deep_scrub_stamp":"2024-09-12T18:02:05.212709+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.212709+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:03.962158+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":485,"num_read_kb":6880,"num_write":973,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.627878+0000","last_change":"2024-09-12T18:02:14.627878+0000","last_active":"2024-09-12T18:02:14.627878+0000","last_peered":"2024-09-12T18:02:14.627878+0000","last_clean":"2024-09-12T18:02:14.627878+0000","last_became_active":"2024-09-12T17:23:44.149799+0000","last_became_peered":"2024-09-12T17:23:44.149799+0000","last_unstale":"2024-09-12T18:02:14.627878+0000","last_undegraded":"2024-09-12T18:02:14.627878+0000","last_fullsized":"2024-09-12T18:02:14.627878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:14.627777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:14.627777+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.627777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:51.256807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"261'487","reported_seq":1116,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.071370+0000","last_change":"2024-09-12T18:02:16.071370+0000","last_active":"2024-09-12T18:02:16.071370+0000","last_peered":"2024-09-12T18:02:16.071370+0000","last_clean":"2024-09-12T18:02:16.071370+0000","last_became_active":"2024-09-12T17:23:46.148861+0000","last_became_peered":"2024-09-12T17:23:46.148861+0000","last_unstale":"2024-09-12T18:02:16.071370+0000","last_undegraded":"2024-09-12T18:02:16.071370+0000","last_fullsized":"2024-09-12T18:02:16.071370+0000","mapping_epoch":29,"log_start":"261'400","ondisk_log_start":"261'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'487","last_scrub_stamp":"2024-09-12T18:02:16.071270+0000","last_deep_scrub":"261'487","last_deep_scrub_stamp":"2024-09-12T18:02:16.071270+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.071270+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:48.773638+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101554,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":879,"num_read_kb":2135,"num_write":756,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.173154+0000","last_change":"2024-09-12T18:02:28.173154+0000","last_active":"2024-09-12T18:02:28.173154+0000","last_peered":"2024-09-12T18:02:28.173154+0000","last_clean":"2024-09-12T18:02:28.173154+0000","last_became_active":"2024-09-12T17:23:48.168566+0000","last_became_peered":"2024-09-12T17:23:48.168566+0000","last_unstale":"2024-09-12T18:02:28.173154+0000","last_undegraded":"2024-09-12T18:02:28.173154+0000","last_fullsized":"2024-09-12T18:02:28.173154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:28.173071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:28.173071+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.173071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:47.649297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"261'219","reported_seq":734,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:35.421467+0000","last_change":"2024-09-12T18:02:35.421467+0000","last_active":"2024-09-12T18:02:35.421467+0000","last_peered":"2024-09-12T18:02:35.421467+0000","last_clean":"2024-09-12T18:02:35.421467+0000","last_became_active":"2024-09-12T17:23:50.641702+0000","last_became_peered":"2024-09-12T17:23:50.641702+0000","last_unstale":"2024-09-12T18:02:35.421467+0000","last_undegraded":"2024-09-12T18:02:35.421467+0000","last_fullsized":"2024-09-12T18:02:35.421467+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'219","last_scrub_stamp":"2024-09-12T18:02:35.421372+0000","last_deep_scrub":"261'219","last_deep_scrub_stamp":"2024-09-12T18:02:35.421372+0000","last_clean_scrub_stamp":"2024-09-12T18:02:35.421372+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:13.033839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":328,"num_write":469,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"261'761","reported_seq":2337,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.610751+0000","last_change":"2024-09-12T18:02:07.610751+0000","last_active":"2024-09-12T18:02:07.610751+0000","last_peered":"2024-09-12T18:02:07.610751+0000","last_clean":"2024-09-12T18:02:07.610751+0000","last_became_active":"2024-09-12T17:23:42.141869+0000","last_became_peered":"2024-09-12T17:23:42.141869+0000","last_unstale":"2024-09-12T18:02:07.610751+0000","last_undegraded":"2024-09-12T18:02:07.610751+0000","last_fullsized":"2024-09-12T18:02:07.610751+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'761","last_scrub_stamp":"2024-09-12T18:02:07.610649+0000","last_deep_scrub":"261'761","last_deep_scrub_stamp":"2024-09-12T18:02:07.610649+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.610649+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:59.154743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3783,"num_read_kb":3443,"num_write":995,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"261'326","reported_seq":936,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.085173+0000","last_change":"2024-09-12T18:02:00.085100+0000","last_active":"2024-09-12T18:02:00.085173+0000","last_peered":"2024-09-12T18:02:00.085173+0000","last_clean":"2024-09-12T18:02:00.085173+0000","last_became_active":"2024-09-12T17:23:40.711679+0000","last_became_peered":"2024-09-12T17:23:40.711679+0000","last_unstale":"2024-09-12T18:02:00.085173+0000","last_undegraded":"2024-09-12T18:02:00.085173+0000","last_fullsized":"2024-09-12T18:02:00.085173+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-12T18:02:00.084987+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-12T18:02:00.084987+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.084987+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:03.235507+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":441,"num_read_kb":3628,"num_write":977,"num_write_kb":35404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.204703+0000","last_change":"2024-09-12T18:02:10.204703+0000","last_active":"2024-09-12T18:02:10.204703+0000","last_peered":"2024-09-12T18:02:10.204703+0000","last_clean":"2024-09-12T18:02:10.204703+0000","last_became_active":"2024-09-12T17:23:44.148044+0000","last_became_peered":"2024-09-12T17:23:44.148044+0000","last_unstale":"2024-09-12T18:02:10.204703+0000","last_undegraded":"2024-09-12T18:02:10.204703+0000","last_fullsized":"2024-09-12T18:02:10.204703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:10.204586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:10.204586+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.204586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:28.253142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"261'300","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.751116+0000","last_change":"2024-09-12T18:02:24.751116+0000","last_active":"2024-09-12T18:02:24.751116+0000","last_peered":"2024-09-12T18:02:24.751116+0000","last_clean":"2024-09-12T18:02:24.751116+0000","last_became_active":"2024-09-12T17:23:46.150380+0000","last_became_peered":"2024-09-12T17:23:46.150380+0000","last_unstale":"2024-09-12T18:02:24.751116+0000","last_undegraded":"2024-09-12T18:02:24.751116+0000","last_fullsized":"2024-09-12T18:02:24.751116+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'300","last_scrub_stamp":"2024-09-12T18:02:24.751022+0000","last_deep_scrub":"261'300","last_deep_scrub_stamp":"2024-09-12T18:02:24.751022+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.751022+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:39.332302+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47278,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":1112,"num_write":416,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.999834+0000","last_change":"2024-09-12T18:02:19.999834+0000","last_active":"2024-09-12T18:02:19.999834+0000","last_peered":"2024-09-12T18:02:19.999834+0000","last_clean":"2024-09-12T18:02:19.999834+0000","last_became_active":"2024-09-12T17:23:48.173575+0000","last_became_peered":"2024-09-12T17:23:48.173575+0000","last_unstale":"2024-09-12T18:02:19.999834+0000","last_undegraded":"2024-09-12T18:02:19.999834+0000","last_fullsized":"2024-09-12T18:02:19.999834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:19.999742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:19.999742+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.999742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:27.971506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"261'195","reported_seq":1059,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.075748+0000","last_change":"2024-09-12T18:02:21.075748+0000","last_active":"2024-09-12T18:02:21.075748+0000","last_peered":"2024-09-12T18:02:21.075748+0000","last_clean":"2024-09-12T18:02:21.075748+0000","last_became_active":"2024-09-12T17:23:50.185853+0000","last_became_peered":"2024-09-12T17:23:50.185853+0000","last_unstale":"2024-09-12T18:02:21.075748+0000","last_undegraded":"2024-09-12T18:02:21.075748+0000","last_fullsized":"2024-09-12T18:02:21.075748+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'195","last_scrub_stamp":"2024-09-12T18:02:21.075656+0000","last_deep_scrub":"261'195","last_deep_scrub_stamp":"2024-09-12T18:02:21.075656+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.075656+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:21.562874+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":633,"num_read_kb":630,"num_write":516,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"261'633","reported_seq":2482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.239446+0000","last_change":"2024-09-12T18:02:12.239446+0000","last_active":"2024-09-12T18:02:12.239446+0000","last_peered":"2024-09-12T18:02:12.239446+0000","last_clean":"2024-09-12T18:02:12.239446+0000","last_became_active":"2024-09-12T17:23:42.154175+0000","last_became_peered":"2024-09-12T17:23:42.154175+0000","last_unstale":"2024-09-12T18:02:12.239446+0000","last_undegraded":"2024-09-12T18:02:12.239446+0000","last_fullsized":"2024-09-12T18:02:12.239446+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'633","last_scrub_stamp":"2024-09-12T18:02:12.239338+0000","last_deep_scrub":"261'633","last_deep_scrub_stamp":"2024-09-12T18:02:12.239338+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.239338+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":600,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:45.683746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3404,"num_read_kb":3151,"num_write":789,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1533,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"261'349","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.040975+0000","last_change":"2024-09-12T18:01:58.040975+0000","last_active":"2024-09-12T18:01:58.040975+0000","last_peered":"2024-09-12T18:01:58.040975+0000","last_clean":"2024-09-12T18:01:58.040975+0000","last_became_active":"2024-09-12T17:23:40.712959+0000","last_became_peered":"2024-09-12T17:23:40.712959+0000","last_unstale":"2024-09-12T18:01:58.040975+0000","last_undegraded":"2024-09-12T18:01:58.040975+0000","last_fullsized":"2024-09-12T18:01:58.040975+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T18:01:58.040878+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T18:01:58.040878+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.040878+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:42.713508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":522,"num_read_kb":11025,"num_write":1066,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.193876+0000","last_change":"2024-09-12T18:02:19.193876+0000","last_active":"2024-09-12T18:02:19.193876+0000","last_peered":"2024-09-12T18:02:19.193876+0000","last_clean":"2024-09-12T18:02:19.193876+0000","last_became_active":"2024-09-12T17:23:44.152006+0000","last_became_peered":"2024-09-12T17:23:44.152006+0000","last_unstale":"2024-09-12T18:02:19.193876+0000","last_undegraded":"2024-09-12T18:02:19.193876+0000","last_fullsized":"2024-09-12T18:02:19.193876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:19.193797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:19.193797+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.193797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:33.141032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"261'255","reported_seq":825,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.325621+0000","last_change":"2024-09-12T18:02:25.325621+0000","last_active":"2024-09-12T18:02:25.325621+0000","last_peered":"2024-09-12T18:02:25.325621+0000","last_clean":"2024-09-12T18:02:25.325621+0000","last_became_active":"2024-09-12T17:23:46.241001+0000","last_became_peered":"2024-09-12T17:23:46.241001+0000","last_unstale":"2024-09-12T18:02:25.325621+0000","last_undegraded":"2024-09-12T18:02:25.325621+0000","last_fullsized":"2024-09-12T18:02:25.325621+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'255","last_scrub_stamp":"2024-09-12T18:02:25.325531+0000","last_deep_scrub":"261'255","last_deep_scrub_stamp":"2024-09-12T18:02:25.325531+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.325531+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:01.527863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42355,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":393,"num_read_kb":868,"num_write":314,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.008014+0000","last_change":"2024-09-12T18:02:19.008014+0000","last_active":"2024-09-12T18:02:19.008014+0000","last_peered":"2024-09-12T18:02:19.008014+0000","last_clean":"2024-09-12T18:02:19.008014+0000","last_became_active":"2024-09-12T17:23:48.170212+0000","last_became_peered":"2024-09-12T17:23:48.170212+0000","last_unstale":"2024-09-12T18:02:19.008014+0000","last_undegraded":"2024-09-12T18:02:19.008014+0000","last_fullsized":"2024-09-12T18:02:19.008014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:19.007879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:19.007879+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.007879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:30.317175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"261'132","reported_seq":620,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.118782+0000","last_change":"2024-09-12T18:02:32.118782+0000","last_active":"2024-09-12T18:02:32.118782+0000","last_peered":"2024-09-12T18:02:32.118782+0000","last_clean":"2024-09-12T18:02:32.118782+0000","last_became_active":"2024-09-12T17:23:50.187329+0000","last_became_peered":"2024-09-12T17:23:50.187329+0000","last_unstale":"2024-09-12T18:02:32.118782+0000","last_undegraded":"2024-09-12T18:02:32.118782+0000","last_fullsized":"2024-09-12T18:02:32.118782+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'132","last_scrub_stamp":"2024-09-12T18:02:32.118687+0000","last_deep_scrub":"261'132","last_deep_scrub_stamp":"2024-09-12T18:02:32.118687+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.118687+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:23.158731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":770,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":154,"num_read_kb":149,"num_write":327,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"261'777","reported_seq":2301,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.938708+0000","last_change":"2024-09-12T18:01:59.938708+0000","last_active":"2024-09-12T18:01:59.938708+0000","last_peered":"2024-09-12T18:01:59.938708+0000","last_clean":"2024-09-12T18:01:59.938708+0000","last_became_active":"2024-09-12T17:23:42.144384+0000","last_became_peered":"2024-09-12T17:23:42.144384+0000","last_unstale":"2024-09-12T18:01:59.938708+0000","last_undegraded":"2024-09-12T18:01:59.938708+0000","last_fullsized":"2024-09-12T18:01:59.938708+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'777","last_scrub_stamp":"2024-09-12T18:01:59.938618+0000","last_deep_scrub":"261'777","last_deep_scrub_stamp":"2024-09-12T18:01:59.938618+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.938618+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:20.494541+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3720,"num_read_kb":3370,"num_write":1041,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"261'331","reported_seq":948,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.748832+0000","last_change":"2024-09-12T18:01:55.748832+0000","last_active":"2024-09-12T18:01:55.748832+0000","last_peered":"2024-09-12T18:01:55.748832+0000","last_clean":"2024-09-12T18:01:55.748832+0000","last_became_active":"2024-09-12T17:23:40.714710+0000","last_became_peered":"2024-09-12T17:23:40.714710+0000","last_unstale":"2024-09-12T18:01:55.748832+0000","last_undegraded":"2024-09-12T18:01:55.748832+0000","last_fullsized":"2024-09-12T18:01:55.748832+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'331","last_scrub_stamp":"2024-09-12T18:01:55.748688+0000","last_deep_scrub":"261'331","last_deep_scrub_stamp":"2024-09-12T18:01:55.748688+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.748688+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:42.546066+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311482,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":467,"num_read_kb":6860,"num_write":1100,"num_write_kb":28418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.007474+0000","last_change":"2024-09-12T18:02:13.007474+0000","last_active":"2024-09-12T18:02:13.007474+0000","last_peered":"2024-09-12T18:02:13.007474+0000","last_clean":"2024-09-12T18:02:13.007474+0000","last_became_active":"2024-09-12T17:23:44.147886+0000","last_became_peered":"2024-09-12T17:23:44.147886+0000","last_unstale":"2024-09-12T18:02:13.007474+0000","last_undegraded":"2024-09-12T18:02:13.007474+0000","last_fullsized":"2024-09-12T18:02:13.007474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:13.007389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:13.007389+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.007389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:11.491836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"261'87","reported_seq":604,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.146248+0000","last_change":"2024-09-12T18:02:26.146248+0000","last_active":"2024-09-12T18:02:26.146248+0000","last_peered":"2024-09-12T18:02:26.146248+0000","last_clean":"2024-09-12T18:02:26.146248+0000","last_became_active":"2024-09-12T17:23:46.241073+0000","last_became_peered":"2024-09-12T17:23:46.241073+0000","last_unstale":"2024-09-12T18:02:26.146248+0000","last_undegraded":"2024-09-12T18:02:26.146248+0000","last_fullsized":"2024-09-12T18:02:26.146248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'87","last_scrub_stamp":"2024-09-12T18:02:26.146111+0000","last_deep_scrub":"261'87","last_deep_scrub_stamp":"2024-09-12T18:02:26.146111+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.146111+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:51.515529+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":73,"num_read_kb":65,"num_write":60,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"261'785","reported_seq":2177,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.122305+0000","last_change":"2024-09-12T18:02:18.122305+0000","last_active":"2024-09-12T18:02:18.122305+0000","last_peered":"2024-09-12T18:02:18.122305+0000","last_clean":"2024-09-12T18:02:18.122305+0000","last_became_active":"2024-09-12T17:23:48.170815+0000","last_became_peered":"2024-09-12T17:23:48.170815+0000","last_unstale":"2024-09-12T18:02:18.122305+0000","last_undegraded":"2024-09-12T18:02:18.122305+0000","last_fullsized":"2024-09-12T18:02:18.122305+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'785","last_scrub_stamp":"2024-09-12T18:02:18.122209+0000","last_deep_scrub":"261'785","last_deep_scrub_stamp":"2024-09-12T18:02:18.122209+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.122209+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:13.299383+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"261'128","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.696630+0000","last_change":"2024-09-12T18:02:29.696630+0000","last_active":"2024-09-12T18:02:29.696630+0000","last_peered":"2024-09-12T18:02:29.696630+0000","last_clean":"2024-09-12T18:02:29.696630+0000","last_became_active":"2024-09-12T17:23:50.190124+0000","last_became_peered":"2024-09-12T17:23:50.190124+0000","last_unstale":"2024-09-12T18:02:29.696630+0000","last_undegraded":"2024-09-12T18:02:29.696630+0000","last_fullsized":"2024-09-12T18:02:29.696630+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'128","last_scrub_stamp":"2024-09-12T18:02:29.696540+0000","last_deep_scrub":"261'128","last_deep_scrub_stamp":"2024-09-12T18:02:29.696540+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.696540+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:44.997582+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":181,"num_read_kb":172,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"261'824","reported_seq":2447,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.135447+0000","last_change":"2024-09-12T18:02:09.135447+0000","last_active":"2024-09-12T18:02:09.135447+0000","last_peered":"2024-09-12T18:02:09.135447+0000","last_clean":"2024-09-12T18:02:09.135447+0000","last_became_active":"2024-09-12T17:23:42.149314+0000","last_became_peered":"2024-09-12T17:23:42.149314+0000","last_unstale":"2024-09-12T18:02:09.135447+0000","last_undegraded":"2024-09-12T18:02:09.135447+0000","last_fullsized":"2024-09-12T18:02:09.135447+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'824","last_scrub_stamp":"2024-09-12T18:02:09.135365+0000","last_deep_scrub":"261'824","last_deep_scrub_stamp":"2024-09-12T18:02:09.135365+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.135365+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:09.176143+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4083,"num_read_kb":3703,"num_write":1086,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":756,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"261'295","reported_seq":924,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.265156+0000","last_change":"2024-09-12T18:02:02.265156+0000","last_active":"2024-09-12T18:02:02.265156+0000","last_peered":"2024-09-12T18:02:02.265156+0000","last_clean":"2024-09-12T18:02:02.265156+0000","last_became_active":"2024-09-12T17:23:40.709818+0000","last_became_peered":"2024-09-12T17:23:40.709818+0000","last_unstale":"2024-09-12T18:02:02.265156+0000","last_undegraded":"2024-09-12T18:02:02.265156+0000","last_fullsized":"2024-09-12T18:02:02.265156+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'295","last_scrub_stamp":"2024-09-12T18:02:02.265077+0000","last_deep_scrub":"261'295","last_deep_scrub_stamp":"2024-09-12T18:02:02.265077+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.265077+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:25.521537+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":426,"num_read_kb":69858,"num_write":935,"num_write_kb":36096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.682930+0000","last_change":"2024-09-12T18:02:18.682930+0000","last_active":"2024-09-12T18:02:18.682930+0000","last_peered":"2024-09-12T18:02:18.682930+0000","last_clean":"2024-09-12T18:02:18.682930+0000","last_became_active":"2024-09-12T17:23:44.150183+0000","last_became_peered":"2024-09-12T17:23:44.150183+0000","last_unstale":"2024-09-12T18:02:18.682930+0000","last_undegraded":"2024-09-12T18:02:18.682930+0000","last_fullsized":"2024-09-12T18:02:18.682930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:18.682841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:18.682841+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.682841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:04.298570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"261'323","reported_seq":898,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.148739+0000","last_change":"2024-09-12T18:02:26.148673+0000","last_active":"2024-09-12T18:02:26.148739+0000","last_peered":"2024-09-12T18:02:26.148739+0000","last_clean":"2024-09-12T18:02:26.148739+0000","last_became_active":"2024-09-12T17:23:46.144587+0000","last_became_peered":"2024-09-12T17:23:46.144587+0000","last_unstale":"2024-09-12T18:02:26.148739+0000","last_undegraded":"2024-09-12T18:02:26.148739+0000","last_fullsized":"2024-09-12T18:02:26.148739+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-12T18:02:26.148565+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-12T18:02:26.148565+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.148565+0000","objects_scrubbed":9,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:12.623163+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46086,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":505,"num_read_kb":1153,"num_write":418,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.611732+0000","last_change":"2024-09-12T18:02:25.611639+0000","last_active":"2024-09-12T18:02:25.611732+0000","last_peered":"2024-09-12T18:02:25.611732+0000","last_clean":"2024-09-12T18:02:25.611732+0000","last_became_active":"2024-09-12T17:23:48.171272+0000","last_became_peered":"2024-09-12T17:23:48.171272+0000","last_unstale":"2024-09-12T18:02:25.611732+0000","last_undegraded":"2024-09-12T18:02:25.611732+0000","last_fullsized":"2024-09-12T18:02:25.611732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:25.611530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:25.611530+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.611530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:45.194075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"261'104","reported_seq":597,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.709004+0000","last_change":"2024-09-12T18:02:32.709004+0000","last_active":"2024-09-12T18:02:32.709004+0000","last_peered":"2024-09-12T18:02:32.709004+0000","last_clean":"2024-09-12T18:02:32.709004+0000","last_became_active":"2024-09-12T17:23:50.191859+0000","last_became_peered":"2024-09-12T17:23:50.191859+0000","last_unstale":"2024-09-12T18:02:32.709004+0000","last_undegraded":"2024-09-12T18:02:32.709004+0000","last_fullsized":"2024-09-12T18:02:32.709004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'104","last_scrub_stamp":"2024-09-12T18:02:32.708900+0000","last_deep_scrub":"261'104","last_deep_scrub_stamp":"2024-09-12T18:02:32.708900+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.708900+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:19.072198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":141,"num_write":249,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"261'477","reported_seq":2065,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.167430+0000","last_change":"2024-09-12T18:02:07.167430+0000","last_active":"2024-09-12T18:02:07.167430+0000","last_peered":"2024-09-12T18:02:07.167430+0000","last_clean":"2024-09-12T18:02:07.167430+0000","last_became_active":"2024-09-12T17:23:42.149260+0000","last_became_peered":"2024-09-12T17:23:42.149260+0000","last_unstale":"2024-09-12T18:02:07.167430+0000","last_undegraded":"2024-09-12T18:02:07.167430+0000","last_fullsized":"2024-09-12T18:02:07.167430+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'477","last_scrub_stamp":"2024-09-12T18:02:07.167342+0000","last_deep_scrub":"261'477","last_deep_scrub_stamp":"2024-09-12T18:02:07.167342+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.167342+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:54.938925+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2426,"num_read_kb":2286,"num_write":546,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"261'381","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.261206+0000","last_change":"2024-09-12T18:02:03.261206+0000","last_active":"2024-09-12T18:02:03.261206+0000","last_peered":"2024-09-12T18:02:03.261206+0000","last_clean":"2024-09-12T18:02:03.261206+0000","last_became_active":"2024-09-12T17:23:40.711032+0000","last_became_peered":"2024-09-12T17:23:40.711032+0000","last_unstale":"2024-09-12T18:02:03.261206+0000","last_undegraded":"2024-09-12T18:02:03.261206+0000","last_fullsized":"2024-09-12T18:02:03.261206+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'381","last_scrub_stamp":"2024-09-12T18:02:03.261091+0000","last_deep_scrub":"261'381","last_deep_scrub_stamp":"2024-09-12T18:02:03.261091+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.261091+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:14.427700+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":607,"num_read_kb":19508,"num_write":1297,"num_write_kb":28388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.162153+0000","last_change":"2024-09-12T18:02:22.162153+0000","last_active":"2024-09-12T18:02:22.162153+0000","last_peered":"2024-09-12T18:02:22.162153+0000","last_clean":"2024-09-12T18:02:22.162153+0000","last_became_active":"2024-09-12T17:23:44.147694+0000","last_became_peered":"2024-09-12T17:23:44.147694+0000","last_unstale":"2024-09-12T18:02:22.162153+0000","last_undegraded":"2024-09-12T18:02:22.162153+0000","last_fullsized":"2024-09-12T18:02:22.162153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:22.162066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:22.162066+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.162066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:39.604814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"261'262","reported_seq":822,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.567988+0000","last_change":"2024-09-12T18:02:19.567887+0000","last_active":"2024-09-12T18:02:19.567988+0000","last_peered":"2024-09-12T18:02:19.567988+0000","last_clean":"2024-09-12T18:02:19.567988+0000","last_became_active":"2024-09-12T17:23:46.152028+0000","last_became_peered":"2024-09-12T17:23:46.152028+0000","last_unstale":"2024-09-12T18:02:19.567988+0000","last_undegraded":"2024-09-12T18:02:19.567988+0000","last_fullsized":"2024-09-12T18:02:19.567988+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'262","last_scrub_stamp":"2024-09-12T18:02:19.567770+0000","last_deep_scrub":"261'262","last_deep_scrub_stamp":"2024-09-12T18:02:19.567770+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.567770+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:40.120655+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":974,"num_write":338,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.110198+0000","last_change":"2024-09-12T18:02:16.110198+0000","last_active":"2024-09-12T18:02:16.110198+0000","last_peered":"2024-09-12T18:02:16.110198+0000","last_clean":"2024-09-12T18:02:16.110198+0000","last_became_active":"2024-09-12T17:23:48.170452+0000","last_became_peered":"2024-09-12T17:23:48.170452+0000","last_unstale":"2024-09-12T18:02:16.110198+0000","last_undegraded":"2024-09-12T18:02:16.110198+0000","last_fullsized":"2024-09-12T18:02:16.110198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:16.110107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:16.110107+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.110107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:51.727297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"261'127","reported_seq":638,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:36.458815+0000","last_change":"2024-09-12T18:02:36.458815+0000","last_active":"2024-09-12T18:02:36.458815+0000","last_peered":"2024-09-12T18:02:36.458815+0000","last_clean":"2024-09-12T18:02:36.458815+0000","last_became_active":"2024-09-12T17:23:50.640911+0000","last_became_peered":"2024-09-12T17:23:50.640911+0000","last_unstale":"2024-09-12T18:02:36.458815+0000","last_undegraded":"2024-09-12T18:02:36.458815+0000","last_fullsized":"2024-09-12T18:02:36.458815+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'127","last_scrub_stamp":"2024-09-12T18:02:36.458662+0000","last_deep_scrub":"261'127","last_deep_scrub_stamp":"2024-09-12T18:02:36.458662+0000","last_clean_scrub_stamp":"2024-09-12T18:02:36.458662+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:11.745887+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":307,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"261'391","reported_seq":1798,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.243312+0000","last_change":"2024-09-12T18:02:10.243251+0000","last_active":"2024-09-12T18:02:10.243312+0000","last_peered":"2024-09-12T18:02:10.243312+0000","last_clean":"2024-09-12T18:02:10.243312+0000","last_became_active":"2024-09-12T17:23:42.146055+0000","last_became_peered":"2024-09-12T17:23:42.146055+0000","last_unstale":"2024-09-12T18:02:10.243312+0000","last_undegraded":"2024-09-12T18:02:10.243312+0000","last_fullsized":"2024-09-12T18:02:10.243312+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'391","last_scrub_stamp":"2024-09-12T18:02:10.243153+0000","last_deep_scrub":"261'391","last_deep_scrub_stamp":"2024-09-12T18:02:10.243153+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.243153+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:14.671527+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1982,"num_read_kb":1877,"num_write":444,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"261'319","reported_seq":944,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.219235+0000","last_change":"2024-09-12T18:02:00.219235+0000","last_active":"2024-09-12T18:02:00.219235+0000","last_peered":"2024-09-12T18:02:00.219235+0000","last_clean":"2024-09-12T18:02:00.219235+0000","last_became_active":"2024-09-12T17:23:40.709759+0000","last_became_peered":"2024-09-12T17:23:40.709759+0000","last_unstale":"2024-09-12T18:02:00.219235+0000","last_undegraded":"2024-09-12T18:02:00.219235+0000","last_fullsized":"2024-09-12T18:02:00.219235+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'319","last_scrub_stamp":"2024-09-12T18:02:00.219087+0000","last_deep_scrub":"261'319","last_deep_scrub_stamp":"2024-09-12T18:02:00.219087+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.219087+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:11.536241+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306344,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":452,"num_read_kb":23018,"num_write":1076,"num_write_kb":26757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.095989+0000","last_change":"2024-09-12T18:02:25.095989+0000","last_active":"2024-09-12T18:02:25.095989+0000","last_peered":"2024-09-12T18:02:25.095989+0000","last_clean":"2024-09-12T18:02:25.095989+0000","last_became_active":"2024-09-12T17:23:44.147372+0000","last_became_peered":"2024-09-12T17:23:44.147372+0000","last_unstale":"2024-09-12T18:02:25.095989+0000","last_undegraded":"2024-09-12T18:02:25.095989+0000","last_fullsized":"2024-09-12T18:02:25.095989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:25.095885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:25.095885+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.095885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:56.421750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"261'245","reported_seq":800,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.318443+0000","last_change":"2024-09-12T18:02:26.318443+0000","last_active":"2024-09-12T18:02:26.318443+0000","last_peered":"2024-09-12T18:02:26.318443+0000","last_clean":"2024-09-12T18:02:26.318443+0000","last_became_active":"2024-09-12T17:23:46.153024+0000","last_became_peered":"2024-09-12T17:23:46.153024+0000","last_unstale":"2024-09-12T18:02:26.318443+0000","last_undegraded":"2024-09-12T18:02:26.318443+0000","last_fullsized":"2024-09-12T18:02:26.318443+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'245","last_scrub_stamp":"2024-09-12T18:02:26.318345+0000","last_deep_scrub":"261'245","last_deep_scrub_stamp":"2024-09-12T18:02:26.318345+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.318345+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:28.556262+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46277,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":401,"num_read_kb":970,"num_write":334,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.100267+0000","last_change":"2024-09-12T18:02:27.100267+0000","last_active":"2024-09-12T18:02:27.100267+0000","last_peered":"2024-09-12T18:02:27.100267+0000","last_clean":"2024-09-12T18:02:27.100267+0000","last_became_active":"2024-09-12T17:23:48.171849+0000","last_became_peered":"2024-09-12T17:23:48.171849+0000","last_unstale":"2024-09-12T18:02:27.100267+0000","last_undegraded":"2024-09-12T18:02:27.100267+0000","last_fullsized":"2024-09-12T18:02:27.100267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:27.100180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:27.100180+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.100180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:51.370449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"261'143","reported_seq":1253,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.731419+0000","last_change":"2024-09-12T18:02:31.731419+0000","last_active":"2024-09-12T18:02:31.731419+0000","last_peered":"2024-09-12T18:02:31.731419+0000","last_clean":"2024-09-12T18:02:31.731419+0000","last_became_active":"2024-09-12T17:23:50.187084+0000","last_became_peered":"2024-09-12T17:23:50.187084+0000","last_unstale":"2024-09-12T18:02:31.731419+0000","last_undegraded":"2024-09-12T18:02:31.731419+0000","last_fullsized":"2024-09-12T18:02:31.731419+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'143","last_scrub_stamp":"2024-09-12T18:02:31.731322+0000","last_deep_scrub":"261'143","last_deep_scrub_stamp":"2024-09-12T18:02:31.731322+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.731322+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:28.520354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":862,"num_read_kb":842,"num_write":338,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"261'421","reported_seq":1880,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.174737+0000","last_change":"2024-09-12T18:02:08.174681+0000","last_active":"2024-09-12T18:02:08.174737+0000","last_peered":"2024-09-12T18:02:08.174737+0000","last_clean":"2024-09-12T18:02:08.174737+0000","last_became_active":"2024-09-12T17:23:42.135975+0000","last_became_peered":"2024-09-12T17:23:42.135975+0000","last_unstale":"2024-09-12T18:02:08.174737+0000","last_undegraded":"2024-09-12T18:02:08.174737+0000","last_fullsized":"2024-09-12T18:02:08.174737+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'421","last_scrub_stamp":"2024-09-12T18:02:08.174594+0000","last_deep_scrub":"261'421","last_deep_scrub_stamp":"2024-09-12T18:02:08.174594+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.174594+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:26.404773+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2123,"num_read_kb":2006,"num_write":479,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"261'385","reported_seq":1035,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.733545+0000","last_change":"2024-09-12T18:01:57.733545+0000","last_active":"2024-09-12T18:01:57.733545+0000","last_peered":"2024-09-12T18:01:57.733545+0000","last_clean":"2024-09-12T18:01:57.733545+0000","last_became_active":"2024-09-12T17:23:40.713129+0000","last_became_peered":"2024-09-12T17:23:40.713129+0000","last_unstale":"2024-09-12T18:01:57.733545+0000","last_undegraded":"2024-09-12T18:01:57.733545+0000","last_fullsized":"2024-09-12T18:01:57.733545+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'385","last_scrub_stamp":"2024-09-12T18:01:57.733451+0000","last_deep_scrub":"261'385","last_deep_scrub_stamp":"2024-09-12T18:01:57.733451+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.733451+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:01.262019+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311685,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":537,"num_read_kb":14035,"num_write":1238,"num_write_kb":28273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"261'2","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.041838+0000","last_change":"2024-09-12T18:02:14.041733+0000","last_active":"2024-09-12T18:02:14.041838+0000","last_peered":"2024-09-12T18:02:14.041838+0000","last_clean":"2024-09-12T18:02:14.041838+0000","last_became_active":"2024-09-12T17:23:44.151126+0000","last_became_peered":"2024-09-12T17:23:44.151126+0000","last_unstale":"2024-09-12T18:02:14.041838+0000","last_undegraded":"2024-09-12T18:02:14.041838+0000","last_fullsized":"2024-09-12T18:02:14.041838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:14.041603+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:14.041603+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.041603+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:38.127428+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"261'288","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.128502+0000","last_change":"2024-09-12T18:02:24.128502+0000","last_active":"2024-09-12T18:02:24.128502+0000","last_peered":"2024-09-12T18:02:24.128502+0000","last_clean":"2024-09-12T18:02:24.128502+0000","last_became_active":"2024-09-12T17:23:46.153111+0000","last_became_peered":"2024-09-12T17:23:46.153111+0000","last_unstale":"2024-09-12T18:02:24.128502+0000","last_undegraded":"2024-09-12T18:02:24.128502+0000","last_fullsized":"2024-09-12T18:02:24.128502+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'288","last_scrub_stamp":"2024-09-12T18:02:24.128386+0000","last_deep_scrub":"261'288","last_deep_scrub_stamp":"2024-09-12T18:02:24.128386+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.128386+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:03.315024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":457,"num_read_kb":1001,"num_write":362,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.574650+0000","last_change":"2024-09-12T18:02:24.574650+0000","last_active":"2024-09-12T18:02:24.574650+0000","last_peered":"2024-09-12T18:02:24.574650+0000","last_clean":"2024-09-12T18:02:24.574650+0000","last_became_active":"2024-09-12T17:23:48.167070+0000","last_became_peered":"2024-09-12T17:23:48.167070+0000","last_unstale":"2024-09-12T18:02:24.574650+0000","last_undegraded":"2024-09-12T18:02:24.574650+0000","last_fullsized":"2024-09-12T18:02:24.574650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:24.574560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:24.574560+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.574560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:04.413448+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"261'86","reported_seq":574,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.023783+0000","last_change":"2024-09-12T18:02:30.023783+0000","last_active":"2024-09-12T18:02:30.023783+0000","last_peered":"2024-09-12T18:02:30.023783+0000","last_clean":"2024-09-12T18:02:30.023783+0000","last_became_active":"2024-09-12T17:23:50.179075+0000","last_became_peered":"2024-09-12T17:23:50.179075+0000","last_unstale":"2024-09-12T18:02:30.023783+0000","last_undegraded":"2024-09-12T18:02:30.023783+0000","last_fullsized":"2024-09-12T18:02:30.023783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'86","last_scrub_stamp":"2024-09-12T18:02:30.023681+0000","last_deep_scrub":"261'86","last_deep_scrub_stamp":"2024-09-12T18:02:30.023681+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.023681+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:03.359607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":88,"num_write":193,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"261'780","reported_seq":2272,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.014426+0000","last_change":"2024-09-12T18:02:11.014426+0000","last_active":"2024-09-12T18:02:11.014426+0000","last_peered":"2024-09-12T18:02:11.014426+0000","last_clean":"2024-09-12T18:02:11.014426+0000","last_became_active":"2024-09-12T17:23:42.137169+0000","last_became_peered":"2024-09-12T17:23:42.137169+0000","last_unstale":"2024-09-12T18:02:11.014426+0000","last_undegraded":"2024-09-12T18:02:11.014426+0000","last_fullsized":"2024-09-12T18:02:11.014426+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'780","last_scrub_stamp":"2024-09-12T18:02:11.014345+0000","last_deep_scrub":"261'780","last_deep_scrub_stamp":"2024-09-12T18:02:11.014345+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.014345+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:33.609949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3876,"num_read_kb":3488,"num_write":1033,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3280,"num_omap_keys":13,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"261'371","reported_seq":1041,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.139558+0000","last_change":"2024-09-12T18:01:58.139558+0000","last_active":"2024-09-12T18:01:58.139558+0000","last_peered":"2024-09-12T18:01:58.139558+0000","last_clean":"2024-09-12T18:01:58.139558+0000","last_became_active":"2024-09-12T17:23:40.713212+0000","last_became_peered":"2024-09-12T17:23:40.713212+0000","last_unstale":"2024-09-12T18:01:58.139558+0000","last_undegraded":"2024-09-12T18:01:58.139558+0000","last_fullsized":"2024-09-12T18:01:58.139558+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'371","last_scrub_stamp":"2024-09-12T18:01:58.139456+0000","last_deep_scrub":"261'371","last_deep_scrub_stamp":"2024-09-12T18:01:58.139456+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.139456+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:12.945343+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":603,"num_read_kb":38604,"num_write":1166,"num_write_kb":36037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"261'634","reported_seq":2105,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.191292+0000","last_change":"2024-09-12T18:02:13.191292+0000","last_active":"2024-09-12T18:02:13.191292+0000","last_peered":"2024-09-12T18:02:13.191292+0000","last_clean":"2024-09-12T18:02:13.191292+0000","last_became_active":"2024-09-12T17:24:17.227465+0000","last_became_peered":"2024-09-12T17:24:17.227465+0000","last_unstale":"2024-09-12T18:02:13.191292+0000","last_undegraded":"2024-09-12T18:02:13.191292+0000","last_fullsized":"2024-09-12T18:02:13.191292+0000","mapping_epoch":36,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'634","last_scrub_stamp":"2024-09-12T18:02:13.191170+0000","last_deep_scrub":"261'634","last_deep_scrub_stamp":"2024-09-12T18:02:13.191170+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.191170+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":600,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:52.485072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3072,"num_read_kb":2745,"num_write":824,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":266,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"261'324","reported_seq":1001,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.956126+0000","last_change":"2024-09-12T18:01:56.956126+0000","last_active":"2024-09-12T18:01:56.956126+0000","last_peered":"2024-09-12T18:01:56.956126+0000","last_clean":"2024-09-12T18:01:56.956126+0000","last_became_active":"2024-09-12T17:23:40.708064+0000","last_became_peered":"2024-09-12T17:23:40.708064+0000","last_unstale":"2024-09-12T18:01:56.956126+0000","last_undegraded":"2024-09-12T18:01:56.956126+0000","last_fullsized":"2024-09-12T18:01:56.956126+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'324","last_scrub_stamp":"2024-09-12T18:01:56.956049+0000","last_deep_scrub":"261'324","last_deep_scrub_stamp":"2024-09-12T18:01:56.956049+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.956049+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:22.585210+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8958905,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":78914,"num_write":996,"num_write_kb":50917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"261'846","reported_seq":2566,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.231701+0000","last_change":"2024-09-12T18:02:12.231701+0000","last_active":"2024-09-12T18:02:12.231701+0000","last_peered":"2024-09-12T18:02:12.231701+0000","last_clean":"2024-09-12T18:02:12.231701+0000","last_became_active":"2024-09-12T17:23:42.144919+0000","last_became_peered":"2024-09-12T17:23:42.144919+0000","last_unstale":"2024-09-12T18:02:12.231701+0000","last_undegraded":"2024-09-12T18:02:12.231701+0000","last_fullsized":"2024-09-12T18:02:12.231701+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'846","last_scrub_stamp":"2024-09-12T18:02:12.231607+0000","last_deep_scrub":"261'846","last_deep_scrub_stamp":"2024-09-12T18:02:12.231607+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.231607+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:17.452515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4312,"num_read_kb":3919,"num_write":1107,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1165,"num_omap_keys":5,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"261'352","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.251183+0000","last_change":"2024-09-12T18:02:04.251183+0000","last_active":"2024-09-12T18:02:04.251183+0000","last_peered":"2024-09-12T18:02:04.251183+0000","last_clean":"2024-09-12T18:02:04.251183+0000","last_became_active":"2024-09-12T17:23:40.715471+0000","last_became_peered":"2024-09-12T17:23:40.715471+0000","last_unstale":"2024-09-12T18:02:04.251183+0000","last_undegraded":"2024-09-12T18:02:04.251183+0000","last_fullsized":"2024-09-12T18:02:04.251183+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'352","last_scrub_stamp":"2024-09-12T18:02:04.251012+0000","last_deep_scrub":"261'352","last_deep_scrub_stamp":"2024-09-12T18:02:04.251012+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.251012+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:39.383192+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":470,"num_read_kb":37845,"num_write":1014,"num_write_kb":24242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"261'768","reported_seq":2217,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.004437+0000","last_change":"2024-09-12T18:02:09.004437+0000","last_active":"2024-09-12T18:02:09.004437+0000","last_peered":"2024-09-12T18:02:09.004437+0000","last_clean":"2024-09-12T18:02:09.004437+0000","last_became_active":"2024-09-12T17:23:42.142672+0000","last_became_peered":"2024-09-12T17:23:42.142672+0000","last_unstale":"2024-09-12T18:02:09.004437+0000","last_undegraded":"2024-09-12T18:02:09.004437+0000","last_fullsized":"2024-09-12T18:02:09.004437+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'768","last_scrub_stamp":"2024-09-12T18:02:09.004346+0000","last_deep_scrub":"261'768","last_deep_scrub_stamp":"2024-09-12T18:02:09.004346+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.004346+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:52.254410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3573,"num_read_kb":3224,"num_write":1004,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"261'287","reported_seq":915,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.707639+0000","last_change":"2024-09-12T18:02:01.707639+0000","last_active":"2024-09-12T18:02:01.707639+0000","last_peered":"2024-09-12T18:02:01.707639+0000","last_clean":"2024-09-12T18:02:01.707639+0000","last_became_active":"2024-09-12T17:23:40.702991+0000","last_became_peered":"2024-09-12T17:23:40.702991+0000","last_unstale":"2024-09-12T18:02:01.707639+0000","last_undegraded":"2024-09-12T18:02:01.707639+0000","last_fullsized":"2024-09-12T18:02:01.707639+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'287","last_scrub_stamp":"2024-09-12T18:02:01.707536+0000","last_deep_scrub":"261'287","last_deep_scrub_stamp":"2024-09-12T18:02:01.707536+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.707536+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:27.542681+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306617,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":429,"num_read_kb":57192,"num_write":879,"num_write_kb":43690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"261'414","reported_seq":1908,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.286617+0000","last_change":"2024-09-12T18:02:13.286617+0000","last_active":"2024-09-12T18:02:13.286617+0000","last_peered":"2024-09-12T18:02:13.286617+0000","last_clean":"2024-09-12T18:02:13.286617+0000","last_became_active":"2024-09-12T17:23:42.146394+0000","last_became_peered":"2024-09-12T17:23:42.146394+0000","last_unstale":"2024-09-12T18:02:13.286617+0000","last_undegraded":"2024-09-12T18:02:13.286617+0000","last_fullsized":"2024-09-12T18:02:13.286617+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'414","last_scrub_stamp":"2024-09-12T18:02:13.286513+0000","last_deep_scrub":"261'414","last_deep_scrub_stamp":"2024-09-12T18:02:13.286513+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.286513+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:01.693990+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2184,"num_read_kb":2068,"num_write":471,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"261'366","reported_seq":1115,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.241761+0000","last_change":"2024-09-12T18:02:02.241761+0000","last_active":"2024-09-12T18:02:02.241761+0000","last_peered":"2024-09-12T18:02:02.241761+0000","last_clean":"2024-09-12T18:02:02.241761+0000","last_became_active":"2024-09-12T17:23:40.712702+0000","last_became_peered":"2024-09-12T17:23:40.712702+0000","last_unstale":"2024-09-12T18:02:02.241761+0000","last_undegraded":"2024-09-12T18:02:02.241761+0000","last_fullsized":"2024-09-12T18:02:02.241761+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'366","last_scrub_stamp":"2024-09-12T18:02:02.241608+0000","last_deep_scrub":"261'366","last_deep_scrub_stamp":"2024-09-12T18:02:02.241608+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.241608+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:45.785430+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":720,"num_read_kb":69814,"num_write":1187,"num_write_kb":31106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"261'859","reported_seq":2451,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.138788+0000","last_change":"2024-09-12T18:02:10.138788+0000","last_active":"2024-09-12T18:02:10.138788+0000","last_peered":"2024-09-12T18:02:10.138788+0000","last_clean":"2024-09-12T18:02:10.138788+0000","last_became_active":"2024-09-12T17:23:42.141605+0000","last_became_peered":"2024-09-12T17:23:42.141605+0000","last_unstale":"2024-09-12T18:02:10.138788+0000","last_undegraded":"2024-09-12T18:02:10.138788+0000","last_fullsized":"2024-09-12T18:02:10.138788+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'859","last_scrub_stamp":"2024-09-12T18:02:10.138696+0000","last_deep_scrub":"261'859","last_deep_scrub_stamp":"2024-09-12T18:02:10.138696+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.138696+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:59.422337+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4009,"num_read_kb":3625,"num_write":1130,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"261'305","reported_seq":1039,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.036630+0000","last_change":"2024-09-12T18:01:59.036630+0000","last_active":"2024-09-12T18:01:59.036630+0000","last_peered":"2024-09-12T18:01:59.036630+0000","last_clean":"2024-09-12T18:01:59.036630+0000","last_became_active":"2024-09-12T17:23:40.715809+0000","last_became_peered":"2024-09-12T17:23:40.715809+0000","last_unstale":"2024-09-12T18:01:59.036630+0000","last_undegraded":"2024-09-12T18:01:59.036630+0000","last_fullsized":"2024-09-12T18:01:59.036630+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'305","last_scrub_stamp":"2024-09-12T18:01:59.036534+0000","last_deep_scrub":"261'305","last_deep_scrub_stamp":"2024-09-12T18:01:59.036534+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.036534+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:38.706923+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":740,"num_read_kb":58572,"num_write":1029,"num_write_kb":36244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"261'1243","reported_seq":2741,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.244580+0000","last_change":"2024-09-12T18:02:14.244580+0000","last_active":"2024-09-12T18:02:14.244580+0000","last_peered":"2024-09-12T18:02:14.244580+0000","last_clean":"2024-09-12T18:02:14.244580+0000","last_became_active":"2024-09-12T17:23:42.155489+0000","last_became_peered":"2024-09-12T17:23:42.155489+0000","last_unstale":"2024-09-12T18:02:14.244580+0000","last_undegraded":"2024-09-12T18:02:14.244580+0000","last_fullsized":"2024-09-12T18:02:14.244580+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1243","last_scrub_stamp":"2024-09-12T18:02:14.244473+0000","last_deep_scrub":"261'1243","last_deep_scrub_stamp":"2024-09-12T18:02:14.244473+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.244473+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:45.679516+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5619,"num_read_kb":4947,"num_write":1761,"num_write_kb":787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":756,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"261'369","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.101987+0000","last_change":"2024-09-12T18:01:59.101987+0000","last_active":"2024-09-12T18:01:59.101987+0000","last_peered":"2024-09-12T18:01:59.101987+0000","last_clean":"2024-09-12T18:01:59.101987+0000","last_became_active":"2024-09-12T17:23:40.704582+0000","last_became_peered":"2024-09-12T17:23:40.704582+0000","last_unstale":"2024-09-12T18:01:59.101987+0000","last_undegraded":"2024-09-12T18:01:59.101987+0000","last_fullsized":"2024-09-12T18:01:59.101987+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'369","last_scrub_stamp":"2024-09-12T18:01:59.101815+0000","last_deep_scrub":"261'369","last_deep_scrub_stamp":"2024-09-12T18:01:59.101815+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.101815+0000","objects_scrubbed":8,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:05.038276+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5258296,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":535,"num_read_kb":13831,"num_write":1155,"num_write_kb":46857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"261'755","reported_seq":2394,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.168066+0000","last_change":"2024-09-12T18:02:09.168066+0000","last_active":"2024-09-12T18:02:09.168066+0000","last_peered":"2024-09-12T18:02:09.168066+0000","last_clean":"2024-09-12T18:02:09.168066+0000","last_became_active":"2024-09-12T17:23:42.141542+0000","last_became_peered":"2024-09-12T17:23:42.141542+0000","last_unstale":"2024-09-12T18:02:09.168066+0000","last_undegraded":"2024-09-12T18:02:09.168066+0000","last_fullsized":"2024-09-12T18:02:09.168066+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'755","last_scrub_stamp":"2024-09-12T18:02:09.167983+0000","last_deep_scrub":"261'755","last_deep_scrub_stamp":"2024-09-12T18:02:09.167983+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.167983+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:32.809383+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3956,"num_read_kb":3681,"num_write":1110,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"261'391","reported_seq":1039,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.073856+0000","last_change":"2024-09-12T18:02:04.073856+0000","last_active":"2024-09-12T18:02:04.073856+0000","last_peered":"2024-09-12T18:02:04.073856+0000","last_clean":"2024-09-12T18:02:04.073856+0000","last_became_active":"2024-09-12T17:24:17.227082+0000","last_became_peered":"2024-09-12T17:24:17.227082+0000","last_unstale":"2024-09-12T18:02:04.073856+0000","last_undegraded":"2024-09-12T18:02:04.073856+0000","last_fullsized":"2024-09-12T18:02:04.073856+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'391","last_scrub_stamp":"2024-09-12T18:02:04.073725+0000","last_deep_scrub":"261'391","last_deep_scrub_stamp":"2024-09-12T18:02:04.073725+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.073725+0000","objects_scrubbed":7,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:53.651302+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":638,"num_read_kb":9829,"num_write":1453,"num_write_kb":18369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"261'767","reported_seq":2170,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.572908+0000","last_change":"2024-09-12T18:02:09.572908+0000","last_active":"2024-09-12T18:02:09.572908+0000","last_peered":"2024-09-12T18:02:09.572908+0000","last_clean":"2024-09-12T18:02:09.572908+0000","last_became_active":"2024-09-12T17:23:42.155052+0000","last_became_peered":"2024-09-12T17:23:42.155052+0000","last_unstale":"2024-09-12T18:02:09.572908+0000","last_undegraded":"2024-09-12T18:02:09.572908+0000","last_fullsized":"2024-09-12T18:02:09.572908+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'767","last_scrub_stamp":"2024-09-12T18:02:09.572815+0000","last_deep_scrub":"261'767","last_deep_scrub_stamp":"2024-09-12T18:02:09.572815+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.572815+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:37.232559+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3588,"num_read_kb":3224,"num_write":1013,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"261'354","reported_seq":1127,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.257003+0000","last_change":"2024-09-12T18:02:05.257003+0000","last_active":"2024-09-12T18:02:05.257003+0000","last_peered":"2024-09-12T18:02:05.257003+0000","last_clean":"2024-09-12T18:02:05.257003+0000","last_became_active":"2024-09-12T17:23:40.707220+0000","last_became_peered":"2024-09-12T17:23:40.707220+0000","last_unstale":"2024-09-12T18:02:05.257003+0000","last_undegraded":"2024-09-12T18:02:05.257003+0000","last_fullsized":"2024-09-12T18:02:05.257003+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-12T18:02:05.256842+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-12T18:02:05.256842+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.256842+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:56.340735+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5635850,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":676,"num_read_kb":59084,"num_write":1125,"num_write_kb":27945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"261'440","reported_seq":1943,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.202872+0000","last_change":"2024-09-12T18:02:12.202872+0000","last_active":"2024-09-12T18:02:12.202872+0000","last_peered":"2024-09-12T18:02:12.202872+0000","last_clean":"2024-09-12T18:02:12.202872+0000","last_became_active":"2024-09-12T17:23:42.134859+0000","last_became_peered":"2024-09-12T17:23:42.134859+0000","last_unstale":"2024-09-12T18:02:12.202872+0000","last_undegraded":"2024-09-12T18:02:12.202872+0000","last_fullsized":"2024-09-12T18:02:12.202872+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'440","last_scrub_stamp":"2024-09-12T18:02:12.202782+0000","last_deep_scrub":"261'440","last_deep_scrub_stamp":"2024-09-12T18:02:12.202782+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.202782+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:10.816400+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2327,"num_read_kb":2188,"num_write":509,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"261'326","reported_seq":968,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.213894+0000","last_change":"2024-09-12T18:02:01.213894+0000","last_active":"2024-09-12T18:02:01.213894+0000","last_peered":"2024-09-12T18:02:01.213894+0000","last_clean":"2024-09-12T18:02:01.213894+0000","last_became_active":"2024-09-12T17:23:40.711042+0000","last_became_peered":"2024-09-12T17:23:40.711042+0000","last_unstale":"2024-09-12T18:02:01.213894+0000","last_undegraded":"2024-09-12T18:02:01.213894+0000","last_fullsized":"2024-09-12T18:02:01.213894+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-12T18:02:01.213797+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-12T18:02:01.213797+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.213797+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:05.849655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":531,"num_read_kb":6765,"num_write":1166,"num_write_kb":43884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"261'952","reported_seq":2519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.074553+0000","last_change":"2024-09-12T18:02:05.074553+0000","last_active":"2024-09-12T18:02:05.074553+0000","last_peered":"2024-09-12T18:02:05.074553+0000","last_clean":"2024-09-12T18:02:05.074553+0000","last_became_active":"2024-09-12T17:23:42.141379+0000","last_became_peered":"2024-09-12T17:23:42.141379+0000","last_unstale":"2024-09-12T18:02:05.074553+0000","last_undegraded":"2024-09-12T18:02:05.074553+0000","last_fullsized":"2024-09-12T18:02:05.074553+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'952","last_scrub_stamp":"2024-09-12T18:02:05.074457+0000","last_deep_scrub":"261'952","last_deep_scrub_stamp":"2024-09-12T18:02:05.074457+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.074457+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":900,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:43.879354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4545,"num_read_kb":4064,"num_write":1359,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"261'399","reported_seq":1034,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.207269+0000","last_change":"2024-09-12T18:02:06.207269+0000","last_active":"2024-09-12T18:02:06.207269+0000","last_peered":"2024-09-12T18:02:06.207269+0000","last_clean":"2024-09-12T18:02:06.207269+0000","last_became_active":"2024-09-12T17:23:40.702825+0000","last_became_peered":"2024-09-12T17:23:40.702825+0000","last_unstale":"2024-09-12T18:02:06.207269+0000","last_undegraded":"2024-09-12T18:02:06.207269+0000","last_fullsized":"2024-09-12T18:02:06.207269+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'399","last_scrub_stamp":"2024-09-12T18:02:06.207160+0000","last_deep_scrub":"261'399","last_deep_scrub_stamp":"2024-09-12T18:02:06.207160+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.207160+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:02.674525+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":642,"num_read_kb":543,"num_write":1172,"num_write_kb":8662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"261'400","reported_seq":1817,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.185744+0000","last_change":"2024-09-12T18:02:11.185744+0000","last_active":"2024-09-12T18:02:11.185744+0000","last_peered":"2024-09-12T18:02:11.185744+0000","last_clean":"2024-09-12T18:02:11.185744+0000","last_became_active":"2024-09-12T17:23:42.139735+0000","last_became_peered":"2024-09-12T17:23:42.139735+0000","last_unstale":"2024-09-12T18:02:11.185744+0000","last_undegraded":"2024-09-12T18:02:11.185744+0000","last_fullsized":"2024-09-12T18:02:11.185744+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'400","last_scrub_stamp":"2024-09-12T18:02:11.185659+0000","last_deep_scrub":"261'400","last_deep_scrub_stamp":"2024-09-12T18:02:11.185659+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.185659+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:20.796201+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2037,"num_read_kb":1920,"num_write":445,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"261'345","reported_seq":1015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.727921+0000","last_change":"2024-09-12T18:02:02.727921+0000","last_active":"2024-09-12T18:02:02.727921+0000","last_peered":"2024-09-12T18:02:02.727921+0000","last_clean":"2024-09-12T18:02:02.727921+0000","last_became_active":"2024-09-12T17:23:40.709392+0000","last_became_peered":"2024-09-12T17:23:40.709392+0000","last_unstale":"2024-09-12T18:02:02.727921+0000","last_undegraded":"2024-09-12T18:02:02.727921+0000","last_fullsized":"2024-09-12T18:02:02.727921+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'345","last_scrub_stamp":"2024-09-12T18:02:02.727811+0000","last_deep_scrub":"261'345","last_deep_scrub_stamp":"2024-09-12T18:02:02.727811+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.727811+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:55.006739+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":64698,"num_write":1140,"num_write_kb":39876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"261'1136","reported_seq":2677,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.696246+0000","last_change":"2024-09-12T18:02:13.696246+0000","last_active":"2024-09-12T18:02:13.696246+0000","last_peered":"2024-09-12T18:02:13.696246+0000","last_clean":"2024-09-12T18:02:13.696246+0000","last_became_active":"2024-09-12T17:23:42.154127+0000","last_became_peered":"2024-09-12T17:23:42.154127+0000","last_unstale":"2024-09-12T18:02:13.696246+0000","last_undegraded":"2024-09-12T18:02:13.696246+0000","last_fullsized":"2024-09-12T18:02:13.696246+0000","mapping_epoch":25,"log_start":"261'1100","ondisk_log_start":"261'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1136","last_scrub_stamp":"2024-09-12T18:02:13.696125+0000","last_deep_scrub":"261'1136","last_deep_scrub_stamp":"2024-09-12T18:02:13.696125+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.696125+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":1100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:51.177021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5169,"num_read_kb":4583,"num_write":1562,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"261'352","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.136792+0000","last_change":"2024-09-12T18:02:04.136792+0000","last_active":"2024-09-12T18:02:04.136792+0000","last_peered":"2024-09-12T18:02:04.136792+0000","last_clean":"2024-09-12T18:02:04.136792+0000","last_became_active":"2024-09-12T17:23:40.714343+0000","last_became_peered":"2024-09-12T17:23:40.714343+0000","last_unstale":"2024-09-12T18:02:04.136792+0000","last_undegraded":"2024-09-12T18:02:04.136792+0000","last_fullsized":"2024-09-12T18:02:04.136792+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'352","last_scrub_stamp":"2024-09-12T18:02:04.136686+0000","last_deep_scrub":"261'352","last_deep_scrub_stamp":"2024-09-12T18:02:04.136686+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.136686+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:10.141603+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":610,"num_read_kb":27408,"num_write":1219,"num_write_kb":25060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"261'997","reported_seq":2626,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.621762+0000","last_change":"2024-09-12T18:02:08.621762+0000","last_active":"2024-09-12T18:02:08.621762+0000","last_peered":"2024-09-12T18:02:08.621762+0000","last_clean":"2024-09-12T18:02:08.621762+0000","last_became_active":"2024-09-12T17:23:42.146107+0000","last_became_peered":"2024-09-12T17:23:42.146107+0000","last_unstale":"2024-09-12T18:02:08.621762+0000","last_undegraded":"2024-09-12T18:02:08.621762+0000","last_fullsized":"2024-09-12T18:02:08.621762+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'997","last_scrub_stamp":"2024-09-12T18:02:08.621665+0000","last_deep_scrub":"261'997","last_deep_scrub_stamp":"2024-09-12T18:02:08.621665+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.621665+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.465820+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4676,"num_read_kb":4145,"num_write":1343,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"261'339","reported_seq":990,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.782950+0000","last_change":"2024-09-12T18:02:06.782877+0000","last_active":"2024-09-12T18:02:06.782950+0000","last_peered":"2024-09-12T18:02:06.782950+0000","last_clean":"2024-09-12T18:02:06.782950+0000","last_became_active":"2024-09-12T17:23:40.706951+0000","last_became_peered":"2024-09-12T17:23:40.706951+0000","last_unstale":"2024-09-12T18:02:06.782950+0000","last_undegraded":"2024-09-12T18:02:06.782950+0000","last_fullsized":"2024-09-12T18:02:06.782950+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'339","last_scrub_stamp":"2024-09-12T18:02:06.782780+0000","last_deep_scrub":"261'339","last_deep_scrub_stamp":"2024-09-12T18:02:06.782780+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.782780+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:28.262679+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918016,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":7215,"num_write":977,"num_write_kb":28374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"261'492","reported_seq":2005,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.279046+0000","last_change":"2024-09-12T18:02:18.279046+0000","last_active":"2024-09-12T18:02:18.279046+0000","last_peered":"2024-09-12T18:02:18.279046+0000","last_clean":"2024-09-12T18:02:18.279046+0000","last_became_active":"2024-09-12T17:23:42.152999+0000","last_became_peered":"2024-09-12T17:23:42.152999+0000","last_unstale":"2024-09-12T18:02:18.279046+0000","last_undegraded":"2024-09-12T18:02:18.279046+0000","last_fullsized":"2024-09-12T18:02:18.279046+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'492","last_scrub_stamp":"2024-09-12T18:02:18.278979+0000","last_deep_scrub":"261'492","last_deep_scrub_stamp":"2024-09-12T18:02:18.278979+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.278979+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:08.961069+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2525,"num_read_kb":2342,"num_write":624,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":739,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"261'358","reported_seq":983,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.987950+0000","last_change":"2024-09-12T18:01:58.987950+0000","last_active":"2024-09-12T18:01:58.987950+0000","last_peered":"2024-09-12T18:01:58.987950+0000","last_clean":"2024-09-12T18:01:58.987950+0000","last_became_active":"2024-09-12T17:23:40.704585+0000","last_became_peered":"2024-09-12T17:23:40.704585+0000","last_unstale":"2024-09-12T18:01:58.987950+0000","last_undegraded":"2024-09-12T18:01:58.987950+0000","last_fullsized":"2024-09-12T18:01:58.987950+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'358","last_scrub_stamp":"2024-09-12T18:01:58.987801+0000","last_deep_scrub":"261'358","last_deep_scrub_stamp":"2024-09-12T18:01:58.987801+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.987801+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:52.057616+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262306,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":466,"num_read_kb":452,"num_write":1104,"num_write_kb":34111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"261'445","reported_seq":2034,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.717537+0000","last_change":"2024-09-12T18:02:10.717537+0000","last_active":"2024-09-12T18:02:10.717537+0000","last_peered":"2024-09-12T18:02:10.717537+0000","last_clean":"2024-09-12T18:02:10.717537+0000","last_became_active":"2024-09-12T17:23:42.154367+0000","last_became_peered":"2024-09-12T17:23:42.154367+0000","last_unstale":"2024-09-12T18:02:10.717537+0000","last_undegraded":"2024-09-12T18:02:10.717537+0000","last_fullsized":"2024-09-12T18:02:10.717537+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'445","last_scrub_stamp":"2024-09-12T18:02:10.717445+0000","last_deep_scrub":"261'445","last_deep_scrub_stamp":"2024-09-12T18:02:10.717445+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.717445+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:16.473683+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2387,"num_read_kb":2268,"num_write":501,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"261'401","reported_seq":1012,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.992526+0000","last_change":"2024-09-12T18:02:00.992526+0000","last_active":"2024-09-12T18:02:00.992526+0000","last_peered":"2024-09-12T18:02:00.992526+0000","last_clean":"2024-09-12T18:02:00.992526+0000","last_became_active":"2024-09-12T17:24:17.287516+0000","last_became_peered":"2024-09-12T17:24:17.287516+0000","last_unstale":"2024-09-12T18:02:00.992526+0000","last_undegraded":"2024-09-12T18:02:00.992526+0000","last_fullsized":"2024-09-12T18:02:00.992526+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'401","last_scrub_stamp":"2024-09-12T18:02:00.992392+0000","last_deep_scrub":"261'401","last_deep_scrub_stamp":"2024-09-12T18:02:00.992392+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.992392+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:29.409874+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":2150,"num_write":1211,"num_write_kb":17735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"261'371","reported_seq":1063,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.201850+0000","last_change":"2024-09-12T18:02:07.201850+0000","last_active":"2024-09-12T18:02:07.201850+0000","last_peered":"2024-09-12T18:02:07.201850+0000","last_clean":"2024-09-12T18:02:07.201850+0000","last_became_active":"2024-09-12T17:23:40.705975+0000","last_became_peered":"2024-09-12T17:23:40.705975+0000","last_unstale":"2024-09-12T18:02:07.201850+0000","last_undegraded":"2024-09-12T18:02:07.201850+0000","last_fullsized":"2024-09-12T18:02:07.201850+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'371","last_scrub_stamp":"2024-09-12T18:02:07.201750+0000","last_deep_scrub":"261'371","last_deep_scrub_stamp":"2024-09-12T18:02:07.201750+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.201750+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:00.288303+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102345,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":38544,"num_write":1177,"num_write_kb":29966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"261'892","reported_seq":2663,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.600938+0000","last_change":"2024-09-12T18:02:10.600768+0000","last_active":"2024-09-12T18:02:10.600938+0000","last_peered":"2024-09-12T18:02:10.600938+0000","last_clean":"2024-09-12T18:02:10.600938+0000","last_became_active":"2024-09-12T17:23:42.155431+0000","last_became_peered":"2024-09-12T17:23:42.155431+0000","last_unstale":"2024-09-12T18:02:10.600938+0000","last_undegraded":"2024-09-12T18:02:10.600938+0000","last_fullsized":"2024-09-12T18:02:10.600938+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'892","last_scrub_stamp":"2024-09-12T18:02:10.600663+0000","last_deep_scrub":"261'892","last_deep_scrub_stamp":"2024-09-12T18:02:10.600663+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.600663+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:56.558490+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4337,"num_read_kb":3945,"num_write":1177,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"261'325","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.090071+0000","last_change":"2024-09-12T18:02:01.090071+0000","last_active":"2024-09-12T18:02:01.090071+0000","last_peered":"2024-09-12T18:02:01.090071+0000","last_clean":"2024-09-12T18:02:01.090071+0000","last_became_active":"2024-09-12T17:23:40.713729+0000","last_became_peered":"2024-09-12T17:23:40.713729+0000","last_unstale":"2024-09-12T18:02:01.090071+0000","last_undegraded":"2024-09-12T18:02:01.090071+0000","last_fullsized":"2024-09-12T18:02:01.090071+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'325","last_scrub_stamp":"2024-09-12T18:02:01.089958+0000","last_deep_scrub":"261'325","last_deep_scrub_stamp":"2024-09-12T18:02:01.089958+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.089958+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:09.856184+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6690697,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":468,"num_read_kb":88924,"num_write":1000,"num_write_kb":31954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"261'921","reported_seq":2516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.238043+0000","last_change":"2024-09-12T18:02:15.237983+0000","last_active":"2024-09-12T18:02:15.238043+0000","last_peered":"2024-09-12T18:02:15.238043+0000","last_clean":"2024-09-12T18:02:15.238043+0000","last_became_active":"2024-09-12T17:23:42.151035+0000","last_became_peered":"2024-09-12T17:23:42.151035+0000","last_unstale":"2024-09-12T18:02:15.238043+0000","last_undegraded":"2024-09-12T18:02:15.238043+0000","last_fullsized":"2024-09-12T18:02:15.238043+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'921","last_scrub_stamp":"2024-09-12T18:02:15.237888+0000","last_deep_scrub":"261'921","last_deep_scrub_stamp":"2024-09-12T18:02:15.237888+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.237888+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":900,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:05.656909+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4231,"num_read_kb":3788,"num_write":1202,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6418,"num_read_kb":4664,"num_write":2041,"num_write_kb":938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1112,"ondisk_log_size":1112,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16069,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16200,"num_read_kb":15888,"num_write":16774,"num_write_kb":4891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2861,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1741,"ondisk_log_size":1741,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":693,"ondisk_log_size":693,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1568925,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":16943,"num_read_kb":36201,"num_write":14185,"num_write_kb":11429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685458,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2166,"ondisk_log_size":2166,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2424,"num_read_kb":2890,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212759,"num_read_kb":194564,"num_write":55413,"num_write_kb":18856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43832,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3805,"ondisk_log_size":3805,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":82077927,"num_objects":360,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":360,"num_whiteouts":0,"num_read":36160,"num_read_kb":2097994,"num_write":72463,"num_write_kb":2176823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":165306368,"data_stored":164155854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3742,"ondisk_log_size":3742,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":196116,"num_write":158,"num_write_kb":127401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":185777,"num_write":158,"num_write_kb":127401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509913,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313532,"kb_used_data":39404,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94058308,"statfs":{"total":96636764160,"available":96315707392,"internally_reserved":0,"allocated":40349696,"data_stored":38689531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509913,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263556,"kb_used_data":11636,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94108284,"statfs":{"total":96636764160,"available":96366882816,"internally_reserved":0,"allocated":11915264,"data_stored":10326315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509914,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":154452,"kb_used_data":28932,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94217388,"statfs":{"total":96636764160,"available":96478605312,"internally_reserved":0,"allocated":29626368,"data_stored":27895637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509914,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108528,"kb_used_data":23200,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94263312,"statfs":{"total":96636764160,"available":96525631488,"internally_reserved":0,"allocated":23756800,"data_stored":22112034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509913,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157492,"kb_used_data":13924,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94214348,"statfs":{"total":96636764160,"available":96475492352,"internally_reserved":0,"allocated":14258176,"data_stored":12683013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509915,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":277444,"kb_used_data":21428,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":94094396,"statfs":{"total":96636764160,"available":96352661504,"internally_reserved":0,"allocated":21942272,"data_stored":20239121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262142407},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542619,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300444,"kb_used_data":30540,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":94071396,"statfs":{"total":96636764160,"available":96329109504,"internally_reserved":0,"allocated":31272960,"data_stored":29588476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276363719},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542620,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111216,"kb_used_data":21792,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94260624,"statfs":{"total":96636764160,"available":96522878976,"internally_reserved":0,"allocated":22315008,"data_stored":20755157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17715200,"data_stored":17530392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10657792,"data_stored":10563849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18726912,"data_stored":18636740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27639808,"data_stored":27468954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20172800,"data_stored":19992871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25960448,"data_stored":25776028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8314880,"data_stored":8207763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36118528,"data_stored":35979257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":3790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:38.768 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.769 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.769 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.769 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.769 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.769 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.769 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.770 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.770 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.770 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.770 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.770 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.770 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.770 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.770 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.770 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.771 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.771 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.771 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.771 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.771 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.771 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.771 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.771 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.771 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.772 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.772 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.772 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.772 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.772 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.772 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.772 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.772 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.773 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.773 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.773 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.773 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.773 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.773 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.773 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.773 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.774 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.774 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.774 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.774 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.774 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.774 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.774 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.774 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.774 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.775 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.775 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.775 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.775 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.775 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.775 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.775 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.775 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.776 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.776 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.776 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.776 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.776 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.776 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.776 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.776 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.777 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.777 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.777 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.777 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.777 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.777 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.777 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.777 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.777 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.778 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.778 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.778 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.778 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.778 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.778 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.778 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.779 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:38:49.986477+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=38, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.779 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.779 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.779 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:40:26.355034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.779 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.779 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.779 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:40:29.380493+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=40, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:38.783 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:02:58.783 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:59.134 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:02:59.146 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-12T18:02:59.148 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":1442,"stamp":"2024-09-12T18:02:58.510874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":84255101,"num_objects":839,"num_object_clones":0,"num_object_copies":1678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":839,"num_whiteouts":0,"num_read":291262,"num_read_kb":2734161,"num_write":161335,"num_write_kb":2469395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":734775,"num_omap_keys":1776,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13563,"ondisk_log_size":13563,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1686664,"kb_used_data":190856,"kb_used_omap":12,"kb_used_meta":1495667,"kb_avail":753288056,"statfs":{"total":773094113280,"available":771366969344,"internally_reserved":0,"allocated":195436544,"data_stored":182289284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1531563571},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005138"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:45.293029+0000","last_change":"2024-09-12T18:02:45.293029+0000","last_active":"2024-09-12T18:02:45.293029+0000","last_peered":"2024-09-12T18:02:45.293029+0000","last_clean":"2024-09-12T18:02:45.293029+0000","last_became_active":"2024-09-12T17:50:58.430327+0000","last_became_peered":"2024-09-12T17:50:58.430327+0000","last_unstale":"2024-09-12T18:02:45.293029+0000","last_undegraded":"2024-09-12T18:02:45.293029+0000","last_fullsized":"2024-09-12T18:02:45.293029+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:45.292938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:45.292938+0000","last_clean_scrub_stamp":"2024-09-12T18:02:45.292938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:48.547960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"261'11","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.217068+0000","last_change":"2024-09-12T18:02:42.217068+0000","last_active":"2024-09-12T18:02:42.217068+0000","last_peered":"2024-09-12T18:02:42.217068+0000","last_clean":"2024-09-12T18:02:42.217068+0000","last_became_active":"2024-09-12T17:40:30.413466+0000","last_became_peered":"2024-09-12T17:40:30.413466+0000","last_unstale":"2024-09-12T18:02:42.217068+0000","last_undegraded":"2024-09-12T18:02:42.217068+0000","last_fullsized":"2024-09-12T18:02:42.217068+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-09-12T18:02:42.216981+0000","last_deep_scrub":"261'11","last_deep_scrub_stamp":"2024-09-12T18:02:42.216981+0000","last_clean_scrub_stamp":"2024-09-12T18:02:42.216981+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:29.146865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14338,"num_write":26,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'2","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:45.483918+0000","last_change":"2024-09-12T18:02:45.483859+0000","last_active":"2024-09-12T18:02:45.483918+0000","last_peered":"2024-09-12T18:02:45.483918+0000","last_clean":"2024-09-12T18:02:45.483918+0000","last_became_active":"2024-09-12T17:40:27.384052+0000","last_became_peered":"2024-09-12T17:40:27.384052+0000","last_unstale":"2024-09-12T18:02:45.483918+0000","last_undegraded":"2024-09-12T18:02:45.483918+0000","last_fullsized":"2024-09-12T18:02:45.483918+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:45.483762+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:45.483762+0000","last_clean_scrub_stamp":"2024-09-12T18:02:45.483762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:58.064918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"261'181","reported_seq":613,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:39.641423+0000","last_change":"2024-09-12T18:02:39.641423+0000","last_active":"2024-09-12T18:02:39.641423+0000","last_peered":"2024-09-12T18:02:39.641423+0000","last_clean":"2024-09-12T18:02:39.641423+0000","last_became_active":"2024-09-12T17:38:51.208740+0000","last_became_peered":"2024-09-12T17:38:51.208740+0000","last_unstale":"2024-09-12T18:02:39.641423+0000","last_undegraded":"2024-09-12T18:02:39.641423+0000","last_fullsized":"2024-09-12T18:02:39.641423+0000","mapping_epoch":248,"log_start":"258'100","ondisk_log_start":"258'100","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'181","last_scrub_stamp":"2024-09-12T18:02:39.641319+0000","last_deep_scrub":"261'181","last_deep_scrub_stamp":"2024-09-12T18:02:39.641319+0000","last_clean_scrub_stamp":"2024-09-12T18:02:39.641319+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:52:32.958550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1105,"num_read_kb":819,"num_write":215,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1872,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.054688+0000","last_change":"2024-09-12T18:02:25.054688+0000","last_active":"2024-09-12T18:02:25.054688+0000","last_peered":"2024-09-12T18:02:25.054688+0000","last_clean":"2024-09-12T18:02:25.054688+0000","last_became_active":"2024-09-12T17:50:58.429172+0000","last_became_peered":"2024-09-12T17:50:58.429172+0000","last_unstale":"2024-09-12T18:02:25.054688+0000","last_undegraded":"2024-09-12T18:02:25.054688+0000","last_fullsized":"2024-09-12T18:02:25.054688+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:25.054583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:25.054583+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.054583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:48.707684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.997049+0000","last_change":"2024-09-12T18:02:42.997049+0000","last_active":"2024-09-12T18:02:42.997049+0000","last_peered":"2024-09-12T18:02:42.997049+0000","last_clean":"2024-09-12T18:02:42.997049+0000","last_became_active":"2024-09-12T17:40:30.419270+0000","last_became_peered":"2024-09-12T17:40:30.419270+0000","last_unstale":"2024-09-12T18:02:42.997049+0000","last_undegraded":"2024-09-12T18:02:42.997049+0000","last_fullsized":"2024-09-12T18:02:42.997049+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:42.996937+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:42.996937+0000","last_clean_scrub_stamp":"2024-09-12T18:02:42.996937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:57.188810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.913848+0000","last_change":"2024-09-12T18:02:29.913848+0000","last_active":"2024-09-12T18:02:29.913848+0000","last_peered":"2024-09-12T18:02:29.913848+0000","last_clean":"2024-09-12T18:02:29.913848+0000","last_became_active":"2024-09-12T17:40:27.383464+0000","last_became_peered":"2024-09-12T17:40:27.383464+0000","last_unstale":"2024-09-12T18:02:29.913848+0000","last_undegraded":"2024-09-12T18:02:29.913848+0000","last_fullsized":"2024-09-12T18:02:29.913848+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:29.913762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:29.913762+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.913762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:04.461544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"261'20","reported_seq":107,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.018192+0000","last_change":"2024-09-12T18:02:17.018133+0000","last_active":"2024-09-12T18:02:17.018192+0000","last_peered":"2024-09-12T18:02:17.018192+0000","last_clean":"2024-09-12T18:02:17.018192+0000","last_became_active":"2024-09-12T17:38:51.217312+0000","last_became_peered":"2024-09-12T17:38:51.217312+0000","last_unstale":"2024-09-12T18:02:17.018192+0000","last_undegraded":"2024-09-12T18:02:17.018192+0000","last_fullsized":"2024-09-12T18:02:17.018192+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'20","last_scrub_stamp":"2024-09-12T18:02:17.018046+0000","last_deep_scrub":"261'20","last_deep_scrub_stamp":"2024-09-12T18:02:17.018046+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.018046+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:10.005857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":68,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.944792+0000","last_change":"2024-09-12T18:02:33.944792+0000","last_active":"2024-09-12T18:02:33.944792+0000","last_peered":"2024-09-12T18:02:33.944792+0000","last_clean":"2024-09-12T18:02:33.944792+0000","last_became_active":"2024-09-12T17:50:58.425202+0000","last_became_peered":"2024-09-12T17:50:58.425202+0000","last_unstale":"2024-09-12T18:02:33.944792+0000","last_undegraded":"2024-09-12T18:02:33.944792+0000","last_fullsized":"2024-09-12T18:02:33.944792+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:33.944707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:33.944707+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.944707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:05.234661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:48.773661+0000","last_change":"2024-09-12T18:02:48.773661+0000","last_active":"2024-09-12T18:02:48.773661+0000","last_peered":"2024-09-12T18:02:48.773661+0000","last_clean":"2024-09-12T18:02:48.773661+0000","last_became_active":"2024-09-12T17:40:30.427798+0000","last_became_peered":"2024-09-12T17:40:30.427798+0000","last_unstale":"2024-09-12T18:02:48.773661+0000","last_undegraded":"2024-09-12T18:02:48.773661+0000","last_fullsized":"2024-09-12T18:02:48.773661+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:48.773564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:48.773564+0000","last_clean_scrub_stamp":"2024-09-12T18:02:48.773564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:40.815093+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.981318+0000","last_change":"2024-09-12T18:02:20.981243+0000","last_active":"2024-09-12T18:02:20.981318+0000","last_peered":"2024-09-12T18:02:20.981318+0000","last_clean":"2024-09-12T18:02:20.981318+0000","last_became_active":"2024-09-12T17:40:27.381456+0000","last_became_peered":"2024-09-12T17:40:27.381456+0000","last_unstale":"2024-09-12T18:02:20.981318+0000","last_undegraded":"2024-09-12T18:02:20.981318+0000","last_fullsized":"2024-09-12T18:02:20.981318+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:20.981153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:20.981153+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.981153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:22.793630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"261'39","reported_seq":154,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:38.642043+0000","last_change":"2024-09-12T18:02:38.642043+0000","last_active":"2024-09-12T18:02:38.642043+0000","last_peered":"2024-09-12T18:02:38.642043+0000","last_clean":"2024-09-12T18:02:38.642043+0000","last_became_active":"2024-09-12T17:38:51.212222+0000","last_became_peered":"2024-09-12T17:38:51.212222+0000","last_unstale":"2024-09-12T18:02:38.642043+0000","last_undegraded":"2024-09-12T18:02:38.642043+0000","last_fullsized":"2024-09-12T18:02:38.642043+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'39","last_scrub_stamp":"2024-09-12T18:02:38.641976+0000","last_deep_scrub":"261'39","last_deep_scrub_stamp":"2024-09-12T18:02:38.641976+0000","last_clean_scrub_stamp":"2024-09-12T18:02:38.641976+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:28.692108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":132,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:18.408592+0000","last_change":"2024-09-12T17:50:58.422072+0000","last_active":"2024-09-12T17:58:18.408592+0000","last_peered":"2024-09-12T17:58:18.408592+0000","last_clean":"2024-09-12T17:58:18.408592+0000","last_became_active":"2024-09-12T17:50:58.421791+0000","last_became_peered":"2024-09-12T17:50:58.421791+0000","last_unstale":"2024-09-12T17:58:18.408592+0000","last_undegraded":"2024-09-12T17:58:18.408592+0000","last_fullsized":"2024-09-12T17:58:18.408592+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:23.289873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:49.803736+0000","last_change":"2024-09-12T18:02:49.803736+0000","last_active":"2024-09-12T18:02:49.803736+0000","last_peered":"2024-09-12T18:02:49.803736+0000","last_clean":"2024-09-12T18:02:49.803736+0000","last_became_active":"2024-09-12T17:41:17.634263+0000","last_became_peered":"2024-09-12T17:41:17.634263+0000","last_unstale":"2024-09-12T18:02:49.803736+0000","last_undegraded":"2024-09-12T18:02:49.803736+0000","last_fullsized":"2024-09-12T18:02:49.803736+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:49.803633+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:49.803633+0000","last_clean_scrub_stamp":"2024-09-12T18:02:49.803633+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:11.325665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1f","version":"261'2","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:39.012863+0000","last_change":"2024-09-12T18:02:39.012863+0000","last_active":"2024-09-12T18:02:39.012863+0000","last_peered":"2024-09-12T18:02:39.012863+0000","last_clean":"2024-09-12T18:02:39.012863+0000","last_became_active":"2024-09-12T17:40:27.381587+0000","last_became_peered":"2024-09-12T17:40:27.381587+0000","last_unstale":"2024-09-12T18:02:39.012863+0000","last_undegraded":"2024-09-12T18:02:39.012863+0000","last_fullsized":"2024-09-12T18:02:39.012863+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:39.012757+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:39.012757+0000","last_clean_scrub_stamp":"2024-09-12T18:02:39.012757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:02.900671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"261'16","reported_seq":94,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:44.512601+0000","last_change":"2024-09-12T18:02:44.512601+0000","last_active":"2024-09-12T18:02:44.512601+0000","last_peered":"2024-09-12T18:02:44.512601+0000","last_clean":"2024-09-12T18:02:44.512601+0000","last_became_active":"2024-09-12T17:38:51.211429+0000","last_became_peered":"2024-09-12T17:38:51.211429+0000","last_unstale":"2024-09-12T18:02:44.512601+0000","last_undegraded":"2024-09-12T18:02:44.512601+0000","last_fullsized":"2024-09-12T18:02:44.512601+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'16","last_scrub_stamp":"2024-09-12T18:02:44.512505+0000","last_deep_scrub":"261'16","last_deep_scrub_stamp":"2024-09-12T18:02:44.512505+0000","last_clean_scrub_stamp":"2024-09-12T18:02:44.512505+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:23.903761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":53,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:57.549952+0000","last_change":"2024-09-12T18:02:57.549952+0000","last_active":"2024-09-12T18:02:57.549952+0000","last_peered":"2024-09-12T18:02:57.549952+0000","last_clean":"2024-09-12T18:02:57.549952+0000","last_became_active":"2024-09-12T17:50:58.424898+0000","last_became_peered":"2024-09-12T17:50:58.424898+0000","last_unstale":"2024-09-12T18:02:57.549952+0000","last_undegraded":"2024-09-12T18:02:57.549952+0000","last_fullsized":"2024-09-12T18:02:57.549952+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:57.549856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:57.549856+0000","last_clean_scrub_stamp":"2024-09-12T18:02:57.549856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:53.064777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.250507+0000","last_change":"2024-09-12T18:02:41.250507+0000","last_active":"2024-09-12T18:02:41.250507+0000","last_peered":"2024-09-12T18:02:41.250507+0000","last_clean":"2024-09-12T18:02:41.250507+0000","last_became_active":"2024-09-12T17:40:30.418865+0000","last_became_peered":"2024-09-12T17:40:30.418865+0000","last_unstale":"2024-09-12T18:02:41.250507+0000","last_undegraded":"2024-09-12T18:02:41.250507+0000","last_fullsized":"2024-09-12T18:02:41.250507+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:41.250421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:41.250421+0000","last_clean_scrub_stamp":"2024-09-12T18:02:41.250421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:12.331609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'8","reported_seq":64,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:44.661103+0000","last_change":"2024-09-12T18:02:44.661103+0000","last_active":"2024-09-12T18:02:44.661103+0000","last_peered":"2024-09-12T18:02:44.661103+0000","last_clean":"2024-09-12T18:02:44.661103+0000","last_became_active":"2024-09-12T17:40:27.384445+0000","last_became_peered":"2024-09-12T17:40:27.384445+0000","last_unstale":"2024-09-12T18:02:44.661103+0000","last_undegraded":"2024-09-12T18:02:44.661103+0000","last_fullsized":"2024-09-12T18:02:44.661103+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T18:02:44.661020+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T18:02:44.661020+0000","last_clean_scrub_stamp":"2024-09-12T18:02:44.661020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:12.098427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"261'42","reported_seq":167,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.489325+0000","last_change":"2024-09-12T18:02:41.489325+0000","last_active":"2024-09-12T18:02:41.489325+0000","last_peered":"2024-09-12T18:02:41.489325+0000","last_clean":"2024-09-12T18:02:41.489325+0000","last_became_active":"2024-09-12T17:38:51.217421+0000","last_became_peered":"2024-09-12T17:38:51.217421+0000","last_unstale":"2024-09-12T18:02:41.489325+0000","last_undegraded":"2024-09-12T18:02:41.489325+0000","last_fullsized":"2024-09-12T18:02:41.489325+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'42","last_scrub_stamp":"2024-09-12T18:02:41.489237+0000","last_deep_scrub":"261'42","last_deep_scrub_stamp":"2024-09-12T18:02:41.489237+0000","last_clean_scrub_stamp":"2024-09-12T18:02:41.489237+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:39.547261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":155,"num_write":73,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:37.775204+0000","last_change":"2024-09-12T18:02:37.775204+0000","last_active":"2024-09-12T18:02:37.775204+0000","last_peered":"2024-09-12T18:02:37.775204+0000","last_clean":"2024-09-12T18:02:37.775204+0000","last_became_active":"2024-09-12T17:50:58.421760+0000","last_became_peered":"2024-09-12T17:50:58.421760+0000","last_unstale":"2024-09-12T18:02:37.775204+0000","last_undegraded":"2024-09-12T18:02:37.775204+0000","last_fullsized":"2024-09-12T18:02:37.775204+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:37.775117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:37.775117+0000","last_clean_scrub_stamp":"2024-09-12T18:02:37.775117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:43.855363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.887608+0000","last_change":"2024-09-12T18:02:30.887608+0000","last_active":"2024-09-12T18:02:30.887608+0000","last_peered":"2024-09-12T18:02:30.887608+0000","last_clean":"2024-09-12T18:02:30.887608+0000","last_became_active":"2024-09-12T17:40:30.417372+0000","last_became_peered":"2024-09-12T17:40:30.417372+0000","last_unstale":"2024-09-12T18:02:30.887608+0000","last_undegraded":"2024-09-12T18:02:30.887608+0000","last_fullsized":"2024-09-12T18:02:30.887608+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:30.887486+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:30.887486+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.887486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:48.515535+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"258'2","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:37.029696+0000","last_change":"2024-09-12T18:02:37.029696+0000","last_active":"2024-09-12T18:02:37.029696+0000","last_peered":"2024-09-12T18:02:37.029696+0000","last_clean":"2024-09-12T18:02:37.029696+0000","last_became_active":"2024-09-12T17:40:27.379161+0000","last_became_peered":"2024-09-12T17:40:27.379161+0000","last_unstale":"2024-09-12T18:02:37.029696+0000","last_undegraded":"2024-09-12T18:02:37.029696+0000","last_fullsized":"2024-09-12T18:02:37.029696+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-12T18:02:37.029610+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-12T18:02:37.029610+0000","last_clean_scrub_stamp":"2024-09-12T18:02:37.029610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:10.431337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"261'20","reported_seq":106,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.989175+0000","last_change":"2024-09-12T18:02:25.989175+0000","last_active":"2024-09-12T18:02:25.989175+0000","last_peered":"2024-09-12T18:02:25.989175+0000","last_clean":"2024-09-12T18:02:25.989175+0000","last_became_active":"2024-09-12T17:38:51.214555+0000","last_became_peered":"2024-09-12T17:38:51.214555+0000","last_unstale":"2024-09-12T18:02:25.989175+0000","last_undegraded":"2024-09-12T18:02:25.989175+0000","last_fullsized":"2024-09-12T18:02:25.989175+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'20","last_scrub_stamp":"2024-09-12T18:02:25.989086+0000","last_deep_scrub":"261'20","last_deep_scrub_stamp":"2024-09-12T18:02:25.989086+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.989086+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:21.310126+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T17:58:29.412872+0000","last_change":"2024-09-12T17:50:58.429666+0000","last_active":"2024-09-12T17:58:29.412872+0000","last_peered":"2024-09-12T17:58:29.412872+0000","last_clean":"2024-09-12T17:58:29.412872+0000","last_became_active":"2024-09-12T17:50:58.429381+0000","last_became_peered":"2024-09-12T17:50:58.429381+0000","last_unstale":"2024-09-12T17:58:29.412872+0000","last_undegraded":"2024-09-12T17:58:29.412872+0000","last_fullsized":"2024-09-12T17:58:29.412872+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:24.108837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.882157+0000","last_change":"2024-09-12T18:02:31.882157+0000","last_active":"2024-09-12T18:02:31.882157+0000","last_peered":"2024-09-12T18:02:31.882157+0000","last_clean":"2024-09-12T18:02:31.882157+0000","last_became_active":"2024-09-12T17:40:30.420165+0000","last_became_peered":"2024-09-12T17:40:30.420165+0000","last_unstale":"2024-09-12T18:02:31.882157+0000","last_undegraded":"2024-09-12T18:02:31.882157+0000","last_fullsized":"2024-09-12T18:02:31.882157+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:31.882070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:31.882070+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.882070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:43.238046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"261'3","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:37.985954+0000","last_change":"2024-09-12T18:02:37.985954+0000","last_active":"2024-09-12T18:02:37.985954+0000","last_peered":"2024-09-12T18:02:37.985954+0000","last_clean":"2024-09-12T18:02:37.985954+0000","last_became_active":"2024-09-12T17:40:27.382310+0000","last_became_peered":"2024-09-12T17:40:27.382310+0000","last_unstale":"2024-09-12T18:02:37.985954+0000","last_undegraded":"2024-09-12T18:02:37.985954+0000","last_fullsized":"2024-09-12T18:02:37.985954+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:37.985817+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:37.985817+0000","last_clean_scrub_stamp":"2024-09-12T18:02:37.985817+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:56.208504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"261'83","reported_seq":284,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:37.644099+0000","last_change":"2024-09-12T18:02:37.644099+0000","last_active":"2024-09-12T18:02:37.644099+0000","last_peered":"2024-09-12T18:02:37.644099+0000","last_clean":"2024-09-12T18:02:37.644099+0000","last_became_active":"2024-09-12T17:38:51.213569+0000","last_became_peered":"2024-09-12T17:38:51.213569+0000","last_unstale":"2024-09-12T18:02:37.644099+0000","last_undegraded":"2024-09-12T18:02:37.644099+0000","last_fullsized":"2024-09-12T18:02:37.644099+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'83","last_scrub_stamp":"2024-09-12T18:02:37.644012+0000","last_deep_scrub":"261'83","last_deep_scrub_stamp":"2024-09-12T18:02:37.644012+0000","last_clean_scrub_stamp":"2024-09-12T18:02:37.644012+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:35.136801+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":443,"num_read_kb":326,"num_write":140,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:53.693301+0000","last_change":"2024-09-12T18:02:53.693301+0000","last_active":"2024-09-12T18:02:53.693301+0000","last_peered":"2024-09-12T18:02:53.693301+0000","last_clean":"2024-09-12T18:02:53.693301+0000","last_became_active":"2024-09-12T17:50:58.431242+0000","last_became_peered":"2024-09-12T17:50:58.431242+0000","last_unstale":"2024-09-12T18:02:53.693301+0000","last_undegraded":"2024-09-12T18:02:53.693301+0000","last_fullsized":"2024-09-12T18:02:53.693301+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:53.693204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:53.693204+0000","last_clean_scrub_stamp":"2024-09-12T18:02:53.693204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:37.575686+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'2","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:53.472680+0000","last_change":"2024-09-12T18:02:53.472680+0000","last_active":"2024-09-12T18:02:53.472680+0000","last_peered":"2024-09-12T18:02:53.472680+0000","last_clean":"2024-09-12T18:02:53.472680+0000","last_became_active":"2024-09-12T17:40:30.416973+0000","last_became_peered":"2024-09-12T17:40:30.416973+0000","last_unstale":"2024-09-12T18:02:53.472680+0000","last_undegraded":"2024-09-12T18:02:53.472680+0000","last_fullsized":"2024-09-12T18:02:53.472680+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:53.472583+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:53.472583+0000","last_clean_scrub_stamp":"2024-09-12T18:02:53.472583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:01.333821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"258'6","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:45.698029+0000","last_change":"2024-09-12T18:02:45.698029+0000","last_active":"2024-09-12T18:02:45.698029+0000","last_peered":"2024-09-12T18:02:45.698029+0000","last_clean":"2024-09-12T18:02:45.698029+0000","last_became_active":"2024-09-12T17:40:27.383589+0000","last_became_peered":"2024-09-12T17:40:27.383589+0000","last_unstale":"2024-09-12T18:02:45.698029+0000","last_undegraded":"2024-09-12T18:02:45.698029+0000","last_fullsized":"2024-09-12T18:02:45.698029+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'6","last_scrub_stamp":"2024-09-12T18:02:45.697922+0000","last_deep_scrub":"258'6","last_deep_scrub_stamp":"2024-09-12T18:02:45.697922+0000","last_clean_scrub_stamp":"2024-09-12T18:02:45.697922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:27.714994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"261'40","reported_seq":157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.928364+0000","last_change":"2024-09-12T18:02:25.928364+0000","last_active":"2024-09-12T18:02:25.928364+0000","last_peered":"2024-09-12T18:02:25.928364+0000","last_clean":"2024-09-12T18:02:25.928364+0000","last_became_active":"2024-09-12T17:38:51.211962+0000","last_became_peered":"2024-09-12T17:38:51.211962+0000","last_unstale":"2024-09-12T18:02:25.928364+0000","last_undegraded":"2024-09-12T18:02:25.928364+0000","last_fullsized":"2024-09-12T18:02:25.928364+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'40","last_scrub_stamp":"2024-09-12T18:02:25.928263+0000","last_deep_scrub":"261'40","last_deep_scrub_stamp":"2024-09-12T18:02:25.928263+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.928263+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:28.089551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":137,"num_write":74,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:36.816419+0000","last_change":"2024-09-12T18:02:36.816309+0000","last_active":"2024-09-12T18:02:36.816419+0000","last_peered":"2024-09-12T18:02:36.816419+0000","last_clean":"2024-09-12T18:02:36.816419+0000","last_became_active":"2024-09-12T17:50:58.415098+0000","last_became_peered":"2024-09-12T17:50:58.415098+0000","last_unstale":"2024-09-12T18:02:36.816419+0000","last_undegraded":"2024-09-12T18:02:36.816419+0000","last_fullsized":"2024-09-12T18:02:36.816419+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:36.816207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:36.816207+0000","last_clean_scrub_stamp":"2024-09-12T18:02:36.816207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:57.660239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:51.423898+0000","last_change":"2024-09-12T18:02:51.423898+0000","last_active":"2024-09-12T18:02:51.423898+0000","last_peered":"2024-09-12T18:02:51.423898+0000","last_clean":"2024-09-12T18:02:51.423898+0000","last_became_active":"2024-09-12T17:40:30.425845+0000","last_became_peered":"2024-09-12T17:40:30.425845+0000","last_unstale":"2024-09-12T18:02:51.423898+0000","last_undegraded":"2024-09-12T18:02:51.423898+0000","last_fullsized":"2024-09-12T18:02:51.423898+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:51.423801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:51.423801+0000","last_clean_scrub_stamp":"2024-09-12T18:02:51.423801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:44.184878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"261'11","reported_seq":72,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:38.184724+0000","last_change":"2024-09-12T18:02:38.184724+0000","last_active":"2024-09-12T18:02:38.184724+0000","last_peered":"2024-09-12T18:02:38.184724+0000","last_clean":"2024-09-12T18:02:38.184724+0000","last_became_active":"2024-09-12T17:40:27.382833+0000","last_became_peered":"2024-09-12T17:40:27.382833+0000","last_unstale":"2024-09-12T18:02:38.184724+0000","last_undegraded":"2024-09-12T18:02:38.184724+0000","last_fullsized":"2024-09-12T18:02:38.184724+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-09-12T18:02:38.184615+0000","last_deep_scrub":"261'11","last_deep_scrub_stamp":"2024-09-12T18:02:38.184615+0000","last_clean_scrub_stamp":"2024-09-12T18:02:38.184615+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:40.952747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32770,"num_write":16,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"261'60","reported_seq":211,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:36.661090+0000","last_change":"2024-09-12T18:02:36.661090+0000","last_active":"2024-09-12T18:02:36.661090+0000","last_peered":"2024-09-12T18:02:36.661090+0000","last_clean":"2024-09-12T18:02:36.661090+0000","last_became_active":"2024-09-12T17:38:51.214274+0000","last_became_peered":"2024-09-12T17:38:51.214274+0000","last_unstale":"2024-09-12T18:02:36.661090+0000","last_undegraded":"2024-09-12T18:02:36.661090+0000","last_fullsized":"2024-09-12T18:02:36.661090+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'60","last_scrub_stamp":"2024-09-12T18:02:36.660968+0000","last_deep_scrub":"261'60","last_deep_scrub_stamp":"2024-09-12T18:02:36.660968+0000","last_clean_scrub_stamp":"2024-09-12T18:02:36.660968+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:44.994140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":211,"num_write":107,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.038837+0000","last_change":"2024-09-12T18:02:24.038781+0000","last_active":"2024-09-12T18:02:24.038837+0000","last_peered":"2024-09-12T18:02:24.038837+0000","last_clean":"2024-09-12T18:02:24.038837+0000","last_became_active":"2024-09-12T17:50:58.426537+0000","last_became_peered":"2024-09-12T17:50:58.426537+0000","last_unstale":"2024-09-12T18:02:24.038837+0000","last_undegraded":"2024-09-12T18:02:24.038837+0000","last_fullsized":"2024-09-12T18:02:24.038837+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:24.038695+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:24.038695+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.038695+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:53.395847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"261'8","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:50.451865+0000","last_change":"2024-09-12T18:02:50.451865+0000","last_active":"2024-09-12T18:02:50.451865+0000","last_peered":"2024-09-12T18:02:50.451865+0000","last_clean":"2024-09-12T18:02:50.451865+0000","last_became_active":"2024-09-12T17:40:30.425368+0000","last_became_peered":"2024-09-12T17:40:30.425368+0000","last_unstale":"2024-09-12T18:02:50.451865+0000","last_undegraded":"2024-09-12T18:02:50.451865+0000","last_fullsized":"2024-09-12T18:02:50.451865+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T18:02:50.451776+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T18:02:50.451776+0000","last_clean_scrub_stamp":"2024-09-12T18:02:50.451776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:58.567240+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'3","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.626752+0000","last_change":"2024-09-12T18:02:41.626752+0000","last_active":"2024-09-12T18:02:41.626752+0000","last_peered":"2024-09-12T18:02:41.626752+0000","last_clean":"2024-09-12T18:02:41.626752+0000","last_became_active":"2024-09-12T17:40:27.380228+0000","last_became_peered":"2024-09-12T17:40:27.380228+0000","last_unstale":"2024-09-12T18:02:41.626752+0000","last_undegraded":"2024-09-12T18:02:41.626752+0000","last_fullsized":"2024-09-12T18:02:41.626752+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:41.626669+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:41.626669+0000","last_clean_scrub_stamp":"2024-09-12T18:02:41.626669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:02.507799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"261'21","reported_seq":107,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:39.455046+0000","last_change":"2024-09-12T18:02:39.455046+0000","last_active":"2024-09-12T18:02:39.455046+0000","last_peered":"2024-09-12T18:02:39.455046+0000","last_clean":"2024-09-12T18:02:39.455046+0000","last_became_active":"2024-09-12T17:38:51.218309+0000","last_became_peered":"2024-09-12T17:38:51.218309+0000","last_unstale":"2024-09-12T18:02:39.455046+0000","last_undegraded":"2024-09-12T18:02:39.455046+0000","last_fullsized":"2024-09-12T18:02:39.455046+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'21","last_scrub_stamp":"2024-09-12T18:02:39.454955+0000","last_deep_scrub":"261'21","last_deep_scrub_stamp":"2024-09-12T18:02:39.454955+0000","last_clean_scrub_stamp":"2024-09-12T18:02:39.454955+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:28.308893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:51.682798+0000","last_change":"2024-09-12T18:02:51.682798+0000","last_active":"2024-09-12T18:02:51.682798+0000","last_peered":"2024-09-12T18:02:51.682798+0000","last_clean":"2024-09-12T18:02:51.682798+0000","last_became_active":"2024-09-12T17:50:58.425003+0000","last_became_peered":"2024-09-12T17:50:58.425003+0000","last_unstale":"2024-09-12T18:02:51.682798+0000","last_undegraded":"2024-09-12T18:02:51.682798+0000","last_fullsized":"2024-09-12T18:02:51.682798+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:51.682710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:51.682710+0000","last_clean_scrub_stamp":"2024-09-12T18:02:51.682710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:41.772002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"261'3","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:52.430913+0000","last_change":"2024-09-12T18:02:52.430913+0000","last_active":"2024-09-12T18:02:52.430913+0000","last_peered":"2024-09-12T18:02:52.430913+0000","last_clean":"2024-09-12T18:02:52.430913+0000","last_became_active":"2024-09-12T17:40:30.426714+0000","last_became_peered":"2024-09-12T17:40:30.426714+0000","last_unstale":"2024-09-12T18:02:52.430913+0000","last_undegraded":"2024-09-12T18:02:52.430913+0000","last_fullsized":"2024-09-12T18:02:52.430913+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:52.430822+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:52.430822+0000","last_clean_scrub_stamp":"2024-09-12T18:02:52.430822+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:16.296868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.968483+0000","last_change":"2024-09-12T18:02:19.968483+0000","last_active":"2024-09-12T18:02:19.968483+0000","last_peered":"2024-09-12T18:02:19.968483+0000","last_clean":"2024-09-12T18:02:19.968483+0000","last_became_active":"2024-09-12T17:40:27.382132+0000","last_became_peered":"2024-09-12T17:40:27.382132+0000","last_unstale":"2024-09-12T18:02:19.968483+0000","last_undegraded":"2024-09-12T18:02:19.968483+0000","last_fullsized":"2024-09-12T18:02:19.968483+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:19.968389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:19.968389+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.968389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:16.177909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"261'28","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.950452+0000","last_change":"2024-09-12T18:02:14.950452+0000","last_active":"2024-09-12T18:02:14.950452+0000","last_peered":"2024-09-12T18:02:14.950452+0000","last_clean":"2024-09-12T18:02:14.950452+0000","last_became_active":"2024-09-12T17:38:51.214963+0000","last_became_peered":"2024-09-12T17:38:51.214963+0000","last_unstale":"2024-09-12T18:02:14.950452+0000","last_undegraded":"2024-09-12T18:02:14.950452+0000","last_fullsized":"2024-09-12T18:02:14.950452+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'28","last_scrub_stamp":"2024-09-12T18:02:14.950343+0000","last_deep_scrub":"261'28","last_deep_scrub_stamp":"2024-09-12T18:02:14.950343+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.950343+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:23.488575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":103,"num_write":58,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:44.280253+0000","last_change":"2024-09-12T18:02:44.280253+0000","last_active":"2024-09-12T18:02:44.280253+0000","last_peered":"2024-09-12T18:02:44.280253+0000","last_clean":"2024-09-12T18:02:44.280253+0000","last_became_active":"2024-09-12T17:50:58.426779+0000","last_became_peered":"2024-09-12T17:50:58.426779+0000","last_unstale":"2024-09-12T18:02:44.280253+0000","last_undegraded":"2024-09-12T18:02:44.280253+0000","last_fullsized":"2024-09-12T18:02:44.280253+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:44.280164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:44.280164+0000","last_clean_scrub_stamp":"2024-09-12T18:02:44.280164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:20.146249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"258'6","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:44.984686+0000","last_change":"2024-09-12T18:02:44.984686+0000","last_active":"2024-09-12T18:02:44.984686+0000","last_peered":"2024-09-12T18:02:44.984686+0000","last_clean":"2024-09-12T18:02:44.984686+0000","last_became_active":"2024-09-12T17:40:30.419211+0000","last_became_peered":"2024-09-12T17:40:30.419211+0000","last_unstale":"2024-09-12T18:02:44.984686+0000","last_undegraded":"2024-09-12T18:02:44.984686+0000","last_fullsized":"2024-09-12T18:02:44.984686+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'6","last_scrub_stamp":"2024-09-12T18:02:44.984582+0000","last_deep_scrub":"258'6","last_deep_scrub_stamp":"2024-09-12T18:02:44.984582+0000","last_clean_scrub_stamp":"2024-09-12T18:02:44.984582+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:22.656420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:43.631824+0000","last_change":"2024-09-12T18:02:43.631824+0000","last_active":"2024-09-12T18:02:43.631824+0000","last_peered":"2024-09-12T18:02:43.631824+0000","last_clean":"2024-09-12T18:02:43.631824+0000","last_became_active":"2024-09-12T17:40:27.382564+0000","last_became_peered":"2024-09-12T17:40:27.382564+0000","last_unstale":"2024-09-12T18:02:43.631824+0000","last_undegraded":"2024-09-12T18:02:43.631824+0000","last_fullsized":"2024-09-12T18:02:43.631824+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:43.631714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:43.631714+0000","last_clean_scrub_stamp":"2024-09-12T18:02:43.631714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:19.446293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"261'12","reported_seq":84,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:36.576009+0000","last_change":"2024-09-12T18:02:36.576009+0000","last_active":"2024-09-12T18:02:36.576009+0000","last_peered":"2024-09-12T18:02:36.576009+0000","last_clean":"2024-09-12T18:02:36.576009+0000","last_became_active":"2024-09-12T17:38:51.214678+0000","last_became_peered":"2024-09-12T17:38:51.214678+0000","last_unstale":"2024-09-12T18:02:36.576009+0000","last_undegraded":"2024-09-12T18:02:36.576009+0000","last_fullsized":"2024-09-12T18:02:36.576009+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'12","last_scrub_stamp":"2024-09-12T18:02:36.575881+0000","last_deep_scrub":"261'12","last_deep_scrub_stamp":"2024-09-12T18:02:36.575881+0000","last_clean_scrub_stamp":"2024-09-12T18:02:36.575881+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:22.760334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":38,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:56.562066+0000","last_change":"2024-09-12T18:02:56.562066+0000","last_active":"2024-09-12T18:02:56.562066+0000","last_peered":"2024-09-12T18:02:56.562066+0000","last_clean":"2024-09-12T18:02:56.562066+0000","last_became_active":"2024-09-12T17:50:58.427630+0000","last_became_peered":"2024-09-12T17:50:58.427630+0000","last_unstale":"2024-09-12T18:02:56.562066+0000","last_undegraded":"2024-09-12T18:02:56.562066+0000","last_fullsized":"2024-09-12T18:02:56.562066+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:56.561964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:56.561964+0000","last_clean_scrub_stamp":"2024-09-12T18:02:56.561964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:03.214489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"261'14","reported_seq":74,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.843157+0000","last_change":"2024-09-12T18:02:34.843157+0000","last_active":"2024-09-12T18:02:34.843157+0000","last_peered":"2024-09-12T18:02:34.843157+0000","last_clean":"2024-09-12T18:02:34.843157+0000","last_became_active":"2024-09-12T17:40:30.413592+0000","last_became_peered":"2024-09-12T17:40:30.413592+0000","last_unstale":"2024-09-12T18:02:34.843157+0000","last_undegraded":"2024-09-12T18:02:34.843157+0000","last_fullsized":"2024-09-12T18:02:34.843157+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'14","last_scrub_stamp":"2024-09-12T18:02:34.843076+0000","last_deep_scrub":"261'14","last_deep_scrub_stamp":"2024-09-12T18:02:34.843076+0000","last_clean_scrub_stamp":"2024-09-12T18:02:34.843076+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:06.293898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":45058,"num_write":24,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'8","reported_seq":68,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:36.031113+0000","last_change":"2024-09-12T18:02:36.031113+0000","last_active":"2024-09-12T18:02:36.031113+0000","last_peered":"2024-09-12T18:02:36.031113+0000","last_clean":"2024-09-12T18:02:36.031113+0000","last_became_active":"2024-09-12T17:40:27.381516+0000","last_became_peered":"2024-09-12T17:40:27.381516+0000","last_unstale":"2024-09-12T18:02:36.031113+0000","last_undegraded":"2024-09-12T18:02:36.031113+0000","last_fullsized":"2024-09-12T18:02:36.031113+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T18:02:36.031024+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T18:02:36.031024+0000","last_clean_scrub_stamp":"2024-09-12T18:02:36.031024+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:18.672677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"261'6","reported_seq":68,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:35.625398+0000","last_change":"2024-09-12T18:02:35.625398+0000","last_active":"2024-09-12T18:02:35.625398+0000","last_peered":"2024-09-12T18:02:35.625398+0000","last_clean":"2024-09-12T18:02:35.625398+0000","last_became_active":"2024-09-12T17:38:51.215646+0000","last_became_peered":"2024-09-12T17:38:51.215646+0000","last_unstale":"2024-09-12T18:02:35.625398+0000","last_undegraded":"2024-09-12T18:02:35.625398+0000","last_fullsized":"2024-09-12T18:02:35.625398+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T18:02:35.625286+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T18:02:35.625286+0000","last_clean_scrub_stamp":"2024-09-12T18:02:35.625286+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:44.327257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:53.854185+0000","last_change":"2024-09-12T18:02:53.854185+0000","last_active":"2024-09-12T18:02:53.854185+0000","last_peered":"2024-09-12T18:02:53.854185+0000","last_clean":"2024-09-12T18:02:53.854185+0000","last_became_active":"2024-09-12T17:50:58.422692+0000","last_became_peered":"2024-09-12T17:50:58.422692+0000","last_unstale":"2024-09-12T18:02:53.854185+0000","last_undegraded":"2024-09-12T18:02:53.854185+0000","last_fullsized":"2024-09-12T18:02:53.854185+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:53.854095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:53.854095+0000","last_clean_scrub_stamp":"2024-09-12T18:02:53.854095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:10.616476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.829091+0000","last_change":"2024-09-12T18:02:33.829091+0000","last_active":"2024-09-12T18:02:33.829091+0000","last_peered":"2024-09-12T18:02:33.829091+0000","last_clean":"2024-09-12T18:02:33.829091+0000","last_became_active":"2024-09-12T17:40:30.418904+0000","last_became_peered":"2024-09-12T17:40:30.418904+0000","last_unstale":"2024-09-12T18:02:33.829091+0000","last_undegraded":"2024-09-12T18:02:33.829091+0000","last_fullsized":"2024-09-12T18:02:33.829091+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:33.828999+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:33.828999+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.828999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:57.783167+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.518166+0000","last_change":"2024-09-12T18:02:42.518166+0000","last_active":"2024-09-12T18:02:42.518166+0000","last_peered":"2024-09-12T18:02:42.518166+0000","last_clean":"2024-09-12T18:02:42.518166+0000","last_became_active":"2024-09-12T17:40:27.381849+0000","last_became_peered":"2024-09-12T17:40:27.381849+0000","last_unstale":"2024-09-12T18:02:42.518166+0000","last_undegraded":"2024-09-12T18:02:42.518166+0000","last_fullsized":"2024-09-12T18:02:42.518166+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:42.518074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:42.518074+0000","last_clean_scrub_stamp":"2024-09-12T18:02:42.518074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:03.054404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"261'23","reported_seq":112,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:35.681349+0000","last_change":"2024-09-12T18:02:35.681349+0000","last_active":"2024-09-12T18:02:35.681349+0000","last_peered":"2024-09-12T18:02:35.681349+0000","last_clean":"2024-09-12T18:02:35.681349+0000","last_became_active":"2024-09-12T17:38:51.207804+0000","last_became_peered":"2024-09-12T17:38:51.207804+0000","last_unstale":"2024-09-12T18:02:35.681349+0000","last_undegraded":"2024-09-12T18:02:35.681349+0000","last_fullsized":"2024-09-12T18:02:35.681349+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'23","last_scrub_stamp":"2024-09-12T18:02:35.681244+0000","last_deep_scrub":"261'23","last_deep_scrub_stamp":"2024-09-12T18:02:35.681244+0000","last_clean_scrub_stamp":"2024-09-12T18:02:35.681244+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:55.561705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":76,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:00:19.554307+0000","last_change":"2024-09-12T17:50:58.424688+0000","last_active":"2024-09-12T18:00:19.554307+0000","last_peered":"2024-09-12T18:00:19.554307+0000","last_clean":"2024-09-12T18:00:19.554307+0000","last_became_active":"2024-09-12T17:50:58.424379+0000","last_became_peered":"2024-09-12T17:50:58.424379+0000","last_unstale":"2024-09-12T18:00:19.554307+0000","last_undegraded":"2024-09-12T18:00:19.554307+0000","last_fullsized":"2024-09-12T18:00:19.554307+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:50:57.390797+0000","last_clean_scrub_stamp":"2024-09-12T17:50:57.390797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:48.464759+0000","last_change":"2024-09-12T18:02:48.464759+0000","last_active":"2024-09-12T18:02:48.464759+0000","last_peered":"2024-09-12T18:02:48.464759+0000","last_clean":"2024-09-12T18:02:48.464759+0000","last_became_active":"2024-09-12T17:40:30.417111+0000","last_became_peered":"2024-09-12T17:40:30.417111+0000","last_unstale":"2024-09-12T18:02:48.464759+0000","last_undegraded":"2024-09-12T18:02:48.464759+0000","last_fullsized":"2024-09-12T18:02:48.464759+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:48.464669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:48.464669+0000","last_clean_scrub_stamp":"2024-09-12T18:02:48.464669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:34.711586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.954712+0000","last_change":"2024-09-12T18:02:26.954712+0000","last_active":"2024-09-12T18:02:26.954712+0000","last_peered":"2024-09-12T18:02:26.954712+0000","last_clean":"2024-09-12T18:02:26.954712+0000","last_became_active":"2024-09-12T17:40:27.378245+0000","last_became_peered":"2024-09-12T17:40:27.378245+0000","last_unstale":"2024-09-12T18:02:26.954712+0000","last_undegraded":"2024-09-12T18:02:26.954712+0000","last_fullsized":"2024-09-12T18:02:26.954712+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:26.954627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:26.954627+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.954627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:34.497961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"261'38","reported_seq":162,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:35.002700+0000","last_change":"2024-09-12T18:02:35.002700+0000","last_active":"2024-09-12T18:02:35.002700+0000","last_peered":"2024-09-12T18:02:35.002700+0000","last_clean":"2024-09-12T18:02:35.002700+0000","last_became_active":"2024-09-12T17:38:51.208950+0000","last_became_peered":"2024-09-12T17:38:51.208950+0000","last_unstale":"2024-09-12T18:02:35.002700+0000","last_undegraded":"2024-09-12T18:02:35.002700+0000","last_fullsized":"2024-09-12T18:02:35.002700+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'38","last_scrub_stamp":"2024-09-12T18:02:35.002605+0000","last_deep_scrub":"261'38","last_deep_scrub_stamp":"2024-09-12T18:02:35.002605+0000","last_clean_scrub_stamp":"2024-09-12T18:02:35.002605+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:12.280316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":143,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"261'2","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:55.542326+0000","last_change":"2024-09-12T18:02:55.542326+0000","last_active":"2024-09-12T18:02:55.542326+0000","last_peered":"2024-09-12T18:02:55.542326+0000","last_clean":"2024-09-12T18:02:55.542326+0000","last_became_active":"2024-09-12T17:50:58.425574+0000","last_became_peered":"2024-09-12T17:50:58.425574+0000","last_unstale":"2024-09-12T18:02:55.542326+0000","last_undegraded":"2024-09-12T18:02:55.542326+0000","last_fullsized":"2024-09-12T18:02:55.542326+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:55.542235+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:55.542235+0000","last_clean_scrub_stamp":"2024-09-12T18:02:55.542235+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:52.882414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.874045+0000","last_change":"2024-09-12T18:02:29.874045+0000","last_active":"2024-09-12T18:02:29.874045+0000","last_peered":"2024-09-12T18:02:29.874045+0000","last_clean":"2024-09-12T18:02:29.874045+0000","last_became_active":"2024-09-12T17:40:30.411737+0000","last_became_peered":"2024-09-12T17:40:30.411737+0000","last_unstale":"2024-09-12T18:02:29.874045+0000","last_undegraded":"2024-09-12T18:02:29.874045+0000","last_fullsized":"2024-09-12T18:02:29.874045+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:29.873959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:29.873959+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.873959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:35.256924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:39.160275+0000","last_change":"2024-09-12T18:02:39.160275+0000","last_active":"2024-09-12T18:02:39.160275+0000","last_peered":"2024-09-12T18:02:39.160275+0000","last_clean":"2024-09-12T18:02:39.160275+0000","last_became_active":"2024-09-12T17:40:27.372357+0000","last_became_peered":"2024-09-12T17:40:27.372357+0000","last_unstale":"2024-09-12T18:02:39.160275+0000","last_undegraded":"2024-09-12T18:02:39.160275+0000","last_fullsized":"2024-09-12T18:02:39.160275+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:39.160188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:39.160188+0000","last_clean_scrub_stamp":"2024-09-12T18:02:39.160188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:56.576778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"261'42","reported_seq":159,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:43.481195+0000","last_change":"2024-09-12T18:02:43.481195+0000","last_active":"2024-09-12T18:02:43.481195+0000","last_peered":"2024-09-12T18:02:43.481195+0000","last_clean":"2024-09-12T18:02:43.481195+0000","last_became_active":"2024-09-12T17:38:51.207798+0000","last_became_peered":"2024-09-12T17:38:51.207798+0000","last_unstale":"2024-09-12T18:02:43.481195+0000","last_undegraded":"2024-09-12T18:02:43.481195+0000","last_fullsized":"2024-09-12T18:02:43.481195+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'42","last_scrub_stamp":"2024-09-12T18:02:43.481102+0000","last_deep_scrub":"261'42","last_deep_scrub_stamp":"2024-09-12T18:02:43.481102+0000","last_clean_scrub_stamp":"2024-09-12T18:02:43.481102+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:28.234594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":137,"num_write":80,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.001901+0000","last_change":"2024-09-12T18:02:23.001901+0000","last_active":"2024-09-12T18:02:23.001901+0000","last_peered":"2024-09-12T18:02:23.001901+0000","last_clean":"2024-09-12T18:02:23.001901+0000","last_became_active":"2024-09-12T17:50:58.428339+0000","last_became_peered":"2024-09-12T17:50:58.428339+0000","last_unstale":"2024-09-12T18:02:23.001901+0000","last_undegraded":"2024-09-12T18:02:23.001901+0000","last_fullsized":"2024-09-12T18:02:23.001901+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:23.001816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:23.001816+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.001816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:27.387765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"261'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:47.444153+0000","last_change":"2024-09-12T18:02:47.444153+0000","last_active":"2024-09-12T18:02:47.444153+0000","last_peered":"2024-09-12T18:02:47.444153+0000","last_clean":"2024-09-12T18:02:47.444153+0000","last_became_active":"2024-09-12T17:40:30.417583+0000","last_became_peered":"2024-09-12T17:40:30.417583+0000","last_unstale":"2024-09-12T18:02:47.444153+0000","last_undegraded":"2024-09-12T18:02:47.444153+0000","last_fullsized":"2024-09-12T18:02:47.444153+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:47.444046+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:47.444046+0000","last_clean_scrub_stamp":"2024-09-12T18:02:47.444046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:24.152928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"258'2","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:39.614846+0000","last_change":"2024-09-12T18:02:39.614846+0000","last_active":"2024-09-12T18:02:39.614846+0000","last_peered":"2024-09-12T18:02:39.614846+0000","last_clean":"2024-09-12T18:02:39.614846+0000","last_became_active":"2024-09-12T17:40:27.381027+0000","last_became_peered":"2024-09-12T17:40:27.381027+0000","last_unstale":"2024-09-12T18:02:39.614846+0000","last_undegraded":"2024-09-12T18:02:39.614846+0000","last_fullsized":"2024-09-12T18:02:39.614846+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-12T18:02:39.614746+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-12T18:02:39.614746+0000","last_clean_scrub_stamp":"2024-09-12T18:02:39.614746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:35.474853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"261'21","reported_seq":106,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:40.473619+0000","last_change":"2024-09-12T18:02:40.473619+0000","last_active":"2024-09-12T18:02:40.473619+0000","last_peered":"2024-09-12T18:02:40.473619+0000","last_clean":"2024-09-12T18:02:40.473619+0000","last_became_active":"2024-09-12T17:38:51.207487+0000","last_became_peered":"2024-09-12T17:38:51.207487+0000","last_unstale":"2024-09-12T18:02:40.473619+0000","last_undegraded":"2024-09-12T18:02:40.473619+0000","last_fullsized":"2024-09-12T18:02:40.473619+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'21","last_scrub_stamp":"2024-09-12T18:02:40.473526+0000","last_deep_scrub":"261'21","last_deep_scrub_stamp":"2024-09-12T18:02:40.473526+0000","last_clean_scrub_stamp":"2024-09-12T18:02:40.473526+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:50.792759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":66,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:48.634809+0000","last_change":"2024-09-12T18:02:48.634809+0000","last_active":"2024-09-12T18:02:48.634809+0000","last_peered":"2024-09-12T18:02:48.634809+0000","last_clean":"2024-09-12T18:02:48.634809+0000","last_became_active":"2024-09-12T17:50:58.430797+0000","last_became_peered":"2024-09-12T17:50:58.430797+0000","last_unstale":"2024-09-12T18:02:48.634809+0000","last_undegraded":"2024-09-12T18:02:48.634809+0000","last_fullsized":"2024-09-12T18:02:48.634809+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:48.634720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:48.634720+0000","last_clean_scrub_stamp":"2024-09-12T18:02:48.634720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:44.691730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"261'5","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:46.487430+0000","last_change":"2024-09-12T18:02:46.487430+0000","last_active":"2024-09-12T18:02:46.487430+0000","last_peered":"2024-09-12T18:02:46.487430+0000","last_clean":"2024-09-12T18:02:46.487430+0000","last_became_active":"2024-09-12T17:40:30.417567+0000","last_became_peered":"2024-09-12T17:40:30.417567+0000","last_unstale":"2024-09-12T18:02:46.487430+0000","last_undegraded":"2024-09-12T18:02:46.487430+0000","last_fullsized":"2024-09-12T18:02:46.487430+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:02:46.487341+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:02:46.487341+0000","last_clean_scrub_stamp":"2024-09-12T18:02:46.487341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:54.385530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"261'10","reported_seq":62,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.009035+0000","last_change":"2024-09-12T18:02:19.008973+0000","last_active":"2024-09-12T18:02:19.009035+0000","last_peered":"2024-09-12T18:02:19.009035+0000","last_clean":"2024-09-12T18:02:19.009035+0000","last_became_active":"2024-09-12T17:40:27.384579+0000","last_became_peered":"2024-09-12T17:40:27.384579+0000","last_unstale":"2024-09-12T18:02:19.009035+0000","last_undegraded":"2024-09-12T18:02:19.009035+0000","last_fullsized":"2024-09-12T18:02:19.009035+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'10","last_scrub_stamp":"2024-09-12T18:02:19.008873+0000","last_deep_scrub":"261'10","last_deep_scrub_stamp":"2024-09-12T18:02:19.008873+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.008873+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:19.052107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":20,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"261'7","reported_seq":69,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:35.147694+0000","last_change":"2024-09-12T18:02:35.147694+0000","last_active":"2024-09-12T18:02:35.147694+0000","last_peered":"2024-09-12T18:02:35.147694+0000","last_clean":"2024-09-12T18:02:35.147694+0000","last_became_active":"2024-09-12T17:38:51.215590+0000","last_became_peered":"2024-09-12T17:38:51.215590+0000","last_unstale":"2024-09-12T18:02:35.147694+0000","last_undegraded":"2024-09-12T18:02:35.147694+0000","last_fullsized":"2024-09-12T18:02:35.147694+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-12T18:02:35.147613+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-12T18:02:35.147613+0000","last_clean_scrub_stamp":"2024-09-12T18:02:35.147613+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:32.712740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.906222+0000","last_change":"2024-09-12T18:02:32.906222+0000","last_active":"2024-09-12T18:02:32.906222+0000","last_peered":"2024-09-12T18:02:32.906222+0000","last_clean":"2024-09-12T18:02:32.906222+0000","last_became_active":"2024-09-12T17:50:58.426867+0000","last_became_peered":"2024-09-12T17:50:58.426867+0000","last_unstale":"2024-09-12T18:02:32.906222+0000","last_undegraded":"2024-09-12T18:02:32.906222+0000","last_fullsized":"2024-09-12T18:02:32.906222+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:32.906115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:32.906115+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.906115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:04.281587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"261'3","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.833051+0000","last_change":"2024-09-12T18:02:32.833051+0000","last_active":"2024-09-12T18:02:32.833051+0000","last_peered":"2024-09-12T18:02:32.833051+0000","last_clean":"2024-09-12T18:02:32.833051+0000","last_became_active":"2024-09-12T17:40:30.425775+0000","last_became_peered":"2024-09-12T17:40:30.425775+0000","last_unstale":"2024-09-12T18:02:32.833051+0000","last_undegraded":"2024-09-12T18:02:32.833051+0000","last_fullsized":"2024-09-12T18:02:32.833051+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:32.832964+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:32.832964+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.832964+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:26.129620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.648345+0000","last_change":"2024-09-12T18:02:42.648345+0000","last_active":"2024-09-12T18:02:42.648345+0000","last_peered":"2024-09-12T18:02:42.648345+0000","last_clean":"2024-09-12T18:02:42.648345+0000","last_became_active":"2024-09-12T17:40:27.381918+0000","last_became_peered":"2024-09-12T17:40:27.381918+0000","last_unstale":"2024-09-12T18:02:42.648345+0000","last_undegraded":"2024-09-12T18:02:42.648345+0000","last_fullsized":"2024-09-12T18:02:42.648345+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:42.648258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:42.648258+0000","last_clean_scrub_stamp":"2024-09-12T18:02:42.648258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:04.256041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"261'43","reported_seq":167,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.034768+0000","last_change":"2024-09-12T18:02:24.034768+0000","last_active":"2024-09-12T18:02:24.034768+0000","last_peered":"2024-09-12T18:02:24.034768+0000","last_clean":"2024-09-12T18:02:24.034768+0000","last_became_active":"2024-09-12T17:38:51.209135+0000","last_became_peered":"2024-09-12T17:38:51.209135+0000","last_unstale":"2024-09-12T18:02:24.034768+0000","last_undegraded":"2024-09-12T18:02:24.034768+0000","last_fullsized":"2024-09-12T18:02:24.034768+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'43","last_scrub_stamp":"2024-09-12T18:02:24.034658+0000","last_deep_scrub":"261'43","last_deep_scrub_stamp":"2024-09-12T18:02:24.034658+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.034658+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:57.068969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":150,"num_write":83,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:49.683974+0000","last_change":"2024-09-12T18:02:49.683974+0000","last_active":"2024-09-12T18:02:49.683974+0000","last_peered":"2024-09-12T18:02:49.683974+0000","last_clean":"2024-09-12T18:02:49.683974+0000","last_became_active":"2024-09-12T17:50:58.431587+0000","last_became_peered":"2024-09-12T17:50:58.431587+0000","last_unstale":"2024-09-12T18:02:49.683974+0000","last_undegraded":"2024-09-12T18:02:49.683974+0000","last_fullsized":"2024-09-12T18:02:49.683974+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:49.683882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:49.683882+0000","last_clean_scrub_stamp":"2024-09-12T18:02:49.683882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:15.232068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:49.451618+0000","last_change":"2024-09-12T18:02:49.451618+0000","last_active":"2024-09-12T18:02:49.451618+0000","last_peered":"2024-09-12T18:02:49.451618+0000","last_clean":"2024-09-12T18:02:49.451618+0000","last_became_active":"2024-09-12T17:40:30.417998+0000","last_became_peered":"2024-09-12T17:40:30.417998+0000","last_unstale":"2024-09-12T18:02:49.451618+0000","last_undegraded":"2024-09-12T18:02:49.451618+0000","last_fullsized":"2024-09-12T18:02:49.451618+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:49.451522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:49.451522+0000","last_clean_scrub_stamp":"2024-09-12T18:02:49.451522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:57.040375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.942781+0000","last_change":"2024-09-12T18:02:28.942781+0000","last_active":"2024-09-12T18:02:28.942781+0000","last_peered":"2024-09-12T18:02:28.942781+0000","last_clean":"2024-09-12T18:02:28.942781+0000","last_became_active":"2024-09-12T17:40:27.374557+0000","last_became_peered":"2024-09-12T17:40:27.374557+0000","last_unstale":"2024-09-12T18:02:28.942781+0000","last_undegraded":"2024-09-12T18:02:28.942781+0000","last_fullsized":"2024-09-12T18:02:28.942781+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:28.942693+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:28.942693+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.942693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:26.660387+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"261'32","reported_seq":138,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.979713+0000","last_change":"2024-09-12T18:02:15.979713+0000","last_active":"2024-09-12T18:02:15.979713+0000","last_peered":"2024-09-12T18:02:15.979713+0000","last_clean":"2024-09-12T18:02:15.979713+0000","last_became_active":"2024-09-12T17:38:51.216209+0000","last_became_peered":"2024-09-12T17:38:51.216209+0000","last_unstale":"2024-09-12T18:02:15.979713+0000","last_undegraded":"2024-09-12T18:02:15.979713+0000","last_fullsized":"2024-09-12T18:02:15.979713+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'32","last_scrub_stamp":"2024-09-12T18:02:15.979620+0000","last_deep_scrub":"261'32","last_deep_scrub_stamp":"2024-09-12T18:02:15.979620+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.979620+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:08.310333+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":109,"num_write":55,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:54.506627+0000","last_change":"2024-09-12T18:02:54.506627+0000","last_active":"2024-09-12T18:02:54.506627+0000","last_peered":"2024-09-12T18:02:54.506627+0000","last_clean":"2024-09-12T18:02:54.506627+0000","last_became_active":"2024-09-12T17:50:58.424452+0000","last_became_peered":"2024-09-12T17:50:58.424452+0000","last_unstale":"2024-09-12T18:02:54.506627+0000","last_undegraded":"2024-09-12T18:02:54.506627+0000","last_fullsized":"2024-09-12T18:02:54.506627+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:54.506540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:54.506540+0000","last_clean_scrub_stamp":"2024-09-12T18:02:54.506540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:21.136075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.012700+0000","last_change":"2024-09-12T18:02:42.012700+0000","last_active":"2024-09-12T18:02:42.012700+0000","last_peered":"2024-09-12T18:02:42.012700+0000","last_clean":"2024-09-12T18:02:42.012700+0000","last_became_active":"2024-09-12T17:40:30.418650+0000","last_became_peered":"2024-09-12T17:40:30.418650+0000","last_unstale":"2024-09-12T18:02:42.012700+0000","last_undegraded":"2024-09-12T18:02:42.012700+0000","last_fullsized":"2024-09-12T18:02:42.012700+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:42.012613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:42.012613+0000","last_clean_scrub_stamp":"2024-09-12T18:02:42.012613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:08.564747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"258'8","reported_seq":68,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:40.653411+0000","last_change":"2024-09-12T18:02:40.653411+0000","last_active":"2024-09-12T18:02:40.653411+0000","last_peered":"2024-09-12T18:02:40.653411+0000","last_clean":"2024-09-12T18:02:40.653411+0000","last_became_active":"2024-09-12T17:40:27.385081+0000","last_became_peered":"2024-09-12T17:40:27.385081+0000","last_unstale":"2024-09-12T18:02:40.653411+0000","last_undegraded":"2024-09-12T18:02:40.653411+0000","last_fullsized":"2024-09-12T18:02:40.653411+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'8","last_scrub_stamp":"2024-09-12T18:02:40.653315+0000","last_deep_scrub":"258'8","last_deep_scrub_stamp":"2024-09-12T18:02:40.653315+0000","last_clean_scrub_stamp":"2024-09-12T18:02:40.653315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:22.324217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"261'37","reported_seq":156,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.711521+0000","last_change":"2024-09-12T18:02:34.711521+0000","last_active":"2024-09-12T18:02:34.711521+0000","last_peered":"2024-09-12T18:02:34.711521+0000","last_clean":"2024-09-12T18:02:34.711521+0000","last_became_active":"2024-09-12T17:38:51.208861+0000","last_became_peered":"2024-09-12T17:38:51.208861+0000","last_unstale":"2024-09-12T18:02:34.711521+0000","last_undegraded":"2024-09-12T18:02:34.711521+0000","last_fullsized":"2024-09-12T18:02:34.711521+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'37","last_scrub_stamp":"2024-09-12T18:02:34.711380+0000","last_deep_scrub":"261'37","last_deep_scrub_stamp":"2024-09-12T18:02:34.711380+0000","last_clean_scrub_stamp":"2024-09-12T18:02:34.711380+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:41.780033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":141,"num_write":67,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:50.709453+0000","last_change":"2024-09-12T18:02:50.709453+0000","last_active":"2024-09-12T18:02:50.709453+0000","last_peered":"2024-09-12T18:02:50.709453+0000","last_clean":"2024-09-12T18:02:50.709453+0000","last_became_active":"2024-09-12T17:50:58.432245+0000","last_became_peered":"2024-09-12T17:50:58.432245+0000","last_unstale":"2024-09-12T18:02:50.709453+0000","last_undegraded":"2024-09-12T18:02:50.709453+0000","last_fullsized":"2024-09-12T18:02:50.709453+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:50.709363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:50.709363+0000","last_clean_scrub_stamp":"2024-09-12T18:02:50.709363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:50.920113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"258'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:45.600409+0000","last_change":"2024-09-12T18:02:45.600409+0000","last_active":"2024-09-12T18:02:45.600409+0000","last_peered":"2024-09-12T18:02:45.600409+0000","last_clean":"2024-09-12T18:02:45.600409+0000","last_became_active":"2024-09-12T17:40:30.425293+0000","last_became_peered":"2024-09-12T17:40:30.425293+0000","last_unstale":"2024-09-12T18:02:45.600409+0000","last_undegraded":"2024-09-12T18:02:45.600409+0000","last_fullsized":"2024-09-12T18:02:45.600409+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T18:02:45.600303+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T18:02:45.600303+0000","last_clean_scrub_stamp":"2024-09-12T18:02:45.600303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:48.539529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"261'3","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.904837+0000","last_change":"2024-09-12T18:02:27.904837+0000","last_active":"2024-09-12T18:02:27.904837+0000","last_peered":"2024-09-12T18:02:27.904837+0000","last_clean":"2024-09-12T18:02:27.904837+0000","last_became_active":"2024-09-12T17:40:27.376781+0000","last_became_peered":"2024-09-12T17:40:27.376781+0000","last_unstale":"2024-09-12T18:02:27.904837+0000","last_undegraded":"2024-09-12T18:02:27.904837+0000","last_fullsized":"2024-09-12T18:02:27.904837+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:27.904747+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:27.904747+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.904747+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:18.705963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.664099+0000","last_change":"2024-09-12T18:02:34.664040+0000","last_active":"2024-09-12T18:02:34.664099+0000","last_peered":"2024-09-12T18:02:34.664099+0000","last_clean":"2024-09-12T18:02:34.664099+0000","last_became_active":"2024-09-12T17:38:51.209772+0000","last_became_peered":"2024-09-12T17:38:51.209772+0000","last_unstale":"2024-09-12T18:02:34.664099+0000","last_undegraded":"2024-09-12T18:02:34.664099+0000","last_fullsized":"2024-09-12T18:02:34.664099+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:34.663935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:34.663935+0000","last_clean_scrub_stamp":"2024-09-12T18:02:34.663935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:16.640569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:52.720033+0000","last_change":"2024-09-12T18:02:52.720033+0000","last_active":"2024-09-12T18:02:52.720033+0000","last_peered":"2024-09-12T18:02:52.720033+0000","last_clean":"2024-09-12T18:02:52.720033+0000","last_became_active":"2024-09-12T17:50:58.429551+0000","last_became_peered":"2024-09-12T17:50:58.429551+0000","last_unstale":"2024-09-12T18:02:52.720033+0000","last_undegraded":"2024-09-12T18:02:52.720033+0000","last_fullsized":"2024-09-12T18:02:52.720033+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:52.719924+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:52.719924+0000","last_clean_scrub_stamp":"2024-09-12T18:02:52.719924+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:46.652635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'7","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.870607+0000","last_change":"2024-09-12T18:02:31.870607+0000","last_active":"2024-09-12T18:02:31.870607+0000","last_peered":"2024-09-12T18:02:31.870607+0000","last_clean":"2024-09-12T18:02:31.870607+0000","last_became_active":"2024-09-12T17:40:30.408915+0000","last_became_peered":"2024-09-12T17:40:30.408915+0000","last_unstale":"2024-09-12T18:02:31.870607+0000","last_undegraded":"2024-09-12T18:02:31.870607+0000","last_fullsized":"2024-09-12T18:02:31.870607+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-12T18:02:31.870487+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-12T18:02:31.870487+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.870487+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:45.211938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25606,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"258'3","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.681741+0000","last_change":"2024-09-12T18:02:41.681741+0000","last_active":"2024-09-12T18:02:41.681741+0000","last_peered":"2024-09-12T18:02:41.681741+0000","last_clean":"2024-09-12T18:02:41.681741+0000","last_became_active":"2024-09-12T17:40:27.381885+0000","last_became_peered":"2024-09-12T17:40:27.381885+0000","last_unstale":"2024-09-12T18:02:41.681741+0000","last_undegraded":"2024-09-12T18:02:41.681741+0000","last_fullsized":"2024-09-12T18:02:41.681741+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T18:02:41.681596+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T18:02:41.681596+0000","last_clean_scrub_stamp":"2024-09-12T18:02:41.681596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:10.794948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"261'68","reported_seq":240,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:38.469534+0000","last_change":"2024-09-12T18:02:38.469461+0000","last_active":"2024-09-12T18:02:38.469534+0000","last_peered":"2024-09-12T18:02:38.469534+0000","last_clean":"2024-09-12T18:02:38.469534+0000","last_became_active":"2024-09-12T17:38:51.214940+0000","last_became_peered":"2024-09-12T17:38:51.214940+0000","last_unstale":"2024-09-12T18:02:38.469534+0000","last_undegraded":"2024-09-12T18:02:38.469534+0000","last_fullsized":"2024-09-12T18:02:38.469534+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'68","last_scrub_stamp":"2024-09-12T18:02:38.469380+0000","last_deep_scrub":"261'68","last_deep_scrub_stamp":"2024-09-12T18:02:38.469380+0000","last_clean_scrub_stamp":"2024-09-12T18:02:38.469380+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:47.065231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":356,"num_read_kb":250,"num_write":117,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:52.821262+0000","last_change":"2024-09-12T18:02:52.821262+0000","last_active":"2024-09-12T18:02:52.821262+0000","last_peered":"2024-09-12T18:02:52.821262+0000","last_clean":"2024-09-12T18:02:52.821262+0000","last_became_active":"2024-09-12T17:50:58.420251+0000","last_became_peered":"2024-09-12T17:50:58.420251+0000","last_unstale":"2024-09-12T18:02:52.821262+0000","last_undegraded":"2024-09-12T18:02:52.821262+0000","last_fullsized":"2024-09-12T18:02:52.821262+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:52.821161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:52.821161+0000","last_clean_scrub_stamp":"2024-09-12T18:02:52.821161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:19.902980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"258'7","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:44.594296+0000","last_change":"2024-09-12T18:02:44.594296+0000","last_active":"2024-09-12T18:02:44.594296+0000","last_peered":"2024-09-12T18:02:44.594296+0000","last_clean":"2024-09-12T18:02:44.594296+0000","last_became_active":"2024-09-12T17:40:30.417393+0000","last_became_peered":"2024-09-12T17:40:30.417393+0000","last_unstale":"2024-09-12T18:02:44.594296+0000","last_undegraded":"2024-09-12T18:02:44.594296+0000","last_fullsized":"2024-09-12T18:02:44.594296+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'7","last_scrub_stamp":"2024-09-12T18:02:44.594215+0000","last_deep_scrub":"258'7","last_deep_scrub_stamp":"2024-09-12T18:02:44.594215+0000","last_clean_scrub_stamp":"2024-09-12T18:02:44.594215+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:12.075648+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":7,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'2","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.001262+0000","last_change":"2024-09-12T18:02:34.001262+0000","last_active":"2024-09-12T18:02:34.001262+0000","last_peered":"2024-09-12T18:02:34.001262+0000","last_clean":"2024-09-12T18:02:34.001262+0000","last_became_active":"2024-09-12T17:40:27.379472+0000","last_became_peered":"2024-09-12T17:40:27.379472+0000","last_unstale":"2024-09-12T18:02:34.001262+0000","last_undegraded":"2024-09-12T18:02:34.001262+0000","last_fullsized":"2024-09-12T18:02:34.001262+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:34.001145+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:34.001145+0000","last_clean_scrub_stamp":"2024-09-12T18:02:34.001145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:27.189307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"261'106","reported_seq":375,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.000317+0000","last_change":"2024-09-12T18:02:25.000259+0000","last_active":"2024-09-12T18:02:25.000317+0000","last_peered":"2024-09-12T18:02:25.000317+0000","last_clean":"2024-09-12T18:02:25.000317+0000","last_became_active":"2024-09-12T17:38:51.207735+0000","last_became_peered":"2024-09-12T17:38:51.207735+0000","last_unstale":"2024-09-12T18:02:25.000317+0000","last_undegraded":"2024-09-12T18:02:25.000317+0000","last_fullsized":"2024-09-12T18:02:25.000317+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'106","last_scrub_stamp":"2024-09-12T18:02:25.000158+0000","last_deep_scrub":"261'106","last_deep_scrub_stamp":"2024-09-12T18:02:25.000158+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.000158+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.557077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":541,"num_write":122,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:46.575106+0000","last_change":"2024-09-12T18:02:46.575106+0000","last_active":"2024-09-12T18:02:46.575106+0000","last_peered":"2024-09-12T18:02:46.575106+0000","last_clean":"2024-09-12T18:02:46.575106+0000","last_became_active":"2024-09-12T17:50:58.430813+0000","last_became_peered":"2024-09-12T17:50:58.430813+0000","last_unstale":"2024-09-12T18:02:46.575106+0000","last_undegraded":"2024-09-12T18:02:46.575106+0000","last_fullsized":"2024-09-12T18:02:46.575106+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:46.575012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:46.575012+0000","last_clean_scrub_stamp":"2024-09-12T18:02:46.575012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:30.109056+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:47.730099+0000","last_change":"2024-09-12T18:02:47.730099+0000","last_active":"2024-09-12T18:02:47.730099+0000","last_peered":"2024-09-12T18:02:47.730099+0000","last_clean":"2024-09-12T18:02:47.730099+0000","last_became_active":"2024-09-12T17:40:30.410872+0000","last_became_peered":"2024-09-12T17:40:30.410872+0000","last_unstale":"2024-09-12T18:02:47.730099+0000","last_undegraded":"2024-09-12T18:02:47.730099+0000","last_fullsized":"2024-09-12T18:02:47.730099+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:47.730015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:47.730015+0000","last_clean_scrub_stamp":"2024-09-12T18:02:47.730015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:39.474370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'2","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.625130+0000","last_change":"2024-09-12T18:02:42.625130+0000","last_active":"2024-09-12T18:02:42.625130+0000","last_peered":"2024-09-12T18:02:42.625130+0000","last_clean":"2024-09-12T18:02:42.625130+0000","last_became_active":"2024-09-12T17:40:27.380269+0000","last_became_peered":"2024-09-12T17:40:27.380269+0000","last_unstale":"2024-09-12T18:02:42.625130+0000","last_undegraded":"2024-09-12T18:02:42.625130+0000","last_fullsized":"2024-09-12T18:02:42.625130+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:42.625026+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:42.625026+0000","last_clean_scrub_stamp":"2024-09-12T18:02:42.625026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:25.134625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"261'42","reported_seq":166,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.731942+0000","last_change":"2024-09-12T18:02:33.731875+0000","last_active":"2024-09-12T18:02:33.731942+0000","last_peered":"2024-09-12T18:02:33.731942+0000","last_clean":"2024-09-12T18:02:33.731942+0000","last_became_active":"2024-09-12T17:38:51.216152+0000","last_became_peered":"2024-09-12T17:38:51.216152+0000","last_unstale":"2024-09-12T18:02:33.731942+0000","last_undegraded":"2024-09-12T18:02:33.731942+0000","last_fullsized":"2024-09-12T18:02:33.731942+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'42","last_scrub_stamp":"2024-09-12T18:02:33.731790+0000","last_deep_scrub":"261'42","last_deep_scrub_stamp":"2024-09-12T18:02:33.731790+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.731790+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:48:40.551255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":152,"num_write":74,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:43.238162+0000","last_change":"2024-09-12T18:02:43.238162+0000","last_active":"2024-09-12T18:02:43.238162+0000","last_peered":"2024-09-12T18:02:43.238162+0000","last_clean":"2024-09-12T18:02:43.238162+0000","last_became_active":"2024-09-12T17:50:58.430723+0000","last_became_peered":"2024-09-12T17:50:58.430723+0000","last_unstale":"2024-09-12T18:02:43.238162+0000","last_undegraded":"2024-09-12T18:02:43.238162+0000","last_fullsized":"2024-09-12T18:02:43.238162+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:43.238078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:43.238078+0000","last_clean_scrub_stamp":"2024-09-12T18:02:43.238078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:20.541243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:46.718213+0000","last_change":"2024-09-12T18:02:46.718213+0000","last_active":"2024-09-12T18:02:46.718213+0000","last_peered":"2024-09-12T18:02:46.718213+0000","last_clean":"2024-09-12T18:02:46.718213+0000","last_became_active":"2024-09-12T17:40:30.425368+0000","last_became_peered":"2024-09-12T17:40:30.425368+0000","last_unstale":"2024-09-12T18:02:46.718213+0000","last_undegraded":"2024-09-12T18:02:46.718213+0000","last_fullsized":"2024-09-12T18:02:46.718213+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:46.718079+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:46.718079+0000","last_clean_scrub_stamp":"2024-09-12T18:02:46.718079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:50.049156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.015051+0000","last_change":"2024-09-12T18:02:18.015051+0000","last_active":"2024-09-12T18:02:18.015051+0000","last_peered":"2024-09-12T18:02:18.015051+0000","last_clean":"2024-09-12T18:02:18.015051+0000","last_became_active":"2024-09-12T17:40:27.383770+0000","last_became_peered":"2024-09-12T17:40:27.383770+0000","last_unstale":"2024-09-12T18:02:18.015051+0000","last_undegraded":"2024-09-12T18:02:18.015051+0000","last_fullsized":"2024-09-12T18:02:18.015051+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:18.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:18.014972+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:48.282723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"258'22","reported_seq":117,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.068283+0000","last_change":"2024-09-12T18:02:23.068222+0000","last_active":"2024-09-12T18:02:23.068283+0000","last_peered":"2024-09-12T18:02:23.068283+0000","last_clean":"2024-09-12T18:02:23.068283+0000","last_became_active":"2024-09-12T17:38:51.208767+0000","last_became_peered":"2024-09-12T17:38:51.208767+0000","last_unstale":"2024-09-12T18:02:23.068283+0000","last_undegraded":"2024-09-12T18:02:23.068283+0000","last_fullsized":"2024-09-12T18:02:23.068283+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'22","last_scrub_stamp":"2024-09-12T18:02:23.068136+0000","last_deep_scrub":"258'22","last_deep_scrub_stamp":"2024-09-12T18:02:23.068136+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.068136+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:52.412076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:35.826312+0000","last_change":"2024-09-12T18:02:35.826312+0000","last_active":"2024-09-12T18:02:35.826312+0000","last_peered":"2024-09-12T18:02:35.826312+0000","last_clean":"2024-09-12T18:02:35.826312+0000","last_became_active":"2024-09-12T17:50:58.422625+0000","last_became_peered":"2024-09-12T17:50:58.422625+0000","last_unstale":"2024-09-12T18:02:35.826312+0000","last_undegraded":"2024-09-12T18:02:35.826312+0000","last_fullsized":"2024-09-12T18:02:35.826312+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:35.826224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:35.826224+0000","last_clean_scrub_stamp":"2024-09-12T18:02:35.826224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:41.055196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"258'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:43.632419+0000","last_change":"2024-09-12T18:02:43.632419+0000","last_active":"2024-09-12T18:02:43.632419+0000","last_peered":"2024-09-12T18:02:43.632419+0000","last_clean":"2024-09-12T18:02:43.632419+0000","last_became_active":"2024-09-12T17:40:30.425536+0000","last_became_peered":"2024-09-12T17:40:30.425536+0000","last_unstale":"2024-09-12T18:02:43.632419+0000","last_undegraded":"2024-09-12T18:02:43.632419+0000","last_fullsized":"2024-09-12T18:02:43.632419+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T18:02:43.632328+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T18:02:43.632328+0000","last_clean_scrub_stamp":"2024-09-12T18:02:43.632328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:50.704210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"258'6","reported_seq":58,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:37.160227+0000","last_change":"2024-09-12T18:02:37.160227+0000","last_active":"2024-09-12T18:02:37.160227+0000","last_peered":"2024-09-12T18:02:37.160227+0000","last_clean":"2024-09-12T18:02:37.160227+0000","last_became_active":"2024-09-12T17:40:27.381818+0000","last_became_peered":"2024-09-12T17:40:27.381818+0000","last_unstale":"2024-09-12T18:02:37.160227+0000","last_undegraded":"2024-09-12T18:02:37.160227+0000","last_fullsized":"2024-09-12T18:02:37.160227+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'6","last_scrub_stamp":"2024-09-12T18:02:37.160137+0000","last_deep_scrub":"258'6","last_deep_scrub_stamp":"2024-09-12T18:02:37.160137+0000","last_clean_scrub_stamp":"2024-09-12T18:02:37.160137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:22.481431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"261'42","reported_seq":174,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.707951+0000","last_change":"2024-09-12T18:02:33.707951+0000","last_active":"2024-09-12T18:02:33.707951+0000","last_peered":"2024-09-12T18:02:33.707951+0000","last_clean":"2024-09-12T18:02:33.707951+0000","last_became_active":"2024-09-12T17:38:51.211219+0000","last_became_peered":"2024-09-12T17:38:51.211219+0000","last_unstale":"2024-09-12T18:02:33.707951+0000","last_undegraded":"2024-09-12T18:02:33.707951+0000","last_fullsized":"2024-09-12T18:02:33.707951+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'42","last_scrub_stamp":"2024-09-12T18:02:33.707856+0000","last_deep_scrub":"261'42","last_deep_scrub_stamp":"2024-09-12T18:02:33.707856+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.707856+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:07.552173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":165,"num_write":70,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:43.951894+0000","last_change":"2024-09-12T18:02:43.951894+0000","last_active":"2024-09-12T18:02:43.951894+0000","last_peered":"2024-09-12T18:02:43.951894+0000","last_clean":"2024-09-12T18:02:43.951894+0000","last_became_active":"2024-09-12T17:50:58.416501+0000","last_became_peered":"2024-09-12T17:50:58.416501+0000","last_unstale":"2024-09-12T18:02:43.951894+0000","last_undegraded":"2024-09-12T18:02:43.951894+0000","last_fullsized":"2024-09-12T18:02:43.951894+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:43.951803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:43.951803+0000","last_clean_scrub_stamp":"2024-09-12T18:02:43.951803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:45.539923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"261'5","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:40.966831+0000","last_change":"2024-09-12T18:02:40.966831+0000","last_active":"2024-09-12T18:02:40.966831+0000","last_peered":"2024-09-12T18:02:40.966831+0000","last_clean":"2024-09-12T18:02:40.966831+0000","last_became_active":"2024-09-12T17:40:30.418418+0000","last_became_peered":"2024-09-12T17:40:30.418418+0000","last_unstale":"2024-09-12T18:02:40.966831+0000","last_undegraded":"2024-09-12T18:02:40.966831+0000","last_fullsized":"2024-09-12T18:02:40.966831+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:02:40.966740+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:02:40.966740+0000","last_clean_scrub_stamp":"2024-09-12T18:02:40.966740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:49.335518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:40.580175+0000","last_change":"2024-09-12T18:02:40.580175+0000","last_active":"2024-09-12T18:02:40.580175+0000","last_peered":"2024-09-12T18:02:40.580175+0000","last_clean":"2024-09-12T18:02:40.580175+0000","last_became_active":"2024-09-12T17:40:27.383023+0000","last_became_peered":"2024-09-12T17:40:27.383023+0000","last_unstale":"2024-09-12T18:02:40.580175+0000","last_undegraded":"2024-09-12T18:02:40.580175+0000","last_fullsized":"2024-09-12T18:02:40.580175+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:40.580051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:40.580051+0000","last_clean_scrub_stamp":"2024-09-12T18:02:40.580051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:23.947805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"261'37","reported_seq":157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.979731+0000","last_change":"2024-09-12T18:02:23.979731+0000","last_active":"2024-09-12T18:02:23.979731+0000","last_peered":"2024-09-12T18:02:23.979731+0000","last_clean":"2024-09-12T18:02:23.979731+0000","last_became_active":"2024-09-12T17:38:51.209833+0000","last_became_peered":"2024-09-12T17:38:51.209833+0000","last_unstale":"2024-09-12T18:02:23.979731+0000","last_undegraded":"2024-09-12T18:02:23.979731+0000","last_fullsized":"2024-09-12T18:02:23.979731+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'37","last_scrub_stamp":"2024-09-12T18:02:23.979634+0000","last_deep_scrub":"261'37","last_deep_scrub_stamp":"2024-09-12T18:02:23.979634+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.979634+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:50.358860+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":141,"num_write":58,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.021561+0000","last_change":"2024-09-12T18:02:22.021561+0000","last_active":"2024-09-12T18:02:22.021561+0000","last_peered":"2024-09-12T18:02:22.021561+0000","last_clean":"2024-09-12T18:02:22.021561+0000","last_became_active":"2024-09-12T17:50:58.423798+0000","last_became_peered":"2024-09-12T17:50:58.423798+0000","last_unstale":"2024-09-12T18:02:22.021561+0000","last_undegraded":"2024-09-12T18:02:22.021561+0000","last_fullsized":"2024-09-12T18:02:22.021561+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:22.021459+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:22.021459+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.021459+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:55.158982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"258'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.914129+0000","last_change":"2024-09-12T18:02:30.914129+0000","last_active":"2024-09-12T18:02:30.914129+0000","last_peered":"2024-09-12T18:02:30.914129+0000","last_clean":"2024-09-12T18:02:30.914129+0000","last_became_active":"2024-09-12T17:40:30.412140+0000","last_became_peered":"2024-09-12T17:40:30.412140+0000","last_unstale":"2024-09-12T18:02:30.914129+0000","last_undegraded":"2024-09-12T18:02:30.914129+0000","last_fullsized":"2024-09-12T18:02:30.914129+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T18:02:30.914030+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T18:02:30.914030+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.914030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:31.123475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'3","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:37.620182+0000","last_change":"2024-09-12T18:02:37.620182+0000","last_active":"2024-09-12T18:02:37.620182+0000","last_peered":"2024-09-12T18:02:37.620182+0000","last_clean":"2024-09-12T18:02:37.620182+0000","last_became_active":"2024-09-12T17:40:27.385649+0000","last_became_peered":"2024-09-12T17:40:27.385649+0000","last_unstale":"2024-09-12T18:02:37.620182+0000","last_undegraded":"2024-09-12T18:02:37.620182+0000","last_fullsized":"2024-09-12T18:02:37.620182+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:37.620097+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:37.620097+0000","last_clean_scrub_stamp":"2024-09-12T18:02:37.620097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:00.430536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"258'14","reported_seq":93,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:36.129963+0000","last_change":"2024-09-12T18:02:36.129963+0000","last_active":"2024-09-12T18:02:36.129963+0000","last_peered":"2024-09-12T18:02:36.129963+0000","last_clean":"2024-09-12T18:02:36.129963+0000","last_became_active":"2024-09-12T17:38:51.215738+0000","last_became_peered":"2024-09-12T17:38:51.215738+0000","last_unstale":"2024-09-12T18:02:36.129963+0000","last_undegraded":"2024-09-12T18:02:36.129963+0000","last_fullsized":"2024-09-12T18:02:36.129963+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'14","last_scrub_stamp":"2024-09-12T18:02:36.129859+0000","last_deep_scrub":"258'14","last_deep_scrub_stamp":"2024-09-12T18:02:36.129859+0000","last_clean_scrub_stamp":"2024-09-12T18:02:36.129859+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:12.647905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:50.833248+0000","last_change":"2024-09-12T18:02:50.833248+0000","last_active":"2024-09-12T18:02:50.833248+0000","last_peered":"2024-09-12T18:02:50.833248+0000","last_clean":"2024-09-12T18:02:50.833248+0000","last_became_active":"2024-09-12T17:50:58.423443+0000","last_became_peered":"2024-09-12T17:50:58.423443+0000","last_unstale":"2024-09-12T18:02:50.833248+0000","last_undegraded":"2024-09-12T18:02:50.833248+0000","last_fullsized":"2024-09-12T18:02:50.833248+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:50.833145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:50.833145+0000","last_clean_scrub_stamp":"2024-09-12T18:02:50.833145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:32.452855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:40.199982+0000","last_change":"2024-09-12T18:02:40.199982+0000","last_active":"2024-09-12T18:02:40.199982+0000","last_peered":"2024-09-12T18:02:40.199982+0000","last_clean":"2024-09-12T18:02:40.199982+0000","last_became_active":"2024-09-12T17:40:30.415696+0000","last_became_peered":"2024-09-12T17:40:30.415696+0000","last_unstale":"2024-09-12T18:02:40.199982+0000","last_undegraded":"2024-09-12T18:02:40.199982+0000","last_fullsized":"2024-09-12T18:02:40.199982+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:40.199890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:40.199890+0000","last_clean_scrub_stamp":"2024-09-12T18:02:40.199890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:26.550506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:38.659771+0000","last_change":"2024-09-12T18:02:38.659771+0000","last_active":"2024-09-12T18:02:38.659771+0000","last_peered":"2024-09-12T18:02:38.659771+0000","last_clean":"2024-09-12T18:02:38.659771+0000","last_became_active":"2024-09-12T17:40:27.381128+0000","last_became_peered":"2024-09-12T17:40:27.381128+0000","last_unstale":"2024-09-12T18:02:38.659771+0000","last_undegraded":"2024-09-12T18:02:38.659771+0000","last_fullsized":"2024-09-12T18:02:38.659771+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:38.659666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:38.659666+0000","last_clean_scrub_stamp":"2024-09-12T18:02:38.659666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:30.233020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"261'15","reported_seq":91,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.028722+0000","last_change":"2024-09-12T18:02:33.028722+0000","last_active":"2024-09-12T18:02:33.028722+0000","last_peered":"2024-09-12T18:02:33.028722+0000","last_clean":"2024-09-12T18:02:33.028722+0000","last_became_active":"2024-09-12T17:38:51.210741+0000","last_became_peered":"2024-09-12T17:38:51.210741+0000","last_unstale":"2024-09-12T18:02:33.028722+0000","last_undegraded":"2024-09-12T18:02:33.028722+0000","last_fullsized":"2024-09-12T18:02:33.028722+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'15","last_scrub_stamp":"2024-09-12T18:02:33.028632+0000","last_deep_scrub":"261'15","last_deep_scrub_stamp":"2024-09-12T18:02:33.028632+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.028632+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:25.853519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":45,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:51.862050+0000","last_change":"2024-09-12T18:02:51.862050+0000","last_active":"2024-09-12T18:02:51.862050+0000","last_peered":"2024-09-12T18:02:51.862050+0000","last_clean":"2024-09-12T18:02:51.862050+0000","last_became_active":"2024-09-12T17:50:58.422195+0000","last_became_peered":"2024-09-12T17:50:58.422195+0000","last_unstale":"2024-09-12T18:02:51.862050+0000","last_undegraded":"2024-09-12T18:02:51.862050+0000","last_fullsized":"2024-09-12T18:02:51.862050+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:51.861932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:51.861932+0000","last_clean_scrub_stamp":"2024-09-12T18:02:51.861932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:52.531598+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.917383+0000","last_change":"2024-09-12T18:02:28.917383+0000","last_active":"2024-09-12T18:02:28.917383+0000","last_peered":"2024-09-12T18:02:28.917383+0000","last_clean":"2024-09-12T18:02:28.917383+0000","last_became_active":"2024-09-12T17:40:30.418692+0000","last_became_peered":"2024-09-12T17:40:30.418692+0000","last_unstale":"2024-09-12T18:02:28.917383+0000","last_undegraded":"2024-09-12T18:02:28.917383+0000","last_fullsized":"2024-09-12T18:02:28.917383+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:28.917289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:28.917289+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.917289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:06.086875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"258'6","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.908948+0000","last_change":"2024-09-12T18:02:26.908948+0000","last_active":"2024-09-12T18:02:26.908948+0000","last_peered":"2024-09-12T18:02:26.908948+0000","last_clean":"2024-09-12T18:02:26.908948+0000","last_became_active":"2024-09-12T17:40:27.376395+0000","last_became_peered":"2024-09-12T17:40:27.376395+0000","last_unstale":"2024-09-12T18:02:26.908948+0000","last_undegraded":"2024-09-12T18:02:26.908948+0000","last_fullsized":"2024-09-12T18:02:26.908948+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'6","last_scrub_stamp":"2024-09-12T18:02:26.908837+0000","last_deep_scrub":"258'6","last_deep_scrub_stamp":"2024-09-12T18:02:26.908837+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.908837+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:49.934905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"261'24","reported_seq":118,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.063627+0000","last_change":"2024-09-12T18:02:22.063627+0000","last_active":"2024-09-12T18:02:22.063627+0000","last_peered":"2024-09-12T18:02:22.063627+0000","last_clean":"2024-09-12T18:02:22.063627+0000","last_became_active":"2024-09-12T17:38:51.212856+0000","last_became_peered":"2024-09-12T17:38:51.212856+0000","last_unstale":"2024-09-12T18:02:22.063627+0000","last_undegraded":"2024-09-12T18:02:22.063627+0000","last_fullsized":"2024-09-12T18:02:22.063627+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'24","last_scrub_stamp":"2024-09-12T18:02:22.063538+0000","last_deep_scrub":"261'24","last_deep_scrub_stamp":"2024-09-12T18:02:22.063538+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.063538+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:33.470326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":83,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:47.589547+0000","last_change":"2024-09-12T18:02:47.589547+0000","last_active":"2024-09-12T18:02:47.589547+0000","last_peered":"2024-09-12T18:02:47.589547+0000","last_clean":"2024-09-12T18:02:47.589547+0000","last_became_active":"2024-09-12T17:50:58.431442+0000","last_became_peered":"2024-09-12T17:50:58.431442+0000","last_unstale":"2024-09-12T18:02:47.589547+0000","last_undegraded":"2024-09-12T18:02:47.589547+0000","last_fullsized":"2024-09-12T18:02:47.589547+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:47.589463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:47.589463+0000","last_clean_scrub_stamp":"2024-09-12T18:02:47.589463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:17.047150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"258'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:39.996129+0000","last_change":"2024-09-12T18:02:39.996129+0000","last_active":"2024-09-12T18:02:39.996129+0000","last_peered":"2024-09-12T18:02:39.996129+0000","last_clean":"2024-09-12T18:02:39.996129+0000","last_became_active":"2024-09-12T17:40:30.418464+0000","last_became_peered":"2024-09-12T17:40:30.418464+0000","last_unstale":"2024-09-12T18:02:39.996129+0000","last_undegraded":"2024-09-12T18:02:39.996129+0000","last_fullsized":"2024-09-12T18:02:39.996129+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T18:02:39.996034+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T18:02:39.996034+0000","last_clean_scrub_stamp":"2024-09-12T18:02:39.996034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:10.487456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"261'5","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.917366+0000","last_change":"2024-09-12T18:02:27.917366+0000","last_active":"2024-09-12T18:02:27.917366+0000","last_peered":"2024-09-12T18:02:27.917366+0000","last_clean":"2024-09-12T18:02:27.917366+0000","last_became_active":"2024-09-12T17:40:27.379133+0000","last_became_peered":"2024-09-12T17:40:27.379133+0000","last_unstale":"2024-09-12T18:02:27.917366+0000","last_undegraded":"2024-09-12T18:02:27.917366+0000","last_fullsized":"2024-09-12T18:02:27.917366+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:02:27.917270+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:02:27.917270+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.917270+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:50.826263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"261'32","reported_seq":138,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.720076+0000","last_change":"2024-09-12T18:02:30.720076+0000","last_active":"2024-09-12T18:02:30.720076+0000","last_peered":"2024-09-12T18:02:30.720076+0000","last_clean":"2024-09-12T18:02:30.720076+0000","last_became_active":"2024-09-12T17:38:51.208386+0000","last_became_peered":"2024-09-12T17:38:51.208386+0000","last_unstale":"2024-09-12T18:02:30.720076+0000","last_undegraded":"2024-09-12T18:02:30.720076+0000","last_fullsized":"2024-09-12T18:02:30.720076+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'32","last_scrub_stamp":"2024-09-12T18:02:30.719990+0000","last_deep_scrub":"261'32","last_deep_scrub_stamp":"2024-09-12T18:02:30.719990+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.719990+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:28.036111+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":109,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"261'348","reported_seq":968,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.683587+0000","last_change":"2024-09-12T18:02:14.683587+0000","last_active":"2024-09-12T18:02:14.683587+0000","last_peered":"2024-09-12T18:02:14.683587+0000","last_clean":"2024-09-12T18:02:14.683587+0000","last_became_active":"2024-09-12T17:23:40.708951+0000","last_became_peered":"2024-09-12T17:23:40.708951+0000","last_unstale":"2024-09-12T18:02:14.683587+0000","last_undegraded":"2024-09-12T18:02:14.683587+0000","last_fullsized":"2024-09-12T18:02:14.683587+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'348","last_scrub_stamp":"2024-09-12T18:02:14.683458+0000","last_deep_scrub":"261'348","last_deep_scrub_stamp":"2024-09-12T18:02:14.683458+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.683458+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:37.385508+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25551,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":469,"num_read_kb":4680,"num_write":1107,"num_write_kb":27229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"261'484","reported_seq":2019,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.256682+0000","last_change":"2024-09-12T18:02:18.256682+0000","last_active":"2024-09-12T18:02:18.256682+0000","last_peered":"2024-09-12T18:02:18.256682+0000","last_clean":"2024-09-12T18:02:18.256682+0000","last_became_active":"2024-09-12T17:23:42.146906+0000","last_became_peered":"2024-09-12T17:23:42.146906+0000","last_unstale":"2024-09-12T18:02:18.256682+0000","last_undegraded":"2024-09-12T18:02:18.256682+0000","last_fullsized":"2024-09-12T18:02:18.256682+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'484","last_scrub_stamp":"2024-09-12T18:02:18.256606+0000","last_deep_scrub":"261'484","last_deep_scrub_stamp":"2024-09-12T18:02:18.256606+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.256606+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:20.735639+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2345,"num_read_kb":2204,"num_write":541,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"261'408","reported_seq":1089,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.042650+0000","last_change":"2024-09-12T18:02:02.042650+0000","last_active":"2024-09-12T18:02:02.042650+0000","last_peered":"2024-09-12T18:02:02.042650+0000","last_clean":"2024-09-12T18:02:02.042650+0000","last_became_active":"2024-09-12T17:23:40.719834+0000","last_became_peered":"2024-09-12T17:23:40.719834+0000","last_unstale":"2024-09-12T18:02:02.042650+0000","last_undegraded":"2024-09-12T18:02:02.042650+0000","last_fullsized":"2024-09-12T18:02:02.042650+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'408","last_scrub_stamp":"2024-09-12T18:02:02.042521+0000","last_deep_scrub":"261'408","last_deep_scrub_stamp":"2024-09-12T18:02:02.042521+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.042521+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:05.142643+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":637,"num_read_kb":15953,"num_write":1206,"num_write_kb":28721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"261'478","reported_seq":2228,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.743852+0000","last_change":"2024-09-12T18:02:12.743852+0000","last_active":"2024-09-12T18:02:12.743852+0000","last_peered":"2024-09-12T18:02:12.743852+0000","last_clean":"2024-09-12T18:02:12.743852+0000","last_became_active":"2024-09-12T17:23:42.147270+0000","last_became_peered":"2024-09-12T17:23:42.147270+0000","last_unstale":"2024-09-12T18:02:12.743852+0000","last_undegraded":"2024-09-12T18:02:12.743852+0000","last_fullsized":"2024-09-12T18:02:12.743852+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'478","last_scrub_stamp":"2024-09-12T18:02:12.743753+0000","last_deep_scrub":"261'478","last_deep_scrub_stamp":"2024-09-12T18:02:12.743753+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.743753+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:19.692853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3009,"num_read_kb":2866,"num_write":558,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"261'351","reported_seq":1157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.764996+0000","last_change":"2024-09-12T18:02:00.764996+0000","last_active":"2024-09-12T18:02:00.764996+0000","last_peered":"2024-09-12T18:02:00.764996+0000","last_clean":"2024-09-12T18:02:00.764996+0000","last_became_active":"2024-09-12T17:23:40.701839+0000","last_became_peered":"2024-09-12T17:23:40.701839+0000","last_unstale":"2024-09-12T18:02:00.764996+0000","last_undegraded":"2024-09-12T18:02:00.764996+0000","last_fullsized":"2024-09-12T18:02:00.764996+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'351","last_scrub_stamp":"2024-09-12T18:02:00.764896+0000","last_deep_scrub":"261'351","last_deep_scrub_stamp":"2024-09-12T18:02:00.764896+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.764896+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:13.922951+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311813,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":845,"num_read_kb":22445,"num_write":993,"num_write_kb":35081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"261'1195","reported_seq":2837,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.220054+0000","last_change":"2024-09-12T18:02:15.220054+0000","last_active":"2024-09-12T18:02:15.220054+0000","last_peered":"2024-09-12T18:02:15.220054+0000","last_clean":"2024-09-12T18:02:15.220054+0000","last_became_active":"2024-09-12T17:23:42.141845+0000","last_became_peered":"2024-09-12T17:23:42.141845+0000","last_unstale":"2024-09-12T18:02:15.220054+0000","last_undegraded":"2024-09-12T18:02:15.220054+0000","last_fullsized":"2024-09-12T18:02:15.220054+0000","mapping_epoch":25,"log_start":"261'1100","ondisk_log_start":"261'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1195","last_scrub_stamp":"2024-09-12T18:02:15.219948+0000","last_deep_scrub":"261'1195","last_deep_scrub_stamp":"2024-09-12T18:02:15.219948+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.219948+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":1100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:58.470773+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5470,"num_read_kb":4840,"num_write":1657,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"261'403","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.267301+0000","last_change":"2024-09-12T18:02:09.267301+0000","last_active":"2024-09-12T18:02:09.267301+0000","last_peered":"2024-09-12T18:02:09.267301+0000","last_clean":"2024-09-12T18:02:09.267301+0000","last_became_active":"2024-09-12T17:23:40.712263+0000","last_became_peered":"2024-09-12T17:23:40.712263+0000","last_unstale":"2024-09-12T18:02:09.267301+0000","last_undegraded":"2024-09-12T18:02:09.267301+0000","last_fullsized":"2024-09-12T18:02:09.267301+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'403","last_scrub_stamp":"2024-09-12T18:02:09.267186+0000","last_deep_scrub":"261'403","last_deep_scrub_stamp":"2024-09-12T18:02:09.267186+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.267186+0000","objects_scrubbed":8,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:55.391563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262228,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":543,"num_read_kb":11573,"num_write":1248,"num_write_kb":26002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"261'1243","reported_seq":2931,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.621430+0000","last_change":"2024-09-12T18:02:11.621430+0000","last_active":"2024-09-12T18:02:11.621430+0000","last_peered":"2024-09-12T18:02:11.621430+0000","last_clean":"2024-09-12T18:02:11.621430+0000","last_became_active":"2024-09-12T17:23:42.157835+0000","last_became_peered":"2024-09-12T17:23:42.157835+0000","last_unstale":"2024-09-12T18:02:11.621430+0000","last_undegraded":"2024-09-12T18:02:11.621430+0000","last_fullsized":"2024-09-12T18:02:11.621430+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1243","last_scrub_stamp":"2024-09-12T18:02:11.621334+0000","last_deep_scrub":"261'1243","last_deep_scrub_stamp":"2024-09-12T18:02:11.621334+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.621334+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:43.082819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5656,"num_read_kb":5021,"num_write":1694,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":960,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"261'354","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.716953+0000","last_change":"2024-09-12T18:02:09.716953+0000","last_active":"2024-09-12T18:02:09.716953+0000","last_peered":"2024-09-12T18:02:09.716953+0000","last_clean":"2024-09-12T18:02:09.716953+0000","last_became_active":"2024-09-12T17:23:40.705906+0000","last_became_peered":"2024-09-12T17:23:40.705906+0000","last_unstale":"2024-09-12T18:02:09.716953+0000","last_undegraded":"2024-09-12T18:02:09.716953+0000","last_fullsized":"2024-09-12T18:02:09.716953+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-12T18:02:09.716851+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-12T18:02:09.716851+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.716851+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:14.429035+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":673,"num_read_kb":37545,"num_write":1095,"num_write_kb":42867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"261'385","reported_seq":1833,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.133940+0000","last_change":"2024-09-12T18:02:07.133940+0000","last_active":"2024-09-12T18:02:07.133940+0000","last_peered":"2024-09-12T18:02:07.133940+0000","last_clean":"2024-09-12T18:02:07.133940+0000","last_became_active":"2024-09-12T17:23:42.142311+0000","last_became_peered":"2024-09-12T17:23:42.142311+0000","last_unstale":"2024-09-12T18:02:07.133940+0000","last_undegraded":"2024-09-12T18:02:07.133940+0000","last_fullsized":"2024-09-12T18:02:07.133940+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'385","last_scrub_stamp":"2024-09-12T18:02:07.133832+0000","last_deep_scrub":"261'385","last_deep_scrub_stamp":"2024-09-12T18:02:07.133832+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.133832+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:19.123354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2045,"num_read_kb":1945,"num_write":422,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"261'388","reported_seq":1088,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.238542+0000","last_change":"2024-09-12T18:02:08.238542+0000","last_active":"2024-09-12T18:02:08.238542+0000","last_peered":"2024-09-12T18:02:08.238542+0000","last_clean":"2024-09-12T18:02:08.238542+0000","last_became_active":"2024-09-12T17:23:40.705215+0000","last_became_peered":"2024-09-12T17:23:40.705215+0000","last_unstale":"2024-09-12T18:02:08.238542+0000","last_undegraded":"2024-09-12T18:02:08.238542+0000","last_fullsized":"2024-09-12T18:02:08.238542+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'388","last_scrub_stamp":"2024-09-12T18:02:08.238416+0000","last_deep_scrub":"261'388","last_deep_scrub_stamp":"2024-09-12T18:02:08.238416+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.238416+0000","objects_scrubbed":9,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:20.183404+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253978,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":760,"num_read_kb":26786,"num_write":1280,"num_write_kb":30822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"261'884","reported_seq":2686,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.226415+0000","last_change":"2024-09-12T18:02:18.226415+0000","last_active":"2024-09-12T18:02:18.226415+0000","last_peered":"2024-09-12T18:02:18.226415+0000","last_clean":"2024-09-12T18:02:18.226415+0000","last_became_active":"2024-09-12T17:23:42.143402+0000","last_became_peered":"2024-09-12T17:23:42.143402+0000","last_unstale":"2024-09-12T18:02:18.226415+0000","last_undegraded":"2024-09-12T18:02:18.226415+0000","last_fullsized":"2024-09-12T18:02:18.226415+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'884","last_scrub_stamp":"2024-09-12T18:02:18.226319+0000","last_deep_scrub":"261'884","last_deep_scrub_stamp":"2024-09-12T18:02:18.226319+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.226319+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":800,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:00.126404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4455,"num_read_kb":4051,"num_write":1149,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"261'328","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.738544+0000","last_change":"2024-09-12T18:02:08.738544+0000","last_active":"2024-09-12T18:02:08.738544+0000","last_peered":"2024-09-12T18:02:08.738544+0000","last_clean":"2024-09-12T18:02:08.738544+0000","last_became_active":"2024-09-12T17:23:40.713883+0000","last_became_peered":"2024-09-12T17:23:40.713883+0000","last_unstale":"2024-09-12T18:02:08.738544+0000","last_undegraded":"2024-09-12T18:02:08.738544+0000","last_fullsized":"2024-09-12T18:02:08.738544+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'328","last_scrub_stamp":"2024-09-12T18:02:08.738443+0000","last_deep_scrub":"261'328","last_deep_scrub_stamp":"2024-09-12T18:02:08.738443+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.738443+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:35.473029+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":466,"num_read_kb":1994,"num_write":1104,"num_write_kb":56686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"261'918","reported_seq":2629,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.248516+0000","last_change":"2024-09-12T18:02:16.248516+0000","last_active":"2024-09-12T18:02:16.248516+0000","last_peered":"2024-09-12T18:02:16.248516+0000","last_clean":"2024-09-12T18:02:16.248516+0000","last_became_active":"2024-09-12T17:23:42.152030+0000","last_became_peered":"2024-09-12T17:23:42.152030+0000","last_unstale":"2024-09-12T18:02:16.248516+0000","last_undegraded":"2024-09-12T18:02:16.248516+0000","last_fullsized":"2024-09-12T18:02:16.248516+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'918","last_scrub_stamp":"2024-09-12T18:02:16.248418+0000","last_deep_scrub":"261'918","last_deep_scrub_stamp":"2024-09-12T18:02:16.248418+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.248418+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:33.323420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4677,"num_read_kb":4199,"num_write":1240,"num_write_kb":482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3560,"num_omap_keys":14,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"261'319","reported_seq":1003,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.254612+0000","last_change":"2024-09-12T18:02:04.254612+0000","last_active":"2024-09-12T18:02:04.254612+0000","last_peered":"2024-09-12T18:02:04.254612+0000","last_clean":"2024-09-12T18:02:04.254612+0000","last_became_active":"2024-09-12T17:23:40.717097+0000","last_became_peered":"2024-09-12T17:23:40.717097+0000","last_unstale":"2024-09-12T18:02:04.254612+0000","last_undegraded":"2024-09-12T18:02:04.254612+0000","last_fullsized":"2024-09-12T18:02:04.254612+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'319","last_scrub_stamp":"2024-09-12T18:02:04.254489+0000","last_deep_scrub":"261'319","last_deep_scrub_stamp":"2024-09-12T18:02:04.254489+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.254489+0000","objects_scrubbed":11,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:54.537782+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655891,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":586,"num_read_kb":3212,"num_write":1067,"num_write_kb":17046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"261'393","reported_seq":1873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.028847+0000","last_change":"2024-09-12T18:02:04.028847+0000","last_active":"2024-09-12T18:02:04.028847+0000","last_peered":"2024-09-12T18:02:04.028847+0000","last_clean":"2024-09-12T18:02:04.028847+0000","last_became_active":"2024-09-12T17:24:17.226840+0000","last_became_peered":"2024-09-12T17:24:17.226840+0000","last_unstale":"2024-09-12T18:02:04.028847+0000","last_undegraded":"2024-09-12T18:02:04.028847+0000","last_fullsized":"2024-09-12T18:02:04.028847+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'393","last_scrub_stamp":"2024-09-12T18:02:04.028758+0000","last_deep_scrub":"261'393","last_deep_scrub_stamp":"2024-09-12T18:02:04.028758+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.028758+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:31.967642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2081,"num_read_kb":1979,"num_write":442,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"261'752","reported_seq":2074,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.188709+0000","last_change":"2024-09-12T18:02:14.188709+0000","last_active":"2024-09-12T18:02:14.188709+0000","last_peered":"2024-09-12T18:02:14.188709+0000","last_clean":"2024-09-12T18:02:14.188709+0000","last_became_active":"2024-09-12T17:23:42.152513+0000","last_became_peered":"2024-09-12T17:23:42.152513+0000","last_unstale":"2024-09-12T18:02:14.188709+0000","last_undegraded":"2024-09-12T18:02:14.188709+0000","last_fullsized":"2024-09-12T18:02:14.188709+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'752","last_scrub_stamp":"2024-09-12T18:02:14.188596+0000","last_deep_scrub":"261'752","last_deep_scrub_stamp":"2024-09-12T18:02:14.188596+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.188596+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:55.988212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3383,"num_read_kb":3022,"num_write":991,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"261'313","reported_seq":939,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.746278+0000","last_change":"2024-09-12T18:02:07.746218+0000","last_active":"2024-09-12T18:02:07.746278+0000","last_peered":"2024-09-12T18:02:07.746278+0000","last_clean":"2024-09-12T18:02:07.746278+0000","last_became_active":"2024-09-12T17:23:40.712747+0000","last_became_peered":"2024-09-12T17:23:40.712747+0000","last_unstale":"2024-09-12T18:02:07.746278+0000","last_undegraded":"2024-09-12T18:02:07.746278+0000","last_fullsized":"2024-09-12T18:02:07.746278+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'313","last_scrub_stamp":"2024-09-12T18:02:07.746109+0000","last_deep_scrub":"261'313","last_deep_scrub_stamp":"2024-09-12T18:02:07.746109+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.746109+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:03.900469+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":452,"num_read_kb":32150,"num_write":963,"num_write_kb":37186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"261'506","reported_seq":2017,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.701997+0000","last_change":"2024-09-12T18:02:11.701997+0000","last_active":"2024-09-12T18:02:11.701997+0000","last_peered":"2024-09-12T18:02:11.701997+0000","last_clean":"2024-09-12T18:02:11.701997+0000","last_became_active":"2024-09-12T17:23:42.148091+0000","last_became_peered":"2024-09-12T17:23:42.148091+0000","last_unstale":"2024-09-12T18:02:11.701997+0000","last_undegraded":"2024-09-12T18:02:11.701997+0000","last_fullsized":"2024-09-12T18:02:11.701997+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'506","last_scrub_stamp":"2024-09-12T18:02:11.701886+0000","last_deep_scrub":"261'506","last_deep_scrub_stamp":"2024-09-12T18:02:11.701886+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.701886+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:22.240495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2605,"num_read_kb":2400,"num_write":650,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"261'353","reported_seq":1049,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.106568+0000","last_change":"2024-09-12T18:02:03.106506+0000","last_active":"2024-09-12T18:02:03.106568+0000","last_peered":"2024-09-12T18:02:03.106568+0000","last_clean":"2024-09-12T18:02:03.106568+0000","last_became_active":"2024-09-12T17:23:40.708089+0000","last_became_peered":"2024-09-12T17:23:40.708089+0000","last_unstale":"2024-09-12T18:02:03.106568+0000","last_undegraded":"2024-09-12T18:02:03.106568+0000","last_fullsized":"2024-09-12T18:02:03.106568+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'353","last_scrub_stamp":"2024-09-12T18:02:03.106382+0000","last_deep_scrub":"261'353","last_deep_scrub_stamp":"2024-09-12T18:02:03.106382+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.106382+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:42.275338+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":647,"num_read_kb":14175,"num_write":1176,"num_write_kb":46213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"261'912","reported_seq":2505,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.237194+0000","last_change":"2024-09-12T18:02:14.237194+0000","last_active":"2024-09-12T18:02:14.237194+0000","last_peered":"2024-09-12T18:02:14.237194+0000","last_clean":"2024-09-12T18:02:14.237194+0000","last_became_active":"2024-09-12T17:23:42.145860+0000","last_became_peered":"2024-09-12T17:23:42.145860+0000","last_unstale":"2024-09-12T18:02:14.237194+0000","last_undegraded":"2024-09-12T18:02:14.237194+0000","last_fullsized":"2024-09-12T18:02:14.237194+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'912","last_scrub_stamp":"2024-09-12T18:02:14.237107+0000","last_deep_scrub":"261'912","last_deep_scrub_stamp":"2024-09-12T18:02:14.237107+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.237107+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":900,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:39.982382+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4352,"num_read_kb":3896,"num_write":1238,"num_write_kb":509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"261'349","reported_seq":1091,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.094349+0000","last_change":"2024-09-12T18:02:02.094282+0000","last_active":"2024-09-12T18:02:02.094349+0000","last_peered":"2024-09-12T18:02:02.094349+0000","last_clean":"2024-09-12T18:02:02.094349+0000","last_became_active":"2024-09-12T17:24:17.232979+0000","last_became_peered":"2024-09-12T17:24:17.232979+0000","last_unstale":"2024-09-12T18:02:02.094349+0000","last_undegraded":"2024-09-12T18:02:02.094349+0000","last_fullsized":"2024-09-12T18:02:02.094349+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T18:02:02.094149+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T18:02:02.094149+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.094149+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:51.671674+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":809,"num_read_kb":6334,"num_write":1258,"num_write_kb":23763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"261'428","reported_seq":1999,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.031902+0000","last_change":"2024-09-12T18:02:02.031835+0000","last_active":"2024-09-12T18:02:02.031902+0000","last_peered":"2024-09-12T18:02:02.031902+0000","last_clean":"2024-09-12T18:02:02.031902+0000","last_became_active":"2024-09-12T17:23:42.148023+0000","last_became_peered":"2024-09-12T17:23:42.148023+0000","last_unstale":"2024-09-12T18:02:02.031902+0000","last_undegraded":"2024-09-12T18:02:02.031902+0000","last_fullsized":"2024-09-12T18:02:02.031902+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'428","last_scrub_stamp":"2024-09-12T18:02:02.031748+0000","last_deep_scrub":"261'428","last_deep_scrub_stamp":"2024-09-12T18:02:02.031748+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.031748+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:37.883390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2276,"num_read_kb":2173,"num_write":473,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"261'353","reported_seq":977,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.085784+0000","last_change":"2024-09-12T18:02:00.085723+0000","last_active":"2024-09-12T18:02:00.085784+0000","last_peered":"2024-09-12T18:02:00.085784+0000","last_clean":"2024-09-12T18:02:00.085784+0000","last_became_active":"2024-09-12T17:23:40.714604+0000","last_became_peered":"2024-09-12T17:23:40.714604+0000","last_unstale":"2024-09-12T18:02:00.085784+0000","last_undegraded":"2024-09-12T18:02:00.085784+0000","last_fullsized":"2024-09-12T18:02:00.085784+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'353","last_scrub_stamp":"2024-09-12T18:02:00.085618+0000","last_deep_scrub":"261'353","last_deep_scrub_stamp":"2024-09-12T18:02:00.085618+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.085618+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:44.532607+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":7319,"num_write":1124,"num_write_kb":22062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"261'421","reported_seq":1942,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.017442+0000","last_change":"2024-09-12T18:02:03.017362+0000","last_active":"2024-09-12T18:02:03.017442+0000","last_peered":"2024-09-12T18:02:03.017442+0000","last_clean":"2024-09-12T18:02:03.017442+0000","last_became_active":"2024-09-12T17:23:42.141237+0000","last_became_peered":"2024-09-12T17:23:42.141237+0000","last_unstale":"2024-09-12T18:02:03.017442+0000","last_undegraded":"2024-09-12T18:02:03.017442+0000","last_fullsized":"2024-09-12T18:02:03.017442+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'421","last_scrub_stamp":"2024-09-12T18:02:03.017268+0000","last_deep_scrub":"261'421","last_deep_scrub_stamp":"2024-09-12T18:02:03.017268+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.017268+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:06.467480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2248,"num_read_kb":2133,"num_write":484,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"261'334","reported_seq":959,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.234784+0000","last_change":"2024-09-12T18:02:03.234682+0000","last_active":"2024-09-12T18:02:03.234784+0000","last_peered":"2024-09-12T18:02:03.234784+0000","last_clean":"2024-09-12T18:02:03.234784+0000","last_became_active":"2024-09-12T17:23:40.704825+0000","last_became_peered":"2024-09-12T17:23:40.704825+0000","last_unstale":"2024-09-12T18:02:03.234784+0000","last_undegraded":"2024-09-12T18:02:03.234784+0000","last_fullsized":"2024-09-12T18:02:03.234784+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'334","last_scrub_stamp":"2024-09-12T18:02:03.234556+0000","last_deep_scrub":"261'334","last_deep_scrub_stamp":"2024-09-12T18:02:03.234556+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.234556+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:14.374566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":456,"num_read_kb":2074,"num_write":1044,"num_write_kb":16303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"261'381","reported_seq":1879,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.160859+0000","last_change":"2024-09-12T18:02:13.160794+0000","last_active":"2024-09-12T18:02:13.160859+0000","last_peered":"2024-09-12T18:02:13.160859+0000","last_clean":"2024-09-12T18:02:13.160859+0000","last_became_active":"2024-09-12T17:23:42.137455+0000","last_became_peered":"2024-09-12T17:23:42.137455+0000","last_unstale":"2024-09-12T18:02:13.160859+0000","last_undegraded":"2024-09-12T18:02:13.160859+0000","last_fullsized":"2024-09-12T18:02:13.160859+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'381","last_scrub_stamp":"2024-09-12T18:02:13.160695+0000","last_deep_scrub":"261'381","last_deep_scrub_stamp":"2024-09-12T18:02:13.160695+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.160695+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:54.943636+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2042,"num_read_kb":1965,"num_write":435,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"261'367","reported_seq":1018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.735389+0000","last_change":"2024-09-12T18:01:59.735389+0000","last_active":"2024-09-12T18:01:59.735389+0000","last_peered":"2024-09-12T18:01:59.735389+0000","last_clean":"2024-09-12T18:01:59.735389+0000","last_became_active":"2024-09-12T17:23:40.711201+0000","last_became_peered":"2024-09-12T17:23:40.711201+0000","last_unstale":"2024-09-12T18:01:59.735389+0000","last_undegraded":"2024-09-12T18:01:59.735389+0000","last_fullsized":"2024-09-12T18:01:59.735389+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'367","last_scrub_stamp":"2024-09-12T18:01:59.735272+0000","last_deep_scrub":"261'367","last_deep_scrub_stamp":"2024-09-12T18:01:59.735272+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.735272+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:34.384056+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2561815,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":549,"num_read_kb":25516,"num_write":1199,"num_write_kb":38939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"261'154","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.059026+0000","last_change":"2024-09-12T18:02:31.059026+0000","last_active":"2024-09-12T18:02:31.059026+0000","last_peered":"2024-09-12T18:02:31.059026+0000","last_clean":"2024-09-12T18:02:31.059026+0000","last_became_active":"2024-09-12T17:23:50.184149+0000","last_became_peered":"2024-09-12T17:23:50.184149+0000","last_unstale":"2024-09-12T18:02:31.059026+0000","last_undegraded":"2024-09-12T18:02:31.059026+0000","last_fullsized":"2024-09-12T18:02:31.059026+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'154","last_scrub_stamp":"2024-09-12T18:02:31.058932+0000","last_deep_scrub":"261'154","last_deep_scrub_stamp":"2024-09-12T18:02:31.058932+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.058932+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:01.071144+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":269,"num_read_kb":251,"num_write":373,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"261'433","reported_seq":2045,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.276276+0000","last_change":"2024-09-12T18:02:08.276276+0000","last_active":"2024-09-12T18:02:08.276276+0000","last_peered":"2024-09-12T18:02:08.276276+0000","last_clean":"2024-09-12T18:02:08.276276+0000","last_became_active":"2024-09-12T17:23:42.153262+0000","last_became_peered":"2024-09-12T17:23:42.153262+0000","last_unstale":"2024-09-12T18:02:08.276276+0000","last_undegraded":"2024-09-12T18:02:08.276276+0000","last_fullsized":"2024-09-12T18:02:08.276276+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'433","last_scrub_stamp":"2024-09-12T18:02:08.276184+0000","last_deep_scrub":"261'433","last_deep_scrub_stamp":"2024-09-12T18:02:08.276184+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.276184+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:25.968608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2462,"num_read_kb":2350,"num_write":478,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"261'337","reported_seq":967,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.703031+0000","last_change":"2024-09-12T18:02:04.703031+0000","last_active":"2024-09-12T18:02:04.703031+0000","last_peered":"2024-09-12T18:02:04.703031+0000","last_clean":"2024-09-12T18:02:04.703031+0000","last_became_active":"2024-09-12T17:23:40.709513+0000","last_became_peered":"2024-09-12T17:23:40.709513+0000","last_unstale":"2024-09-12T18:02:04.703031+0000","last_undegraded":"2024-09-12T18:02:04.703031+0000","last_fullsized":"2024-09-12T18:02:04.703031+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'337","last_scrub_stamp":"2024-09-12T18:02:04.702947+0000","last_deep_scrub":"261'337","last_deep_scrub_stamp":"2024-09-12T18:02:04.702947+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.702947+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:03.175885+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":481,"num_read_kb":53800,"num_write":1092,"num_write_kb":42009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.185313+0000","last_change":"2024-09-12T18:02:20.185257+0000","last_active":"2024-09-12T18:02:20.185313+0000","last_peered":"2024-09-12T18:02:20.185313+0000","last_clean":"2024-09-12T18:02:20.185313+0000","last_became_active":"2024-09-12T17:23:44.150860+0000","last_became_peered":"2024-09-12T17:23:44.150860+0000","last_unstale":"2024-09-12T18:02:20.185313+0000","last_undegraded":"2024-09-12T18:02:20.185313+0000","last_fullsized":"2024-09-12T18:02:20.185313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:20.185172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:20.185172+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.185172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:12.927147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"261'341","reported_seq":935,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.590262+0000","last_change":"2024-09-12T18:02:18.590169+0000","last_active":"2024-09-12T18:02:18.590262+0000","last_peered":"2024-09-12T18:02:18.590262+0000","last_clean":"2024-09-12T18:02:18.590262+0000","last_became_active":"2024-09-12T17:23:46.152874+0000","last_became_peered":"2024-09-12T17:23:46.152874+0000","last_unstale":"2024-09-12T18:02:18.590262+0000","last_undegraded":"2024-09-12T18:02:18.590262+0000","last_fullsized":"2024-09-12T18:02:18.590262+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'341","last_scrub_stamp":"2024-09-12T18:02:18.590040+0000","last_deep_scrub":"261'341","last_deep_scrub_stamp":"2024-09-12T18:02:18.590040+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.590040+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:14.837701+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49853,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":1208,"num_write":446,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.690548+0000","last_change":"2024-09-12T18:02:28.690484+0000","last_active":"2024-09-12T18:02:28.690548+0000","last_peered":"2024-09-12T18:02:28.690548+0000","last_clean":"2024-09-12T18:02:28.690548+0000","last_became_active":"2024-09-12T17:23:48.168052+0000","last_became_peered":"2024-09-12T17:23:48.168052+0000","last_unstale":"2024-09-12T18:02:28.690548+0000","last_undegraded":"2024-09-12T18:02:28.690548+0000","last_fullsized":"2024-09-12T18:02:28.690548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:28.690399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:28.690399+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.690399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:50.891973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"261'177","reported_seq":741,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.140625+0000","last_change":"2024-09-12T18:02:33.140566+0000","last_active":"2024-09-12T18:02:33.140625+0000","last_peered":"2024-09-12T18:02:33.140625+0000","last_clean":"2024-09-12T18:02:33.140625+0000","last_became_active":"2024-09-12T17:23:50.188506+0000","last_became_peered":"2024-09-12T17:23:50.188506+0000","last_unstale":"2024-09-12T18:02:33.140625+0000","last_undegraded":"2024-09-12T18:02:33.140625+0000","last_fullsized":"2024-09-12T18:02:33.140625+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'177","last_scrub_stamp":"2024-09-12T18:02:33.140475+0000","last_deep_scrub":"261'177","last_deep_scrub_stamp":"2024-09-12T18:02:33.140475+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.140475+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:01.265620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":316,"num_read_kb":300,"num_write":383,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"261'581","reported_seq":2136,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.271107+0000","last_change":"2024-09-12T18:02:11.271006+0000","last_active":"2024-09-12T18:02:11.271107+0000","last_peered":"2024-09-12T18:02:11.271107+0000","last_clean":"2024-09-12T18:02:11.271107+0000","last_became_active":"2024-09-12T17:23:42.143794+0000","last_became_peered":"2024-09-12T17:23:42.143794+0000","last_unstale":"2024-09-12T18:02:11.271107+0000","last_undegraded":"2024-09-12T18:02:11.271107+0000","last_fullsized":"2024-09-12T18:02:11.271107+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'581","last_scrub_stamp":"2024-09-12T18:02:11.270879+0000","last_deep_scrub":"261'581","last_deep_scrub_stamp":"2024-09-12T18:02:11.270879+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.270879+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:08.118727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3146,"num_read_kb":2882,"num_write":787,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1514,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"261'432","reported_seq":1078,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.940842+0000","last_change":"2024-09-12T18:01:57.940842+0000","last_active":"2024-09-12T18:01:57.940842+0000","last_peered":"2024-09-12T18:01:57.940842+0000","last_clean":"2024-09-12T18:01:57.940842+0000","last_became_active":"2024-09-12T17:24:17.287987+0000","last_became_peered":"2024-09-12T17:24:17.287987+0000","last_unstale":"2024-09-12T18:01:57.940842+0000","last_undegraded":"2024-09-12T18:01:57.940842+0000","last_fullsized":"2024-09-12T18:01:57.940842+0000","mapping_epoch":36,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'432","last_scrub_stamp":"2024-09-12T18:01:57.940767+0000","last_deep_scrub":"261'432","last_deep_scrub_stamp":"2024-09-12T18:01:57.940767+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.940767+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:05.500595+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174825,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":630,"num_read_kb":42370,"num_write":1204,"num_write_kb":32675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.285158+0000","last_change":"2024-09-12T18:02:16.285158+0000","last_active":"2024-09-12T18:02:16.285158+0000","last_peered":"2024-09-12T18:02:16.285158+0000","last_clean":"2024-09-12T18:02:16.285158+0000","last_became_active":"2024-09-12T17:23:44.149079+0000","last_became_peered":"2024-09-12T17:23:44.149079+0000","last_unstale":"2024-09-12T18:02:16.285158+0000","last_undegraded":"2024-09-12T18:02:16.285158+0000","last_fullsized":"2024-09-12T18:02:16.285158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:16.285066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:16.285066+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.285066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:05.713328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"261'81","reported_seq":603,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.236795+0000","last_change":"2024-09-12T18:02:21.236737+0000","last_active":"2024-09-12T18:02:21.236795+0000","last_peered":"2024-09-12T18:02:21.236795+0000","last_clean":"2024-09-12T18:02:21.236795+0000","last_became_active":"2024-09-12T17:23:46.150447+0000","last_became_peered":"2024-09-12T17:23:46.150447+0000","last_unstale":"2024-09-12T18:02:21.236795+0000","last_undegraded":"2024-09-12T18:02:21.236795+0000","last_fullsized":"2024-09-12T18:02:21.236795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'81","last_scrub_stamp":"2024-09-12T18:02:21.236652+0000","last_deep_scrub":"261'81","last_deep_scrub_stamp":"2024-09-12T18:02:21.236652+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.236652+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:38.664086+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":77,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.016420+0000","last_change":"2024-09-12T18:02:29.016340+0000","last_active":"2024-09-12T18:02:29.016420+0000","last_peered":"2024-09-12T18:02:29.016420+0000","last_clean":"2024-09-12T18:02:29.016420+0000","last_became_active":"2024-09-12T17:23:48.165965+0000","last_became_peered":"2024-09-12T17:23:48.165965+0000","last_unstale":"2024-09-12T18:02:29.016420+0000","last_undegraded":"2024-09-12T18:02:29.016420+0000","last_fullsized":"2024-09-12T18:02:29.016420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:29.016243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:29.016243+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.016243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:06.472207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"261'118","reported_seq":622,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.632077+0000","last_change":"2024-09-12T18:02:29.632077+0000","last_active":"2024-09-12T18:02:29.632077+0000","last_peered":"2024-09-12T18:02:29.632077+0000","last_clean":"2024-09-12T18:02:29.632077+0000","last_became_active":"2024-09-12T17:23:50.188143+0000","last_became_peered":"2024-09-12T17:23:50.188143+0000","last_unstale":"2024-09-12T18:02:29.632077+0000","last_undegraded":"2024-09-12T18:02:29.632077+0000","last_fullsized":"2024-09-12T18:02:29.632077+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'118","last_scrub_stamp":"2024-09-12T18:02:29.631986+0000","last_deep_scrub":"261'118","last_deep_scrub_stamp":"2024-09-12T18:02:29.631986+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.631986+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:49.267339+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":180,"num_write":267,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"261'433","reported_seq":2059,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.638005+0000","last_change":"2024-09-12T18:02:06.637886+0000","last_active":"2024-09-12T18:02:06.638005+0000","last_peered":"2024-09-12T18:02:06.638005+0000","last_clean":"2024-09-12T18:02:06.638005+0000","last_became_active":"2024-09-12T17:23:42.155137+0000","last_became_peered":"2024-09-12T17:23:42.155137+0000","last_unstale":"2024-09-12T18:02:06.638005+0000","last_undegraded":"2024-09-12T18:02:06.638005+0000","last_fullsized":"2024-09-12T18:02:06.638005+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'433","last_scrub_stamp":"2024-09-12T18:02:06.637778+0000","last_deep_scrub":"261'433","last_deep_scrub_stamp":"2024-09-12T18:02:06.637778+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.637778+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:48.440676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2401,"num_read_kb":2311,"num_write":475,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1514,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"261'493","reported_seq":1150,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.668021+0000","last_change":"2024-09-12T18:02:02.668021+0000","last_active":"2024-09-12T18:02:02.668021+0000","last_peered":"2024-09-12T18:02:02.668021+0000","last_clean":"2024-09-12T18:02:02.668021+0000","last_became_active":"2024-09-12T17:23:40.707549+0000","last_became_peered":"2024-09-12T17:23:40.707549+0000","last_unstale":"2024-09-12T18:02:02.668021+0000","last_undegraded":"2024-09-12T18:02:02.668021+0000","last_fullsized":"2024-09-12T18:02:02.668021+0000","mapping_epoch":23,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'493","last_scrub_stamp":"2024-09-12T18:02:02.667893+0000","last_deep_scrub":"261'493","last_deep_scrub_stamp":"2024-09-12T18:02:02.667893+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.667893+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:16.321949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":822,"num_read_kb":5813,"num_write":1382,"num_write_kb":24859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.266935+0000","last_change":"2024-09-12T18:02:17.266866+0000","last_active":"2024-09-12T18:02:17.266935+0000","last_peered":"2024-09-12T18:02:17.266935+0000","last_clean":"2024-09-12T18:02:17.266935+0000","last_became_active":"2024-09-12T17:23:44.150973+0000","last_became_peered":"2024-09-12T17:23:44.150973+0000","last_unstale":"2024-09-12T18:02:17.266935+0000","last_undegraded":"2024-09-12T18:02:17.266935+0000","last_fullsized":"2024-09-12T18:02:17.266935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:17.266776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:17.266776+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.266776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:00.212068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"261'100","reported_seq":628,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.959168+0000","last_change":"2024-09-12T18:02:12.959168+0000","last_active":"2024-09-12T18:02:12.959168+0000","last_peered":"2024-09-12T18:02:12.959168+0000","last_clean":"2024-09-12T18:02:12.959168+0000","last_became_active":"2024-09-12T17:23:46.153864+0000","last_became_peered":"2024-09-12T17:23:46.153864+0000","last_unstale":"2024-09-12T18:02:12.959168+0000","last_undegraded":"2024-09-12T18:02:12.959168+0000","last_fullsized":"2024-09-12T18:02:12.959168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'100","last_scrub_stamp":"2024-09-12T18:02:12.959072+0000","last_deep_scrub":"261'100","last_deep_scrub_stamp":"2024-09-12T18:02:12.959072+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.959072+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:33.074044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"261'765","reported_seq":2165,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.701740+0000","last_change":"2024-09-12T18:02:27.701665+0000","last_active":"2024-09-12T18:02:27.701740+0000","last_peered":"2024-09-12T18:02:27.701740+0000","last_clean":"2024-09-12T18:02:27.701740+0000","last_became_active":"2024-09-12T17:23:48.173454+0000","last_became_peered":"2024-09-12T17:23:48.173454+0000","last_unstale":"2024-09-12T18:02:27.701740+0000","last_undegraded":"2024-09-12T18:02:27.701740+0000","last_fullsized":"2024-09-12T18:02:27.701740+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'765","last_scrub_stamp":"2024-09-12T18:02:27.701583+0000","last_deep_scrub":"261'765","last_deep_scrub_stamp":"2024-09-12T18:02:27.701583+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.701583+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:16.305885+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"261'217","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.058144+0000","last_change":"2024-09-12T18:02:32.058144+0000","last_active":"2024-09-12T18:02:32.058144+0000","last_peered":"2024-09-12T18:02:32.058144+0000","last_clean":"2024-09-12T18:02:32.058144+0000","last_became_active":"2024-09-12T17:23:50.640401+0000","last_became_peered":"2024-09-12T17:23:50.640401+0000","last_unstale":"2024-09-12T18:02:32.058144+0000","last_undegraded":"2024-09-12T18:02:32.058144+0000","last_fullsized":"2024-09-12T18:02:32.058144+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'217","last_scrub_stamp":"2024-09-12T18:02:32.058040+0000","last_deep_scrub":"261'217","last_deep_scrub_stamp":"2024-09-12T18:02:32.058040+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.058040+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:19.450219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":682,"num_read_kb":671,"num_write":489,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"261'900","reported_seq":2450,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.245836+0000","last_change":"2024-09-12T18:02:09.245763+0000","last_active":"2024-09-12T18:02:09.245836+0000","last_peered":"2024-09-12T18:02:09.245836+0000","last_clean":"2024-09-12T18:02:09.245836+0000","last_became_active":"2024-09-12T17:23:42.147597+0000","last_became_peered":"2024-09-12T17:23:42.147597+0000","last_unstale":"2024-09-12T18:02:09.245836+0000","last_undegraded":"2024-09-12T18:02:09.245836+0000","last_fullsized":"2024-09-12T18:02:09.245836+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'900","last_scrub_stamp":"2024-09-12T18:02:09.245668+0000","last_deep_scrub":"261'900","last_deep_scrub_stamp":"2024-09-12T18:02:09.245668+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.245668+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:31.980911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4183,"num_read_kb":3727,"num_write":1220,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"261'367","reported_seq":1052,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.070259+0000","last_change":"2024-09-12T18:02:00.070259+0000","last_active":"2024-09-12T18:02:00.070259+0000","last_peered":"2024-09-12T18:02:00.070259+0000","last_clean":"2024-09-12T18:02:00.070259+0000","last_became_active":"2024-09-12T17:23:40.718582+0000","last_became_peered":"2024-09-12T17:23:40.718582+0000","last_unstale":"2024-09-12T18:02:00.070259+0000","last_undegraded":"2024-09-12T18:02:00.070259+0000","last_fullsized":"2024-09-12T18:02:00.070259+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'367","last_scrub_stamp":"2024-09-12T18:02:00.070123+0000","last_deep_scrub":"261'367","last_deep_scrub_stamp":"2024-09-12T18:02:00.070123+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.070123+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:55.441884+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":588,"num_read_kb":83250,"num_write":1103,"num_write_kb":35659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.197737+0000","last_change":"2024-09-12T18:02:21.197644+0000","last_active":"2024-09-12T18:02:21.197737+0000","last_peered":"2024-09-12T18:02:21.197737+0000","last_clean":"2024-09-12T18:02:21.197737+0000","last_became_active":"2024-09-12T17:23:44.151918+0000","last_became_peered":"2024-09-12T17:23:44.151918+0000","last_unstale":"2024-09-12T18:02:21.197737+0000","last_undegraded":"2024-09-12T18:02:21.197737+0000","last_fullsized":"2024-09-12T18:02:21.197737+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:21.197551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:21.197551+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.197551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:36.589194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"261'270","reported_seq":830,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.771840+0000","last_change":"2024-09-12T18:02:23.771736+0000","last_active":"2024-09-12T18:02:23.771840+0000","last_peered":"2024-09-12T18:02:23.771840+0000","last_clean":"2024-09-12T18:02:23.771840+0000","last_became_active":"2024-09-12T17:23:46.241137+0000","last_became_peered":"2024-09-12T17:23:46.241137+0000","last_unstale":"2024-09-12T18:02:23.771840+0000","last_undegraded":"2024-09-12T18:02:23.771840+0000","last_fullsized":"2024-09-12T18:02:23.771840+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'270","last_scrub_stamp":"2024-09-12T18:02:23.771628+0000","last_deep_scrub":"261'270","last_deep_scrub_stamp":"2024-09-12T18:02:23.771628+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.771628+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:32.243330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":1112,"num_write":380,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"261'807","reported_seq":6210,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.371547+0000","last_change":"2024-09-12T18:02:30.371547+0000","last_active":"2024-09-12T18:02:30.371547+0000","last_peered":"2024-09-12T18:02:30.371547+0000","last_clean":"2024-09-12T18:02:30.371547+0000","last_became_active":"2024-09-12T17:23:48.167038+0000","last_became_peered":"2024-09-12T17:23:48.167038+0000","last_unstale":"2024-09-12T18:02:30.371547+0000","last_undegraded":"2024-09-12T18:02:30.371547+0000","last_fullsized":"2024-09-12T18:02:30.371547+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'807","last_scrub_stamp":"2024-09-12T18:02:30.371394+0000","last_deep_scrub":"261'807","last_deep_scrub_stamp":"2024-09-12T18:02:30.371394+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.371394+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:04.660887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"261'667","reported_seq":2273,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.287959+0000","last_change":"2024-09-12T18:02:10.287880+0000","last_active":"2024-09-12T18:02:10.287959+0000","last_peered":"2024-09-12T18:02:10.287959+0000","last_clean":"2024-09-12T18:02:10.287959+0000","last_became_active":"2024-09-12T17:23:42.143778+0000","last_became_peered":"2024-09-12T17:23:42.143778+0000","last_unstale":"2024-09-12T18:02:10.287959+0000","last_undegraded":"2024-09-12T18:02:10.287959+0000","last_fullsized":"2024-09-12T18:02:10.287959+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'667","last_scrub_stamp":"2024-09-12T18:02:10.287792+0000","last_deep_scrub":"261'667","last_deep_scrub_stamp":"2024-09-12T18:02:10.287792+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.287792+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":600,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:51.075062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3245,"num_read_kb":3064,"num_write":918,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"261'356","reported_seq":966,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.667617+0000","last_change":"2024-09-12T18:02:01.667556+0000","last_active":"2024-09-12T18:02:01.667617+0000","last_peered":"2024-09-12T18:02:01.667617+0000","last_clean":"2024-09-12T18:02:01.667617+0000","last_became_active":"2024-09-12T17:23:40.709587+0000","last_became_peered":"2024-09-12T17:23:40.709587+0000","last_unstale":"2024-09-12T18:02:01.667617+0000","last_undegraded":"2024-09-12T18:02:01.667617+0000","last_fullsized":"2024-09-12T18:02:01.667617+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'356","last_scrub_stamp":"2024-09-12T18:02:01.667423+0000","last_deep_scrub":"261'356","last_deep_scrub_stamp":"2024-09-12T18:02:01.667423+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.667423+0000","objects_scrubbed":9,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:03.026185+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947352,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":408,"num_read_kb":61352,"num_write":1018,"num_write_kb":60278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.682150+0000","last_change":"2024-09-12T18:02:16.682052+0000","last_active":"2024-09-12T18:02:16.682150+0000","last_peered":"2024-09-12T18:02:16.682150+0000","last_clean":"2024-09-12T18:02:16.682150+0000","last_became_active":"2024-09-12T17:23:44.150957+0000","last_became_peered":"2024-09-12T17:23:44.150957+0000","last_unstale":"2024-09-12T18:02:16.682150+0000","last_undegraded":"2024-09-12T18:02:16.682150+0000","last_fullsized":"2024-09-12T18:02:16.682150+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:16.681963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:16.681963+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.681963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:47.949276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"261'354","reported_seq":955,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.203290+0000","last_change":"2024-09-12T18:02:24.203230+0000","last_active":"2024-09-12T18:02:24.203290+0000","last_peered":"2024-09-12T18:02:24.203290+0000","last_clean":"2024-09-12T18:02:24.203290+0000","last_became_active":"2024-09-12T17:23:46.241442+0000","last_became_peered":"2024-09-12T17:23:46.241442+0000","last_unstale":"2024-09-12T18:02:24.203290+0000","last_undegraded":"2024-09-12T18:02:24.203290+0000","last_fullsized":"2024-09-12T18:02:24.203290+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-12T18:02:24.203125+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-12T18:02:24.203125+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.203125+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:49.009181+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47631,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":562,"num_read_kb":1202,"num_write":448,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.028351+0000","last_change":"2024-09-12T18:02:18.028351+0000","last_active":"2024-09-12T18:02:18.028351+0000","last_peered":"2024-09-12T18:02:18.028351+0000","last_clean":"2024-09-12T18:02:18.028351+0000","last_became_active":"2024-09-12T17:23:48.167925+0000","last_became_peered":"2024-09-12T17:23:48.167925+0000","last_unstale":"2024-09-12T18:02:18.028351+0000","last_undegraded":"2024-09-12T18:02:18.028351+0000","last_fullsized":"2024-09-12T18:02:18.028351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:18.028282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:18.028282+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.028282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:28.697057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"261'579","reported_seq":1395,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.156558+0000","last_change":"2024-09-12T18:02:29.156558+0000","last_active":"2024-09-12T18:02:29.156558+0000","last_peered":"2024-09-12T18:02:29.156558+0000","last_clean":"2024-09-12T18:02:29.156558+0000","last_became_active":"2024-09-12T17:23:50.188109+0000","last_became_peered":"2024-09-12T17:23:50.188109+0000","last_unstale":"2024-09-12T18:02:29.156558+0000","last_undegraded":"2024-09-12T18:02:29.156558+0000","last_fullsized":"2024-09-12T18:02:29.156558+0000","mapping_epoch":33,"log_start":"261'500","ondisk_log_start":"261'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'579","last_scrub_stamp":"2024-09-12T18:02:29.156466+0000","last_deep_scrub":"261'579","last_deep_scrub_stamp":"2024-09-12T18:02:29.156466+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.156466+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:01.376584+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1373,"num_read_kb":1362,"num_write":1221,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"261'468","reported_seq":2012,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.076676+0000","last_change":"2024-09-12T18:02:01.076591+0000","last_active":"2024-09-12T18:02:01.076676+0000","last_peered":"2024-09-12T18:02:01.076676+0000","last_clean":"2024-09-12T18:02:01.076676+0000","last_became_active":"2024-09-12T17:23:42.135997+0000","last_became_peered":"2024-09-12T17:23:42.135997+0000","last_unstale":"2024-09-12T18:02:01.076676+0000","last_undegraded":"2024-09-12T18:02:01.076676+0000","last_fullsized":"2024-09-12T18:02:01.076676+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'468","last_scrub_stamp":"2024-09-12T18:02:01.076481+0000","last_deep_scrub":"261'468","last_deep_scrub_stamp":"2024-09-12T18:02:01.076481+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.076481+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:43.499647+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2354,"num_read_kb":2214,"num_write":547,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"261'349","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.611950+0000","last_change":"2024-09-12T18:01:59.611950+0000","last_active":"2024-09-12T18:01:59.611950+0000","last_peered":"2024-09-12T18:01:59.611950+0000","last_clean":"2024-09-12T18:01:59.611950+0000","last_became_active":"2024-09-12T17:23:40.711546+0000","last_became_peered":"2024-09-12T17:23:40.711546+0000","last_unstale":"2024-09-12T18:01:59.611950+0000","last_undegraded":"2024-09-12T18:01:59.611950+0000","last_fullsized":"2024-09-12T18:01:59.611950+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T18:01:59.611817+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T18:01:59.611817+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.611817+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:06.835809+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":612536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":14392,"num_write":1010,"num_write_kb":31885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.005964+0000","last_change":"2024-09-12T18:02:07.005898+0000","last_active":"2024-09-12T18:02:07.005964+0000","last_peered":"2024-09-12T18:02:07.005964+0000","last_clean":"2024-09-12T18:02:07.005964+0000","last_became_active":"2024-09-12T17:23:44.148472+0000","last_became_peered":"2024-09-12T17:23:44.148472+0000","last_unstale":"2024-09-12T18:02:07.005964+0000","last_undegraded":"2024-09-12T18:02:07.005964+0000","last_fullsized":"2024-09-12T18:02:07.005964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:07.005812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:07.005812+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.005812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:49.459504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"261'249","reported_seq":814,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.315174+0000","last_change":"2024-09-12T18:02:24.315174+0000","last_active":"2024-09-12T18:02:24.315174+0000","last_peered":"2024-09-12T18:02:24.315174+0000","last_clean":"2024-09-12T18:02:24.315174+0000","last_became_active":"2024-09-12T17:23:46.152441+0000","last_became_peered":"2024-09-12T17:23:46.152441+0000","last_unstale":"2024-09-12T18:02:24.315174+0000","last_undegraded":"2024-09-12T18:02:24.315174+0000","last_fullsized":"2024-09-12T18:02:24.315174+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'249","last_scrub_stamp":"2024-09-12T18:02:24.315085+0000","last_deep_scrub":"261'249","last_deep_scrub_stamp":"2024-09-12T18:02:24.315085+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.315085+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:46.268282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46658,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":411,"num_read_kb":954,"num_write":334,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.333010+0000","last_change":"2024-09-12T18:02:29.332954+0000","last_active":"2024-09-12T18:02:29.333010+0000","last_peered":"2024-09-12T18:02:29.333010+0000","last_clean":"2024-09-12T18:02:29.333010+0000","last_became_active":"2024-09-12T17:23:48.167829+0000","last_became_peered":"2024-09-12T17:23:48.167829+0000","last_unstale":"2024-09-12T18:02:29.333010+0000","last_undegraded":"2024-09-12T18:02:29.333010+0000","last_fullsized":"2024-09-12T18:02:29.333010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:29.332866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:29.332866+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.332866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:20.543107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"261'2378","reported_seq":4224,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.107111+0000","last_change":"2024-09-12T18:02:19.107111+0000","last_active":"2024-09-12T18:02:19.107111+0000","last_peered":"2024-09-12T18:02:19.107111+0000","last_clean":"2024-09-12T18:02:19.107111+0000","last_became_active":"2024-09-12T17:23:50.186026+0000","last_became_peered":"2024-09-12T17:23:50.186026+0000","last_unstale":"2024-09-12T18:02:19.107111+0000","last_undegraded":"2024-09-12T18:02:19.107111+0000","last_fullsized":"2024-09-12T18:02:19.107111+0000","mapping_epoch":33,"log_start":"261'2300","ondisk_log_start":"261'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2378","last_scrub_stamp":"2024-09-12T18:02:19.107026+0000","last_deep_scrub":"261'2378","last_deep_scrub_stamp":"2024-09-12T18:02:19.107026+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.107026+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":2300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:43.107144+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6096,"num_read_kb":6075,"num_write":4800,"num_write_kb":1772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"261'459","reported_seq":1997,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.193571+0000","last_change":"2024-09-12T18:02:11.193479+0000","last_active":"2024-09-12T18:02:11.193571+0000","last_peered":"2024-09-12T18:02:11.193571+0000","last_clean":"2024-09-12T18:02:11.193571+0000","last_became_active":"2024-09-12T17:23:42.147136+0000","last_became_peered":"2024-09-12T17:23:42.147136+0000","last_unstale":"2024-09-12T18:02:11.193571+0000","last_undegraded":"2024-09-12T18:02:11.193571+0000","last_fullsized":"2024-09-12T18:02:11.193571+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'459","last_scrub_stamp":"2024-09-12T18:02:11.193356+0000","last_deep_scrub":"261'459","last_deep_scrub_stamp":"2024-09-12T18:02:11.193356+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.193356+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:03.523588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2419,"num_read_kb":2271,"num_write":547,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"261'326","reported_seq":929,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.661213+0000","last_change":"2024-09-12T18:02:03.661213+0000","last_active":"2024-09-12T18:02:03.661213+0000","last_peered":"2024-09-12T18:02:03.661213+0000","last_clean":"2024-09-12T18:02:03.661213+0000","last_became_active":"2024-09-12T17:23:40.713481+0000","last_became_peered":"2024-09-12T17:23:40.713481+0000","last_unstale":"2024-09-12T18:02:03.661213+0000","last_undegraded":"2024-09-12T18:02:03.661213+0000","last_fullsized":"2024-09-12T18:02:03.661213+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-12T18:02:03.661110+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-12T18:02:03.661110+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.661110+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:27.094156+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":421,"num_read_kb":5522,"num_write":1047,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.030052+0000","last_change":"2024-09-12T18:02:10.030052+0000","last_active":"2024-09-12T18:02:10.030052+0000","last_peered":"2024-09-12T18:02:10.030052+0000","last_clean":"2024-09-12T18:02:10.030052+0000","last_became_active":"2024-09-12T17:23:44.147677+0000","last_became_peered":"2024-09-12T17:23:44.147677+0000","last_unstale":"2024-09-12T18:02:10.030052+0000","last_undegraded":"2024-09-12T18:02:10.030052+0000","last_fullsized":"2024-09-12T18:02:10.030052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:10.029964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:10.029964+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.029964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:58.321187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"261'293","reported_seq":867,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.766286+0000","last_change":"2024-09-12T18:02:21.766228+0000","last_active":"2024-09-12T18:02:21.766286+0000","last_peered":"2024-09-12T18:02:21.766286+0000","last_clean":"2024-09-12T18:02:21.766286+0000","last_became_active":"2024-09-12T17:23:46.150555+0000","last_became_peered":"2024-09-12T17:23:46.150555+0000","last_unstale":"2024-09-12T18:02:21.766286+0000","last_undegraded":"2024-09-12T18:02:21.766286+0000","last_fullsized":"2024-09-12T18:02:21.766286+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'293","last_scrub_stamp":"2024-09-12T18:02:21.766124+0000","last_deep_scrub":"261'293","last_deep_scrub_stamp":"2024-09-12T18:02:21.766124+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.766124+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:47.826501+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53816,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":485,"num_read_kb":1109,"num_write":394,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"261'805","reported_seq":2482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.560004+0000","last_change":"2024-09-12T18:02:22.559936+0000","last_active":"2024-09-12T18:02:22.560004+0000","last_peered":"2024-09-12T18:02:22.560004+0000","last_clean":"2024-09-12T18:02:22.560004+0000","last_became_active":"2024-09-12T17:23:48.165179+0000","last_became_peered":"2024-09-12T17:23:48.165179+0000","last_unstale":"2024-09-12T18:02:22.560004+0000","last_undegraded":"2024-09-12T18:02:22.560004+0000","last_fullsized":"2024-09-12T18:02:22.560004+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'805","last_scrub_stamp":"2024-09-12T18:02:22.559848+0000","last_deep_scrub":"261'805","last_deep_scrub_stamp":"2024-09-12T18:02:22.559848+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.559848+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:36.016185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"261'145","reported_seq":642,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.610800+0000","last_change":"2024-09-12T18:02:26.610738+0000","last_active":"2024-09-12T18:02:26.610800+0000","last_peered":"2024-09-12T18:02:26.610800+0000","last_clean":"2024-09-12T18:02:26.610800+0000","last_became_active":"2024-09-12T17:23:50.188230+0000","last_became_peered":"2024-09-12T17:23:50.188230+0000","last_unstale":"2024-09-12T18:02:26.610800+0000","last_undegraded":"2024-09-12T18:02:26.610800+0000","last_fullsized":"2024-09-12T18:02:26.610800+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'145","last_scrub_stamp":"2024-09-12T18:02:26.610649+0000","last_deep_scrub":"261'145","last_deep_scrub_stamp":"2024-09-12T18:02:26.610649+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.610649+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:02.263154+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":185,"num_write":335,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"261'475","reported_seq":2033,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.632480+0000","last_change":"2024-09-12T18:02:04.632480+0000","last_active":"2024-09-12T18:02:04.632480+0000","last_peered":"2024-09-12T18:02:04.632480+0000","last_clean":"2024-09-12T18:02:04.632480+0000","last_became_active":"2024-09-12T17:23:42.153910+0000","last_became_peered":"2024-09-12T17:23:42.153910+0000","last_unstale":"2024-09-12T18:02:04.632480+0000","last_undegraded":"2024-09-12T18:02:04.632480+0000","last_fullsized":"2024-09-12T18:02:04.632480+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'475","last_scrub_stamp":"2024-09-12T18:02:04.632383+0000","last_deep_scrub":"261'475","last_deep_scrub_stamp":"2024-09-12T18:02:04.632383+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.632383+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:53.568782+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2575,"num_read_kb":2405,"num_write":575,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"261'399","reported_seq":1123,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.268326+0000","last_change":"2024-09-12T18:02:00.268326+0000","last_active":"2024-09-12T18:02:00.268326+0000","last_peered":"2024-09-12T18:02:00.268326+0000","last_clean":"2024-09-12T18:02:00.268326+0000","last_became_active":"2024-09-12T17:23:40.712691+0000","last_became_peered":"2024-09-12T17:23:40.712691+0000","last_unstale":"2024-09-12T18:02:00.268326+0000","last_undegraded":"2024-09-12T18:02:00.268326+0000","last_fullsized":"2024-09-12T18:02:00.268326+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'399","last_scrub_stamp":"2024-09-12T18:02:00.268230+0000","last_deep_scrub":"261'399","last_deep_scrub_stamp":"2024-09-12T18:02:00.268230+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.268230+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:40.016187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":118590,"num_write":1283,"num_write_kb":72411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.002552+0000","last_change":"2024-09-12T18:02:09.002484+0000","last_active":"2024-09-12T18:02:09.002552+0000","last_peered":"2024-09-12T18:02:09.002552+0000","last_clean":"2024-09-12T18:02:09.002552+0000","last_became_active":"2024-09-12T17:23:44.142306+0000","last_became_peered":"2024-09-12T17:23:44.142306+0000","last_unstale":"2024-09-12T18:02:09.002552+0000","last_undegraded":"2024-09-12T18:02:09.002552+0000","last_fullsized":"2024-09-12T18:02:09.002552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:09.002389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:09.002389+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.002389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:07.194068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"261'459","reported_seq":1082,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.599084+0000","last_change":"2024-09-12T18:02:16.599021+0000","last_active":"2024-09-12T18:02:16.599084+0000","last_peered":"2024-09-12T18:02:16.599084+0000","last_clean":"2024-09-12T18:02:16.599084+0000","last_became_active":"2024-09-12T17:23:46.153719+0000","last_became_peered":"2024-09-12T17:23:46.153719+0000","last_unstale":"2024-09-12T18:02:16.599084+0000","last_undegraded":"2024-09-12T18:02:16.599084+0000","last_fullsized":"2024-09-12T18:02:16.599084+0000","mapping_epoch":29,"log_start":"261'400","ondisk_log_start":"261'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'459","last_scrub_stamp":"2024-09-12T18:02:16.598915+0000","last_deep_scrub":"261'459","last_deep_scrub_stamp":"2024-09-12T18:02:16.598915+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.598915+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:21.772998+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96999,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":810,"num_read_kb":1963,"num_write":664,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.004271+0000","last_change":"2024-09-12T18:02:12.004207+0000","last_active":"2024-09-12T18:02:12.004271+0000","last_peered":"2024-09-12T18:02:12.004271+0000","last_clean":"2024-09-12T18:02:12.004271+0000","last_became_active":"2024-09-12T17:23:48.170317+0000","last_became_peered":"2024-09-12T17:23:48.170317+0000","last_unstale":"2024-09-12T18:02:12.004271+0000","last_undegraded":"2024-09-12T18:02:12.004271+0000","last_fullsized":"2024-09-12T18:02:12.004271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:12.004106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:12.004106+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.004106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:51.147942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"261'156","reported_seq":670,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.966472+0000","last_change":"2024-09-12T18:02:22.966413+0000","last_active":"2024-09-12T18:02:22.966472+0000","last_peered":"2024-09-12T18:02:22.966472+0000","last_clean":"2024-09-12T18:02:22.966472+0000","last_became_active":"2024-09-12T17:23:50.184033+0000","last_became_peered":"2024-09-12T17:23:50.184033+0000","last_unstale":"2024-09-12T18:02:22.966472+0000","last_undegraded":"2024-09-12T18:02:22.966472+0000","last_fullsized":"2024-09-12T18:02:22.966472+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'156","last_scrub_stamp":"2024-09-12T18:02:22.966324+0000","last_deep_scrub":"261'156","last_deep_scrub_stamp":"2024-09-12T18:02:22.966324+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.966324+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:45.009578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":204,"num_write":351,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"261'835","reported_seq":2451,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.034117+0000","last_change":"2024-09-12T18:02:03.034117+0000","last_active":"2024-09-12T18:02:03.034117+0000","last_peered":"2024-09-12T18:02:03.034117+0000","last_clean":"2024-09-12T18:02:03.034117+0000","last_became_active":"2024-09-12T17:23:42.144703+0000","last_became_peered":"2024-09-12T17:23:42.144703+0000","last_unstale":"2024-09-12T18:02:03.034117+0000","last_undegraded":"2024-09-12T18:02:03.034117+0000","last_fullsized":"2024-09-12T18:02:03.034117+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'835","last_scrub_stamp":"2024-09-12T18:02:03.034031+0000","last_deep_scrub":"261'835","last_deep_scrub_stamp":"2024-09-12T18:02:03.034031+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.034031+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:20.574756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3952,"num_read_kb":3587,"num_write":1103,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"261'396","reported_seq":1062,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.233459+0000","last_change":"2024-09-12T18:01:59.233459+0000","last_active":"2024-09-12T18:01:59.233459+0000","last_peered":"2024-09-12T18:01:59.233459+0000","last_clean":"2024-09-12T18:01:59.233459+0000","last_became_active":"2024-09-12T17:23:40.706213+0000","last_became_peered":"2024-09-12T17:23:40.706213+0000","last_unstale":"2024-09-12T18:01:59.233459+0000","last_undegraded":"2024-09-12T18:01:59.233459+0000","last_fullsized":"2024-09-12T18:01:59.233459+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'396","last_scrub_stamp":"2024-09-12T18:01:59.233355+0000","last_deep_scrub":"261'396","last_deep_scrub_stamp":"2024-09-12T18:01:59.233355+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.233355+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:59.541266+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2088372,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":615,"num_read_kb":8190,"num_write":1407,"num_write_kb":25988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.021025+0000","last_change":"2024-09-12T18:02:08.021025+0000","last_active":"2024-09-12T18:02:08.021025+0000","last_peered":"2024-09-12T18:02:08.021025+0000","last_clean":"2024-09-12T18:02:08.021025+0000","last_became_active":"2024-09-12T17:23:44.149550+0000","last_became_peered":"2024-09-12T17:23:44.149550+0000","last_unstale":"2024-09-12T18:02:08.021025+0000","last_undegraded":"2024-09-12T18:02:08.021025+0000","last_fullsized":"2024-09-12T18:02:08.021025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:08.020929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:08.020929+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.020929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:44.082038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"261'283","reported_seq":855,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.193388+0000","last_change":"2024-09-12T18:02:22.193388+0000","last_active":"2024-09-12T18:02:22.193388+0000","last_peered":"2024-09-12T18:02:22.193388+0000","last_clean":"2024-09-12T18:02:22.193388+0000","last_became_active":"2024-09-12T17:23:46.153210+0000","last_became_peered":"2024-09-12T17:23:46.153210+0000","last_unstale":"2024-09-12T18:02:22.193388+0000","last_undegraded":"2024-09-12T18:02:22.193388+0000","last_fullsized":"2024-09-12T18:02:22.193388+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'283","last_scrub_stamp":"2024-09-12T18:02:22.193294+0000","last_deep_scrub":"261'283","last_deep_scrub_stamp":"2024-09-12T18:02:22.193294+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.193294+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:46.683819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":1026,"num_write":426,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.528683+0000","last_change":"2024-09-12T18:02:23.528683+0000","last_active":"2024-09-12T18:02:23.528683+0000","last_peered":"2024-09-12T18:02:23.528683+0000","last_clean":"2024-09-12T18:02:23.528683+0000","last_became_active":"2024-09-12T17:23:48.168675+0000","last_became_peered":"2024-09-12T17:23:48.168675+0000","last_unstale":"2024-09-12T18:02:23.528683+0000","last_undegraded":"2024-09-12T18:02:23.528683+0000","last_fullsized":"2024-09-12T18:02:23.528683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:23.528590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:23.528590+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.528590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:41.560581+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"261'101","reported_seq":590,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.335852+0000","last_change":"2024-09-12T18:02:31.335852+0000","last_active":"2024-09-12T18:02:31.335852+0000","last_peered":"2024-09-12T18:02:31.335852+0000","last_clean":"2024-09-12T18:02:31.335852+0000","last_became_active":"2024-09-12T17:23:50.186287+0000","last_became_peered":"2024-09-12T17:23:50.186287+0000","last_unstale":"2024-09-12T18:02:31.335852+0000","last_undegraded":"2024-09-12T18:02:31.335852+0000","last_fullsized":"2024-09-12T18:02:31.335852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'101","last_scrub_stamp":"2024-09-12T18:02:31.335753+0000","last_deep_scrub":"261'101","last_deep_scrub_stamp":"2024-09-12T18:02:31.335753+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.335753+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:10.965870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":108,"num_read_kb":104,"num_write":228,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"261'642","reported_seq":2252,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.070744+0000","last_change":"2024-09-12T18:02:04.070744+0000","last_active":"2024-09-12T18:02:04.070744+0000","last_peered":"2024-09-12T18:02:04.070744+0000","last_clean":"2024-09-12T18:02:04.070744+0000","last_became_active":"2024-09-12T17:23:42.132858+0000","last_became_peered":"2024-09-12T17:23:42.132858+0000","last_unstale":"2024-09-12T18:02:04.070744+0000","last_undegraded":"2024-09-12T18:02:04.070744+0000","last_fullsized":"2024-09-12T18:02:04.070744+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'642","last_scrub_stamp":"2024-09-12T18:02:04.070634+0000","last_deep_scrub":"261'642","last_deep_scrub_stamp":"2024-09-12T18:02:04.070634+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.070634+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:45.786486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3409,"num_read_kb":3082,"num_write":929,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"261'409","reported_seq":1091,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.166653+0000","last_change":"2024-09-12T18:01:57.166598+0000","last_active":"2024-09-12T18:01:57.166653+0000","last_peered":"2024-09-12T18:01:57.166653+0000","last_clean":"2024-09-12T18:01:57.166653+0000","last_became_active":"2024-09-12T17:23:40.706531+0000","last_became_peered":"2024-09-12T17:23:40.706531+0000","last_unstale":"2024-09-12T18:01:57.166653+0000","last_undegraded":"2024-09-12T18:01:57.166653+0000","last_fullsized":"2024-09-12T18:01:57.166653+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'409","last_scrub_stamp":"2024-09-12T18:01:57.166513+0000","last_deep_scrub":"261'409","last_deep_scrub_stamp":"2024-09-12T18:01:57.166513+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.166513+0000","objects_scrubbed":6,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:43.195543+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":670,"num_read_kb":36595,"num_write":1219,"num_write_kb":30858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"261'6","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.977020+0000","last_change":"2024-09-12T18:02:11.977020+0000","last_active":"2024-09-12T18:02:11.977020+0000","last_peered":"2024-09-12T18:02:11.977020+0000","last_clean":"2024-09-12T18:02:11.977020+0000","last_became_active":"2024-09-12T17:23:44.147427+0000","last_became_peered":"2024-09-12T17:23:44.147427+0000","last_unstale":"2024-09-12T18:02:11.977020+0000","last_undegraded":"2024-09-12T18:02:11.977020+0000","last_fullsized":"2024-09-12T18:02:11.977020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T18:02:11.976933+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T18:02:11.976933+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.976933+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:25.517914+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":1201,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"261'305","reported_seq":883,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.994122+0000","last_change":"2024-09-12T18:02:10.994122+0000","last_active":"2024-09-12T18:02:10.994122+0000","last_peered":"2024-09-12T18:02:10.994122+0000","last_clean":"2024-09-12T18:02:10.994122+0000","last_became_active":"2024-09-12T17:23:46.153004+0000","last_became_peered":"2024-09-12T17:23:46.153004+0000","last_unstale":"2024-09-12T18:02:10.994122+0000","last_undegraded":"2024-09-12T18:02:10.994122+0000","last_fullsized":"2024-09-12T18:02:10.994122+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'305","last_scrub_stamp":"2024-09-12T18:02:10.994015+0000","last_deep_scrub":"261'305","last_deep_scrub_stamp":"2024-09-12T18:02:10.994015+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.994015+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:16.444198+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46983,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":497,"num_read_kb":1127,"num_write":408,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"261'742","reported_seq":2139,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.981896+0000","last_change":"2024-09-12T18:02:13.981896+0000","last_active":"2024-09-12T18:02:13.981896+0000","last_peered":"2024-09-12T18:02:13.981896+0000","last_clean":"2024-09-12T18:02:13.981896+0000","last_became_active":"2024-09-12T17:23:48.169062+0000","last_became_peered":"2024-09-12T17:23:48.169062+0000","last_unstale":"2024-09-12T18:02:13.981896+0000","last_undegraded":"2024-09-12T18:02:13.981896+0000","last_fullsized":"2024-09-12T18:02:13.981896+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'742","last_scrub_stamp":"2024-09-12T18:02:13.981802+0000","last_deep_scrub":"261'742","last_deep_scrub_stamp":"2024-09-12T18:02:13.981802+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.981802+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:50.710110+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"261'143","reported_seq":637,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.934580+0000","last_change":"2024-09-12T18:02:24.934580+0000","last_active":"2024-09-12T18:02:24.934580+0000","last_peered":"2024-09-12T18:02:24.934580+0000","last_clean":"2024-09-12T18:02:24.934580+0000","last_became_active":"2024-09-12T17:23:50.184460+0000","last_became_peered":"2024-09-12T17:23:50.184460+0000","last_unstale":"2024-09-12T18:02:24.934580+0000","last_undegraded":"2024-09-12T18:02:24.934580+0000","last_fullsized":"2024-09-12T18:02:24.934580+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'143","last_scrub_stamp":"2024-09-12T18:02:24.934481+0000","last_deep_scrub":"261'143","last_deep_scrub_stamp":"2024-09-12T18:02:24.934481+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.934481+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:59.139694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":156,"num_write":329,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"261'798","reported_seq":2262,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.150267+0000","last_change":"2024-09-12T18:02:06.150267+0000","last_active":"2024-09-12T18:02:06.150267+0000","last_peered":"2024-09-12T18:02:06.150267+0000","last_clean":"2024-09-12T18:02:06.150267+0000","last_became_active":"2024-09-12T17:23:42.142896+0000","last_became_peered":"2024-09-12T17:23:42.142896+0000","last_unstale":"2024-09-12T18:02:06.150267+0000","last_undegraded":"2024-09-12T18:02:06.150267+0000","last_fullsized":"2024-09-12T18:02:06.150267+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'798","last_scrub_stamp":"2024-09-12T18:02:06.150180+0000","last_deep_scrub":"261'798","last_deep_scrub_stamp":"2024-09-12T18:02:06.150180+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.150180+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:47.648995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3737,"num_read_kb":3347,"num_write":1075,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"261'343","reported_seq":1015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.076466+0000","last_change":"2024-09-12T18:01:56.076389+0000","last_active":"2024-09-12T18:01:56.076466+0000","last_peered":"2024-09-12T18:01:56.076466+0000","last_clean":"2024-09-12T18:01:56.076466+0000","last_became_active":"2024-09-12T17:23:40.708386+0000","last_became_peered":"2024-09-12T17:23:40.708386+0000","last_unstale":"2024-09-12T18:01:56.076466+0000","last_undegraded":"2024-09-12T18:01:56.076466+0000","last_fullsized":"2024-09-12T18:01:56.076466+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'343","last_scrub_stamp":"2024-09-12T18:01:56.076247+0000","last_deep_scrub":"261'343","last_deep_scrub_stamp":"2024-09-12T18:01:56.076247+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.076247+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:59.205706+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655881,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":106949,"num_write":1131,"num_write_kb":37410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"261'4","reported_seq":1460,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.227769+0000","last_change":"2024-09-12T18:02:19.227769+0000","last_active":"2024-09-12T18:02:19.227769+0000","last_peered":"2024-09-12T18:02:19.227769+0000","last_clean":"2024-09-12T18:02:19.227769+0000","last_became_active":"2024-09-12T17:23:44.149279+0000","last_became_peered":"2024-09-12T17:23:44.149279+0000","last_unstale":"2024-09-12T18:02:19.227769+0000","last_undegraded":"2024-09-12T18:02:19.227769+0000","last_fullsized":"2024-09-12T18:02:19.227769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T18:02:19.227681+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T18:02:19.227681+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.227681+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:18.615853+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"261'68","reported_seq":580,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.273405+0000","last_change":"2024-09-12T18:02:20.273405+0000","last_active":"2024-09-12T18:02:20.273405+0000","last_peered":"2024-09-12T18:02:20.273405+0000","last_clean":"2024-09-12T18:02:20.273405+0000","last_became_active":"2024-09-12T17:23:46.240979+0000","last_became_peered":"2024-09-12T17:23:46.240979+0000","last_unstale":"2024-09-12T18:02:20.273405+0000","last_undegraded":"2024-09-12T18:02:20.273405+0000","last_fullsized":"2024-09-12T18:02:20.273405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'68","last_scrub_stamp":"2024-09-12T18:02:20.273317+0000","last_deep_scrub":"261'68","last_deep_scrub_stamp":"2024-09-12T18:02:20.273317+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.273317+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:58.881950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"261'786","reported_seq":2389,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.107046+0000","last_change":"2024-09-12T18:02:17.107046+0000","last_active":"2024-09-12T18:02:17.107046+0000","last_peered":"2024-09-12T18:02:17.107046+0000","last_clean":"2024-09-12T18:02:17.107046+0000","last_became_active":"2024-09-12T17:23:48.172485+0000","last_became_peered":"2024-09-12T17:23:48.172485+0000","last_unstale":"2024-09-12T18:02:17.107046+0000","last_undegraded":"2024-09-12T18:02:17.107046+0000","last_fullsized":"2024-09-12T18:02:17.107046+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'786","last_scrub_stamp":"2024-09-12T18:02:17.106958+0000","last_deep_scrub":"261'786","last_deep_scrub_stamp":"2024-09-12T18:02:17.106958+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.106958+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:38.457220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"261'141","reported_seq":634,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.056357+0000","last_change":"2024-09-12T18:02:28.056357+0000","last_active":"2024-09-12T18:02:28.056357+0000","last_peered":"2024-09-12T18:02:28.056357+0000","last_clean":"2024-09-12T18:02:28.056357+0000","last_became_active":"2024-09-12T17:23:50.179153+0000","last_became_peered":"2024-09-12T17:23:50.179153+0000","last_unstale":"2024-09-12T18:02:28.056357+0000","last_undegraded":"2024-09-12T18:02:28.056357+0000","last_fullsized":"2024-09-12T18:02:28.056357+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'141","last_scrub_stamp":"2024-09-12T18:02:28.056234+0000","last_deep_scrub":"261'141","last_deep_scrub_stamp":"2024-09-12T18:02:28.056234+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.056234+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:22.001475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":149,"num_read_kb":148,"num_write":323,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"261'409","reported_seq":1909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.043260+0000","last_change":"2024-09-12T18:02:07.043260+0000","last_active":"2024-09-12T18:02:07.043260+0000","last_peered":"2024-09-12T18:02:07.043260+0000","last_clean":"2024-09-12T18:02:07.043260+0000","last_became_active":"2024-09-12T17:23:42.152339+0000","last_became_peered":"2024-09-12T17:23:42.152339+0000","last_unstale":"2024-09-12T18:02:07.043260+0000","last_undegraded":"2024-09-12T18:02:07.043260+0000","last_fullsized":"2024-09-12T18:02:07.043260+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'409","last_scrub_stamp":"2024-09-12T18:02:07.043170+0000","last_deep_scrub":"261'409","last_deep_scrub_stamp":"2024-09-12T18:02:07.043170+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.043170+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:06.071189+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2264,"num_read_kb":2142,"num_write":477,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"261'440","reported_seq":1221,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.180960+0000","last_change":"2024-09-12T18:01:58.180910+0000","last_active":"2024-09-12T18:01:58.180960+0000","last_peered":"2024-09-12T18:01:58.180960+0000","last_clean":"2024-09-12T18:01:58.180960+0000","last_became_active":"2024-09-12T17:23:40.714708+0000","last_became_peered":"2024-09-12T17:23:40.714708+0000","last_unstale":"2024-09-12T18:01:58.180960+0000","last_undegraded":"2024-09-12T18:01:58.180960+0000","last_fullsized":"2024-09-12T18:01:58.180960+0000","mapping_epoch":23,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'440","last_scrub_stamp":"2024-09-12T18:01:58.180819+0000","last_deep_scrub":"261'440","last_deep_scrub_stamp":"2024-09-12T18:01:58.180819+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.180819+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:13.620327+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1005,"num_read_kb":34670,"num_write":1495,"num_write_kb":45714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.220941+0000","last_change":"2024-09-12T18:02:16.220941+0000","last_active":"2024-09-12T18:02:16.220941+0000","last_peered":"2024-09-12T18:02:16.220941+0000","last_clean":"2024-09-12T18:02:16.220941+0000","last_became_active":"2024-09-12T17:23:44.151392+0000","last_became_peered":"2024-09-12T17:23:44.151392+0000","last_unstale":"2024-09-12T18:02:16.220941+0000","last_undegraded":"2024-09-12T18:02:16.220941+0000","last_fullsized":"2024-09-12T18:02:16.220941+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:16.220650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:16.220650+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.220650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:42.850614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"261'313","reported_seq":909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.171235+0000","last_change":"2024-09-12T18:02:25.171235+0000","last_active":"2024-09-12T18:02:25.171235+0000","last_peered":"2024-09-12T18:02:25.171235+0000","last_clean":"2024-09-12T18:02:25.171235+0000","last_became_active":"2024-09-12T17:23:46.144754+0000","last_became_peered":"2024-09-12T17:23:46.144754+0000","last_unstale":"2024-09-12T18:02:25.171235+0000","last_undegraded":"2024-09-12T18:02:25.171235+0000","last_fullsized":"2024-09-12T18:02:25.171235+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'313","last_scrub_stamp":"2024-09-12T18:02:25.171143+0000","last_deep_scrub":"261'313","last_deep_scrub_stamp":"2024-09-12T18:02:25.171143+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.171143+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:02.652521+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46816,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":500,"num_read_kb":1038,"num_write":390,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.115251+0000","last_change":"2024-09-12T18:02:13.115251+0000","last_active":"2024-09-12T18:02:13.115251+0000","last_peered":"2024-09-12T18:02:13.115251+0000","last_clean":"2024-09-12T18:02:13.115251+0000","last_became_active":"2024-09-12T17:23:48.170482+0000","last_became_peered":"2024-09-12T17:23:48.170482+0000","last_unstale":"2024-09-12T18:02:13.115251+0000","last_undegraded":"2024-09-12T18:02:13.115251+0000","last_fullsized":"2024-09-12T18:02:13.115251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:13.115166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:13.115166+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.115166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:47.974782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"261'142","reported_seq":643,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.960301+0000","last_change":"2024-09-12T18:02:20.960301+0000","last_active":"2024-09-12T18:02:20.960301+0000","last_peered":"2024-09-12T18:02:20.960301+0000","last_clean":"2024-09-12T18:02:20.960301+0000","last_became_active":"2024-09-12T17:23:50.187040+0000","last_became_peered":"2024-09-12T17:23:50.187040+0000","last_unstale":"2024-09-12T18:02:20.960301+0000","last_undegraded":"2024-09-12T18:02:20.960301+0000","last_fullsized":"2024-09-12T18:02:20.960301+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'142","last_scrub_stamp":"2024-09-12T18:02:20.960210+0000","last_deep_scrub":"261'142","last_deep_scrub_stamp":"2024-09-12T18:02:20.960210+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.960210+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:06.679889+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":190,"num_write":335,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"261'1233","reported_seq":2789,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.139896+0000","last_change":"2024-09-12T18:02:05.139896+0000","last_active":"2024-09-12T18:02:05.139896+0000","last_peered":"2024-09-12T18:02:05.139896+0000","last_clean":"2024-09-12T18:02:05.139896+0000","last_became_active":"2024-09-12T17:23:42.146200+0000","last_became_peered":"2024-09-12T17:23:42.146200+0000","last_unstale":"2024-09-12T18:02:05.139896+0000","last_undegraded":"2024-09-12T18:02:05.139896+0000","last_fullsized":"2024-09-12T18:02:05.139896+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1233","last_scrub_stamp":"2024-09-12T18:02:05.139829+0000","last_deep_scrub":"261'1233","last_deep_scrub_stamp":"2024-09-12T18:02:05.139829+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.139829+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":1200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:20.252996+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5862,"num_read_kb":5167,"num_write":1742,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"261'74","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.604067+0000","last_change":"2024-09-12T18:01:57.604067+0000","last_active":"2024-09-12T18:01:57.604067+0000","last_peered":"2024-09-12T18:01:57.604067+0000","last_clean":"2024-09-12T18:01:57.604067+0000","last_became_active":"2024-09-12T17:23:26.034872+0000","last_became_peered":"2024-09-12T17:23:26.034872+0000","last_unstale":"2024-09-12T18:01:57.604067+0000","last_undegraded":"2024-09-12T18:01:57.604067+0000","last_fullsized":"2024-09-12T18:01:57.604067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'74","last_scrub_stamp":"2024-09-12T18:01:57.603967+0000","last_deep_scrub":"261'74","last_deep_scrub_stamp":"2024-09-12T18:01:57.603967+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.603967+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:41.712562+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"261'2","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.219549+0000","last_change":"2024-09-12T18:01:58.219549+0000","last_active":"2024-09-12T18:01:58.219549+0000","last_peered":"2024-09-12T18:01:58.219549+0000","last_clean":"2024-09-12T18:01:58.219549+0000","last_became_active":"2024-09-12T17:23:31.584884+0000","last_became_peered":"2024-09-12T17:23:31.584884+0000","last_unstale":"2024-09-12T18:01:58.219549+0000","last_undegraded":"2024-09-12T18:01:58.219549+0000","last_fullsized":"2024-09-12T18:01:58.219549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:01:58.219468+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:01:58.219468+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.219468+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:46.365922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000423087,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"261'317","reported_seq":954,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.118593+0000","last_change":"2024-09-12T18:01:56.118593+0000","last_active":"2024-09-12T18:01:56.118593+0000","last_peered":"2024-09-12T18:01:56.118593+0000","last_clean":"2024-09-12T18:01:56.118593+0000","last_became_active":"2024-09-12T17:23:40.718896+0000","last_became_peered":"2024-09-12T17:23:40.718896+0000","last_unstale":"2024-09-12T18:01:56.118593+0000","last_undegraded":"2024-09-12T18:01:56.118593+0000","last_fullsized":"2024-09-12T18:01:56.118593+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'317","last_scrub_stamp":"2024-09-12T18:01:56.118490+0000","last_deep_scrub":"261'317","last_deep_scrub_stamp":"2024-09-12T18:01:56.118490+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.118490+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:05.520040+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":13109,"num_write":1018,"num_write_kb":39939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"261'4","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.686852+0000","last_change":"2024-09-12T18:02:15.686852+0000","last_active":"2024-09-12T18:02:15.686852+0000","last_peered":"2024-09-12T18:02:15.686852+0000","last_clean":"2024-09-12T18:02:15.686852+0000","last_became_active":"2024-09-12T17:23:44.152585+0000","last_became_peered":"2024-09-12T17:23:44.152585+0000","last_unstale":"2024-09-12T18:02:15.686852+0000","last_undegraded":"2024-09-12T18:02:15.686852+0000","last_fullsized":"2024-09-12T18:02:15.686852+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T18:02:15.686767+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T18:02:15.686767+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.686767+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:37.441894+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"261'723","reported_seq":1422,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.163278+0000","last_change":"2024-09-12T18:02:23.163217+0000","last_active":"2024-09-12T18:02:23.163278+0000","last_peered":"2024-09-12T18:02:23.163278+0000","last_clean":"2024-09-12T18:02:23.163278+0000","last_became_active":"2024-09-12T17:23:46.151673+0000","last_became_peered":"2024-09-12T17:23:46.151673+0000","last_unstale":"2024-09-12T18:02:23.163278+0000","last_undegraded":"2024-09-12T18:02:23.163278+0000","last_fullsized":"2024-09-12T18:02:23.163278+0000","mapping_epoch":29,"log_start":"261'700","ondisk_log_start":"261'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'723","last_scrub_stamp":"2024-09-12T18:02:23.163118+0000","last_deep_scrub":"261'723","last_deep_scrub_stamp":"2024-09-12T18:02:23.163118+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.163118+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:13.781960+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145502,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1428,"num_read_kb":3259,"num_write":1354,"num_write_kb":1206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106776,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.604170+0000","last_change":"2024-09-12T18:02:20.604097+0000","last_active":"2024-09-12T18:02:20.604170+0000","last_peered":"2024-09-12T18:02:20.604170+0000","last_clean":"2024-09-12T18:02:20.604170+0000","last_became_active":"2024-09-12T17:23:48.170153+0000","last_became_peered":"2024-09-12T17:23:48.170153+0000","last_unstale":"2024-09-12T18:02:20.604170+0000","last_undegraded":"2024-09-12T18:02:20.604170+0000","last_fullsized":"2024-09-12T18:02:20.604170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:20.603993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:20.603993+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.603993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:23.747962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"261'227","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.107458+0000","last_change":"2024-09-12T18:02:20.107381+0000","last_active":"2024-09-12T18:02:20.107458+0000","last_peered":"2024-09-12T18:02:20.107458+0000","last_clean":"2024-09-12T18:02:20.107458+0000","last_became_active":"2024-09-12T17:23:50.188552+0000","last_became_peered":"2024-09-12T17:23:50.188552+0000","last_unstale":"2024-09-12T18:02:20.107458+0000","last_undegraded":"2024-09-12T18:02:20.107458+0000","last_fullsized":"2024-09-12T18:02:20.107458+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'227","last_scrub_stamp":"2024-09-12T18:02:20.107290+0000","last_deep_scrub":"261'227","last_deep_scrub_stamp":"2024-09-12T18:02:20.107290+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.107290+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:00.704292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":580,"num_write":503,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"261'393","reported_seq":1840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.682179+0000","last_change":"2024-09-12T18:02:03.682090+0000","last_active":"2024-09-12T18:02:03.682179+0000","last_peered":"2024-09-12T18:02:03.682179+0000","last_clean":"2024-09-12T18:02:03.682179+0000","last_became_active":"2024-09-12T17:23:42.147045+0000","last_became_peered":"2024-09-12T17:23:42.147045+0000","last_unstale":"2024-09-12T18:02:03.682179+0000","last_undegraded":"2024-09-12T18:02:03.682179+0000","last_fullsized":"2024-09-12T18:02:03.682179+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'393","last_scrub_stamp":"2024-09-12T18:02:03.681965+0000","last_deep_scrub":"261'393","last_deep_scrub_stamp":"2024-09-12T18:02:03.681965+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.681965+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:17.784933+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2080,"num_read_kb":1972,"num_write":429,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1199,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":515,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.639675+0000","last_change":"2024-09-12T18:01:58.639675+0000","last_active":"2024-09-12T18:01:58.639675+0000","last_peered":"2024-09-12T18:01:58.639675+0000","last_clean":"2024-09-12T18:01:58.639675+0000","last_became_active":"2024-09-12T17:23:31.588699+0000","last_became_peered":"2024-09-12T17:23:31.588699+0000","last_unstale":"2024-09-12T18:01:58.639675+0000","last_undegraded":"2024-09-12T18:01:58.639675+0000","last_fullsized":"2024-09-12T18:01:58.639675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:58.639583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:58.639583+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.639583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:21.037862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052181899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"261'342","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.723017+0000","last_change":"2024-09-12T18:01:58.723017+0000","last_active":"2024-09-12T18:01:58.723017+0000","last_peered":"2024-09-12T18:01:58.723017+0000","last_clean":"2024-09-12T18:01:58.723017+0000","last_became_active":"2024-09-12T17:23:40.713199+0000","last_became_peered":"2024-09-12T17:23:40.713199+0000","last_unstale":"2024-09-12T18:01:58.723017+0000","last_undegraded":"2024-09-12T18:01:58.723017+0000","last_fullsized":"2024-09-12T18:01:58.723017+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'342","last_scrub_stamp":"2024-09-12T18:01:58.722915+0000","last_deep_scrub":"261'342","last_deep_scrub_stamp":"2024-09-12T18:01:58.722915+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.722915+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:52.223877+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":39290,"num_write":1124,"num_write_kb":55994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.272095+0000","last_change":"2024-09-12T18:02:17.272039+0000","last_active":"2024-09-12T18:02:17.272095+0000","last_peered":"2024-09-12T18:02:17.272095+0000","last_clean":"2024-09-12T18:02:17.272095+0000","last_became_active":"2024-09-12T17:23:44.149400+0000","last_became_peered":"2024-09-12T17:23:44.149400+0000","last_unstale":"2024-09-12T18:02:17.272095+0000","last_undegraded":"2024-09-12T18:02:17.272095+0000","last_fullsized":"2024-09-12T18:02:17.272095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:17.271849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:17.271849+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.271849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:57.900849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"261'1320","reported_seq":2715,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.052671+0000","last_change":"2024-09-12T18:02:15.052671+0000","last_active":"2024-09-12T18:02:15.052671+0000","last_peered":"2024-09-12T18:02:15.052671+0000","last_clean":"2024-09-12T18:02:15.052671+0000","last_became_active":"2024-09-12T17:23:46.145354+0000","last_became_peered":"2024-09-12T17:23:46.145354+0000","last_unstale":"2024-09-12T18:02:15.052671+0000","last_undegraded":"2024-09-12T18:02:15.052671+0000","last_fullsized":"2024-09-12T18:02:15.052671+0000","mapping_epoch":29,"log_start":"261'1300","ondisk_log_start":"261'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1320","last_scrub_stamp":"2024-09-12T18:02:15.052569+0000","last_deep_scrub":"261'1320","last_deep_scrub_stamp":"2024-09-12T18:02:15.052569+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.052569+0000","objects_scrubbed":12,"log_size":20,"log_dups_size":1300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:58.558654+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139395,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2079,"num_read_kb":4017,"num_write":1172,"num_write_kb":1007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.786228+0000","last_change":"2024-09-12T18:02:25.786228+0000","last_active":"2024-09-12T18:02:25.786228+0000","last_peered":"2024-09-12T18:02:25.786228+0000","last_clean":"2024-09-12T18:02:25.786228+0000","last_became_active":"2024-09-12T17:23:48.171355+0000","last_became_peered":"2024-09-12T17:23:48.171355+0000","last_unstale":"2024-09-12T18:02:25.786228+0000","last_undegraded":"2024-09-12T18:02:25.786228+0000","last_fullsized":"2024-09-12T18:02:25.786228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:25.786136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:25.786136+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.786136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:33.215639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"261'109","reported_seq":618,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.990778+0000","last_change":"2024-09-12T18:02:21.990666+0000","last_active":"2024-09-12T18:02:21.990778+0000","last_peered":"2024-09-12T18:02:21.990778+0000","last_clean":"2024-09-12T18:02:21.990778+0000","last_became_active":"2024-09-12T17:23:50.639053+0000","last_became_peered":"2024-09-12T17:23:50.639053+0000","last_unstale":"2024-09-12T18:02:21.990778+0000","last_undegraded":"2024-09-12T18:02:21.990778+0000","last_fullsized":"2024-09-12T18:02:21.990778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'109","last_scrub_stamp":"2024-09-12T18:02:21.990551+0000","last_deep_scrub":"261'109","last_deep_scrub_stamp":"2024-09-12T18:02:21.990551+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.990551+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:25.489390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":162,"num_write":260,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"261'914","reported_seq":2651,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.066830+0000","last_change":"2024-09-12T18:02:06.066774+0000","last_active":"2024-09-12T18:02:06.066830+0000","last_peered":"2024-09-12T18:02:06.066830+0000","last_clean":"2024-09-12T18:02:06.066830+0000","last_became_active":"2024-09-12T17:23:42.145049+0000","last_became_peered":"2024-09-12T17:23:42.145049+0000","last_unstale":"2024-09-12T18:02:06.066830+0000","last_undegraded":"2024-09-12T18:02:06.066830+0000","last_fullsized":"2024-09-12T18:02:06.066830+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'914","last_scrub_stamp":"2024-09-12T18:02:06.066685+0000","last_deep_scrub":"261'914","last_deep_scrub_stamp":"2024-09-12T18:02:06.066685+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.066685+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":900,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:56.688488+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4463,"num_read_kb":4014,"num_write":1227,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.898988+0000","last_change":"2024-09-12T18:01:55.898988+0000","last_active":"2024-09-12T18:01:55.898988+0000","last_peered":"2024-09-12T18:01:55.898988+0000","last_clean":"2024-09-12T18:01:55.898988+0000","last_became_active":"2024-09-12T17:23:31.584259+0000","last_became_peered":"2024-09-12T17:23:31.584259+0000","last_unstale":"2024-09-12T18:01:55.898988+0000","last_undegraded":"2024-09-12T18:01:55.898988+0000","last_fullsized":"2024-09-12T18:01:55.898988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:55.898906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:55.898906+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.898906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:27.914712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045870900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"261'331","reported_seq":961,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.976477+0000","last_change":"2024-09-12T18:01:55.976477+0000","last_active":"2024-09-12T18:01:55.976477+0000","last_peered":"2024-09-12T18:01:55.976477+0000","last_clean":"2024-09-12T18:01:55.976477+0000","last_became_active":"2024-09-12T17:23:40.712276+0000","last_became_peered":"2024-09-12T17:23:40.712276+0000","last_unstale":"2024-09-12T18:01:55.976477+0000","last_undegraded":"2024-09-12T18:01:55.976477+0000","last_fullsized":"2024-09-12T18:01:55.976477+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'331","last_scrub_stamp":"2024-09-12T18:01:55.976396+0000","last_deep_scrub":"261'331","last_deep_scrub_stamp":"2024-09-12T18:01:55.976396+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.976396+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:09.619450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":8922,"num_write":1082,"num_write_kb":17941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"261'2","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.053972+0000","last_change":"2024-09-12T18:02:06.053911+0000","last_active":"2024-09-12T18:02:06.053972+0000","last_peered":"2024-09-12T18:02:06.053972+0000","last_clean":"2024-09-12T18:02:06.053972+0000","last_became_active":"2024-09-12T17:23:44.151006+0000","last_became_peered":"2024-09-12T17:23:44.151006+0000","last_unstale":"2024-09-12T18:02:06.053972+0000","last_undegraded":"2024-09-12T18:02:06.053972+0000","last_fullsized":"2024-09-12T18:02:06.053972+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:06.053826+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:06.053826+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.053826+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:20.770473+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"261'203","reported_seq":1198,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.748490+0000","last_change":"2024-09-12T18:02:20.748490+0000","last_active":"2024-09-12T18:02:20.748490+0000","last_peered":"2024-09-12T18:02:20.748490+0000","last_clean":"2024-09-12T18:02:20.748490+0000","last_became_active":"2024-09-12T17:23:46.241733+0000","last_became_peered":"2024-09-12T17:23:46.241733+0000","last_unstale":"2024-09-12T18:02:20.748490+0000","last_undegraded":"2024-09-12T18:02:20.748490+0000","last_fullsized":"2024-09-12T18:02:20.748490+0000","mapping_epoch":29,"log_start":"258'100","ondisk_log_start":"258'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'203","last_scrub_stamp":"2024-09-12T18:02:20.748374+0000","last_deep_scrub":"261'203","last_deep_scrub_stamp":"2024-09-12T18:02:20.748374+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.748374+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:40.960458+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":152,"num_read_kb":143,"num_write":117,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.566774+0000","last_change":"2024-09-12T18:02:21.566774+0000","last_active":"2024-09-12T18:02:21.566774+0000","last_peered":"2024-09-12T18:02:21.566774+0000","last_clean":"2024-09-12T18:02:21.566774+0000","last_became_active":"2024-09-12T17:23:48.167920+0000","last_became_peered":"2024-09-12T17:23:48.167920+0000","last_unstale":"2024-09-12T18:02:21.566774+0000","last_undegraded":"2024-09-12T18:02:21.566774+0000","last_fullsized":"2024-09-12T18:02:21.566774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:21.566682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:21.566682+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.566682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:26.235303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"261'265","reported_seq":870,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.378316+0000","last_change":"2024-09-12T18:02:32.378316+0000","last_active":"2024-09-12T18:02:32.378316+0000","last_peered":"2024-09-12T18:02:32.378316+0000","last_clean":"2024-09-12T18:02:32.378316+0000","last_became_active":"2024-09-12T17:23:50.177293+0000","last_became_peered":"2024-09-12T17:23:50.177293+0000","last_unstale":"2024-09-12T18:02:32.378316+0000","last_undegraded":"2024-09-12T18:02:32.378316+0000","last_fullsized":"2024-09-12T18:02:32.378316+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'265","last_scrub_stamp":"2024-09-12T18:02:32.378205+0000","last_deep_scrub":"261'265","last_deep_scrub_stamp":"2024-09-12T18:02:32.378205+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.378205+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:34.137386+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":569,"num_write":571,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"261'445","reported_seq":2043,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.029638+0000","last_change":"2024-09-12T18:02:05.029638+0000","last_active":"2024-09-12T18:02:05.029638+0000","last_peered":"2024-09-12T18:02:05.029638+0000","last_clean":"2024-09-12T18:02:05.029638+0000","last_became_active":"2024-09-12T17:23:42.136083+0000","last_became_peered":"2024-09-12T17:23:42.136083+0000","last_unstale":"2024-09-12T18:02:05.029638+0000","last_undegraded":"2024-09-12T18:02:05.029638+0000","last_fullsized":"2024-09-12T18:02:05.029638+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'445","last_scrub_stamp":"2024-09-12T18:02:05.029525+0000","last_deep_scrub":"261'445","last_deep_scrub_stamp":"2024-09-12T18:02:05.029525+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.029525+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:54.386989+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2433,"num_read_kb":2304,"num_write":511,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"261'3","reported_seq":520,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.201047+0000","last_change":"2024-09-12T18:01:57.201047+0000","last_active":"2024-09-12T18:01:57.201047+0000","last_peered":"2024-09-12T18:01:57.201047+0000","last_clean":"2024-09-12T18:01:57.201047+0000","last_became_active":"2024-09-12T17:23:31.588612+0000","last_became_peered":"2024-09-12T17:23:31.588612+0000","last_unstale":"2024-09-12T18:01:57.201047+0000","last_undegraded":"2024-09-12T18:01:57.201047+0000","last_fullsized":"2024-09-12T18:01:57.201047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:01:57.200972+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:01:57.200972+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.200972+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:08.741396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00095838300000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"261'358","reported_seq":1082,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.069482+0000","last_change":"2024-09-12T18:01:57.069482+0000","last_active":"2024-09-12T18:01:57.069482+0000","last_peered":"2024-09-12T18:01:57.069482+0000","last_clean":"2024-09-12T18:01:57.069482+0000","last_became_active":"2024-09-12T17:23:40.716786+0000","last_became_peered":"2024-09-12T17:23:40.716786+0000","last_unstale":"2024-09-12T18:01:57.069482+0000","last_undegraded":"2024-09-12T18:01:57.069482+0000","last_fullsized":"2024-09-12T18:01:57.069482+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'358","last_scrub_stamp":"2024-09-12T18:01:57.069360+0000","last_deep_scrub":"261'358","last_deep_scrub_stamp":"2024-09-12T18:01:57.069360+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.069360+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:04.851606+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287987,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":555,"num_read_kb":40133,"num_write":1081,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.579113+0000","last_change":"2024-09-12T18:02:13.579113+0000","last_active":"2024-09-12T18:02:13.579113+0000","last_peered":"2024-09-12T18:02:13.579113+0000","last_clean":"2024-09-12T18:02:13.579113+0000","last_became_active":"2024-09-12T17:23:44.150912+0000","last_became_peered":"2024-09-12T17:23:44.150912+0000","last_unstale":"2024-09-12T18:02:13.579113+0000","last_undegraded":"2024-09-12T18:02:13.579113+0000","last_fullsized":"2024-09-12T18:02:13.579113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:13.579019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:13.579019+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.579019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:58.259163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"261'116","reported_seq":650,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.283540+0000","last_change":"2024-09-12T18:02:21.283472+0000","last_active":"2024-09-12T18:02:21.283540+0000","last_peered":"2024-09-12T18:02:21.283540+0000","last_clean":"2024-09-12T18:02:21.283540+0000","last_became_active":"2024-09-12T17:23:46.155516+0000","last_became_peered":"2024-09-12T17:23:46.155516+0000","last_unstale":"2024-09-12T18:02:21.283540+0000","last_undegraded":"2024-09-12T18:02:21.283540+0000","last_fullsized":"2024-09-12T18:02:21.283540+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'116","last_scrub_stamp":"2024-09-12T18:02:21.283360+0000","last_deep_scrub":"261'116","last_deep_scrub_stamp":"2024-09-12T18:02:21.283360+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.283360+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:06.535901+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":92,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.131315+0000","last_change":"2024-09-12T18:02:14.131263+0000","last_active":"2024-09-12T18:02:14.131315+0000","last_peered":"2024-09-12T18:02:14.131315+0000","last_clean":"2024-09-12T18:02:14.131315+0000","last_became_active":"2024-09-12T17:23:48.170462+0000","last_became_peered":"2024-09-12T17:23:48.170462+0000","last_unstale":"2024-09-12T18:02:14.131315+0000","last_undegraded":"2024-09-12T18:02:14.131315+0000","last_fullsized":"2024-09-12T18:02:14.131315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:14.131174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:14.131174+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.131174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:21.306321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":664,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.164657+0000","last_change":"2024-09-12T18:02:31.164597+0000","last_active":"2024-09-12T18:02:31.164657+0000","last_peered":"2024-09-12T18:02:31.164657+0000","last_clean":"2024-09-12T18:02:31.164657+0000","last_became_active":"2024-09-12T17:23:50.186526+0000","last_became_peered":"2024-09-12T17:23:50.186526+0000","last_unstale":"2024-09-12T18:02:31.164657+0000","last_undegraded":"2024-09-12T18:02:31.164657+0000","last_fullsized":"2024-09-12T18:02:31.164657+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'122","last_scrub_stamp":"2024-09-12T18:02:31.164513+0000","last_deep_scrub":"261'122","last_deep_scrub_stamp":"2024-09-12T18:02:31.164513+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.164513+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:43.441056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":247,"num_write":303,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"261'542","reported_seq":2265,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.073021+0000","last_change":"2024-09-12T18:02:03.073021+0000","last_active":"2024-09-12T18:02:03.073021+0000","last_peered":"2024-09-12T18:02:03.073021+0000","last_clean":"2024-09-12T18:02:03.073021+0000","last_became_active":"2024-09-12T17:23:42.151735+0000","last_became_peered":"2024-09-12T17:23:42.151735+0000","last_unstale":"2024-09-12T18:02:03.073021+0000","last_undegraded":"2024-09-12T18:02:03.073021+0000","last_fullsized":"2024-09-12T18:02:03.073021+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'542","last_scrub_stamp":"2024-09-12T18:02:03.072918+0000","last_deep_scrub":"261'542","last_deep_scrub_stamp":"2024-09-12T18:02:03.072918+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.072918+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:38.792420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2982,"num_read_kb":2809,"num_write":660,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"261'324","reported_seq":921,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.273198+0000","last_change":"2024-09-12T18:01:59.273198+0000","last_active":"2024-09-12T18:01:59.273198+0000","last_peered":"2024-09-12T18:01:59.273198+0000","last_clean":"2024-09-12T18:01:59.273198+0000","last_became_active":"2024-09-12T17:23:40.712386+0000","last_became_peered":"2024-09-12T17:23:40.712386+0000","last_unstale":"2024-09-12T18:01:59.273198+0000","last_undegraded":"2024-09-12T18:01:59.273198+0000","last_fullsized":"2024-09-12T18:01:59.273198+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'324","last_scrub_stamp":"2024-09-12T18:01:59.273097+0000","last_deep_scrub":"261'324","last_deep_scrub_stamp":"2024-09-12T18:01:59.273097+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.273097+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:24.760087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":415,"num_read_kb":6504,"num_write":991,"num_write_kb":34893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":521,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.011936+0000","last_change":"2024-09-12T18:01:55.011936+0000","last_active":"2024-09-12T18:01:55.011936+0000","last_peered":"2024-09-12T18:01:55.011936+0000","last_clean":"2024-09-12T18:01:55.011936+0000","last_became_active":"2024-09-12T17:23:31.681209+0000","last_became_peered":"2024-09-12T17:23:31.681209+0000","last_unstale":"2024-09-12T18:01:55.011936+0000","last_undegraded":"2024-09-12T18:01:55.011936+0000","last_fullsized":"2024-09-12T18:01:55.011936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:55.011864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:55.011864+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.011864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:54.403724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056110600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.613324+0000","last_change":"2024-09-12T18:02:12.613324+0000","last_active":"2024-09-12T18:02:12.613324+0000","last_peered":"2024-09-12T18:02:12.613324+0000","last_clean":"2024-09-12T18:02:12.613324+0000","last_became_active":"2024-09-12T17:23:44.148035+0000","last_became_peered":"2024-09-12T17:23:44.148035+0000","last_unstale":"2024-09-12T18:02:12.613324+0000","last_undegraded":"2024-09-12T18:02:12.613324+0000","last_fullsized":"2024-09-12T18:02:12.613324+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:12.613224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:12.613224+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.613224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:09.496521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"261'571","reported_seq":1223,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.627975+0000","last_change":"2024-09-12T18:02:15.627975+0000","last_active":"2024-09-12T18:02:15.627975+0000","last_peered":"2024-09-12T18:02:15.627975+0000","last_clean":"2024-09-12T18:02:15.627975+0000","last_became_active":"2024-09-12T17:23:46.151649+0000","last_became_peered":"2024-09-12T17:23:46.151649+0000","last_unstale":"2024-09-12T18:02:15.627975+0000","last_undegraded":"2024-09-12T18:02:15.627975+0000","last_fullsized":"2024-09-12T18:02:15.627975+0000","mapping_epoch":29,"log_start":"261'500","ondisk_log_start":"261'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'571","last_scrub_stamp":"2024-09-12T18:02:15.627874+0000","last_deep_scrub":"261'571","last_deep_scrub_stamp":"2024-09-12T18:02:15.627874+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.627874+0000","objects_scrubbed":10,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:19.245704+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91231,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1527,"num_read_kb":2702,"num_write":1958,"num_write_kb":1787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":502154,"num_omap_keys":1138,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.172021+0000","last_change":"2024-09-12T18:02:23.172021+0000","last_active":"2024-09-12T18:02:23.172021+0000","last_peered":"2024-09-12T18:02:23.172021+0000","last_clean":"2024-09-12T18:02:23.172021+0000","last_became_active":"2024-09-12T17:23:48.166196+0000","last_became_peered":"2024-09-12T17:23:48.166196+0000","last_unstale":"2024-09-12T18:02:23.172021+0000","last_undegraded":"2024-09-12T18:02:23.172021+0000","last_fullsized":"2024-09-12T18:02:23.172021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:23.171932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:23.171932+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.171932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:59.532011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"261'227","reported_seq":736,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.593807+0000","last_change":"2024-09-12T18:02:28.593807+0000","last_active":"2024-09-12T18:02:28.593807+0000","last_peered":"2024-09-12T18:02:28.593807+0000","last_clean":"2024-09-12T18:02:28.593807+0000","last_became_active":"2024-09-12T17:23:50.640185+0000","last_became_peered":"2024-09-12T17:23:50.640185+0000","last_unstale":"2024-09-12T18:02:28.593807+0000","last_undegraded":"2024-09-12T18:02:28.593807+0000","last_fullsized":"2024-09-12T18:02:28.593807+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'227","last_scrub_stamp":"2024-09-12T18:02:28.593705+0000","last_deep_scrub":"261'227","last_deep_scrub_stamp":"2024-09-12T18:02:28.593705+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.593705+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:08.171833+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":243,"num_write":513,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"261'511","reported_seq":2075,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.675785+0000","last_change":"2024-09-12T18:02:05.675785+0000","last_active":"2024-09-12T18:02:05.675785+0000","last_peered":"2024-09-12T18:02:05.675785+0000","last_clean":"2024-09-12T18:02:05.675785+0000","last_became_active":"2024-09-12T17:23:42.148578+0000","last_became_peered":"2024-09-12T17:23:42.148578+0000","last_unstale":"2024-09-12T18:02:05.675785+0000","last_undegraded":"2024-09-12T18:02:05.675785+0000","last_fullsized":"2024-09-12T18:02:05.675785+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'511","last_scrub_stamp":"2024-09-12T18:02:05.675698+0000","last_deep_scrub":"261'511","last_deep_scrub_stamp":"2024-09-12T18:02:05.675698+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.675698+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:16.683349+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2709,"num_read_kb":2501,"num_write":646,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"261'359","reported_seq":989,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.005174+0000","last_change":"2024-09-12T18:01:58.005174+0000","last_active":"2024-09-12T18:01:58.005174+0000","last_peered":"2024-09-12T18:01:58.005174+0000","last_clean":"2024-09-12T18:01:58.005174+0000","last_became_active":"2024-09-12T17:23:40.710780+0000","last_became_peered":"2024-09-12T17:23:40.710780+0000","last_unstale":"2024-09-12T18:01:58.005174+0000","last_undegraded":"2024-09-12T18:01:58.005174+0000","last_fullsized":"2024-09-12T18:01:58.005174+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'359","last_scrub_stamp":"2024-09-12T18:01:58.005070+0000","last_deep_scrub":"261'359","last_deep_scrub_stamp":"2024-09-12T18:01:58.005070+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.005070+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:48.684663+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":525,"num_write":1227,"num_write_kb":43788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":514,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.654264+0000","last_change":"2024-09-12T18:02:00.654264+0000","last_active":"2024-09-12T18:02:00.654264+0000","last_peered":"2024-09-12T18:02:00.654264+0000","last_clean":"2024-09-12T18:02:00.654264+0000","last_became_active":"2024-09-12T17:23:31.681155+0000","last_became_peered":"2024-09-12T17:23:31.681155+0000","last_unstale":"2024-09-12T18:02:00.654264+0000","last_undegraded":"2024-09-12T18:02:00.654264+0000","last_fullsized":"2024-09-12T18:02:00.654264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:00.654154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:00.654154+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.654154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:58.454140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00048562399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.149994+0000","last_change":"2024-09-12T18:02:08.149994+0000","last_active":"2024-09-12T18:02:08.149994+0000","last_peered":"2024-09-12T18:02:08.149994+0000","last_clean":"2024-09-12T18:02:08.149994+0000","last_became_active":"2024-09-12T17:23:44.147347+0000","last_became_peered":"2024-09-12T17:23:44.147347+0000","last_unstale":"2024-09-12T18:02:08.149994+0000","last_undegraded":"2024-09-12T18:02:08.149994+0000","last_fullsized":"2024-09-12T18:02:08.149994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:08.149901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:08.149901+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.149901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:21.117683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"261'157","reported_seq":713,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.048995+0000","last_change":"2024-09-12T18:02:17.048995+0000","last_active":"2024-09-12T18:02:17.048995+0000","last_peered":"2024-09-12T18:02:17.048995+0000","last_clean":"2024-09-12T18:02:17.048995+0000","last_became_active":"2024-09-12T17:23:46.241046+0000","last_became_peered":"2024-09-12T17:23:46.241046+0000","last_unstale":"2024-09-12T18:02:17.048995+0000","last_undegraded":"2024-09-12T18:02:17.048995+0000","last_fullsized":"2024-09-12T18:02:17.048995+0000","mapping_epoch":29,"log_start":"258'100","ondisk_log_start":"258'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'157","last_scrub_stamp":"2024-09-12T18:02:17.048897+0000","last_deep_scrub":"261'157","last_deep_scrub_stamp":"2024-09-12T18:02:17.048897+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.048897+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:15.742303+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":154,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"261'795","reported_seq":2353,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.142744+0000","last_change":"2024-09-12T18:02:27.142744+0000","last_active":"2024-09-12T18:02:27.142744+0000","last_peered":"2024-09-12T18:02:27.142744+0000","last_clean":"2024-09-12T18:02:27.142744+0000","last_became_active":"2024-09-12T17:23:48.173351+0000","last_became_peered":"2024-09-12T17:23:48.173351+0000","last_unstale":"2024-09-12T18:02:27.142744+0000","last_undegraded":"2024-09-12T18:02:27.142744+0000","last_fullsized":"2024-09-12T18:02:27.142744+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'795","last_scrub_stamp":"2024-09-12T18:02:27.142659+0000","last_deep_scrub":"261'795","last_deep_scrub_stamp":"2024-09-12T18:02:27.142659+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.142659+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:11.902738+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"261'106","reported_seq":602,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.396475+0000","last_change":"2024-09-12T18:02:34.396475+0000","last_active":"2024-09-12T18:02:34.396475+0000","last_peered":"2024-09-12T18:02:34.396475+0000","last_clean":"2024-09-12T18:02:34.396475+0000","last_became_active":"2024-09-12T17:23:50.639054+0000","last_became_peered":"2024-09-12T17:23:50.639054+0000","last_unstale":"2024-09-12T18:02:34.396475+0000","last_undegraded":"2024-09-12T18:02:34.396475+0000","last_fullsized":"2024-09-12T18:02:34.396475+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'106","last_scrub_stamp":"2024-09-12T18:02:34.396378+0000","last_deep_scrub":"261'106","last_deep_scrub_stamp":"2024-09-12T18:02:34.396378+0000","last_clean_scrub_stamp":"2024-09-12T18:02:34.396378+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:36.065703+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":220,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"261'498","reported_seq":2027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.237197+0000","last_change":"2024-09-12T18:02:07.237197+0000","last_active":"2024-09-12T18:02:07.237197+0000","last_peered":"2024-09-12T18:02:07.237197+0000","last_clean":"2024-09-12T18:02:07.237197+0000","last_became_active":"2024-09-12T17:23:42.148523+0000","last_became_peered":"2024-09-12T17:23:42.148523+0000","last_unstale":"2024-09-12T18:02:07.237197+0000","last_undegraded":"2024-09-12T18:02:07.237197+0000","last_fullsized":"2024-09-12T18:02:07.237197+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'498","last_scrub_stamp":"2024-09-12T18:02:07.237103+0000","last_deep_scrub":"261'498","last_deep_scrub_stamp":"2024-09-12T18:02:07.237103+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.237103+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:26.038707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2488,"num_read_kb":2312,"num_write":602,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":892,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"261'378","reported_seq":1103,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.174118+0000","last_change":"2024-09-12T18:01:57.174066+0000","last_active":"2024-09-12T18:01:57.174118+0000","last_peered":"2024-09-12T18:01:57.174118+0000","last_clean":"2024-09-12T18:01:57.174118+0000","last_became_active":"2024-09-12T17:23:40.709077+0000","last_became_peered":"2024-09-12T17:23:40.709077+0000","last_unstale":"2024-09-12T18:01:57.174118+0000","last_undegraded":"2024-09-12T18:01:57.174118+0000","last_fullsized":"2024-09-12T18:01:57.174118+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'378","last_scrub_stamp":"2024-09-12T18:01:57.173981+0000","last_deep_scrub":"261'378","last_deep_scrub_stamp":"2024-09-12T18:01:57.173981+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.173981+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:35.684048+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8154045,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":687,"num_read_kb":135818,"num_write":1222,"num_write_kb":56746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":521,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.952985+0000","last_change":"2024-09-12T18:01:56.952897+0000","last_active":"2024-09-12T18:01:56.952985+0000","last_peered":"2024-09-12T18:01:56.952985+0000","last_clean":"2024-09-12T18:01:56.952985+0000","last_became_active":"2024-09-12T17:23:31.588526+0000","last_became_peered":"2024-09-12T17:23:31.588526+0000","last_unstale":"2024-09-12T18:01:56.952985+0000","last_undegraded":"2024-09-12T18:01:56.952985+0000","last_fullsized":"2024-09-12T18:01:56.952985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:56.952784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:56.952784+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.952784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:58.755509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055923099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.176243+0000","last_change":"2024-09-12T18:02:17.176243+0000","last_active":"2024-09-12T18:02:17.176243+0000","last_peered":"2024-09-12T18:02:17.176243+0000","last_clean":"2024-09-12T18:02:17.176243+0000","last_became_active":"2024-09-12T17:23:44.147594+0000","last_became_peered":"2024-09-12T17:23:44.147594+0000","last_unstale":"2024-09-12T18:02:17.176243+0000","last_undegraded":"2024-09-12T18:02:17.176243+0000","last_fullsized":"2024-09-12T18:02:17.176243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:17.176158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:17.176158+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.176158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:58.923912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"261'102","reported_seq":634,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.203083+0000","last_change":"2024-09-12T18:02:20.203083+0000","last_active":"2024-09-12T18:02:20.203083+0000","last_peered":"2024-09-12T18:02:20.203083+0000","last_clean":"2024-09-12T18:02:20.203083+0000","last_became_active":"2024-09-12T17:23:46.151335+0000","last_became_peered":"2024-09-12T17:23:46.151335+0000","last_unstale":"2024-09-12T18:02:20.203083+0000","last_undegraded":"2024-09-12T18:02:20.203083+0000","last_fullsized":"2024-09-12T18:02:20.203083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'102","last_scrub_stamp":"2024-09-12T18:02:20.202996+0000","last_deep_scrub":"261'102","last_deep_scrub_stamp":"2024-09-12T18:02:20.202996+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.202996+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:35.603053+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"261'808","reported_seq":2596,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.327575+0000","last_change":"2024-09-12T18:02:28.327575+0000","last_active":"2024-09-12T18:02:28.327575+0000","last_peered":"2024-09-12T18:02:28.327575+0000","last_clean":"2024-09-12T18:02:28.327575+0000","last_became_active":"2024-09-12T17:23:48.167739+0000","last_became_peered":"2024-09-12T17:23:48.167739+0000","last_unstale":"2024-09-12T18:02:28.327575+0000","last_undegraded":"2024-09-12T18:02:28.327575+0000","last_fullsized":"2024-09-12T18:02:28.327575+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'808","last_scrub_stamp":"2024-09-12T18:02:28.327479+0000","last_deep_scrub":"261'808","last_deep_scrub_stamp":"2024-09-12T18:02:28.327479+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.327479+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:39.277808+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"261'315","reported_seq":842,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.571415+0000","last_change":"2024-09-12T18:02:27.571415+0000","last_active":"2024-09-12T18:02:27.571415+0000","last_peered":"2024-09-12T18:02:27.571415+0000","last_clean":"2024-09-12T18:02:27.571415+0000","last_became_active":"2024-09-12T17:23:50.179127+0000","last_became_peered":"2024-09-12T17:23:50.179127+0000","last_unstale":"2024-09-12T18:02:27.571415+0000","last_undegraded":"2024-09-12T18:02:27.571415+0000","last_fullsized":"2024-09-12T18:02:27.571415+0000","mapping_epoch":33,"log_start":"261'300","ondisk_log_start":"261'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'315","last_scrub_stamp":"2024-09-12T18:02:27.571322+0000","last_deep_scrub":"261'315","last_deep_scrub_stamp":"2024-09-12T18:02:27.571322+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.571322+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:01.014783+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":442,"num_write":705,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"261'1032","reported_seq":2767,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.065931+0000","last_change":"2024-09-12T18:02:02.065931+0000","last_active":"2024-09-12T18:02:02.065931+0000","last_peered":"2024-09-12T18:02:02.065931+0000","last_clean":"2024-09-12T18:02:02.065931+0000","last_became_active":"2024-09-12T17:23:42.145139+0000","last_became_peered":"2024-09-12T17:23:42.145139+0000","last_unstale":"2024-09-12T18:02:02.065931+0000","last_undegraded":"2024-09-12T18:02:02.065931+0000","last_fullsized":"2024-09-12T18:02:02.065931+0000","mapping_epoch":25,"log_start":"261'1000","ondisk_log_start":"261'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1032","last_scrub_stamp":"2024-09-12T18:02:02.065838+0000","last_deep_scrub":"261'1032","last_deep_scrub_stamp":"2024-09-12T18:02:02.065838+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.065838+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":1000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:57.748014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4954,"num_read_kb":4437,"num_write":1455,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"261'378","reported_seq":1034,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.770937+0000","last_change":"2024-09-12T18:01:56.770846+0000","last_active":"2024-09-12T18:01:56.770937+0000","last_peered":"2024-09-12T18:01:56.770937+0000","last_clean":"2024-09-12T18:01:56.770937+0000","last_became_active":"2024-09-12T17:23:40.712974+0000","last_became_peered":"2024-09-12T17:23:40.712974+0000","last_unstale":"2024-09-12T18:01:56.770937+0000","last_undegraded":"2024-09-12T18:01:56.770937+0000","last_fullsized":"2024-09-12T18:01:56.770937+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'378","last_scrub_stamp":"2024-09-12T18:01:56.770724+0000","last_deep_scrub":"261'378","last_deep_scrub_stamp":"2024-09-12T18:01:56.770724+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.770724+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:19.994907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048959,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":103148,"num_write":1174,"num_write_kb":43429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.062048+0000","last_change":"2024-09-12T18:02:01.061986+0000","last_active":"2024-09-12T18:02:01.062048+0000","last_peered":"2024-09-12T18:02:01.062048+0000","last_clean":"2024-09-12T18:02:01.062048+0000","last_became_active":"2024-09-12T17:23:31.588266+0000","last_became_peered":"2024-09-12T17:23:31.588266+0000","last_unstale":"2024-09-12T18:02:01.062048+0000","last_undegraded":"2024-09-12T18:02:01.062048+0000","last_fullsized":"2024-09-12T18:02:01.062048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:01.061897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:01.061897+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.061897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:32.592640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051630700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.243385+0000","last_change":"2024-09-12T18:02:19.243385+0000","last_active":"2024-09-12T18:02:19.243385+0000","last_peered":"2024-09-12T18:02:19.243385+0000","last_clean":"2024-09-12T18:02:19.243385+0000","last_became_active":"2024-09-12T17:23:44.149649+0000","last_became_peered":"2024-09-12T17:23:44.149649+0000","last_unstale":"2024-09-12T18:02:19.243385+0000","last_undegraded":"2024-09-12T18:02:19.243385+0000","last_fullsized":"2024-09-12T18:02:19.243385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:19.243293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:19.243293+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.243293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:02.359442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"261'699","reported_seq":1407,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.714172+0000","last_change":"2024-09-12T18:02:19.714172+0000","last_active":"2024-09-12T18:02:19.714172+0000","last_peered":"2024-09-12T18:02:19.714172+0000","last_clean":"2024-09-12T18:02:19.714172+0000","last_became_active":"2024-09-12T17:23:46.241681+0000","last_became_peered":"2024-09-12T17:23:46.241681+0000","last_unstale":"2024-09-12T18:02:19.714172+0000","last_undegraded":"2024-09-12T18:02:19.714172+0000","last_fullsized":"2024-09-12T18:02:19.714172+0000","mapping_epoch":29,"log_start":"261'600","ondisk_log_start":"261'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'699","last_scrub_stamp":"2024-09-12T18:02:19.714079+0000","last_deep_scrub":"261'699","last_deep_scrub_stamp":"2024-09-12T18:02:19.714079+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.714079+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":600,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:03.530890+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155444,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1250,"num_read_kb":2999,"num_write":1014,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.278596+0000","last_change":"2024-09-12T18:02:27.278596+0000","last_active":"2024-09-12T18:02:27.278596+0000","last_peered":"2024-09-12T18:02:27.278596+0000","last_clean":"2024-09-12T18:02:27.278596+0000","last_became_active":"2024-09-12T17:23:48.170687+0000","last_became_peered":"2024-09-12T17:23:48.170687+0000","last_unstale":"2024-09-12T18:02:27.278596+0000","last_undegraded":"2024-09-12T18:02:27.278596+0000","last_fullsized":"2024-09-12T18:02:27.278596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:27.278501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:27.278501+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.278501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:14.871907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"261'138","reported_seq":678,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.156061+0000","last_change":"2024-09-12T18:02:30.156061+0000","last_active":"2024-09-12T18:02:30.156061+0000","last_peered":"2024-09-12T18:02:30.156061+0000","last_clean":"2024-09-12T18:02:30.156061+0000","last_became_active":"2024-09-12T17:23:50.188042+0000","last_became_peered":"2024-09-12T17:23:50.188042+0000","last_unstale":"2024-09-12T18:02:30.156061+0000","last_undegraded":"2024-09-12T18:02:30.156061+0000","last_fullsized":"2024-09-12T18:02:30.156061+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'138","last_scrub_stamp":"2024-09-12T18:02:30.155950+0000","last_deep_scrub":"261'138","last_deep_scrub_stamp":"2024-09-12T18:02:30.155950+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.155950+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:45.806522+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":351,"num_read_kb":302,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"261'130","reported_seq":679,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.707739+0000","last_change":"2024-09-12T18:02:32.707739+0000","last_active":"2024-09-12T18:02:32.707739+0000","last_peered":"2024-09-12T18:02:32.707739+0000","last_clean":"2024-09-12T18:02:32.707739+0000","last_became_active":"2024-09-12T17:23:50.189955+0000","last_became_peered":"2024-09-12T17:23:50.189955+0000","last_unstale":"2024-09-12T18:02:32.707739+0000","last_undegraded":"2024-09-12T18:02:32.707739+0000","last_fullsized":"2024-09-12T18:02:32.707739+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'130","last_scrub_stamp":"2024-09-12T18:02:32.707641+0000","last_deep_scrub":"261'130","last_deep_scrub_stamp":"2024-09-12T18:02:32.707641+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.707641+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:53.507529+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":232,"num_write":318,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"261'332","reported_seq":1807,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.103984+0000","last_change":"2024-09-12T18:02:05.103984+0000","last_active":"2024-09-12T18:02:05.103984+0000","last_peered":"2024-09-12T18:02:05.103984+0000","last_clean":"2024-09-12T18:02:05.103984+0000","last_became_active":"2024-09-12T17:23:42.138899+0000","last_became_peered":"2024-09-12T17:23:42.138899+0000","last_unstale":"2024-09-12T18:02:05.103984+0000","last_undegraded":"2024-09-12T18:02:05.103984+0000","last_fullsized":"2024-09-12T18:02:05.103984+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'332","last_scrub_stamp":"2024-09-12T18:02:05.103884+0000","last_deep_scrub":"261'332","last_deep_scrub_stamp":"2024-09-12T18:02:05.103884+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.103884+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:33.934674+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1873,"num_read_kb":1826,"num_write":350,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"261'371","reported_seq":1012,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.041826+0000","last_change":"2024-09-12T18:01:59.041826+0000","last_active":"2024-09-12T18:01:59.041826+0000","last_peered":"2024-09-12T18:01:59.041826+0000","last_clean":"2024-09-12T18:01:59.041826+0000","last_became_active":"2024-09-12T17:23:40.709219+0000","last_became_peered":"2024-09-12T17:23:40.709219+0000","last_unstale":"2024-09-12T18:01:59.041826+0000","last_undegraded":"2024-09-12T18:01:59.041826+0000","last_fullsized":"2024-09-12T18:01:59.041826+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'371","last_scrub_stamp":"2024-09-12T18:01:59.041598+0000","last_deep_scrub":"261'371","last_deep_scrub_stamp":"2024-09-12T18:01:59.041598+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.041598+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:07.760220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":4301,"num_write":1267,"num_write_kb":9304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.977761+0000","last_change":"2024-09-12T18:02:09.977761+0000","last_active":"2024-09-12T18:02:09.977761+0000","last_peered":"2024-09-12T18:02:09.977761+0000","last_clean":"2024-09-12T18:02:09.977761+0000","last_became_active":"2024-09-12T17:23:44.151175+0000","last_became_peered":"2024-09-12T17:23:44.151175+0000","last_unstale":"2024-09-12T18:02:09.977761+0000","last_undegraded":"2024-09-12T18:02:09.977761+0000","last_fullsized":"2024-09-12T18:02:09.977761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:09.977657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:09.977657+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.977657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:18.070048+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"261'281","reported_seq":849,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.329809+0000","last_change":"2024-09-12T18:02:22.329809+0000","last_active":"2024-09-12T18:02:22.329809+0000","last_peered":"2024-09-12T18:02:22.329809+0000","last_clean":"2024-09-12T18:02:22.329809+0000","last_became_active":"2024-09-12T17:23:46.150505+0000","last_became_peered":"2024-09-12T17:23:46.150505+0000","last_unstale":"2024-09-12T18:02:22.329809+0000","last_undegraded":"2024-09-12T18:02:22.329809+0000","last_fullsized":"2024-09-12T18:02:22.329809+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'281","last_scrub_stamp":"2024-09-12T18:02:22.329716+0000","last_deep_scrub":"261'281","last_deep_scrub_stamp":"2024-09-12T18:02:22.329716+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.329716+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:15.914502+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80053,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":479,"num_read_kb":1186,"num_write":396,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.373878+0000","last_change":"2024-09-12T18:02:33.373878+0000","last_active":"2024-09-12T18:02:33.373878+0000","last_peered":"2024-09-12T18:02:33.373878+0000","last_clean":"2024-09-12T18:02:33.373878+0000","last_became_active":"2024-09-12T17:23:48.167911+0000","last_became_peered":"2024-09-12T17:23:48.167911+0000","last_unstale":"2024-09-12T18:02:33.373878+0000","last_undegraded":"2024-09-12T18:02:33.373878+0000","last_fullsized":"2024-09-12T18:02:33.373878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:33.373775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:33.373775+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.373775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:15.476740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"261'95","reported_seq":593,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:37.489717+0000","last_change":"2024-09-12T18:02:37.489717+0000","last_active":"2024-09-12T18:02:37.489717+0000","last_peered":"2024-09-12T18:02:37.489717+0000","last_clean":"2024-09-12T18:02:37.489717+0000","last_became_active":"2024-09-12T17:23:50.183400+0000","last_became_peered":"2024-09-12T17:23:50.183400+0000","last_unstale":"2024-09-12T18:02:37.489717+0000","last_undegraded":"2024-09-12T18:02:37.489717+0000","last_fullsized":"2024-09-12T18:02:37.489717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'95","last_scrub_stamp":"2024-09-12T18:02:37.489626+0000","last_deep_scrub":"261'95","last_deep_scrub_stamp":"2024-09-12T18:02:37.489626+0000","last_clean_scrub_stamp":"2024-09-12T18:02:37.489626+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:39.081170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":128,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"261'480","reported_seq":1894,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.032918+0000","last_change":"2024-09-12T18:02:08.032918+0000","last_active":"2024-09-12T18:02:08.032918+0000","last_peered":"2024-09-12T18:02:08.032918+0000","last_clean":"2024-09-12T18:02:08.032918+0000","last_became_active":"2024-09-12T17:23:42.137988+0000","last_became_peered":"2024-09-12T17:23:42.137988+0000","last_unstale":"2024-09-12T18:02:08.032918+0000","last_undegraded":"2024-09-12T18:02:08.032918+0000","last_fullsized":"2024-09-12T18:02:08.032918+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'480","last_scrub_stamp":"2024-09-12T18:02:08.032812+0000","last_deep_scrub":"261'480","last_deep_scrub_stamp":"2024-09-12T18:02:08.032812+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.032812+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:49.513754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2384,"num_read_kb":2190,"num_write":595,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"261'377","reported_seq":1024,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.757547+0000","last_change":"2024-09-12T18:02:05.757480+0000","last_active":"2024-09-12T18:02:05.757547+0000","last_peered":"2024-09-12T18:02:05.757547+0000","last_clean":"2024-09-12T18:02:05.757547+0000","last_became_active":"2024-09-12T17:23:40.710425+0000","last_became_peered":"2024-09-12T17:23:40.710425+0000","last_unstale":"2024-09-12T18:02:05.757547+0000","last_undegraded":"2024-09-12T18:02:05.757547+0000","last_fullsized":"2024-09-12T18:02:05.757547+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'377","last_scrub_stamp":"2024-09-12T18:02:05.757380+0000","last_deep_scrub":"261'377","last_deep_scrub_stamp":"2024-09-12T18:02:05.757380+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.757380+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:11.058871+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6598189,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":49330,"num_write":1152,"num_write_kb":37186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.276322+0000","last_change":"2024-09-12T18:02:15.276322+0000","last_active":"2024-09-12T18:02:15.276322+0000","last_peered":"2024-09-12T18:02:15.276322+0000","last_clean":"2024-09-12T18:02:15.276322+0000","last_became_active":"2024-09-12T17:23:44.148078+0000","last_became_peered":"2024-09-12T17:23:44.148078+0000","last_unstale":"2024-09-12T18:02:15.276322+0000","last_undegraded":"2024-09-12T18:02:15.276322+0000","last_fullsized":"2024-09-12T18:02:15.276322+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:15.276227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:15.276227+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.276227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:44.747010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"261'45","reported_seq":540,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.563257+0000","last_change":"2024-09-12T18:02:17.563257+0000","last_active":"2024-09-12T18:02:17.563257+0000","last_peered":"2024-09-12T18:02:17.563257+0000","last_clean":"2024-09-12T18:02:17.563257+0000","last_became_active":"2024-09-12T17:23:46.151258+0000","last_became_peered":"2024-09-12T17:23:46.151258+0000","last_unstale":"2024-09-12T18:02:17.563257+0000","last_undegraded":"2024-09-12T18:02:17.563257+0000","last_fullsized":"2024-09-12T18:02:17.563257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'45","last_scrub_stamp":"2024-09-12T18:02:17.563159+0000","last_deep_scrub":"261'45","last_deep_scrub_stamp":"2024-09-12T18:02:17.563159+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.563159+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:26.970725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":25,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.738619+0000","last_change":"2024-09-12T18:02:26.738619+0000","last_active":"2024-09-12T18:02:26.738619+0000","last_peered":"2024-09-12T18:02:26.738619+0000","last_clean":"2024-09-12T18:02:26.738619+0000","last_became_active":"2024-09-12T17:23:48.173781+0000","last_became_peered":"2024-09-12T17:23:48.173781+0000","last_unstale":"2024-09-12T18:02:26.738619+0000","last_undegraded":"2024-09-12T18:02:26.738619+0000","last_fullsized":"2024-09-12T18:02:26.738619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:26.738530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:26.738530+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.738530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:58.104164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"261'167","reported_seq":677,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.678537+0000","last_change":"2024-09-12T18:02:30.678537+0000","last_active":"2024-09-12T18:02:30.678537+0000","last_peered":"2024-09-12T18:02:30.678537+0000","last_clean":"2024-09-12T18:02:30.678537+0000","last_became_active":"2024-09-12T17:23:50.183784+0000","last_became_peered":"2024-09-12T17:23:50.183784+0000","last_unstale":"2024-09-12T18:02:30.678537+0000","last_undegraded":"2024-09-12T18:02:30.678537+0000","last_fullsized":"2024-09-12T18:02:30.678537+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'167","last_scrub_stamp":"2024-09-12T18:02:30.678426+0000","last_deep_scrub":"261'167","last_deep_scrub_stamp":"2024-09-12T18:02:30.678426+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.678426+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:17.172239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":278,"num_read_kb":278,"num_write":359,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"261'419","reported_seq":1962,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.192402+0000","last_change":"2024-09-12T18:02:06.192402+0000","last_active":"2024-09-12T18:02:06.192402+0000","last_peered":"2024-09-12T18:02:06.192402+0000","last_clean":"2024-09-12T18:02:06.192402+0000","last_became_active":"2024-09-12T17:23:42.146703+0000","last_became_peered":"2024-09-12T17:23:42.146703+0000","last_unstale":"2024-09-12T18:02:06.192402+0000","last_undegraded":"2024-09-12T18:02:06.192402+0000","last_fullsized":"2024-09-12T18:02:06.192402+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'419","last_scrub_stamp":"2024-09-12T18:02:06.192317+0000","last_deep_scrub":"261'419","last_deep_scrub_stamp":"2024-09-12T18:02:06.192317+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.192317+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:52.444010+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2240,"num_read_kb":2131,"num_write":479,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":501,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"261'293","reported_seq":959,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.316196+0000","last_change":"2024-09-12T18:02:01.316120+0000","last_active":"2024-09-12T18:02:01.316196+0000","last_peered":"2024-09-12T18:02:01.316196+0000","last_clean":"2024-09-12T18:02:01.316196+0000","last_became_active":"2024-09-12T17:23:40.704278+0000","last_became_peered":"2024-09-12T17:23:40.704278+0000","last_unstale":"2024-09-12T18:02:01.316196+0000","last_undegraded":"2024-09-12T18:02:01.316196+0000","last_fullsized":"2024-09-12T18:02:01.316196+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'293","last_scrub_stamp":"2024-09-12T18:02:01.316032+0000","last_deep_scrub":"261'293","last_deep_scrub_stamp":"2024-09-12T18:02:01.316032+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.316032+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:16.068553+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3045160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":96519,"num_write":927,"num_write_kb":33057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.706883+0000","last_change":"2024-09-12T18:02:17.706883+0000","last_active":"2024-09-12T18:02:17.706883+0000","last_peered":"2024-09-12T18:02:17.706883+0000","last_clean":"2024-09-12T18:02:17.706883+0000","last_became_active":"2024-09-12T17:23:44.149838+0000","last_became_peered":"2024-09-12T17:23:44.149838+0000","last_unstale":"2024-09-12T18:02:17.706883+0000","last_undegraded":"2024-09-12T18:02:17.706883+0000","last_fullsized":"2024-09-12T18:02:17.706883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:17.706800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:17.706800+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.706800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:08.623448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"261'306","reported_seq":890,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.324912+0000","last_change":"2024-09-12T18:02:23.324912+0000","last_active":"2024-09-12T18:02:23.324912+0000","last_peered":"2024-09-12T18:02:23.324912+0000","last_clean":"2024-09-12T18:02:23.324912+0000","last_became_active":"2024-09-12T17:23:46.150528+0000","last_became_peered":"2024-09-12T17:23:46.150528+0000","last_unstale":"2024-09-12T18:02:23.324912+0000","last_undegraded":"2024-09-12T18:02:23.324912+0000","last_fullsized":"2024-09-12T18:02:23.324912+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'306","last_scrub_stamp":"2024-09-12T18:02:23.324823+0000","last_deep_scrub":"261'306","last_deep_scrub_stamp":"2024-09-12T18:02:23.324823+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.324823+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:51.330358+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45198,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":1096,"num_write":398,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.097012+0000","last_change":"2024-09-12T18:02:15.097012+0000","last_active":"2024-09-12T18:02:15.097012+0000","last_peered":"2024-09-12T18:02:15.097012+0000","last_clean":"2024-09-12T18:02:15.097012+0000","last_became_active":"2024-09-12T17:23:48.171031+0000","last_became_peered":"2024-09-12T17:23:48.171031+0000","last_unstale":"2024-09-12T18:02:15.097012+0000","last_undegraded":"2024-09-12T18:02:15.097012+0000","last_fullsized":"2024-09-12T18:02:15.097012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:15.096890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:15.096890+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.096890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:37.985935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"261'155","reported_seq":666,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.172024+0000","last_change":"2024-09-12T18:02:34.172024+0000","last_active":"2024-09-12T18:02:34.172024+0000","last_peered":"2024-09-12T18:02:34.172024+0000","last_clean":"2024-09-12T18:02:34.172024+0000","last_became_active":"2024-09-12T17:23:50.185846+0000","last_became_peered":"2024-09-12T17:23:50.185846+0000","last_unstale":"2024-09-12T18:02:34.172024+0000","last_undegraded":"2024-09-12T18:02:34.172024+0000","last_fullsized":"2024-09-12T18:02:34.172024+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'155","last_scrub_stamp":"2024-09-12T18:02:34.171906+0000","last_deep_scrub":"261'155","last_deep_scrub_stamp":"2024-09-12T18:02:34.171906+0000","last_clean_scrub_stamp":"2024-09-12T18:02:34.171906+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:47.312682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":366,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"261'794","reported_seq":2414,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.273399+0000","last_change":"2024-09-12T18:02:11.273399+0000","last_active":"2024-09-12T18:02:11.273399+0000","last_peered":"2024-09-12T18:02:11.273399+0000","last_clean":"2024-09-12T18:02:11.273399+0000","last_became_active":"2024-09-12T17:23:42.154925+0000","last_became_peered":"2024-09-12T17:23:42.154925+0000","last_unstale":"2024-09-12T18:02:11.273399+0000","last_undegraded":"2024-09-12T18:02:11.273399+0000","last_fullsized":"2024-09-12T18:02:11.273399+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'794","last_scrub_stamp":"2024-09-12T18:02:11.273304+0000","last_deep_scrub":"261'794","last_deep_scrub_stamp":"2024-09-12T18:02:11.273304+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.273304+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:14.231877+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3893,"num_read_kb":3543,"num_write":1032,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"261'364","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:54.755889+0000","last_change":"2024-09-12T18:01:54.755805+0000","last_active":"2024-09-12T18:01:54.755889+0000","last_peered":"2024-09-12T18:01:54.755889+0000","last_clean":"2024-09-12T18:01:54.755889+0000","last_became_active":"2024-09-12T17:23:40.708670+0000","last_became_peered":"2024-09-12T17:23:40.708670+0000","last_unstale":"2024-09-12T18:01:54.755889+0000","last_undegraded":"2024-09-12T18:01:54.755889+0000","last_fullsized":"2024-09-12T18:01:54.755889+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'364","last_scrub_stamp":"2024-09-12T18:01:54.755697+0000","last_deep_scrub":"261'364","last_deep_scrub_stamp":"2024-09-12T18:01:54.755697+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.755697+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:28.461074+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306433,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":1950,"num_write":1111,"num_write_kb":27043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.155600+0000","last_change":"2024-09-12T18:02:12.155600+0000","last_active":"2024-09-12T18:02:12.155600+0000","last_peered":"2024-09-12T18:02:12.155600+0000","last_clean":"2024-09-12T18:02:12.155600+0000","last_became_active":"2024-09-12T17:23:44.149907+0000","last_became_peered":"2024-09-12T17:23:44.149907+0000","last_unstale":"2024-09-12T18:02:12.155600+0000","last_undegraded":"2024-09-12T18:02:12.155600+0000","last_fullsized":"2024-09-12T18:02:12.155600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:12.155514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:12.155514+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.155514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:15.472208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"261'280","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.813283+0000","last_change":"2024-09-12T18:02:22.813283+0000","last_active":"2024-09-12T18:02:22.813283+0000","last_peered":"2024-09-12T18:02:22.813283+0000","last_clean":"2024-09-12T18:02:22.813283+0000","last_became_active":"2024-09-12T17:23:46.149987+0000","last_became_peered":"2024-09-12T17:23:46.149987+0000","last_unstale":"2024-09-12T18:02:22.813283+0000","last_undegraded":"2024-09-12T18:02:22.813283+0000","last_fullsized":"2024-09-12T18:02:22.813283+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'280","last_scrub_stamp":"2024-09-12T18:02:22.813122+0000","last_deep_scrub":"261'280","last_deep_scrub_stamp":"2024-09-12T18:02:22.813122+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.813122+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:06.437239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46832,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":1121,"num_write":390,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.705411+0000","last_change":"2024-09-12T18:02:31.705411+0000","last_active":"2024-09-12T18:02:31.705411+0000","last_peered":"2024-09-12T18:02:31.705411+0000","last_clean":"2024-09-12T18:02:31.705411+0000","last_became_active":"2024-09-12T17:23:48.169308+0000","last_became_peered":"2024-09-12T17:23:48.169308+0000","last_unstale":"2024-09-12T18:02:31.705411+0000","last_undegraded":"2024-09-12T18:02:31.705411+0000","last_fullsized":"2024-09-12T18:02:31.705411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:31.705317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:31.705317+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.705317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:15.786791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"261'807","reported_seq":2262,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.135687+0000","last_change":"2024-09-12T18:02:06.135687+0000","last_active":"2024-09-12T18:02:06.135687+0000","last_peered":"2024-09-12T18:02:06.135687+0000","last_clean":"2024-09-12T18:02:06.135687+0000","last_became_active":"2024-09-12T17:23:42.148412+0000","last_became_peered":"2024-09-12T17:23:42.148412+0000","last_unstale":"2024-09-12T18:02:06.135687+0000","last_undegraded":"2024-09-12T18:02:06.135687+0000","last_fullsized":"2024-09-12T18:02:06.135687+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'807","last_scrub_stamp":"2024-09-12T18:02:06.135591+0000","last_deep_scrub":"261'807","last_deep_scrub_stamp":"2024-09-12T18:02:06.135591+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.135591+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:19.719813+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3663,"num_read_kb":3282,"num_write":1025,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"261'314","reported_seq":954,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.212887+0000","last_change":"2024-09-12T18:02:05.212827+0000","last_active":"2024-09-12T18:02:05.212887+0000","last_peered":"2024-09-12T18:02:05.212887+0000","last_clean":"2024-09-12T18:02:05.212887+0000","last_became_active":"2024-09-12T17:23:40.717447+0000","last_became_peered":"2024-09-12T17:23:40.717447+0000","last_unstale":"2024-09-12T18:02:05.212887+0000","last_undegraded":"2024-09-12T18:02:05.212887+0000","last_fullsized":"2024-09-12T18:02:05.212887+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'314","last_scrub_stamp":"2024-09-12T18:02:05.212709+0000","last_deep_scrub":"261'314","last_deep_scrub_stamp":"2024-09-12T18:02:05.212709+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.212709+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:03.962158+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":485,"num_read_kb":6880,"num_write":973,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.627878+0000","last_change":"2024-09-12T18:02:14.627878+0000","last_active":"2024-09-12T18:02:14.627878+0000","last_peered":"2024-09-12T18:02:14.627878+0000","last_clean":"2024-09-12T18:02:14.627878+0000","last_became_active":"2024-09-12T17:23:44.149799+0000","last_became_peered":"2024-09-12T17:23:44.149799+0000","last_unstale":"2024-09-12T18:02:14.627878+0000","last_undegraded":"2024-09-12T18:02:14.627878+0000","last_fullsized":"2024-09-12T18:02:14.627878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:14.627777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:14.627777+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.627777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:51.256807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"261'487","reported_seq":1116,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.071370+0000","last_change":"2024-09-12T18:02:16.071370+0000","last_active":"2024-09-12T18:02:16.071370+0000","last_peered":"2024-09-12T18:02:16.071370+0000","last_clean":"2024-09-12T18:02:16.071370+0000","last_became_active":"2024-09-12T17:23:46.148861+0000","last_became_peered":"2024-09-12T17:23:46.148861+0000","last_unstale":"2024-09-12T18:02:16.071370+0000","last_undegraded":"2024-09-12T18:02:16.071370+0000","last_fullsized":"2024-09-12T18:02:16.071370+0000","mapping_epoch":29,"log_start":"261'400","ondisk_log_start":"261'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'487","last_scrub_stamp":"2024-09-12T18:02:16.071270+0000","last_deep_scrub":"261'487","last_deep_scrub_stamp":"2024-09-12T18:02:16.071270+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.071270+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:48.773638+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101554,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":879,"num_read_kb":2135,"num_write":756,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.173154+0000","last_change":"2024-09-12T18:02:28.173154+0000","last_active":"2024-09-12T18:02:28.173154+0000","last_peered":"2024-09-12T18:02:28.173154+0000","last_clean":"2024-09-12T18:02:28.173154+0000","last_became_active":"2024-09-12T17:23:48.168566+0000","last_became_peered":"2024-09-12T17:23:48.168566+0000","last_unstale":"2024-09-12T18:02:28.173154+0000","last_undegraded":"2024-09-12T18:02:28.173154+0000","last_fullsized":"2024-09-12T18:02:28.173154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:28.173071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:28.173071+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.173071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:47.649297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"261'219","reported_seq":734,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:35.421467+0000","last_change":"2024-09-12T18:02:35.421467+0000","last_active":"2024-09-12T18:02:35.421467+0000","last_peered":"2024-09-12T18:02:35.421467+0000","last_clean":"2024-09-12T18:02:35.421467+0000","last_became_active":"2024-09-12T17:23:50.641702+0000","last_became_peered":"2024-09-12T17:23:50.641702+0000","last_unstale":"2024-09-12T18:02:35.421467+0000","last_undegraded":"2024-09-12T18:02:35.421467+0000","last_fullsized":"2024-09-12T18:02:35.421467+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'219","last_scrub_stamp":"2024-09-12T18:02:35.421372+0000","last_deep_scrub":"261'219","last_deep_scrub_stamp":"2024-09-12T18:02:35.421372+0000","last_clean_scrub_stamp":"2024-09-12T18:02:35.421372+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:13.033839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":328,"num_write":469,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"261'761","reported_seq":2337,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.610751+0000","last_change":"2024-09-12T18:02:07.610751+0000","last_active":"2024-09-12T18:02:07.610751+0000","last_peered":"2024-09-12T18:02:07.610751+0000","last_clean":"2024-09-12T18:02:07.610751+0000","last_became_active":"2024-09-12T17:23:42.141869+0000","last_became_peered":"2024-09-12T17:23:42.141869+0000","last_unstale":"2024-09-12T18:02:07.610751+0000","last_undegraded":"2024-09-12T18:02:07.610751+0000","last_fullsized":"2024-09-12T18:02:07.610751+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'761","last_scrub_stamp":"2024-09-12T18:02:07.610649+0000","last_deep_scrub":"261'761","last_deep_scrub_stamp":"2024-09-12T18:02:07.610649+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.610649+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:59.154743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3783,"num_read_kb":3443,"num_write":995,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"261'326","reported_seq":936,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.085173+0000","last_change":"2024-09-12T18:02:00.085100+0000","last_active":"2024-09-12T18:02:00.085173+0000","last_peered":"2024-09-12T18:02:00.085173+0000","last_clean":"2024-09-12T18:02:00.085173+0000","last_became_active":"2024-09-12T17:23:40.711679+0000","last_became_peered":"2024-09-12T17:23:40.711679+0000","last_unstale":"2024-09-12T18:02:00.085173+0000","last_undegraded":"2024-09-12T18:02:00.085173+0000","last_fullsized":"2024-09-12T18:02:00.085173+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-12T18:02:00.084987+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-12T18:02:00.084987+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.084987+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:03.235507+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":441,"num_read_kb":3628,"num_write":977,"num_write_kb":35404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.204703+0000","last_change":"2024-09-12T18:02:10.204703+0000","last_active":"2024-09-12T18:02:10.204703+0000","last_peered":"2024-09-12T18:02:10.204703+0000","last_clean":"2024-09-12T18:02:10.204703+0000","last_became_active":"2024-09-12T17:23:44.148044+0000","last_became_peered":"2024-09-12T17:23:44.148044+0000","last_unstale":"2024-09-12T18:02:10.204703+0000","last_undegraded":"2024-09-12T18:02:10.204703+0000","last_fullsized":"2024-09-12T18:02:10.204703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:10.204586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:10.204586+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.204586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:28.253142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"261'300","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.751116+0000","last_change":"2024-09-12T18:02:24.751116+0000","last_active":"2024-09-12T18:02:24.751116+0000","last_peered":"2024-09-12T18:02:24.751116+0000","last_clean":"2024-09-12T18:02:24.751116+0000","last_became_active":"2024-09-12T17:23:46.150380+0000","last_became_peered":"2024-09-12T17:23:46.150380+0000","last_unstale":"2024-09-12T18:02:24.751116+0000","last_undegraded":"2024-09-12T18:02:24.751116+0000","last_fullsized":"2024-09-12T18:02:24.751116+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'300","last_scrub_stamp":"2024-09-12T18:02:24.751022+0000","last_deep_scrub":"261'300","last_deep_scrub_stamp":"2024-09-12T18:02:24.751022+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.751022+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:39.332302+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47278,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":1112,"num_write":416,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.999834+0000","last_change":"2024-09-12T18:02:19.999834+0000","last_active":"2024-09-12T18:02:19.999834+0000","last_peered":"2024-09-12T18:02:19.999834+0000","last_clean":"2024-09-12T18:02:19.999834+0000","last_became_active":"2024-09-12T17:23:48.173575+0000","last_became_peered":"2024-09-12T17:23:48.173575+0000","last_unstale":"2024-09-12T18:02:19.999834+0000","last_undegraded":"2024-09-12T18:02:19.999834+0000","last_fullsized":"2024-09-12T18:02:19.999834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:19.999742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:19.999742+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.999742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:27.971506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"261'195","reported_seq":1059,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.075748+0000","last_change":"2024-09-12T18:02:21.075748+0000","last_active":"2024-09-12T18:02:21.075748+0000","last_peered":"2024-09-12T18:02:21.075748+0000","last_clean":"2024-09-12T18:02:21.075748+0000","last_became_active":"2024-09-12T17:23:50.185853+0000","last_became_peered":"2024-09-12T17:23:50.185853+0000","last_unstale":"2024-09-12T18:02:21.075748+0000","last_undegraded":"2024-09-12T18:02:21.075748+0000","last_fullsized":"2024-09-12T18:02:21.075748+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'195","last_scrub_stamp":"2024-09-12T18:02:21.075656+0000","last_deep_scrub":"261'195","last_deep_scrub_stamp":"2024-09-12T18:02:21.075656+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.075656+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:21.562874+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":633,"num_read_kb":630,"num_write":516,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"261'633","reported_seq":2482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.239446+0000","last_change":"2024-09-12T18:02:12.239446+0000","last_active":"2024-09-12T18:02:12.239446+0000","last_peered":"2024-09-12T18:02:12.239446+0000","last_clean":"2024-09-12T18:02:12.239446+0000","last_became_active":"2024-09-12T17:23:42.154175+0000","last_became_peered":"2024-09-12T17:23:42.154175+0000","last_unstale":"2024-09-12T18:02:12.239446+0000","last_undegraded":"2024-09-12T18:02:12.239446+0000","last_fullsized":"2024-09-12T18:02:12.239446+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'633","last_scrub_stamp":"2024-09-12T18:02:12.239338+0000","last_deep_scrub":"261'633","last_deep_scrub_stamp":"2024-09-12T18:02:12.239338+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.239338+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":600,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:45.683746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3404,"num_read_kb":3151,"num_write":789,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1533,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"261'349","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.040975+0000","last_change":"2024-09-12T18:01:58.040975+0000","last_active":"2024-09-12T18:01:58.040975+0000","last_peered":"2024-09-12T18:01:58.040975+0000","last_clean":"2024-09-12T18:01:58.040975+0000","last_became_active":"2024-09-12T17:23:40.712959+0000","last_became_peered":"2024-09-12T17:23:40.712959+0000","last_unstale":"2024-09-12T18:01:58.040975+0000","last_undegraded":"2024-09-12T18:01:58.040975+0000","last_fullsized":"2024-09-12T18:01:58.040975+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T18:01:58.040878+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T18:01:58.040878+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.040878+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:42.713508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":522,"num_read_kb":11025,"num_write":1066,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.193876+0000","last_change":"2024-09-12T18:02:19.193876+0000","last_active":"2024-09-12T18:02:19.193876+0000","last_peered":"2024-09-12T18:02:19.193876+0000","last_clean":"2024-09-12T18:02:19.193876+0000","last_became_active":"2024-09-12T17:23:44.152006+0000","last_became_peered":"2024-09-12T17:23:44.152006+0000","last_unstale":"2024-09-12T18:02:19.193876+0000","last_undegraded":"2024-09-12T18:02:19.193876+0000","last_fullsized":"2024-09-12T18:02:19.193876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:19.193797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:19.193797+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.193797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:33.141032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"261'255","reported_seq":825,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.325621+0000","last_change":"2024-09-12T18:02:25.325621+0000","last_active":"2024-09-12T18:02:25.325621+0000","last_peered":"2024-09-12T18:02:25.325621+0000","last_clean":"2024-09-12T18:02:25.325621+0000","last_became_active":"2024-09-12T17:23:46.241001+0000","last_became_peered":"2024-09-12T17:23:46.241001+0000","last_unstale":"2024-09-12T18:02:25.325621+0000","last_undegraded":"2024-09-12T18:02:25.325621+0000","last_fullsized":"2024-09-12T18:02:25.325621+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'255","last_scrub_stamp":"2024-09-12T18:02:25.325531+0000","last_deep_scrub":"261'255","last_deep_scrub_stamp":"2024-09-12T18:02:25.325531+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.325531+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:01.527863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42355,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":393,"num_read_kb":868,"num_write":314,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.008014+0000","last_change":"2024-09-12T18:02:19.008014+0000","last_active":"2024-09-12T18:02:19.008014+0000","last_peered":"2024-09-12T18:02:19.008014+0000","last_clean":"2024-09-12T18:02:19.008014+0000","last_became_active":"2024-09-12T17:23:48.170212+0000","last_became_peered":"2024-09-12T17:23:48.170212+0000","last_unstale":"2024-09-12T18:02:19.008014+0000","last_undegraded":"2024-09-12T18:02:19.008014+0000","last_fullsized":"2024-09-12T18:02:19.008014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:19.007879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:19.007879+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.007879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:30.317175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"261'132","reported_seq":620,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.118782+0000","last_change":"2024-09-12T18:02:32.118782+0000","last_active":"2024-09-12T18:02:32.118782+0000","last_peered":"2024-09-12T18:02:32.118782+0000","last_clean":"2024-09-12T18:02:32.118782+0000","last_became_active":"2024-09-12T17:23:50.187329+0000","last_became_peered":"2024-09-12T17:23:50.187329+0000","last_unstale":"2024-09-12T18:02:32.118782+0000","last_undegraded":"2024-09-12T18:02:32.118782+0000","last_fullsized":"2024-09-12T18:02:32.118782+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'132","last_scrub_stamp":"2024-09-12T18:02:32.118687+0000","last_deep_scrub":"261'132","last_deep_scrub_stamp":"2024-09-12T18:02:32.118687+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.118687+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:23.158731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":770,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":154,"num_read_kb":149,"num_write":327,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"261'777","reported_seq":2301,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.938708+0000","last_change":"2024-09-12T18:01:59.938708+0000","last_active":"2024-09-12T18:01:59.938708+0000","last_peered":"2024-09-12T18:01:59.938708+0000","last_clean":"2024-09-12T18:01:59.938708+0000","last_became_active":"2024-09-12T17:23:42.144384+0000","last_became_peered":"2024-09-12T17:23:42.144384+0000","last_unstale":"2024-09-12T18:01:59.938708+0000","last_undegraded":"2024-09-12T18:01:59.938708+0000","last_fullsized":"2024-09-12T18:01:59.938708+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'777","last_scrub_stamp":"2024-09-12T18:01:59.938618+0000","last_deep_scrub":"261'777","last_deep_scrub_stamp":"2024-09-12T18:01:59.938618+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.938618+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:20.494541+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3720,"num_read_kb":3370,"num_write":1041,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"261'331","reported_seq":948,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.748832+0000","last_change":"2024-09-12T18:01:55.748832+0000","last_active":"2024-09-12T18:01:55.748832+0000","last_peered":"2024-09-12T18:01:55.748832+0000","last_clean":"2024-09-12T18:01:55.748832+0000","last_became_active":"2024-09-12T17:23:40.714710+0000","last_became_peered":"2024-09-12T17:23:40.714710+0000","last_unstale":"2024-09-12T18:01:55.748832+0000","last_undegraded":"2024-09-12T18:01:55.748832+0000","last_fullsized":"2024-09-12T18:01:55.748832+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'331","last_scrub_stamp":"2024-09-12T18:01:55.748688+0000","last_deep_scrub":"261'331","last_deep_scrub_stamp":"2024-09-12T18:01:55.748688+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.748688+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:42.546066+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311482,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":467,"num_read_kb":6860,"num_write":1100,"num_write_kb":28418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.007474+0000","last_change":"2024-09-12T18:02:13.007474+0000","last_active":"2024-09-12T18:02:13.007474+0000","last_peered":"2024-09-12T18:02:13.007474+0000","last_clean":"2024-09-12T18:02:13.007474+0000","last_became_active":"2024-09-12T17:23:44.147886+0000","last_became_peered":"2024-09-12T17:23:44.147886+0000","last_unstale":"2024-09-12T18:02:13.007474+0000","last_undegraded":"2024-09-12T18:02:13.007474+0000","last_fullsized":"2024-09-12T18:02:13.007474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:13.007389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:13.007389+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.007389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:11.491836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"261'87","reported_seq":604,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.146248+0000","last_change":"2024-09-12T18:02:26.146248+0000","last_active":"2024-09-12T18:02:26.146248+0000","last_peered":"2024-09-12T18:02:26.146248+0000","last_clean":"2024-09-12T18:02:26.146248+0000","last_became_active":"2024-09-12T17:23:46.241073+0000","last_became_peered":"2024-09-12T17:23:46.241073+0000","last_unstale":"2024-09-12T18:02:26.146248+0000","last_undegraded":"2024-09-12T18:02:26.146248+0000","last_fullsized":"2024-09-12T18:02:26.146248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'87","last_scrub_stamp":"2024-09-12T18:02:26.146111+0000","last_deep_scrub":"261'87","last_deep_scrub_stamp":"2024-09-12T18:02:26.146111+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.146111+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:51.515529+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":73,"num_read_kb":65,"num_write":60,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"261'785","reported_seq":2177,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.122305+0000","last_change":"2024-09-12T18:02:18.122305+0000","last_active":"2024-09-12T18:02:18.122305+0000","last_peered":"2024-09-12T18:02:18.122305+0000","last_clean":"2024-09-12T18:02:18.122305+0000","last_became_active":"2024-09-12T17:23:48.170815+0000","last_became_peered":"2024-09-12T17:23:48.170815+0000","last_unstale":"2024-09-12T18:02:18.122305+0000","last_undegraded":"2024-09-12T18:02:18.122305+0000","last_fullsized":"2024-09-12T18:02:18.122305+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'785","last_scrub_stamp":"2024-09-12T18:02:18.122209+0000","last_deep_scrub":"261'785","last_deep_scrub_stamp":"2024-09-12T18:02:18.122209+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.122209+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:13.299383+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"261'128","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.696630+0000","last_change":"2024-09-12T18:02:29.696630+0000","last_active":"2024-09-12T18:02:29.696630+0000","last_peered":"2024-09-12T18:02:29.696630+0000","last_clean":"2024-09-12T18:02:29.696630+0000","last_became_active":"2024-09-12T17:23:50.190124+0000","last_became_peered":"2024-09-12T17:23:50.190124+0000","last_unstale":"2024-09-12T18:02:29.696630+0000","last_undegraded":"2024-09-12T18:02:29.696630+0000","last_fullsized":"2024-09-12T18:02:29.696630+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'128","last_scrub_stamp":"2024-09-12T18:02:29.696540+0000","last_deep_scrub":"261'128","last_deep_scrub_stamp":"2024-09-12T18:02:29.696540+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.696540+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:44.997582+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":181,"num_read_kb":172,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"261'824","reported_seq":2447,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.135447+0000","last_change":"2024-09-12T18:02:09.135447+0000","last_active":"2024-09-12T18:02:09.135447+0000","last_peered":"2024-09-12T18:02:09.135447+0000","last_clean":"2024-09-12T18:02:09.135447+0000","last_became_active":"2024-09-12T17:23:42.149314+0000","last_became_peered":"2024-09-12T17:23:42.149314+0000","last_unstale":"2024-09-12T18:02:09.135447+0000","last_undegraded":"2024-09-12T18:02:09.135447+0000","last_fullsized":"2024-09-12T18:02:09.135447+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'824","last_scrub_stamp":"2024-09-12T18:02:09.135365+0000","last_deep_scrub":"261'824","last_deep_scrub_stamp":"2024-09-12T18:02:09.135365+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.135365+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:09.176143+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4083,"num_read_kb":3703,"num_write":1086,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":756,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"261'295","reported_seq":924,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.265156+0000","last_change":"2024-09-12T18:02:02.265156+0000","last_active":"2024-09-12T18:02:02.265156+0000","last_peered":"2024-09-12T18:02:02.265156+0000","last_clean":"2024-09-12T18:02:02.265156+0000","last_became_active":"2024-09-12T17:23:40.709818+0000","last_became_peered":"2024-09-12T17:23:40.709818+0000","last_unstale":"2024-09-12T18:02:02.265156+0000","last_undegraded":"2024-09-12T18:02:02.265156+0000","last_fullsized":"2024-09-12T18:02:02.265156+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'295","last_scrub_stamp":"2024-09-12T18:02:02.265077+0000","last_deep_scrub":"261'295","last_deep_scrub_stamp":"2024-09-12T18:02:02.265077+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.265077+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:25.521537+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":426,"num_read_kb":69858,"num_write":935,"num_write_kb":36096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.682930+0000","last_change":"2024-09-12T18:02:18.682930+0000","last_active":"2024-09-12T18:02:18.682930+0000","last_peered":"2024-09-12T18:02:18.682930+0000","last_clean":"2024-09-12T18:02:18.682930+0000","last_became_active":"2024-09-12T17:23:44.150183+0000","last_became_peered":"2024-09-12T17:23:44.150183+0000","last_unstale":"2024-09-12T18:02:18.682930+0000","last_undegraded":"2024-09-12T18:02:18.682930+0000","last_fullsized":"2024-09-12T18:02:18.682930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:18.682841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:18.682841+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.682841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:04.298570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"261'323","reported_seq":898,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.148739+0000","last_change":"2024-09-12T18:02:26.148673+0000","last_active":"2024-09-12T18:02:26.148739+0000","last_peered":"2024-09-12T18:02:26.148739+0000","last_clean":"2024-09-12T18:02:26.148739+0000","last_became_active":"2024-09-12T17:23:46.144587+0000","last_became_peered":"2024-09-12T17:23:46.144587+0000","last_unstale":"2024-09-12T18:02:26.148739+0000","last_undegraded":"2024-09-12T18:02:26.148739+0000","last_fullsized":"2024-09-12T18:02:26.148739+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-12T18:02:26.148565+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-12T18:02:26.148565+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.148565+0000","objects_scrubbed":9,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:12.623163+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46086,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":505,"num_read_kb":1153,"num_write":418,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.611732+0000","last_change":"2024-09-12T18:02:25.611639+0000","last_active":"2024-09-12T18:02:25.611732+0000","last_peered":"2024-09-12T18:02:25.611732+0000","last_clean":"2024-09-12T18:02:25.611732+0000","last_became_active":"2024-09-12T17:23:48.171272+0000","last_became_peered":"2024-09-12T17:23:48.171272+0000","last_unstale":"2024-09-12T18:02:25.611732+0000","last_undegraded":"2024-09-12T18:02:25.611732+0000","last_fullsized":"2024-09-12T18:02:25.611732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:25.611530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:25.611530+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.611530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:45.194075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"261'104","reported_seq":597,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.709004+0000","last_change":"2024-09-12T18:02:32.709004+0000","last_active":"2024-09-12T18:02:32.709004+0000","last_peered":"2024-09-12T18:02:32.709004+0000","last_clean":"2024-09-12T18:02:32.709004+0000","last_became_active":"2024-09-12T17:23:50.191859+0000","last_became_peered":"2024-09-12T17:23:50.191859+0000","last_unstale":"2024-09-12T18:02:32.709004+0000","last_undegraded":"2024-09-12T18:02:32.709004+0000","last_fullsized":"2024-09-12T18:02:32.709004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'104","last_scrub_stamp":"2024-09-12T18:02:32.708900+0000","last_deep_scrub":"261'104","last_deep_scrub_stamp":"2024-09-12T18:02:32.708900+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.708900+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:19.072198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":141,"num_write":249,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"261'477","reported_seq":2065,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.167430+0000","last_change":"2024-09-12T18:02:07.167430+0000","last_active":"2024-09-12T18:02:07.167430+0000","last_peered":"2024-09-12T18:02:07.167430+0000","last_clean":"2024-09-12T18:02:07.167430+0000","last_became_active":"2024-09-12T17:23:42.149260+0000","last_became_peered":"2024-09-12T17:23:42.149260+0000","last_unstale":"2024-09-12T18:02:07.167430+0000","last_undegraded":"2024-09-12T18:02:07.167430+0000","last_fullsized":"2024-09-12T18:02:07.167430+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'477","last_scrub_stamp":"2024-09-12T18:02:07.167342+0000","last_deep_scrub":"261'477","last_deep_scrub_stamp":"2024-09-12T18:02:07.167342+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.167342+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:54.938925+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2426,"num_read_kb":2286,"num_write":546,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"261'381","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.261206+0000","last_change":"2024-09-12T18:02:03.261206+0000","last_active":"2024-09-12T18:02:03.261206+0000","last_peered":"2024-09-12T18:02:03.261206+0000","last_clean":"2024-09-12T18:02:03.261206+0000","last_became_active":"2024-09-12T17:23:40.711032+0000","last_became_peered":"2024-09-12T17:23:40.711032+0000","last_unstale":"2024-09-12T18:02:03.261206+0000","last_undegraded":"2024-09-12T18:02:03.261206+0000","last_fullsized":"2024-09-12T18:02:03.261206+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'381","last_scrub_stamp":"2024-09-12T18:02:03.261091+0000","last_deep_scrub":"261'381","last_deep_scrub_stamp":"2024-09-12T18:02:03.261091+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.261091+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:14.427700+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":607,"num_read_kb":19508,"num_write":1297,"num_write_kb":28388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.162153+0000","last_change":"2024-09-12T18:02:22.162153+0000","last_active":"2024-09-12T18:02:22.162153+0000","last_peered":"2024-09-12T18:02:22.162153+0000","last_clean":"2024-09-12T18:02:22.162153+0000","last_became_active":"2024-09-12T17:23:44.147694+0000","last_became_peered":"2024-09-12T17:23:44.147694+0000","last_unstale":"2024-09-12T18:02:22.162153+0000","last_undegraded":"2024-09-12T18:02:22.162153+0000","last_fullsized":"2024-09-12T18:02:22.162153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:22.162066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:22.162066+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.162066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:39.604814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"261'262","reported_seq":822,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.567988+0000","last_change":"2024-09-12T18:02:19.567887+0000","last_active":"2024-09-12T18:02:19.567988+0000","last_peered":"2024-09-12T18:02:19.567988+0000","last_clean":"2024-09-12T18:02:19.567988+0000","last_became_active":"2024-09-12T17:23:46.152028+0000","last_became_peered":"2024-09-12T17:23:46.152028+0000","last_unstale":"2024-09-12T18:02:19.567988+0000","last_undegraded":"2024-09-12T18:02:19.567988+0000","last_fullsized":"2024-09-12T18:02:19.567988+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'262","last_scrub_stamp":"2024-09-12T18:02:19.567770+0000","last_deep_scrub":"261'262","last_deep_scrub_stamp":"2024-09-12T18:02:19.567770+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.567770+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:40.120655+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":974,"num_write":338,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.110255+0000","last_change":"2024-09-12T18:02:16.110198+0000","last_active":"2024-09-12T18:02:16.110255+0000","last_peered":"2024-09-12T18:02:16.110255+0000","last_clean":"2024-09-12T18:02:16.110255+0000","last_became_active":"2024-09-12T17:23:48.170452+0000","last_became_peered":"2024-09-12T17:23:48.170452+0000","last_unstale":"2024-09-12T18:02:16.110255+0000","last_undegraded":"2024-09-12T18:02:16.110255+0000","last_fullsized":"2024-09-12T18:02:16.110255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:16.110107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:16.110107+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.110107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:51.727297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"261'127","reported_seq":638,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:36.458815+0000","last_change":"2024-09-12T18:02:36.458815+0000","last_active":"2024-09-12T18:02:36.458815+0000","last_peered":"2024-09-12T18:02:36.458815+0000","last_clean":"2024-09-12T18:02:36.458815+0000","last_became_active":"2024-09-12T17:23:50.640911+0000","last_became_peered":"2024-09-12T17:23:50.640911+0000","last_unstale":"2024-09-12T18:02:36.458815+0000","last_undegraded":"2024-09-12T18:02:36.458815+0000","last_fullsized":"2024-09-12T18:02:36.458815+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'127","last_scrub_stamp":"2024-09-12T18:02:36.458662+0000","last_deep_scrub":"261'127","last_deep_scrub_stamp":"2024-09-12T18:02:36.458662+0000","last_clean_scrub_stamp":"2024-09-12T18:02:36.458662+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:11.745887+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":307,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"261'391","reported_seq":1798,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.243312+0000","last_change":"2024-09-12T18:02:10.243251+0000","last_active":"2024-09-12T18:02:10.243312+0000","last_peered":"2024-09-12T18:02:10.243312+0000","last_clean":"2024-09-12T18:02:10.243312+0000","last_became_active":"2024-09-12T17:23:42.146055+0000","last_became_peered":"2024-09-12T17:23:42.146055+0000","last_unstale":"2024-09-12T18:02:10.243312+0000","last_undegraded":"2024-09-12T18:02:10.243312+0000","last_fullsized":"2024-09-12T18:02:10.243312+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'391","last_scrub_stamp":"2024-09-12T18:02:10.243153+0000","last_deep_scrub":"261'391","last_deep_scrub_stamp":"2024-09-12T18:02:10.243153+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.243153+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:14.671527+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1982,"num_read_kb":1877,"num_write":444,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"261'319","reported_seq":944,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.219235+0000","last_change":"2024-09-12T18:02:00.219235+0000","last_active":"2024-09-12T18:02:00.219235+0000","last_peered":"2024-09-12T18:02:00.219235+0000","last_clean":"2024-09-12T18:02:00.219235+0000","last_became_active":"2024-09-12T17:23:40.709759+0000","last_became_peered":"2024-09-12T17:23:40.709759+0000","last_unstale":"2024-09-12T18:02:00.219235+0000","last_undegraded":"2024-09-12T18:02:00.219235+0000","last_fullsized":"2024-09-12T18:02:00.219235+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'319","last_scrub_stamp":"2024-09-12T18:02:00.219087+0000","last_deep_scrub":"261'319","last_deep_scrub_stamp":"2024-09-12T18:02:00.219087+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.219087+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:11.536241+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306344,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":452,"num_read_kb":23018,"num_write":1076,"num_write_kb":26757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.095989+0000","last_change":"2024-09-12T18:02:25.095989+0000","last_active":"2024-09-12T18:02:25.095989+0000","last_peered":"2024-09-12T18:02:25.095989+0000","last_clean":"2024-09-12T18:02:25.095989+0000","last_became_active":"2024-09-12T17:23:44.147372+0000","last_became_peered":"2024-09-12T17:23:44.147372+0000","last_unstale":"2024-09-12T18:02:25.095989+0000","last_undegraded":"2024-09-12T18:02:25.095989+0000","last_fullsized":"2024-09-12T18:02:25.095989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:25.095885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:25.095885+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.095885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:56.421750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"261'245","reported_seq":800,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.318443+0000","last_change":"2024-09-12T18:02:26.318443+0000","last_active":"2024-09-12T18:02:26.318443+0000","last_peered":"2024-09-12T18:02:26.318443+0000","last_clean":"2024-09-12T18:02:26.318443+0000","last_became_active":"2024-09-12T17:23:46.153024+0000","last_became_peered":"2024-09-12T17:23:46.153024+0000","last_unstale":"2024-09-12T18:02:26.318443+0000","last_undegraded":"2024-09-12T18:02:26.318443+0000","last_fullsized":"2024-09-12T18:02:26.318443+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'245","last_scrub_stamp":"2024-09-12T18:02:26.318345+0000","last_deep_scrub":"261'245","last_deep_scrub_stamp":"2024-09-12T18:02:26.318345+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.318345+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:28.556262+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46277,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":401,"num_read_kb":970,"num_write":334,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.100267+0000","last_change":"2024-09-12T18:02:27.100267+0000","last_active":"2024-09-12T18:02:27.100267+0000","last_peered":"2024-09-12T18:02:27.100267+0000","last_clean":"2024-09-12T18:02:27.100267+0000","last_became_active":"2024-09-12T17:23:48.171849+0000","last_became_peered":"2024-09-12T17:23:48.171849+0000","last_unstale":"2024-09-12T18:02:27.100267+0000","last_undegraded":"2024-09-12T18:02:27.100267+0000","last_fullsized":"2024-09-12T18:02:27.100267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:27.100180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:27.100180+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.100180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:51.370449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"261'143","reported_seq":1253,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.731419+0000","last_change":"2024-09-12T18:02:31.731419+0000","last_active":"2024-09-12T18:02:31.731419+0000","last_peered":"2024-09-12T18:02:31.731419+0000","last_clean":"2024-09-12T18:02:31.731419+0000","last_became_active":"2024-09-12T17:23:50.187084+0000","last_became_peered":"2024-09-12T17:23:50.187084+0000","last_unstale":"2024-09-12T18:02:31.731419+0000","last_undegraded":"2024-09-12T18:02:31.731419+0000","last_fullsized":"2024-09-12T18:02:31.731419+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'143","last_scrub_stamp":"2024-09-12T18:02:31.731322+0000","last_deep_scrub":"261'143","last_deep_scrub_stamp":"2024-09-12T18:02:31.731322+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.731322+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:28.520354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":862,"num_read_kb":842,"num_write":338,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"261'421","reported_seq":1880,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.174737+0000","last_change":"2024-09-12T18:02:08.174681+0000","last_active":"2024-09-12T18:02:08.174737+0000","last_peered":"2024-09-12T18:02:08.174737+0000","last_clean":"2024-09-12T18:02:08.174737+0000","last_became_active":"2024-09-12T17:23:42.135975+0000","last_became_peered":"2024-09-12T17:23:42.135975+0000","last_unstale":"2024-09-12T18:02:08.174737+0000","last_undegraded":"2024-09-12T18:02:08.174737+0000","last_fullsized":"2024-09-12T18:02:08.174737+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'421","last_scrub_stamp":"2024-09-12T18:02:08.174594+0000","last_deep_scrub":"261'421","last_deep_scrub_stamp":"2024-09-12T18:02:08.174594+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.174594+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:26.404773+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2123,"num_read_kb":2006,"num_write":479,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"261'385","reported_seq":1035,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.733545+0000","last_change":"2024-09-12T18:01:57.733545+0000","last_active":"2024-09-12T18:01:57.733545+0000","last_peered":"2024-09-12T18:01:57.733545+0000","last_clean":"2024-09-12T18:01:57.733545+0000","last_became_active":"2024-09-12T17:23:40.713129+0000","last_became_peered":"2024-09-12T17:23:40.713129+0000","last_unstale":"2024-09-12T18:01:57.733545+0000","last_undegraded":"2024-09-12T18:01:57.733545+0000","last_fullsized":"2024-09-12T18:01:57.733545+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'385","last_scrub_stamp":"2024-09-12T18:01:57.733451+0000","last_deep_scrub":"261'385","last_deep_scrub_stamp":"2024-09-12T18:01:57.733451+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.733451+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:01.262019+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311685,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":537,"num_read_kb":14035,"num_write":1238,"num_write_kb":28273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"261'2","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.041838+0000","last_change":"2024-09-12T18:02:14.041733+0000","last_active":"2024-09-12T18:02:14.041838+0000","last_peered":"2024-09-12T18:02:14.041838+0000","last_clean":"2024-09-12T18:02:14.041838+0000","last_became_active":"2024-09-12T17:23:44.151126+0000","last_became_peered":"2024-09-12T17:23:44.151126+0000","last_unstale":"2024-09-12T18:02:14.041838+0000","last_undegraded":"2024-09-12T18:02:14.041838+0000","last_fullsized":"2024-09-12T18:02:14.041838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:14.041603+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:14.041603+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.041603+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:38.127428+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"261'288","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.128502+0000","last_change":"2024-09-12T18:02:24.128502+0000","last_active":"2024-09-12T18:02:24.128502+0000","last_peered":"2024-09-12T18:02:24.128502+0000","last_clean":"2024-09-12T18:02:24.128502+0000","last_became_active":"2024-09-12T17:23:46.153111+0000","last_became_peered":"2024-09-12T17:23:46.153111+0000","last_unstale":"2024-09-12T18:02:24.128502+0000","last_undegraded":"2024-09-12T18:02:24.128502+0000","last_fullsized":"2024-09-12T18:02:24.128502+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'288","last_scrub_stamp":"2024-09-12T18:02:24.128386+0000","last_deep_scrub":"261'288","last_deep_scrub_stamp":"2024-09-12T18:02:24.128386+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.128386+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:03.315024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":457,"num_read_kb":1001,"num_write":362,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.574650+0000","last_change":"2024-09-12T18:02:24.574650+0000","last_active":"2024-09-12T18:02:24.574650+0000","last_peered":"2024-09-12T18:02:24.574650+0000","last_clean":"2024-09-12T18:02:24.574650+0000","last_became_active":"2024-09-12T17:23:48.167070+0000","last_became_peered":"2024-09-12T17:23:48.167070+0000","last_unstale":"2024-09-12T18:02:24.574650+0000","last_undegraded":"2024-09-12T18:02:24.574650+0000","last_fullsized":"2024-09-12T18:02:24.574650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:24.574560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:24.574560+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.574560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:04.413448+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"261'86","reported_seq":574,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.023783+0000","last_change":"2024-09-12T18:02:30.023783+0000","last_active":"2024-09-12T18:02:30.023783+0000","last_peered":"2024-09-12T18:02:30.023783+0000","last_clean":"2024-09-12T18:02:30.023783+0000","last_became_active":"2024-09-12T17:23:50.179075+0000","last_became_peered":"2024-09-12T17:23:50.179075+0000","last_unstale":"2024-09-12T18:02:30.023783+0000","last_undegraded":"2024-09-12T18:02:30.023783+0000","last_fullsized":"2024-09-12T18:02:30.023783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'86","last_scrub_stamp":"2024-09-12T18:02:30.023681+0000","last_deep_scrub":"261'86","last_deep_scrub_stamp":"2024-09-12T18:02:30.023681+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.023681+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:03.359607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":88,"num_write":193,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"261'780","reported_seq":2273,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.014503+0000","last_change":"2024-09-12T18:02:11.014426+0000","last_active":"2024-09-12T18:02:11.014503+0000","last_peered":"2024-09-12T18:02:11.014503+0000","last_clean":"2024-09-12T18:02:11.014503+0000","last_became_active":"2024-09-12T17:23:42.137169+0000","last_became_peered":"2024-09-12T17:23:42.137169+0000","last_unstale":"2024-09-12T18:02:11.014503+0000","last_undegraded":"2024-09-12T18:02:11.014503+0000","last_fullsized":"2024-09-12T18:02:11.014503+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'780","last_scrub_stamp":"2024-09-12T18:02:11.014345+0000","last_deep_scrub":"261'780","last_deep_scrub_stamp":"2024-09-12T18:02:11.014345+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.014345+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:33.609949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3876,"num_read_kb":3488,"num_write":1033,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3280,"num_omap_keys":13,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"261'371","reported_seq":1041,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.139558+0000","last_change":"2024-09-12T18:01:58.139558+0000","last_active":"2024-09-12T18:01:58.139558+0000","last_peered":"2024-09-12T18:01:58.139558+0000","last_clean":"2024-09-12T18:01:58.139558+0000","last_became_active":"2024-09-12T17:23:40.713212+0000","last_became_peered":"2024-09-12T17:23:40.713212+0000","last_unstale":"2024-09-12T18:01:58.139558+0000","last_undegraded":"2024-09-12T18:01:58.139558+0000","last_fullsized":"2024-09-12T18:01:58.139558+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'371","last_scrub_stamp":"2024-09-12T18:01:58.139456+0000","last_deep_scrub":"261'371","last_deep_scrub_stamp":"2024-09-12T18:01:58.139456+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.139456+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:12.945343+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":603,"num_read_kb":38604,"num_write":1166,"num_write_kb":36037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"261'634","reported_seq":2105,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.191292+0000","last_change":"2024-09-12T18:02:13.191292+0000","last_active":"2024-09-12T18:02:13.191292+0000","last_peered":"2024-09-12T18:02:13.191292+0000","last_clean":"2024-09-12T18:02:13.191292+0000","last_became_active":"2024-09-12T17:24:17.227465+0000","last_became_peered":"2024-09-12T17:24:17.227465+0000","last_unstale":"2024-09-12T18:02:13.191292+0000","last_undegraded":"2024-09-12T18:02:13.191292+0000","last_fullsized":"2024-09-12T18:02:13.191292+0000","mapping_epoch":36,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'634","last_scrub_stamp":"2024-09-12T18:02:13.191170+0000","last_deep_scrub":"261'634","last_deep_scrub_stamp":"2024-09-12T18:02:13.191170+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.191170+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":600,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:52.485072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3072,"num_read_kb":2745,"num_write":824,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":266,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"261'324","reported_seq":1001,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.956126+0000","last_change":"2024-09-12T18:01:56.956126+0000","last_active":"2024-09-12T18:01:56.956126+0000","last_peered":"2024-09-12T18:01:56.956126+0000","last_clean":"2024-09-12T18:01:56.956126+0000","last_became_active":"2024-09-12T17:23:40.708064+0000","last_became_peered":"2024-09-12T17:23:40.708064+0000","last_unstale":"2024-09-12T18:01:56.956126+0000","last_undegraded":"2024-09-12T18:01:56.956126+0000","last_fullsized":"2024-09-12T18:01:56.956126+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'324","last_scrub_stamp":"2024-09-12T18:01:56.956049+0000","last_deep_scrub":"261'324","last_deep_scrub_stamp":"2024-09-12T18:01:56.956049+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.956049+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:22.585210+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8958905,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":78914,"num_write":996,"num_write_kb":50917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"261'846","reported_seq":2567,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.231756+0000","last_change":"2024-09-12T18:02:12.231701+0000","last_active":"2024-09-12T18:02:12.231756+0000","last_peered":"2024-09-12T18:02:12.231756+0000","last_clean":"2024-09-12T18:02:12.231756+0000","last_became_active":"2024-09-12T17:23:42.144919+0000","last_became_peered":"2024-09-12T17:23:42.144919+0000","last_unstale":"2024-09-12T18:02:12.231756+0000","last_undegraded":"2024-09-12T18:02:12.231756+0000","last_fullsized":"2024-09-12T18:02:12.231756+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'846","last_scrub_stamp":"2024-09-12T18:02:12.231607+0000","last_deep_scrub":"261'846","last_deep_scrub_stamp":"2024-09-12T18:02:12.231607+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.231607+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:17.452515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4312,"num_read_kb":3919,"num_write":1107,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1165,"num_omap_keys":5,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"261'352","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.251183+0000","last_change":"2024-09-12T18:02:04.251183+0000","last_active":"2024-09-12T18:02:04.251183+0000","last_peered":"2024-09-12T18:02:04.251183+0000","last_clean":"2024-09-12T18:02:04.251183+0000","last_became_active":"2024-09-12T17:23:40.715471+0000","last_became_peered":"2024-09-12T17:23:40.715471+0000","last_unstale":"2024-09-12T18:02:04.251183+0000","last_undegraded":"2024-09-12T18:02:04.251183+0000","last_fullsized":"2024-09-12T18:02:04.251183+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'352","last_scrub_stamp":"2024-09-12T18:02:04.251012+0000","last_deep_scrub":"261'352","last_deep_scrub_stamp":"2024-09-12T18:02:04.251012+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.251012+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:39.383192+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":470,"num_read_kb":37845,"num_write":1014,"num_write_kb":24242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"261'768","reported_seq":2218,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.004513+0000","last_change":"2024-09-12T18:02:09.004437+0000","last_active":"2024-09-12T18:02:09.004513+0000","last_peered":"2024-09-12T18:02:09.004513+0000","last_clean":"2024-09-12T18:02:09.004513+0000","last_became_active":"2024-09-12T17:23:42.142672+0000","last_became_peered":"2024-09-12T17:23:42.142672+0000","last_unstale":"2024-09-12T18:02:09.004513+0000","last_undegraded":"2024-09-12T18:02:09.004513+0000","last_fullsized":"2024-09-12T18:02:09.004513+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'768","last_scrub_stamp":"2024-09-12T18:02:09.004346+0000","last_deep_scrub":"261'768","last_deep_scrub_stamp":"2024-09-12T18:02:09.004346+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.004346+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:52.254410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3573,"num_read_kb":3224,"num_write":1004,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"261'287","reported_seq":915,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.707639+0000","last_change":"2024-09-12T18:02:01.707639+0000","last_active":"2024-09-12T18:02:01.707639+0000","last_peered":"2024-09-12T18:02:01.707639+0000","last_clean":"2024-09-12T18:02:01.707639+0000","last_became_active":"2024-09-12T17:23:40.702991+0000","last_became_peered":"2024-09-12T17:23:40.702991+0000","last_unstale":"2024-09-12T18:02:01.707639+0000","last_undegraded":"2024-09-12T18:02:01.707639+0000","last_fullsized":"2024-09-12T18:02:01.707639+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'287","last_scrub_stamp":"2024-09-12T18:02:01.707536+0000","last_deep_scrub":"261'287","last_deep_scrub_stamp":"2024-09-12T18:02:01.707536+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.707536+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:27.542681+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306617,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":429,"num_read_kb":57192,"num_write":879,"num_write_kb":43690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"261'414","reported_seq":1908,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.286617+0000","last_change":"2024-09-12T18:02:13.286617+0000","last_active":"2024-09-12T18:02:13.286617+0000","last_peered":"2024-09-12T18:02:13.286617+0000","last_clean":"2024-09-12T18:02:13.286617+0000","last_became_active":"2024-09-12T17:23:42.146394+0000","last_became_peered":"2024-09-12T17:23:42.146394+0000","last_unstale":"2024-09-12T18:02:13.286617+0000","last_undegraded":"2024-09-12T18:02:13.286617+0000","last_fullsized":"2024-09-12T18:02:13.286617+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'414","last_scrub_stamp":"2024-09-12T18:02:13.286513+0000","last_deep_scrub":"261'414","last_deep_scrub_stamp":"2024-09-12T18:02:13.286513+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.286513+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:01.693990+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2184,"num_read_kb":2068,"num_write":471,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"261'366","reported_seq":1116,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.241856+0000","last_change":"2024-09-12T18:02:02.241761+0000","last_active":"2024-09-12T18:02:02.241856+0000","last_peered":"2024-09-12T18:02:02.241856+0000","last_clean":"2024-09-12T18:02:02.241856+0000","last_became_active":"2024-09-12T17:23:40.712702+0000","last_became_peered":"2024-09-12T17:23:40.712702+0000","last_unstale":"2024-09-12T18:02:02.241856+0000","last_undegraded":"2024-09-12T18:02:02.241856+0000","last_fullsized":"2024-09-12T18:02:02.241856+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'366","last_scrub_stamp":"2024-09-12T18:02:02.241608+0000","last_deep_scrub":"261'366","last_deep_scrub_stamp":"2024-09-12T18:02:02.241608+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.241608+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:45.785430+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":720,"num_read_kb":69814,"num_write":1187,"num_write_kb":31106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"261'859","reported_seq":2451,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.138788+0000","last_change":"2024-09-12T18:02:10.138788+0000","last_active":"2024-09-12T18:02:10.138788+0000","last_peered":"2024-09-12T18:02:10.138788+0000","last_clean":"2024-09-12T18:02:10.138788+0000","last_became_active":"2024-09-12T17:23:42.141605+0000","last_became_peered":"2024-09-12T17:23:42.141605+0000","last_unstale":"2024-09-12T18:02:10.138788+0000","last_undegraded":"2024-09-12T18:02:10.138788+0000","last_fullsized":"2024-09-12T18:02:10.138788+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'859","last_scrub_stamp":"2024-09-12T18:02:10.138696+0000","last_deep_scrub":"261'859","last_deep_scrub_stamp":"2024-09-12T18:02:10.138696+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.138696+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:59.422337+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4009,"num_read_kb":3625,"num_write":1130,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"261'305","reported_seq":1040,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.036693+0000","last_change":"2024-09-12T18:01:59.036630+0000","last_active":"2024-09-12T18:01:59.036693+0000","last_peered":"2024-09-12T18:01:59.036693+0000","last_clean":"2024-09-12T18:01:59.036693+0000","last_became_active":"2024-09-12T17:23:40.715809+0000","last_became_peered":"2024-09-12T17:23:40.715809+0000","last_unstale":"2024-09-12T18:01:59.036693+0000","last_undegraded":"2024-09-12T18:01:59.036693+0000","last_fullsized":"2024-09-12T18:01:59.036693+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'305","last_scrub_stamp":"2024-09-12T18:01:59.036534+0000","last_deep_scrub":"261'305","last_deep_scrub_stamp":"2024-09-12T18:01:59.036534+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.036534+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:38.706923+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":740,"num_read_kb":58572,"num_write":1029,"num_write_kb":36244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"261'1243","reported_seq":2741,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.244580+0000","last_change":"2024-09-12T18:02:14.244580+0000","last_active":"2024-09-12T18:02:14.244580+0000","last_peered":"2024-09-12T18:02:14.244580+0000","last_clean":"2024-09-12T18:02:14.244580+0000","last_became_active":"2024-09-12T17:23:42.155489+0000","last_became_peered":"2024-09-12T17:23:42.155489+0000","last_unstale":"2024-09-12T18:02:14.244580+0000","last_undegraded":"2024-09-12T18:02:14.244580+0000","last_fullsized":"2024-09-12T18:02:14.244580+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1243","last_scrub_stamp":"2024-09-12T18:02:14.244473+0000","last_deep_scrub":"261'1243","last_deep_scrub_stamp":"2024-09-12T18:02:14.244473+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.244473+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:45.679516+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5619,"num_read_kb":4947,"num_write":1761,"num_write_kb":787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":756,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"261'369","reported_seq":1005,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.102061+0000","last_change":"2024-09-12T18:01:59.101987+0000","last_active":"2024-09-12T18:01:59.102061+0000","last_peered":"2024-09-12T18:01:59.102061+0000","last_clean":"2024-09-12T18:01:59.102061+0000","last_became_active":"2024-09-12T17:23:40.704582+0000","last_became_peered":"2024-09-12T17:23:40.704582+0000","last_unstale":"2024-09-12T18:01:59.102061+0000","last_undegraded":"2024-09-12T18:01:59.102061+0000","last_fullsized":"2024-09-12T18:01:59.102061+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'369","last_scrub_stamp":"2024-09-12T18:01:59.101815+0000","last_deep_scrub":"261'369","last_deep_scrub_stamp":"2024-09-12T18:01:59.101815+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.101815+0000","objects_scrubbed":8,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:05.038276+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5258296,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":535,"num_read_kb":13831,"num_write":1155,"num_write_kb":46857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"261'755","reported_seq":2394,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.168066+0000","last_change":"2024-09-12T18:02:09.168066+0000","last_active":"2024-09-12T18:02:09.168066+0000","last_peered":"2024-09-12T18:02:09.168066+0000","last_clean":"2024-09-12T18:02:09.168066+0000","last_became_active":"2024-09-12T17:23:42.141542+0000","last_became_peered":"2024-09-12T17:23:42.141542+0000","last_unstale":"2024-09-12T18:02:09.168066+0000","last_undegraded":"2024-09-12T18:02:09.168066+0000","last_fullsized":"2024-09-12T18:02:09.168066+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'755","last_scrub_stamp":"2024-09-12T18:02:09.167983+0000","last_deep_scrub":"261'755","last_deep_scrub_stamp":"2024-09-12T18:02:09.167983+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.167983+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:32.809383+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3956,"num_read_kb":3681,"num_write":1110,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"261'391","reported_seq":1039,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.073856+0000","last_change":"2024-09-12T18:02:04.073856+0000","last_active":"2024-09-12T18:02:04.073856+0000","last_peered":"2024-09-12T18:02:04.073856+0000","last_clean":"2024-09-12T18:02:04.073856+0000","last_became_active":"2024-09-12T17:24:17.227082+0000","last_became_peered":"2024-09-12T17:24:17.227082+0000","last_unstale":"2024-09-12T18:02:04.073856+0000","last_undegraded":"2024-09-12T18:02:04.073856+0000","last_fullsized":"2024-09-12T18:02:04.073856+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'391","last_scrub_stamp":"2024-09-12T18:02:04.073725+0000","last_deep_scrub":"261'391","last_deep_scrub_stamp":"2024-09-12T18:02:04.073725+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.073725+0000","objects_scrubbed":7,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:53.651302+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":638,"num_read_kb":9829,"num_write":1453,"num_write_kb":18369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"261'767","reported_seq":2170,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.572908+0000","last_change":"2024-09-12T18:02:09.572908+0000","last_active":"2024-09-12T18:02:09.572908+0000","last_peered":"2024-09-12T18:02:09.572908+0000","last_clean":"2024-09-12T18:02:09.572908+0000","last_became_active":"2024-09-12T17:23:42.155052+0000","last_became_peered":"2024-09-12T17:23:42.155052+0000","last_unstale":"2024-09-12T18:02:09.572908+0000","last_undegraded":"2024-09-12T18:02:09.572908+0000","last_fullsized":"2024-09-12T18:02:09.572908+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'767","last_scrub_stamp":"2024-09-12T18:02:09.572815+0000","last_deep_scrub":"261'767","last_deep_scrub_stamp":"2024-09-12T18:02:09.572815+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.572815+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:37.232559+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3588,"num_read_kb":3224,"num_write":1013,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"261'354","reported_seq":1128,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.257091+0000","last_change":"2024-09-12T18:02:05.257003+0000","last_active":"2024-09-12T18:02:05.257091+0000","last_peered":"2024-09-12T18:02:05.257091+0000","last_clean":"2024-09-12T18:02:05.257091+0000","last_became_active":"2024-09-12T17:23:40.707220+0000","last_became_peered":"2024-09-12T17:23:40.707220+0000","last_unstale":"2024-09-12T18:02:05.257091+0000","last_undegraded":"2024-09-12T18:02:05.257091+0000","last_fullsized":"2024-09-12T18:02:05.257091+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-12T18:02:05.256842+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-12T18:02:05.256842+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.256842+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:56.340735+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5635850,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":676,"num_read_kb":59084,"num_write":1125,"num_write_kb":27945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"261'440","reported_seq":1943,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.202872+0000","last_change":"2024-09-12T18:02:12.202872+0000","last_active":"2024-09-12T18:02:12.202872+0000","last_peered":"2024-09-12T18:02:12.202872+0000","last_clean":"2024-09-12T18:02:12.202872+0000","last_became_active":"2024-09-12T17:23:42.134859+0000","last_became_peered":"2024-09-12T17:23:42.134859+0000","last_unstale":"2024-09-12T18:02:12.202872+0000","last_undegraded":"2024-09-12T18:02:12.202872+0000","last_fullsized":"2024-09-12T18:02:12.202872+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'440","last_scrub_stamp":"2024-09-12T18:02:12.202782+0000","last_deep_scrub":"261'440","last_deep_scrub_stamp":"2024-09-12T18:02:12.202782+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.202782+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:10.816400+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2327,"num_read_kb":2188,"num_write":509,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"261'326","reported_seq":968,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.213894+0000","last_change":"2024-09-12T18:02:01.213894+0000","last_active":"2024-09-12T18:02:01.213894+0000","last_peered":"2024-09-12T18:02:01.213894+0000","last_clean":"2024-09-12T18:02:01.213894+0000","last_became_active":"2024-09-12T17:23:40.711042+0000","last_became_peered":"2024-09-12T17:23:40.711042+0000","last_unstale":"2024-09-12T18:02:01.213894+0000","last_undegraded":"2024-09-12T18:02:01.213894+0000","last_fullsized":"2024-09-12T18:02:01.213894+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-12T18:02:01.213797+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-12T18:02:01.213797+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.213797+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:05.849655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":531,"num_read_kb":6765,"num_write":1166,"num_write_kb":43884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"261'952","reported_seq":2519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.074553+0000","last_change":"2024-09-12T18:02:05.074553+0000","last_active":"2024-09-12T18:02:05.074553+0000","last_peered":"2024-09-12T18:02:05.074553+0000","last_clean":"2024-09-12T18:02:05.074553+0000","last_became_active":"2024-09-12T17:23:42.141379+0000","last_became_peered":"2024-09-12T17:23:42.141379+0000","last_unstale":"2024-09-12T18:02:05.074553+0000","last_undegraded":"2024-09-12T18:02:05.074553+0000","last_fullsized":"2024-09-12T18:02:05.074553+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'952","last_scrub_stamp":"2024-09-12T18:02:05.074457+0000","last_deep_scrub":"261'952","last_deep_scrub_stamp":"2024-09-12T18:02:05.074457+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.074457+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":900,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:43.879354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4545,"num_read_kb":4064,"num_write":1359,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"261'399","reported_seq":1034,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.207269+0000","last_change":"2024-09-12T18:02:06.207269+0000","last_active":"2024-09-12T18:02:06.207269+0000","last_peered":"2024-09-12T18:02:06.207269+0000","last_clean":"2024-09-12T18:02:06.207269+0000","last_became_active":"2024-09-12T17:23:40.702825+0000","last_became_peered":"2024-09-12T17:23:40.702825+0000","last_unstale":"2024-09-12T18:02:06.207269+0000","last_undegraded":"2024-09-12T18:02:06.207269+0000","last_fullsized":"2024-09-12T18:02:06.207269+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'399","last_scrub_stamp":"2024-09-12T18:02:06.207160+0000","last_deep_scrub":"261'399","last_deep_scrub_stamp":"2024-09-12T18:02:06.207160+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.207160+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:02.674525+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":642,"num_read_kb":543,"num_write":1172,"num_write_kb":8662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"261'400","reported_seq":1817,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.185744+0000","last_change":"2024-09-12T18:02:11.185744+0000","last_active":"2024-09-12T18:02:11.185744+0000","last_peered":"2024-09-12T18:02:11.185744+0000","last_clean":"2024-09-12T18:02:11.185744+0000","last_became_active":"2024-09-12T17:23:42.139735+0000","last_became_peered":"2024-09-12T17:23:42.139735+0000","last_unstale":"2024-09-12T18:02:11.185744+0000","last_undegraded":"2024-09-12T18:02:11.185744+0000","last_fullsized":"2024-09-12T18:02:11.185744+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'400","last_scrub_stamp":"2024-09-12T18:02:11.185659+0000","last_deep_scrub":"261'400","last_deep_scrub_stamp":"2024-09-12T18:02:11.185659+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.185659+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:20.796201+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2037,"num_read_kb":1920,"num_write":445,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"261'345","reported_seq":1015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.727921+0000","last_change":"2024-09-12T18:02:02.727921+0000","last_active":"2024-09-12T18:02:02.727921+0000","last_peered":"2024-09-12T18:02:02.727921+0000","last_clean":"2024-09-12T18:02:02.727921+0000","last_became_active":"2024-09-12T17:23:40.709392+0000","last_became_peered":"2024-09-12T17:23:40.709392+0000","last_unstale":"2024-09-12T18:02:02.727921+0000","last_undegraded":"2024-09-12T18:02:02.727921+0000","last_fullsized":"2024-09-12T18:02:02.727921+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'345","last_scrub_stamp":"2024-09-12T18:02:02.727811+0000","last_deep_scrub":"261'345","last_deep_scrub_stamp":"2024-09-12T18:02:02.727811+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.727811+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:55.006739+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":64698,"num_write":1140,"num_write_kb":39876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"261'1136","reported_seq":2677,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.696246+0000","last_change":"2024-09-12T18:02:13.696246+0000","last_active":"2024-09-12T18:02:13.696246+0000","last_peered":"2024-09-12T18:02:13.696246+0000","last_clean":"2024-09-12T18:02:13.696246+0000","last_became_active":"2024-09-12T17:23:42.154127+0000","last_became_peered":"2024-09-12T17:23:42.154127+0000","last_unstale":"2024-09-12T18:02:13.696246+0000","last_undegraded":"2024-09-12T18:02:13.696246+0000","last_fullsized":"2024-09-12T18:02:13.696246+0000","mapping_epoch":25,"log_start":"261'1100","ondisk_log_start":"261'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1136","last_scrub_stamp":"2024-09-12T18:02:13.696125+0000","last_deep_scrub":"261'1136","last_deep_scrub_stamp":"2024-09-12T18:02:13.696125+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.696125+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":1100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:51.177021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5169,"num_read_kb":4583,"num_write":1562,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"261'352","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.136792+0000","last_change":"2024-09-12T18:02:04.136792+0000","last_active":"2024-09-12T18:02:04.136792+0000","last_peered":"2024-09-12T18:02:04.136792+0000","last_clean":"2024-09-12T18:02:04.136792+0000","last_became_active":"2024-09-12T17:23:40.714343+0000","last_became_peered":"2024-09-12T17:23:40.714343+0000","last_unstale":"2024-09-12T18:02:04.136792+0000","last_undegraded":"2024-09-12T18:02:04.136792+0000","last_fullsized":"2024-09-12T18:02:04.136792+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'352","last_scrub_stamp":"2024-09-12T18:02:04.136686+0000","last_deep_scrub":"261'352","last_deep_scrub_stamp":"2024-09-12T18:02:04.136686+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.136686+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:10.141603+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":610,"num_read_kb":27408,"num_write":1219,"num_write_kb":25060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"261'997","reported_seq":2626,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.621762+0000","last_change":"2024-09-12T18:02:08.621762+0000","last_active":"2024-09-12T18:02:08.621762+0000","last_peered":"2024-09-12T18:02:08.621762+0000","last_clean":"2024-09-12T18:02:08.621762+0000","last_became_active":"2024-09-12T17:23:42.146107+0000","last_became_peered":"2024-09-12T17:23:42.146107+0000","last_unstale":"2024-09-12T18:02:08.621762+0000","last_undegraded":"2024-09-12T18:02:08.621762+0000","last_fullsized":"2024-09-12T18:02:08.621762+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'997","last_scrub_stamp":"2024-09-12T18:02:08.621665+0000","last_deep_scrub":"261'997","last_deep_scrub_stamp":"2024-09-12T18:02:08.621665+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.621665+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.465820+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4676,"num_read_kb":4145,"num_write":1343,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"261'339","reported_seq":990,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.782950+0000","last_change":"2024-09-12T18:02:06.782877+0000","last_active":"2024-09-12T18:02:06.782950+0000","last_peered":"2024-09-12T18:02:06.782950+0000","last_clean":"2024-09-12T18:02:06.782950+0000","last_became_active":"2024-09-12T17:23:40.706951+0000","last_became_peered":"2024-09-12T17:23:40.706951+0000","last_unstale":"2024-09-12T18:02:06.782950+0000","last_undegraded":"2024-09-12T18:02:06.782950+0000","last_fullsized":"2024-09-12T18:02:06.782950+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'339","last_scrub_stamp":"2024-09-12T18:02:06.782780+0000","last_deep_scrub":"261'339","last_deep_scrub_stamp":"2024-09-12T18:02:06.782780+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.782780+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:28.262679+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918016,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":7215,"num_write":977,"num_write_kb":28374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"261'492","reported_seq":2005,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.279046+0000","last_change":"2024-09-12T18:02:18.279046+0000","last_active":"2024-09-12T18:02:18.279046+0000","last_peered":"2024-09-12T18:02:18.279046+0000","last_clean":"2024-09-12T18:02:18.279046+0000","last_became_active":"2024-09-12T17:23:42.152999+0000","last_became_peered":"2024-09-12T17:23:42.152999+0000","last_unstale":"2024-09-12T18:02:18.279046+0000","last_undegraded":"2024-09-12T18:02:18.279046+0000","last_fullsized":"2024-09-12T18:02:18.279046+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'492","last_scrub_stamp":"2024-09-12T18:02:18.278979+0000","last_deep_scrub":"261'492","last_deep_scrub_stamp":"2024-09-12T18:02:18.278979+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.278979+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:08.961069+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2525,"num_read_kb":2342,"num_write":624,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":739,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"261'358","reported_seq":983,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.987950+0000","last_change":"2024-09-12T18:01:58.987950+0000","last_active":"2024-09-12T18:01:58.987950+0000","last_peered":"2024-09-12T18:01:58.987950+0000","last_clean":"2024-09-12T18:01:58.987950+0000","last_became_active":"2024-09-12T17:23:40.704585+0000","last_became_peered":"2024-09-12T17:23:40.704585+0000","last_unstale":"2024-09-12T18:01:58.987950+0000","last_undegraded":"2024-09-12T18:01:58.987950+0000","last_fullsized":"2024-09-12T18:01:58.987950+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'358","last_scrub_stamp":"2024-09-12T18:01:58.987801+0000","last_deep_scrub":"261'358","last_deep_scrub_stamp":"2024-09-12T18:01:58.987801+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.987801+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:52.057616+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262306,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":466,"num_read_kb":452,"num_write":1104,"num_write_kb":34111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"261'445","reported_seq":2035,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.717603+0000","last_change":"2024-09-12T18:02:10.717537+0000","last_active":"2024-09-12T18:02:10.717603+0000","last_peered":"2024-09-12T18:02:10.717603+0000","last_clean":"2024-09-12T18:02:10.717603+0000","last_became_active":"2024-09-12T17:23:42.154367+0000","last_became_peered":"2024-09-12T17:23:42.154367+0000","last_unstale":"2024-09-12T18:02:10.717603+0000","last_undegraded":"2024-09-12T18:02:10.717603+0000","last_fullsized":"2024-09-12T18:02:10.717603+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'445","last_scrub_stamp":"2024-09-12T18:02:10.717445+0000","last_deep_scrub":"261'445","last_deep_scrub_stamp":"2024-09-12T18:02:10.717445+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.717445+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:16.473683+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2387,"num_read_kb":2268,"num_write":501,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"261'401","reported_seq":1012,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.992526+0000","last_change":"2024-09-12T18:02:00.992526+0000","last_active":"2024-09-12T18:02:00.992526+0000","last_peered":"2024-09-12T18:02:00.992526+0000","last_clean":"2024-09-12T18:02:00.992526+0000","last_became_active":"2024-09-12T17:24:17.287516+0000","last_became_peered":"2024-09-12T17:24:17.287516+0000","last_unstale":"2024-09-12T18:02:00.992526+0000","last_undegraded":"2024-09-12T18:02:00.992526+0000","last_fullsized":"2024-09-12T18:02:00.992526+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'401","last_scrub_stamp":"2024-09-12T18:02:00.992392+0000","last_deep_scrub":"261'401","last_deep_scrub_stamp":"2024-09-12T18:02:00.992392+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.992392+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:29.409874+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":2150,"num_write":1211,"num_write_kb":17735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"261'371","reported_seq":1063,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.201850+0000","last_change":"2024-09-12T18:02:07.201850+0000","last_active":"2024-09-12T18:02:07.201850+0000","last_peered":"2024-09-12T18:02:07.201850+0000","last_clean":"2024-09-12T18:02:07.201850+0000","last_became_active":"2024-09-12T17:23:40.705975+0000","last_became_peered":"2024-09-12T17:23:40.705975+0000","last_unstale":"2024-09-12T18:02:07.201850+0000","last_undegraded":"2024-09-12T18:02:07.201850+0000","last_fullsized":"2024-09-12T18:02:07.201850+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'371","last_scrub_stamp":"2024-09-12T18:02:07.201750+0000","last_deep_scrub":"261'371","last_deep_scrub_stamp":"2024-09-12T18:02:07.201750+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.201750+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:00.288303+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102345,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":38544,"num_write":1177,"num_write_kb":29966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"261'892","reported_seq":2663,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.600938+0000","last_change":"2024-09-12T18:02:10.600768+0000","last_active":"2024-09-12T18:02:10.600938+0000","last_peered":"2024-09-12T18:02:10.600938+0000","last_clean":"2024-09-12T18:02:10.600938+0000","last_became_active":"2024-09-12T17:23:42.155431+0000","last_became_peered":"2024-09-12T17:23:42.155431+0000","last_unstale":"2024-09-12T18:02:10.600938+0000","last_undegraded":"2024-09-12T18:02:10.600938+0000","last_fullsized":"2024-09-12T18:02:10.600938+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'892","last_scrub_stamp":"2024-09-12T18:02:10.600663+0000","last_deep_scrub":"261'892","last_deep_scrub_stamp":"2024-09-12T18:02:10.600663+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.600663+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:56.558490+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4337,"num_read_kb":3945,"num_write":1177,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"261'325","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.090071+0000","last_change":"2024-09-12T18:02:01.090071+0000","last_active":"2024-09-12T18:02:01.090071+0000","last_peered":"2024-09-12T18:02:01.090071+0000","last_clean":"2024-09-12T18:02:01.090071+0000","last_became_active":"2024-09-12T17:23:40.713729+0000","last_became_peered":"2024-09-12T17:23:40.713729+0000","last_unstale":"2024-09-12T18:02:01.090071+0000","last_undegraded":"2024-09-12T18:02:01.090071+0000","last_fullsized":"2024-09-12T18:02:01.090071+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'325","last_scrub_stamp":"2024-09-12T18:02:01.089958+0000","last_deep_scrub":"261'325","last_deep_scrub_stamp":"2024-09-12T18:02:01.089958+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.089958+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:09.856184+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6690697,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":468,"num_read_kb":88924,"num_write":1000,"num_write_kb":31954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"261'921","reported_seq":2516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.238043+0000","last_change":"2024-09-12T18:02:15.237983+0000","last_active":"2024-09-12T18:02:15.238043+0000","last_peered":"2024-09-12T18:02:15.238043+0000","last_clean":"2024-09-12T18:02:15.238043+0000","last_became_active":"2024-09-12T17:23:42.151035+0000","last_became_peered":"2024-09-12T17:23:42.151035+0000","last_unstale":"2024-09-12T18:02:15.238043+0000","last_undegraded":"2024-09-12T18:02:15.238043+0000","last_fullsized":"2024-09-12T18:02:15.238043+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'921","last_scrub_stamp":"2024-09-12T18:02:15.237888+0000","last_deep_scrub":"261'921","last_deep_scrub_stamp":"2024-09-12T18:02:15.237888+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.237888+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":900,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:05.656909+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4231,"num_read_kb":3788,"num_write":1202,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6418,"num_read_kb":4664,"num_write":2041,"num_write_kb":938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1872,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1113,"ondisk_log_size":1113,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16069,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16200,"num_read_kb":15888,"num_write":16774,"num_write_kb":4891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2861,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1741,"ondisk_log_size":1741,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":693,"ondisk_log_size":693,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1568925,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":16943,"num_read_kb":36201,"num_write":14185,"num_write_kb":11429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685458,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2166,"ondisk_log_size":2166,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2424,"num_read_kb":2890,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212759,"num_read_kb":194564,"num_write":55413,"num_write_kb":18856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43832,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3805,"ondisk_log_size":3805,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":82077927,"num_objects":360,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":360,"num_whiteouts":0,"num_read":36160,"num_read_kb":2097994,"num_write":72463,"num_write_kb":2176823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":165306368,"data_stored":164155854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3742,"ondisk_log_size":3742,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":196116,"num_write":158,"num_write_kb":127401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":185777,"num_write":158,"num_write_kb":127401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509917,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313532,"kb_used_data":39404,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94058308,"statfs":{"total":96636764160,"available":96315707392,"internally_reserved":0,"allocated":40349696,"data_stored":38689531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509917,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263556,"kb_used_data":11636,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94108284,"statfs":{"total":96636764160,"available":96366882816,"internally_reserved":0,"allocated":11915264,"data_stored":10326315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509918,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":154452,"kb_used_data":28932,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94217388,"statfs":{"total":96636764160,"available":96478605312,"internally_reserved":0,"allocated":29626368,"data_stored":27895637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509918,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108528,"kb_used_data":23200,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94263312,"statfs":{"total":96636764160,"available":96525631488,"internally_reserved":0,"allocated":23756800,"data_stored":22112034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509917,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157492,"kb_used_data":13924,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94214348,"statfs":{"total":96636764160,"available":96475492352,"internally_reserved":0,"allocated":14258176,"data_stored":12683013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509919,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":277444,"kb_used_data":21428,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":94094396,"statfs":{"total":96636764160,"available":96352661504,"internally_reserved":0,"allocated":21942272,"data_stored":20239121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262142407},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542623,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300444,"kb_used_data":30540,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":94071396,"statfs":{"total":96636764160,"available":96329109504,"internally_reserved":0,"allocated":31272960,"data_stored":29588476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276363719},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542624,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111216,"kb_used_data":21792,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94260624,"statfs":{"total":96636764160,"available":96522878976,"internally_reserved":0,"allocated":22315008,"data_stored":20755157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17715200,"data_stored":17530392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10657792,"data_stored":10563849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18726912,"data_stored":18636740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27639808,"data_stored":27468954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20172800,"data_stored":19992871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25960448,"data_stored":25776028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8314880,"data_stored":8207763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36118528,"data_stored":35979257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":3790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:59.163 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:59.164 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:59.164 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:50:57.390797+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=50, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:02:59.168 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:03:19.169 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:03:19.521 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T18:03:19.533 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-12T18:03:19.535 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":1452,"stamp":"2024-09-12T18:03:18.519229+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":84255101,"num_objects":839,"num_object_clones":0,"num_object_copies":1678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":839,"num_whiteouts":0,"num_read":291262,"num_read_kb":2734161,"num_write":161335,"num_write_kb":2469395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":735151,"num_omap_keys":1780,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13565,"ondisk_log_size":13565,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1686664,"kb_used_data":190856,"kb_used_omap":12,"kb_used_meta":1495667,"kb_avail":753288056,"statfs":{"total":773094113280,"available":771366969344,"internally_reserved":0,"allocated":195436544,"data_stored":182289284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1531563571},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004795"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:45.293029+0000","last_change":"2024-09-12T18:02:45.293029+0000","last_active":"2024-09-12T18:02:45.293029+0000","last_peered":"2024-09-12T18:02:45.293029+0000","last_clean":"2024-09-12T18:02:45.293029+0000","last_became_active":"2024-09-12T17:50:58.430327+0000","last_became_peered":"2024-09-12T17:50:58.430327+0000","last_unstale":"2024-09-12T18:02:45.293029+0000","last_undegraded":"2024-09-12T18:02:45.293029+0000","last_fullsized":"2024-09-12T18:02:45.293029+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:45.292938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:45.292938+0000","last_clean_scrub_stamp":"2024-09-12T18:02:45.292938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:48.547960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"261'11","reported_seq":61,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.217122+0000","last_change":"2024-09-12T18:02:42.217068+0000","last_active":"2024-09-12T18:02:42.217122+0000","last_peered":"2024-09-12T18:02:42.217122+0000","last_clean":"2024-09-12T18:02:42.217122+0000","last_became_active":"2024-09-12T17:40:30.413466+0000","last_became_peered":"2024-09-12T17:40:30.413466+0000","last_unstale":"2024-09-12T18:02:42.217122+0000","last_undegraded":"2024-09-12T18:02:42.217122+0000","last_fullsized":"2024-09-12T18:02:42.217122+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-09-12T18:02:42.216981+0000","last_deep_scrub":"261'11","last_deep_scrub_stamp":"2024-09-12T18:02:42.216981+0000","last_clean_scrub_stamp":"2024-09-12T18:02:42.216981+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:29.146865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14338,"num_write":26,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'2","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:45.483918+0000","last_change":"2024-09-12T18:02:45.483859+0000","last_active":"2024-09-12T18:02:45.483918+0000","last_peered":"2024-09-12T18:02:45.483918+0000","last_clean":"2024-09-12T18:02:45.483918+0000","last_became_active":"2024-09-12T17:40:27.384052+0000","last_became_peered":"2024-09-12T17:40:27.384052+0000","last_unstale":"2024-09-12T18:02:45.483918+0000","last_undegraded":"2024-09-12T18:02:45.483918+0000","last_fullsized":"2024-09-12T18:02:45.483918+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:45.483762+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:45.483762+0000","last_clean_scrub_stamp":"2024-09-12T18:02:45.483762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:58.064918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"261'181","reported_seq":613,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:39.641423+0000","last_change":"2024-09-12T18:02:39.641423+0000","last_active":"2024-09-12T18:02:39.641423+0000","last_peered":"2024-09-12T18:02:39.641423+0000","last_clean":"2024-09-12T18:02:39.641423+0000","last_became_active":"2024-09-12T17:38:51.208740+0000","last_became_peered":"2024-09-12T17:38:51.208740+0000","last_unstale":"2024-09-12T18:02:39.641423+0000","last_undegraded":"2024-09-12T18:02:39.641423+0000","last_fullsized":"2024-09-12T18:02:39.641423+0000","mapping_epoch":248,"log_start":"258'100","ondisk_log_start":"258'100","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'181","last_scrub_stamp":"2024-09-12T18:02:39.641319+0000","last_deep_scrub":"261'181","last_deep_scrub_stamp":"2024-09-12T18:02:39.641319+0000","last_clean_scrub_stamp":"2024-09-12T18:02:39.641319+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:52:32.958550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1105,"num_read_kb":819,"num_write":215,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1872,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.054688+0000","last_change":"2024-09-12T18:02:25.054688+0000","last_active":"2024-09-12T18:02:25.054688+0000","last_peered":"2024-09-12T18:02:25.054688+0000","last_clean":"2024-09-12T18:02:25.054688+0000","last_became_active":"2024-09-12T17:50:58.429172+0000","last_became_peered":"2024-09-12T17:50:58.429172+0000","last_unstale":"2024-09-12T18:02:25.054688+0000","last_undegraded":"2024-09-12T18:02:25.054688+0000","last_fullsized":"2024-09-12T18:02:25.054688+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:25.054583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:25.054583+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.054583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:48.707684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.997121+0000","last_change":"2024-09-12T18:02:42.997049+0000","last_active":"2024-09-12T18:02:42.997121+0000","last_peered":"2024-09-12T18:02:42.997121+0000","last_clean":"2024-09-12T18:02:42.997121+0000","last_became_active":"2024-09-12T17:40:30.419270+0000","last_became_peered":"2024-09-12T17:40:30.419270+0000","last_unstale":"2024-09-12T18:02:42.997121+0000","last_undegraded":"2024-09-12T18:02:42.997121+0000","last_fullsized":"2024-09-12T18:02:42.997121+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:42.996937+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:42.996937+0000","last_clean_scrub_stamp":"2024-09-12T18:02:42.996937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:57.188810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.913901+0000","last_change":"2024-09-12T18:02:29.913848+0000","last_active":"2024-09-12T18:02:29.913901+0000","last_peered":"2024-09-12T18:02:29.913901+0000","last_clean":"2024-09-12T18:02:29.913901+0000","last_became_active":"2024-09-12T17:40:27.383464+0000","last_became_peered":"2024-09-12T17:40:27.383464+0000","last_unstale":"2024-09-12T18:02:29.913901+0000","last_undegraded":"2024-09-12T18:02:29.913901+0000","last_fullsized":"2024-09-12T18:02:29.913901+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:29.913762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:29.913762+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.913762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:04.461544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"261'20","reported_seq":107,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.018192+0000","last_change":"2024-09-12T18:02:17.018133+0000","last_active":"2024-09-12T18:02:17.018192+0000","last_peered":"2024-09-12T18:02:17.018192+0000","last_clean":"2024-09-12T18:02:17.018192+0000","last_became_active":"2024-09-12T17:38:51.217312+0000","last_became_peered":"2024-09-12T17:38:51.217312+0000","last_unstale":"2024-09-12T18:02:17.018192+0000","last_undegraded":"2024-09-12T18:02:17.018192+0000","last_fullsized":"2024-09-12T18:02:17.018192+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'20","last_scrub_stamp":"2024-09-12T18:02:17.018046+0000","last_deep_scrub":"261'20","last_deep_scrub_stamp":"2024-09-12T18:02:17.018046+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.018046+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:10.005857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":68,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.944849+0000","last_change":"2024-09-12T18:02:33.944792+0000","last_active":"2024-09-12T18:02:33.944849+0000","last_peered":"2024-09-12T18:02:33.944849+0000","last_clean":"2024-09-12T18:02:33.944849+0000","last_became_active":"2024-09-12T17:50:58.425202+0000","last_became_peered":"2024-09-12T17:50:58.425202+0000","last_unstale":"2024-09-12T18:02:33.944849+0000","last_undegraded":"2024-09-12T18:02:33.944849+0000","last_fullsized":"2024-09-12T18:02:33.944849+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:33.944707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:33.944707+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.944707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:05.234661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:48.773661+0000","last_change":"2024-09-12T18:02:48.773661+0000","last_active":"2024-09-12T18:02:48.773661+0000","last_peered":"2024-09-12T18:02:48.773661+0000","last_clean":"2024-09-12T18:02:48.773661+0000","last_became_active":"2024-09-12T17:40:30.427798+0000","last_became_peered":"2024-09-12T17:40:30.427798+0000","last_unstale":"2024-09-12T18:02:48.773661+0000","last_undegraded":"2024-09-12T18:02:48.773661+0000","last_fullsized":"2024-09-12T18:02:48.773661+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:48.773564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:48.773564+0000","last_clean_scrub_stamp":"2024-09-12T18:02:48.773564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:40.815093+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.981318+0000","last_change":"2024-09-12T18:02:20.981243+0000","last_active":"2024-09-12T18:02:20.981318+0000","last_peered":"2024-09-12T18:02:20.981318+0000","last_clean":"2024-09-12T18:02:20.981318+0000","last_became_active":"2024-09-12T17:40:27.381456+0000","last_became_peered":"2024-09-12T17:40:27.381456+0000","last_unstale":"2024-09-12T18:02:20.981318+0000","last_undegraded":"2024-09-12T18:02:20.981318+0000","last_fullsized":"2024-09-12T18:02:20.981318+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:20.981153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:20.981153+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.981153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:22.793630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"261'39","reported_seq":154,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:38.642043+0000","last_change":"2024-09-12T18:02:38.642043+0000","last_active":"2024-09-12T18:02:38.642043+0000","last_peered":"2024-09-12T18:02:38.642043+0000","last_clean":"2024-09-12T18:02:38.642043+0000","last_became_active":"2024-09-12T17:38:51.212222+0000","last_became_peered":"2024-09-12T17:38:51.212222+0000","last_unstale":"2024-09-12T18:02:38.642043+0000","last_undegraded":"2024-09-12T18:02:38.642043+0000","last_fullsized":"2024-09-12T18:02:38.642043+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'39","last_scrub_stamp":"2024-09-12T18:02:38.641976+0000","last_deep_scrub":"261'39","last_deep_scrub_stamp":"2024-09-12T18:02:38.641976+0000","last_clean_scrub_stamp":"2024-09-12T18:02:38.641976+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:28.692108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":132,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:58.582420+0000","last_change":"2024-09-12T18:02:58.582344+0000","last_active":"2024-09-12T18:02:58.582420+0000","last_peered":"2024-09-12T18:02:58.582420+0000","last_clean":"2024-09-12T18:02:58.582420+0000","last_became_active":"2024-09-12T17:50:58.421791+0000","last_became_peered":"2024-09-12T17:50:58.421791+0000","last_unstale":"2024-09-12T18:02:58.582420+0000","last_undegraded":"2024-09-12T18:02:58.582420+0000","last_fullsized":"2024-09-12T18:02:58.582420+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:58.582248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:58.582248+0000","last_clean_scrub_stamp":"2024-09-12T18:02:58.582248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:35.495885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:49.803736+0000","last_change":"2024-09-12T18:02:49.803736+0000","last_active":"2024-09-12T18:02:49.803736+0000","last_peered":"2024-09-12T18:02:49.803736+0000","last_clean":"2024-09-12T18:02:49.803736+0000","last_became_active":"2024-09-12T17:41:17.634263+0000","last_became_peered":"2024-09-12T17:41:17.634263+0000","last_unstale":"2024-09-12T18:02:49.803736+0000","last_undegraded":"2024-09-12T18:02:49.803736+0000","last_fullsized":"2024-09-12T18:02:49.803736+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:49.803633+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:49.803633+0000","last_clean_scrub_stamp":"2024-09-12T18:02:49.803633+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:11.325665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1f","version":"261'2","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:39.012863+0000","last_change":"2024-09-12T18:02:39.012863+0000","last_active":"2024-09-12T18:02:39.012863+0000","last_peered":"2024-09-12T18:02:39.012863+0000","last_clean":"2024-09-12T18:02:39.012863+0000","last_became_active":"2024-09-12T17:40:27.381587+0000","last_became_peered":"2024-09-12T17:40:27.381587+0000","last_unstale":"2024-09-12T18:02:39.012863+0000","last_undegraded":"2024-09-12T18:02:39.012863+0000","last_fullsized":"2024-09-12T18:02:39.012863+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:39.012757+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:39.012757+0000","last_clean_scrub_stamp":"2024-09-12T18:02:39.012757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:02.900671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"261'16","reported_seq":94,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:44.512601+0000","last_change":"2024-09-12T18:02:44.512601+0000","last_active":"2024-09-12T18:02:44.512601+0000","last_peered":"2024-09-12T18:02:44.512601+0000","last_clean":"2024-09-12T18:02:44.512601+0000","last_became_active":"2024-09-12T17:38:51.211429+0000","last_became_peered":"2024-09-12T17:38:51.211429+0000","last_unstale":"2024-09-12T18:02:44.512601+0000","last_undegraded":"2024-09-12T18:02:44.512601+0000","last_fullsized":"2024-09-12T18:02:44.512601+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'16","last_scrub_stamp":"2024-09-12T18:02:44.512505+0000","last_deep_scrub":"261'16","last_deep_scrub_stamp":"2024-09-12T18:02:44.512505+0000","last_clean_scrub_stamp":"2024-09-12T18:02:44.512505+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:23.903761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":53,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:57.550031+0000","last_change":"2024-09-12T18:02:57.549952+0000","last_active":"2024-09-12T18:02:57.550031+0000","last_peered":"2024-09-12T18:02:57.550031+0000","last_clean":"2024-09-12T18:02:57.550031+0000","last_became_active":"2024-09-12T17:50:58.424898+0000","last_became_peered":"2024-09-12T17:50:58.424898+0000","last_unstale":"2024-09-12T18:02:57.550031+0000","last_undegraded":"2024-09-12T18:02:57.550031+0000","last_fullsized":"2024-09-12T18:02:57.550031+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:57.549856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:57.549856+0000","last_clean_scrub_stamp":"2024-09-12T18:02:57.549856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:53.064777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.250507+0000","last_change":"2024-09-12T18:02:41.250507+0000","last_active":"2024-09-12T18:02:41.250507+0000","last_peered":"2024-09-12T18:02:41.250507+0000","last_clean":"2024-09-12T18:02:41.250507+0000","last_became_active":"2024-09-12T17:40:30.418865+0000","last_became_peered":"2024-09-12T17:40:30.418865+0000","last_unstale":"2024-09-12T18:02:41.250507+0000","last_undegraded":"2024-09-12T18:02:41.250507+0000","last_fullsized":"2024-09-12T18:02:41.250507+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:41.250421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:41.250421+0000","last_clean_scrub_stamp":"2024-09-12T18:02:41.250421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:12.331609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'8","reported_seq":64,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:44.661103+0000","last_change":"2024-09-12T18:02:44.661103+0000","last_active":"2024-09-12T18:02:44.661103+0000","last_peered":"2024-09-12T18:02:44.661103+0000","last_clean":"2024-09-12T18:02:44.661103+0000","last_became_active":"2024-09-12T17:40:27.384445+0000","last_became_peered":"2024-09-12T17:40:27.384445+0000","last_unstale":"2024-09-12T18:02:44.661103+0000","last_undegraded":"2024-09-12T18:02:44.661103+0000","last_fullsized":"2024-09-12T18:02:44.661103+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T18:02:44.661020+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T18:02:44.661020+0000","last_clean_scrub_stamp":"2024-09-12T18:02:44.661020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:12.098427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"261'42","reported_seq":167,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.489325+0000","last_change":"2024-09-12T18:02:41.489325+0000","last_active":"2024-09-12T18:02:41.489325+0000","last_peered":"2024-09-12T18:02:41.489325+0000","last_clean":"2024-09-12T18:02:41.489325+0000","last_became_active":"2024-09-12T17:38:51.217421+0000","last_became_peered":"2024-09-12T17:38:51.217421+0000","last_unstale":"2024-09-12T18:02:41.489325+0000","last_undegraded":"2024-09-12T18:02:41.489325+0000","last_fullsized":"2024-09-12T18:02:41.489325+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'42","last_scrub_stamp":"2024-09-12T18:02:41.489237+0000","last_deep_scrub":"261'42","last_deep_scrub_stamp":"2024-09-12T18:02:41.489237+0000","last_clean_scrub_stamp":"2024-09-12T18:02:41.489237+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:39.547261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":155,"num_write":73,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:37.775204+0000","last_change":"2024-09-12T18:02:37.775204+0000","last_active":"2024-09-12T18:02:37.775204+0000","last_peered":"2024-09-12T18:02:37.775204+0000","last_clean":"2024-09-12T18:02:37.775204+0000","last_became_active":"2024-09-12T17:50:58.421760+0000","last_became_peered":"2024-09-12T17:50:58.421760+0000","last_unstale":"2024-09-12T18:02:37.775204+0000","last_undegraded":"2024-09-12T18:02:37.775204+0000","last_fullsized":"2024-09-12T18:02:37.775204+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:37.775117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:37.775117+0000","last_clean_scrub_stamp":"2024-09-12T18:02:37.775117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:43.855363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.887608+0000","last_change":"2024-09-12T18:02:30.887608+0000","last_active":"2024-09-12T18:02:30.887608+0000","last_peered":"2024-09-12T18:02:30.887608+0000","last_clean":"2024-09-12T18:02:30.887608+0000","last_became_active":"2024-09-12T17:40:30.417372+0000","last_became_peered":"2024-09-12T17:40:30.417372+0000","last_unstale":"2024-09-12T18:02:30.887608+0000","last_undegraded":"2024-09-12T18:02:30.887608+0000","last_fullsized":"2024-09-12T18:02:30.887608+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:30.887486+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:30.887486+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.887486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:48.515535+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"258'2","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:37.029696+0000","last_change":"2024-09-12T18:02:37.029696+0000","last_active":"2024-09-12T18:02:37.029696+0000","last_peered":"2024-09-12T18:02:37.029696+0000","last_clean":"2024-09-12T18:02:37.029696+0000","last_became_active":"2024-09-12T17:40:27.379161+0000","last_became_peered":"2024-09-12T17:40:27.379161+0000","last_unstale":"2024-09-12T18:02:37.029696+0000","last_undegraded":"2024-09-12T18:02:37.029696+0000","last_fullsized":"2024-09-12T18:02:37.029696+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-12T18:02:37.029610+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-12T18:02:37.029610+0000","last_clean_scrub_stamp":"2024-09-12T18:02:37.029610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:10.431337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"261'20","reported_seq":106,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.989175+0000","last_change":"2024-09-12T18:02:25.989175+0000","last_active":"2024-09-12T18:02:25.989175+0000","last_peered":"2024-09-12T18:02:25.989175+0000","last_clean":"2024-09-12T18:02:25.989175+0000","last_became_active":"2024-09-12T17:38:51.214555+0000","last_became_peered":"2024-09-12T17:38:51.214555+0000","last_unstale":"2024-09-12T18:02:25.989175+0000","last_undegraded":"2024-09-12T18:02:25.989175+0000","last_fullsized":"2024-09-12T18:02:25.989175+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'20","last_scrub_stamp":"2024-09-12T18:02:25.989086+0000","last_deep_scrub":"261'20","last_deep_scrub_stamp":"2024-09-12T18:02:25.989086+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.989086+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:21.310126+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"261'2","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:54.670923+0000","last_change":"2024-09-12T18:02:54.670923+0000","last_active":"2024-09-12T18:02:54.670923+0000","last_peered":"2024-09-12T18:02:54.670923+0000","last_clean":"2024-09-12T18:02:54.670923+0000","last_became_active":"2024-09-12T17:50:58.429381+0000","last_became_peered":"2024-09-12T17:50:58.429381+0000","last_unstale":"2024-09-12T18:02:54.670923+0000","last_undegraded":"2024-09-12T18:02:54.670923+0000","last_fullsized":"2024-09-12T18:02:54.670923+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:54.670822+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:54.670822+0000","last_clean_scrub_stamp":"2024-09-12T18:02:54.670822+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:58.205016+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.882216+0000","last_change":"2024-09-12T18:02:31.882157+0000","last_active":"2024-09-12T18:02:31.882216+0000","last_peered":"2024-09-12T18:02:31.882216+0000","last_clean":"2024-09-12T18:02:31.882216+0000","last_became_active":"2024-09-12T17:40:30.420165+0000","last_became_peered":"2024-09-12T17:40:30.420165+0000","last_unstale":"2024-09-12T18:02:31.882216+0000","last_undegraded":"2024-09-12T18:02:31.882216+0000","last_fullsized":"2024-09-12T18:02:31.882216+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:31.882070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:31.882070+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.882070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:43.238046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"261'3","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:37.986042+0000","last_change":"2024-09-12T18:02:37.985954+0000","last_active":"2024-09-12T18:02:37.986042+0000","last_peered":"2024-09-12T18:02:37.986042+0000","last_clean":"2024-09-12T18:02:37.986042+0000","last_became_active":"2024-09-12T17:40:27.382310+0000","last_became_peered":"2024-09-12T17:40:27.382310+0000","last_unstale":"2024-09-12T18:02:37.986042+0000","last_undegraded":"2024-09-12T18:02:37.986042+0000","last_fullsized":"2024-09-12T18:02:37.986042+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:37.985817+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:37.985817+0000","last_clean_scrub_stamp":"2024-09-12T18:02:37.985817+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:56.208504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"261'83","reported_seq":285,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:37.644161+0000","last_change":"2024-09-12T18:02:37.644099+0000","last_active":"2024-09-12T18:02:37.644161+0000","last_peered":"2024-09-12T18:02:37.644161+0000","last_clean":"2024-09-12T18:02:37.644161+0000","last_became_active":"2024-09-12T17:38:51.213569+0000","last_became_peered":"2024-09-12T17:38:51.213569+0000","last_unstale":"2024-09-12T18:02:37.644161+0000","last_undegraded":"2024-09-12T18:02:37.644161+0000","last_fullsized":"2024-09-12T18:02:37.644161+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'83","last_scrub_stamp":"2024-09-12T18:02:37.644012+0000","last_deep_scrub":"261'83","last_deep_scrub_stamp":"2024-09-12T18:02:37.644012+0000","last_clean_scrub_stamp":"2024-09-12T18:02:37.644012+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:35.136801+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":443,"num_read_kb":326,"num_write":140,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:53.693301+0000","last_change":"2024-09-12T18:02:53.693301+0000","last_active":"2024-09-12T18:02:53.693301+0000","last_peered":"2024-09-12T18:02:53.693301+0000","last_clean":"2024-09-12T18:02:53.693301+0000","last_became_active":"2024-09-12T17:50:58.431242+0000","last_became_peered":"2024-09-12T17:50:58.431242+0000","last_unstale":"2024-09-12T18:02:53.693301+0000","last_undegraded":"2024-09-12T18:02:53.693301+0000","last_fullsized":"2024-09-12T18:02:53.693301+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:53.693204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:53.693204+0000","last_clean_scrub_stamp":"2024-09-12T18:02:53.693204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:37.575686+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"261'2","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:53.472769+0000","last_change":"2024-09-12T18:02:53.472680+0000","last_active":"2024-09-12T18:02:53.472769+0000","last_peered":"2024-09-12T18:02:53.472769+0000","last_clean":"2024-09-12T18:02:53.472769+0000","last_became_active":"2024-09-12T17:40:30.416973+0000","last_became_peered":"2024-09-12T17:40:30.416973+0000","last_unstale":"2024-09-12T18:02:53.472769+0000","last_undegraded":"2024-09-12T18:02:53.472769+0000","last_fullsized":"2024-09-12T18:02:53.472769+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:53.472583+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:53.472583+0000","last_clean_scrub_stamp":"2024-09-12T18:02:53.472583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:01.333821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"258'6","reported_seq":58,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:45.698149+0000","last_change":"2024-09-12T18:02:45.698029+0000","last_active":"2024-09-12T18:02:45.698149+0000","last_peered":"2024-09-12T18:02:45.698149+0000","last_clean":"2024-09-12T18:02:45.698149+0000","last_became_active":"2024-09-12T17:40:27.383589+0000","last_became_peered":"2024-09-12T17:40:27.383589+0000","last_unstale":"2024-09-12T18:02:45.698149+0000","last_undegraded":"2024-09-12T18:02:45.698149+0000","last_fullsized":"2024-09-12T18:02:45.698149+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'6","last_scrub_stamp":"2024-09-12T18:02:45.697922+0000","last_deep_scrub":"258'6","last_deep_scrub_stamp":"2024-09-12T18:02:45.697922+0000","last_clean_scrub_stamp":"2024-09-12T18:02:45.697922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:27.714994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"261'40","reported_seq":158,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.928443+0000","last_change":"2024-09-12T18:02:25.928364+0000","last_active":"2024-09-12T18:02:25.928443+0000","last_peered":"2024-09-12T18:02:25.928443+0000","last_clean":"2024-09-12T18:02:25.928443+0000","last_became_active":"2024-09-12T17:38:51.211962+0000","last_became_peered":"2024-09-12T17:38:51.211962+0000","last_unstale":"2024-09-12T18:02:25.928443+0000","last_undegraded":"2024-09-12T18:02:25.928443+0000","last_fullsized":"2024-09-12T18:02:25.928443+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'40","last_scrub_stamp":"2024-09-12T18:02:25.928263+0000","last_deep_scrub":"261'40","last_deep_scrub_stamp":"2024-09-12T18:02:25.928263+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.928263+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:28.089551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":137,"num_write":74,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:36.816419+0000","last_change":"2024-09-12T18:02:36.816309+0000","last_active":"2024-09-12T18:02:36.816419+0000","last_peered":"2024-09-12T18:02:36.816419+0000","last_clean":"2024-09-12T18:02:36.816419+0000","last_became_active":"2024-09-12T17:50:58.415098+0000","last_became_peered":"2024-09-12T17:50:58.415098+0000","last_unstale":"2024-09-12T18:02:36.816419+0000","last_undegraded":"2024-09-12T18:02:36.816419+0000","last_fullsized":"2024-09-12T18:02:36.816419+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:36.816207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:36.816207+0000","last_clean_scrub_stamp":"2024-09-12T18:02:36.816207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:57.660239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:51.423898+0000","last_change":"2024-09-12T18:02:51.423898+0000","last_active":"2024-09-12T18:02:51.423898+0000","last_peered":"2024-09-12T18:02:51.423898+0000","last_clean":"2024-09-12T18:02:51.423898+0000","last_became_active":"2024-09-12T17:40:30.425845+0000","last_became_peered":"2024-09-12T17:40:30.425845+0000","last_unstale":"2024-09-12T18:02:51.423898+0000","last_undegraded":"2024-09-12T18:02:51.423898+0000","last_fullsized":"2024-09-12T18:02:51.423898+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:51.423801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:51.423801+0000","last_clean_scrub_stamp":"2024-09-12T18:02:51.423801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:44.184878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"261'11","reported_seq":72,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:38.184724+0000","last_change":"2024-09-12T18:02:38.184724+0000","last_active":"2024-09-12T18:02:38.184724+0000","last_peered":"2024-09-12T18:02:38.184724+0000","last_clean":"2024-09-12T18:02:38.184724+0000","last_became_active":"2024-09-12T17:40:27.382833+0000","last_became_peered":"2024-09-12T17:40:27.382833+0000","last_unstale":"2024-09-12T18:02:38.184724+0000","last_undegraded":"2024-09-12T18:02:38.184724+0000","last_fullsized":"2024-09-12T18:02:38.184724+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'11","last_scrub_stamp":"2024-09-12T18:02:38.184615+0000","last_deep_scrub":"261'11","last_deep_scrub_stamp":"2024-09-12T18:02:38.184615+0000","last_clean_scrub_stamp":"2024-09-12T18:02:38.184615+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:40.952747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32770,"num_write":16,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"261'60","reported_seq":212,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:36.661194+0000","last_change":"2024-09-12T18:02:36.661090+0000","last_active":"2024-09-12T18:02:36.661194+0000","last_peered":"2024-09-12T18:02:36.661194+0000","last_clean":"2024-09-12T18:02:36.661194+0000","last_became_active":"2024-09-12T17:38:51.214274+0000","last_became_peered":"2024-09-12T17:38:51.214274+0000","last_unstale":"2024-09-12T18:02:36.661194+0000","last_undegraded":"2024-09-12T18:02:36.661194+0000","last_fullsized":"2024-09-12T18:02:36.661194+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'60","last_scrub_stamp":"2024-09-12T18:02:36.660968+0000","last_deep_scrub":"261'60","last_deep_scrub_stamp":"2024-09-12T18:02:36.660968+0000","last_clean_scrub_stamp":"2024-09-12T18:02:36.660968+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:44.994140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":211,"num_write":107,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.038837+0000","last_change":"2024-09-12T18:02:24.038781+0000","last_active":"2024-09-12T18:02:24.038837+0000","last_peered":"2024-09-12T18:02:24.038837+0000","last_clean":"2024-09-12T18:02:24.038837+0000","last_became_active":"2024-09-12T17:50:58.426537+0000","last_became_peered":"2024-09-12T17:50:58.426537+0000","last_unstale":"2024-09-12T18:02:24.038837+0000","last_undegraded":"2024-09-12T18:02:24.038837+0000","last_fullsized":"2024-09-12T18:02:24.038837+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:24.038695+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:24.038695+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.038695+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:53.395847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"261'8","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:50.451865+0000","last_change":"2024-09-12T18:02:50.451865+0000","last_active":"2024-09-12T18:02:50.451865+0000","last_peered":"2024-09-12T18:02:50.451865+0000","last_clean":"2024-09-12T18:02:50.451865+0000","last_became_active":"2024-09-12T17:40:30.425368+0000","last_became_peered":"2024-09-12T17:40:30.425368+0000","last_unstale":"2024-09-12T18:02:50.451865+0000","last_undegraded":"2024-09-12T18:02:50.451865+0000","last_fullsized":"2024-09-12T18:02:50.451865+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T18:02:50.451776+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T18:02:50.451776+0000","last_clean_scrub_stamp":"2024-09-12T18:02:50.451776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:58.567240+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'3","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.626752+0000","last_change":"2024-09-12T18:02:41.626752+0000","last_active":"2024-09-12T18:02:41.626752+0000","last_peered":"2024-09-12T18:02:41.626752+0000","last_clean":"2024-09-12T18:02:41.626752+0000","last_became_active":"2024-09-12T17:40:27.380228+0000","last_became_peered":"2024-09-12T17:40:27.380228+0000","last_unstale":"2024-09-12T18:02:41.626752+0000","last_undegraded":"2024-09-12T18:02:41.626752+0000","last_fullsized":"2024-09-12T18:02:41.626752+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:41.626669+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:41.626669+0000","last_clean_scrub_stamp":"2024-09-12T18:02:41.626669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:02.507799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"261'21","reported_seq":108,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:39.455108+0000","last_change":"2024-09-12T18:02:39.455046+0000","last_active":"2024-09-12T18:02:39.455108+0000","last_peered":"2024-09-12T18:02:39.455108+0000","last_clean":"2024-09-12T18:02:39.455108+0000","last_became_active":"2024-09-12T17:38:51.218309+0000","last_became_peered":"2024-09-12T17:38:51.218309+0000","last_unstale":"2024-09-12T18:02:39.455108+0000","last_undegraded":"2024-09-12T18:02:39.455108+0000","last_fullsized":"2024-09-12T18:02:39.455108+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'21","last_scrub_stamp":"2024-09-12T18:02:39.454955+0000","last_deep_scrub":"261'21","last_deep_scrub_stamp":"2024-09-12T18:02:39.454955+0000","last_clean_scrub_stamp":"2024-09-12T18:02:39.454955+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:28.308893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:51.682798+0000","last_change":"2024-09-12T18:02:51.682798+0000","last_active":"2024-09-12T18:02:51.682798+0000","last_peered":"2024-09-12T18:02:51.682798+0000","last_clean":"2024-09-12T18:02:51.682798+0000","last_became_active":"2024-09-12T17:50:58.425003+0000","last_became_peered":"2024-09-12T17:50:58.425003+0000","last_unstale":"2024-09-12T18:02:51.682798+0000","last_undegraded":"2024-09-12T18:02:51.682798+0000","last_fullsized":"2024-09-12T18:02:51.682798+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:51.682710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:51.682710+0000","last_clean_scrub_stamp":"2024-09-12T18:02:51.682710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:41.772002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"261'3","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:52.430913+0000","last_change":"2024-09-12T18:02:52.430913+0000","last_active":"2024-09-12T18:02:52.430913+0000","last_peered":"2024-09-12T18:02:52.430913+0000","last_clean":"2024-09-12T18:02:52.430913+0000","last_became_active":"2024-09-12T17:40:30.426714+0000","last_became_peered":"2024-09-12T17:40:30.426714+0000","last_unstale":"2024-09-12T18:02:52.430913+0000","last_undegraded":"2024-09-12T18:02:52.430913+0000","last_fullsized":"2024-09-12T18:02:52.430913+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:52.430822+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:52.430822+0000","last_clean_scrub_stamp":"2024-09-12T18:02:52.430822+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:16.296868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.968483+0000","last_change":"2024-09-12T18:02:19.968483+0000","last_active":"2024-09-12T18:02:19.968483+0000","last_peered":"2024-09-12T18:02:19.968483+0000","last_clean":"2024-09-12T18:02:19.968483+0000","last_became_active":"2024-09-12T17:40:27.382132+0000","last_became_peered":"2024-09-12T17:40:27.382132+0000","last_unstale":"2024-09-12T18:02:19.968483+0000","last_undegraded":"2024-09-12T18:02:19.968483+0000","last_fullsized":"2024-09-12T18:02:19.968483+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:19.968389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:19.968389+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.968389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:16.177909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"261'28","reported_seq":131,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.950529+0000","last_change":"2024-09-12T18:02:14.950452+0000","last_active":"2024-09-12T18:02:14.950529+0000","last_peered":"2024-09-12T18:02:14.950529+0000","last_clean":"2024-09-12T18:02:14.950529+0000","last_became_active":"2024-09-12T17:38:51.214963+0000","last_became_peered":"2024-09-12T17:38:51.214963+0000","last_unstale":"2024-09-12T18:02:14.950529+0000","last_undegraded":"2024-09-12T18:02:14.950529+0000","last_fullsized":"2024-09-12T18:02:14.950529+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'28","last_scrub_stamp":"2024-09-12T18:02:14.950343+0000","last_deep_scrub":"261'28","last_deep_scrub_stamp":"2024-09-12T18:02:14.950343+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.950343+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:23.488575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":103,"num_write":58,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:44.280253+0000","last_change":"2024-09-12T18:02:44.280253+0000","last_active":"2024-09-12T18:02:44.280253+0000","last_peered":"2024-09-12T18:02:44.280253+0000","last_clean":"2024-09-12T18:02:44.280253+0000","last_became_active":"2024-09-12T17:50:58.426779+0000","last_became_peered":"2024-09-12T17:50:58.426779+0000","last_unstale":"2024-09-12T18:02:44.280253+0000","last_undegraded":"2024-09-12T18:02:44.280253+0000","last_fullsized":"2024-09-12T18:02:44.280253+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:44.280164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:44.280164+0000","last_clean_scrub_stamp":"2024-09-12T18:02:44.280164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:20.146249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"258'6","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:44.984686+0000","last_change":"2024-09-12T18:02:44.984686+0000","last_active":"2024-09-12T18:02:44.984686+0000","last_peered":"2024-09-12T18:02:44.984686+0000","last_clean":"2024-09-12T18:02:44.984686+0000","last_became_active":"2024-09-12T17:40:30.419211+0000","last_became_peered":"2024-09-12T17:40:30.419211+0000","last_unstale":"2024-09-12T18:02:44.984686+0000","last_undegraded":"2024-09-12T18:02:44.984686+0000","last_fullsized":"2024-09-12T18:02:44.984686+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'6","last_scrub_stamp":"2024-09-12T18:02:44.984582+0000","last_deep_scrub":"258'6","last_deep_scrub_stamp":"2024-09-12T18:02:44.984582+0000","last_clean_scrub_stamp":"2024-09-12T18:02:44.984582+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:22.656420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:43.631824+0000","last_change":"2024-09-12T18:02:43.631824+0000","last_active":"2024-09-12T18:02:43.631824+0000","last_peered":"2024-09-12T18:02:43.631824+0000","last_clean":"2024-09-12T18:02:43.631824+0000","last_became_active":"2024-09-12T17:40:27.382564+0000","last_became_peered":"2024-09-12T17:40:27.382564+0000","last_unstale":"2024-09-12T18:02:43.631824+0000","last_undegraded":"2024-09-12T18:02:43.631824+0000","last_fullsized":"2024-09-12T18:02:43.631824+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:43.631714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:43.631714+0000","last_clean_scrub_stamp":"2024-09-12T18:02:43.631714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:19.446293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"261'12","reported_seq":84,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:36.576009+0000","last_change":"2024-09-12T18:02:36.576009+0000","last_active":"2024-09-12T18:02:36.576009+0000","last_peered":"2024-09-12T18:02:36.576009+0000","last_clean":"2024-09-12T18:02:36.576009+0000","last_became_active":"2024-09-12T17:38:51.214678+0000","last_became_peered":"2024-09-12T17:38:51.214678+0000","last_unstale":"2024-09-12T18:02:36.576009+0000","last_undegraded":"2024-09-12T18:02:36.576009+0000","last_fullsized":"2024-09-12T18:02:36.576009+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'12","last_scrub_stamp":"2024-09-12T18:02:36.575881+0000","last_deep_scrub":"261'12","last_deep_scrub_stamp":"2024-09-12T18:02:36.575881+0000","last_clean_scrub_stamp":"2024-09-12T18:02:36.575881+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:22.760334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":38,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:56.562147+0000","last_change":"2024-09-12T18:02:56.562066+0000","last_active":"2024-09-12T18:02:56.562147+0000","last_peered":"2024-09-12T18:02:56.562147+0000","last_clean":"2024-09-12T18:02:56.562147+0000","last_became_active":"2024-09-12T17:50:58.427630+0000","last_became_peered":"2024-09-12T17:50:58.427630+0000","last_unstale":"2024-09-12T18:02:56.562147+0000","last_undegraded":"2024-09-12T18:02:56.562147+0000","last_fullsized":"2024-09-12T18:02:56.562147+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:56.561964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:56.561964+0000","last_clean_scrub_stamp":"2024-09-12T18:02:56.561964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:03.214489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"261'14","reported_seq":74,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.843157+0000","last_change":"2024-09-12T18:02:34.843157+0000","last_active":"2024-09-12T18:02:34.843157+0000","last_peered":"2024-09-12T18:02:34.843157+0000","last_clean":"2024-09-12T18:02:34.843157+0000","last_became_active":"2024-09-12T17:40:30.413592+0000","last_became_peered":"2024-09-12T17:40:30.413592+0000","last_unstale":"2024-09-12T18:02:34.843157+0000","last_undegraded":"2024-09-12T18:02:34.843157+0000","last_fullsized":"2024-09-12T18:02:34.843157+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'14","last_scrub_stamp":"2024-09-12T18:02:34.843076+0000","last_deep_scrub":"261'14","last_deep_scrub_stamp":"2024-09-12T18:02:34.843076+0000","last_clean_scrub_stamp":"2024-09-12T18:02:34.843076+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:06.293898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":45058,"num_write":24,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'8","reported_seq":68,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:36.031113+0000","last_change":"2024-09-12T18:02:36.031113+0000","last_active":"2024-09-12T18:02:36.031113+0000","last_peered":"2024-09-12T18:02:36.031113+0000","last_clean":"2024-09-12T18:02:36.031113+0000","last_became_active":"2024-09-12T17:40:27.381516+0000","last_became_peered":"2024-09-12T17:40:27.381516+0000","last_unstale":"2024-09-12T18:02:36.031113+0000","last_undegraded":"2024-09-12T18:02:36.031113+0000","last_fullsized":"2024-09-12T18:02:36.031113+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T18:02:36.031024+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T18:02:36.031024+0000","last_clean_scrub_stamp":"2024-09-12T18:02:36.031024+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:18.672677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"261'6","reported_seq":68,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:35.625398+0000","last_change":"2024-09-12T18:02:35.625398+0000","last_active":"2024-09-12T18:02:35.625398+0000","last_peered":"2024-09-12T18:02:35.625398+0000","last_clean":"2024-09-12T18:02:35.625398+0000","last_became_active":"2024-09-12T17:38:51.215646+0000","last_became_peered":"2024-09-12T17:38:51.215646+0000","last_unstale":"2024-09-12T18:02:35.625398+0000","last_undegraded":"2024-09-12T18:02:35.625398+0000","last_fullsized":"2024-09-12T18:02:35.625398+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T18:02:35.625286+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T18:02:35.625286+0000","last_clean_scrub_stamp":"2024-09-12T18:02:35.625286+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:44.327257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:53.854258+0000","last_change":"2024-09-12T18:02:53.854185+0000","last_active":"2024-09-12T18:02:53.854258+0000","last_peered":"2024-09-12T18:02:53.854258+0000","last_clean":"2024-09-12T18:02:53.854258+0000","last_became_active":"2024-09-12T17:50:58.422692+0000","last_became_peered":"2024-09-12T17:50:58.422692+0000","last_unstale":"2024-09-12T18:02:53.854258+0000","last_undegraded":"2024-09-12T18:02:53.854258+0000","last_fullsized":"2024-09-12T18:02:53.854258+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:53.854095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:53.854095+0000","last_clean_scrub_stamp":"2024-09-12T18:02:53.854095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:10.616476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.829091+0000","last_change":"2024-09-12T18:02:33.829091+0000","last_active":"2024-09-12T18:02:33.829091+0000","last_peered":"2024-09-12T18:02:33.829091+0000","last_clean":"2024-09-12T18:02:33.829091+0000","last_became_active":"2024-09-12T17:40:30.418904+0000","last_became_peered":"2024-09-12T17:40:30.418904+0000","last_unstale":"2024-09-12T18:02:33.829091+0000","last_undegraded":"2024-09-12T18:02:33.829091+0000","last_fullsized":"2024-09-12T18:02:33.829091+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:33.828999+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:33.828999+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.828999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:57.783167+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.518166+0000","last_change":"2024-09-12T18:02:42.518166+0000","last_active":"2024-09-12T18:02:42.518166+0000","last_peered":"2024-09-12T18:02:42.518166+0000","last_clean":"2024-09-12T18:02:42.518166+0000","last_became_active":"2024-09-12T17:40:27.381849+0000","last_became_peered":"2024-09-12T17:40:27.381849+0000","last_unstale":"2024-09-12T18:02:42.518166+0000","last_undegraded":"2024-09-12T18:02:42.518166+0000","last_fullsized":"2024-09-12T18:02:42.518166+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:42.518074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:42.518074+0000","last_clean_scrub_stamp":"2024-09-12T18:02:42.518074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:03.054404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"261'23","reported_seq":112,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:35.681349+0000","last_change":"2024-09-12T18:02:35.681349+0000","last_active":"2024-09-12T18:02:35.681349+0000","last_peered":"2024-09-12T18:02:35.681349+0000","last_clean":"2024-09-12T18:02:35.681349+0000","last_became_active":"2024-09-12T17:38:51.207804+0000","last_became_peered":"2024-09-12T17:38:51.207804+0000","last_unstale":"2024-09-12T18:02:35.681349+0000","last_undegraded":"2024-09-12T18:02:35.681349+0000","last_fullsized":"2024-09-12T18:02:35.681349+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'23","last_scrub_stamp":"2024-09-12T18:02:35.681244+0000","last_deep_scrub":"261'23","last_deep_scrub_stamp":"2024-09-12T18:02:35.681244+0000","last_clean_scrub_stamp":"2024-09-12T18:02:35.681244+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:55.561705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":76,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:54.899071+0000","last_change":"2024-09-12T18:02:54.899071+0000","last_active":"2024-09-12T18:02:54.899071+0000","last_peered":"2024-09-12T18:02:54.899071+0000","last_clean":"2024-09-12T18:02:54.899071+0000","last_became_active":"2024-09-12T17:50:58.424379+0000","last_became_peered":"2024-09-12T17:50:58.424379+0000","last_unstale":"2024-09-12T18:02:54.899071+0000","last_undegraded":"2024-09-12T18:02:54.899071+0000","last_fullsized":"2024-09-12T18:02:54.899071+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:54.898966+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:54.898966+0000","last_clean_scrub_stamp":"2024-09-12T18:02:54.898966+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:20.796166+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:48.464759+0000","last_change":"2024-09-12T18:02:48.464759+0000","last_active":"2024-09-12T18:02:48.464759+0000","last_peered":"2024-09-12T18:02:48.464759+0000","last_clean":"2024-09-12T18:02:48.464759+0000","last_became_active":"2024-09-12T17:40:30.417111+0000","last_became_peered":"2024-09-12T17:40:30.417111+0000","last_unstale":"2024-09-12T18:02:48.464759+0000","last_undegraded":"2024-09-12T18:02:48.464759+0000","last_fullsized":"2024-09-12T18:02:48.464759+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:48.464669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:48.464669+0000","last_clean_scrub_stamp":"2024-09-12T18:02:48.464669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:34.711586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.954712+0000","last_change":"2024-09-12T18:02:26.954712+0000","last_active":"2024-09-12T18:02:26.954712+0000","last_peered":"2024-09-12T18:02:26.954712+0000","last_clean":"2024-09-12T18:02:26.954712+0000","last_became_active":"2024-09-12T17:40:27.378245+0000","last_became_peered":"2024-09-12T17:40:27.378245+0000","last_unstale":"2024-09-12T18:02:26.954712+0000","last_undegraded":"2024-09-12T18:02:26.954712+0000","last_fullsized":"2024-09-12T18:02:26.954712+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:26.954627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:26.954627+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.954627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:34.497961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"261'38","reported_seq":162,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:35.002700+0000","last_change":"2024-09-12T18:02:35.002700+0000","last_active":"2024-09-12T18:02:35.002700+0000","last_peered":"2024-09-12T18:02:35.002700+0000","last_clean":"2024-09-12T18:02:35.002700+0000","last_became_active":"2024-09-12T17:38:51.208950+0000","last_became_peered":"2024-09-12T17:38:51.208950+0000","last_unstale":"2024-09-12T18:02:35.002700+0000","last_undegraded":"2024-09-12T18:02:35.002700+0000","last_fullsized":"2024-09-12T18:02:35.002700+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'38","last_scrub_stamp":"2024-09-12T18:02:35.002605+0000","last_deep_scrub":"261'38","last_deep_scrub_stamp":"2024-09-12T18:02:35.002605+0000","last_clean_scrub_stamp":"2024-09-12T18:02:35.002605+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:12.280316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":143,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:55.542387+0000","last_change":"2024-09-12T18:02:55.542326+0000","last_active":"2024-09-12T18:02:55.542387+0000","last_peered":"2024-09-12T18:02:55.542387+0000","last_clean":"2024-09-12T18:02:55.542387+0000","last_became_active":"2024-09-12T17:50:58.425574+0000","last_became_peered":"2024-09-12T17:50:58.425574+0000","last_unstale":"2024-09-12T18:02:55.542387+0000","last_undegraded":"2024-09-12T18:02:55.542387+0000","last_fullsized":"2024-09-12T18:02:55.542387+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:55.542235+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:55.542235+0000","last_clean_scrub_stamp":"2024-09-12T18:02:55.542235+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:52.882414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.874045+0000","last_change":"2024-09-12T18:02:29.874045+0000","last_active":"2024-09-12T18:02:29.874045+0000","last_peered":"2024-09-12T18:02:29.874045+0000","last_clean":"2024-09-12T18:02:29.874045+0000","last_became_active":"2024-09-12T17:40:30.411737+0000","last_became_peered":"2024-09-12T17:40:30.411737+0000","last_unstale":"2024-09-12T18:02:29.874045+0000","last_undegraded":"2024-09-12T18:02:29.874045+0000","last_fullsized":"2024-09-12T18:02:29.874045+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:29.873959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:29.873959+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.873959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:35.256924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:39.160275+0000","last_change":"2024-09-12T18:02:39.160275+0000","last_active":"2024-09-12T18:02:39.160275+0000","last_peered":"2024-09-12T18:02:39.160275+0000","last_clean":"2024-09-12T18:02:39.160275+0000","last_became_active":"2024-09-12T17:40:27.372357+0000","last_became_peered":"2024-09-12T17:40:27.372357+0000","last_unstale":"2024-09-12T18:02:39.160275+0000","last_undegraded":"2024-09-12T18:02:39.160275+0000","last_fullsized":"2024-09-12T18:02:39.160275+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:39.160188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:39.160188+0000","last_clean_scrub_stamp":"2024-09-12T18:02:39.160188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:56.576778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"261'42","reported_seq":159,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:43.481195+0000","last_change":"2024-09-12T18:02:43.481195+0000","last_active":"2024-09-12T18:02:43.481195+0000","last_peered":"2024-09-12T18:02:43.481195+0000","last_clean":"2024-09-12T18:02:43.481195+0000","last_became_active":"2024-09-12T17:38:51.207798+0000","last_became_peered":"2024-09-12T17:38:51.207798+0000","last_unstale":"2024-09-12T18:02:43.481195+0000","last_undegraded":"2024-09-12T18:02:43.481195+0000","last_fullsized":"2024-09-12T18:02:43.481195+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'42","last_scrub_stamp":"2024-09-12T18:02:43.481102+0000","last_deep_scrub":"261'42","last_deep_scrub_stamp":"2024-09-12T18:02:43.481102+0000","last_clean_scrub_stamp":"2024-09-12T18:02:43.481102+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:28.234594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":137,"num_write":80,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.001901+0000","last_change":"2024-09-12T18:02:23.001901+0000","last_active":"2024-09-12T18:02:23.001901+0000","last_peered":"2024-09-12T18:02:23.001901+0000","last_clean":"2024-09-12T18:02:23.001901+0000","last_became_active":"2024-09-12T17:50:58.428339+0000","last_became_peered":"2024-09-12T17:50:58.428339+0000","last_unstale":"2024-09-12T18:02:23.001901+0000","last_undegraded":"2024-09-12T18:02:23.001901+0000","last_fullsized":"2024-09-12T18:02:23.001901+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:23.001816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:23.001816+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.001816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:27.387765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"261'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:47.444273+0000","last_change":"2024-09-12T18:02:47.444153+0000","last_active":"2024-09-12T18:02:47.444273+0000","last_peered":"2024-09-12T18:02:47.444273+0000","last_clean":"2024-09-12T18:02:47.444273+0000","last_became_active":"2024-09-12T17:40:30.417583+0000","last_became_peered":"2024-09-12T17:40:30.417583+0000","last_unstale":"2024-09-12T18:02:47.444273+0000","last_undegraded":"2024-09-12T18:02:47.444273+0000","last_fullsized":"2024-09-12T18:02:47.444273+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:47.444046+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:47.444046+0000","last_clean_scrub_stamp":"2024-09-12T18:02:47.444046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:24.152928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"258'2","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:39.614954+0000","last_change":"2024-09-12T18:02:39.614846+0000","last_active":"2024-09-12T18:02:39.614954+0000","last_peered":"2024-09-12T18:02:39.614954+0000","last_clean":"2024-09-12T18:02:39.614954+0000","last_became_active":"2024-09-12T17:40:27.381027+0000","last_became_peered":"2024-09-12T17:40:27.381027+0000","last_unstale":"2024-09-12T18:02:39.614954+0000","last_undegraded":"2024-09-12T18:02:39.614954+0000","last_fullsized":"2024-09-12T18:02:39.614954+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-12T18:02:39.614746+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-12T18:02:39.614746+0000","last_clean_scrub_stamp":"2024-09-12T18:02:39.614746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:35.474853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"261'21","reported_seq":106,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:40.473619+0000","last_change":"2024-09-12T18:02:40.473619+0000","last_active":"2024-09-12T18:02:40.473619+0000","last_peered":"2024-09-12T18:02:40.473619+0000","last_clean":"2024-09-12T18:02:40.473619+0000","last_became_active":"2024-09-12T17:38:51.207487+0000","last_became_peered":"2024-09-12T17:38:51.207487+0000","last_unstale":"2024-09-12T18:02:40.473619+0000","last_undegraded":"2024-09-12T18:02:40.473619+0000","last_fullsized":"2024-09-12T18:02:40.473619+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'21","last_scrub_stamp":"2024-09-12T18:02:40.473526+0000","last_deep_scrub":"261'21","last_deep_scrub_stamp":"2024-09-12T18:02:40.473526+0000","last_clean_scrub_stamp":"2024-09-12T18:02:40.473526+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:50.792759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":66,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:48.634809+0000","last_change":"2024-09-12T18:02:48.634809+0000","last_active":"2024-09-12T18:02:48.634809+0000","last_peered":"2024-09-12T18:02:48.634809+0000","last_clean":"2024-09-12T18:02:48.634809+0000","last_became_active":"2024-09-12T17:50:58.430797+0000","last_became_peered":"2024-09-12T17:50:58.430797+0000","last_unstale":"2024-09-12T18:02:48.634809+0000","last_undegraded":"2024-09-12T18:02:48.634809+0000","last_fullsized":"2024-09-12T18:02:48.634809+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:48.634720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:48.634720+0000","last_clean_scrub_stamp":"2024-09-12T18:02:48.634720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:44.691730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"261'5","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:46.487489+0000","last_change":"2024-09-12T18:02:46.487430+0000","last_active":"2024-09-12T18:02:46.487489+0000","last_peered":"2024-09-12T18:02:46.487489+0000","last_clean":"2024-09-12T18:02:46.487489+0000","last_became_active":"2024-09-12T17:40:30.417567+0000","last_became_peered":"2024-09-12T17:40:30.417567+0000","last_unstale":"2024-09-12T18:02:46.487489+0000","last_undegraded":"2024-09-12T18:02:46.487489+0000","last_fullsized":"2024-09-12T18:02:46.487489+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:02:46.487341+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:02:46.487341+0000","last_clean_scrub_stamp":"2024-09-12T18:02:46.487341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:54.385530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"261'10","reported_seq":62,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.009035+0000","last_change":"2024-09-12T18:02:19.008973+0000","last_active":"2024-09-12T18:02:19.009035+0000","last_peered":"2024-09-12T18:02:19.009035+0000","last_clean":"2024-09-12T18:02:19.009035+0000","last_became_active":"2024-09-12T17:40:27.384579+0000","last_became_peered":"2024-09-12T17:40:27.384579+0000","last_unstale":"2024-09-12T18:02:19.009035+0000","last_undegraded":"2024-09-12T18:02:19.009035+0000","last_fullsized":"2024-09-12T18:02:19.009035+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'10","last_scrub_stamp":"2024-09-12T18:02:19.008873+0000","last_deep_scrub":"261'10","last_deep_scrub_stamp":"2024-09-12T18:02:19.008873+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.008873+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:19.052107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":20,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"261'7","reported_seq":69,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:35.147694+0000","last_change":"2024-09-12T18:02:35.147694+0000","last_active":"2024-09-12T18:02:35.147694+0000","last_peered":"2024-09-12T18:02:35.147694+0000","last_clean":"2024-09-12T18:02:35.147694+0000","last_became_active":"2024-09-12T17:38:51.215590+0000","last_became_peered":"2024-09-12T17:38:51.215590+0000","last_unstale":"2024-09-12T18:02:35.147694+0000","last_undegraded":"2024-09-12T18:02:35.147694+0000","last_fullsized":"2024-09-12T18:02:35.147694+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-12T18:02:35.147613+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-12T18:02:35.147613+0000","last_clean_scrub_stamp":"2024-09-12T18:02:35.147613+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:32.712740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":17,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.906222+0000","last_change":"2024-09-12T18:02:32.906222+0000","last_active":"2024-09-12T18:02:32.906222+0000","last_peered":"2024-09-12T18:02:32.906222+0000","last_clean":"2024-09-12T18:02:32.906222+0000","last_became_active":"2024-09-12T17:50:58.426867+0000","last_became_peered":"2024-09-12T17:50:58.426867+0000","last_unstale":"2024-09-12T18:02:32.906222+0000","last_undegraded":"2024-09-12T18:02:32.906222+0000","last_fullsized":"2024-09-12T18:02:32.906222+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:32.906115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:32.906115+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.906115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:04.281587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"261'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.833122+0000","last_change":"2024-09-12T18:02:32.833051+0000","last_active":"2024-09-12T18:02:32.833122+0000","last_peered":"2024-09-12T18:02:32.833122+0000","last_clean":"2024-09-12T18:02:32.833122+0000","last_became_active":"2024-09-12T17:40:30.425775+0000","last_became_peered":"2024-09-12T17:40:30.425775+0000","last_unstale":"2024-09-12T18:02:32.833122+0000","last_undegraded":"2024-09-12T18:02:32.833122+0000","last_fullsized":"2024-09-12T18:02:32.833122+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:32.832964+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:32.832964+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.832964+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:26.129620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.648401+0000","last_change":"2024-09-12T18:02:42.648345+0000","last_active":"2024-09-12T18:02:42.648401+0000","last_peered":"2024-09-12T18:02:42.648401+0000","last_clean":"2024-09-12T18:02:42.648401+0000","last_became_active":"2024-09-12T17:40:27.381918+0000","last_became_peered":"2024-09-12T17:40:27.381918+0000","last_unstale":"2024-09-12T18:02:42.648401+0000","last_undegraded":"2024-09-12T18:02:42.648401+0000","last_fullsized":"2024-09-12T18:02:42.648401+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:42.648258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:42.648258+0000","last_clean_scrub_stamp":"2024-09-12T18:02:42.648258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:04.256041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"261'43","reported_seq":167,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.034768+0000","last_change":"2024-09-12T18:02:24.034768+0000","last_active":"2024-09-12T18:02:24.034768+0000","last_peered":"2024-09-12T18:02:24.034768+0000","last_clean":"2024-09-12T18:02:24.034768+0000","last_became_active":"2024-09-12T17:38:51.209135+0000","last_became_peered":"2024-09-12T17:38:51.209135+0000","last_unstale":"2024-09-12T18:02:24.034768+0000","last_undegraded":"2024-09-12T18:02:24.034768+0000","last_fullsized":"2024-09-12T18:02:24.034768+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'43","last_scrub_stamp":"2024-09-12T18:02:24.034658+0000","last_deep_scrub":"261'43","last_deep_scrub_stamp":"2024-09-12T18:02:24.034658+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.034658+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:57.068969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":150,"num_write":83,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:49.683974+0000","last_change":"2024-09-12T18:02:49.683974+0000","last_active":"2024-09-12T18:02:49.683974+0000","last_peered":"2024-09-12T18:02:49.683974+0000","last_clean":"2024-09-12T18:02:49.683974+0000","last_became_active":"2024-09-12T17:50:58.431587+0000","last_became_peered":"2024-09-12T17:50:58.431587+0000","last_unstale":"2024-09-12T18:02:49.683974+0000","last_undegraded":"2024-09-12T18:02:49.683974+0000","last_fullsized":"2024-09-12T18:02:49.683974+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:49.683882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:49.683882+0000","last_clean_scrub_stamp":"2024-09-12T18:02:49.683882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:15.232068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:49.451675+0000","last_change":"2024-09-12T18:02:49.451618+0000","last_active":"2024-09-12T18:02:49.451675+0000","last_peered":"2024-09-12T18:02:49.451675+0000","last_clean":"2024-09-12T18:02:49.451675+0000","last_became_active":"2024-09-12T17:40:30.417998+0000","last_became_peered":"2024-09-12T17:40:30.417998+0000","last_unstale":"2024-09-12T18:02:49.451675+0000","last_undegraded":"2024-09-12T18:02:49.451675+0000","last_fullsized":"2024-09-12T18:02:49.451675+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:49.451522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:49.451522+0000","last_clean_scrub_stamp":"2024-09-12T18:02:49.451522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:57.040375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.942846+0000","last_change":"2024-09-12T18:02:28.942781+0000","last_active":"2024-09-12T18:02:28.942846+0000","last_peered":"2024-09-12T18:02:28.942846+0000","last_clean":"2024-09-12T18:02:28.942846+0000","last_became_active":"2024-09-12T17:40:27.374557+0000","last_became_peered":"2024-09-12T17:40:27.374557+0000","last_unstale":"2024-09-12T18:02:28.942846+0000","last_undegraded":"2024-09-12T18:02:28.942846+0000","last_fullsized":"2024-09-12T18:02:28.942846+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:28.942693+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:28.942693+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.942693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:26.660387+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"261'32","reported_seq":138,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.979713+0000","last_change":"2024-09-12T18:02:15.979713+0000","last_active":"2024-09-12T18:02:15.979713+0000","last_peered":"2024-09-12T18:02:15.979713+0000","last_clean":"2024-09-12T18:02:15.979713+0000","last_became_active":"2024-09-12T17:38:51.216209+0000","last_became_peered":"2024-09-12T17:38:51.216209+0000","last_unstale":"2024-09-12T18:02:15.979713+0000","last_undegraded":"2024-09-12T18:02:15.979713+0000","last_fullsized":"2024-09-12T18:02:15.979713+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'32","last_scrub_stamp":"2024-09-12T18:02:15.979620+0000","last_deep_scrub":"261'32","last_deep_scrub_stamp":"2024-09-12T18:02:15.979620+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.979620+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:08.310333+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":109,"num_write":55,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:54.506627+0000","last_change":"2024-09-12T18:02:54.506627+0000","last_active":"2024-09-12T18:02:54.506627+0000","last_peered":"2024-09-12T18:02:54.506627+0000","last_clean":"2024-09-12T18:02:54.506627+0000","last_became_active":"2024-09-12T17:50:58.424452+0000","last_became_peered":"2024-09-12T17:50:58.424452+0000","last_unstale":"2024-09-12T18:02:54.506627+0000","last_undegraded":"2024-09-12T18:02:54.506627+0000","last_fullsized":"2024-09-12T18:02:54.506627+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:54.506540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:54.506540+0000","last_clean_scrub_stamp":"2024-09-12T18:02:54.506540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:21.136075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.012700+0000","last_change":"2024-09-12T18:02:42.012700+0000","last_active":"2024-09-12T18:02:42.012700+0000","last_peered":"2024-09-12T18:02:42.012700+0000","last_clean":"2024-09-12T18:02:42.012700+0000","last_became_active":"2024-09-12T17:40:30.418650+0000","last_became_peered":"2024-09-12T17:40:30.418650+0000","last_unstale":"2024-09-12T18:02:42.012700+0000","last_undegraded":"2024-09-12T18:02:42.012700+0000","last_fullsized":"2024-09-12T18:02:42.012700+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:42.012613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:42.012613+0000","last_clean_scrub_stamp":"2024-09-12T18:02:42.012613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:08.564747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"258'8","reported_seq":68,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:40.653411+0000","last_change":"2024-09-12T18:02:40.653411+0000","last_active":"2024-09-12T18:02:40.653411+0000","last_peered":"2024-09-12T18:02:40.653411+0000","last_clean":"2024-09-12T18:02:40.653411+0000","last_became_active":"2024-09-12T17:40:27.385081+0000","last_became_peered":"2024-09-12T17:40:27.385081+0000","last_unstale":"2024-09-12T18:02:40.653411+0000","last_undegraded":"2024-09-12T18:02:40.653411+0000","last_fullsized":"2024-09-12T18:02:40.653411+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'8","last_scrub_stamp":"2024-09-12T18:02:40.653315+0000","last_deep_scrub":"258'8","last_deep_scrub_stamp":"2024-09-12T18:02:40.653315+0000","last_clean_scrub_stamp":"2024-09-12T18:02:40.653315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:22.324217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"261'37","reported_seq":156,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.711521+0000","last_change":"2024-09-12T18:02:34.711521+0000","last_active":"2024-09-12T18:02:34.711521+0000","last_peered":"2024-09-12T18:02:34.711521+0000","last_clean":"2024-09-12T18:02:34.711521+0000","last_became_active":"2024-09-12T17:38:51.208861+0000","last_became_peered":"2024-09-12T17:38:51.208861+0000","last_unstale":"2024-09-12T18:02:34.711521+0000","last_undegraded":"2024-09-12T18:02:34.711521+0000","last_fullsized":"2024-09-12T18:02:34.711521+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'37","last_scrub_stamp":"2024-09-12T18:02:34.711380+0000","last_deep_scrub":"261'37","last_deep_scrub_stamp":"2024-09-12T18:02:34.711380+0000","last_clean_scrub_stamp":"2024-09-12T18:02:34.711380+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:41.780033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":141,"num_write":67,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:50.709453+0000","last_change":"2024-09-12T18:02:50.709453+0000","last_active":"2024-09-12T18:02:50.709453+0000","last_peered":"2024-09-12T18:02:50.709453+0000","last_clean":"2024-09-12T18:02:50.709453+0000","last_became_active":"2024-09-12T17:50:58.432245+0000","last_became_peered":"2024-09-12T17:50:58.432245+0000","last_unstale":"2024-09-12T18:02:50.709453+0000","last_undegraded":"2024-09-12T18:02:50.709453+0000","last_fullsized":"2024-09-12T18:02:50.709453+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:50.709363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:50.709363+0000","last_clean_scrub_stamp":"2024-09-12T18:02:50.709363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:50.920113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"258'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:45.600409+0000","last_change":"2024-09-12T18:02:45.600409+0000","last_active":"2024-09-12T18:02:45.600409+0000","last_peered":"2024-09-12T18:02:45.600409+0000","last_clean":"2024-09-12T18:02:45.600409+0000","last_became_active":"2024-09-12T17:40:30.425293+0000","last_became_peered":"2024-09-12T17:40:30.425293+0000","last_unstale":"2024-09-12T18:02:45.600409+0000","last_undegraded":"2024-09-12T18:02:45.600409+0000","last_fullsized":"2024-09-12T18:02:45.600409+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T18:02:45.600303+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T18:02:45.600303+0000","last_clean_scrub_stamp":"2024-09-12T18:02:45.600303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:48.539529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"261'3","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.904837+0000","last_change":"2024-09-12T18:02:27.904837+0000","last_active":"2024-09-12T18:02:27.904837+0000","last_peered":"2024-09-12T18:02:27.904837+0000","last_clean":"2024-09-12T18:02:27.904837+0000","last_became_active":"2024-09-12T17:40:27.376781+0000","last_became_peered":"2024-09-12T17:40:27.376781+0000","last_unstale":"2024-09-12T18:02:27.904837+0000","last_undegraded":"2024-09-12T18:02:27.904837+0000","last_fullsized":"2024-09-12T18:02:27.904837+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:27.904747+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:27.904747+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.904747+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:18.705963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.664099+0000","last_change":"2024-09-12T18:02:34.664040+0000","last_active":"2024-09-12T18:02:34.664099+0000","last_peered":"2024-09-12T18:02:34.664099+0000","last_clean":"2024-09-12T18:02:34.664099+0000","last_became_active":"2024-09-12T17:38:51.209772+0000","last_became_peered":"2024-09-12T17:38:51.209772+0000","last_unstale":"2024-09-12T18:02:34.664099+0000","last_undegraded":"2024-09-12T18:02:34.664099+0000","last_fullsized":"2024-09-12T18:02:34.664099+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:34.663935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:34.663935+0000","last_clean_scrub_stamp":"2024-09-12T18:02:34.663935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:16.640569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:52.720033+0000","last_change":"2024-09-12T18:02:52.720033+0000","last_active":"2024-09-12T18:02:52.720033+0000","last_peered":"2024-09-12T18:02:52.720033+0000","last_clean":"2024-09-12T18:02:52.720033+0000","last_became_active":"2024-09-12T17:50:58.429551+0000","last_became_peered":"2024-09-12T17:50:58.429551+0000","last_unstale":"2024-09-12T18:02:52.720033+0000","last_undegraded":"2024-09-12T18:02:52.720033+0000","last_fullsized":"2024-09-12T18:02:52.720033+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:52.719924+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:52.719924+0000","last_clean_scrub_stamp":"2024-09-12T18:02:52.719924+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:46.652635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'7","reported_seq":61,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.870677+0000","last_change":"2024-09-12T18:02:31.870607+0000","last_active":"2024-09-12T18:02:31.870677+0000","last_peered":"2024-09-12T18:02:31.870677+0000","last_clean":"2024-09-12T18:02:31.870677+0000","last_became_active":"2024-09-12T17:40:30.408915+0000","last_became_peered":"2024-09-12T17:40:30.408915+0000","last_unstale":"2024-09-12T18:02:31.870677+0000","last_undegraded":"2024-09-12T18:02:31.870677+0000","last_fullsized":"2024-09-12T18:02:31.870677+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-12T18:02:31.870487+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-12T18:02:31.870487+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.870487+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:45.211938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25606,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"258'3","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.681741+0000","last_change":"2024-09-12T18:02:41.681741+0000","last_active":"2024-09-12T18:02:41.681741+0000","last_peered":"2024-09-12T18:02:41.681741+0000","last_clean":"2024-09-12T18:02:41.681741+0000","last_became_active":"2024-09-12T17:40:27.381885+0000","last_became_peered":"2024-09-12T17:40:27.381885+0000","last_unstale":"2024-09-12T18:02:41.681741+0000","last_undegraded":"2024-09-12T18:02:41.681741+0000","last_fullsized":"2024-09-12T18:02:41.681741+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T18:02:41.681596+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T18:02:41.681596+0000","last_clean_scrub_stamp":"2024-09-12T18:02:41.681596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:10.794948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"261'68","reported_seq":240,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:38.469534+0000","last_change":"2024-09-12T18:02:38.469461+0000","last_active":"2024-09-12T18:02:38.469534+0000","last_peered":"2024-09-12T18:02:38.469534+0000","last_clean":"2024-09-12T18:02:38.469534+0000","last_became_active":"2024-09-12T17:38:51.214940+0000","last_became_peered":"2024-09-12T17:38:51.214940+0000","last_unstale":"2024-09-12T18:02:38.469534+0000","last_undegraded":"2024-09-12T18:02:38.469534+0000","last_fullsized":"2024-09-12T18:02:38.469534+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'68","last_scrub_stamp":"2024-09-12T18:02:38.469380+0000","last_deep_scrub":"261'68","last_deep_scrub_stamp":"2024-09-12T18:02:38.469380+0000","last_clean_scrub_stamp":"2024-09-12T18:02:38.469380+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:47.065231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":356,"num_read_kb":250,"num_write":117,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:52.821262+0000","last_change":"2024-09-12T18:02:52.821262+0000","last_active":"2024-09-12T18:02:52.821262+0000","last_peered":"2024-09-12T18:02:52.821262+0000","last_clean":"2024-09-12T18:02:52.821262+0000","last_became_active":"2024-09-12T17:50:58.420251+0000","last_became_peered":"2024-09-12T17:50:58.420251+0000","last_unstale":"2024-09-12T18:02:52.821262+0000","last_undegraded":"2024-09-12T18:02:52.821262+0000","last_fullsized":"2024-09-12T18:02:52.821262+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:52.821161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:52.821161+0000","last_clean_scrub_stamp":"2024-09-12T18:02:52.821161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:19.902980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"258'7","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:44.594296+0000","last_change":"2024-09-12T18:02:44.594296+0000","last_active":"2024-09-12T18:02:44.594296+0000","last_peered":"2024-09-12T18:02:44.594296+0000","last_clean":"2024-09-12T18:02:44.594296+0000","last_became_active":"2024-09-12T17:40:30.417393+0000","last_became_peered":"2024-09-12T17:40:30.417393+0000","last_unstale":"2024-09-12T18:02:44.594296+0000","last_undegraded":"2024-09-12T18:02:44.594296+0000","last_fullsized":"2024-09-12T18:02:44.594296+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'7","last_scrub_stamp":"2024-09-12T18:02:44.594215+0000","last_deep_scrub":"258'7","last_deep_scrub_stamp":"2024-09-12T18:02:44.594215+0000","last_clean_scrub_stamp":"2024-09-12T18:02:44.594215+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:12.075648+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":7,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'2","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.001341+0000","last_change":"2024-09-12T18:02:34.001262+0000","last_active":"2024-09-12T18:02:34.001341+0000","last_peered":"2024-09-12T18:02:34.001341+0000","last_clean":"2024-09-12T18:02:34.001341+0000","last_became_active":"2024-09-12T17:40:27.379472+0000","last_became_peered":"2024-09-12T17:40:27.379472+0000","last_unstale":"2024-09-12T18:02:34.001341+0000","last_undegraded":"2024-09-12T18:02:34.001341+0000","last_fullsized":"2024-09-12T18:02:34.001341+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:34.001145+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:34.001145+0000","last_clean_scrub_stamp":"2024-09-12T18:02:34.001145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:27.189307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"261'106","reported_seq":375,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.000317+0000","last_change":"2024-09-12T18:02:25.000259+0000","last_active":"2024-09-12T18:02:25.000317+0000","last_peered":"2024-09-12T18:02:25.000317+0000","last_clean":"2024-09-12T18:02:25.000317+0000","last_became_active":"2024-09-12T17:38:51.207735+0000","last_became_peered":"2024-09-12T17:38:51.207735+0000","last_unstale":"2024-09-12T18:02:25.000317+0000","last_undegraded":"2024-09-12T18:02:25.000317+0000","last_fullsized":"2024-09-12T18:02:25.000317+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'106","last_scrub_stamp":"2024-09-12T18:02:25.000158+0000","last_deep_scrub":"261'106","last_deep_scrub_stamp":"2024-09-12T18:02:25.000158+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.000158+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.557077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":541,"num_write":122,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:46.575106+0000","last_change":"2024-09-12T18:02:46.575106+0000","last_active":"2024-09-12T18:02:46.575106+0000","last_peered":"2024-09-12T18:02:46.575106+0000","last_clean":"2024-09-12T18:02:46.575106+0000","last_became_active":"2024-09-12T17:50:58.430813+0000","last_became_peered":"2024-09-12T17:50:58.430813+0000","last_unstale":"2024-09-12T18:02:46.575106+0000","last_undegraded":"2024-09-12T18:02:46.575106+0000","last_fullsized":"2024-09-12T18:02:46.575106+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:46.575012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:46.575012+0000","last_clean_scrub_stamp":"2024-09-12T18:02:46.575012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:30.109056+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:47.730099+0000","last_change":"2024-09-12T18:02:47.730099+0000","last_active":"2024-09-12T18:02:47.730099+0000","last_peered":"2024-09-12T18:02:47.730099+0000","last_clean":"2024-09-12T18:02:47.730099+0000","last_became_active":"2024-09-12T17:40:30.410872+0000","last_became_peered":"2024-09-12T17:40:30.410872+0000","last_unstale":"2024-09-12T18:02:47.730099+0000","last_undegraded":"2024-09-12T18:02:47.730099+0000","last_fullsized":"2024-09-12T18:02:47.730099+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:47.730015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:47.730015+0000","last_clean_scrub_stamp":"2024-09-12T18:02:47.730015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:39.474370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'2","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.625130+0000","last_change":"2024-09-12T18:02:42.625130+0000","last_active":"2024-09-12T18:02:42.625130+0000","last_peered":"2024-09-12T18:02:42.625130+0000","last_clean":"2024-09-12T18:02:42.625130+0000","last_became_active":"2024-09-12T17:40:27.380269+0000","last_became_peered":"2024-09-12T17:40:27.380269+0000","last_unstale":"2024-09-12T18:02:42.625130+0000","last_undegraded":"2024-09-12T18:02:42.625130+0000","last_fullsized":"2024-09-12T18:02:42.625130+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:42.625026+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:42.625026+0000","last_clean_scrub_stamp":"2024-09-12T18:02:42.625026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:25.134625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"261'42","reported_seq":166,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.731942+0000","last_change":"2024-09-12T18:02:33.731875+0000","last_active":"2024-09-12T18:02:33.731942+0000","last_peered":"2024-09-12T18:02:33.731942+0000","last_clean":"2024-09-12T18:02:33.731942+0000","last_became_active":"2024-09-12T17:38:51.216152+0000","last_became_peered":"2024-09-12T17:38:51.216152+0000","last_unstale":"2024-09-12T18:02:33.731942+0000","last_undegraded":"2024-09-12T18:02:33.731942+0000","last_fullsized":"2024-09-12T18:02:33.731942+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'42","last_scrub_stamp":"2024-09-12T18:02:33.731790+0000","last_deep_scrub":"261'42","last_deep_scrub_stamp":"2024-09-12T18:02:33.731790+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.731790+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:48:40.551255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":152,"num_write":74,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:43.238162+0000","last_change":"2024-09-12T18:02:43.238162+0000","last_active":"2024-09-12T18:02:43.238162+0000","last_peered":"2024-09-12T18:02:43.238162+0000","last_clean":"2024-09-12T18:02:43.238162+0000","last_became_active":"2024-09-12T17:50:58.430723+0000","last_became_peered":"2024-09-12T17:50:58.430723+0000","last_unstale":"2024-09-12T18:02:43.238162+0000","last_undegraded":"2024-09-12T18:02:43.238162+0000","last_fullsized":"2024-09-12T18:02:43.238162+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:43.238078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:43.238078+0000","last_clean_scrub_stamp":"2024-09-12T18:02:43.238078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:20.541243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"261'2","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:46.718213+0000","last_change":"2024-09-12T18:02:46.718213+0000","last_active":"2024-09-12T18:02:46.718213+0000","last_peered":"2024-09-12T18:02:46.718213+0000","last_clean":"2024-09-12T18:02:46.718213+0000","last_became_active":"2024-09-12T17:40:30.425368+0000","last_became_peered":"2024-09-12T17:40:30.425368+0000","last_unstale":"2024-09-12T18:02:46.718213+0000","last_undegraded":"2024-09-12T18:02:46.718213+0000","last_fullsized":"2024-09-12T18:02:46.718213+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:46.718079+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:46.718079+0000","last_clean_scrub_stamp":"2024-09-12T18:02:46.718079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:50.049156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.015051+0000","last_change":"2024-09-12T18:02:18.015051+0000","last_active":"2024-09-12T18:02:18.015051+0000","last_peered":"2024-09-12T18:02:18.015051+0000","last_clean":"2024-09-12T18:02:18.015051+0000","last_became_active":"2024-09-12T17:40:27.383770+0000","last_became_peered":"2024-09-12T17:40:27.383770+0000","last_unstale":"2024-09-12T18:02:18.015051+0000","last_undegraded":"2024-09-12T18:02:18.015051+0000","last_fullsized":"2024-09-12T18:02:18.015051+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:18.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:18.014972+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:48.282723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"258'22","reported_seq":117,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.068283+0000","last_change":"2024-09-12T18:02:23.068222+0000","last_active":"2024-09-12T18:02:23.068283+0000","last_peered":"2024-09-12T18:02:23.068283+0000","last_clean":"2024-09-12T18:02:23.068283+0000","last_became_active":"2024-09-12T17:38:51.208767+0000","last_became_peered":"2024-09-12T17:38:51.208767+0000","last_unstale":"2024-09-12T18:02:23.068283+0000","last_undegraded":"2024-09-12T18:02:23.068283+0000","last_fullsized":"2024-09-12T18:02:23.068283+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'22","last_scrub_stamp":"2024-09-12T18:02:23.068136+0000","last_deep_scrub":"258'22","last_deep_scrub_stamp":"2024-09-12T18:02:23.068136+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.068136+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:52.412076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:35.826379+0000","last_change":"2024-09-12T18:02:35.826312+0000","last_active":"2024-09-12T18:02:35.826379+0000","last_peered":"2024-09-12T18:02:35.826379+0000","last_clean":"2024-09-12T18:02:35.826379+0000","last_became_active":"2024-09-12T17:50:58.422625+0000","last_became_peered":"2024-09-12T17:50:58.422625+0000","last_unstale":"2024-09-12T18:02:35.826379+0000","last_undegraded":"2024-09-12T18:02:35.826379+0000","last_fullsized":"2024-09-12T18:02:35.826379+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:35.826224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:35.826224+0000","last_clean_scrub_stamp":"2024-09-12T18:02:35.826224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:41.055196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"258'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:43.632419+0000","last_change":"2024-09-12T18:02:43.632419+0000","last_active":"2024-09-12T18:02:43.632419+0000","last_peered":"2024-09-12T18:02:43.632419+0000","last_clean":"2024-09-12T18:02:43.632419+0000","last_became_active":"2024-09-12T17:40:30.425536+0000","last_became_peered":"2024-09-12T17:40:30.425536+0000","last_unstale":"2024-09-12T18:02:43.632419+0000","last_undegraded":"2024-09-12T18:02:43.632419+0000","last_fullsized":"2024-09-12T18:02:43.632419+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T18:02:43.632328+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T18:02:43.632328+0000","last_clean_scrub_stamp":"2024-09-12T18:02:43.632328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:50.704210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"258'6","reported_seq":58,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:37.160227+0000","last_change":"2024-09-12T18:02:37.160227+0000","last_active":"2024-09-12T18:02:37.160227+0000","last_peered":"2024-09-12T18:02:37.160227+0000","last_clean":"2024-09-12T18:02:37.160227+0000","last_became_active":"2024-09-12T17:40:27.381818+0000","last_became_peered":"2024-09-12T17:40:27.381818+0000","last_unstale":"2024-09-12T18:02:37.160227+0000","last_undegraded":"2024-09-12T18:02:37.160227+0000","last_fullsized":"2024-09-12T18:02:37.160227+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'6","last_scrub_stamp":"2024-09-12T18:02:37.160137+0000","last_deep_scrub":"258'6","last_deep_scrub_stamp":"2024-09-12T18:02:37.160137+0000","last_clean_scrub_stamp":"2024-09-12T18:02:37.160137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:22.481431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"261'42","reported_seq":174,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.707951+0000","last_change":"2024-09-12T18:02:33.707951+0000","last_active":"2024-09-12T18:02:33.707951+0000","last_peered":"2024-09-12T18:02:33.707951+0000","last_clean":"2024-09-12T18:02:33.707951+0000","last_became_active":"2024-09-12T17:38:51.211219+0000","last_became_peered":"2024-09-12T17:38:51.211219+0000","last_unstale":"2024-09-12T18:02:33.707951+0000","last_undegraded":"2024-09-12T18:02:33.707951+0000","last_fullsized":"2024-09-12T18:02:33.707951+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'42","last_scrub_stamp":"2024-09-12T18:02:33.707856+0000","last_deep_scrub":"261'42","last_deep_scrub_stamp":"2024-09-12T18:02:33.707856+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.707856+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:07.552173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":165,"num_write":70,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:43.951894+0000","last_change":"2024-09-12T18:02:43.951894+0000","last_active":"2024-09-12T18:02:43.951894+0000","last_peered":"2024-09-12T18:02:43.951894+0000","last_clean":"2024-09-12T18:02:43.951894+0000","last_became_active":"2024-09-12T17:50:58.416501+0000","last_became_peered":"2024-09-12T17:50:58.416501+0000","last_unstale":"2024-09-12T18:02:43.951894+0000","last_undegraded":"2024-09-12T18:02:43.951894+0000","last_fullsized":"2024-09-12T18:02:43.951894+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:43.951803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:43.951803+0000","last_clean_scrub_stamp":"2024-09-12T18:02:43.951803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:45.539923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"261'5","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:40.966831+0000","last_change":"2024-09-12T18:02:40.966831+0000","last_active":"2024-09-12T18:02:40.966831+0000","last_peered":"2024-09-12T18:02:40.966831+0000","last_clean":"2024-09-12T18:02:40.966831+0000","last_became_active":"2024-09-12T17:40:30.418418+0000","last_became_peered":"2024-09-12T17:40:30.418418+0000","last_unstale":"2024-09-12T18:02:40.966831+0000","last_undegraded":"2024-09-12T18:02:40.966831+0000","last_fullsized":"2024-09-12T18:02:40.966831+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:02:40.966740+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:02:40.966740+0000","last_clean_scrub_stamp":"2024-09-12T18:02:40.966740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:49.335518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:40.580175+0000","last_change":"2024-09-12T18:02:40.580175+0000","last_active":"2024-09-12T18:02:40.580175+0000","last_peered":"2024-09-12T18:02:40.580175+0000","last_clean":"2024-09-12T18:02:40.580175+0000","last_became_active":"2024-09-12T17:40:27.383023+0000","last_became_peered":"2024-09-12T17:40:27.383023+0000","last_unstale":"2024-09-12T18:02:40.580175+0000","last_undegraded":"2024-09-12T18:02:40.580175+0000","last_fullsized":"2024-09-12T18:02:40.580175+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:40.580051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:40.580051+0000","last_clean_scrub_stamp":"2024-09-12T18:02:40.580051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:23.947805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"261'37","reported_seq":157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.979731+0000","last_change":"2024-09-12T18:02:23.979731+0000","last_active":"2024-09-12T18:02:23.979731+0000","last_peered":"2024-09-12T18:02:23.979731+0000","last_clean":"2024-09-12T18:02:23.979731+0000","last_became_active":"2024-09-12T17:38:51.209833+0000","last_became_peered":"2024-09-12T17:38:51.209833+0000","last_unstale":"2024-09-12T18:02:23.979731+0000","last_undegraded":"2024-09-12T18:02:23.979731+0000","last_fullsized":"2024-09-12T18:02:23.979731+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'37","last_scrub_stamp":"2024-09-12T18:02:23.979634+0000","last_deep_scrub":"261'37","last_deep_scrub_stamp":"2024-09-12T18:02:23.979634+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.979634+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:50.358860+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":141,"num_write":58,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.021561+0000","last_change":"2024-09-12T18:02:22.021561+0000","last_active":"2024-09-12T18:02:22.021561+0000","last_peered":"2024-09-12T18:02:22.021561+0000","last_clean":"2024-09-12T18:02:22.021561+0000","last_became_active":"2024-09-12T17:50:58.423798+0000","last_became_peered":"2024-09-12T17:50:58.423798+0000","last_unstale":"2024-09-12T18:02:22.021561+0000","last_undegraded":"2024-09-12T18:02:22.021561+0000","last_fullsized":"2024-09-12T18:02:22.021561+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:22.021459+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:22.021459+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.021459+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:55.158982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"258'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.914129+0000","last_change":"2024-09-12T18:02:30.914129+0000","last_active":"2024-09-12T18:02:30.914129+0000","last_peered":"2024-09-12T18:02:30.914129+0000","last_clean":"2024-09-12T18:02:30.914129+0000","last_became_active":"2024-09-12T17:40:30.412140+0000","last_became_peered":"2024-09-12T17:40:30.412140+0000","last_unstale":"2024-09-12T18:02:30.914129+0000","last_undegraded":"2024-09-12T18:02:30.914129+0000","last_fullsized":"2024-09-12T18:02:30.914129+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T18:02:30.914030+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T18:02:30.914030+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.914030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:31.123475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'3","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:37.620182+0000","last_change":"2024-09-12T18:02:37.620182+0000","last_active":"2024-09-12T18:02:37.620182+0000","last_peered":"2024-09-12T18:02:37.620182+0000","last_clean":"2024-09-12T18:02:37.620182+0000","last_became_active":"2024-09-12T17:40:27.385649+0000","last_became_peered":"2024-09-12T17:40:27.385649+0000","last_unstale":"2024-09-12T18:02:37.620182+0000","last_undegraded":"2024-09-12T18:02:37.620182+0000","last_fullsized":"2024-09-12T18:02:37.620182+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:02:37.620097+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:02:37.620097+0000","last_clean_scrub_stamp":"2024-09-12T18:02:37.620097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:00.430536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"258'14","reported_seq":93,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:36.129963+0000","last_change":"2024-09-12T18:02:36.129963+0000","last_active":"2024-09-12T18:02:36.129963+0000","last_peered":"2024-09-12T18:02:36.129963+0000","last_clean":"2024-09-12T18:02:36.129963+0000","last_became_active":"2024-09-12T17:38:51.215738+0000","last_became_peered":"2024-09-12T17:38:51.215738+0000","last_unstale":"2024-09-12T18:02:36.129963+0000","last_undegraded":"2024-09-12T18:02:36.129963+0000","last_fullsized":"2024-09-12T18:02:36.129963+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'14","last_scrub_stamp":"2024-09-12T18:02:36.129859+0000","last_deep_scrub":"258'14","last_deep_scrub_stamp":"2024-09-12T18:02:36.129859+0000","last_clean_scrub_stamp":"2024-09-12T18:02:36.129859+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:12.647905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:50.833248+0000","last_change":"2024-09-12T18:02:50.833248+0000","last_active":"2024-09-12T18:02:50.833248+0000","last_peered":"2024-09-12T18:02:50.833248+0000","last_clean":"2024-09-12T18:02:50.833248+0000","last_became_active":"2024-09-12T17:50:58.423443+0000","last_became_peered":"2024-09-12T17:50:58.423443+0000","last_unstale":"2024-09-12T18:02:50.833248+0000","last_undegraded":"2024-09-12T18:02:50.833248+0000","last_fullsized":"2024-09-12T18:02:50.833248+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:50.833145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:50.833145+0000","last_clean_scrub_stamp":"2024-09-12T18:02:50.833145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:32.452855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:40.199982+0000","last_change":"2024-09-12T18:02:40.199982+0000","last_active":"2024-09-12T18:02:40.199982+0000","last_peered":"2024-09-12T18:02:40.199982+0000","last_clean":"2024-09-12T18:02:40.199982+0000","last_became_active":"2024-09-12T17:40:30.415696+0000","last_became_peered":"2024-09-12T17:40:30.415696+0000","last_unstale":"2024-09-12T18:02:40.199982+0000","last_undegraded":"2024-09-12T18:02:40.199982+0000","last_fullsized":"2024-09-12T18:02:40.199982+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:40.199890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:40.199890+0000","last_clean_scrub_stamp":"2024-09-12T18:02:40.199890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:26.550506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:38.659771+0000","last_change":"2024-09-12T18:02:38.659771+0000","last_active":"2024-09-12T18:02:38.659771+0000","last_peered":"2024-09-12T18:02:38.659771+0000","last_clean":"2024-09-12T18:02:38.659771+0000","last_became_active":"2024-09-12T17:40:27.381128+0000","last_became_peered":"2024-09-12T17:40:27.381128+0000","last_unstale":"2024-09-12T18:02:38.659771+0000","last_undegraded":"2024-09-12T18:02:38.659771+0000","last_fullsized":"2024-09-12T18:02:38.659771+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:38.659666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:38.659666+0000","last_clean_scrub_stamp":"2024-09-12T18:02:38.659666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:30.233020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"261'15","reported_seq":91,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.028722+0000","last_change":"2024-09-12T18:02:33.028722+0000","last_active":"2024-09-12T18:02:33.028722+0000","last_peered":"2024-09-12T18:02:33.028722+0000","last_clean":"2024-09-12T18:02:33.028722+0000","last_became_active":"2024-09-12T17:38:51.210741+0000","last_became_peered":"2024-09-12T17:38:51.210741+0000","last_unstale":"2024-09-12T18:02:33.028722+0000","last_undegraded":"2024-09-12T18:02:33.028722+0000","last_fullsized":"2024-09-12T18:02:33.028722+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'15","last_scrub_stamp":"2024-09-12T18:02:33.028632+0000","last_deep_scrub":"261'15","last_deep_scrub_stamp":"2024-09-12T18:02:33.028632+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.028632+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:25.853519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":45,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:51.862050+0000","last_change":"2024-09-12T18:02:51.862050+0000","last_active":"2024-09-12T18:02:51.862050+0000","last_peered":"2024-09-12T18:02:51.862050+0000","last_clean":"2024-09-12T18:02:51.862050+0000","last_became_active":"2024-09-12T17:50:58.422195+0000","last_became_peered":"2024-09-12T17:50:58.422195+0000","last_unstale":"2024-09-12T18:02:51.862050+0000","last_undegraded":"2024-09-12T18:02:51.862050+0000","last_fullsized":"2024-09-12T18:02:51.862050+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:51.861932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:51.861932+0000","last_clean_scrub_stamp":"2024-09-12T18:02:51.861932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:52.531598+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.917383+0000","last_change":"2024-09-12T18:02:28.917383+0000","last_active":"2024-09-12T18:02:28.917383+0000","last_peered":"2024-09-12T18:02:28.917383+0000","last_clean":"2024-09-12T18:02:28.917383+0000","last_became_active":"2024-09-12T17:40:30.418692+0000","last_became_peered":"2024-09-12T17:40:30.418692+0000","last_unstale":"2024-09-12T18:02:28.917383+0000","last_undegraded":"2024-09-12T18:02:28.917383+0000","last_fullsized":"2024-09-12T18:02:28.917383+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:28.917289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:28.917289+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.917289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:06.086875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"258'6","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.908948+0000","last_change":"2024-09-12T18:02:26.908948+0000","last_active":"2024-09-12T18:02:26.908948+0000","last_peered":"2024-09-12T18:02:26.908948+0000","last_clean":"2024-09-12T18:02:26.908948+0000","last_became_active":"2024-09-12T17:40:27.376395+0000","last_became_peered":"2024-09-12T17:40:27.376395+0000","last_unstale":"2024-09-12T18:02:26.908948+0000","last_undegraded":"2024-09-12T18:02:26.908948+0000","last_fullsized":"2024-09-12T18:02:26.908948+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'6","last_scrub_stamp":"2024-09-12T18:02:26.908837+0000","last_deep_scrub":"258'6","last_deep_scrub_stamp":"2024-09-12T18:02:26.908837+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.908837+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:49.934905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"261'24","reported_seq":118,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.063627+0000","last_change":"2024-09-12T18:02:22.063627+0000","last_active":"2024-09-12T18:02:22.063627+0000","last_peered":"2024-09-12T18:02:22.063627+0000","last_clean":"2024-09-12T18:02:22.063627+0000","last_became_active":"2024-09-12T17:38:51.212856+0000","last_became_peered":"2024-09-12T17:38:51.212856+0000","last_unstale":"2024-09-12T18:02:22.063627+0000","last_undegraded":"2024-09-12T18:02:22.063627+0000","last_fullsized":"2024-09-12T18:02:22.063627+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'24","last_scrub_stamp":"2024-09-12T18:02:22.063538+0000","last_deep_scrub":"261'24","last_deep_scrub_stamp":"2024-09-12T18:02:22.063538+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.063538+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:33.470326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":83,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:47.589547+0000","last_change":"2024-09-12T18:02:47.589547+0000","last_active":"2024-09-12T18:02:47.589547+0000","last_peered":"2024-09-12T18:02:47.589547+0000","last_clean":"2024-09-12T18:02:47.589547+0000","last_became_active":"2024-09-12T17:50:58.431442+0000","last_became_peered":"2024-09-12T17:50:58.431442+0000","last_unstale":"2024-09-12T18:02:47.589547+0000","last_undegraded":"2024-09-12T18:02:47.589547+0000","last_fullsized":"2024-09-12T18:02:47.589547+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:47.589463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:47.589463+0000","last_clean_scrub_stamp":"2024-09-12T18:02:47.589463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:17.047150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"258'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:39.996129+0000","last_change":"2024-09-12T18:02:39.996129+0000","last_active":"2024-09-12T18:02:39.996129+0000","last_peered":"2024-09-12T18:02:39.996129+0000","last_clean":"2024-09-12T18:02:39.996129+0000","last_became_active":"2024-09-12T17:40:30.418464+0000","last_became_peered":"2024-09-12T17:40:30.418464+0000","last_unstale":"2024-09-12T18:02:39.996129+0000","last_undegraded":"2024-09-12T18:02:39.996129+0000","last_fullsized":"2024-09-12T18:02:39.996129+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T18:02:39.996034+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T18:02:39.996034+0000","last_clean_scrub_stamp":"2024-09-12T18:02:39.996034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:10.487456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"261'5","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.917366+0000","last_change":"2024-09-12T18:02:27.917366+0000","last_active":"2024-09-12T18:02:27.917366+0000","last_peered":"2024-09-12T18:02:27.917366+0000","last_clean":"2024-09-12T18:02:27.917366+0000","last_became_active":"2024-09-12T17:40:27.379133+0000","last_became_peered":"2024-09-12T17:40:27.379133+0000","last_unstale":"2024-09-12T18:02:27.917366+0000","last_undegraded":"2024-09-12T18:02:27.917366+0000","last_fullsized":"2024-09-12T18:02:27.917366+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:02:27.917270+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:02:27.917270+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.917270+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:50.826263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"261'32","reported_seq":139,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.720137+0000","last_change":"2024-09-12T18:02:30.720076+0000","last_active":"2024-09-12T18:02:30.720137+0000","last_peered":"2024-09-12T18:02:30.720137+0000","last_clean":"2024-09-12T18:02:30.720137+0000","last_became_active":"2024-09-12T17:38:51.208386+0000","last_became_peered":"2024-09-12T17:38:51.208386+0000","last_unstale":"2024-09-12T18:02:30.720137+0000","last_undegraded":"2024-09-12T18:02:30.720137+0000","last_fullsized":"2024-09-12T18:02:30.720137+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'32","last_scrub_stamp":"2024-09-12T18:02:30.719990+0000","last_deep_scrub":"261'32","last_deep_scrub_stamp":"2024-09-12T18:02:30.719990+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.719990+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:28.036111+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":109,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"261'348","reported_seq":968,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.683587+0000","last_change":"2024-09-12T18:02:14.683587+0000","last_active":"2024-09-12T18:02:14.683587+0000","last_peered":"2024-09-12T18:02:14.683587+0000","last_clean":"2024-09-12T18:02:14.683587+0000","last_became_active":"2024-09-12T17:23:40.708951+0000","last_became_peered":"2024-09-12T17:23:40.708951+0000","last_unstale":"2024-09-12T18:02:14.683587+0000","last_undegraded":"2024-09-12T18:02:14.683587+0000","last_fullsized":"2024-09-12T18:02:14.683587+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'348","last_scrub_stamp":"2024-09-12T18:02:14.683458+0000","last_deep_scrub":"261'348","last_deep_scrub_stamp":"2024-09-12T18:02:14.683458+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.683458+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:37.385508+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25551,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":469,"num_read_kb":4680,"num_write":1107,"num_write_kb":27229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"261'484","reported_seq":2019,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.256682+0000","last_change":"2024-09-12T18:02:18.256682+0000","last_active":"2024-09-12T18:02:18.256682+0000","last_peered":"2024-09-12T18:02:18.256682+0000","last_clean":"2024-09-12T18:02:18.256682+0000","last_became_active":"2024-09-12T17:23:42.146906+0000","last_became_peered":"2024-09-12T17:23:42.146906+0000","last_unstale":"2024-09-12T18:02:18.256682+0000","last_undegraded":"2024-09-12T18:02:18.256682+0000","last_fullsized":"2024-09-12T18:02:18.256682+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'484","last_scrub_stamp":"2024-09-12T18:02:18.256606+0000","last_deep_scrub":"261'484","last_deep_scrub_stamp":"2024-09-12T18:02:18.256606+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.256606+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:20.735639+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2345,"num_read_kb":2204,"num_write":541,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"261'408","reported_seq":1089,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.042650+0000","last_change":"2024-09-12T18:02:02.042650+0000","last_active":"2024-09-12T18:02:02.042650+0000","last_peered":"2024-09-12T18:02:02.042650+0000","last_clean":"2024-09-12T18:02:02.042650+0000","last_became_active":"2024-09-12T17:23:40.719834+0000","last_became_peered":"2024-09-12T17:23:40.719834+0000","last_unstale":"2024-09-12T18:02:02.042650+0000","last_undegraded":"2024-09-12T18:02:02.042650+0000","last_fullsized":"2024-09-12T18:02:02.042650+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'408","last_scrub_stamp":"2024-09-12T18:02:02.042521+0000","last_deep_scrub":"261'408","last_deep_scrub_stamp":"2024-09-12T18:02:02.042521+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.042521+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:05.142643+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":637,"num_read_kb":15953,"num_write":1206,"num_write_kb":28721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"261'478","reported_seq":2228,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.743852+0000","last_change":"2024-09-12T18:02:12.743852+0000","last_active":"2024-09-12T18:02:12.743852+0000","last_peered":"2024-09-12T18:02:12.743852+0000","last_clean":"2024-09-12T18:02:12.743852+0000","last_became_active":"2024-09-12T17:23:42.147270+0000","last_became_peered":"2024-09-12T17:23:42.147270+0000","last_unstale":"2024-09-12T18:02:12.743852+0000","last_undegraded":"2024-09-12T18:02:12.743852+0000","last_fullsized":"2024-09-12T18:02:12.743852+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'478","last_scrub_stamp":"2024-09-12T18:02:12.743753+0000","last_deep_scrub":"261'478","last_deep_scrub_stamp":"2024-09-12T18:02:12.743753+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.743753+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:19.692853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3009,"num_read_kb":2866,"num_write":558,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"261'351","reported_seq":1157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.764996+0000","last_change":"2024-09-12T18:02:00.764996+0000","last_active":"2024-09-12T18:02:00.764996+0000","last_peered":"2024-09-12T18:02:00.764996+0000","last_clean":"2024-09-12T18:02:00.764996+0000","last_became_active":"2024-09-12T17:23:40.701839+0000","last_became_peered":"2024-09-12T17:23:40.701839+0000","last_unstale":"2024-09-12T18:02:00.764996+0000","last_undegraded":"2024-09-12T18:02:00.764996+0000","last_fullsized":"2024-09-12T18:02:00.764996+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'351","last_scrub_stamp":"2024-09-12T18:02:00.764896+0000","last_deep_scrub":"261'351","last_deep_scrub_stamp":"2024-09-12T18:02:00.764896+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.764896+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:13.922951+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311813,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":845,"num_read_kb":22445,"num_write":993,"num_write_kb":35081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"261'1195","reported_seq":2837,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.220054+0000","last_change":"2024-09-12T18:02:15.220054+0000","last_active":"2024-09-12T18:02:15.220054+0000","last_peered":"2024-09-12T18:02:15.220054+0000","last_clean":"2024-09-12T18:02:15.220054+0000","last_became_active":"2024-09-12T17:23:42.141845+0000","last_became_peered":"2024-09-12T17:23:42.141845+0000","last_unstale":"2024-09-12T18:02:15.220054+0000","last_undegraded":"2024-09-12T18:02:15.220054+0000","last_fullsized":"2024-09-12T18:02:15.220054+0000","mapping_epoch":25,"log_start":"261'1100","ondisk_log_start":"261'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1195","last_scrub_stamp":"2024-09-12T18:02:15.219948+0000","last_deep_scrub":"261'1195","last_deep_scrub_stamp":"2024-09-12T18:02:15.219948+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.219948+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":1100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:58.470773+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5470,"num_read_kb":4840,"num_write":1657,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"261'403","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.267301+0000","last_change":"2024-09-12T18:02:09.267301+0000","last_active":"2024-09-12T18:02:09.267301+0000","last_peered":"2024-09-12T18:02:09.267301+0000","last_clean":"2024-09-12T18:02:09.267301+0000","last_became_active":"2024-09-12T17:23:40.712263+0000","last_became_peered":"2024-09-12T17:23:40.712263+0000","last_unstale":"2024-09-12T18:02:09.267301+0000","last_undegraded":"2024-09-12T18:02:09.267301+0000","last_fullsized":"2024-09-12T18:02:09.267301+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'403","last_scrub_stamp":"2024-09-12T18:02:09.267186+0000","last_deep_scrub":"261'403","last_deep_scrub_stamp":"2024-09-12T18:02:09.267186+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.267186+0000","objects_scrubbed":8,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:55.391563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262228,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":543,"num_read_kb":11573,"num_write":1248,"num_write_kb":26002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"261'1243","reported_seq":2931,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.621430+0000","last_change":"2024-09-12T18:02:11.621430+0000","last_active":"2024-09-12T18:02:11.621430+0000","last_peered":"2024-09-12T18:02:11.621430+0000","last_clean":"2024-09-12T18:02:11.621430+0000","last_became_active":"2024-09-12T17:23:42.157835+0000","last_became_peered":"2024-09-12T17:23:42.157835+0000","last_unstale":"2024-09-12T18:02:11.621430+0000","last_undegraded":"2024-09-12T18:02:11.621430+0000","last_fullsized":"2024-09-12T18:02:11.621430+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1243","last_scrub_stamp":"2024-09-12T18:02:11.621334+0000","last_deep_scrub":"261'1243","last_deep_scrub_stamp":"2024-09-12T18:02:11.621334+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.621334+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:43.082819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5656,"num_read_kb":5021,"num_write":1694,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":960,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"261'354","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.716953+0000","last_change":"2024-09-12T18:02:09.716953+0000","last_active":"2024-09-12T18:02:09.716953+0000","last_peered":"2024-09-12T18:02:09.716953+0000","last_clean":"2024-09-12T18:02:09.716953+0000","last_became_active":"2024-09-12T17:23:40.705906+0000","last_became_peered":"2024-09-12T17:23:40.705906+0000","last_unstale":"2024-09-12T18:02:09.716953+0000","last_undegraded":"2024-09-12T18:02:09.716953+0000","last_fullsized":"2024-09-12T18:02:09.716953+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-12T18:02:09.716851+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-12T18:02:09.716851+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.716851+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:14.429035+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":673,"num_read_kb":37545,"num_write":1095,"num_write_kb":42867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"261'385","reported_seq":1833,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.133940+0000","last_change":"2024-09-12T18:02:07.133940+0000","last_active":"2024-09-12T18:02:07.133940+0000","last_peered":"2024-09-12T18:02:07.133940+0000","last_clean":"2024-09-12T18:02:07.133940+0000","last_became_active":"2024-09-12T17:23:42.142311+0000","last_became_peered":"2024-09-12T17:23:42.142311+0000","last_unstale":"2024-09-12T18:02:07.133940+0000","last_undegraded":"2024-09-12T18:02:07.133940+0000","last_fullsized":"2024-09-12T18:02:07.133940+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'385","last_scrub_stamp":"2024-09-12T18:02:07.133832+0000","last_deep_scrub":"261'385","last_deep_scrub_stamp":"2024-09-12T18:02:07.133832+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.133832+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:19.123354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2045,"num_read_kb":1945,"num_write":422,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"261'388","reported_seq":1088,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.238542+0000","last_change":"2024-09-12T18:02:08.238542+0000","last_active":"2024-09-12T18:02:08.238542+0000","last_peered":"2024-09-12T18:02:08.238542+0000","last_clean":"2024-09-12T18:02:08.238542+0000","last_became_active":"2024-09-12T17:23:40.705215+0000","last_became_peered":"2024-09-12T17:23:40.705215+0000","last_unstale":"2024-09-12T18:02:08.238542+0000","last_undegraded":"2024-09-12T18:02:08.238542+0000","last_fullsized":"2024-09-12T18:02:08.238542+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'388","last_scrub_stamp":"2024-09-12T18:02:08.238416+0000","last_deep_scrub":"261'388","last_deep_scrub_stamp":"2024-09-12T18:02:08.238416+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.238416+0000","objects_scrubbed":9,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:20.183404+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253978,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":760,"num_read_kb":26786,"num_write":1280,"num_write_kb":30822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"261'884","reported_seq":2686,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.226415+0000","last_change":"2024-09-12T18:02:18.226415+0000","last_active":"2024-09-12T18:02:18.226415+0000","last_peered":"2024-09-12T18:02:18.226415+0000","last_clean":"2024-09-12T18:02:18.226415+0000","last_became_active":"2024-09-12T17:23:42.143402+0000","last_became_peered":"2024-09-12T17:23:42.143402+0000","last_unstale":"2024-09-12T18:02:18.226415+0000","last_undegraded":"2024-09-12T18:02:18.226415+0000","last_fullsized":"2024-09-12T18:02:18.226415+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'884","last_scrub_stamp":"2024-09-12T18:02:18.226319+0000","last_deep_scrub":"261'884","last_deep_scrub_stamp":"2024-09-12T18:02:18.226319+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.226319+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":800,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:00.126404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4455,"num_read_kb":4051,"num_write":1149,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"261'328","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.738544+0000","last_change":"2024-09-12T18:02:08.738544+0000","last_active":"2024-09-12T18:02:08.738544+0000","last_peered":"2024-09-12T18:02:08.738544+0000","last_clean":"2024-09-12T18:02:08.738544+0000","last_became_active":"2024-09-12T17:23:40.713883+0000","last_became_peered":"2024-09-12T17:23:40.713883+0000","last_unstale":"2024-09-12T18:02:08.738544+0000","last_undegraded":"2024-09-12T18:02:08.738544+0000","last_fullsized":"2024-09-12T18:02:08.738544+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'328","last_scrub_stamp":"2024-09-12T18:02:08.738443+0000","last_deep_scrub":"261'328","last_deep_scrub_stamp":"2024-09-12T18:02:08.738443+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.738443+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:35.473029+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":466,"num_read_kb":1994,"num_write":1104,"num_write_kb":56686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"261'918","reported_seq":2629,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.248516+0000","last_change":"2024-09-12T18:02:16.248516+0000","last_active":"2024-09-12T18:02:16.248516+0000","last_peered":"2024-09-12T18:02:16.248516+0000","last_clean":"2024-09-12T18:02:16.248516+0000","last_became_active":"2024-09-12T17:23:42.152030+0000","last_became_peered":"2024-09-12T17:23:42.152030+0000","last_unstale":"2024-09-12T18:02:16.248516+0000","last_undegraded":"2024-09-12T18:02:16.248516+0000","last_fullsized":"2024-09-12T18:02:16.248516+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'918","last_scrub_stamp":"2024-09-12T18:02:16.248418+0000","last_deep_scrub":"261'918","last_deep_scrub_stamp":"2024-09-12T18:02:16.248418+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.248418+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:33.323420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4677,"num_read_kb":4199,"num_write":1240,"num_write_kb":482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3560,"num_omap_keys":14,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"261'319","reported_seq":1003,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.254612+0000","last_change":"2024-09-12T18:02:04.254612+0000","last_active":"2024-09-12T18:02:04.254612+0000","last_peered":"2024-09-12T18:02:04.254612+0000","last_clean":"2024-09-12T18:02:04.254612+0000","last_became_active":"2024-09-12T17:23:40.717097+0000","last_became_peered":"2024-09-12T17:23:40.717097+0000","last_unstale":"2024-09-12T18:02:04.254612+0000","last_undegraded":"2024-09-12T18:02:04.254612+0000","last_fullsized":"2024-09-12T18:02:04.254612+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'319","last_scrub_stamp":"2024-09-12T18:02:04.254489+0000","last_deep_scrub":"261'319","last_deep_scrub_stamp":"2024-09-12T18:02:04.254489+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.254489+0000","objects_scrubbed":11,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:54.537782+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655891,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":586,"num_read_kb":3212,"num_write":1067,"num_write_kb":17046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"261'393","reported_seq":1874,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.028906+0000","last_change":"2024-09-12T18:02:04.028847+0000","last_active":"2024-09-12T18:02:04.028906+0000","last_peered":"2024-09-12T18:02:04.028906+0000","last_clean":"2024-09-12T18:02:04.028906+0000","last_became_active":"2024-09-12T17:24:17.226840+0000","last_became_peered":"2024-09-12T17:24:17.226840+0000","last_unstale":"2024-09-12T18:02:04.028906+0000","last_undegraded":"2024-09-12T18:02:04.028906+0000","last_fullsized":"2024-09-12T18:02:04.028906+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'393","last_scrub_stamp":"2024-09-12T18:02:04.028758+0000","last_deep_scrub":"261'393","last_deep_scrub_stamp":"2024-09-12T18:02:04.028758+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.028758+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:31.967642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2081,"num_read_kb":1979,"num_write":442,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"261'752","reported_seq":2074,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.188709+0000","last_change":"2024-09-12T18:02:14.188709+0000","last_active":"2024-09-12T18:02:14.188709+0000","last_peered":"2024-09-12T18:02:14.188709+0000","last_clean":"2024-09-12T18:02:14.188709+0000","last_became_active":"2024-09-12T17:23:42.152513+0000","last_became_peered":"2024-09-12T17:23:42.152513+0000","last_unstale":"2024-09-12T18:02:14.188709+0000","last_undegraded":"2024-09-12T18:02:14.188709+0000","last_fullsized":"2024-09-12T18:02:14.188709+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'752","last_scrub_stamp":"2024-09-12T18:02:14.188596+0000","last_deep_scrub":"261'752","last_deep_scrub_stamp":"2024-09-12T18:02:14.188596+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.188596+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:55.988212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3383,"num_read_kb":3022,"num_write":991,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"261'313","reported_seq":939,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.746278+0000","last_change":"2024-09-12T18:02:07.746218+0000","last_active":"2024-09-12T18:02:07.746278+0000","last_peered":"2024-09-12T18:02:07.746278+0000","last_clean":"2024-09-12T18:02:07.746278+0000","last_became_active":"2024-09-12T17:23:40.712747+0000","last_became_peered":"2024-09-12T17:23:40.712747+0000","last_unstale":"2024-09-12T18:02:07.746278+0000","last_undegraded":"2024-09-12T18:02:07.746278+0000","last_fullsized":"2024-09-12T18:02:07.746278+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'313","last_scrub_stamp":"2024-09-12T18:02:07.746109+0000","last_deep_scrub":"261'313","last_deep_scrub_stamp":"2024-09-12T18:02:07.746109+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.746109+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:03.900469+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":452,"num_read_kb":32150,"num_write":963,"num_write_kb":37186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"261'506","reported_seq":2017,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.701997+0000","last_change":"2024-09-12T18:02:11.701997+0000","last_active":"2024-09-12T18:02:11.701997+0000","last_peered":"2024-09-12T18:02:11.701997+0000","last_clean":"2024-09-12T18:02:11.701997+0000","last_became_active":"2024-09-12T17:23:42.148091+0000","last_became_peered":"2024-09-12T17:23:42.148091+0000","last_unstale":"2024-09-12T18:02:11.701997+0000","last_undegraded":"2024-09-12T18:02:11.701997+0000","last_fullsized":"2024-09-12T18:02:11.701997+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'506","last_scrub_stamp":"2024-09-12T18:02:11.701886+0000","last_deep_scrub":"261'506","last_deep_scrub_stamp":"2024-09-12T18:02:11.701886+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.701886+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:22.240495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2605,"num_read_kb":2400,"num_write":650,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"261'353","reported_seq":1049,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.106568+0000","last_change":"2024-09-12T18:02:03.106506+0000","last_active":"2024-09-12T18:02:03.106568+0000","last_peered":"2024-09-12T18:02:03.106568+0000","last_clean":"2024-09-12T18:02:03.106568+0000","last_became_active":"2024-09-12T17:23:40.708089+0000","last_became_peered":"2024-09-12T17:23:40.708089+0000","last_unstale":"2024-09-12T18:02:03.106568+0000","last_undegraded":"2024-09-12T18:02:03.106568+0000","last_fullsized":"2024-09-12T18:02:03.106568+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'353","last_scrub_stamp":"2024-09-12T18:02:03.106382+0000","last_deep_scrub":"261'353","last_deep_scrub_stamp":"2024-09-12T18:02:03.106382+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.106382+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:42.275338+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":647,"num_read_kb":14175,"num_write":1176,"num_write_kb":46213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"261'912","reported_seq":2505,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.237194+0000","last_change":"2024-09-12T18:02:14.237194+0000","last_active":"2024-09-12T18:02:14.237194+0000","last_peered":"2024-09-12T18:02:14.237194+0000","last_clean":"2024-09-12T18:02:14.237194+0000","last_became_active":"2024-09-12T17:23:42.145860+0000","last_became_peered":"2024-09-12T17:23:42.145860+0000","last_unstale":"2024-09-12T18:02:14.237194+0000","last_undegraded":"2024-09-12T18:02:14.237194+0000","last_fullsized":"2024-09-12T18:02:14.237194+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'912","last_scrub_stamp":"2024-09-12T18:02:14.237107+0000","last_deep_scrub":"261'912","last_deep_scrub_stamp":"2024-09-12T18:02:14.237107+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.237107+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":900,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:39.982382+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4352,"num_read_kb":3896,"num_write":1238,"num_write_kb":509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"261'349","reported_seq":1091,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.094349+0000","last_change":"2024-09-12T18:02:02.094282+0000","last_active":"2024-09-12T18:02:02.094349+0000","last_peered":"2024-09-12T18:02:02.094349+0000","last_clean":"2024-09-12T18:02:02.094349+0000","last_became_active":"2024-09-12T17:24:17.232979+0000","last_became_peered":"2024-09-12T17:24:17.232979+0000","last_unstale":"2024-09-12T18:02:02.094349+0000","last_undegraded":"2024-09-12T18:02:02.094349+0000","last_fullsized":"2024-09-12T18:02:02.094349+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T18:02:02.094149+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T18:02:02.094149+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.094149+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:51.671674+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":809,"num_read_kb":6334,"num_write":1258,"num_write_kb":23763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"261'428","reported_seq":1999,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.031902+0000","last_change":"2024-09-12T18:02:02.031835+0000","last_active":"2024-09-12T18:02:02.031902+0000","last_peered":"2024-09-12T18:02:02.031902+0000","last_clean":"2024-09-12T18:02:02.031902+0000","last_became_active":"2024-09-12T17:23:42.148023+0000","last_became_peered":"2024-09-12T17:23:42.148023+0000","last_unstale":"2024-09-12T18:02:02.031902+0000","last_undegraded":"2024-09-12T18:02:02.031902+0000","last_fullsized":"2024-09-12T18:02:02.031902+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'428","last_scrub_stamp":"2024-09-12T18:02:02.031748+0000","last_deep_scrub":"261'428","last_deep_scrub_stamp":"2024-09-12T18:02:02.031748+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.031748+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:37.883390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2276,"num_read_kb":2173,"num_write":473,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"261'353","reported_seq":977,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.085784+0000","last_change":"2024-09-12T18:02:00.085723+0000","last_active":"2024-09-12T18:02:00.085784+0000","last_peered":"2024-09-12T18:02:00.085784+0000","last_clean":"2024-09-12T18:02:00.085784+0000","last_became_active":"2024-09-12T17:23:40.714604+0000","last_became_peered":"2024-09-12T17:23:40.714604+0000","last_unstale":"2024-09-12T18:02:00.085784+0000","last_undegraded":"2024-09-12T18:02:00.085784+0000","last_fullsized":"2024-09-12T18:02:00.085784+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'353","last_scrub_stamp":"2024-09-12T18:02:00.085618+0000","last_deep_scrub":"261'353","last_deep_scrub_stamp":"2024-09-12T18:02:00.085618+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.085618+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:44.532607+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":7319,"num_write":1124,"num_write_kb":22062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"261'421","reported_seq":1942,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.017442+0000","last_change":"2024-09-12T18:02:03.017362+0000","last_active":"2024-09-12T18:02:03.017442+0000","last_peered":"2024-09-12T18:02:03.017442+0000","last_clean":"2024-09-12T18:02:03.017442+0000","last_became_active":"2024-09-12T17:23:42.141237+0000","last_became_peered":"2024-09-12T17:23:42.141237+0000","last_unstale":"2024-09-12T18:02:03.017442+0000","last_undegraded":"2024-09-12T18:02:03.017442+0000","last_fullsized":"2024-09-12T18:02:03.017442+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'421","last_scrub_stamp":"2024-09-12T18:02:03.017268+0000","last_deep_scrub":"261'421","last_deep_scrub_stamp":"2024-09-12T18:02:03.017268+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.017268+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:06.467480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2248,"num_read_kb":2133,"num_write":484,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"261'334","reported_seq":959,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.234784+0000","last_change":"2024-09-12T18:02:03.234682+0000","last_active":"2024-09-12T18:02:03.234784+0000","last_peered":"2024-09-12T18:02:03.234784+0000","last_clean":"2024-09-12T18:02:03.234784+0000","last_became_active":"2024-09-12T17:23:40.704825+0000","last_became_peered":"2024-09-12T17:23:40.704825+0000","last_unstale":"2024-09-12T18:02:03.234784+0000","last_undegraded":"2024-09-12T18:02:03.234784+0000","last_fullsized":"2024-09-12T18:02:03.234784+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'334","last_scrub_stamp":"2024-09-12T18:02:03.234556+0000","last_deep_scrub":"261'334","last_deep_scrub_stamp":"2024-09-12T18:02:03.234556+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.234556+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:14.374566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":456,"num_read_kb":2074,"num_write":1044,"num_write_kb":16303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"261'381","reported_seq":1879,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.160859+0000","last_change":"2024-09-12T18:02:13.160794+0000","last_active":"2024-09-12T18:02:13.160859+0000","last_peered":"2024-09-12T18:02:13.160859+0000","last_clean":"2024-09-12T18:02:13.160859+0000","last_became_active":"2024-09-12T17:23:42.137455+0000","last_became_peered":"2024-09-12T17:23:42.137455+0000","last_unstale":"2024-09-12T18:02:13.160859+0000","last_undegraded":"2024-09-12T18:02:13.160859+0000","last_fullsized":"2024-09-12T18:02:13.160859+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'381","last_scrub_stamp":"2024-09-12T18:02:13.160695+0000","last_deep_scrub":"261'381","last_deep_scrub_stamp":"2024-09-12T18:02:13.160695+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.160695+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:54.943636+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2042,"num_read_kb":1965,"num_write":435,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"261'367","reported_seq":1018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.735389+0000","last_change":"2024-09-12T18:01:59.735389+0000","last_active":"2024-09-12T18:01:59.735389+0000","last_peered":"2024-09-12T18:01:59.735389+0000","last_clean":"2024-09-12T18:01:59.735389+0000","last_became_active":"2024-09-12T17:23:40.711201+0000","last_became_peered":"2024-09-12T17:23:40.711201+0000","last_unstale":"2024-09-12T18:01:59.735389+0000","last_undegraded":"2024-09-12T18:01:59.735389+0000","last_fullsized":"2024-09-12T18:01:59.735389+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'367","last_scrub_stamp":"2024-09-12T18:01:59.735272+0000","last_deep_scrub":"261'367","last_deep_scrub_stamp":"2024-09-12T18:01:59.735272+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.735272+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:34.384056+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2561815,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":549,"num_read_kb":25516,"num_write":1199,"num_write_kb":38939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"261'154","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.059026+0000","last_change":"2024-09-12T18:02:31.059026+0000","last_active":"2024-09-12T18:02:31.059026+0000","last_peered":"2024-09-12T18:02:31.059026+0000","last_clean":"2024-09-12T18:02:31.059026+0000","last_became_active":"2024-09-12T17:23:50.184149+0000","last_became_peered":"2024-09-12T17:23:50.184149+0000","last_unstale":"2024-09-12T18:02:31.059026+0000","last_undegraded":"2024-09-12T18:02:31.059026+0000","last_fullsized":"2024-09-12T18:02:31.059026+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'154","last_scrub_stamp":"2024-09-12T18:02:31.058932+0000","last_deep_scrub":"261'154","last_deep_scrub_stamp":"2024-09-12T18:02:31.058932+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.058932+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:01.071144+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":269,"num_read_kb":251,"num_write":373,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"261'433","reported_seq":2045,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.276276+0000","last_change":"2024-09-12T18:02:08.276276+0000","last_active":"2024-09-12T18:02:08.276276+0000","last_peered":"2024-09-12T18:02:08.276276+0000","last_clean":"2024-09-12T18:02:08.276276+0000","last_became_active":"2024-09-12T17:23:42.153262+0000","last_became_peered":"2024-09-12T17:23:42.153262+0000","last_unstale":"2024-09-12T18:02:08.276276+0000","last_undegraded":"2024-09-12T18:02:08.276276+0000","last_fullsized":"2024-09-12T18:02:08.276276+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'433","last_scrub_stamp":"2024-09-12T18:02:08.276184+0000","last_deep_scrub":"261'433","last_deep_scrub_stamp":"2024-09-12T18:02:08.276184+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.276184+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:25.968608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2462,"num_read_kb":2350,"num_write":478,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"261'337","reported_seq":967,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.703031+0000","last_change":"2024-09-12T18:02:04.703031+0000","last_active":"2024-09-12T18:02:04.703031+0000","last_peered":"2024-09-12T18:02:04.703031+0000","last_clean":"2024-09-12T18:02:04.703031+0000","last_became_active":"2024-09-12T17:23:40.709513+0000","last_became_peered":"2024-09-12T17:23:40.709513+0000","last_unstale":"2024-09-12T18:02:04.703031+0000","last_undegraded":"2024-09-12T18:02:04.703031+0000","last_fullsized":"2024-09-12T18:02:04.703031+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'337","last_scrub_stamp":"2024-09-12T18:02:04.702947+0000","last_deep_scrub":"261'337","last_deep_scrub_stamp":"2024-09-12T18:02:04.702947+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.702947+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:03.175885+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":481,"num_read_kb":53800,"num_write":1092,"num_write_kb":42009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.185313+0000","last_change":"2024-09-12T18:02:20.185257+0000","last_active":"2024-09-12T18:02:20.185313+0000","last_peered":"2024-09-12T18:02:20.185313+0000","last_clean":"2024-09-12T18:02:20.185313+0000","last_became_active":"2024-09-12T17:23:44.150860+0000","last_became_peered":"2024-09-12T17:23:44.150860+0000","last_unstale":"2024-09-12T18:02:20.185313+0000","last_undegraded":"2024-09-12T18:02:20.185313+0000","last_fullsized":"2024-09-12T18:02:20.185313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:20.185172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:20.185172+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.185172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:12.927147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"261'341","reported_seq":935,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.590262+0000","last_change":"2024-09-12T18:02:18.590169+0000","last_active":"2024-09-12T18:02:18.590262+0000","last_peered":"2024-09-12T18:02:18.590262+0000","last_clean":"2024-09-12T18:02:18.590262+0000","last_became_active":"2024-09-12T17:23:46.152874+0000","last_became_peered":"2024-09-12T17:23:46.152874+0000","last_unstale":"2024-09-12T18:02:18.590262+0000","last_undegraded":"2024-09-12T18:02:18.590262+0000","last_fullsized":"2024-09-12T18:02:18.590262+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'341","last_scrub_stamp":"2024-09-12T18:02:18.590040+0000","last_deep_scrub":"261'341","last_deep_scrub_stamp":"2024-09-12T18:02:18.590040+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.590040+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:14.837701+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49853,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":1208,"num_write":446,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.690548+0000","last_change":"2024-09-12T18:02:28.690484+0000","last_active":"2024-09-12T18:02:28.690548+0000","last_peered":"2024-09-12T18:02:28.690548+0000","last_clean":"2024-09-12T18:02:28.690548+0000","last_became_active":"2024-09-12T17:23:48.168052+0000","last_became_peered":"2024-09-12T17:23:48.168052+0000","last_unstale":"2024-09-12T18:02:28.690548+0000","last_undegraded":"2024-09-12T18:02:28.690548+0000","last_fullsized":"2024-09-12T18:02:28.690548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:28.690399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:28.690399+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.690399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:50.891973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"261'177","reported_seq":741,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.140625+0000","last_change":"2024-09-12T18:02:33.140566+0000","last_active":"2024-09-12T18:02:33.140625+0000","last_peered":"2024-09-12T18:02:33.140625+0000","last_clean":"2024-09-12T18:02:33.140625+0000","last_became_active":"2024-09-12T17:23:50.188506+0000","last_became_peered":"2024-09-12T17:23:50.188506+0000","last_unstale":"2024-09-12T18:02:33.140625+0000","last_undegraded":"2024-09-12T18:02:33.140625+0000","last_fullsized":"2024-09-12T18:02:33.140625+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'177","last_scrub_stamp":"2024-09-12T18:02:33.140475+0000","last_deep_scrub":"261'177","last_deep_scrub_stamp":"2024-09-12T18:02:33.140475+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.140475+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:01.265620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":316,"num_read_kb":300,"num_write":383,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"261'581","reported_seq":2136,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.271107+0000","last_change":"2024-09-12T18:02:11.271006+0000","last_active":"2024-09-12T18:02:11.271107+0000","last_peered":"2024-09-12T18:02:11.271107+0000","last_clean":"2024-09-12T18:02:11.271107+0000","last_became_active":"2024-09-12T17:23:42.143794+0000","last_became_peered":"2024-09-12T17:23:42.143794+0000","last_unstale":"2024-09-12T18:02:11.271107+0000","last_undegraded":"2024-09-12T18:02:11.271107+0000","last_fullsized":"2024-09-12T18:02:11.271107+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'581","last_scrub_stamp":"2024-09-12T18:02:11.270879+0000","last_deep_scrub":"261'581","last_deep_scrub_stamp":"2024-09-12T18:02:11.270879+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.270879+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:08.118727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3146,"num_read_kb":2882,"num_write":787,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1514,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"261'432","reported_seq":1078,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.940842+0000","last_change":"2024-09-12T18:01:57.940842+0000","last_active":"2024-09-12T18:01:57.940842+0000","last_peered":"2024-09-12T18:01:57.940842+0000","last_clean":"2024-09-12T18:01:57.940842+0000","last_became_active":"2024-09-12T17:24:17.287987+0000","last_became_peered":"2024-09-12T17:24:17.287987+0000","last_unstale":"2024-09-12T18:01:57.940842+0000","last_undegraded":"2024-09-12T18:01:57.940842+0000","last_fullsized":"2024-09-12T18:01:57.940842+0000","mapping_epoch":36,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'432","last_scrub_stamp":"2024-09-12T18:01:57.940767+0000","last_deep_scrub":"261'432","last_deep_scrub_stamp":"2024-09-12T18:01:57.940767+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.940767+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:05.500595+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174825,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":630,"num_read_kb":42370,"num_write":1204,"num_write_kb":32675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.285158+0000","last_change":"2024-09-12T18:02:16.285158+0000","last_active":"2024-09-12T18:02:16.285158+0000","last_peered":"2024-09-12T18:02:16.285158+0000","last_clean":"2024-09-12T18:02:16.285158+0000","last_became_active":"2024-09-12T17:23:44.149079+0000","last_became_peered":"2024-09-12T17:23:44.149079+0000","last_unstale":"2024-09-12T18:02:16.285158+0000","last_undegraded":"2024-09-12T18:02:16.285158+0000","last_fullsized":"2024-09-12T18:02:16.285158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:16.285066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:16.285066+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.285066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:05.713328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"261'81","reported_seq":603,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.236795+0000","last_change":"2024-09-12T18:02:21.236737+0000","last_active":"2024-09-12T18:02:21.236795+0000","last_peered":"2024-09-12T18:02:21.236795+0000","last_clean":"2024-09-12T18:02:21.236795+0000","last_became_active":"2024-09-12T17:23:46.150447+0000","last_became_peered":"2024-09-12T17:23:46.150447+0000","last_unstale":"2024-09-12T18:02:21.236795+0000","last_undegraded":"2024-09-12T18:02:21.236795+0000","last_fullsized":"2024-09-12T18:02:21.236795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'81","last_scrub_stamp":"2024-09-12T18:02:21.236652+0000","last_deep_scrub":"261'81","last_deep_scrub_stamp":"2024-09-12T18:02:21.236652+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.236652+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:38.664086+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":77,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.016420+0000","last_change":"2024-09-12T18:02:29.016340+0000","last_active":"2024-09-12T18:02:29.016420+0000","last_peered":"2024-09-12T18:02:29.016420+0000","last_clean":"2024-09-12T18:02:29.016420+0000","last_became_active":"2024-09-12T17:23:48.165965+0000","last_became_peered":"2024-09-12T17:23:48.165965+0000","last_unstale":"2024-09-12T18:02:29.016420+0000","last_undegraded":"2024-09-12T18:02:29.016420+0000","last_fullsized":"2024-09-12T18:02:29.016420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:29.016243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:29.016243+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.016243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:06.472207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"261'118","reported_seq":622,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.632077+0000","last_change":"2024-09-12T18:02:29.632077+0000","last_active":"2024-09-12T18:02:29.632077+0000","last_peered":"2024-09-12T18:02:29.632077+0000","last_clean":"2024-09-12T18:02:29.632077+0000","last_became_active":"2024-09-12T17:23:50.188143+0000","last_became_peered":"2024-09-12T17:23:50.188143+0000","last_unstale":"2024-09-12T18:02:29.632077+0000","last_undegraded":"2024-09-12T18:02:29.632077+0000","last_fullsized":"2024-09-12T18:02:29.632077+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'118","last_scrub_stamp":"2024-09-12T18:02:29.631986+0000","last_deep_scrub":"261'118","last_deep_scrub_stamp":"2024-09-12T18:02:29.631986+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.631986+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:49.267339+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":180,"num_write":267,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"261'433","reported_seq":2059,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.638005+0000","last_change":"2024-09-12T18:02:06.637886+0000","last_active":"2024-09-12T18:02:06.638005+0000","last_peered":"2024-09-12T18:02:06.638005+0000","last_clean":"2024-09-12T18:02:06.638005+0000","last_became_active":"2024-09-12T17:23:42.155137+0000","last_became_peered":"2024-09-12T17:23:42.155137+0000","last_unstale":"2024-09-12T18:02:06.638005+0000","last_undegraded":"2024-09-12T18:02:06.638005+0000","last_fullsized":"2024-09-12T18:02:06.638005+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'433","last_scrub_stamp":"2024-09-12T18:02:06.637778+0000","last_deep_scrub":"261'433","last_deep_scrub_stamp":"2024-09-12T18:02:06.637778+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.637778+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:48.440676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2401,"num_read_kb":2311,"num_write":475,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1514,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"261'493","reported_seq":1150,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.668021+0000","last_change":"2024-09-12T18:02:02.668021+0000","last_active":"2024-09-12T18:02:02.668021+0000","last_peered":"2024-09-12T18:02:02.668021+0000","last_clean":"2024-09-12T18:02:02.668021+0000","last_became_active":"2024-09-12T17:23:40.707549+0000","last_became_peered":"2024-09-12T17:23:40.707549+0000","last_unstale":"2024-09-12T18:02:02.668021+0000","last_undegraded":"2024-09-12T18:02:02.668021+0000","last_fullsized":"2024-09-12T18:02:02.668021+0000","mapping_epoch":23,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'493","last_scrub_stamp":"2024-09-12T18:02:02.667893+0000","last_deep_scrub":"261'493","last_deep_scrub_stamp":"2024-09-12T18:02:02.667893+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.667893+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:16.321949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":822,"num_read_kb":5813,"num_write":1382,"num_write_kb":24859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.266935+0000","last_change":"2024-09-12T18:02:17.266866+0000","last_active":"2024-09-12T18:02:17.266935+0000","last_peered":"2024-09-12T18:02:17.266935+0000","last_clean":"2024-09-12T18:02:17.266935+0000","last_became_active":"2024-09-12T17:23:44.150973+0000","last_became_peered":"2024-09-12T17:23:44.150973+0000","last_unstale":"2024-09-12T18:02:17.266935+0000","last_undegraded":"2024-09-12T18:02:17.266935+0000","last_fullsized":"2024-09-12T18:02:17.266935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:17.266776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:17.266776+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.266776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:00.212068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"261'100","reported_seq":628,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.959168+0000","last_change":"2024-09-12T18:02:12.959168+0000","last_active":"2024-09-12T18:02:12.959168+0000","last_peered":"2024-09-12T18:02:12.959168+0000","last_clean":"2024-09-12T18:02:12.959168+0000","last_became_active":"2024-09-12T17:23:46.153864+0000","last_became_peered":"2024-09-12T17:23:46.153864+0000","last_unstale":"2024-09-12T18:02:12.959168+0000","last_undegraded":"2024-09-12T18:02:12.959168+0000","last_fullsized":"2024-09-12T18:02:12.959168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'100","last_scrub_stamp":"2024-09-12T18:02:12.959072+0000","last_deep_scrub":"261'100","last_deep_scrub_stamp":"2024-09-12T18:02:12.959072+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.959072+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:33.074044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"261'765","reported_seq":2165,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.701740+0000","last_change":"2024-09-12T18:02:27.701665+0000","last_active":"2024-09-12T18:02:27.701740+0000","last_peered":"2024-09-12T18:02:27.701740+0000","last_clean":"2024-09-12T18:02:27.701740+0000","last_became_active":"2024-09-12T17:23:48.173454+0000","last_became_peered":"2024-09-12T17:23:48.173454+0000","last_unstale":"2024-09-12T18:02:27.701740+0000","last_undegraded":"2024-09-12T18:02:27.701740+0000","last_fullsized":"2024-09-12T18:02:27.701740+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'765","last_scrub_stamp":"2024-09-12T18:02:27.701583+0000","last_deep_scrub":"261'765","last_deep_scrub_stamp":"2024-09-12T18:02:27.701583+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.701583+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:16.305885+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"261'217","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.058144+0000","last_change":"2024-09-12T18:02:32.058144+0000","last_active":"2024-09-12T18:02:32.058144+0000","last_peered":"2024-09-12T18:02:32.058144+0000","last_clean":"2024-09-12T18:02:32.058144+0000","last_became_active":"2024-09-12T17:23:50.640401+0000","last_became_peered":"2024-09-12T17:23:50.640401+0000","last_unstale":"2024-09-12T18:02:32.058144+0000","last_undegraded":"2024-09-12T18:02:32.058144+0000","last_fullsized":"2024-09-12T18:02:32.058144+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'217","last_scrub_stamp":"2024-09-12T18:02:32.058040+0000","last_deep_scrub":"261'217","last_deep_scrub_stamp":"2024-09-12T18:02:32.058040+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.058040+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:19.450219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":682,"num_read_kb":671,"num_write":489,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"261'900","reported_seq":2450,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.245836+0000","last_change":"2024-09-12T18:02:09.245763+0000","last_active":"2024-09-12T18:02:09.245836+0000","last_peered":"2024-09-12T18:02:09.245836+0000","last_clean":"2024-09-12T18:02:09.245836+0000","last_became_active":"2024-09-12T17:23:42.147597+0000","last_became_peered":"2024-09-12T17:23:42.147597+0000","last_unstale":"2024-09-12T18:02:09.245836+0000","last_undegraded":"2024-09-12T18:02:09.245836+0000","last_fullsized":"2024-09-12T18:02:09.245836+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'900","last_scrub_stamp":"2024-09-12T18:02:09.245668+0000","last_deep_scrub":"261'900","last_deep_scrub_stamp":"2024-09-12T18:02:09.245668+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.245668+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:31.980911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4183,"num_read_kb":3727,"num_write":1220,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"261'367","reported_seq":1052,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.070259+0000","last_change":"2024-09-12T18:02:00.070259+0000","last_active":"2024-09-12T18:02:00.070259+0000","last_peered":"2024-09-12T18:02:00.070259+0000","last_clean":"2024-09-12T18:02:00.070259+0000","last_became_active":"2024-09-12T17:23:40.718582+0000","last_became_peered":"2024-09-12T17:23:40.718582+0000","last_unstale":"2024-09-12T18:02:00.070259+0000","last_undegraded":"2024-09-12T18:02:00.070259+0000","last_fullsized":"2024-09-12T18:02:00.070259+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'367","last_scrub_stamp":"2024-09-12T18:02:00.070123+0000","last_deep_scrub":"261'367","last_deep_scrub_stamp":"2024-09-12T18:02:00.070123+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.070123+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:55.441884+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":588,"num_read_kb":83250,"num_write":1103,"num_write_kb":35659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.197737+0000","last_change":"2024-09-12T18:02:21.197644+0000","last_active":"2024-09-12T18:02:21.197737+0000","last_peered":"2024-09-12T18:02:21.197737+0000","last_clean":"2024-09-12T18:02:21.197737+0000","last_became_active":"2024-09-12T17:23:44.151918+0000","last_became_peered":"2024-09-12T17:23:44.151918+0000","last_unstale":"2024-09-12T18:02:21.197737+0000","last_undegraded":"2024-09-12T18:02:21.197737+0000","last_fullsized":"2024-09-12T18:02:21.197737+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:21.197551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:21.197551+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.197551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:36.589194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"261'270","reported_seq":830,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.771840+0000","last_change":"2024-09-12T18:02:23.771736+0000","last_active":"2024-09-12T18:02:23.771840+0000","last_peered":"2024-09-12T18:02:23.771840+0000","last_clean":"2024-09-12T18:02:23.771840+0000","last_became_active":"2024-09-12T17:23:46.241137+0000","last_became_peered":"2024-09-12T17:23:46.241137+0000","last_unstale":"2024-09-12T18:02:23.771840+0000","last_undegraded":"2024-09-12T18:02:23.771840+0000","last_fullsized":"2024-09-12T18:02:23.771840+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'270","last_scrub_stamp":"2024-09-12T18:02:23.771628+0000","last_deep_scrub":"261'270","last_deep_scrub_stamp":"2024-09-12T18:02:23.771628+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.771628+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:32.243330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":1112,"num_write":380,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"261'807","reported_seq":6210,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.371547+0000","last_change":"2024-09-12T18:02:30.371547+0000","last_active":"2024-09-12T18:02:30.371547+0000","last_peered":"2024-09-12T18:02:30.371547+0000","last_clean":"2024-09-12T18:02:30.371547+0000","last_became_active":"2024-09-12T17:23:48.167038+0000","last_became_peered":"2024-09-12T17:23:48.167038+0000","last_unstale":"2024-09-12T18:02:30.371547+0000","last_undegraded":"2024-09-12T18:02:30.371547+0000","last_fullsized":"2024-09-12T18:02:30.371547+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'807","last_scrub_stamp":"2024-09-12T18:02:30.371394+0000","last_deep_scrub":"261'807","last_deep_scrub_stamp":"2024-09-12T18:02:30.371394+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.371394+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:04.660887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"261'667","reported_seq":2273,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.287959+0000","last_change":"2024-09-12T18:02:10.287880+0000","last_active":"2024-09-12T18:02:10.287959+0000","last_peered":"2024-09-12T18:02:10.287959+0000","last_clean":"2024-09-12T18:02:10.287959+0000","last_became_active":"2024-09-12T17:23:42.143778+0000","last_became_peered":"2024-09-12T17:23:42.143778+0000","last_unstale":"2024-09-12T18:02:10.287959+0000","last_undegraded":"2024-09-12T18:02:10.287959+0000","last_fullsized":"2024-09-12T18:02:10.287959+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'667","last_scrub_stamp":"2024-09-12T18:02:10.287792+0000","last_deep_scrub":"261'667","last_deep_scrub_stamp":"2024-09-12T18:02:10.287792+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.287792+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":600,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:51.075062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3245,"num_read_kb":3064,"num_write":918,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"261'356","reported_seq":966,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.667617+0000","last_change":"2024-09-12T18:02:01.667556+0000","last_active":"2024-09-12T18:02:01.667617+0000","last_peered":"2024-09-12T18:02:01.667617+0000","last_clean":"2024-09-12T18:02:01.667617+0000","last_became_active":"2024-09-12T17:23:40.709587+0000","last_became_peered":"2024-09-12T17:23:40.709587+0000","last_unstale":"2024-09-12T18:02:01.667617+0000","last_undegraded":"2024-09-12T18:02:01.667617+0000","last_fullsized":"2024-09-12T18:02:01.667617+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'356","last_scrub_stamp":"2024-09-12T18:02:01.667423+0000","last_deep_scrub":"261'356","last_deep_scrub_stamp":"2024-09-12T18:02:01.667423+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.667423+0000","objects_scrubbed":9,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:03.026185+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947352,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":408,"num_read_kb":61352,"num_write":1018,"num_write_kb":60278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.682150+0000","last_change":"2024-09-12T18:02:16.682052+0000","last_active":"2024-09-12T18:02:16.682150+0000","last_peered":"2024-09-12T18:02:16.682150+0000","last_clean":"2024-09-12T18:02:16.682150+0000","last_became_active":"2024-09-12T17:23:44.150957+0000","last_became_peered":"2024-09-12T17:23:44.150957+0000","last_unstale":"2024-09-12T18:02:16.682150+0000","last_undegraded":"2024-09-12T18:02:16.682150+0000","last_fullsized":"2024-09-12T18:02:16.682150+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:16.681963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:16.681963+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.681963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:47.949276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"261'354","reported_seq":955,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.203290+0000","last_change":"2024-09-12T18:02:24.203230+0000","last_active":"2024-09-12T18:02:24.203290+0000","last_peered":"2024-09-12T18:02:24.203290+0000","last_clean":"2024-09-12T18:02:24.203290+0000","last_became_active":"2024-09-12T17:23:46.241442+0000","last_became_peered":"2024-09-12T17:23:46.241442+0000","last_unstale":"2024-09-12T18:02:24.203290+0000","last_undegraded":"2024-09-12T18:02:24.203290+0000","last_fullsized":"2024-09-12T18:02:24.203290+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-12T18:02:24.203125+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-12T18:02:24.203125+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.203125+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:49.009181+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47631,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":562,"num_read_kb":1202,"num_write":448,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.028351+0000","last_change":"2024-09-12T18:02:18.028351+0000","last_active":"2024-09-12T18:02:18.028351+0000","last_peered":"2024-09-12T18:02:18.028351+0000","last_clean":"2024-09-12T18:02:18.028351+0000","last_became_active":"2024-09-12T17:23:48.167925+0000","last_became_peered":"2024-09-12T17:23:48.167925+0000","last_unstale":"2024-09-12T18:02:18.028351+0000","last_undegraded":"2024-09-12T18:02:18.028351+0000","last_fullsized":"2024-09-12T18:02:18.028351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:18.028282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:18.028282+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.028282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:28.697057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"261'579","reported_seq":1395,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.156558+0000","last_change":"2024-09-12T18:02:29.156558+0000","last_active":"2024-09-12T18:02:29.156558+0000","last_peered":"2024-09-12T18:02:29.156558+0000","last_clean":"2024-09-12T18:02:29.156558+0000","last_became_active":"2024-09-12T17:23:50.188109+0000","last_became_peered":"2024-09-12T17:23:50.188109+0000","last_unstale":"2024-09-12T18:02:29.156558+0000","last_undegraded":"2024-09-12T18:02:29.156558+0000","last_fullsized":"2024-09-12T18:02:29.156558+0000","mapping_epoch":33,"log_start":"261'500","ondisk_log_start":"261'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'579","last_scrub_stamp":"2024-09-12T18:02:29.156466+0000","last_deep_scrub":"261'579","last_deep_scrub_stamp":"2024-09-12T18:02:29.156466+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.156466+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:01.376584+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1373,"num_read_kb":1362,"num_write":1221,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"261'468","reported_seq":2012,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.076676+0000","last_change":"2024-09-12T18:02:01.076591+0000","last_active":"2024-09-12T18:02:01.076676+0000","last_peered":"2024-09-12T18:02:01.076676+0000","last_clean":"2024-09-12T18:02:01.076676+0000","last_became_active":"2024-09-12T17:23:42.135997+0000","last_became_peered":"2024-09-12T17:23:42.135997+0000","last_unstale":"2024-09-12T18:02:01.076676+0000","last_undegraded":"2024-09-12T18:02:01.076676+0000","last_fullsized":"2024-09-12T18:02:01.076676+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'468","last_scrub_stamp":"2024-09-12T18:02:01.076481+0000","last_deep_scrub":"261'468","last_deep_scrub_stamp":"2024-09-12T18:02:01.076481+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.076481+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:43.499647+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2354,"num_read_kb":2214,"num_write":547,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"261'349","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.611950+0000","last_change":"2024-09-12T18:01:59.611950+0000","last_active":"2024-09-12T18:01:59.611950+0000","last_peered":"2024-09-12T18:01:59.611950+0000","last_clean":"2024-09-12T18:01:59.611950+0000","last_became_active":"2024-09-12T17:23:40.711546+0000","last_became_peered":"2024-09-12T17:23:40.711546+0000","last_unstale":"2024-09-12T18:01:59.611950+0000","last_undegraded":"2024-09-12T18:01:59.611950+0000","last_fullsized":"2024-09-12T18:01:59.611950+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T18:01:59.611817+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T18:01:59.611817+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.611817+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:06.835809+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":612536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":14392,"num_write":1010,"num_write_kb":31885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.005964+0000","last_change":"2024-09-12T18:02:07.005898+0000","last_active":"2024-09-12T18:02:07.005964+0000","last_peered":"2024-09-12T18:02:07.005964+0000","last_clean":"2024-09-12T18:02:07.005964+0000","last_became_active":"2024-09-12T17:23:44.148472+0000","last_became_peered":"2024-09-12T17:23:44.148472+0000","last_unstale":"2024-09-12T18:02:07.005964+0000","last_undegraded":"2024-09-12T18:02:07.005964+0000","last_fullsized":"2024-09-12T18:02:07.005964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:07.005812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:07.005812+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.005812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:49.459504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"261'249","reported_seq":814,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.315174+0000","last_change":"2024-09-12T18:02:24.315174+0000","last_active":"2024-09-12T18:02:24.315174+0000","last_peered":"2024-09-12T18:02:24.315174+0000","last_clean":"2024-09-12T18:02:24.315174+0000","last_became_active":"2024-09-12T17:23:46.152441+0000","last_became_peered":"2024-09-12T17:23:46.152441+0000","last_unstale":"2024-09-12T18:02:24.315174+0000","last_undegraded":"2024-09-12T18:02:24.315174+0000","last_fullsized":"2024-09-12T18:02:24.315174+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'249","last_scrub_stamp":"2024-09-12T18:02:24.315085+0000","last_deep_scrub":"261'249","last_deep_scrub_stamp":"2024-09-12T18:02:24.315085+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.315085+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:46.268282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46658,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":411,"num_read_kb":954,"num_write":334,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.333010+0000","last_change":"2024-09-12T18:02:29.332954+0000","last_active":"2024-09-12T18:02:29.333010+0000","last_peered":"2024-09-12T18:02:29.333010+0000","last_clean":"2024-09-12T18:02:29.333010+0000","last_became_active":"2024-09-12T17:23:48.167829+0000","last_became_peered":"2024-09-12T17:23:48.167829+0000","last_unstale":"2024-09-12T18:02:29.333010+0000","last_undegraded":"2024-09-12T18:02:29.333010+0000","last_fullsized":"2024-09-12T18:02:29.333010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:29.332866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:29.332866+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.332866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:20.543107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"261'2378","reported_seq":4224,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.107111+0000","last_change":"2024-09-12T18:02:19.107111+0000","last_active":"2024-09-12T18:02:19.107111+0000","last_peered":"2024-09-12T18:02:19.107111+0000","last_clean":"2024-09-12T18:02:19.107111+0000","last_became_active":"2024-09-12T17:23:50.186026+0000","last_became_peered":"2024-09-12T17:23:50.186026+0000","last_unstale":"2024-09-12T18:02:19.107111+0000","last_undegraded":"2024-09-12T18:02:19.107111+0000","last_fullsized":"2024-09-12T18:02:19.107111+0000","mapping_epoch":33,"log_start":"261'2300","ondisk_log_start":"261'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2378","last_scrub_stamp":"2024-09-12T18:02:19.107026+0000","last_deep_scrub":"261'2378","last_deep_scrub_stamp":"2024-09-12T18:02:19.107026+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.107026+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":2300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:43.107144+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6096,"num_read_kb":6075,"num_write":4800,"num_write_kb":1772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"261'459","reported_seq":1997,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.193571+0000","last_change":"2024-09-12T18:02:11.193479+0000","last_active":"2024-09-12T18:02:11.193571+0000","last_peered":"2024-09-12T18:02:11.193571+0000","last_clean":"2024-09-12T18:02:11.193571+0000","last_became_active":"2024-09-12T17:23:42.147136+0000","last_became_peered":"2024-09-12T17:23:42.147136+0000","last_unstale":"2024-09-12T18:02:11.193571+0000","last_undegraded":"2024-09-12T18:02:11.193571+0000","last_fullsized":"2024-09-12T18:02:11.193571+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'459","last_scrub_stamp":"2024-09-12T18:02:11.193356+0000","last_deep_scrub":"261'459","last_deep_scrub_stamp":"2024-09-12T18:02:11.193356+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.193356+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:03.523588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2419,"num_read_kb":2271,"num_write":547,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"261'326","reported_seq":929,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.661213+0000","last_change":"2024-09-12T18:02:03.661213+0000","last_active":"2024-09-12T18:02:03.661213+0000","last_peered":"2024-09-12T18:02:03.661213+0000","last_clean":"2024-09-12T18:02:03.661213+0000","last_became_active":"2024-09-12T17:23:40.713481+0000","last_became_peered":"2024-09-12T17:23:40.713481+0000","last_unstale":"2024-09-12T18:02:03.661213+0000","last_undegraded":"2024-09-12T18:02:03.661213+0000","last_fullsized":"2024-09-12T18:02:03.661213+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-12T18:02:03.661110+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-12T18:02:03.661110+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.661110+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:27.094156+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":421,"num_read_kb":5522,"num_write":1047,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.030052+0000","last_change":"2024-09-12T18:02:10.030052+0000","last_active":"2024-09-12T18:02:10.030052+0000","last_peered":"2024-09-12T18:02:10.030052+0000","last_clean":"2024-09-12T18:02:10.030052+0000","last_became_active":"2024-09-12T17:23:44.147677+0000","last_became_peered":"2024-09-12T17:23:44.147677+0000","last_unstale":"2024-09-12T18:02:10.030052+0000","last_undegraded":"2024-09-12T18:02:10.030052+0000","last_fullsized":"2024-09-12T18:02:10.030052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:10.029964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:10.029964+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.029964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:58.321187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"261'293","reported_seq":867,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.766286+0000","last_change":"2024-09-12T18:02:21.766228+0000","last_active":"2024-09-12T18:02:21.766286+0000","last_peered":"2024-09-12T18:02:21.766286+0000","last_clean":"2024-09-12T18:02:21.766286+0000","last_became_active":"2024-09-12T17:23:46.150555+0000","last_became_peered":"2024-09-12T17:23:46.150555+0000","last_unstale":"2024-09-12T18:02:21.766286+0000","last_undegraded":"2024-09-12T18:02:21.766286+0000","last_fullsized":"2024-09-12T18:02:21.766286+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'293","last_scrub_stamp":"2024-09-12T18:02:21.766124+0000","last_deep_scrub":"261'293","last_deep_scrub_stamp":"2024-09-12T18:02:21.766124+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.766124+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:47.826501+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53816,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":485,"num_read_kb":1109,"num_write":394,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"261'805","reported_seq":2482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.560004+0000","last_change":"2024-09-12T18:02:22.559936+0000","last_active":"2024-09-12T18:02:22.560004+0000","last_peered":"2024-09-12T18:02:22.560004+0000","last_clean":"2024-09-12T18:02:22.560004+0000","last_became_active":"2024-09-12T17:23:48.165179+0000","last_became_peered":"2024-09-12T17:23:48.165179+0000","last_unstale":"2024-09-12T18:02:22.560004+0000","last_undegraded":"2024-09-12T18:02:22.560004+0000","last_fullsized":"2024-09-12T18:02:22.560004+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'805","last_scrub_stamp":"2024-09-12T18:02:22.559848+0000","last_deep_scrub":"261'805","last_deep_scrub_stamp":"2024-09-12T18:02:22.559848+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.559848+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:36.016185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"261'145","reported_seq":642,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.610800+0000","last_change":"2024-09-12T18:02:26.610738+0000","last_active":"2024-09-12T18:02:26.610800+0000","last_peered":"2024-09-12T18:02:26.610800+0000","last_clean":"2024-09-12T18:02:26.610800+0000","last_became_active":"2024-09-12T17:23:50.188230+0000","last_became_peered":"2024-09-12T17:23:50.188230+0000","last_unstale":"2024-09-12T18:02:26.610800+0000","last_undegraded":"2024-09-12T18:02:26.610800+0000","last_fullsized":"2024-09-12T18:02:26.610800+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'145","last_scrub_stamp":"2024-09-12T18:02:26.610649+0000","last_deep_scrub":"261'145","last_deep_scrub_stamp":"2024-09-12T18:02:26.610649+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.610649+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:02.263154+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":185,"num_write":335,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"261'475","reported_seq":2033,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.632480+0000","last_change":"2024-09-12T18:02:04.632480+0000","last_active":"2024-09-12T18:02:04.632480+0000","last_peered":"2024-09-12T18:02:04.632480+0000","last_clean":"2024-09-12T18:02:04.632480+0000","last_became_active":"2024-09-12T17:23:42.153910+0000","last_became_peered":"2024-09-12T17:23:42.153910+0000","last_unstale":"2024-09-12T18:02:04.632480+0000","last_undegraded":"2024-09-12T18:02:04.632480+0000","last_fullsized":"2024-09-12T18:02:04.632480+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'475","last_scrub_stamp":"2024-09-12T18:02:04.632383+0000","last_deep_scrub":"261'475","last_deep_scrub_stamp":"2024-09-12T18:02:04.632383+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.632383+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:53.568782+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2575,"num_read_kb":2405,"num_write":575,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"261'399","reported_seq":1123,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.268326+0000","last_change":"2024-09-12T18:02:00.268326+0000","last_active":"2024-09-12T18:02:00.268326+0000","last_peered":"2024-09-12T18:02:00.268326+0000","last_clean":"2024-09-12T18:02:00.268326+0000","last_became_active":"2024-09-12T17:23:40.712691+0000","last_became_peered":"2024-09-12T17:23:40.712691+0000","last_unstale":"2024-09-12T18:02:00.268326+0000","last_undegraded":"2024-09-12T18:02:00.268326+0000","last_fullsized":"2024-09-12T18:02:00.268326+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'399","last_scrub_stamp":"2024-09-12T18:02:00.268230+0000","last_deep_scrub":"261'399","last_deep_scrub_stamp":"2024-09-12T18:02:00.268230+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.268230+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:40.016187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":118590,"num_write":1283,"num_write_kb":72411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.002552+0000","last_change":"2024-09-12T18:02:09.002484+0000","last_active":"2024-09-12T18:02:09.002552+0000","last_peered":"2024-09-12T18:02:09.002552+0000","last_clean":"2024-09-12T18:02:09.002552+0000","last_became_active":"2024-09-12T17:23:44.142306+0000","last_became_peered":"2024-09-12T17:23:44.142306+0000","last_unstale":"2024-09-12T18:02:09.002552+0000","last_undegraded":"2024-09-12T18:02:09.002552+0000","last_fullsized":"2024-09-12T18:02:09.002552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:09.002389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:09.002389+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.002389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:07.194068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"261'459","reported_seq":1082,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.599084+0000","last_change":"2024-09-12T18:02:16.599021+0000","last_active":"2024-09-12T18:02:16.599084+0000","last_peered":"2024-09-12T18:02:16.599084+0000","last_clean":"2024-09-12T18:02:16.599084+0000","last_became_active":"2024-09-12T17:23:46.153719+0000","last_became_peered":"2024-09-12T17:23:46.153719+0000","last_unstale":"2024-09-12T18:02:16.599084+0000","last_undegraded":"2024-09-12T18:02:16.599084+0000","last_fullsized":"2024-09-12T18:02:16.599084+0000","mapping_epoch":29,"log_start":"261'400","ondisk_log_start":"261'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'459","last_scrub_stamp":"2024-09-12T18:02:16.598915+0000","last_deep_scrub":"261'459","last_deep_scrub_stamp":"2024-09-12T18:02:16.598915+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.598915+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:21.772998+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96999,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":810,"num_read_kb":1963,"num_write":664,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.004271+0000","last_change":"2024-09-12T18:02:12.004207+0000","last_active":"2024-09-12T18:02:12.004271+0000","last_peered":"2024-09-12T18:02:12.004271+0000","last_clean":"2024-09-12T18:02:12.004271+0000","last_became_active":"2024-09-12T17:23:48.170317+0000","last_became_peered":"2024-09-12T17:23:48.170317+0000","last_unstale":"2024-09-12T18:02:12.004271+0000","last_undegraded":"2024-09-12T18:02:12.004271+0000","last_fullsized":"2024-09-12T18:02:12.004271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:12.004106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:12.004106+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.004106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:51.147942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"261'156","reported_seq":670,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.966472+0000","last_change":"2024-09-12T18:02:22.966413+0000","last_active":"2024-09-12T18:02:22.966472+0000","last_peered":"2024-09-12T18:02:22.966472+0000","last_clean":"2024-09-12T18:02:22.966472+0000","last_became_active":"2024-09-12T17:23:50.184033+0000","last_became_peered":"2024-09-12T17:23:50.184033+0000","last_unstale":"2024-09-12T18:02:22.966472+0000","last_undegraded":"2024-09-12T18:02:22.966472+0000","last_fullsized":"2024-09-12T18:02:22.966472+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'156","last_scrub_stamp":"2024-09-12T18:02:22.966324+0000","last_deep_scrub":"261'156","last_deep_scrub_stamp":"2024-09-12T18:02:22.966324+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.966324+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:45.009578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":204,"num_write":351,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"261'835","reported_seq":2451,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.034117+0000","last_change":"2024-09-12T18:02:03.034117+0000","last_active":"2024-09-12T18:02:03.034117+0000","last_peered":"2024-09-12T18:02:03.034117+0000","last_clean":"2024-09-12T18:02:03.034117+0000","last_became_active":"2024-09-12T17:23:42.144703+0000","last_became_peered":"2024-09-12T17:23:42.144703+0000","last_unstale":"2024-09-12T18:02:03.034117+0000","last_undegraded":"2024-09-12T18:02:03.034117+0000","last_fullsized":"2024-09-12T18:02:03.034117+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'835","last_scrub_stamp":"2024-09-12T18:02:03.034031+0000","last_deep_scrub":"261'835","last_deep_scrub_stamp":"2024-09-12T18:02:03.034031+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.034031+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:20.574756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3952,"num_read_kb":3587,"num_write":1103,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"261'396","reported_seq":1062,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.233459+0000","last_change":"2024-09-12T18:01:59.233459+0000","last_active":"2024-09-12T18:01:59.233459+0000","last_peered":"2024-09-12T18:01:59.233459+0000","last_clean":"2024-09-12T18:01:59.233459+0000","last_became_active":"2024-09-12T17:23:40.706213+0000","last_became_peered":"2024-09-12T17:23:40.706213+0000","last_unstale":"2024-09-12T18:01:59.233459+0000","last_undegraded":"2024-09-12T18:01:59.233459+0000","last_fullsized":"2024-09-12T18:01:59.233459+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'396","last_scrub_stamp":"2024-09-12T18:01:59.233355+0000","last_deep_scrub":"261'396","last_deep_scrub_stamp":"2024-09-12T18:01:59.233355+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.233355+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:59.541266+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2088372,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":615,"num_read_kb":8190,"num_write":1407,"num_write_kb":25988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.021025+0000","last_change":"2024-09-12T18:02:08.021025+0000","last_active":"2024-09-12T18:02:08.021025+0000","last_peered":"2024-09-12T18:02:08.021025+0000","last_clean":"2024-09-12T18:02:08.021025+0000","last_became_active":"2024-09-12T17:23:44.149550+0000","last_became_peered":"2024-09-12T17:23:44.149550+0000","last_unstale":"2024-09-12T18:02:08.021025+0000","last_undegraded":"2024-09-12T18:02:08.021025+0000","last_fullsized":"2024-09-12T18:02:08.021025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:08.020929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:08.020929+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.020929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:44.082038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"261'283","reported_seq":855,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.193388+0000","last_change":"2024-09-12T18:02:22.193388+0000","last_active":"2024-09-12T18:02:22.193388+0000","last_peered":"2024-09-12T18:02:22.193388+0000","last_clean":"2024-09-12T18:02:22.193388+0000","last_became_active":"2024-09-12T17:23:46.153210+0000","last_became_peered":"2024-09-12T17:23:46.153210+0000","last_unstale":"2024-09-12T18:02:22.193388+0000","last_undegraded":"2024-09-12T18:02:22.193388+0000","last_fullsized":"2024-09-12T18:02:22.193388+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'283","last_scrub_stamp":"2024-09-12T18:02:22.193294+0000","last_deep_scrub":"261'283","last_deep_scrub_stamp":"2024-09-12T18:02:22.193294+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.193294+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:46.683819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54539,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":1026,"num_write":426,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.528683+0000","last_change":"2024-09-12T18:02:23.528683+0000","last_active":"2024-09-12T18:02:23.528683+0000","last_peered":"2024-09-12T18:02:23.528683+0000","last_clean":"2024-09-12T18:02:23.528683+0000","last_became_active":"2024-09-12T17:23:48.168675+0000","last_became_peered":"2024-09-12T17:23:48.168675+0000","last_unstale":"2024-09-12T18:02:23.528683+0000","last_undegraded":"2024-09-12T18:02:23.528683+0000","last_fullsized":"2024-09-12T18:02:23.528683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:23.528590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:23.528590+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.528590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:41.560581+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"261'101","reported_seq":590,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.335852+0000","last_change":"2024-09-12T18:02:31.335852+0000","last_active":"2024-09-12T18:02:31.335852+0000","last_peered":"2024-09-12T18:02:31.335852+0000","last_clean":"2024-09-12T18:02:31.335852+0000","last_became_active":"2024-09-12T17:23:50.186287+0000","last_became_peered":"2024-09-12T17:23:50.186287+0000","last_unstale":"2024-09-12T18:02:31.335852+0000","last_undegraded":"2024-09-12T18:02:31.335852+0000","last_fullsized":"2024-09-12T18:02:31.335852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'101","last_scrub_stamp":"2024-09-12T18:02:31.335753+0000","last_deep_scrub":"261'101","last_deep_scrub_stamp":"2024-09-12T18:02:31.335753+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.335753+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:10.965870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":108,"num_read_kb":104,"num_write":228,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"261'642","reported_seq":2252,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.070744+0000","last_change":"2024-09-12T18:02:04.070744+0000","last_active":"2024-09-12T18:02:04.070744+0000","last_peered":"2024-09-12T18:02:04.070744+0000","last_clean":"2024-09-12T18:02:04.070744+0000","last_became_active":"2024-09-12T17:23:42.132858+0000","last_became_peered":"2024-09-12T17:23:42.132858+0000","last_unstale":"2024-09-12T18:02:04.070744+0000","last_undegraded":"2024-09-12T18:02:04.070744+0000","last_fullsized":"2024-09-12T18:02:04.070744+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'642","last_scrub_stamp":"2024-09-12T18:02:04.070634+0000","last_deep_scrub":"261'642","last_deep_scrub_stamp":"2024-09-12T18:02:04.070634+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.070634+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:45.786486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3409,"num_read_kb":3082,"num_write":929,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"261'409","reported_seq":1091,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.166653+0000","last_change":"2024-09-12T18:01:57.166598+0000","last_active":"2024-09-12T18:01:57.166653+0000","last_peered":"2024-09-12T18:01:57.166653+0000","last_clean":"2024-09-12T18:01:57.166653+0000","last_became_active":"2024-09-12T17:23:40.706531+0000","last_became_peered":"2024-09-12T17:23:40.706531+0000","last_unstale":"2024-09-12T18:01:57.166653+0000","last_undegraded":"2024-09-12T18:01:57.166653+0000","last_fullsized":"2024-09-12T18:01:57.166653+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'409","last_scrub_stamp":"2024-09-12T18:01:57.166513+0000","last_deep_scrub":"261'409","last_deep_scrub_stamp":"2024-09-12T18:01:57.166513+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.166513+0000","objects_scrubbed":6,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:43.195543+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":670,"num_read_kb":36595,"num_write":1219,"num_write_kb":30858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"261'6","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.977020+0000","last_change":"2024-09-12T18:02:11.977020+0000","last_active":"2024-09-12T18:02:11.977020+0000","last_peered":"2024-09-12T18:02:11.977020+0000","last_clean":"2024-09-12T18:02:11.977020+0000","last_became_active":"2024-09-12T17:23:44.147427+0000","last_became_peered":"2024-09-12T17:23:44.147427+0000","last_unstale":"2024-09-12T18:02:11.977020+0000","last_undegraded":"2024-09-12T18:02:11.977020+0000","last_fullsized":"2024-09-12T18:02:11.977020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T18:02:11.976933+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T18:02:11.976933+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.976933+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:25.517914+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":1201,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"261'305","reported_seq":883,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.994122+0000","last_change":"2024-09-12T18:02:10.994122+0000","last_active":"2024-09-12T18:02:10.994122+0000","last_peered":"2024-09-12T18:02:10.994122+0000","last_clean":"2024-09-12T18:02:10.994122+0000","last_became_active":"2024-09-12T17:23:46.153004+0000","last_became_peered":"2024-09-12T17:23:46.153004+0000","last_unstale":"2024-09-12T18:02:10.994122+0000","last_undegraded":"2024-09-12T18:02:10.994122+0000","last_fullsized":"2024-09-12T18:02:10.994122+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'305","last_scrub_stamp":"2024-09-12T18:02:10.994015+0000","last_deep_scrub":"261'305","last_deep_scrub_stamp":"2024-09-12T18:02:10.994015+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.994015+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:16.444198+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46983,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":497,"num_read_kb":1127,"num_write":408,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"261'742","reported_seq":2139,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.981896+0000","last_change":"2024-09-12T18:02:13.981896+0000","last_active":"2024-09-12T18:02:13.981896+0000","last_peered":"2024-09-12T18:02:13.981896+0000","last_clean":"2024-09-12T18:02:13.981896+0000","last_became_active":"2024-09-12T17:23:48.169062+0000","last_became_peered":"2024-09-12T17:23:48.169062+0000","last_unstale":"2024-09-12T18:02:13.981896+0000","last_undegraded":"2024-09-12T18:02:13.981896+0000","last_fullsized":"2024-09-12T18:02:13.981896+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'742","last_scrub_stamp":"2024-09-12T18:02:13.981802+0000","last_deep_scrub":"261'742","last_deep_scrub_stamp":"2024-09-12T18:02:13.981802+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.981802+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:50.710110+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"261'143","reported_seq":637,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.934580+0000","last_change":"2024-09-12T18:02:24.934580+0000","last_active":"2024-09-12T18:02:24.934580+0000","last_peered":"2024-09-12T18:02:24.934580+0000","last_clean":"2024-09-12T18:02:24.934580+0000","last_became_active":"2024-09-12T17:23:50.184460+0000","last_became_peered":"2024-09-12T17:23:50.184460+0000","last_unstale":"2024-09-12T18:02:24.934580+0000","last_undegraded":"2024-09-12T18:02:24.934580+0000","last_fullsized":"2024-09-12T18:02:24.934580+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'143","last_scrub_stamp":"2024-09-12T18:02:24.934481+0000","last_deep_scrub":"261'143","last_deep_scrub_stamp":"2024-09-12T18:02:24.934481+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.934481+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:59.139694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":156,"num_write":329,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"261'798","reported_seq":2262,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.150267+0000","last_change":"2024-09-12T18:02:06.150267+0000","last_active":"2024-09-12T18:02:06.150267+0000","last_peered":"2024-09-12T18:02:06.150267+0000","last_clean":"2024-09-12T18:02:06.150267+0000","last_became_active":"2024-09-12T17:23:42.142896+0000","last_became_peered":"2024-09-12T17:23:42.142896+0000","last_unstale":"2024-09-12T18:02:06.150267+0000","last_undegraded":"2024-09-12T18:02:06.150267+0000","last_fullsized":"2024-09-12T18:02:06.150267+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'798","last_scrub_stamp":"2024-09-12T18:02:06.150180+0000","last_deep_scrub":"261'798","last_deep_scrub_stamp":"2024-09-12T18:02:06.150180+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.150180+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:47.648995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3737,"num_read_kb":3347,"num_write":1075,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"261'343","reported_seq":1015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.076466+0000","last_change":"2024-09-12T18:01:56.076389+0000","last_active":"2024-09-12T18:01:56.076466+0000","last_peered":"2024-09-12T18:01:56.076466+0000","last_clean":"2024-09-12T18:01:56.076466+0000","last_became_active":"2024-09-12T17:23:40.708386+0000","last_became_peered":"2024-09-12T17:23:40.708386+0000","last_unstale":"2024-09-12T18:01:56.076466+0000","last_undegraded":"2024-09-12T18:01:56.076466+0000","last_fullsized":"2024-09-12T18:01:56.076466+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'343","last_scrub_stamp":"2024-09-12T18:01:56.076247+0000","last_deep_scrub":"261'343","last_deep_scrub_stamp":"2024-09-12T18:01:56.076247+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.076247+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:59.205706+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655881,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":106949,"num_write":1131,"num_write_kb":37410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"261'4","reported_seq":1460,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.227769+0000","last_change":"2024-09-12T18:02:19.227769+0000","last_active":"2024-09-12T18:02:19.227769+0000","last_peered":"2024-09-12T18:02:19.227769+0000","last_clean":"2024-09-12T18:02:19.227769+0000","last_became_active":"2024-09-12T17:23:44.149279+0000","last_became_peered":"2024-09-12T17:23:44.149279+0000","last_unstale":"2024-09-12T18:02:19.227769+0000","last_undegraded":"2024-09-12T18:02:19.227769+0000","last_fullsized":"2024-09-12T18:02:19.227769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T18:02:19.227681+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T18:02:19.227681+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.227681+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:18.615853+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"261'68","reported_seq":580,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.273405+0000","last_change":"2024-09-12T18:02:20.273405+0000","last_active":"2024-09-12T18:02:20.273405+0000","last_peered":"2024-09-12T18:02:20.273405+0000","last_clean":"2024-09-12T18:02:20.273405+0000","last_became_active":"2024-09-12T17:23:46.240979+0000","last_became_peered":"2024-09-12T17:23:46.240979+0000","last_unstale":"2024-09-12T18:02:20.273405+0000","last_undegraded":"2024-09-12T18:02:20.273405+0000","last_fullsized":"2024-09-12T18:02:20.273405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'68","last_scrub_stamp":"2024-09-12T18:02:20.273317+0000","last_deep_scrub":"261'68","last_deep_scrub_stamp":"2024-09-12T18:02:20.273317+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.273317+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:58.881950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"261'786","reported_seq":2389,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.107046+0000","last_change":"2024-09-12T18:02:17.107046+0000","last_active":"2024-09-12T18:02:17.107046+0000","last_peered":"2024-09-12T18:02:17.107046+0000","last_clean":"2024-09-12T18:02:17.107046+0000","last_became_active":"2024-09-12T17:23:48.172485+0000","last_became_peered":"2024-09-12T17:23:48.172485+0000","last_unstale":"2024-09-12T18:02:17.107046+0000","last_undegraded":"2024-09-12T18:02:17.107046+0000","last_fullsized":"2024-09-12T18:02:17.107046+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'786","last_scrub_stamp":"2024-09-12T18:02:17.106958+0000","last_deep_scrub":"261'786","last_deep_scrub_stamp":"2024-09-12T18:02:17.106958+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.106958+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:38.457220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"261'141","reported_seq":634,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.056357+0000","last_change":"2024-09-12T18:02:28.056357+0000","last_active":"2024-09-12T18:02:28.056357+0000","last_peered":"2024-09-12T18:02:28.056357+0000","last_clean":"2024-09-12T18:02:28.056357+0000","last_became_active":"2024-09-12T17:23:50.179153+0000","last_became_peered":"2024-09-12T17:23:50.179153+0000","last_unstale":"2024-09-12T18:02:28.056357+0000","last_undegraded":"2024-09-12T18:02:28.056357+0000","last_fullsized":"2024-09-12T18:02:28.056357+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'141","last_scrub_stamp":"2024-09-12T18:02:28.056234+0000","last_deep_scrub":"261'141","last_deep_scrub_stamp":"2024-09-12T18:02:28.056234+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.056234+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:22.001475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":149,"num_read_kb":148,"num_write":323,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"261'409","reported_seq":1909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.043260+0000","last_change":"2024-09-12T18:02:07.043260+0000","last_active":"2024-09-12T18:02:07.043260+0000","last_peered":"2024-09-12T18:02:07.043260+0000","last_clean":"2024-09-12T18:02:07.043260+0000","last_became_active":"2024-09-12T17:23:42.152339+0000","last_became_peered":"2024-09-12T17:23:42.152339+0000","last_unstale":"2024-09-12T18:02:07.043260+0000","last_undegraded":"2024-09-12T18:02:07.043260+0000","last_fullsized":"2024-09-12T18:02:07.043260+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'409","last_scrub_stamp":"2024-09-12T18:02:07.043170+0000","last_deep_scrub":"261'409","last_deep_scrub_stamp":"2024-09-12T18:02:07.043170+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.043170+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:06.071189+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2264,"num_read_kb":2142,"num_write":477,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"261'440","reported_seq":1221,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.180960+0000","last_change":"2024-09-12T18:01:58.180910+0000","last_active":"2024-09-12T18:01:58.180960+0000","last_peered":"2024-09-12T18:01:58.180960+0000","last_clean":"2024-09-12T18:01:58.180960+0000","last_became_active":"2024-09-12T17:23:40.714708+0000","last_became_peered":"2024-09-12T17:23:40.714708+0000","last_unstale":"2024-09-12T18:01:58.180960+0000","last_undegraded":"2024-09-12T18:01:58.180960+0000","last_fullsized":"2024-09-12T18:01:58.180960+0000","mapping_epoch":23,"log_start":"261'400","ondisk_log_start":"261'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'440","last_scrub_stamp":"2024-09-12T18:01:58.180819+0000","last_deep_scrub":"261'440","last_deep_scrub_stamp":"2024-09-12T18:01:58.180819+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.180819+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:13.620327+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1005,"num_read_kb":34670,"num_write":1495,"num_write_kb":45714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.220941+0000","last_change":"2024-09-12T18:02:16.220941+0000","last_active":"2024-09-12T18:02:16.220941+0000","last_peered":"2024-09-12T18:02:16.220941+0000","last_clean":"2024-09-12T18:02:16.220941+0000","last_became_active":"2024-09-12T17:23:44.151392+0000","last_became_peered":"2024-09-12T17:23:44.151392+0000","last_unstale":"2024-09-12T18:02:16.220941+0000","last_undegraded":"2024-09-12T18:02:16.220941+0000","last_fullsized":"2024-09-12T18:02:16.220941+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:16.220650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:16.220650+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.220650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:42.850614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"261'313","reported_seq":909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.171235+0000","last_change":"2024-09-12T18:02:25.171235+0000","last_active":"2024-09-12T18:02:25.171235+0000","last_peered":"2024-09-12T18:02:25.171235+0000","last_clean":"2024-09-12T18:02:25.171235+0000","last_became_active":"2024-09-12T17:23:46.144754+0000","last_became_peered":"2024-09-12T17:23:46.144754+0000","last_unstale":"2024-09-12T18:02:25.171235+0000","last_undegraded":"2024-09-12T18:02:25.171235+0000","last_fullsized":"2024-09-12T18:02:25.171235+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'313","last_scrub_stamp":"2024-09-12T18:02:25.171143+0000","last_deep_scrub":"261'313","last_deep_scrub_stamp":"2024-09-12T18:02:25.171143+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.171143+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:02.652521+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46816,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":500,"num_read_kb":1038,"num_write":390,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.115251+0000","last_change":"2024-09-12T18:02:13.115251+0000","last_active":"2024-09-12T18:02:13.115251+0000","last_peered":"2024-09-12T18:02:13.115251+0000","last_clean":"2024-09-12T18:02:13.115251+0000","last_became_active":"2024-09-12T17:23:48.170482+0000","last_became_peered":"2024-09-12T17:23:48.170482+0000","last_unstale":"2024-09-12T18:02:13.115251+0000","last_undegraded":"2024-09-12T18:02:13.115251+0000","last_fullsized":"2024-09-12T18:02:13.115251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:13.115166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:13.115166+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.115166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:47.974782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"261'142","reported_seq":643,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.960301+0000","last_change":"2024-09-12T18:02:20.960301+0000","last_active":"2024-09-12T18:02:20.960301+0000","last_peered":"2024-09-12T18:02:20.960301+0000","last_clean":"2024-09-12T18:02:20.960301+0000","last_became_active":"2024-09-12T17:23:50.187040+0000","last_became_peered":"2024-09-12T17:23:50.187040+0000","last_unstale":"2024-09-12T18:02:20.960301+0000","last_undegraded":"2024-09-12T18:02:20.960301+0000","last_fullsized":"2024-09-12T18:02:20.960301+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'142","last_scrub_stamp":"2024-09-12T18:02:20.960210+0000","last_deep_scrub":"261'142","last_deep_scrub_stamp":"2024-09-12T18:02:20.960210+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.960210+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:06.679889+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":190,"num_write":335,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"261'1233","reported_seq":2789,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.139896+0000","last_change":"2024-09-12T18:02:05.139896+0000","last_active":"2024-09-12T18:02:05.139896+0000","last_peered":"2024-09-12T18:02:05.139896+0000","last_clean":"2024-09-12T18:02:05.139896+0000","last_became_active":"2024-09-12T17:23:42.146200+0000","last_became_peered":"2024-09-12T17:23:42.146200+0000","last_unstale":"2024-09-12T18:02:05.139896+0000","last_undegraded":"2024-09-12T18:02:05.139896+0000","last_fullsized":"2024-09-12T18:02:05.139896+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1233","last_scrub_stamp":"2024-09-12T18:02:05.139829+0000","last_deep_scrub":"261'1233","last_deep_scrub_stamp":"2024-09-12T18:02:05.139829+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.139829+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":1200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:20.252996+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5862,"num_read_kb":5167,"num_write":1742,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"261'74","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.604067+0000","last_change":"2024-09-12T18:01:57.604067+0000","last_active":"2024-09-12T18:01:57.604067+0000","last_peered":"2024-09-12T18:01:57.604067+0000","last_clean":"2024-09-12T18:01:57.604067+0000","last_became_active":"2024-09-12T17:23:26.034872+0000","last_became_peered":"2024-09-12T17:23:26.034872+0000","last_unstale":"2024-09-12T18:01:57.604067+0000","last_undegraded":"2024-09-12T18:01:57.604067+0000","last_fullsized":"2024-09-12T18:01:57.604067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'74","last_scrub_stamp":"2024-09-12T18:01:57.603967+0000","last_deep_scrub":"261'74","last_deep_scrub_stamp":"2024-09-12T18:01:57.603967+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.603967+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:41.712562+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"261'2","reported_seq":520,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.219619+0000","last_change":"2024-09-12T18:01:58.219549+0000","last_active":"2024-09-12T18:01:58.219619+0000","last_peered":"2024-09-12T18:01:58.219619+0000","last_clean":"2024-09-12T18:01:58.219619+0000","last_became_active":"2024-09-12T17:23:31.584884+0000","last_became_peered":"2024-09-12T17:23:31.584884+0000","last_unstale":"2024-09-12T18:01:58.219619+0000","last_undegraded":"2024-09-12T18:01:58.219619+0000","last_fullsized":"2024-09-12T18:01:58.219619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:01:58.219468+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:01:58.219468+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.219468+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:46.365922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000423087,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"261'317","reported_seq":955,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.118644+0000","last_change":"2024-09-12T18:01:56.118593+0000","last_active":"2024-09-12T18:01:56.118644+0000","last_peered":"2024-09-12T18:01:56.118644+0000","last_clean":"2024-09-12T18:01:56.118644+0000","last_became_active":"2024-09-12T17:23:40.718896+0000","last_became_peered":"2024-09-12T17:23:40.718896+0000","last_unstale":"2024-09-12T18:01:56.118644+0000","last_undegraded":"2024-09-12T18:01:56.118644+0000","last_fullsized":"2024-09-12T18:01:56.118644+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'317","last_scrub_stamp":"2024-09-12T18:01:56.118490+0000","last_deep_scrub":"261'317","last_deep_scrub_stamp":"2024-09-12T18:01:56.118490+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.118490+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:05.520040+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":13109,"num_write":1018,"num_write_kb":39939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"261'4","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.686852+0000","last_change":"2024-09-12T18:02:15.686852+0000","last_active":"2024-09-12T18:02:15.686852+0000","last_peered":"2024-09-12T18:02:15.686852+0000","last_clean":"2024-09-12T18:02:15.686852+0000","last_became_active":"2024-09-12T17:23:44.152585+0000","last_became_peered":"2024-09-12T17:23:44.152585+0000","last_unstale":"2024-09-12T18:02:15.686852+0000","last_undegraded":"2024-09-12T18:02:15.686852+0000","last_fullsized":"2024-09-12T18:02:15.686852+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T18:02:15.686767+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T18:02:15.686767+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.686767+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:37.441894+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"261'723","reported_seq":1422,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.163278+0000","last_change":"2024-09-12T18:02:23.163217+0000","last_active":"2024-09-12T18:02:23.163278+0000","last_peered":"2024-09-12T18:02:23.163278+0000","last_clean":"2024-09-12T18:02:23.163278+0000","last_became_active":"2024-09-12T17:23:46.151673+0000","last_became_peered":"2024-09-12T17:23:46.151673+0000","last_unstale":"2024-09-12T18:02:23.163278+0000","last_undegraded":"2024-09-12T18:02:23.163278+0000","last_fullsized":"2024-09-12T18:02:23.163278+0000","mapping_epoch":29,"log_start":"261'700","ondisk_log_start":"261'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'723","last_scrub_stamp":"2024-09-12T18:02:23.163118+0000","last_deep_scrub":"261'723","last_deep_scrub_stamp":"2024-09-12T18:02:23.163118+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.163118+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:13.781960+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145502,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1428,"num_read_kb":3259,"num_write":1354,"num_write_kb":1206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106776,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.604170+0000","last_change":"2024-09-12T18:02:20.604097+0000","last_active":"2024-09-12T18:02:20.604170+0000","last_peered":"2024-09-12T18:02:20.604170+0000","last_clean":"2024-09-12T18:02:20.604170+0000","last_became_active":"2024-09-12T17:23:48.170153+0000","last_became_peered":"2024-09-12T17:23:48.170153+0000","last_unstale":"2024-09-12T18:02:20.604170+0000","last_undegraded":"2024-09-12T18:02:20.604170+0000","last_fullsized":"2024-09-12T18:02:20.604170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:20.603993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:20.603993+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.603993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:23.747962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"261'227","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.107458+0000","last_change":"2024-09-12T18:02:20.107381+0000","last_active":"2024-09-12T18:02:20.107458+0000","last_peered":"2024-09-12T18:02:20.107458+0000","last_clean":"2024-09-12T18:02:20.107458+0000","last_became_active":"2024-09-12T17:23:50.188552+0000","last_became_peered":"2024-09-12T17:23:50.188552+0000","last_unstale":"2024-09-12T18:02:20.107458+0000","last_undegraded":"2024-09-12T18:02:20.107458+0000","last_fullsized":"2024-09-12T18:02:20.107458+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'227","last_scrub_stamp":"2024-09-12T18:02:20.107290+0000","last_deep_scrub":"261'227","last_deep_scrub_stamp":"2024-09-12T18:02:20.107290+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.107290+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:00.704292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":580,"num_write":503,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"261'393","reported_seq":1840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.682179+0000","last_change":"2024-09-12T18:02:03.682090+0000","last_active":"2024-09-12T18:02:03.682179+0000","last_peered":"2024-09-12T18:02:03.682179+0000","last_clean":"2024-09-12T18:02:03.682179+0000","last_became_active":"2024-09-12T17:23:42.147045+0000","last_became_peered":"2024-09-12T17:23:42.147045+0000","last_unstale":"2024-09-12T18:02:03.682179+0000","last_undegraded":"2024-09-12T18:02:03.682179+0000","last_fullsized":"2024-09-12T18:02:03.682179+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'393","last_scrub_stamp":"2024-09-12T18:02:03.681965+0000","last_deep_scrub":"261'393","last_deep_scrub_stamp":"2024-09-12T18:02:03.681965+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.681965+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:17.784933+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2080,"num_read_kb":1972,"num_write":429,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1199,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":515,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.639675+0000","last_change":"2024-09-12T18:01:58.639675+0000","last_active":"2024-09-12T18:01:58.639675+0000","last_peered":"2024-09-12T18:01:58.639675+0000","last_clean":"2024-09-12T18:01:58.639675+0000","last_became_active":"2024-09-12T17:23:31.588699+0000","last_became_peered":"2024-09-12T17:23:31.588699+0000","last_unstale":"2024-09-12T18:01:58.639675+0000","last_undegraded":"2024-09-12T18:01:58.639675+0000","last_fullsized":"2024-09-12T18:01:58.639675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:58.639583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:58.639583+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.639583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:21.037862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052181899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"261'342","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.723017+0000","last_change":"2024-09-12T18:01:58.723017+0000","last_active":"2024-09-12T18:01:58.723017+0000","last_peered":"2024-09-12T18:01:58.723017+0000","last_clean":"2024-09-12T18:01:58.723017+0000","last_became_active":"2024-09-12T17:23:40.713199+0000","last_became_peered":"2024-09-12T17:23:40.713199+0000","last_unstale":"2024-09-12T18:01:58.723017+0000","last_undegraded":"2024-09-12T18:01:58.723017+0000","last_fullsized":"2024-09-12T18:01:58.723017+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'342","last_scrub_stamp":"2024-09-12T18:01:58.722915+0000","last_deep_scrub":"261'342","last_deep_scrub_stamp":"2024-09-12T18:01:58.722915+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.722915+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:52.223877+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":39290,"num_write":1124,"num_write_kb":55994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.272095+0000","last_change":"2024-09-12T18:02:17.272039+0000","last_active":"2024-09-12T18:02:17.272095+0000","last_peered":"2024-09-12T18:02:17.272095+0000","last_clean":"2024-09-12T18:02:17.272095+0000","last_became_active":"2024-09-12T17:23:44.149400+0000","last_became_peered":"2024-09-12T17:23:44.149400+0000","last_unstale":"2024-09-12T18:02:17.272095+0000","last_undegraded":"2024-09-12T18:02:17.272095+0000","last_fullsized":"2024-09-12T18:02:17.272095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:17.271849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:17.271849+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.271849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:57.900849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"261'1320","reported_seq":2715,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.052671+0000","last_change":"2024-09-12T18:02:15.052671+0000","last_active":"2024-09-12T18:02:15.052671+0000","last_peered":"2024-09-12T18:02:15.052671+0000","last_clean":"2024-09-12T18:02:15.052671+0000","last_became_active":"2024-09-12T17:23:46.145354+0000","last_became_peered":"2024-09-12T17:23:46.145354+0000","last_unstale":"2024-09-12T18:02:15.052671+0000","last_undegraded":"2024-09-12T18:02:15.052671+0000","last_fullsized":"2024-09-12T18:02:15.052671+0000","mapping_epoch":29,"log_start":"261'1300","ondisk_log_start":"261'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1320","last_scrub_stamp":"2024-09-12T18:02:15.052569+0000","last_deep_scrub":"261'1320","last_deep_scrub_stamp":"2024-09-12T18:02:15.052569+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.052569+0000","objects_scrubbed":12,"log_size":20,"log_dups_size":1300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:58.558654+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139395,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2079,"num_read_kb":4017,"num_write":1172,"num_write_kb":1007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.786228+0000","last_change":"2024-09-12T18:02:25.786228+0000","last_active":"2024-09-12T18:02:25.786228+0000","last_peered":"2024-09-12T18:02:25.786228+0000","last_clean":"2024-09-12T18:02:25.786228+0000","last_became_active":"2024-09-12T17:23:48.171355+0000","last_became_peered":"2024-09-12T17:23:48.171355+0000","last_unstale":"2024-09-12T18:02:25.786228+0000","last_undegraded":"2024-09-12T18:02:25.786228+0000","last_fullsized":"2024-09-12T18:02:25.786228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:25.786136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:25.786136+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.786136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:33.215639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"261'109","reported_seq":618,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.990778+0000","last_change":"2024-09-12T18:02:21.990666+0000","last_active":"2024-09-12T18:02:21.990778+0000","last_peered":"2024-09-12T18:02:21.990778+0000","last_clean":"2024-09-12T18:02:21.990778+0000","last_became_active":"2024-09-12T17:23:50.639053+0000","last_became_peered":"2024-09-12T17:23:50.639053+0000","last_unstale":"2024-09-12T18:02:21.990778+0000","last_undegraded":"2024-09-12T18:02:21.990778+0000","last_fullsized":"2024-09-12T18:02:21.990778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'109","last_scrub_stamp":"2024-09-12T18:02:21.990551+0000","last_deep_scrub":"261'109","last_deep_scrub_stamp":"2024-09-12T18:02:21.990551+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.990551+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:25.489390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":175,"num_read_kb":162,"num_write":260,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"261'914","reported_seq":2651,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.066830+0000","last_change":"2024-09-12T18:02:06.066774+0000","last_active":"2024-09-12T18:02:06.066830+0000","last_peered":"2024-09-12T18:02:06.066830+0000","last_clean":"2024-09-12T18:02:06.066830+0000","last_became_active":"2024-09-12T17:23:42.145049+0000","last_became_peered":"2024-09-12T17:23:42.145049+0000","last_unstale":"2024-09-12T18:02:06.066830+0000","last_undegraded":"2024-09-12T18:02:06.066830+0000","last_fullsized":"2024-09-12T18:02:06.066830+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'914","last_scrub_stamp":"2024-09-12T18:02:06.066685+0000","last_deep_scrub":"261'914","last_deep_scrub_stamp":"2024-09-12T18:02:06.066685+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.066685+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":900,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:56.688488+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4463,"num_read_kb":4014,"num_write":1227,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":520,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.899081+0000","last_change":"2024-09-12T18:01:55.898988+0000","last_active":"2024-09-12T18:01:55.899081+0000","last_peered":"2024-09-12T18:01:55.899081+0000","last_clean":"2024-09-12T18:01:55.899081+0000","last_became_active":"2024-09-12T17:23:31.584259+0000","last_became_peered":"2024-09-12T17:23:31.584259+0000","last_unstale":"2024-09-12T18:01:55.899081+0000","last_undegraded":"2024-09-12T18:01:55.899081+0000","last_fullsized":"2024-09-12T18:01:55.899081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:55.898906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:55.898906+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.898906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:27.914712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045870900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"261'331","reported_seq":961,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.976477+0000","last_change":"2024-09-12T18:01:55.976477+0000","last_active":"2024-09-12T18:01:55.976477+0000","last_peered":"2024-09-12T18:01:55.976477+0000","last_clean":"2024-09-12T18:01:55.976477+0000","last_became_active":"2024-09-12T17:23:40.712276+0000","last_became_peered":"2024-09-12T17:23:40.712276+0000","last_unstale":"2024-09-12T18:01:55.976477+0000","last_undegraded":"2024-09-12T18:01:55.976477+0000","last_fullsized":"2024-09-12T18:01:55.976477+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'331","last_scrub_stamp":"2024-09-12T18:01:55.976396+0000","last_deep_scrub":"261'331","last_deep_scrub_stamp":"2024-09-12T18:01:55.976396+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.976396+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:09.619450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":8922,"num_write":1082,"num_write_kb":17941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"261'2","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.053972+0000","last_change":"2024-09-12T18:02:06.053911+0000","last_active":"2024-09-12T18:02:06.053972+0000","last_peered":"2024-09-12T18:02:06.053972+0000","last_clean":"2024-09-12T18:02:06.053972+0000","last_became_active":"2024-09-12T17:23:44.151006+0000","last_became_peered":"2024-09-12T17:23:44.151006+0000","last_unstale":"2024-09-12T18:02:06.053972+0000","last_undegraded":"2024-09-12T18:02:06.053972+0000","last_fullsized":"2024-09-12T18:02:06.053972+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:06.053826+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:06.053826+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.053826+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:20.770473+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"261'203","reported_seq":1198,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.748490+0000","last_change":"2024-09-12T18:02:20.748490+0000","last_active":"2024-09-12T18:02:20.748490+0000","last_peered":"2024-09-12T18:02:20.748490+0000","last_clean":"2024-09-12T18:02:20.748490+0000","last_became_active":"2024-09-12T17:23:46.241733+0000","last_became_peered":"2024-09-12T17:23:46.241733+0000","last_unstale":"2024-09-12T18:02:20.748490+0000","last_undegraded":"2024-09-12T18:02:20.748490+0000","last_fullsized":"2024-09-12T18:02:20.748490+0000","mapping_epoch":29,"log_start":"258'100","ondisk_log_start":"258'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'203","last_scrub_stamp":"2024-09-12T18:02:20.748374+0000","last_deep_scrub":"261'203","last_deep_scrub_stamp":"2024-09-12T18:02:20.748374+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.748374+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:40.960458+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":152,"num_read_kb":143,"num_write":117,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.566774+0000","last_change":"2024-09-12T18:02:21.566774+0000","last_active":"2024-09-12T18:02:21.566774+0000","last_peered":"2024-09-12T18:02:21.566774+0000","last_clean":"2024-09-12T18:02:21.566774+0000","last_became_active":"2024-09-12T17:23:48.167920+0000","last_became_peered":"2024-09-12T17:23:48.167920+0000","last_unstale":"2024-09-12T18:02:21.566774+0000","last_undegraded":"2024-09-12T18:02:21.566774+0000","last_fullsized":"2024-09-12T18:02:21.566774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:21.566682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:21.566682+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.566682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:26.235303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"261'265","reported_seq":870,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.378316+0000","last_change":"2024-09-12T18:02:32.378316+0000","last_active":"2024-09-12T18:02:32.378316+0000","last_peered":"2024-09-12T18:02:32.378316+0000","last_clean":"2024-09-12T18:02:32.378316+0000","last_became_active":"2024-09-12T17:23:50.177293+0000","last_became_peered":"2024-09-12T17:23:50.177293+0000","last_unstale":"2024-09-12T18:02:32.378316+0000","last_undegraded":"2024-09-12T18:02:32.378316+0000","last_fullsized":"2024-09-12T18:02:32.378316+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'265","last_scrub_stamp":"2024-09-12T18:02:32.378205+0000","last_deep_scrub":"261'265","last_deep_scrub_stamp":"2024-09-12T18:02:32.378205+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.378205+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:34.137386+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":569,"num_write":571,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"261'445","reported_seq":2043,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.029638+0000","last_change":"2024-09-12T18:02:05.029638+0000","last_active":"2024-09-12T18:02:05.029638+0000","last_peered":"2024-09-12T18:02:05.029638+0000","last_clean":"2024-09-12T18:02:05.029638+0000","last_became_active":"2024-09-12T17:23:42.136083+0000","last_became_peered":"2024-09-12T17:23:42.136083+0000","last_unstale":"2024-09-12T18:02:05.029638+0000","last_undegraded":"2024-09-12T18:02:05.029638+0000","last_fullsized":"2024-09-12T18:02:05.029638+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'445","last_scrub_stamp":"2024-09-12T18:02:05.029525+0000","last_deep_scrub":"261'445","last_deep_scrub_stamp":"2024-09-12T18:02:05.029525+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.029525+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:54.386989+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2433,"num_read_kb":2304,"num_write":511,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"261'3","reported_seq":521,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.201094+0000","last_change":"2024-09-12T18:01:57.201047+0000","last_active":"2024-09-12T18:01:57.201094+0000","last_peered":"2024-09-12T18:01:57.201094+0000","last_clean":"2024-09-12T18:01:57.201094+0000","last_became_active":"2024-09-12T17:23:31.588612+0000","last_became_peered":"2024-09-12T17:23:31.588612+0000","last_unstale":"2024-09-12T18:01:57.201094+0000","last_undegraded":"2024-09-12T18:01:57.201094+0000","last_fullsized":"2024-09-12T18:01:57.201094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:01:57.200972+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:01:57.200972+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.200972+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:08.741396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00095838300000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"261'358","reported_seq":1082,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.069482+0000","last_change":"2024-09-12T18:01:57.069482+0000","last_active":"2024-09-12T18:01:57.069482+0000","last_peered":"2024-09-12T18:01:57.069482+0000","last_clean":"2024-09-12T18:01:57.069482+0000","last_became_active":"2024-09-12T17:23:40.716786+0000","last_became_peered":"2024-09-12T17:23:40.716786+0000","last_unstale":"2024-09-12T18:01:57.069482+0000","last_undegraded":"2024-09-12T18:01:57.069482+0000","last_fullsized":"2024-09-12T18:01:57.069482+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'358","last_scrub_stamp":"2024-09-12T18:01:57.069360+0000","last_deep_scrub":"261'358","last_deep_scrub_stamp":"2024-09-12T18:01:57.069360+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.069360+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:04.851606+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287987,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":555,"num_read_kb":40133,"num_write":1081,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.579113+0000","last_change":"2024-09-12T18:02:13.579113+0000","last_active":"2024-09-12T18:02:13.579113+0000","last_peered":"2024-09-12T18:02:13.579113+0000","last_clean":"2024-09-12T18:02:13.579113+0000","last_became_active":"2024-09-12T17:23:44.150912+0000","last_became_peered":"2024-09-12T17:23:44.150912+0000","last_unstale":"2024-09-12T18:02:13.579113+0000","last_undegraded":"2024-09-12T18:02:13.579113+0000","last_fullsized":"2024-09-12T18:02:13.579113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:13.579019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:13.579019+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.579019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:58.259163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"261'116","reported_seq":650,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.283540+0000","last_change":"2024-09-12T18:02:21.283472+0000","last_active":"2024-09-12T18:02:21.283540+0000","last_peered":"2024-09-12T18:02:21.283540+0000","last_clean":"2024-09-12T18:02:21.283540+0000","last_became_active":"2024-09-12T17:23:46.155516+0000","last_became_peered":"2024-09-12T17:23:46.155516+0000","last_unstale":"2024-09-12T18:02:21.283540+0000","last_undegraded":"2024-09-12T18:02:21.283540+0000","last_fullsized":"2024-09-12T18:02:21.283540+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'116","last_scrub_stamp":"2024-09-12T18:02:21.283360+0000","last_deep_scrub":"261'116","last_deep_scrub_stamp":"2024-09-12T18:02:21.283360+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.283360+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:06.535901+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":92,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.131315+0000","last_change":"2024-09-12T18:02:14.131263+0000","last_active":"2024-09-12T18:02:14.131315+0000","last_peered":"2024-09-12T18:02:14.131315+0000","last_clean":"2024-09-12T18:02:14.131315+0000","last_became_active":"2024-09-12T17:23:48.170462+0000","last_became_peered":"2024-09-12T17:23:48.170462+0000","last_unstale":"2024-09-12T18:02:14.131315+0000","last_undegraded":"2024-09-12T18:02:14.131315+0000","last_fullsized":"2024-09-12T18:02:14.131315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:14.131174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:14.131174+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.131174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:21.306321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":664,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.164657+0000","last_change":"2024-09-12T18:02:31.164597+0000","last_active":"2024-09-12T18:02:31.164657+0000","last_peered":"2024-09-12T18:02:31.164657+0000","last_clean":"2024-09-12T18:02:31.164657+0000","last_became_active":"2024-09-12T17:23:50.186526+0000","last_became_peered":"2024-09-12T17:23:50.186526+0000","last_unstale":"2024-09-12T18:02:31.164657+0000","last_undegraded":"2024-09-12T18:02:31.164657+0000","last_fullsized":"2024-09-12T18:02:31.164657+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'122","last_scrub_stamp":"2024-09-12T18:02:31.164513+0000","last_deep_scrub":"261'122","last_deep_scrub_stamp":"2024-09-12T18:02:31.164513+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.164513+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:43.441056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":247,"num_write":303,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"261'542","reported_seq":2265,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.073021+0000","last_change":"2024-09-12T18:02:03.073021+0000","last_active":"2024-09-12T18:02:03.073021+0000","last_peered":"2024-09-12T18:02:03.073021+0000","last_clean":"2024-09-12T18:02:03.073021+0000","last_became_active":"2024-09-12T17:23:42.151735+0000","last_became_peered":"2024-09-12T17:23:42.151735+0000","last_unstale":"2024-09-12T18:02:03.073021+0000","last_undegraded":"2024-09-12T18:02:03.073021+0000","last_fullsized":"2024-09-12T18:02:03.073021+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'542","last_scrub_stamp":"2024-09-12T18:02:03.072918+0000","last_deep_scrub":"261'542","last_deep_scrub_stamp":"2024-09-12T18:02:03.072918+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.072918+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:38.792420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2982,"num_read_kb":2809,"num_write":660,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"261'324","reported_seq":921,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.273198+0000","last_change":"2024-09-12T18:01:59.273198+0000","last_active":"2024-09-12T18:01:59.273198+0000","last_peered":"2024-09-12T18:01:59.273198+0000","last_clean":"2024-09-12T18:01:59.273198+0000","last_became_active":"2024-09-12T17:23:40.712386+0000","last_became_peered":"2024-09-12T17:23:40.712386+0000","last_unstale":"2024-09-12T18:01:59.273198+0000","last_undegraded":"2024-09-12T18:01:59.273198+0000","last_fullsized":"2024-09-12T18:01:59.273198+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'324","last_scrub_stamp":"2024-09-12T18:01:59.273097+0000","last_deep_scrub":"261'324","last_deep_scrub_stamp":"2024-09-12T18:01:59.273097+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.273097+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:24.760087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":415,"num_read_kb":6504,"num_write":991,"num_write_kb":34893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":522,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.011989+0000","last_change":"2024-09-12T18:01:55.011936+0000","last_active":"2024-09-12T18:01:55.011989+0000","last_peered":"2024-09-12T18:01:55.011989+0000","last_clean":"2024-09-12T18:01:55.011989+0000","last_became_active":"2024-09-12T17:23:31.681209+0000","last_became_peered":"2024-09-12T17:23:31.681209+0000","last_unstale":"2024-09-12T18:01:55.011989+0000","last_undegraded":"2024-09-12T18:01:55.011989+0000","last_fullsized":"2024-09-12T18:01:55.011989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:55.011864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:55.011864+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.011864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:54.403724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056110600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.613324+0000","last_change":"2024-09-12T18:02:12.613324+0000","last_active":"2024-09-12T18:02:12.613324+0000","last_peered":"2024-09-12T18:02:12.613324+0000","last_clean":"2024-09-12T18:02:12.613324+0000","last_became_active":"2024-09-12T17:23:44.148035+0000","last_became_peered":"2024-09-12T17:23:44.148035+0000","last_unstale":"2024-09-12T18:02:12.613324+0000","last_undegraded":"2024-09-12T18:02:12.613324+0000","last_fullsized":"2024-09-12T18:02:12.613324+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:12.613224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:12.613224+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.613224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:09.496521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"261'571","reported_seq":1223,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.627975+0000","last_change":"2024-09-12T18:02:15.627975+0000","last_active":"2024-09-12T18:02:15.627975+0000","last_peered":"2024-09-12T18:02:15.627975+0000","last_clean":"2024-09-12T18:02:15.627975+0000","last_became_active":"2024-09-12T17:23:46.151649+0000","last_became_peered":"2024-09-12T17:23:46.151649+0000","last_unstale":"2024-09-12T18:02:15.627975+0000","last_undegraded":"2024-09-12T18:02:15.627975+0000","last_fullsized":"2024-09-12T18:02:15.627975+0000","mapping_epoch":29,"log_start":"261'500","ondisk_log_start":"261'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'571","last_scrub_stamp":"2024-09-12T18:02:15.627874+0000","last_deep_scrub":"261'571","last_deep_scrub_stamp":"2024-09-12T18:02:15.627874+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.627874+0000","objects_scrubbed":10,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:19.245704+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91231,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1527,"num_read_kb":2702,"num_write":1958,"num_write_kb":1787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":502154,"num_omap_keys":1138,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.172021+0000","last_change":"2024-09-12T18:02:23.172021+0000","last_active":"2024-09-12T18:02:23.172021+0000","last_peered":"2024-09-12T18:02:23.172021+0000","last_clean":"2024-09-12T18:02:23.172021+0000","last_became_active":"2024-09-12T17:23:48.166196+0000","last_became_peered":"2024-09-12T17:23:48.166196+0000","last_unstale":"2024-09-12T18:02:23.172021+0000","last_undegraded":"2024-09-12T18:02:23.172021+0000","last_fullsized":"2024-09-12T18:02:23.172021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:23.171932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:23.171932+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.171932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:59.532011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"261'227","reported_seq":736,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.593807+0000","last_change":"2024-09-12T18:02:28.593807+0000","last_active":"2024-09-12T18:02:28.593807+0000","last_peered":"2024-09-12T18:02:28.593807+0000","last_clean":"2024-09-12T18:02:28.593807+0000","last_became_active":"2024-09-12T17:23:50.640185+0000","last_became_peered":"2024-09-12T17:23:50.640185+0000","last_unstale":"2024-09-12T18:02:28.593807+0000","last_undegraded":"2024-09-12T18:02:28.593807+0000","last_fullsized":"2024-09-12T18:02:28.593807+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'227","last_scrub_stamp":"2024-09-12T18:02:28.593705+0000","last_deep_scrub":"261'227","last_deep_scrub_stamp":"2024-09-12T18:02:28.593705+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.593705+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:08.171833+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":243,"num_write":513,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"261'511","reported_seq":2075,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.675785+0000","last_change":"2024-09-12T18:02:05.675785+0000","last_active":"2024-09-12T18:02:05.675785+0000","last_peered":"2024-09-12T18:02:05.675785+0000","last_clean":"2024-09-12T18:02:05.675785+0000","last_became_active":"2024-09-12T17:23:42.148578+0000","last_became_peered":"2024-09-12T17:23:42.148578+0000","last_unstale":"2024-09-12T18:02:05.675785+0000","last_undegraded":"2024-09-12T18:02:05.675785+0000","last_fullsized":"2024-09-12T18:02:05.675785+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'511","last_scrub_stamp":"2024-09-12T18:02:05.675698+0000","last_deep_scrub":"261'511","last_deep_scrub_stamp":"2024-09-12T18:02:05.675698+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.675698+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:16.683349+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2709,"num_read_kb":2501,"num_write":646,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"261'359","reported_seq":989,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.005174+0000","last_change":"2024-09-12T18:01:58.005174+0000","last_active":"2024-09-12T18:01:58.005174+0000","last_peered":"2024-09-12T18:01:58.005174+0000","last_clean":"2024-09-12T18:01:58.005174+0000","last_became_active":"2024-09-12T17:23:40.710780+0000","last_became_peered":"2024-09-12T17:23:40.710780+0000","last_unstale":"2024-09-12T18:01:58.005174+0000","last_undegraded":"2024-09-12T18:01:58.005174+0000","last_fullsized":"2024-09-12T18:01:58.005174+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'359","last_scrub_stamp":"2024-09-12T18:01:58.005070+0000","last_deep_scrub":"261'359","last_deep_scrub_stamp":"2024-09-12T18:01:58.005070+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.005070+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:48.684663+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":525,"num_write":1227,"num_write_kb":43788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":514,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.654264+0000","last_change":"2024-09-12T18:02:00.654264+0000","last_active":"2024-09-12T18:02:00.654264+0000","last_peered":"2024-09-12T18:02:00.654264+0000","last_clean":"2024-09-12T18:02:00.654264+0000","last_became_active":"2024-09-12T17:23:31.681155+0000","last_became_peered":"2024-09-12T17:23:31.681155+0000","last_unstale":"2024-09-12T18:02:00.654264+0000","last_undegraded":"2024-09-12T18:02:00.654264+0000","last_fullsized":"2024-09-12T18:02:00.654264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:00.654154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:00.654154+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.654154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:58.454140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00048562399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.149994+0000","last_change":"2024-09-12T18:02:08.149994+0000","last_active":"2024-09-12T18:02:08.149994+0000","last_peered":"2024-09-12T18:02:08.149994+0000","last_clean":"2024-09-12T18:02:08.149994+0000","last_became_active":"2024-09-12T17:23:44.147347+0000","last_became_peered":"2024-09-12T17:23:44.147347+0000","last_unstale":"2024-09-12T18:02:08.149994+0000","last_undegraded":"2024-09-12T18:02:08.149994+0000","last_fullsized":"2024-09-12T18:02:08.149994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:08.149901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:08.149901+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.149901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:21.117683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"261'157","reported_seq":713,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.048995+0000","last_change":"2024-09-12T18:02:17.048995+0000","last_active":"2024-09-12T18:02:17.048995+0000","last_peered":"2024-09-12T18:02:17.048995+0000","last_clean":"2024-09-12T18:02:17.048995+0000","last_became_active":"2024-09-12T17:23:46.241046+0000","last_became_peered":"2024-09-12T17:23:46.241046+0000","last_unstale":"2024-09-12T18:02:17.048995+0000","last_undegraded":"2024-09-12T18:02:17.048995+0000","last_fullsized":"2024-09-12T18:02:17.048995+0000","mapping_epoch":29,"log_start":"258'100","ondisk_log_start":"258'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'157","last_scrub_stamp":"2024-09-12T18:02:17.048897+0000","last_deep_scrub":"261'157","last_deep_scrub_stamp":"2024-09-12T18:02:17.048897+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.048897+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:15.742303+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":154,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"261'795","reported_seq":2353,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.142744+0000","last_change":"2024-09-12T18:02:27.142744+0000","last_active":"2024-09-12T18:02:27.142744+0000","last_peered":"2024-09-12T18:02:27.142744+0000","last_clean":"2024-09-12T18:02:27.142744+0000","last_became_active":"2024-09-12T17:23:48.173351+0000","last_became_peered":"2024-09-12T17:23:48.173351+0000","last_unstale":"2024-09-12T18:02:27.142744+0000","last_undegraded":"2024-09-12T18:02:27.142744+0000","last_fullsized":"2024-09-12T18:02:27.142744+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'795","last_scrub_stamp":"2024-09-12T18:02:27.142659+0000","last_deep_scrub":"261'795","last_deep_scrub_stamp":"2024-09-12T18:02:27.142659+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.142659+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:11.902738+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"261'106","reported_seq":602,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.396475+0000","last_change":"2024-09-12T18:02:34.396475+0000","last_active":"2024-09-12T18:02:34.396475+0000","last_peered":"2024-09-12T18:02:34.396475+0000","last_clean":"2024-09-12T18:02:34.396475+0000","last_became_active":"2024-09-12T17:23:50.639054+0000","last_became_peered":"2024-09-12T17:23:50.639054+0000","last_unstale":"2024-09-12T18:02:34.396475+0000","last_undegraded":"2024-09-12T18:02:34.396475+0000","last_fullsized":"2024-09-12T18:02:34.396475+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'106","last_scrub_stamp":"2024-09-12T18:02:34.396378+0000","last_deep_scrub":"261'106","last_deep_scrub_stamp":"2024-09-12T18:02:34.396378+0000","last_clean_scrub_stamp":"2024-09-12T18:02:34.396378+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:36.065703+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":220,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"261'498","reported_seq":2027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.237197+0000","last_change":"2024-09-12T18:02:07.237197+0000","last_active":"2024-09-12T18:02:07.237197+0000","last_peered":"2024-09-12T18:02:07.237197+0000","last_clean":"2024-09-12T18:02:07.237197+0000","last_became_active":"2024-09-12T17:23:42.148523+0000","last_became_peered":"2024-09-12T17:23:42.148523+0000","last_unstale":"2024-09-12T18:02:07.237197+0000","last_undegraded":"2024-09-12T18:02:07.237197+0000","last_fullsized":"2024-09-12T18:02:07.237197+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'498","last_scrub_stamp":"2024-09-12T18:02:07.237103+0000","last_deep_scrub":"261'498","last_deep_scrub_stamp":"2024-09-12T18:02:07.237103+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.237103+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:26.038707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2488,"num_read_kb":2312,"num_write":602,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":892,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"261'378","reported_seq":1103,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.174118+0000","last_change":"2024-09-12T18:01:57.174066+0000","last_active":"2024-09-12T18:01:57.174118+0000","last_peered":"2024-09-12T18:01:57.174118+0000","last_clean":"2024-09-12T18:01:57.174118+0000","last_became_active":"2024-09-12T17:23:40.709077+0000","last_became_peered":"2024-09-12T17:23:40.709077+0000","last_unstale":"2024-09-12T18:01:57.174118+0000","last_undegraded":"2024-09-12T18:01:57.174118+0000","last_fullsized":"2024-09-12T18:01:57.174118+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'378","last_scrub_stamp":"2024-09-12T18:01:57.173981+0000","last_deep_scrub":"261'378","last_deep_scrub_stamp":"2024-09-12T18:01:57.173981+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.173981+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:35.684048+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8154045,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":687,"num_read_kb":135818,"num_write":1222,"num_write_kb":56746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":521,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.952985+0000","last_change":"2024-09-12T18:01:56.952897+0000","last_active":"2024-09-12T18:01:56.952985+0000","last_peered":"2024-09-12T18:01:56.952985+0000","last_clean":"2024-09-12T18:01:56.952985+0000","last_became_active":"2024-09-12T17:23:31.588526+0000","last_became_peered":"2024-09-12T17:23:31.588526+0000","last_unstale":"2024-09-12T18:01:56.952985+0000","last_undegraded":"2024-09-12T18:01:56.952985+0000","last_fullsized":"2024-09-12T18:01:56.952985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:56.952784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:56.952784+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.952784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:58.755509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055923099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.176243+0000","last_change":"2024-09-12T18:02:17.176243+0000","last_active":"2024-09-12T18:02:17.176243+0000","last_peered":"2024-09-12T18:02:17.176243+0000","last_clean":"2024-09-12T18:02:17.176243+0000","last_became_active":"2024-09-12T17:23:44.147594+0000","last_became_peered":"2024-09-12T17:23:44.147594+0000","last_unstale":"2024-09-12T18:02:17.176243+0000","last_undegraded":"2024-09-12T18:02:17.176243+0000","last_fullsized":"2024-09-12T18:02:17.176243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:17.176158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:17.176158+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.176158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:58.923912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"261'102","reported_seq":634,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:20.203083+0000","last_change":"2024-09-12T18:02:20.203083+0000","last_active":"2024-09-12T18:02:20.203083+0000","last_peered":"2024-09-12T18:02:20.203083+0000","last_clean":"2024-09-12T18:02:20.203083+0000","last_became_active":"2024-09-12T17:23:46.151335+0000","last_became_peered":"2024-09-12T17:23:46.151335+0000","last_unstale":"2024-09-12T18:02:20.203083+0000","last_undegraded":"2024-09-12T18:02:20.203083+0000","last_fullsized":"2024-09-12T18:02:20.203083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'102","last_scrub_stamp":"2024-09-12T18:02:20.202996+0000","last_deep_scrub":"261'102","last_deep_scrub_stamp":"2024-09-12T18:02:20.202996+0000","last_clean_scrub_stamp":"2024-09-12T18:02:20.202996+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:35.603053+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":100,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"261'808","reported_seq":2596,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.327575+0000","last_change":"2024-09-12T18:02:28.327575+0000","last_active":"2024-09-12T18:02:28.327575+0000","last_peered":"2024-09-12T18:02:28.327575+0000","last_clean":"2024-09-12T18:02:28.327575+0000","last_became_active":"2024-09-12T17:23:48.167739+0000","last_became_peered":"2024-09-12T17:23:48.167739+0000","last_unstale":"2024-09-12T18:02:28.327575+0000","last_undegraded":"2024-09-12T18:02:28.327575+0000","last_fullsized":"2024-09-12T18:02:28.327575+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'808","last_scrub_stamp":"2024-09-12T18:02:28.327479+0000","last_deep_scrub":"261'808","last_deep_scrub_stamp":"2024-09-12T18:02:28.327479+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.327479+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:39.277808+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"261'315","reported_seq":842,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.571415+0000","last_change":"2024-09-12T18:02:27.571415+0000","last_active":"2024-09-12T18:02:27.571415+0000","last_peered":"2024-09-12T18:02:27.571415+0000","last_clean":"2024-09-12T18:02:27.571415+0000","last_became_active":"2024-09-12T17:23:50.179127+0000","last_became_peered":"2024-09-12T17:23:50.179127+0000","last_unstale":"2024-09-12T18:02:27.571415+0000","last_undegraded":"2024-09-12T18:02:27.571415+0000","last_fullsized":"2024-09-12T18:02:27.571415+0000","mapping_epoch":33,"log_start":"261'300","ondisk_log_start":"261'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'315","last_scrub_stamp":"2024-09-12T18:02:27.571322+0000","last_deep_scrub":"261'315","last_deep_scrub_stamp":"2024-09-12T18:02:27.571322+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.571322+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:01.014783+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":442,"num_write":705,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"261'1032","reported_seq":2767,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.065931+0000","last_change":"2024-09-12T18:02:02.065931+0000","last_active":"2024-09-12T18:02:02.065931+0000","last_peered":"2024-09-12T18:02:02.065931+0000","last_clean":"2024-09-12T18:02:02.065931+0000","last_became_active":"2024-09-12T17:23:42.145139+0000","last_became_peered":"2024-09-12T17:23:42.145139+0000","last_unstale":"2024-09-12T18:02:02.065931+0000","last_undegraded":"2024-09-12T18:02:02.065931+0000","last_fullsized":"2024-09-12T18:02:02.065931+0000","mapping_epoch":25,"log_start":"261'1000","ondisk_log_start":"261'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1032","last_scrub_stamp":"2024-09-12T18:02:02.065838+0000","last_deep_scrub":"261'1032","last_deep_scrub_stamp":"2024-09-12T18:02:02.065838+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.065838+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":1000,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:57.748014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4954,"num_read_kb":4437,"num_write":1455,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"261'378","reported_seq":1034,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.770937+0000","last_change":"2024-09-12T18:01:56.770846+0000","last_active":"2024-09-12T18:01:56.770937+0000","last_peered":"2024-09-12T18:01:56.770937+0000","last_clean":"2024-09-12T18:01:56.770937+0000","last_became_active":"2024-09-12T17:23:40.712974+0000","last_became_peered":"2024-09-12T17:23:40.712974+0000","last_unstale":"2024-09-12T18:01:56.770937+0000","last_undegraded":"2024-09-12T18:01:56.770937+0000","last_fullsized":"2024-09-12T18:01:56.770937+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'378","last_scrub_stamp":"2024-09-12T18:01:56.770724+0000","last_deep_scrub":"261'378","last_deep_scrub_stamp":"2024-09-12T18:01:56.770724+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.770724+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:19.994907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048959,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":103148,"num_write":1174,"num_write_kb":43429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.062048+0000","last_change":"2024-09-12T18:02:01.061986+0000","last_active":"2024-09-12T18:02:01.062048+0000","last_peered":"2024-09-12T18:02:01.062048+0000","last_clean":"2024-09-12T18:02:01.062048+0000","last_became_active":"2024-09-12T17:23:31.588266+0000","last_became_peered":"2024-09-12T17:23:31.588266+0000","last_unstale":"2024-09-12T18:02:01.062048+0000","last_undegraded":"2024-09-12T18:02:01.062048+0000","last_fullsized":"2024-09-12T18:02:01.062048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:01.061897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:01.061897+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.061897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:32.592640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051630700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.243385+0000","last_change":"2024-09-12T18:02:19.243385+0000","last_active":"2024-09-12T18:02:19.243385+0000","last_peered":"2024-09-12T18:02:19.243385+0000","last_clean":"2024-09-12T18:02:19.243385+0000","last_became_active":"2024-09-12T17:23:44.149649+0000","last_became_peered":"2024-09-12T17:23:44.149649+0000","last_unstale":"2024-09-12T18:02:19.243385+0000","last_undegraded":"2024-09-12T18:02:19.243385+0000","last_fullsized":"2024-09-12T18:02:19.243385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:19.243293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:19.243293+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.243293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:02.359442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"261'699","reported_seq":1407,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.714172+0000","last_change":"2024-09-12T18:02:19.714172+0000","last_active":"2024-09-12T18:02:19.714172+0000","last_peered":"2024-09-12T18:02:19.714172+0000","last_clean":"2024-09-12T18:02:19.714172+0000","last_became_active":"2024-09-12T17:23:46.241681+0000","last_became_peered":"2024-09-12T17:23:46.241681+0000","last_unstale":"2024-09-12T18:02:19.714172+0000","last_undegraded":"2024-09-12T18:02:19.714172+0000","last_fullsized":"2024-09-12T18:02:19.714172+0000","mapping_epoch":29,"log_start":"261'600","ondisk_log_start":"261'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'699","last_scrub_stamp":"2024-09-12T18:02:19.714079+0000","last_deep_scrub":"261'699","last_deep_scrub_stamp":"2024-09-12T18:02:19.714079+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.714079+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":600,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:03.530890+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155444,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1250,"num_read_kb":2999,"num_write":1014,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.278596+0000","last_change":"2024-09-12T18:02:27.278596+0000","last_active":"2024-09-12T18:02:27.278596+0000","last_peered":"2024-09-12T18:02:27.278596+0000","last_clean":"2024-09-12T18:02:27.278596+0000","last_became_active":"2024-09-12T17:23:48.170687+0000","last_became_peered":"2024-09-12T17:23:48.170687+0000","last_unstale":"2024-09-12T18:02:27.278596+0000","last_undegraded":"2024-09-12T18:02:27.278596+0000","last_fullsized":"2024-09-12T18:02:27.278596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:27.278501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:27.278501+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.278501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:14.871907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"261'138","reported_seq":678,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.156061+0000","last_change":"2024-09-12T18:02:30.156061+0000","last_active":"2024-09-12T18:02:30.156061+0000","last_peered":"2024-09-12T18:02:30.156061+0000","last_clean":"2024-09-12T18:02:30.156061+0000","last_became_active":"2024-09-12T17:23:50.188042+0000","last_became_peered":"2024-09-12T17:23:50.188042+0000","last_unstale":"2024-09-12T18:02:30.156061+0000","last_undegraded":"2024-09-12T18:02:30.156061+0000","last_fullsized":"2024-09-12T18:02:30.156061+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'138","last_scrub_stamp":"2024-09-12T18:02:30.155950+0000","last_deep_scrub":"261'138","last_deep_scrub_stamp":"2024-09-12T18:02:30.155950+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.155950+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:45.806522+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":351,"num_read_kb":302,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"261'130","reported_seq":679,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.707739+0000","last_change":"2024-09-12T18:02:32.707739+0000","last_active":"2024-09-12T18:02:32.707739+0000","last_peered":"2024-09-12T18:02:32.707739+0000","last_clean":"2024-09-12T18:02:32.707739+0000","last_became_active":"2024-09-12T17:23:50.189955+0000","last_became_peered":"2024-09-12T17:23:50.189955+0000","last_unstale":"2024-09-12T18:02:32.707739+0000","last_undegraded":"2024-09-12T18:02:32.707739+0000","last_fullsized":"2024-09-12T18:02:32.707739+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'130","last_scrub_stamp":"2024-09-12T18:02:32.707641+0000","last_deep_scrub":"261'130","last_deep_scrub_stamp":"2024-09-12T18:02:32.707641+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.707641+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:53.507529+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":232,"num_write":318,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"261'332","reported_seq":1807,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.103984+0000","last_change":"2024-09-12T18:02:05.103984+0000","last_active":"2024-09-12T18:02:05.103984+0000","last_peered":"2024-09-12T18:02:05.103984+0000","last_clean":"2024-09-12T18:02:05.103984+0000","last_became_active":"2024-09-12T17:23:42.138899+0000","last_became_peered":"2024-09-12T17:23:42.138899+0000","last_unstale":"2024-09-12T18:02:05.103984+0000","last_undegraded":"2024-09-12T18:02:05.103984+0000","last_fullsized":"2024-09-12T18:02:05.103984+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'332","last_scrub_stamp":"2024-09-12T18:02:05.103884+0000","last_deep_scrub":"261'332","last_deep_scrub_stamp":"2024-09-12T18:02:05.103884+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.103884+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:33.934674+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1873,"num_read_kb":1826,"num_write":350,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"261'371","reported_seq":1012,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.041826+0000","last_change":"2024-09-12T18:01:59.041826+0000","last_active":"2024-09-12T18:01:59.041826+0000","last_peered":"2024-09-12T18:01:59.041826+0000","last_clean":"2024-09-12T18:01:59.041826+0000","last_became_active":"2024-09-12T17:23:40.709219+0000","last_became_peered":"2024-09-12T17:23:40.709219+0000","last_unstale":"2024-09-12T18:01:59.041826+0000","last_undegraded":"2024-09-12T18:01:59.041826+0000","last_fullsized":"2024-09-12T18:01:59.041826+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'371","last_scrub_stamp":"2024-09-12T18:01:59.041598+0000","last_deep_scrub":"261'371","last_deep_scrub_stamp":"2024-09-12T18:01:59.041598+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.041598+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:07.760220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":4301,"num_write":1267,"num_write_kb":9304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.977761+0000","last_change":"2024-09-12T18:02:09.977761+0000","last_active":"2024-09-12T18:02:09.977761+0000","last_peered":"2024-09-12T18:02:09.977761+0000","last_clean":"2024-09-12T18:02:09.977761+0000","last_became_active":"2024-09-12T17:23:44.151175+0000","last_became_peered":"2024-09-12T17:23:44.151175+0000","last_unstale":"2024-09-12T18:02:09.977761+0000","last_undegraded":"2024-09-12T18:02:09.977761+0000","last_fullsized":"2024-09-12T18:02:09.977761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:09.977657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:09.977657+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.977657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:18.070048+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"261'281","reported_seq":849,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.329809+0000","last_change":"2024-09-12T18:02:22.329809+0000","last_active":"2024-09-12T18:02:22.329809+0000","last_peered":"2024-09-12T18:02:22.329809+0000","last_clean":"2024-09-12T18:02:22.329809+0000","last_became_active":"2024-09-12T17:23:46.150505+0000","last_became_peered":"2024-09-12T17:23:46.150505+0000","last_unstale":"2024-09-12T18:02:22.329809+0000","last_undegraded":"2024-09-12T18:02:22.329809+0000","last_fullsized":"2024-09-12T18:02:22.329809+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'281","last_scrub_stamp":"2024-09-12T18:02:22.329716+0000","last_deep_scrub":"261'281","last_deep_scrub_stamp":"2024-09-12T18:02:22.329716+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.329716+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:15.914502+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80053,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":479,"num_read_kb":1186,"num_write":396,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:33.373878+0000","last_change":"2024-09-12T18:02:33.373878+0000","last_active":"2024-09-12T18:02:33.373878+0000","last_peered":"2024-09-12T18:02:33.373878+0000","last_clean":"2024-09-12T18:02:33.373878+0000","last_became_active":"2024-09-12T17:23:48.167911+0000","last_became_peered":"2024-09-12T17:23:48.167911+0000","last_unstale":"2024-09-12T18:02:33.373878+0000","last_undegraded":"2024-09-12T18:02:33.373878+0000","last_fullsized":"2024-09-12T18:02:33.373878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:33.373775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:33.373775+0000","last_clean_scrub_stamp":"2024-09-12T18:02:33.373775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:15.476740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"261'95","reported_seq":593,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:37.489717+0000","last_change":"2024-09-12T18:02:37.489717+0000","last_active":"2024-09-12T18:02:37.489717+0000","last_peered":"2024-09-12T18:02:37.489717+0000","last_clean":"2024-09-12T18:02:37.489717+0000","last_became_active":"2024-09-12T17:23:50.183400+0000","last_became_peered":"2024-09-12T17:23:50.183400+0000","last_unstale":"2024-09-12T18:02:37.489717+0000","last_undegraded":"2024-09-12T18:02:37.489717+0000","last_fullsized":"2024-09-12T18:02:37.489717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'95","last_scrub_stamp":"2024-09-12T18:02:37.489626+0000","last_deep_scrub":"261'95","last_deep_scrub_stamp":"2024-09-12T18:02:37.489626+0000","last_clean_scrub_stamp":"2024-09-12T18:02:37.489626+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:39.081170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":128,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"261'480","reported_seq":1894,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.032918+0000","last_change":"2024-09-12T18:02:08.032918+0000","last_active":"2024-09-12T18:02:08.032918+0000","last_peered":"2024-09-12T18:02:08.032918+0000","last_clean":"2024-09-12T18:02:08.032918+0000","last_became_active":"2024-09-12T17:23:42.137988+0000","last_became_peered":"2024-09-12T17:23:42.137988+0000","last_unstale":"2024-09-12T18:02:08.032918+0000","last_undegraded":"2024-09-12T18:02:08.032918+0000","last_fullsized":"2024-09-12T18:02:08.032918+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'480","last_scrub_stamp":"2024-09-12T18:02:08.032812+0000","last_deep_scrub":"261'480","last_deep_scrub_stamp":"2024-09-12T18:02:08.032812+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.032812+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:49.513754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2384,"num_read_kb":2190,"num_write":595,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"261'377","reported_seq":1024,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.757547+0000","last_change":"2024-09-12T18:02:05.757480+0000","last_active":"2024-09-12T18:02:05.757547+0000","last_peered":"2024-09-12T18:02:05.757547+0000","last_clean":"2024-09-12T18:02:05.757547+0000","last_became_active":"2024-09-12T17:23:40.710425+0000","last_became_peered":"2024-09-12T17:23:40.710425+0000","last_unstale":"2024-09-12T18:02:05.757547+0000","last_undegraded":"2024-09-12T18:02:05.757547+0000","last_fullsized":"2024-09-12T18:02:05.757547+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'377","last_scrub_stamp":"2024-09-12T18:02:05.757380+0000","last_deep_scrub":"261'377","last_deep_scrub_stamp":"2024-09-12T18:02:05.757380+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.757380+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:11.058871+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6598189,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":49330,"num_write":1152,"num_write_kb":37186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.276322+0000","last_change":"2024-09-12T18:02:15.276322+0000","last_active":"2024-09-12T18:02:15.276322+0000","last_peered":"2024-09-12T18:02:15.276322+0000","last_clean":"2024-09-12T18:02:15.276322+0000","last_became_active":"2024-09-12T17:23:44.148078+0000","last_became_peered":"2024-09-12T17:23:44.148078+0000","last_unstale":"2024-09-12T18:02:15.276322+0000","last_undegraded":"2024-09-12T18:02:15.276322+0000","last_fullsized":"2024-09-12T18:02:15.276322+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:15.276227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:15.276227+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.276227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:44.747010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"261'45","reported_seq":540,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.563257+0000","last_change":"2024-09-12T18:02:17.563257+0000","last_active":"2024-09-12T18:02:17.563257+0000","last_peered":"2024-09-12T18:02:17.563257+0000","last_clean":"2024-09-12T18:02:17.563257+0000","last_became_active":"2024-09-12T17:23:46.151258+0000","last_became_peered":"2024-09-12T17:23:46.151258+0000","last_unstale":"2024-09-12T18:02:17.563257+0000","last_undegraded":"2024-09-12T18:02:17.563257+0000","last_fullsized":"2024-09-12T18:02:17.563257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'45","last_scrub_stamp":"2024-09-12T18:02:17.563159+0000","last_deep_scrub":"261'45","last_deep_scrub_stamp":"2024-09-12T18:02:17.563159+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.563159+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:26.970725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":25,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.738619+0000","last_change":"2024-09-12T18:02:26.738619+0000","last_active":"2024-09-12T18:02:26.738619+0000","last_peered":"2024-09-12T18:02:26.738619+0000","last_clean":"2024-09-12T18:02:26.738619+0000","last_became_active":"2024-09-12T17:23:48.173781+0000","last_became_peered":"2024-09-12T17:23:48.173781+0000","last_unstale":"2024-09-12T18:02:26.738619+0000","last_undegraded":"2024-09-12T18:02:26.738619+0000","last_fullsized":"2024-09-12T18:02:26.738619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:26.738530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:26.738530+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.738530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:58.104164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"261'167","reported_seq":677,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.678537+0000","last_change":"2024-09-12T18:02:30.678537+0000","last_active":"2024-09-12T18:02:30.678537+0000","last_peered":"2024-09-12T18:02:30.678537+0000","last_clean":"2024-09-12T18:02:30.678537+0000","last_became_active":"2024-09-12T17:23:50.183784+0000","last_became_peered":"2024-09-12T17:23:50.183784+0000","last_unstale":"2024-09-12T18:02:30.678537+0000","last_undegraded":"2024-09-12T18:02:30.678537+0000","last_fullsized":"2024-09-12T18:02:30.678537+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'167","last_scrub_stamp":"2024-09-12T18:02:30.678426+0000","last_deep_scrub":"261'167","last_deep_scrub_stamp":"2024-09-12T18:02:30.678426+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.678426+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:17.172239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":278,"num_read_kb":278,"num_write":359,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"261'419","reported_seq":1962,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.192402+0000","last_change":"2024-09-12T18:02:06.192402+0000","last_active":"2024-09-12T18:02:06.192402+0000","last_peered":"2024-09-12T18:02:06.192402+0000","last_clean":"2024-09-12T18:02:06.192402+0000","last_became_active":"2024-09-12T17:23:42.146703+0000","last_became_peered":"2024-09-12T17:23:42.146703+0000","last_unstale":"2024-09-12T18:02:06.192402+0000","last_undegraded":"2024-09-12T18:02:06.192402+0000","last_fullsized":"2024-09-12T18:02:06.192402+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'419","last_scrub_stamp":"2024-09-12T18:02:06.192317+0000","last_deep_scrub":"261'419","last_deep_scrub_stamp":"2024-09-12T18:02:06.192317+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.192317+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:52.444010+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2240,"num_read_kb":2131,"num_write":479,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":501,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"261'293","reported_seq":959,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.316196+0000","last_change":"2024-09-12T18:02:01.316120+0000","last_active":"2024-09-12T18:02:01.316196+0000","last_peered":"2024-09-12T18:02:01.316196+0000","last_clean":"2024-09-12T18:02:01.316196+0000","last_became_active":"2024-09-12T17:23:40.704278+0000","last_became_peered":"2024-09-12T17:23:40.704278+0000","last_unstale":"2024-09-12T18:02:01.316196+0000","last_undegraded":"2024-09-12T18:02:01.316196+0000","last_fullsized":"2024-09-12T18:02:01.316196+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'293","last_scrub_stamp":"2024-09-12T18:02:01.316032+0000","last_deep_scrub":"261'293","last_deep_scrub_stamp":"2024-09-12T18:02:01.316032+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.316032+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:16.068553+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3045160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":96519,"num_write":927,"num_write_kb":33057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:17.706883+0000","last_change":"2024-09-12T18:02:17.706883+0000","last_active":"2024-09-12T18:02:17.706883+0000","last_peered":"2024-09-12T18:02:17.706883+0000","last_clean":"2024-09-12T18:02:17.706883+0000","last_became_active":"2024-09-12T17:23:44.149838+0000","last_became_peered":"2024-09-12T17:23:44.149838+0000","last_unstale":"2024-09-12T18:02:17.706883+0000","last_undegraded":"2024-09-12T18:02:17.706883+0000","last_fullsized":"2024-09-12T18:02:17.706883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:17.706800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:17.706800+0000","last_clean_scrub_stamp":"2024-09-12T18:02:17.706800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:08.623448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"261'306","reported_seq":890,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:23.324912+0000","last_change":"2024-09-12T18:02:23.324912+0000","last_active":"2024-09-12T18:02:23.324912+0000","last_peered":"2024-09-12T18:02:23.324912+0000","last_clean":"2024-09-12T18:02:23.324912+0000","last_became_active":"2024-09-12T17:23:46.150528+0000","last_became_peered":"2024-09-12T17:23:46.150528+0000","last_unstale":"2024-09-12T18:02:23.324912+0000","last_undegraded":"2024-09-12T18:02:23.324912+0000","last_fullsized":"2024-09-12T18:02:23.324912+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'306","last_scrub_stamp":"2024-09-12T18:02:23.324823+0000","last_deep_scrub":"261'306","last_deep_scrub_stamp":"2024-09-12T18:02:23.324823+0000","last_clean_scrub_stamp":"2024-09-12T18:02:23.324823+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:51.330358+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45198,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":1096,"num_write":398,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.097012+0000","last_change":"2024-09-12T18:02:15.097012+0000","last_active":"2024-09-12T18:02:15.097012+0000","last_peered":"2024-09-12T18:02:15.097012+0000","last_clean":"2024-09-12T18:02:15.097012+0000","last_became_active":"2024-09-12T17:23:48.171031+0000","last_became_peered":"2024-09-12T17:23:48.171031+0000","last_unstale":"2024-09-12T18:02:15.097012+0000","last_undegraded":"2024-09-12T18:02:15.097012+0000","last_fullsized":"2024-09-12T18:02:15.097012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:15.096890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:15.096890+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.096890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:37.985935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"261'155","reported_seq":666,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.172024+0000","last_change":"2024-09-12T18:02:34.172024+0000","last_active":"2024-09-12T18:02:34.172024+0000","last_peered":"2024-09-12T18:02:34.172024+0000","last_clean":"2024-09-12T18:02:34.172024+0000","last_became_active":"2024-09-12T17:23:50.185846+0000","last_became_peered":"2024-09-12T17:23:50.185846+0000","last_unstale":"2024-09-12T18:02:34.172024+0000","last_undegraded":"2024-09-12T18:02:34.172024+0000","last_fullsized":"2024-09-12T18:02:34.172024+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'155","last_scrub_stamp":"2024-09-12T18:02:34.171906+0000","last_deep_scrub":"261'155","last_deep_scrub_stamp":"2024-09-12T18:02:34.171906+0000","last_clean_scrub_stamp":"2024-09-12T18:02:34.171906+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:47.312682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":366,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"261'794","reported_seq":2414,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.273399+0000","last_change":"2024-09-12T18:02:11.273399+0000","last_active":"2024-09-12T18:02:11.273399+0000","last_peered":"2024-09-12T18:02:11.273399+0000","last_clean":"2024-09-12T18:02:11.273399+0000","last_became_active":"2024-09-12T17:23:42.154925+0000","last_became_peered":"2024-09-12T17:23:42.154925+0000","last_unstale":"2024-09-12T18:02:11.273399+0000","last_undegraded":"2024-09-12T18:02:11.273399+0000","last_fullsized":"2024-09-12T18:02:11.273399+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'794","last_scrub_stamp":"2024-09-12T18:02:11.273304+0000","last_deep_scrub":"261'794","last_deep_scrub_stamp":"2024-09-12T18:02:11.273304+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.273304+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:14.231877+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3893,"num_read_kb":3543,"num_write":1032,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"261'364","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:54.755889+0000","last_change":"2024-09-12T18:01:54.755805+0000","last_active":"2024-09-12T18:01:54.755889+0000","last_peered":"2024-09-12T18:01:54.755889+0000","last_clean":"2024-09-12T18:01:54.755889+0000","last_became_active":"2024-09-12T17:23:40.708670+0000","last_became_peered":"2024-09-12T17:23:40.708670+0000","last_unstale":"2024-09-12T18:01:54.755889+0000","last_undegraded":"2024-09-12T18:01:54.755889+0000","last_fullsized":"2024-09-12T18:01:54.755889+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'364","last_scrub_stamp":"2024-09-12T18:01:54.755697+0000","last_deep_scrub":"261'364","last_deep_scrub_stamp":"2024-09-12T18:01:54.755697+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.755697+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:28.461074+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306433,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":1950,"num_write":1111,"num_write_kb":27043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.155600+0000","last_change":"2024-09-12T18:02:12.155600+0000","last_active":"2024-09-12T18:02:12.155600+0000","last_peered":"2024-09-12T18:02:12.155600+0000","last_clean":"2024-09-12T18:02:12.155600+0000","last_became_active":"2024-09-12T17:23:44.149907+0000","last_became_peered":"2024-09-12T17:23:44.149907+0000","last_unstale":"2024-09-12T18:02:12.155600+0000","last_undegraded":"2024-09-12T18:02:12.155600+0000","last_fullsized":"2024-09-12T18:02:12.155600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:12.155514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:12.155514+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.155514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:15.472208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"261'280","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.813283+0000","last_change":"2024-09-12T18:02:22.813283+0000","last_active":"2024-09-12T18:02:22.813283+0000","last_peered":"2024-09-12T18:02:22.813283+0000","last_clean":"2024-09-12T18:02:22.813283+0000","last_became_active":"2024-09-12T17:23:46.149987+0000","last_became_peered":"2024-09-12T17:23:46.149987+0000","last_unstale":"2024-09-12T18:02:22.813283+0000","last_undegraded":"2024-09-12T18:02:22.813283+0000","last_fullsized":"2024-09-12T18:02:22.813283+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'280","last_scrub_stamp":"2024-09-12T18:02:22.813122+0000","last_deep_scrub":"261'280","last_deep_scrub_stamp":"2024-09-12T18:02:22.813122+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.813122+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:06.437239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46832,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":1121,"num_write":390,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.705411+0000","last_change":"2024-09-12T18:02:31.705411+0000","last_active":"2024-09-12T18:02:31.705411+0000","last_peered":"2024-09-12T18:02:31.705411+0000","last_clean":"2024-09-12T18:02:31.705411+0000","last_became_active":"2024-09-12T17:23:48.169308+0000","last_became_peered":"2024-09-12T17:23:48.169308+0000","last_unstale":"2024-09-12T18:02:31.705411+0000","last_undegraded":"2024-09-12T18:02:31.705411+0000","last_fullsized":"2024-09-12T18:02:31.705411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:31.705317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:31.705317+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.705317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:15.786791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"261'807","reported_seq":2262,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.135687+0000","last_change":"2024-09-12T18:02:06.135687+0000","last_active":"2024-09-12T18:02:06.135687+0000","last_peered":"2024-09-12T18:02:06.135687+0000","last_clean":"2024-09-12T18:02:06.135687+0000","last_became_active":"2024-09-12T17:23:42.148412+0000","last_became_peered":"2024-09-12T17:23:42.148412+0000","last_unstale":"2024-09-12T18:02:06.135687+0000","last_undegraded":"2024-09-12T18:02:06.135687+0000","last_fullsized":"2024-09-12T18:02:06.135687+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'807","last_scrub_stamp":"2024-09-12T18:02:06.135591+0000","last_deep_scrub":"261'807","last_deep_scrub_stamp":"2024-09-12T18:02:06.135591+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.135591+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:19.719813+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3663,"num_read_kb":3282,"num_write":1025,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"261'314","reported_seq":954,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.212887+0000","last_change":"2024-09-12T18:02:05.212827+0000","last_active":"2024-09-12T18:02:05.212887+0000","last_peered":"2024-09-12T18:02:05.212887+0000","last_clean":"2024-09-12T18:02:05.212887+0000","last_became_active":"2024-09-12T17:23:40.717447+0000","last_became_peered":"2024-09-12T17:23:40.717447+0000","last_unstale":"2024-09-12T18:02:05.212887+0000","last_undegraded":"2024-09-12T18:02:05.212887+0000","last_fullsized":"2024-09-12T18:02:05.212887+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'314","last_scrub_stamp":"2024-09-12T18:02:05.212709+0000","last_deep_scrub":"261'314","last_deep_scrub_stamp":"2024-09-12T18:02:05.212709+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.212709+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:03.962158+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":485,"num_read_kb":6880,"num_write":973,"num_write_kb":42559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.627878+0000","last_change":"2024-09-12T18:02:14.627878+0000","last_active":"2024-09-12T18:02:14.627878+0000","last_peered":"2024-09-12T18:02:14.627878+0000","last_clean":"2024-09-12T18:02:14.627878+0000","last_became_active":"2024-09-12T17:23:44.149799+0000","last_became_peered":"2024-09-12T17:23:44.149799+0000","last_unstale":"2024-09-12T18:02:14.627878+0000","last_undegraded":"2024-09-12T18:02:14.627878+0000","last_fullsized":"2024-09-12T18:02:14.627878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:14.627777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:14.627777+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.627777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:51.256807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"261'487","reported_seq":1116,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.071370+0000","last_change":"2024-09-12T18:02:16.071370+0000","last_active":"2024-09-12T18:02:16.071370+0000","last_peered":"2024-09-12T18:02:16.071370+0000","last_clean":"2024-09-12T18:02:16.071370+0000","last_became_active":"2024-09-12T17:23:46.148861+0000","last_became_peered":"2024-09-12T17:23:46.148861+0000","last_unstale":"2024-09-12T18:02:16.071370+0000","last_undegraded":"2024-09-12T18:02:16.071370+0000","last_fullsized":"2024-09-12T18:02:16.071370+0000","mapping_epoch":29,"log_start":"261'400","ondisk_log_start":"261'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'487","last_scrub_stamp":"2024-09-12T18:02:16.071270+0000","last_deep_scrub":"261'487","last_deep_scrub_stamp":"2024-09-12T18:02:16.071270+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.071270+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:48.773638+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101554,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":879,"num_read_kb":2135,"num_write":756,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:28.173154+0000","last_change":"2024-09-12T18:02:28.173154+0000","last_active":"2024-09-12T18:02:28.173154+0000","last_peered":"2024-09-12T18:02:28.173154+0000","last_clean":"2024-09-12T18:02:28.173154+0000","last_became_active":"2024-09-12T17:23:48.168566+0000","last_became_peered":"2024-09-12T17:23:48.168566+0000","last_unstale":"2024-09-12T18:02:28.173154+0000","last_undegraded":"2024-09-12T18:02:28.173154+0000","last_fullsized":"2024-09-12T18:02:28.173154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:28.173071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:28.173071+0000","last_clean_scrub_stamp":"2024-09-12T18:02:28.173071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:47.649297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"261'219","reported_seq":734,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:35.421467+0000","last_change":"2024-09-12T18:02:35.421467+0000","last_active":"2024-09-12T18:02:35.421467+0000","last_peered":"2024-09-12T18:02:35.421467+0000","last_clean":"2024-09-12T18:02:35.421467+0000","last_became_active":"2024-09-12T17:23:50.641702+0000","last_became_peered":"2024-09-12T17:23:50.641702+0000","last_unstale":"2024-09-12T18:02:35.421467+0000","last_undegraded":"2024-09-12T18:02:35.421467+0000","last_fullsized":"2024-09-12T18:02:35.421467+0000","mapping_epoch":33,"log_start":"261'200","ondisk_log_start":"261'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'219","last_scrub_stamp":"2024-09-12T18:02:35.421372+0000","last_deep_scrub":"261'219","last_deep_scrub_stamp":"2024-09-12T18:02:35.421372+0000","last_clean_scrub_stamp":"2024-09-12T18:02:35.421372+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:13.033839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":328,"num_write":469,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"261'761","reported_seq":2337,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.610751+0000","last_change":"2024-09-12T18:02:07.610751+0000","last_active":"2024-09-12T18:02:07.610751+0000","last_peered":"2024-09-12T18:02:07.610751+0000","last_clean":"2024-09-12T18:02:07.610751+0000","last_became_active":"2024-09-12T17:23:42.141869+0000","last_became_peered":"2024-09-12T17:23:42.141869+0000","last_unstale":"2024-09-12T18:02:07.610751+0000","last_undegraded":"2024-09-12T18:02:07.610751+0000","last_fullsized":"2024-09-12T18:02:07.610751+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'761","last_scrub_stamp":"2024-09-12T18:02:07.610649+0000","last_deep_scrub":"261'761","last_deep_scrub_stamp":"2024-09-12T18:02:07.610649+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.610649+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:59.154743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3783,"num_read_kb":3443,"num_write":995,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"261'326","reported_seq":936,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.085173+0000","last_change":"2024-09-12T18:02:00.085100+0000","last_active":"2024-09-12T18:02:00.085173+0000","last_peered":"2024-09-12T18:02:00.085173+0000","last_clean":"2024-09-12T18:02:00.085173+0000","last_became_active":"2024-09-12T17:23:40.711679+0000","last_became_peered":"2024-09-12T17:23:40.711679+0000","last_unstale":"2024-09-12T18:02:00.085173+0000","last_undegraded":"2024-09-12T18:02:00.085173+0000","last_fullsized":"2024-09-12T18:02:00.085173+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-12T18:02:00.084987+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-12T18:02:00.084987+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.084987+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:03.235507+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":441,"num_read_kb":3628,"num_write":977,"num_write_kb":35404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.204703+0000","last_change":"2024-09-12T18:02:10.204703+0000","last_active":"2024-09-12T18:02:10.204703+0000","last_peered":"2024-09-12T18:02:10.204703+0000","last_clean":"2024-09-12T18:02:10.204703+0000","last_became_active":"2024-09-12T17:23:44.148044+0000","last_became_peered":"2024-09-12T17:23:44.148044+0000","last_unstale":"2024-09-12T18:02:10.204703+0000","last_undegraded":"2024-09-12T18:02:10.204703+0000","last_fullsized":"2024-09-12T18:02:10.204703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:10.204586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:10.204586+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.204586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:28.253142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"261'300","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.751116+0000","last_change":"2024-09-12T18:02:24.751116+0000","last_active":"2024-09-12T18:02:24.751116+0000","last_peered":"2024-09-12T18:02:24.751116+0000","last_clean":"2024-09-12T18:02:24.751116+0000","last_became_active":"2024-09-12T17:23:46.150380+0000","last_became_peered":"2024-09-12T17:23:46.150380+0000","last_unstale":"2024-09-12T18:02:24.751116+0000","last_undegraded":"2024-09-12T18:02:24.751116+0000","last_fullsized":"2024-09-12T18:02:24.751116+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'300","last_scrub_stamp":"2024-09-12T18:02:24.751022+0000","last_deep_scrub":"261'300","last_deep_scrub_stamp":"2024-09-12T18:02:24.751022+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.751022+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:39.332302+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47278,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":1112,"num_write":416,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.999834+0000","last_change":"2024-09-12T18:02:19.999834+0000","last_active":"2024-09-12T18:02:19.999834+0000","last_peered":"2024-09-12T18:02:19.999834+0000","last_clean":"2024-09-12T18:02:19.999834+0000","last_became_active":"2024-09-12T17:23:48.173575+0000","last_became_peered":"2024-09-12T17:23:48.173575+0000","last_unstale":"2024-09-12T18:02:19.999834+0000","last_undegraded":"2024-09-12T18:02:19.999834+0000","last_fullsized":"2024-09-12T18:02:19.999834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:19.999742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:19.999742+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.999742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:27.971506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"261'195","reported_seq":1059,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:21.075748+0000","last_change":"2024-09-12T18:02:21.075748+0000","last_active":"2024-09-12T18:02:21.075748+0000","last_peered":"2024-09-12T18:02:21.075748+0000","last_clean":"2024-09-12T18:02:21.075748+0000","last_became_active":"2024-09-12T17:23:50.185853+0000","last_became_peered":"2024-09-12T17:23:50.185853+0000","last_unstale":"2024-09-12T18:02:21.075748+0000","last_undegraded":"2024-09-12T18:02:21.075748+0000","last_fullsized":"2024-09-12T18:02:21.075748+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'195","last_scrub_stamp":"2024-09-12T18:02:21.075656+0000","last_deep_scrub":"261'195","last_deep_scrub_stamp":"2024-09-12T18:02:21.075656+0000","last_clean_scrub_stamp":"2024-09-12T18:02:21.075656+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:21.562874+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":633,"num_read_kb":630,"num_write":516,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"261'633","reported_seq":2482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.239446+0000","last_change":"2024-09-12T18:02:12.239446+0000","last_active":"2024-09-12T18:02:12.239446+0000","last_peered":"2024-09-12T18:02:12.239446+0000","last_clean":"2024-09-12T18:02:12.239446+0000","last_became_active":"2024-09-12T17:23:42.154175+0000","last_became_peered":"2024-09-12T17:23:42.154175+0000","last_unstale":"2024-09-12T18:02:12.239446+0000","last_undegraded":"2024-09-12T18:02:12.239446+0000","last_fullsized":"2024-09-12T18:02:12.239446+0000","mapping_epoch":25,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'633","last_scrub_stamp":"2024-09-12T18:02:12.239338+0000","last_deep_scrub":"261'633","last_deep_scrub_stamp":"2024-09-12T18:02:12.239338+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.239338+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":600,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:45.683746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3404,"num_read_kb":3151,"num_write":789,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1533,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"261'349","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.040975+0000","last_change":"2024-09-12T18:01:58.040975+0000","last_active":"2024-09-12T18:01:58.040975+0000","last_peered":"2024-09-12T18:01:58.040975+0000","last_clean":"2024-09-12T18:01:58.040975+0000","last_became_active":"2024-09-12T17:23:40.712959+0000","last_became_peered":"2024-09-12T17:23:40.712959+0000","last_unstale":"2024-09-12T18:01:58.040975+0000","last_undegraded":"2024-09-12T18:01:58.040975+0000","last_fullsized":"2024-09-12T18:01:58.040975+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T18:01:58.040878+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T18:01:58.040878+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.040878+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:42.713508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":522,"num_read_kb":11025,"num_write":1066,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.193876+0000","last_change":"2024-09-12T18:02:19.193876+0000","last_active":"2024-09-12T18:02:19.193876+0000","last_peered":"2024-09-12T18:02:19.193876+0000","last_clean":"2024-09-12T18:02:19.193876+0000","last_became_active":"2024-09-12T17:23:44.152006+0000","last_became_peered":"2024-09-12T17:23:44.152006+0000","last_unstale":"2024-09-12T18:02:19.193876+0000","last_undegraded":"2024-09-12T18:02:19.193876+0000","last_fullsized":"2024-09-12T18:02:19.193876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:19.193797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:19.193797+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.193797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:33.141032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"261'255","reported_seq":825,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.325621+0000","last_change":"2024-09-12T18:02:25.325621+0000","last_active":"2024-09-12T18:02:25.325621+0000","last_peered":"2024-09-12T18:02:25.325621+0000","last_clean":"2024-09-12T18:02:25.325621+0000","last_became_active":"2024-09-12T17:23:46.241001+0000","last_became_peered":"2024-09-12T17:23:46.241001+0000","last_unstale":"2024-09-12T18:02:25.325621+0000","last_undegraded":"2024-09-12T18:02:25.325621+0000","last_fullsized":"2024-09-12T18:02:25.325621+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'255","last_scrub_stamp":"2024-09-12T18:02:25.325531+0000","last_deep_scrub":"261'255","last_deep_scrub_stamp":"2024-09-12T18:02:25.325531+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.325531+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:01.527863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42355,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":393,"num_read_kb":868,"num_write":314,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.008014+0000","last_change":"2024-09-12T18:02:19.008014+0000","last_active":"2024-09-12T18:02:19.008014+0000","last_peered":"2024-09-12T18:02:19.008014+0000","last_clean":"2024-09-12T18:02:19.008014+0000","last_became_active":"2024-09-12T17:23:48.170212+0000","last_became_peered":"2024-09-12T17:23:48.170212+0000","last_unstale":"2024-09-12T18:02:19.008014+0000","last_undegraded":"2024-09-12T18:02:19.008014+0000","last_fullsized":"2024-09-12T18:02:19.008014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:19.007879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:19.007879+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.007879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:30.317175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"261'132","reported_seq":620,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.118782+0000","last_change":"2024-09-12T18:02:32.118782+0000","last_active":"2024-09-12T18:02:32.118782+0000","last_peered":"2024-09-12T18:02:32.118782+0000","last_clean":"2024-09-12T18:02:32.118782+0000","last_became_active":"2024-09-12T17:23:50.187329+0000","last_became_peered":"2024-09-12T17:23:50.187329+0000","last_unstale":"2024-09-12T18:02:32.118782+0000","last_undegraded":"2024-09-12T18:02:32.118782+0000","last_fullsized":"2024-09-12T18:02:32.118782+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'132","last_scrub_stamp":"2024-09-12T18:02:32.118687+0000","last_deep_scrub":"261'132","last_deep_scrub_stamp":"2024-09-12T18:02:32.118687+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.118687+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:23.158731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":770,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":154,"num_read_kb":149,"num_write":327,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"261'777","reported_seq":2301,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.938708+0000","last_change":"2024-09-12T18:01:59.938708+0000","last_active":"2024-09-12T18:01:59.938708+0000","last_peered":"2024-09-12T18:01:59.938708+0000","last_clean":"2024-09-12T18:01:59.938708+0000","last_became_active":"2024-09-12T17:23:42.144384+0000","last_became_peered":"2024-09-12T17:23:42.144384+0000","last_unstale":"2024-09-12T18:01:59.938708+0000","last_undegraded":"2024-09-12T18:01:59.938708+0000","last_fullsized":"2024-09-12T18:01:59.938708+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'777","last_scrub_stamp":"2024-09-12T18:01:59.938618+0000","last_deep_scrub":"261'777","last_deep_scrub_stamp":"2024-09-12T18:01:59.938618+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.938618+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:20.494541+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3720,"num_read_kb":3370,"num_write":1041,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"261'331","reported_seq":948,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:55.748832+0000","last_change":"2024-09-12T18:01:55.748832+0000","last_active":"2024-09-12T18:01:55.748832+0000","last_peered":"2024-09-12T18:01:55.748832+0000","last_clean":"2024-09-12T18:01:55.748832+0000","last_became_active":"2024-09-12T17:23:40.714710+0000","last_became_peered":"2024-09-12T17:23:40.714710+0000","last_unstale":"2024-09-12T18:01:55.748832+0000","last_undegraded":"2024-09-12T18:01:55.748832+0000","last_fullsized":"2024-09-12T18:01:55.748832+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'331","last_scrub_stamp":"2024-09-12T18:01:55.748688+0000","last_deep_scrub":"261'331","last_deep_scrub_stamp":"2024-09-12T18:01:55.748688+0000","last_clean_scrub_stamp":"2024-09-12T18:01:55.748688+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:42.546066+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311482,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":467,"num_read_kb":6860,"num_write":1100,"num_write_kb":28418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.007474+0000","last_change":"2024-09-12T18:02:13.007474+0000","last_active":"2024-09-12T18:02:13.007474+0000","last_peered":"2024-09-12T18:02:13.007474+0000","last_clean":"2024-09-12T18:02:13.007474+0000","last_became_active":"2024-09-12T17:23:44.147886+0000","last_became_peered":"2024-09-12T17:23:44.147886+0000","last_unstale":"2024-09-12T18:02:13.007474+0000","last_undegraded":"2024-09-12T18:02:13.007474+0000","last_fullsized":"2024-09-12T18:02:13.007474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:13.007389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:13.007389+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.007389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:11.491836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"261'87","reported_seq":604,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.146248+0000","last_change":"2024-09-12T18:02:26.146248+0000","last_active":"2024-09-12T18:02:26.146248+0000","last_peered":"2024-09-12T18:02:26.146248+0000","last_clean":"2024-09-12T18:02:26.146248+0000","last_became_active":"2024-09-12T17:23:46.241073+0000","last_became_peered":"2024-09-12T17:23:46.241073+0000","last_unstale":"2024-09-12T18:02:26.146248+0000","last_undegraded":"2024-09-12T18:02:26.146248+0000","last_fullsized":"2024-09-12T18:02:26.146248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'87","last_scrub_stamp":"2024-09-12T18:02:26.146111+0000","last_deep_scrub":"261'87","last_deep_scrub_stamp":"2024-09-12T18:02:26.146111+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.146111+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:51.515529+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":73,"num_read_kb":65,"num_write":60,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"261'785","reported_seq":2177,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.122305+0000","last_change":"2024-09-12T18:02:18.122305+0000","last_active":"2024-09-12T18:02:18.122305+0000","last_peered":"2024-09-12T18:02:18.122305+0000","last_clean":"2024-09-12T18:02:18.122305+0000","last_became_active":"2024-09-12T17:23:48.170815+0000","last_became_peered":"2024-09-12T17:23:48.170815+0000","last_unstale":"2024-09-12T18:02:18.122305+0000","last_undegraded":"2024-09-12T18:02:18.122305+0000","last_fullsized":"2024-09-12T18:02:18.122305+0000","mapping_epoch":31,"log_start":"261'700","ondisk_log_start":"261'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'785","last_scrub_stamp":"2024-09-12T18:02:18.122209+0000","last_deep_scrub":"261'785","last_deep_scrub_stamp":"2024-09-12T18:02:18.122209+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.122209+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:13.299383+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"261'128","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:29.696630+0000","last_change":"2024-09-12T18:02:29.696630+0000","last_active":"2024-09-12T18:02:29.696630+0000","last_peered":"2024-09-12T18:02:29.696630+0000","last_clean":"2024-09-12T18:02:29.696630+0000","last_became_active":"2024-09-12T17:23:50.190124+0000","last_became_peered":"2024-09-12T17:23:50.190124+0000","last_unstale":"2024-09-12T18:02:29.696630+0000","last_undegraded":"2024-09-12T18:02:29.696630+0000","last_fullsized":"2024-09-12T18:02:29.696630+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'128","last_scrub_stamp":"2024-09-12T18:02:29.696540+0000","last_deep_scrub":"261'128","last_deep_scrub_stamp":"2024-09-12T18:02:29.696540+0000","last_clean_scrub_stamp":"2024-09-12T18:02:29.696540+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:44.997582+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":181,"num_read_kb":172,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"261'824","reported_seq":2447,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.135447+0000","last_change":"2024-09-12T18:02:09.135447+0000","last_active":"2024-09-12T18:02:09.135447+0000","last_peered":"2024-09-12T18:02:09.135447+0000","last_clean":"2024-09-12T18:02:09.135447+0000","last_became_active":"2024-09-12T17:23:42.149314+0000","last_became_peered":"2024-09-12T17:23:42.149314+0000","last_unstale":"2024-09-12T18:02:09.135447+0000","last_undegraded":"2024-09-12T18:02:09.135447+0000","last_fullsized":"2024-09-12T18:02:09.135447+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'824","last_scrub_stamp":"2024-09-12T18:02:09.135365+0000","last_deep_scrub":"261'824","last_deep_scrub_stamp":"2024-09-12T18:02:09.135365+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.135365+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:09.176143+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4083,"num_read_kb":3703,"num_write":1086,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":756,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"261'295","reported_seq":924,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.265156+0000","last_change":"2024-09-12T18:02:02.265156+0000","last_active":"2024-09-12T18:02:02.265156+0000","last_peered":"2024-09-12T18:02:02.265156+0000","last_clean":"2024-09-12T18:02:02.265156+0000","last_became_active":"2024-09-12T17:23:40.709818+0000","last_became_peered":"2024-09-12T17:23:40.709818+0000","last_unstale":"2024-09-12T18:02:02.265156+0000","last_undegraded":"2024-09-12T18:02:02.265156+0000","last_fullsized":"2024-09-12T18:02:02.265156+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'295","last_scrub_stamp":"2024-09-12T18:02:02.265077+0000","last_deep_scrub":"261'295","last_deep_scrub_stamp":"2024-09-12T18:02:02.265077+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.265077+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:25.521537+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":426,"num_read_kb":69858,"num_write":935,"num_write_kb":36096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.682930+0000","last_change":"2024-09-12T18:02:18.682930+0000","last_active":"2024-09-12T18:02:18.682930+0000","last_peered":"2024-09-12T18:02:18.682930+0000","last_clean":"2024-09-12T18:02:18.682930+0000","last_became_active":"2024-09-12T17:23:44.150183+0000","last_became_peered":"2024-09-12T17:23:44.150183+0000","last_unstale":"2024-09-12T18:02:18.682930+0000","last_undegraded":"2024-09-12T18:02:18.682930+0000","last_fullsized":"2024-09-12T18:02:18.682930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:18.682841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:18.682841+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.682841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:04.298570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"261'323","reported_seq":898,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.148739+0000","last_change":"2024-09-12T18:02:26.148673+0000","last_active":"2024-09-12T18:02:26.148739+0000","last_peered":"2024-09-12T18:02:26.148739+0000","last_clean":"2024-09-12T18:02:26.148739+0000","last_became_active":"2024-09-12T17:23:46.144587+0000","last_became_peered":"2024-09-12T17:23:46.144587+0000","last_unstale":"2024-09-12T18:02:26.148739+0000","last_undegraded":"2024-09-12T18:02:26.148739+0000","last_fullsized":"2024-09-12T18:02:26.148739+0000","mapping_epoch":29,"log_start":"261'300","ondisk_log_start":"261'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-12T18:02:26.148565+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-12T18:02:26.148565+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.148565+0000","objects_scrubbed":9,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:12.623163+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46086,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":505,"num_read_kb":1153,"num_write":418,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.611732+0000","last_change":"2024-09-12T18:02:25.611639+0000","last_active":"2024-09-12T18:02:25.611732+0000","last_peered":"2024-09-12T18:02:25.611732+0000","last_clean":"2024-09-12T18:02:25.611732+0000","last_became_active":"2024-09-12T17:23:48.171272+0000","last_became_peered":"2024-09-12T17:23:48.171272+0000","last_unstale":"2024-09-12T18:02:25.611732+0000","last_undegraded":"2024-09-12T18:02:25.611732+0000","last_fullsized":"2024-09-12T18:02:25.611732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:25.611530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:25.611530+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.611530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:45.194075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"261'104","reported_seq":597,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:32.709004+0000","last_change":"2024-09-12T18:02:32.709004+0000","last_active":"2024-09-12T18:02:32.709004+0000","last_peered":"2024-09-12T18:02:32.709004+0000","last_clean":"2024-09-12T18:02:32.709004+0000","last_became_active":"2024-09-12T17:23:50.191859+0000","last_became_peered":"2024-09-12T17:23:50.191859+0000","last_unstale":"2024-09-12T18:02:32.709004+0000","last_undegraded":"2024-09-12T18:02:32.709004+0000","last_fullsized":"2024-09-12T18:02:32.709004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'104","last_scrub_stamp":"2024-09-12T18:02:32.708900+0000","last_deep_scrub":"261'104","last_deep_scrub_stamp":"2024-09-12T18:02:32.708900+0000","last_clean_scrub_stamp":"2024-09-12T18:02:32.708900+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:19.072198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":141,"num_write":249,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"261'477","reported_seq":2065,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.167430+0000","last_change":"2024-09-12T18:02:07.167430+0000","last_active":"2024-09-12T18:02:07.167430+0000","last_peered":"2024-09-12T18:02:07.167430+0000","last_clean":"2024-09-12T18:02:07.167430+0000","last_became_active":"2024-09-12T17:23:42.149260+0000","last_became_peered":"2024-09-12T17:23:42.149260+0000","last_unstale":"2024-09-12T18:02:07.167430+0000","last_undegraded":"2024-09-12T18:02:07.167430+0000","last_fullsized":"2024-09-12T18:02:07.167430+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'477","last_scrub_stamp":"2024-09-12T18:02:07.167342+0000","last_deep_scrub":"261'477","last_deep_scrub_stamp":"2024-09-12T18:02:07.167342+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.167342+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:54.938925+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2426,"num_read_kb":2286,"num_write":546,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"261'381","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:03.261206+0000","last_change":"2024-09-12T18:02:03.261206+0000","last_active":"2024-09-12T18:02:03.261206+0000","last_peered":"2024-09-12T18:02:03.261206+0000","last_clean":"2024-09-12T18:02:03.261206+0000","last_became_active":"2024-09-12T17:23:40.711032+0000","last_became_peered":"2024-09-12T17:23:40.711032+0000","last_unstale":"2024-09-12T18:02:03.261206+0000","last_undegraded":"2024-09-12T18:02:03.261206+0000","last_fullsized":"2024-09-12T18:02:03.261206+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'381","last_scrub_stamp":"2024-09-12T18:02:03.261091+0000","last_deep_scrub":"261'381","last_deep_scrub_stamp":"2024-09-12T18:02:03.261091+0000","last_clean_scrub_stamp":"2024-09-12T18:02:03.261091+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:14.427700+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":607,"num_read_kb":19508,"num_write":1297,"num_write_kb":28388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:22.162153+0000","last_change":"2024-09-12T18:02:22.162153+0000","last_active":"2024-09-12T18:02:22.162153+0000","last_peered":"2024-09-12T18:02:22.162153+0000","last_clean":"2024-09-12T18:02:22.162153+0000","last_became_active":"2024-09-12T17:23:44.147694+0000","last_became_peered":"2024-09-12T17:23:44.147694+0000","last_unstale":"2024-09-12T18:02:22.162153+0000","last_undegraded":"2024-09-12T18:02:22.162153+0000","last_fullsized":"2024-09-12T18:02:22.162153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:22.162066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:22.162066+0000","last_clean_scrub_stamp":"2024-09-12T18:02:22.162066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:39.604814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"261'262","reported_seq":822,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:19.567988+0000","last_change":"2024-09-12T18:02:19.567887+0000","last_active":"2024-09-12T18:02:19.567988+0000","last_peered":"2024-09-12T18:02:19.567988+0000","last_clean":"2024-09-12T18:02:19.567988+0000","last_became_active":"2024-09-12T17:23:46.152028+0000","last_became_peered":"2024-09-12T17:23:46.152028+0000","last_unstale":"2024-09-12T18:02:19.567988+0000","last_undegraded":"2024-09-12T18:02:19.567988+0000","last_fullsized":"2024-09-12T18:02:19.567988+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'262","last_scrub_stamp":"2024-09-12T18:02:19.567770+0000","last_deep_scrub":"261'262","last_deep_scrub_stamp":"2024-09-12T18:02:19.567770+0000","last_clean_scrub_stamp":"2024-09-12T18:02:19.567770+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:40.120655+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":974,"num_write":338,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.110255+0000","last_change":"2024-09-12T18:02:16.110198+0000","last_active":"2024-09-12T18:02:16.110255+0000","last_peered":"2024-09-12T18:02:16.110255+0000","last_clean":"2024-09-12T18:02:16.110255+0000","last_became_active":"2024-09-12T17:23:48.170452+0000","last_became_peered":"2024-09-12T17:23:48.170452+0000","last_unstale":"2024-09-12T18:02:16.110255+0000","last_undegraded":"2024-09-12T18:02:16.110255+0000","last_fullsized":"2024-09-12T18:02:16.110255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:16.110107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:16.110107+0000","last_clean_scrub_stamp":"2024-09-12T18:02:16.110107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:51.727297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"261'127","reported_seq":638,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:36.458815+0000","last_change":"2024-09-12T18:02:36.458815+0000","last_active":"2024-09-12T18:02:36.458815+0000","last_peered":"2024-09-12T18:02:36.458815+0000","last_clean":"2024-09-12T18:02:36.458815+0000","last_became_active":"2024-09-12T17:23:50.640911+0000","last_became_peered":"2024-09-12T17:23:50.640911+0000","last_unstale":"2024-09-12T18:02:36.458815+0000","last_undegraded":"2024-09-12T18:02:36.458815+0000","last_fullsized":"2024-09-12T18:02:36.458815+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'127","last_scrub_stamp":"2024-09-12T18:02:36.458662+0000","last_deep_scrub":"261'127","last_deep_scrub_stamp":"2024-09-12T18:02:36.458662+0000","last_clean_scrub_stamp":"2024-09-12T18:02:36.458662+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:11.745887+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":307,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"261'391","reported_seq":1798,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.243312+0000","last_change":"2024-09-12T18:02:10.243251+0000","last_active":"2024-09-12T18:02:10.243312+0000","last_peered":"2024-09-12T18:02:10.243312+0000","last_clean":"2024-09-12T18:02:10.243312+0000","last_became_active":"2024-09-12T17:23:42.146055+0000","last_became_peered":"2024-09-12T17:23:42.146055+0000","last_unstale":"2024-09-12T18:02:10.243312+0000","last_undegraded":"2024-09-12T18:02:10.243312+0000","last_fullsized":"2024-09-12T18:02:10.243312+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'391","last_scrub_stamp":"2024-09-12T18:02:10.243153+0000","last_deep_scrub":"261'391","last_deep_scrub_stamp":"2024-09-12T18:02:10.243153+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.243153+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:14.671527+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1982,"num_read_kb":1877,"num_write":444,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"261'319","reported_seq":944,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.219235+0000","last_change":"2024-09-12T18:02:00.219235+0000","last_active":"2024-09-12T18:02:00.219235+0000","last_peered":"2024-09-12T18:02:00.219235+0000","last_clean":"2024-09-12T18:02:00.219235+0000","last_became_active":"2024-09-12T17:23:40.709759+0000","last_became_peered":"2024-09-12T17:23:40.709759+0000","last_unstale":"2024-09-12T18:02:00.219235+0000","last_undegraded":"2024-09-12T18:02:00.219235+0000","last_fullsized":"2024-09-12T18:02:00.219235+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'319","last_scrub_stamp":"2024-09-12T18:02:00.219087+0000","last_deep_scrub":"261'319","last_deep_scrub_stamp":"2024-09-12T18:02:00.219087+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.219087+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:11.536241+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306344,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":452,"num_read_kb":23018,"num_write":1076,"num_write_kb":26757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.095989+0000","last_change":"2024-09-12T18:02:25.095989+0000","last_active":"2024-09-12T18:02:25.095989+0000","last_peered":"2024-09-12T18:02:25.095989+0000","last_clean":"2024-09-12T18:02:25.095989+0000","last_became_active":"2024-09-12T17:23:44.147372+0000","last_became_peered":"2024-09-12T17:23:44.147372+0000","last_unstale":"2024-09-12T18:02:25.095989+0000","last_undegraded":"2024-09-12T18:02:25.095989+0000","last_fullsized":"2024-09-12T18:02:25.095989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:25.095885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:25.095885+0000","last_clean_scrub_stamp":"2024-09-12T18:02:25.095885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:56.421750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"261'245","reported_seq":800,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.318443+0000","last_change":"2024-09-12T18:02:26.318443+0000","last_active":"2024-09-12T18:02:26.318443+0000","last_peered":"2024-09-12T18:02:26.318443+0000","last_clean":"2024-09-12T18:02:26.318443+0000","last_became_active":"2024-09-12T17:23:46.153024+0000","last_became_peered":"2024-09-12T17:23:46.153024+0000","last_unstale":"2024-09-12T18:02:26.318443+0000","last_undegraded":"2024-09-12T18:02:26.318443+0000","last_fullsized":"2024-09-12T18:02:26.318443+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'245","last_scrub_stamp":"2024-09-12T18:02:26.318345+0000","last_deep_scrub":"261'245","last_deep_scrub_stamp":"2024-09-12T18:02:26.318345+0000","last_clean_scrub_stamp":"2024-09-12T18:02:26.318345+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:28.556262+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46277,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":401,"num_read_kb":970,"num_write":334,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:27.100267+0000","last_change":"2024-09-12T18:02:27.100267+0000","last_active":"2024-09-12T18:02:27.100267+0000","last_peered":"2024-09-12T18:02:27.100267+0000","last_clean":"2024-09-12T18:02:27.100267+0000","last_became_active":"2024-09-12T17:23:48.171849+0000","last_became_peered":"2024-09-12T17:23:48.171849+0000","last_unstale":"2024-09-12T18:02:27.100267+0000","last_undegraded":"2024-09-12T18:02:27.100267+0000","last_fullsized":"2024-09-12T18:02:27.100267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:27.100180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:27.100180+0000","last_clean_scrub_stamp":"2024-09-12T18:02:27.100180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:51.370449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"261'143","reported_seq":1253,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:31.731419+0000","last_change":"2024-09-12T18:02:31.731419+0000","last_active":"2024-09-12T18:02:31.731419+0000","last_peered":"2024-09-12T18:02:31.731419+0000","last_clean":"2024-09-12T18:02:31.731419+0000","last_became_active":"2024-09-12T17:23:50.187084+0000","last_became_peered":"2024-09-12T17:23:50.187084+0000","last_unstale":"2024-09-12T18:02:31.731419+0000","last_undegraded":"2024-09-12T18:02:31.731419+0000","last_fullsized":"2024-09-12T18:02:31.731419+0000","mapping_epoch":33,"log_start":"261'100","ondisk_log_start":"261'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'143","last_scrub_stamp":"2024-09-12T18:02:31.731322+0000","last_deep_scrub":"261'143","last_deep_scrub_stamp":"2024-09-12T18:02:31.731322+0000","last_clean_scrub_stamp":"2024-09-12T18:02:31.731322+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:28.520354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":862,"num_read_kb":842,"num_write":338,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"261'421","reported_seq":1880,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.174737+0000","last_change":"2024-09-12T18:02:08.174681+0000","last_active":"2024-09-12T18:02:08.174737+0000","last_peered":"2024-09-12T18:02:08.174737+0000","last_clean":"2024-09-12T18:02:08.174737+0000","last_became_active":"2024-09-12T17:23:42.135975+0000","last_became_peered":"2024-09-12T17:23:42.135975+0000","last_unstale":"2024-09-12T18:02:08.174737+0000","last_undegraded":"2024-09-12T18:02:08.174737+0000","last_fullsized":"2024-09-12T18:02:08.174737+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'421","last_scrub_stamp":"2024-09-12T18:02:08.174594+0000","last_deep_scrub":"261'421","last_deep_scrub_stamp":"2024-09-12T18:02:08.174594+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.174594+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:26.404773+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2123,"num_read_kb":2006,"num_write":479,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"261'385","reported_seq":1035,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.733545+0000","last_change":"2024-09-12T18:01:57.733545+0000","last_active":"2024-09-12T18:01:57.733545+0000","last_peered":"2024-09-12T18:01:57.733545+0000","last_clean":"2024-09-12T18:01:57.733545+0000","last_became_active":"2024-09-12T17:23:40.713129+0000","last_became_peered":"2024-09-12T17:23:40.713129+0000","last_unstale":"2024-09-12T18:01:57.733545+0000","last_undegraded":"2024-09-12T18:01:57.733545+0000","last_fullsized":"2024-09-12T18:01:57.733545+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'385","last_scrub_stamp":"2024-09-12T18:01:57.733451+0000","last_deep_scrub":"261'385","last_deep_scrub_stamp":"2024-09-12T18:01:57.733451+0000","last_clean_scrub_stamp":"2024-09-12T18:01:57.733451+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:01.262019+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311685,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":537,"num_read_kb":14035,"num_write":1238,"num_write_kb":28273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"261'2","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.041838+0000","last_change":"2024-09-12T18:02:14.041733+0000","last_active":"2024-09-12T18:02:14.041838+0000","last_peered":"2024-09-12T18:02:14.041838+0000","last_clean":"2024-09-12T18:02:14.041838+0000","last_became_active":"2024-09-12T17:23:44.151126+0000","last_became_peered":"2024-09-12T17:23:44.151126+0000","last_unstale":"2024-09-12T18:02:14.041838+0000","last_undegraded":"2024-09-12T18:02:14.041838+0000","last_fullsized":"2024-09-12T18:02:14.041838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:02:14.041603+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:02:14.041603+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.041603+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:38.127428+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"261'288","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.128502+0000","last_change":"2024-09-12T18:02:24.128502+0000","last_active":"2024-09-12T18:02:24.128502+0000","last_peered":"2024-09-12T18:02:24.128502+0000","last_clean":"2024-09-12T18:02:24.128502+0000","last_became_active":"2024-09-12T17:23:46.153111+0000","last_became_peered":"2024-09-12T17:23:46.153111+0000","last_unstale":"2024-09-12T18:02:24.128502+0000","last_undegraded":"2024-09-12T18:02:24.128502+0000","last_fullsized":"2024-09-12T18:02:24.128502+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'288","last_scrub_stamp":"2024-09-12T18:02:24.128386+0000","last_deep_scrub":"261'288","last_deep_scrub_stamp":"2024-09-12T18:02:24.128386+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.128386+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:03.315024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":457,"num_read_kb":1001,"num_write":362,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:24.574650+0000","last_change":"2024-09-12T18:02:24.574650+0000","last_active":"2024-09-12T18:02:24.574650+0000","last_peered":"2024-09-12T18:02:24.574650+0000","last_clean":"2024-09-12T18:02:24.574650+0000","last_became_active":"2024-09-12T17:23:48.167070+0000","last_became_peered":"2024-09-12T17:23:48.167070+0000","last_unstale":"2024-09-12T18:02:24.574650+0000","last_undegraded":"2024-09-12T18:02:24.574650+0000","last_fullsized":"2024-09-12T18:02:24.574650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:02:24.574560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:02:24.574560+0000","last_clean_scrub_stamp":"2024-09-12T18:02:24.574560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:04.413448+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"261'86","reported_seq":574,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:30.023783+0000","last_change":"2024-09-12T18:02:30.023783+0000","last_active":"2024-09-12T18:02:30.023783+0000","last_peered":"2024-09-12T18:02:30.023783+0000","last_clean":"2024-09-12T18:02:30.023783+0000","last_became_active":"2024-09-12T17:23:50.179075+0000","last_became_peered":"2024-09-12T17:23:50.179075+0000","last_unstale":"2024-09-12T18:02:30.023783+0000","last_undegraded":"2024-09-12T18:02:30.023783+0000","last_fullsized":"2024-09-12T18:02:30.023783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'86","last_scrub_stamp":"2024-09-12T18:02:30.023681+0000","last_deep_scrub":"261'86","last_deep_scrub_stamp":"2024-09-12T18:02:30.023681+0000","last_clean_scrub_stamp":"2024-09-12T18:02:30.023681+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:03.359607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":88,"num_write":193,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"261'780","reported_seq":2273,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.014503+0000","last_change":"2024-09-12T18:02:11.014426+0000","last_active":"2024-09-12T18:02:11.014503+0000","last_peered":"2024-09-12T18:02:11.014503+0000","last_clean":"2024-09-12T18:02:11.014503+0000","last_became_active":"2024-09-12T17:23:42.137169+0000","last_became_peered":"2024-09-12T17:23:42.137169+0000","last_unstale":"2024-09-12T18:02:11.014503+0000","last_undegraded":"2024-09-12T18:02:11.014503+0000","last_fullsized":"2024-09-12T18:02:11.014503+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'780","last_scrub_stamp":"2024-09-12T18:02:11.014345+0000","last_deep_scrub":"261'780","last_deep_scrub_stamp":"2024-09-12T18:02:11.014345+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.014345+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:33.609949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3876,"num_read_kb":3488,"num_write":1033,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3280,"num_omap_keys":13,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"261'371","reported_seq":1041,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.139558+0000","last_change":"2024-09-12T18:01:58.139558+0000","last_active":"2024-09-12T18:01:58.139558+0000","last_peered":"2024-09-12T18:01:58.139558+0000","last_clean":"2024-09-12T18:01:58.139558+0000","last_became_active":"2024-09-12T17:23:40.713212+0000","last_became_peered":"2024-09-12T17:23:40.713212+0000","last_unstale":"2024-09-12T18:01:58.139558+0000","last_undegraded":"2024-09-12T18:01:58.139558+0000","last_fullsized":"2024-09-12T18:01:58.139558+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'371","last_scrub_stamp":"2024-09-12T18:01:58.139456+0000","last_deep_scrub":"261'371","last_deep_scrub_stamp":"2024-09-12T18:01:58.139456+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.139456+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:12.945343+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":603,"num_read_kb":38604,"num_write":1166,"num_write_kb":36037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"261'634","reported_seq":2105,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.191292+0000","last_change":"2024-09-12T18:02:13.191292+0000","last_active":"2024-09-12T18:02:13.191292+0000","last_peered":"2024-09-12T18:02:13.191292+0000","last_clean":"2024-09-12T18:02:13.191292+0000","last_became_active":"2024-09-12T17:24:17.227465+0000","last_became_peered":"2024-09-12T17:24:17.227465+0000","last_unstale":"2024-09-12T18:02:13.191292+0000","last_undegraded":"2024-09-12T18:02:13.191292+0000","last_fullsized":"2024-09-12T18:02:13.191292+0000","mapping_epoch":36,"log_start":"261'600","ondisk_log_start":"261'600","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'634","last_scrub_stamp":"2024-09-12T18:02:13.191170+0000","last_deep_scrub":"261'634","last_deep_scrub_stamp":"2024-09-12T18:02:13.191170+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.191170+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":600,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:52.485072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3072,"num_read_kb":2745,"num_write":824,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":266,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"261'324","reported_seq":1002,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.956188+0000","last_change":"2024-09-12T18:01:56.956126+0000","last_active":"2024-09-12T18:01:56.956188+0000","last_peered":"2024-09-12T18:01:56.956188+0000","last_clean":"2024-09-12T18:01:56.956188+0000","last_became_active":"2024-09-12T17:23:40.708064+0000","last_became_peered":"2024-09-12T17:23:40.708064+0000","last_unstale":"2024-09-12T18:01:56.956188+0000","last_undegraded":"2024-09-12T18:01:56.956188+0000","last_fullsized":"2024-09-12T18:01:56.956188+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'324","last_scrub_stamp":"2024-09-12T18:01:56.956049+0000","last_deep_scrub":"261'324","last_deep_scrub_stamp":"2024-09-12T18:01:56.956049+0000","last_clean_scrub_stamp":"2024-09-12T18:01:56.956049+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:22.585210+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8958905,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":78914,"num_write":996,"num_write_kb":50917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"261'846","reported_seq":2567,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.231756+0000","last_change":"2024-09-12T18:02:12.231701+0000","last_active":"2024-09-12T18:02:12.231756+0000","last_peered":"2024-09-12T18:02:12.231756+0000","last_clean":"2024-09-12T18:02:12.231756+0000","last_became_active":"2024-09-12T17:23:42.144919+0000","last_became_peered":"2024-09-12T17:23:42.144919+0000","last_unstale":"2024-09-12T18:02:12.231756+0000","last_undegraded":"2024-09-12T18:02:12.231756+0000","last_fullsized":"2024-09-12T18:02:12.231756+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'846","last_scrub_stamp":"2024-09-12T18:02:12.231607+0000","last_deep_scrub":"261'846","last_deep_scrub_stamp":"2024-09-12T18:02:12.231607+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.231607+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:17.452515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4312,"num_read_kb":3919,"num_write":1107,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1165,"num_omap_keys":5,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"261'352","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.251183+0000","last_change":"2024-09-12T18:02:04.251183+0000","last_active":"2024-09-12T18:02:04.251183+0000","last_peered":"2024-09-12T18:02:04.251183+0000","last_clean":"2024-09-12T18:02:04.251183+0000","last_became_active":"2024-09-12T17:23:40.715471+0000","last_became_peered":"2024-09-12T17:23:40.715471+0000","last_unstale":"2024-09-12T18:02:04.251183+0000","last_undegraded":"2024-09-12T18:02:04.251183+0000","last_fullsized":"2024-09-12T18:02:04.251183+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'352","last_scrub_stamp":"2024-09-12T18:02:04.251012+0000","last_deep_scrub":"261'352","last_deep_scrub_stamp":"2024-09-12T18:02:04.251012+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.251012+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:39.383192+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":470,"num_read_kb":37845,"num_write":1014,"num_write_kb":24242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"261'768","reported_seq":2218,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.004513+0000","last_change":"2024-09-12T18:02:09.004437+0000","last_active":"2024-09-12T18:02:09.004513+0000","last_peered":"2024-09-12T18:02:09.004513+0000","last_clean":"2024-09-12T18:02:09.004513+0000","last_became_active":"2024-09-12T17:23:42.142672+0000","last_became_peered":"2024-09-12T17:23:42.142672+0000","last_unstale":"2024-09-12T18:02:09.004513+0000","last_undegraded":"2024-09-12T18:02:09.004513+0000","last_fullsized":"2024-09-12T18:02:09.004513+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'768","last_scrub_stamp":"2024-09-12T18:02:09.004346+0000","last_deep_scrub":"261'768","last_deep_scrub_stamp":"2024-09-12T18:02:09.004346+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.004346+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:52.254410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3573,"num_read_kb":3224,"num_write":1004,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"261'287","reported_seq":915,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.707639+0000","last_change":"2024-09-12T18:02:01.707639+0000","last_active":"2024-09-12T18:02:01.707639+0000","last_peered":"2024-09-12T18:02:01.707639+0000","last_clean":"2024-09-12T18:02:01.707639+0000","last_became_active":"2024-09-12T17:23:40.702991+0000","last_became_peered":"2024-09-12T17:23:40.702991+0000","last_unstale":"2024-09-12T18:02:01.707639+0000","last_undegraded":"2024-09-12T18:02:01.707639+0000","last_fullsized":"2024-09-12T18:02:01.707639+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'287","last_scrub_stamp":"2024-09-12T18:02:01.707536+0000","last_deep_scrub":"261'287","last_deep_scrub_stamp":"2024-09-12T18:02:01.707536+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.707536+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:27.542681+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306617,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":429,"num_read_kb":57192,"num_write":879,"num_write_kb":43690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"261'414","reported_seq":1908,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.286617+0000","last_change":"2024-09-12T18:02:13.286617+0000","last_active":"2024-09-12T18:02:13.286617+0000","last_peered":"2024-09-12T18:02:13.286617+0000","last_clean":"2024-09-12T18:02:13.286617+0000","last_became_active":"2024-09-12T17:23:42.146394+0000","last_became_peered":"2024-09-12T17:23:42.146394+0000","last_unstale":"2024-09-12T18:02:13.286617+0000","last_undegraded":"2024-09-12T18:02:13.286617+0000","last_fullsized":"2024-09-12T18:02:13.286617+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'414","last_scrub_stamp":"2024-09-12T18:02:13.286513+0000","last_deep_scrub":"261'414","last_deep_scrub_stamp":"2024-09-12T18:02:13.286513+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.286513+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:01.693990+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2184,"num_read_kb":2068,"num_write":471,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"261'366","reported_seq":1116,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.241856+0000","last_change":"2024-09-12T18:02:02.241761+0000","last_active":"2024-09-12T18:02:02.241856+0000","last_peered":"2024-09-12T18:02:02.241856+0000","last_clean":"2024-09-12T18:02:02.241856+0000","last_became_active":"2024-09-12T17:23:40.712702+0000","last_became_peered":"2024-09-12T17:23:40.712702+0000","last_unstale":"2024-09-12T18:02:02.241856+0000","last_undegraded":"2024-09-12T18:02:02.241856+0000","last_fullsized":"2024-09-12T18:02:02.241856+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'366","last_scrub_stamp":"2024-09-12T18:02:02.241608+0000","last_deep_scrub":"261'366","last_deep_scrub_stamp":"2024-09-12T18:02:02.241608+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.241608+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:45.785430+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":720,"num_read_kb":69814,"num_write":1187,"num_write_kb":31106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"261'859","reported_seq":2451,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.138788+0000","last_change":"2024-09-12T18:02:10.138788+0000","last_active":"2024-09-12T18:02:10.138788+0000","last_peered":"2024-09-12T18:02:10.138788+0000","last_clean":"2024-09-12T18:02:10.138788+0000","last_became_active":"2024-09-12T17:23:42.141605+0000","last_became_peered":"2024-09-12T17:23:42.141605+0000","last_unstale":"2024-09-12T18:02:10.138788+0000","last_undegraded":"2024-09-12T18:02:10.138788+0000","last_fullsized":"2024-09-12T18:02:10.138788+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'859","last_scrub_stamp":"2024-09-12T18:02:10.138696+0000","last_deep_scrub":"261'859","last_deep_scrub_stamp":"2024-09-12T18:02:10.138696+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.138696+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:59.422337+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4009,"num_read_kb":3625,"num_write":1130,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"261'305","reported_seq":1040,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.036693+0000","last_change":"2024-09-12T18:01:59.036630+0000","last_active":"2024-09-12T18:01:59.036693+0000","last_peered":"2024-09-12T18:01:59.036693+0000","last_clean":"2024-09-12T18:01:59.036693+0000","last_became_active":"2024-09-12T17:23:40.715809+0000","last_became_peered":"2024-09-12T17:23:40.715809+0000","last_unstale":"2024-09-12T18:01:59.036693+0000","last_undegraded":"2024-09-12T18:01:59.036693+0000","last_fullsized":"2024-09-12T18:01:59.036693+0000","mapping_epoch":23,"log_start":"261'200","ondisk_log_start":"261'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'305","last_scrub_stamp":"2024-09-12T18:01:59.036534+0000","last_deep_scrub":"261'305","last_deep_scrub_stamp":"2024-09-12T18:01:59.036534+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.036534+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:38.706923+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":740,"num_read_kb":58572,"num_write":1029,"num_write_kb":36244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"261'1243","reported_seq":2742,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:14.244670+0000","last_change":"2024-09-12T18:02:14.244580+0000","last_active":"2024-09-12T18:02:14.244670+0000","last_peered":"2024-09-12T18:02:14.244670+0000","last_clean":"2024-09-12T18:02:14.244670+0000","last_became_active":"2024-09-12T17:23:42.155489+0000","last_became_peered":"2024-09-12T17:23:42.155489+0000","last_unstale":"2024-09-12T18:02:14.244670+0000","last_undegraded":"2024-09-12T18:02:14.244670+0000","last_fullsized":"2024-09-12T18:02:14.244670+0000","mapping_epoch":25,"log_start":"261'1200","ondisk_log_start":"261'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1243","last_scrub_stamp":"2024-09-12T18:02:14.244473+0000","last_deep_scrub":"261'1243","last_deep_scrub_stamp":"2024-09-12T18:02:14.244473+0000","last_clean_scrub_stamp":"2024-09-12T18:02:14.244473+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:45.679516+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5619,"num_read_kb":4947,"num_write":1761,"num_write_kb":787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":756,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"261'369","reported_seq":1005,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:59.102061+0000","last_change":"2024-09-12T18:01:59.101987+0000","last_active":"2024-09-12T18:01:59.102061+0000","last_peered":"2024-09-12T18:01:59.102061+0000","last_clean":"2024-09-12T18:01:59.102061+0000","last_became_active":"2024-09-12T17:23:40.704582+0000","last_became_peered":"2024-09-12T17:23:40.704582+0000","last_unstale":"2024-09-12T18:01:59.102061+0000","last_undegraded":"2024-09-12T18:01:59.102061+0000","last_fullsized":"2024-09-12T18:01:59.102061+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'369","last_scrub_stamp":"2024-09-12T18:01:59.101815+0000","last_deep_scrub":"261'369","last_deep_scrub_stamp":"2024-09-12T18:01:59.101815+0000","last_clean_scrub_stamp":"2024-09-12T18:01:59.101815+0000","objects_scrubbed":8,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:05.038276+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5258296,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":535,"num_read_kb":13831,"num_write":1155,"num_write_kb":46857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"261'755","reported_seq":2394,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.168066+0000","last_change":"2024-09-12T18:02:09.168066+0000","last_active":"2024-09-12T18:02:09.168066+0000","last_peered":"2024-09-12T18:02:09.168066+0000","last_clean":"2024-09-12T18:02:09.168066+0000","last_became_active":"2024-09-12T17:23:42.141542+0000","last_became_peered":"2024-09-12T17:23:42.141542+0000","last_unstale":"2024-09-12T18:02:09.168066+0000","last_undegraded":"2024-09-12T18:02:09.168066+0000","last_fullsized":"2024-09-12T18:02:09.168066+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'755","last_scrub_stamp":"2024-09-12T18:02:09.167983+0000","last_deep_scrub":"261'755","last_deep_scrub_stamp":"2024-09-12T18:02:09.167983+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.167983+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:32.809383+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3956,"num_read_kb":3681,"num_write":1110,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"261'391","reported_seq":1039,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.073856+0000","last_change":"2024-09-12T18:02:04.073856+0000","last_active":"2024-09-12T18:02:04.073856+0000","last_peered":"2024-09-12T18:02:04.073856+0000","last_clean":"2024-09-12T18:02:04.073856+0000","last_became_active":"2024-09-12T17:24:17.227082+0000","last_became_peered":"2024-09-12T17:24:17.227082+0000","last_unstale":"2024-09-12T18:02:04.073856+0000","last_undegraded":"2024-09-12T18:02:04.073856+0000","last_fullsized":"2024-09-12T18:02:04.073856+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'391","last_scrub_stamp":"2024-09-12T18:02:04.073725+0000","last_deep_scrub":"261'391","last_deep_scrub_stamp":"2024-09-12T18:02:04.073725+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.073725+0000","objects_scrubbed":7,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:53.651302+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":638,"num_read_kb":9829,"num_write":1453,"num_write_kb":18369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"261'767","reported_seq":2170,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:09.572908+0000","last_change":"2024-09-12T18:02:09.572908+0000","last_active":"2024-09-12T18:02:09.572908+0000","last_peered":"2024-09-12T18:02:09.572908+0000","last_clean":"2024-09-12T18:02:09.572908+0000","last_became_active":"2024-09-12T17:23:42.155052+0000","last_became_peered":"2024-09-12T17:23:42.155052+0000","last_unstale":"2024-09-12T18:02:09.572908+0000","last_undegraded":"2024-09-12T18:02:09.572908+0000","last_fullsized":"2024-09-12T18:02:09.572908+0000","mapping_epoch":25,"log_start":"261'700","ondisk_log_start":"261'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'767","last_scrub_stamp":"2024-09-12T18:02:09.572815+0000","last_deep_scrub":"261'767","last_deep_scrub_stamp":"2024-09-12T18:02:09.572815+0000","last_clean_scrub_stamp":"2024-09-12T18:02:09.572815+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:37.232559+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3588,"num_read_kb":3224,"num_write":1013,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"261'354","reported_seq":1128,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.257091+0000","last_change":"2024-09-12T18:02:05.257003+0000","last_active":"2024-09-12T18:02:05.257091+0000","last_peered":"2024-09-12T18:02:05.257091+0000","last_clean":"2024-09-12T18:02:05.257091+0000","last_became_active":"2024-09-12T17:23:40.707220+0000","last_became_peered":"2024-09-12T17:23:40.707220+0000","last_unstale":"2024-09-12T18:02:05.257091+0000","last_undegraded":"2024-09-12T18:02:05.257091+0000","last_fullsized":"2024-09-12T18:02:05.257091+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-12T18:02:05.256842+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-12T18:02:05.256842+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.256842+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:56.340735+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5635850,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":676,"num_read_kb":59084,"num_write":1125,"num_write_kb":27945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"261'440","reported_seq":1943,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.202872+0000","last_change":"2024-09-12T18:02:12.202872+0000","last_active":"2024-09-12T18:02:12.202872+0000","last_peered":"2024-09-12T18:02:12.202872+0000","last_clean":"2024-09-12T18:02:12.202872+0000","last_became_active":"2024-09-12T17:23:42.134859+0000","last_became_peered":"2024-09-12T17:23:42.134859+0000","last_unstale":"2024-09-12T18:02:12.202872+0000","last_undegraded":"2024-09-12T18:02:12.202872+0000","last_fullsized":"2024-09-12T18:02:12.202872+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'440","last_scrub_stamp":"2024-09-12T18:02:12.202782+0000","last_deep_scrub":"261'440","last_deep_scrub_stamp":"2024-09-12T18:02:12.202782+0000","last_clean_scrub_stamp":"2024-09-12T18:02:12.202782+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:10.816400+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2327,"num_read_kb":2188,"num_write":509,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"261'326","reported_seq":968,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.213894+0000","last_change":"2024-09-12T18:02:01.213894+0000","last_active":"2024-09-12T18:02:01.213894+0000","last_peered":"2024-09-12T18:02:01.213894+0000","last_clean":"2024-09-12T18:02:01.213894+0000","last_became_active":"2024-09-12T17:23:40.711042+0000","last_became_peered":"2024-09-12T17:23:40.711042+0000","last_unstale":"2024-09-12T18:02:01.213894+0000","last_undegraded":"2024-09-12T18:02:01.213894+0000","last_fullsized":"2024-09-12T18:02:01.213894+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'326","last_scrub_stamp":"2024-09-12T18:02:01.213797+0000","last_deep_scrub":"261'326","last_deep_scrub_stamp":"2024-09-12T18:02:01.213797+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.213797+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:05.849655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":531,"num_read_kb":6765,"num_write":1166,"num_write_kb":43884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"261'952","reported_seq":2519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:05.074553+0000","last_change":"2024-09-12T18:02:05.074553+0000","last_active":"2024-09-12T18:02:05.074553+0000","last_peered":"2024-09-12T18:02:05.074553+0000","last_clean":"2024-09-12T18:02:05.074553+0000","last_became_active":"2024-09-12T17:23:42.141379+0000","last_became_peered":"2024-09-12T17:23:42.141379+0000","last_unstale":"2024-09-12T18:02:05.074553+0000","last_undegraded":"2024-09-12T18:02:05.074553+0000","last_fullsized":"2024-09-12T18:02:05.074553+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'952","last_scrub_stamp":"2024-09-12T18:02:05.074457+0000","last_deep_scrub":"261'952","last_deep_scrub_stamp":"2024-09-12T18:02:05.074457+0000","last_clean_scrub_stamp":"2024-09-12T18:02:05.074457+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":900,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:43.879354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4545,"num_read_kb":4064,"num_write":1359,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"261'399","reported_seq":1034,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.207269+0000","last_change":"2024-09-12T18:02:06.207269+0000","last_active":"2024-09-12T18:02:06.207269+0000","last_peered":"2024-09-12T18:02:06.207269+0000","last_clean":"2024-09-12T18:02:06.207269+0000","last_became_active":"2024-09-12T17:23:40.702825+0000","last_became_peered":"2024-09-12T17:23:40.702825+0000","last_unstale":"2024-09-12T18:02:06.207269+0000","last_undegraded":"2024-09-12T18:02:06.207269+0000","last_fullsized":"2024-09-12T18:02:06.207269+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'399","last_scrub_stamp":"2024-09-12T18:02:06.207160+0000","last_deep_scrub":"261'399","last_deep_scrub_stamp":"2024-09-12T18:02:06.207160+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.207160+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:02.674525+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":642,"num_read_kb":543,"num_write":1172,"num_write_kb":8662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"261'400","reported_seq":1817,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.185744+0000","last_change":"2024-09-12T18:02:11.185744+0000","last_active":"2024-09-12T18:02:11.185744+0000","last_peered":"2024-09-12T18:02:11.185744+0000","last_clean":"2024-09-12T18:02:11.185744+0000","last_became_active":"2024-09-12T17:23:42.139735+0000","last_became_peered":"2024-09-12T17:23:42.139735+0000","last_unstale":"2024-09-12T18:02:11.185744+0000","last_undegraded":"2024-09-12T18:02:11.185744+0000","last_fullsized":"2024-09-12T18:02:11.185744+0000","mapping_epoch":25,"log_start":"261'300","ondisk_log_start":"261'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'400","last_scrub_stamp":"2024-09-12T18:02:11.185659+0000","last_deep_scrub":"261'400","last_deep_scrub_stamp":"2024-09-12T18:02:11.185659+0000","last_clean_scrub_stamp":"2024-09-12T18:02:11.185659+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:20.796201+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2037,"num_read_kb":1920,"num_write":445,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"261'345","reported_seq":1015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:02.727921+0000","last_change":"2024-09-12T18:02:02.727921+0000","last_active":"2024-09-12T18:02:02.727921+0000","last_peered":"2024-09-12T18:02:02.727921+0000","last_clean":"2024-09-12T18:02:02.727921+0000","last_became_active":"2024-09-12T17:23:40.709392+0000","last_became_peered":"2024-09-12T17:23:40.709392+0000","last_unstale":"2024-09-12T18:02:02.727921+0000","last_undegraded":"2024-09-12T18:02:02.727921+0000","last_fullsized":"2024-09-12T18:02:02.727921+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'345","last_scrub_stamp":"2024-09-12T18:02:02.727811+0000","last_deep_scrub":"261'345","last_deep_scrub_stamp":"2024-09-12T18:02:02.727811+0000","last_clean_scrub_stamp":"2024-09-12T18:02:02.727811+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:55.006739+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":64698,"num_write":1140,"num_write_kb":39876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"261'1136","reported_seq":2677,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:13.696246+0000","last_change":"2024-09-12T18:02:13.696246+0000","last_active":"2024-09-12T18:02:13.696246+0000","last_peered":"2024-09-12T18:02:13.696246+0000","last_clean":"2024-09-12T18:02:13.696246+0000","last_became_active":"2024-09-12T17:23:42.154127+0000","last_became_peered":"2024-09-12T17:23:42.154127+0000","last_unstale":"2024-09-12T18:02:13.696246+0000","last_undegraded":"2024-09-12T18:02:13.696246+0000","last_fullsized":"2024-09-12T18:02:13.696246+0000","mapping_epoch":25,"log_start":"261'1100","ondisk_log_start":"261'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1136","last_scrub_stamp":"2024-09-12T18:02:13.696125+0000","last_deep_scrub":"261'1136","last_deep_scrub_stamp":"2024-09-12T18:02:13.696125+0000","last_clean_scrub_stamp":"2024-09-12T18:02:13.696125+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":1100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:51.177021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5169,"num_read_kb":4583,"num_write":1562,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"261'352","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:04.136792+0000","last_change":"2024-09-12T18:02:04.136792+0000","last_active":"2024-09-12T18:02:04.136792+0000","last_peered":"2024-09-12T18:02:04.136792+0000","last_clean":"2024-09-12T18:02:04.136792+0000","last_became_active":"2024-09-12T17:23:40.714343+0000","last_became_peered":"2024-09-12T17:23:40.714343+0000","last_unstale":"2024-09-12T18:02:04.136792+0000","last_undegraded":"2024-09-12T18:02:04.136792+0000","last_fullsized":"2024-09-12T18:02:04.136792+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'352","last_scrub_stamp":"2024-09-12T18:02:04.136686+0000","last_deep_scrub":"261'352","last_deep_scrub_stamp":"2024-09-12T18:02:04.136686+0000","last_clean_scrub_stamp":"2024-09-12T18:02:04.136686+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:10.141603+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":610,"num_read_kb":27408,"num_write":1219,"num_write_kb":25060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"261'997","reported_seq":2626,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:08.621762+0000","last_change":"2024-09-12T18:02:08.621762+0000","last_active":"2024-09-12T18:02:08.621762+0000","last_peered":"2024-09-12T18:02:08.621762+0000","last_clean":"2024-09-12T18:02:08.621762+0000","last_became_active":"2024-09-12T17:23:42.146107+0000","last_became_peered":"2024-09-12T17:23:42.146107+0000","last_unstale":"2024-09-12T18:02:08.621762+0000","last_undegraded":"2024-09-12T18:02:08.621762+0000","last_fullsized":"2024-09-12T18:02:08.621762+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'997","last_scrub_stamp":"2024-09-12T18:02:08.621665+0000","last_deep_scrub":"261'997","last_deep_scrub_stamp":"2024-09-12T18:02:08.621665+0000","last_clean_scrub_stamp":"2024-09-12T18:02:08.621665+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.465820+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4676,"num_read_kb":4145,"num_write":1343,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"261'339","reported_seq":990,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:06.782950+0000","last_change":"2024-09-12T18:02:06.782877+0000","last_active":"2024-09-12T18:02:06.782950+0000","last_peered":"2024-09-12T18:02:06.782950+0000","last_clean":"2024-09-12T18:02:06.782950+0000","last_became_active":"2024-09-12T17:23:40.706951+0000","last_became_peered":"2024-09-12T17:23:40.706951+0000","last_unstale":"2024-09-12T18:02:06.782950+0000","last_undegraded":"2024-09-12T18:02:06.782950+0000","last_fullsized":"2024-09-12T18:02:06.782950+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'339","last_scrub_stamp":"2024-09-12T18:02:06.782780+0000","last_deep_scrub":"261'339","last_deep_scrub_stamp":"2024-09-12T18:02:06.782780+0000","last_clean_scrub_stamp":"2024-09-12T18:02:06.782780+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:28.262679+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918016,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":7215,"num_write":977,"num_write_kb":28374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"261'492","reported_seq":2005,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:18.279046+0000","last_change":"2024-09-12T18:02:18.279046+0000","last_active":"2024-09-12T18:02:18.279046+0000","last_peered":"2024-09-12T18:02:18.279046+0000","last_clean":"2024-09-12T18:02:18.279046+0000","last_became_active":"2024-09-12T17:23:42.152999+0000","last_became_peered":"2024-09-12T17:23:42.152999+0000","last_unstale":"2024-09-12T18:02:18.279046+0000","last_undegraded":"2024-09-12T18:02:18.279046+0000","last_fullsized":"2024-09-12T18:02:18.279046+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'492","last_scrub_stamp":"2024-09-12T18:02:18.278979+0000","last_deep_scrub":"261'492","last_deep_scrub_stamp":"2024-09-12T18:02:18.278979+0000","last_clean_scrub_stamp":"2024-09-12T18:02:18.278979+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:08.961069+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2525,"num_read_kb":2342,"num_write":624,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":739,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"261'358","reported_seq":983,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.987950+0000","last_change":"2024-09-12T18:01:58.987950+0000","last_active":"2024-09-12T18:01:58.987950+0000","last_peered":"2024-09-12T18:01:58.987950+0000","last_clean":"2024-09-12T18:01:58.987950+0000","last_became_active":"2024-09-12T17:23:40.704585+0000","last_became_peered":"2024-09-12T17:23:40.704585+0000","last_unstale":"2024-09-12T18:01:58.987950+0000","last_undegraded":"2024-09-12T18:01:58.987950+0000","last_fullsized":"2024-09-12T18:01:58.987950+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'358","last_scrub_stamp":"2024-09-12T18:01:58.987801+0000","last_deep_scrub":"261'358","last_deep_scrub_stamp":"2024-09-12T18:01:58.987801+0000","last_clean_scrub_stamp":"2024-09-12T18:01:58.987801+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:52.057616+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262306,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":466,"num_read_kb":452,"num_write":1104,"num_write_kb":34111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"261'445","reported_seq":2035,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.717603+0000","last_change":"2024-09-12T18:02:10.717537+0000","last_active":"2024-09-12T18:02:10.717603+0000","last_peered":"2024-09-12T18:02:10.717603+0000","last_clean":"2024-09-12T18:02:10.717603+0000","last_became_active":"2024-09-12T17:23:42.154367+0000","last_became_peered":"2024-09-12T17:23:42.154367+0000","last_unstale":"2024-09-12T18:02:10.717603+0000","last_undegraded":"2024-09-12T18:02:10.717603+0000","last_fullsized":"2024-09-12T18:02:10.717603+0000","mapping_epoch":25,"log_start":"261'400","ondisk_log_start":"261'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'445","last_scrub_stamp":"2024-09-12T18:02:10.717445+0000","last_deep_scrub":"261'445","last_deep_scrub_stamp":"2024-09-12T18:02:10.717445+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.717445+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:16.473683+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2387,"num_read_kb":2268,"num_write":501,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"261'401","reported_seq":1012,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:00.992526+0000","last_change":"2024-09-12T18:02:00.992526+0000","last_active":"2024-09-12T18:02:00.992526+0000","last_peered":"2024-09-12T18:02:00.992526+0000","last_clean":"2024-09-12T18:02:00.992526+0000","last_became_active":"2024-09-12T17:24:17.287516+0000","last_became_peered":"2024-09-12T17:24:17.287516+0000","last_unstale":"2024-09-12T18:02:00.992526+0000","last_undegraded":"2024-09-12T18:02:00.992526+0000","last_fullsized":"2024-09-12T18:02:00.992526+0000","mapping_epoch":36,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'401","last_scrub_stamp":"2024-09-12T18:02:00.992392+0000","last_deep_scrub":"261'401","last_deep_scrub_stamp":"2024-09-12T18:02:00.992392+0000","last_clean_scrub_stamp":"2024-09-12T18:02:00.992392+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:29.409874+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":2150,"num_write":1211,"num_write_kb":17735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"261'371","reported_seq":1063,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:07.201850+0000","last_change":"2024-09-12T18:02:07.201850+0000","last_active":"2024-09-12T18:02:07.201850+0000","last_peered":"2024-09-12T18:02:07.201850+0000","last_clean":"2024-09-12T18:02:07.201850+0000","last_became_active":"2024-09-12T17:23:40.705975+0000","last_became_peered":"2024-09-12T17:23:40.705975+0000","last_unstale":"2024-09-12T18:02:07.201850+0000","last_undegraded":"2024-09-12T18:02:07.201850+0000","last_fullsized":"2024-09-12T18:02:07.201850+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'371","last_scrub_stamp":"2024-09-12T18:02:07.201750+0000","last_deep_scrub":"261'371","last_deep_scrub_stamp":"2024-09-12T18:02:07.201750+0000","last_clean_scrub_stamp":"2024-09-12T18:02:07.201750+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:00.288303+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102345,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":38544,"num_write":1177,"num_write_kb":29966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"261'892","reported_seq":2663,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:10.600938+0000","last_change":"2024-09-12T18:02:10.600768+0000","last_active":"2024-09-12T18:02:10.600938+0000","last_peered":"2024-09-12T18:02:10.600938+0000","last_clean":"2024-09-12T18:02:10.600938+0000","last_became_active":"2024-09-12T17:23:42.155431+0000","last_became_peered":"2024-09-12T17:23:42.155431+0000","last_unstale":"2024-09-12T18:02:10.600938+0000","last_undegraded":"2024-09-12T18:02:10.600938+0000","last_fullsized":"2024-09-12T18:02:10.600938+0000","mapping_epoch":25,"log_start":"261'800","ondisk_log_start":"261'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'892","last_scrub_stamp":"2024-09-12T18:02:10.600663+0000","last_deep_scrub":"261'892","last_deep_scrub_stamp":"2024-09-12T18:02:10.600663+0000","last_clean_scrub_stamp":"2024-09-12T18:02:10.600663+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:56.558490+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4337,"num_read_kb":3945,"num_write":1177,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"261'325","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:01.090071+0000","last_change":"2024-09-12T18:02:01.090071+0000","last_active":"2024-09-12T18:02:01.090071+0000","last_peered":"2024-09-12T18:02:01.090071+0000","last_clean":"2024-09-12T18:02:01.090071+0000","last_became_active":"2024-09-12T17:23:40.713729+0000","last_became_peered":"2024-09-12T17:23:40.713729+0000","last_unstale":"2024-09-12T18:02:01.090071+0000","last_undegraded":"2024-09-12T18:02:01.090071+0000","last_fullsized":"2024-09-12T18:02:01.090071+0000","mapping_epoch":23,"log_start":"261'300","ondisk_log_start":"261'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'325","last_scrub_stamp":"2024-09-12T18:02:01.089958+0000","last_deep_scrub":"261'325","last_deep_scrub_stamp":"2024-09-12T18:02:01.089958+0000","last_clean_scrub_stamp":"2024-09-12T18:02:01.089958+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:09.856184+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6690697,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":468,"num_read_kb":88924,"num_write":1000,"num_write_kb":31954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"261'921","reported_seq":2516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T18:02:15.238043+0000","last_change":"2024-09-12T18:02:15.237983+0000","last_active":"2024-09-12T18:02:15.238043+0000","last_peered":"2024-09-12T18:02:15.238043+0000","last_clean":"2024-09-12T18:02:15.238043+0000","last_became_active":"2024-09-12T17:23:42.151035+0000","last_became_peered":"2024-09-12T17:23:42.151035+0000","last_unstale":"2024-09-12T18:02:15.238043+0000","last_undegraded":"2024-09-12T18:02:15.238043+0000","last_fullsized":"2024-09-12T18:02:15.238043+0000","mapping_epoch":25,"log_start":"261'900","ondisk_log_start":"261'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'921","last_scrub_stamp":"2024-09-12T18:02:15.237888+0000","last_deep_scrub":"261'921","last_deep_scrub_stamp":"2024-09-12T18:02:15.237888+0000","last_clean_scrub_stamp":"2024-09-12T18:02:15.237888+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":900,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:05.656909+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4231,"num_read_kb":3788,"num_write":1202,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6418,"num_read_kb":4664,"num_write":2041,"num_write_kb":938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1872,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1113,"ondisk_log_size":1113,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16069,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16200,"num_read_kb":15888,"num_write":16774,"num_write_kb":4891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2861,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1741,"ondisk_log_size":1741,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":693,"ondisk_log_size":693,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1568925,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":16943,"num_read_kb":36201,"num_write":14185,"num_write_kb":11429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685458,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2166,"ondisk_log_size":2166,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2424,"num_read_kb":2890,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212759,"num_read_kb":194564,"num_write":55413,"num_write_kb":18856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43832,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3805,"ondisk_log_size":3805,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":82077927,"num_objects":360,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":360,"num_whiteouts":0,"num_read":36160,"num_read_kb":2097994,"num_write":72463,"num_write_kb":2176823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":165306368,"data_stored":164155854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3742,"ondisk_log_size":3742,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":196116,"num_write":158,"num_write_kb":127401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":185777,"num_write":158,"num_write_kb":127401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509921,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313532,"kb_used_data":39404,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94058308,"statfs":{"total":96636764160,"available":96315707392,"internally_reserved":0,"allocated":40349696,"data_stored":38689531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509921,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263556,"kb_used_data":11636,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94108284,"statfs":{"total":96636764160,"available":96366882816,"internally_reserved":0,"allocated":11915264,"data_stored":10326315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509922,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":154452,"kb_used_data":28932,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94217388,"statfs":{"total":96636764160,"available":96478605312,"internally_reserved":0,"allocated":29626368,"data_stored":27895637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509922,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108528,"kb_used_data":23200,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94263312,"statfs":{"total":96636764160,"available":96525631488,"internally_reserved":0,"allocated":23756800,"data_stored":22112034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509921,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157492,"kb_used_data":13924,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94214348,"statfs":{"total":96636764160,"available":96475492352,"internally_reserved":0,"allocated":14258176,"data_stored":12683013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509923,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":277444,"kb_used_data":21428,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":94094396,"statfs":{"total":96636764160,"available":96352661504,"internally_reserved":0,"allocated":21942272,"data_stored":20239121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262142407},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542627,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300444,"kb_used_data":30540,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":94071396,"statfs":{"total":96636764160,"available":96329109504,"internally_reserved":0,"allocated":31272960,"data_stored":29588476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276363719},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542628,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111216,"kb_used_data":21792,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94260624,"statfs":{"total":96636764160,"available":96522878976,"internally_reserved":0,"allocated":22315008,"data_stored":20755157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17715200,"data_stored":17530392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10657792,"data_stored":10563849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18726912,"data_stored":18636740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27639808,"data_stored":27468954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20172800,"data_stored":19992871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25960448,"data_stored":25776028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8314880,"data_stored":8207763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36118528,"data_stored":35979257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":3790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:03:19.558 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T18:03:19.895 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T18:03:19.896 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T18:03:19.896 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T18:03:19.896 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:03:19.950 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T18:03:19.950 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T18:03:19.950 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:03:19.995 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T18:03:19.995 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T18:03:19.996 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:03:20.031 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T18:03:20.031 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T18:03:20.031 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:03:20.109 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T18:03:20.110 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T18:03:20.110 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:03:20.157 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T18:03:20.157 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T18:03:20.157 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:03:20.212 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T18:03:20.213 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T18:03:20.213 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:03:20.260 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T18:03:20.260 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T18:03:20.260 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:03:20.308 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T18:03:20.309 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T18:03:20.309 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T18:03:20.309 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:03:20.334 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T18:03:20.334 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T18:03:20.334 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:03:20.363 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T18:03:20.363 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T18:03:20.363 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T18:03:20.363 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:03:20.388 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T18:03:20.389 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T18:03:20.389 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:03:20.441 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T18:03:20.441 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T18:03:20.441 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:03:20.454 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T18:03:20.454 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T18:03:20.454 DEBUG:teuthology.orchestra.run.smithi044:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T18:03:20.523 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-12T18:03:20.524 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T18:03:20.754 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-12T18:03:20.754 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T18:03:20.855 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-12T18:03:20.855 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T18:03:20.925 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-12T18:03:20.925 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T18:03:21.025 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T18:03:21.025 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T18:03:21.220 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T18:03:21.221 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T18:03:21.324 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T18:03:21.324 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T18:03:21.404 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T18:03:21.404 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T18:03:21.486 INFO:tasks.ceph:Archiving mon data... 2024-09-12T18:03:21.487 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902725/data/mon.a.tgz 2024-09-12T18:03:21.487 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-09-12T18:03:21.518 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.IgBrjRskrA 2024-09-12T18:03:21.518 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.IgBrjRskrA 2024-09-12T18:03:21.728 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.IgBrjRskrA 2024-09-12T18:03:21.841 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.IgBrjRskrA is 481KB 2024-09-12T18:03:21.939 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.IgBrjRskrA 2024-09-12T18:03:21.968 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902725/data/mon.c.tgz 2024-09-12T18:03:21.969 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-09-12T18:03:22.037 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.VKO8o1WcvH 2024-09-12T18:03:22.038 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.VKO8o1WcvH 2024-09-12T18:03:22.231 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.VKO8o1WcvH 2024-09-12T18:03:22.343 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.VKO8o1WcvH is 494KB 2024-09-12T18:03:22.440 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.VKO8o1WcvH 2024-09-12T18:03:22.469 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902725/data/mon.b.tgz 2024-09-12T18:03:22.469 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-09-12T18:03:22.502 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.TffCPEZxrP 2024-09-12T18:03:22.502 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.TffCPEZxrP 2024-09-12T18:03:22.709 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.TffCPEZxrP 2024-09-12T18:03:22.820 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.TffCPEZxrP is 494KB 2024-09-12T18:03:22.918 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.TffCPEZxrP 2024-09-12T18:03:22.946 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T18:03:22.946 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:03:22.949 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:03:23.060 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:03:23.093 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:03:23.094 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T18:03:23.095 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902725/remote/smithi044/crash 2024-09-12T18:03:23.096 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:03:23.143 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902725/remote/smithi181/crash 2024-09-12T18:03:23.144 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:03:23.181 INFO:tasks.ceph:Compressing logs... 2024-09-12T18:03:23.181 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:03:23.187 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:03:23.224 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T18:03:23.226 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158602.log 2024-09-12T18:03:23.226 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106765.log 2024-09-12T18:03:23.226 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.158602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154479.log 2024-09-12T18:03:23.226 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.106765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61373.log 2024-09-12T18:03:23.226 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.158602.log.gz 2024-09-12T18:03:23.226 INFO:teuthology.orchestra.run.smithi044.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.106765.log.gz 2024-09-12T18:03:23.226 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.154479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185581.log 2024-09-12T18:03:23.226 INFO:teuthology.orchestra.run.smithi044.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.154479.log.gz 2024-09-12T18:03:23.226 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.61373.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.122081.log 2024-09-12T18:03:23.276 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32924.log 2024-09-12T18:03:23.276 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T18:03:23.276 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.32924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32693.log 2024-09-12T18:03:23.276 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32924.log.gz 2024-09-12T18:03:23.276 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T18:03:23.276 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.32693.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T18:03:23.276 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32693.log.gz 2024-09-12T18:03:23.277 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32605.log 2024-09-12T18:03:23.277 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5/var/log/ceph/ceph.audit.log: --verbose -- /var/log/ceph/ceph-client.admin.32836.log 2024-09-12T18:03:23.277 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.32605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32605.log.gz 2024-09-12T18:03:23.277 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32792.log 2024-09-12T18:03:23.277 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T18:03:23.277 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.32836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32836.log.gz 2024-09-12T18:03:23.277 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.32792.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.32792.log.gz /var/log/ceph/ceph-client.admin.32649.log 2024-09-12T18:03:23.277 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-12T18:03:23.277 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T18:03:23.277 INFO:teuthology.orchestra.run.smithi181.stderr: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:03:23.277 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.32649.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T18:03:23.278 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32649.log.gz 2024-09-12T18:03:23.278 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T18:03:23.278 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32880.log 2024-09-12T18:03:23.278 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T18:03:23.278 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.32880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32880.log.gzgzip 2024-09-12T18:03:23.278 INFO:teuthology.orchestra.run.smithi181.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32748.log 2024-09-12T18:03:23.278 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.32748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32748.log.gz 2024-09-12T18:03:23.278 INFO:teuthology.orchestra.run.smithi181.stderr: 87.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:03:23.349 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.185581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38346.log 2024-09-12T18:03:23.349 INFO:teuthology.orchestra.run.smithi044.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.61373.log.gz 2024-09-12T18:03:23.349 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122081.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.185581.log.gz 2024-09-12T18:03:23.349 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39065.log 2024-09-12T18:03:23.349 INFO:teuthology.orchestra.run.smithi044.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.122081.log.gz 2024-09-12T18:03:23.349 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146822.log 2024-09-12T18:03:23.349 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38346.log.gz 2024-09-12T18:03:23.349 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155068.log 2024-09-12T18:03:23.349 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39065.log.gz 2024-09-12T18:03:23.350 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.146822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165740.log 2024-09-12T18:03:23.350 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.146822.log.gz 2024-09-12T18:03:23.350 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.155068.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46716.log 2024-09-12T18:03:23.350 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.165740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158013.log 2024-09-12T18:03:23.350 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165740.log.gz 2024-09-12T18:03:23.350 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140342.log 2024-09-12T18:03:23.350 INFO:teuthology.orchestra.run.smithi044.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.46716.log.gz 2024-09-12T18:03:23.350 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.158013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64522.log 2024-09-12T18:03:23.350 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.158013.log.gz 2024-09-12T18:03:23.350 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60736.log 2024-09-12T18:03:23.350 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.140342.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.155068.log.gz 2024-09-12T18:03:23.350 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.64522.log: gzip 81.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.140342.log.gz 2024-09-12T18:03:23.351 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49401.log 2024-09-12T18:03:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.60736.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.64522.log.gz 2024-09-12T18:03:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126793.log 2024-09-12T18:03:23.351 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60736.log.gz 2024-09-12T18:03:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191902.log 2024-09-12T18:03:23.351 INFO:teuthology.orchestra.run.smithi044.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.49401.log.gz 2024-09-12T18:03:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131506.log 2024-09-12T18:03:23.351 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126793.log.gz/var/log/ceph/ceph-client.admin.191902.log: 2024-09-12T18:03:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177662.log 2024-09-12T18:03:23.351 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191902.log.gz 2024-09-12T18:03:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.131506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87916.log 2024-09-12T18:03:23.352 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.131506.log.gz 2024-09-12T18:03:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.0.177662.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.173692.log 2024-09-12T18:03:23.352 INFO:teuthology.orchestra.run.smithi044.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.177662.log.gz 2024-09-12T18:03:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65730.log 2024-09-12T18:03:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.87916.log: /var/log/ceph/ceph-client.admin.173692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133273.log 2024-09-12T18:03:23.352 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87916.log.gz 2024-09-12T18:03:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.65730.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.173692.log.gz 2024-09-12T18:03:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130917.log 2024-09-12T18:03:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.133273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98519.log 2024-09-12T18:03:23.352 INFO:teuthology.orchestra.run.smithi044.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.65730.log.gz 2024-09-12T18:03:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.130917.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.133273.log.gz 2024-09-12T18:03:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50038.log 2024-09-12T18:03:23.353 INFO:teuthology.orchestra.run.smithi044.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.130917.log.gz 2024-09-12T18:03:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39429.log 2024-09-12T18:03:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.98519.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.98519.log.gz 2024-09-12T18:03:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160369.log 2024-09-12T18:03:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50038.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.50038.log.gz 2024-09-12T18:03:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100286.log 2024-09-12T18:03:23.353 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39429.log.gz 2024-09-12T18:03:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.160369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86149.log 2024-09-12T18:03:23.353 INFO:teuthology.orchestra.run.smithi044.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.160369.log.gz 2024-09-12T18:03:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192455.log 2024-09-12T18:03:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.100286.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.100286.log.gz 2024-09-12T18:03:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.86149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107943.log 2024-09-12T18:03:23.354 INFO:teuthology.orchestra.run.smithi044.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.86149.log.gz 2024-09-12T18:03:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.192455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192455.log.gz 2024-09-12T18:03:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54798.log 2024-09-12T18:03:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.107943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38097.log 2024-09-12T18:03:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46112.log 2024-09-12T18:03:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54798.log: /var/log/ceph/ceph-client.admin.38097.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.54798.log.gz 2024-09-12T18:03:23.354 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38097.log.gz 2024-09-12T18:03:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42671.log 2024-09-12T18:03:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181318.log 2024-09-12T18:03:23.354 INFO:teuthology.orchestra.run.smithi044.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.46112.log.gz 2024-09-12T18:03:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.42671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180709.log 2024-09-12T18:03:23.354 INFO:teuthology.orchestra.run.smithi044.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.107943.log.gz 2024-09-12T18:03:23.354 INFO:teuthology.orchestra.run.smithi044.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.42671.log.gz 2024-09-12T18:03:23.355 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.181318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55387.log 2024-09-12T18:03:23.355 INFO:teuthology.orchestra.run.smithi044.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.181318.log.gz 2024-09-12T18:03:23.355 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.180709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161569.log 2024-09-12T18:03:23.355 INFO:teuthology.orchestra.run.smithi044.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.180709.log.gz 2024-09-12T18:03:23.355 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.55387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39519.log 2024-09-12T18:03:23.355 INFO:teuthology.orchestra.run.smithi044.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.55387.log.gz 2024-09-12T18:03:23.355 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.161569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191441.log 2024-09-12T18:03:23.355 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161569.log.gz 2024-09-12T18:03:23.355 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188572.log 2024-09-12T18:03:23.355 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39519.log.gz 2024-09-12T18:03:23.355 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.191441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61962.log 2024-09-12T18:03:23.355 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191441.log.gz 2024-09-12T18:03:23.355 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.188572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87327.log 2024-09-12T18:03:23.356 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188572.log.gz 2024-09-12T18:03:23.356 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.61962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180100.log 2024-09-12T18:03:23.356 INFO:teuthology.orchestra.run.smithi044.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.61962.log.gz 2024-09-12T18:03:23.356 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.87327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37857.log 2024-09-12T18:03:23.356 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.87327.log.gz 2024-09-12T18:03:23.356 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.180100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97930.log 2024-09-12T18:03:23.356 INFO:teuthology.orchestra.run.smithi044.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.180100.log.gz 2024-09-12T18:03:23.356 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37857.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T18:03:23.356 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37857.log.gz 2024-09-12T18:03:23.356 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63629.log 2024-09-12T18:03:23.356 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97930.log.gz 2024-09-12T18:03:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159780.log 2024-09-12T18:03:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.63629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116191.log 2024-09-12T18:03:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.159780.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T18:03:23.357 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.159780.log.gz 2024-09-12T18:03:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132684.log 2024-09-12T18:03:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116191.log.gz 2024-09-12T18:03:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38352.log 2024-09-12T18:03:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112066.log 2024-09-12T18:03:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.132684.log: /var/log/ceph/ceph-client.admin.38352.log: 81.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.186190.log 2024-09-12T18:03:23.357 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38352.log.gz 2024-09-12T18:03:23.357 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.132684.log.gz 2024-09-12T18:03:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38051.log 2024-09-12T18:03:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112066.log: /var/log/ceph/ceph-client.0.186190.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.112066.log.gz 2024-09-12T18:03:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192270.log 2024-09-12T18:03:23.358 INFO:teuthology.orchestra.run.smithi044.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.186190.log.gz 2024-09-12T18:03:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38935.log 2024-09-12T18:03:23.358 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38051.log.gz 2024-09-12T18:03:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63136.log 2024-09-12T18:03:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.192270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192270.log.gz 2024-09-12T18:03:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177053.log 2024-09-12T18:03:23.358 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38935.log.gz 2024-09-12T18:03:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.63136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178882.log 2024-09-12T18:03:23.358 INFO:teuthology.orchestra.run.smithi044.stderr: 58.8% -- replaced with /var/log/ceph/ceph-client.admin.63136.log.gz 2024-09-12T18:03:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116780.log 2024-09-12T18:03:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.177053.log: /var/log/ceph/ceph-client.0.178882.log: 83.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173084.log 2024-09-12T18:03:23.359 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.0.177053.log.gz 2024-09-12T18:03:23.359 INFO:teuthology.orchestra.run.smithi044.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.178882.log.gz 2024-09-12T18:03:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.116780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63481.log 2024-09-12T18:03:23.359 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.116780.log.gz 2024-09-12T18:03:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88505.log 2024-09-12T18:03:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.173084.log: /var/log/ceph/ceph-client.admin.63481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33195.log 2024-09-12T18:03:23.359 INFO:teuthology.orchestra.run.smithi044.stderr: 90.0% 91.7% -- replaced with /var/log/ceph/ceph-client.admin.173084.log.gz 2024-09-12T18:03:23.359 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63481.log.gz 2024-09-12T18:03:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.88505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39565.log 2024-09-12T18:03:23.359 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.88505.log.gz 2024-09-12T18:03:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103231.log 2024-09-12T18:03:23.359 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33195.log.gz 2024-09-12T18:03:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38357.log 2024-09-12T18:03:23.360 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39565.log.gz 2024-09-12T18:03:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.103231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39385.log 2024-09-12T18:03:23.360 INFO:teuthology.orchestra.run.smithi044.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.103231.log.gz 2024-09-12T18:03:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38357.log.gz 2024-09-12T18:03:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125026.log 2024-09-12T18:03:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72589.log 2024-09-12T18:03:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39385.log.gz 2024-09-12T18:03:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.125026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44480.log 2024-09-12T18:03:23.360 INFO:teuthology.orchestra.run.smithi044.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.125026.log.gz 2024-09-12T18:03:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.72589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59558.log 2024-09-12T18:03:23.360 INFO:teuthology.orchestra.run.smithi044.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.72589.log.gz 2024-09-12T18:03:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.44480.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.44480.log.gz 2024-09-12T18:03:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187960.log 2024-09-12T18:03:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.59558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120903.log 2024-09-12T18:03:23.361 INFO:teuthology.orchestra.run.smithi044.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.59558.log.gz 2024-09-12T18:03:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.187960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166966.log 2024-09-12T18:03:23.361 INFO:teuthology.orchestra.run.smithi044.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.187960.log.gz 2024-09-12T18:03:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.120903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135040.log 2024-09-12T18:03:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.166966.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120903.log.gz 2024-09-12T18:03:23.361 INFO:teuthology.orchestra.run.smithi044.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.166966.log.gz 2024-09-12T18:03:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163925.log 2024-09-12T18:03:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.135040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171112.log 2024-09-12T18:03:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.163925.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163925.log.gz 2024-09-12T18:03:23.361 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.99108.log 2024-09-12T18:03:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.171112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76060.log 2024-09-12T18:03:23.362 INFO:teuthology.orchestra.run.smithi044.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.171112.log.gz 2024-09-12T18:03:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.99108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113245.log 2024-09-12T18:03:23.362 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.99108.log.gz 86.1% -- replaced with /var/log/ceph/ceph-client.admin.135040.log.gz 2024-09-12T18:03:23.362 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T18:03:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89094.log 2024-09-12T18:03:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.76060.log: gzip/var/log/ceph/ceph-client.admin.113245.log: -5 81.9% -- replaced with /var/log/ceph/ceph-client.admin.76060.log.gz 2024-09-12T18:03:23.362 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.189305.log 2024-09-12T18:03:23.362 INFO:teuthology.orchestra.run.smithi044.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.113245.log.gz 2024-09-12T18:03:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.89094.log: gzip -5 81.7% -- replaced with /var/log/ceph/ceph-client.admin.89094.log.gz 2024-09-12T18:03:23.362 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57154.log 2024-09-12T18:03:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.189305.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160980.log 2024-09-12T18:03:23.362 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.189305.log.gz 2024-09-12T18:03:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33105.log 2024-09-12T18:03:23.363 INFO:teuthology.orchestra.run.smithi044.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.57154.log.gz 2024-09-12T18:03:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.160980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58356.log 2024-09-12T18:03:23.363 INFO:teuthology.orchestra.run.smithi044.stderr: 86.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71925.log 2024-09-12T18:03:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33105.log: -- replaced with /var/log/ceph/ceph-client.admin.160980.log.gz 2024-09-12T18:03:23.363 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33105.log.gz 2024-09-12T18:03:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191994.log 2024-09-12T18:03:23.363 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58356.log.gz 2024-09-12T18:03:23.363 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63629.log.gz 2024-09-12T18:03:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.71925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93218.log 2024-09-12T18:03:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.191994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39022.log 2024-09-12T18:03:23.363 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191994.log.gz 2024-09-12T18:03:23.364 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39588.log 2024-09-12T18:03:23.364 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39022.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165764.log 2024-09-12T18:03:23.364 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39022.log.gz 2024-09-12T18:03:23.364 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93218.log.gz 2024-09-12T18:03:23.364 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.39588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96163.log 2024-09-12T18:03:23.364 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.165764.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165764.log.gz 2024-09-12T18:03:23.364 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.134451.log 2024-09-12T18:03:23.364 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40205.log 95.8% 2024-09-12T18:03:23.364 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.0.39588.log.gz 2024-09-12T18:03:23.364 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96163.log.gz 2024-09-12T18:03:23.364 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.134451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156246.log 2024-09-12T18:03:23.364 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.134451.log.gz 2024-09-12T18:03:23.364 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.40205.log: gzip -5 --verbose -- 43.5% -- replaced with /var/log/ceph/ceph-client.0.40205.log.gz 2024-09-12T18:03:23.365 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.0.179491.log 2024-09-12T18:03:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.156246.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.71925.log.gz 2024-09-12T18:03:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.190024.log 2024-09-12T18:03:23.365 INFO:teuthology.orchestra.run.smithi044.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.156246.log.gz 2024-09-12T18:03:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.179491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191395.log 2024-09-12T18:03:23.365 INFO:teuthology.orchestra.run.smithi044.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.179491.log.gz 2024-09-12T18:03:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.190024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67589.log 2024-09-12T18:03:23.365 INFO:teuthology.orchestra.run.smithi044.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.190024.log.gz 2024-09-12T18:03:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.191395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39475.log 2024-09-12T18:03:23.365 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191395.log.gz 2024-09-12T18:03:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.67589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39339.log 2024-09-12T18:03:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39475.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39475.log.gz 2024-09-12T18:03:23.365 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.166377.log 2024-09-12T18:03:23.366 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39339.log.gz 2024-09-12T18:03:23.366 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126204.log 2024-09-12T18:03:23.366 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.166377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42062.log 2024-09-12T18:03:23.366 INFO:teuthology.orchestra.run.smithi044.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.166377.log.gz 2024-09-12T18:03:23.366 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.126204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188620.log 81.5% -- replaced with /var/log/ceph/ceph-client.admin.126204.log.gz 2024-09-12T18:03:23.366 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T18:03:23.366 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.42062.log: gzip -5 80.8% -- replaced with /var/log/ceph/ceph-client.0.42062.log.gz 2024-09-12T18:03:23.366 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.0.190717.log 2024-09-12T18:03:23.366 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.188620.log: gzip -5 --verbose -- 85.3% /var/log/ceph/ceph-client.admin.133862.log 2024-09-12T18:03:23.366 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.188620.log.gz 2024-09-12T18:03:23.366 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.190717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192086.log 2024-09-12T18:03:23.366 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.133862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38344.log 2024-09-12T18:03:23.366 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8%/var/log/ceph/ceph-client.admin.192086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105587.log 2024-09-12T18:03:23.367 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.133862.log.gz 2024-09-12T18:03:23.367 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192086.log.gz 2024-09-12T18:03:23.367 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117958.log 2024-09-12T18:03:23.367 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38344.log.gz 92.9% -- replaced with /var/log/ceph/ceph-client.admin.67589.log.gz 2024-09-12T18:03:23.367 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.105587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113835.log 2024-09-12T18:03:23.367 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T18:03:23.367 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.105587.log.gz 2024-09-12T18:03:23.367 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.117958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191764.log 2024-09-12T18:03:23.367 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0%/var/log/ceph/ceph-client.admin.113835.log: -- replaced with /var/log/ceph/ceph-client.admin.117958.log.gz 2024-09-12T18:03:23.367 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188550.log 2024-09-12T18:03:23.367 INFO:teuthology.orchestra.run.smithi044.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.113835.log.gz 2024-09-12T18:03:23.367 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.191764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191764.log.gz 2024-09-12T18:03:23.367 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110888.log 2024-09-12T18:03:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191580.log 2024-09-12T18:03:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.188550.log: 25.0% -- replaced with /var/log/ceph/ceph-client.admin.188550.log.gz 2024-09-12T18:03:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90861.log 2024-09-12T18:03:23.368 INFO:teuthology.orchestra.run.smithi044.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.110888.log.gz 2024-09-12T18:03:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.191580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191580.log.gz 2024-09-12T18:03:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99697.log 2024-09-12T18:03:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191349.log 2024-09-12T18:03:23.368 INFO:teuthology.orchestra.run.smithi044.stderr: 81.4%/var/log/ceph/ceph-client.admin.99697.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T18:03:23.368 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90861.log.gz 2024-09-12T18:03:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.191349.log: -- /var/log/ceph/ceph-client.admin.122670.log 2024-09-12T18:03:23.368 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191349.log.gz 2024-09-12T18:03:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76821.log 2024-09-12T18:03:23.369 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.122670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142698.log 2024-09-12T18:03:23.369 INFO:teuthology.orchestra.run.smithi044.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.99697.log.gz 2024-09-12T18:03:23.369 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.76821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41417.log 2024-09-12T18:03:23.369 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.142698.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.76821.log.gz 2024-09-12T18:03:23.369 INFO:teuthology.orchestra.run.smithi044.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.142698.log.gz 2024-09-12T18:03:23.369 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 87.1% -- replaced with /var/log/ceph/ceph-client.admin.122670.log.gz 2024-09-12T18:03:23.369 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.191626.log 2024-09-12T18:03:23.369 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.41417.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.41417.log.gz 2024-09-12T18:03:23.369 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102053.log 2024-09-12T18:03:23.369 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5/var/log/ceph/ceph-client.admin.191626.log: 94.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:03:23.369 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191626.log.gz 2024-09-12T18:03:23.369 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.114424.log 2024-09-12T18:03:23.370 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102053.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.102053.log.gz 2024-09-12T18:03:23.370 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63697.log 2024-09-12T18:03:23.370 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183145.log 2024-09-12T18:03:23.370 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.114424.log: /var/log/ceph/ceph-client.admin.63697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92628.log 2024-09-12T18:03:23.370 INFO:teuthology.orchestra.run.smithi044.stderr: 57.3% -- replaced with /var/log/ceph/ceph-client.admin.63697.log.gz 2024-09-12T18:03:23.370 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70067.log/var/log/ceph/ceph-client.0.183145.log: 2024-09-12T18:03:23.370 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.92628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120314.log 2024-09-12T18:03:23.370 INFO:teuthology.orchestra.run.smithi044.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.0.183145.log.gz 2024-09-12T18:03:23.370 INFO:teuthology.orchestra.run.smithi044.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.92628.log.gz 2024-09-12T18:03:23.370 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174300.log 2024-09-12T18:03:23.370 INFO:teuthology.orchestra.run.smithi044.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.114424.log.gz 2024-09-12T18:03:23.370 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.70067.log: /var/log/ceph/ceph-client.admin.120314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149178.log 2024-09-12T18:03:23.370 INFO:teuthology.orchestra.run.smithi044.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.120314.log.gz 2024-09-12T18:03:23.370 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.174300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165151.log 2024-09-12T18:03:23.371 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.149178.log: gzip 92.2% -- replaced with /var/log/ceph/ceph-client.admin.174300.log.gz -5 2024-09-12T18:03:23.371 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.75469.log 2024-09-12T18:03:23.371 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.149178.log.gz/var/log/ceph/ceph-client.admin.165151.log: 2024-09-12T18:03:23.371 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69447.log 2024-09-12T18:03:23.371 INFO:teuthology.orchestra.run.smithi044.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.165151.log.gz 2024-09-12T18:03:23.371 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.75469.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.75469.log.gz 2024-09-12T18:03:23.371 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145055.log 2024-09-12T18:03:23.371 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.69447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103820.log 2024-09-12T18:03:23.371 INFO:teuthology.orchestra.run.smithi044.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.70067.log.gz 2024-09-12T18:03:23.371 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.145055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125615.log 2024-09-12T18:03:23.371 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9%/var/log/ceph/ceph-client.admin.103820.log: -- replaced with /var/log/ceph/ceph-client.admin.145055.log.gz 2024-09-12T18:03:23.371 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191810.log 2024-09-12T18:03:23.371 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.103820.log.gz 2024-09-12T18:03:23.371 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.125615.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.125615.log.gz 2024-09-12T18:03:23.372 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95574.log 2024-09-12T18:03:23.372 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.191810.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191810.log.gz 2024-09-12T18:03:23.372 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.79670.log 2024-09-12T18:03:23.372 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.95574.log: gzip -5 81.6% --verbose -- /var/log/ceph/ceph-client.admin.129149.log 2024-09-12T18:03:23.372 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95574.log.gz 2024-09-12T18:03:23.372 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.79670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136808.log 2024-09-12T18:03:23.372 INFO:teuthology.orchestra.run.smithi044.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.79670.log.gz 2024-09-12T18:03:23.372 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50014.log 2024-09-12T18:03:23.372 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.129149.log: /var/log/ceph/ceph-client.admin.136808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43274.log 2024-09-12T18:03:23.372 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.129149.log.gz 2024-09-12T18:03:23.372 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136808.log.gz/var/log/ceph/ceph-client.admin.50014.log: 2024-09-12T18:03:23.372 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50014.log.gz 2024-09-12T18:03:23.372 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143876.log 2024-09-12T18:03:23.373 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.43274.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43274.log.gz 2024-09-12T18:03:23.373 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38621.log 2024-09-12T18:03:23.373 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.143876.log: gzip -5 --verbose -- 81.8% -- replaced with /var/log/ceph/ceph-client.admin.143876.log.gz 2024-09-12T18:03:23.373 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.121492.log 2024-09-12T18:03:23.373 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38621.log.gz 2024-09-12T18:03:23.373 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63254.log 2024-09-12T18:03:23.373 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.121492.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 81.6% -- replaced with /var/log/ceph/ceph-client.admin.121492.log.gz 2024-09-12T18:03:23.373 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T18:03:23.373 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.63254.log: 53.4% -- replaced with /var/log/ceph/ceph-client.admin.63254.log.gz 2024-09-12T18:03:23.373 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64408.log 2024-09-12T18:03:23.373 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189210.log 2024-09-12T18:03:23.373 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.64408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78805.log 2024-09-12T18:03:23.373 INFO:teuthology.orchestra.run.smithi044.stderr: 21.6% -- replaced with /var/log/ceph/ceph-client.admin.64408.log.gz 2024-09-12T18:03:23.373 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.189210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123259.log 2024-09-12T18:03:23.374 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.78805.log: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.189210.log.gz 2024-09-12T18:03:23.374 INFO:teuthology.orchestra.run.smithi044.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.78805.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191718.log 2024-09-12T18:03:23.374 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T18:03:23.374 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138575.log 2024-09-12T18:03:23.374 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.123259.log: /var/log/ceph/ceph-client.admin.191718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191718.log.gz 2024-09-12T18:03:23.374 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.123259.log.gz 2024-09-12T18:03:23.374 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38629.log 2024-09-12T18:03:23.374 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.138575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86738.log 2024-09-12T18:03:23.374 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.138575.log.gz 2024-09-12T18:03:23.374 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38629.log.gz 2024-09-12T18:03:23.374 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108532.log 2024-09-12T18:03:23.374 INFO:teuthology.orchestra.run.smithi044.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz/var/log/ceph/ceph-client.admin.86738.log: 2024-09-12T18:03:23.374 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153890.log 2024-09-12T18:03:23.375 INFO:teuthology.orchestra.run.smithi044.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.86738.log.gz 2024-09-12T18:03:23.375 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.108532.log: -- /var/log/ceph/ceph-client.admin.146233.log 2024-09-12T18:03:23.375 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.153890.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.108532.log.gz 2024-09-12T18:03:23.375 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62860.log 2024-09-12T18:03:23.375 INFO:teuthology.orchestra.run.smithi044.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.153890.log.gz 2024-09-12T18:03:23.375 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.146233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37946.log 2024-09-12T18:03:23.375 INFO:teuthology.orchestra.run.smithi044.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.146233.log.gz 2024-09-12T18:03:23.375 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124437.log 2024-09-12T18:03:23.375 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.62860.log: /var/log/ceph/ceph-client.admin.37946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148000.log 2024-09-12T18:03:23.375 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37946.log.gz 59.2% -- replaced with /var/log/ceph/ceph-client.admin.62860.log.gz 2024-09-12T18:03:23.375 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T18:03:23.375 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.124437.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.124437.log.gz 2024-09-12T18:03:23.375 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110299.log 2024-09-12T18:03:23.375 INFO:teuthology.orchestra.run.smithi044.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.0.190717.log.gz 2024-09-12T18:03:23.376 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.148000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39293.log 2024-09-12T18:03:23.376 INFO:teuthology.orchestra.run.smithi044.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.148000.log.gz 2024-09-12T18:03:23.376 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.110299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117369.log 2024-09-12T18:03:23.376 INFO:teuthology.orchestra.run.smithi044.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.110299.log.gz 2024-09-12T18:03:23.376 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174908.log 2024-09-12T18:03:23.376 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39293.log.gz 2024-09-12T18:03:23.376 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137397.log 2024-09-12T18:03:23.376 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.117369.log: /var/log/ceph/ceph-client.admin.174908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188596.log 2024-09-12T18:03:23.376 INFO:teuthology.orchestra.run.smithi044.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.117369.log.gz/var/log/ceph/ceph-client.admin.137397.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T18:03:23.376 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T18:03:23.376 INFO:teuthology.orchestra.run.smithi044.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.174908.log.gz 2024-09-12T18:03:23.376 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.137397.log.gz 2024-09-12T18:03:23.376 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.188596.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188596.log.gz 2024-09-12T18:03:23.377 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.97341.log 2024-09-12T18:03:23.377 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163336.log 2024-09-12T18:03:23.377 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.97341.log: gzip -5 --verbose 81.8% -- /var/log/ceph/ceph-client.admin.80848.log 2024-09-12T18:03:23.377 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97341.log.gz 2024-09-12T18:03:23.377 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.163336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90272.log 2024-09-12T18:03:23.377 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37921.log 2024-09-12T18:03:23.377 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.163336.log.gz 2024-09-12T18:03:23.377 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.80848.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.80848.log.gz 2024-09-12T18:03:23.377 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.90272.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.90272.log.gz 2024-09-12T18:03:23.377 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104409.log 2024-09-12T18:03:23.377 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106176.log 2024-09-12T18:03:23.377 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37921.log.gz 2024-09-12T18:03:23.377 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.104409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147411.log 2024-09-12T18:03:23.377 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49990.log 2024-09-12T18:03:23.378 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104409.log.gz/var/log/ceph/ceph-client.admin.106176.log: 2024-09-12T18:03:23.378 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.147411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192132.log 2024-09-12T18:03:23.378 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.106176.log.gz 2024-09-12T18:03:23.378 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49990.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53620.log 2024-09-12T18:03:23.378 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49990.log.gz 2024-09-12T18:03:23.378 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.192132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192132.log.gz 2024-09-12T18:03:23.378 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176414.log 2024-09-12T18:03:23.378 INFO:teuthology.orchestra.run.smithi044.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.147411.log.gz 2024-09-12T18:03:23.378 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66970.log 2024-09-12T18:03:23.378 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53620.log: /var/log/ceph/ceph-client.admin.176414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153301.log 2024-09-12T18:03:23.378 INFO:teuthology.orchestra.run.smithi044.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.53620.log.gz 2024-09-12T18:03:23.378 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66970.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.176414.log.gz 2024-09-12T18:03:23.378 INFO:teuthology.orchestra.run.smithi044.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.69447.log.gz 2024-09-12T18:03:23.378 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164562.log 2024-09-12T18:03:23.379 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.153301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119725.log 2024-09-12T18:03:23.379 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.164562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38724.log 2024-09-12T18:03:23.379 INFO:teuthology.orchestra.run.smithi044.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.164562.log.gz 2024-09-12T18:03:23.379 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.119725.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.119725.log.gz 2024-09-12T18:03:23.379 INFO:teuthology.orchestra.run.smithi044.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.153301.log.gz 2024-09-12T18:03:23.379 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82026.log 2024-09-12T18:03:23.379 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83204.log 2024-09-12T18:03:23.379 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38724.log.gz 2024-09-12T18:03:23.379 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.82026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70687.log 2024-09-12T18:03:23.379 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191948.log 2024-09-12T18:03:23.379 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.82026.log.gz 2024-09-12T18:03:23.379 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.83204.log: gzip/var/log/ceph/ceph-client.admin.70687.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.150356.log 2024-09-12T18:03:23.379 INFO:teuthology.orchestra.run.smithi044.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.66970.log.gz 2024-09-12T18:03:23.380 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.191948.log: 0.0% 81.7% -- replaced with /var/log/ceph/ceph-client.admin.83204.log.gz 2024-09-12T18:03:23.380 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -- replaced with /var/log/ceph/ceph-client.admin.191948.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.111477.log 2024-09-12T18:03:23.380 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T18:03:23.380 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191487.log 2024-09-12T18:03:23.380 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.150356.log: /var/log/ceph/ceph-client.admin.111477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144465.log 2024-09-12T18:03:23.380 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% 81.7% -- replaced with /var/log/ceph/ceph-client.admin.150356.log.gz 2024-09-12T18:03:23.380 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70687.log.gz/var/log/ceph/ceph-client.admin.191487.log: 2024-09-12T18:03:23.380 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111477.log.gz 2024-09-12T18:03:23.380 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.191487.log.gz 2024-09-12T18:03:23.380 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175806.log 2024-09-12T18:03:23.380 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.144465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58332.log 2024-09-12T18:03:23.380 INFO:teuthology.orchestra.run.smithi044.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.144465.log.gz 2024-09-12T18:03:23.380 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.175806.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52418.log 2024-09-12T18:03:23.381 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58332.log.gz 2024-09-12T18:03:23.381 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142109.log 2024-09-12T18:03:23.381 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.52418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52418.log.gz 2024-09-12T18:03:23.381 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T18:03:23.381 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.142109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151534.log 2024-09-12T18:03:23.381 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.142109.log.gz 2024-09-12T18:03:23.381 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mon.a.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.175806.log.gz 2024-09-12T18:03:23.381 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38005.log 2024-09-12T18:03:23.381 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.151534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52442.log 2024-09-12T18:03:23.381 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38005.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100875.log 2024-09-12T18:03:23.381 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38005.log.gz 2024-09-12T18:03:23.381 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60784.log 2024-09-12T18:03:23.381 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.52442.log: /var/log/ceph/ceph-client.admin.100875.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.151534.log.gz 2024-09-12T18:03:23.381 INFO:teuthology.orchestra.run.smithi044.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.52442.log.gz 2024-09-12T18:03:23.382 INFO:teuthology.orchestra.run.smithi044.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.100875.log.gz 2024-09-12T18:03:23.382 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168963.log 2024-09-12T18:03:23.382 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.60784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149767.log 2024-09-12T18:03:23.382 INFO:teuthology.orchestra.run.smithi044.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.60784.log.gz 2024-09-12T18:03:23.382 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.168963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94985.log 2024-09-12T18:03:23.382 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162747.log 2024-09-12T18:03:23.382 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.149767.log: /var/log/ceph/ceph-client.admin.94985.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.149767.log.gz 2024-09-12T18:03:23.382 INFO:teuthology.orchestra.run.smithi044.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.94985.log.gz 2024-09-12T18:03:23.382 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.168963.log.gz 2024-09-12T18:03:23.382 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115013.log 2024-09-12T18:03:23.382 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.162747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39092.log 2024-09-12T18:03:23.382 INFO:teuthology.orchestra.run.smithi044.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.162747.log.gz 2024-09-12T18:03:23.382 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.115013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163973.log 2024-09-12T18:03:23.382 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.115013.log.gz 2024-09-12T18:03:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5/var/log/ceph/ceph-client.admin.39092.log: --verbose -- /var/log/ceph/ceph-client.0.77430.log 2024-09-12T18:03:23.383 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39092.log.gz 2024-09-12T18:03:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.163973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84971.log 2024-09-12T18:03:23.383 INFO:teuthology.orchestra.run.smithi044.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.163973.log.gz 2024-09-12T18:03:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192316.log 2024-09-12T18:03:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.77430.log: /var/log/ceph/ceph-client.admin.84971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71306.log 2024-09-12T18:03:23.383 INFO:teuthology.orchestra.run.smithi044.stderr: 84.1%/var/log/ceph/ceph-client.admin.192316.log: -- replaced with /var/log/ceph/ceph-client.0.77430.log.gz 2024-09-12T18:03:23.383 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192316.log.gz 89.9% -- replaced with /var/log/ceph/ceph-client.admin.84971.log.gz 2024-09-12T18:03:23.383 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T18:03:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83793.log 2024-09-12T18:03:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.71306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63563.log 2024-09-12T18:03:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.83793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152123.log 2024-09-12T18:03:23.383 INFO:teuthology.orchestra.run.smithi044.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.83793.log.gz 2024-09-12T18:03:23.384 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.63563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63563.log.gz 2024-09-12T18:03:23.384 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71306.log.gz 2024-09-12T18:03:23.384 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73698.log 2024-09-12T18:03:23.384 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.152123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63761.log 2024-09-12T18:03:23.384 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.152123.log.gz 2024-09-12T18:03:23.384 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.73698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189329.log 2024-09-12T18:03:23.384 INFO:teuthology.orchestra.run.smithi044.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.73698.log.gz 2024-09-12T18:03:23.384 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.63761.log: -- /var/log/ceph/ceph-client.admin.191672.log 2024-09-12T18:03:23.384 INFO:teuthology.orchestra.run.smithi044.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.63761.log.gz 2024-09-12T18:03:23.384 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T18:03:23.384 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.189329.log: /var/log/ceph/ceph-client.admin.191672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40808.log 2024-09-12T18:03:23.384 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191672.log.gz 2024-09-12T18:03:23.384 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.2.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.189329.log.gz 2024-09-12T18:03:23.384 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104998.log 2024-09-12T18:03:23.385 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172328.log 2024-09-12T18:03:23.385 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.40808.log: /var/log/ceph/ceph-client.admin.104998.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.40808.log.gz 2024-09-12T18:03:23.385 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.104998.log.gz 2024-09-12T18:03:23.385 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129738.log 2024-09-12T18:03:23.385 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.172328.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.172328.log.gz 2024-09-12T18:03:23.385 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143287.log 2024-09-12T18:03:23.385 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53031.log 2024-09-12T18:03:23.385 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.129738.log: /var/log/ceph/ceph-client.admin.143287.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.129738.log.gz 2024-09-12T18:03:23.385 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78140.log 2024-09-12T18:03:23.385 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53031.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.53031.log.gz 2024-09-12T18:03:23.385 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48812.log 2024-09-12T18:03:23.385 INFO:teuthology.orchestra.run.smithi044.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.143287.log.gz 2024-09-12T18:03:23.385 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.78140.log: 50.5% -- replaced with /var/log/ceph/ceph-client.admin.78140.log.gz 2024-09-12T18:03:23.385 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192409.log 2024-09-12T18:03:23.386 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181927.log 2024-09-12T18:03:23.386 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48812.log: /var/log/ceph/ceph-client.admin.192409.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.48812.log.gz 2024-09-12T18:03:23.386 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192409.log.gz 2024-09-12T18:03:23.386 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145644.log 2024-09-12T18:03:23.386 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168313.log 2024-09-12T18:03:23.386 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.181927.log: /var/log/ceph/ceph-client.admin.145644.log: 80.0% -- replaced with /var/log/ceph/ceph-client.0.181927.log.gz 2024-09-12T18:03:23.386 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.145644.log.gz 2024-09-12T18:03:23.386 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150945.log 2024-09-12T18:03:23.386 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.168313.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.168313.log.gz 2024-09-12T18:03:23.388 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37764.log 2024-09-12T18:03:23.388 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38356.log 2024-09-12T18:03:23.388 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.150945.log: /var/log/ceph/ceph-client.admin.37764.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.150945.log.gz 2024-09-12T18:03:23.388 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37764.log.gz 2024-09-12T18:03:23.388 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139164.log 2024-09-12T18:03:23.388 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T18:03:23.388 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38356.log.gz 2024-09-12T18:03:23.389 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.139164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78196.log 2024-09-12T18:03:23.389 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.139164.log.gz 2024-09-12T18:03:23.443 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162158.log 2024-09-12T18:03:23.443 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.78196.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.78196.log.gz 2024-09-12T18:03:23.443 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58969.log 2024-09-12T18:03:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.162158.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.162158.log.gz 2024-09-12T18:03:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156835.log 2024-09-12T18:03:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58969.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.58969.log.gz 2024-09-12T18:03:23.444 INFO:teuthology.orchestra.run.smithi044.stderr: 94.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T18:03:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130328.log 2024-09-12T18:03:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.156835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169571.log 2024-09-12T18:03:23.444 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.156835.log.gz 2024-09-12T18:03:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.130328.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130328.log.gz 2024-09-12T18:03:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170504.log 2024-09-12T18:03:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89683.log 2024-09-12T18:03:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.169571.log: /var/log/ceph/ceph-client.admin.170504.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.169571.log.gz 2024-09-12T18:03:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58380.log 2024-09-12T18:03:23.445 INFO:teuthology.orchestra.run.smithi044.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T18:03:23.445 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.89683.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.170504.log.gz 2024-09-12T18:03:23.445 INFO:teuthology.orchestra.run.smithi044.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.89683.log.gz 2024-09-12T18:03:23.445 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127382.log 2024-09-12T18:03:23.445 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127971.log 84.8% -- replaced with /var/log/ceph/ceph-client.admin.58380.log.gz 2024-09-12T18:03:23.445 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T18:03:23.445 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.127382.log: gzip -5 --verbose -- 81.7% -- replaced with /var/log/ceph/ceph-client.admin.127382.log.gz 2024-09-12T18:03:23.445 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph.log 2024-09-12T18:03:23.445 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.127971.log: gzip -5 --verbose 81.7% -- replaced with /var/log/ceph/ceph-client.admin.127971.log.gz 2024-09-12T18:03:23.445 INFO:teuthology.orchestra.run.smithi044.stderr: -- /var/log/ceph/ceph-client.admin.102642.log 2024-09-12T18:03:23.445 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191856.log 2024-09-12T18:03:23.445 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.102642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51216.log 2024-09-12T18:03:23.446 INFO:teuthology.orchestra.run.smithi044.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.102642.log.gz 2024-09-12T18:03:23.446 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.191856.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38721.log 2024-09-12T18:03:23.446 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.191856.log.gz 2024-09-12T18:03:23.446 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192040.log 2024-09-12T18:03:23.446 INFO:teuthology.orchestra.run.smithi044.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.51216.log.gz 2024-09-12T18:03:23.446 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60760.log 2024-09-12T18:03:23.446 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.192040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38721.log.gz 2024-09-12T18:03:23.446 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192040.log.gz 2024-09-12T18:03:23.446 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60147.log 2024-09-12T18:03:23.446 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84382.log 2024-09-12T18:03:23.446 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.60760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60760.log.gz 2024-09-12T18:03:23.446 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.60147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128560.log 2024-09-12T18:03:23.446 INFO:teuthology.orchestra.run.smithi044.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.60147.log.gz 2024-09-12T18:03:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.84382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81437.log 2024-09-12T18:03:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.128560.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.84382.log.gz 2024-09-12T18:03:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148589.log 2024-09-12T18:03:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.81437.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.81437.log.gz 2024-09-12T18:03:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137986.log 2024-09-12T18:03:23.447 INFO:teuthology.orchestra.run.smithi044.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.128560.log.gz 2024-09-12T18:03:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.148589.log: 85.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68208.log 2024-09-12T18:03:23.447 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.148589.log.gz 2024-09-12T18:03:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.137986.log: 81.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50627.log 2024-09-12T18:03:23.447 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.137986.log.gz 2024-09-12T18:03:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136218.log 2024-09-12T18:03:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68208.log: /var/log/ceph/ceph-client.admin.50627.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.50627.log.gz 2024-09-12T18:03:23.447 INFO:teuthology.orchestra.run.smithi044.stderr: 93.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:03:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107354.log 2024-09-12T18:03:23.448 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.136218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38628.log 2024-09-12T18:03:23.448 INFO:teuthology.orchestra.run.smithi044.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.136218.log.gz/var/log/ceph/ceph-client.admin.107354.log: 2024-09-12T18:03:23.448 INFO:teuthology.orchestra.run.smithi044.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.107354.log.gz 2024-09-12T18:03:23.448 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119136.log 2024-09-12T18:03:23.448 INFO:teuthology.orchestra.run.smithi044.stderr: 89.7%/var/log/ceph/ceph-client.admin.38628.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.68208.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.38725.log 2024-09-12T18:03:23.448 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T18:03:23.448 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38628.log.gz 2024-09-12T18:03:23.448 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5/var/log/ceph/ceph-client.admin.119136.log: --verbose -- /var/log/ceph/ceph-client.admin.38350.log 2024-09-12T18:03:23.448 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38725.log: 89.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38725.log.gz 2024-09-12T18:03:23.448 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66349.log 2024-09-12T18:03:23.448 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.119136.log.gz 2024-09-12T18:03:23.448 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55976.log 2024-09-12T18:03:23.449 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38350.log.gz 2024-09-12T18:03:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115602.log 2024-09-12T18:03:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39093.log 2024-09-12T18:03:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.55976.log: /var/log/ceph/ceph-client.admin.115602.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.55976.log.gz 2024-09-12T18:03:23.449 INFO:teuthology.orchestra.run.smithi044.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.115602.log.gz 2024-09-12T18:03:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32767.log 2024-09-12T18:03:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43877.log 2024-09-12T18:03:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39093.log.gz 2024-09-12T18:03:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32767.log: 28.8% -- replaced with /var/log/ceph/ceph-client.admin.32767.log.gzgzip 2024-09-12T18:03:23.449 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.178271.log 2024-09-12T18:03:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96752.log 2024-09-12T18:03:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.43877.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43877.log.gz 2024-09-12T18:03:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.178271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74879.log 2024-09-12T18:03:23.450 INFO:teuthology.orchestra.run.smithi044.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.178271.log.gz 2024-09-12T18:03:23.450 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74287.log 2024-09-12T18:03:23.450 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.96752.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.96752.log.gz 2024-09-12T18:03:23.450 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.74879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101464.log 2024-09-12T18:03:23.450 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.74287.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.74879.log.gz 2024-09-12T18:03:23.450 INFO:teuthology.orchestra.run.smithi044.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.74287.log.gz 2024-09-12T18:03:23.450 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82615.log 2024-09-12T18:03:23.450 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.101464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64342.log 2024-09-12T18:03:23.450 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101464.log.gz/var/log/ceph/ceph-client.admin.82615.log: 2024-09-12T18:03:23.450 INFO:teuthology.orchestra.run.smithi044.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.82615.log.gz 2024-09-12T18:03:23.450 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- 93.2% -- replaced with /var/log/ceph/ceph-client.admin.66349.log.gz 2024-09-12T18:03:23.450 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.92039.log 2024-09-12T18:03:23.450 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.64342.log: gzip 20.3% -- replaced with /var/log/ceph/ceph-client.admin.64342.log.gz 2024-09-12T18:03:23.450 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.132095.log 2024-09-12T18:03:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.92039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183754.log 2024-09-12T18:03:23.451 INFO:teuthology.orchestra.run.smithi044.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.92039.log.gz 2024-09-12T18:03:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39029.log 2024-09-12T18:03:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.132095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80259.log 2024-09-12T18:03:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.183754.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.132095.log.gz 84.1% -- replaced with /var/log/ceph/ceph-client.0.183754.log.gz 2024-09-12T18:03:23.451 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T18:03:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39029.log.gz 2024-09-12T18:03:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192499.log 2024-09-12T18:03:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.80259.log: gzip -5 --verbose 81.7% -- replaced with /var/log/ceph/ceph-client.admin.80259.log.gz 2024-09-12T18:03:23.451 INFO:teuthology.orchestra.run.smithi044.stderr: -- /var/log/ceph/ceph-client.admin.152712.log 2024-09-12T18:03:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.192499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192499.log.gz 2024-09-12T18:03:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68827.log 2024-09-12T18:03:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.152712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187371.log 2024-09-12T18:03:23.452 INFO:teuthology.orchestra.run.smithi044.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.152712.log.gz 2024-09-12T18:03:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171720.log 2024-09-12T18:03:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.187371.log: -- /var/log/ceph/ceph-client.admin.159191.log 2024-09-12T18:03:23.452 INFO:teuthology.orchestra.run.smithi044.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.187371.log.gz 2024-09-12T18:03:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.171720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56565.log 2024-09-12T18:03:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.159191.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68827.log.gz 92.3% -- replaced with /var/log/ceph/ceph-client.admin.171720.log.gz 2024-09-12T18:03:23.452 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T18:03:23.452 INFO:teuthology.orchestra.run.smithi044.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.159191.log.gz 2024-09-12T18:03:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189280.log 2024-09-12T18:03:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.56565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135629.log 2024-09-12T18:03:23.452 INFO:teuthology.orchestra.run.smithi044.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.56565.log.gz 2024-09-12T18:03:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.189280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189280.log.gz 2024-09-12T18:03:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76651.log 2024-09-12T18:03:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T18:03:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.135629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189232.log 2024-09-12T18:03:23.453 INFO:teuthology.orchestra.run.smithi044.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.135629.log.gz 2024-09-12T18:03:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.76651.log: /var/log/ceph/rgw.ceph.client.0.log: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.76651.log.gz 2024-09-12T18:03:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184363.log 2024-09-12T18:03:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.189232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189232.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192224.log 2024-09-12T18:03:23.453 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T18:03:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26674.log 2024-09-12T18:03:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.192224.log: /var/log/ceph/ceph-client.0.184363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192224.log.gz 2024-09-12T18:03:23.453 INFO:teuthology.orchestra.run.smithi044.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.184363.log.gz 2024-09-12T18:03:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38355.log 2024-09-12T18:03:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.tmp-client.admin.26674.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26674.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160959.log 2024-09-12T18:03:23.453 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T18:03:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165788.log 2024-09-12T18:03:23.454 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.160959.log: /var/log/ceph/ceph-client.admin.38355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38355.log.gz 2024-09-12T18:03:23.454 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160959.log.gz 2024-09-12T18:03:23.454 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91450.log 2024-09-12T18:03:23.454 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.165788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123848.log 2024-09-12T18:03:23.454 INFO:teuthology.orchestra.run.smithi044.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.165788.log.gz 2024-09-12T18:03:23.454 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.91450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163949.log 2024-09-12T18:03:23.454 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.123848.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.123848.log.gz 2024-09-12T18:03:23.454 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65111.log 2024-09-12T18:03:23.454 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.163949.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.91450.log.gz 2024-09-12T18:03:23.454 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163949.log.gz 2024-09-12T18:03:23.454 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38143.log 2024-09-12T18:03:23.454 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.65111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192178.log 2024-09-12T18:03:23.454 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38143.log.gz 2024-09-12T18:03:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112656.log 2024-09-12T18:03:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.192178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192178.log.gz 2024-09-12T18:03:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118547.log 2024-09-12T18:03:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.112656.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112656.log.gz 2024-09-12T18:03:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38354.log 2024-09-12T18:03:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.118547.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.118547.log.gz 2024-09-12T18:03:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93807.log 2024-09-12T18:03:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38354.log.gz 2024-09-12T18:03:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38722.log 2024-09-12T18:03:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.93807.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.93807.log.gz 2024-09-12T18:03:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94396.log 2024-09-12T18:03:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38722.log.gz 2024-09-12T18:03:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155657.log 2024-09-12T18:03:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.94396.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.94396.log.gz 2024-09-12T18:03:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51805.log 2024-09-12T18:03:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.155657.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.155657.log.gz 2024-09-12T18:03:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192362.log 2024-09-12T18:03:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51805.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.51805.log.gz 2024-09-12T18:03:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47634.log 2024-09-12T18:03:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.192362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192362.log.gz 2024-09-12T18:03:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139753.log 2024-09-12T18:03:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47634.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.47634.log.gz 2024-09-12T18:03:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157424.log 2024-09-12T18:03:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.139753.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139753.log.gz 2024-09-12T18:03:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141520.log 2024-09-12T18:03:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.157424.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.157424.log.gz 2024-09-12T18:03:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48223.log 2024-09-12T18:03:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.141520.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.141520.log.gz 2024-09-12T18:03:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189256.log 2024-09-12T18:03:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48223.log: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.48223.log.gz 2024-09-12T18:03:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T18:03:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.189256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189256.log.gz 2024-09-12T18:03:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39094.log 2024-09-12T18:03:23.457 INFO:teuthology.orchestra.run.smithi044.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.65111.log.gz 2024-09-12T18:03:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85560.log 2024-09-12T18:03:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39094.log.gz 2024-09-12T18:03:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184972.log 2024-09-12T18:03:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.85560.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.85560.log.gz 2024-09-12T18:03:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52394.log 2024-09-12T18:03:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.184972.log: 83.7% -- replaced with /var/log/ceph/ceph-client.0.184972.log.gz 2024-09-12T18:03:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109121.log 2024-09-12T18:03:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.52394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52394.log.gz 2024-09-12T18:03:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38625.log 2024-09-12T18:03:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109121.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.109121.log.gz 2024-09-12T18:03:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140931.log 2024-09-12T18:03:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38625.log.gz 2024-09-12T18:03:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191534.log 2024-09-12T18:03:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.140931.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.140931.log.gz 2024-09-12T18:03:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182536.log 2024-09-12T18:03:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.191534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191534.log.gz 2024-09-12T18:03:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54209.log 2024-09-12T18:03:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.182536.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.182536.log.gz 2024-09-12T18:03:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39066.log 2024-09-12T18:03:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54209.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.54209.log.gz 2024-09-12T18:03:23.459 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57743.log 2024-09-12T18:03:23.459 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39066.log.gz 2024-09-12T18:03:23.459 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109710.log 2024-09-12T18:03:23.459 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57743.log: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.57743.log.gz 2024-09-12T18:03:23.459 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.109710.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109710.log.gz 2024-09-12T18:03:23.680 INFO:teuthology.orchestra.run.smithi181.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T18:03:23.913 INFO:teuthology.orchestra.run.smithi181.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T18:03:24.147 INFO:teuthology.orchestra.run.smithi044.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T18:03:24.790 INFO:teuthology.orchestra.run.smithi044.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T18:03:26.566 INFO:teuthology.orchestra.run.smithi044.stderr: 93.3% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T18:03:29.940 INFO:teuthology.orchestra.run.smithi044.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T18:03:32.216 INFO:teuthology.orchestra.run.smithi181.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T18:03:32.500 INFO:teuthology.orchestra.run.smithi181.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T18:03:32.649 INFO:teuthology.orchestra.run.smithi044.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T18:03:32.795 INFO:teuthology.orchestra.run.smithi181.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T18:03:37.258 INFO:teuthology.orchestra.run.smithi044.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T18:03:40.010 INFO:teuthology.orchestra.run.smithi181.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T18:03:40.012 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-12T18:03:40.012 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m16.761s 2024-09-12T18:03:40.012 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m43.851s 2024-09-12T18:03:40.012 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m1.642s 2024-09-12T18:03:44.941 INFO:teuthology.orchestra.run.smithi044.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T18:03:44.943 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T18:03:44.943 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m21.729s 2024-09-12T18:03:44.943 INFO:teuthology.orchestra.run.smithi044.stderr:user 0m55.624s 2024-09-12T18:03:44.943 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m2.003s 2024-09-12T18:03:44.943 INFO:tasks.ceph:Archiving logs... 2024-09-12T18:03:44.944 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902725/remote/smithi044/log 2024-09-12T18:03:44.945 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:03:52.686 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902725/remote/smithi181/log 2024-09-12T18:03:52.687 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:03:58.933 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T18:03:58.947 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T18:03:58.947 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:03:58.950 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:03:59.044 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T18:03:59.055 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T18:03:59.055 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:03:59.058 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:03:59.087 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-09-12T18:03:59.089 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-09-12T18:03:59.091 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T18:03:59.091 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-09-12T18:03:59.091 INFO:teuthology.orchestra.run.smithi044.stdout:^* hv01.front.sepia.ceph.com 3 6 377 38 +792us[ +787us] +/- 44ms 2024-09-12T18:03:59.091 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 35 -164us[ -164us] +/- 57ms 2024-09-12T18:03:59.092 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -1464us[-1464us] +/- 88ms 2024-09-12T18:03:59.092 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T18:03:59.094 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T18:03:59.094 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-09-12T18:03:59.095 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv01.front.sepia.ceph.com 3 6 377 38 +817us[ +802us] +/- 44ms 2024-09-12T18:03:59.095 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 -131us[ -131us] +/- 57ms 2024-09-12T18:03:59.095 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 -1445us[-1445us] +/- 88ms 2024-09-12T18:03:59.095 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T18:03:59.096 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T18:03:59.106 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T18:03:59.106 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T18:03:59.186 DEBUG:teuthology.orchestra.run.smithi044:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T18:03:59.272 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T18:03:59.353 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T18:03:59.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:03:59.396 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T18:03:59.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:03:59.438 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T18:03:59.449 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T18:03:59.532 INFO:teuthology.task.internal:Duration was 2856.215693 seconds 2024-09-12T18:03:59.533 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T18:03:59.557 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T18:03:59.557 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:03:59.560 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:03:59.612 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T18:03:59.613 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T18:04:00.057 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T18:04:00.057 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2024-09-12T18:04:00.057 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:04:00.093 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-09-12T18:04:00.094 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:04:00.136 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T18:04:00.136 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:04:00.139 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:04:00.217 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T18:04:00.217 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:04:00.221 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:04:00.368 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T18:04:00.380 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T18:04:00.380 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:04:00.419 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:04:00.459 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T18:04:00.470 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:04:00.472 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:04:00.507 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2024-09-12T18:04:00.535 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-09-12T18:04:00.559 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:04:00.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:04:00.594 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:04:00.626 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:04:00.627 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T18:04:00.638 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T18:04:00.639 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902725/remote/smithi044 2024-09-12T18:04:00.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:04:00.690 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902725/remote/smithi181 2024-09-12T18:04:00.690 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:04:00.736 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T18:04:00.736 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:04:00.738 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:04:00.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T18:04:00.812 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T18:04:00.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T18:04:00.852 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T18:04:00.853 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:04:00.855 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:04:00.882 INFO:teuthology.orchestra.run.smithi044.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:04 /home/ubuntu/cephtest 2024-09-12T18:04:00.884 INFO:teuthology.orchestra.run.smithi181.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:04 /home/ubuntu/cephtest 2024-09-12T18:04:00.885 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T18:04:00.897 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T18:04:01.028 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 2856.2156929969788 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T18:04:01.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T18:04:01.145 INFO:teuthology.run:pass